-- Logs begin at Sat 2022-10-08 20:01:32 UTC, end at Sat 2022-10-08 22:27:00 UTC. -- Oct 08 20:33:44.005522 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Oct 08 20:33:44.013439 ncdv-master-1 devstack@keystone.service[99073]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 8 20:33:44 2022] *** Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: nodename: ncdv-master-1 Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: machine: x86_64 Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: clock source: unix Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: pcre jit disabled Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: detected number of CPU cores: 4 Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: current working directory: / Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: detected binary path: /usr/bin/uwsgi-core Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: your processes number limit is 47680 Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: your memory page size is 4096 bytes Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: detected max file descriptor number: 2048 Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: lock engine: pthread robust mutexes Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: thunder lock: enabled Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 08 20:33:44.017016 ncdv-master-1 devstack@keystone.service[99073]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 08 20:33:44.060401 ncdv-master-1 devstack@keystone.service[99073]: Python main interpreter initialized at 0x55d963a339c0 Oct 08 20:33:44.060401 ncdv-master-1 devstack@keystone.service[99073]: python threads support enabled Oct 08 20:33:44.060401 ncdv-master-1 devstack@keystone.service[99073]: your server socket listen backlog is limited to 100 connections Oct 08 20:33:44.060401 ncdv-master-1 devstack@keystone.service[99073]: your mercy for graceful operations on workers is 90 seconds Oct 08 20:33:44.060774 ncdv-master-1 devstack@keystone.service[99073]: mapped 403077 bytes (393 KB) for 2 cores Oct 08 20:33:44.060860 ncdv-master-1 devstack@keystone.service[99073]: *** Operational MODE: preforking *** Oct 08 20:33:44.061061 ncdv-master-1 devstack@keystone.service[99073]: *** uWSGI is running in multiple interpreter mode *** Oct 08 20:33:44.061061 ncdv-master-1 devstack@keystone.service[99073]: spawned uWSGI master process (pid: 99073) Oct 08 20:33:44.061289 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Oct 08 20:33:44.062379 ncdv-master-1 devstack@keystone.service[99073]: spawned uWSGI worker 1 (pid: 99084, cores: 1) Oct 08 20:33:44.062379 ncdv-master-1 devstack@keystone.service[99073]: spawned uWSGI worker 2 (pid: 99085, cores: 1) Oct 08 20:33:44.062379 ncdv-master-1 devstack@keystone.service[99073]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 08 20:33:48.686752 ncdv-master-1 devstack@keystone.service[99085]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:33:48.686752 ncdv-master-1 devstack@keystone.service[99085]: from cryptography.utils import int_from_bytes Oct 08 20:33:48.687554 ncdv-master-1 devstack@keystone.service[99084]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:33:48.687554 ncdv-master-1 devstack@keystone.service[99084]: from cryptography.utils import int_from_bytes Oct 08 20:33:48.687964 ncdv-master-1 devstack@keystone.service[99085]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:33:48.687964 ncdv-master-1 devstack@keystone.service[99085]: from cryptography.utils import int_from_bytes Oct 08 20:33:48.688072 ncdv-master-1 devstack@keystone.service[99084]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:33:48.688072 ncdv-master-1 devstack@keystone.service[99084]: from cryptography.utils import int_from_bytes Oct 08 20:33:48.737708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 08 20:33:48.737868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 08 20:33:48.737948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 08 20:33:48.738022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] command line args: [] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 08 20:33:48.738086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 08 20:33:48.738225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] command line args: [] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 08 20:33:48.738317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 08 20:33:48.738441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ================================================================================ {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 08 20:33:48.738530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 08 20:33:48.738649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ================================================================================ {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 08 20:33:48.738725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] admin_token = **** {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.738907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] admin_token = **** {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.738991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] config_dir = [] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.739098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.739180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] config_dir = [] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.739283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] config_source = [] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.739366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.739470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] debug = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.739554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] config_source = [] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.739669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.739934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] debug = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.739934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.740073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.740137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.740199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] insecure_debug = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.740260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] insecure_debug = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.740442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.740559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.740690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.740799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.740923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] list_limit = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.741041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] list_limit = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.741142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] log_config_append = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.741281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] log_config_append = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.741385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.741494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.741609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] log_dir = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.741710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] log_dir = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.741811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] log_file = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.741914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] log_file = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.742016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.742117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.742211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.742289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.742438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.742524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.742601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.742678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.742753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.742870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.742954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.743076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.743156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.743276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.743390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.743481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.743609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.743690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.743810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.743888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.744078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.744159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.744313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.744399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.744559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.744647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.744803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] notification_format = cadf {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.744880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] notification_format = cadf {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.745080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.745163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.745712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.745796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.745917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] publish_errors = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.746030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] publish_errors = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.746136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.746274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.746360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.746435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.746555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.746634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.746752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.746847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.746984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.747067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.747223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] standard_threads = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.747306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] standard_threads = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.747458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] strict_password_check = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.747584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] strict_password_check = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.747699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.747812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.747890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] use_eventlog = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.747964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] use_eventlog = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.748082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] use_journal = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.748154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] use_journal = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.748274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] use_json = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.748353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] use_json = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.748428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] use_stderr = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.748496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] use_stderr = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.748573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] use_syslog = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.748642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] use_syslog = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.748751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] watch_log_file = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.748827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] watch_log_file = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:33:48.749010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.749098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.749276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.749368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.749541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.749617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.749784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.749865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.750035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.750117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.750275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.750356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.750528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.750602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.750765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.750841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.751015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.751096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.751265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.751340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.751518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.751592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.751758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.751832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.752009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.752083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.752247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.752330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.752492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.752574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.752741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.752817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.752980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.753055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.753255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.753343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.753515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.753600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.753764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.753847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.754003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.754083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.754255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.754336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.754518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.754595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.754774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.754849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.755020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.755102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.755253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.755329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.755484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.755558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.755878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.756010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.756114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.756215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.756316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.756411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.756505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.756606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.756709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.756811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.756914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.757032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.757105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.757259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.757340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.757462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.757570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.757646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.757819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.757906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.758051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.758143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.758287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.758370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.758524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.758605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.758754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.758835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.758986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.759071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.759740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.759895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.759967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.760034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.760196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.760276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.760446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.760541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.760678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.760795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.760914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.760995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.761144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.761290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.761406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.761482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.761642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.761721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.761891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.761981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.762124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.762199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.762359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.762443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.762595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.762681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.762833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.762908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.763066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.763150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.763303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.763389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.763539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.763658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.763788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.763884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.764025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.764102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.764258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.764333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.764491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.764627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.764763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.764898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.765035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.765162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.765303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.765376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.765444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.765511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.765660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.765739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.765926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.766006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.766164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.766240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.766412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.766490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.766657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.766739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.766892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.766974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.767128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.767206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.767365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.767440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.767610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.enabled = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.767694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.enabled = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.767847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.767929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.768083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.768159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.768325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.768408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.768561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.768638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.768806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.768883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.769043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.769124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.769301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.769383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.769537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.769621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.769773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.769850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.770008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.770086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.770268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.770351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.770510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.770624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.770760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.770878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.770998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.771075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.771236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.771312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.771477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.771555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.771715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.771790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.771949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.772034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.772186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.772272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.772415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.772491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.772647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.772725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.772877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.772960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.773109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.773203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.773363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.773440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.773608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.773728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.773842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.773930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.774090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.774167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.774325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.774410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.774582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.774667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.775389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.775644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.775883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] auth.external = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.776118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] auth.mapped = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.776204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.776418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.776504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.776656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.776741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] auth.external = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.776890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] auth.password = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.776973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] auth.mapped = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.777126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] auth.token = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.777225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.777397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.777475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.777639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] catalog.caching = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.777718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] auth.password = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.777883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] auth.token = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.777960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.778118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.778193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.778355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] catalog.caching = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.778437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.778604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.778687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.778838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.778920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.779079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] credential.caching = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.779165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.779326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.779409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] credential.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.779560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.779638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.779799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] credential.caching = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.779876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.780049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] credential.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.780127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.780295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.780371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.780533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.780617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.780784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.780866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.781029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.781122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.781290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.781380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.781541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.781626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.781795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.781897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.782031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.782146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.782291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.782411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.782574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.782652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.782819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.782897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.783082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.783160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] federation.caching = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.783325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.783402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.783581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.783701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] federation.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.783818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] federation.caching = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.783897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.784050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.784126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.784293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] federation.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.784370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.784533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.784610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.784762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.784838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.785010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.785096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.785270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.785353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.785525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.785601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.785760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.785847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.786009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.caching = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.786086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.786243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.786319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.786490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.786638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.786712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.786781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.caching = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.786955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.787032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.787201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.787285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.787434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.787510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.787670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.787746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.787918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.788002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.788150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.788228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.788387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.788464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.788618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.788701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.788853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.788931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.789091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.789167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.789345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.789434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.789576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.789653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.789820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.789897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.790067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.790153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.790314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.790414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.790612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.790694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.790859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.790944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.791094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.791171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.791334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.791412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.791566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.791650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.791795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.791871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.792031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.792108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.792267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.792352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.792502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.792579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.792737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.792813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.792973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.793057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.793245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.793329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.793471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.793548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.793717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.793822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.793962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.794039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.794196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.794273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.794435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.794519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.794671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.password = **** {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.794748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.794898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.794974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.795133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.795217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.795364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.password = **** {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.795446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.795602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.795717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.795836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.795913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.796075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.796151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.796311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.796388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.796547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.796624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.796783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.796860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.797027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.797103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.797281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.797362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.797514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.797591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.797755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.797874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.797996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.798076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.798228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.798304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.798463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.798539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.798698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.798776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.798928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.799011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.799165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.799242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.799416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.799492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.799646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.799723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.799891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.799967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.800124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.800202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.800363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.800440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.800593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.800670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.800822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.800906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.801053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.801129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.801309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.801390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.801561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.801640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.801792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.801869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.802037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.802114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.802287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.802364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.802523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.802600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.802766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.802843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.803004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.803081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.803233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.803309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.803472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.803547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.803706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.803784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.803942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.804074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.804208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.804335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.804480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.804606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.804730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.804855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] policy.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.804981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.805106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.805261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.805385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.805510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] policy.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.805635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.805760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.805884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] receipt.caching = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.806509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.806634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.806771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.806902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.807028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] receipt.caching = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.807152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.807284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.807407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.807532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.807656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.807781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.807905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] resource.caching = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.808037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.808163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.808287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.808411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] resource.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.808544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] resource.caching = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.808668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.808800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.808924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.809048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] resource.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.809174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.809339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.809464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] revoke.caching = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.809598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.809724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.809849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.809973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.810096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] revoke.caching = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.810222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] role.cache_time = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.810427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.810553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] role.caching = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.810678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.810803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] role.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.810928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] role.cache_time = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.811053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] role.list_limit = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.811185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] role.caching = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.811313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.811438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] role.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.811562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.811687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] role.list_limit = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.811822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.811948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.812103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.812224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.812351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.812476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.812608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.812734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.812858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.812983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.813108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.813247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.813377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.813505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.813630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.813765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.813891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.814018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.814147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.814269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.814391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.814513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.814513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.814741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.814869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.814991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.814991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.815225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.815356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.815479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.815607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.815729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.815850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.815971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.816091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.816212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.816340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.816462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.816462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.816690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.816811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.816939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.816939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.817179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.817331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.817456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.817593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.817727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.817727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.817967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.818092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.818216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.818341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.818473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.818599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.818737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.818863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.818989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.819144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.819292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] token.cache_time = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.819420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.819545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] token.caching = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.819671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] token.cache_time = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.819795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.819938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] token.caching = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] token.provider = fernet {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] token.provider = fernet {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.820937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.821006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] trust.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.821074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.821142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.821232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] trust.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.821361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.821437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.821506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.821575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.822264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.822340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.822418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.822489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.822558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.822635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.822713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.822784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.822860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.822938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.823009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.connection = **** {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.823137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.823264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.823403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.connection = **** {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.823514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.823645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.823758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.823892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.824003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.824130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.824242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.824370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.824482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.824605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.824725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.824839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.824964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.825073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.825256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.825398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.825476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.825547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.825702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.825780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.825941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.826027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.826192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.826270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.826430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.826513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.826678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.826763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.826914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.826992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.827144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.827221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.827382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.827466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.827557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 08 20:33:48.827636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:33:48.827773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 08 20:33:48.856815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.856968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.857046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.857226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.857377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.857521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.866194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.866286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.896138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.896271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.896402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.896511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.948450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.948579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.996993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.997176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.997283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:48.997516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.063184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.063413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.063539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.063624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.063775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.063858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.064005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.064086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.064228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.064310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.064446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.064662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.087814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.088047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.088131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.088273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.088356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.088496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.088577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.088717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.088806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.088935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.089016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.089149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.089259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.089412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.100265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.100511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.113066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.113325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.113525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.113624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.113766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.113848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.113983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.114063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.114217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.114300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.114415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.114492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.114630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.114844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:33:49.131469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.131678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 08 20:33:49.131925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.132007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.132140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 08 20:33:49.132236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 08 20:33:49.132470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.132551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.132674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 08 20:33:49.132754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.132952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.133034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.133238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.133321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.133504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.133761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.143341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.143622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.143895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.143975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.144181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.144274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.144468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.144756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.151299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.151800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.154220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.154505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.154727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.154806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.155016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.155097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.155305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.155386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.155572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.155652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.155839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.155931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.156111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.156191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.156379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.156457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.156652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.156730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.156919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.156997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.157223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.157487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.181634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.182430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.183104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.183390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.183907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.184195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.188083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.188368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.188650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.188883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.189170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.189476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.195179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.195468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.196030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.196319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.200187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.200485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.200786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.200994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.201076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.201319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.201403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.201621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.201701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.201903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.201994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.202191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.202270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.202473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.202772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.203050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.217911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.218199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.218799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.219085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.222083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.222990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.225328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.225628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.226279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.226580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.230393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.231370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.233647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.234556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.237145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.237466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.237754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.238049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.238130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.238330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.238420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.238611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.238692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.238929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.239220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.239499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.255117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.255379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.255648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.255850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.255932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.256160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.256434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.256703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.262829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.263600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.264369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.265154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.265942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.266229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.266716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.267006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.268867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.269160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.269487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.269660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.269774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.269956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.270159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.270240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.270518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.270923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.281491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.281777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.282068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.282149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.282363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.282503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.282711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.282792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.282998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.283079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.283289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.283370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.283662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.283953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.299203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.299950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.302146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.302916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.305132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.305862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.307129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.307851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.308605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.308896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.309332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.309415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.309657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.310056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.315681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.316448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.317169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.317980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.320070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.320883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.321324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.321653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.321939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.322171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.322464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.322747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.329791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.330080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.330361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.330681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.330977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.331264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.337324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=99085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.337608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.337888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.338161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.338240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=99084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:33:49.338441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.338522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.338712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.338808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.338984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.339073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.339262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.339352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.339580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.339667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.339857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.339945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.340125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.340204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.340399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.340479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.340661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.340748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.340918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=99085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.340997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.341206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.341487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.341750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=99084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:33:49.376168 ncdv-master-1 devstack@keystone.service[99084]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d963a339c0 pid: 99084 (default app) Oct 08 20:33:49.376702 ncdv-master-1 devstack@keystone.service[99085]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d963a339c0 pid: 99085 (default app) Oct 08 20:33:49.379434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb2c0c-d664-4f0d-bb34-0c5c4cc8445c None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:49.379735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb2c0c-d664-4f0d-bb34-0c5c4cc8445c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:49.380013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb2c0c-d664-4f0d-bb34-0c5c4cc8445c None None] PATH_INFO: `/v3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:49.384228 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Sat Oct 8 20:33:49 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:56.605975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb0b45-cac4-49d7-8f3c-faf4c3da34c0 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:56.606527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb0b45-cac4-49d7-8f3c-faf4c3da34c0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:56.606527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb0b45-cac4-49d7-8f3c-faf4c3da34c0 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:56.611023 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:33:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:33:56.616320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a3870-1c0d-4dc0-aac3-ca3b361a613d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:56.616746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a3870-1c0d-4dc0-aac3-ca3b361a613d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:56.616881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a3870-1c0d-4dc0-aac3-ca3b361a613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:56.693849 ncdv-master-1 devstack@keystone.service[99084]: INFO dbcounter [None req-c44a3870-1c0d-4dc0-aac3-ca3b361a613d None None] Registered counter for database keystone Oct 08 20:33:56.713623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG oslo_db.sqlalchemy.engines [None req-c44a3870-1c0d-4dc0-aac3-ca3b361a613d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:33:56.720009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writer thread running {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:33:56.896798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG passlib.handlers.bcrypt [None req-c44a3870-1c0d-4dc0-aac3-ca3b361a613d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=99084) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 08 20:33:56.897119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG passlib.handlers.bcrypt [None req-c44a3870-1c0d-4dc0-aac3-ca3b361a613d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=99084) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 08 20:33:56.955131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c44a3870-1c0d-4dc0-aac3-ca3b361a613d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:56.956706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c44a3870-1c0d-4dc0-aac3-ca3b361a613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:57.083903 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 08 20:33:57.567344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb0b45-cac4-49d7-8f3c-faf4c3da34c0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:57.643886 ncdv-master-1 devstack@keystone.service[99085]: INFO dbcounter [None req-a9cb0b45-cac4-49d7-8f3c-faf4c3da34c0 None None] Registered counter for database keystone Oct 08 20:33:57.666371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG oslo_db.sqlalchemy.engines [None req-a9cb0b45-cac4-49d7-8f3c-faf4c3da34c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:33:57.672616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writer thread running {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:33:57.789809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb0b45-cac4-49d7-8f3c-faf4c3da34c0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:57.794569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4b9ea-6ea1-4d84-ac98-c9cc647443c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:57.795200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4b9ea-6ea1-4d84-ac98-c9cc647443c8 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.795478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4b9ea-6ea1-4d84-ac98-c9cc647443c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.795772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4b9ea-6ea1-4d84-ac98-c9cc647443c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.804047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4b9ea-6ea1-4d84-ac98-c9cc647443c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:57.855858 ncdv-master-1 devstack@keystone.service[99085]: WARNING keystone.common.rbac_enforcer.enforcer [None req-98b4b9ea-6ea1-4d84-ac98-c9cc647443c8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 08 20:33:57.856235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4b9ea-6ea1-4d84-ac98-c9cc647443c8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:57.866720 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Sat Oct 8 20:33:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:33:57.872704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a3870-1c0d-4dc0-aac3-ca3b361a613d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:57.889675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a3870-1c0d-4dc0-aac3-ca3b361a613d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:57.894034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936a5c7-5854-4596-98f7-18bc9be444ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:57.895124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936a5c7-5854-4596-98f7-18bc9be444ee admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.895401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936a5c7-5854-4596-98f7-18bc9be444ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.895667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936a5c7-5854-4596-98f7-18bc9be444ee admin admin] PATH_INFO: `/v3/projects/8cbdca763b15498ebcee722600237097` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.897104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936a5c7-5854-4596-98f7-18bc9be444ee admin admin] RBAC: Authorizing `identity:get_project(project_id=8cbdca763b15498ebcee722600237097)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:57.947768 ncdv-master-1 devstack@keystone.service[99084]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a936a5c7-5854-4596-98f7-18bc9be444ee admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 08 20:33:57.948106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936a5c7-5854-4596-98f7-18bc9be444ee admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:57.952621 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Sat Oct 8 20:33:57 2022] GET /identity/v3/projects/8cbdca763b15498ebcee722600237097 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:00.288369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade721b-e537-42de-87b8-5e9ec86ce7ec None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.288909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade721b-e537-42de-87b8-5e9ec86ce7ec None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.288909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade721b-e537-42de-87b8-5e9ec86ce7ec None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.293753 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:00.299118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b578-60f1-42f5-8395-3dbcdc18967f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.299516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b578-60f1-42f5-8395-3dbcdc18967f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.299673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b578-60f1-42f5-8395-3dbcdc18967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.319167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-06b5b578-60f1-42f5-8395-3dbcdc18967f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:00.320662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-06b5b578-60f1-42f5-8395-3dbcdc18967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:00.328323 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 08 20:34:00.647422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade721b-e537-42de-87b8-5e9ec86ce7ec None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.659982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade721b-e537-42de-87b8-5e9ec86ce7ec None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.664165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0099195-f108-4532-bbc1-aa53d7cd592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.664756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0099195-f108-4532-bbc1-aa53d7cd592b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.665036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0099195-f108-4532-bbc1-aa53d7cd592b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.665342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0099195-f108-4532-bbc1-aa53d7cd592b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.672872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0099195-f108-4532-bbc1-aa53d7cd592b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.674687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0099195-f108-4532-bbc1-aa53d7cd592b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.683432 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Sat Oct 8 20:34:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:34:00.688653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5b578-60f1-42f5-8395-3dbcdc18967f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.698080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5b578-60f1-42f5-8395-3dbcdc18967f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.702372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f827a2-18c0-427b-89c1-90a6d0d786b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.702981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f827a2-18c0-427b-89c1-90a6d0d786b3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.703257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f827a2-18c0-427b-89c1-90a6d0d786b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.703528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f827a2-18c0-427b-89c1-90a6d0d786b3 admin admin] PATH_INFO: `/v3/users/1a6e50d0928e4f92987cd089e6138f36` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.704800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f827a2-18c0-427b-89c1-90a6d0d786b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=1a6e50d0928e4f92987cd089e6138f36)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.706621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f827a2-18c0-427b-89c1-90a6d0d786b3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.708099 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Sat Oct 8 20:34:00 2022] GET /identity/v3/users/1a6e50d0928e4f92987cd089e6138f36 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:03.139048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20847b67-5c48-4661-95b8-ef65fc3e1bb7 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.139621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20847b67-5c48-4661-95b8-ef65fc3e1bb7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.139621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20847b67-5c48-4661-95b8-ef65fc3e1bb7 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.140918 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:03.146015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e01bd7-0492-4c83-ba7e-72620cf4eb74 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.146391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e01bd7-0492-4c83-ba7e-72620cf4eb74 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.146572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e01bd7-0492-4c83-ba7e-72620cf4eb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.165830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-64e01bd7-0492-4c83-ba7e-72620cf4eb74 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:03.167015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-64e01bd7-0492-4c83-ba7e-72620cf4eb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:03.208515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4fde1-ffd0-41b0-81e9-e38f801c7830 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.208794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4fde1-ffd0-41b0-81e9-e38f801c7830 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.209068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4fde1-ffd0-41b0-81e9-e38f801c7830 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.210472 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:34:03.216490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cdcb2-85ea-4f55-ae01-c6ee8784ab44 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.216774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cdcb2-85ea-4f55-ae01-c6ee8784ab44 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.217054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cdcb2-85ea-4f55-ae01-c6ee8784ab44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.262994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG passlib.handlers.bcrypt [None req-9d7cdcb2-85ea-4f55-ae01-c6ee8784ab44 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=99085) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 08 20:34:03.263389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG passlib.handlers.bcrypt [None req-9d7cdcb2-85ea-4f55-ae01-c6ee8784ab44 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=99085) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 08 20:34:03.312763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9d7cdcb2-85ea-4f55-ae01-c6ee8784ab44 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:03.314421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9d7cdcb2-85ea-4f55-ae01-c6ee8784ab44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:03.355312 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:03.413217 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:03.677368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e01bd7-0492-4c83-ba7e-72620cf4eb74 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:03.701514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:03.737207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cdcb2-85ea-4f55-ae01-c6ee8784ab44 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:03.782547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e01bd7-0492-4c83-ba7e-72620cf4eb74 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:03.820249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79dbe6-bc08-44b4-8d21-a03c89133beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:03.820922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79dbe6-bc08-44b4-8d21-a03c89133beb None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.821229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79dbe6-bc08-44b4-8d21-a03c89133beb None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.821510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79dbe6-bc08-44b4-8d21-a03c89133beb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.832750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79dbe6-bc08-44b4-8d21-a03c89133beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:03.838069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cdcb2-85ea-4f55-ae01-c6ee8784ab44 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:03.840346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-1e79dbe6-bc08-44b4-8d21-a03c89133beb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:03.842206 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:03.843112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:03.843918 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:03.843918 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:03.843918 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:03.843918 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:03.843918 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:03.843918 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:03.843918 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:03.843918 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:03.843918 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:03.843918 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:03.843918 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:03.843918 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:03.843918 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:34:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:03.849233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79dbe6-bc08-44b4-8d21-a03c89133beb None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:03.876589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f0309-18f3-40fb-b387-f72e2008e01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:03.877489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f0309-18f3-40fb-b387-f72e2008e01b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.877860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f0309-18f3-40fb-b387-f72e2008e01b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.878146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f0309-18f3-40fb-b387-f72e2008e01b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.931589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:03.945869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f0309-18f3-40fb-b387-f72e2008e01b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:03.947418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f0309-18f3-40fb-b387-f72e2008e01b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:03.951425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79dbe6-bc08-44b4-8d21-a03c89133beb None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:03.987782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028a994-cdcc-4840-b669-9fef1850e455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:03.988393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028a994-cdcc-4840-b669-9fef1850e455 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.988672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028a994-cdcc-4840-b669-9fef1850e455 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.988946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028a994-cdcc-4840-b669-9fef1850e455 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.989656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028a994-cdcc-4840-b669-9fef1850e455 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:03.989961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028a994-cdcc-4840-b669-9fef1850e455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:03.991336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028a994-cdcc-4840-b669-9fef1850e455 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.004889 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:04.010328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028a994-cdcc-4840-b669-9fef1850e455 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.046692 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:34:04.052131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f0309-18f3-40fb-b387-f72e2008e01b None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.054812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:04.109429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028a994-cdcc-4840-b669-9fef1850e455 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.142495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce349f-1c2d-4bd2-846e-2a4781258c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.143122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce349f-1c2d-4bd2-846e-2a4781258c4f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.143409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce349f-1c2d-4bd2-846e-2a4781258c4f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.143683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce349f-1c2d-4bd2-846e-2a4781258c4f None admin] PATH_INFO: `/v3/users/1a6e50d0928e4f92987cd089e6138f36` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.144819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce349f-1c2d-4bd2-846e-2a4781258c4f None admin] RBAC: Authorizing `identity:get_user(user_id=1a6e50d0928e4f92987cd089e6138f36)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.146306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce349f-1c2d-4bd2-846e-2a4781258c4f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.147871 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/users/1a6e50d0928e4f92987cd089e6138f36 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:04.151116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f0309-18f3-40fb-b387-f72e2008e01b None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.154661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce349f-1c2d-4bd2-846e-2a4781258c4f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.169640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:04.185034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6e01-3b3b-4913-86e7-ce5b7ba87818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.185861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6e01-3b3b-4913-86e7-ce5b7ba87818 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.186146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6e01-3b3b-4913-86e7-ce5b7ba87818 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.186422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6e01-3b3b-4913-86e7-ce5b7ba87818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.206192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a6e01-3b3b-4913-86e7-ce5b7ba87818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.207640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a6e01-3b3b-4913-86e7-ce5b7ba87818 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.257850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce349f-1c2d-4bd2-846e-2a4781258c4f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.294304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba13b80-8eb3-4e42-b7a7-17854f952bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.294958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba13b80-8eb3-4e42-b7a7-17854f952bb5 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.295241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba13b80-8eb3-4e42-b7a7-17854f952bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.295516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba13b80-8eb3-4e42-b7a7-17854f952bb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.296679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba13b80-8eb3-4e42-b7a7-17854f952bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.298210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba13b80-8eb3-4e42-b7a7-17854f952bb5 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.299812 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:04.306110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba13b80-8eb3-4e42-b7a7-17854f952bb5 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-2d0a6e01-3b3b-4913-86e7-ce5b7ba87818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:34:04.332289 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:04.333450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:34:04.334434 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:34:04.334434 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:04.334434 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:04.334434 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:34:04.340091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6e01-3b3b-4913-86e7-ce5b7ba87818 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.390712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:04.395424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:04.413381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba13b80-8eb3-4e42-b7a7-17854f952bb5 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.439028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6e01-3b3b-4913-86e7-ce5b7ba87818 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.445875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda4130-dd0f-4f9d-b07a-c7e287b5fcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.446969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda4130-dd0f-4f9d-b07a-c7e287b5fcb8 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.447249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda4130-dd0f-4f9d-b07a-c7e287b5fcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.447525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda4130-dd0f-4f9d-b07a-c7e287b5fcb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.448248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda4130-dd0f-4f9d-b07a-c7e287b5fcb8 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.domain.id=default, user.id=1a6e50d0928e4f92987cd089e6138f36) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:04.448552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda4130-dd0f-4f9d-b07a-c7e287b5fcb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.450017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda4130-dd0f-4f9d-b07a-c7e287b5fcb8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.456875 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/role_assignments?user.id=1a6e50d0928e4f92987cd089e6138f36&scope.domain.id=default&role.id=a409f81bd5744563a303a825783bed61 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:04.474860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4eb2c-5ee3-4f3f-bfea-806a85b19434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.475520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4eb2c-5ee3-4f3f-bfea-806a85b19434 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.475803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4eb2c-5ee3-4f3f-bfea-806a85b19434 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.476078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4eb2c-5ee3-4f3f-bfea-806a85b19434 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.476756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4eb2c-5ee3-4f3f-bfea-806a85b19434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:04.477064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4eb2c-5ee3-4f3f-bfea-806a85b19434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.478838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4eb2c-5ee3-4f3f-bfea-806a85b19434 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.498378 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:07.126785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9e1f6-6a4b-4c90-9cab-a4fb011de83e None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.127315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9e1f6-6a4b-4c90-9cab-a4fb011de83e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.127391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9e1f6-6a4b-4c90-9cab-a4fb011de83e None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.129031 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:07.134624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a9ce8-199c-4510-abbd-55281c5abae1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.135034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a9ce8-199c-4510-abbd-55281c5abae1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.135215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a9ce8-199c-4510-abbd-55281c5abae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.162459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bd4a9ce8-199c-4510-abbd-55281c5abae1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:07.163640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bd4a9ce8-199c-4510-abbd-55281c5abae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:07.219313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89479d-64bc-4023-8884-a4f463086408 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.219619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89479d-64bc-4023-8884-a4f463086408 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.219878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89479d-64bc-4023-8884-a4f463086408 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.221433 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 13/23] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:34:07.228802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fce811-eb8c-4abc-ae93-db5b260a329b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.229090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fce811-eb8c-4abc-ae93-db5b260a329b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.229411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fce811-eb8c-4abc-ae93-db5b260a329b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.257316 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 11/24] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:07.263723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-37fce811-eb8c-4abc-ae93-db5b260a329b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:07.264915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-37fce811-eb8c-4abc-ae93-db5b260a329b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:07.371811 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:07.779803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a9ce8-199c-4510-abbd-55281c5abae1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:07.827872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:07.899301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a9ce8-199c-4510-abbd-55281c5abae1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:07.943413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8832b0-5bf3-41de-b0b8-6905020f9b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:07.944065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8832b0-5bf3-41de-b0b8-6905020f9b73 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.944345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8832b0-5bf3-41de-b0b8-6905020f9b73 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.944615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8832b0-5bf3-41de-b0b8-6905020f9b73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.956554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8832b0-5bf3-41de-b0b8-6905020f9b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-5c8832b0-5bf3-41de-b0b8-6905020f9b73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:07.967686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:07.968535 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:07.969316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:07.969316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:07.969316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:07.969316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:07.969316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:07.969316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:07.969316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:07.969316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:07.969316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:07.969316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:07.969316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:07.969316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:07.969316 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 12/26] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:34:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:07.974579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fce811-eb8c-4abc-ae93-db5b260a329b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:08.075732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:08.107908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fce811-eb8c-4abc-ae93-db5b260a329b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.138289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8832b0-5bf3-41de-b0b8-6905020f9b73 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:08.195256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adef04-1b0b-4578-b326-cdda31424c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:08.195933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adef04-1b0b-4578-b326-cdda31424c82 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.196156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adef04-1b0b-4578-b326-cdda31424c82 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.197229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adef04-1b0b-4578-b326-cdda31424c82 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.197663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adef04-1b0b-4578-b326-cdda31424c82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:08.197967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adef04-1b0b-4578-b326-cdda31424c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:08.199369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adef04-1b0b-4578-b326-cdda31424c82 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:08.227376 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 15/27] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:08.238225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adef04-1b0b-4578-b326-cdda31424c82 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:08.271548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8832b0-5bf3-41de-b0b8-6905020f9b73 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.301588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:08.311056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207587b-c376-4fc8-8bf4-367df44da73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:08.311757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207587b-c376-4fc8-8bf4-367df44da73a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.312044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207587b-c376-4fc8-8bf4-367df44da73a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.312326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207587b-c376-4fc8-8bf4-367df44da73a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.324096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207587b-c376-4fc8-8bf4-367df44da73a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:08.325614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207587b-c376-4fc8-8bf4-367df44da73a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-2207587b-c376-4fc8-8bf4-367df44da73a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:34:08.341247 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:08.342125 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:34:08.342923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:34:08.342923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:08.342923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:08.342923 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 13/28] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:34:08.343951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360f78d-65bb-4841-b9a4-577833ed99fe None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.344392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360f78d-65bb-4841-b9a4-577833ed99fe None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.344675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360f78d-65bb-4841-b9a4-577833ed99fe None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.346130 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 14/29] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:08.347285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aead0-ee71-49ed-a69c-875bad2ff983 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.347468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aead0-ee71-49ed-a69c-875bad2ff983 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.348072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aead0-ee71-49ed-a69c-875bad2ff983 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.349373 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 15/30] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:08.352059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3b08b-6dd9-40c5-9da5-16e3a58cd6fd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.352437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3b08b-6dd9-40c5-9da5-16e3a58cd6fd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.353044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3b08b-6dd9-40c5-9da5-16e3a58cd6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.380451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0ed3b08b-6dd9-40c5-9da5-16e3a58cd6fd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:08.381859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0ed3b08b-6dd9-40c5-9da5-16e3a58cd6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:08.408811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adef04-1b0b-4578-b326-cdda31424c82 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.456474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c6758-373c-495d-a21a-29f214182fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:08.457130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6758-373c-495d-a21a-29f214182fe7 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.457442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6758-373c-495d-a21a-29f214182fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.457717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6758-373c-495d-a21a-29f214182fe7 None admin] PATH_INFO: `/v3/users/1a6e50d0928e4f92987cd089e6138f36` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.459056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c6758-373c-495d-a21a-29f214182fe7 None admin] RBAC: Authorizing `identity:get_user(user_id=1a6e50d0928e4f92987cd089e6138f36)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:08.460529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c6758-373c-495d-a21a-29f214182fe7 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:08.462576 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 16/31] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:08 2022] GET /identity/v3/users/1a6e50d0928e4f92987cd089e6138f36 => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:08.463645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c6758-373c-495d-a21a-29f214182fe7 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:08.468505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:08.490868 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 16/32] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:08.492438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b939f19-ed12-41ab-bd11-080bb20e387e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.492869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b939f19-ed12-41ab-bd11-080bb20e387e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.493859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b939f19-ed12-41ab-bd11-080bb20e387e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.515131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4b939f19-ed12-41ab-bd11-080bb20e387e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:08.517277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4b939f19-ed12-41ab-bd11-080bb20e387e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:08.600016 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 17/33] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:08.601588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b939f19-ed12-41ab-bd11-080bb20e387e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:08.626479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:08.659141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c6758-373c-495d-a21a-29f214182fe7 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.735847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b939f19-ed12-41ab-bd11-080bb20e387e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.771122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29492da7-4a75-4e8b-9f4a-9dda52d410c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:08.771747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492da7-4a75-4e8b-9f4a-9dda52d410c1 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.772026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492da7-4a75-4e8b-9f4a-9dda52d410c1 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.772297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492da7-4a75-4e8b-9f4a-9dda52d410c1 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.772952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492da7-4a75-4e8b-9f4a-9dda52d410c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:08.773277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492da7-4a75-4e8b-9f4a-9dda52d410c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:08.775310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492da7-4a75-4e8b-9f4a-9dda52d410c1 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:08.776388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54688828-6812-4db1-aa67-d0a694227a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:08.777587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54688828-6812-4db1-aa67-d0a694227a28 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.778073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54688828-6812-4db1-aa67-d0a694227a28 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.778549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54688828-6812-4db1-aa67-d0a694227a28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.780122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54688828-6812-4db1-aa67-d0a694227a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:08.781794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54688828-6812-4db1-aa67-d0a694227a28 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:08.783580 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 18/34] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:08.796615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54688828-6812-4db1-aa67-d0a694227a28 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:08.802742 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 17/35] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:08.808059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29492da7-4a75-4e8b-9f4a-9dda52d410c1 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:08.909022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:08.926251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:08.949868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29492da7-4a75-4e8b-9f4a-9dda52d410c1 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.957228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54688828-6812-4db1-aa67-d0a694227a28 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.985867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababa971-ebed-4e55-ad54-ff0cc4f96c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:08.986627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababa971-ebed-4e55-ad54-ff0cc4f96c04 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.987163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababa971-ebed-4e55-ad54-ff0cc4f96c04 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.987537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababa971-ebed-4e55-ad54-ff0cc4f96c04 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.988323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababa971-ebed-4e55-ad54-ff0cc4f96c04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:08.989907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababa971-ebed-4e55-ad54-ff0cc4f96c04 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:09.018031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc610f-bb90-4145-955d-1585678522b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:09.019294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc610f-bb90-4145-955d-1585678522b8 None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:09.020693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc610f-bb90-4145-955d-1585678522b8 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:09.021100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc610f-bb90-4145-955d-1585678522b8 None admin] PATH_INFO: `/v3/domains/default/users/1a6e50d0928e4f92987cd089e6138f36/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:09.030447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc610f-bb90-4145-955d-1585678522b8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1a6e50d0928e4f92987cd089e6138f36, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:09.032160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc610f-bb90-4145-955d-1585678522b8 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:09.154721 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 18/36] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:34:08 2022] POST /identity/v3/projects => generated 301 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:34:09.156388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143a94e-7454-408b-b5e5-0f7f8af827fe None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:09.156752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143a94e-7454-408b-b5e5-0f7f8af827fe None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:09.157144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143a94e-7454-408b-b5e5-0f7f8af827fe None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:09.158603 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 19/37] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:09.159479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143a94e-7454-408b-b5e5-0f7f8af827fe None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:09.164227 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 19/38] 10.222.0.26 () {58 vars in 1361 bytes} [Sat Oct 8 20:34:08 2022] PUT /identity/v3/domains/default/users/1a6e50d0928e4f92987cd089e6138f36/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:34:09.166902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c180fc-fe8f-4458-9094-986f02307395 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:09.167201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c180fc-fe8f-4458-9094-986f02307395 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:09.167485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c180fc-fe8f-4458-9094-986f02307395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:09.193462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-70c180fc-fe8f-4458-9094-986f02307395 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:09.195385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-70c180fc-fe8f-4458-9094-986f02307395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:09.284400 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 20/39] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:09.287117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7c73d-70bd-421d-8ca4-7a790d3cc4fb None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:09.287980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7c73d-70bd-421d-8ca4-7a790d3cc4fb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:09.288671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7c73d-70bd-421d-8ca4-7a790d3cc4fb None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:09.294685 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 21/40] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:09.295919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7c73d-70bd-421d-8ca4-7a790d3cc4fb None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:09.301123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143a94e-7454-408b-b5e5-0f7f8af827fe None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:09.337060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:09.376214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0bc68-cac6-44e8-8524-8c2e3ac3ed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:09.376966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0bc68-cac6-44e8-8524-8c2e3ac3ed45 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:09.377270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0bc68-cac6-44e8-8524-8c2e3ac3ed45 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:09.377550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0bc68-cac6-44e8-8524-8c2e3ac3ed45 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:09.378477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0bc68-cac6-44e8-8524-8c2e3ac3ed45 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:09.380235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0bc68-cac6-44e8-8524-8c2e3ac3ed45 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:09.413372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:09.422374 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Oct 8 20:34:09 2022] POST /identity/v3/roles => generated 225 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:09.423908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa23e91-2257-4706-9235-422d2785f823 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:09.424347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa23e91-2257-4706-9235-422d2785f823 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:09.424759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa23e91-2257-4706-9235-422d2785f823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:09.444866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7c73d-70bd-421d-8ca4-7a790d3cc4fb None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:09.464496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-afa23e91-2257-4706-9235-422d2785f823 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:09.466529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-afa23e91-2257-4706-9235-422d2785f823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:09.503509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ee706-5304-4c60-a9e7-94077a68db81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:09.504180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ee706-5304-4c60-a9e7-94077a68db81 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:09.504464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ee706-5304-4c60-a9e7-94077a68db81 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:09.504741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ee706-5304-4c60-a9e7-94077a68db81 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:09.505679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ee706-5304-4c60-a9e7-94077a68db81 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:09.507067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ee706-5304-4c60-a9e7-94077a68db81 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:09.527197 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Oct 8 20:34:09 2022] POST /identity/v3/roles => generated 219 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:09.582313 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:09.761517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ee706-5304-4c60-a9e7-94077a68db81 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:09.881872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ee706-5304-4c60-a9e7-94077a68db81 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:09.918930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c8346-55eb-463c-aec5-8cd6471c3310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:09.919637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8346-55eb-463c-aec5-8cd6471c3310 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:09.919926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8346-55eb-463c-aec5-8cd6471c3310 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:09.920255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8346-55eb-463c-aec5-8cd6471c3310 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:09.921455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c8346-55eb-463c-aec5-8cd6471c3310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:09.922976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c8346-55eb-463c-aec5-8cd6471c3310 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:09.924634 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 23/44] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:09.930252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa23e91-2257-4706-9235-422d2785f823 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:10.012580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c8346-55eb-463c-aec5-8cd6471c3310 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:10.017451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:10.043580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa23e91-2257-4706-9235-422d2785f823 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:10.053093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:10.084416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233ec58-1eb3-4783-9f01-c191e946a3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:10.085032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233ec58-1eb3-4783-9f01-c191e946a3ca None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:10.085348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233ec58-1eb3-4783-9f01-c191e946a3ca None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:10.085626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233ec58-1eb3-4783-9f01-c191e946a3ca None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:10.086295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233ec58-1eb3-4783-9f01-c191e946a3ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:10.088299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233ec58-1eb3-4783-9f01-c191e946a3ca None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:10.117071 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:34:09 2022] POST /identity/v3/projects => generated 312 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:34:10.128244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c8346-55eb-463c-aec5-8cd6471c3310 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:10.168873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159ab58-faa4-4719-a803-7925d27af276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:10.169726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159ab58-faa4-4719-a803-7925d27af276 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:10.169966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159ab58-faa4-4719-a803-7925d27af276 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:10.170259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159ab58-faa4-4719-a803-7925d27af276 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:10.170944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159ab58-faa4-4719-a803-7925d27af276 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:10.172346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159ab58-faa4-4719-a803-7925d27af276 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:10.188421 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Oct 8 20:34:10 2022] POST /identity/v3/roles => generated 223 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:34:11.791311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ffd3e-0cfc-4301-a5f0-2a72320b11c7 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.791806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ffd3e-0cfc-4301-a5f0-2a72320b11c7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.791806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ffd3e-0cfc-4301-a5f0-2a72320b11c7 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.793111 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 23/47] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:11.798808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09161f04-a7ab-4182-87e1-48d6d254add0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.799241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09161f04-a7ab-4182-87e1-48d6d254add0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.799405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09161f04-a7ab-4182-87e1-48d6d254add0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.820475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-09161f04-a7ab-4182-87e1-48d6d254add0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:11.821743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-09161f04-a7ab-4182-87e1-48d6d254add0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:11.878450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:11.887417 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:12.210468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ffd3e-0cfc-4301-a5f0-2a72320b11c7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:12.310173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ffd3e-0cfc-4301-a5f0-2a72320b11c7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.346008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ae21d-f485-4eac-8c6a-ff63c32d420c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.346645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ae21d-f485-4eac-8c6a-ff63c32d420c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.346928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ae21d-f485-4eac-8c6a-ff63c32d420c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.347200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ae21d-f485-4eac-8c6a-ff63c32d420c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.357675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ae21d-f485-4eac-8c6a-ff63c32d420c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-d36ae21d-f485-4eac-8c6a-ff63c32d420c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:12.362729 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:12.363600 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:12.364329 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:12.364329 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:12.364329 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:12.364329 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:12.364329 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:12.364329 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:12.364329 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:12.364329 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:12.364329 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:12.364329 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:12.364329 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:12.364329 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:12.364329 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 24/49] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:12.369620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09161f04-a7ab-4182-87e1-48d6d254add0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:12.467376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09161f04-a7ab-4182-87e1-48d6d254add0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.503226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b38fb-7be7-4422-b351-c85824e156e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.503842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b38fb-7be7-4422-b351-c85824e156e1 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.504123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b38fb-7be7-4422-b351-c85824e156e1 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.504394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b38fb-7be7-4422-b351-c85824e156e1 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.505055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b38fb-7be7-4422-b351-c85824e156e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:12.505445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b38fb-7be7-4422-b351-c85824e156e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:12.506811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b38fb-7be7-4422-b351-c85824e156e1 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:12.518919 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 26/50] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:12.525074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ae21d-f485-4eac-8c6a-ff63c32d420c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:12.545950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:12.558220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87934c99-82c5-46cc-ac89-517758fd9274 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.558516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87934c99-82c5-46cc-ac89-517758fd9274 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.558797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87934c99-82c5-46cc-ac89-517758fd9274 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.560139 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 27/51] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:34:12.565008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bd40d-78a4-4a0f-95da-e88df509ec63 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.565325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bd40d-78a4-4a0f-95da-e88df509ec63 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.565603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bd40d-78a4-4a0f-95da-e88df509ec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.583628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a12bd40d-78a4-4a0f-95da-e88df509ec63 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:12.584833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a12bd40d-78a4-4a0f-95da-e88df509ec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:12.629043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ae21d-f485-4eac-8c6a-ff63c32d420c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.636822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:12.656644 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 28/52] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:12.663820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820f495-fb90-4315-ab4f-cf6983cc53a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.664448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820f495-fb90-4315-ab4f-cf6983cc53a3 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.664725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820f495-fb90-4315-ab4f-cf6983cc53a3 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.665003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820f495-fb90-4315-ab4f-cf6983cc53a3 None admin] PATH_INFO: `/v3/users/1a6e50d0928e4f92987cd089e6138f36` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.666136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820f495-fb90-4315-ab4f-cf6983cc53a3 None admin] RBAC: Authorizing `identity:get_user(user_id=1a6e50d0928e4f92987cd089e6138f36)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:12.667569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820f495-fb90-4315-ab4f-cf6983cc53a3 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:12.669260 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 25/53] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/users/1a6e50d0928e4f92987cd089e6138f36 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:12.674391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bd40d-78a4-4a0f-95da-e88df509ec63 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:12.769507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bd40d-78a4-4a0f-95da-e88df509ec63 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.801758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf7ca6-9ec3-4b79-b766-c7dc5dd7c0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.802380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf7ca6-9ec3-4b79-b766-c7dc5dd7c0ad None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.802656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf7ca6-9ec3-4b79-b766-c7dc5dd7c0ad None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.802925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf7ca6-9ec3-4b79-b766-c7dc5dd7c0ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.804022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf7ca6-9ec3-4b79-b766-c7dc5dd7c0ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:12.805489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf7ca6-9ec3-4b79-b766-c7dc5dd7c0ad None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:12.807583 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 29/54] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:12.813215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820f495-fb90-4315-ab4f-cf6983cc53a3 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:12.895957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:12.910562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820f495-fb90-4315-ab4f-cf6983cc53a3 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.942384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed59e8-1f5f-4d03-9295-3a03a43748cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.942979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed59e8-1f5f-4d03-9295-3a03a43748cc None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.943261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed59e8-1f5f-4d03-9295-3a03a43748cc None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.943529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed59e8-1f5f-4d03-9295-3a03a43748cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.944244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed59e8-1f5f-4d03-9295-3a03a43748cc None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.domain.id=default, user.id=1a6e50d0928e4f92987cd089e6138f36) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:12.944548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed59e8-1f5f-4d03-9295-3a03a43748cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:12.946004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed59e8-1f5f-4d03-9295-3a03a43748cc None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:12.952024 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 26/55] 10.222.0.26 () {56 vars in 1322 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/role_assignments?user.id=1a6e50d0928e4f92987cd089e6138f36&scope.domain.id=default&role.id=a409f81bd5744563a303a825783bed61 => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:12.984013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf7ca6-9ec3-4b79-b766-c7dc5dd7c0ad None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:13.043875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:13.090712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf7ca6-9ec3-4b79-b766-c7dc5dd7c0ad None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:13.127834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f9a92-a165-48de-b6e4-a620bf3e4fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:13.128493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9a92-a165-48de-b6e4-a620bf3e4fde None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:13.128779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9a92-a165-48de-b6e4-a620bf3e4fde None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:13.129063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9a92-a165-48de-b6e4-a620bf3e4fde None admin] PATH_INFO: `/v3/domains/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:13.130238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f9a92-a165-48de-b6e4-a620bf3e4fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:13.131707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f9a92-a165-48de-b6e4-a620bf3e4fde None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:13.133345 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 30/56] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:13.139605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed59e8-1f5f-4d03-9295-3a03a43748cc None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:13.238804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed59e8-1f5f-4d03-9295-3a03a43748cc None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:13.271063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86e833-5d68-41d9-88f2-27741ca3415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:13.271661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86e833-5d68-41d9-88f2-27741ca3415d None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:13.271941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86e833-5d68-41d9-88f2-27741ca3415d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:13.272212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86e833-5d68-41d9-88f2-27741ca3415d None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:13.272844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86e833-5d68-41d9-88f2-27741ca3415d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:13.274312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86e833-5d68-41d9-88f2-27741ca3415d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:13.299485 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 27/57] 10.222.0.26 () {60 vars in 1140 bytes} [Sat Oct 8 20:34:13 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:15.663180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f09e0-4666-440a-9cd0-ba37fd6432a8 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:15.663679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f09e0-4666-440a-9cd0-ba37fd6432a8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:15.663762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f09e0-4666-440a-9cd0-ba37fd6432a8 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:15.665600 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 31/58] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:15.670743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c108-20e2-4034-b19c-dac9125a5ee5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:15.671126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c108-20e2-4034-b19c-dac9125a5ee5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:15.671301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c108-20e2-4034-b19c-dac9125a5ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:15.677584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:15.691350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6d88c108-20e2-4034-b19c-dac9125a5ee5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:15.692522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6d88c108-20e2-4034-b19c-dac9125a5ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:15.756427 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 28/59] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:16.080562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f09e0-4666-440a-9cd0-ba37fd6432a8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:16.185646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f09e0-4666-440a-9cd0-ba37fd6432a8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:16.208460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:16.220005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76201079-d2c0-46c3-9acb-834ce552fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:16.220637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76201079-d2c0-46c3-9acb-834ce552fe1d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:16.220921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76201079-d2c0-46c3-9acb-834ce552fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:16.221219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76201079-d2c0-46c3-9acb-834ce552fe1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:16.222330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76201079-d2c0-46c3-9acb-834ce552fe1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:16.223773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76201079-d2c0-46c3-9acb-834ce552fe1d None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:16.225343 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 32/60] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:16.231381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c108-20e2-4034-b19c-dac9125a5ee5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:16.326129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c108-20e2-4034-b19c-dac9125a5ee5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:16.354285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:16.359431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b05c29-07bd-4ee1-9277-374e968be2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:16.360024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b05c29-07bd-4ee1-9277-374e968be2a7 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:16.360301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b05c29-07bd-4ee1-9277-374e968be2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:16.360827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b05c29-07bd-4ee1-9277-374e968be2a7 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:16.361498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b05c29-07bd-4ee1-9277-374e968be2a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:16.362930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b05c29-07bd-4ee1-9277-374e968be2a7 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:16.388646 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 29/61] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:34:16 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:19.920043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697f0a1-af73-444a-b919-877e493bbfae None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:19.921030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697f0a1-af73-444a-b919-877e493bbfae None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:19.921557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697f0a1-af73-444a-b919-877e493bbfae None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:19.923103 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 33/62] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:19.928610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ff42a-2f98-44be-b992-55778654fe1d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:19.929458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ff42a-2f98-44be-b992-55778654fe1d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:19.929936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ff42a-2f98-44be-b992-55778654fe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:19.958209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8c9ff42a-2f98-44be-b992-55778654fe1d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:19.959767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8c9ff42a-2f98-44be-b992-55778654fe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:20.015900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbbf8d-809e-41ba-bb75-9c1ed62ca076 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:20.016540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbbf8d-809e-41ba-bb75-9c1ed62ca076 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:20.017018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbbf8d-809e-41ba-bb75-9c1ed62ca076 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:20.018572 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 34/63] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:34:20.023489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2cd72-e205-4527-a3ff-33765a5d08c9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:20.023997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2cd72-e205-4527-a3ff-33765a5d08c9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:20.024514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2cd72-e205-4527-a3ff-33765a5d08c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:20.056283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f3a2cd72-e205-4527-a3ff-33765a5d08c9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:20.058864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f3a2cd72-e205-4527-a3ff-33765a5d08c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:20.078274 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 30/64] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:20.165774 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 35/65] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:20.423177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c5d5e-eecb-48f9-a548-b9d3414d6b62 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:20.423881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c5d5e-eecb-48f9-a548-b9d3414d6b62 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:20.424361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c5d5e-eecb-48f9-a548-b9d3414d6b62 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:20.425944 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 31/66] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:20.431251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb660b-df20-4df9-91f7-f4da02bbb237 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:20.431537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb660b-df20-4df9-91f7-f4da02bbb237 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:20.431814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb660b-df20-4df9-91f7-f4da02bbb237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:20.454443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bcfb660b-df20-4df9-91f7-f4da02bbb237 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:20.455623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bcfb660b-df20-4df9-91f7-f4da02bbb237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:20.511692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c5d5e-eecb-48f9-a548-b9d3414d6b62 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:20.546809 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 36/67] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:20.547982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb660b-df20-4df9-91f7-f4da02bbb237 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:20.608996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:20.653724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c5d5e-eecb-48f9-a548-b9d3414d6b62 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:20.663986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb660b-df20-4df9-91f7-f4da02bbb237 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:20.675158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:20.696086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64660f1f-a450-4380-aaf3-9728491216dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:20.697744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64660f1f-a450-4380-aaf3-9728491216dc None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:20.698222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64660f1f-a450-4380-aaf3-9728491216dc None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:20.698949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64660f1f-a450-4380-aaf3-9728491216dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:20.706723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031a428-58ea-49b0-88ef-de305d07730f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:20.707801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031a428-58ea-49b0-88ef-de305d07730f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:20.708163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031a428-58ea-49b0-88ef-de305d07730f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:20.708513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031a428-58ea-49b0-88ef-de305d07730f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:20.711435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64660f1f-a450-4380-aaf3-9728491216dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-64660f1f-a450-4380-aaf3-9728491216dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:20.717681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:20.718486 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:20.719285 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:20.719285 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:20.719285 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:20.719285 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:20.719285 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:20.719285 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:20.719285 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:20.719285 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:20.719285 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:20.719285 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:20.719285 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:20.719285 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:20.720690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031a428-58ea-49b0-88ef-de305d07730f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-7031a428-58ea-49b0-88ef-de305d07730f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:20.725855 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:20.726696 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:20.727486 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:20.727486 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:20.727486 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:20.727486 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:20.727486 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:20.727486 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:20.727486 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:20.727486 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:20.727486 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:20.727486 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:20.727486 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:20.727486 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:20.728056 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 32/68] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:20.728815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e2ff7-6f4b-4b5d-a1e8-0a053775aa6d None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:20.729104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e2ff7-6f4b-4b5d-a1e8-0a053775aa6d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:20.729406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e2ff7-6f4b-4b5d-a1e8-0a053775aa6d None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:20.730421 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 37/69] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:34:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:20.735080 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 33/70] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:20.735201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031a428-58ea-49b0-88ef-de305d07730f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:20.736593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15d386-e9b3-4b9d-bc06-26dcaa0c144f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:20.736878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15d386-e9b3-4b9d-bc06-26dcaa0c144f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:20.737176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15d386-e9b3-4b9d-bc06-26dcaa0c144f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:20.757784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-df15d386-e9b3-4b9d-bc06-26dcaa0c144f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:20.759483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-df15d386-e9b3-4b9d-bc06-26dcaa0c144f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:20.840419 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 34/71] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:20.840419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15d386-e9b3-4b9d-bc06-26dcaa0c144f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:20.878850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031a428-58ea-49b0-88ef-de305d07730f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:20.894383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:20.927157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d55ed-9170-45ad-9874-39ab12edac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:20.928434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d55ed-9170-45ad-9874-39ab12edac88 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:20.928925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d55ed-9170-45ad-9874-39ab12edac88 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:20.929386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d55ed-9170-45ad-9874-39ab12edac88 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:20.930179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d55ed-9170-45ad-9874-39ab12edac88 None admin] RBAC: Adding query filter params (name=member) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:20.930681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d55ed-9170-45ad-9874-39ab12edac88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:20.932195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d55ed-9170-45ad-9874-39ab12edac88 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:20.940166 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 38/72] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:20.941470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dad2e-aac7-453d-847e-8e61472edd59 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:20.941754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dad2e-aac7-453d-847e-8e61472edd59 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:20.942027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dad2e-aac7-453d-847e-8e61472edd59 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:20.942463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15d386-e9b3-4b9d-bc06-26dcaa0c144f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:20.943214 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 39/73] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:20.943901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dad2e-aac7-453d-847e-8e61472edd59 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:20.953875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:20.979504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b8be8-ab4a-44a3-a314-f5cc4f952e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:20.980312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8be8-ab4a-44a3-a314-f5cc4f952e83 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:20.980753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8be8-ab4a-44a3-a314-f5cc4f952e83 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:20.981035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8be8-ab4a-44a3-a314-f5cc4f952e83 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:20.981741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b8be8-ab4a-44a3-a314-f5cc4f952e83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:20.982051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b8be8-ab4a-44a3-a314-f5cc4f952e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:20.983442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b8be8-ab4a-44a3-a314-f5cc4f952e83 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:20.991845 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 35/74] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:20.992471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b8be8-ab4a-44a3-a314-f5cc4f952e83 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:21.058169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dad2e-aac7-453d-847e-8e61472edd59 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:21.093459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064e190-3abd-4798-a34e-394d2d8e5f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:21.094088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064e190-3abd-4798-a34e-394d2d8e5f07 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:21.094370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064e190-3abd-4798-a34e-394d2d8e5f07 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:21.094642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064e190-3abd-4798-a34e-394d2d8e5f07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:21.106356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064e190-3abd-4798-a34e-394d2d8e5f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:21.107893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b8be8-ab4a-44a3-a314-f5cc4f952e83 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-d064e190-3abd-4798-a34e-394d2d8e5f07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:21.112307 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:21.113165 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:21.113977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:21.113977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:21.113977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:21.113977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:21.113977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:21.113977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:21.113977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:21.113977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:21.113977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:21.113977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:21.113977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:34:21.113977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:21.113977 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 40/75] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:21.117392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2ac14-f5c3-497b-8808-b1321a58fbeb None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:21.117673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2ac14-f5c3-497b-8808-b1321a58fbeb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:21.117947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2ac14-f5c3-497b-8808-b1321a58fbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:21.136983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b1e2ac14-f5c3-497b-8808-b1321a58fbeb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:21.138218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b1e2ac14-f5c3-497b-8808-b1321a58fbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:21.148302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092364a-0a84-41cd-be10-590c308151ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:21.149297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092364a-0a84-41cd-be10-590c308151ea None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:21.149748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092364a-0a84-41cd-be10-590c308151ea None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:21.150034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092364a-0a84-41cd-be10-590c308151ea None admin] PATH_INFO: `/v3/users/a6d309261b4e4134aae2ca007b31a433` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:21.163664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092364a-0a84-41cd-be10-590c308151ea None admin] RBAC: Authorizing `identity:get_user(user_id=a6d309261b4e4134aae2ca007b31a433)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:21.165243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092364a-0a84-41cd-be10-590c308151ea None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:21.166888 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 36/76] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:20 2022] GET /identity/v3/users/a6d309261b4e4134aae2ca007b31a433 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:21.167712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092364a-0a84-41cd-be10-590c308151ea None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:21.168614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:21.195442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:21.212121 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 41/77] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:21.212984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2ac14-f5c3-497b-8808-b1321a58fbeb None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:21.275049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092364a-0a84-41cd-be10-590c308151ea None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:21.310254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdc939-7de9-4da0-bbfb-841372a1df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:21.310958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdc939-7de9-4da0-bbfb-841372a1df0c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:21.311244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdc939-7de9-4da0-bbfb-841372a1df0c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:21.311512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdc939-7de9-4da0-bbfb-841372a1df0c None admin] PATH_INFO: `/v3/users/1a6e50d0928e4f92987cd089e6138f36` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:21.312653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdc939-7de9-4da0-bbfb-841372a1df0c None admin] RBAC: Authorizing `identity:get_user(user_id=1a6e50d0928e4f92987cd089e6138f36)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:21.314244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdc939-7de9-4da0-bbfb-841372a1df0c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:21.315794 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 37/78] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:21 2022] GET /identity/v3/users/1a6e50d0928e4f92987cd089e6138f36 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:21.316584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2ac14-f5c3-497b-8808-b1321a58fbeb None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:21.318273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdc939-7de9-4da0-bbfb-841372a1df0c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:21.352076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb557b-eedd-4d0e-9232-1015f52dbdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:21.352707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb557b-eedd-4d0e-9232-1015f52dbdf4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:21.352985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb557b-eedd-4d0e-9232-1015f52dbdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:21.353281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb557b-eedd-4d0e-9232-1015f52dbdf4 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:21.353941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb557b-eedd-4d0e-9232-1015f52dbdf4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:21.354242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb557b-eedd-4d0e-9232-1015f52dbdf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:21.355601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb557b-eedd-4d0e-9232-1015f52dbdf4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:21.364524 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 42/79] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:21.365337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb557b-eedd-4d0e-9232-1015f52dbdf4 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:21.393986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:21.426651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:21.433802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdc939-7de9-4da0-bbfb-841372a1df0c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:21.470049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63706bc1-8915-4326-a584-b7b4c97ae661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:21.470636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63706bc1-8915-4326-a584-b7b4c97ae661 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:21.470920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63706bc1-8915-4326-a584-b7b4c97ae661 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:21.471195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63706bc1-8915-4326-a584-b7b4c97ae661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:21.475830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb557b-eedd-4d0e-9232-1015f52dbdf4 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:21.516047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9f3c2-8963-4720-b474-717384fb4bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:21.516691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9f3c2-8963-4720-b474-717384fb4bcf None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:21.516976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9f3c2-8963-4720-b474-717384fb4bcf None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:21.517285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9f3c2-8963-4720-b474-717384fb4bcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:21.528534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9f3c2-8963-4720-b474-717384fb4bcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-d7e9f3c2-8963-4720-b474-717384fb4bcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:21.533899 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:21.534789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 43/80] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:21.537925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9f3c2-8963-4720-b474-717384fb4bcf None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:21.553304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63706bc1-8915-4326-a584-b7b4c97ae661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:21.554758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63706bc1-8915-4326-a584-b7b4c97ae661 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:21.620311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:21.636777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9f3c2-8963-4720-b474-717384fb4bcf None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:21.645372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:21.652900 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 38/81] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:21.653755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63706bc1-8915-4326-a584-b7b4c97ae661 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:21.670692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a46a4-7a5a-420b-b60d-ed43a0ec97d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:21.671517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a46a4-7a5a-420b-b60d-ed43a0ec97d5 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:21.671801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a46a4-7a5a-420b-b60d-ed43a0ec97d5 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:21.672079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a46a4-7a5a-420b-b60d-ed43a0ec97d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:21.739213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a46a4-7a5a-420b-b60d-ed43a0ec97d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:21.740611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a46a4-7a5a-420b-b60d-ed43a0ec97d5 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:21.750006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63706bc1-8915-4326-a584-b7b4c97ae661 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:21.784086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74974085-be61-4b07-92ea-84054970940a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:21.784723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74974085-be61-4b07-92ea-84054970940a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:21.785007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74974085-be61-4b07-92ea-84054970940a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:21.785312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74974085-be61-4b07-92ea-84054970940a None admin] PATH_INFO: `/v3/users/a6d309261b4e4134aae2ca007b31a433` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:21.786442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74974085-be61-4b07-92ea-84054970940a None admin] RBAC: Authorizing `identity:get_user(user_id=a6d309261b4e4134aae2ca007b31a433)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:21.787888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74974085-be61-4b07-92ea-84054970940a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:21.789500 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 39/82] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:21 2022] GET /identity/v3/users/a6d309261b4e4134aae2ca007b31a433 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:21.790751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74974085-be61-4b07-92ea-84054970940a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:21.826273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:21.843597 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 44/83] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:21.844570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a46a4-7a5a-420b-b60d-ed43a0ec97d5 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:21.857803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:21.896335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74974085-be61-4b07-92ea-84054970940a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:21.927767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170475c-ab97-4397-9b3c-744dcf8fd902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:21.928423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170475c-ab97-4397-9b3c-744dcf8fd902 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:21.928705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170475c-ab97-4397-9b3c-744dcf8fd902 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:21.928979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170475c-ab97-4397-9b3c-744dcf8fd902 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:21.930136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170475c-ab97-4397-9b3c-744dcf8fd902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:21.932110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170475c-ab97-4397-9b3c-744dcf8fd902 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:21.933689 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 40/84] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:21.938875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170475c-ab97-4397-9b3c-744dcf8fd902 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:21.945439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a46a4-7a5a-420b-b60d-ed43a0ec97d5 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:21.978720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76da83-b52b-48ec-90ce-4246c4e75897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:21.979317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76da83-b52b-48ec-90ce-4246c4e75897 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:21.979592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76da83-b52b-48ec-90ce-4246c4e75897 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:21.979863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76da83-b52b-48ec-90ce-4246c4e75897 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:21.980518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76da83-b52b-48ec-90ce-4246c4e75897 None admin] RBAC: Adding query filter params (name=member) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:21.980820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76da83-b52b-48ec-90ce-4246c4e75897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:21.982208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76da83-b52b-48ec-90ce-4246c4e75897 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:21.990195 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 45/85] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:21.990979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76da83-b52b-48ec-90ce-4246c4e75897 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:22.037151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:22.039963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170475c-ab97-4397-9b3c-744dcf8fd902 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:22.068310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:22.074366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d88fac-1ced-49f2-85e6-c8ff4487ed92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:22.074998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d88fac-1ced-49f2-85e6-c8ff4487ed92 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:22.075279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d88fac-1ced-49f2-85e6-c8ff4487ed92 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:22.075554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d88fac-1ced-49f2-85e6-c8ff4487ed92 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:22.076675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d88fac-1ced-49f2-85e6-c8ff4487ed92 None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:22.078137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d88fac-1ced-49f2-85e6-c8ff4487ed92 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:22.079760 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 41/86] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:21 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:22.080514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d88fac-1ced-49f2-85e6-c8ff4487ed92 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:22.091816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76da83-b52b-48ec-90ce-4246c4e75897 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:22.124785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508dabe-cc26-4cd5-ba5a-0e817cddef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:22.125419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508dabe-cc26-4cd5-ba5a-0e817cddef65 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:22.125700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508dabe-cc26-4cd5-ba5a-0e817cddef65 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:22.125974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508dabe-cc26-4cd5-ba5a-0e817cddef65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:22.176304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d88fac-1ced-49f2-85e6-c8ff4487ed92 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:22.192261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508dabe-cc26-4cd5-ba5a-0e817cddef65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:22.193745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508dabe-cc26-4cd5-ba5a-0e817cddef65 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:22.209179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf727f-fd4b-4aff-b076-7d4eb1eaef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:22.209825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf727f-fd4b-4aff-b076-7d4eb1eaef8a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:22.210108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf727f-fd4b-4aff-b076-7d4eb1eaef8a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:22.210385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf727f-fd4b-4aff-b076-7d4eb1eaef8a None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:22.211491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf727f-fd4b-4aff-b076-7d4eb1eaef8a None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:22.212935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf727f-fd4b-4aff-b076-7d4eb1eaef8a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:22.214570 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 42/87] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:22 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:22.215299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf727f-fd4b-4aff-b076-7d4eb1eaef8a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:22.237977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:22.281703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:22.292307 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 46/88] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:22.293148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508dabe-cc26-4cd5-ba5a-0e817cddef65 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:22.316654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf727f-fd4b-4aff-b076-7d4eb1eaef8a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:22.349074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436c6b0-9a99-42bd-a461-d206c82dfca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:22.349702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436c6b0-9a99-42bd-a461-d206c82dfca0 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:22.349983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436c6b0-9a99-42bd-a461-d206c82dfca0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:22.350256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436c6b0-9a99-42bd-a461-d206c82dfca0 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:22.350901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436c6b0-9a99-42bd-a461-d206c82dfca0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:22.352326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436c6b0-9a99-42bd-a461-d206c82dfca0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:22.373502 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 43/89] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:34:22 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:22.374311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436c6b0-9a99-42bd-a461-d206c82dfca0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:22.395360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508dabe-cc26-4cd5-ba5a-0e817cddef65 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:22.436633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe712a62-f23d-41de-b77c-afe9a5fbec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:22.437389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712a62-f23d-41de-b77c-afe9a5fbec89 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:22.437645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712a62-f23d-41de-b77c-afe9a5fbec89 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:22.437923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712a62-f23d-41de-b77c-afe9a5fbec89 None admin] PATH_INFO: `/v3/users/a6d309261b4e4134aae2ca007b31a433` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:22.439212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe712a62-f23d-41de-b77c-afe9a5fbec89 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d309261b4e4134aae2ca007b31a433)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:22.440704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe712a62-f23d-41de-b77c-afe9a5fbec89 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:22.442658 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 47/90] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:22 2022] GET /identity/v3/users/a6d309261b4e4134aae2ca007b31a433 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:22.448213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe712a62-f23d-41de-b77c-afe9a5fbec89 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:22.466031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:22.496774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436c6b0-9a99-42bd-a461-d206c82dfca0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:22.522589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:22.536727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445bd48-eec1-4109-b234-ea2e8dfc4bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:22.537279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445bd48-eec1-4109-b234-ea2e8dfc4bad None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:22.537563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445bd48-eec1-4109-b234-ea2e8dfc4bad None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:22.537835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445bd48-eec1-4109-b234-ea2e8dfc4bad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:22.538583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445bd48-eec1-4109-b234-ea2e8dfc4bad None admin] RBAC: Adding query filter params (role.id=27431c49ccd74f7a898d1a39e251ce29, scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc, user.id=a6d309261b4e4134aae2ca007b31a433) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:22.538895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445bd48-eec1-4109-b234-ea2e8dfc4bad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:22.540961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445bd48-eec1-4109-b234-ea2e8dfc4bad None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:22.561604 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 44/91] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:22 2022] GET /identity/v3/role_assignments?user.id=a6d309261b4e4134aae2ca007b31a433&scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc&role.id=27431c49ccd74f7a898d1a39e251ce29 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:22.561604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445bd48-eec1-4109-b234-ea2e8dfc4bad None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:22.595295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe712a62-f23d-41de-b77c-afe9a5fbec89 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:22.641364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3be0ae-49b1-46fe-ba86-c7e055fca254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:22.641991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3be0ae-49b1-46fe-ba86-c7e055fca254 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:22.642270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3be0ae-49b1-46fe-ba86-c7e055fca254 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:22.642543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3be0ae-49b1-46fe-ba86-c7e055fca254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:22.643341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3be0ae-49b1-46fe-ba86-c7e055fca254 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc, user.id=1a6e50d0928e4f92987cd089e6138f36) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:22.643657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3be0ae-49b1-46fe-ba86-c7e055fca254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:22.645150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3be0ae-49b1-46fe-ba86-c7e055fca254 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:22.655568 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 48/92] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:22 2022] GET /identity/v3/role_assignments?user.id=1a6e50d0928e4f92987cd089e6138f36&scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc&role.id=a409f81bd5744563a303a825783bed61 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:22.656478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3be0ae-49b1-46fe-ba86-c7e055fca254 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:22.697128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445bd48-eec1-4109-b234-ea2e8dfc4bad None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:22.741905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c0c4c-fc95-440d-83fa-3ee880b15866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:22.742667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c0c4c-fc95-440d-83fa-3ee880b15866 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:22.742956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c0c4c-fc95-440d-83fa-3ee880b15866 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:22.743360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c0c4c-fc95-440d-83fa-3ee880b15866 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:22.744661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c0c4c-fc95-440d-83fa-3ee880b15866 None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:22.746353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c0c4c-fc95-440d-83fa-3ee880b15866 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:22.748357 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 45/93] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:22 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:22.754612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c0c4c-fc95-440d-83fa-3ee880b15866 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:22.767072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:22.798618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3be0ae-49b1-46fe-ba86-c7e055fca254 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:22.827297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:22.843331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853771a2-9765-47ac-9e89-f04602d81eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:22.844259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853771a2-9765-47ac-9e89-f04602d81eb0 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:22.844693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853771a2-9765-47ac-9e89-f04602d81eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:22.845124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853771a2-9765-47ac-9e89-f04602d81eb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:22.893101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c0c4c-fc95-440d-83fa-3ee880b15866 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:22.937891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e60591-5c35-43b6-88fb-d7b10cba9ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:22.938513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e60591-5c35-43b6-88fb-d7b10cba9ed2 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:22.938792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e60591-5c35-43b6-88fb-d7b10cba9ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:22.939068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e60591-5c35-43b6-88fb-d7b10cba9ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:22.939976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e60591-5c35-43b6-88fb-d7b10cba9ed2 None admin] RBAC: Adding query filter params (role.id=94f39d4bced64cc98e66bceafe049303, scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc, user.id=a6d309261b4e4134aae2ca007b31a433) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:22.940288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e60591-5c35-43b6-88fb-d7b10cba9ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:22.942786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e60591-5c35-43b6-88fb-d7b10cba9ed2 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:22.948924 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 46/94] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:22 2022] GET /identity/v3/role_assignments?user.id=a6d309261b4e4134aae2ca007b31a433&scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc&role.id=94f39d4bced64cc98e66bceafe049303 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:22.957068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853771a2-9765-47ac-9e89-f04602d81eb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:22.959420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853771a2-9765-47ac-9e89-f04602d81eb0 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:23.056545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:23.082346 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 49/95] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:23.088362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e60591-5c35-43b6-88fb-d7b10cba9ed2 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:23.225840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e60591-5c35-43b6-88fb-d7b10cba9ed2 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:23.255593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:23.274387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd560e3f-1f70-4d77-a24c-91847132658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:23.275077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd560e3f-1f70-4d77-a24c-91847132658d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:23.275363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd560e3f-1f70-4d77-a24c-91847132658d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:23.275641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd560e3f-1f70-4d77-a24c-91847132658d None admin] PATH_INFO: `/v3/projects/7ddb3df85a334e199cffabad3fa1572c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:23.276826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd560e3f-1f70-4d77-a24c-91847132658d None admin] RBAC: Authorizing `identity:get_project(project_id=7ddb3df85a334e199cffabad3fa1572c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:23.278326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd560e3f-1f70-4d77-a24c-91847132658d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:23.280012 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 47/96] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:23 2022] GET /identity/v3/projects/7ddb3df85a334e199cffabad3fa1572c => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:23.288059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853771a2-9765-47ac-9e89-f04602d81eb0 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:23.419855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853771a2-9765-47ac-9e89-f04602d81eb0 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:23.467710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73cba7-5bc3-4cea-86ca-8f9a8816c3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:23.468561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73cba7-5bc3-4cea-86ca-8f9a8816c3d9 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:23.468986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73cba7-5bc3-4cea-86ca-8f9a8816c3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:23.469424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73cba7-5bc3-4cea-86ca-8f9a8816c3d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:23.470288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73cba7-5bc3-4cea-86ca-8f9a8816c3d9 None admin] RBAC: Adding query filter params (role.id=27431c49ccd74f7a898d1a39e251ce29, scope.project.id=7ddb3df85a334e199cffabad3fa1572c, user.id=a6d309261b4e4134aae2ca007b31a433) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:23.470838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73cba7-5bc3-4cea-86ca-8f9a8816c3d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:23.472411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73cba7-5bc3-4cea-86ca-8f9a8816c3d9 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:23.482295 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 50/97] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:23 2022] GET /identity/v3/role_assignments?user.id=a6d309261b4e4134aae2ca007b31a433&scope.project.id=7ddb3df85a334e199cffabad3fa1572c&role.id=27431c49ccd74f7a898d1a39e251ce29 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:26.072143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b0097-4738-4582-9b3a-774bdb725c0e None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:26.072655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b0097-4738-4582-9b3a-774bdb725c0e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:26.072728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b0097-4738-4582-9b3a-774bdb725c0e None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:26.074389 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 48/98] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:26.079830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d0a98-e798-4eda-8efe-d79c56275e65 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:26.080254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d0a98-e798-4eda-8efe-d79c56275e65 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:26.080428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d0a98-e798-4eda-8efe-d79c56275e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:26.090853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62aa4b-72f2-4291-9b02-ca7a6b1ec2a1 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:26.091143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62aa4b-72f2-4291-9b02-ca7a6b1ec2a1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:26.091422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62aa4b-72f2-4291-9b02-ca7a6b1ec2a1 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:26.092953 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 49/99] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:26.098440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05715c-0065-4e44-9457-207053f30503 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:26.098733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05715c-0065-4e44-9457-207053f30503 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:26.098994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05715c-0065-4e44-9457-207053f30503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:26.118492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-842d0a98-e798-4eda-8efe-d79c56275e65 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:26.119800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-842d0a98-e798-4eda-8efe-d79c56275e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:26.136278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ca05715c-0065-4e44-9457-207053f30503 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:26.137413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ca05715c-0065-4e44-9457-207053f30503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:26.217677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:26.294347 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 51/100] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:26.303522 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 50/101] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:26.598387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a10f2-9cf0-4ff5-a1f2-2509e87b6a87 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:26.599129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a10f2-9cf0-4ff5-a1f2-2509e87b6a87 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:26.599624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a10f2-9cf0-4ff5-a1f2-2509e87b6a87 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:26.601222 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 52/102] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:26.606547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a14d6-702e-4e70-aa17-6f1503cd1a40 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:26.607097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a14d6-702e-4e70-aa17-6f1503cd1a40 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:26.607589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a14d6-702e-4e70-aa17-6f1503cd1a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:26.631126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f60a14d6-702e-4e70-aa17-6f1503cd1a40 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:26.632714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f60a14d6-702e-4e70-aa17-6f1503cd1a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:26.721902 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 51/103] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:26.761056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a10f2-9cf0-4ff5-a1f2-2509e87b6a87 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:26.825375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a14d6-702e-4e70-aa17-6f1503cd1a40 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:26.903043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a10f2-9cf0-4ff5-a1f2-2509e87b6a87 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:26.929575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:26.947931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e8a9d-7fee-4afb-bb84-730239c37036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:26.948571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8a9d-7fee-4afb-bb84-730239c37036 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:26.948898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8a9d-7fee-4afb-bb84-730239c37036 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:26.949171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8a9d-7fee-4afb-bb84-730239c37036 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:26.964943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e8a9d-7fee-4afb-bb84-730239c37036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-0b3e8a9d-7fee-4afb-bb84-730239c37036 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:26.970127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:26.970985 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:26.971776 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:26.971776 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:26.971776 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:26.971776 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:26.971776 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:26.971776 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:26.971776 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:26.971776 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:26.971776 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:26.971776 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:26.971776 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:26.971776 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:26.971776 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 53/104] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:26.972908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996384-23fa-4eec-ad39-579c83f9852d None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:26.972908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996384-23fa-4eec-ad39-579c83f9852d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:26.973145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996384-23fa-4eec-ad39-579c83f9852d None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:26.979627 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 54/105] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:26.980699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b0d3d-28f8-4f3a-8f40-bc57388363c8 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:26.980981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b0d3d-28f8-4f3a-8f40-bc57388363c8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:26.981277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b0d3d-28f8-4f3a-8f40-bc57388363c8 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:26.983237 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 55/106] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:26.983953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b0d3d-28f8-4f3a-8f40-bc57388363c8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:26.997257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a14d6-702e-4e70-aa17-6f1503cd1a40 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:27.022287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:27.048916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830af1fb-dc44-4c51-95ef-85fbe60f75cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:27.050097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830af1fb-dc44-4c51-95ef-85fbe60f75cc None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.050534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830af1fb-dc44-4c51-95ef-85fbe60f75cc None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.051195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830af1fb-dc44-4c51-95ef-85fbe60f75cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.066189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830af1fb-dc44-4c51-95ef-85fbe60f75cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-830af1fb-dc44-4c51-95ef-85fbe60f75cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:27.072597 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:27.074056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:27.074996 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:27.074996 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:27.074996 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:27.074996 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:27.074996 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:27.074996 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:27.074996 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:27.074996 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:27.074996 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:27.074996 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:27.074996 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:27.074996 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:27.077668 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 52/107] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:34:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:27.080113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631f7f0-acdf-42d6-b89b-37589cae9d49 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.080558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631f7f0-acdf-42d6-b89b-37589cae9d49 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.080990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631f7f0-acdf-42d6-b89b-37589cae9d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.101916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b0d3d-28f8-4f3a-8f40-bc57388363c8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:27.106094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b631f7f0-acdf-42d6-b89b-37589cae9d49 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:27.107286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b631f7f0-acdf-42d6-b89b-37589cae9d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:27.142799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cf96f-df14-452e-a6e1-a61fec9b6714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:27.143415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf96f-df14-452e-a6e1-a61fec9b6714 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.143812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf96f-df14-452e-a6e1-a61fec9b6714 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.143956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf96f-df14-452e-a6e1-a61fec9b6714 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.144624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cf96f-df14-452e-a6e1-a61fec9b6714 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:27.144926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cf96f-df14-452e-a6e1-a61fec9b6714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:27.146339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cf96f-df14-452e-a6e1-a61fec9b6714 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:27.155832 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 56/108] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:27.156829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed140d5-a594-46be-8ceb-16334808a9d9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.157113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed140d5-a594-46be-8ceb-16334808a9d9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.157419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed140d5-a594-46be-8ceb-16334808a9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.175523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9ed140d5-a594-46be-8ceb-16334808a9d9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:27.176705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9ed140d5-a594-46be-8ceb-16334808a9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:27.193056 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 53/109] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:27.193924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631f7f0-acdf-42d6-b89b-37589cae9d49 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:27.235122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:27.254324 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 57/110] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:27.255363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed140d5-a594-46be-8ceb-16334808a9d9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:27.291663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:27.311766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631f7f0-acdf-42d6-b89b-37589cae9d49 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:27.353571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef5c68-8687-4eec-a102-fe3214e4bd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:27.354193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef5c68-8687-4eec-a102-fe3214e4bd4b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.354476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef5c68-8687-4eec-a102-fe3214e4bd4b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.354751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef5c68-8687-4eec-a102-fe3214e4bd4b None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.355418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef5c68-8687-4eec-a102-fe3214e4bd4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:27.355720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef5c68-8687-4eec-a102-fe3214e4bd4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:27.357870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef5c68-8687-4eec-a102-fe3214e4bd4b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:27.366768 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 54/111] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:27.367229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef5c68-8687-4eec-a102-fe3214e4bd4b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:27.379624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed140d5-a594-46be-8ceb-16334808a9d9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:27.416192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9eca9-2192-4735-afd5-d23f085f213a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:27.417155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9eca9-2192-4735-afd5-d23f085f213a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.417707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9eca9-2192-4735-afd5-d23f085f213a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.418198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9eca9-2192-4735-afd5-d23f085f213a None admin] PATH_INFO: `/v3/roles/member` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.429108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9eca9-2192-4735-afd5-d23f085f213a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-ebb9eca9-2192-4735-afd5-d23f085f213a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:27.434347 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:27.435221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:27.435969 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:27.435969 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:27.435969 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:27.435969 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:27.435969 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:27.435969 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:27.435969 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:27.435969 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:27.435969 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:27.435969 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:27.435969 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:27.435969 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:27.438239 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 58/112] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:27.439854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920aad3-e180-4bf6-8e3e-0a73b91a86fc None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.440340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920aad3-e180-4bf6-8e3e-0a73b91a86fc None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.440818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920aad3-e180-4bf6-8e3e-0a73b91a86fc None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.443060 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 59/113] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:27.443978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920aad3-e180-4bf6-8e3e-0a73b91a86fc None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:27.473200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:27.476555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef5c68-8687-4eec-a102-fe3214e4bd4b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:27.513090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936f127-2491-4bf0-9a70-2b53e7c3c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:27.513705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936f127-2491-4bf0-9a70-2b53e7c3c21a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.513989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936f127-2491-4bf0-9a70-2b53e7c3c21a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.514310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936f127-2491-4bf0-9a70-2b53e7c3c21a None admin] PATH_INFO: `/v3/users/b179e4fdb06640c3b1707390f1a32fc8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.528829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936f127-2491-4bf0-9a70-2b53e7c3c21a None admin] RBAC: Authorizing `identity:get_user(user_id=b179e4fdb06640c3b1707390f1a32fc8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:27.530417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936f127-2491-4bf0-9a70-2b53e7c3c21a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:27.532097 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 55/114] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:27 2022] GET /identity/v3/users/b179e4fdb06640c3b1707390f1a32fc8 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:27.536632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936f127-2491-4bf0-9a70-2b53e7c3c21a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:27.542979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:27.560247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920aad3-e180-4bf6-8e3e-0a73b91a86fc None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:27.599762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae59eb-9fab-405d-aa72-ee94ecb63291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:27.600390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae59eb-9fab-405d-aa72-ee94ecb63291 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.600680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae59eb-9fab-405d-aa72-ee94ecb63291 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.601146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae59eb-9fab-405d-aa72-ee94ecb63291 None admin] PATH_INFO: `/v3/users/1a6e50d0928e4f92987cd089e6138f36` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.602118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae59eb-9fab-405d-aa72-ee94ecb63291 None admin] RBAC: Authorizing `identity:get_user(user_id=1a6e50d0928e4f92987cd089e6138f36)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:27.603611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae59eb-9fab-405d-aa72-ee94ecb63291 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:27.606013 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 60/115] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:27 2022] GET /identity/v3/users/1a6e50d0928e4f92987cd089e6138f36 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:27.610374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4894854-7621-4f14-8e0a-9015671b1a43 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.611288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4894854-7621-4f14-8e0a-9015671b1a43 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.611573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4894854-7621-4f14-8e0a-9015671b1a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.630823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a4894854-7621-4f14-8e0a-9015671b1a43 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:27.632005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a4894854-7621-4f14-8e0a-9015671b1a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:27.641418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936f127-2491-4bf0-9a70-2b53e7c3c21a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:27.675617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea6489-176a-4520-b05b-c023a6706db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:27.676232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea6489-176a-4520-b05b-c023a6706db7 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.676519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea6489-176a-4520-b05b-c023a6706db7 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.676804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea6489-176a-4520-b05b-c023a6706db7 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.677504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea6489-176a-4520-b05b-c023a6706db7 None admin] RBAC: Adding query filter params (name=member) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:27.677811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea6489-176a-4520-b05b-c023a6706db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:27.679186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea6489-176a-4520-b05b-c023a6706db7 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:27.687101 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 56/116] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:27.687883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea6489-176a-4520-b05b-c023a6706db7 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:27.713220 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 61/117] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:27.713220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4894854-7621-4f14-8e0a-9015671b1a43 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:27.713495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:27.791753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea6489-176a-4520-b05b-c023a6706db7 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:27.798490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:27.818909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4894854-7621-4f14-8e0a-9015671b1a43 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:27.828410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc85aa-418e-4505-82da-b69323efa5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:27.829112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc85aa-418e-4505-82da-b69323efa5f6 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.829545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc85aa-418e-4505-82da-b69323efa5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.829886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc85aa-418e-4505-82da-b69323efa5f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.856031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b9ab4-0bdd-4fa0-bcf3-db915d745842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:27.857022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b9ab4-0bdd-4fa0-bcf3-db915d745842 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.857502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b9ab4-0bdd-4fa0-bcf3-db915d745842 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.857958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b9ab4-0bdd-4fa0-bcf3-db915d745842 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.859455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b9ab4-0bdd-4fa0-bcf3-db915d745842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:27.861148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b9ab4-0bdd-4fa0-bcf3-db915d745842 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:27.867697 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 62/118] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:27.868971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b9ab4-0bdd-4fa0-bcf3-db915d745842 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:27.897604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc85aa-418e-4505-82da-b69323efa5f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:27.899089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc85aa-418e-4505-82da-b69323efa5f6 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:27.919464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:27.973214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b9ab4-0bdd-4fa0-bcf3-db915d745842 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:28.002908 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 57/119] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:28.003746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc85aa-418e-4505-82da-b69323efa5f6 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:28.014305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440eb2e-65e7-4c7f-a718-f6b60a822b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:28.015157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440eb2e-65e7-4c7f-a718-f6b60a822b9a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.015443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440eb2e-65e7-4c7f-a718-f6b60a822b9a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.015721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440eb2e-65e7-4c7f-a718-f6b60a822b9a None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.016890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440eb2e-65e7-4c7f-a718-f6b60a822b9a None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:28.018372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440eb2e-65e7-4c7f-a718-f6b60a822b9a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:28.021223 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 63/120] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:27 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:28.021223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440eb2e-65e7-4c7f-a718-f6b60a822b9a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:28.039780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:28.108493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc85aa-418e-4505-82da-b69323efa5f6 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:28.118915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440eb2e-65e7-4c7f-a718-f6b60a822b9a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:28.128389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:28.143019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d77a3-5b31-4c86-89e2-ccdd0a134fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:28.143653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d77a3-5b31-4c86-89e2-ccdd0a134fb1 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.143936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d77a3-5b31-4c86-89e2-ccdd0a134fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.144211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d77a3-5b31-4c86-89e2-ccdd0a134fb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.152929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3152b2-1646-43f8-a69c-42e973f82c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:28.153592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3152b2-1646-43f8-a69c-42e973f82c92 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.153878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3152b2-1646-43f8-a69c-42e973f82c92 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.153982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d77a3-5b31-4c86-89e2-ccdd0a134fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:28.154156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3152b2-1646-43f8-a69c-42e973f82c92 None admin] PATH_INFO: `/v3/users/a6d309261b4e4134aae2ca007b31a433` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.155294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3152b2-1646-43f8-a69c-42e973f82c92 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d309261b4e4134aae2ca007b31a433)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:28.156733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3152b2-1646-43f8-a69c-42e973f82c92 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:28.158345 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 64/121] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:28 2022] GET /identity/v3/users/a6d309261b4e4134aae2ca007b31a433 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-935d77a3-5b31-4c86-89e2-ccdd0a134fb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:28.158722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:28.159505 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:28.160258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:28.160258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:28.160258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:28.160258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:28.160258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:28.160258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:28.160258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:28.160258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:28.160258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:28.160258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:28.160258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:34:28.160258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:28.160868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3152b2-1646-43f8-a69c-42e973f82c92 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:28.160938 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 58/122] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:28.160938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d77a3-5b31-4c86-89e2-ccdd0a134fb1 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:28.246861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:28.260399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d77a3-5b31-4c86-89e2-ccdd0a134fb1 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:28.261413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3152b2-1646-43f8-a69c-42e973f82c92 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:28.293209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab61280-a67f-4455-af8a-121ed45caebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:28.293850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab61280-a67f-4455-af8a-121ed45caebe None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.294141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab61280-a67f-4455-af8a-121ed45caebe None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.294418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab61280-a67f-4455-af8a-121ed45caebe None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.294740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1ce78-b19f-482e-87e7-d90b7601f6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:28.295342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1ce78-b19f-482e-87e7-d90b7601f6d8 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.295560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab61280-a67f-4455-af8a-121ed45caebe None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:28.295662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1ce78-b19f-482e-87e7-d90b7601f6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.295881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1ce78-b19f-482e-87e7-d90b7601f6d8 None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.296516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1ce78-b19f-482e-87e7-d90b7601f6d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:28.297016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab61280-a67f-4455-af8a-121ed45caebe None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:28.297951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1ce78-b19f-482e-87e7-d90b7601f6d8 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:28.298671 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 59/123] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:28 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:28.303575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab61280-a67f-4455-af8a-121ed45caebe None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:28.326158 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 65/124] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:34:28 2022] POST /identity/v3/projects => generated 302 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:28.326990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1ce78-b19f-482e-87e7-d90b7601f6d8 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:28.372732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:28.432135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab61280-a67f-4455-af8a-121ed45caebe None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:28.437465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1ce78-b19f-482e-87e7-d90b7601f6d8 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:28.472768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911364bb-17a6-4814-88a5-99390a65aff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:28.473484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911364bb-17a6-4814-88a5-99390a65aff9 None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.473770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911364bb-17a6-4814-88a5-99390a65aff9 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.473891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076b871-d242-4bfb-ad1f-f5a7ca341d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:28.474074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911364bb-17a6-4814-88a5-99390a65aff9 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc/users/1a6e50d0928e4f92987cd089e6138f36/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.477112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076b871-d242-4bfb-ad1f-f5a7ca341d2c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.477112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076b871-d242-4bfb-ad1f-f5a7ca341d2c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.477112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076b871-d242-4bfb-ad1f-f5a7ca341d2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.479832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911364bb-17a6-4814-88a5-99390a65aff9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e1aed93c9534d8d87cc68e56be1e9fc, user_id=1a6e50d0928e4f92987cd089e6138f36, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:28.481376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911364bb-17a6-4814-88a5-99390a65aff9 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:28.484594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:28.494810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076b871-d242-4bfb-ad1f-f5a7ca341d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-4076b871-d242-4bfb-ad1f-f5a7ca341d2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:28.500878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:28.501903 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:28.503951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:28.503951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:28.503951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:28.503951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:28.503951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:28.503951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:28.503951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:28.503951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:28.503951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:28.503951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:28.503951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:28.503951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:28.503951 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 66/125] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:28.504582 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 60/126] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:34:28 2022] PUT /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc/users/1a6e50d0928e4f92987cd089e6138f36/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:34:28.504582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911364bb-17a6-4814-88a5-99390a65aff9 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:28.513381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076b871-d242-4bfb-ad1f-f5a7ca341d2c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:28.644902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911364bb-17a6-4814-88a5-99390a65aff9 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:28.655005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076b871-d242-4bfb-ad1f-f5a7ca341d2c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:28.658080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:28.690814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763c43f-e9c3-4a28-a0dd-16870b9b9c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:28.691741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763c43f-e9c3-4a28-a0dd-16870b9b9c42 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.692129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763c43f-e9c3-4a28-a0dd-16870b9b9c42 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.692509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763c43f-e9c3-4a28-a0dd-16870b9b9c42 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.693340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763c43f-e9c3-4a28-a0dd-16870b9b9c42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:28.693752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763c43f-e9c3-4a28-a0dd-16870b9b9c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:28.695789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763c43f-e9c3-4a28-a0dd-16870b9b9c42 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:28.698099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aeaf7a-6793-48ce-b3fc-bf47f976973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:28.698770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aeaf7a-6793-48ce-b3fc-bf47f976973c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.699058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aeaf7a-6793-48ce-b3fc-bf47f976973c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.699340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aeaf7a-6793-48ce-b3fc-bf47f976973c None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.700894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aeaf7a-6793-48ce-b3fc-bf47f976973c None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:28.702622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aeaf7a-6793-48ce-b3fc-bf47f976973c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:28.704700 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 67/127] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:28 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:28.705393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aeaf7a-6793-48ce-b3fc-bf47f976973c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:28.708078 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 61/128] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:28.718027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763c43f-e9c3-4a28-a0dd-16870b9b9c42 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:28.786075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:28.828325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aeaf7a-6793-48ce-b3fc-bf47f976973c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:28.841067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763c43f-e9c3-4a28-a0dd-16870b9b9c42 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:28.868289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748c59d-b88d-499c-bff1-e86d8414b720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:28.869216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748c59d-b88d-499c-bff1-e86d8414b720 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.869506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748c59d-b88d-499c-bff1-e86d8414b720 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.869787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748c59d-b88d-499c-bff1-e86d8414b720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.871198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748c59d-b88d-499c-bff1-e86d8414b720 None admin] RBAC: Adding query filter params (role.id=e56cb0010cc3451ba5b280b4d1ca76a6, scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc, user.id=b179e4fdb06640c3b1707390f1a32fc8) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:28.871580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748c59d-b88d-499c-bff1-e86d8414b720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:28.873711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748c59d-b88d-499c-bff1-e86d8414b720 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:28.878980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc785024-a523-4b0d-a5e4-a7ca0b63bb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:28.879597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc785024-a523-4b0d-a5e4-a7ca0b63bb31 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.880048 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 68/129] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:28 2022] GET /identity/v3/role_assignments?user.id=b179e4fdb06640c3b1707390f1a32fc8&scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc&role.id=e56cb0010cc3451ba5b280b4d1ca76a6 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:28.880152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc785024-a523-4b0d-a5e4-a7ca0b63bb31 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.880231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc785024-a523-4b0d-a5e4-a7ca0b63bb31 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.880594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748c59d-b88d-499c-bff1-e86d8414b720 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:28.880871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc785024-a523-4b0d-a5e4-a7ca0b63bb31 None admin] RBAC: Adding query filter params (name=member) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:28.881298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc785024-a523-4b0d-a5e4-a7ca0b63bb31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:28.882748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc785024-a523-4b0d-a5e4-a7ca0b63bb31 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:28.900049 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 62/130] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:28.903657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc785024-a523-4b0d-a5e4-a7ca0b63bb31 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:28.969383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:29.091908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748c59d-b88d-499c-bff1-e86d8414b720 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:29.095346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc785024-a523-4b0d-a5e4-a7ca0b63bb31 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:29.146876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:29.149973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab95b83-442b-472d-86b1-154ed3915d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:29.151592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab95b83-442b-472d-86b1-154ed3915d68 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:29.151825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab95b83-442b-472d-86b1-154ed3915d68 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:29.152101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab95b83-442b-472d-86b1-154ed3915d68 None admin] PATH_INFO: `/v3/users/a6d309261b4e4134aae2ca007b31a433` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:29.153370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab95b83-442b-472d-86b1-154ed3915d68 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d309261b4e4134aae2ca007b31a433)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:29.155088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab95b83-442b-472d-86b1-154ed3915d68 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:29.156990 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 63/131] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:28 2022] GET /identity/v3/users/a6d309261b4e4134aae2ca007b31a433 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:29.157802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab95b83-442b-472d-86b1-154ed3915d68 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:29.168652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fab7f-a5ca-4b42-b0bc-6f0cf390e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:29.169363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fab7f-a5ca-4b42-b0bc-6f0cf390e6e6 None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:29.169646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fab7f-a5ca-4b42-b0bc-6f0cf390e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:29.169924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fab7f-a5ca-4b42-b0bc-6f0cf390e6e6 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc/users/a6d309261b4e4134aae2ca007b31a433/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:29.175051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fab7f-a5ca-4b42-b0bc-6f0cf390e6e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e1aed93c9534d8d87cc68e56be1e9fc, user_id=a6d309261b4e4134aae2ca007b31a433, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:29.176503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fab7f-a5ca-4b42-b0bc-6f0cf390e6e6 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:29.203149 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 69/132] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:34:28 2022] PUT /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc/users/a6d309261b4e4134aae2ca007b31a433/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:34:29.204102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fab7f-a5ca-4b42-b0bc-6f0cf390e6e6 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:29.366959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:29.370837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab95b83-442b-472d-86b1-154ed3915d68 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:29.417216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fab7f-a5ca-4b42-b0bc-6f0cf390e6e6 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:29.433698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15730267-2d06-4e01-95f5-a83223afc1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:29.434712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730267-2d06-4e01-95f5-a83223afc1a0 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:29.435198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730267-2d06-4e01-95f5-a83223afc1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:29.435678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730267-2d06-4e01-95f5-a83223afc1a0 None admin] PATH_INFO: `/v3/users/a6d309261b4e4134aae2ca007b31a433` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:29.437145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15730267-2d06-4e01-95f5-a83223afc1a0 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d309261b4e4134aae2ca007b31a433)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:29.438848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15730267-2d06-4e01-95f5-a83223afc1a0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:29.440710 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 64/133] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:29 2022] GET /identity/v3/users/a6d309261b4e4134aae2ca007b31a433 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:29.456722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15730267-2d06-4e01-95f5-a83223afc1a0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:29.458610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325e493-9b4f-47e2-913a-f99b64855a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:29.459270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e493-9b4f-47e2-913a-f99b64855a9b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:29.459561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e493-9b4f-47e2-913a-f99b64855a9b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:29.459839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e493-9b4f-47e2-913a-f99b64855a9b None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:29.461157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325e493-9b4f-47e2-913a-f99b64855a9b None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:29.465031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325e493-9b4f-47e2-913a-f99b64855a9b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:29.465031 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 70/134] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:29 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:29.470532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325e493-9b4f-47e2-913a-f99b64855a9b None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:29.564626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:29.614747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325e493-9b4f-47e2-913a-f99b64855a9b None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:29.651514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54325c78-73a3-432e-8e8b-a9cc94550683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:29.652173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54325c78-73a3-432e-8e8b-a9cc94550683 None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:29.652454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54325c78-73a3-432e-8e8b-a9cc94550683 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:29.652734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54325c78-73a3-432e-8e8b-a9cc94550683 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc/users/a6d309261b4e4134aae2ca007b31a433/roles/94f39d4bced64cc98e66bceafe049303` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:29.654933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54325c78-73a3-432e-8e8b-a9cc94550683 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e1aed93c9534d8d87cc68e56be1e9fc, user_id=a6d309261b4e4134aae2ca007b31a433, role_id=94f39d4bced64cc98e66bceafe049303)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:29.656392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54325c78-73a3-432e-8e8b-a9cc94550683 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:29.663459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15730267-2d06-4e01-95f5-a83223afc1a0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:29.677038 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 71/135] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:34:29 2022] PUT /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc/users/a6d309261b4e4134aae2ca007b31a433/roles/94f39d4bced64cc98e66bceafe049303 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:34:29.711334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dec36-00fd-41d4-88e3-fbe91c390843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:29.712683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dec36-00fd-41d4-88e3-fbe91c390843 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:29.712966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dec36-00fd-41d4-88e3-fbe91c390843 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:29.713319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dec36-00fd-41d4-88e3-fbe91c390843 None admin] PATH_INFO: `/v3/projects/7ddb3df85a334e199cffabad3fa1572c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:29.714480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dec36-00fd-41d4-88e3-fbe91c390843 None admin] RBAC: Authorizing `identity:get_project(project_id=7ddb3df85a334e199cffabad3fa1572c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:29.716044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dec36-00fd-41d4-88e3-fbe91c390843 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:29.718052 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 65/136] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:29 2022] GET /identity/v3/projects/7ddb3df85a334e199cffabad3fa1572c => generated 312 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:29.723849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54325c78-73a3-432e-8e8b-a9cc94550683 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:29.851272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54325c78-73a3-432e-8e8b-a9cc94550683 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:29.874632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:29.895387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fe060-b863-4fb7-a623-901a8cd9aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:29.896068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fe060-b863-4fb7-a623-901a8cd9aad3 None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:29.896524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fe060-b863-4fb7-a623-901a8cd9aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:29.896806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fe060-b863-4fb7-a623-901a8cd9aad3 None admin] PATH_INFO: `/v3/projects/7ddb3df85a334e199cffabad3fa1572c/users/a6d309261b4e4134aae2ca007b31a433/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:29.902719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fe060-b863-4fb7-a623-901a8cd9aad3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ddb3df85a334e199cffabad3fa1572c, user_id=a6d309261b4e4134aae2ca007b31a433, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:29.904199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fe060-b863-4fb7-a623-901a8cd9aad3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:29.928868 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 72/137] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:34:29 2022] PUT /identity/v3/projects/7ddb3df85a334e199cffabad3fa1572c/users/a6d309261b4e4134aae2ca007b31a433/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:34:31.334175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6055fad-8058-4f1e-bbff-3a9544335004 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:31.334683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6055fad-8058-4f1e-bbff-3a9544335004 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:31.334756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6055fad-8058-4f1e-bbff-3a9544335004 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:31.336134 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 66/138] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:31.341279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eed24e-d4ac-44e3-867b-4dc8f1749d29 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:31.341682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eed24e-d4ac-44e3-867b-4dc8f1749d29 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:31.341944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eed24e-d4ac-44e3-867b-4dc8f1749d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:31.366616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-70eed24e-d4ac-44e3-867b-4dc8f1749d29 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:31.367801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-70eed24e-d4ac-44e3-867b-4dc8f1749d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:31.455968 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 73/139] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:31.787474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6055fad-8058-4f1e-bbff-3a9544335004 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:31.837377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:31.910019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42643e1-3ffb-43db-82ae-786244f3024d None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:31.910340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42643e1-3ffb-43db-82ae-786244f3024d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:31.910578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42643e1-3ffb-43db-82ae-786244f3024d None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:31.911930 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 74/140] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:34:31.924218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1c2c2-eecf-4039-a0f5-c550616280b6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:31.924506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1c2c2-eecf-4039-a0f5-c550616280b6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:31.924799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1c2c2-eecf-4039-a0f5-c550616280b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:31.954904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5de1c2c2-eecf-4039-a0f5-c550616280b6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:31.956096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5de1c2c2-eecf-4039-a0f5-c550616280b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:31.962940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6055fad-8058-4f1e-bbff-3a9544335004 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:32.023476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa12aa-6598-4933-a9d8-46416a487dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:32.024186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa12aa-6598-4933-a9d8-46416a487dde None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:32.024986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa12aa-6598-4933-a9d8-46416a487dde None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:32.025285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa12aa-6598-4933-a9d8-46416a487dde None admin] PATH_INFO: `/v3/domains/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:32.027087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa12aa-6598-4933-a9d8-46416a487dde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:32.032812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa12aa-6598-4933-a9d8-46416a487dde None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:32.034468 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 67/141] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:32.043003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa12aa-6598-4933-a9d8-46416a487dde None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:32.087311 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 75/142] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:32.181488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa12aa-6598-4933-a9d8-46416a487dde None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:32.186198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:32.223225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700e617-5156-4eda-8393-c640fb1d0a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:32.223844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700e617-5156-4eda-8393-c640fb1d0a18 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:32.224128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700e617-5156-4eda-8393-c640fb1d0a18 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:32.224401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700e617-5156-4eda-8393-c640fb1d0a18 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:32.225052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700e617-5156-4eda-8393-c640fb1d0a18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:32.226547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700e617-5156-4eda-8393-c640fb1d0a18 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:32.261245 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 68/143] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:34:32 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:32.392779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95728d27-98ba-4e98-a9ad-5a2371af2992 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:32.393299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95728d27-98ba-4e98-a9ad-5a2371af2992 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:32.393299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95728d27-98ba-4e98-a9ad-5a2371af2992 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:32.394802 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 76/144] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:32.401050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837b513-67f8-4e36-b403-30b9fa8b84d3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:32.401588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837b513-67f8-4e36-b403-30b9fa8b84d3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:32.401661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837b513-67f8-4e36-b403-30b9fa8b84d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:32.434402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9837b513-67f8-4e36-b403-30b9fa8b84d3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:32.435646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9837b513-67f8-4e36-b403-30b9fa8b84d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:32.541321 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 69/145] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:32.630237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95728d27-98ba-4e98-a9ad-5a2371af2992 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:32.678390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:32.763454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95728d27-98ba-4e98-a9ad-5a2371af2992 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:32.814869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377e3e0-a9fb-405e-9016-f5f3bdb957f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:32.815537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377e3e0-a9fb-405e-9016-f5f3bdb957f0 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:32.815825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377e3e0-a9fb-405e-9016-f5f3bdb957f0 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:32.816099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377e3e0-a9fb-405e-9016-f5f3bdb957f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:32.833296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377e3e0-a9fb-405e-9016-f5f3bdb957f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-9377e3e0-a9fb-405e-9016-f5f3bdb957f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:32.839272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:32.840095 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:32.840845 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:32.840845 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:32.840845 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:32.840845 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:32.840845 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:32.840845 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:32.840845 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:32.840845 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:32.840845 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:32.840845 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:32.840845 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:32.840845 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:32.840845 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 77/146] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:32.847433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837b513-67f8-4e36-b403-30b9fa8b84d3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:32.948084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:32.958778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837b513-67f8-4e36-b403-30b9fa8b84d3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:32.998585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb32f53-8b06-4ea2-a19f-f96e9e071be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:32.999279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb32f53-8b06-4ea2-a19f-f96e9e071be4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:32.999563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb32f53-8b06-4ea2-a19f-f96e9e071be4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:32.999842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb32f53-8b06-4ea2-a19f-f96e9e071be4 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.000572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb32f53-8b06-4ea2-a19f-f96e9e071be4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:33.000882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb32f53-8b06-4ea2-a19f-f96e9e071be4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:33.002313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb32f53-8b06-4ea2-a19f-f96e9e071be4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:33.012024 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 70/147] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:33.017668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377e3e0-a9fb-405e-9016-f5f3bdb957f0 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:33.135986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:33.142139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377e3e0-a9fb-405e-9016-f5f3bdb957f0 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:33.158695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb32f53-8b06-4ea2-a19f-f96e9e071be4 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:33.187820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586eec1f-9f43-46ce-bba6-b49140afd04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:33.188465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eec1f-9f43-46ce-bba6-b49140afd04e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.188745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eec1f-9f43-46ce-bba6-b49140afd04e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.189021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eec1f-9f43-46ce-bba6-b49140afd04e None admin] PATH_INFO: `/v3/users/1a6e50d0928e4f92987cd089e6138f36` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.192990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586eec1f-9f43-46ce-bba6-b49140afd04e None admin] RBAC: Authorizing `identity:get_user(user_id=1a6e50d0928e4f92987cd089e6138f36)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:33.194552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586eec1f-9f43-46ce-bba6-b49140afd04e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:33.196425 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 78/148] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:33 2022] GET /identity/v3/users/1a6e50d0928e4f92987cd089e6138f36 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:33.202111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586eec1f-9f43-46ce-bba6-b49140afd04e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:33.361686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb32f53-8b06-4ea2-a19f-f96e9e071be4 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:33.392869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586eec1f-9f43-46ce-bba6-b49140afd04e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:33.410206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255a936-010a-42c7-bead-beab5e2f39ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:33.411810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a936-010a-42c7-bead-beab5e2f39ce None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.412297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a936-010a-42c7-bead-beab5e2f39ce None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.413049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a936-010a-42c7-bead-beab5e2f39ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.428791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255a936-010a-42c7-bead-beab5e2f39ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-3255a936-010a-42c7-bead-beab5e2f39ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:33.436388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:33.437361 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:33.438114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:33.438114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:33.438114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:33.438114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:33.438114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:33.438114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:33.438114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:33.438114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:33.438114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:33.438114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:33.438114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:33.438114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:33.439261 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 71/149] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:34:33.439962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758409d-1f49-49b4-9a6d-eccaef7715f2 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.440238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758409d-1f49-49b4-9a6d-eccaef7715f2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.440505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758409d-1f49-49b4-9a6d-eccaef7715f2 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.441670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4328f-ccb0-4d73-aa4e-cbdd8eb38f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:33.441791 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 72/150] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:33.442601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4328f-ccb0-4d73-aa4e-cbdd8eb38f2f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.442894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4328f-ccb0-4d73-aa4e-cbdd8eb38f2f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.443182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4328f-ccb0-4d73-aa4e-cbdd8eb38f2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.449145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a3da3-8ec5-4483-ab75-d0c0e928adb2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.449698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a3da3-8ec5-4483-ab75-d0c0e928adb2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.450160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a3da3-8ec5-4483-ab75-d0c0e928adb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.474122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5b1a3da3-8ec5-4483-ab75-d0c0e928adb2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:33.475650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5b1a3da3-8ec5-4483-ab75-d0c0e928adb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:33.490699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:33.504639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:33.551592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4328f-ccb0-4d73-aa4e-cbdd8eb38f2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:33.553673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4328f-ccb0-4d73-aa4e-cbdd8eb38f2f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:33.560985 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 73/151] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:33.562245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a3da3-8ec5-4483-ab75-d0c0e928adb2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:33.690959 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 79/152] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:34:33.692619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c82ef-68b0-4520-bb4b-d376da0ac82e None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.693098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c82ef-68b0-4520-bb4b-d376da0ac82e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.693646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c82ef-68b0-4520-bb4b-d376da0ac82e None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.695316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a3da3-8ec5-4483-ab75-d0c0e928adb2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:33.695527 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 80/153] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:33.701508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36b80-8f24-43c9-80b2-853083173c72 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.702057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36b80-8f24-43c9-80b2-853083173c72 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.702582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36b80-8f24-43c9-80b2-853083173c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.738480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-55e36b80-8f24-43c9-80b2-853083173c72 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:33.740294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-55e36b80-8f24-43c9-80b2-853083173c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:33.741710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e80c8e-3bb6-4c90-85fd-22cfff35ea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:33.742577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e80c8e-3bb6-4c90-85fd-22cfff35ea93 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.743644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e80c8e-3bb6-4c90-85fd-22cfff35ea93 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.744135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e80c8e-3bb6-4c90-85fd-22cfff35ea93 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.745018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e80c8e-3bb6-4c90-85fd-22cfff35ea93 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:33.745555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e80c8e-3bb6-4c90-85fd-22cfff35ea93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:33.747145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e80c8e-3bb6-4c90-85fd-22cfff35ea93 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:33.756684 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 74/154] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:33.757947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e80c8e-3bb6-4c90-85fd-22cfff35ea93 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:33.762024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:33.813857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:33.822714 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 81/155] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:33.823457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e36b80-8f24-43c9-80b2-853083173c72 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:33.897862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e80c8e-3bb6-4c90-85fd-22cfff35ea93 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:33.934499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e36b80-8f24-43c9-80b2-853083173c72 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:33.954825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7a934-c638-4301-b9e2-7d857377a639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:33.955835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7a934-c638-4301-b9e2-7d857377a639 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.956312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7a934-c638-4301-b9e2-7d857377a639 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.956782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7a934-c638-4301-b9e2-7d857377a639 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.958161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7a934-c638-4301-b9e2-7d857377a639 None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:33.959800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7a934-c638-4301-b9e2-7d857377a639 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:33.962652 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 75/156] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:33 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:33.976460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7a934-c638-4301-b9e2-7d857377a639 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:33.976964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f914d1f-d702-41b1-a7d3-ca168ae17bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:33.978288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f914d1f-d702-41b1-a7d3-ca168ae17bd1 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.978573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f914d1f-d702-41b1-a7d3-ca168ae17bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.978847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f914d1f-d702-41b1-a7d3-ca168ae17bd1 None admin] PATH_INFO: `/v3/users/b179e4fdb06640c3b1707390f1a32fc8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.979993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f914d1f-d702-41b1-a7d3-ca168ae17bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=b179e4fdb06640c3b1707390f1a32fc8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:33.981477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f914d1f-d702-41b1-a7d3-ca168ae17bd1 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:33.983065 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 82/157] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:33 2022] GET /identity/v3/users/b179e4fdb06640c3b1707390f1a32fc8 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:33.989059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f914d1f-d702-41b1-a7d3-ca168ae17bd1 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:34.072642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:34.089224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:34.126733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7a934-c638-4301-b9e2-7d857377a639 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:34.131818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f914d1f-d702-41b1-a7d3-ca168ae17bd1 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:34.164029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9e2ed-585b-4808-8569-47e1244b0918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:34.164668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9e2ed-585b-4808-8569-47e1244b0918 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:34.165655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9e2ed-585b-4808-8569-47e1244b0918 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:34.166052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9e2ed-585b-4808-8569-47e1244b0918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:34.166931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9e2ed-585b-4808-8569-47e1244b0918 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc, user.id=1a6e50d0928e4f92987cd089e6138f36) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:34.167267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9e2ed-585b-4808-8569-47e1244b0918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:34.168804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9e2ed-585b-4808-8569-47e1244b0918 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:34.175557 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 76/158] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:33 2022] GET /identity/v3/role_assignments?user.id=1a6e50d0928e4f92987cd089e6138f36&scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc&role.id=a409f81bd5744563a303a825783bed61 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:34.182283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec048ae-ed02-4c3a-8807-c35945b8e284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:34.183284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec048ae-ed02-4c3a-8807-c35945b8e284 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:34.183778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec048ae-ed02-4c3a-8807-c35945b8e284 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:34.184251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec048ae-ed02-4c3a-8807-c35945b8e284 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:34.185854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec048ae-ed02-4c3a-8807-c35945b8e284 None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:34.187693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec048ae-ed02-4c3a-8807-c35945b8e284 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:34.189759 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 83/159] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:33 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:34.197553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9e2ed-585b-4808-8569-47e1244b0918 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:34.198428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbabc63-f3ec-4918-aa4b-72aaa6caa0f0 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:34.198928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbabc63-f3ec-4918-aa4b-72aaa6caa0f0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:34.199395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbabc63-f3ec-4918-aa4b-72aaa6caa0f0 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:34.200999 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 84/160] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:34.222039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac009a-3e0f-4daa-ae98-098bcba39cfe None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:34.223124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac009a-3e0f-4daa-ae98-098bcba39cfe None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:34.223778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac009a-3e0f-4daa-ae98-098bcba39cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:34.250938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-44ac009a-3e0f-4daa-ae98-098bcba39cfe None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:34.252849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-44ac009a-3e0f-4daa-ae98-098bcba39cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:34.384554 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 85/161] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:34.385463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac009a-3e0f-4daa-ae98-098bcba39cfe None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:34.411360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9e2ed-585b-4808-8569-47e1244b0918 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:34.538902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5df5e-8e3b-4da5-a6b4-ec76f03d06ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:34.539519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5df5e-8e3b-4da5-a6b4-ec76f03d06ae None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:34.539845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5df5e-8e3b-4da5-a6b4-ec76f03d06ae None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:34.540120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5df5e-8e3b-4da5-a6b4-ec76f03d06ae None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc/users/b179e4fdb06640c3b1707390f1a32fc8/roles/e56cb0010cc3451ba5b280b4d1ca76a6` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:34.541197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:34.546823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5df5e-8e3b-4da5-a6b4-ec76f03d06ae None admin] RBAC: Authorizing `identity:create_grant(project_id=1e1aed93c9534d8d87cc68e56be1e9fc, user_id=b179e4fdb06640c3b1707390f1a32fc8, role_id=e56cb0010cc3451ba5b280b4d1ca76a6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:34.548439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5df5e-8e3b-4da5-a6b4-ec76f03d06ae None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:34.555947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:34.587413 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 77/162] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:34:34 2022] PUT /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc/users/b179e4fdb06640c3b1707390f1a32fc8/roles/e56cb0010cc3451ba5b280b4d1ca76a6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:34:34.588255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5df5e-8e3b-4da5-a6b4-ec76f03d06ae None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:34.613124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac009a-3e0f-4daa-ae98-098bcba39cfe None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:34.686790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa8f47-37e0-41e8-beae-701d64cc7912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:34.687686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8f47-37e0-41e8-beae-701d64cc7912 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:34.688132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8f47-37e0-41e8-beae-701d64cc7912 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:34.688554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8f47-37e0-41e8-beae-701d64cc7912 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:34.706649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa8f47-37e0-41e8-beae-701d64cc7912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-fafa8f47-37e0-41e8-beae-701d64cc7912 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:34.712514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:34.713665 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:34.714676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:34.714676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:34.714676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:34.714676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:34.714676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:34.714676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:34.714676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:34.714676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:34.714676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:34.714676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:34.714676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:34.714676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:34.716870 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 86/163] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:34.722975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa8f47-37e0-41e8-beae-701d64cc7912 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:34.782010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5df5e-8e3b-4da5-a6b4-ec76f03d06ae None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:34.854098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786455fe-6fdd-4fec-93b6-f0ed227a35be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:34.854669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786455fe-6fdd-4fec-93b6-f0ed227a35be None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:34.854942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786455fe-6fdd-4fec-93b6-f0ed227a35be None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:34.855209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786455fe-6fdd-4fec-93b6-f0ed227a35be None admin] PATH_INFO: `/v3/roles/member` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:34.880872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786455fe-6fdd-4fec-93b6-f0ed227a35be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-786455fe-6fdd-4fec-93b6-f0ed227a35be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:34.887873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:34.888939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:34.889985 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:34.889985 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:34.889985 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:34.889985 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:34.889985 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:34.889985 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:34.889985 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:34.889985 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:34.889985 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:34.889985 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:34.889985 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:34.889985 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:34.893339 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 78/164] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:34.899054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786455fe-6fdd-4fec-93b6-f0ed227a35be None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:34.908587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa8f47-37e0-41e8-beae-701d64cc7912 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:34.955930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:34.976380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3087d-dbce-445a-bf71-b2ad5ea5048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:34.977691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3087d-dbce-445a-bf71-b2ad5ea5048c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:34.978301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3087d-dbce-445a-bf71-b2ad5ea5048c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:34.978770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3087d-dbce-445a-bf71-b2ad5ea5048c None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:34.979665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3087d-dbce-445a-bf71-b2ad5ea5048c None admin] RBAC: Adding query filter params (name=member) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:34.980176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3087d-dbce-445a-bf71-b2ad5ea5048c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:34.981948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3087d-dbce-445a-bf71-b2ad5ea5048c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:35.000620 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 87/165] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:35.002584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3087d-dbce-445a-bf71-b2ad5ea5048c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:35.064489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:35.132808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786455fe-6fdd-4fec-93b6-f0ed227a35be None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:35.176522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3087d-dbce-445a-bf71-b2ad5ea5048c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:35.195374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a382a7-7112-4f21-991e-942e0c0cca18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:35.196535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a382a7-7112-4f21-991e-942e0c0cca18 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:35.196808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a382a7-7112-4f21-991e-942e0c0cca18 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:35.197082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a382a7-7112-4f21-991e-942e0c0cca18 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:35.197787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a382a7-7112-4f21-991e-942e0c0cca18 None admin] RBAC: Adding query filter params (name=member) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:35.198088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a382a7-7112-4f21-991e-942e0c0cca18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:35.199501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a382a7-7112-4f21-991e-942e0c0cca18 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:35.219921 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 79/166] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:35.220802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a382a7-7112-4f21-991e-942e0c0cca18 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:35.245337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7aa7b-042e-4777-a276-aeb3fba665d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:35.245978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7aa7b-042e-4777-a276-aeb3fba665d0 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:35.246255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7aa7b-042e-4777-a276-aeb3fba665d0 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:35.246530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7aa7b-042e-4777-a276-aeb3fba665d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:35.265913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7aa7b-042e-4777-a276-aeb3fba665d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-60c7aa7b-042e-4777-a276-aeb3fba665d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:35.273948 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:35.275462 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:35.276316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:35.276316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:35.276316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:35.276316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:35.276316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:35.276316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:35.276316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:35.276316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:35.276316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:35.276316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:35.276316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:34:35.276316 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:35.276914 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 88/167] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:35.278358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7aa7b-042e-4777-a276-aeb3fba665d0 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:35.365708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:35.427406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a382a7-7112-4f21-991e-942e0c0cca18 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:35.467536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:35.501130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7aa7b-042e-4777-a276-aeb3fba665d0 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:35.518583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a2926-9a49-4e65-adcd-bac32fae4778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:35.519294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a2926-9a49-4e65-adcd-bac32fae4778 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:35.519576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a2926-9a49-4e65-adcd-bac32fae4778 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:35.519850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a2926-9a49-4e65-adcd-bac32fae4778 None admin] PATH_INFO: `/v3/users/a6d309261b4e4134aae2ca007b31a433` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:35.521073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a2926-9a49-4e65-adcd-bac32fae4778 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d309261b4e4134aae2ca007b31a433)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:35.522550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a2926-9a49-4e65-adcd-bac32fae4778 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:35.524748 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 80/168] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:35 2022] GET /identity/v3/users/a6d309261b4e4134aae2ca007b31a433 => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:35.525542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a2926-9a49-4e65-adcd-bac32fae4778 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:35.582668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a414d-9d71-4c5d-8b53-27dd781375ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:35.583334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a414d-9d71-4c5d-8b53-27dd781375ec None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:35.583608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a414d-9d71-4c5d-8b53-27dd781375ec None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:35.583880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a414d-9d71-4c5d-8b53-27dd781375ec None admin] PATH_INFO: `/v3/users/a6d309261b4e4134aae2ca007b31a433` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:35.585285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a414d-9d71-4c5d-8b53-27dd781375ec None admin] RBAC: Authorizing `identity:get_user(user_id=a6d309261b4e4134aae2ca007b31a433)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:35.587339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a414d-9d71-4c5d-8b53-27dd781375ec None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:35.590411 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 89/169] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:35 2022] GET /identity/v3/users/a6d309261b4e4134aae2ca007b31a433 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:35.591343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a414d-9d71-4c5d-8b53-27dd781375ec None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:35.729164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a2926-9a49-4e65-adcd-bac32fae4778 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:35.786900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10acb4-e47e-405c-8e2a-799c5b31ec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:35.787899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10acb4-e47e-405c-8e2a-799c5b31ec99 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:35.788378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10acb4-e47e-405c-8e2a-799c5b31ec99 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:35.788845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10acb4-e47e-405c-8e2a-799c5b31ec99 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:35.789777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10acb4-e47e-405c-8e2a-799c5b31ec99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:35.790302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10acb4-e47e-405c-8e2a-799c5b31ec99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:35.791875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10acb4-e47e-405c-8e2a-799c5b31ec99 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:35.801527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a414d-9d71-4c5d-8b53-27dd781375ec None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:35.808041 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 81/170] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:35.809145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10acb4-e47e-405c-8e2a-799c5b31ec99 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:35.824136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:35.873912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32422d-5cdd-4afe-b037-d8034edb396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:35.874544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32422d-5cdd-4afe-b037-d8034edb396c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:35.874821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32422d-5cdd-4afe-b037-d8034edb396c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:35.875199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32422d-5cdd-4afe-b037-d8034edb396c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:35.894319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:35.997299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10acb4-e47e-405c-8e2a-799c5b31ec99 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:36.008041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32422d-5cdd-4afe-b037-d8034edb396c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:36.015845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32422d-5cdd-4afe-b037-d8034edb396c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:36.110304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b374c-4a11-4577-be0c-bd0ca57fb092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:36.111236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b374c-4a11-4577-be0c-bd0ca57fb092 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:36.111514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b374c-4a11-4577-be0c-bd0ca57fb092 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:36.111783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b374c-4a11-4577-be0c-bd0ca57fb092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:36.150771 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 90/171] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:36.152245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32422d-5cdd-4afe-b037-d8034edb396c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:36.167334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:36.264429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32422d-5cdd-4afe-b037-d8034edb396c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:36.266138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b374c-4a11-4577-be0c-bd0ca57fb092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:36.267886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b374c-4a11-4577-be0c-bd0ca57fb092 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:36.304122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb5ef7-1e87-439f-a8ef-1947427d6fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:36.305084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb5ef7-1e87-439f-a8ef-1947427d6fc3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:36.306145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb5ef7-1e87-439f-a8ef-1947427d6fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:36.306981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb5ef7-1e87-439f-a8ef-1947427d6fc3 None admin] PATH_INFO: `/v3/users/a6d309261b4e4134aae2ca007b31a433` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:36.308334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb5ef7-1e87-439f-a8ef-1947427d6fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d309261b4e4134aae2ca007b31a433)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:36.309998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb5ef7-1e87-439f-a8ef-1947427d6fc3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:36.312292 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 91/172] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:36 2022] GET /identity/v3/users/a6d309261b4e4134aae2ca007b31a433 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:36.313274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb5ef7-1e87-439f-a8ef-1947427d6fc3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:36.386745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:36.409168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:36.431776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb5ef7-1e87-439f-a8ef-1947427d6fc3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:36.469396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d567f25-02a8-43fc-99fe-a7df3f9aa07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:36.470397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d567f25-02a8-43fc-99fe-a7df3f9aa07a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:36.471371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d567f25-02a8-43fc-99fe-a7df3f9aa07a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:36.471841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d567f25-02a8-43fc-99fe-a7df3f9aa07a None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:36.473176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d567f25-02a8-43fc-99fe-a7df3f9aa07a None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:36.476453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d567f25-02a8-43fc-99fe-a7df3f9aa07a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:36.476777 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 92/173] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:36 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:36.479352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d567f25-02a8-43fc-99fe-a7df3f9aa07a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:36.524349 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 82/174] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:36.526033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b374c-4a11-4577-be0c-bd0ca57fb092 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:36.717703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d567f25-02a8-43fc-99fe-a7df3f9aa07a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:36.761104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b374c-4a11-4577-be0c-bd0ca57fb092 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:36.784662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cfeda-415d-4741-b073-e137ce4e3da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:36.785213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cfeda-415d-4741-b073-e137ce4e3da4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:36.785501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cfeda-415d-4741-b073-e137ce4e3da4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:36.785771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cfeda-415d-4741-b073-e137ce4e3da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:36.815655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:36.828607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed1c88-4168-4154-979d-90586089ce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:36.829241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed1c88-4168-4154-979d-90586089ce8a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:36.829523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed1c88-4168-4154-979d-90586089ce8a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:36.829791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed1c88-4168-4154-979d-90586089ce8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:36.830527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed1c88-4168-4154-979d-90586089ce8a None admin] RBAC: Adding query filter params (role.id=27431c49ccd74f7a898d1a39e251ce29, scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc, user.id=a6d309261b4e4134aae2ca007b31a433) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:36.830834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed1c88-4168-4154-979d-90586089ce8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:36.832275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed1c88-4168-4154-979d-90586089ce8a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:36.842512 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 83/175] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:36 2022] GET /identity/v3/role_assignments?user.id=a6d309261b4e4134aae2ca007b31a433&scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc&role.id=27431c49ccd74f7a898d1a39e251ce29 => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:36.843132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed1c88-4168-4154-979d-90586089ce8a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:36.877576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:36.920423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cfeda-415d-4741-b073-e137ce4e3da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:36.921918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cfeda-415d-4741-b073-e137ce4e3da4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:37.058483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed1c88-4168-4154-979d-90586089ce8a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:37.122120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1da15-1975-46ab-8f32-0dbd539910f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:37.124176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1da15-1975-46ab-8f32-0dbd539910f4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.124685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1da15-1975-46ab-8f32-0dbd539910f4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.125104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1da15-1975-46ab-8f32-0dbd539910f4 None admin] PATH_INFO: `/v3/projects/7ddb3df85a334e199cffabad3fa1572c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.126766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1da15-1975-46ab-8f32-0dbd539910f4 None admin] RBAC: Authorizing `identity:get_project(project_id=7ddb3df85a334e199cffabad3fa1572c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:37.127459 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 93/176] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:37.128596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1da15-1975-46ab-8f32-0dbd539910f4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:37.130516 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 84/177] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:36 2022] GET /identity/v3/projects/7ddb3df85a334e199cffabad3fa1572c => generated 312 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:37.132799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cfeda-415d-4741-b073-e137ce4e3da4 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:37.137137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1da15-1975-46ab-8f32-0dbd539910f4 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:37.239281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:37.297609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:37.329677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1da15-1975-46ab-8f32-0dbd539910f4 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:37.370937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cfeda-415d-4741-b073-e137ce4e3da4 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:37.400378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddd09e-9ced-47f1-9633-275bae59fb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:37.401008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddd09e-9ced-47f1-9633-275bae59fb5f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.401309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddd09e-9ced-47f1-9633-275bae59fb5f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.401579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddd09e-9ced-47f1-9633-275bae59fb5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.402317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddd09e-9ced-47f1-9633-275bae59fb5f None admin] RBAC: Adding query filter params (role.id=27431c49ccd74f7a898d1a39e251ce29, scope.project.id=7ddb3df85a334e199cffabad3fa1572c, user.id=a6d309261b4e4134aae2ca007b31a433) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:37.402885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddd09e-9ced-47f1-9633-275bae59fb5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:37.404341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddd09e-9ced-47f1-9633-275bae59fb5f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:37.418665 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 85/178] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:37 2022] GET /identity/v3/role_assignments?user.id=a6d309261b4e4134aae2ca007b31a433&scope.project.id=7ddb3df85a334e199cffabad3fa1572c&role.id=27431c49ccd74f7a898d1a39e251ce29 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:37.431295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa23c2e-f9c1-4968-9fe8-202bfa9d8cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:37.431965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa23c2e-f9c1-4968-9fe8-202bfa9d8cf0 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.432244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa23c2e-f9c1-4968-9fe8-202bfa9d8cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.432515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa23c2e-f9c1-4968-9fe8-202bfa9d8cf0 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.437964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa23c2e-f9c1-4968-9fe8-202bfa9d8cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:37.439442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa23c2e-f9c1-4968-9fe8-202bfa9d8cf0 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:37.441138 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 94/179] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:37 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:37.448532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddd09e-9ced-47f1-9633-275bae59fb5f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:37.470494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c2c56-3dde-4048-ad9a-462240164f3f None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.470795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c2c56-3dde-4048-ad9a-462240164f3f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.471032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c2c56-3dde-4048-ad9a-462240164f3f None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.472388 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 95/180] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:37.480430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2f183-c713-433c-a65c-34134c7d8f9e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.480717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2f183-c713-433c-a65c-34134c7d8f9e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.480996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2f183-c713-433c-a65c-34134c7d8f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.505529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5df2f183-c713-433c-a65c-34134c7d8f9e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:37.506821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5df2f183-c713-433c-a65c-34134c7d8f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:37.597310 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 96/181] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:37.598701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2a41a-2aed-4263-b0ae-3eace9bd7ed9 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.598980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2a41a-2aed-4263-b0ae-3eace9bd7ed9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.599249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2a41a-2aed-4263-b0ae-3eace9bd7ed9 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.601877 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 97/182] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:37.607743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddd09e-9ced-47f1-9633-275bae59fb5f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:37.608217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849e2e2-4988-4393-a604-badbbca94f98 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.608217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849e2e2-4988-4393-a604-badbbca94f98 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.608478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849e2e2-4988-4393-a604-badbbca94f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.630351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6849e2e2-4988-4393-a604-badbbca94f98 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:37.631599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6849e2e2-4988-4393-a604-badbbca94f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:37.651512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2c031-6c61-4901-9e08-14dc3001c31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:37.652412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2c031-6c61-4901-9e08-14dc3001c31b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.652693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2c031-6c61-4901-9e08-14dc3001c31b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.652966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2c031-6c61-4901-9e08-14dc3001c31b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.654050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2c031-6c61-4901-9e08-14dc3001c31b None admin] RBAC: Adding query filter params (role.id=94f39d4bced64cc98e66bceafe049303, scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc, user.id=a6d309261b4e4134aae2ca007b31a433) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:37.654759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2c031-6c61-4901-9e08-14dc3001c31b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:37.656303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2c031-6c61-4901-9e08-14dc3001c31b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:37.666019 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 86/183] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:37 2022] GET /identity/v3/role_assignments?user.id=a6d309261b4e4134aae2ca007b31a433&scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc&role.id=94f39d4bced64cc98e66bceafe049303 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:37.695966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:37.739873 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 98/184] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:37.821298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3cdda-45dc-4296-814b-48be89acea68 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.821649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3cdda-45dc-4296-814b-48be89acea68 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.821930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3cdda-45dc-4296-814b-48be89acea68 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.823381 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 87/185] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:37.829390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9013e-1b0f-4462-bf17-972674641502 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.829689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9013e-1b0f-4462-bf17-972674641502 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.829934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9013e-1b0f-4462-bf17-972674641502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.859019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-37d9013e-1b0f-4462-bf17-972674641502 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:37.860153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-37d9013e-1b0f-4462-bf17-972674641502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:37.948406 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 99/186] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:38.008189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3cdda-45dc-4296-814b-48be89acea68 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:38.020897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:38.131155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3cdda-45dc-4296-814b-48be89acea68 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:38.172328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209db36-c492-459c-a6bf-eee2533dc127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:38.172961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209db36-c492-459c-a6bf-eee2533dc127 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:38.173305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209db36-c492-459c-a6bf-eee2533dc127 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:38.173579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209db36-c492-459c-a6bf-eee2533dc127 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:38.184164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209db36-c492-459c-a6bf-eee2533dc127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-a209db36-c492-459c-a6bf-eee2533dc127 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:38.188961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:38.191029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:38.192973 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:38.192973 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:38.192973 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:38.192973 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:38.192973 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:38.192973 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:38.192973 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:38.192973 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:38.192973 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:38.192973 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:38.192973 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:38.192973 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:38.192973 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 88/187] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:34:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:38.198660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9013e-1b0f-4462-bf17-972674641502 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:38.243760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209db36-c492-459c-a6bf-eee2533dc127 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:38.327292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:38.333428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9013e-1b0f-4462-bf17-972674641502 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:38.342392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:38.366113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209db36-c492-459c-a6bf-eee2533dc127 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:38.373035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9572733-d235-4a51-b885-4e2769b6c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:38.373680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9572733-d235-4a51-b885-4e2769b6c3c2 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:38.373957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9572733-d235-4a51-b885-4e2769b6c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:38.374227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9572733-d235-4a51-b885-4e2769b6c3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:38.374886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9572733-d235-4a51-b885-4e2769b6c3c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:38.375189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9572733-d235-4a51-b885-4e2769b6c3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:38.376545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9572733-d235-4a51-b885-4e2769b6c3c2 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:38.385537 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 100/188] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:38.390640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9572733-d235-4a51-b885-4e2769b6c3c2 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:38.406156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24143ed-f0b4-46a8-8729-f2f0c3a5a3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:38.406797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24143ed-f0b4-46a8-8729-f2f0c3a5a3dd None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:38.407066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24143ed-f0b4-46a8-8729-f2f0c3a5a3dd None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:38.407334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24143ed-f0b4-46a8-8729-f2f0c3a5a3dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:38.408460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24143ed-f0b4-46a8-8729-f2f0c3a5a3dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:38.409922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24143ed-f0b4-46a8-8729-f2f0c3a5a3dd None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:38.411631 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 89/189] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:38.414032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24143ed-f0b4-46a8-8729-f2f0c3a5a3dd None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:38.505156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9572733-d235-4a51-b885-4e2769b6c3c2 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:38.519330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24143ed-f0b4-46a8-8729-f2f0c3a5a3dd None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:38.541608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77549e8-a52d-4fe7-939f-c4e8fb6b0c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:38.542244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77549e8-a52d-4fe7-939f-c4e8fb6b0c53 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:38.542521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77549e8-a52d-4fe7-939f-c4e8fb6b0c53 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:38.542795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77549e8-a52d-4fe7-939f-c4e8fb6b0c53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:38.553464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77549e8-a52d-4fe7-939f-c4e8fb6b0c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:38.555197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3415a4e-baaf-4c0f-ac9e-80f9e8137ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:38.555907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3415a4e-baaf-4c0f-ac9e-80f9e8137ae4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:38.556187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3415a4e-baaf-4c0f-ac9e-80f9e8137ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:38.556461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3415a4e-baaf-4c0f-ac9e-80f9e8137ae4 None admin] PATH_INFO: `/v3/users/8b695d820611484e9515b984ef161ea7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-e77549e8-a52d-4fe7-939f-c4e8fb6b0c53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:38.558768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:38.559628 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:38.560416 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:38.560416 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:38.560416 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:38.560416 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:38.560416 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:38.560416 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:38.560416 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:38.560416 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:38.560416 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:38.560416 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:38.560416 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:34:38.560416 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:38.560416 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 101/190] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:38.561070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77549e8-a52d-4fe7-939f-c4e8fb6b0c53 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:38.562904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:38.576402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3415a4e-baaf-4c0f-ac9e-80f9e8137ae4 None admin] RBAC: Authorizing `identity:get_user(user_id=8b695d820611484e9515b984ef161ea7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:38.577961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3415a4e-baaf-4c0f-ac9e-80f9e8137ae4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:38.580058 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 90/191] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:38 2022] GET /identity/v3/users/8b695d820611484e9515b984ef161ea7 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:38.580759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3415a4e-baaf-4c0f-ac9e-80f9e8137ae4 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:38.593902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:38.669065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77549e8-a52d-4fe7-939f-c4e8fb6b0c53 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:38.681636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3415a4e-baaf-4c0f-ac9e-80f9e8137ae4 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:38.701476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3607c-07a7-4364-b4c2-5d75c7b0c809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:38.702081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3607c-07a7-4364-b4c2-5d75c7b0c809 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:38.702357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3607c-07a7-4364-b4c2-5d75c7b0c809 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:38.702629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3607c-07a7-4364-b4c2-5d75c7b0c809 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:38.703273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3607c-07a7-4364-b4c2-5d75c7b0c809 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:38.704704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3607c-07a7-4364-b4c2-5d75c7b0c809 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:38.715850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcc018-dec5-4590-8bd2-a07845d69fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:38.716610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcc018-dec5-4590-8bd2-a07845d69fef None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:38.717004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcc018-dec5-4590-8bd2-a07845d69fef None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:38.717278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcc018-dec5-4590-8bd2-a07845d69fef None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:38.718057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcc018-dec5-4590-8bd2-a07845d69fef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:38.718417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcc018-dec5-4590-8bd2-a07845d69fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:38.719963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcc018-dec5-4590-8bd2-a07845d69fef None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:38.733796 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 91/192] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:38.733796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15242170-6aec-4194-826b-79fc4b0e7bfa None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:38.733796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15242170-6aec-4194-826b-79fc4b0e7bfa None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:38.733796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15242170-6aec-4194-826b-79fc4b0e7bfa None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:38.733796 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 92/193] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:38.733796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15242170-6aec-4194-826b-79fc4b0e7bfa None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:38.739932 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 102/194] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:34:38 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:38.740766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3607c-07a7-4364-b4c2-5d75c7b0c809 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:38.819930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:38.843798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:38.866073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3607c-07a7-4364-b4c2-5d75c7b0c809 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:38.872331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15242170-6aec-4194-826b-79fc4b0e7bfa None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:38.908645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9e3de-f698-4e00-b19d-0c54fec4c5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:38.908903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459df50-2520-4758-bd84-1ae1af08330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:38.909348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9e3de-f698-4e00-b19d-0c54fec4c5e8 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:38.909450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459df50-2520-4758-bd84-1ae1af08330d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:38.909630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9e3de-f698-4e00-b19d-0c54fec4c5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:38.909725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459df50-2520-4758-bd84-1ae1af08330d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:38.909901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9e3de-f698-4e00-b19d-0c54fec4c5e8 None admin] PATH_INFO: `/v3/users/8b695d820611484e9515b984ef161ea7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:38.909994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459df50-2520-4758-bd84-1ae1af08330d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:38.911121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9e3de-f698-4e00-b19d-0c54fec4c5e8 None admin] RBAC: Authorizing `identity:get_user(user_id=8b695d820611484e9515b984ef161ea7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:38.912602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9e3de-f698-4e00-b19d-0c54fec4c5e8 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:38.914458 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 103/195] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:38 2022] GET /identity/v3/users/8b695d820611484e9515b984ef161ea7 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:38.920431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036278a-60f3-4583-897d-3b62835306ba None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:38.920637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036278a-60f3-4583-897d-3b62835306ba None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:38.920919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036278a-60f3-4583-897d-3b62835306ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:38.940583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3036278a-60f3-4583-897d-3b62835306ba None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:38.942050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3036278a-60f3-4583-897d-3b62835306ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:38.991232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459df50-2520-4758-bd84-1ae1af08330d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:38.992707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459df50-2520-4758-bd84-1ae1af08330d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:39.027391 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 104/196] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:39.034081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036278a-60f3-4583-897d-3b62835306ba None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:39.061979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:39.119498 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 93/197] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:39.127825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459df50-2520-4758-bd84-1ae1af08330d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:39.155797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:39.177506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036278a-60f3-4583-897d-3b62835306ba None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:39.217034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bfb71-2765-40c6-b641-6db3b19f3905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:39.217722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bfb71-2765-40c6-b641-6db3b19f3905 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:39.218008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bfb71-2765-40c6-b641-6db3b19f3905 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:39.218286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bfb71-2765-40c6-b641-6db3b19f3905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:39.255912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459df50-2520-4758-bd84-1ae1af08330d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:39.302386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f37bdf-ddfe-47db-b325-4f23336a5d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:39.303841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f37bdf-ddfe-47db-b325-4f23336a5d3e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:39.304297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f37bdf-ddfe-47db-b325-4f23336a5d3e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:39.304977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f37bdf-ddfe-47db-b325-4f23336a5d3e None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:39.305696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bfb71-2765-40c6-b641-6db3b19f3905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:39.306454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f37bdf-ddfe-47db-b325-4f23336a5d3e None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:39.307221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bfb71-2765-40c6-b641-6db3b19f3905 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:39.308202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f37bdf-ddfe-47db-b325-4f23336a5d3e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:39.310581 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 94/198] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:39 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:39.317073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f37bdf-ddfe-47db-b325-4f23336a5d3e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:39.369577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:39.417958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:39.426213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f37bdf-ddfe-47db-b325-4f23336a5d3e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:39.444052 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 105/199] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:39.454777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bfb71-2765-40c6-b641-6db3b19f3905 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:39.468872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddbb0c-fbb4-4a95-a274-d8ebd522fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:39.469523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddbb0c-fbb4-4a95-a274-d8ebd522fad0 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:39.469803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddbb0c-fbb4-4a95-a274-d8ebd522fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:39.470076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddbb0c-fbb4-4a95-a274-d8ebd522fad0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:39.470809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddbb0c-fbb4-4a95-a274-d8ebd522fad0 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=a453d14403a142248aefae9ff0bf5691, user.id=8b695d820611484e9515b984ef161ea7) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:39.471222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddbb0c-fbb4-4a95-a274-d8ebd522fad0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:39.472766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddbb0c-fbb4-4a95-a274-d8ebd522fad0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:39.478899 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 95/200] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:39 2022] GET /identity/v3/role_assignments?user.id=8b695d820611484e9515b984ef161ea7&scope.project.id=a453d14403a142248aefae9ff0bf5691&role.id=a409f81bd5744563a303a825783bed61 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:39.479810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddbb0c-fbb4-4a95-a274-d8ebd522fad0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:39.647437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bfb71-2765-40c6-b641-6db3b19f3905 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:39.656295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:39.688227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddbb0c-fbb4-4a95-a274-d8ebd522fad0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:39.703367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dd308-08b2-405a-b0fe-5976fcbbc517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:39.704021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dd308-08b2-405a-b0fe-5976fcbbc517 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:39.704302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dd308-08b2-405a-b0fe-5976fcbbc517 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:39.704568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dd308-08b2-405a-b0fe-5976fcbbc517 None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:39.705751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dd308-08b2-405a-b0fe-5976fcbbc517 None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:39.708305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dd308-08b2-405a-b0fe-5976fcbbc517 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:39.709554 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 106/201] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:39 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:39.719767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dd308-08b2-405a-b0fe-5976fcbbc517 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:39.762415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18283f22-6988-4196-b357-3464e069db9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:39.763070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18283f22-6988-4196-b357-3464e069db9f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:39.763353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18283f22-6988-4196-b357-3464e069db9f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:39.763630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18283f22-6988-4196-b357-3464e069db9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:39.794080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18283f22-6988-4196-b357-3464e069db9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:39.794706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-18283f22-6988-4196-b357-3464e069db9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:39.807563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:39.808589 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:39.809408 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:39.809408 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:39.809408 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:39.809408 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:39.809408 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:39.809408 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:39.809408 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:39.809408 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:39.809408 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:39.809408 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:39.809408 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:39.809408 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:39.812000 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 96/202] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:39.822271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18283f22-6988-4196-b357-3464e069db9f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:39.841759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dd308-08b2-405a-b0fe-5976fcbbc517 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:39.880073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c96d94-cf0c-416f-8ece-b54d644960ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:39.880690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c96d94-cf0c-416f-8ece-b54d644960ca None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:39.880981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c96d94-cf0c-416f-8ece-b54d644960ca None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:39.881380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c96d94-cf0c-416f-8ece-b54d644960ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:39.882414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c96d94-cf0c-416f-8ece-b54d644960ca None admin] RBAC: Adding query filter params (role.id=94f39d4bced64cc98e66bceafe049303, scope.project.id=a453d14403a142248aefae9ff0bf5691, user.id=8b695d820611484e9515b984ef161ea7) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:39.882736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c96d94-cf0c-416f-8ece-b54d644960ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:39.884224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c96d94-cf0c-416f-8ece-b54d644960ca None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:39.890908 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 107/203] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:39 2022] GET /identity/v3/role_assignments?user.id=8b695d820611484e9515b984ef161ea7&scope.project.id=a453d14403a142248aefae9ff0bf5691&role.id=94f39d4bced64cc98e66bceafe049303 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:40.003792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18283f22-6988-4196-b357-3464e069db9f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:40.063413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94389fb-c457-4419-a2c5-545fa201e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:40.064032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94389fb-c457-4419-a2c5-545fa201e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:40.064315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94389fb-c457-4419-a2c5-545fa201e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:40.064590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94389fb-c457-4419-a2c5-545fa201e7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:40.065287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94389fb-c457-4419-a2c5-545fa201e7f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:40.065593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94389fb-c457-4419-a2c5-545fa201e7f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:40.067142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94389fb-c457-4419-a2c5-545fa201e7f6 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:40.081101 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 97/204] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:40.087357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c96d94-cf0c-416f-8ece-b54d644960ca None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:40.218558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c96d94-cf0c-416f-8ece-b54d644960ca None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:40.234385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:40.260445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb89c8-f0f1-47af-9ae0-f7577558bacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:40.261011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb89c8-f0f1-47af-9ae0-f7577558bacd None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:40.261320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb89c8-f0f1-47af-9ae0-f7577558bacd None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:40.261597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb89c8-f0f1-47af-9ae0-f7577558bacd None admin] PATH_INFO: `/v3/users/b179e4fdb06640c3b1707390f1a32fc8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:40.262743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb89c8-f0f1-47af-9ae0-f7577558bacd None admin] RBAC: Authorizing `identity:get_user(user_id=b179e4fdb06640c3b1707390f1a32fc8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:40.264185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb89c8-f0f1-47af-9ae0-f7577558bacd None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:40.265957 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 108/205] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:40 2022] GET /identity/v3/users/b179e4fdb06640c3b1707390f1a32fc8 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:40.271396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94389fb-c457-4419-a2c5-545fa201e7f6 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:40.286602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:40.404600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94389fb-c457-4419-a2c5-545fa201e7f6 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:40.452438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70e31b-4a1b-417d-9f81-44b1e786b650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:40.453053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e31b-4a1b-417d-9f81-44b1e786b650 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:40.453361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e31b-4a1b-417d-9f81-44b1e786b650 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:40.453631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e31b-4a1b-417d-9f81-44b1e786b650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:40.565235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70e31b-4a1b-417d-9f81-44b1e786b650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:40.566630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70e31b-4a1b-417d-9f81-44b1e786b650 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:40.587161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:40.716896 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 98/206] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:40.722350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb89c8-f0f1-47af-9ae0-f7577558bacd None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:40.827143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb89c8-f0f1-47af-9ae0-f7577558bacd None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:40.876241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8de31b-721f-4fab-ac2d-3453ddadad15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:40.877294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8de31b-721f-4fab-ac2d-3453ddadad15 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:40.877812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8de31b-721f-4fab-ac2d-3453ddadad15 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:40.878281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8de31b-721f-4fab-ac2d-3453ddadad15 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:40.885869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8de31b-721f-4fab-ac2d-3453ddadad15 None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:40.887526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8de31b-721f-4fab-ac2d-3453ddadad15 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:40.889903 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 109/207] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:40 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:40.895607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70e31b-4a1b-417d-9f81-44b1e786b650 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:41.041059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70e31b-4a1b-417d-9f81-44b1e786b650 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:41.060511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:41.090992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6c385-168d-4fa3-855a-51780299debe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:41.091913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6c385-168d-4fa3-855a-51780299debe None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:41.092392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6c385-168d-4fa3-855a-51780299debe None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:41.092885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6c385-168d-4fa3-855a-51780299debe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:41.093832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6c385-168d-4fa3-855a-51780299debe None admin] RBAC: Adding query filter params (role.id=e56cb0010cc3451ba5b280b4d1ca76a6, scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc, user.id=b179e4fdb06640c3b1707390f1a32fc8) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:41.094343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6c385-168d-4fa3-855a-51780299debe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:41.095987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6c385-168d-4fa3-855a-51780299debe None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:41.108116 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 99/208] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:40 2022] GET /identity/v3/role_assignments?user.id=b179e4fdb06640c3b1707390f1a32fc8&scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc&role.id=e56cb0010cc3451ba5b280b4d1ca76a6 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:41.934978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d97021-7f8e-43c3-b641-d7d72daf4255 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:41.935464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d97021-7f8e-43c3-b641-d7d72daf4255 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:41.935464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d97021-7f8e-43c3-b641-d7d72daf4255 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:41.936920 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 110/209] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:41.942470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e8f9-bb24-4a6b-bf87-1457eda1745f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:41.943307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e8f9-bb24-4a6b-bf87-1457eda1745f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:41.943826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e8f9-bb24-4a6b-bf87-1457eda1745f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:41.962970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-09a7e8f9-bb24-4a6b-bf87-1457eda1745f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:41.964491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-09a7e8f9-bb24-4a6b-bf87-1457eda1745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:41.991088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc320a5b-326b-481a-b0c7-7859c16d43d3 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:41.991392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc320a5b-326b-481a-b0c7-7859c16d43d3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:41.991634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc320a5b-326b-481a-b0c7-7859c16d43d3 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:41.993685 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 111/210] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:34:42.005423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc51f0e-c744-4ac2-b05b-e5d3d472fb42 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:42.005799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc51f0e-c744-4ac2-b05b-e5d3d472fb42 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:42.006144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc51f0e-c744-4ac2-b05b-e5d3d472fb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:42.034272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6fc51f0e-c744-4ac2-b05b-e5d3d472fb42 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:42.035739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6fc51f0e-c744-4ac2-b05b-e5d3d472fb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:42.047485 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 100/211] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:42.098573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:42.120597 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 112/212] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:42.163968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c879c-c8aa-4fb1-bb6b-47e8e3a573f3 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:42.163968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c879c-c8aa-4fb1-bb6b-47e8e3a573f3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:42.163968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c879c-c8aa-4fb1-bb6b-47e8e3a573f3 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:42.163968 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 101/213] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:34:42.169644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281476e2-7efb-45d3-9e35-9e54790bb380 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:42.170086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281476e2-7efb-45d3-9e35-9e54790bb380 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:42.170491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281476e2-7efb-45d3-9e35-9e54790bb380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:42.189133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-281476e2-7efb-45d3-9e35-9e54790bb380 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:42.190533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-281476e2-7efb-45d3-9e35-9e54790bb380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:42.257296 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 113/214] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:42.400651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c879c-c8aa-4fb1-bb6b-47e8e3a573f3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:42.472247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281476e2-7efb-45d3-9e35-9e54790bb380 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:42.523934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c879c-c8aa-4fb1-bb6b-47e8e3a573f3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:42.527559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:42.582816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305c4a3-f850-4857-ac6e-3b856d115aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:42.583460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c4a3-f850-4857-ac6e-3b856d115aa3 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:42.583741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c4a3-f850-4857-ac6e-3b856d115aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:42.584019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c4a3-f850-4857-ac6e-3b856d115aa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:42.597069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305c4a3-f850-4857-ac6e-3b856d115aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:42.599647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281476e2-7efb-45d3-9e35-9e54790bb380 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-7305c4a3-f850-4857-ac6e-3b856d115aa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:42.601976 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:42.602912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 102/215] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:42.608640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305c4a3-f850-4857-ac6e-3b856d115aa3 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:42.617830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:42.646143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad214a43-602a-4d01-8899-fd725798d9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:42.646790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214a43-602a-4d01-8899-fd725798d9da None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:42.647097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214a43-602a-4d01-8899-fd725798d9da None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:42.647370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214a43-602a-4d01-8899-fd725798d9da None admin] PATH_INFO: `/v3/domains/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:42.648482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad214a43-602a-4d01-8899-fd725798d9da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:42.650512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad214a43-602a-4d01-8899-fd725798d9da None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:42.657066 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 114/216] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:42.657954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad214a43-602a-4d01-8899-fd725798d9da None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:42.718591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305c4a3-f850-4857-ac6e-3b856d115aa3 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:42.755153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46853ddf-9180-40d5-88f1-ee00f9eefab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:42.755710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46853ddf-9180-40d5-88f1-ee00f9eefab2 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:42.755993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46853ddf-9180-40d5-88f1-ee00f9eefab2 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:42.756269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46853ddf-9180-40d5-88f1-ee00f9eefab2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:42.766916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46853ddf-9180-40d5-88f1-ee00f9eefab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:42.767618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad214a43-602a-4d01-8899-fd725798d9da None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-46853ddf-9180-40d5-88f1-ee00f9eefab2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:42.771702 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:42.772614 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 103/217] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:34:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:42.773782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46853ddf-9180-40d5-88f1-ee00f9eefab2 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:42.799706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:42.804413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4d561-e7f0-420f-99f2-9f113df7ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:42.805022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4d561-e7f0-420f-99f2-9f113df7ca0e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:42.805960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4d561-e7f0-420f-99f2-9f113df7ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:42.806237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4d561-e7f0-420f-99f2-9f113df7ca0e None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:42.806899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4d561-e7f0-420f-99f2-9f113df7ca0e None admin] RBAC: Adding query filter params (name=member) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:42.807204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4d561-e7f0-420f-99f2-9f113df7ca0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:42.808566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4d561-e7f0-420f-99f2-9f113df7ca0e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:42.816541 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 115/218] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:42.817798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6102c1-bcc1-44e7-a938-34f894daa399 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:42.818082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6102c1-bcc1-44e7-a938-34f894daa399 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:42.818351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6102c1-bcc1-44e7-a938-34f894daa399 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:42.819559 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 116/219] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:42.820242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6102c1-bcc1-44e7-a938-34f894daa399 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:42.863680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:42.877549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46853ddf-9180-40d5-88f1-ee00f9eefab2 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:42.911193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0ab23-09ad-457b-a601-b1c36217caf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:42.911798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0ab23-09ad-457b-a601-b1c36217caf8 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:42.912076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0ab23-09ad-457b-a601-b1c36217caf8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:42.912348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0ab23-09ad-457b-a601-b1c36217caf8 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:42.912983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0ab23-09ad-457b-a601-b1c36217caf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:42.914458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0ab23-09ad-457b-a601-b1c36217caf8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:42.928120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6102c1-bcc1-44e7-a938-34f894daa399 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:42.935639 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 104/220] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:34:42 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:42.936451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0ab23-09ad-457b-a601-b1c36217caf8 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:42.972445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c6b5c-01c7-4cbc-8fa6-4a85e7cab81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:42.973724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6b5c-01c7-4cbc-8fa6-4a85e7cab81d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:42.974157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6b5c-01c7-4cbc-8fa6-4a85e7cab81d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:42.974427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6b5c-01c7-4cbc-8fa6-4a85e7cab81d None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:42.975121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c6b5c-01c7-4cbc-8fa6-4a85e7cab81d None admin] RBAC: Adding query filter params (name=admin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:42.975429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c6b5c-01c7-4cbc-8fa6-4a85e7cab81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:42.976844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c6b5c-01c7-4cbc-8fa6-4a85e7cab81d None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:42.987251 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 117/221] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:42.988552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5167b-dd61-4aa0-9e3e-4adf86709151 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:42.988835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5167b-dd61-4aa0-9e3e-4adf86709151 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:42.989107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5167b-dd61-4aa0-9e3e-4adf86709151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:43.008344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-48b5167b-dd61-4aa0-9e3e-4adf86709151 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:43.010229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-48b5167b-dd61-4aa0-9e3e-4adf86709151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:43.030661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:43.054212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0ab23-09ad-457b-a601-b1c36217caf8 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:43.093798 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 118/222] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:43.093798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5167b-dd61-4aa0-9e3e-4adf86709151 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:43.099047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97eebd3-5a20-4607-bba6-e1ab282c7bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:43.099702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97eebd3-5a20-4607-bba6-e1ab282c7bb2 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:43.099984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97eebd3-5a20-4607-bba6-e1ab282c7bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:43.100257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97eebd3-5a20-4607-bba6-e1ab282c7bb2 None admin] PATH_INFO: `/v3/users/925ce3c1c15c405f811be6cb007002a0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:43.115641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97eebd3-5a20-4607-bba6-e1ab282c7bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=925ce3c1c15c405f811be6cb007002a0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:43.117162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97eebd3-5a20-4607-bba6-e1ab282c7bb2 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:43.119786 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 105/223] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:42 2022] GET /identity/v3/users/925ce3c1c15c405f811be6cb007002a0 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:43.126199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97eebd3-5a20-4607-bba6-e1ab282c7bb2 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:43.138512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:43.222857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5167b-dd61-4aa0-9e3e-4adf86709151 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:43.255434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97eebd3-5a20-4607-bba6-e1ab282c7bb2 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:43.272241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311d048-1871-40d5-b5ef-cd5732eca4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:43.273250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311d048-1871-40d5-b5ef-cd5732eca4f2 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:43.273741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311d048-1871-40d5-b5ef-cd5732eca4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:43.274258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311d048-1871-40d5-b5ef-cd5732eca4f2 None admin] PATH_INFO: `/v3/users/8b695d820611484e9515b984ef161ea7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:43.275597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311d048-1871-40d5-b5ef-cd5732eca4f2 None admin] RBAC: Authorizing `identity:get_user(user_id=8b695d820611484e9515b984ef161ea7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:43.278032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311d048-1871-40d5-b5ef-cd5732eca4f2 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:43.279870 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 119/224] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:43 2022] GET /identity/v3/users/8b695d820611484e9515b984ef161ea7 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:43.288100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311d048-1871-40d5-b5ef-cd5732eca4f2 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:43.294787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e74e1-1ad6-4c0b-9c0c-2e8011fd7df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:43.295186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e74e1-1ad6-4c0b-9c0c-2e8011fd7df2 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:43.295473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e74e1-1ad6-4c0b-9c0c-2e8011fd7df2 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:43.295748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e74e1-1ad6-4c0b-9c0c-2e8011fd7df2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:43.310453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:43.385893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e74e1-1ad6-4c0b-9c0c-2e8011fd7df2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:43.387668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e74e1-1ad6-4c0b-9c0c-2e8011fd7df2 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:43.423683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:43.427265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311d048-1871-40d5-b5ef-cd5732eca4f2 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:43.472246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73c26e-42cf-4212-bda7-bff611ddf657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:43.472891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73c26e-42cf-4212-bda7-bff611ddf657 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:43.473150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73c26e-42cf-4212-bda7-bff611ddf657 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:43.473448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73c26e-42cf-4212-bda7-bff611ddf657 None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:43.474645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73c26e-42cf-4212-bda7-bff611ddf657 None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:43.476103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73c26e-42cf-4212-bda7-bff611ddf657 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:43.478645 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 120/225] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:43 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:43.479436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73c26e-42cf-4212-bda7-bff611ddf657 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:43.543669 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 106/226] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:34:43.544705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e74e1-1ad6-4c0b-9c0c-2e8011fd7df2 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:43.591721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:43.627050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73c26e-42cf-4212-bda7-bff611ddf657 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:43.663555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149d602-f914-4301-8edc-a3abfb1b9d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:43.664349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149d602-f914-4301-8edc-a3abfb1b9d31 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:43.665300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149d602-f914-4301-8edc-a3abfb1b9d31 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:43.665789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149d602-f914-4301-8edc-a3abfb1b9d31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:43.672828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e74e1-1ad6-4c0b-9c0c-2e8011fd7df2 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:43.678548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149d602-f914-4301-8edc-a3abfb1b9d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-8149d602-f914-4301-8edc-a3abfb1b9d31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:43.683760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:43.684660 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 121/227] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:43.690478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149d602-f914-4301-8edc-a3abfb1b9d31 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:43.717756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e1348-8389-448e-8b0d-6002ee92f09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:43.718607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:43.718910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e1348-8389-448e-8b0d-6002ee92f09a None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:43.719545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e1348-8389-448e-8b0d-6002ee92f09a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:43.720041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e1348-8389-448e-8b0d-6002ee92f09a None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691/users/8b695d820611484e9515b984ef161ea7/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:43.722356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e1348-8389-448e-8b0d-6002ee92f09a None admin] RBAC: Authorizing `identity:create_grant(project_id=a453d14403a142248aefae9ff0bf5691, user_id=8b695d820611484e9515b984ef161ea7, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:43.724009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e1348-8389-448e-8b0d-6002ee92f09a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:43.743178 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 107/228] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:34:43 2022] PUT /identity/v3/projects/a453d14403a142248aefae9ff0bf5691/users/8b695d820611484e9515b984ef161ea7/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:34:43.744721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e1348-8389-448e-8b0d-6002ee92f09a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:43.799570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149d602-f914-4301-8edc-a3abfb1b9d31 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:43.836111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cbd01-db6f-412f-a180-9448b2264d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:43.837328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cbd01-db6f-412f-a180-9448b2264d8c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:43.837591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cbd01-db6f-412f-a180-9448b2264d8c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:43.837858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cbd01-db6f-412f-a180-9448b2264d8c None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:43.839101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cbd01-db6f-412f-a180-9448b2264d8c None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:43.840685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cbd01-db6f-412f-a180-9448b2264d8c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:43.842636 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 122/229] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:43 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:43.848795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cbd01-db6f-412f-a180-9448b2264d8c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:43.865533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:43.870554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e1348-8389-448e-8b0d-6002ee92f09a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:43.918532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bfc80-6d71-4e9f-ad35-6c6913c39ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:43.919697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bfc80-6d71-4e9f-ad35-6c6913c39ef9 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:43.920263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bfc80-6d71-4e9f-ad35-6c6913c39ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:43.920736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bfc80-6d71-4e9f-ad35-6c6913c39ef9 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:43.921684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bfc80-6d71-4e9f-ad35-6c6913c39ef9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:43.922385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bfc80-6d71-4e9f-ad35-6c6913c39ef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:43.924168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bfc80-6d71-4e9f-ad35-6c6913c39ef9 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:43.934163 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 108/230] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:43.940250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bfc80-6d71-4e9f-ad35-6c6913c39ef9 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:43.959177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:43.966069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cbd01-db6f-412f-a180-9448b2264d8c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:44.005115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0141a-f8d4-480f-a6af-555aa1eecf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:44.006347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0141a-f8d4-480f-a6af-555aa1eecf3a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:44.006347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0141a-f8d4-480f-a6af-555aa1eecf3a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:44.006347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0141a-f8d4-480f-a6af-555aa1eecf3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:44.006988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0141a-f8d4-480f-a6af-555aa1eecf3a None admin] RBAC: Adding query filter params (role.id=27431c49ccd74f7a898d1a39e251ce29, scope.project.id=a453d14403a142248aefae9ff0bf5691, user.id=925ce3c1c15c405f811be6cb007002a0) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:44.007288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0141a-f8d4-480f-a6af-555aa1eecf3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:44.009273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0141a-f8d4-480f-a6af-555aa1eecf3a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:44.016731 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 123/231] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:43 2022] GET /identity/v3/role_assignments?user.id=925ce3c1c15c405f811be6cb007002a0&scope.project.id=a453d14403a142248aefae9ff0bf5691&role.id=27431c49ccd74f7a898d1a39e251ce29 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:44.064461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bfc80-6d71-4e9f-ad35-6c6913c39ef9 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:44.103839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f4d71-c394-4d06-b4ec-425836e33b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:44.104865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f4d71-c394-4d06-b4ec-425836e33b70 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:44.105390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f4d71-c394-4d06-b4ec-425836e33b70 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:44.105866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f4d71-c394-4d06-b4ec-425836e33b70 None admin] PATH_INFO: `/v3/users/8b695d820611484e9515b984ef161ea7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:44.107286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f4d71-c394-4d06-b4ec-425836e33b70 None admin] RBAC: Authorizing `identity:get_user(user_id=8b695d820611484e9515b984ef161ea7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:44.108986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f4d71-c394-4d06-b4ec-425836e33b70 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:44.110920 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 109/232] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:43 2022] GET /identity/v3/users/8b695d820611484e9515b984ef161ea7 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:44.116998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0141a-f8d4-480f-a6af-555aa1eecf3a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:44.244107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0141a-f8d4-480f-a6af-555aa1eecf3a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:44.287542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edc1bf-fc42-4501-8b33-40b18cac466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:44.288568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc1bf-fc42-4501-8b33-40b18cac466f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:44.289050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc1bf-fc42-4501-8b33-40b18cac466f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:44.289546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc1bf-fc42-4501-8b33-40b18cac466f None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:44.290913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edc1bf-fc42-4501-8b33-40b18cac466f None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:44.292643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edc1bf-fc42-4501-8b33-40b18cac466f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:44.294516 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 124/233] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:44 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:44.300308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f4d71-c394-4d06-b4ec-425836e33b70 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:44.331151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:44.417983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f4d71-c394-4d06-b4ec-425836e33b70 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:44.453251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacab89c-dfba-4e66-8dfb-5a15dae102b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:44.453973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab89c-dfba-4e66-8dfb-5a15dae102b6 None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:44.454258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab89c-dfba-4e66-8dfb-5a15dae102b6 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:44.454535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab89c-dfba-4e66-8dfb-5a15dae102b6 None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691/users/8b695d820611484e9515b984ef161ea7/roles/94f39d4bced64cc98e66bceafe049303` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:44.456728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacab89c-dfba-4e66-8dfb-5a15dae102b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a453d14403a142248aefae9ff0bf5691, user_id=8b695d820611484e9515b984ef161ea7, role_id=94f39d4bced64cc98e66bceafe049303)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:44.458219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacab89c-dfba-4e66-8dfb-5a15dae102b6 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:44.476093 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 110/234] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:34:44 2022] PUT /identity/v3/projects/a453d14403a142248aefae9ff0bf5691/users/8b695d820611484e9515b984ef161ea7/roles/94f39d4bced64cc98e66bceafe049303 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:34:46.099647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca480a-2baf-40aa-bcac-cff82c3f8b34 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:46.100754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca480a-2baf-40aa-bcac-cff82c3f8b34 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:46.101293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca480a-2baf-40aa-bcac-cff82c3f8b34 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:46.103765 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 125/235] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:46.109502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64ebf8-8d07-4b54-a1f1-61e4b2fe31a5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:46.110312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64ebf8-8d07-4b54-a1f1-61e4b2fe31a5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:46.110780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64ebf8-8d07-4b54-a1f1-61e4b2fe31a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:46.129514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb57a-4e12-4d43-9b6e-565a1d9a106e None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:46.130109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb57a-4e12-4d43-9b6e-565a1d9a106e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:46.130577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb57a-4e12-4d43-9b6e-565a1d9a106e None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:46.132100 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 126/236] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:34:46.137809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1afe3-a4dc-4169-9db3-959eddd8eb72 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:46.138098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1afe3-a4dc-4169-9db3-959eddd8eb72 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:46.138382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1afe3-a4dc-4169-9db3-959eddd8eb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:46.142532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9c64ebf8-8d07-4b54-a1f1-61e4b2fe31a5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:46.143933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9c64ebf8-8d07-4b54-a1f1-61e4b2fe31a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:46.174174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b8a1afe3-a4dc-4169-9db3-959eddd8eb72 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:46.175391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b8a1afe3-a4dc-4169-9db3-959eddd8eb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:46.212574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:46.254728 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 111/237] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:46.283838 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 127/238] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:46.773361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64ebf8-8d07-4b54-a1f1-61e4b2fe31a5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:46.797610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:46.886397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64ebf8-8d07-4b54-a1f1-61e4b2fe31a5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:46.891599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1afe3-a4dc-4169-9db3-959eddd8eb72 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:46.938395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80cb05-b946-4018-bca8-630947fc3649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:46.939043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80cb05-b946-4018-bca8-630947fc3649 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:46.939323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80cb05-b946-4018-bca8-630947fc3649 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:46.941777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80cb05-b946-4018-bca8-630947fc3649 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:46.943843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80cb05-b946-4018-bca8-630947fc3649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:46.945325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80cb05-b946-4018-bca8-630947fc3649 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:46.948181 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 112/239] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:46.953036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80cb05-b946-4018-bca8-630947fc3649 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:47.043325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1afe3-a4dc-4169-9db3-959eddd8eb72 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:47.080745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:47.090596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f4ba7-1028-4d93-97f9-3f46d287c9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:47.091241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f4ba7-1028-4d93-97f9-3f46d287c9fe None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:47.091517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f4ba7-1028-4d93-97f9-3f46d287c9fe None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:47.091789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f4ba7-1028-4d93-97f9-3f46d287c9fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:47.099081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80cb05-b946-4018-bca8-630947fc3649 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:47.105443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f4ba7-1028-4d93-97f9-3f46d287c9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-a15f4ba7-1028-4d93-97f9-3f46d287c9fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:47.111595 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:47.112661 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:47.113582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:47.113582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:47.113582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:47.113582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:47.113582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:47.113582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:47.113582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:47.113582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:47.113582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:47.113582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:47.113582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:47.113582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:47.113582 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 128/240] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:47.114566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb23025-101f-4c28-8944-8eb4ecfe6510 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:47.114844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb23025-101f-4c28-8944-8eb4ecfe6510 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:47.115115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb23025-101f-4c28-8944-8eb4ecfe6510 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:47.117148 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 129/241] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:47.122068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c1ba1-c445-4f58-b2f0-9b24a2877507 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:47.122068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c1ba1-c445-4f58-b2f0-9b24a2877507 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:47.122068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c1ba1-c445-4f58-b2f0-9b24a2877507 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:47.122068 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 130/242] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:47.122472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c1ba1-c445-4f58-b2f0-9b24a2877507 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:47.144989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:47.149492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d368152-2f33-4d01-91e4-458af52bb2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:47.150427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d368152-2f33-4d01-91e4-458af52bb2ae None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:47.150720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d368152-2f33-4d01-91e4-458af52bb2ae None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:47.150996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d368152-2f33-4d01-91e4-458af52bb2ae None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:47.151651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d368152-2f33-4d01-91e4-458af52bb2ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:47.153163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d368152-2f33-4d01-91e4-458af52bb2ae None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:47.185545 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 113/243] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:34:46 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:47.186846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9e25-91d5-4294-9ffb-1e0a652c5549 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:47.187132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9e25-91d5-4294-9ffb-1e0a652c5549 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:47.187411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9e25-91d5-4294-9ffb-1e0a652c5549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:47.212672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-32ea9e25-91d5-4294-9ffb-1e0a652c5549 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:47.214246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-32ea9e25-91d5-4294-9ffb-1e0a652c5549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:47.249122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c1ba1-c445-4f58-b2f0-9b24a2877507 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:47.293786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0572f6-58cf-43c7-9d73-835073ad546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:47.294325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0572f6-58cf-43c7-9d73-835073ad546b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:47.294514 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 114/244] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:47.294764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0572f6-58cf-43c7-9d73-835073ad546b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:47.295049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0572f6-58cf-43c7-9d73-835073ad546b None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:47.295729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0572f6-58cf-43c7-9d73-835073ad546b None admin] RBAC: Adding query filter params (name=reader) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:47.296034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0572f6-58cf-43c7-9d73-835073ad546b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:47.296942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beeabe-13d0-4b35-8389-be857006600b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:47.297444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0572f6-58cf-43c7-9d73-835073ad546b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:47.297547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beeabe-13d0-4b35-8389-be857006600b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:47.298050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beeabe-13d0-4b35-8389-be857006600b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:47.308137 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 131/245] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:47.314031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0572f6-58cf-43c7-9d73-835073ad546b None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:47.319831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a6beeabe-13d0-4b35-8389-be857006600b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:47.321494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a6beeabe-13d0-4b35-8389-be857006600b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:47.408481 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 115/246] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:47.426006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:47.440944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69bb0e-d73f-476e-8e2a-8e6807dcbdba None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:47.441318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69bb0e-d73f-476e-8e2a-8e6807dcbdba None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:47.441515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69bb0e-d73f-476e-8e2a-8e6807dcbdba None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:47.443171 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 116/247] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:47.448392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a839-ea4b-4946-9b9a-48528e346961 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:47.448676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a839-ea4b-4946-9b9a-48528e346961 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:47.448952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a839-ea4b-4946-9b9a-48528e346961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:47.458616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0572f6-58cf-43c7-9d73-835073ad546b None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:47.467246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:47.499668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd348c-34f7-4a84-94ca-7c5f48f87bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:47.500667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd348c-34f7-4a84-94ca-7c5f48f87bc2 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:47.501145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd348c-34f7-4a84-94ca-7c5f48f87bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:47.501641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd348c-34f7-4a84-94ca-7c5f48f87bc2 None admin] PATH_INFO: `/v3/users/eaf1bc7572094391b7252c100c84f607` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:47.509673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7b73a839-ea4b-4946-9b9a-48528e346961 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:47.511598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7b73a839-ea4b-4946-9b9a-48528e346961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:47.519310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd348c-34f7-4a84-94ca-7c5f48f87bc2 None admin] RBAC: Authorizing `identity:get_user(user_id=eaf1bc7572094391b7252c100c84f607)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:47.521053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd348c-34f7-4a84-94ca-7c5f48f87bc2 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:47.522931 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 132/248] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:47 2022] GET /identity/v3/users/eaf1bc7572094391b7252c100c84f607 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:47.530231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd348c-34f7-4a84-94ca-7c5f48f87bc2 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:47.600431 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 117/249] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:47.644647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd348c-34f7-4a84-94ca-7c5f48f87bc2 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:47.682715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e5c6f-19f5-4a5d-b9e5-99a0844347ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:47.683318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5c6f-19f5-4a5d-b9e5-99a0844347ea None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:47.683593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5c6f-19f5-4a5d-b9e5-99a0844347ea None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:47.683860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5c6f-19f5-4a5d-b9e5-99a0844347ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:47.692851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:47.699851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73a839-ea4b-4946-9b9a-48528e346961 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:47.768800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e5c6f-19f5-4a5d-b9e5-99a0844347ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:47.770303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e5c6f-19f5-4a5d-b9e5-99a0844347ea None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:47.834066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73a839-ea4b-4946-9b9a-48528e346961 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:47.875782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:47.880805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db011d-78cc-49a3-8298-a78c56ae252e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:47.881759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db011d-78cc-49a3-8298-a78c56ae252e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:47.881976 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 133/250] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:47.882321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db011d-78cc-49a3-8298-a78c56ae252e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:47.882716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db011d-78cc-49a3-8298-a78c56ae252e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:47.882889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e5c6f-19f5-4a5d-b9e5-99a0844347ea None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:47.906280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db011d-78cc-49a3-8298-a78c56ae252e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-52db011d-78cc-49a3-8298-a78c56ae252e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:47.911497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:47.912554 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:47.913363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:47.913363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:47.913363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:47.913363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:47.913363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:47.913363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:47.913363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:47.913363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:47.913363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:47.913363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:47.913363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:47.913363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:47.913363 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 118/251] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:34:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:47.914011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db011d-78cc-49a3-8298-a78c56ae252e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:47.944575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:48.014312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e5c6f-19f5-4a5d-b9e5-99a0844347ea None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:48.033546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db011d-78cc-49a3-8298-a78c56ae252e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:48.066039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8696aa-7454-48d6-a01b-b428e79b246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:48.066852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8696aa-7454-48d6-a01b-b428e79b246f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:48.067151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8696aa-7454-48d6-a01b-b428e79b246f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:48.067422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8696aa-7454-48d6-a01b-b428e79b246f None admin] PATH_INFO: `/v3/roles/member` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:48.073712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e196fa-12c1-48fd-9afc-6076589c040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:48.074344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e196fa-12c1-48fd-9afc-6076589c040c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:48.074624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e196fa-12c1-48fd-9afc-6076589c040c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:48.074897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e196fa-12c1-48fd-9afc-6076589c040c None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:48.076647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e196fa-12c1-48fd-9afc-6076589c040c None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:48.078130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e196fa-12c1-48fd-9afc-6076589c040c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:48.080067 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 119/252] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:47 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:48.081133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e196fa-12c1-48fd-9afc-6076589c040c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:48.083276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8696aa-7454-48d6-a01b-b428e79b246f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-6e8696aa-7454-48d6-a01b-b428e79b246f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:48.090029 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:48.090958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 134/253] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:48.092437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8696aa-7454-48d6-a01b-b428e79b246f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:48.165687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:48.198466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:48.204267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8696aa-7454-48d6-a01b-b428e79b246f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:48.219430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e196fa-12c1-48fd-9afc-6076589c040c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:48.242860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f375ad-1ea4-4adb-9109-b12bf5fc045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:48.243539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f375ad-1ea4-4adb-9109-b12bf5fc045c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:48.243825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f375ad-1ea4-4adb-9109-b12bf5fc045c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:48.244351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f375ad-1ea4-4adb-9109-b12bf5fc045c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:48.256046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f375ad-1ea4-4adb-9109-b12bf5fc045c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-93f375ad-1ea4-4adb-9109-b12bf5fc045c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:48.261552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:48.262432 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:48.263212 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:48.263212 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:48.263212 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:48.263212 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:48.263212 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:48.263212 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:48.263212 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:48.263212 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:48.263212 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:48.263212 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:48.263212 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:34:48.263212 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:48.263212 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 135/254] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:48.263853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f375ad-1ea4-4adb-9109-b12bf5fc045c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:48.271437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e7055-560c-4e1c-a713-1a4827407457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:48.272059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e7055-560c-4e1c-a713-1a4827407457 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:48.272339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e7055-560c-4e1c-a713-1a4827407457 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:48.272614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e7055-560c-4e1c-a713-1a4827407457 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:48.273379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e7055-560c-4e1c-a713-1a4827407457 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:48.273687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e7055-560c-4e1c-a713-1a4827407457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:48.275652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e7055-560c-4e1c-a713-1a4827407457 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:48.289567 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 120/255] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:48.291021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e7055-560c-4e1c-a713-1a4827407457 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:48.393570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f375ad-1ea4-4adb-9109-b12bf5fc045c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:48.397409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e7055-560c-4e1c-a713-1a4827407457 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:48.421013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:48.435061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb30c20-ea85-4664-9b63-9edecac9183a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:48.435670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb30c20-ea85-4664-9b63-9edecac9183a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:48.435948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb30c20-ea85-4664-9b63-9edecac9183a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:48.436217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb30c20-ea85-4664-9b63-9edecac9183a None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:48.436890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb30c20-ea85-4664-9b63-9edecac9183a None admin] RBAC: Adding query filter params (name=member) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:48.437226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb30c20-ea85-4664-9b63-9edecac9183a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:48.439064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb30c20-ea85-4664-9b63-9edecac9183a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:48.446400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13124bfc-1396-4aa0-8faa-9103ce6b1865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:48.447771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124bfc-1396-4aa0-8faa-9103ce6b1865 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:48.448521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124bfc-1396-4aa0-8faa-9103ce6b1865 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:48.448986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124bfc-1396-4aa0-8faa-9103ce6b1865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:48.449954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13124bfc-1396-4aa0-8faa-9103ce6b1865 None admin] RBAC: Adding query filter params (role.id=e56cb0010cc3451ba5b280b4d1ca76a6, scope.project.id=a453d14403a142248aefae9ff0bf5691, user.id=eaf1bc7572094391b7252c100c84f607) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:48.450467 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 121/256] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:48.450721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13124bfc-1396-4aa0-8faa-9103ce6b1865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:48.451281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb30c20-ea85-4664-9b63-9edecac9183a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:48.452918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13124bfc-1396-4aa0-8faa-9103ce6b1865 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:48.460559 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 136/257] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:48 2022] GET /identity/v3/role_assignments?user.id=eaf1bc7572094391b7252c100c84f607&scope.project.id=a453d14403a142248aefae9ff0bf5691&role.id=e56cb0010cc3451ba5b280b4d1ca76a6 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:48.462838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13124bfc-1396-4aa0-8faa-9103ce6b1865 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:48.514178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:48.575360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb30c20-ea85-4664-9b63-9edecac9183a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:48.613137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe228e4-cdd9-4eec-a333-105ccb42f413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:48.614049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe228e4-cdd9-4eec-a333-105ccb42f413 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:48.614158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe228e4-cdd9-4eec-a333-105ccb42f413 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:48.614353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe228e4-cdd9-4eec-a333-105ccb42f413 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:48.615027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe228e4-cdd9-4eec-a333-105ccb42f413 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:48.615341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe228e4-cdd9-4eec-a333-105ccb42f413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:48.616759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe228e4-cdd9-4eec-a333-105ccb42f413 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:48.625333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13124bfc-1396-4aa0-8faa-9103ce6b1865 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:48.631188 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 122/258] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:48.631188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe228e4-cdd9-4eec-a333-105ccb42f413 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:48.706903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f4e45-167f-4227-a587-ccae73f268df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:48.707613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f4e45-167f-4227-a587-ccae73f268df None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:48.707898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f4e45-167f-4227-a587-ccae73f268df None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:48.708173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f4e45-167f-4227-a587-ccae73f268df None admin] PATH_INFO: `/v3/users/8b695d820611484e9515b984ef161ea7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:48.709404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f4e45-167f-4227-a587-ccae73f268df None admin] RBAC: Authorizing `identity:get_user(user_id=8b695d820611484e9515b984ef161ea7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:48.710899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f4e45-167f-4227-a587-ccae73f268df None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:48.717987 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 137/259] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:48 2022] GET /identity/v3/users/8b695d820611484e9515b984ef161ea7 => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:48.718663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f4e45-167f-4227-a587-ccae73f268df None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:48.731605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:48.863680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:48.868921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe228e4-cdd9-4eec-a333-105ccb42f413 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:48.874656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f4e45-167f-4227-a587-ccae73f268df None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:48.918438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7a096-458a-428b-9a6b-929f5112181c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:48.919434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7a096-458a-428b-9a6b-929f5112181c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:48.919907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7a096-458a-428b-9a6b-929f5112181c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:48.920374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7a096-458a-428b-9a6b-929f5112181c None admin] PATH_INFO: `/v3/users/8b695d820611484e9515b984ef161ea7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:48.923334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7a096-458a-428b-9a6b-929f5112181c None admin] RBAC: Authorizing `identity:get_user(user_id=8b695d820611484e9515b984ef161ea7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:48.925225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7a096-458a-428b-9a6b-929f5112181c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:48.929008 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 138/260] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:48 2022] GET /identity/v3/users/8b695d820611484e9515b984ef161ea7 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:48.932617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7a096-458a-428b-9a6b-929f5112181c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:48.950830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7e4ec-c32c-4197-9b6c-b40720700deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:48.951831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7e4ec-c32c-4197-9b6c-b40720700deb None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:48.952306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7e4ec-c32c-4197-9b6c-b40720700deb None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:48.954979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7e4ec-c32c-4197-9b6c-b40720700deb None admin] PATH_INFO: `/v3/users/925ce3c1c15c405f811be6cb007002a0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:48.956351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7e4ec-c32c-4197-9b6c-b40720700deb None admin] RBAC: Authorizing `identity:get_user(user_id=925ce3c1c15c405f811be6cb007002a0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:48.958090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7e4ec-c32c-4197-9b6c-b40720700deb None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:48.963393 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 123/261] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:48 2022] GET /identity/v3/users/925ce3c1c15c405f811be6cb007002a0 => generated 297 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:48.967319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7e4ec-c32c-4197-9b6c-b40720700deb None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:49.096924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7e4ec-c32c-4197-9b6c-b40720700deb None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:49.113912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:49.149450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32490a49-e85b-4d3a-be39-408e57af7ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:49.150442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32490a49-e85b-4d3a-be39-408e57af7ec7 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:49.150919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32490a49-e85b-4d3a-be39-408e57af7ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:49.151789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32490a49-e85b-4d3a-be39-408e57af7ec7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:49.199465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7a096-458a-428b-9a6b-929f5112181c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:49.231120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32490a49-e85b-4d3a-be39-408e57af7ec7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:49.233257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32490a49-e85b-4d3a-be39-408e57af7ec7 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:49.275347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05ea3e-40fa-4ed2-b1de-11aa20a7dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:49.275963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05ea3e-40fa-4ed2-b1de-11aa20a7dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:49.276241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05ea3e-40fa-4ed2-b1de-11aa20a7dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:49.276511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05ea3e-40fa-4ed2-b1de-11aa20a7dfe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:49.334373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:49.399449 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 124/262] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:49.400300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32490a49-e85b-4d3a-be39-408e57af7ec7 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:49.408966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05ea3e-40fa-4ed2-b1de-11aa20a7dfe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:49.410510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05ea3e-40fa-4ed2-b1de-11aa20a7dfe2 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:49.420718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:49.568210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32490a49-e85b-4d3a-be39-408e57af7ec7 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:49.610934 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 139/263] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:49.613001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05ea3e-40fa-4ed2-b1de-11aa20a7dfe2 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:49.638704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316827b-d206-4bb6-941b-90be4900821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:49.639342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316827b-d206-4bb6-941b-90be4900821d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:49.639615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316827b-d206-4bb6-941b-90be4900821d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:49.639884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316827b-d206-4bb6-941b-90be4900821d None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:49.644358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316827b-d206-4bb6-941b-90be4900821d None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:49.645822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316827b-d206-4bb6-941b-90be4900821d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:49.647622 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 125/264] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:49 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:49.652967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316827b-d206-4bb6-941b-90be4900821d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:49.729579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:49.749124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05ea3e-40fa-4ed2-b1de-11aa20a7dfe2 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:49.788998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497630e8-5e73-433a-8b3c-cdd149770ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:49.790540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497630e8-5e73-433a-8b3c-cdd149770ee7 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:49.790952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497630e8-5e73-433a-8b3c-cdd149770ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:49.791377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497630e8-5e73-433a-8b3c-cdd149770ee7 None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:49.792942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497630e8-5e73-433a-8b3c-cdd149770ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:49.795160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497630e8-5e73-433a-8b3c-cdd149770ee7 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:49.797335 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 140/265] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:49 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:49.798298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497630e8-5e73-433a-8b3c-cdd149770ee7 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:49.844642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:49.887123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316827b-d206-4bb6-941b-90be4900821d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:49.915379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497630e8-5e73-433a-8b3c-cdd149770ee7 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:49.948795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:49.968604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2e2ba-ae68-4a01-98f0-955f53b09306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:49.970323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2e2ba-ae68-4a01-98f0-955f53b09306 None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:49.971247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2e2ba-ae68-4a01-98f0-955f53b09306 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:49.972030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f8812-3db0-4f8a-8a49-8835b10627b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:49.972473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2e2ba-ae68-4a01-98f0-955f53b09306 None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691/users/925ce3c1c15c405f811be6cb007002a0/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:49.974086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f8812-3db0-4f8a-8a49-8835b10627b0 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:49.974510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f8812-3db0-4f8a-8a49-8835b10627b0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:49.975454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f8812-3db0-4f8a-8a49-8835b10627b0 None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:49.976258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2e2ba-ae68-4a01-98f0-955f53b09306 None admin] RBAC: Authorizing `identity:create_grant(project_id=a453d14403a142248aefae9ff0bf5691, user_id=925ce3c1c15c405f811be6cb007002a0, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:49.978913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2e2ba-ae68-4a01-98f0-955f53b09306 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:49.979655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f8812-3db0-4f8a-8a49-8835b10627b0 None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:49.981246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f8812-3db0-4f8a-8a49-8835b10627b0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:49.983044 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 126/266] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:49 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:49.986458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f8812-3db0-4f8a-8a49-8835b10627b0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:50.011826 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 141/267] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:34:49 2022] PUT /identity/v3/projects/a453d14403a142248aefae9ff0bf5691/users/925ce3c1c15c405f811be6cb007002a0/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:34:50.012918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2e2ba-ae68-4a01-98f0-955f53b09306 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:50.204378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f8812-3db0-4f8a-8a49-8835b10627b0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:50.266685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2e2ba-ae68-4a01-98f0-955f53b09306 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:50.276004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbec6c-593b-4f7f-a207-f9ad7e1a2834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:50.276616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbec6c-593b-4f7f-a207-f9ad7e1a2834 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:50.276896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbec6c-593b-4f7f-a207-f9ad7e1a2834 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:50.277166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbec6c-593b-4f7f-a207-f9ad7e1a2834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:50.277929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbec6c-593b-4f7f-a207-f9ad7e1a2834 None admin] RBAC: Adding query filter params (role.id=94f39d4bced64cc98e66bceafe049303, scope.project.id=a453d14403a142248aefae9ff0bf5691, user.id=8b695d820611484e9515b984ef161ea7) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:50.278237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbec6c-593b-4f7f-a207-f9ad7e1a2834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:50.279691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbec6c-593b-4f7f-a207-f9ad7e1a2834 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:50.289058 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 127/268] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:49 2022] GET /identity/v3/role_assignments?user.id=8b695d820611484e9515b984ef161ea7&scope.project.id=a453d14403a142248aefae9ff0bf5691&role.id=94f39d4bced64cc98e66bceafe049303 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:50.314327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d625cf-9a1e-4e78-888b-2d7f67745d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:50.314942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d625cf-9a1e-4e78-888b-2d7f67745d52 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:50.315219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d625cf-9a1e-4e78-888b-2d7f67745d52 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:50.315491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d625cf-9a1e-4e78-888b-2d7f67745d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:50.316230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d625cf-9a1e-4e78-888b-2d7f67745d52 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=a453d14403a142248aefae9ff0bf5691, user.id=8b695d820611484e9515b984ef161ea7) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:50.316541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d625cf-9a1e-4e78-888b-2d7f67745d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:50.318018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d625cf-9a1e-4e78-888b-2d7f67745d52 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:50.326707 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 142/269] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:50 2022] GET /identity/v3/role_assignments?user.id=8b695d820611484e9515b984ef161ea7&scope.project.id=a453d14403a142248aefae9ff0bf5691&role.id=a409f81bd5744563a303a825783bed61 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:50.359314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bf673-98ce-486a-9b88-59093592cd77 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:50.359618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bf673-98ce-486a-9b88-59093592cd77 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:50.359877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bf673-98ce-486a-9b88-59093592cd77 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:50.361825 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 128/270] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:50.367199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549168a9-09c6-48ed-bff8-61fd5671dbe6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:50.367504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549168a9-09c6-48ed-bff8-61fd5671dbe6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:50.367814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549168a9-09c6-48ed-bff8-61fd5671dbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:50.389628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-549168a9-09c6-48ed-bff8-61fd5671dbe6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:50.390908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-549168a9-09c6-48ed-bff8-61fd5671dbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:50.457263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:50.501276 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 143/271] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:50.754974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a126db-73a9-4f1d-86d4-351f3fd5a564 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:50.755304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a126db-73a9-4f1d-86d4-351f3fd5a564 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:50.755498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a126db-73a9-4f1d-86d4-351f3fd5a564 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:50.757018 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 129/272] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:50.762595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113ef5d-a0ba-4ff4-a695-e5839903be9f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:50.762875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113ef5d-a0ba-4ff4-a695-e5839903be9f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:50.763147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113ef5d-a0ba-4ff4-a695-e5839903be9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:50.783880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6113ef5d-a0ba-4ff4-a695-e5839903be9f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:50.785080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6113ef5d-a0ba-4ff4-a695-e5839903be9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:50.876270 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 144/273] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:50.930802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a126db-73a9-4f1d-86d4-351f3fd5a564 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:50.950251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:51.051056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a126db-73a9-4f1d-86d4-351f3fd5a564 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:51.090326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9b539-e756-4d16-805a-5bc7ed19bcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:51.090986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9b539-e756-4d16-805a-5bc7ed19bcf9 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:51.091267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9b539-e756-4d16-805a-5bc7ed19bcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:51.091536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9b539-e756-4d16-805a-5bc7ed19bcf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:51.106594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9b539-e756-4d16-805a-5bc7ed19bcf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-ffb9b539-e756-4d16-805a-5bc7ed19bcf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:51.112069 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:51.113010 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:51.113826 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:51.113826 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:51.113826 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:51.113826 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:51.113826 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:51.113826 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:51.113826 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:51.113826 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:51.113826 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:51.113826 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:51.113826 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:51.113826 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:51.113826 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 130/274] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:51.121632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113ef5d-a0ba-4ff4-a695-e5839903be9f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:51.230365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113ef5d-a0ba-4ff4-a695-e5839903be9f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:51.241226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:51.265370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49212ff9-2119-4a17-93c6-24ee0916b519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:51.265978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212ff9-2119-4a17-93c6-24ee0916b519 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:51.266251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212ff9-2119-4a17-93c6-24ee0916b519 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:51.266517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212ff9-2119-4a17-93c6-24ee0916b519 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:51.267163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49212ff9-2119-4a17-93c6-24ee0916b519 None admin] RBAC: Adding query filter params (name=member) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:51.267682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49212ff9-2119-4a17-93c6-24ee0916b519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:51.268809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49212ff9-2119-4a17-93c6-24ee0916b519 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:51.277007 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 145/275] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:51.278841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9b539-e756-4d16-805a-5bc7ed19bcf9 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:51.282692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49212ff9-2119-4a17-93c6-24ee0916b519 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:51.365077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:51.387348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49212ff9-2119-4a17-93c6-24ee0916b519 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:51.394483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9b539-e756-4d16-805a-5bc7ed19bcf9 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:51.424843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ffff2-26e3-4779-9ba1-feb788135fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:51.425521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ffff2-26e3-4779-9ba1-feb788135fd7 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:51.425798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ffff2-26e3-4779-9ba1-feb788135fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:51.426070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ffff2-26e3-4779-9ba1-feb788135fd7 None admin] PATH_INFO: `/v3/users/cf097f618f014247be7e1585a9fe32ee` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:51.435452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa3168-c876-4517-8f1d-6df746f8a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:51.436399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa3168-c876-4517-8f1d-6df746f8a157 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:51.436882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa3168-c876-4517-8f1d-6df746f8a157 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:51.437397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa3168-c876-4517-8f1d-6df746f8a157 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:51.438758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa3168-c876-4517-8f1d-6df746f8a157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:51.440555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa3168-c876-4517-8f1d-6df746f8a157 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:51.440664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ffff2-26e3-4779-9ba1-feb788135fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=cf097f618f014247be7e1585a9fe32ee)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:51.442097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ffff2-26e3-4779-9ba1-feb788135fd7 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:51.443024 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 131/276] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:51.443860 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 146/277] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:51 2022] GET /identity/v3/users/cf097f618f014247be7e1585a9fe32ee => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:51.453228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa3168-c876-4517-8f1d-6df746f8a157 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:51.453388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ffff2-26e3-4779-9ba1-feb788135fd7 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:51.494575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:51.577068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ffff2-26e3-4779-9ba1-feb788135fd7 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:51.590015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa3168-c876-4517-8f1d-6df746f8a157 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:51.615309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65a370-ecf4-4945-af1a-3c5b6f83afcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:51.616195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65a370-ecf4-4945-af1a-3c5b6f83afcc None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:51.616487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65a370-ecf4-4945-af1a-3c5b6f83afcc None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:51.616760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65a370-ecf4-4945-af1a-3c5b6f83afcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:51.617516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65a370-ecf4-4945-af1a-3c5b6f83afcc None admin] RBAC: Adding query filter params (role.id=27431c49ccd74f7a898d1a39e251ce29, user.id=cf097f618f014247be7e1585a9fe32ee, scope.system=all) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:51.618390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65a370-ecf4-4945-af1a-3c5b6f83afcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:51.619842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65a370-ecf4-4945-af1a-3c5b6f83afcc None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:51.625179 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 147/278] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Oct 8 20:34:51 2022] GET /identity/v3/role_assignments?user.id=cf097f618f014247be7e1585a9fe32ee&scope.system=all&role.id=27431c49ccd74f7a898d1a39e251ce29 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:51.629301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd9e36-6088-4c82-b852-bcae58b5775c None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:51.629301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd9e36-6088-4c82-b852-bcae58b5775c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:51.629301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd9e36-6088-4c82-b852-bcae58b5775c None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:51.629301 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 148/279] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:51.633918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee980dc-194f-49fe-8efc-521b4341e0d5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:51.633918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee980dc-194f-49fe-8efc-521b4341e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:51.634162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee980dc-194f-49fe-8efc-521b4341e0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:51.635877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfda93-f993-4430-8050-6654c6ab06b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:51.636509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfda93-f993-4430-8050-6654c6ab06b2 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:51.636787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfda93-f993-4430-8050-6654c6ab06b2 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:51.637161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfda93-f993-4430-8050-6654c6ab06b2 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:51.638039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfda93-f993-4430-8050-6654c6ab06b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:51.639670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfda93-f993-4430-8050-6654c6ab06b2 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:51.654679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1ee980dc-194f-49fe-8efc-521b4341e0d5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:51.656230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1ee980dc-194f-49fe-8efc-521b4341e0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:51.664374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:51.677738 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 132/280] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:34:51 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:51.749334 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 149/281] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:52.095392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfda93-f993-4430-8050-6654c6ab06b2 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:52.204274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfda93-f993-4430-8050-6654c6ab06b2 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:52.240466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2491e-8283-4103-9ff8-79ea25795e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:52.241522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2491e-8283-4103-9ff8-79ea25795e0b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:52.242003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2491e-8283-4103-9ff8-79ea25795e0b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:52.242467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2491e-8283-4103-9ff8-79ea25795e0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:52.253624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2491e-8283-4103-9ff8-79ea25795e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-b3f2491e-8283-4103-9ff8-79ea25795e0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:52.259901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:52.260794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:52.261631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:52.261631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:52.261631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:52.261631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:52.261631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:52.261631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:52.261631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:52.261631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:52.261631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:52.261631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:52.261631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:52.261631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:52.264242 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 133/282] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:52.269756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee980dc-194f-49fe-8efc-521b4341e0d5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:52.312275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:52.424526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee980dc-194f-49fe-8efc-521b4341e0d5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:52.459889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1de246-f791-4a33-83a4-a2bbd141531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:52.460506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de246-f791-4a33-83a4-a2bbd141531b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:52.460788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de246-f791-4a33-83a4-a2bbd141531b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:52.461059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de246-f791-4a33-83a4-a2bbd141531b None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:52.462318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1de246-f791-4a33-83a4-a2bbd141531b None admin] RBAC: Adding query filter params (name=reader) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:52.462626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1de246-f791-4a33-83a4-a2bbd141531b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:52.464006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1de246-f791-4a33-83a4-a2bbd141531b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:52.473275 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 150/283] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:52.481210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2491e-8283-4103-9ff8-79ea25795e0b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:52.556337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:52.610040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2491e-8283-4103-9ff8-79ea25795e0b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:52.652931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febced4-fd11-41af-bd48-7587c44c4fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:52.653602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febced4-fd11-41af-bd48-7587c44c4fab None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:52.653885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febced4-fd11-41af-bd48-7587c44c4fab None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:52.654157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febced4-fd11-41af-bd48-7587c44c4fab None admin] PATH_INFO: `/v3/users/eaf1bc7572094391b7252c100c84f607` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:52.655317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febced4-fd11-41af-bd48-7587c44c4fab None admin] RBAC: Authorizing `identity:get_user(user_id=eaf1bc7572094391b7252c100c84f607)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:52.656767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febced4-fd11-41af-bd48-7587c44c4fab None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:52.658445 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 134/284] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:52 2022] GET /identity/v3/users/eaf1bc7572094391b7252c100c84f607 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:52.663943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1de246-f791-4a33-83a4-a2bbd141531b None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:52.790427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:52.810951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1de246-f791-4a33-83a4-a2bbd141531b None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:52.851708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83783ce1-48ef-47b7-953e-11f070077584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:52.852935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83783ce1-48ef-47b7-953e-11f070077584 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:52.853233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83783ce1-48ef-47b7-953e-11f070077584 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:52.853508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83783ce1-48ef-47b7-953e-11f070077584 None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:52.857863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83783ce1-48ef-47b7-953e-11f070077584 None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:52.859331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83783ce1-48ef-47b7-953e-11f070077584 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:52.861101 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 151/285] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:52 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:52.867439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febced4-fd11-41af-bd48-7587c44c4fab None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:53.003423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febced4-fd11-41af-bd48-7587c44c4fab None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:53.037928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:53.051757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390071d5-9400-4ad5-b73a-56221a2338a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:53.052360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390071d5-9400-4ad5-b73a-56221a2338a4 None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:53.052640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390071d5-9400-4ad5-b73a-56221a2338a4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:53.052915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390071d5-9400-4ad5-b73a-56221a2338a4 None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691/users/eaf1bc7572094391b7252c100c84f607/roles/e56cb0010cc3451ba5b280b4d1ca76a6` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:53.058440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390071d5-9400-4ad5-b73a-56221a2338a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a453d14403a142248aefae9ff0bf5691, user_id=eaf1bc7572094391b7252c100c84f607, role_id=e56cb0010cc3451ba5b280b4d1ca76a6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:53.059895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390071d5-9400-4ad5-b73a-56221a2338a4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:53.074872 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 135/286] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:34:52 2022] PUT /identity/v3/projects/a453d14403a142248aefae9ff0bf5691/users/eaf1bc7572094391b7252c100c84f607/roles/e56cb0010cc3451ba5b280b4d1ca76a6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:34:53.187234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4eaa0-144b-4159-8fb3-bd6ac9e72b02 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:53.187585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4eaa0-144b-4159-8fb3-bd6ac9e72b02 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:53.187786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4eaa0-144b-4159-8fb3-bd6ac9e72b02 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:53.189136 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 152/287] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:53.194996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcda461-31c8-4f37-af10-31a50273c44e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:53.195279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcda461-31c8-4f37-af10-31a50273c44e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:53.195548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcda461-31c8-4f37-af10-31a50273c44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:53.222165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2fcda461-31c8-4f37-af10-31a50273c44e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:53.223594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2fcda461-31c8-4f37-af10-31a50273c44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:53.308237 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 136/288] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:53.799470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4eaa0-144b-4159-8fb3-bd6ac9e72b02 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:53.913167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4eaa0-144b-4159-8fb3-bd6ac9e72b02 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:53.949149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4022f3-8ca0-453e-abbe-5ae4074cbfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:53.949811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4022f3-8ca0-453e-abbe-5ae4074cbfd7 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:53.950091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4022f3-8ca0-453e-abbe-5ae4074cbfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:53.950366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4022f3-8ca0-453e-abbe-5ae4074cbfd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:53.961341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4022f3-8ca0-453e-abbe-5ae4074cbfd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-2c4022f3-8ca0-453e-abbe-5ae4074cbfd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:53.967267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:53.969458 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:53.971443 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:53.971443 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:53.971443 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:53.971443 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:53.971443 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:53.971443 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:53.971443 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:53.971443 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:53.971443 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:53.971443 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:53.971443 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:53.971443 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:53.971443 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 153/289] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:53.977531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcda461-31c8-4f37-af10-31a50273c44e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:54.121483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcda461-31c8-4f37-af10-31a50273c44e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:54.144814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:54.174148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ed5f1-8a8a-4cc6-8a94-73ff975be9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:54.174791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ed5f1-8a8a-4cc6-8a94-73ff975be9cd None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:54.175107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ed5f1-8a8a-4cc6-8a94-73ff975be9cd None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:54.175396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ed5f1-8a8a-4cc6-8a94-73ff975be9cd None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:54.176255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ed5f1-8a8a-4cc6-8a94-73ff975be9cd None admin] RBAC: Adding query filter params (name=member) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:54.176570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ed5f1-8a8a-4cc6-8a94-73ff975be9cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:54.178108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ed5f1-8a8a-4cc6-8a94-73ff975be9cd None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:54.188167 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 137/290] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:54.194153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4022f3-8ca0-453e-abbe-5ae4074cbfd7 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:54.219816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6fa23-3956-4363-9fd0-b9b8b3bedc2c None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:54.219816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6fa23-3956-4363-9fd0-b9b8b3bedc2c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:54.219816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6fa23-3956-4363-9fd0-b9b8b3bedc2c None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:54.220405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:54.220551 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 138/291] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:54.246205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e52228-ea3a-441b-a123-aac07f2f3290 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:54.246719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e52228-ea3a-441b-a123-aac07f2f3290 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:54.247213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e52228-ea3a-441b-a123-aac07f2f3290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:54.279697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-43e52228-ea3a-441b-a123-aac07f2f3290 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:54.281297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-43e52228-ea3a-441b-a123-aac07f2f3290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:54.328588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4022f3-8ca0-453e-abbe-5ae4074cbfd7 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:54.392972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828651ba-87bf-4f72-b8f8-4229fbe25f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:54.393562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828651ba-87bf-4f72-b8f8-4229fbe25f4e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:54.393837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828651ba-87bf-4f72-b8f8-4229fbe25f4e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:54.394105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828651ba-87bf-4f72-b8f8-4229fbe25f4e None admin] PATH_INFO: `/v3/users/925ce3c1c15c405f811be6cb007002a0` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:54.395362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828651ba-87bf-4f72-b8f8-4229fbe25f4e None admin] RBAC: Authorizing `identity:get_user(user_id=925ce3c1c15c405f811be6cb007002a0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:54.396783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828651ba-87bf-4f72-b8f8-4229fbe25f4e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:54.398378 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 154/292] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:54 2022] GET /identity/v3/users/925ce3c1c15c405f811be6cb007002a0 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:54.402388 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 139/293] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:54.406150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828651ba-87bf-4f72-b8f8-4229fbe25f4e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:54.528089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:54.552922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828651ba-87bf-4f72-b8f8-4229fbe25f4e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:54.600915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507675-baf9-4eca-874f-6192e2aa7e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:54.601600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507675-baf9-4eca-874f-6192e2aa7e38 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:54.601879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507675-baf9-4eca-874f-6192e2aa7e38 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:54.601973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ce31a-eaad-4ece-864c-18b21886aa7e None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:54.602212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507675-baf9-4eca-874f-6192e2aa7e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:54.602305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ce31a-eaad-4ece-864c-18b21886aa7e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:54.602543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ce31a-eaad-4ece-864c-18b21886aa7e None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:54.604105 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 140/294] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:54.609803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90002bc-3aa9-4105-87bd-040ac319ebba None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:54.610083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90002bc-3aa9-4105-87bd-040ac319ebba None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:54.610361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90002bc-3aa9-4105-87bd-040ac319ebba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:54.642580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d90002bc-3aa9-4105-87bd-040ac319ebba None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:54.645006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d90002bc-3aa9-4105-87bd-040ac319ebba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:54.722069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66507675-baf9-4eca-874f-6192e2aa7e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:54.723843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66507675-baf9-4eca-874f-6192e2aa7e38 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:54.775245 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 141/295] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:54.781220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90002bc-3aa9-4105-87bd-040ac319ebba None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:54.829556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:54.878975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:54.913669 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 155/296] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:54.919536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507675-baf9-4eca-874f-6192e2aa7e38 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:54.940397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90002bc-3aa9-4105-87bd-040ac319ebba None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:55.006981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424e598-8468-46cf-8c19-17b636dbb0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:55.007603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424e598-8468-46cf-8c19-17b636dbb0e2 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:55.007885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424e598-8468-46cf-8c19-17b636dbb0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:55.008154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424e598-8468-46cf-8c19-17b636dbb0e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:55.027483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424e598-8468-46cf-8c19-17b636dbb0e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-5424e598-8468-46cf-8c19-17b636dbb0e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:55.032327 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:55.033200 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:55.033983 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:55.033983 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:55.033983 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:55.033983 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:55.033983 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:55.033983 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:55.033983 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:55.033983 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:55.033983 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:55.033983 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:55.033983 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:55.033983 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:55.033983 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 142/297] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:55.044201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424e598-8468-46cf-8c19-17b636dbb0e2 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:55.102406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507675-baf9-4eca-874f-6192e2aa7e38 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:55.173237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df8abf-95da-4dd9-b3ae-75a1da18d1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:55.174228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df8abf-95da-4dd9-b3ae-75a1da18d1ac None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:55.174701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df8abf-95da-4dd9-b3ae-75a1da18d1ac None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:55.175186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df8abf-95da-4dd9-b3ae-75a1da18d1ac None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:55.176521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df8abf-95da-4dd9-b3ae-75a1da18d1ac None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:55.178334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df8abf-95da-4dd9-b3ae-75a1da18d1ac None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:55.181016 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 156/298] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:54 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:55.181975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df8abf-95da-4dd9-b3ae-75a1da18d1ac None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:55.202717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424e598-8468-46cf-8c19-17b636dbb0e2 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:55.205533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:55.235226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:55.242682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70dfdb-fdb5-4535-99de-696488134538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:55.244886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70dfdb-fdb5-4535-99de-696488134538 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:55.245415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70dfdb-fdb5-4535-99de-696488134538 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:55.246139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70dfdb-fdb5-4535-99de-696488134538 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:55.247252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70dfdb-fdb5-4535-99de-696488134538 None admin] RBAC: Adding query filter params (name=member) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:55.248178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70dfdb-fdb5-4535-99de-696488134538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:55.250330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70dfdb-fdb5-4535-99de-696488134538 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:55.262482 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 143/299] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:55.263582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70dfdb-fdb5-4535-99de-696488134538 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:55.295384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df8abf-95da-4dd9-b3ae-75a1da18d1ac None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:55.335357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf95114-12fe-4e63-8052-da0154c6bd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:55.335993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf95114-12fe-4e63-8052-da0154c6bd9f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:55.336272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf95114-12fe-4e63-8052-da0154c6bd9f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:55.336584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf95114-12fe-4e63-8052-da0154c6bd9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:55.347083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf95114-12fe-4e63-8052-da0154c6bd9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-abf95114-12fe-4e63-8052-da0154c6bd9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:55.351876 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:55.353312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:55.354120 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:55.354120 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:55.354120 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:55.354120 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:55.354120 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:55.354120 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:55.354120 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:55.354120 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:55.354120 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:55.354120 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:55.354120 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:55.354120 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:55.354120 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 157/300] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:55.354777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b842-d4c5-41e1-af81-cc241be729d3 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:55.355449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b842-d4c5-41e1-af81-cc241be729d3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:55.355449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b842-d4c5-41e1-af81-cc241be729d3 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:55.356631 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 158/301] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:55.361501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b842-d4c5-41e1-af81-cc241be729d3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:55.384206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70dfdb-fdb5-4535-99de-696488134538 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:55.421428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40e383-89d6-42d0-a8bd-75af8490b716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:55.422182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40e383-89d6-42d0-a8bd-75af8490b716 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:55.422467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40e383-89d6-42d0-a8bd-75af8490b716 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:55.422762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40e383-89d6-42d0-a8bd-75af8490b716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:55.423544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40e383-89d6-42d0-a8bd-75af8490b716 None admin] RBAC: Adding query filter params (role.id=27431c49ccd74f7a898d1a39e251ce29, scope.project.id=a453d14403a142248aefae9ff0bf5691, user.id=925ce3c1c15c405f811be6cb007002a0) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:55.423793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40e383-89d6-42d0-a8bd-75af8490b716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:55.425372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40e383-89d6-42d0-a8bd-75af8490b716 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:55.441220 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 144/302] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:55 2022] GET /identity/v3/role_assignments?user.id=925ce3c1c15c405f811be6cb007002a0&scope.project.id=a453d14403a142248aefae9ff0bf5691&role.id=27431c49ccd74f7a898d1a39e251ce29 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:55.441220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40e383-89d6-42d0-a8bd-75af8490b716 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:55.470117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:55.470653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b842-d4c5-41e1-af81-cc241be729d3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:55.490962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:55.515895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5d143-6c55-40c1-9c27-885ae31ea85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:55.516817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5d143-6c55-40c1-9c27-885ae31ea85e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:55.517214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5d143-6c55-40c1-9c27-885ae31ea85e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:55.517663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5d143-6c55-40c1-9c27-885ae31ea85e None admin] PATH_INFO: `/v3/users/cf097f618f014247be7e1585a9fe32ee` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:55.518919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5d143-6c55-40c1-9c27-885ae31ea85e None admin] RBAC: Authorizing `identity:get_user(user_id=cf097f618f014247be7e1585a9fe32ee)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:55.520787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5d143-6c55-40c1-9c27-885ae31ea85e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:55.523119 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 159/303] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:55 2022] GET /identity/v3/users/cf097f618f014247be7e1585a9fe32ee => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:55.524519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f7330-e5ba-4509-877c-81ad2c959f4e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:55.524903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f7330-e5ba-4509-877c-81ad2c959f4e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:55.525304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f7330-e5ba-4509-877c-81ad2c959f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:55.545811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fe4f7330-e5ba-4509-877c-81ad2c959f4e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:55.547225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fe4f7330-e5ba-4509-877c-81ad2c959f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:55.574752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40e383-89d6-42d0-a8bd-75af8490b716 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:55.632648 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 160/304] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:55.633267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ec924-a114-4801-82ac-bd66ec50ba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:55.634099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ec924-a114-4801-82ac-bd66ec50ba53 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:55.634446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ec924-a114-4801-82ac-bd66ec50ba53 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:55.634789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ec924-a114-4801-82ac-bd66ec50ba53 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:55.635557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ec924-a114-4801-82ac-bd66ec50ba53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:55.635926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ec924-a114-4801-82ac-bd66ec50ba53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:55.637535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ec924-a114-4801-82ac-bd66ec50ba53 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:55.638149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f7330-e5ba-4509-877c-81ad2c959f4e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:55.655704 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 145/305] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:55.662336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ec924-a114-4801-82ac-bd66ec50ba53 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:55.785614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:55.797046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f7330-e5ba-4509-877c-81ad2c959f4e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:55.797595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ec924-a114-4801-82ac-bd66ec50ba53 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:55.808872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:55.840799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d08f5-9e29-4448-bca0-868a39b698c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:55.841494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d08f5-9e29-4448-bca0-868a39b698c1 None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:55.841821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d08f5-9e29-4448-bca0-868a39b698c1 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:55.842100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d08f5-9e29-4448-bca0-868a39b698c1 None admin] PATH_INFO: `/v3/system/users/cf097f618f014247be7e1585a9fe32ee/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:55.843523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d08f5-9e29-4448-bca0-868a39b698c1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cf097f618f014247be7e1585a9fe32ee, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:55.844750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ded6a8-1364-45ef-8dfb-a7bd075c1b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:55.844873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d08f5-9e29-4448-bca0-868a39b698c1 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:55.845731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded6a8-1364-45ef-8dfb-a7bd075c1b26 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:55.846209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded6a8-1364-45ef-8dfb-a7bd075c1b26 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:55.846753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded6a8-1364-45ef-8dfb-a7bd075c1b26 None admin] PATH_INFO: `/v3/users/f5948e2c8638458c8894d041c532f630` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:55.859323 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 161/306] 10.222.0.26 () {58 vars in 1334 bytes} [Sat Oct 8 20:34:55 2022] PUT /identity/v3/system/users/cf097f618f014247be7e1585a9fe32ee/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:34:55.874242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ded6a8-1364-45ef-8dfb-a7bd075c1b26 None admin] RBAC: Authorizing `identity:get_user(user_id=f5948e2c8638458c8894d041c532f630)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:55.876353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ded6a8-1364-45ef-8dfb-a7bd075c1b26 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:55.878574 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 146/307] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:55 2022] GET /identity/v3/users/f5948e2c8638458c8894d041c532f630 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:55.885291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d08f5-9e29-4448-bca0-868a39b698c1 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:56.013108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d08f5-9e29-4448-bca0-868a39b698c1 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:56.042026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43c1d7-d35d-44b6-9d42-12ee0bd4ccf5 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:56.042974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43c1d7-d35d-44b6-9d42-12ee0bd4ccf5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:56.043450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43c1d7-d35d-44b6-9d42-12ee0bd4ccf5 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:56.049298 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 147/308] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:56.051526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cdb88-cd0e-4fa6-83ec-d966f5aebf83 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:56.052159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cdb88-cd0e-4fa6-83ec-d966f5aebf83 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:56.052531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cdb88-cd0e-4fa6-83ec-d966f5aebf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:56.057238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beec16-e95d-4930-bb85-174ace247455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:56.057238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beec16-e95d-4930-bb85-174ace247455 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:56.057238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beec16-e95d-4930-bb85-174ace247455 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:56.057238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beec16-e95d-4930-bb85-174ace247455 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:56.057964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beec16-e95d-4930-bb85-174ace247455 None admin] RBAC: Adding query filter params (role.id=e56cb0010cc3451ba5b280b4d1ca76a6, user.id=f5948e2c8638458c8894d041c532f630, scope.system=all) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:56.058476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beec16-e95d-4930-bb85-174ace247455 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:56.059961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beec16-e95d-4930-bb85-174ace247455 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:56.066093 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 162/309] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Oct 8 20:34:55 2022] GET /identity/v3/role_assignments?user.id=f5948e2c8638458c8894d041c532f630&scope.system=all&role.id=e56cb0010cc3451ba5b280b4d1ca76a6 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:56.066785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beec16-e95d-4930-bb85-174ace247455 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:56.076895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fb6cdb88-cd0e-4fa6-83ec-d966f5aebf83 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:56.078565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fb6cdb88-cd0e-4fa6-83ec-d966f5aebf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:56.125598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:56.194713 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 148/310] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:56.211614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beec16-e95d-4930-bb85-174ace247455 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:56.252519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9155a-a255-4e8d-b311-aeddcc17ab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:56.253571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9155a-a255-4e8d-b311-aeddcc17ab45 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:56.254052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9155a-a255-4e8d-b311-aeddcc17ab45 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:56.254538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9155a-a255-4e8d-b311-aeddcc17ab45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:56.255989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9155a-a255-4e8d-b311-aeddcc17ab45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:56.257733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9155a-a255-4e8d-b311-aeddcc17ab45 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:56.259998 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 163/311] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:56.267973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cdb88-cd0e-4fa6-83ec-d966f5aebf83 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:56.348508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:56.375472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cdb88-cd0e-4fa6-83ec-d966f5aebf83 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:56.411301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b11c9-0a0b-4b00-b204-796e1ff6999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:56.411913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b11c9-0a0b-4b00-b204-796e1ff6999e None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:56.412193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b11c9-0a0b-4b00-b204-796e1ff6999e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:56.412465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b11c9-0a0b-4b00-b204-796e1ff6999e None admin] PATH_INFO: `/v3/groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:56.413162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b11c9-0a0b-4b00-b204-796e1ff6999e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:56.415221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b11c9-0a0b-4b00-b204-796e1ff6999e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:56.437880 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 149/312] 10.222.0.26 () {60 vars in 1134 bytes} [Sat Oct 8 20:34:56 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:56.522727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9155a-a255-4e8d-b311-aeddcc17ab45 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:56.637749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9155a-a255-4e8d-b311-aeddcc17ab45 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:56.640258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:56.676101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050f2e8-6b5e-45d7-b93d-2f4ec099e86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:56.676729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050f2e8-6b5e-45d7-b93d-2f4ec099e86d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:56.677003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050f2e8-6b5e-45d7-b93d-2f4ec099e86d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:56.677299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050f2e8-6b5e-45d7-b93d-2f4ec099e86d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:56.691313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050f2e8-6b5e-45d7-b93d-2f4ec099e86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-3050f2e8-6b5e-45d7-b93d-2f4ec099e86d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:56.696634 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:56.697568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:56.698377 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:56.698377 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:56.698377 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:56.698377 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:56.698377 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:56.698377 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:56.698377 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:56.698377 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:56.698377 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:56.698377 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:56.698377 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:56.698377 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:56.698377 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 164/313] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:56.705902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b11c9-0a0b-4b00-b204-796e1ff6999e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:56.810006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b11c9-0a0b-4b00-b204-796e1ff6999e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:56.845238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d75ce-6cc8-4af0-a840-6421869dce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:56.845906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d75ce-6cc8-4af0-a840-6421869dce8f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:56.846184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d75ce-6cc8-4af0-a840-6421869dce8f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:56.846453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d75ce-6cc8-4af0-a840-6421869dce8f None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:56.847171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d75ce-6cc8-4af0-a840-6421869dce8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:56.847479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d75ce-6cc8-4af0-a840-6421869dce8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:56.848836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d75ce-6cc8-4af0-a840-6421869dce8f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:56.850221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:56.857799 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 150/314] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:56.864200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050f2e8-6b5e-45d7-b93d-2f4ec099e86d None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:56.971759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050f2e8-6b5e-45d7-b93d-2f4ec099e86d None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:57.008786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458956a-f031-465d-999e-98ac99fb9b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:57.009808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458956a-f031-465d-999e-98ac99fb9b27 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:57.010307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458956a-f031-465d-999e-98ac99fb9b27 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:57.010746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458956a-f031-465d-999e-98ac99fb9b27 None admin] PATH_INFO: `/v3/users/eaf1bc7572094391b7252c100c84f607` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:57.012049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458956a-f031-465d-999e-98ac99fb9b27 None admin] RBAC: Authorizing `identity:get_user(user_id=eaf1bc7572094391b7252c100c84f607)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:57.013785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458956a-f031-465d-999e-98ac99fb9b27 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:57.015920 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 165/315] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:56 2022] GET /identity/v3/users/eaf1bc7572094391b7252c100c84f607 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:57.021709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d75ce-6cc8-4af0-a840-6421869dce8f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:57.128920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d75ce-6cc8-4af0-a840-6421869dce8f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:57.167531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40b59c-2f46-4508-99ad-87683adaf8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:57.168149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40b59c-2f46-4508-99ad-87683adaf8b0 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:57.168425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40b59c-2f46-4508-99ad-87683adaf8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:57.168695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40b59c-2f46-4508-99ad-87683adaf8b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:57.233894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:57.240971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40b59c-2f46-4508-99ad-87683adaf8b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:57.242525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40b59c-2f46-4508-99ad-87683adaf8b0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:57.344719 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 151/316] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:57.350495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458956a-f031-465d-999e-98ac99fb9b27 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:57.389568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:57.457512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458956a-f031-465d-999e-98ac99fb9b27 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:57.502917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8ce91-1822-4617-8b99-25033f6f7ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:57.503486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8ce91-1822-4617-8b99-25033f6f7ff4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:57.503762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8ce91-1822-4617-8b99-25033f6f7ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:57.504032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8ce91-1822-4617-8b99-25033f6f7ff4 None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:57.505157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8ce91-1822-4617-8b99-25033f6f7ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:57.506636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8ce91-1822-4617-8b99-25033f6f7ff4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:57.508950 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 166/317] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:34:57 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:57.514774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40b59c-2f46-4508-99ad-87683adaf8b0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:57.618692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40b59c-2f46-4508-99ad-87683adaf8b0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:57.621897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:57.656552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19bc4e-4152-4fb6-aab9-845da9571267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:57.657500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19bc4e-4152-4fb6-aab9-845da9571267 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:57.658012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19bc4e-4152-4fb6-aab9-845da9571267 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:57.658497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19bc4e-4152-4fb6-aab9-845da9571267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:57.659433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19bc4e-4152-4fb6-aab9-845da9571267 None admin] RBAC: Adding query filter params (role.id=e56cb0010cc3451ba5b280b4d1ca76a6, scope.project.id=a453d14403a142248aefae9ff0bf5691, user.id=eaf1bc7572094391b7252c100c84f607) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:57.659954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19bc4e-4152-4fb6-aab9-845da9571267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:57.661611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19bc4e-4152-4fb6-aab9-845da9571267 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:57.668169 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 152/318] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:57 2022] GET /identity/v3/role_assignments?user.id=eaf1bc7572094391b7252c100c84f607&scope.project.id=a453d14403a142248aefae9ff0bf5691&role.id=e56cb0010cc3451ba5b280b4d1ca76a6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:58.516729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e539348-0ede-40b2-97cb-527679979119 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:58.517404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e539348-0ede-40b2-97cb-527679979119 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:58.517404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e539348-0ede-40b2-97cb-527679979119 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:58.518814 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 167/319] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:58.523822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defccab8-fae4-4a87-b0d4-5f44428a98a4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:58.524271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defccab8-fae4-4a87-b0d4-5f44428a98a4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:58.524448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defccab8-fae4-4a87-b0d4-5f44428a98a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:58.543544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d7e5c-f541-4bb5-b10f-57d88d36ba5b None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:58.543826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d7e5c-f541-4bb5-b10f-57d88d36ba5b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:58.544098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d7e5c-f541-4bb5-b10f-57d88d36ba5b None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:58.544758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-defccab8-fae4-4a87-b0d4-5f44428a98a4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:58.545677 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 168/320] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:34:58.546041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-defccab8-fae4-4a87-b0d4-5f44428a98a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:58.551339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cb0f0-7a90-4629-9a1a-8b44ad1f3940 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:58.551656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cb0f0-7a90-4629-9a1a-8b44ad1f3940 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:58.551894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cb0f0-7a90-4629-9a1a-8b44ad1f3940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:58.572665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d29cb0f0-7a90-4629-9a1a-8b44ad1f3940 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:58.573899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d29cb0f0-7a90-4629-9a1a-8b44ad1f3940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:58.621265 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 153/321] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:58.652350 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 169/322] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:58.941956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defccab8-fae4-4a87-b0d4-5f44428a98a4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:58.974609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c222bf-cd90-4cc7-af05-bf0c820e6445 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:58.975311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c222bf-cd90-4cc7-af05-bf0c820e6445 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:58.975892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c222bf-cd90-4cc7-af05-bf0c820e6445 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:58.977483 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 170/323] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:34:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:58.978202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c222bf-cd90-4cc7-af05-bf0c820e6445 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:59.008181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:59.033403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:59.043745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defccab8-fae4-4a87-b0d4-5f44428a98a4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:59.078519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627af5b-f411-47bf-9de6-e830799e32de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:59.079146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627af5b-f411-47bf-9de6-e830799e32de None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:59.079423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627af5b-f411-47bf-9de6-e830799e32de None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:59.079695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627af5b-f411-47bf-9de6-e830799e32de None admin] PATH_INFO: `/v3/roles/member` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:59.082419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c222bf-cd90-4cc7-af05-bf0c820e6445 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:59.090055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627af5b-f411-47bf-9de6-e830799e32de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-4627af5b-f411-47bf-9de6-e830799e32de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:59.094881 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:59.095969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:59.096809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:59.096809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:59.096809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:59.096809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:59.096809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:59.096809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:59.096809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:59.096809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:59.096809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:59.096809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:59.096809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:34:59.096809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:34:59.096809 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 154/324] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:59.097953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51066aa-3fe1-4309-8041-8e9e19b881d8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:59.097953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51066aa-3fe1-4309-8041-8e9e19b881d8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:59.098125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51066aa-3fe1-4309-8041-8e9e19b881d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:59.116061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b51066aa-3fe1-4309-8041-8e9e19b881d8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:59.117283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b51066aa-3fe1-4309-8041-8e9e19b881d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:59.127555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae89f13-e346-4296-afa2-a01fb8aa4852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:59.128183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae89f13-e346-4296-afa2-a01fb8aa4852 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:59.128455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae89f13-e346-4296-afa2-a01fb8aa4852 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:59.128722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae89f13-e346-4296-afa2-a01fb8aa4852 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:59.139067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae89f13-e346-4296-afa2-a01fb8aa4852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-5ae89f13-e346-4296-afa2-a01fb8aa4852 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:59.143799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:59.144701 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 171/325] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:59.146086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae89f13-e346-4296-afa2-a01fb8aa4852 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:59.185657 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 155/326] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:59.186311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51066aa-3fe1-4309-8041-8e9e19b881d8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:59.251632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:59.268812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae89f13-e346-4296-afa2-a01fb8aa4852 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:59.279292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:59.300807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51066aa-3fe1-4309-8041-8e9e19b881d8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:59.309707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1271f7-295e-4735-b351-1b12532d917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:59.310346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1271f7-295e-4735-b351-1b12532d917e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:59.310627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1271f7-295e-4735-b351-1b12532d917e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:59.310903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1271f7-295e-4735-b351-1b12532d917e None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:59.311571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1271f7-295e-4735-b351-1b12532d917e None admin] RBAC: Adding query filter params (name=member) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:59.311876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1271f7-295e-4735-b351-1b12532d917e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:59.313278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1271f7-295e-4735-b351-1b12532d917e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:59.322395 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 172/327] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:59.327739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1271f7-295e-4735-b351-1b12532d917e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:59.337600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857721e-aac0-4e06-bea7-61a957e8db1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:59.338218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857721e-aac0-4e06-bea7-61a957e8db1c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:59.338500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857721e-aac0-4e06-bea7-61a957e8db1c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:59.338775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857721e-aac0-4e06-bea7-61a957e8db1c None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:59.339451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857721e-aac0-4e06-bea7-61a957e8db1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:59.339758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857721e-aac0-4e06-bea7-61a957e8db1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:59.341127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857721e-aac0-4e06-bea7-61a957e8db1c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:59.353239 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 156/328] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:59.355123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857721e-aac0-4e06-bea7-61a957e8db1c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:59.437090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1271f7-295e-4735-b351-1b12532d917e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:59.462176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857721e-aac0-4e06-bea7-61a957e8db1c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:59.476357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675da40-d422-45cc-bf9e-3f36b07a9e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:59.476357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675da40-d422-45cc-bf9e-3f36b07a9e6a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:59.476357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675da40-d422-45cc-bf9e-3f36b07a9e6a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:59.476357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675da40-d422-45cc-bf9e-3f36b07a9e6a None admin] PATH_INFO: `/v3/users/cf097f618f014247be7e1585a9fe32ee` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:59.477553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675da40-d422-45cc-bf9e-3f36b07a9e6a None admin] RBAC: Authorizing `identity:get_user(user_id=cf097f618f014247be7e1585a9fe32ee)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:59.479062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675da40-d422-45cc-bf9e-3f36b07a9e6a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:59.480881 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 173/329] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:59 2022] GET /identity/v3/users/cf097f618f014247be7e1585a9fe32ee => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:59.487726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675da40-d422-45cc-bf9e-3f36b07a9e6a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:59.506972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44291f-040c-44d6-be4b-6d52d1115f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:59.507569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44291f-040c-44d6-be4b-6d52d1115f2d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:59.507848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44291f-040c-44d6-be4b-6d52d1115f2d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:59.508123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44291f-040c-44d6-be4b-6d52d1115f2d None admin] PATH_INFO: `/v3/users/f5948e2c8638458c8894d041c532f630` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:59.509903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44291f-040c-44d6-be4b-6d52d1115f2d None admin] RBAC: Authorizing `identity:get_user(user_id=f5948e2c8638458c8894d041c532f630)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:59.511348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44291f-040c-44d6-be4b-6d52d1115f2d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:59.511963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:59.513722 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 157/330] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:34:59 2022] GET /identity/v3/users/f5948e2c8638458c8894d041c532f630 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:59.515020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44291f-040c-44d6-be4b-6d52d1115f2d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:59.529347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:59.591244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675da40-d422-45cc-bf9e-3f36b07a9e6a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:59.617230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44291f-040c-44d6-be4b-6d52d1115f2d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:59.624661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f45e98-8afd-46d0-9c85-9287debd2230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:59.625299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f45e98-8afd-46d0-9c85-9287debd2230 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:59.626762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f45e98-8afd-46d0-9c85-9287debd2230 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:59.627049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f45e98-8afd-46d0-9c85-9287debd2230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:59.627775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f45e98-8afd-46d0-9c85-9287debd2230 None admin] RBAC: Adding query filter params (role.id=27431c49ccd74f7a898d1a39e251ce29, user.id=cf097f618f014247be7e1585a9fe32ee, scope.system=all) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:59.628085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f45e98-8afd-46d0-9c85-9287debd2230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:59.629538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f45e98-8afd-46d0-9c85-9287debd2230 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:59.640934 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 174/331] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Oct 8 20:34:59 2022] GET /identity/v3/role_assignments?user.id=cf097f618f014247be7e1585a9fe32ee&scope.system=all&role.id=27431c49ccd74f7a898d1a39e251ce29 => generated 510 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:59.641818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f45e98-8afd-46d0-9c85-9287debd2230 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:59.658226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26b9c6-7401-4274-af0c-b57d8317e192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:59.660533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26b9c6-7401-4274-af0c-b57d8317e192 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:59.660837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26b9c6-7401-4274-af0c-b57d8317e192 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:59.661127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26b9c6-7401-4274-af0c-b57d8317e192 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:59.662473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26b9c6-7401-4274-af0c-b57d8317e192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:59.663948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26b9c6-7401-4274-af0c-b57d8317e192 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:59.666225 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 158/332] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:59.671914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26b9c6-7401-4274-af0c-b57d8317e192 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:59.739348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:59.765547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f45e98-8afd-46d0-9c85-9287debd2230 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:59.767916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:59.797771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26b9c6-7401-4274-af0c-b57d8317e192 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:59.810119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c01b9-5d15-4968-9c02-d7ab72105031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:59.811266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c01b9-5d15-4968-9c02-d7ab72105031 None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:59.811553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c01b9-5d15-4968-9c02-d7ab72105031 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:59.811837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c01b9-5d15-4968-9c02-d7ab72105031 None admin] PATH_INFO: `/v3/system/users/f5948e2c8638458c8894d041c532f630/roles/e56cb0010cc3451ba5b280b4d1ca76a6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:59.813706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c01b9-5d15-4968-9c02-d7ab72105031 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f5948e2c8638458c8894d041c532f630, role_id=e56cb0010cc3451ba5b280b4d1ca76a6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:59.815113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c01b9-5d15-4968-9c02-d7ab72105031 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:59.824086 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 175/333] 10.222.0.26 () {58 vars in 1334 bytes} [Sat Oct 8 20:34:59 2022] PUT /identity/v3/system/users/f5948e2c8638458c8894d041c532f630/roles/e56cb0010cc3451ba5b280b4d1ca76a6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:34:59.847120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099249f9-f4cd-42ad-bb0a-e6aba7362467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:59.848069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099249f9-f4cd-42ad-bb0a-e6aba7362467 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:59.848545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099249f9-f4cd-42ad-bb0a-e6aba7362467 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:59.849006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099249f9-f4cd-42ad-bb0a-e6aba7362467 None admin] PATH_INFO: `/v3/groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:59.849865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099249f9-f4cd-42ad-bb0a-e6aba7362467 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:59.851716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099249f9-f4cd-42ad-bb0a-e6aba7362467 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:59.871630 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 159/334] 10.222.0.26 () {60 vars in 1134 bytes} [Sat Oct 8 20:34:59 2022] POST /identity/v3/groups => generated 226 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:35:02.393786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f18eae-e412-4ba1-b86e-64fb09791b00 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:02.394872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f18eae-e412-4ba1-b86e-64fb09791b00 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:02.395383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f18eae-e412-4ba1-b86e-64fb09791b00 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:02.397250 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 176/335] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:02.404185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75020f20-8a25-42d6-9dea-304fc4244944 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:02.405030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75020f20-8a25-42d6-9dea-304fc4244944 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:02.405553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75020f20-8a25-42d6-9dea-304fc4244944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:02.438173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-75020f20-8a25-42d6-9dea-304fc4244944 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:02.439716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-75020f20-8a25-42d6-9dea-304fc4244944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:02.532766 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 160/336] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:02.718753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827bbcc-5b09-400c-91b8-44a2079d7924 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:02.719468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827bbcc-5b09-400c-91b8-44a2079d7924 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:02.719966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827bbcc-5b09-400c-91b8-44a2079d7924 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:02.722110 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 177/337] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:02.727309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b283e3-0c07-4304-a597-b7e96ad2e728 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:02.727860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b283e3-0c07-4304-a597-b7e96ad2e728 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:02.728339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b283e3-0c07-4304-a597-b7e96ad2e728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:02.758982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-56b283e3-0c07-4304-a597-b7e96ad2e728 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:02.760575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-56b283e3-0c07-4304-a597-b7e96ad2e728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:02.835382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:02.841364 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 161/338] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:03.136683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827bbcc-5b09-400c-91b8-44a2079d7924 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:03.268009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827bbcc-5b09-400c-91b8-44a2079d7924 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:03.310412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de0305-2e87-4d50-b15a-7d18dacde544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:03.311406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de0305-2e87-4d50-b15a-7d18dacde544 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:03.311917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de0305-2e87-4d50-b15a-7d18dacde544 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:03.312415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de0305-2e87-4d50-b15a-7d18dacde544 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:03.325347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de0305-2e87-4d50-b15a-7d18dacde544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-63de0305-2e87-4d50-b15a-7d18dacde544 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:03.331057 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:03.331923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:03.332715 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:03.332715 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:03.332715 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:03.332715 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:03.332715 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:03.332715 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:03.332715 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:03.332715 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:03.332715 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:03.332715 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:03.332715 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:35:03.332715 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:03.335315 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 178/339] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:03.341679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b283e3-0c07-4304-a597-b7e96ad2e728 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:03.496188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b283e3-0c07-4304-a597-b7e96ad2e728 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:03.545831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137186d-bd47-4381-a433-977786c2e136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:03.546826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137186d-bd47-4381-a433-977786c2e136 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:03.547341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137186d-bd47-4381-a433-977786c2e136 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:03.547826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137186d-bd47-4381-a433-977786c2e136 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:03.549110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de0305-2e87-4d50-b15a-7d18dacde544 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:03.552928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:03.553083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137186d-bd47-4381-a433-977786c2e136 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:03.553363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137186d-bd47-4381-a433-977786c2e136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:03.561171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137186d-bd47-4381-a433-977786c2e136 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:03.586182 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 162/340] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:35:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:03.588881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137186d-bd47-4381-a433-977786c2e136 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:03.682658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:03.712084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de0305-2e87-4d50-b15a-7d18dacde544 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:03.738857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137186d-bd47-4381-a433-977786c2e136 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:03.759784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585fa4c-b400-4b1f-8454-47f8e12b7d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:03.760784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585fa4c-b400-4b1f-8454-47f8e12b7d9e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:03.761354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585fa4c-b400-4b1f-8454-47f8e12b7d9e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:03.761823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585fa4c-b400-4b1f-8454-47f8e12b7d9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:03.774236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585fa4c-b400-4b1f-8454-47f8e12b7d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-9585fa4c-b400-4b1f-8454-47f8e12b7d9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:03.780425 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:03.781323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:03.782108 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:03.782108 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:03.782108 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:03.782108 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:03.782108 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:03.782108 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:03.782108 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:03.782108 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:03.782108 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:03.782108 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:03.782108 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:35:03.782108 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:03.784472 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 179/341] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:03.784809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dbfbd-123e-4ba9-8026-daf779b26484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:03.785618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dbfbd-123e-4ba9-8026-daf779b26484 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:03.785997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dbfbd-123e-4ba9-8026-daf779b26484 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:03.786332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958a055-40c0-48b5-ab33-73032d157098 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:03.786440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dbfbd-123e-4ba9-8026-daf779b26484 None admin] PATH_INFO: `/v3/users/f5948e2c8638458c8894d041c532f630` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:03.786827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958a055-40c0-48b5-ab33-73032d157098 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:03.787231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958a055-40c0-48b5-ab33-73032d157098 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:03.793220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dbfbd-123e-4ba9-8026-daf779b26484 None admin] RBAC: Authorizing `identity:get_user(user_id=f5948e2c8638458c8894d041c532f630)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:03.793379 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 180/342] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:03.793470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dbfbd-123e-4ba9-8026-daf779b26484 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:03.793470 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 163/343] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:35:03 2022] GET /identity/v3/users/f5948e2c8638458c8894d041c532f630 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:03.795540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be1085-b62a-49ba-84e1-7fc8b5593f68 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:03.795540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be1085-b62a-49ba-84e1-7fc8b5593f68 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:03.795540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be1085-b62a-49ba-84e1-7fc8b5593f68 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:03.796011 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 164/344] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:03.799472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eacf34-f497-42b9-bbf6-9b1ed2aa100c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:03.799982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eacf34-f497-42b9-bbf6-9b1ed2aa100c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:03.800455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eacf34-f497-42b9-bbf6-9b1ed2aa100c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:03.804100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cef431-b9f4-4e98-8941-a3a4289501c8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:03.804100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cef431-b9f4-4e98-8941-a3a4289501c8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:03.804421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cef431-b9f4-4e98-8941-a3a4289501c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:03.822267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e2eacf34-f497-42b9-bbf6-9b1ed2aa100c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:03.824747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a0cef431-b9f4-4e98-8941-a3a4289501c8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:03.825207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e2eacf34-f497-42b9-bbf6-9b1ed2aa100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:03.826381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a0cef431-b9f4-4e98-8941-a3a4289501c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:03.911900 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 165/345] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:03.912820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:03.914320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cef431-b9f4-4e98-8941-a3a4289501c8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:03.936295 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 181/346] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:03.937429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eacf34-f497-42b9-bbf6-9b1ed2aa100c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:04.021114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:04.081278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cef431-b9f4-4e98-8941-a3a4289501c8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:04.122737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eacf34-f497-42b9-bbf6-9b1ed2aa100c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:04.144663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880d792-2bb0-4ce1-8ac2-7c0e1a7aa499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:04.145294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880d792-2bb0-4ce1-8ac2-7c0e1a7aa499 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:04.145569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880d792-2bb0-4ce1-8ac2-7c0e1a7aa499 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:04.145836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880d792-2bb0-4ce1-8ac2-7c0e1a7aa499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:04.146646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880d792-2bb0-4ce1-8ac2-7c0e1a7aa499 None admin] RBAC: Adding query filter params (role.id=e56cb0010cc3451ba5b280b4d1ca76a6, user.id=f5948e2c8638458c8894d041c532f630, scope.system=all) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:04.146954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880d792-2bb0-4ce1-8ac2-7c0e1a7aa499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:04.148502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880d792-2bb0-4ce1-8ac2-7c0e1a7aa499 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:04.168402 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 166/347] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Oct 8 20:35:03 2022] GET /identity/v3/role_assignments?user.id=f5948e2c8638458c8894d041c532f630&scope.system=all&role.id=e56cb0010cc3451ba5b280b4d1ca76a6 => generated 510 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:04.187254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc742c3e-3e4d-4478-b74c-1b57a28124d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:04.187897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742c3e-3e4d-4478-b74c-1b57a28124d1 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:04.188171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742c3e-3e4d-4478-b74c-1b57a28124d1 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:04.188438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742c3e-3e4d-4478-b74c-1b57a28124d1 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:04.189117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc742c3e-3e4d-4478-b74c-1b57a28124d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:04.189440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc742c3e-3e4d-4478-b74c-1b57a28124d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:04.190823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc742c3e-3e4d-4478-b74c-1b57a28124d1 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:04.207499 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 182/348] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:35:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:04.213695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880d792-2bb0-4ce1-8ac2-7c0e1a7aa499 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:04.343262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880d792-2bb0-4ce1-8ac2-7c0e1a7aa499 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:04.362495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:04.382614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73bb20-f5b4-4a6c-a4b8-b1a41a19f396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:04.383728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73bb20-f5b4-4a6c-a4b8-b1a41a19f396 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:04.384015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73bb20-f5b4-4a6c-a4b8-b1a41a19f396 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:04.384283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73bb20-f5b4-4a6c-a4b8-b1a41a19f396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:04.389646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38c202-3bac-4e4c-9300-35593ab0e438 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:04.389923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38c202-3bac-4e4c-9300-35593ab0e438 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:04.390186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38c202-3bac-4e4c-9300-35593ab0e438 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:04.391679 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 183/349] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:35:04.396835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c41ea-bc08-43b7-9d77-dbe48132e7c1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:04.397120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c41ea-bc08-43b7-9d77-dbe48132e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:04.397420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c41ea-bc08-43b7-9d77-dbe48132e7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:04.422930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7b7c41ea-bc08-43b7-9d77-dbe48132e7c1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:04.424994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7b7c41ea-bc08-43b7-9d77-dbe48132e7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:04.526567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73bb20-f5b4-4a6c-a4b8-b1a41a19f396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:04.528043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73bb20-f5b4-4a6c-a4b8-b1a41a19f396 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:04.535755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:04.565644 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 184/350] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:04.568159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c41ea-bc08-43b7-9d77-dbe48132e7c1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:04.667536 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 167/351] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:04.668833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73bb20-f5b4-4a6c-a4b8-b1a41a19f396 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:04.688865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:04.701246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c41ea-bc08-43b7-9d77-dbe48132e7c1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:04.739543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906d7d7-16c2-49fc-9f8f-552e89a5c4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:04.740206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906d7d7-16c2-49fc-9f8f-552e89a5c4dd None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:04.740686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906d7d7-16c2-49fc-9f8f-552e89a5c4dd None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:04.740795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906d7d7-16c2-49fc-9f8f-552e89a5c4dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:04.752266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906d7d7-16c2-49fc-9f8f-552e89a5c4dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-0906d7d7-16c2-49fc-9f8f-552e89a5c4dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:04.757610 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:04.759114 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:04.759976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:04.759976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:04.759976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:04.759976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:04.759976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:04.759976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:04.759976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:04.759976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:04.759976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:04.759976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:04.759976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:35:04.759976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:04.759976 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 185/352] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:04.760661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906d7d7-16c2-49fc-9f8f-552e89a5c4dd None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:04.798954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73bb20-f5b4-4a6c-a4b8-b1a41a19f396 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:04.811204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:04.841761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d708da8-c187-428a-9bd7-79d31bc09f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:04.842674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d708da8-c187-428a-9bd7-79d31bc09f4b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:04.843115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d708da8-c187-428a-9bd7-79d31bc09f4b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:04.843532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d708da8-c187-428a-9bd7-79d31bc09f4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:04.855137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d708da8-c187-428a-9bd7-79d31bc09f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-2d708da8-c187-428a-9bd7-79d31bc09f4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:04.860681 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:04.862056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:04.862838 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:04.862838 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:04.862838 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:04.862838 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:04.862838 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:04.862838 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:04.862838 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:04.862838 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:04.862838 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:04.862838 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:04.862838 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:04.862838 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:04.865272 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 168/353] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:35:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:04.866327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d708da8-c187-428a-9bd7-79d31bc09f4b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:04.875926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906d7d7-16c2-49fc-9f8f-552e89a5c4dd None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:04.917780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66b83f-524d-4e0c-b1a9-d3cc37294ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:04.918579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66b83f-524d-4e0c-b1a9-d3cc37294ca3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:04.918834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66b83f-524d-4e0c-b1a9-d3cc37294ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:04.919230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66b83f-524d-4e0c-b1a9-d3cc37294ca3 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:04.920526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66b83f-524d-4e0c-b1a9-d3cc37294ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:04.922330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66b83f-524d-4e0c-b1a9-d3cc37294ca3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:04.924043 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 186/354] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:04 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:04.925004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66b83f-524d-4e0c-b1a9-d3cc37294ca3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:04.957423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:04.985620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d708da8-c187-428a-9bd7-79d31bc09f4b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:05.031375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec326f96-034a-4e50-b182-855f560700e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:05.032314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec326f96-034a-4e50-b182-855f560700e0 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:05.032811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec326f96-034a-4e50-b182-855f560700e0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:05.033297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec326f96-034a-4e50-b182-855f560700e0 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:05.034183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec326f96-034a-4e50-b182-855f560700e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:05.034688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec326f96-034a-4e50-b182-855f560700e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:05.036294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec326f96-034a-4e50-b182-855f560700e0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:05.051317 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 169/355] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:35:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:05.052280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec326f96-034a-4e50-b182-855f560700e0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:05.053839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66b83f-524d-4e0c-b1a9-d3cc37294ca3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:05.069463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:05.094522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b2d6e-ba77-4004-ac2c-6eacaca81e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:05.095133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b2d6e-ba77-4004-ac2c-6eacaca81e40 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:05.095413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b2d6e-ba77-4004-ac2c-6eacaca81e40 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:05.095684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b2d6e-ba77-4004-ac2c-6eacaca81e40 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:05.096351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b2d6e-ba77-4004-ac2c-6eacaca81e40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:05.096653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b2d6e-ba77-4004-ac2c-6eacaca81e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:05.099038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b2d6e-ba77-4004-ac2c-6eacaca81e40 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:05.108191 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 187/356] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:05.109099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b2d6e-ba77-4004-ac2c-6eacaca81e40 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:05.185337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec326f96-034a-4e50-b182-855f560700e0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:05.229769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e31b5-9e73-4596-b7de-46e07b7904c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:05.230638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e31b5-9e73-4596-b7de-46e07b7904c3 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:05.231098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e31b5-9e73-4596-b7de-46e07b7904c3 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:05.231373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e31b5-9e73-4596-b7de-46e07b7904c3 None admin] PATH_INFO: `/v3/groups/a173b8cf9c0245f9b45632507d87ce5a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:05.238055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e31b5-9e73-4596-b7de-46e07b7904c3 None admin] RBAC: Authorizing `identity:get_group(group_id=a173b8cf9c0245f9b45632507d87ce5a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:05.239494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e31b5-9e73-4596-b7de-46e07b7904c3 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:05.240717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b2d6e-ba77-4004-ac2c-6eacaca81e40 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:05.241497 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 170/357] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:05 2022] GET /identity/v3/groups/a173b8cf9c0245f9b45632507d87ce5a => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:05.242392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e31b5-9e73-4596-b7de-46e07b7904c3 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:05.248914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:05.283415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea7260-850b-4a80-8d82-e40c45a29eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:05.284195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea7260-850b-4a80-8d82-e40c45a29eb4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:05.284534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea7260-850b-4a80-8d82-e40c45a29eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:05.285225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea7260-850b-4a80-8d82-e40c45a29eb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:05.300084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea7260-850b-4a80-8d82-e40c45a29eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-46ea7260-850b-4a80-8d82-e40c45a29eb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:05.307340 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:05.308258 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 188/358] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:35:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:05.309481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea7260-850b-4a80-8d82-e40c45a29eb4 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:05.363198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:05.372022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e31b5-9e73-4596-b7de-46e07b7904c3 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:05.409932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10351a-a906-45f4-a211-1a45e121bbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:05.410552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10351a-a906-45f4-a211-1a45e121bbd1 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:05.410830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10351a-a906-45f4-a211-1a45e121bbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:05.411100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10351a-a906-45f4-a211-1a45e121bbd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:05.446177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea7260-850b-4a80-8d82-e40c45a29eb4 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:05.496093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994301e2-e0f8-4464-8b3d-06019b1c5e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:05.496815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994301e2-e0f8-4464-8b3d-06019b1c5e8f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:05.497168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994301e2-e0f8-4464-8b3d-06019b1c5e8f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:05.497562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994301e2-e0f8-4464-8b3d-06019b1c5e8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:05.500238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10351a-a906-45f4-a211-1a45e121bbd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:05.502037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10351a-a906-45f4-a211-1a45e121bbd1 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:05.503657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:05.578221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994301e2-e0f8-4464-8b3d-06019b1c5e8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:05.579747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994301e2-e0f8-4464-8b3d-06019b1c5e8f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:05.615677 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 171/359] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:05.617159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10351a-a906-45f4-a211-1a45e121bbd1 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:05.624062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:05.701383 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 189/360] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:05.702443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994301e2-e0f8-4464-8b3d-06019b1c5e8f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:05.735192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10351a-a906-45f4-a211-1a45e121bbd1 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:05.736979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:05.776661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262769f2-b423-4ed7-be72-b5fd50d862d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:05.777545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262769f2-b423-4ed7-be72-b5fd50d862d4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:05.777830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262769f2-b423-4ed7-be72-b5fd50d862d4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:05.778090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262769f2-b423-4ed7-be72-b5fd50d862d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:05.778815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262769f2-b423-4ed7-be72-b5fd50d862d4 None admin] RBAC: Adding query filter params (group.id=a173b8cf9c0245f9b45632507d87ce5a, role.id=27431c49ccd74f7a898d1a39e251ce29, scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:05.779201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262769f2-b423-4ed7-be72-b5fd50d862d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:05.780540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262769f2-b423-4ed7-be72-b5fd50d862d4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:05.787929 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 172/361] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Oct 8 20:35:05 2022] GET /identity/v3/role_assignments?group.id=a173b8cf9c0245f9b45632507d87ce5a&scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc&role.id=27431c49ccd74f7a898d1a39e251ce29 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:05.789131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28477c4-e62d-4f9b-9af4-d4bd0b226bcc None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:05.789503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28477c4-e62d-4f9b-9af4-d4bd0b226bcc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:05.789779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28477c4-e62d-4f9b-9af4-d4bd0b226bcc None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:05.791161 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 173/362] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:05.791777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28477c4-e62d-4f9b-9af4-d4bd0b226bcc None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:05.840594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994301e2-e0f8-4464-8b3d-06019b1c5e8f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:05.886038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c62c15-f0eb-4276-b46d-9f6f8d21060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:05.887021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c62c15-f0eb-4276-b46d-9f6f8d21060d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:05.887416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c62c15-f0eb-4276-b46d-9f6f8d21060d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:05.887691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c62c15-f0eb-4276-b46d-9f6f8d21060d None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:05.888379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c62c15-f0eb-4276-b46d-9f6f8d21060d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:05.888683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c62c15-f0eb-4276-b46d-9f6f8d21060d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:05.890120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c62c15-f0eb-4276-b46d-9f6f8d21060d None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:05.891780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:05.904156 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 190/363] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:05.905014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c62c15-f0eb-4276-b46d-9f6f8d21060d None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:05.942806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28477c4-e62d-4f9b-9af4-d4bd0b226bcc None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:05.995980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99b1d8-67b4-4cd8-86d2-f914335a3e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:05.996723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b1d8-67b4-4cd8-86d2-f914335a3e5c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:05.997010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b1d8-67b4-4cd8-86d2-f914335a3e5c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:05.997305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b1d8-67b4-4cd8-86d2-f914335a3e5c None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:05.999207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99b1d8-67b4-4cd8-86d2-f914335a3e5c None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:06.001290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99b1d8-67b4-4cd8-86d2-f914335a3e5c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:06.003151 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 174/364] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:05 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:06.004112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607de066-f68d-4fec-ab8a-ed900998932e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:06.004389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607de066-f68d-4fec-ab8a-ed900998932e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:06.004946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607de066-f68d-4fec-ab8a-ed900998932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:06.023756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-607de066-f68d-4fec-ab8a-ed900998932e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:06.024997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-607de066-f68d-4fec-ab8a-ed900998932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:06.055783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c62c15-f0eb-4276-b46d-9f6f8d21060d None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:06.057440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:06.100876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cf4e4-013b-44df-ae4b-eceb39569fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:06.101609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf4e4-013b-44df-ae4b-eceb39569fba None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:06.101896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf4e4-013b-44df-ae4b-eceb39569fba None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:06.102753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf4e4-013b-44df-ae4b-eceb39569fba None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:06.104189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cf4e4-013b-44df-ae4b-eceb39569fba None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:06.105830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cf4e4-013b-44df-ae4b-eceb39569fba None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:06.107338 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 191/365] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:05 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:06.107945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cf4e4-013b-44df-ae4b-eceb39569fba None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:06.108883 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 175/366] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:06.117100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607de066-f68d-4fec-ab8a-ed900998932e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:06.238482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:06.246545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607de066-f68d-4fec-ab8a-ed900998932e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:06.288743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cf4e4-013b-44df-ae4b-eceb39569fba None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:06.291239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc3d6a-4152-4638-940a-e2034a451872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:06.291946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc3d6a-4152-4638-940a-e2034a451872 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:06.292228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc3d6a-4152-4638-940a-e2034a451872 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:06.292504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc3d6a-4152-4638-940a-e2034a451872 None admin] PATH_INFO: `/v3/groups/a173b8cf9c0245f9b45632507d87ce5a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:06.293658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc3d6a-4152-4638-940a-e2034a451872 None admin] RBAC: Authorizing `identity:get_group(group_id=a173b8cf9c0245f9b45632507d87ce5a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:06.295093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc3d6a-4152-4638-940a-e2034a451872 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:06.297082 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 176/367] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:06 2022] GET /identity/v3/groups/a173b8cf9c0245f9b45632507d87ce5a => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:06.297949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc3d6a-4152-4638-940a-e2034a451872 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:06.339600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0fc00-03d8-4e22-a337-5d8639819108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:06.340230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0fc00-03d8-4e22-a337-5d8639819108 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:06.340516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0fc00-03d8-4e22-a337-5d8639819108 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:06.341316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0fc00-03d8-4e22-a337-5d8639819108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:06.348420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:06.437818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0fc00-03d8-4e22-a337-5d8639819108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:06.439287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0fc00-03d8-4e22-a337-5d8639819108 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:06.462670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc3d6a-4152-4638-940a-e2034a451872 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:06.511912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e1cf-69f3-44ec-941b-706867473255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:06.512927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e1cf-69f3-44ec-941b-706867473255 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:06.513402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e1cf-69f3-44ec-941b-706867473255 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:06.513813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e1cf-69f3-44ec-941b-706867473255 None admin] PATH_INFO: `/v3/groups/a173b8cf9c0245f9b45632507d87ce5a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:06.515199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:06.516308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869e1cf-69f3-44ec-941b-706867473255 None admin] RBAC: Authorizing `identity:get_group(group_id=a173b8cf9c0245f9b45632507d87ce5a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:06.517963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869e1cf-69f3-44ec-941b-706867473255 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:06.519993 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 177/368] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:06 2022] GET /identity/v3/groups/a173b8cf9c0245f9b45632507d87ce5a => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:06.521018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e1cf-69f3-44ec-941b-706867473255 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:06.569795 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 192/369] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:06.570677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0fc00-03d8-4e22-a337-5d8639819108 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:06.650745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:06.656778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e1cf-69f3-44ec-941b-706867473255 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:06.703921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0fc00-03d8-4e22-a337-5d8639819108 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:06.710479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a774c6-c9d3-4a8b-8af2-fbd32b53f38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:06.711088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a774c6-c9d3-4a8b-8af2-fbd32b53f38a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:06.711442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a774c6-c9d3-4a8b-8af2-fbd32b53f38a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:06.711761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a774c6-c9d3-4a8b-8af2-fbd32b53f38a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:06.712493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a774c6-c9d3-4a8b-8af2-fbd32b53f38a None admin] RBAC: Adding query filter params (group.id=a173b8cf9c0245f9b45632507d87ce5a, role.id=27431c49ccd74f7a898d1a39e251ce29, scope.project.id=a453d14403a142248aefae9ff0bf5691) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:06.712797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a774c6-c9d3-4a8b-8af2-fbd32b53f38a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:06.714281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a774c6-c9d3-4a8b-8af2-fbd32b53f38a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:06.720751 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 178/370] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Oct 8 20:35:06 2022] GET /identity/v3/role_assignments?group.id=a173b8cf9c0245f9b45632507d87ce5a&scope.project.id=a453d14403a142248aefae9ff0bf5691&role.id=27431c49ccd74f7a898d1a39e251ce29 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:06.721562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a774c6-c9d3-4a8b-8af2-fbd32b53f38a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:06.752405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afbc9d-7037-4c83-9daa-717a6aa26d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:06.753400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afbc9d-7037-4c83-9daa-717a6aa26d95 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:06.753865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afbc9d-7037-4c83-9daa-717a6aa26d95 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:06.754315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afbc9d-7037-4c83-9daa-717a6aa26d95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:06.768431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afbc9d-7037-4c83-9daa-717a6aa26d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-b8afbc9d-7037-4c83-9daa-717a6aa26d95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:06.773461 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:06.774553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:06.775373 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:06.775373 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:06.775373 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:06.775373 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:06.775373 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:06.775373 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:06.775373 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:06.775373 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:06.775373 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:06.775373 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:06.775373 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:06.775373 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:06.775373 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 193/371] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:35:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:06.776074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afbc9d-7037-4c83-9daa-717a6aa26d95 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:06.812765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:06.893294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a774c6-c9d3-4a8b-8af2-fbd32b53f38a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:06.919280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afbc9d-7037-4c83-9daa-717a6aa26d95 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:06.934100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc722f9-3bd7-43b8-92b3-6c02a9205af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:06.934724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc722f9-3bd7-43b8-92b3-6c02a9205af6 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:06.935005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc722f9-3bd7-43b8-92b3-6c02a9205af6 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:06.935279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc722f9-3bd7-43b8-92b3-6c02a9205af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:06.936087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc722f9-3bd7-43b8-92b3-6c02a9205af6 None admin] RBAC: Adding query filter params (group.id=a173b8cf9c0245f9b45632507d87ce5a, role.id=94f39d4bced64cc98e66bceafe049303, scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:06.936400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc722f9-3bd7-43b8-92b3-6c02a9205af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:06.938006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc722f9-3bd7-43b8-92b3-6c02a9205af6 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:06.945619 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 179/372] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Oct 8 20:35:06 2022] GET /identity/v3/role_assignments?group.id=a173b8cf9c0245f9b45632507d87ce5a&scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc&role.id=94f39d4bced64cc98e66bceafe049303 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:06.947114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc722f9-3bd7-43b8-92b3-6c02a9205af6 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:06.973004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0f4ea-ef92-4b0a-b532-9384be1927fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:06.975584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0f4ea-ef92-4b0a-b532-9384be1927fc None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:06.975723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0f4ea-ef92-4b0a-b532-9384be1927fc None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:06.975928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0f4ea-ef92-4b0a-b532-9384be1927fc None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:06.979276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0f4ea-ef92-4b0a-b532-9384be1927fc None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:06.981674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0f4ea-ef92-4b0a-b532-9384be1927fc None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:06.984052 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 194/373] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:06 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:06.990947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0f4ea-ef92-4b0a-b532-9384be1927fc None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:07.013656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:07.117899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc722f9-3bd7-43b8-92b3-6c02a9205af6 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:07.118671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:07.129976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0f4ea-ef92-4b0a-b532-9384be1927fc None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:07.180816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063d877-5275-42cc-8b40-a54dfcaed48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:07.181852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063d877-5275-42cc-8b40-a54dfcaed48f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:07.182335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063d877-5275-42cc-8b40-a54dfcaed48f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:07.182828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063d877-5275-42cc-8b40-a54dfcaed48f None admin] PATH_INFO: `/v3/groups/a173b8cf9c0245f9b45632507d87ce5a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:07.185722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063d877-5275-42cc-8b40-a54dfcaed48f None admin] RBAC: Authorizing `identity:get_group(group_id=a173b8cf9c0245f9b45632507d87ce5a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:07.188282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063d877-5275-42cc-8b40-a54dfcaed48f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:07.192763 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 195/374] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:06 2022] GET /identity/v3/groups/a173b8cf9c0245f9b45632507d87ce5a => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:07.199313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bdd1d-82a1-40da-82a1-cc7acc04da4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:07.200252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bdd1d-82a1-40da-82a1-cc7acc04da4c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:07.200786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bdd1d-82a1-40da-82a1-cc7acc04da4c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:07.201276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bdd1d-82a1-40da-82a1-cc7acc04da4c None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:07.202169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bdd1d-82a1-40da-82a1-cc7acc04da4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:07.202668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bdd1d-82a1-40da-82a1-cc7acc04da4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:07.204231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bdd1d-82a1-40da-82a1-cc7acc04da4c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:07.206193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063d877-5275-42cc-8b40-a54dfcaed48f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:07.223370 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 180/375] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:07.230158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bdd1d-82a1-40da-82a1-cc7acc04da4c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:07.351555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:07.363549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bdd1d-82a1-40da-82a1-cc7acc04da4c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:07.392169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063d877-5275-42cc-8b40-a54dfcaed48f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:07.416652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f3f84-d70f-4ce7-888f-a705b8024d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:07.417722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f3f84-d70f-4ce7-888f-a705b8024d5e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:07.418202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f3f84-d70f-4ce7-888f-a705b8024d5e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:07.418713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f3f84-d70f-4ce7-888f-a705b8024d5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:07.464163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66137f02-0bcb-49a2-8ba5-2b2b6cd8216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:07.464787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66137f02-0bcb-49a2-8ba5-2b2b6cd8216e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:07.465063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66137f02-0bcb-49a2-8ba5-2b2b6cd8216e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:07.466480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66137f02-0bcb-49a2-8ba5-2b2b6cd8216e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:07.466480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66137f02-0bcb-49a2-8ba5-2b2b6cd8216e None admin] RBAC: Adding query filter params (group.id=a173b8cf9c0245f9b45632507d87ce5a, role.id=94f39d4bced64cc98e66bceafe049303, scope.project.id=a453d14403a142248aefae9ff0bf5691) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:07.466679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66137f02-0bcb-49a2-8ba5-2b2b6cd8216e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:07.469826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66137f02-0bcb-49a2-8ba5-2b2b6cd8216e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:07.483872 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 196/376] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Oct 8 20:35:07 2022] GET /identity/v3/role_assignments?group.id=a173b8cf9c0245f9b45632507d87ce5a&scope.project.id=a453d14403a142248aefae9ff0bf5691&role.id=94f39d4bced64cc98e66bceafe049303 => generated 260 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:07.557714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f3f84-d70f-4ce7-888f-a705b8024d5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:07.559764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f3f84-d70f-4ce7-888f-a705b8024d5e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:07.686332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:07.700028 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 181/377] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:35:07.705811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66137f02-0bcb-49a2-8ba5-2b2b6cd8216e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:07.735489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:07.817913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66137f02-0bcb-49a2-8ba5-2b2b6cd8216e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:07.854234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d1f97-a9dc-431e-8f47-500127ee311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:07.854883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d1f97-a9dc-431e-8f47-500127ee311b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:07.855163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d1f97-a9dc-431e-8f47-500127ee311b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:07.855499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d1f97-a9dc-431e-8f47-500127ee311b None admin] PATH_INFO: `/v3/projects/8cbdca763b15498ebcee722600237097` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:07.856637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d1f97-a9dc-431e-8f47-500127ee311b None admin] RBAC: Authorizing `identity:get_project(project_id=8cbdca763b15498ebcee722600237097)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:07.858195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d1f97-a9dc-431e-8f47-500127ee311b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:07.860155 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 197/378] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:07 2022] GET /identity/v3/projects/8cbdca763b15498ebcee722600237097 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:07.865922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f3f84-d70f-4ce7-888f-a705b8024d5e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:07.983698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f3f84-d70f-4ce7-888f-a705b8024d5e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:08.030530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a1868-1915-4b8b-bf09-2da0f832bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:08.031190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a1868-1915-4b8b-bf09-2da0f832bd91 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:08.031470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a1868-1915-4b8b-bf09-2da0f832bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:08.031750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a1868-1915-4b8b-bf09-2da0f832bd91 None admin] PATH_INFO: `/v3/groups/721f419ecbd843a9bc29ed225bb114af` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:08.037061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a1868-1915-4b8b-bf09-2da0f832bd91 None admin] RBAC: Authorizing `identity:get_group(group_id=721f419ecbd843a9bc29ed225bb114af)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:08.038524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a1868-1915-4b8b-bf09-2da0f832bd91 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:08.041028 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 182/379] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:07 2022] GET /identity/v3/groups/721f419ecbd843a9bc29ed225bb114af => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:08.047039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d1f97-a9dc-431e-8f47-500127ee311b None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:08.167536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:08.182342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d1f97-a9dc-431e-8f47-500127ee311b None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:08.220617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42655dee-2d40-448b-aff8-9f3bdb2dd74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:08.221611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42655dee-2d40-448b-aff8-9f3bdb2dd74d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:08.222122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42655dee-2d40-448b-aff8-9f3bdb2dd74d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:08.222592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42655dee-2d40-448b-aff8-9f3bdb2dd74d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:08.223510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42655dee-2d40-448b-aff8-9f3bdb2dd74d None admin] RBAC: Adding query filter params (group.id=721f419ecbd843a9bc29ed225bb114af, role.id=a409f81bd5744563a303a825783bed61, scope.project.id=8cbdca763b15498ebcee722600237097) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:08.224016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42655dee-2d40-448b-aff8-9f3bdb2dd74d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:08.225684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42655dee-2d40-448b-aff8-9f3bdb2dd74d None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:08.232412 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 198/380] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Oct 8 20:35:08 2022] GET /identity/v3/role_assignments?group.id=721f419ecbd843a9bc29ed225bb114af&scope.project.id=8cbdca763b15498ebcee722600237097&role.id=a409f81bd5744563a303a825783bed61 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:08.614697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824095c6-b969-455c-ae03-64287d4d2c6c None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:08.615063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824095c6-b969-455c-ae03-64287d4d2c6c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:08.615265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824095c6-b969-455c-ae03-64287d4d2c6c None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:08.616859 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 183/381] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:08.622652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb284d09-e94b-4fc6-9010-44e00878364b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:08.622940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb284d09-e94b-4fc6-9010-44e00878364b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:08.623221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb284d09-e94b-4fc6-9010-44e00878364b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:08.641748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cb284d09-e94b-4fc6-9010-44e00878364b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:08.643031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cb284d09-e94b-4fc6-9010-44e00878364b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:08.730824 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 199/382] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:09.175558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824095c6-b969-455c-ae03-64287d4d2c6c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:09.236171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:09.301991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824095c6-b969-455c-ae03-64287d4d2c6c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:09.351474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd13a62-6aa8-4347-a319-8e337eb30f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:09.352997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13a62-6aa8-4347-a319-8e337eb30f10 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:09.353294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13a62-6aa8-4347-a319-8e337eb30f10 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:09.353571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13a62-6aa8-4347-a319-8e337eb30f10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:09.367808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd13a62-6aa8-4347-a319-8e337eb30f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-fcd13a62-6aa8-4347-a319-8e337eb30f10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:09.372831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:09.373728 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:09.374523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:09.374523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:09.374523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:09.374523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:09.374523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:09.374523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:09.374523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:09.374523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:09.374523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:09.374523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:09.374523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:35:09.374523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:09.374523 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 184/383] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:09.380183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb284d09-e94b-4fc6-9010-44e00878364b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:09.496009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:09.515337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb284d09-e94b-4fc6-9010-44e00878364b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:09.556548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b32a5b-978f-412f-8260-adbf1ffda8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:09.557288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b32a5b-978f-412f-8260-adbf1ffda8e7 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:09.557576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b32a5b-978f-412f-8260-adbf1ffda8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:09.557856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b32a5b-978f-412f-8260-adbf1ffda8e7 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:09.558994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b32a5b-978f-412f-8260-adbf1ffda8e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:09.559526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b32a5b-978f-412f-8260-adbf1ffda8e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:09.561724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b32a5b-978f-412f-8260-adbf1ffda8e7 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:09.571179 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 200/384] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:35:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:09.576933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd13a62-6aa8-4347-a319-8e337eb30f10 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:09.708053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd13a62-6aa8-4347-a319-8e337eb30f10 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:09.722707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:09.743281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88195cd9-b535-43ed-b2a1-5ad4d6c6a12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:09.743832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88195cd9-b535-43ed-b2a1-5ad4d6c6a12c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:09.744111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88195cd9-b535-43ed-b2a1-5ad4d6c6a12c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:09.744379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88195cd9-b535-43ed-b2a1-5ad4d6c6a12c None admin] PATH_INFO: `/v3/groups/a173b8cf9c0245f9b45632507d87ce5a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:09.745710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88195cd9-b535-43ed-b2a1-5ad4d6c6a12c None admin] RBAC: Authorizing `identity:get_group(group_id=a173b8cf9c0245f9b45632507d87ce5a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:09.747280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88195cd9-b535-43ed-b2a1-5ad4d6c6a12c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:09.749331 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 185/385] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:09 2022] GET /identity/v3/groups/a173b8cf9c0245f9b45632507d87ce5a => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:09.754628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b32a5b-978f-412f-8260-adbf1ffda8e7 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:09.895048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b32a5b-978f-412f-8260-adbf1ffda8e7 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:09.929138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089beee-361c-4cd1-b96a-e496037e6904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:09.929804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089beee-361c-4cd1-b96a-e496037e6904 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:09.930732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089beee-361c-4cd1-b96a-e496037e6904 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:09.931047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089beee-361c-4cd1-b96a-e496037e6904 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:09.932202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089beee-361c-4cd1-b96a-e496037e6904 None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:09.933664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089beee-361c-4cd1-b96a-e496037e6904 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:09.935644 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 201/386] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:09 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:09.942298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88195cd9-b535-43ed-b2a1-5ad4d6c6a12c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:10.026007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22efc4-0bb4-49dc-b463-22b46d0d6624 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:10.026581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22efc4-0bb4-49dc-b463-22b46d0d6624 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:10.027035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22efc4-0bb4-49dc-b463-22b46d0d6624 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:10.028538 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 202/387] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:35:10.038942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade35dd-31cb-4ddf-a507-e32fb42a016a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:10.039494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade35dd-31cb-4ddf-a507-e32fb42a016a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:10.039966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade35dd-31cb-4ddf-a507-e32fb42a016a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:10.074594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6ade35dd-31cb-4ddf-a507-e32fb42a016a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:10.076831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6ade35dd-31cb-4ddf-a507-e32fb42a016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:10.088364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88195cd9-b535-43ed-b2a1-5ad4d6c6a12c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:10.101580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:10.124896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97578e-915a-432d-bac6-0fe626c5af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:10.125847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97578e-915a-432d-bac6-0fe626c5af40 None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:10.126818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97578e-915a-432d-bac6-0fe626c5af40 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:10.126818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97578e-915a-432d-bac6-0fe626c5af40 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc/groups/a173b8cf9c0245f9b45632507d87ce5a/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:10.128824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97578e-915a-432d-bac6-0fe626c5af40 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e1aed93c9534d8d87cc68e56be1e9fc, group_id=a173b8cf9c0245f9b45632507d87ce5a, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:10.130531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97578e-915a-432d-bac6-0fe626c5af40 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:10.160954 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 186/388] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Oct 8 20:35:09 2022] PUT /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc/groups/a173b8cf9c0245f9b45632507d87ce5a/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:35:10.163924 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 203/389] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:10.197818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18a5a6-12ea-4e9f-ab90-0a357e359612 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:10.198777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18a5a6-12ea-4e9f-ab90-0a357e359612 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:10.199231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18a5a6-12ea-4e9f-ab90-0a357e359612 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:10.201150 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 187/390] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:10.207271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ccc33-02c7-4061-bf50-02c0a0e41eff None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:10.207817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ccc33-02c7-4061-bf50-02c0a0e41eff None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:10.208295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ccc33-02c7-4061-bf50-02c0a0e41eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:10.229023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-650ccc33-02c7-4061-bf50-02c0a0e41eff None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:10.230715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-650ccc33-02c7-4061-bf50-02c0a0e41eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:10.304879 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 204/391] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:10.624856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf0f69-4bda-4626-a031-0b93ee46bc58 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:10.625154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf0f69-4bda-4626-a031-0b93ee46bc58 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:10.625375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf0f69-4bda-4626-a031-0b93ee46bc58 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:10.626716 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 188/392] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:10.630895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ccc33-02c7-4061-bf50-02c0a0e41eff None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:10.636611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86463cfe-8b0b-44fe-8aba-40cf595a9479 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:10.636894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86463cfe-8b0b-44fe-8aba-40cf595a9479 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:10.637167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86463cfe-8b0b-44fe-8aba-40cf595a9479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:10.656059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-86463cfe-8b0b-44fe-8aba-40cf595a9479 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:10.657483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-86463cfe-8b0b-44fe-8aba-40cf595a9479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:10.694719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:10.724506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:10.733154 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 189/393] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:10.734380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86463cfe-8b0b-44fe-8aba-40cf595a9479 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:10.771826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ccc33-02c7-4061-bf50-02c0a0e41eff None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:10.826308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bfe34-d292-47eb-9aa5-8dd5f86e9ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:10.827298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bfe34-d292-47eb-9aa5-8dd5f86e9ada None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:10.827806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bfe34-d292-47eb-9aa5-8dd5f86e9ada None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:10.828338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bfe34-d292-47eb-9aa5-8dd5f86e9ada None admin] PATH_INFO: `/v3/roles/member` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:10.840859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bfe34-d292-47eb-9aa5-8dd5f86e9ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-b96bfe34-d292-47eb-9aa5-8dd5f86e9ada None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:10.847414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:10.848323 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:10.849098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:10.849098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:10.849098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:10.849098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:10.849098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:10.849098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:10.849098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:10.849098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:10.849098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:10.849098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:10.849098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:35:10.849098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:10.851902 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 205/394] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:10.858191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bfe34-d292-47eb-9aa5-8dd5f86e9ada None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:10.877852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86463cfe-8b0b-44fe-8aba-40cf595a9479 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:10.939889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078b1e6-91b1-4e0d-8282-54b0232734b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:10.940537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078b1e6-91b1-4e0d-8282-54b0232734b5 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:10.940815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078b1e6-91b1-4e0d-8282-54b0232734b5 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:10.941086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078b1e6-91b1-4e0d-8282-54b0232734b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:10.962018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078b1e6-91b1-4e0d-8282-54b0232734b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-1078b1e6-91b1-4e0d-8282-54b0232734b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:10.967878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:10.968737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:10.969561 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:10.969561 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:10.969561 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:10.969561 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:10.969561 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:10.969561 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:10.969561 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:10.969561 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:10.969561 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:10.969561 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:10.969561 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:10.969561 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:10.969561 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 190/395] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:35:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:10.975700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078b1e6-91b1-4e0d-8282-54b0232734b5 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:11.042249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:11.062299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bfe34-d292-47eb-9aa5-8dd5f86e9ada None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:11.138061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078b1e6-91b1-4e0d-8282-54b0232734b5 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:11.140594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4de6c-01c1-4bbd-9309-b4517464b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:11.141223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4de6c-01c1-4bbd-9309-b4517464b960 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:11.141509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4de6c-01c1-4bbd-9309-b4517464b960 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:11.141780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4de6c-01c1-4bbd-9309-b4517464b960 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:11.142449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4de6c-01c1-4bbd-9309-b4517464b960 None admin] RBAC: Adding query filter params (name=member) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:11.142755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4de6c-01c1-4bbd-9309-b4517464b960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:11.144122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4de6c-01c1-4bbd-9309-b4517464b960 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:11.152920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:11.165259 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 206/396] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:35:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:11.165259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4de6c-01c1-4bbd-9309-b4517464b960 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:11.189597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dc9e0-e261-4b7d-b4bf-10d76b3e1629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:11.190342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dc9e0-e261-4b7d-b4bf-10d76b3e1629 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:11.190727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dc9e0-e261-4b7d-b4bf-10d76b3e1629 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:11.191121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dc9e0-e261-4b7d-b4bf-10d76b3e1629 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:11.191901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dc9e0-e261-4b7d-b4bf-10d76b3e1629 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:11.192308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dc9e0-e261-4b7d-b4bf-10d76b3e1629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:11.193815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dc9e0-e261-4b7d-b4bf-10d76b3e1629 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:11.202211 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 191/397] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:11.207702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dc9e0-e261-4b7d-b4bf-10d76b3e1629 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:11.289354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4de6c-01c1-4bbd-9309-b4517464b960 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:11.323723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:11.327221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5dcc0-3e64-49c2-ae8d-7a7089556ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:11.328019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5dcc0-3e64-49c2-ae8d-7a7089556ff9 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:11.328761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5dcc0-3e64-49c2-ae8d-7a7089556ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:11.329137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5dcc0-3e64-49c2-ae8d-7a7089556ff9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:11.333583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dc9e0-e261-4b7d-b4bf-10d76b3e1629 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:11.344151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5dcc0-3e64-49c2-ae8d-7a7089556ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-5ea5dcc0-3e64-49c2-ae8d-7a7089556ff9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:11.349459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:11.350562 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:11.351553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:11.351553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:11.351553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:11.351553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:11.351553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:11.351553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:11.351553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:11.351553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:11.351553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:11.351553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:11.351553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:11.351553 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:11.355809 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 207/398] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:35:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:11.356636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5dcc0-3e64-49c2-ae8d-7a7089556ff9 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:11.372281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2c116-5250-461d-aafa-0a1c3828f6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:11.372916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c116-5250-461d-aafa-0a1c3828f6f5 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:11.373219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c116-5250-461d-aafa-0a1c3828f6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:11.373495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c116-5250-461d-aafa-0a1c3828f6f5 None admin] PATH_INFO: `/v3/groups/a173b8cf9c0245f9b45632507d87ce5a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:11.374611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2c116-5250-461d-aafa-0a1c3828f6f5 None admin] RBAC: Authorizing `identity:get_group(group_id=a173b8cf9c0245f9b45632507d87ce5a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:11.376067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2c116-5250-461d-aafa-0a1c3828f6f5 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:11.382135 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 192/399] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:11 2022] GET /identity/v3/groups/a173b8cf9c0245f9b45632507d87ce5a => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:11.382135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88851f2e-3943-4941-af43-8367a1168801 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:11.382135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88851f2e-3943-4941-af43-8367a1168801 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:11.382135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88851f2e-3943-4941-af43-8367a1168801 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:11.382135 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 193/400] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:11.382135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88851f2e-3943-4941-af43-8367a1168801 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:11.425215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:11.469551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5dcc0-3e64-49c2-ae8d-7a7089556ff9 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:11.487632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88851f2e-3943-4941-af43-8367a1168801 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:11.511254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211272b-35f7-43c3-bf5f-b2b8c0940046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:11.511933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211272b-35f7-43c3-bf5f-b2b8c0940046 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:11.512299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211272b-35f7-43c3-bf5f-b2b8c0940046 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:11.512581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211272b-35f7-43c3-bf5f-b2b8c0940046 None admin] PATH_INFO: `/v3/groups/a173b8cf9c0245f9b45632507d87ce5a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:11.513729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211272b-35f7-43c3-bf5f-b2b8c0940046 None admin] RBAC: Authorizing `identity:get_group(group_id=a173b8cf9c0245f9b45632507d87ce5a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:11.515253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211272b-35f7-43c3-bf5f-b2b8c0940046 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:11.516863 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 208/401] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:11 2022] GET /identity/v3/groups/a173b8cf9c0245f9b45632507d87ce5a => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:11.521857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211272b-35f7-43c3-bf5f-b2b8c0940046 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:11.524082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57d28a-7051-429e-8279-34eb15a018ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:11.524685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57d28a-7051-429e-8279-34eb15a018ae None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:11.524963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57d28a-7051-429e-8279-34eb15a018ae None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:11.525906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57d28a-7051-429e-8279-34eb15a018ae None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:11.525906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57d28a-7051-429e-8279-34eb15a018ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:11.526263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57d28a-7051-429e-8279-34eb15a018ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:11.527615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57d28a-7051-429e-8279-34eb15a018ae None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:11.535896 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 194/402] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:11.537046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b44f-fbd9-4403-9df9-9c774fdfed79 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:11.537380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b44f-fbd9-4403-9df9-9c774fdfed79 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:11.537627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b44f-fbd9-4403-9df9-9c774fdfed79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:11.555645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6f99b44f-fbd9-4403-9df9-9c774fdfed79 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:11.556815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6f99b44f-fbd9-4403-9df9-9c774fdfed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:11.574737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:11.637231 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 195/403] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:11.637231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b44f-fbd9-4403-9df9-9c774fdfed79 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:11.637512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211272b-35f7-43c3-bf5f-b2b8c0940046 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:11.666307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:11.675198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd7ae5-6e86-4770-9f1e-5d25013ad425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:11.675906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd7ae5-6e86-4770-9f1e-5d25013ad425 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:11.676142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd7ae5-6e86-4770-9f1e-5d25013ad425 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:11.676425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd7ae5-6e86-4770-9f1e-5d25013ad425 None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:11.677678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd7ae5-6e86-4770-9f1e-5d25013ad425 None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:11.679233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd7ae5-6e86-4770-9f1e-5d25013ad425 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:11.681803 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 209/404] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:11 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:11.682896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd7ae5-6e86-4770-9f1e-5d25013ad425 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:11.756487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b44f-fbd9-4403-9df9-9c774fdfed79 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:11.793317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b659-359a-4e6d-91b6-2e1eefa35bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:11.793919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b659-359a-4e6d-91b6-2e1eefa35bb8 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:11.794256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b659-359a-4e6d-91b6-2e1eefa35bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:11.794533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b659-359a-4e6d-91b6-2e1eefa35bb8 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:11.795688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3b659-359a-4e6d-91b6-2e1eefa35bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:11.797171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3b659-359a-4e6d-91b6-2e1eefa35bb8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:11.803294 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 196/405] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:11 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:11.803294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b659-359a-4e6d-91b6-2e1eefa35bb8 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:11.812405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd7ae5-6e86-4770-9f1e-5d25013ad425 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:11.830487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:11.855749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a94d31-8604-4b06-9b55-16c61556be74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:11.856992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a94d31-8604-4b06-9b55-16c61556be74 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:11.857550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a94d31-8604-4b06-9b55-16c61556be74 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:11.858092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a94d31-8604-4b06-9b55-16c61556be74 None admin] PATH_INFO: `/v3/groups/a173b8cf9c0245f9b45632507d87ce5a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:11.859621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a94d31-8604-4b06-9b55-16c61556be74 None admin] RBAC: Authorizing `identity:get_group(group_id=a173b8cf9c0245f9b45632507d87ce5a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:11.861285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a94d31-8604-4b06-9b55-16c61556be74 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:11.863348 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 210/406] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:11 2022] GET /identity/v3/groups/a173b8cf9c0245f9b45632507d87ce5a => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:11.864302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a94d31-8604-4b06-9b55-16c61556be74 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:11.916962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b659-359a-4e6d-91b6-2e1eefa35bb8 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:11.941363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:11.953770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3474fcd-9544-43af-a3c5-82ec5d83c089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:11.953928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3474fcd-9544-43af-a3c5-82ec5d83c089 None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:11.954134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3474fcd-9544-43af-a3c5-82ec5d83c089 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:11.954364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3474fcd-9544-43af-a3c5-82ec5d83c089 None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691/groups/a173b8cf9c0245f9b45632507d87ce5a/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:11.956286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3474fcd-9544-43af-a3c5-82ec5d83c089 None admin] RBAC: Authorizing `identity:create_grant(project_id=a453d14403a142248aefae9ff0bf5691, group_id=a173b8cf9c0245f9b45632507d87ce5a, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:11.957883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3474fcd-9544-43af-a3c5-82ec5d83c089 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:11.974475 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 197/407] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Oct 8 20:35:11 2022] PUT /identity/v3/projects/a453d14403a142248aefae9ff0bf5691/groups/a173b8cf9c0245f9b45632507d87ce5a/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:35:11.975390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3474fcd-9544-43af-a3c5-82ec5d83c089 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:11.991883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a94d31-8604-4b06-9b55-16c61556be74 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:12.034017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7f647-38fc-4f19-a062-b3582922013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:12.035158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7f647-38fc-4f19-a062-b3582922013a None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:12.035663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7f647-38fc-4f19-a062-b3582922013a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:12.036158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7f647-38fc-4f19-a062-b3582922013a None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc/groups/a173b8cf9c0245f9b45632507d87ce5a/roles/94f39d4bced64cc98e66bceafe049303` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:12.038914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7f647-38fc-4f19-a062-b3582922013a None admin] RBAC: Authorizing `identity:create_grant(project_id=1e1aed93c9534d8d87cc68e56be1e9fc, group_id=a173b8cf9c0245f9b45632507d87ce5a, role_id=94f39d4bced64cc98e66bceafe049303)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:12.041587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7f647-38fc-4f19-a062-b3582922013a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:12.065546 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 211/408] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Oct 8 20:35:11 2022] PUT /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc/groups/a173b8cf9c0245f9b45632507d87ce5a/roles/94f39d4bced64cc98e66bceafe049303 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:35:12.067074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7f647-38fc-4f19-a062-b3582922013a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:12.090863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:12.116916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3474fcd-9544-43af-a3c5-82ec5d83c089 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:12.159185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d44893-e003-411b-8934-4401e280b8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:12.159910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d44893-e003-411b-8934-4401e280b8d5 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:12.160184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d44893-e003-411b-8934-4401e280b8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:12.160454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d44893-e003-411b-8934-4401e280b8d5 None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:12.161855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d44893-e003-411b-8934-4401e280b8d5 None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:12.169844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d44893-e003-411b-8934-4401e280b8d5 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:12.169844 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 198/409] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:11 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:12.172225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d44893-e003-411b-8934-4401e280b8d5 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:12.244436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7f647-38fc-4f19-a062-b3582922013a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:12.274916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:12.290265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4b5f1-6748-4799-b18d-7a89611a5fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:12.291451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4b5f1-6748-4799-b18d-7a89611a5fb6 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:12.292002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4b5f1-6748-4799-b18d-7a89611a5fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:12.292500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4b5f1-6748-4799-b18d-7a89611a5fb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:12.306134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4b5f1-6748-4799-b18d-7a89611a5fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:12.309806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d44893-e003-411b-8934-4401e280b8d5 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-70f4b5f1-6748-4799-b18d-7a89611a5fb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:12.313930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:12.314958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:12.315764 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:12.315764 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:12.315764 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:12.315764 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:12.315764 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:12.315764 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:12.315764 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:12.315764 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:12.315764 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:12.315764 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:12.315764 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:12.315764 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:12.318837 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 212/410] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:35:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:12.326690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4b5f1-6748-4799-b18d-7a89611a5fb6 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:12.360008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489afca7-82be-44e4-815d-ad8bc5a694f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:12.361201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489afca7-82be-44e4-815d-ad8bc5a694f9 None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:12.361201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489afca7-82be-44e4-815d-ad8bc5a694f9 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:12.361393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489afca7-82be-44e4-815d-ad8bc5a694f9 None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691/groups/a173b8cf9c0245f9b45632507d87ce5a/roles/94f39d4bced64cc98e66bceafe049303` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:12.363884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489afca7-82be-44e4-815d-ad8bc5a694f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a453d14403a142248aefae9ff0bf5691, group_id=a173b8cf9c0245f9b45632507d87ce5a, role_id=94f39d4bced64cc98e66bceafe049303)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:12.365463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489afca7-82be-44e4-815d-ad8bc5a694f9 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:12.383820 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 199/411] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Oct 8 20:35:12 2022] PUT /identity/v3/projects/a453d14403a142248aefae9ff0bf5691/groups/a173b8cf9c0245f9b45632507d87ce5a/roles/94f39d4bced64cc98e66bceafe049303 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:35:12.475798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4b5f1-6748-4799-b18d-7a89611a5fb6 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:12.520150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13b3c-244a-40a8-b58e-a93aa90ed6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:12.520690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13b3c-244a-40a8-b58e-a93aa90ed6ff None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:12.520970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13b3c-244a-40a8-b58e-a93aa90ed6ff None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:12.521270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13b3c-244a-40a8-b58e-a93aa90ed6ff None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:12.521958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13b3c-244a-40a8-b58e-a93aa90ed6ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:12.522263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13b3c-244a-40a8-b58e-a93aa90ed6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:12.523654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13b3c-244a-40a8-b58e-a93aa90ed6ff None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:12.533869 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 213/412] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:12.540283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489afca7-82be-44e4-815d-ad8bc5a694f9 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:12.553934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:12.700017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489afca7-82be-44e4-815d-ad8bc5a694f9 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:12.747708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aac4a-8cd0-46c1-875e-0fd63cf471f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:12.748741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aac4a-8cd0-46c1-875e-0fd63cf471f5 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:12.749260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aac4a-8cd0-46c1-875e-0fd63cf471f5 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:12.749749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aac4a-8cd0-46c1-875e-0fd63cf471f5 None admin] PATH_INFO: `/v3/groups/721f419ecbd843a9bc29ed225bb114af` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:12.751056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aac4a-8cd0-46c1-875e-0fd63cf471f5 None admin] RBAC: Authorizing `identity:get_group(group_id=721f419ecbd843a9bc29ed225bb114af)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:12.752694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aac4a-8cd0-46c1-875e-0fd63cf471f5 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:12.756625 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 200/413] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:12 2022] GET /identity/v3/groups/721f419ecbd843a9bc29ed225bb114af => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:12.763130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13b3c-244a-40a8-b58e-a93aa90ed6ff None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:12.824092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:12.890373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13b3c-244a-40a8-b58e-a93aa90ed6ff None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:12.932937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3b6ea-2682-4d07-b5b4-e580722a7976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:12.933884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3b6ea-2682-4d07-b5b4-e580722a7976 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:12.934334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3b6ea-2682-4d07-b5b4-e580722a7976 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:12.934777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3b6ea-2682-4d07-b5b4-e580722a7976 None admin] PATH_INFO: `/v3/projects/8cbdca763b15498ebcee722600237097` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:12.936099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3b6ea-2682-4d07-b5b4-e580722a7976 None admin] RBAC: Authorizing `identity:get_project(project_id=8cbdca763b15498ebcee722600237097)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:12.937715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3b6ea-2682-4d07-b5b4-e580722a7976 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:12.939841 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 214/414] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:12 2022] GET /identity/v3/projects/8cbdca763b15498ebcee722600237097 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:12.945312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aac4a-8cd0-46c1-875e-0fd63cf471f5 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:13.059599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:13.089226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aac4a-8cd0-46c1-875e-0fd63cf471f5 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:13.094506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bd539-6489-415f-8ef0-6b1cd405f614 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:13.095027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bd539-6489-415f-8ef0-6b1cd405f614 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:13.095497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bd539-6489-415f-8ef0-6b1cd405f614 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:13.097075 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 215/415] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:35:13.102375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f35825-85c1-4acd-9736-e741ca405bdf None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:13.102655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f35825-85c1-4acd-9736-e741ca405bdf None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:13.102928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f35825-85c1-4acd-9736-e741ca405bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:13.129966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-63f35825-85c1-4acd-9736-e741ca405bdf None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:13.132767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-63f35825-85c1-4acd-9736-e741ca405bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:13.157048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05005210-d6bb-41ec-b167-065b67706bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:13.158105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005210-d6bb-41ec-b167-065b67706bf4 None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:13.158582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005210-d6bb-41ec-b167-065b67706bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:13.159050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005210-d6bb-41ec-b167-065b67706bf4 None admin] PATH_INFO: `/v3/projects/8cbdca763b15498ebcee722600237097/groups/721f419ecbd843a9bc29ed225bb114af/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:13.162568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05005210-d6bb-41ec-b167-065b67706bf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cbdca763b15498ebcee722600237097, group_id=721f419ecbd843a9bc29ed225bb114af, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:13.164280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05005210-d6bb-41ec-b167-065b67706bf4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:13.188757 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 201/416] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Oct 8 20:35:12 2022] PUT /identity/v3/projects/8cbdca763b15498ebcee722600237097/groups/721f419ecbd843a9bc29ed225bb114af/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:35:13.251251 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 216/417] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:13.584325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05005210-d6bb-41ec-b167-065b67706bf4 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:13.714909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05005210-d6bb-41ec-b167-065b67706bf4 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:13.751195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5aa4f-f880-4c2e-8789-23178fa5880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:13.752205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5aa4f-f880-4c2e-8789-23178fa5880f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:13.752697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5aa4f-f880-4c2e-8789-23178fa5880f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:13.753243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5aa4f-f880-4c2e-8789-23178fa5880f None admin] PATH_INFO: `/v3/roles/member` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:13.760284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:13.765728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5aa4f-f880-4c2e-8789-23178fa5880f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-fab5aa4f-f880-4c2e-8789-23178fa5880f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:13.771054 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:13.771912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:13.772711 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:13.772711 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:13.772711 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:13.772711 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:13.772711 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:13.772711 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:13.772711 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:13.772711 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:13.772711 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:13.772711 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:13.772711 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:35:13.772711 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:13.776319 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 202/418] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:13.782061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f35825-85c1-4acd-9736-e741ca405bdf None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:13.863600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:13.938698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f35825-85c1-4acd-9736-e741ca405bdf None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:13.988403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06616d-95aa-48c5-ad6a-44270de2ac7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:13.989012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06616d-95aa-48c5-ad6a-44270de2ac7e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:13.989319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06616d-95aa-48c5-ad6a-44270de2ac7e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:13.989595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06616d-95aa-48c5-ad6a-44270de2ac7e None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:13.990258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06616d-95aa-48c5-ad6a-44270de2ac7e None admin] RBAC: Adding query filter params (name=member) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:13.990560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06616d-95aa-48c5-ad6a-44270de2ac7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:13.991925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06616d-95aa-48c5-ad6a-44270de2ac7e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:14.000372 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 217/419] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:35:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:14.006330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5aa4f-f880-4c2e-8789-23178fa5880f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:14.177037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5aa4f-f880-4c2e-8789-23178fa5880f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:14.220936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a6854-6d5c-4aef-92ff-f62a8872dde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:14.221578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a6854-6d5c-4aef-92ff-f62a8872dde6 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:14.221861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a6854-6d5c-4aef-92ff-f62a8872dde6 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:14.222131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a6854-6d5c-4aef-92ff-f62a8872dde6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:14.302415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:14.308922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a6854-6d5c-4aef-92ff-f62a8872dde6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:14.310770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a6854-6d5c-4aef-92ff-f62a8872dde6 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:14.445347 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 203/420] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:14.447343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06616d-95aa-48c5-ad6a-44270de2ac7e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:14.567004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06616d-95aa-48c5-ad6a-44270de2ac7e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:14.574944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:14.615382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50aa7c-a65b-4de6-b4fc-21d5e636f461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:14.616010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50aa7c-a65b-4de6-b4fc-21d5e636f461 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:14.616285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50aa7c-a65b-4de6-b4fc-21d5e636f461 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:14.616551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50aa7c-a65b-4de6-b4fc-21d5e636f461 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:14.618217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50aa7c-a65b-4de6-b4fc-21d5e636f461 None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:14.619784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50aa7c-a65b-4de6-b4fc-21d5e636f461 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:14.621782 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 218/421] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:14 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:14.627345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a6854-6d5c-4aef-92ff-f62a8872dde6 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:14.737327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:14.745622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a6854-6d5c-4aef-92ff-f62a8872dde6 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:14.793621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671be24-5773-45e0-9899-52554f9d08ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:14.794257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671be24-5773-45e0-9899-52554f9d08ed None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:14.794535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671be24-5773-45e0-9899-52554f9d08ed None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:14.794808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671be24-5773-45e0-9899-52554f9d08ed None admin] PATH_INFO: `/v3/groups/a173b8cf9c0245f9b45632507d87ce5a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:14.801871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671be24-5773-45e0-9899-52554f9d08ed None admin] RBAC: Authorizing `identity:get_group(group_id=a173b8cf9c0245f9b45632507d87ce5a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:14.803314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671be24-5773-45e0-9899-52554f9d08ed None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:14.804904 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 204/422] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:14 2022] GET /identity/v3/groups/a173b8cf9c0245f9b45632507d87ce5a => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:14.811542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50aa7c-a65b-4de6-b4fc-21d5e636f461 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:14.969462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50aa7c-a65b-4de6-b4fc-21d5e636f461 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:15.012751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f351-6204-4706-8d16-92905e39e951 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:15.013070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f351-6204-4706-8d16-92905e39e951 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:15.013347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f351-6204-4706-8d16-92905e39e951 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:15.014965 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 205/423] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:15.019779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b89dac-a491-4d7c-9974-65a418bc82db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:15.019973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f0113-7b06-4e3a-9702-ead9ba670377 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:15.020388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b89dac-a491-4d7c-9974-65a418bc82db None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:15.020503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f0113-7b06-4e3a-9702-ead9ba670377 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:15.020666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b89dac-a491-4d7c-9974-65a418bc82db None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:15.020759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f0113-7b06-4e3a-9702-ead9ba670377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:15.020935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b89dac-a491-4d7c-9974-65a418bc82db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:15.021686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b89dac-a491-4d7c-9974-65a418bc82db None admin] RBAC: Adding query filter params (group.id=a173b8cf9c0245f9b45632507d87ce5a, role.id=27431c49ccd74f7a898d1a39e251ce29, scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:15.021999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b89dac-a491-4d7c-9974-65a418bc82db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:15.023417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b89dac-a491-4d7c-9974-65a418bc82db None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:15.034699 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 219/424] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Oct 8 20:35:14 2022] GET /identity/v3/role_assignments?group.id=a173b8cf9c0245f9b45632507d87ce5a&scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc&role.id=27431c49ccd74f7a898d1a39e251ce29 => generated 611 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:15.047834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d73f0113-7b06-4e3a-9702-ead9ba670377 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:15.054836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d73f0113-7b06-4e3a-9702-ead9ba670377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:15.147574 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 206/425] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:15.292447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60bff4-90e7-4193-b03a-076d4e2b437e None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:15.292790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60bff4-90e7-4193-b03a-076d4e2b437e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:15.292907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60bff4-90e7-4193-b03a-076d4e2b437e None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:15.294557 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 220/426] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:15.300175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbbf15-a28a-42a6-8ee4-215b4999cc87 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:15.300511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbbf15-a28a-42a6-8ee4-215b4999cc87 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:15.300511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbbf15-a28a-42a6-8ee4-215b4999cc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:15.330338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2bfbbf15-a28a-42a6-8ee4-215b4999cc87 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:15.331548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2bfbbf15-a28a-42a6-8ee4-215b4999cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:15.421455 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 207/427] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:15.633097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60bff4-90e7-4193-b03a-076d4e2b437e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:15.670042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bbb37-e3ed-4130-9eb6-02200ca548f8 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:15.670983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bbb37-e3ed-4130-9eb6-02200ca548f8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:15.671455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bbb37-e3ed-4130-9eb6-02200ca548f8 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:15.673334 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 208/428] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:35:15.673810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:15.679715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bea219-9da1-49d1-a925-270bf6d19f2a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:15.680738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bea219-9da1-49d1-a925-270bf6d19f2a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:15.681022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bea219-9da1-49d1-a925-270bf6d19f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:15.702279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-64bea219-9da1-49d1-a925-270bf6d19f2a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:15.703727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-64bea219-9da1-49d1-a925-270bf6d19f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:15.724813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:15.756783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60bff4-90e7-4193-b03a-076d4e2b437e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:15.780800 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 209/429] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:15.798951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eee482-625e-4a46-b2b3-97f42f0eba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:15.799968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eee482-625e-4a46-b2b3-97f42f0eba41 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:15.800497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eee482-625e-4a46-b2b3-97f42f0eba41 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:15.800965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eee482-625e-4a46-b2b3-97f42f0eba41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:15.814363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eee482-625e-4a46-b2b3-97f42f0eba41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-78eee482-625e-4a46-b2b3-97f42f0eba41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:15.819862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:15.820904 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:15.821728 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:15.821728 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:15.821728 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:15.821728 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:15.821728 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:15.821728 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:15.821728 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:15.821728 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:15.821728 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:15.821728 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:15.821728 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:35:15.821728 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:15.824556 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 221/430] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:15.832055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bea219-9da1-49d1-a925-270bf6d19f2a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:15.833966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eee482-625e-4a46-b2b3-97f42f0eba41 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:15.948894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:15.956418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eee482-625e-4a46-b2b3-97f42f0eba41 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:15.966990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bea219-9da1-49d1-a925-270bf6d19f2a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:15.993606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26eece-b7ff-418a-ae90-c2dce0019106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:15.994389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26eece-b7ff-418a-ae90-c2dce0019106 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:15.994763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26eece-b7ff-418a-ae90-c2dce0019106 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:15.995132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26eece-b7ff-418a-ae90-c2dce0019106 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:16.006388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26eece-b7ff-418a-ae90-c2dce0019106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:16.009016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd668bb-e7b4-4900-aeef-3f983b9abbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:16.009656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd668bb-e7b4-4900-aeef-3f983b9abbdb None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:16.009933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd668bb-e7b4-4900-aeef-3f983b9abbdb None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:16.010208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd668bb-e7b4-4900-aeef-3f983b9abbdb None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:16.010880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd668bb-e7b4-4900-aeef-3f983b9abbdb None admin] RBAC: Adding query filter params (name=member) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:16.011184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd668bb-e7b4-4900-aeef-3f983b9abbdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:16.012542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd668bb-e7b4-4900-aeef-3f983b9abbdb None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-0f26eece-b7ff-418a-ae90-c2dce0019106 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:16.013277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:16.014206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:16.015018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:16.015018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:16.015018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:16.015018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:16.015018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:16.015018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:16.015018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:16.015018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:16.015018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:16.015018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:16.015018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:16.015018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:16.015018 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 222/431] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:35:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:16.020836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26eece-b7ff-418a-ae90-c2dce0019106 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:16.025303 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 210/432] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:35:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:16.031541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd668bb-e7b4-4900-aeef-3f983b9abbdb None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:16.054531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:16.155155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd668bb-e7b4-4900-aeef-3f983b9abbdb None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:16.158643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26eece-b7ff-418a-ae90-c2dce0019106 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:16.199262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a34eb-7b22-49af-99b1-7038a2c4a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:16.199463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaa0a3-33e5-41f0-aa1b-d8ebc2fde09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:16.199787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a34eb-7b22-49af-99b1-7038a2c4a6aa None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:16.199888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaa0a3-33e5-41f0-aa1b-d8ebc2fde09d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:16.200068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a34eb-7b22-49af-99b1-7038a2c4a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:16.200173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaa0a3-33e5-41f0-aa1b-d8ebc2fde09d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:16.200335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaa0a3-33e5-41f0-aa1b-d8ebc2fde09d None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:16.200425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a34eb-7b22-49af-99b1-7038a2c4a6aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:16.201004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaa0a3-33e5-41f0-aa1b-d8ebc2fde09d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:16.201338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaa0a3-33e5-41f0-aa1b-d8ebc2fde09d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:16.202692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaa0a3-33e5-41f0-aa1b-d8ebc2fde09d None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:16.217228 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 223/433] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:16.218110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaa0a3-33e5-41f0-aa1b-d8ebc2fde09d None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:16.243904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:16.292692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a34eb-7b22-49af-99b1-7038a2c4a6aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:16.294198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a34eb-7b22-49af-99b1-7038a2c4a6aa None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:16.311245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:16.332890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaa0a3-33e5-41f0-aa1b-d8ebc2fde09d None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:16.366316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358e910-233a-4e22-bd45-e116138436ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:16.366942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358e910-233a-4e22-bd45-e116138436ef None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:16.367227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358e910-233a-4e22-bd45-e116138436ef None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:16.367532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358e910-233a-4e22-bd45-e116138436ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:16.377550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358e910-233a-4e22-bd45-e116138436ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-7358e910-233a-4e22-bd45-e116138436ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:16.382761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:16.384157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:16.384959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:16.384959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:16.384959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:16.384959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:16.384959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:16.384959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:16.384959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:16.384959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:16.384959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:16.384959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:16.384959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:16.384959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:16.384959 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 224/434] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:35:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:16.385661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358e910-233a-4e22-bd45-e116138436ef None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:16.393608 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 211/435] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:16.394916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5faa6-33ca-41d8-a171-2fa419551dfe None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:16.395202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5faa6-33ca-41d8-a171-2fa419551dfe None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:16.395472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5faa6-33ca-41d8-a171-2fa419551dfe None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:16.396674 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 212/436] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:16.397397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5faa6-33ca-41d8-a171-2fa419551dfe None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:16.467843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:16.494799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358e910-233a-4e22-bd45-e116138436ef None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:16.503237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5faa6-33ca-41d8-a171-2fa419551dfe None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:16.520175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:16.528880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbd888-d429-4ffa-81eb-c64f5ef78dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:16.529524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbd888-d429-4ffa-81eb-c64f5ef78dc4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:16.529802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbd888-d429-4ffa-81eb-c64f5ef78dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:16.530075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbd888-d429-4ffa-81eb-c64f5ef78dc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:16.537391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b65c-f552-4265-87df-b0870f8e01f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:16.537991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b65c-f552-4265-87df-b0870f8e01f8 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:16.538600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b65c-f552-4265-87df-b0870f8e01f8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:16.538600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b65c-f552-4265-87df-b0870f8e01f8 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:16.539191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5b65c-f552-4265-87df-b0870f8e01f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:16.540012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5b65c-f552-4265-87df-b0870f8e01f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:16.541413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5b65c-f552-4265-87df-b0870f8e01f8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:16.549014 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 213/437] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:16.549819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b65c-f552-4265-87df-b0870f8e01f8 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:16.601000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbd888-d429-4ffa-81eb-c64f5ef78dc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:16.603071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbd888-d429-4ffa-81eb-c64f5ef78dc4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:16.646598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b65c-f552-4265-87df-b0870f8e01f8 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:16.678864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:16.680436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92f4dc-5f94-4f93-8261-17defe2a6cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:16.681300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92f4dc-5f94-4f93-8261-17defe2a6cdf None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:16.681791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92f4dc-5f94-4f93-8261-17defe2a6cdf None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:16.681920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92f4dc-5f94-4f93-8261-17defe2a6cdf None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:16.682971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92f4dc-5f94-4f93-8261-17defe2a6cdf None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:16.684389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92f4dc-5f94-4f93-8261-17defe2a6cdf None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:16.686032 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 214/438] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:16 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:16.687115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008958b-62ba-4221-90e5-8b8748309db8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:16.687397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008958b-62ba-4221-90e5-8b8748309db8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:16.687669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008958b-62ba-4221-90e5-8b8748309db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:16.702673 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 225/439] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:16.703494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbd888-d429-4ffa-81eb-c64f5ef78dc4 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:16.704822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0008958b-62ba-4221-90e5-8b8748309db8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:16.706049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0008958b-62ba-4221-90e5-8b8748309db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:16.748937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:16.771438 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 215/440] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:16.772235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008958b-62ba-4221-90e5-8b8748309db8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:16.806499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbd888-d429-4ffa-81eb-c64f5ef78dc4 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:16.842430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d358e4-a921-4a82-9aa5-64f828166fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:16.843146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d358e4-a921-4a82-9aa5-64f828166fba None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:16.843539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d358e4-a921-4a82-9aa5-64f828166fba None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:16.843836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d358e4-a921-4a82-9aa5-64f828166fba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:16.872454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008958b-62ba-4221-90e5-8b8748309db8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:16.896552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:16.906659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6a584-6c8b-414e-b6fa-ca18f7967af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:16.907279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6a584-6c8b-414e-b6fa-ca18f7967af1 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:16.907554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6a584-6c8b-414e-b6fa-ca18f7967af1 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:16.907825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6a584-6c8b-414e-b6fa-ca18f7967af1 None admin] PATH_INFO: `/v3/groups/a173b8cf9c0245f9b45632507d87ce5a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:16.908914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6a584-6c8b-414e-b6fa-ca18f7967af1 None admin] RBAC: Authorizing `identity:get_group(group_id=a173b8cf9c0245f9b45632507d87ce5a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:16.910370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6a584-6c8b-414e-b6fa-ca18f7967af1 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:16.911899 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 216/441] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:16 2022] GET /identity/v3/groups/a173b8cf9c0245f9b45632507d87ce5a => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:16.912633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6a584-6c8b-414e-b6fa-ca18f7967af1 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:16.927638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d358e4-a921-4a82-9aa5-64f828166fba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:16.929369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d358e4-a921-4a82-9aa5-64f828166fba None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:16.960105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:17.016088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6a584-6c8b-414e-b6fa-ca18f7967af1 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:17.036590 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 226/442] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:17.038201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d358e4-a921-4a82-9aa5-64f828166fba None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:17.053396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166e2b0-65f0-4b55-8dce-3ef91652b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:17.054010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166e2b0-65f0-4b55-8dce-3ef91652b158 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:17.054310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166e2b0-65f0-4b55-8dce-3ef91652b158 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:17.054558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166e2b0-65f0-4b55-8dce-3ef91652b158 None admin] PATH_INFO: `/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:17.055646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166e2b0-65f0-4b55-8dce-3ef91652b158 None admin] RBAC: Authorizing `identity:get_project(project_id=1e1aed93c9534d8d87cc68e56be1e9fc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:17.057055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166e2b0-65f0-4b55-8dce-3ef91652b158 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:17.058665 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 217/443] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:16 2022] GET /identity/v3/projects/1e1aed93c9534d8d87cc68e56be1e9fc => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:17.059401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166e2b0-65f0-4b55-8dce-3ef91652b158 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:17.126766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:17.149679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d358e4-a921-4a82-9aa5-64f828166fba None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:17.158342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166e2b0-65f0-4b55-8dce-3ef91652b158 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:17.171415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:17.182610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6af7-ebf6-49c7-9641-73d7c6acc1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:17.183210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6af7-ebf6-49c7-9641-73d7c6acc1e9 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:17.183489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6af7-ebf6-49c7-9641-73d7c6acc1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:17.183760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6af7-ebf6-49c7-9641-73d7c6acc1e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:17.184512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6af7-ebf6-49c7-9641-73d7c6acc1e9 None admin] RBAC: Adding query filter params (group.id=a173b8cf9c0245f9b45632507d87ce5a, role.id=27431c49ccd74f7a898d1a39e251ce29, scope.project.id=a453d14403a142248aefae9ff0bf5691) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:17.184822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6af7-ebf6-49c7-9641-73d7c6acc1e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:17.186278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6af7-ebf6-49c7-9641-73d7c6acc1e9 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:17.191866 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 227/444] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Oct 8 20:35:17 2022] GET /identity/v3/role_assignments?group.id=a173b8cf9c0245f9b45632507d87ce5a&scope.project.id=a453d14403a142248aefae9ff0bf5691&role.id=27431c49ccd74f7a898d1a39e251ce29 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:17.192030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a47e3-187a-439b-9d91-379b6b0f09fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:17.192655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a47e3-187a-439b-9d91-379b6b0f09fd None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:17.192784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6af7-ebf6-49c7-9641-73d7c6acc1e9 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:17.192940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a47e3-187a-439b-9d91-379b6b0f09fd None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:17.193235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a47e3-187a-439b-9d91-379b6b0f09fd None admin] PATH_INFO: `/v3/projects/a453d14403a142248aefae9ff0bf5691` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:17.194366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a47e3-187a-439b-9d91-379b6b0f09fd None admin] RBAC: Authorizing `identity:get_project(project_id=a453d14403a142248aefae9ff0bf5691)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:17.196329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a47e3-187a-439b-9d91-379b6b0f09fd None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:17.198052 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 218/445] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:17 2022] GET /identity/v3/projects/a453d14403a142248aefae9ff0bf5691 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:17.198841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a47e3-187a-439b-9d91-379b6b0f09fd None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:17.315839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6af7-ebf6-49c7-9641-73d7c6acc1e9 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:17.320035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a47e3-187a-439b-9d91-379b6b0f09fd None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:17.355875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb6550-7883-46e2-b1b4-1e33f97615fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:17.356909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb6550-7883-46e2-b1b4-1e33f97615fe None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:17.357423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d490d6-459b-4f34-af00-8d606d43811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:17.357556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb6550-7883-46e2-b1b4-1e33f97615fe None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:17.357957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb6550-7883-46e2-b1b4-1e33f97615fe None admin] PATH_INFO: `/v3/groups/a173b8cf9c0245f9b45632507d87ce5a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:17.358086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d490d6-459b-4f34-af00-8d606d43811e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:17.358334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d490d6-459b-4f34-af00-8d606d43811e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:17.358608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d490d6-459b-4f34-af00-8d606d43811e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:17.359743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb6550-7883-46e2-b1b4-1e33f97615fe None admin] RBAC: Authorizing `identity:get_group(group_id=a173b8cf9c0245f9b45632507d87ce5a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:17.361906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb6550-7883-46e2-b1b4-1e33f97615fe None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:17.363577 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 228/446] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:17 2022] GET /identity/v3/groups/a173b8cf9c0245f9b45632507d87ce5a => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:17.364362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb6550-7883-46e2-b1b4-1e33f97615fe None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:17.377327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d490d6-459b-4f34-af00-8d606d43811e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-47d490d6-459b-4f34-af00-8d606d43811e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:17.383563 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:17.384555 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 219/447] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:35:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:17.385793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d490d6-459b-4f34-af00-8d606d43811e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:17.386920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:17.441898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:17.490659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb6550-7883-46e2-b1b4-1e33f97615fe None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:17.509923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d490d6-459b-4f34-af00-8d606d43811e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:17.522680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bfd89-f19d-4ba6-88a2-c1807439e5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:17.523328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bfd89-f19d-4ba6-88a2-c1807439e5a8 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:17.523599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bfd89-f19d-4ba6-88a2-c1807439e5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:17.524402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bfd89-f19d-4ba6-88a2-c1807439e5a8 None admin] PATH_INFO: `/v3/groups/a173b8cf9c0245f9b45632507d87ce5a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:17.525531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bfd89-f19d-4ba6-88a2-c1807439e5a8 None admin] RBAC: Authorizing `identity:get_group(group_id=a173b8cf9c0245f9b45632507d87ce5a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:17.526942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bfd89-f19d-4ba6-88a2-c1807439e5a8 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:17.528477 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 229/448] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:17 2022] GET /identity/v3/groups/a173b8cf9c0245f9b45632507d87ce5a => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:17.529243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bfd89-f19d-4ba6-88a2-c1807439e5a8 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:17.547485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9fec0-44d9-4c52-8cc4-5ad4b0c2328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:17.548093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9fec0-44d9-4c52-8cc4-5ad4b0c2328a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:17.548374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9fec0-44d9-4c52-8cc4-5ad4b0c2328a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:17.548670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9fec0-44d9-4c52-8cc4-5ad4b0c2328a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:17.549400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9fec0-44d9-4c52-8cc4-5ad4b0c2328a None admin] RBAC: Adding query filter params (group.id=a173b8cf9c0245f9b45632507d87ce5a, role.id=94f39d4bced64cc98e66bceafe049303, scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:17.549711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9fec0-44d9-4c52-8cc4-5ad4b0c2328a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:17.551157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9fec0-44d9-4c52-8cc4-5ad4b0c2328a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:17.556705 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 220/449] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Oct 8 20:35:17 2022] GET /identity/v3/role_assignments?group.id=a173b8cf9c0245f9b45632507d87ce5a&scope.project.id=1e1aed93c9534d8d87cc68e56be1e9fc&role.id=94f39d4bced64cc98e66bceafe049303 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:17.557496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9fec0-44d9-4c52-8cc4-5ad4b0c2328a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:17.617320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:17.646081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bfd89-f19d-4ba6-88a2-c1807439e5a8 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:17.684547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a076f-3e31-4494-8521-cec4f161667c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:17.685036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9fec0-44d9-4c52-8cc4-5ad4b0c2328a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:17.686168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a076f-3e31-4494-8521-cec4f161667c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:17.686660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a076f-3e31-4494-8521-cec4f161667c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:17.687034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a076f-3e31-4494-8521-cec4f161667c None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:17.688344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a076f-3e31-4494-8521-cec4f161667c None admin] RBAC: Adding query filter params (name=admin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:17.688344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a076f-3e31-4494-8521-cec4f161667c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:17.689435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a076f-3e31-4494-8521-cec4f161667c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:17.693909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:17.704468 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 230/450] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:17.705520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a076f-3e31-4494-8521-cec4f161667c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:17.725720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea480b-38f6-4d34-bb9c-6b152d9fe91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:17.726349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea480b-38f6-4d34-bb9c-6b152d9fe91f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:17.726625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea480b-38f6-4d34-bb9c-6b152d9fe91f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:17.726949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea480b-38f6-4d34-bb9c-6b152d9fe91f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:17.727693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea480b-38f6-4d34-bb9c-6b152d9fe91f None admin] RBAC: Adding query filter params (group.id=a173b8cf9c0245f9b45632507d87ce5a, role.id=94f39d4bced64cc98e66bceafe049303, scope.project.id=a453d14403a142248aefae9ff0bf5691) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:17.728000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea480b-38f6-4d34-bb9c-6b152d9fe91f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:17.729473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea480b-38f6-4d34-bb9c-6b152d9fe91f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:17.735929 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 221/451] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Oct 8 20:35:17 2022] GET /identity/v3/role_assignments?group.id=a173b8cf9c0245f9b45632507d87ce5a&scope.project.id=a453d14403a142248aefae9ff0bf5691&role.id=94f39d4bced64cc98e66bceafe049303 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:17.827316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a076f-3e31-4494-8521-cec4f161667c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:17.868691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2db87-cfb1-4713-8df8-7dd0a9b91790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:17.869301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2db87-cfb1-4713-8df8-7dd0a9b91790 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:17.869577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2db87-cfb1-4713-8df8-7dd0a9b91790 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:17.869848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2db87-cfb1-4713-8df8-7dd0a9b91790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:17.881790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:17.949142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2db87-cfb1-4713-8df8-7dd0a9b91790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:17.950709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2db87-cfb1-4713-8df8-7dd0a9b91790 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:18.053536 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 231/452] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:18.059791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea480b-38f6-4d34-bb9c-6b152d9fe91f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:18.163230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea480b-38f6-4d34-bb9c-6b152d9fe91f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:18.197087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5126c-7c0b-4d1b-bca2-30c7514a7f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:18.197760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5126c-7c0b-4d1b-bca2-30c7514a7f78 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:18.198041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5126c-7c0b-4d1b-bca2-30c7514a7f78 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:18.198316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5126c-7c0b-4d1b-bca2-30c7514a7f78 None admin] PATH_INFO: `/v3/projects/8cbdca763b15498ebcee722600237097` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:18.199452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5126c-7c0b-4d1b-bca2-30c7514a7f78 None admin] RBAC: Authorizing `identity:get_project(project_id=8cbdca763b15498ebcee722600237097)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:18.200893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5126c-7c0b-4d1b-bca2-30c7514a7f78 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:18.202608 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 222/453] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:35:18 2022] GET /identity/v3/projects/8cbdca763b15498ebcee722600237097 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:18.208372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2db87-cfb1-4713-8df8-7dd0a9b91790 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:18.249577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:18.310129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2db87-cfb1-4713-8df8-7dd0a9b91790 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:18.343844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92d699-9450-45e0-ba84-6da6b35f2ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:18.344472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92d699-9450-45e0-ba84-6da6b35f2ebe None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:18.344750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92d699-9450-45e0-ba84-6da6b35f2ebe None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:18.345021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92d699-9450-45e0-ba84-6da6b35f2ebe None admin] PATH_INFO: `/v3/groups/721f419ecbd843a9bc29ed225bb114af` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:18.346155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92d699-9450-45e0-ba84-6da6b35f2ebe None admin] RBAC: Authorizing `identity:get_group(group_id=721f419ecbd843a9bc29ed225bb114af)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:18.347572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92d699-9450-45e0-ba84-6da6b35f2ebe None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:18.349124 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 232/454] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Oct 8 20:35:18 2022] GET /identity/v3/groups/721f419ecbd843a9bc29ed225bb114af => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:18.355031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5126c-7c0b-4d1b-bca2-30c7514a7f78 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:18.394818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:18.452766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5126c-7c0b-4d1b-bca2-30c7514a7f78 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:18.488552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d055-0acd-4a5d-83cb-9753122ea453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:18.489158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d055-0acd-4a5d-83cb-9753122ea453 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:18.489467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d055-0acd-4a5d-83cb-9753122ea453 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:18.489742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d055-0acd-4a5d-83cb-9753122ea453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:18.490469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d055-0acd-4a5d-83cb-9753122ea453 None admin] RBAC: Adding query filter params (group.id=721f419ecbd843a9bc29ed225bb114af, role.id=a409f81bd5744563a303a825783bed61, scope.project.id=8cbdca763b15498ebcee722600237097) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:18.490778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d055-0acd-4a5d-83cb-9753122ea453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:18.492224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d055-0acd-4a5d-83cb-9753122ea453 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:18.498486 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 223/455] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Oct 8 20:35:18 2022] GET /identity/v3/role_assignments?group.id=721f419ecbd843a9bc29ed225bb114af&scope.project.id=8cbdca763b15498ebcee722600237097&role.id=a409f81bd5744563a303a825783bed61 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:21.437742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cf4e2-d002-405d-8ae2-4acc75fb1964 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:21.438799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cf4e2-d002-405d-8ae2-4acc75fb1964 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:21.439299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cf4e2-d002-405d-8ae2-4acc75fb1964 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:21.441088 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 233/456] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:21.442741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6113e8-eeb8-4079-b296-e96bf45afb08 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:21.443175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6113e8-eeb8-4079-b296-e96bf45afb08 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:21.443340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6113e8-eeb8-4079-b296-e96bf45afb08 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:21.444801 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 224/457] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:21.450728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11af15f-b0c2-4f08-bc07-987459d54a24 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:21.451252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11af15f-b0c2-4f08-bc07-987459d54a24 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:21.451748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11af15f-b0c2-4f08-bc07-987459d54a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:21.457854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714cc1-ab6f-4834-9140-05a950a9c2b0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:21.459850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714cc1-ab6f-4834-9140-05a950a9c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:21.461135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714cc1-ab6f-4834-9140-05a950a9c2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:21.478909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b11af15f-b0c2-4f08-bc07-987459d54a24 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:21.481713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b11af15f-b0c2-4f08-bc07-987459d54a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:21.498625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b3714cc1-ab6f-4834-9140-05a950a9c2b0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:21.499807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b3714cc1-ab6f-4834-9140-05a950a9c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:21.607249 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 234/458] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:21.623137 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 225/459] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:21.633883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a12b79-25ac-4a19-90ca-e8e930021bd5 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:21.634171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a12b79-25ac-4a19-90ca-e8e930021bd5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:21.634448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a12b79-25ac-4a19-90ca-e8e930021bd5 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:21.635780 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 235/460] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:21.647677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a06ae9-26d6-4a71-aa8a-4acfa7b7d807 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:21.648156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a06ae9-26d6-4a71-aa8a-4acfa7b7d807 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:21.648574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a06ae9-26d6-4a71-aa8a-4acfa7b7d807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:21.682161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-09a06ae9-26d6-4a71-aa8a-4acfa7b7d807 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:21.683602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-09a06ae9-26d6-4a71-aa8a-4acfa7b7d807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:21.722129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:21.779751 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 226/461] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:21.977086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a12b79-25ac-4a19-90ca-e8e930021bd5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:22.032043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:22.066250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a06ae9-26d6-4a71-aa8a-4acfa7b7d807 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:22.141166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a12b79-25ac-4a19-90ca-e8e930021bd5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:22.204553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685a6dd-3b1d-4a5a-a905-5cf4973bfbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:22.205224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685a6dd-3b1d-4a5a-a905-5cf4973bfbaa None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:22.205503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685a6dd-3b1d-4a5a-a905-5cf4973bfbaa None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:22.206043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685a6dd-3b1d-4a5a-a905-5cf4973bfbaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:22.219408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685a6dd-3b1d-4a5a-a905-5cf4973bfbaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:22.221418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685a6dd-3b1d-4a5a-a905-5cf4973bfbaa None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:22.231286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a06ae9-26d6-4a71-aa8a-4acfa7b7d807 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-c685a6dd-3b1d-4a5a-a905-5cf4973bfbaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:22.240514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:22.241477 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:22.242409 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:22.242409 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:22.242409 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:22.245464 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 236/462] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:22.246701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685a6dd-3b1d-4a5a-a905-5cf4973bfbaa None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:22.273329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848addb3-9605-46c0-8803-da480a36693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:22.274301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848addb3-9605-46c0-8803-da480a36693a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:22.274714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848addb3-9605-46c0-8803-da480a36693a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:22.275158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848addb3-9605-46c0-8803-da480a36693a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:22.288833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848addb3-9605-46c0-8803-da480a36693a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:22.290908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848addb3-9605-46c0-8803-da480a36693a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-848addb3-9605-46c0-8803-da480a36693a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:22.312027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:22.312951 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:22.313968 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:22.313968 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:22.313968 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:22.313968 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 227/463] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:22.314206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848addb3-9605-46c0-8803-da480a36693a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:22.338016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:22.365280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:22.382831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685a6dd-3b1d-4a5a-a905-5cf4973bfbaa None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:22.417801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506341b-73bf-478c-9d3a-c089c7b78edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:22.418444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506341b-73bf-478c-9d3a-c089c7b78edc None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:22.419588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506341b-73bf-478c-9d3a-c089c7b78edc None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:22.419588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506341b-73bf-478c-9d3a-c089c7b78edc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:22.432513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506341b-73bf-478c-9d3a-c089c7b78edc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:22.434102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506341b-73bf-478c-9d3a-c089c7b78edc None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-1506341b-73bf-478c-9d3a-c089c7b78edc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:22.449196 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:22.450778 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:22.451820 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:22.451820 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:22.451820 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:22.456344 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 237/464] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:22.456344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506341b-73bf-478c-9d3a-c089c7b78edc None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:22.464299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848addb3-9605-46c0-8803-da480a36693a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:22.503550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5d95-4d01-48e8-bd1a-f331e20b5da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:22.504170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5d95-4d01-48e8-bd1a-f331e20b5da0 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:22.504549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5d95-4d01-48e8-bd1a-f331e20b5da0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:22.504898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5d95-4d01-48e8-bd1a-f331e20b5da0 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:22.505645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a5d95-4d01-48e8-bd1a-f331e20b5da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:22.506023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a5d95-4d01-48e8-bd1a-f331e20b5da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:22.507475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a5d95-4d01-48e8-bd1a-f331e20b5da0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:22.519850 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 228/465] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:22.524975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5d95-4d01-48e8-bd1a-f331e20b5da0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:22.567625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506341b-73bf-478c-9d3a-c089c7b78edc None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:22.610338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a447cf2-95c0-4f41-9a9b-37aff942accb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:22.610947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a447cf2-95c0-4f41-9a9b-37aff942accb None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:22.611227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a447cf2-95c0-4f41-9a9b-37aff942accb None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:22.611507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a447cf2-95c0-4f41-9a9b-37aff942accb None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:22.612395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a447cf2-95c0-4f41-9a9b-37aff942accb None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:22.612526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:22.612696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a447cf2-95c0-4f41-9a9b-37aff942accb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:22.614097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a447cf2-95c0-4f41-9a9b-37aff942accb None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:22.632012 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 238/466] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:22.632012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc84a-69a5-4156-ae45-740b503b24bb None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:22.632012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc84a-69a5-4156-ae45-740b503b24bb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:22.632012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc84a-69a5-4156-ae45-740b503b24bb None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:22.632012 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 239/467] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:22.633145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dc84a-69a5-4156-ae45-740b503b24bb None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:22.635764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:22.644208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5d95-4d01-48e8-bd1a-f331e20b5da0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:22.680367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c7f51-7d0c-486b-9fab-645e856627ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:22.680997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c7f51-7d0c-486b-9fab-645e856627ba None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:22.681421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c7f51-7d0c-486b-9fab-645e856627ba None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:22.681596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c7f51-7d0c-486b-9fab-645e856627ba None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:22.682258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c7f51-7d0c-486b-9fab-645e856627ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:22.682598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c7f51-7d0c-486b-9fab-645e856627ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:22.684021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c7f51-7d0c-486b-9fab-645e856627ba None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:22.697863 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 229/468] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:22.698504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c7f51-7d0c-486b-9fab-645e856627ba None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:22.755846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dc84a-69a5-4156-ae45-740b503b24bb None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:22.795499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfb837-d65a-4cb8-b3b4-f9d15d88665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:22.802575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb837-d65a-4cb8-b3b4-f9d15d88665f None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:22.802575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb837-d65a-4cb8-b3b4-f9d15d88665f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:22.802575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb837-d65a-4cb8-b3b4-f9d15d88665f None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:22.802575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfb837-d65a-4cb8-b3b4-f9d15d88665f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:22.802575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfb837-d65a-4cb8-b3b4-f9d15d88665f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:22.806527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c7f51-7d0c-486b-9fab-645e856627ba None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:22.824287 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 240/469] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:35:22 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:35:22.835149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac90a30-a13d-41fb-92c1-568d8f052141 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:22.835480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac90a30-a13d-41fb-92c1-568d8f052141 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:22.835701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac90a30-a13d-41fb-92c1-568d8f052141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:22.850535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a6e08-4d9d-451f-b6c1-6c5f8f8e343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:22.851588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a6e08-4d9d-451f-b6c1-6c5f8f8e343e None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:22.852752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a6e08-4d9d-451f-b6c1-6c5f8f8e343e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:22.853262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a6e08-4d9d-451f-b6c1-6c5f8f8e343e None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:22.854994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a6e08-4d9d-451f-b6c1-6c5f8f8e343e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:22.857167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a6e08-4d9d-451f-b6c1-6c5f8f8e343e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:22.860940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9ac90a30-a13d-41fb-92c1-568d8f052141 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:22.862498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9ac90a30-a13d-41fb-92c1-568d8f052141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:22.869256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:22.889492 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 230/470] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:35:22 2022] POST /identity/v3/users => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:35:22.890924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a6e08-4d9d-451f-b6c1-6c5f8f8e343e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:22.966737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:22.996943 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 241/471] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:23.022351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a6e08-4d9d-451f-b6c1-6c5f8f8e343e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:23.065177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b989e-09dc-4f2c-9309-f7dbdf0de625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:23.066229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b989e-09dc-4f2c-9309-f7dbdf0de625 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:23.066718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b989e-09dc-4f2c-9309-f7dbdf0de625 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:23.067192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b989e-09dc-4f2c-9309-f7dbdf0de625 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:23.068039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b989e-09dc-4f2c-9309-f7dbdf0de625 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:23.069747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b989e-09dc-4f2c-9309-f7dbdf0de625 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:23.108952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ec3d5-fb76-4f37-b794-0dd017334291 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:23.109259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ec3d5-fb76-4f37-b794-0dd017334291 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:23.109539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ec3d5-fb76-4f37-b794-0dd017334291 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:23.110880 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 242/472] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:35:23.116010 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 231/473] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:35:22 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:35:23.122606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1af20-7a07-4444-b775-532e39caacf9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:23.122606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1af20-7a07-4444-b775-532e39caacf9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:23.122606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1af20-7a07-4444-b775-532e39caacf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:23.146715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3bf1af20-7a07-4444-b775-532e39caacf9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:23.147986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3bf1af20-7a07-4444-b775-532e39caacf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:23.231007 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 243/474] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:23.387123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b989e-09dc-4f2c-9309-f7dbdf0de625 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:23.441516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:23.501472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b989e-09dc-4f2c-9309-f7dbdf0de625 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:23.538783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9eb20-becb-43a6-b883-ae9e120a1783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:23.539750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9eb20-becb-43a6-b883-ae9e120a1783 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:23.540174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9eb20-becb-43a6-b883-ae9e120a1783 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:23.540587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9eb20-becb-43a6-b883-ae9e120a1783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:23.551972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9eb20-becb-43a6-b883-ae9e120a1783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:23.553647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9eb20-becb-43a6-b883-ae9e120a1783 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-aae9eb20-becb-43a6-b883-ae9e120a1783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:23.572231 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:23.577468 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:23.578604 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:23.578604 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:23.578604 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:23.580311 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 232/475] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:23.586141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1af20-7a07-4444-b775-532e39caacf9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:23.605426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9eb20-becb-43a6-b883-ae9e120a1783 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:23.736236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:23.744670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9eb20-becb-43a6-b883-ae9e120a1783 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:23.783606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802a2bb-f9be-4db0-9dbe-af9f40476fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:23.784219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a2bb-f9be-4db0-9dbe-af9f40476fca None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:23.784503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a2bb-f9be-4db0-9dbe-af9f40476fca None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:23.784779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a2bb-f9be-4db0-9dbe-af9f40476fca None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:23.785493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802a2bb-f9be-4db0-9dbe-af9f40476fca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:23.787012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802a2bb-f9be-4db0-9dbe-af9f40476fca None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:23.795677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.sql.core [None req-7802a2bb-f9be-4db0-9dbe-af9f40476fca None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 08 20:35:23.795677 ncdv-master-1 devstack@keystone.service[99084]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 08 20:35:23.795677 ncdv-master-1 devstack@keystone.service[99084]: [parameters: {'id': '464becc20c244d888742812893c47851', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 08 20:35:23.795677 ncdv-master-1 devstack@keystone.service[99084]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=99084) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-7802a2bb-f9be-4db0-9dbe-af9f40476fca None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application conn.query(q) Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result.read() Oct 08 20:35:23.814290 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return ref.to_dict() Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 20:35:23.815373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application next(self.gen) Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application yield resource Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application next(self.gen) Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.session.rollback() Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.force_reraise() Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise self.value Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application session.commit() Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 08 20:35:23.816559 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._prepare_impl() Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.session.flush() Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._flush(objects) Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application compat.raise_( Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application flush_context.execute() Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rec.execute(self) Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 08 20:35:23.817544 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:35:23.818435 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application conn.query(q) Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result.read() Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:35:23.819250 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [parameters: {'id': '464becc20c244d888742812893c47851', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:23.820056 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 08 20:35:23.825523 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:23.826557 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 233/476] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Oct 8 20:35:23 2022] POST /identity/v3/roles => generated 144 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:23.826557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802a2bb-f9be-4db0-9dbe-af9f40476fca None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:23.841056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1af20-7a07-4444-b775-532e39caacf9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:23.885908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:23.936582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802a2bb-f9be-4db0-9dbe-af9f40476fca None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:23.949890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e52566-b0e8-491c-8e73-77df9526487c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:23.950781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52566-b0e8-491c-8e73-77df9526487c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:23.951200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52566-b0e8-491c-8e73-77df9526487c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:23.951619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52566-b0e8-491c-8e73-77df9526487c None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:23.952414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e52566-b0e8-491c-8e73-77df9526487c None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:23.952861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e52566-b0e8-491c-8e73-77df9526487c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:23.954427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e52566-b0e8-491c-8e73-77df9526487c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:23.978257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d447b-3ef6-47cc-a514-54fdb2561dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:23.979370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d447b-3ef6-47cc-a514-54fdb2561dbd None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:23.979749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d447b-3ef6-47cc-a514-54fdb2561dbd None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:23.980185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d447b-3ef6-47cc-a514-54fdb2561dbd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:23.981890 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 244/477] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:23.987962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e52566-b0e8-491c-8e73-77df9526487c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:23.993415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d447b-3ef6-47cc-a514-54fdb2561dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-fa6d447b-3ef6-47cc-a514-54fdb2561dbd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:24.003512 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:24.004414 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:24.005278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:24.005278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:24.005278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:24.005278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:24.005278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:24.005278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:24.005278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:24.005278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:24.005278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:24.005278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:24.005278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:35:24.005278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:24.009351 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 234/478] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:35:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:24.017206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d447b-3ef6-47cc-a514-54fdb2561dbd None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:24.042568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:24.175224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e52566-b0e8-491c-8e73-77df9526487c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:24.221994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd99960-84f3-4be5-b42a-9eec06e83e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:24.222610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd99960-84f3-4be5-b42a-9eec06e83e90 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:24.222885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd99960-84f3-4be5-b42a-9eec06e83e90 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:24.223157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd99960-84f3-4be5-b42a-9eec06e83e90 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:24.223802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd99960-84f3-4be5-b42a-9eec06e83e90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:24.225247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd99960-84f3-4be5-b42a-9eec06e83e90 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:24.236036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d447b-3ef6-47cc-a514-54fdb2561dbd None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:24.276572 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 245/479] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:35:23 2022] POST /identity/v3/users => generated 249 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:35:24.291769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903ebd2-df8f-404b-a97e-72f0150a74a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:24.292388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903ebd2-df8f-404b-a97e-72f0150a74a5 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:24.292668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903ebd2-df8f-404b-a97e-72f0150a74a5 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:24.292940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903ebd2-df8f-404b-a97e-72f0150a74a5 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:24.293653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903ebd2-df8f-404b-a97e-72f0150a74a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:24.293960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903ebd2-df8f-404b-a97e-72f0150a74a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:24.295477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903ebd2-df8f-404b-a97e-72f0150a74a5 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:24.306227 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 235/480] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:25.959567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e267d56-aee6-44b5-b553-37b4a928f06d None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:25.960068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e267d56-aee6-44b5-b553-37b4a928f06d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:25.960142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e267d56-aee6-44b5-b553-37b4a928f06d None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:25.962296 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 246/481] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:25.967532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4da23-7870-411b-a4f4-be11671dc3ab None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:25.967931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4da23-7870-411b-a4f4-be11671dc3ab None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:25.968094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4da23-7870-411b-a4f4-be11671dc3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:25.994199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-37f4da23-7870-411b-a4f4-be11671dc3ab None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:25.995486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-37f4da23-7870-411b-a4f4-be11671dc3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:26.071718 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 236/482] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:26.164000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f9f9d-de9f-455c-bb90-b426309d8b39 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:26.164971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f9f9d-de9f-455c-bb90-b426309d8b39 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:26.165388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f9f9d-de9f-455c-bb90-b426309d8b39 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:26.167113 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 247/483] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:26.172485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430406ca-22ec-4c37-9dd9-9e81a8ece0c7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:26.172877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430406ca-22ec-4c37-9dd9-9e81a8ece0c7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:26.173290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430406ca-22ec-4c37-9dd9-9e81a8ece0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:26.192360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-430406ca-22ec-4c37-9dd9-9e81a8ece0c7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:26.193570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-430406ca-22ec-4c37-9dd9-9e81a8ece0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:26.203124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:26.263038 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 237/484] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:26.363413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1107f0f-cbfa-4e59-8545-0c378b8af509 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:26.363748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1107f0f-cbfa-4e59-8545-0c378b8af509 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:26.363963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1107f0f-cbfa-4e59-8545-0c378b8af509 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:26.365325 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 248/485] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:26.371329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868172e1-409d-4b0b-8272-070f417bfa84 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:26.371612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868172e1-409d-4b0b-8272-070f417bfa84 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:26.371886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868172e1-409d-4b0b-8272-070f417bfa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:26.394717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-868172e1-409d-4b0b-8272-070f417bfa84 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:26.395900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-868172e1-409d-4b0b-8272-070f417bfa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:26.479975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1107f0f-cbfa-4e59-8545-0c378b8af509 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:26.484556 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 238/486] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:26.540825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:26.618590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1107f0f-cbfa-4e59-8545-0c378b8af509 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:26.653403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9278c-e0cc-4c73-afee-c753825b6f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:26.654034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9278c-e0cc-4c73-afee-c753825b6f18 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:26.654312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9278c-e0cc-4c73-afee-c753825b6f18 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:26.654585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9278c-e0cc-4c73-afee-c753825b6f18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:26.665460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9278c-e0cc-4c73-afee-c753825b6f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-8be9278c-e0cc-4c73-afee-c753825b6f18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:26.670263 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:26.671153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:26.671958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:26.671958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:26.671958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:26.671958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:26.671958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:26.671958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:26.671958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:26.671958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:26.671958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:26.671958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:26.671958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:26.671958 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:26.671958 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 249/487] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:26.677179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868172e1-409d-4b0b-8272-070f417bfa84 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:26.792273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9278c-e0cc-4c73-afee-c753825b6f18 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:26.809640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:26.875160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868172e1-409d-4b0b-8272-070f417bfa84 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:26.910468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9278c-e0cc-4c73-afee-c753825b6f18 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:26.913591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:26.949089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc310af6-d386-43ee-bc07-630a2fca8c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:26.950096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc310af6-d386-43ee-bc07-630a2fca8c93 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:26.950731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc310af6-d386-43ee-bc07-630a2fca8c93 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:26.951532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc310af6-d386-43ee-bc07-630a2fca8c93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:26.963917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc310af6-d386-43ee-bc07-630a2fca8c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-bc310af6-d386-43ee-bc07-630a2fca8c93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:26.970308 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:26.971197 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:26.972015 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:26.972015 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:26.972015 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:26.972015 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:26.972015 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:26.972015 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:26.972015 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:26.972015 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:26.972015 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:26.972015 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:26.972015 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:26.972015 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:26.972612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f43e8-fdec-4305-bac7-4afa5094b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:26.972612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f43e8-fdec-4305-bac7-4afa5094b557 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:26.972612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f43e8-fdec-4305-bac7-4afa5094b557 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:26.972612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f43e8-fdec-4305-bac7-4afa5094b557 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:26.973150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f43e8-fdec-4305-bac7-4afa5094b557 None admin] RBAC: Adding query filter params (name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:26.973150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f43e8-fdec-4305-bac7-4afa5094b557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:26.974395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f43e8-fdec-4305-bac7-4afa5094b557 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:26.976164 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 250/488] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:26.982344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc310af6-d386-43ee-bc07-630a2fca8c93 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:26.990593 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 239/489] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:26.991524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f43e8-fdec-4305-bac7-4afa5094b557 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:27.098160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f43e8-fdec-4305-bac7-4afa5094b557 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:27.108950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc310af6-d386-43ee-bc07-630a2fca8c93 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:27.142333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b51c7c-a45c-4e04-a8a0-daaed507d292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:27.143299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b51c7c-a45c-4e04-a8a0-daaed507d292 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:27.143804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b51c7c-a45c-4e04-a8a0-daaed507d292 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:27.144272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b51c7c-a45c-4e04-a8a0-daaed507d292 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:27.145164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b51c7c-a45c-4e04-a8a0-daaed507d292 None admin] RBAC: Adding query filter params (name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:27.145689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b51c7c-a45c-4e04-a8a0-daaed507d292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:27.146051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee669596-1900-45fc-9fd7-411c9eb7c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:27.146685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee669596-1900-45fc-9fd7-411c9eb7c8a1 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:27.146965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee669596-1900-45fc-9fd7-411c9eb7c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:27.147300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee669596-1900-45fc-9fd7-411c9eb7c8a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:27.148144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b51c7c-a45c-4e04-a8a0-daaed507d292 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:27.158820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee669596-1900-45fc-9fd7-411c9eb7c8a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:27.163756 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 240/490] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-ee669596-1900-45fc-9fd7-411c9eb7c8a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:27.165405 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:27.166296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:27.167150 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:27.167150 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:27.167150 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:27.167150 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:27.167150 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:27.167150 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:27.167150 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:27.167150 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:27.167150 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:27.167150 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:27.167150 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:27.167150 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:27.168627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b51c7c-a45c-4e04-a8a0-daaed507d292 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:27.169637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:27.171565 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 251/491] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:27.172631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee669596-1900-45fc-9fd7-411c9eb7c8a1 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:27.199788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:27.289688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b51c7c-a45c-4e04-a8a0-daaed507d292 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:27.292665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee669596-1900-45fc-9fd7-411c9eb7c8a1 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:27.325827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010a2ca-9f3e-4077-9d45-decbf697a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:27.326482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010a2ca-9f3e-4077-9d45-decbf697a68a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:27.326768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010a2ca-9f3e-4077-9d45-decbf697a68a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:27.327069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010a2ca-9f3e-4077-9d45-decbf697a68a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:27.329083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6318d-9c3c-4d0b-be4e-f0ff1484d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:27.329766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6318d-9c3c-4d0b-be4e-f0ff1484d8be None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:27.330096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6318d-9c3c-4d0b-be4e-f0ff1484d8be None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:27.330376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6318d-9c3c-4d0b-be4e-f0ff1484d8be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:27.337911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010a2ca-9f3e-4077-9d45-decbf697a68a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:27.339340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010a2ca-9f3e-4077-9d45-decbf697a68a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:27.341471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6318d-9c3c-4d0b-be4e-f0ff1484d8be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:27.343230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6318d-9c3c-4d0b-be4e-f0ff1484d8be None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-f010a2ca-9f3e-4077-9d45-decbf697a68a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:27.353339 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:27.354194 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:27.355039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:27.355039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:27.355039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:27.355039 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 241/492] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:27.355256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010a2ca-9f3e-4077-9d45-decbf697a68a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-f2b6318d-9c3c-4d0b-be4e-f0ff1484d8be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:27.364564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:27.365651 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:27.366512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:27.366512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:27.366512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:27.366512 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 252/493] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:27.367281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda63ed-54ee-4a26-8e3b-c1d9ae1dfd29 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:27.367281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda63ed-54ee-4a26-8e3b-c1d9ae1dfd29 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:27.368289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda63ed-54ee-4a26-8e3b-c1d9ae1dfd29 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:27.373807 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 253/494] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:27.373807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda63ed-54ee-4a26-8e3b-c1d9ae1dfd29 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:27.419045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:27.440208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:27.470971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010a2ca-9f3e-4077-9d45-decbf697a68a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:27.480918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda63ed-54ee-4a26-8e3b-c1d9ae1dfd29 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:27.511152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a81477-9adc-4128-83b1-a20d734fc5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:27.511759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a81477-9adc-4128-83b1-a20d734fc5d8 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:27.512037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a81477-9adc-4128-83b1-a20d734fc5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:27.512308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a81477-9adc-4128-83b1-a20d734fc5d8 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:27.512973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a81477-9adc-4128-83b1-a20d734fc5d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:27.513305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a81477-9adc-4128-83b1-a20d734fc5d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:27.514666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a81477-9adc-4128-83b1-a20d734fc5d8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:27.517717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276b9ec-9e85-497b-9fc8-56064edac4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:27.518344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b9ec-9e85-497b-9fc8-56064edac4b4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:27.518626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b9ec-9e85-497b-9fc8-56064edac4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:27.518904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b9ec-9e85-497b-9fc8-56064edac4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:27.519869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276b9ec-9e85-497b-9fc8-56064edac4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:27.520167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276b9ec-9e85-497b-9fc8-56064edac4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:27.521539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276b9ec-9e85-497b-9fc8-56064edac4b4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:27.527076 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 242/495] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:27.527076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a81477-9adc-4128-83b1-a20d734fc5d8 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:27.544774 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 254/496] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:27.546443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6e148-b3d2-4739-b50c-a0fcb0ee616a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:27.546736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6e148-b3d2-4739-b50c-a0fcb0ee616a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:27.547012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6e148-b3d2-4739-b50c-a0fcb0ee616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:27.567330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-52b6e148-b3d2-4739-b50c-a0fcb0ee616a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:27.568513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-52b6e148-b3d2-4739-b50c-a0fcb0ee616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:27.628203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a81477-9adc-4128-83b1-a20d734fc5d8 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:27.636777 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 255/497] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:27.637637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6e148-b3d2-4739-b50c-a0fcb0ee616a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:27.642038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:27.670667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fa7cd-1c6b-4bf2-adbf-93ce91950418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:27.672576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fa7cd-1c6b-4bf2-adbf-93ce91950418 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:27.672998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fa7cd-1c6b-4bf2-adbf-93ce91950418 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:27.673442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fa7cd-1c6b-4bf2-adbf-93ce91950418 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:27.674257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fa7cd-1c6b-4bf2-adbf-93ce91950418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:27.674701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fa7cd-1c6b-4bf2-adbf-93ce91950418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:27.676210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fa7cd-1c6b-4bf2-adbf-93ce91950418 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:27.697683 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 243/498] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:27.697683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fa7cd-1c6b-4bf2-adbf-93ce91950418 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:27.698750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:27.747103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6e148-b3d2-4739-b50c-a0fcb0ee616a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:27.786380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe4425-0997-4e8e-a787-2d8db9ce3994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:27.787005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe4425-0997-4e8e-a787-2d8db9ce3994 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:27.787284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe4425-0997-4e8e-a787-2d8db9ce3994 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:27.787553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe4425-0997-4e8e-a787-2d8db9ce3994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:27.797908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fa7cd-1c6b-4bf2-adbf-93ce91950418 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:27.799211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe4425-0997-4e8e-a787-2d8db9ce3994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:27.800734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe4425-0997-4e8e-a787-2d8db9ce3994 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-ecfe4425-0997-4e8e-a787-2d8db9ce3994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:27.820743 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:27.821872 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:27.822774 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:27.822774 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:27.822774 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:27.826488 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 256/499] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:27.827711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d167-946c-48a6-9920-4bb30d4ca4f4 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:27.827997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d167-946c-48a6-9920-4bb30d4ca4f4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:27.828272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d167-946c-48a6-9920-4bb30d4ca4f4 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:27.833602 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 257/500] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:27.833602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d167-946c-48a6-9920-4bb30d4ca4f4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:27.845791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab0bc3-6fcc-4cd4-97cb-64670620639d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:27.846416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab0bc3-6fcc-4cd4-97cb-64670620639d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:27.846691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab0bc3-6fcc-4cd4-97cb-64670620639d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:27.846957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab0bc3-6fcc-4cd4-97cb-64670620639d None admin] PATH_INFO: `/v3/users/nova` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:27.855729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab0bc3-6fcc-4cd4-97cb-64670620639d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:27.857177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab0bc3-6fcc-4cd4-97cb-64670620639d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-66ab0bc3-6fcc-4cd4-97cb-64670620639d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:27.871266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:27.872186 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:27.877949 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:27.877949 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:27.877949 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:27.877949 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:27.877949 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:27.877949 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:27.877949 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:27.877949 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:27.877949 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:35:27.877949 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:27.877949 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 244/501] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Oct 8 20:35:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:27.877949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab0bc3-6fcc-4cd4-97cb-64670620639d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:27.908018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:27.945541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d167-946c-48a6-9920-4bb30d4ca4f4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:27.955021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:27.980887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c13c85-2c4c-440d-95bc-f1d3f7c11b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:27.981561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c13c85-2c4c-440d-95bc-f1d3f7c11b31 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:27.981804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c13c85-2c4c-440d-95bc-f1d3f7c11b31 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:27.982070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c13c85-2c4c-440d-95bc-f1d3f7c11b31 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:27.985292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab0bc3-6fcc-4cd4-97cb-64670620639d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:27.989594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c13c85-2c4c-440d-95bc-f1d3f7c11b31 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:27.991005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c13c85-2c4c-440d-95bc-f1d3f7c11b31 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-82c13c85-2c4c-440d-95bc-f1d3f7c11b31 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:28.003017 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:28.003951 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:28.004827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:28.004827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:28.004827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:28.004827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:28.004827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:28.004827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:28.004827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:28.004827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:28.004827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:35:28.004827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:28.004827 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 258/502] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:28.005445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0b9ef-1590-4322-ac29-6dbead57f28c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:28.005637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0b9ef-1590-4322-ac29-6dbead57f28c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:28.005908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0b9ef-1590-4322-ac29-6dbead57f28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:28.022372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b7584-1e93-40a8-96dd-9de7f623e1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:28.022978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b7584-1e93-40a8-96dd-9de7f623e1bf None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:28.023211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-17f0b9ef-1590-4322-ac29-6dbead57f28c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:28.023318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b7584-1e93-40a8-96dd-9de7f623e1bf None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:28.023517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b7584-1e93-40a8-96dd-9de7f623e1bf None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:28.024677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b7584-1e93-40a8-96dd-9de7f623e1bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:28.024894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-17f0b9ef-1590-4322-ac29-6dbead57f28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:28.024990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b7584-1e93-40a8-96dd-9de7f623e1bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:28.026375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b7584-1e93-40a8-96dd-9de7f623e1bf None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:28.037801 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 245/503] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:28.038593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b7584-1e93-40a8-96dd-9de7f623e1bf None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:28.091547 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 259/504] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:28.092517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0b9ef-1590-4322-ac29-6dbead57f28c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:28.134897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:28.146421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b7584-1e93-40a8-96dd-9de7f623e1bf None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:28.186241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e1410-1024-4095-ab0c-d9db9aa0729a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:28.186880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e1410-1024-4095-ab0c-d9db9aa0729a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:28.187160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e1410-1024-4095-ab0c-d9db9aa0729a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:28.187430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e1410-1024-4095-ab0c-d9db9aa0729a None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:28.188152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e1410-1024-4095-ab0c-d9db9aa0729a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:28.188452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e1410-1024-4095-ab0c-d9db9aa0729a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:28.189887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e1410-1024-4095-ab0c-d9db9aa0729a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:28.196636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:28.201232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0b9ef-1590-4322-ac29-6dbead57f28c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:28.226798 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 246/505] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Oct 8 20:35:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:28.227620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e1410-1024-4095-ab0c-d9db9aa0729a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:28.243453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00b06f-6dce-4e5c-afac-e6beca748f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:28.244650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b06f-6dce-4e5c-afac-e6beca748f2e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:28.245076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b06f-6dce-4e5c-afac-e6beca748f2e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:28.245542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b06f-6dce-4e5c-afac-e6beca748f2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:28.255931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00b06f-6dce-4e5c-afac-e6beca748f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:28.257562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00b06f-6dce-4e5c-afac-e6beca748f2e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-ca00b06f-6dce-4e5c-afac-e6beca748f2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:28.275954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:28.277047 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:28.278084 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:28.278084 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:28.278084 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:28.278084 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 260/506] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:28.278084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00b06f-6dce-4e5c-afac-e6beca748f2e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:28.342453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e1410-1024-4095-ab0c-d9db9aa0729a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:28.377269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f348-bf81-463a-ba13-a684b4563e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:28.377875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f348-bf81-463a-ba13-a684b4563e14 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:28.378154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f348-bf81-463a-ba13-a684b4563e14 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:28.378429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f348-bf81-463a-ba13-a684b4563e14 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:28.378534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00b06f-6dce-4e5c-afac-e6beca748f2e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:28.379160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09f348-bf81-463a-ba13-a684b4563e14 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:28.379464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09f348-bf81-463a-ba13-a684b4563e14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:28.380915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09f348-bf81-463a-ba13-a684b4563e14 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:28.399584 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 247/507] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Oct 8 20:35:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:28.400384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f348-bf81-463a-ba13-a684b4563e14 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:28.413841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:28.420878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dee105-b55e-434f-bac6-df03f104e115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:28.421553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dee105-b55e-434f-bac6-df03f104e115 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:28.421838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dee105-b55e-434f-bac6-df03f104e115 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:28.422114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dee105-b55e-434f-bac6-df03f104e115 None admin] PATH_INFO: `/v3/users/glance` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:28.429719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dee105-b55e-434f-bac6-df03f104e115 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:28.431175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dee105-b55e-434f-bac6-df03f104e115 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-e8dee105-b55e-434f-bac6-df03f104e115 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:28.442234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:28.443266 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:28.444260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:28.444260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:28.444260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:28.444260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:28.444260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:28.444260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:28.444260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:28.444260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:28.444260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 08 20:35:28.444260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:28.445327 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 261/508] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:28.446826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dee105-b55e-434f-bac6-df03f104e115 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:28.458803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:28.507852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f348-bf81-463a-ba13-a684b4563e14 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:28.542853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0246ff2-d673-41e0-a17a-982128511d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:28.543455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0246ff2-d673-41e0-a17a-982128511d02 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:28.543736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0246ff2-d673-41e0-a17a-982128511d02 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:28.544010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0246ff2-d673-41e0-a17a-982128511d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:28.549740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dee105-b55e-434f-bac6-df03f104e115 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:28.583443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28b82b-3b45-4714-bd92-0a30ae2efc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:28.584040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28b82b-3b45-4714-bd92-0a30ae2efc7f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:28.584318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28b82b-3b45-4714-bd92-0a30ae2efc7f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:28.584586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28b82b-3b45-4714-bd92-0a30ae2efc7f None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:28.585238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28b82b-3b45-4714-bd92-0a30ae2efc7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:28.585541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28b82b-3b45-4714-bd92-0a30ae2efc7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:28.586913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28b82b-3b45-4714-bd92-0a30ae2efc7f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:28.599015 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 262/509] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:28.599658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28b82b-3b45-4714-bd92-0a30ae2efc7f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:28.614369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0246ff2-d673-41e0-a17a-982128511d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:28.615837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0246ff2-d673-41e0-a17a-982128511d02 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:28.625882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:28.667516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:28.698697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28b82b-3b45-4714-bd92-0a30ae2efc7f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:28.713047 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 248/510] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:28.713890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0246ff2-d673-41e0-a17a-982128511d02 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:28.731617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db250f0e-310e-4d8e-aed1-1f8ee560bbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:28.732224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db250f0e-310e-4d8e-aed1-1f8ee560bbde None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:28.732502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db250f0e-310e-4d8e-aed1-1f8ee560bbde None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:28.732906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db250f0e-310e-4d8e-aed1-1f8ee560bbde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:28.799138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db250f0e-310e-4d8e-aed1-1f8ee560bbde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:28.800582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db250f0e-310e-4d8e-aed1-1f8ee560bbde None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:28.810522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0246ff2-d673-41e0-a17a-982128511d02 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:28.819445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:28.846575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455228ec-9c1e-4eb7-858d-2889735e9bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:28.847199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455228ec-9c1e-4eb7-858d-2889735e9bda None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:28.847477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455228ec-9c1e-4eb7-858d-2889735e9bda None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:28.847748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455228ec-9c1e-4eb7-858d-2889735e9bda None admin] PATH_INFO: `/v3/roles/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:28.857717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455228ec-9c1e-4eb7-858d-2889735e9bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-455228ec-9c1e-4eb7-858d-2889735e9bda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:28.862737 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:28.863780 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 249/511] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:28.864586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455228ec-9c1e-4eb7-858d-2889735e9bda None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:28.869900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:28.901215 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 263/512] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:28.902018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db250f0e-310e-4d8e-aed1-1f8ee560bbde None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:28.965076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455228ec-9c1e-4eb7-858d-2889735e9bda None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:28.999171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5e6e1-741b-4d65-bdb5-a926f7a1e2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:28.999819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5e6e1-741b-4d65-bdb5-a926f7a1e2dc None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:29.000031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5e6e1-741b-4d65-bdb5-a926f7a1e2dc None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:29.000295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5e6e1-741b-4d65-bdb5-a926f7a1e2dc None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:29.001008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5e6e1-741b-4d65-bdb5-a926f7a1e2dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:29.001340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5e6e1-741b-4d65-bdb5-a926f7a1e2dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:29.002765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5e6e1-741b-4d65-bdb5-a926f7a1e2dc None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:29.005264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db250f0e-310e-4d8e-aed1-1f8ee560bbde None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:29.019408 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 250/513] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Oct 8 20:35:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:29.020275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5e6e1-741b-4d65-bdb5-a926f7a1e2dc None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:29.038064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0d295-7ee1-4c60-a49b-878b28b5c3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:29.038659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0d295-7ee1-4c60-a49b-878b28b5c3b3 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:29.038934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0d295-7ee1-4c60-a49b-878b28b5c3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:29.039202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0d295-7ee1-4c60-a49b-878b28b5c3b3 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:29.040436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0d295-7ee1-4c60-a49b-878b28b5c3b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:29.041883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0d295-7ee1-4c60-a49b-878b28b5c3b3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:29.046821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:29.063895 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 264/514] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:35:28 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:35:29.064696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0d295-7ee1-4c60-a49b-878b28b5c3b3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:29.095950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:29.146404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5e6e1-741b-4d65-bdb5-a926f7a1e2dc None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:29.182719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0d295-7ee1-4c60-a49b-878b28b5c3b3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:29.184279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47615e2b-4d61-463f-a811-60b21621c72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:29.184907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615e2b-4d61-463f-a811-60b21621c72e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:29.185222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615e2b-4d61-463f-a811-60b21621c72e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:29.185493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615e2b-4d61-463f-a811-60b21621c72e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:29.196410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47615e2b-4d61-463f-a811-60b21621c72e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:29.197937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47615e2b-4d61-463f-a811-60b21621c72e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-47615e2b-4d61-463f-a811-60b21621c72e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:29.214363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:29.215577 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:29.216436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:29.216436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:29.216436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:29.216436 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 251/515] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:29.216436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47615e2b-4d61-463f-a811-60b21621c72e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:29.226301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8163e-a362-4a08-92e3-be4711f8554a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:29.227545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8163e-a362-4a08-92e3-be4711f8554a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:29.227835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8163e-a362-4a08-92e3-be4711f8554a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:29.228113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8163e-a362-4a08-92e3-be4711f8554a None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:29.228812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8163e-a362-4a08-92e3-be4711f8554a None admin] RBAC: Adding query filter params (name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:29.229118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8163e-a362-4a08-92e3-be4711f8554a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:29.230587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8163e-a362-4a08-92e3-be4711f8554a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:29.241035 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 265/516] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:29.241945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8163e-a362-4a08-92e3-be4711f8554a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:29.308895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:29.337467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47615e2b-4d61-463f-a811-60b21621c72e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:29.345284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:29.358766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8163e-a362-4a08-92e3-be4711f8554a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:29.372948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297825c5-a997-4b53-86da-38e296f791fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:29.373603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297825c5-a997-4b53-86da-38e296f791fb None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:29.373883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297825c5-a997-4b53-86da-38e296f791fb None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:29.374156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297825c5-a997-4b53-86da-38e296f791fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:29.384579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297825c5-a997-4b53-86da-38e296f791fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:29.386035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297825c5-a997-4b53-86da-38e296f791fb None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:29.394352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda82347-50bb-4316-b24d-f93a811418ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:29.394951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda82347-50bb-4316-b24d-f93a811418ab None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:29.395226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda82347-50bb-4316-b24d-f93a811418ab None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:29.395493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda82347-50bb-4316-b24d-f93a811418ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-297825c5-a997-4b53-86da-38e296f791fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:29.401749 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:29.402633 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:29.403489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:29.403489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:29.403489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:29.404362 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 252/517] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:29.405213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297825c5-a997-4b53-86da-38e296f791fb None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:29.471829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda82347-50bb-4316-b24d-f93a811418ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:29.473212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda82347-50bb-4316-b24d-f93a811418ab None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:29.512971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297825c5-a997-4b53-86da-38e296f791fb None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:29.544323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:29.551489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198957a-1d7a-42f0-b8fc-534b14afdde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:29.552049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198957a-1d7a-42f0-b8fc-534b14afdde1 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:29.552783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198957a-1d7a-42f0-b8fc-534b14afdde1 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:29.553581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198957a-1d7a-42f0-b8fc-534b14afdde1 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:29.554237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198957a-1d7a-42f0-b8fc-534b14afdde1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:29.554545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198957a-1d7a-42f0-b8fc-534b14afdde1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:29.556124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198957a-1d7a-42f0-b8fc-534b14afdde1 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:29.573018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:29.573691 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 253/518] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:29.574899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198957a-1d7a-42f0-b8fc-534b14afdde1 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:29.593312 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 266/519] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:29.593312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda82347-50bb-4316-b24d-f93a811418ab None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:29.685904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198957a-1d7a-42f0-b8fc-534b14afdde1 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:29.699976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda82347-50bb-4316-b24d-f93a811418ab None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:29.723436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe047056-5e5b-44fe-ba4b-3d3081d75d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:29.723983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe047056-5e5b-44fe-ba4b-3d3081d75d9b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:29.724263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe047056-5e5b-44fe-ba4b-3d3081d75d9b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:29.724538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe047056-5e5b-44fe-ba4b-3d3081d75d9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:29.734538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe047056-5e5b-44fe-ba4b-3d3081d75d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:29.735955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe047056-5e5b-44fe-ba4b-3d3081d75d9b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:29.737469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5930b-6a97-4282-a143-5e78408a06ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:29.738073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5930b-6a97-4282-a143-5e78408a06ef None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:29.738351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5930b-6a97-4282-a143-5e78408a06ef None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:29.738794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5930b-6a97-4282-a143-5e78408a06ef None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:29.739238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5930b-6a97-4282-a143-5e78408a06ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:29.739537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5930b-6a97-4282-a143-5e78408a06ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:29.740868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5930b-6a97-4282-a143-5e78408a06ef None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-fe047056-5e5b-44fe-ba4b-3d3081d75d9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:29.751167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:29.752067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:29.752935 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:29.752935 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:29.752935 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:29.756933 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 267/521] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:29.757046 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 254/521] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:29.757845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe047056-5e5b-44fe-ba4b-3d3081d75d9b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:29.757951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5930b-6a97-4282-a143-5e78408a06ef None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:29.805533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:29.814446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:29.868133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe047056-5e5b-44fe-ba4b-3d3081d75d9b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:29.871739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5930b-6a97-4282-a143-5e78408a06ef None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:29.905852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ad8e0-d529-4ba5-90fd-0f26816a8fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:29.906475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ad8e0-d529-4ba5-90fd-0f26816a8fce None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:29.906745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ad8e0-d529-4ba5-90fd-0f26816a8fce None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:29.907051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ad8e0-d529-4ba5-90fd-0f26816a8fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:29.909815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ad700-bd6c-4570-b57d-5ff5fdb33447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:29.910420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ad700-bd6c-4570-b57d-5ff5fdb33447 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:29.910697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ad700-bd6c-4570-b57d-5ff5fdb33447 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:29.910969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ad700-bd6c-4570-b57d-5ff5fdb33447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:29.917994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ad8e0-d529-4ba5-90fd-0f26816a8fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:29.918858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ad700-bd6c-4570-b57d-5ff5fdb33447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:29.919436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ad8e0-d529-4ba5-90fd-0f26816a8fce None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:29.920347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ad700-bd6c-4570-b57d-5ff5fdb33447 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-760ad700-bd6c-4570-b57d-5ff5fdb33447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:29.939033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:29.939923 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:29.940930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:29.940930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:29.940930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:29.940930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:29.940930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:29.940930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:29.940930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:29.940930 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:29.940930 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 268/522] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-3a9ad8e0-d529-4ba5-90fd-0f26816a8fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:29.941442 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:29.942299 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:29.943142 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:29.943142 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:29.943142 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:29.943311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ad700-bd6c-4570-b57d-5ff5fdb33447 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:29.943386 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 255/523] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:29.943386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ad8e0-d529-4ba5-90fd-0f26816a8fce None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:30.032001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:30.038691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ad8e0-d529-4ba5-90fd-0f26816a8fce None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:30.058949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ad700-bd6c-4570-b57d-5ff5fdb33447 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:30.068156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:30.075957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842ecf6-5ca3-4d74-8067-e020be740e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:30.076765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842ecf6-5ca3-4d74-8067-e020be740e76 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:30.077237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842ecf6-5ca3-4d74-8067-e020be740e76 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:30.077525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842ecf6-5ca3-4d74-8067-e020be740e76 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:30.078174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842ecf6-5ca3-4d74-8067-e020be740e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:30.078484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842ecf6-5ca3-4d74-8067-e020be740e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:30.079851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842ecf6-5ca3-4d74-8067-e020be740e76 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:30.091783 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 256/524] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:30.092564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842ecf6-5ca3-4d74-8067-e020be740e76 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:30.101002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4cfc2-1756-46f2-a3a0-85dcd841b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:30.103981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4cfc2-1756-46f2-a3a0-85dcd841b362 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:30.104554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4cfc2-1756-46f2-a3a0-85dcd841b362 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:30.105067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4cfc2-1756-46f2-a3a0-85dcd841b362 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:30.113130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4cfc2-1756-46f2-a3a0-85dcd841b362 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:30.114999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4cfc2-1756-46f2-a3a0-85dcd841b362 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-9fe4cfc2-1756-46f2-a3a0-85dcd841b362 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:30.127727 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:30.128618 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:30.129524 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:30.129524 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:30.129524 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:30.129524 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:30.129524 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:30.129524 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:30.129524 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:30.129524 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:30.129524 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 269/525] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:30.134032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4cfc2-1756-46f2-a3a0-85dcd841b362 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:30.199674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842ecf6-5ca3-4d74-8067-e020be740e76 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:30.236242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab4494-7854-46f4-a60c-0e87cad4b26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:30.237400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab4494-7854-46f4-a60c-0e87cad4b26f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:30.237853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab4494-7854-46f4-a60c-0e87cad4b26f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:30.238134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab4494-7854-46f4-a60c-0e87cad4b26f None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:30.238826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab4494-7854-46f4-a60c-0e87cad4b26f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:30.239134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab4494-7854-46f4-a60c-0e87cad4b26f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:30.240562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab4494-7854-46f4-a60c-0e87cad4b26f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:30.246628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4cfc2-1756-46f2-a3a0-85dcd841b362 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:30.258649 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 257/526] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:30.259313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab4494-7854-46f4-a60c-0e87cad4b26f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:30.275478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:30.288704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9dd53-a2ce-46f7-9a26-a0ff3b72f515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:30.289259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9dd53-a2ce-46f7-9a26-a0ff3b72f515 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:30.290124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9dd53-a2ce-46f7-9a26-a0ff3b72f515 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:30.290396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9dd53-a2ce-46f7-9a26-a0ff3b72f515 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:30.291040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9dd53-a2ce-46f7-9a26-a0ff3b72f515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:30.291347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9dd53-a2ce-46f7-9a26-a0ff3b72f515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:30.292700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9dd53-a2ce-46f7-9a26-a0ff3b72f515 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:30.304735 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 270/527] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:30.305791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9dd53-a2ce-46f7-9a26-a0ff3b72f515 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:30.334050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:30.370783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab4494-7854-46f4-a60c-0e87cad4b26f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:30.405728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a87385-f50b-4ea1-a865-4fd9033db857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:30.406362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a87385-f50b-4ea1-a865-4fd9033db857 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:30.406636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a87385-f50b-4ea1-a865-4fd9033db857 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:30.406906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a87385-f50b-4ea1-a865-4fd9033db857 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:30.414040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a87385-f50b-4ea1-a865-4fd9033db857 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:30.416035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a87385-f50b-4ea1-a865-4fd9033db857 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:30.416962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9dd53-a2ce-46f7-9a26-a0ff3b72f515 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-56a87385-f50b-4ea1-a865-4fd9033db857 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:30.428046 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:30.428970 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:30.429910 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:30.429910 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:30.429910 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:30.429910 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:30.429910 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:30.429910 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:30.429910 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:30.429910 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:30.429910 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 08 20:35:30.429910 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:30.429910 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 258/528] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:30.429910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a87385-f50b-4ea1-a865-4fd9033db857 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:30.460247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859a913-2526-4370-916a-39f567e8949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:30.460959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859a913-2526-4370-916a-39f567e8949e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:30.461246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859a913-2526-4370-916a-39f567e8949e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:30.462319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859a913-2526-4370-916a-39f567e8949e None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:30.463010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859a913-2526-4370-916a-39f567e8949e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:30.463314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859a913-2526-4370-916a-39f567e8949e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:30.464751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859a913-2526-4370-916a-39f567e8949e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:30.487749 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 271/529] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:30.487749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859a913-2526-4370-916a-39f567e8949e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:30.518142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:30.544157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a87385-f50b-4ea1-a865-4fd9033db857 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:30.581445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3cf93-038d-4ceb-ba9d-6ae6bc1e29e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:30.582149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3cf93-038d-4ceb-ba9d-6ae6bc1e29e7 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:30.582432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3cf93-038d-4ceb-ba9d-6ae6bc1e29e7 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:30.582813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3cf93-038d-4ceb-ba9d-6ae6bc1e29e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:30.583537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3cf93-038d-4ceb-ba9d-6ae6bc1e29e7 None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=187d6f51b1604327a4879e9e19b47963) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:30.583843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3cf93-038d-4ceb-ba9d-6ae6bc1e29e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:30.585289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3cf93-038d-4ceb-ba9d-6ae6bc1e29e7 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:30.587168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:30.592024 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 259/530] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:30 2022] GET /identity/v3/role_assignments?user.id=187d6f51b1604327a4879e9e19b47963&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:30.592797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3cf93-038d-4ceb-ba9d-6ae6bc1e29e7 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:30.611488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859a913-2526-4370-916a-39f567e8949e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:30.658378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e1301-8fb1-4ac6-92b7-79aea8c7f70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:30.659039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1301-8fb1-4ac6-92b7-79aea8c7f70c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:30.659317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1301-8fb1-4ac6-92b7-79aea8c7f70c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:30.659591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1301-8fb1-4ac6-92b7-79aea8c7f70c None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:30.671797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e1301-8fb1-4ac6-92b7-79aea8c7f70c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:30.674244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e1301-8fb1-4ac6-92b7-79aea8c7f70c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-ee5e1301-8fb1-4ac6-92b7-79aea8c7f70c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:30.690954 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:30.691906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:30.692763 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:30.692763 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:30.692763 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:30.692763 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:30.692763 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:30.692763 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:30.692763 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:30.692763 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:30.700906 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 272/531] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:30.700906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e1301-8fb1-4ac6-92b7-79aea8c7f70c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:30.735523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3cf93-038d-4ceb-ba9d-6ae6bc1e29e7 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:30.785623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f419a-53f6-447a-b563-b2e6cd650e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:30.787779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f419a-53f6-447a-b563-b2e6cd650e80 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:30.788997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f419a-53f6-447a-b563-b2e6cd650e80 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:30.790398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f419a-53f6-447a-b563-b2e6cd650e80 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:30.791393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f419a-53f6-447a-b563-b2e6cd650e80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:30.792184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f419a-53f6-447a-b563-b2e6cd650e80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:30.795051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f419a-53f6-447a-b563-b2e6cd650e80 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:30.809645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:30.813949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e1301-8fb1-4ac6-92b7-79aea8c7f70c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:30.821745 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 260/532] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Oct 8 20:35:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:30.822984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f419a-53f6-447a-b563-b2e6cd650e80 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:30.858403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a393-8bc9-4b3e-81d8-9fde0551054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:30.859334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a393-8bc9-4b3e-81d8-9fde0551054d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:30.859616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a393-8bc9-4b3e-81d8-9fde0551054d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:30.859889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a393-8bc9-4b3e-81d8-9fde0551054d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:30.860899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a393-8bc9-4b3e-81d8-9fde0551054d None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=7885df3b2ae34969852f76fbc94a7a10) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:30.861223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a393-8bc9-4b3e-81d8-9fde0551054d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:30.862930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a393-8bc9-4b3e-81d8-9fde0551054d None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:30.873447 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 273/533] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:30 2022] GET /identity/v3/role_assignments?user.id=7885df3b2ae34969852f76fbc94a7a10&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:30.874435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a393-8bc9-4b3e-81d8-9fde0551054d None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:30.912709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:30.979747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f419a-53f6-447a-b563-b2e6cd650e80 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:31.049134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65565b30-42c7-4101-b192-b77c36d527ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:31.050703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65565b30-42c7-4101-b192-b77c36d527ab None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:31.052158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65565b30-42c7-4101-b192-b77c36d527ab None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:31.052656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65565b30-42c7-4101-b192-b77c36d527ab None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:31.054979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65565b30-42c7-4101-b192-b77c36d527ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:31.055522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65565b30-42c7-4101-b192-b77c36d527ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:31.057841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65565b30-42c7-4101-b192-b77c36d527ab None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:31.085572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a393-8bc9-4b3e-81d8-9fde0551054d None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:31.088132 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 261/534] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:31.095830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65565b30-42c7-4101-b192-b77c36d527ab None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:31.147907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd0f42-9b9e-4fbc-baf6-0fb9aa776287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:31.148533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd0f42-9b9e-4fbc-baf6-0fb9aa776287 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:31.148864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd0f42-9b9e-4fbc-baf6-0fb9aa776287 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:31.149137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd0f42-9b9e-4fbc-baf6-0fb9aa776287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:31.176624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:31.259190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65565b30-42c7-4101-b192-b77c36d527ab None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:31.260845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd0f42-9b9e-4fbc-baf6-0fb9aa776287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:31.262528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd0f42-9b9e-4fbc-baf6-0fb9aa776287 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:31.293605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:31.333505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ea300-abaa-4938-bfaf-6afdddb198b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:31.334180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ea300-abaa-4938-bfaf-6afdddb198b3 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:31.334551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ea300-abaa-4938-bfaf-6afdddb198b3 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:31.335881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ea300-abaa-4938-bfaf-6afdddb198b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:31.336825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ea300-abaa-4938-bfaf-6afdddb198b3 None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=6d82a39388514ff79b2235ff2ede6ef2) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:31.337427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ea300-abaa-4938-bfaf-6afdddb198b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:31.340066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ea300-abaa-4938-bfaf-6afdddb198b3 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:31.351247 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 262/535] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:31 2022] GET /identity/v3/role_assignments?user.id=6d82a39388514ff79b2235ff2ede6ef2&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:31.419098 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 274/536] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:31.424711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ea300-abaa-4938-bfaf-6afdddb198b3 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:31.582439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ea300-abaa-4938-bfaf-6afdddb198b3 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:31.604579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:31.620621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d8c4d-215d-402e-a38a-82596aeff533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:31.621344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d8c4d-215d-402e-a38a-82596aeff533 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:31.621626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d8c4d-215d-402e-a38a-82596aeff533 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:31.621900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d8c4d-215d-402e-a38a-82596aeff533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:31.633982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d8c4d-215d-402e-a38a-82596aeff533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:31.635788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d8c4d-215d-402e-a38a-82596aeff533 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-2a2d8c4d-215d-402e-a38a-82596aeff533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:31.650946 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:31.651961 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:31.652804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:31.652804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:31.652804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:31.652804 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 263/537] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:31.658339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd0f42-9b9e-4fbc-baf6-0fb9aa776287 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:31.723370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c714ff-b66b-428e-9ede-8fa4eaa7fdd8 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:31.723731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c714ff-b66b-428e-9ede-8fa4eaa7fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:31.724064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c714ff-b66b-428e-9ede-8fa4eaa7fdd8 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:31.725692 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 264/538] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:31.730825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b88ff-b09f-4df4-8c17-da564683d5d2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:31.731111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b88ff-b09f-4df4-8c17-da564683d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:31.731382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b88ff-b09f-4df4-8c17-da564683d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:31.753575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d96b88ff-b09f-4df4-8c17-da564683d5d2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:31.754784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d96b88ff-b09f-4df4-8c17-da564683d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:31.830783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd0f42-9b9e-4fbc-baf6-0fb9aa776287 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:31.859871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:31.864649 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 265/539] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:31.916258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471a21c-eaf5-4214-832a-d038ba5abfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:31.916867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471a21c-eaf5-4214-832a-d038ba5abfa8 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:31.917141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471a21c-eaf5-4214-832a-d038ba5abfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:31.917431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471a21c-eaf5-4214-832a-d038ba5abfa8 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:31.918069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471a21c-eaf5-4214-832a-d038ba5abfa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:31.918376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471a21c-eaf5-4214-832a-d038ba5abfa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:31.919719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471a21c-eaf5-4214-832a-d038ba5abfa8 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:31.932524 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 275/540] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:31.938472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b88ff-b09f-4df4-8c17-da564683d5d2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:32.093282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b88ff-b09f-4df4-8c17-da564683d5d2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:32.094881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:32.153996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817d7ed-caf1-4676-a386-823fe7d7ddce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:32.154558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817d7ed-caf1-4676-a386-823fe7d7ddce None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:32.154837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817d7ed-caf1-4676-a386-823fe7d7ddce None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:32.155108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817d7ed-caf1-4676-a386-823fe7d7ddce None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:32.162404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817d7ed-caf1-4676-a386-823fe7d7ddce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:32.163835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817d7ed-caf1-4676-a386-823fe7d7ddce None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-b817d7ed-caf1-4676-a386-823fe7d7ddce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:32.181474 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:32.182362 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:32.183215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:32.183215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:32.183215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:32.183215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:32.183215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:32.183215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:32.183215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:32.183215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:32.183215 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 266/541] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:32.194282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471a21c-eaf5-4214-832a-d038ba5abfa8 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:32.260842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817d7ed-caf1-4676-a386-823fe7d7ddce None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:32.379549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817d7ed-caf1-4676-a386-823fe7d7ddce None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:32.410231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471a21c-eaf5-4214-832a-d038ba5abfa8 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:32.441074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2072d-065b-44ed-95bf-05685a408426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:32.441878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2072d-065b-44ed-95bf-05685a408426 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:32.442153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2072d-065b-44ed-95bf-05685a408426 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:32.442461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2072d-065b-44ed-95bf-05685a408426 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:32.455187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2072d-065b-44ed-95bf-05685a408426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-b7e2072d-065b-44ed-95bf-05685a408426 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:32.460410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:32.461863 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:32.462663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:32.462663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:32.462663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:32.462663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:32.462663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:32.462663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:32.462663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:32.462663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:32.462663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:32.462663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:32.462663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:32.462663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:32.462663 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 267/542] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:32.470018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2072d-065b-44ed-95bf-05685a408426 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:32.476529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e614058-54f8-4a2d-843b-2465adecf1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:32.476529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e614058-54f8-4a2d-843b-2465adecf1f9 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:32.476529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e614058-54f8-4a2d-843b-2465adecf1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:32.476529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e614058-54f8-4a2d-843b-2465adecf1f9 None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:32.477702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e614058-54f8-4a2d-843b-2465adecf1f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:32.477702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e614058-54f8-4a2d-843b-2465adecf1f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:32.483901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e614058-54f8-4a2d-843b-2465adecf1f9 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:32.508823 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 276/543] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:32.517062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e614058-54f8-4a2d-843b-2465adecf1f9 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:32.524180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:32.596758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:32.598095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2072d-065b-44ed-95bf-05685a408426 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:32.669159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bb6ab-c174-4ad4-8145-9018c559b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:32.670120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bb6ab-c174-4ad4-8145-9018c559b303 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:32.670414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bb6ab-c174-4ad4-8145-9018c559b303 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:32.670682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bb6ab-c174-4ad4-8145-9018c559b303 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:32.671349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bb6ab-c174-4ad4-8145-9018c559b303 None admin] RBAC: Adding query filter params (name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:32.671656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bb6ab-c174-4ad4-8145-9018c559b303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:32.673030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bb6ab-c174-4ad4-8145-9018c559b303 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:32.694137 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 268/544] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:32.699298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bb6ab-c174-4ad4-8145-9018c559b303 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:32.746596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e614058-54f8-4a2d-843b-2465adecf1f9 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:32.793380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25fdc5-9557-4f62-b377-3a904e98fd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:32.793988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25fdc5-9557-4f62-b377-3a904e98fd70 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:32.794269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25fdc5-9557-4f62-b377-3a904e98fd70 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:32.794541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25fdc5-9557-4f62-b377-3a904e98fd70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:32.795265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25fdc5-9557-4f62-b377-3a904e98fd70 None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=32932449fed540ac9073f056065899bd) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:32.795754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25fdc5-9557-4f62-b377-3a904e98fd70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:32.797222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25fdc5-9557-4f62-b377-3a904e98fd70 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:32.819916 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 277/545] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:32 2022] GET /identity/v3/role_assignments?user.id=32932449fed540ac9073f056065899bd&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:32.916293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:32.968431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bb6ab-c174-4ad4-8145-9018c559b303 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:33.039861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b358c64-78f3-4620-8087-ff1000a1254b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:33.040523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b358c64-78f3-4620-8087-ff1000a1254b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:33.040795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b358c64-78f3-4620-8087-ff1000a1254b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:33.041058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b358c64-78f3-4620-8087-ff1000a1254b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:33.064371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b358c64-78f3-4620-8087-ff1000a1254b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:33.065918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b358c64-78f3-4620-8087-ff1000a1254b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-7b358c64-78f3-4620-8087-ff1000a1254b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:33.115112 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:33.116508 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:33.117886 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:33.117886 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:33.117886 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:33.117886 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 269/546] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:33.125749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25fdc5-9557-4f62-b377-3a904e98fd70 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:33.264077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:33.270304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25fdc5-9557-4f62-b377-3a904e98fd70 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:33.317478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc8d87-f108-4764-a975-fceb405056a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:33.318177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8d87-f108-4764-a975-fceb405056a6 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:33.318466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8d87-f108-4764-a975-fceb405056a6 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:33.318731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8d87-f108-4764-a975-fceb405056a6 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:33.319790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc8d87-f108-4764-a975-fceb405056a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:33.320320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc8d87-f108-4764-a975-fceb405056a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:33.322269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc8d87-f108-4764-a975-fceb405056a6 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:33.341269 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 278/547] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:33.346988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b358c64-78f3-4620-8087-ff1000a1254b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:33.493213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b358c64-78f3-4620-8087-ff1000a1254b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:33.536709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670b88e-4d58-4044-902c-f039167f1559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:33.537283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670b88e-4d58-4044-902c-f039167f1559 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:33.537563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670b88e-4d58-4044-902c-f039167f1559 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:33.537831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670b88e-4d58-4044-902c-f039167f1559 None admin] PATH_INFO: `/v3/users/swift` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:33.543687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:33.549016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670b88e-4d58-4044-902c-f039167f1559 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:33.550625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670b88e-4d58-4044-902c-f039167f1559 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-d670b88e-4d58-4044-902c-f039167f1559 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:33.562124 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:33.563743 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:33.565062 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:33.565062 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:33.565062 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:33.565062 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:33.565062 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:33.565062 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:33.565062 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:33.565062 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:33.565062 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 08 20:35:33.565062 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:33.567970 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 270/548] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:35:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:33.569340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc8d87-f108-4764-a975-fceb405056a6 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:33.600870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211cea3-e014-47fd-828f-1df555d336b9 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:33.601172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211cea3-e014-47fd-828f-1df555d336b9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:33.601472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211cea3-e014-47fd-828f-1df555d336b9 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:33.602950 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 271/549] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:35:33.607803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a97d1d-9980-4537-afa8-9d23a4c4e70d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:33.608083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a97d1d-9980-4537-afa8-9d23a4c4e70d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:33.608419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a97d1d-9980-4537-afa8-9d23a4c4e70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:33.628908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-88a97d1d-9980-4537-afa8-9d23a4c4e70d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:33.630698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-88a97d1d-9980-4537-afa8-9d23a4c4e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:33.746086 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 272/550] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:33.765221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298d50d-2ffa-43e4-a6df-4ea9b84baf4a None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:33.765549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298d50d-2ffa-43e4-a6df-4ea9b84baf4a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:33.765826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298d50d-2ffa-43e4-a6df-4ea9b84baf4a None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:33.767529 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 273/551] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:35:33.770614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc8d87-f108-4764-a975-fceb405056a6 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:33.783035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a426f-3817-4b6d-bdab-c5b51d39414e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:33.783325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a426f-3817-4b6d-bdab-c5b51d39414e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:33.783586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a426f-3817-4b6d-bdab-c5b51d39414e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:33.815550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bb2a426f-3817-4b6d-bdab-c5b51d39414e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:33.816669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bb2a426f-3817-4b6d-bdab-c5b51d39414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:33.833101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621517b8-920f-476e-aebe-f40225ce8888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:33.833747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621517b8-920f-476e-aebe-f40225ce8888 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:33.834024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621517b8-920f-476e-aebe-f40225ce8888 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:33.834292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621517b8-920f-476e-aebe-f40225ce8888 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:33.835024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621517b8-920f-476e-aebe-f40225ce8888 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:33.835329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621517b8-920f-476e-aebe-f40225ce8888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:33.836798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621517b8-920f-476e-aebe-f40225ce8888 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:33.876550 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 279/552] 10.222.0.26 () {56 vars in 1135 bytes} [Sat Oct 8 20:35:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:33.886062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621517b8-920f-476e-aebe-f40225ce8888 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:33.914091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:33.930981 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 274/553] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:34.025619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621517b8-920f-476e-aebe-f40225ce8888 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:34.061038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbf673-1ede-4b4a-ba6d-a1a57682a23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:34.061687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbf673-1ede-4b4a-ba6d-a1a57682a23c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:34.061969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbf673-1ede-4b4a-ba6d-a1a57682a23c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:34.062245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbf673-1ede-4b4a-ba6d-a1a57682a23c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:34.139008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbf673-1ede-4b4a-ba6d-a1a57682a23c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:34.140403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbf673-1ede-4b4a-ba6d-a1a57682a23c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:34.155876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:34.243392 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 280/554] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:35:34.248630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a426f-3817-4b6d-bdab-c5b51d39414e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:34.256203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbf673-1ede-4b4a-ba6d-a1a57682a23c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:34.330779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:34.380733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a426f-3817-4b6d-bdab-c5b51d39414e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:34.421172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd61b5b-c1e6-488e-93cb-6005160e75f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:34.422033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61b5b-c1e6-488e-93cb-6005160e75f0 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:34.422317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61b5b-c1e6-488e-93cb-6005160e75f0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:34.422743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61b5b-c1e6-488e-93cb-6005160e75f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:34.430666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbf673-1ede-4b4a-ba6d-a1a57682a23c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:34.436374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd61b5b-c1e6-488e-93cb-6005160e75f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:34.437865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd61b5b-c1e6-488e-93cb-6005160e75f0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:34.447132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-ebd61b5b-c1e6-488e-93cb-6005160e75f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:34.457244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:34.458183 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:34.459049 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:34.459049 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:34.459049 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:34.461992 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 275/555] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:34.462997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd61b5b-c1e6-488e-93cb-6005160e75f0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:34.480475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a36f5-45e8-4cb9-938b-1e3b281a37cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:34.481124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a36f5-45e8-4cb9-938b-1e3b281a37cc None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:34.481438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a36f5-45e8-4cb9-938b-1e3b281a37cc None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:34.481708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a36f5-45e8-4cb9-938b-1e3b281a37cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:34.500938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a36f5-45e8-4cb9-938b-1e3b281a37cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-b30a36f5-45e8-4cb9-938b-1e3b281a37cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:34.508896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:34.509835 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:34.510663 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:34.510663 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:34.510663 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:34.510663 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:34.510663 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:34.510663 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:34.510663 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:34.510663 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:34.510663 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:34.510663 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:34.510663 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:34.510663 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:34.513273 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 281/556] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:34.514106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a36f5-45e8-4cb9-938b-1e3b281a37cc None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:34.597671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd61b5b-c1e6-488e-93cb-6005160e75f0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:34.608097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:34.634147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a36f5-45e8-4cb9-938b-1e3b281a37cc None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:34.636285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e34021-39a7-44fe-b340-68be5e6c7d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:34.636910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34021-39a7-44fe-b340-68be5e6c7d24 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:34.637212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34021-39a7-44fe-b340-68be5e6c7d24 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:34.637489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34021-39a7-44fe-b340-68be5e6c7d24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:34.648246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e34021-39a7-44fe-b340-68be5e6c7d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-85e34021-39a7-44fe-b340-68be5e6c7d24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:34.654533 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:34.656185 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 276/557] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:34.657072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e34021-39a7-44fe-b340-68be5e6c7d24 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:34.674810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2c4be-cf67-4d96-b1eb-b8930279484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:34.675351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2c4be-cf67-4d96-b1eb-b8930279484f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:34.675629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2c4be-cf67-4d96-b1eb-b8930279484f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:34.675899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2c4be-cf67-4d96-b1eb-b8930279484f None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:34.676546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2c4be-cf67-4d96-b1eb-b8930279484f None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:34.676830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2c4be-cf67-4d96-b1eb-b8930279484f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:34.678258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2c4be-cf67-4d96-b1eb-b8930279484f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:34.690611 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 282/558] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:34.691816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f78f7a-5999-4111-b41d-647b1f9618ff None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:34.692099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f78f7a-5999-4111-b41d-647b1f9618ff None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:34.692370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f78f7a-5999-4111-b41d-647b1f9618ff None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:34.693695 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 283/559] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:34.694291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f78f7a-5999-4111-b41d-647b1f9618ff None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:34.735682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:34.770373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e34021-39a7-44fe-b340-68be5e6c7d24 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:34.803309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abf6e2-068b-4a47-b207-95158a7d14f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:34.803964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abf6e2-068b-4a47-b207-95158a7d14f6 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:34.804246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abf6e2-068b-4a47-b207-95158a7d14f6 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:34.804521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abf6e2-068b-4a47-b207-95158a7d14f6 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:34.805224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abf6e2-068b-4a47-b207-95158a7d14f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:34.805529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abf6e2-068b-4a47-b207-95158a7d14f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:34.806886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abf6e2-068b-4a47-b207-95158a7d14f6 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:34.808565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f78f7a-5999-4111-b41d-647b1f9618ff None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:34.818853 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 277/560] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:34.818853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abf6e2-068b-4a47-b207-95158a7d14f6 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:34.851825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:34.854771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95323c3f-0d97-46e8-9e9d-2d1fb2c46b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:34.855381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95323c3f-0d97-46e8-9e9d-2d1fb2c46b87 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:34.855702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95323c3f-0d97-46e8-9e9d-2d1fb2c46b87 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:34.855976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95323c3f-0d97-46e8-9e9d-2d1fb2c46b87 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:34.856665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95323c3f-0d97-46e8-9e9d-2d1fb2c46b87 None admin] RBAC: Adding query filter params (name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:34.856961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95323c3f-0d97-46e8-9e9d-2d1fb2c46b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:34.858307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95323c3f-0d97-46e8-9e9d-2d1fb2c46b87 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:34.868242 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 284/561] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:34.869552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b924ef3-a82f-4c18-aad4-37c935bb6620 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:34.869834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b924ef3-a82f-4c18-aad4-37c935bb6620 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:34.870104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b924ef3-a82f-4c18-aad4-37c935bb6620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:34.888615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3b924ef3-a82f-4c18-aad4-37c935bb6620 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:34.889828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3b924ef3-a82f-4c18-aad4-37c935bb6620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:34.933085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abf6e2-068b-4a47-b207-95158a7d14f6 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:34.959779 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 285/562] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:34.960921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b924ef3-a82f-4c18-aad4-37c935bb6620 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:34.978349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c030a2f-6d1e-4646-9bc5-389f7647ebeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:34.979072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c030a2f-6d1e-4646-9bc5-389f7647ebeb None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:34.979410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c030a2f-6d1e-4646-9bc5-389f7647ebeb None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:34.979892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c030a2f-6d1e-4646-9bc5-389f7647ebeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:34.986822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c030a2f-6d1e-4646-9bc5-389f7647ebeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:34.988556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c030a2f-6d1e-4646-9bc5-389f7647ebeb None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:34.996268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-4c030a2f-6d1e-4646-9bc5-389f7647ebeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:35.001244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:35.002203 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:35.003202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:35.003202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:35.003202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:35.003202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:35.003202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:35.003202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:35.003202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:35.003202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:35.010692 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 278/563] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:35.011823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c030a2f-6d1e-4646-9bc5-389f7647ebeb None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:35.084217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b924ef3-a82f-4c18-aad4-37c935bb6620 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:35.133580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73e6b3-4ac4-4f23-babd-290abf7d8e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:35.134659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73e6b3-4ac4-4f23-babd-290abf7d8e67 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:35.135170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73e6b3-4ac4-4f23-babd-290abf7d8e67 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:35.135723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:35.136159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73e6b3-4ac4-4f23-babd-290abf7d8e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:35.146077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c030a2f-6d1e-4646-9bc5-389f7647ebeb None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:35.149682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73e6b3-4ac4-4f23-babd-290abf7d8e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:35.151353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73e6b3-4ac4-4f23-babd-290abf7d8e67 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-9a73e6b3-4ac4-4f23-babd-290abf7d8e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:35.167772 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:35.168722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:35.169647 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:35.169647 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:35.169647 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:35.171270 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 286/564] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:35.172216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73e6b3-4ac4-4f23-babd-290abf7d8e67 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:35.181831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cde6c-6fc8-4e76-a2a9-aeda1817a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:35.182595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cde6c-6fc8-4e76-a2a9-aeda1817a658 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:35.182998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cde6c-6fc8-4e76-a2a9-aeda1817a658 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:35.183678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cde6c-6fc8-4e76-a2a9-aeda1817a658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:35.195235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cde6c-6fc8-4e76-a2a9-aeda1817a658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:35.197413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cde6c-6fc8-4e76-a2a9-aeda1817a658 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-ed5cde6c-6fc8-4e76-a2a9-aeda1817a658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:35.221853 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:35.222810 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:35.223708 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:35.223708 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:35.223708 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:35.227666 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 279/565] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:35.228622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cde6c-6fc8-4e76-a2a9-aeda1817a658 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:35.261584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:35.289080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73e6b3-4ac4-4f23-babd-290abf7d8e67 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:35.329014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549f663-e388-4503-958e-7c0a1e30f721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:35.330022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549f663-e388-4503-958e-7c0a1e30f721 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:35.330402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549f663-e388-4503-958e-7c0a1e30f721 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:35.330782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549f663-e388-4503-958e-7c0a1e30f721 None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:35.331577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549f663-e388-4503-958e-7c0a1e30f721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:35.332249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549f663-e388-4503-958e-7c0a1e30f721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:35.334493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549f663-e388-4503-958e-7c0a1e30f721 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:35.348852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cde6c-6fc8-4e76-a2a9-aeda1817a658 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:35.355164 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 287/566] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:35.356065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549f663-e388-4503-958e-7c0a1e30f721 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:35.386340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ad104-aab2-48ff-8a0b-af4ca13a616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:35.386947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ad104-aab2-48ff-8a0b-af4ca13a616d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:35.387335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ad104-aab2-48ff-8a0b-af4ca13a616d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:35.387606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ad104-aab2-48ff-8a0b-af4ca13a616d None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:35.388242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ad104-aab2-48ff-8a0b-af4ca13a616d None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:35.388573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ad104-aab2-48ff-8a0b-af4ca13a616d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:35.389921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ad104-aab2-48ff-8a0b-af4ca13a616d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:35.406850 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 280/567] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:35.406850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ad104-aab2-48ff-8a0b-af4ca13a616d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:35.409515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:35.465079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549f663-e388-4503-958e-7c0a1e30f721 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:35.504275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae338f7-d0de-453c-89a8-e1b641cf7203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:35.504891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae338f7-d0de-453c-89a8-e1b641cf7203 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:35.505171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae338f7-d0de-453c-89a8-e1b641cf7203 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:35.505474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae338f7-d0de-453c-89a8-e1b641cf7203 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:35.506115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae338f7-d0de-453c-89a8-e1b641cf7203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:35.506418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae338f7-d0de-453c-89a8-e1b641cf7203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:35.507882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae338f7-d0de-453c-89a8-e1b641cf7203 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:35.515445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:35.521319 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 288/568] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:35.522938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae338f7-d0de-453c-89a8-e1b641cf7203 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:35.526315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ad104-aab2-48ff-8a0b-af4ca13a616d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:35.560543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558da8bb-3b0e-4f83-8359-97d2b2e6a7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:35.561161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558da8bb-3b0e-4f83-8359-97d2b2e6a7cd None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:35.561470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558da8bb-3b0e-4f83-8359-97d2b2e6a7cd None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:35.561742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558da8bb-3b0e-4f83-8359-97d2b2e6a7cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:35.572016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558da8bb-3b0e-4f83-8359-97d2b2e6a7cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-558da8bb-3b0e-4f83-8359-97d2b2e6a7cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:35.576726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:35.577831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 281/569] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:35.579020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558da8bb-3b0e-4f83-8359-97d2b2e6a7cd None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:35.627650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae338f7-d0de-453c-89a8-e1b641cf7203 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:35.639443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:35.660801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff0132-3012-459b-87a1-75f71fd8c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:35.661438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0132-3012-459b-87a1-75f71fd8c968 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:35.661715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0132-3012-459b-87a1-75f71fd8c968 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:35.661986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0132-3012-459b-87a1-75f71fd8c968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:35.662708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff0132-3012-459b-87a1-75f71fd8c968 None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=5bd5adc10b4344e1847c23c2c0599e59) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:35.663014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff0132-3012-459b-87a1-75f71fd8c968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:35.665022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff0132-3012-459b-87a1-75f71fd8c968 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:35.670206 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 289/570] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:35 2022] GET /identity/v3/role_assignments?user.id=5bd5adc10b4344e1847c23c2c0599e59&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:35.671355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3f822-0956-4012-af3e-efa2eb746af0 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:35.671635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3f822-0956-4012-af3e-efa2eb746af0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:35.671907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3f822-0956-4012-af3e-efa2eb746af0 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:35.673105 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 290/571] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:35.673838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3f822-0956-4012-af3e-efa2eb746af0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:35.694233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558da8bb-3b0e-4f83-8359-97d2b2e6a7cd None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:35.736706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1280d-e4d4-4f8f-95e4-6a80e6d04b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:35.737999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1280d-e4d4-4f8f-95e4-6a80e6d04b8b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:35.738562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1280d-e4d4-4f8f-95e4-6a80e6d04b8b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:35.738842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1280d-e4d4-4f8f-95e4-6a80e6d04b8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:35.746070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:35.748521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1280d-e4d4-4f8f-95e4-6a80e6d04b8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:35.750251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1280d-e4d4-4f8f-95e4-6a80e6d04b8b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-a0b1280d-e4d4-4f8f-95e4-6a80e6d04b8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:35.763746 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:35.764921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:35.766332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:35.766332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:35.766332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:35.766332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:35.766332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:35.766332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:35.766332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:35.766332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:35.766332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:35:35.766332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:35.766332 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 282/572] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Oct 8 20:35:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:35.770698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1280d-e4d4-4f8f-95e4-6a80e6d04b8b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:35.797044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3f822-0956-4012-af3e-efa2eb746af0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:35.838206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9a5ce-5ffc-4188-b16d-5b41994b535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:35.839038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9a5ce-5ffc-4188-b16d-5b41994b535d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:35.839607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9a5ce-5ffc-4188-b16d-5b41994b535d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:35.839984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9a5ce-5ffc-4188-b16d-5b41994b535d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:35.849044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9a5ce-5ffc-4188-b16d-5b41994b535d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:35.850650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9a5ce-5ffc-4188-b16d-5b41994b535d None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-a6d9a5ce-5ffc-4188-b16d-5b41994b535d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:35.864008 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:35.865216 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:35.866502 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:35.866502 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:35.866502 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:35.866502 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:35.866502 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:35.866502 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:35.866502 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:35.866502 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:35.866502 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:35:35.866502 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:35.866502 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 291/573] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:35.867106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04c794-b133-4f85-9cb1-eb73c6f959d1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:35.867364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04c794-b133-4f85-9cb1-eb73c6f959d1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:35.867579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04c794-b133-4f85-9cb1-eb73c6f959d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:35.890591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4d04c794-b133-4f85-9cb1-eb73c6f959d1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:35.891818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4d04c794-b133-4f85-9cb1-eb73c6f959d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:35.892256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1280d-e4d4-4f8f-95e4-6a80e6d04b8b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:35.916281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:35.930051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c08515-06a8-4ce0-a3d4-5b4261e8b3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:35.930782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08515-06a8-4ce0-a3d4-5b4261e8b3da None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:35.931166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08515-06a8-4ce0-a3d4-5b4261e8b3da None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:35.931532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08515-06a8-4ce0-a3d4-5b4261e8b3da None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:35.932293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c08515-06a8-4ce0-a3d4-5b4261e8b3da None admin] RBAC: Adding query filter params (name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:35.932693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c08515-06a8-4ce0-a3d4-5b4261e8b3da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:35.934203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c08515-06a8-4ce0-a3d4-5b4261e8b3da None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:35.947593 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 283/574] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:35.947593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c08515-06a8-4ce0-a3d4-5b4261e8b3da None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:35.972348 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 292/575] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:35.973116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04c794-b133-4f85-9cb1-eb73c6f959d1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:36.037402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:36.065262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c08515-06a8-4ce0-a3d4-5b4261e8b3da None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:36.089032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04c794-b133-4f85-9cb1-eb73c6f959d1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:36.106561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7e2bc-62de-4831-bacc-e7ee8e76ece1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:36.107501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7e2bc-62de-4831-bacc-e7ee8e76ece1 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:36.107984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7e2bc-62de-4831-bacc-e7ee8e76ece1 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:36.108552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7e2bc-62de-4831-bacc-e7ee8e76ece1 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:36.109552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7e2bc-62de-4831-bacc-e7ee8e76ece1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:36.110062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7e2bc-62de-4831-bacc-e7ee8e76ece1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:36.111694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7e2bc-62de-4831-bacc-e7ee8e76ece1 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:36.127302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41ffb5-13fe-420c-ac66-f026b28f3fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:36.127974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41ffb5-13fe-420c-ac66-f026b28f3fba None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:36.128255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41ffb5-13fe-420c-ac66-f026b28f3fba None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:36.128569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41ffb5-13fe-420c-ac66-f026b28f3fba None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:36.129382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41ffb5-13fe-420c-ac66-f026b28f3fba None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:36.129688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41ffb5-13fe-420c-ac66-f026b28f3fba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:36.131507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41ffb5-13fe-420c-ac66-f026b28f3fba None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:36.135245 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 284/576] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Oct 8 20:35:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:36.136427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7e2bc-62de-4831-bacc-e7ee8e76ece1 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:36.160025 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 293/577] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Oct 8 20:35:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:36.160934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41ffb5-13fe-420c-ac66-f026b28f3fba None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:36.182524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:36.241927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7e2bc-62de-4831-bacc-e7ee8e76ece1 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:36.267436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41ffb5-13fe-420c-ac66-f026b28f3fba None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:36.278316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d5d4-d6ed-4776-a628-8e032550fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:36.278545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:36.279344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d5d4-d6ed-4776-a628-8e032550fea7 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:36.279846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d5d4-d6ed-4776-a628-8e032550fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:36.280086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d5d4-d6ed-4776-a628-8e032550fea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:36.290710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8d5d4-d6ed-4776-a628-8e032550fea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:36.292206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8d5d4-d6ed-4776-a628-8e032550fea7 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:36.307005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b267c-9f9e-4e7e-82f1-c94b5a10dd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:36.307633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b267c-9f9e-4e7e-82f1-c94b5a10dd80 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:36.307908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b267c-9f9e-4e7e-82f1-c94b5a10dd80 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:36.308176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b267c-9f9e-4e7e-82f1-c94b5a10dd80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-aab8d5d4-d6ed-4776-a628-8e032550fea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:36.308958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:36.310041 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:36.311038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:36.311038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:36.311038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:36.313259 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 285/578] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:36.313259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d5d4-d6ed-4776-a628-8e032550fea7 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:36.318892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b267c-9f9e-4e7e-82f1-c94b5a10dd80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:36.320449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b267c-9f9e-4e7e-82f1-c94b5a10dd80 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-7b8b267c-9f9e-4e7e-82f1-c94b5a10dd80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:36.336041 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:36.337254 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:36.338496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:36.338496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:36.338496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:36.341494 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 294/579] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:36.342193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b267c-9f9e-4e7e-82f1-c94b5a10dd80 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:36.422598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:36.429786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d5d4-d6ed-4776-a628-8e032550fea7 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:36.451574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b267c-9f9e-4e7e-82f1-c94b5a10dd80 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:36.466012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d636753-322b-408f-8df1-a57f074ffd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:36.466727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d636753-322b-408f-8df1-a57f074ffd3d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:36.467081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d636753-322b-408f-8df1-a57f074ffd3d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:36.467432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d636753-322b-408f-8df1-a57f074ffd3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:36.478721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d636753-322b-408f-8df1-a57f074ffd3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:36.480302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d636753-322b-408f-8df1-a57f074ffd3d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-9d636753-322b-408f-8df1-a57f074ffd3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:36.496130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:36.497081 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:36.498088 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:36.498088 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:36.498088 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:36.498088 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 286/580] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:36.498088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d636753-322b-408f-8df1-a57f074ffd3d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:36.499316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c580e-4514-420a-ac46-07102cb9ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:36.500424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c580e-4514-420a-ac46-07102cb9ff28 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:36.500706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c580e-4514-420a-ac46-07102cb9ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:36.500977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c580e-4514-420a-ac46-07102cb9ff28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:36.514975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c580e-4514-420a-ac46-07102cb9ff28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-bb5c580e-4514-420a-ac46-07102cb9ff28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:36.520529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:36.521557 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 295/581] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:36.526260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c580e-4514-420a-ac46-07102cb9ff28 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:36.549469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:36.609908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d636753-322b-408f-8df1-a57f074ffd3d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:36.631597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c580e-4514-420a-ac46-07102cb9ff28 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:36.646436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59a3c1-4189-4bce-8b35-aa11d34fb56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:36.647046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59a3c1-4189-4bce-8b35-aa11d34fb56d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:36.647402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59a3c1-4189-4bce-8b35-aa11d34fb56d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:36.647666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59a3c1-4189-4bce-8b35-aa11d34fb56d None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:36.648306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59a3c1-4189-4bce-8b35-aa11d34fb56d None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:36.648608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59a3c1-4189-4bce-8b35-aa11d34fb56d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:36.650025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59a3c1-4189-4bce-8b35-aa11d34fb56d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:36.662146 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 287/582] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:36.662931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59a3c1-4189-4bce-8b35-aa11d34fb56d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:36.671277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d15b84-2578-45e8-a593-8609600491d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:36.672062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:36.672860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15b84-2578-45e8-a593-8609600491d2 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:36.673201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15b84-2578-45e8-a593-8609600491d2 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:36.673603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15b84-2578-45e8-a593-8609600491d2 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:36.674815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d15b84-2578-45e8-a593-8609600491d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:36.675227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d15b84-2578-45e8-a593-8609600491d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:36.677035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d15b84-2578-45e8-a593-8609600491d2 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:36.693678 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 296/583] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:36.693678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d15b84-2578-45e8-a593-8609600491d2 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:36.773721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59a3c1-4189-4bce-8b35-aa11d34fb56d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:36.778570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:36.799052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d15b84-2578-45e8-a593-8609600491d2 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:36.812367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72a337-4922-4dde-a54c-b11f7a48c6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:36.812908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72a337-4922-4dde-a54c-b11f7a48c6e1 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:36.813218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72a337-4922-4dde-a54c-b11f7a48c6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:36.813488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72a337-4922-4dde-a54c-b11f7a48c6e1 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:36.814125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72a337-4922-4dde-a54c-b11f7a48c6e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:36.814429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72a337-4922-4dde-a54c-b11f7a48c6e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:36.815922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72a337-4922-4dde-a54c-b11f7a48c6e1 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:36.831678 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 288/584] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:36.831678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72a337-4922-4dde-a54c-b11f7a48c6e1 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:36.842468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c38e6-2916-4063-a28c-43dcda26af91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:36.843441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c38e6-2916-4063-a28c-43dcda26af91 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:36.843907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c38e6-2916-4063-a28c-43dcda26af91 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:36.844373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c38e6-2916-4063-a28c-43dcda26af91 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:36.845605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c38e6-2916-4063-a28c-43dcda26af91 None admin] RBAC: Adding query filter params (name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:36.846512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c38e6-2916-4063-a28c-43dcda26af91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:36.848475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c38e6-2916-4063-a28c-43dcda26af91 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:36.858189 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 297/585] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:36.858928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c38e6-2916-4063-a28c-43dcda26af91 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:36.904464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:36.940878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72a337-4922-4dde-a54c-b11f7a48c6e1 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:36.966273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c38e6-2916-4063-a28c-43dcda26af91 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:36.974352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15733e-5cf4-4c13-b0b9-64f82e24a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:36.974985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15733e-5cf4-4c13-b0b9-64f82e24a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:36.975262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15733e-5cf4-4c13-b0b9-64f82e24a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:36.975534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15733e-5cf4-4c13-b0b9-64f82e24a2a8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:36.983733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15733e-5cf4-4c13-b0b9-64f82e24a2a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:36.985153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15733e-5cf4-4c13-b0b9-64f82e24a2a8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-4a15733e-5cf4-4c13-b0b9-64f82e24a2a8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:36.996878 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:36.998029 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:36.999237 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:36.999237 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:36.999237 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:36.999237 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:36.999237 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:36.999237 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:36.999237 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:36.999237 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:36.999237 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 08 20:35:36.999237 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:37.002790 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 289/586] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:37.003452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15733e-5cf4-4c13-b0b9-64f82e24a2a8 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:37.006093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690b841-1fa7-4286-8e6e-4845f3848d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:37.006811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690b841-1fa7-4286-8e6e-4845f3848d41 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:37.007167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690b841-1fa7-4286-8e6e-4845f3848d41 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:37.007504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690b841-1fa7-4286-8e6e-4845f3848d41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:37.014343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690b841-1fa7-4286-8e6e-4845f3848d41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:37.015834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690b841-1fa7-4286-8e6e-4845f3848d41 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-0690b841-1fa7-4286-8e6e-4845f3848d41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:37.027564 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:37.028555 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:37.029509 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:37.029509 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:37.029509 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:37.029509 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:37.029509 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:37.029509 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:37.029509 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:37.029509 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:37.029509 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 298/587] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:37.029509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690b841-1fa7-4286-8e6e-4845f3848d41 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:37.037388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:37.112632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15733e-5cf4-4c13-b0b9-64f82e24a2a8 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:37.139062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:37.145778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690b841-1fa7-4286-8e6e-4845f3848d41 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:37.150189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19564d-db00-4437-bebf-b2536ccdbe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:37.150814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19564d-db00-4437-bebf-b2536ccdbe96 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:37.151088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19564d-db00-4437-bebf-b2536ccdbe96 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:37.151357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19564d-db00-4437-bebf-b2536ccdbe96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:37.159068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19564d-db00-4437-bebf-b2536ccdbe96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:37.160508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19564d-db00-4437-bebf-b2536ccdbe96 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-6b19564d-db00-4437-bebf-b2536ccdbe96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:37.172765 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:37.173688 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:37.174657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:37.174657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:37.174657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:37.174657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:37.174657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:37.174657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:37.174657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:37.174657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:37.174657 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 290/588] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:37.174657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19564d-db00-4437-bebf-b2536ccdbe96 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:37.185894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca653210-0c49-4af9-a164-0e24b12573b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:37.186600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca653210-0c49-4af9-a164-0e24b12573b3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:37.187117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca653210-0c49-4af9-a164-0e24b12573b3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:37.187274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca653210-0c49-4af9-a164-0e24b12573b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:37.199621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca653210-0c49-4af9-a164-0e24b12573b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:37.201038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca653210-0c49-4af9-a164-0e24b12573b3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-ca653210-0c49-4af9-a164-0e24b12573b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:37.215966 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:37.217106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:37.218363 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:37.218363 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:37.218363 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:37.221789 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 299/589] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:37.222614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca653210-0c49-4af9-a164-0e24b12573b3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:37.280034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19564d-db00-4437-bebf-b2536ccdbe96 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:37.280886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:37.315540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed660a-e99c-401f-8cc2-b631a08cbd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:37.316329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed660a-e99c-401f-8cc2-b631a08cbd14 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:37.316701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed660a-e99c-401f-8cc2-b631a08cbd14 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:37.317038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed660a-e99c-401f-8cc2-b631a08cbd14 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:37.317792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed660a-e99c-401f-8cc2-b631a08cbd14 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:37.318095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed660a-e99c-401f-8cc2-b631a08cbd14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:37.319771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed660a-e99c-401f-8cc2-b631a08cbd14 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:37.329403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca653210-0c49-4af9-a164-0e24b12573b3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:37.345288 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 291/590] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Oct 8 20:35:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:37.345288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed660a-e99c-401f-8cc2-b631a08cbd14 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:37.364823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8388775-e2b6-4dcd-9b8e-720e6d71a8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:37.365480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8388775-e2b6-4dcd-9b8e-720e6d71a8be None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:37.365848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8388775-e2b6-4dcd-9b8e-720e6d71a8be None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:37.366190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8388775-e2b6-4dcd-9b8e-720e6d71a8be None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:37.366942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8388775-e2b6-4dcd-9b8e-720e6d71a8be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:37.367322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8388775-e2b6-4dcd-9b8e-720e6d71a8be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:37.368784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8388775-e2b6-4dcd-9b8e-720e6d71a8be None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:37.381052 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 300/591] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:37.386097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8388775-e2b6-4dcd-9b8e-720e6d71a8be None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:37.400586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:37.457363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed660a-e99c-401f-8cc2-b631a08cbd14 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:37.493987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48b795-ec38-40f7-b76f-b8aef45f4681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:37.495007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48b795-ec38-40f7-b76f-b8aef45f4681 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:37.495299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48b795-ec38-40f7-b76f-b8aef45f4681 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:37.495574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48b795-ec38-40f7-b76f-b8aef45f4681 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:37.496273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48b795-ec38-40f7-b76f-b8aef45f4681 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:37.496577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48b795-ec38-40f7-b76f-b8aef45f4681 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:37.498041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48b795-ec38-40f7-b76f-b8aef45f4681 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:37.507370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8388775-e2b6-4dcd-9b8e-720e6d71a8be None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:37.511059 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 292/592] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:37.511938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48b795-ec38-40f7-b76f-b8aef45f4681 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:37.531555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:37.550660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e7608-f13d-4834-ad75-10d9df8501b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:37.551265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e7608-f13d-4834-ad75-10d9df8501b3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:37.551543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e7608-f13d-4834-ad75-10d9df8501b3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:37.551805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e7608-f13d-4834-ad75-10d9df8501b3 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:37.552441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e7608-f13d-4834-ad75-10d9df8501b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:37.552743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e7608-f13d-4834-ad75-10d9df8501b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:37.554138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e7608-f13d-4834-ad75-10d9df8501b3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:37.571404 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 301/593] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:37.571404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e7608-f13d-4834-ad75-10d9df8501b3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:37.620956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48b795-ec38-40f7-b76f-b8aef45f4681 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:37.623998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:37.661367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719fda8-929f-4b1f-be9f-852e2f88448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:37.662172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719fda8-929f-4b1f-be9f-852e2f88448c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:37.662533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719fda8-929f-4b1f-be9f-852e2f88448c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:37.662924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719fda8-929f-4b1f-be9f-852e2f88448c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:37.674329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719fda8-929f-4b1f-be9f-852e2f88448c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:37.675882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719fda8-929f-4b1f-be9f-852e2f88448c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:37.690932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e7608-f13d-4834-ad75-10d9df8501b3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-7719fda8-929f-4b1f-be9f-852e2f88448c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:37.692164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:37.693313 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:37.694241 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:37.694241 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:37.694241 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:37.694241 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 293/594] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:37.694695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719fda8-929f-4b1f-be9f-852e2f88448c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:37.730033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b36d-7708-4cbb-af8d-b179e95fc84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:37.730754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b36d-7708-4cbb-af8d-b179e95fc84e None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:37.731038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b36d-7708-4cbb-af8d-b179e95fc84e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:37.731367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b36d-7708-4cbb-af8d-b179e95fc84e None admin] PATH_INFO: `/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/187d6f51b1604327a4879e9e19b47963/roles/f16d77e2bee5436dab21baa2ee33e03b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:37.749498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195b36d-7708-4cbb-af8d-b179e95fc84e None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba1e9ad05694bbe8723c14f5e2b08f7, user_id=187d6f51b1604327a4879e9e19b47963, role_id=f16d77e2bee5436dab21baa2ee33e03b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:37.751456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195b36d-7708-4cbb-af8d-b179e95fc84e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:37.765488 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 302/595] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:35:37 2022] PUT /identity/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/187d6f51b1604327a4879e9e19b47963/roles/f16d77e2bee5436dab21baa2ee33e03b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:35:37.766143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b36d-7708-4cbb-af8d-b179e95fc84e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:37.800217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:37.816478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719fda8-929f-4b1f-be9f-852e2f88448c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:37.861940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b89af-cf37-4e28-b559-ffdc47b41961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:37.862941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b89af-cf37-4e28-b559-ffdc47b41961 None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:37.863259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b89af-cf37-4e28-b559-ffdc47b41961 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:37.863610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b89af-cf37-4e28-b559-ffdc47b41961 None admin] PATH_INFO: `/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/7885df3b2ae34969852f76fbc94a7a10/roles/f16d77e2bee5436dab21baa2ee33e03b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:37.882790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b89af-cf37-4e28-b559-ffdc47b41961 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba1e9ad05694bbe8723c14f5e2b08f7, user_id=7885df3b2ae34969852f76fbc94a7a10, role_id=f16d77e2bee5436dab21baa2ee33e03b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:37.886365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b89af-cf37-4e28-b559-ffdc47b41961 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:37.896711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b36d-7708-4cbb-af8d-b179e95fc84e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:37.911883 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 294/596] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:35:37 2022] PUT /identity/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/7885df3b2ae34969852f76fbc94a7a10/roles/f16d77e2bee5436dab21baa2ee33e03b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:35:37.911883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b89af-cf37-4e28-b559-ffdc47b41961 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:37.933904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:37.973765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c30b-ca5a-4460-bea9-776ff01f7c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:37.974458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c30b-ca5a-4460-bea9-776ff01f7c27 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:37.974748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c30b-ca5a-4460-bea9-776ff01f7c27 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:37.975019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c30b-ca5a-4460-bea9-776ff01f7c27 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:37.989296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8c30b-ca5a-4460-bea9-776ff01f7c27 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:37.991065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8c30b-ca5a-4460-bea9-776ff01f7c27 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-53f8c30b-ca5a-4460-bea9-776ff01f7c27 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:38.019111 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:38.020143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:38.021100 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:38.021100 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:38.021100 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:38.021100 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:38.021100 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:38.021100 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:38.021100 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:38.021100 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:38.021100 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 08 20:35:38.021100 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:38.021100 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 303/597] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:38.028204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c30b-ca5a-4460-bea9-776ff01f7c27 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:38.109667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b89af-cf37-4e28-b559-ffdc47b41961 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:38.157930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f692057-2f7c-411c-9ba0-78cf908df2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:38.158132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:38.159285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692057-2f7c-411c-9ba0-78cf908df2ff None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:38.159745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692057-2f7c-411c-9ba0-78cf908df2ff None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:38.160262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692057-2f7c-411c-9ba0-78cf908df2ff None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:38.161223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f692057-2f7c-411c-9ba0-78cf908df2ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:38.161738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f692057-2f7c-411c-9ba0-78cf908df2ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:38.163375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f692057-2f7c-411c-9ba0-78cf908df2ff None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:38.178268 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 295/598] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:38.178506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c30b-ca5a-4460-bea9-776ff01f7c27 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:38.180675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78262953-3a1e-46f7-9d81-f5783296fb10 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:38.181120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78262953-3a1e-46f7-9d81-f5783296fb10 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:38.184499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78262953-3a1e-46f7-9d81-f5783296fb10 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:38.186297 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 296/599] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:38.189062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78262953-3a1e-46f7-9d81-f5783296fb10 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:38.221333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b17c5-1deb-4553-a51c-2e713c58d143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:38.222101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b17c5-1deb-4553-a51c-2e713c58d143 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:38.222486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b17c5-1deb-4553-a51c-2e713c58d143 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:38.222863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b17c5-1deb-4553-a51c-2e713c58d143 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:38.223781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b17c5-1deb-4553-a51c-2e713c58d143 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:38.224193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b17c5-1deb-4553-a51c-2e713c58d143 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:38.227297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b17c5-1deb-4553-a51c-2e713c58d143 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:38.246556 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 304/600] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Oct 8 20:35:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:38.247600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3011ba-6485-4037-882a-87bce31185a1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:38.247887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3011ba-6485-4037-882a-87bce31185a1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:38.248217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3011ba-6485-4037-882a-87bce31185a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:38.270946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-db3011ba-6485-4037-882a-87bce31185a1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:38.272156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-db3011ba-6485-4037-882a-87bce31185a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:38.272900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:38.313939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78262953-3a1e-46f7-9d81-f5783296fb10 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:38.351648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dad40-773a-4903-bccd-32e16a8c4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:38.353035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dad40-773a-4903-bccd-32e16a8c4ab7 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:38.353324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dad40-773a-4903-bccd-32e16a8c4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:38.353597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dad40-773a-4903-bccd-32e16a8c4ab7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:38.361318 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 305/601] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:38.362642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3011ba-6485-4037-882a-87bce31185a1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:38.366524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dad40-773a-4903-bccd-32e16a8c4ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:38.368250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dad40-773a-4903-bccd-32e16a8c4ab7 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-693dad40-773a-4903-bccd-32e16a8c4ab7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:38.395163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:38.396309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:38.397471 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:38.397471 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:38.397471 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:38.397471 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:38.397471 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:38.397471 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:38.397471 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:38.397471 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:38.405627 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 297/602] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:38.410959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dad40-773a-4903-bccd-32e16a8c4ab7 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:38.453675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:38.476689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3011ba-6485-4037-882a-87bce31185a1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:38.528964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c5452-391f-4bc3-a58e-ac84abd3e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:38.529654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c5452-391f-4bc3-a58e-ac84abd3e868 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:38.529654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c5452-391f-4bc3-a58e-ac84abd3e868 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:38.529978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c5452-391f-4bc3-a58e-ac84abd3e868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:38.541226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c5452-391f-4bc3-a58e-ac84abd3e868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:38.543699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c5452-391f-4bc3-a58e-ac84abd3e868 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-1b7c5452-391f-4bc3-a58e-ac84abd3e868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:38.565539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:38.566706 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:38.567789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:38.567789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:38.567789 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:38.573866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dad40-773a-4903-bccd-32e16a8c4ab7 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:38.576706 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 306/603] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:38.582919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c5452-391f-4bc3-a58e-ac84abd3e868 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:38.623314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:38.639004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d378f8-91dd-4ac5-8f85-b3420df62890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:38.640668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d378f8-91dd-4ac5-8f85-b3420df62890 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:38.641255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d378f8-91dd-4ac5-8f85-b3420df62890 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:38.642395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d378f8-91dd-4ac5-8f85-b3420df62890 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:38.643745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d378f8-91dd-4ac5-8f85-b3420df62890 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:38.644312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d378f8-91dd-4ac5-8f85-b3420df62890 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:38.647676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d378f8-91dd-4ac5-8f85-b3420df62890 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:38.670583 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 298/604] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:38.677539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d378f8-91dd-4ac5-8f85-b3420df62890 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:38.783759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c5452-391f-4bc3-a58e-ac84abd3e868 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:38.785817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d378f8-91dd-4ac5-8f85-b3420df62890 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:38.827169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:38.838674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658d30c-c6eb-41d3-987a-06d2da1d37c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:38.839589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658d30c-c6eb-41d3-987a-06d2da1d37c2 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:38.840067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658d30c-c6eb-41d3-987a-06d2da1d37c2 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:38.840560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658d30c-c6eb-41d3-987a-06d2da1d37c2 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:38.841705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658d30c-c6eb-41d3-987a-06d2da1d37c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:38.842210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658d30c-c6eb-41d3-987a-06d2da1d37c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:38.843870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658d30c-c6eb-41d3-987a-06d2da1d37c2 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:38.846855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec97cf-7d6a-4c72-9bef-48f530a5e6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:38.847536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec97cf-7d6a-4c72-9bef-48f530a5e6d9 None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:38.847818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec97cf-7d6a-4c72-9bef-48f530a5e6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:38.848094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec97cf-7d6a-4c72-9bef-48f530a5e6d9 None admin] PATH_INFO: `/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/6d82a39388514ff79b2235ff2ede6ef2/roles/f16d77e2bee5436dab21baa2ee33e03b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:38.864164 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 307/605] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:38.865325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658d30c-c6eb-41d3-987a-06d2da1d37c2 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:38.869066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec97cf-7d6a-4c72-9bef-48f530a5e6d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba1e9ad05694bbe8723c14f5e2b08f7, user_id=6d82a39388514ff79b2235ff2ede6ef2, role_id=f16d77e2bee5436dab21baa2ee33e03b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:38.870848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec97cf-7d6a-4c72-9bef-48f530a5e6d9 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:38.893446 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 299/606] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:35:38 2022] PUT /identity/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/6d82a39388514ff79b2235ff2ede6ef2/roles/f16d77e2bee5436dab21baa2ee33e03b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:35:38.894874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec97cf-7d6a-4c72-9bef-48f530a5e6d9 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:38.952649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:38.982069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658d30c-c6eb-41d3-987a-06d2da1d37c2 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:39.017922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ec703-57e0-410c-b69a-43ff0ad339e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:39.019364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ec703-57e0-410c-b69a-43ff0ad339e8 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:39.019949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ec703-57e0-410c-b69a-43ff0ad339e8 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:39.021179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ec703-57e0-410c-b69a-43ff0ad339e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:39.040963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ec703-57e0-410c-b69a-43ff0ad339e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-904ec703-57e0-410c-b69a-43ff0ad339e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:39.048723 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:39.049750 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:39.050591 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:39.050591 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:39.050591 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:39.050591 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:39.050591 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:39.050591 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:39.050591 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:39.050591 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:39.050591 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:39.050591 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:39.050591 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:39.050591 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:39.052353 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 308/607] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:39.058401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ec703-57e0-410c-b69a-43ff0ad339e8 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:39.094585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec97cf-7d6a-4c72-9bef-48f530a5e6d9 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:39.169600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:39.173027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857147e-b418-4e2a-b4c7-3d8c4e39c1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:39.173768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857147e-b418-4e2a-b4c7-3d8c4e39c1f5 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:39.174048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857147e-b418-4e2a-b4c7-3d8c4e39c1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:39.174318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857147e-b418-4e2a-b4c7-3d8c4e39c1f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:39.191284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857147e-b418-4e2a-b4c7-3d8c4e39c1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:39.192786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857147e-b418-4e2a-b4c7-3d8c4e39c1f5 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-6857147e-b418-4e2a-b4c7-3d8c4e39c1f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:39.208740 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:39.209783 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:39.211059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:39.211059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:39.211059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:39.211059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:39.211059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:39.211059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:39.211059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:39.211059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:39.211059 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 300/608] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:39.216826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857147e-b418-4e2a-b4c7-3d8c4e39c1f5 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:39.282605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ec703-57e0-410c-b69a-43ff0ad339e8 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:39.333292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458b5ad-2ea1-4c29-9b81-c711a7eefa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:39.334055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458b5ad-2ea1-4c29-9b81-c711a7eefa31 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:39.334236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458b5ad-2ea1-4c29-9b81-c711a7eefa31 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:39.334461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458b5ad-2ea1-4c29-9b81-c711a7eefa31 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:39.335130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458b5ad-2ea1-4c29-9b81-c711a7eefa31 None admin] RBAC: Adding query filter params (name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:39.335433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458b5ad-2ea1-4c29-9b81-c711a7eefa31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:39.336838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458b5ad-2ea1-4c29-9b81-c711a7eefa31 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:39.344881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:39.346206 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 309/609] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:39.351667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458b5ad-2ea1-4c29-9b81-c711a7eefa31 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:39.352460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857147e-b418-4e2a-b4c7-3d8c4e39c1f5 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:39.390705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476986e-3cd7-4670-bd74-6c8ededa32eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:39.391456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476986e-3cd7-4670-bd74-6c8ededa32eb None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:39.391834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476986e-3cd7-4670-bd74-6c8ededa32eb None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:39.392202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476986e-3cd7-4670-bd74-6c8ededa32eb None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:39.392984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476986e-3cd7-4670-bd74-6c8ededa32eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:39.393416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476986e-3cd7-4670-bd74-6c8ededa32eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:39.394933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476986e-3cd7-4670-bd74-6c8ededa32eb None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:39.407326 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 301/610] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:39.422735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476986e-3cd7-4670-bd74-6c8ededa32eb None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:39.542823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476986e-3cd7-4670-bd74-6c8ededa32eb None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:39.563132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458b5ad-2ea1-4c29-9b81-c711a7eefa31 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:39.575930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:39.580259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e3c86-8554-4166-a3df-7652b5f791ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:39.581179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e3c86-8554-4166-a3df-7652b5f791ad None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:39.582622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e3c86-8554-4166-a3df-7652b5f791ad None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:39.583571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e3c86-8554-4166-a3df-7652b5f791ad None admin] PATH_INFO: `/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/32932449fed540ac9073f056065899bd/roles/f16d77e2bee5436dab21baa2ee33e03b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:39.599887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e3c86-8554-4166-a3df-7652b5f791ad None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba1e9ad05694bbe8723c14f5e2b08f7, user_id=32932449fed540ac9073f056065899bd, role_id=f16d77e2bee5436dab21baa2ee33e03b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:39.601462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e3c86-8554-4166-a3df-7652b5f791ad None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:39.618224 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 302/611] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:35:39 2022] PUT /identity/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/32932449fed540ac9073f056065899bd/roles/f16d77e2bee5436dab21baa2ee33e03b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:35:39.644517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf80d2-443a-48fa-ace4-0d390cb8d552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:39.645216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf80d2-443a-48fa-ace4-0d390cb8d552 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:39.645491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf80d2-443a-48fa-ace4-0d390cb8d552 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:39.645764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf80d2-443a-48fa-ace4-0d390cb8d552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:39.658329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf80d2-443a-48fa-ace4-0d390cb8d552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:39.659821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf80d2-443a-48fa-ace4-0d390cb8d552 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-c7bf80d2-443a-48fa-ace4-0d390cb8d552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:39.677417 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:39.679653 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:39.681648 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:39.681648 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:39.681648 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:39.681648 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 310/612] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:39.687780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e3c86-8554-4166-a3df-7652b5f791ad None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:39.697408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:39.828967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e3c86-8554-4166-a3df-7652b5f791ad None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:39.870663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7845f0e-f154-4dd5-ae2f-b3d2f6f0f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:39.871283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7845f0e-f154-4dd5-ae2f-b3d2f6f0f839 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:39.871563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7845f0e-f154-4dd5-ae2f-b3d2f6f0f839 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:39.871834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7845f0e-f154-4dd5-ae2f-b3d2f6f0f839 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:39.872486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7845f0e-f154-4dd5-ae2f-b3d2f6f0f839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:39.872789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7845f0e-f154-4dd5-ae2f-b3d2f6f0f839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:39.874186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7845f0e-f154-4dd5-ae2f-b3d2f6f0f839 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:39.886737 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 303/613] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:39.892239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf80d2-443a-48fa-ace4-0d390cb8d552 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:40.007838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf80d2-443a-48fa-ace4-0d390cb8d552 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:40.048738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf5088-42f0-4956-996d-60ce096eb7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:40.049412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf5088-42f0-4956-996d-60ce096eb7de None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:40.049697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf5088-42f0-4956-996d-60ce096eb7de None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:40.049955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf5088-42f0-4956-996d-60ce096eb7de None admin] PATH_INFO: `/v3/users/swift` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:40.057864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf5088-42f0-4956-996d-60ce096eb7de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:40.059302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf5088-42f0-4956-996d-60ce096eb7de None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-aadf5088-42f0-4956-996d-60ce096eb7de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:40.071758 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:40.072795 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:40.073791 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:40.073791 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:40.073791 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:40.073791 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:40.073791 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:40.073791 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:40.073791 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:40.073791 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:40.073791 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 08 20:35:40.073791 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:40.073791 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 311/614] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:35:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:40.079138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7845f0e-f154-4dd5-ae2f-b3d2f6f0f839 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:40.197362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:40.232602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7845f0e-f154-4dd5-ae2f-b3d2f6f0f839 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:40.278507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61227144-e381-4b48-bc2f-ee5385d6999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:40.279124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61227144-e381-4b48-bc2f-ee5385d6999b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:40.279402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61227144-e381-4b48-bc2f-ee5385d6999b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:40.279674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61227144-e381-4b48-bc2f-ee5385d6999b None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:40.280400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61227144-e381-4b48-bc2f-ee5385d6999b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:40.280701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61227144-e381-4b48-bc2f-ee5385d6999b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:40.282142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61227144-e381-4b48-bc2f-ee5385d6999b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:40.306659 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 304/615] 10.222.0.26 () {56 vars in 1135 bytes} [Sat Oct 8 20:35:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:40.312378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf5088-42f0-4956-996d-60ce096eb7de None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:40.346298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:40.432561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf5088-42f0-4956-996d-60ce096eb7de None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:40.469153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995eb4f-d7f8-4c8c-a1c1-9b4c924ac1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:40.470222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995eb4f-d7f8-4c8c-a1c1-9b4c924ac1dd None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:40.470700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995eb4f-d7f8-4c8c-a1c1-9b4c924ac1dd None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:40.471170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995eb4f-d7f8-4c8c-a1c1-9b4c924ac1dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:40.483177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995eb4f-d7f8-4c8c-a1c1-9b4c924ac1dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:40.484730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995eb4f-d7f8-4c8c-a1c1-9b4c924ac1dd None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-1995eb4f-d7f8-4c8c-a1c1-9b4c924ac1dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:40.500484 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:40.501705 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:40.502815 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:40.502815 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:40.502815 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:40.504204 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 312/616] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:40.509684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61227144-e381-4b48-bc2f-ee5385d6999b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:40.567208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c68b71-17a7-4588-a349-708b36ff9b1c None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:40.567904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c68b71-17a7-4588-a349-708b36ff9b1c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:40.568419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c68b71-17a7-4588-a349-708b36ff9b1c None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:40.569798 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 313/617] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:35:40.580575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5f15f-5546-42f3-9c48-43a2d907b584 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:40.581005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5f15f-5546-42f3-9c48-43a2d907b584 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:40.581413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5f15f-5546-42f3-9c48-43a2d907b584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:40.610128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5ba5f15f-5546-42f3-9c48-43a2d907b584 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:40.612009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5ba5f15f-5546-42f3-9c48-43a2d907b584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:40.694643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61227144-e381-4b48-bc2f-ee5385d6999b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:40.716160 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 314/618] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:40.736023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:40.751209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee345b2-f5d8-4006-8077-c85bfacb3e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:40.752116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee345b2-f5d8-4006-8077-c85bfacb3e0e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:40.752554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee345b2-f5d8-4006-8077-c85bfacb3e0e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:40.752984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee345b2-f5d8-4006-8077-c85bfacb3e0e None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:40.753795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee345b2-f5d8-4006-8077-c85bfacb3e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:40.754255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee345b2-f5d8-4006-8077-c85bfacb3e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:40.755895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee345b2-f5d8-4006-8077-c85bfacb3e0e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:40.769957 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 305/619] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:40.777017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5f15f-5546-42f3-9c48-43a2d907b584 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:40.781947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:40.913580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5f15f-5546-42f3-9c48-43a2d907b584 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:40.963103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c71e7-9072-450e-b1e7-1095b90d8dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:40.963995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c71e7-9072-450e-b1e7-1095b90d8dc7 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:40.964419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c71e7-9072-450e-b1e7-1095b90d8dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:40.964837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c71e7-9072-450e-b1e7-1095b90d8dc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:40.975968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c71e7-9072-450e-b1e7-1095b90d8dc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:40.977666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c71e7-9072-450e-b1e7-1095b90d8dc7 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-ef5c71e7-9072-450e-b1e7-1095b90d8dc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:40.989952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:40.991055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:40.992206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:40.992206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:40.992206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:40.992206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:40.992206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:40.992206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:40.992206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:40.992206 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:40.994287 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 315/620] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:41.002266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee345b2-f5d8-4006-8077-c85bfacb3e0e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:41.058990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760543-f52b-43ee-88a8-1f1a6f6b4847 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:41.059276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760543-f52b-43ee-88a8-1f1a6f6b4847 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:41.059557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760543-f52b-43ee-88a8-1f1a6f6b4847 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:41.061140 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 316/621] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:41.066382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c4754-2c88-43cd-9c0d-b9ceab6aa0c9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:41.066662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c4754-2c88-43cd-9c0d-b9ceab6aa0c9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:41.066935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c4754-2c88-43cd-9c0d-b9ceab6aa0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:41.089636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5d5c4754-2c88-43cd-9c0d-b9ceab6aa0c9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:41.091346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5d5c4754-2c88-43cd-9c0d-b9ceab6aa0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:41.173600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:41.189744 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 317/622] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:41.204032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee345b2-f5d8-4006-8077-c85bfacb3e0e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:41.259460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c2392-2388-4c77-b923-476b7ee37e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:41.260065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c2392-2388-4c77-b923-476b7ee37e5f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:41.260356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c2392-2388-4c77-b923-476b7ee37e5f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:41.260609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c2392-2388-4c77-b923-476b7ee37e5f None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:41.261327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c2392-2388-4c77-b923-476b7ee37e5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:41.261636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c2392-2388-4c77-b923-476b7ee37e5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:41.263066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c2392-2388-4c77-b923-476b7ee37e5f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:41.267864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c4754-2c88-43cd-9c0d-b9ceab6aa0c9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:41.276457 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 306/623] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:41.285960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c2392-2388-4c77-b923-476b7ee37e5f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:41.375084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:41.444015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c2392-2388-4c77-b923-476b7ee37e5f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:41.468003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c4754-2c88-43cd-9c0d-b9ceab6aa0c9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:41.491910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd38b5b-8f77-41ba-a4c3-1ae22e782a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:41.492616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd38b5b-8f77-41ba-a4c3-1ae22e782a6d None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:41.492896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd38b5b-8f77-41ba-a4c3-1ae22e782a6d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:41.493172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd38b5b-8f77-41ba-a4c3-1ae22e782a6d None admin] PATH_INFO: `/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/5bd5adc10b4344e1847c23c2c0599e59/roles/f16d77e2bee5436dab21baa2ee33e03b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:41.508675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd38b5b-8f77-41ba-a4c3-1ae22e782a6d None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba1e9ad05694bbe8723c14f5e2b08f7, user_id=5bd5adc10b4344e1847c23c2c0599e59, role_id=f16d77e2bee5436dab21baa2ee33e03b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:41.510155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd38b5b-8f77-41ba-a4c3-1ae22e782a6d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:41.525772 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 307/624] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:35:41 2022] PUT /identity/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/5bd5adc10b4344e1847c23c2c0599e59/roles/f16d77e2bee5436dab21baa2ee33e03b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:35:41.546336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae9c72-565e-4858-b7bc-485460e39ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:41.547155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae9c72-565e-4858-b7bc-485460e39ca4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:41.547437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae9c72-565e-4858-b7bc-485460e39ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:41.547757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae9c72-565e-4858-b7bc-485460e39ca4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:41.548010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd38b5b-8f77-41ba-a4c3-1ae22e782a6d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:41.560448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae9c72-565e-4858-b7bc-485460e39ca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-6cae9c72-565e-4858-b7bc-485460e39ca4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:41.565616 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:41.567976 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:41.569106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:41.569106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:41.569106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:41.569106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:41.569106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:41.569106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:41.569106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:41.569106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:41.569106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:41.569106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:41.569106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:41.569106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:41.569106 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 318/625] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:41.576281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae9c72-565e-4858-b7bc-485460e39ca4 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:41.665046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:41.733143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae9c72-565e-4858-b7bc-485460e39ca4 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:41.755113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:41.770794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd38b5b-8f77-41ba-a4c3-1ae22e782a6d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:41.800780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a01d7-155b-46f7-b38e-5c39c94c2ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:41.803218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a01d7-155b-46f7-b38e-5c39c94c2ee3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:41.803853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a01d7-155b-46f7-b38e-5c39c94c2ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:41.805643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a01d7-155b-46f7-b38e-5c39c94c2ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:41.806317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a01d7-155b-46f7-b38e-5c39c94c2ee3 None admin] RBAC: Adding query filter params (name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:41.806848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a01d7-155b-46f7-b38e-5c39c94c2ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:41.812628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a01d7-155b-46f7-b38e-5c39c94c2ee3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:41.827904 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 319/626] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:41.833889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a01d7-155b-46f7-b38e-5c39c94c2ee3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:41.846065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde48ec5-9358-4871-9549-bcde681cc112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:41.846942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde48ec5-9358-4871-9549-bcde681cc112 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:41.847367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde48ec5-9358-4871-9549-bcde681cc112 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:41.847782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde48ec5-9358-4871-9549-bcde681cc112 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:41.864406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde48ec5-9358-4871-9549-bcde681cc112 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-bde48ec5-9358-4871-9549-bcde681cc112 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:41.869602 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:41.870539 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:41.871373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:41.871373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:41.871373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:41.871373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:41.871373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:41.871373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:41.871373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:41.871373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:41.871373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:41.871373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:41.871373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:41.871373 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:41.871373 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 308/627] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:41.876888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde48ec5-9358-4871-9549-bcde681cc112 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:42.016855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a01d7-155b-46f7-b38e-5c39c94c2ee3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:42.040435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:42.043248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde48ec5-9358-4871-9549-bcde681cc112 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:42.067854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d85c4-9df7-4792-925f-e894c987d240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:42.068486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d85c4-9df7-4792-925f-e894c987d240 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:42.068763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d85c4-9df7-4792-925f-e894c987d240 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:42.069035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d85c4-9df7-4792-925f-e894c987d240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:42.080748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d85c4-9df7-4792-925f-e894c987d240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:42.082221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d85c4-9df7-4792-925f-e894c987d240 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:42.088692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2361ad9-663b-4f2d-986d-557444a88eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:42.089884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2361ad9-663b-4f2d-986d-557444a88eb3 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:42.090187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2361ad9-663b-4f2d-986d-557444a88eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:42.090464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2361ad9-663b-4f2d-986d-557444a88eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:42.091132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2361ad9-663b-4f2d-986d-557444a88eb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:42.091435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2361ad9-663b-4f2d-986d-557444a88eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:42.092798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2361ad9-663b-4f2d-986d-557444a88eb3 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:42.101331 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 309/628] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-a01d85c4-9df7-4792-925f-e894c987d240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:42.102048 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:42.102975 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:42.103891 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:42.103891 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:42.103891 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:42.104069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa1061-f6e1-4b97-a96a-905c07bc6ee6 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:42.104069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa1061-f6e1-4b97-a96a-905c07bc6ee6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:42.104069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa1061-f6e1-4b97-a96a-905c07bc6ee6 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:42.104247 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 310/629] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:42.109842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc05bbc-203c-420c-8da6-45fea762fc12 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:42.110125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc05bbc-203c-420c-8da6-45fea762fc12 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:42.110463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc05bbc-203c-420c-8da6-45fea762fc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:42.110875 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 320/630] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:42.111875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d85c4-9df7-4792-925f-e894c987d240 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:42.146690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1bc05bbc-203c-420c-8da6-45fea762fc12 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:42.149357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1bc05bbc-203c-420c-8da6-45fea762fc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:42.165542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:42.243192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d85c4-9df7-4792-925f-e894c987d240 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:42.246524 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 311/631] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:42.247451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc05bbc-203c-420c-8da6-45fea762fc12 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:42.311003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb42b3c-bcdd-4e20-9e9c-cae4fbbc5aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:42.311558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb42b3c-bcdd-4e20-9e9c-cae4fbbc5aa7 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:42.311934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb42b3c-bcdd-4e20-9e9c-cae4fbbc5aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:42.312212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb42b3c-bcdd-4e20-9e9c-cae4fbbc5aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:42.329469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb42b3c-bcdd-4e20-9e9c-cae4fbbc5aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:42.331026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb42b3c-bcdd-4e20-9e9c-cae4fbbc5aa7 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:42.355135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc05bbc-203c-420c-8da6-45fea762fc12 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-bbb42b3c-bcdd-4e20-9e9c-cae4fbbc5aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:42.360511 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:42.361460 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:42.362654 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:42.362654 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:42.362654 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:42.362654 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 321/632] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:42.368535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb42b3c-bcdd-4e20-9e9c-cae4fbbc5aa7 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:42.392609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9e36c-4317-48a5-af18-a575917a30a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:42.393237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9e36c-4317-48a5-af18-a575917a30a0 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:42.393520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9e36c-4317-48a5-af18-a575917a30a0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:42.393786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9e36c-4317-48a5-af18-a575917a30a0 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:42.394473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9e36c-4317-48a5-af18-a575917a30a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:42.394773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9e36c-4317-48a5-af18-a575917a30a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:42.396418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9e36c-4317-48a5-af18-a575917a30a0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:42.399683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:42.409322 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 312/633] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:42.415037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9e36c-4317-48a5-af18-a575917a30a0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:42.431612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:42.556449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb42b3c-bcdd-4e20-9e9c-cae4fbbc5aa7 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:42.595091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65c9a9-5210-49f7-8697-6ada74cf90c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:42.595719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65c9a9-5210-49f7-8697-6ada74cf90c7 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:42.595899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65c9a9-5210-49f7-8697-6ada74cf90c7 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:42.596142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65c9a9-5210-49f7-8697-6ada74cf90c7 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:42.596929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65c9a9-5210-49f7-8697-6ada74cf90c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:42.597375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65c9a9-5210-49f7-8697-6ada74cf90c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:42.598984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65c9a9-5210-49f7-8697-6ada74cf90c7 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:42.613081 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 322/634] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:42.618856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65c9a9-5210-49f7-8697-6ada74cf90c7 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:42.636192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9e36c-4317-48a5-af18-a575917a30a0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:42.672495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c648f4c-d6d7-4359-98ea-55611fef709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:42.673112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c648f4c-d6d7-4359-98ea-55611fef709b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:42.673418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c648f4c-d6d7-4359-98ea-55611fef709b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:42.673807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c648f4c-d6d7-4359-98ea-55611fef709b None admin] PATH_INFO: `/v3/users/nova` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:42.681711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c648f4c-d6d7-4359-98ea-55611fef709b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:42.683128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c648f4c-d6d7-4359-98ea-55611fef709b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-7c648f4c-d6d7-4359-98ea-55611fef709b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:42.694138 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:42.695067 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:42.696047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:42.696047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:42.696047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:42.696047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:42.696047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:42.696047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:42.696047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:42.696047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:42.696047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:35:42.696047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:42.696047 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 313/635] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Oct 8 20:35:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:42.696635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aadcd6-9d58-41c1-a5e2-1201cd060007 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:42.697045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aadcd6-9d58-41c1-a5e2-1201cd060007 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:42.697045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aadcd6-9d58-41c1-a5e2-1201cd060007 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:42.700294 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 314/636] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:42.700294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aadcd6-9d58-41c1-a5e2-1201cd060007 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:42.712694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:42.737609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65c9a9-5210-49f7-8697-6ada74cf90c7 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:42.772360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:42.773549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2abe9-32d7-4a54-b9ca-686623bb3029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:42.774206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2abe9-32d7-4a54-b9ca-686623bb3029 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:42.774485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2abe9-32d7-4a54-b9ca-686623bb3029 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:42.774758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2abe9-32d7-4a54-b9ca-686623bb3029 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:42.781903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2abe9-32d7-4a54-b9ca-686623bb3029 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:42.783327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2abe9-32d7-4a54-b9ca-686623bb3029 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-44b2abe9-32d7-4a54-b9ca-686623bb3029 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:42.795569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:42.796554 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:42.797513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:42.797513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:42.797513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:42.797513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:42.797513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:42.797513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:42.797513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:42.797513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:42.797513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:35:42.797513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:42.801387 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 323/637] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:42.802214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2abe9-32d7-4a54-b9ca-686623bb3029 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:42.812287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aadcd6-9d58-41c1-a5e2-1201cd060007 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:42.855101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b9fbe-363d-4626-81e8-728c1babc7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:42.855642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9fbe-363d-4626-81e8-728c1babc7ee None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:42.855919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9fbe-363d-4626-81e8-728c1babc7ee None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:42.856189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9fbe-363d-4626-81e8-728c1babc7ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:42.867345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b9fbe-363d-4626-81e8-728c1babc7ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-d47b9fbe-363d-4626-81e8-728c1babc7ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:42.872059 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:42.873065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:42.873950 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:42.873950 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:42.873950 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:42.873950 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:42.873950 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:42.873950 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:42.873950 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:42.873950 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:42.873950 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:42.873950 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:42.873950 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:42.873950 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:42.873950 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 315/638] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:42.878044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ff45-2970-4cd3-b92f-1b8a03f6cda1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:42.878326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ff45-2970-4cd3-b92f-1b8a03f6cda1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:42.878601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ff45-2970-4cd3-b92f-1b8a03f6cda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:42.898387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8e71ff45-2970-4cd3-b92f-1b8a03f6cda1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:42.900521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8e71ff45-2970-4cd3-b92f-1b8a03f6cda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:42.916281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2abe9-32d7-4a54-b9ca-686623bb3029 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:42.952374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739547b-3e7f-4497-8ac2-fd76627f6084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:42.952985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739547b-3e7f-4497-8ac2-fd76627f6084 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:42.953277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739547b-3e7f-4497-8ac2-fd76627f6084 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:42.953557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739547b-3e7f-4497-8ac2-fd76627f6084 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:42.954344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739547b-3e7f-4497-8ac2-fd76627f6084 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:42.954653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739547b-3e7f-4497-8ac2-fd76627f6084 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:42.956298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739547b-3e7f-4497-8ac2-fd76627f6084 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:42.966378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:42.973539 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 316/639] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:42.974342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71ff45-2970-4cd3-b92f-1b8a03f6cda1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:42.986287 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 324/640] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Oct 8 20:35:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:42.986287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739547b-3e7f-4497-8ac2-fd76627f6084 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:43.054176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:43.093850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739547b-3e7f-4497-8ac2-fd76627f6084 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:43.116669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71ff45-2970-4cd3-b92f-1b8a03f6cda1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:43.134719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11843-763f-4990-a4d8-2173dff80270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:43.135334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11843-763f-4990-a4d8-2173dff80270 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:43.135732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11843-763f-4990-a4d8-2173dff80270 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:43.136029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11843-763f-4990-a4d8-2173dff80270 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:43.136899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a11843-763f-4990-a4d8-2173dff80270 None admin] RBAC: Adding query filter params (name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:43.137243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a11843-763f-4990-a4d8-2173dff80270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:43.138688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a11843-763f-4990-a4d8-2173dff80270 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:43.154526 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 325/641] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:43.154526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11843-763f-4990-a4d8-2173dff80270 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:43.170551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873b759-ce06-4ecc-8221-2e1a5a946fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:43.171854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873b759-ce06-4ecc-8221-2e1a5a946fe1 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:43.172286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873b759-ce06-4ecc-8221-2e1a5a946fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:43.172945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873b759-ce06-4ecc-8221-2e1a5a946fe1 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:43.174076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873b759-ce06-4ecc-8221-2e1a5a946fe1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:43.174533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873b759-ce06-4ecc-8221-2e1a5a946fe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:43.176516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873b759-ce06-4ecc-8221-2e1a5a946fe1 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:43.205743 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 317/642] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Oct 8 20:35:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:43.207159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873b759-ce06-4ecc-8221-2e1a5a946fe1 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:43.227044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:43.281136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11843-763f-4990-a4d8-2173dff80270 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:43.317624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873b759-ce06-4ecc-8221-2e1a5a946fe1 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:43.321192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a198fe-513d-4767-969d-035851bc0d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:43.321825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a198fe-513d-4767-969d-035851bc0d1c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:43.322115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a198fe-513d-4767-969d-035851bc0d1c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:43.322369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a198fe-513d-4767-969d-035851bc0d1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:43.332353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:43.356281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c49e43-8a1e-41e5-bef9-021f6e52aa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:43.357111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c49e43-8a1e-41e5-bef9-021f6e52aa63 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:43.357691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c49e43-8a1e-41e5-bef9-021f6e52aa63 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:43.358151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c49e43-8a1e-41e5-bef9-021f6e52aa63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:43.369798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c49e43-8a1e-41e5-bef9-021f6e52aa63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:43.371407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c49e43-8a1e-41e5-bef9-021f6e52aa63 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-c5c49e43-8a1e-41e5-bef9-021f6e52aa63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:43.389873 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:43.390864 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:43.391787 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:43.391787 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:43.391787 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:43.391787 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 318/643] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:43.391787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c49e43-8a1e-41e5-bef9-021f6e52aa63 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:43.396430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a198fe-513d-4767-969d-035851bc0d1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:43.397898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a198fe-513d-4767-969d-035851bc0d1c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:43.458105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:43.498655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c49e43-8a1e-41e5-bef9-021f6e52aa63 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:43.510625 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 326/644] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:43.510625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a198fe-513d-4767-969d-035851bc0d1c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:43.540608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a65a37-04a6-456a-add4-87c4dc93b913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:43.541233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a65a37-04a6-456a-add4-87c4dc93b913 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:43.541514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a65a37-04a6-456a-add4-87c4dc93b913 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:43.541787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a65a37-04a6-456a-add4-87c4dc93b913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:43.576632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:43.612655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a65a37-04a6-456a-add4-87c4dc93b913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:43.614222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a65a37-04a6-456a-add4-87c4dc93b913 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:43.614957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a198fe-513d-4767-969d-035851bc0d1c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:43.653931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019bafd-37cd-432a-81fa-c543c73b8c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:43.654670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019bafd-37cd-432a-81fa-c543c73b8c3b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:43.654947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019bafd-37cd-432a-81fa-c543c73b8c3b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:43.655218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019bafd-37cd-432a-81fa-c543c73b8c3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:43.665659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019bafd-37cd-432a-81fa-c543c73b8c3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-4019bafd-37cd-432a-81fa-c543c73b8c3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:43.670504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:43.671445 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 327/645] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:43.672419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019bafd-37cd-432a-81fa-c543c73b8c3b None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:43.696722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:43.726460 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 319/646] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:43.726460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a65a37-04a6-456a-add4-87c4dc93b913 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:43.791277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019bafd-37cd-432a-81fa-c543c73b8c3b None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:43.804204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:43.827768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b790307-895f-432b-a62e-c48d3eff5c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:43.828461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790307-895f-432b-a62e-c48d3eff5c21 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:43.828806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790307-895f-432b-a62e-c48d3eff5c21 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:43.829142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790307-895f-432b-a62e-c48d3eff5c21 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:43.829873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b790307-895f-432b-a62e-c48d3eff5c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:43.830254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b790307-895f-432b-a62e-c48d3eff5c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:43.831654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b790307-895f-432b-a62e-c48d3eff5c21 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:43.843365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a65a37-04a6-456a-add4-87c4dc93b913 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:43.845652 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 328/647] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:43.846848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b790307-895f-432b-a62e-c48d3eff5c21 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:43.882374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8240440-1830-4b42-9baa-b291102426e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:43.883012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240440-1830-4b42-9baa-b291102426e9 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:43.883872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240440-1830-4b42-9baa-b291102426e9 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:43.884146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240440-1830-4b42-9baa-b291102426e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:43.896083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8240440-1830-4b42-9baa-b291102426e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:43.897554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8240440-1830-4b42-9baa-b291102426e9 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-b8240440-1830-4b42-9baa-b291102426e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:43.913807 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:43.914782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:43.920565 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:43.920565 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:43.920565 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:43.920565 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 320/648] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:43.920565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8240440-1830-4b42-9baa-b291102426e9 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:43.937301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:43.963582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b790307-895f-432b-a62e-c48d3eff5c21 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:44.002102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c38eee-338f-43bc-88cb-5d2a865cf5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:44.002720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c38eee-338f-43bc-88cb-5d2a865cf5a4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.002993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c38eee-338f-43bc-88cb-5d2a865cf5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.003317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c38eee-338f-43bc-88cb-5d2a865cf5a4 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.003987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c38eee-338f-43bc-88cb-5d2a865cf5a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:44.004284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c38eee-338f-43bc-88cb-5d2a865cf5a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:44.005730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c38eee-338f-43bc-88cb-5d2a865cf5a4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:44.019548 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 329/649] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:44.019548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c38eee-338f-43bc-88cb-5d2a865cf5a4 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:44.135761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c38eee-338f-43bc-88cb-5d2a865cf5a4 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:44.146349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8240440-1830-4b42-9baa-b291102426e9 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:44.166062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:44.174260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32fca9-73b5-4519-969a-37fc0afcbf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:44.174896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32fca9-73b5-4519-969a-37fc0afcbf2a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.175175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32fca9-73b5-4519-969a-37fc0afcbf2a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.175449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32fca9-73b5-4519-969a-37fc0afcbf2a None admin] PATH_INFO: `/v3/users/glance` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.184485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32fca9-73b5-4519-969a-37fc0afcbf2a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:44.185517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786eb185-63e6-4d51-bc33-d407bb8ae924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:44.185949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32fca9-73b5-4519-969a-37fc0afcbf2a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:44.186145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786eb185-63e6-4d51-bc33-d407bb8ae924 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.186420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786eb185-63e6-4d51-bc33-d407bb8ae924 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.186686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786eb185-63e6-4d51-bc33-d407bb8ae924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.188622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:44.197238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786eb185-63e6-4d51-bc33-d407bb8ae924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-ec32fca9-73b5-4519-969a-37fc0afcbf2a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:44.198055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:44.199128 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:44.200085 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:44.200085 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:44.200085 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:44.200085 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:44.200085 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:44.200085 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:44.200085 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:44.200085 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:44.200085 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 08 20:35:44.200085 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:44.200632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786eb185-63e6-4d51-bc33-d407bb8ae924 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:44.200711 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 330/650] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:44.200711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32fca9-73b5-4519-969a-37fc0afcbf2a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-786eb185-63e6-4d51-bc33-d407bb8ae924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:44.218538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:44.219705 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:44.220800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:44.220800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:44.220800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:44.220800 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 321/651] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:44.220800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786eb185-63e6-4d51-bc33-d407bb8ae924 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:44.303827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32fca9-73b5-4519-969a-37fc0afcbf2a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:44.317554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786eb185-63e6-4d51-bc33-d407bb8ae924 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:44.337873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc0e00-f094-4a85-b78a-18318bb33122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:44.338470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc0e00-f094-4a85-b78a-18318bb33122 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.338749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc0e00-f094-4a85-b78a-18318bb33122 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.339017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc0e00-f094-4a85-b78a-18318bb33122 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.339645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc0e00-f094-4a85-b78a-18318bb33122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:44.339942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc0e00-f094-4a85-b78a-18318bb33122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:44.341318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc0e00-f094-4a85-b78a-18318bb33122 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:44.352573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86c8a1-50e7-4ec8-ae73-936ab6362ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:44.353205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86c8a1-50e7-4ec8-ae73-936ab6362ac7 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.353505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86c8a1-50e7-4ec8-ae73-936ab6362ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.353624 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 331/652] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:44.353797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86c8a1-50e7-4ec8-ae73-936ab6362ac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.354683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee7582-dcef-492c-b149-d78b5bf61c58 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.354964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee7582-dcef-492c-b149-d78b5bf61c58 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.355291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee7582-dcef-492c-b149-d78b5bf61c58 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.356624 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 332/653] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:44.357148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee7582-dcef-492c-b149-d78b5bf61c58 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:44.367072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86c8a1-50e7-4ec8-ae73-936ab6362ac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:44.368556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86c8a1-50e7-4ec8-ae73-936ab6362ac7 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-fe86c8a1-50e7-4ec8-ae73-936ab6362ac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:44.383255 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:44.384265 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:44.385133 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:44.385133 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:44.385133 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:44.385535 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 322/654] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:44.386108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86c8a1-50e7-4ec8-ae73-936ab6362ac7 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:44.409504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:44.421446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:44.463335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee7582-dcef-492c-b149-d78b5bf61c58 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:44.483559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86c8a1-50e7-4ec8-ae73-936ab6362ac7 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:44.500559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d005cb-4a77-4bf7-92d5-29af5fc48c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:44.501165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d005cb-4a77-4bf7-92d5-29af5fc48c5a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.501475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d005cb-4a77-4bf7-92d5-29af5fc48c5a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.501754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d005cb-4a77-4bf7-92d5-29af5fc48c5a None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.502478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d005cb-4a77-4bf7-92d5-29af5fc48c5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:44.502787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d005cb-4a77-4bf7-92d5-29af5fc48c5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:44.504202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d005cb-4a77-4bf7-92d5-29af5fc48c5a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:44.518303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ff312-336c-4995-b688-d81bc95adb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:44.518901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ff312-336c-4995-b688-d81bc95adb77 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.519206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ff312-336c-4995-b688-d81bc95adb77 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.519480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ff312-336c-4995-b688-d81bc95adb77 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.520112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ff312-336c-4995-b688-d81bc95adb77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:44.520412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ff312-336c-4995-b688-d81bc95adb77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:44.521775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ff312-336c-4995-b688-d81bc95adb77 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:44.522052 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 333/655] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Oct 8 20:35:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:44.522854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d005cb-4a77-4bf7-92d5-29af5fc48c5a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:44.537661 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 323/656] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:44.538895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55554be-ee58-444f-a808-82d06f9fd4a8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.539177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55554be-ee58-444f-a808-82d06f9fd4a8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.539484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55554be-ee58-444f-a808-82d06f9fd4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.557428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c55554be-ee58-444f-a808-82d06f9fd4a8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:44.558616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c55554be-ee58-444f-a808-82d06f9fd4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:44.622259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d005cb-4a77-4bf7-92d5-29af5fc48c5a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:44.623755 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 324/657] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:44.624569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55554be-ee58-444f-a808-82d06f9fd4a8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:44.638318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:44.654086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:44.672270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ce16b-00a9-4ad8-8d42-ab5eaf3ef448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:44.672830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ce16b-00a9-4ad8-8d42-ab5eaf3ef448 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.673109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ce16b-00a9-4ad8-8d42-ab5eaf3ef448 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.673409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ce16b-00a9-4ad8-8d42-ab5eaf3ef448 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.680736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ce16b-00a9-4ad8-8d42-ab5eaf3ef448 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:44.682697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ce16b-00a9-4ad8-8d42-ab5eaf3ef448 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-617ce16b-00a9-4ad8-8d42-ab5eaf3ef448 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:44.694708 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:44.696359 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:44.697829 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:44.697829 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:44.697829 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:44.697829 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:44.697829 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:44.697829 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:44.697829 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:44.697829 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:44.701108 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 334/658] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:44.701963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ce16b-00a9-4ad8-8d42-ab5eaf3ef448 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:44.728450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55554be-ee58-444f-a808-82d06f9fd4a8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:44.763300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e64a7-2c57-4b57-aee8-6b4f0cfe3b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:44.763903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e64a7-2c57-4b57-aee8-6b4f0cfe3b9c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.764182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e64a7-2c57-4b57-aee8-6b4f0cfe3b9c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.764447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e64a7-2c57-4b57-aee8-6b4f0cfe3b9c None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.765091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e64a7-2c57-4b57-aee8-6b4f0cfe3b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:44.765464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e64a7-2c57-4b57-aee8-6b4f0cfe3b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:44.766918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e64a7-2c57-4b57-aee8-6b4f0cfe3b9c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:44.782115 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 325/659] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:44.782115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e64a7-2c57-4b57-aee8-6b4f0cfe3b9c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:44.814472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ce16b-00a9-4ad8-8d42-ab5eaf3ef448 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:44.849766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c42a4-6c71-4d1a-85bd-1ad094d64f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:44.850373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c42a4-6c71-4d1a-85bd-1ad094d64f42 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.850649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c42a4-6c71-4d1a-85bd-1ad094d64f42 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.850967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c42a4-6c71-4d1a-85bd-1ad094d64f42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.851240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:44.884680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e64a7-2c57-4b57-aee8-6b4f0cfe3b9c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:44.907873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:44.921589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70431b6f-55e5-4c98-ac50-18ff31889fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:44.922215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70431b6f-55e5-4c98-ac50-18ff31889fc7 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.922538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70431b6f-55e5-4c98-ac50-18ff31889fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.922750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70431b6f-55e5-4c98-ac50-18ff31889fc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.929619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70431b6f-55e5-4c98-ac50-18ff31889fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:44.931605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70431b6f-55e5-4c98-ac50-18ff31889fc7 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:44.933077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c42a4-6c71-4d1a-85bd-1ad094d64f42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:44.934545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c42a4-6c71-4d1a-85bd-1ad094d64f42 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-70431b6f-55e5-4c98-ac50-18ff31889fc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:44.942939 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:44.943831 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:44.944726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:44.944726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:44.944726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:44.944726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:44.944726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:44.944726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:44.944726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:44.944726 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:44.944726 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 326/660] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:44.945262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70431b6f-55e5-4c98-ac50-18ff31889fc7 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.036321 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 335/661] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:45.037154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c42a4-6c71-4d1a-85bd-1ad094d64f42 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.044899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70431b6f-55e5-4c98-ac50-18ff31889fc7 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.074822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:45.080477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee001e-801a-403b-9259-1c7a5a60a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.081252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee001e-801a-403b-9259-1c7a5a60a476 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.081544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee001e-801a-403b-9259-1c7a5a60a476 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.081819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee001e-801a-403b-9259-1c7a5a60a476 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:45.082507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee001e-801a-403b-9259-1c7a5a60a476 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:45.082810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee001e-801a-403b-9259-1c7a5a60a476 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:45.084226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee001e-801a-403b-9259-1c7a5a60a476 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:45.096217 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 327/662] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:45.096995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee001e-801a-403b-9259-1c7a5a60a476 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.115719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:45.138841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c42a4-6c71-4d1a-85bd-1ad094d64f42 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.172407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97f503-6a73-4d67-9fcd-83f2b0c08298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.173078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97f503-6a73-4d67-9fcd-83f2b0c08298 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.173334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97f503-6a73-4d67-9fcd-83f2b0c08298 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.173609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97f503-6a73-4d67-9fcd-83f2b0c08298 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:45.180726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97f503-6a73-4d67-9fcd-83f2b0c08298 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:45.182101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97f503-6a73-4d67-9fcd-83f2b0c08298 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-7d97f503-6a73-4d67-9fcd-83f2b0c08298 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:45.193414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:45.194576 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:45.195592 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:45.195592 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:45.195592 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:45.195592 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:45.195592 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:45.195592 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:45.195592 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:45.195592 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:45.195592 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 08 20:35:45.195592 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:45.195592 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 336/663] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:45.196192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee001e-801a-403b-9259-1c7a5a60a476 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.196271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97f503-6a73-4d67-9fcd-83f2b0c08298 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.229727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd52f84-e75f-4700-b512-ce0e8705f115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.230332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd52f84-e75f-4700-b512-ce0e8705f115 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.230608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd52f84-e75f-4700-b512-ce0e8705f115 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.230881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd52f84-e75f-4700-b512-ce0e8705f115 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:45.231572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd52f84-e75f-4700-b512-ce0e8705f115 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:45.231899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd52f84-e75f-4700-b512-ce0e8705f115 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:45.233348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd52f84-e75f-4700-b512-ce0e8705f115 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:45.244945 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 328/664] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:45.245879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd52f84-e75f-4700-b512-ce0e8705f115 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.297177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:45.302009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97f503-6a73-4d67-9fcd-83f2b0c08298 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.333886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4143b1-6628-43a1-9ca4-9e6610e1e09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.334508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4143b1-6628-43a1-9ca4-9e6610e1e09f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.334795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4143b1-6628-43a1-9ca4-9e6610e1e09f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.335061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4143b1-6628-43a1-9ca4-9e6610e1e09f None admin] PATH_INFO: `/v3/roles/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:45.342122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:45.345265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd52f84-e75f-4700-b512-ce0e8705f115 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.346558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4143b1-6628-43a1-9ca4-9e6610e1e09f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-1c4143b1-6628-43a1-9ca4-9e6610e1e09f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:45.351582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:45.353234 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 337/665] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:45.354087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4143b1-6628-43a1-9ca4-9e6610e1e09f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.383093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c0a93-d329-4dce-960d-64c72a2a9f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.383725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c0a93-d329-4dce-960d-64c72a2a9f5b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.384004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c0a93-d329-4dce-960d-64c72a2a9f5b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.384277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c0a93-d329-4dce-960d-64c72a2a9f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:45.394430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c0a93-d329-4dce-960d-64c72a2a9f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:45.395857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c0a93-d329-4dce-960d-64c72a2a9f5b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-d22c0a93-d329-4dce-960d-64c72a2a9f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:45.410164 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:45.411252 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:45.412146 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:45.412146 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:45.412146 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:45.412146 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 329/666] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:45.412146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c0a93-d329-4dce-960d-64c72a2a9f5b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.457437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4143b1-6628-43a1-9ca4-9e6610e1e09f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.494715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecb015-2742-4366-b966-62d6a41791aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.495321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecb015-2742-4366-b966-62d6a41791aa None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.495596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecb015-2742-4366-b966-62d6a41791aa None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.495863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecb015-2742-4366-b966-62d6a41791aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:45.496579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecb015-2742-4366-b966-62d6a41791aa None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=187d6f51b1604327a4879e9e19b47963) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:45.496882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecb015-2742-4366-b966-62d6a41791aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:45.498352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecb015-2742-4366-b966-62d6a41791aa None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:45.504058 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 338/667] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:45 2022] GET /identity/v3/role_assignments?user.id=187d6f51b1604327a4879e9e19b47963&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:45.504938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecb015-2742-4366-b966-62d6a41791aa None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.533664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c0a93-d329-4dce-960d-64c72a2a9f5b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.538199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:45.573220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:45.582229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13e3eb-2999-4eed-a84e-e959e7ed672f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.582855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13e3eb-2999-4eed-a84e-e959e7ed672f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.583160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13e3eb-2999-4eed-a84e-e959e7ed672f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.583405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13e3eb-2999-4eed-a84e-e959e7ed672f None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:45.584158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13e3eb-2999-4eed-a84e-e959e7ed672f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:45.584461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13e3eb-2999-4eed-a84e-e959e7ed672f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:45.585947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13e3eb-2999-4eed-a84e-e959e7ed672f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:45.611694 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 330/668] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Oct 8 20:35:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:45.611694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13e3eb-2999-4eed-a84e-e959e7ed672f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.624805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecb015-2742-4366-b966-62d6a41791aa None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.661737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a38d5-f8fb-4a0d-8b33-dfe74f303f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.662463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a38d5-f8fb-4a0d-8b33-dfe74f303f0c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.662806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a38d5-f8fb-4a0d-8b33-dfe74f303f0c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.663147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a38d5-f8fb-4a0d-8b33-dfe74f303f0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:45.663979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a38d5-f8fb-4a0d-8b33-dfe74f303f0c None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=7885df3b2ae34969852f76fbc94a7a10) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:45.664891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a38d5-f8fb-4a0d-8b33-dfe74f303f0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:45.666465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a38d5-f8fb-4a0d-8b33-dfe74f303f0c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:45.685230 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 339/669] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:45 2022] GET /identity/v3/role_assignments?user.id=7885df3b2ae34969852f76fbc94a7a10&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:45.685230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a38d5-f8fb-4a0d-8b33-dfe74f303f0c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.750980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13e3eb-2999-4eed-a84e-e959e7ed672f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.803382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44e3b2-cbcc-49b5-92aa-fe77be9e6a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.804014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44e3b2-cbcc-49b5-92aa-fe77be9e6a41 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.804291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44e3b2-cbcc-49b5-92aa-fe77be9e6a41 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.805538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44e3b2-cbcc-49b5-92aa-fe77be9e6a41 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:45.806468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44e3b2-cbcc-49b5-92aa-fe77be9e6a41 None admin] RBAC: Adding query filter params (name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:45.806784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44e3b2-cbcc-49b5-92aa-fe77be9e6a41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:45.808196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44e3b2-cbcc-49b5-92aa-fe77be9e6a41 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:45.817623 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 331/670] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:45.818477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44e3b2-cbcc-49b5-92aa-fe77be9e6a41 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.833412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a38d5-f8fb-4a0d-8b33-dfe74f303f0c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.857631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:45.881467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:45.893424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d51e2-82c2-440e-8b7d-714c858532b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.894399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d51e2-82c2-440e-8b7d-714c858532b9 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.894959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d51e2-82c2-440e-8b7d-714c858532b9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.895371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d51e2-82c2-440e-8b7d-714c858532b9 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:45.896174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d51e2-82c2-440e-8b7d-714c858532b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:45.896618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d51e2-82c2-440e-8b7d-714c858532b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:45.899461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d51e2-82c2-440e-8b7d-714c858532b9 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:45.915294 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 340/671] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:45.916393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d51e2-82c2-440e-8b7d-714c858532b9 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.946430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44e3b2-cbcc-49b5-92aa-fe77be9e6a41 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.992610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac39db-182a-41a6-ae64-722f98a5a6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.993501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac39db-182a-41a6-ae64-722f98a5a6fd None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.993962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac39db-182a-41a6-ae64-722f98a5a6fd None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.994383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac39db-182a-41a6-ae64-722f98a5a6fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:46.057530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d51e2-82c2-440e-8b7d-714c858532b9 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:46.066530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac39db-182a-41a6-ae64-722f98a5a6fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:46.068154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac39db-182a-41a6-ae64-722f98a5a6fd None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:46.093770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:46.101346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33018891-7806-48f0-ad89-b14207e02787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:46.102813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33018891-7806-48f0-ad89-b14207e02787 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:46.104164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33018891-7806-48f0-ad89-b14207e02787 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:46.105565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33018891-7806-48f0-ad89-b14207e02787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:46.118876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33018891-7806-48f0-ad89-b14207e02787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:46.121312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33018891-7806-48f0-ad89-b14207e02787 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-33018891-7806-48f0-ad89-b14207e02787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:46.140342 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:46.141514 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:46.142418 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:46.142418 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:46.142418 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:46.144387 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 341/672] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:46.145430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33018891-7806-48f0-ad89-b14207e02787 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:46.176806 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 332/673] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:46.177700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac39db-182a-41a6-ae64-722f98a5a6fd None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:46.194350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:46.273886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33018891-7806-48f0-ad89-b14207e02787 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:46.292336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac39db-182a-41a6-ae64-722f98a5a6fd None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:46.313680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feb548-e53b-4d15-8038-d61b074441a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:46.314237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb548-e53b-4d15-8038-d61b074441a4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:46.314521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb548-e53b-4d15-8038-d61b074441a4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:46.315191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb548-e53b-4d15-8038-d61b074441a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:46.319548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:46.324447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7feb548-e53b-4d15-8038-d61b074441a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:46.327754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7feb548-e53b-4d15-8038-d61b074441a4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:46.332604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ab304-727c-4088-90dc-1e87e14566e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:46.333494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ab304-727c-4088-90dc-1e87e14566e7 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:46.333981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ab304-727c-4088-90dc-1e87e14566e7 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:46.334443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ab304-727c-4088-90dc-1e87e14566e7 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:46.335246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ab304-727c-4088-90dc-1e87e14566e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:46.335647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ab304-727c-4088-90dc-1e87e14566e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:46.337210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ab304-727c-4088-90dc-1e87e14566e7 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-a7feb548-e53b-4d15-8038-d61b074441a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:46.340922 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:46.342022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:46.343146 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:46.343146 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:46.343146 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:46.343146 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:46.343146 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:46.343146 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:46.343146 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:46.343146 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:46.345224 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 342/674] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:46.346145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feb548-e53b-4d15-8038-d61b074441a4 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:46.353035 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 333/675] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:46.354026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ab304-727c-4088-90dc-1e87e14566e7 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:46.470315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:46.470899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ab304-727c-4088-90dc-1e87e14566e7 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:46.474862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feb548-e53b-4d15-8038-d61b074441a4 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:46.511662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c23e5-2fe9-4c4e-a91f-5022528999df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:46.512536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c23e5-2fe9-4c4e-a91f-5022528999df None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:46.512921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c23e5-2fe9-4c4e-a91f-5022528999df None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:46.513437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c23e5-2fe9-4c4e-a91f-5022528999df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:46.516128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6ee2f-648c-41da-84d7-6dde883cd894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:46.517228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6ee2f-648c-41da-84d7-6dde883cd894 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:46.517654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6ee2f-648c-41da-84d7-6dde883cd894 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:46.518088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6ee2f-648c-41da-84d7-6dde883cd894 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:46.518925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6ee2f-648c-41da-84d7-6dde883cd894 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:46.519494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6ee2f-648c-41da-84d7-6dde883cd894 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:46.521070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6ee2f-648c-41da-84d7-6dde883cd894 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:46.525799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c23e5-2fe9-4c4e-a91f-5022528999df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:46.527347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c23e5-2fe9-4c4e-a91f-5022528999df None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:46.537612 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 334/676] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:46.538796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6ee2f-648c-41da-84d7-6dde883cd894 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-660c23e5-2fe9-4c4e-a91f-5022528999df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:46.543546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:46.544578 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:46.545542 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:46.545542 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:46.545542 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:46.545542 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 343/677] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:46.546393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c23e5-2fe9-4c4e-a91f-5022528999df None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:46.599987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:46.656603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c23e5-2fe9-4c4e-a91f-5022528999df None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:46.678923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6ee2f-648c-41da-84d7-6dde883cd894 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:46.692328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fe5ed-0093-4389-b23e-8004d2f0fecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:46.692944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fe5ed-0093-4389-b23e-8004d2f0fecb None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:46.693251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fe5ed-0093-4389-b23e-8004d2f0fecb None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:46.693536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fe5ed-0093-4389-b23e-8004d2f0fecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:46.694373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fe5ed-0093-4389-b23e-8004d2f0fecb None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=6d82a39388514ff79b2235ff2ede6ef2) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:46.694688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fe5ed-0093-4389-b23e-8004d2f0fecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:46.696681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fe5ed-0093-4389-b23e-8004d2f0fecb None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:46.703236 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 344/678] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:46 2022] GET /identity/v3/role_assignments?user.id=6d82a39388514ff79b2235ff2ede6ef2&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:46.704031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fe5ed-0093-4389-b23e-8004d2f0fecb None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:46.722107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:46.732288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18185c1a-08d7-403f-b12e-86d61e145348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:46.734096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18185c1a-08d7-403f-b12e-86d61e145348 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:46.734835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18185c1a-08d7-403f-b12e-86d61e145348 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:46.737642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18185c1a-08d7-403f-b12e-86d61e145348 None admin] PATH_INFO: `/v3/users/swift` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:46.751780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18185c1a-08d7-403f-b12e-86d61e145348 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:46.754527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18185c1a-08d7-403f-b12e-86d61e145348 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-18185c1a-08d7-403f-b12e-86d61e145348 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:46.773321 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:46.774806 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:46.776027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:46.776027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:46.776027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:46.776027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:46.776027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:46.776027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:46.776027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:46.776027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:46.776027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 08 20:35:46.776027 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:46.777953 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 335/679] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:35:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:46.783894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18185c1a-08d7-403f-b12e-86d61e145348 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:46.911411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fe5ed-0093-4389-b23e-8004d2f0fecb None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:46.960010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e74ff-c653-4965-adf6-c8019f7a1740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:46.961878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e74ff-c653-4965-adf6-c8019f7a1740 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:46.962378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e74ff-c653-4965-adf6-c8019f7a1740 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:46.967894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e74ff-c653-4965-adf6-c8019f7a1740 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:46.968876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e74ff-c653-4965-adf6-c8019f7a1740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:46.969366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e74ff-c653-4965-adf6-c8019f7a1740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:46.971009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e74ff-c653-4965-adf6-c8019f7a1740 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:46.991019 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 345/680] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:46.997080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e74ff-c653-4965-adf6-c8019f7a1740 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:47.017509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18185c1a-08d7-403f-b12e-86d61e145348 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:47.021348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:47.062246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e737cac-2da1-48c1-955b-b7aaae55f502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:47.062792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e737cac-2da1-48c1-955b-b7aaae55f502 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:47.063170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e737cac-2da1-48c1-955b-b7aaae55f502 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:47.063562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e737cac-2da1-48c1-955b-b7aaae55f502 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:47.064455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e737cac-2da1-48c1-955b-b7aaae55f502 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:47.064863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e737cac-2da1-48c1-955b-b7aaae55f502 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:47.066503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e737cac-2da1-48c1-955b-b7aaae55f502 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:47.088799 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 336/681] 10.222.0.26 () {56 vars in 1135 bytes} [Sat Oct 8 20:35:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:47.093850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:47.095336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e737cac-2da1-48c1-955b-b7aaae55f502 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:47.124179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e74ff-c653-4965-adf6-c8019f7a1740 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:47.167686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a10c3-f875-4225-8a76-7c8df84ae275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:47.168774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a10c3-f875-4225-8a76-7c8df84ae275 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:47.168774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a10c3-f875-4225-8a76-7c8df84ae275 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:47.169201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a10c3-f875-4225-8a76-7c8df84ae275 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:47.178206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a10c3-f875-4225-8a76-7c8df84ae275 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:47.180489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a10c3-f875-4225-8a76-7c8df84ae275 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-a06a10c3-f875-4225-8a76-7c8df84ae275 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:47.193180 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:47.194171 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:47.195262 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:47.195262 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:47.195262 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:47.195262 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:47.195262 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:47.195262 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:47.195262 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:47.195262 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:47.197253 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 346/682] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:47.202515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a10c3-f875-4225-8a76-7c8df84ae275 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:47.224761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e737cac-2da1-48c1-955b-b7aaae55f502 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:47.273171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c05e12-b36e-4ed9-80e7-608773bc4445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:47.273955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c05e12-b36e-4ed9-80e7-608773bc4445 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:47.274223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c05e12-b36e-4ed9-80e7-608773bc4445 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:47.274515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c05e12-b36e-4ed9-80e7-608773bc4445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:47.322399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:47.347662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a10c3-f875-4225-8a76-7c8df84ae275 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:47.371500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c05e12-b36e-4ed9-80e7-608773bc4445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:47.372936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c05e12-b36e-4ed9-80e7-608773bc4445 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:47.411523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c80e-d1c5-4a71-b5e5-26390ba1c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:47.412130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c80e-d1c5-4a71-b5e5-26390ba1c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:47.412398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c80e-d1c5-4a71-b5e5-26390ba1c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:47.412666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c80e-d1c5-4a71-b5e5-26390ba1c9a9 None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:47.413373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c80e-d1c5-4a71-b5e5-26390ba1c9a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:47.413673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c80e-d1c5-4a71-b5e5-26390ba1c9a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:47.415662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c80e-d1c5-4a71-b5e5-26390ba1c9a9 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:47.425588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:47.444553 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 347/683] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:47.450167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c80e-d1c5-4a71-b5e5-26390ba1c9a9 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:47.547580 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 337/684] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:35:47.553540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c05e12-b36e-4ed9-80e7-608773bc4445 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:47.634483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c80e-d1c5-4a71-b5e5-26390ba1c9a9 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:47.651836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:47.690551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbf58d-ac70-4971-9006-89e851983085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:47.691061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbf58d-ac70-4971-9006-89e851983085 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:47.691612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbf58d-ac70-4971-9006-89e851983085 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:47.691888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbf58d-ac70-4971-9006-89e851983085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:47.693034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbf58d-ac70-4971-9006-89e851983085 None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=32932449fed540ac9073f056065899bd) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:47.693390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbf58d-ac70-4971-9006-89e851983085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:47.694813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbf58d-ac70-4971-9006-89e851983085 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:47.702416 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 348/685] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:47 2022] GET /identity/v3/role_assignments?user.id=32932449fed540ac9073f056065899bd&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:47.721020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c05e12-b36e-4ed9-80e7-608773bc4445 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:47.760219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ac167-2c8e-4f2a-bbdd-ae43c2233035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:47.760883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ac167-2c8e-4f2a-bbdd-ae43c2233035 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:47.761160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ac167-2c8e-4f2a-bbdd-ae43c2233035 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:47.761464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ac167-2c8e-4f2a-bbdd-ae43c2233035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:47.772887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ac167-2c8e-4f2a-bbdd-ae43c2233035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:47.775087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ac167-2c8e-4f2a-bbdd-ae43c2233035 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-372ac167-2c8e-4f2a-bbdd-ae43c2233035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:47.791446 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:47.792449 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:47.793395 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:47.793395 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:47.793395 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:47.793395 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 338/686] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:47.798343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbf58d-ac70-4971-9006-89e851983085 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:47.889726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:47.955826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbf58d-ac70-4971-9006-89e851983085 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:47.996143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef2096-c5d4-4894-b9eb-5dfbedef477d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:47.996776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef2096-c5d4-4894-b9eb-5dfbedef477d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:47.997056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef2096-c5d4-4894-b9eb-5dfbedef477d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:47.997373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef2096-c5d4-4894-b9eb-5dfbedef477d None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:47.998040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef2096-c5d4-4894-b9eb-5dfbedef477d None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:47.998345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef2096-c5d4-4894-b9eb-5dfbedef477d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:47.999800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef2096-c5d4-4894-b9eb-5dfbedef477d None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:48.013204 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 349/687] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:48.019093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ac167-2c8e-4f2a-bbdd-ae43c2233035 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:48.132359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ac167-2c8e-4f2a-bbdd-ae43c2233035 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:48.149796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:48.172526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951b056-61bc-4374-988e-0196ad8e9378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:48.173156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b056-61bc-4374-988e-0196ad8e9378 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:48.173462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b056-61bc-4374-988e-0196ad8e9378 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:48.173736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b056-61bc-4374-988e-0196ad8e9378 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:48.181249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951b056-61bc-4374-988e-0196ad8e9378 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:48.182747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951b056-61bc-4374-988e-0196ad8e9378 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-8951b056-61bc-4374-988e-0196ad8e9378 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:48.194368 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:48.195278 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:48.196777 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:48.196777 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:48.196777 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:48.196777 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:48.196777 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:48.196777 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:48.196777 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:48.196777 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:48.198703 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 339/688] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:48.204347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef2096-c5d4-4894-b9eb-5dfbedef477d None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:48.330467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee715f5-acc0-4f15-819e-0d0aae5a89c9 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:48.331108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee715f5-acc0-4f15-819e-0d0aae5a89c9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:48.331598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee715f5-acc0-4f15-819e-0d0aae5a89c9 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:48.333460 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 340/689] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:48.338759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17d789-d021-49bb-a1b8-c4d348a5f484 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:48.339281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17d789-d021-49bb-a1b8-c4d348a5f484 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:48.339767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17d789-d021-49bb-a1b8-c4d348a5f484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:48.358145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef2096-c5d4-4894-b9eb-5dfbedef477d None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:48.358977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ea17d789-d021-49bb-a1b8-c4d348a5f484 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:48.360401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ea17d789-d021-49bb-a1b8-c4d348a5f484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:48.397764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:48.429120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf44775-ab4b-4f33-952a-55b6d7d6e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:48.433548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf44775-ab4b-4f33-952a-55b6d7d6e551 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:48.434052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf44775-ab4b-4f33-952a-55b6d7d6e551 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:48.434569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf44775-ab4b-4f33-952a-55b6d7d6e551 None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:48.435472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf44775-ab4b-4f33-952a-55b6d7d6e551 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:48.435986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf44775-ab4b-4f33-952a-55b6d7d6e551 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:48.437715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf44775-ab4b-4f33-952a-55b6d7d6e551 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:48.455382 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 350/690] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:48.463079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a4e3d-d100-488f-9a45-289ece2064e2 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:48.463079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a4e3d-d100-488f-9a45-289ece2064e2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:48.463079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a4e3d-d100-488f-9a45-289ece2064e2 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:48.464251 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 351/691] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:48.469493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075c263-331c-4715-ba86-81732a154ec0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:48.469779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075c263-331c-4715-ba86-81732a154ec0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:48.470182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075c263-331c-4715-ba86-81732a154ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:48.481862 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 341/692] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:48.484359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17d789-d021-49bb-a1b8-c4d348a5f484 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:48.489701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6075c263-331c-4715-ba86-81732a154ec0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:48.497244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6075c263-331c-4715-ba86-81732a154ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:48.588194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17d789-d021-49bb-a1b8-c4d348a5f484 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:48.606655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:48.627956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef499195-eaa8-40ec-b6ac-4d457c681cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:48.628562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef499195-eaa8-40ec-b6ac-4d457c681cf9 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:48.628841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef499195-eaa8-40ec-b6ac-4d457c681cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:48.629574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef499195-eaa8-40ec-b6ac-4d457c681cf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:48.632340 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 352/693] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:48.632456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef499195-eaa8-40ec-b6ac-4d457c681cf9 None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=5bd5adc10b4344e1847c23c2c0599e59) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:48.632547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef499195-eaa8-40ec-b6ac-4d457c681cf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:48.634511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef499195-eaa8-40ec-b6ac-4d457c681cf9 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:48.646131 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 342/694] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:48 2022] GET /identity/v3/role_assignments?user.id=5bd5adc10b4344e1847c23c2c0599e59&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:48.846304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075c263-331c-4715-ba86-81732a154ec0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:48.982999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075c263-331c-4715-ba86-81732a154ec0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:48.993457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:49.025132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b3568-9542-48ff-8bdf-7f695ede2f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.025797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3568-9542-48ff-8bdf-7f695ede2f28 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.026078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3568-9542-48ff-8bdf-7f695ede2f28 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.026349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3568-9542-48ff-8bdf-7f695ede2f28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.037790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b3568-9542-48ff-8bdf-7f695ede2f28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-523b3568-9542-48ff-8bdf-7f695ede2f28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:49.043354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:49.044274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:49.046190 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:49.046190 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:49.046190 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:49.046190 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:49.046190 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:49.046190 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:49.046190 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:49.046190 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:49.046190 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:49.046190 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:49.046190 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:49.046190 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:49.046190 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 353/695] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:35:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:49.050274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef499195-eaa8-40ec-b6ac-4d457c681cf9 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:49.099143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b3568-9542-48ff-8bdf-7f695ede2f28 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:49.188578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef499195-eaa8-40ec-b6ac-4d457c681cf9 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:49.221476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b3568-9542-48ff-8bdf-7f695ede2f28 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:49.229326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0add9-f762-44ef-9730-117714e20c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.229948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0add9-f762-44ef-9730-117714e20c6a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.230234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0add9-f762-44ef-9730-117714e20c6a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.230494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0add9-f762-44ef-9730-117714e20c6a None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.231160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0add9-f762-44ef-9730-117714e20c6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:49.231504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0add9-f762-44ef-9730-117714e20c6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:49.232978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0add9-f762-44ef-9730-117714e20c6a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:49.243470 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 343/696] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:49.249104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0add9-f762-44ef-9730-117714e20c6a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:49.261619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b8f80-45bb-4036-b9f6-30e93ddeb33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.262565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b8f80-45bb-4036-b9f6-30e93ddeb33a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.263046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b8f80-45bb-4036-b9f6-30e93ddeb33a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.263520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b8f80-45bb-4036-b9f6-30e93ddeb33a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.264357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b8f80-45bb-4036-b9f6-30e93ddeb33a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:49.266031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b8f80-45bb-4036-b9f6-30e93ddeb33a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-6c6b8f80-45bb-4036-b9f6-30e93ddeb33a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:49.277426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:49.278507 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:35:49.279364 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:49.282208 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 354/697] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Oct 8 20:35:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:49.289208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:49.292000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b8f80-45bb-4036-b9f6-30e93ddeb33a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:49.362964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:49.411947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0add9-f762-44ef-9730-117714e20c6a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:49.452007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35777296-df7f-4fa3-bf46-7abe33aea208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.452658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35777296-df7f-4fa3-bf46-7abe33aea208 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.452938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35777296-df7f-4fa3-bf46-7abe33aea208 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.453264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35777296-df7f-4fa3-bf46-7abe33aea208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.465428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35777296-df7f-4fa3-bf46-7abe33aea208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:49.466868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35777296-df7f-4fa3-bf46-7abe33aea208 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-35777296-df7f-4fa3-bf46-7abe33aea208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:49.484647 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:49.485947 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:49.486830 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:49.486830 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:49.486830 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:49.486830 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 344/698] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:49.495445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35777296-df7f-4fa3-bf46-7abe33aea208 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:49.500538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b8f80-45bb-4036-b9f6-30e93ddeb33a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:49.574440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f62058-49bb-4b7c-9de2-0aa46d1418f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.575425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f62058-49bb-4b7c-9de2-0aa46d1418f0 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.575903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f62058-49bb-4b7c-9de2-0aa46d1418f0 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.576371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f62058-49bb-4b7c-9de2-0aa46d1418f0 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.577215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f62058-49bb-4b7c-9de2-0aa46d1418f0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:49.577741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f62058-49bb-4b7c-9de2-0aa46d1418f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:49.578612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:49.579411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f62058-49bb-4b7c-9de2-0aa46d1418f0 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:49.595250 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 355/699] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Oct 8 20:35:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:49.605152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35777296-df7f-4fa3-bf46-7abe33aea208 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:49.606355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f62058-49bb-4b7c-9de2-0aa46d1418f0 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:49.688212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf3d29-e433-49e0-99bd-4f198ee27caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.688737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf3d29-e433-49e0-99bd-4f198ee27caf None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.689018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf3d29-e433-49e0-99bd-4f198ee27caf None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.689335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf3d29-e433-49e0-99bd-4f198ee27caf None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.690100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf3d29-e433-49e0-99bd-4f198ee27caf None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:49.690400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf3d29-e433-49e0-99bd-4f198ee27caf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:49.691772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf3d29-e433-49e0-99bd-4f198ee27caf None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:49.712911 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 345/700] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:49.719588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf3d29-e433-49e0-99bd-4f198ee27caf None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:49.753458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:49.757747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f62058-49bb-4b7c-9de2-0aa46d1418f0 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:49.848610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf3d29-e433-49e0-99bd-4f198ee27caf None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:49.849606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767d05e-f4df-48ee-a784-26b82c3607e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.850338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767d05e-f4df-48ee-a784-26b82c3607e6 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.850721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767d05e-f4df-48ee-a784-26b82c3607e6 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.851095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767d05e-f4df-48ee-a784-26b82c3607e6 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.851897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767d05e-f4df-48ee-a784-26b82c3607e6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:49.852305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767d05e-f4df-48ee-a784-26b82c3607e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:49.853804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767d05e-f4df-48ee-a784-26b82c3607e6 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:49.871387 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 356/701] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Oct 8 20:35:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:49.897759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b87d-d513-40ff-95bb-fe7ffb163d9a None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.898098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b87d-d513-40ff-95bb-fe7ffb163d9a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.898313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b87d-d513-40ff-95bb-fe7ffb163d9a None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.899820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081fcb-4daf-467f-b2ea-270e5cf8094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.899949 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 357/702] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:35:49.901407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081fcb-4daf-467f-b2ea-270e5cf8094b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.901407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081fcb-4daf-467f-b2ea-270e5cf8094b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.901407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081fcb-4daf-467f-b2ea-270e5cf8094b None admin] PATH_INFO: `/v3/users/nova` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.910699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259ba9a-1377-4a62-883e-faea03aa30ca None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.911044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259ba9a-1377-4a62-883e-faea03aa30ca None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.911256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259ba9a-1377-4a62-883e-faea03aa30ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.914460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081fcb-4daf-467f-b2ea-270e5cf8094b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:49.916360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081fcb-4daf-467f-b2ea-270e5cf8094b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-e7081fcb-4daf-467f-b2ea-270e5cf8094b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:49.930481 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:49.931501 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:49.932447 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:49.932447 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:49.932447 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:49.932447 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:49.932447 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:49.932447 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:49.932447 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:49.932447 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:49.932447 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:35:49.932447 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:49.936346 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 346/703] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Oct 8 20:35:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:49.941823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081fcb-4daf-467f-b2ea-270e5cf8094b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:49.947708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:49.950615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1259ba9a-1377-4a62-883e-faea03aa30ca None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:49.954106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1259ba9a-1377-4a62-883e-faea03aa30ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:50.073453 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 358/704] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:50.142373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081fcb-4daf-467f-b2ea-270e5cf8094b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:50.178867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9454a94-d2b7-460e-bba4-a89e3f3a70b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:50.179480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9454a94-d2b7-460e-bba4-a89e3f3a70b3 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:50.179757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9454a94-d2b7-460e-bba4-a89e3f3a70b3 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:50.180590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9454a94-d2b7-460e-bba4-a89e3f3a70b3 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:50.181361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9454a94-d2b7-460e-bba4-a89e3f3a70b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:50.181667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9454a94-d2b7-460e-bba4-a89e3f3a70b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:50.183089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9454a94-d2b7-460e-bba4-a89e3f3a70b3 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:50.200870 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 347/705] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Oct 8 20:35:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:50.210602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259ba9a-1377-4a62-883e-faea03aa30ca None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:50.328020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:50.340331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259ba9a-1377-4a62-883e-faea03aa30ca None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:50.392103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad90129-4bdc-404f-b5c1-01ce558817c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:50.392721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad90129-4bdc-404f-b5c1-01ce558817c2 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:50.392998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad90129-4bdc-404f-b5c1-01ce558817c2 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:50.393373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad90129-4bdc-404f-b5c1-01ce558817c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:50.465546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9454a94-d2b7-460e-bba4-a89e3f3a70b3 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:50.498282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad90129-4bdc-404f-b5c1-01ce558817c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:50.499749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad90129-4bdc-404f-b5c1-01ce558817c2 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:50.557544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:50.632423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9454a94-d2b7-460e-bba4-a89e3f3a70b3 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:50.680439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:50.692681 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 359/706] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:50.700539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad90129-4bdc-404f-b5c1-01ce558817c2 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:50.716377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ed113-d931-499e-8f48-406bf38a4795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:50.717394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed113-d931-499e-8f48-406bf38a4795 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:50.717897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed113-d931-499e-8f48-406bf38a4795 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:50.718373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed113-d931-499e-8f48-406bf38a4795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:50.742068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ed113-d931-499e-8f48-406bf38a4795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:50.743737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ed113-d931-499e-8f48-406bf38a4795 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-004ed113-d931-499e-8f48-406bf38a4795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:50.762036 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:50.763023 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:50.763958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:50.763958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:50.763958 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:50.763958 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 348/707] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:50.767389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ed113-d931-499e-8f48-406bf38a4795 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:50.831555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad90129-4bdc-404f-b5c1-01ce558817c2 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:50.875051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f7bf7-3369-4e02-a982-e1aa3118a7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:50.875714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f7bf7-3369-4e02-a982-e1aa3118a7a1 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:50.875946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f7bf7-3369-4e02-a982-e1aa3118a7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:50.876216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f7bf7-3369-4e02-a982-e1aa3118a7a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:50.887903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f7bf7-3369-4e02-a982-e1aa3118a7a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:50.889686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f7bf7-3369-4e02-a982-e1aa3118a7a1 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-e59f7bf7-3369-4e02-a982-e1aa3118a7a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:50.905175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:50.906187 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:50.907104 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:50.907104 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:50.907104 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:50.909249 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 360/708] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:50.910808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b17e5-4129-42c8-a1c7-d6dd3ffa5cee None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:50.911343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b17e5-4129-42c8-a1c7-d6dd3ffa5cee None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:50.911824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b17e5-4129-42c8-a1c7-d6dd3ffa5cee None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:50.917443 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 361/709] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:50.918473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b17e5-4129-42c8-a1c7-d6dd3ffa5cee None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:50.938639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ed113-d931-499e-8f48-406bf38a4795 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:50.956251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:50.968320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:50.984785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64bb56-206c-42ee-897e-0dd8cd9a5012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:50.985688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64bb56-206c-42ee-897e-0dd8cd9a5012 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:50.985970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64bb56-206c-42ee-897e-0dd8cd9a5012 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:50.986245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64bb56-206c-42ee-897e-0dd8cd9a5012 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:50.986895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64bb56-206c-42ee-897e-0dd8cd9a5012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:50.987199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64bb56-206c-42ee-897e-0dd8cd9a5012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:50.989567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64bb56-206c-42ee-897e-0dd8cd9a5012 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:51.003074 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 349/710] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:51.004678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e29b5d-3ac5-41bd-bcdd-681723bf64a5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:51.005206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e29b5d-3ac5-41bd-bcdd-681723bf64a5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:51.005709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e29b5d-3ac5-41bd-bcdd-681723bf64a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:51.024538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-86e29b5d-3ac5-41bd-bcdd-681723bf64a5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:51.026106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-86e29b5d-3ac5-41bd-bcdd-681723bf64a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:51.043976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b17e5-4129-42c8-a1c7-d6dd3ffa5cee None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:51.084214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb39d5-4968-44aa-862d-cbb1cb896ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:51.084765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb39d5-4968-44aa-862d-cbb1cb896ca4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:51.085044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb39d5-4968-44aa-862d-cbb1cb896ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:51.085358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb39d5-4968-44aa-862d-cbb1cb896ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:51.086009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb39d5-4968-44aa-862d-cbb1cb896ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:51.086466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb39d5-4968-44aa-862d-cbb1cb896ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:51.087845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb39d5-4968-44aa-862d-cbb1cb896ca4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:51.108088 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 362/711] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:51.108088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb39d5-4968-44aa-862d-cbb1cb896ca4 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:51.117953 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 350/712] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:51.118915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e29b5d-3ac5-41bd-bcdd-681723bf64a5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:51.261488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb39d5-4968-44aa-862d-cbb1cb896ca4 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:51.265481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:51.308106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e29b5d-3ac5-41bd-bcdd-681723bf64a5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:51.309788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:51.317059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b0372-a5f7-4581-9840-ded4ec1835d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:51.317994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b0372-a5f7-4581-9840-ded4ec1835d8 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:51.318486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b0372-a5f7-4581-9840-ded4ec1835d8 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:51.318967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b0372-a5f7-4581-9840-ded4ec1835d8 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:51.319935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b0372-a5f7-4581-9840-ded4ec1835d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:51.322385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b0372-a5f7-4581-9840-ded4ec1835d8 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:51.348119 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 363/713] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:35:51 2022] POST /identity/v3/users => generated 254 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:35:51.372396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b0039-5bc3-4daa-9b29-c9f83e34aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:51.373065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b0039-5bc3-4daa-9b29-c9f83e34aad3 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:51.373389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b0039-5bc3-4daa-9b29-c9f83e34aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:51.373662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b0039-5bc3-4daa-9b29-c9f83e34aad3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:51.381742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b0039-5bc3-4daa-9b29-c9f83e34aad3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:51.383831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b0039-5bc3-4daa-9b29-c9f83e34aad3 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-c47b0039-5bc3-4daa-9b29-c9f83e34aad3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:51.397145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:51.398256 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:51.399289 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:51.399289 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:51.399289 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:51.399289 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:51.399289 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:51.399289 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:51.399289 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:51.399289 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:51.403536 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 351/714] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:51.408449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b0372-a5f7-4581-9840-ded4ec1835d8 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:51.589158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b0039-5bc3-4daa-9b29-c9f83e34aad3 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:51.707473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b0372-a5f7-4581-9840-ded4ec1835d8 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:51.748435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b0039-5bc3-4daa-9b29-c9f83e34aad3 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:51.749115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393156a-c43c-4763-883c-bdbd52ceb84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:51.749763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393156a-c43c-4763-883c-bdbd52ceb84c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:51.750039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393156a-c43c-4763-883c-bdbd52ceb84c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:51.750306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393156a-c43c-4763-883c-bdbd52ceb84c None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:51.751174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393156a-c43c-4763-883c-bdbd52ceb84c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:51.751479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393156a-c43c-4763-883c-bdbd52ceb84c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:51.753866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393156a-c43c-4763-883c-bdbd52ceb84c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:51.769285 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 364/715] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:51.774194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393156a-c43c-4763-883c-bdbd52ceb84c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:51.797842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:51.807311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d905506-2e6a-4505-8fc0-e830abdd038c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:51.808240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905506-2e6a-4505-8fc0-e830abdd038c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:51.808702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905506-2e6a-4505-8fc0-e830abdd038c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:51.809294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905506-2e6a-4505-8fc0-e830abdd038c None admin] PATH_INFO: `/v3/services/network` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:51.811265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d905506-2e6a-4505-8fc0-e830abdd038c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:51.813432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d905506-2e6a-4505-8fc0-e830abdd038c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-2d905506-2e6a-4505-8fc0-e830abdd038c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:51.839000 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:51.840266 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:51.841230 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 352/716] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:51 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:51.846755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d905506-2e6a-4505-8fc0-e830abdd038c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:51.884994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:51.927713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393156a-c43c-4763-883c-bdbd52ceb84c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:51.965334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1013ba-81f4-4ce4-87f1-c2f02dcdb6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:51.966046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1013ba-81f4-4ce4-87f1-c2f02dcdb6ee None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:51.966399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1013ba-81f4-4ce4-87f1-c2f02dcdb6ee None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:51.966746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1013ba-81f4-4ce4-87f1-c2f02dcdb6ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:51.967553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1013ba-81f4-4ce4-87f1-c2f02dcdb6ee None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=187d6f51b1604327a4879e9e19b47963) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:51.967935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1013ba-81f4-4ce4-87f1-c2f02dcdb6ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:51.969461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1013ba-81f4-4ce4-87f1-c2f02dcdb6ee None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:51.971617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d905506-2e6a-4505-8fc0-e830abdd038c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:51.975591 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 365/717] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:51 2022] GET /identity/v3/role_assignments?user.id=187d6f51b1604327a4879e9e19b47963&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=a409f81bd5744563a303a825783bed61 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:51.977533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bfac4-e5c8-45c4-896e-6d5c5bcef5ef None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:51.977893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bfac4-e5c8-45c4-896e-6d5c5bcef5ef None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:51.978237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bfac4-e5c8-45c4-896e-6d5c5bcef5ef None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:51.983808 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 366/718] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:51.991041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8bd14-f71b-4fb4-af41-954e575151c9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:51.993611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8bd14-f71b-4fb4-af41-954e575151c9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:51.993993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8bd14-f71b-4fb4-af41-954e575151c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:52.028801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-24c8bd14-f71b-4fb4-af41-954e575151c9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:52.030190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-24c8bd14-f71b-4fb4-af41-954e575151c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:52.059943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c60c93-de45-475d-9e02-b8eb4fcb5d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:52.060868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c60c93-de45-475d-9e02-b8eb4fcb5d3f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:52.061315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c60c93-de45-475d-9e02-b8eb4fcb5d3f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:52.061755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c60c93-de45-475d-9e02-b8eb4fcb5d3f None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:52.062550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c60c93-de45-475d-9e02-b8eb4fcb5d3f None admin] RBAC: Adding query filter params (name=network) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:52.063001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c60c93-de45-475d-9e02-b8eb4fcb5d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:52.064548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c60c93-de45-475d-9e02-b8eb4fcb5d3f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:52.069873 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 353/719] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Oct 8 20:35:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:52.075102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c60c93-de45-475d-9e02-b8eb4fcb5d3f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:52.147471 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 367/720] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:52.220001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:52.232354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c60c93-de45-475d-9e02-b8eb4fcb5d3f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:52.269649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c3dd6-1512-4fe3-ad2f-fdcf653e1ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:52.270251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c3dd6-1512-4fe3-ad2f-fdcf653e1ec1 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:52.270526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c3dd6-1512-4fe3-ad2f-fdcf653e1ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:52.270794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c3dd6-1512-4fe3-ad2f-fdcf653e1ec1 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:52.271415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c3dd6-1512-4fe3-ad2f-fdcf653e1ec1 None admin] RBAC: Adding query filter params (type=network) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:52.271711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c3dd6-1512-4fe3-ad2f-fdcf653e1ec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:52.273067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c3dd6-1512-4fe3-ad2f-fdcf653e1ec1 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:52.279033 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 354/721] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Oct 8 20:35:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:52.585928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8bd14-f71b-4fb4-af41-954e575151c9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:52.606295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:52.714161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8bd14-f71b-4fb4-af41-954e575151c9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:52.749026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65414b-c351-4dce-86a7-27799046124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:52.749611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65414b-c351-4dce-86a7-27799046124c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:52.749887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65414b-c351-4dce-86a7-27799046124c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:52.750156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65414b-c351-4dce-86a7-27799046124c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:52.762052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65414b-c351-4dce-86a7-27799046124c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-ce65414b-c351-4dce-86a7-27799046124c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:52.766941 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:52.767862 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:52.769800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:52.769800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:52.769800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:52.769800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:52.769800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:52.769800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:52.769800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:52.769800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:52.769800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:52.769800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:52.769800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:52.769800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:52.769800 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 368/722] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:35:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:52.774852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c3dd6-1512-4fe3-ad2f-fdcf653e1ec1 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:52.911408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c3dd6-1512-4fe3-ad2f-fdcf653e1ec1 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:52.953566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9935f-c613-4215-9a56-bc4fa02a24cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:52.954186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9935f-c613-4215-9a56-bc4fa02a24cb None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:52.954468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9935f-c613-4215-9a56-bc4fa02a24cb None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:52.954742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9935f-c613-4215-9a56-bc4fa02a24cb None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:52.955410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9935f-c613-4215-9a56-bc4fa02a24cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:52.955712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9935f-c613-4215-9a56-bc4fa02a24cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:52.957068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9935f-c613-4215-9a56-bc4fa02a24cb None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:52.967866 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 355/723] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:52.973472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65414b-c351-4dce-86a7-27799046124c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:52.983977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dab58-f4ec-4b55-9559-e810f9627645 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:52.984263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dab58-f4ec-4b55-9559-e810f9627645 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:52.984535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dab58-f4ec-4b55-9559-e810f9627645 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:52.986135 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 356/724] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:35:52.991290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c01097-67d5-4186-bee5-05f7aa514665 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:52.991578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c01097-67d5-4186-bee5-05f7aa514665 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:52.991855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c01097-67d5-4186-bee5-05f7aa514665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:53.011436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-76c01097-67d5-4186-bee5-05f7aa514665 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:53.012585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-76c01097-67d5-4186-bee5-05f7aa514665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:53.026724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:53.088730 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 357/725] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:53.108698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:53.164897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65414b-c351-4dce-86a7-27799046124c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:53.212622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0161a8-bda7-4cd0-9ac9-50988d3e9223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:53.213277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0161a8-bda7-4cd0-9ac9-50988d3e9223 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:53.213558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0161a8-bda7-4cd0-9ac9-50988d3e9223 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:53.213828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0161a8-bda7-4cd0-9ac9-50988d3e9223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:53.224270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0161a8-bda7-4cd0-9ac9-50988d3e9223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:53.225735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0161a8-bda7-4cd0-9ac9-50988d3e9223 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-fe0161a8-bda7-4cd0-9ac9-50988d3e9223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:53.240049 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:53.241011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:53.241942 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:53.241942 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:53.241942 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:53.241942 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 369/726] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:53.247124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c01097-67d5-4186-bee5-05f7aa514665 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:53.382672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c01097-67d5-4186-bee5-05f7aa514665 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:53.422330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f62080-bb4d-4bb3-8043-2d60bd49d99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:53.422949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f62080-bb4d-4bb3-8043-2d60bd49d99e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:53.423234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f62080-bb4d-4bb3-8043-2d60bd49d99e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:53.423512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f62080-bb4d-4bb3-8043-2d60bd49d99e None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:53.424161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f62080-bb4d-4bb3-8043-2d60bd49d99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:53.424469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f62080-bb4d-4bb3-8043-2d60bd49d99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:53.425973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f62080-bb4d-4bb3-8043-2d60bd49d99e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:53.439545 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 358/727] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:53.444822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0161a8-bda7-4cd0-9ac9-50988d3e9223 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:53.511867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f62080-bb4d-4bb3-8043-2d60bd49d99e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:53.525561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:53.625005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f62080-bb4d-4bb3-8043-2d60bd49d99e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:53.662772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42267377-25f5-4e90-bcf9-91c4fa578e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:53.663294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267377-25f5-4e90-bcf9-91c4fa578e84 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:53.663577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267377-25f5-4e90-bcf9-91c4fa578e84 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:53.663852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267377-25f5-4e90-bcf9-91c4fa578e84 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:53.664546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42267377-25f5-4e90-bcf9-91c4fa578e84 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:53.665999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42267377-25f5-4e90-bcf9-91c4fa578e84 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:53.689662 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 359/728] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:35:53 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:35:53.741729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0161a8-bda7-4cd0-9ac9-50988d3e9223 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:53.783233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:53.820669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7d4e1-e862-49d7-abe1-424df077693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:53.821351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7d4e1-e862-49d7-abe1-424df077693e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:53.821630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7d4e1-e862-49d7-abe1-424df077693e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:53.821900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7d4e1-e862-49d7-abe1-424df077693e None admin] PATH_INFO: `/v3/users/swift` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:53.832923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7d4e1-e862-49d7-abe1-424df077693e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:53.834405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7d4e1-e862-49d7-abe1-424df077693e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-45e7d4e1-e862-49d7-abe1-424df077693e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:53.849175 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:53.850224 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:53.851219 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:53.851219 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:53.851219 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:53.851219 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:53.851219 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:53.851219 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:53.851219 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:53.851219 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:53.851219 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 08 20:35:53.851219 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:53.851219 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 370/729] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:35:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:53.858331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42267377-25f5-4e90-bcf9-91c4fa578e84 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:53.952580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:53.989109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42267377-25f5-4e90-bcf9-91c4fa578e84 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:54.027626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fefb66-1eb6-40a5-8523-2bb8fbd938df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:54.028320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fefb66-1eb6-40a5-8523-2bb8fbd938df None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:54.028606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fefb66-1eb6-40a5-8523-2bb8fbd938df None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:54.028879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fefb66-1eb6-40a5-8523-2bb8fbd938df None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:54.029669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fefb66-1eb6-40a5-8523-2bb8fbd938df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:54.029974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fefb66-1eb6-40a5-8523-2bb8fbd938df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:54.031451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fefb66-1eb6-40a5-8523-2bb8fbd938df None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:54.051786 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 360/730] 10.222.0.26 () {56 vars in 1135 bytes} [Sat Oct 8 20:35:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:54.058248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7d4e1-e862-49d7-abe1-424df077693e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:54.166817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7d4e1-e862-49d7-abe1-424df077693e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:54.201551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0241f-e66c-4dc8-8d3e-6fc3c1193df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:54.202162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0241f-e66c-4dc8-8d3e-6fc3c1193df1 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:54.202440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0241f-e66c-4dc8-8d3e-6fc3c1193df1 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:54.202768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0241f-e66c-4dc8-8d3e-6fc3c1193df1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:54.253999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:54.274531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0241f-e66c-4dc8-8d3e-6fc3c1193df1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:54.275976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0241f-e66c-4dc8-8d3e-6fc3c1193df1 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:54.381031 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 371/731] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:54 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:35:54.386870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fefb66-1eb6-40a5-8523-2bb8fbd938df None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:54.539791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fefb66-1eb6-40a5-8523-2bb8fbd938df None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:54.568948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc668bf-b242-4260-b661-2b268c6c7fee None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:54.569294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc668bf-b242-4260-b661-2b268c6c7fee None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:54.569542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc668bf-b242-4260-b661-2b268c6c7fee None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:54.571418 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 372/732] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:35:54.577436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261889b-2bba-4a42-b4e0-7199a040a185 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:54.577725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261889b-2bba-4a42-b4e0-7199a040a185 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:54.578194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:54.578355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261889b-2bba-4a42-b4e0-7199a040a185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:54.592894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db422c91-d43b-427b-a736-7d1228f0146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:54.593555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422c91-d43b-427b-a736-7d1228f0146d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:54.593826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422c91-d43b-427b-a736-7d1228f0146d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:54.594097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422c91-d43b-427b-a736-7d1228f0146d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:54.605664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db422c91-d43b-427b-a736-7d1228f0146d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:54.607104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db422c91-d43b-427b-a736-7d1228f0146d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:54.618228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7261889b-2bba-4a42-b4e0-7199a040a185 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:54.620917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7261889b-2bba-4a42-b4e0-7199a040a185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-db422c91-d43b-427b-a736-7d1228f0146d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:54.634815 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:54.635790 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:54.636718 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:54.636718 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:54.636718 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:54.636718 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 361/733] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:54.641462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db422c91-d43b-427b-a736-7d1228f0146d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:54.740056 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 373/734] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:54.791158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db422c91-d43b-427b-a736-7d1228f0146d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:54.838606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f2d6a-acf8-4bcc-8b53-ac0417ef41c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:54.839221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f2d6a-acf8-4bcc-8b53-ac0417ef41c7 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:54.839502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f2d6a-acf8-4bcc-8b53-ac0417ef41c7 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:54.839776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f2d6a-acf8-4bcc-8b53-ac0417ef41c7 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:54.840420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f2d6a-acf8-4bcc-8b53-ac0417ef41c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:54.840724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f2d6a-acf8-4bcc-8b53-ac0417ef41c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:54.842263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f2d6a-acf8-4bcc-8b53-ac0417ef41c7 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:54.864734 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 362/735] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:54.870649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261889b-2bba-4a42-b4e0-7199a040a185 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:54.889220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:54.907660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbeb47-5baf-4cc8-a487-359e0a396fec None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:54.907964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbeb47-5baf-4cc8-a487-359e0a396fec None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:54.908203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbeb47-5baf-4cc8-a487-359e0a396fec None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:54.909814 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 363/736] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:54.914965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c9701-2879-4b8d-8e8f-8cb9c6cb9b36 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:54.915241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c9701-2879-4b8d-8e8f-8cb9c6cb9b36 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:54.915514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c9701-2879-4b8d-8e8f-8cb9c6cb9b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:54.942260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e69c9701-2879-4b8d-8e8f-8cb9c6cb9b36 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:54.944244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e69c9701-2879-4b8d-8e8f-8cb9c6cb9b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:55.004093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:55.050096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261889b-2bba-4a42-b4e0-7199a040a185 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.070257 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 364/737] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:35:55.098607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6d121-058a-4cc8-848b-04246530c03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.099384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d121-058a-4cc8-848b-04246530c03e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.099587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d121-058a-4cc8-848b-04246530c03e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.099907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d121-058a-4cc8-848b-04246530c03e None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.107861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6d121-058a-4cc8-848b-04246530c03e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:55.109385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6d121-058a-4cc8-848b-04246530c03e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-e4c6d121-058a-4cc8-848b-04246530c03e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:55.123852 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:55.126058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:55.128269 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:55.128269 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:55.128269 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:55.128269 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:55.128269 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:55.128269 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:55.128269 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:55.128269 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:55.128269 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 374/738] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:55.133793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c9701-2879-4b8d-8e8f-8cb9c6cb9b36 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:55.186079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6d121-058a-4cc8-848b-04246530c03e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:55.269149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:55.307321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6d121-058a-4cc8-848b-04246530c03e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.310520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c9701-2879-4b8d-8e8f-8cb9c6cb9b36 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.345426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335a65d-262b-4994-8aed-1bad82166448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.346297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335a65d-262b-4994-8aed-1bad82166448 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.346739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335a65d-262b-4994-8aed-1bad82166448 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.347662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335a65d-262b-4994-8aed-1bad82166448 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.360237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335a65d-262b-4994-8aed-1bad82166448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:55.362252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5bdf0-5add-426f-a1ce-50c5efbb9a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.363127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5bdf0-5add-426f-a1ce-50c5efbb9a6d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.363406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5bdf0-5add-426f-a1ce-50c5efbb9a6d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.363680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5bdf0-5add-426f-a1ce-50c5efbb9a6d None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.364390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5bdf0-5add-426f-a1ce-50c5efbb9a6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:55.364697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5bdf0-5add-426f-a1ce-50c5efbb9a6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:55.366212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5bdf0-5add-426f-a1ce-50c5efbb9a6d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-b335a65d-262b-4994-8aed-1bad82166448 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:55.368314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:55.369322 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:55.370159 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:55.370159 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:55.370159 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:55.370159 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:55.370159 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:55.370159 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:55.370159 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:55.370159 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:55.370159 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:55.370159 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:55.370159 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:55.370159 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:55.376699 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 375/739] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:55.380054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335a65d-262b-4994-8aed-1bad82166448 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:55.399975 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 365/740] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:55.405833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5bdf0-5add-426f-a1ce-50c5efbb9a6d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:55.455540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:55.499921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335a65d-262b-4994-8aed-1bad82166448 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.532705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:55.541070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cfc8f-b71d-48dc-9302-7162f6338423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.541711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cfc8f-b71d-48dc-9302-7162f6338423 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.541987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cfc8f-b71d-48dc-9302-7162f6338423 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.542256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cfc8f-b71d-48dc-9302-7162f6338423 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.543022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cfc8f-b71d-48dc-9302-7162f6338423 None admin] RBAC: Adding query filter params (name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:55.543328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cfc8f-b71d-48dc-9302-7162f6338423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:55.544794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cfc8f-b71d-48dc-9302-7162f6338423 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:55.560176 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 376/741] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:55.560176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cfc8f-b71d-48dc-9302-7162f6338423 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:55.605644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5bdf0-5add-426f-a1ce-50c5efbb9a6d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.642655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556bc53-a0df-4efe-aa34-517d52ba7aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.643629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556bc53-a0df-4efe-aa34-517d52ba7aa8 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.644166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556bc53-a0df-4efe-aa34-517d52ba7aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.644638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556bc53-a0df-4efe-aa34-517d52ba7aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.645695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556bc53-a0df-4efe-aa34-517d52ba7aa8 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=5bd5adc10b4344e1847c23c2c0599e59) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:55.646259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556bc53-a0df-4efe-aa34-517d52ba7aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:55.647932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556bc53-a0df-4efe-aa34-517d52ba7aa8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:55.655109 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 366/742] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:55 2022] GET /identity/v3/role_assignments?user.id=5bd5adc10b4344e1847c23c2c0599e59&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=a409f81bd5744563a303a825783bed61 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:55.656328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556bc53-a0df-4efe-aa34-517d52ba7aa8 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:55.686343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cfc8f-b71d-48dc-9302-7162f6338423 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.729159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2304d0-785c-48fe-af4f-9d87b8e8ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.730382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2304d0-785c-48fe-af4f-9d87b8e8ed88 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.730874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2304d0-785c-48fe-af4f-9d87b8e8ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.731408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2304d0-785c-48fe-af4f-9d87b8e8ed88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.746017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2304d0-785c-48fe-af4f-9d87b8e8ed88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-6b2304d0-785c-48fe-af4f-9d87b8e8ed88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:55.752827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:55.753961 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:55.754994 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:55.754994 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:55.754994 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:55.754994 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:55.754994 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:55.754994 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:55.754994 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:55.754994 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:55.754994 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:55.754994 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:55.754994 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:55.754994 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:55.762809 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 377/743] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:35:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:55.764496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ad78d-b322-45a5-bf5b-1b75735754ed None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.764958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ad78d-b322-45a5-bf5b-1b75735754ed None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.765075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:55.765753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ad78d-b322-45a5-bf5b-1b75735754ed None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.767548 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 378/744] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:55.768580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ad78d-b322-45a5-bf5b-1b75735754ed None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:55.775531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556bc53-a0df-4efe-aa34-517d52ba7aa8 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.812658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443cf5d-5fa4-4a43-9fce-d6028ccf2612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.813232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443cf5d-5fa4-4a43-9fce-d6028ccf2612 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.813515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443cf5d-5fa4-4a43-9fce-d6028ccf2612 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.813783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443cf5d-5fa4-4a43-9fce-d6028ccf2612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.826447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443cf5d-5fa4-4a43-9fce-d6028ccf2612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:55.827993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443cf5d-5fa4-4a43-9fce-d6028ccf2612 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:55.834016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-6443cf5d-5fa4-4a43-9fce-d6028ccf2612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:55.846921 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:55.847981 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:55.848867 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:55.848867 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:55.848867 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:55.853527 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 367/745] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:55.855032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d77086-56d4-4d8c-a917-25b1e1e988dd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.855321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d77086-56d4-4d8c-a917-25b1e1e988dd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.855594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d77086-56d4-4d8c-a917-25b1e1e988dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.875762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-66d77086-56d4-4d8c-a917-25b1e1e988dd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:55.876999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-66d77086-56d4-4d8c-a917-25b1e1e988dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:55.895675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ad78d-b322-45a5-bf5b-1b75735754ed None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.933351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd6d70-2131-42be-b56e-fe9b7f284663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.933978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd6d70-2131-42be-b56e-fe9b7f284663 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.934295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd6d70-2131-42be-b56e-fe9b7f284663 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.934577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd6d70-2131-42be-b56e-fe9b7f284663 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.935234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd6d70-2131-42be-b56e-fe9b7f284663 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:55.935537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd6d70-2131-42be-b56e-fe9b7f284663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:55.936916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd6d70-2131-42be-b56e-fe9b7f284663 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:55.946506 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 379/746] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:55.947321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd6d70-2131-42be-b56e-fe9b7f284663 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:55.976331 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 368/747] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:35:55.977725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d77086-56d4-4d8c-a917-25b1e1e988dd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:56.094876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd6d70-2131-42be-b56e-fe9b7f284663 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:56.109287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:56.125740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:56.141367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb72eb-5bcf-443e-833f-257268c6184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:56.141367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb72eb-5bcf-443e-833f-257268c6184e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:56.141367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb72eb-5bcf-443e-833f-257268c6184e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:56.141367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb72eb-5bcf-443e-833f-257268c6184e None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:56.141721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb72eb-5bcf-443e-833f-257268c6184e None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:56.141721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb72eb-5bcf-443e-833f-257268c6184e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:56.141721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb72eb-5bcf-443e-833f-257268c6184e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:56.150685 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 380/748] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:56.156400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb72eb-5bcf-443e-833f-257268c6184e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:56.203374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d77086-56d4-4d8c-a917-25b1e1e988dd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:56.260237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb72eb-5bcf-443e-833f-257268c6184e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:56.263668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746cbac-262c-4b8e-98eb-a3f149d70b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:56.264314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746cbac-262c-4b8e-98eb-a3f149d70b32 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:56.264597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746cbac-262c-4b8e-98eb-a3f149d70b32 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:56.264870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746cbac-262c-4b8e-98eb-a3f149d70b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:56.280856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746cbac-262c-4b8e-98eb-a3f149d70b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:56.282352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746cbac-262c-4b8e-98eb-a3f149d70b32 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:56.297764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae29192-de7d-4284-bb34-5f1c160b5a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:56.298449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae29192-de7d-4284-bb34-5f1c160b5a87 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:56.298722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae29192-de7d-4284-bb34-5f1c160b5a87 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:56.298987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae29192-de7d-4284-bb34-5f1c160b5a87 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:56.307515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae29192-de7d-4284-bb34-5f1c160b5a87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-d746cbac-262c-4b8e-98eb-a3f149d70b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:56.308585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:56.309540 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:56.310809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:56.310809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:56.310809 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:56.310991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae29192-de7d-4284-bb34-5f1c160b5a87 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:56.311061 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 369/749] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:56.316757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746cbac-262c-4b8e-98eb-a3f149d70b32 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-eae29192-de7d-4284-bb34-5f1c160b5a87 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:56.327780 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:56.328756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:56.331001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:56.331001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:56.331001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:56.331001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:56.331001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:56.331001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:56.331001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:56.331001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:56.331001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 08 20:35:56.331001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:56.331001 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 381/750] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Oct 8 20:35:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:56.334855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae29192-de7d-4284-bb34-5f1c160b5a87 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:56.375537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:56.459094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae29192-de7d-4284-bb34-5f1c160b5a87 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:56.496112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746cbac-262c-4b8e-98eb-a3f149d70b32 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:56.517866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a05a8c-fba8-4d91-a509-dcc77326a4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:56.521979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05a8c-fba8-4d91-a509-dcc77326a4fd None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:56.522514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05a8c-fba8-4d91-a509-dcc77326a4fd None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:56.522514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05a8c-fba8-4d91-a509-dcc77326a4fd None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:56.523242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a05a8c-fba8-4d91-a509-dcc77326a4fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:56.523543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a05a8c-fba8-4d91-a509-dcc77326a4fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:56.524983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a05a8c-fba8-4d91-a509-dcc77326a4fd None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:56.531927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:56.544641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9662a-15e3-4089-9038-0c9753433c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:56.545618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9662a-15e3-4089-9038-0c9753433c0b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:56.546169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9662a-15e3-4089-9038-0c9753433c0b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:56.546639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9662a-15e3-4089-9038-0c9753433c0b None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:56.547526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9662a-15e3-4089-9038-0c9753433c0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:56.548030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9662a-15e3-4089-9038-0c9753433c0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:56.549840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9662a-15e3-4089-9038-0c9753433c0b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:56.549950 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 382/751] 10.222.0.26 () {56 vars in 1149 bytes} [Sat Oct 8 20:35:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:56.550817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a05a8c-fba8-4d91-a509-dcc77326a4fd None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:56.565221 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 370/752] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:56.566489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9662a-15e3-4089-9038-0c9753433c0b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:56.657019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:56.666733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a05a8c-fba8-4d91-a509-dcc77326a4fd None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:56.680380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9662a-15e3-4089-9038-0c9753433c0b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:56.704368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b69a9-a0b5-4eb6-bbba-42543fdb1592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:56.705138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b69a9-a0b5-4eb6-bbba-42543fdb1592 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:56.705593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b69a9-a0b5-4eb6-bbba-42543fdb1592 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:56.705998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b69a9-a0b5-4eb6-bbba-42543fdb1592 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:56.706956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b69a9-a0b5-4eb6-bbba-42543fdb1592 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:56.708283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b69a9-a0b5-4eb6-bbba-42543fdb1592 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:56.720963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6562c6-67a8-4aca-9119-d8bcf3d29b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:56.721868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6562c6-67a8-4aca-9119-d8bcf3d29b19 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:56.722345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6562c6-67a8-4aca-9119-d8bcf3d29b19 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:56.722819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6562c6-67a8-4aca-9119-d8bcf3d29b19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:56.733331 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 383/753] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:35:56 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:35:56.734305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b69a9-a0b5-4eb6-bbba-42543fdb1592 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:56.802049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:56.829249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6562c6-67a8-4aca-9119-d8bcf3d29b19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:56.832507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6562c6-67a8-4aca-9119-d8bcf3d29b19 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:56.882693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b69a9-a0b5-4eb6-bbba-42543fdb1592 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:56.935589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82bebe-c4cb-40f6-8190-160a6e98393c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:56.936188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82bebe-c4cb-40f6-8190-160a6e98393c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:56.936474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82bebe-c4cb-40f6-8190-160a6e98393c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:56.936751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82bebe-c4cb-40f6-8190-160a6e98393c None admin] PATH_INFO: `/v3/users/nova` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:56.948194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82bebe-c4cb-40f6-8190-160a6e98393c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:56.950506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82bebe-c4cb-40f6-8190-160a6e98393c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-fa82bebe-c4cb-40f6-8190-160a6e98393c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:56.965995 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:56.967018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:56.967979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:56.967979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:56.967979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:56.967979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:56.967979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:56.967979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:56.967979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:56.967979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:56.967979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:35:56.967979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:56.975288 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 384/754] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Oct 8 20:35:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:56.975970 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 371/755] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:56 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:35:56.977474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6562c6-67a8-4aca-9119-d8bcf3d29b19 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:56.978741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2266f8c-2d68-4e4a-bce9-e38259fe4f11 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:56.979291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2266f8c-2d68-4e4a-bce9-e38259fe4f11 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:56.979775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2266f8c-2d68-4e4a-bce9-e38259fe4f11 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:56.981559 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 385/756] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:56.987980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de166b-ca3b-427d-8663-61b721c06ce1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:56.988544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de166b-ca3b-427d-8663-61b721c06ce1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:56.989011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de166b-ca3b-427d-8663-61b721c06ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:57.011332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b0de166b-ca3b-427d-8663-61b721c06ce1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:57.012524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b0de166b-ca3b-427d-8663-61b721c06ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:57.014846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:57.086936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:57.104535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6562c6-67a8-4aca-9119-d8bcf3d29b19 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:57.107915 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 386/757] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:35:57.108834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de166b-ca3b-427d-8663-61b721c06ce1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:57.141246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1715d0-0c2e-4690-a06a-73e343522301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:57.141913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1715d0-0c2e-4690-a06a-73e343522301 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:57.142194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1715d0-0c2e-4690-a06a-73e343522301 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:57.142518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1715d0-0c2e-4690-a06a-73e343522301 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:57.143253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1715d0-0c2e-4690-a06a-73e343522301 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:57.143553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1715d0-0c2e-4690-a06a-73e343522301 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:57.144972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1715d0-0c2e-4690-a06a-73e343522301 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:57.168495 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 372/758] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Oct 8 20:35:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:57.169794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1715d0-0c2e-4690-a06a-73e343522301 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:57.233947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de166b-ca3b-427d-8663-61b721c06ce1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:57.280749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1568d-3538-4b80-8c9c-f7f6f32c67de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:57.283783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1568d-3538-4b80-8c9c-f7f6f32c67de None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:57.284807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1568d-3538-4b80-8c9c-f7f6f32c67de None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:57.285455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1568d-3538-4b80-8c9c-f7f6f32c67de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:57.287473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1715d0-0c2e-4690-a06a-73e343522301 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:57.301122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:57.314195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1568d-3538-4b80-8c9c-f7f6f32c67de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:57.315663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1568d-3538-4b80-8c9c-f7f6f32c67de None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:57.328889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775046fd-324a-4219-a6ed-ac5c685e01d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:57.329843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775046fd-324a-4219-a6ed-ac5c685e01d0 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:57.330320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775046fd-324a-4219-a6ed-ac5c685e01d0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:57.330785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775046fd-324a-4219-a6ed-ac5c685e01d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-b5e1568d-3538-4b80-8c9c-f7f6f32c67de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:57.342178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:57.343149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:57.344080 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:57.344080 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:57.344080 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:57.348280 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 387/759] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:57.352803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775046fd-324a-4219-a6ed-ac5c685e01d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:57.354625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775046fd-324a-4219-a6ed-ac5c685e01d0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:57.355759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1568d-3538-4b80-8c9c-f7f6f32c67de None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:57.362031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-775046fd-324a-4219-a6ed-ac5c685e01d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:57.386685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:57.387690 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:57.388612 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:57.388612 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:57.388612 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:57.397241 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 373/760] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:57.401800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775046fd-324a-4219-a6ed-ac5c685e01d0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:57.543678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1568d-3538-4b80-8c9c-f7f6f32c67de None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:57.580870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a33bb1-b62a-4f89-843f-1aba4c4a0876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:57.581074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775046fd-324a-4219-a6ed-ac5c685e01d0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:57.582030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a33bb1-b62a-4f89-843f-1aba4c4a0876 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:57.582623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a33bb1-b62a-4f89-843f-1aba4c4a0876 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:57.583090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a33bb1-b62a-4f89-843f-1aba4c4a0876 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:57.583982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a33bb1-b62a-4f89-843f-1aba4c4a0876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:57.584479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a33bb1-b62a-4f89-843f-1aba4c4a0876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:57.586725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a33bb1-b62a-4f89-843f-1aba4c4a0876 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:57.600336 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 388/761] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:57.601365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a33bb1-b62a-4f89-843f-1aba4c4a0876 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:57.622883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbcbb0-ec66-46ce-8ca6-ebcc7990554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:57.623560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbcbb0-ec66-46ce-8ca6-ebcc7990554f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:57.623839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbcbb0-ec66-46ce-8ca6-ebcc7990554f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:57.624128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbcbb0-ec66-46ce-8ca6-ebcc7990554f None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:57.624850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbcbb0-ec66-46ce-8ca6-ebcc7990554f None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:57.625152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbcbb0-ec66-46ce-8ca6-ebcc7990554f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:57.626567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbcbb0-ec66-46ce-8ca6-ebcc7990554f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:57.647116 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 374/762] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:57.648281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbcbb0-ec66-46ce-8ca6-ebcc7990554f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:57.665640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:57.721757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a33bb1-b62a-4f89-843f-1aba4c4a0876 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:57.723452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:57.767956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d692f6-7c71-44b5-b3aa-2b2ca8806067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:57.769638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d692f6-7c71-44b5-b3aa-2b2ca8806067 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:57.770125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d692f6-7c71-44b5-b3aa-2b2ca8806067 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:57.770679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d692f6-7c71-44b5-b3aa-2b2ca8806067 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:57.771590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d692f6-7c71-44b5-b3aa-2b2ca8806067 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:57.773133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d692f6-7c71-44b5-b3aa-2b2ca8806067 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:57.775076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbcbb0-ec66-46ce-8ca6-ebcc7990554f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-e8d692f6-7c71-44b5-b3aa-2b2ca8806067 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:57.785646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:57.786691 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:35:57.787545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:57.790905 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 389/763] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Oct 8 20:35:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:57.791993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d692f6-7c71-44b5-b3aa-2b2ca8806067 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:57.815103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2558a-d9e1-4ed5-9a27-d41f0fe82461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:57.815768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2558a-d9e1-4ed5-9a27-d41f0fe82461 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:57.816149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2558a-d9e1-4ed5-9a27-d41f0fe82461 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:57.816523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2558a-d9e1-4ed5-9a27-d41f0fe82461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:57.824517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2558a-d9e1-4ed5-9a27-d41f0fe82461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:57.826420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2558a-d9e1-4ed5-9a27-d41f0fe82461 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-52c2558a-d9e1-4ed5-9a27-d41f0fe82461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:57.838952 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:57.840130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:57.841291 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:57.841291 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:57.841291 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:57.841291 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:57.841291 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:57.841291 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:57.841291 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:57.841291 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:57.847801 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 375/764] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:57.849099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2558a-d9e1-4ed5-9a27-d41f0fe82461 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:57.923047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d692f6-7c71-44b5-b3aa-2b2ca8806067 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:57.940305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:57.968356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2338f5d-d05a-4cbc-bd26-3b3fe84bfcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:57.969347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2338f5d-d05a-4cbc-bd26-3b3fe84bfcc1 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:57.969775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2338f5d-d05a-4cbc-bd26-3b3fe84bfcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:57.970195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2338f5d-d05a-4cbc-bd26-3b3fe84bfcc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:57.974998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2558a-d9e1-4ed5-9a27-d41f0fe82461 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:57.979190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2338f5d-d05a-4cbc-bd26-3b3fe84bfcc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:57.980787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2338f5d-d05a-4cbc-bd26-3b3fe84bfcc1 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:57.991060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-f2338f5d-d05a-4cbc-bd26-3b3fe84bfcc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:57.995624 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:57.997038 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:57.998122 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:57.998122 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:57.998122 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:57.998122 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:57.998122 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:57.998122 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:57.998122 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:57.998122 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:35:58.004762 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 390/765] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:58.006856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2338f5d-d05a-4cbc-bd26-3b3fe84bfcc1 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:58.017121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514174b-f5ee-4542-8743-57a3a363d0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:58.017886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514174b-f5ee-4542-8743-57a3a363d0f8 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:58.018265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514174b-f5ee-4542-8743-57a3a363d0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:58.018646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514174b-f5ee-4542-8743-57a3a363d0f8 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:58.019560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514174b-f5ee-4542-8743-57a3a363d0f8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:58.019975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514174b-f5ee-4542-8743-57a3a363d0f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:58.021531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514174b-f5ee-4542-8743-57a3a363d0f8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:58.027138 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 376/766] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Oct 8 20:35:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:58.028041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514174b-f5ee-4542-8743-57a3a363d0f8 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:58.135508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2338f5d-d05a-4cbc-bd26-3b3fe84bfcc1 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:58.135717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514174b-f5ee-4542-8743-57a3a363d0f8 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:58.173249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975a61d-c702-4778-8df2-c65c7004b57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:58.174013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975a61d-c702-4778-8df2-c65c7004b57a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:58.174407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975a61d-c702-4778-8df2-c65c7004b57a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:58.174786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975a61d-c702-4778-8df2-c65c7004b57a None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:58.175594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975a61d-c702-4778-8df2-c65c7004b57a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:58.176069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975a61d-c702-4778-8df2-c65c7004b57a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:58.176752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86236b26-5b0e-477c-98ed-5ea860195a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:58.177552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236b26-5b0e-477c-98ed-5ea860195a75 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:58.177896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975a61d-c702-4778-8df2-c65c7004b57a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:58.178152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236b26-5b0e-477c-98ed-5ea860195a75 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:58.178570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236b26-5b0e-477c-98ed-5ea860195a75 None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:58.179400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86236b26-5b0e-477c-98ed-5ea860195a75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:58.179993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86236b26-5b0e-477c-98ed-5ea860195a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:58.181707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86236b26-5b0e-477c-98ed-5ea860195a75 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:58.193241 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 377/767] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:58.193241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975a61d-c702-4778-8df2-c65c7004b57a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:58.200363 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 391/768] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:58.203381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86236b26-5b0e-477c-98ed-5ea860195a75 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:58.242378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:58.249649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:58.313703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975a61d-c702-4778-8df2-c65c7004b57a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:58.326108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86236b26-5b0e-477c-98ed-5ea860195a75 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:58.355604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e6469-cd07-4beb-a4ee-099b6de76de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:58.356578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e6469-cd07-4beb-a4ee-099b6de76de4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:58.356921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e6469-cd07-4beb-a4ee-099b6de76de4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:58.357239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e6469-cd07-4beb-a4ee-099b6de76de4 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:58.357856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e6469-cd07-4beb-a4ee-099b6de76de4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:58.358154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e6469-cd07-4beb-a4ee-099b6de76de4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:58.359586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e6469-cd07-4beb-a4ee-099b6de76de4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:58.363554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e14cc2-a50b-4645-b432-38e97fa7bd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:58.364212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e14cc2-a50b-4645-b432-38e97fa7bd25 None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:58.364490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e14cc2-a50b-4645-b432-38e97fa7bd25 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:58.369459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e14cc2-a50b-4645-b432-38e97fa7bd25 None admin] PATH_INFO: `/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/187d6f51b1604327a4879e9e19b47963/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:58.369593 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 378/769] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Oct 8 20:35:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:58.369593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e6469-cd07-4beb-a4ee-099b6de76de4 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:58.369756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e14cc2-a50b-4645-b432-38e97fa7bd25 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba1e9ad05694bbe8723c14f5e2b08f7, user_id=187d6f51b1604327a4879e9e19b47963, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:58.369756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e14cc2-a50b-4645-b432-38e97fa7bd25 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:58.389778 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 392/770] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:35:58 2022] PUT /identity/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/187d6f51b1604327a4879e9e19b47963/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:35:58.389778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18959a2-ad36-48fa-a435-41b8396fc732 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:58.389778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18959a2-ad36-48fa-a435-41b8396fc732 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:58.389778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18959a2-ad36-48fa-a435-41b8396fc732 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:58.389778 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 393/771] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:58.389778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18959a2-ad36-48fa-a435-41b8396fc732 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:58.517294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:58.531099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e6469-cd07-4beb-a4ee-099b6de76de4 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:58.532972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:58.536632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18959a2-ad36-48fa-a435-41b8396fc732 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:58.581035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84ded-0baf-413c-bc9c-335ca222f950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:58.581852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84ded-0baf-413c-bc9c-335ca222f950 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:58.582136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84ded-0baf-413c-bc9c-335ca222f950 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:58.582502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84ded-0baf-413c-bc9c-335ca222f950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:58.583351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca84ded-0baf-413c-bc9c-335ca222f950 None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=5a6d89a355d4415a95913449481b3e6b) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:58.583665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca84ded-0baf-413c-bc9c-335ca222f950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:58.584385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f2e14-5083-4e13-9c59-ed6e8cacac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:58.585009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2e14-5083-4e13-9c59-ed6e8cacac2a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:58.585349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2e14-5083-4e13-9c59-ed6e8cacac2a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:58.585464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca84ded-0baf-413c-bc9c-335ca222f950 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:58.585659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2e14-5083-4e13-9c59-ed6e8cacac2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:58.586386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f2e14-5083-4e13-9c59-ed6e8cacac2a None admin] RBAC: Adding query filter params (interface=public, service_id=f824dc68bf814d1c845d5ba9ec3181de, region_id=RegionOne) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:58.586700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f2e14-5083-4e13-9c59-ed6e8cacac2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:58.588185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f2e14-5083-4e13-9c59-ed6e8cacac2a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:58.592328 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 379/772] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:58 2022] GET /identity/v3/role_assignments?user.id=5a6d89a355d4415a95913449481b3e6b&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:58.594092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d30b-c31b-4d9b-9b06-d0ae54b4f04b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:58.594378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d30b-c31b-4d9b-9b06-d0ae54b4f04b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:58.594703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d30b-c31b-4d9b-9b06-d0ae54b4f04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:58.596764 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 394/773] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Oct 8 20:35:58 2022] GET /identity/v3/endpoints?service_id=f824dc68bf814d1c845d5ba9ec3181de&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:58.603712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f2e14-5083-4e13-9c59-ed6e8cacac2a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:58.615122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2dd8d30b-c31b-4d9b-9b06-d0ae54b4f04b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:58.616401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2dd8d30b-c31b-4d9b-9b06-d0ae54b4f04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:58.700428 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 380/774] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:35:58.728922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f2e14-5083-4e13-9c59-ed6e8cacac2a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:58.768068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81f686-037a-4535-a5de-506269fb8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:58.768691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81f686-037a-4535-a5de-506269fb8ffd None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:58.768971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81f686-037a-4535-a5de-506269fb8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:58.769267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81f686-037a-4535-a5de-506269fb8ffd None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:58.769887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81f686-037a-4535-a5de-506269fb8ffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:58.771324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81f686-037a-4535-a5de-506269fb8ffd None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:58.777406 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 395/775] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Oct 8 20:35:58 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:59.052509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d30b-c31b-4d9b-9b06-d0ae54b4f04b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:59.160455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:59.167243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d30b-c31b-4d9b-9b06-d0ae54b4f04b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:59.208513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9624c6-9547-4309-837a-2250c1ec0b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:59.209158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9624c6-9547-4309-837a-2250c1ec0b84 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:59.209461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9624c6-9547-4309-837a-2250c1ec0b84 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:59.209739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9624c6-9547-4309-837a-2250c1ec0b84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:59.220690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9624c6-9547-4309-837a-2250c1ec0b84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-2a9624c6-9547-4309-837a-2250c1ec0b84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:59.225912 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:59.229882 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:59.232075 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:59.232075 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:59.232075 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:59.232075 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:59.232075 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:59.232075 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:59.232075 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:59.232075 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:59.232075 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:59.232075 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:59.232075 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:35:59.232075 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:59.232075 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 381/776] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:35:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:59.233904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81f686-037a-4535-a5de-506269fb8ffd None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:59.261233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:59.349516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81f686-037a-4535-a5de-506269fb8ffd None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:59.384292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b299b-d1ae-4048-bb87-03efe489d1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:59.384909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b299b-d1ae-4048-bb87-03efe489d1cb None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:59.385209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b299b-d1ae-4048-bb87-03efe489d1cb None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:59.385484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b299b-d1ae-4048-bb87-03efe489d1cb None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:59.386152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b299b-d1ae-4048-bb87-03efe489d1cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:59.386457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b299b-d1ae-4048-bb87-03efe489d1cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:59.387807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b299b-d1ae-4048-bb87-03efe489d1cb None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:59.400843 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 396/777] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:35:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:59.406518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9624c6-9547-4309-837a-2250c1ec0b84 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:59.536240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546d43c-6a5c-4545-8a36-9adea1f780de None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:59.536588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546d43c-6a5c-4545-8a36-9adea1f780de None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:59.536794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546d43c-6a5c-4545-8a36-9adea1f780de None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:59.538301 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 397/778] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:35:59.547184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9624c6-9547-4309-837a-2250c1ec0b84 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:59.550144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bf47e-944f-43d4-87a1-e2043ea8ba37 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:59.550430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bf47e-944f-43d4-87a1-e2043ea8ba37 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:59.550704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bf47e-944f-43d4-87a1-e2043ea8ba37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:59.586254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cd7bf47e-944f-43d4-87a1-e2043ea8ba37 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:59.587460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cd7bf47e-944f-43d4-87a1-e2043ea8ba37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:59.590327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163eaa6-d400-486b-b856-a8cf98899260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:59.590970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163eaa6-d400-486b-b856-a8cf98899260 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:59.591252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163eaa6-d400-486b-b856-a8cf98899260 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:59.591529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163eaa6-d400-486b-b856-a8cf98899260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:59.603731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163eaa6-d400-486b-b856-a8cf98899260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:59.605312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163eaa6-d400-486b-b856-a8cf98899260 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-a163eaa6-d400-486b-b856-a8cf98899260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:59.621959 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:59.622975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:59.624453 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:59.624453 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:59.624453 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:35:59.624453 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 382/779] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:59.629250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163eaa6-d400-486b-b856-a8cf98899260 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:59.644727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:59.691742 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 398/780] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:35:59.790369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163eaa6-d400-486b-b856-a8cf98899260 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:59.824783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0246e8-8059-47a4-ad46-670c94c5c39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:59.825416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0246e8-8059-47a4-ad46-670c94c5c39c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:59.825698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0246e8-8059-47a4-ad46-670c94c5c39c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:59.825974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0246e8-8059-47a4-ad46-670c94c5c39c None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:59.826621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0246e8-8059-47a4-ad46-670c94c5c39c None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:59.826934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0246e8-8059-47a4-ad46-670c94c5c39c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:59.828296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0246e8-8059-47a4-ad46-670c94c5c39c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:59.840542 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 383/781] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:59.850310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bf47e-944f-43d4-87a1-e2043ea8ba37 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:59.867423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:59.968360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bf47e-944f-43d4-87a1-e2043ea8ba37 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:00.005156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243fb76-968e-4d8c-bb43-3490209ac464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:00.005936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243fb76-968e-4d8c-bb43-3490209ac464 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:00.006220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243fb76-968e-4d8c-bb43-3490209ac464 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:00.006493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243fb76-968e-4d8c-bb43-3490209ac464 None admin] PATH_INFO: `/v3/users/swift` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:00.015702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243fb76-968e-4d8c-bb43-3490209ac464 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:00.017220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243fb76-968e-4d8c-bb43-3490209ac464 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-0243fb76-968e-4d8c-bb43-3490209ac464 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:00.030868 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:00.033244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:00.035491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:00.035491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:00.035491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:00.035491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:00.035491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:00.035491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:00.035491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:00.035491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:00.035491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 08 20:36:00.035491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:00.035491 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 399/782] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:35:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:00.041901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0246e8-8059-47a4-ad46-670c94c5c39c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:00.130782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:00.168495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243fb76-968e-4d8c-bb43-3490209ac464 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:00.180818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0246e8-8059-47a4-ad46-670c94c5c39c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:00.244417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5205cde-58c7-4396-97ff-0cd13e0288de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:00.245500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5205cde-58c7-4396-97ff-0cd13e0288de None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:00.245992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5205cde-58c7-4396-97ff-0cd13e0288de None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:00.246470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5205cde-58c7-4396-97ff-0cd13e0288de None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:00.247389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5205cde-58c7-4396-97ff-0cd13e0288de None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:00.247903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5205cde-58c7-4396-97ff-0cd13e0288de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:00.249639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5205cde-58c7-4396-97ff-0cd13e0288de None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:00.281000 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 384/783] 10.222.0.26 () {56 vars in 1135 bytes} [Sat Oct 8 20:36:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:00.286752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5205cde-58c7-4396-97ff-0cd13e0288de None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:00.294368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:00.323711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243fb76-968e-4d8c-bb43-3490209ac464 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:00.361374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d51f5-dd7a-49b2-8e50-5b611e5cff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:00.362864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d51f5-dd7a-49b2-8e50-5b611e5cff30 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:00.364274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d51f5-dd7a-49b2-8e50-5b611e5cff30 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:00.364765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d51f5-dd7a-49b2-8e50-5b611e5cff30 None admin] PATH_INFO: `/v3/services/network` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:00.365588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d51f5-dd7a-49b2-8e50-5b611e5cff30 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:00.367159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d51f5-dd7a-49b2-8e50-5b611e5cff30 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-ca5d51f5-dd7a-49b2-8e50-5b611e5cff30 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:00.377525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:00.378582 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:36:00.379427 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:00.389337 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 400/784] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:00 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:00.390760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d51f5-dd7a-49b2-8e50-5b611e5cff30 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:00.494535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5205cde-58c7-4396-97ff-0cd13e0288de None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:00.525504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:00.533398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db75f84-5c41-46af-892b-e5c1346b9be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:00.534036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db75f84-5c41-46af-892b-e5c1346b9be4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:00.534323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db75f84-5c41-46af-892b-e5c1346b9be4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:00.534700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db75f84-5c41-46af-892b-e5c1346b9be4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:00.545459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db75f84-5c41-46af-892b-e5c1346b9be4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:00.547179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db75f84-5c41-46af-892b-e5c1346b9be4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:00.557958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d51f5-dd7a-49b2-8e50-5b611e5cff30 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-6db75f84-5c41-46af-892b-e5c1346b9be4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:00.563412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:00.564333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:00.565273 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:00.565273 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:00.565273 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:00.568307 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 385/785] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:00.578784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db75f84-5c41-46af-892b-e5c1346b9be4 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:00.604556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd9a5f-de67-4c75-8375-4c8b4654193c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:00.605594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd9a5f-de67-4c75-8375-4c8b4654193c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:00.606093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd9a5f-de67-4c75-8375-4c8b4654193c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:00.606774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd9a5f-de67-4c75-8375-4c8b4654193c None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:00.607618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd9a5f-de67-4c75-8375-4c8b4654193c None admin] RBAC: Adding query filter params (name=network) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:00.608133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd9a5f-de67-4c75-8375-4c8b4654193c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:00.609732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd9a5f-de67-4c75-8375-4c8b4654193c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:00.620746 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 401/786] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Oct 8 20:36:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:00.622305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd9a5f-de67-4c75-8375-4c8b4654193c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:00.634376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:00.773799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db75f84-5c41-46af-892b-e5c1346b9be4 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:00.776062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd9a5f-de67-4c75-8375-4c8b4654193c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:00.844024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3340be9-f1b5-4d02-8bc0-1856d975bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:00.845002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f4d1e-c0c8-4242-841e-bd1dbb63b814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:00.845964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f4d1e-c0c8-4242-841e-bd1dbb63b814 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:00.846454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f4d1e-c0c8-4242-841e-bd1dbb63b814 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:00.846960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f4d1e-c0c8-4242-841e-bd1dbb63b814 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:00.847796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f4d1e-c0c8-4242-841e-bd1dbb63b814 None admin] RBAC: Adding query filter params (type=network) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:00.848301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f4d1e-c0c8-4242-841e-bd1dbb63b814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:00.849901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f4d1e-c0c8-4242-841e-bd1dbb63b814 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:00.850026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3340be9-f1b5-4d02-8bc0-1856d975bdbb None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:00.850238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3340be9-f1b5-4d02-8bc0-1856d975bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:00.850501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3340be9-f1b5-4d02-8bc0-1856d975bdbb None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:00.851166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3340be9-f1b5-4d02-8bc0-1856d975bdbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:00.851473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3340be9-f1b5-4d02-8bc0-1856d975bdbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:00.853723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3340be9-f1b5-4d02-8bc0-1856d975bdbb None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:00.863341 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 402/787] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Oct 8 20:36:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:00.864842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f4d1e-c0c8-4242-841e-bd1dbb63b814 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:00.875322 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 386/788] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:00.886163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3340be9-f1b5-4d02-8bc0-1856d975bdbb None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:00.960083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:00.970449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:01.044340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f4d1e-c0c8-4242-841e-bd1dbb63b814 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:01.095104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3340be9-f1b5-4d02-8bc0-1856d975bdbb None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:01.126702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552221c1-b618-4011-a184-e0ef3e62b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:01.128927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552221c1-b618-4011-a184-e0ef3e62b82d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:01.129306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552221c1-b618-4011-a184-e0ef3e62b82d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:01.129504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552221c1-b618-4011-a184-e0ef3e62b82d None admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:01.131532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552221c1-b618-4011-a184-e0ef3e62b82d None admin] RBAC: Adding query filter params (interface=public, service_id=25b244d2e7bb4a83b64beeecc835e710, region_id=RegionOne) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:01.131852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552221c1-b618-4011-a184-e0ef3e62b82d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:01.133274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552221c1-b618-4011-a184-e0ef3e62b82d None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:01.145672 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 403/789] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Oct 8 20:36:00 2022] GET /identity/v3/endpoints?service_id=25b244d2e7bb4a83b64beeecc835e710&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:01.154953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552221c1-b618-4011-a184-e0ef3e62b82d None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:01.158773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1f70d-89c0-4d6f-9f25-5d2259af6db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:01.160298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1f70d-89c0-4d6f-9f25-5d2259af6db8 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:01.160580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1f70d-89c0-4d6f-9f25-5d2259af6db8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:01.160853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1f70d-89c0-4d6f-9f25-5d2259af6db8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:01.174081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1f70d-89c0-4d6f-9f25-5d2259af6db8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:01.175537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1f70d-89c0-4d6f-9f25-5d2259af6db8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-d8c1f70d-89c0-4d6f-9f25-5d2259af6db8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:01.197224 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:01.198192 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:01.199097 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:01.199097 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:01.199097 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:01.199097 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:01.199097 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:01.199097 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:01.199097 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:01.199097 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:01.208967 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 387/790] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:01.212675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1f70d-89c0-4d6f-9f25-5d2259af6db8 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:01.379504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552221c1-b618-4011-a184-e0ef3e62b82d None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:01.383060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:01.395089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1f70d-89c0-4d6f-9f25-5d2259af6db8 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:01.442412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:01.454790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b93e1-e750-4f17-819d-a2e82644ff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:01.455400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b93e1-e750-4f17-819d-a2e82644ff35 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:01.455674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b93e1-e750-4f17-819d-a2e82644ff35 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:01.455941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b93e1-e750-4f17-819d-a2e82644ff35 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:01.456547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b93e1-e750-4f17-819d-a2e82644ff35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:01.457922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b93e1-e750-4f17-819d-a2e82644ff35 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:01.472083 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 404/791] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Oct 8 20:36:01 2022] GET /identity/v3/services => generated 772 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:01.472649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8fb8d-0aef-4d22-8388-0d8100bc6ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:01.473287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8fb8d-0aef-4d22-8388-0d8100bc6ca7 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:01.473567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8fb8d-0aef-4d22-8388-0d8100bc6ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:01.473833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8fb8d-0aef-4d22-8388-0d8100bc6ca7 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:01.474679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8fb8d-0aef-4d22-8388-0d8100bc6ca7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:01.474957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8fb8d-0aef-4d22-8388-0d8100bc6ca7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:01.476539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8fb8d-0aef-4d22-8388-0d8100bc6ca7 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:01.514391 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 388/792] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:01.520991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b93e1-e750-4f17-819d-a2e82644ff35 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:01.530823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda346-0c65-4354-9a0a-2bf444fa0524 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:01.531184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda346-0c65-4354-9a0a-2bf444fa0524 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:01.531387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda346-0c65-4354-9a0a-2bf444fa0524 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:01.533033 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 389/793] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:01.538643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254d2df-3b4e-4e04-bb23-06eb46448c77 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:01.538948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254d2df-3b4e-4e04-bb23-06eb46448c77 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:01.539244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254d2df-3b4e-4e04-bb23-06eb46448c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:01.559420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1254d2df-3b4e-4e04-bb23-06eb46448c77 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:01.560652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1254d2df-3b4e-4e04-bb23-06eb46448c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:01.658829 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 390/794] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:01.660394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd326f6c-b1ea-422c-8a69-f6f67e756edf None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:01.660876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd326f6c-b1ea-422c-8a69-f6f67e756edf None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:01.661059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd326f6c-b1ea-422c-8a69-f6f67e756edf None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:01.666766 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 391/795] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:01.668698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7060c-73ce-416a-9a0f-aab99f4a8275 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:01.669237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7060c-73ce-416a-9a0f-aab99f4a8275 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:01.669665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7060c-73ce-416a-9a0f-aab99f4a8275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:01.713630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d2b7060c-73ce-416a-9a0f-aab99f4a8275 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:01.715870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d2b7060c-73ce-416a-9a0f-aab99f4a8275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:01.730776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b93e1-e750-4f17-819d-a2e82644ff35 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:01.782791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e258a97-a98c-48b6-ad0c-1e7c6c1eb64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:01.783840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e258a97-a98c-48b6-ad0c-1e7c6c1eb64b None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:01.784792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e258a97-a98c-48b6-ad0c-1e7c6c1eb64b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:01.785353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e258a97-a98c-48b6-ad0c-1e7c6c1eb64b None admin] PATH_INFO: `/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/5bd5adc10b4344e1847c23c2c0599e59/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:01.787707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e258a97-a98c-48b6-ad0c-1e7c6c1eb64b None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba1e9ad05694bbe8723c14f5e2b08f7, user_id=5bd5adc10b4344e1847c23c2c0599e59, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:01.790178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e258a97-a98c-48b6-ad0c-1e7c6c1eb64b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:01.798826 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 392/796] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:01.808664 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 405/797] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:36:01 2022] PUT /identity/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/5bd5adc10b4344e1847c23c2c0599e59/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:36:02.009847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7060c-73ce-416a-9a0f-aab99f4a8275 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:02.038290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:02.135191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08f09f-f330-4569-af77-bb89aa0f8a07 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:02.135526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08f09f-f330-4569-af77-bb89aa0f8a07 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:02.135787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08f09f-f330-4569-af77-bb89aa0f8a07 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:02.137440 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 406/798] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:02.142856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900c191-55b0-4335-b02f-08352663253a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:02.143220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900c191-55b0-4335-b02f-08352663253a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:02.143425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900c191-55b0-4335-b02f-08352663253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:02.147342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7060c-73ce-416a-9a0f-aab99f4a8275 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:02.168662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c900c191-55b0-4335-b02f-08352663253a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:02.169943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c900c191-55b0-4335-b02f-08352663253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:02.197748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b79e64-6bd5-4b27-9f75-7e5720c9be99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:02.198461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b79e64-6bd5-4b27-9f75-7e5720c9be99 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:02.198660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b79e64-6bd5-4b27-9f75-7e5720c9be99 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:02.198931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b79e64-6bd5-4b27-9f75-7e5720c9be99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:02.211343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b79e64-6bd5-4b27-9f75-7e5720c9be99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-06b79e64-6bd5-4b27-9f75-7e5720c9be99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:02.216349 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:02.217350 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:02.218217 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:02.218217 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:02.218217 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:02.218217 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:02.218217 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:02.218217 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:02.218217 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:02.218217 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:02.218217 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:02.218217 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:02.218217 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:02.218217 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:02.218217 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 393/799] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:36:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:02.223484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b79e64-6bd5-4b27-9f75-7e5720c9be99 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:02.244894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:02.268542 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 407/800] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:02.318446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:02.333725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900c191-55b0-4335-b02f-08352663253a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:02.341517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b79e64-6bd5-4b27-9f75-7e5720c9be99 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:02.407956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb1c49-dbdf-4455-922d-0662ff4fec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:02.408574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1c49-dbdf-4455-922d-0662ff4fec59 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:02.408855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1c49-dbdf-4455-922d-0662ff4fec59 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:02.409129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1c49-dbdf-4455-922d-0662ff4fec59 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:02.409826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb1c49-dbdf-4455-922d-0662ff4fec59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:02.410135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb1c49-dbdf-4455-922d-0662ff4fec59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:02.411509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb1c49-dbdf-4455-922d-0662ff4fec59 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:02.437525 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 394/801] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:36:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:02.438476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb1c49-dbdf-4455-922d-0662ff4fec59 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:02.503187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900c191-55b0-4335-b02f-08352663253a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:02.560129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea8fbf-ac33-48e7-8f28-1c3cdf12e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:02.560690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea8fbf-ac33-48e7-8f28-1c3cdf12e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:02.560970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea8fbf-ac33-48e7-8f28-1c3cdf12e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:02.561275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea8fbf-ac33-48e7-8f28-1c3cdf12e2a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:02.582217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea8fbf-ac33-48e7-8f28-1c3cdf12e2a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-dbea8fbf-ac33-48e7-8f28-1c3cdf12e2a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:02.587752 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:02.588676 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:02.590816 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:02.590816 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:02.590816 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:02.590816 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:02.590816 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:02.590816 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:02.590816 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:02.590816 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:02.590816 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:02.590816 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:02.590816 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:36:02.590816 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:02.590816 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 408/802] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:36:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:02.595915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea8fbf-ac33-48e7-8f28-1c3cdf12e2a6 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:02.652566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:02.661406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb1c49-dbdf-4455-922d-0662ff4fec59 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:02.696987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f665458-8c4a-432c-9e8f-23616413393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:02.698072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f665458-8c4a-432c-9e8f-23616413393d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:02.698650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f665458-8c4a-432c-9e8f-23616413393d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:02.699153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f665458-8c4a-432c-9e8f-23616413393d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:02.709604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:02.714060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f665458-8c4a-432c-9e8f-23616413393d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:02.716029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f665458-8c4a-432c-9e8f-23616413393d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:02.719406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea8fbf-ac33-48e7-8f28-1c3cdf12e2a6 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-9f665458-8c4a-432c-9e8f-23616413393d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:02.732259 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:02.733245 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:02.734141 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:02.734141 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:02.734141 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:02.737269 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 395/803] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:02.738607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f665458-8c4a-432c-9e8f-23616413393d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:02.765606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca03be-5791-47e9-ba51-856e53e3677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:02.766594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca03be-5791-47e9-ba51-856e53e3677f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:02.767079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca03be-5791-47e9-ba51-856e53e3677f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:02.767573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca03be-5791-47e9-ba51-856e53e3677f None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:02.768447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca03be-5791-47e9-ba51-856e53e3677f None admin] RBAC: Adding query filter params (name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:02.768962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca03be-5791-47e9-ba51-856e53e3677f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:02.770550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca03be-5791-47e9-ba51-856e53e3677f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:02.779868 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 409/804] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:36:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:02.781027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca03be-5791-47e9-ba51-856e53e3677f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:02.874975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f665458-8c4a-432c-9e8f-23616413393d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:02.904445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca03be-5791-47e9-ba51-856e53e3677f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:02.912219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:02.931611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df2be0-8eac-4f84-8a7d-c6549b4a7773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:02.932737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df2be0-8eac-4f84-8a7d-c6549b4a7773 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:02.933477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df2be0-8eac-4f84-8a7d-c6549b4a7773 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:02.933981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df2be0-8eac-4f84-8a7d-c6549b4a7773 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:02.935376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df2be0-8eac-4f84-8a7d-c6549b4a7773 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:02.937304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df2be0-8eac-4f84-8a7d-c6549b4a7773 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:02.943024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a46ce-44a8-4f98-9a93-b25465e3c2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:02.944130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a46ce-44a8-4f98-9a93-b25465e3c2fc None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:02.944512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a46ce-44a8-4f98-9a93-b25465e3c2fc None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:02.944891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a46ce-44a8-4f98-9a93-b25465e3c2fc None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:02.946211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a46ce-44a8-4f98-9a93-b25465e3c2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:02.946633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a46ce-44a8-4f98-9a93-b25465e3c2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:02.948074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a46ce-44a8-4f98-9a93-b25465e3c2fc None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-f5df2be0-8eac-4f84-8a7d-c6549b4a7773 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:02.949431 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:02.950616 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:36:02.951660 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:02.955018 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 396/805] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Oct 8 20:36:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:02.956015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df2be0-8eac-4f84-8a7d-c6549b4a7773 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:02.973611 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 410/806] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:02.978289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a46ce-44a8-4f98-9a93-b25465e3c2fc None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:03.036897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:03.084034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df2be0-8eac-4f84-8a7d-c6549b4a7773 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:03.094075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a46ce-44a8-4f98-9a93-b25465e3c2fc None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:03.120050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f3691-ddd2-4bdd-bc3a-057ee3041d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:03.120625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f3691-ddd2-4bdd-bc3a-057ee3041d1b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:03.121051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f3691-ddd2-4bdd-bc3a-057ee3041d1b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:03.121457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f3691-ddd2-4bdd-bc3a-057ee3041d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:03.132224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f3691-ddd2-4bdd-bc3a-057ee3041d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:03.134601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f3691-ddd2-4bdd-bc3a-057ee3041d1b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:03.138207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e3c8f-656a-490f-8f28-8cd8a4419852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:03.138992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e3c8f-656a-490f-8f28-8cd8a4419852 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:03.139440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e3c8f-656a-490f-8f28-8cd8a4419852 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:03.139860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e3c8f-656a-490f-8f28-8cd8a4419852 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:03.140635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e3c8f-656a-490f-8f28-8cd8a4419852 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:03.141085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e3c8f-656a-490f-8f28-8cd8a4419852 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:03.143109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e3c8f-656a-490f-8f28-8cd8a4419852 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:03.149053 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 411/807] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Oct 8 20:36:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:03.150001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e3c8f-656a-490f-8f28-8cd8a4419852 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-be6f3691-ddd2-4bdd-bc3a-057ee3041d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:03.155489 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:03.156651 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:03.157770 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:03.157770 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:03.157770 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:03.163230 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 397/808] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:03.163230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f3691-ddd2-4bdd-bc3a-057ee3041d1b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:03.193070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:03.272177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f3691-ddd2-4bdd-bc3a-057ee3041d1b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:03.282677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:03.286014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e3c8f-656a-490f-8f28-8cd8a4419852 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:03.311384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e8674-4609-4d61-bf13-f72bbe6e72a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:03.312167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e8674-4609-4d61-bf13-f72bbe6e72a1 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:03.312552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e8674-4609-4d61-bf13-f72bbe6e72a1 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:03.313001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e8674-4609-4d61-bf13-f72bbe6e72a1 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:03.313775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e8674-4609-4d61-bf13-f72bbe6e72a1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:03.314182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e8674-4609-4d61-bf13-f72bbe6e72a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:03.315936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e8674-4609-4d61-bf13-f72bbe6e72a1 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:03.327361 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 398/809] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Oct 8 20:36:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:03.328354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e8674-4609-4d61-bf13-f72bbe6e72a1 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:03.328624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2f81f-5df8-477c-bdd5-394b19da5597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:03.329563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2f81f-5df8-477c-bdd5-394b19da5597 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:03.329991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2f81f-5df8-477c-bdd5-394b19da5597 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:03.330412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2f81f-5df8-477c-bdd5-394b19da5597 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:03.338477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2f81f-5df8-477c-bdd5-394b19da5597 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:03.340153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2f81f-5df8-477c-bdd5-394b19da5597 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-84d2f81f-5df8-477c-bdd5-394b19da5597 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:03.353918 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:03.355022 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:03.355992 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:03.355992 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:03.355992 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:03.355992 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:03.355992 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:03.355992 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:03.355992 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:03.355992 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:03.355992 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:36:03.355992 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:03.363391 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 412/810] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Oct 8 20:36:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:03.363391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2f81f-5df8-477c-bdd5-394b19da5597 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:03.453851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e8674-4609-4d61-bf13-f72bbe6e72a1 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:03.480196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:03.490009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2f81f-5df8-477c-bdd5-394b19da5597 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:03.506021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33027a9e-a21b-408e-9786-d0f7228156c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:03.506942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33027a9e-a21b-408e-9786-d0f7228156c4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:03.507469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33027a9e-a21b-408e-9786-d0f7228156c4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:03.507973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33027a9e-a21b-408e-9786-d0f7228156c4 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:03.508819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33027a9e-a21b-408e-9786-d0f7228156c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:03.509453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33027a9e-a21b-408e-9786-d0f7228156c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:03.511164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33027a9e-a21b-408e-9786-d0f7228156c4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:03.524287 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 399/811] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:03.525571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33027a9e-a21b-408e-9786-d0f7228156c4 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:03.534546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3251b-eef0-43b0-ad62-8f3226a5f2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:03.535173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3251b-eef0-43b0-ad62-8f3226a5f2e3 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:03.535459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3251b-eef0-43b0-ad62-8f3226a5f2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:03.535795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3251b-eef0-43b0-ad62-8f3226a5f2e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:03.536466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3251b-eef0-43b0-ad62-8f3226a5f2e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:03.538029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3251b-eef0-43b0-ad62-8f3226a5f2e3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:03.563008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:03.577213 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 413/812] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:36:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:36:03.577213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3251b-eef0-43b0-ad62-8f3226a5f2e3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:03.705686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3251b-eef0-43b0-ad62-8f3226a5f2e3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:03.750954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582bbfc-8840-4a91-b463-f803dd72fedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:03.753105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582bbfc-8840-4a91-b463-f803dd72fedd None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:03.753424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582bbfc-8840-4a91-b463-f803dd72fedd None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:03.753702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582bbfc-8840-4a91-b463-f803dd72fedd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:03.763604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33027a9e-a21b-408e-9786-d0f7228156c4 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:03.772579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582bbfc-8840-4a91-b463-f803dd72fedd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:03.774165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582bbfc-8840-4a91-b463-f803dd72fedd None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-2582bbfc-8840-4a91-b463-f803dd72fedd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:03.800058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:03.801073 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:03.802062 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:03.802062 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:03.802062 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:03.802062 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:03.802062 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:03.802062 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:03.802062 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:03.802062 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:03.802062 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 08 20:36:03.802062 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:03.804536 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 414/813] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Oct 8 20:36:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:03.815510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582bbfc-8840-4a91-b463-f803dd72fedd None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:03.822861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:03.844416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023529c0-132a-4522-bc46-7e4e0f198fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:03.845179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023529c0-132a-4522-bc46-7e4e0f198fd1 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:03.845665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023529c0-132a-4522-bc46-7e4e0f198fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:03.845949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023529c0-132a-4522-bc46-7e4e0f198fd1 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:03.846697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023529c0-132a-4522-bc46-7e4e0f198fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:03.846994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023529c0-132a-4522-bc46-7e4e0f198fd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:03.848893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023529c0-132a-4522-bc46-7e4e0f198fd1 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:03.871652 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 400/814] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Oct 8 20:36:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:03.877426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023529c0-132a-4522-bc46-7e4e0f198fd1 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:03.957586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582bbfc-8840-4a91-b463-f803dd72fedd None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:03.999568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:04.003194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b74980-b08c-494f-98fd-078e7654919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:04.004766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b74980-b08c-494f-98fd-078e7654919f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.005340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b74980-b08c-494f-98fd-078e7654919f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.005821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b74980-b08c-494f-98fd-078e7654919f None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.006774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b74980-b08c-494f-98fd-078e7654919f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:04.007282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b74980-b08c-494f-98fd-078e7654919f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:04.008922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b74980-b08c-494f-98fd-078e7654919f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:04.010066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023529c0-132a-4522-bc46-7e4e0f198fd1 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:04.032229 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 415/815] 10.222.0.26 () {56 vars in 1149 bytes} [Sat Oct 8 20:36:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:04.037236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b74980-b08c-494f-98fd-078e7654919f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:04.078200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ee18f-3b67-4342-a8d0-8589e719b146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:04.080518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ee18f-3b67-4342-a8d0-8589e719b146 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.082272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ee18f-3b67-4342-a8d0-8589e719b146 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.082815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ee18f-3b67-4342-a8d0-8589e719b146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.145755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:04.202567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b74980-b08c-494f-98fd-078e7654919f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:04.214703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ee18f-3b67-4342-a8d0-8589e719b146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:04.216683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ee18f-3b67-4342-a8d0-8589e719b146 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:04.249887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca31d4-584e-4682-bcac-43cb2bbeb273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:04.250685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca31d4-584e-4682-bcac-43cb2bbeb273 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.250910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca31d4-584e-4682-bcac-43cb2bbeb273 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.251185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca31d4-584e-4682-bcac-43cb2bbeb273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.265322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca31d4-584e-4682-bcac-43cb2bbeb273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:04.267050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca31d4-584e-4682-bcac-43cb2bbeb273 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-f1ca31d4-584e-4682-bcac-43cb2bbeb273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:04.286646 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:04.287632 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:04.288510 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:04.288510 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:04.288510 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:04.290806 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 416/816] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:04.292121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e4f54-8c68-4538-abe2-5ab57b56ee50 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.292404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e4f54-8c68-4538-abe2-5ab57b56ee50 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.292675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e4f54-8c68-4538-abe2-5ab57b56ee50 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.297279 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 417/817] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:04.298423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e4f54-8c68-4538-abe2-5ab57b56ee50 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:04.331622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:04.346941 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 401/818] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:36:04.348209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3874219-26c1-43a0-a806-af39c41b74c2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.348487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3874219-26c1-43a0-a806-af39c41b74c2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.348756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3874219-26c1-43a0-a806-af39c41b74c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.373175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a3874219-26c1-43a0-a806-af39c41b74c2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:04.375076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a3874219-26c1-43a0-a806-af39c41b74c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:04.426800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e4f54-8c68-4538-abe2-5ab57b56ee50 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:04.442140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:04.476267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2835c53-0d7a-4aca-a17f-30ef7c610739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:04.476267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2835c53-0d7a-4aca-a17f-30ef7c610739 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.476267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2835c53-0d7a-4aca-a17f-30ef7c610739 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.476267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2835c53-0d7a-4aca-a17f-30ef7c610739 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.476657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2835c53-0d7a-4aca-a17f-30ef7c610739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:04.476657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2835c53-0d7a-4aca-a17f-30ef7c610739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:04.476657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2835c53-0d7a-4aca-a17f-30ef7c610739 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:04.483441 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 402/819] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:04.489146 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 418/820] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:04.489886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3874219-26c1-43a0-a806-af39c41b74c2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:04.494951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2835c53-0d7a-4aca-a17f-30ef7c610739 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:04.661067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3874219-26c1-43a0-a806-af39c41b74c2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:04.665440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2835c53-0d7a-4aca-a17f-30ef7c610739 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:04.682901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:04.700219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf486df-2527-4951-b588-49e013ea22b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:04.700654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf486df-2527-4951-b588-49e013ea22b6 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.700939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf486df-2527-4951-b588-49e013ea22b6 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.701230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf486df-2527-4951-b588-49e013ea22b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.705614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6768-c3b9-4ae0-81b6-7a041f2293eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:04.706638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6768-c3b9-4ae0-81b6-7a041f2293eb None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.707062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6768-c3b9-4ae0-81b6-7a041f2293eb None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.707497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6768-c3b9-4ae0-81b6-7a041f2293eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.711940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf486df-2527-4951-b588-49e013ea22b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:04.713405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf486df-2527-4951-b588-49e013ea22b6 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:04.714913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe6768-c3b9-4ae0-81b6-7a041f2293eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:04.716927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe6768-c3b9-4ae0-81b6-7a041f2293eb None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-5bf486df-2527-4951-b588-49e013ea22b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:04.728857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:04.729948 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:04.730857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:04.730857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:04.730857 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:04.730857 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 403/821] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:04.731088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0af5fc-0355-475d-8416-69b5ac620b59 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.731315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0af5fc-0355-475d-8416-69b5ac620b59 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.731590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0af5fc-0355-475d-8416-69b5ac620b59 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-aabe6768-c3b9-4ae0-81b6-7a041f2293eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:04.732890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:04.733768 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:04.734645 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:04.734645 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:04.734645 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:04.734645 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:04.734645 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:04.734645 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:04.734645 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:04.734645 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:04.736449 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 419/822] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:04.737230 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 404/823] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:04.737537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6768-c3b9-4ae0-81b6-7a041f2293eb None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:04.738722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def88b17-9ec1-483d-a6f9-b700fce498da None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.739014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def88b17-9ec1-483d-a6f9-b700fce498da None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.739289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def88b17-9ec1-483d-a6f9-b700fce498da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.759573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-def88b17-9ec1-483d-a6f9-b700fce498da None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:04.760766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-def88b17-9ec1-483d-a6f9-b700fce498da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:04.773889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:04.850318 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 405/824] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:04.851224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def88b17-9ec1-483d-a6f9-b700fce498da None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:04.858836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6768-c3b9-4ae0-81b6-7a041f2293eb None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:04.898500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f29e27-107d-4f26-9026-79c0ca45ea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:04.899894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f29e27-107d-4f26-9026-79c0ca45ea6b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.900602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f29e27-107d-4f26-9026-79c0ca45ea6b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.901022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f29e27-107d-4f26-9026-79c0ca45ea6b None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.901918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f29e27-107d-4f26-9026-79c0ca45ea6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:04.902362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f29e27-107d-4f26-9026-79c0ca45ea6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:04.903971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f29e27-107d-4f26-9026-79c0ca45ea6b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:04.920034 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 420/825] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:04.921283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f29e27-107d-4f26-9026-79c0ca45ea6b None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:04.963786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def88b17-9ec1-483d-a6f9-b700fce498da None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:04.969806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:05.006129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28df4db-8508-46e0-b11a-63fd4ce46413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.006876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28df4db-8508-46e0-b11a-63fd4ce46413 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.007260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28df4db-8508-46e0-b11a-63fd4ce46413 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.007635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28df4db-8508-46e0-b11a-63fd4ce46413 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.008488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28df4db-8508-46e0-b11a-63fd4ce46413 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:05.008901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28df4db-8508-46e0-b11a-63fd4ce46413 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.010498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28df4db-8508-46e0-b11a-63fd4ce46413 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.022988 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 406/826] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:05.023933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28df4db-8508-46e0-b11a-63fd4ce46413 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.044092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:05.056007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f29e27-107d-4f26-9026-79c0ca45ea6b None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.096350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d07bdb-ded0-4f71-baa9-e9f21d74085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.098166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d07bdb-ded0-4f71-baa9-e9f21d74085b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.098594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d07bdb-ded0-4f71-baa9-e9f21d74085b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.099007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d07bdb-ded0-4f71-baa9-e9f21d74085b None admin] PATH_INFO: `/v3/services/network` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.099729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d07bdb-ded0-4f71-baa9-e9f21d74085b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.101276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d07bdb-ded0-4f71-baa9-e9f21d74085b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-a2d07bdb-ded0-4f71-baa9-e9f21d74085b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:05.113734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:05.114991 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:36:05.116009 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:05.118616 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 421/827] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:04 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:05.119653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d07bdb-ded0-4f71-baa9-e9f21d74085b None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.141076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28df4db-8508-46e0-b11a-63fd4ce46413 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.177676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267300f-653f-40c1-bec7-40e58c8b3d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.178769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267300f-653f-40c1-bec7-40e58c8b3d84 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.178769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267300f-653f-40c1-bec7-40e58c8b3d84 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.179287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267300f-653f-40c1-bec7-40e58c8b3d84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.191596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267300f-653f-40c1-bec7-40e58c8b3d84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.193044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267300f-653f-40c1-bec7-40e58c8b3d84 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-f267300f-653f-40c1-bec7-40e58c8b3d84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:05.204510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:05.205485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:05.206409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:05.206409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:05.206409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:05.206409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:05.206409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:05.206409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:05.206409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:05.206409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:05.206409 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 407/828] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:05.206901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267300f-653f-40c1-bec7-40e58c8b3d84 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.238290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d07bdb-ded0-4f71-baa9-e9f21d74085b None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.239392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:05.272954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbc55a-682b-4445-a48b-d6c70625d173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.273584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbc55a-682b-4445-a48b-d6c70625d173 None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.273868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbc55a-682b-4445-a48b-d6c70625d173 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.274139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbc55a-682b-4445-a48b-d6c70625d173 None admin] PATH_INFO: `/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/5a6d89a355d4415a95913449481b3e6b/roles/f16d77e2bee5436dab21baa2ee33e03b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.288693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbc55a-682b-4445-a48b-d6c70625d173 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba1e9ad05694bbe8723c14f5e2b08f7, user_id=5a6d89a355d4415a95913449481b3e6b, role_id=f16d77e2bee5436dab21baa2ee33e03b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.290665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbc55a-682b-4445-a48b-d6c70625d173 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.313422 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 422/829] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:36:05 2022] PUT /identity/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/5a6d89a355d4415a95913449481b3e6b/roles/f16d77e2bee5436dab21baa2ee33e03b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:36:05.315249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbc55a-682b-4445-a48b-d6c70625d173 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.328917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267300f-653f-40c1-bec7-40e58c8b3d84 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.333586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:05.374747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c8a20-6a1f-42f7-a233-2021cddd69e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.376172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c8a20-6a1f-42f7-a233-2021cddd69e9 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.376532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c8a20-6a1f-42f7-a233-2021cddd69e9 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.376925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c8a20-6a1f-42f7-a233-2021cddd69e9 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.378039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c8a20-6a1f-42f7-a233-2021cddd69e9 None admin] RBAC: Adding query filter params (name=network) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:05.378703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c8a20-6a1f-42f7-a233-2021cddd69e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.380376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c8a20-6a1f-42f7-a233-2021cddd69e9 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.387920 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 408/830] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Oct 8 20:36:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:05.388786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c8a20-6a1f-42f7-a233-2021cddd69e9 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.455192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbc55a-682b-4445-a48b-d6c70625d173 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.496292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ab60e-0fce-442c-8701-3c51f8ffab55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.496935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ab60e-0fce-442c-8701-3c51f8ffab55 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.497237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ab60e-0fce-442c-8701-3c51f8ffab55 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.497525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ab60e-0fce-442c-8701-3c51f8ffab55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.510476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ab60e-0fce-442c-8701-3c51f8ffab55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:05.511019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-916ab60e-0fce-442c-8701-3c51f8ffab55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:05.518303 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:05.519320 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:05.520183 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:05.520183 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:05.520183 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:05.520183 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:05.520183 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:05.520183 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:05.520183 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:05.520183 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:05.520183 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:05.520183 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:05.520183 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:05.520183 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:05.522563 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 423/831] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:36:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:05.524205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ab60e-0fce-442c-8701-3c51f8ffab55 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.529538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c8a20-6a1f-42f7-a233-2021cddd69e9 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.568363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cd0ab-9f5d-4e82-8921-3eb154f6f041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.568976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cd0ab-9f5d-4e82-8921-3eb154f6f041 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.569577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cd0ab-9f5d-4e82-8921-3eb154f6f041 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.569685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cd0ab-9f5d-4e82-8921-3eb154f6f041 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.571082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cd0ab-9f5d-4e82-8921-3eb154f6f041 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:05.571082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cd0ab-9f5d-4e82-8921-3eb154f6f041 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.572495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cd0ab-9f5d-4e82-8921-3eb154f6f041 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.593436 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 409/832] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:05.595263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cd0ab-9f5d-4e82-8921-3eb154f6f041 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.597712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:05.638992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ab60e-0fce-442c-8701-3c51f8ffab55 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.682788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519c832-56ee-468f-982a-a836613abe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.684359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519c832-56ee-468f-982a-a836613abe58 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.684791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519c832-56ee-468f-982a-a836613abe58 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.685229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519c832-56ee-468f-982a-a836613abe58 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.686012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519c832-56ee-468f-982a-a836613abe58 None admin] RBAC: Adding query filter params (type=network) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:05.686783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519c832-56ee-468f-982a-a836613abe58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.688907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519c832-56ee-468f-982a-a836613abe58 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.701691 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 424/833] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Oct 8 20:36:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:05.701691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519c832-56ee-468f-982a-a836613abe58 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.739877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cd0ab-9f5d-4e82-8921-3eb154f6f041 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.790825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb04c0-7192-4c18-a386-5201ebada330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.791945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb04c0-7192-4c18-a386-5201ebada330 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.792779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb04c0-7192-4c18-a386-5201ebada330 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.793272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb04c0-7192-4c18-a386-5201ebada330 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.794120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb04c0-7192-4c18-a386-5201ebada330 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:05.794627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb04c0-7192-4c18-a386-5201ebada330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.796683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb04c0-7192-4c18-a386-5201ebada330 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.809066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519c832-56ee-468f-982a-a836613abe58 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.814274 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 410/834] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:36:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:05.814274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb04c0-7192-4c18-a386-5201ebada330 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.827064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:05.855107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:05.863404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed03dd-0f65-477a-9d83-54cd4b2e8dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.864702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed03dd-0f65-477a-9d83-54cd4b2e8dd4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.865310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed03dd-0f65-477a-9d83-54cd4b2e8dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.865772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed03dd-0f65-477a-9d83-54cd4b2e8dd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.866891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed03dd-0f65-477a-9d83-54cd4b2e8dd4 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=187d6f51b1604327a4879e9e19b47963) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:05.867959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed03dd-0f65-477a-9d83-54cd4b2e8dd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.870334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed03dd-0f65-477a-9d83-54cd4b2e8dd4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.878831 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 425/835] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:36:05 2022] GET /identity/v3/role_assignments?user.id=187d6f51b1604327a4879e9e19b47963&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=a409f81bd5744563a303a825783bed61 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:05.880017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed03dd-0f65-477a-9d83-54cd4b2e8dd4 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.983541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb04c0-7192-4c18-a386-5201ebada330 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:06.004725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed03dd-0f65-477a-9d83-54cd4b2e8dd4 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:06.046375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b385f7-1417-452f-b3a4-13cd6f46e65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:06.047558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b385f7-1417-452f-b3a4-13cd6f46e65c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:06.048060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b385f7-1417-452f-b3a4-13cd6f46e65c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:06.048584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b385f7-1417-452f-b3a4-13cd6f46e65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:06.060085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaafc8b-ae9a-41ea-8ea8-9904279aab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:06.060787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaafc8b-ae9a-41ea-8ea8-9904279aab1c None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:06.061077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaafc8b-ae9a-41ea-8ea8-9904279aab1c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:06.061378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaafc8b-ae9a-41ea-8ea8-9904279aab1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:06.062064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaafc8b-ae9a-41ea-8ea8-9904279aab1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:06.062982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b385f7-1417-452f-b3a4-13cd6f46e65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:06.063445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaafc8b-ae9a-41ea-8ea8-9904279aab1c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:06.064877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b385f7-1417-452f-b3a4-13cd6f46e65c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-85b385f7-1417-452f-b3a4-13cd6f46e65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:06.093241 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:06.094368 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:06.095907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:06.095907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:06.095907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:06.095907 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 426/836] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:06.103117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b385f7-1417-452f-b3a4-13cd6f46e65c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:06.113535 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 411/837] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:36:05 2022] POST /identity/v3/endpoints => generated 337 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:36:06.163402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:06.251794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b385f7-1417-452f-b3a4-13cd6f46e65c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:06.304505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062acf8a-01f1-443a-bcec-94d7637817bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:06.305163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062acf8a-01f1-443a-bcec-94d7637817bf None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:06.305495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062acf8a-01f1-443a-bcec-94d7637817bf None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:06.305771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062acf8a-01f1-443a-bcec-94d7637817bf None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:06.306436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062acf8a-01f1-443a-bcec-94d7637817bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:06.306745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062acf8a-01f1-443a-bcec-94d7637817bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:06.308140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062acf8a-01f1-443a-bcec-94d7637817bf None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:06.324388 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 427/838] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:06.330611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaafc8b-ae9a-41ea-8ea8-9904279aab1c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:06.401650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:06.445402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaafc8b-ae9a-41ea-8ea8-9904279aab1c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:06.458613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41eec-511c-423b-a344-566efc078f07 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:06.458932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41eec-511c-423b-a344-566efc078f07 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:06.459167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41eec-511c-423b-a344-566efc078f07 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:06.465596 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 428/839] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:06.471610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60395af3-9086-4b04-ae92-b75ea5c55f70 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:06.471900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60395af3-9086-4b04-ae92-b75ea5c55f70 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:06.472177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60395af3-9086-4b04-ae92-b75ea5c55f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:06.495591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-60395af3-9086-4b04-ae92-b75ea5c55f70 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:06.496812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-60395af3-9086-4b04-ae92-b75ea5c55f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:06.505995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d451af-18f7-40ad-ad4d-1c8ec070d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:06.506940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d451af-18f7-40ad-ad4d-1c8ec070d138 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:06.507487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d451af-18f7-40ad-ad4d-1c8ec070d138 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:06.508518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d451af-18f7-40ad-ad4d-1c8ec070d138 None admin] PATH_INFO: `/v3/users/swift` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:06.517307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d451af-18f7-40ad-ad4d-1c8ec070d138 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:06.519036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d451af-18f7-40ad-ad4d-1c8ec070d138 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-52d451af-18f7-40ad-ad4d-1c8ec070d138 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:06.531908 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:06.532902 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:06.533945 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:06.533945 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:06.533945 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:06.533945 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:06.533945 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:06.533945 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:06.533945 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:06.533945 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:06.533945 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 08 20:36:06.533945 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:06.539928 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 412/840] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:36:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:06.542290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d451af-18f7-40ad-ad4d-1c8ec070d138 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:06.578928 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 429/841] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:06.672423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d451af-18f7-40ad-ad4d-1c8ec070d138 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:06.699720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:06.710877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b495fe-e3c7-465c-9c3c-dcfbb1f4f657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:06.712269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b495fe-e3c7-465c-9c3c-dcfbb1f4f657 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:06.712794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b495fe-e3c7-465c-9c3c-dcfbb1f4f657 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:06.713294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b495fe-e3c7-465c-9c3c-dcfbb1f4f657 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:06.714090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b495fe-e3c7-465c-9c3c-dcfbb1f4f657 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:06.714404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b495fe-e3c7-465c-9c3c-dcfbb1f4f657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:06.715839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b495fe-e3c7-465c-9c3c-dcfbb1f4f657 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:06.734285 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 413/842] 10.222.0.26 () {56 vars in 1135 bytes} [Sat Oct 8 20:36:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:06.742325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60395af3-9086-4b04-ae92-b75ea5c55f70 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:06.777545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:06.845400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60395af3-9086-4b04-ae92-b75ea5c55f70 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:06.885818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085e5f6-a6ab-4f28-9ac1-18c38017bc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:06.886429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085e5f6-a6ab-4f28-9ac1-18c38017bc33 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:06.886711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085e5f6-a6ab-4f28-9ac1-18c38017bc33 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:06.886986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085e5f6-a6ab-4f28-9ac1-18c38017bc33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:06.935233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b495fe-e3c7-465c-9c3c-dcfbb1f4f657 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:06.960055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085e5f6-a6ab-4f28-9ac1-18c38017bc33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:06.962409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085e5f6-a6ab-4f28-9ac1-18c38017bc33 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:07.002582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:07.070167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b495fe-e3c7-465c-9c3c-dcfbb1f4f657 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:07.076006 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 430/843] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:36:07.082164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085e5f6-a6ab-4f28-9ac1-18c38017bc33 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:07.108910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e413-217e-4196-a41b-18b197c9851c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:07.109495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e413-217e-4196-a41b-18b197c9851c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:07.109777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e413-217e-4196-a41b-18b197c9851c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:07.110049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e413-217e-4196-a41b-18b197c9851c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:07.110798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e413-217e-4196-a41b-18b197c9851c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:07.113056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e413-217e-4196-a41b-18b197c9851c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-b7d4e413-217e-4196-a41b-18b197c9851c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:07.125143 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:07.126248 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:07.127099 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 414/844] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:36:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:07.142601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e413-217e-4196-a41b-18b197c9851c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:07.197137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085e5f6-a6ab-4f28-9ac1-18c38017bc33 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:07.211256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:07.231469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:07.238423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6802aae-bb12-4e31-ad80-ec126c0978d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:07.239062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802aae-bb12-4e31-ad80-ec126c0978d9 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:07.239335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802aae-bb12-4e31-ad80-ec126c0978d9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:07.239600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802aae-bb12-4e31-ad80-ec126c0978d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:07.252209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6802aae-bb12-4e31-ad80-ec126c0978d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:07.254185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6802aae-bb12-4e31-ad80-ec126c0978d9 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-c6802aae-bb12-4e31-ad80-ec126c0978d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:07.271575 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:07.272528 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:07.273472 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:07.273472 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:07.273472 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:07.273472 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 431/845] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:07.278478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6802aae-bb12-4e31-ad80-ec126c0978d9 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:07.285990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e413-217e-4196-a41b-18b197c9851c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:07.322471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697c348-0e1b-403b-a60b-98e405e9f541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:07.323073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697c348-0e1b-403b-a60b-98e405e9f541 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:07.323349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697c348-0e1b-403b-a60b-98e405e9f541 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:07.323623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697c348-0e1b-403b-a60b-98e405e9f541 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:07.324238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697c348-0e1b-403b-a60b-98e405e9f541 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:07.324536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697c348-0e1b-403b-a60b-98e405e9f541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:07.325981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697c348-0e1b-403b-a60b-98e405e9f541 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:07.330964 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 415/846] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:36:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:07.336208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697c348-0e1b-403b-a60b-98e405e9f541 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:07.417122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6802aae-bb12-4e31-ad80-ec126c0978d9 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:07.458343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf5eab-785b-49ea-acd5-31c94536bd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:07.458953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf5eab-785b-49ea-acd5-31c94536bd02 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:07.459232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf5eab-785b-49ea-acd5-31c94536bd02 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:07.459499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf5eab-785b-49ea-acd5-31c94536bd02 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:07.460138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf5eab-785b-49ea-acd5-31c94536bd02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:07.460435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf5eab-785b-49ea-acd5-31c94536bd02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:07.461853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf5eab-785b-49ea-acd5-31c94536bd02 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:07.466428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697c348-0e1b-403b-a60b-98e405e9f541 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:07.474717 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 432/847] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:07.480396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf5eab-785b-49ea-acd5-31c94536bd02 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:07.485615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:07.511953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2b617-d51e-4e24-a7e5-9412c3fcd95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:07.513301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b617-d51e-4e24-a7e5-9412c3fcd95f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:07.513779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b617-d51e-4e24-a7e5-9412c3fcd95f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:07.514248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b617-d51e-4e24-a7e5-9412c3fcd95f None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:07.515154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2b617-d51e-4e24-a7e5-9412c3fcd95f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:07.515739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2b617-d51e-4e24-a7e5-9412c3fcd95f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:07.517317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2b617-d51e-4e24-a7e5-9412c3fcd95f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:07.523745 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 416/848] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:36:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:07.535360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:07.598433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf5eab-785b-49ea-acd5-31c94536bd02 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:07.637470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baae113-6b98-4e0a-be45-1c16cca1c626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:07.638121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baae113-6b98-4e0a-be45-1c16cca1c626 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:07.638397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baae113-6b98-4e0a-be45-1c16cca1c626 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:07.638663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baae113-6b98-4e0a-be45-1c16cca1c626 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:07.646371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baae113-6b98-4e0a-be45-1c16cca1c626 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:07.647925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baae113-6b98-4e0a-be45-1c16cca1c626 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-1baae113-6b98-4e0a-be45-1c16cca1c626 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:07.660901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:07.661925 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:07.662827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:07.662827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:07.662827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:07.662827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:07.662827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:07.662827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:07.662827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:07.662827 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:07.662827 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 433/849] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:07.668962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2b617-d51e-4e24-a7e5-9412c3fcd95f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:07.779322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2b617-d51e-4e24-a7e5-9412c3fcd95f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:07.815251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087f047-7dda-46bb-b574-3396703c66f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:07.816201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f047-7dda-46bb-b574-3396703c66f2 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:07.816684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f047-7dda-46bb-b574-3396703c66f2 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:07.817299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f047-7dda-46bb-b574-3396703c66f2 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:07.818189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087f047-7dda-46bb-b574-3396703c66f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:07.818710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087f047-7dda-46bb-b574-3396703c66f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:07.820336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087f047-7dda-46bb-b574-3396703c66f2 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:07.833529 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 417/850] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:07.841313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baae113-6b98-4e0a-be45-1c16cca1c626 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:07.875255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b385a0-4e00-4f23-9736-dd1b8bceb96a None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:07.875602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b385a0-4e00-4f23-9736-dd1b8bceb96a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:07.875862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b385a0-4e00-4f23-9736-dd1b8bceb96a None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:07.877384 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 418/851] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:07.882412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978aa3d-3b81-4c71-a741-8b909e6dd859 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:07.882693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978aa3d-3b81-4c71-a741-8b909e6dd859 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:07.883025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978aa3d-3b81-4c71-a741-8b909e6dd859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:07.908171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f978aa3d-3b81-4c71-a741-8b909e6dd859 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:07.909399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f978aa3d-3b81-4c71-a741-8b909e6dd859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:07.942756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:07.974815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baae113-6b98-4e0a-be45-1c16cca1c626 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:07.978554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:08.000593 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 419/852] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:08.020398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1b0a3-4b72-4fe3-9818-631ad53f4520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:08.021364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b0a3-4b72-4fe3-9818-631ad53f4520 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:08.021855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b0a3-4b72-4fe3-9818-631ad53f4520 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:08.022319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b0a3-4b72-4fe3-9818-631ad53f4520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:08.023222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1b0a3-4b72-4fe3-9818-631ad53f4520 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=5bd5adc10b4344e1847c23c2c0599e59) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:08.024249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1b0a3-4b72-4fe3-9818-631ad53f4520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:08.025933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1b0a3-4b72-4fe3-9818-631ad53f4520 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:08.032460 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 434/853] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:36:07 2022] GET /identity/v3/role_assignments?user.id=5bd5adc10b4344e1847c23c2c0599e59&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=a409f81bd5744563a303a825783bed61 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:08.322565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978aa3d-3b81-4c71-a741-8b909e6dd859 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:08.427742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978aa3d-3b81-4c71-a741-8b909e6dd859 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:08.464101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6735e1f-19cf-4cbc-98d8-771ff7f1e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:08.464732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735e1f-19cf-4cbc-98d8-771ff7f1e134 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:08.465067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735e1f-19cf-4cbc-98d8-771ff7f1e134 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:08.465388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735e1f-19cf-4cbc-98d8-771ff7f1e134 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:08.480170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6735e1f-19cf-4cbc-98d8-771ff7f1e134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-c6735e1f-19cf-4cbc-98d8-771ff7f1e134 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:08.485210 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:08.486139 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:08.487014 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:08.487014 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:08.487014 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:08.487014 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:08.487014 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:08.487014 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:08.487014 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:08.487014 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:08.487014 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:08.487014 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:08.487014 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:36:08.487014 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:08.487014 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 420/854] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:36:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:08.494303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1b0a3-4b72-4fe3-9818-631ad53f4520 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:08.604217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1b0a3-4b72-4fe3-9818-631ad53f4520 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:08.641434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd53139-e736-49e9-911a-7a74f32200fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:08.642420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53139-e736-49e9-911a-7a74f32200fe None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:08.642922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53139-e736-49e9-911a-7a74f32200fe None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:08.643395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53139-e736-49e9-911a-7a74f32200fe None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:08.644253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd53139-e736-49e9-911a-7a74f32200fe None admin] RBAC: Adding query filter params (name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:08.644758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd53139-e736-49e9-911a-7a74f32200fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:08.646508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd53139-e736-49e9-911a-7a74f32200fe None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:08.655607 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 435/855] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:36:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:08.661549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6735e1f-19cf-4cbc-98d8-771ff7f1e134 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:08.689181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:08.750240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a232df-b920-419f-bded-c1cb521b237a None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:08.750510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a232df-b920-419f-bded-c1cb521b237a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:08.750866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a232df-b920-419f-bded-c1cb521b237a None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:08.752523 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 436/856] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:36:08.757826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772ffbb-6d72-46c0-aa57-ee45b9a71974 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:08.758801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772ffbb-6d72-46c0-aa57-ee45b9a71974 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:08.759167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772ffbb-6d72-46c0-aa57-ee45b9a71974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:08.773286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6735e1f-19cf-4cbc-98d8-771ff7f1e134 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:08.780358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b772ffbb-6d72-46c0-aa57-ee45b9a71974 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:08.782244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b772ffbb-6d72-46c0-aa57-ee45b9a71974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:08.810674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e7f27-c25b-42e0-9324-696a360d8622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:08.811559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e7f27-c25b-42e0-9324-696a360d8622 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:08.811849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e7f27-c25b-42e0-9324-696a360d8622 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:08.812122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e7f27-c25b-42e0-9324-696a360d8622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:08.813612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:08.827362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e7f27-c25b-42e0-9324-696a360d8622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:08.829070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e7f27-c25b-42e0-9324-696a360d8622 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-266e7f27-c25b-42e0-9324-696a360d8622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:08.849571 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:08.850586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:08.851497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:08.851497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:08.851497 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:08.851497 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 421/857] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:08.856639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e7f27-c25b-42e0-9324-696a360d8622 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:08.870153 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 437/858] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:08.942781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:08.969408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e7f27-c25b-42e0-9324-696a360d8622 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:09.005501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c779af0-2a84-44d2-9ecd-1b72e8ac9c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:09.006493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c779af0-2a84-44d2-9ecd-1b72e8ac9c73 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:09.006977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c779af0-2a84-44d2-9ecd-1b72e8ac9c73 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:09.007468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c779af0-2a84-44d2-9ecd-1b72e8ac9c73 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:09.008832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c779af0-2a84-44d2-9ecd-1b72e8ac9c73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:09.009372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c779af0-2a84-44d2-9ecd-1b72e8ac9c73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:09.010933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c779af0-2a84-44d2-9ecd-1b72e8ac9c73 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:09.025863 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 422/859] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:09.034036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772ffbb-6d72-46c0-aa57-ee45b9a71974 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:09.138100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772ffbb-6d72-46c0-aa57-ee45b9a71974 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:09.173846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c182bf7-eb7d-4432-bf62-600befc7211c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:09.174464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c182bf7-eb7d-4432-bf62-600befc7211c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:09.174741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c182bf7-eb7d-4432-bf62-600befc7211c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:09.175009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c182bf7-eb7d-4432-bf62-600befc7211c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:09.182043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c182bf7-eb7d-4432-bf62-600befc7211c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:09.183458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c182bf7-eb7d-4432-bf62-600befc7211c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-2c182bf7-eb7d-4432-bf62-600befc7211c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:09.194847 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:09.195800 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:09.196751 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:09.196751 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:09.196751 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:09.196751 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:09.196751 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:09.196751 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:09.196751 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:09.196751 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:09.196751 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 08 20:36:09.196751 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:09.200653 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 438/860] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:09.202012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c779af0-2a84-44d2-9ecd-1b72e8ac9c73 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:09.217925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c182bf7-eb7d-4432-bf62-600befc7211c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:09.245119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:09.316115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c779af0-2a84-44d2-9ecd-1b72e8ac9c73 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:09.345973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c182bf7-eb7d-4432-bf62-600befc7211c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:09.352951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e1591-00d2-4092-bb31-a28fc7640851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:09.353590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e1591-00d2-4092-bb31-a28fc7640851 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:09.353871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e1591-00d2-4092-bb31-a28fc7640851 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:09.354137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e1591-00d2-4092-bb31-a28fc7640851 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:09.354856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e1591-00d2-4092-bb31-a28fc7640851 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:09.355155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e1591-00d2-4092-bb31-a28fc7640851 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:09.356617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e1591-00d2-4092-bb31-a28fc7640851 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:09.359358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:09.380035 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 423/861] 10.222.0.26 () {56 vars in 1149 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:09.381370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e1591-00d2-4092-bb31-a28fc7640851 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:09.391292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fc1d1-bd1a-42a3-becb-df54b221f2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:09.392574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fc1d1-bd1a-42a3-becb-df54b221f2e9 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:09.393063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fc1d1-bd1a-42a3-becb-df54b221f2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:09.393567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fc1d1-bd1a-42a3-becb-df54b221f2e9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:09.394590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fc1d1-bd1a-42a3-becb-df54b221f2e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:09.396552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fc1d1-bd1a-42a3-becb-df54b221f2e9 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-216fc1d1-bd1a-42a3-becb-df54b221f2e9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:09.407549 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:09.408513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:36:09.409448 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:09.413426 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 439/862] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:09.415266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fc1d1-bd1a-42a3-becb-df54b221f2e9 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:09.503653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e1591-00d2-4092-bb31-a28fc7640851 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:09.528783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:09.543462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de331f10-2812-4cda-9e65-2ded73e54380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:09.544072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de331f10-2812-4cda-9e65-2ded73e54380 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:09.544392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de331f10-2812-4cda-9e65-2ded73e54380 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:09.544674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de331f10-2812-4cda-9e65-2ded73e54380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:09.547973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fc1d1-bd1a-42a3-becb-df54b221f2e9 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:09.591132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624a03f-feb8-427d-8e3a-49834055f1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:09.591738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624a03f-feb8-427d-8e3a-49834055f1b3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:09.592021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624a03f-feb8-427d-8e3a-49834055f1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:09.592291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624a03f-feb8-427d-8e3a-49834055f1b3 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:09.593480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624a03f-feb8-427d-8e3a-49834055f1b3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:09.593789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624a03f-feb8-427d-8e3a-49834055f1b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:09.595679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624a03f-feb8-427d-8e3a-49834055f1b3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:09.606290 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 440/863] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:09.607379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624a03f-feb8-427d-8e3a-49834055f1b3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:09.626707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:09.636401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de331f10-2812-4cda-9e65-2ded73e54380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:09.638241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de331f10-2812-4cda-9e65-2ded73e54380 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:09.728334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624a03f-feb8-427d-8e3a-49834055f1b3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:09.767612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79f25a-396a-44dd-987b-4bbbafd8306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:09.768586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79f25a-396a-44dd-987b-4bbbafd8306a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:09.769080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79f25a-396a-44dd-987b-4bbbafd8306a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:09.769614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79f25a-396a-44dd-987b-4bbbafd8306a None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:09.770434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79f25a-396a-44dd-987b-4bbbafd8306a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:09.770933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79f25a-396a-44dd-987b-4bbbafd8306a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:09.772481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79f25a-396a-44dd-987b-4bbbafd8306a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:09.775656 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 424/864] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:36:09.777378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de331f10-2812-4cda-9e65-2ded73e54380 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:09.786825 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 441/865] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:09.881689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:09.890000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de331f10-2812-4cda-9e65-2ded73e54380 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:09.929806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f7487-9a19-4d65-807d-28a0e7db44ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:09.930463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f7487-9a19-4d65-807d-28a0e7db44ce None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:09.930791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f7487-9a19-4d65-807d-28a0e7db44ce None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:09.931066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f7487-9a19-4d65-807d-28a0e7db44ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:09.942937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f7487-9a19-4d65-807d-28a0e7db44ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:09.944488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f7487-9a19-4d65-807d-28a0e7db44ce None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-ef4f7487-9a19-4d65-807d-28a0e7db44ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:09.961957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:09.962957 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:09.963837 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:09.963837 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:09.963837 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:09.967915 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 425/866] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:09.969368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79f25a-396a-44dd-987b-4bbbafd8306a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:09.987233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:10.078924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79f25a-396a-44dd-987b-4bbbafd8306a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:10.107438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38581a7f-7f13-4f7e-bb42-96b7c64025ee None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.107765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38581a7f-7f13-4f7e-bb42-96b7c64025ee None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.108002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38581a7f-7f13-4f7e-bb42-96b7c64025ee None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.109648 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 426/867] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:10.114905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a042d0-a5cf-4d14-9bdd-9e69c634f095 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.115068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a0946-5fbc-4834-a54b-1b04cbce43e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:10.115170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a042d0-a5cf-4d14-9bdd-9e69c634f095 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.115466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a042d0-a5cf-4d14-9bdd-9e69c634f095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.115672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a0946-5fbc-4834-a54b-1b04cbce43e4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.115893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a0946-5fbc-4834-a54b-1b04cbce43e4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.116167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a0946-5fbc-4834-a54b-1b04cbce43e4 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.116808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a0946-5fbc-4834-a54b-1b04cbce43e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:10.117102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a0946-5fbc-4834-a54b-1b04cbce43e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:10.118509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a0946-5fbc-4834-a54b-1b04cbce43e4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:10.132514 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 442/868] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:10.134843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-60a042d0-a5cf-4d14-9bdd-9e69c634f095 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:10.136079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-60a042d0-a5cf-4d14-9bdd-9e69c634f095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:10.138598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a0946-5fbc-4834-a54b-1b04cbce43e4 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:10.223072 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 427/869] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:10.232285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:10.264976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a0946-5fbc-4834-a54b-1b04cbce43e4 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:10.299807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393f9b8-132c-4e4f-9c0f-5f9f213a2c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:10.300433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393f9b8-132c-4e4f-9c0f-5f9f213a2c32 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.300752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393f9b8-132c-4e4f-9c0f-5f9f213a2c32 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.300953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393f9b8-132c-4e4f-9c0f-5f9f213a2c32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.307766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393f9b8-132c-4e4f-9c0f-5f9f213a2c32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:10.309203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393f9b8-132c-4e4f-9c0f-5f9f213a2c32 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-1393f9b8-132c-4e4f-9c0f-5f9f213a2c32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:10.321312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:10.322242 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:10.323123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:10.323123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:10.323123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:10.323123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:10.323123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:10.323123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:10.323123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:10.323123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:10.327336 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 443/870] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:10.328718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a042d0-a5cf-4d14-9bdd-9e69c634f095 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:10.410835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:10.434459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a042d0-a5cf-4d14-9bdd-9e69c634f095 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:10.469939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd1d9-e59d-43ee-8256-d8931d236176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:10.470549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd1d9-e59d-43ee-8256-d8931d236176 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.470827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd1d9-e59d-43ee-8256-d8931d236176 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.471138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd1d9-e59d-43ee-8256-d8931d236176 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.471880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd1d9-e59d-43ee-8256-d8931d236176 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:10.472178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd1d9-e59d-43ee-8256-d8931d236176 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:10.473684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd1d9-e59d-43ee-8256-d8931d236176 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:10.486096 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 428/871] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:10.492055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393f9b8-132c-4e4f-9c0f-5f9f213a2c32 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:10.560153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd1d9-e59d-43ee-8256-d8931d236176 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:10.606093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393f9b8-132c-4e4f-9c0f-5f9f213a2c32 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:10.640929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:10.646563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f885133-945e-4689-a824-356e85215c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:10.647447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f885133-945e-4689-a824-356e85215c5d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.647950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f885133-945e-4689-a824-356e85215c5d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.648428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f885133-945e-4689-a824-356e85215c5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.649443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f885133-945e-4689-a824-356e85215c5d None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=5a6d89a355d4415a95913449481b3e6b) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:10.649964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f885133-945e-4689-a824-356e85215c5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:10.652191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f885133-945e-4689-a824-356e85215c5d None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:10.665221 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 444/872] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:36:10 2022] GET /identity/v3/role_assignments?user.id=5a6d89a355d4415a95913449481b3e6b&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:10.665221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c580ef0-bb64-4960-8ac1-08a1979fd06b None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.665221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c580ef0-bb64-4960-8ac1-08a1979fd06b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.665221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c580ef0-bb64-4960-8ac1-08a1979fd06b None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.665221 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 445/873] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:10.671186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6aef9-4424-4804-b4dd-8a5ba1901bfc None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.671506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6aef9-4424-4804-b4dd-8a5ba1901bfc None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.672287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6aef9-4424-4804-b4dd-8a5ba1901bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.678825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd1d9-e59d-43ee-8256-d8931d236176 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:10.698503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-74f6aef9-4424-4804-b4dd-8a5ba1901bfc None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:10.700455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-74f6aef9-4424-4804-b4dd-8a5ba1901bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:10.718907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89059bf-111a-4518-93ac-2970ed776c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:10.719639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89059bf-111a-4518-93ac-2970ed776c97 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.719925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89059bf-111a-4518-93ac-2970ed776c97 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.720199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89059bf-111a-4518-93ac-2970ed776c97 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.720917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89059bf-111a-4518-93ac-2970ed776c97 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:10.722408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89059bf-111a-4518-93ac-2970ed776c97 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:10.727827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:10.747615 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 429/874] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:36:10 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:36:10.808500 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 446/875] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:10 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:11.137684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89059bf-111a-4518-93ac-2970ed776c97 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:11.243595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89059bf-111a-4518-93ac-2970ed776c97 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:11.278083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee02d8-9858-4403-83ba-ecfd55f826b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:11.278856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee02d8-9858-4403-83ba-ecfd55f826b8 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:11.279136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee02d8-9858-4403-83ba-ecfd55f826b8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:11.279406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee02d8-9858-4403-83ba-ecfd55f826b8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:11.279984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee02d8-9858-4403-83ba-ecfd55f826b8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:11.281359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee02d8-9858-4403-83ba-ecfd55f826b8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-57ee02d8-9858-4403-83ba-ecfd55f826b8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:11.291101 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:11.293465 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:11.295526 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:11.297619 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 430/876] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Oct 8 20:36:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:11.301219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6aef9-4424-4804-b4dd-8a5ba1901bfc None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:11.403437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6aef9-4424-4804-b4dd-8a5ba1901bfc None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:11.427031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:11.440002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e894ec8-e46e-4be3-a75b-06c6a751a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:11.440602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e894ec8-e46e-4be3-a75b-06c6a751a387 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:11.440877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e894ec8-e46e-4be3-a75b-06c6a751a387 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:11.441144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e894ec8-e46e-4be3-a75b-06c6a751a387 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:11.441788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e894ec8-e46e-4be3-a75b-06c6a751a387 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:11.442084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e894ec8-e46e-4be3-a75b-06c6a751a387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:11.443436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e894ec8-e46e-4be3-a75b-06c6a751a387 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:11.452778 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 447/877] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Oct 8 20:36:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:11.454095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee02d8-9858-4403-83ba-ecfd55f826b8 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:11.520096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:11.562189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee02d8-9858-4403-83ba-ecfd55f826b8 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:11.597436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e913a7-2ada-4d69-96ae-7971b9bbdf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:11.598047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e913a7-2ada-4d69-96ae-7971b9bbdf78 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:11.598324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e913a7-2ada-4d69-96ae-7971b9bbdf78 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:11.598595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e913a7-2ada-4d69-96ae-7971b9bbdf78 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:11.599220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e913a7-2ada-4d69-96ae-7971b9bbdf78 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:11.599520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e913a7-2ada-4d69-96ae-7971b9bbdf78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:11.600870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e913a7-2ada-4d69-96ae-7971b9bbdf78 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:11.613361 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 431/878] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Oct 8 20:36:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:12.317069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a38b4-e53c-4ce6-98cd-60c267edfb1d None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:12.317650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a38b4-e53c-4ce6-98cd-60c267edfb1d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:12.317650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a38b4-e53c-4ce6-98cd-60c267edfb1d None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:12.319385 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 448/879] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:12.325062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13af18-503a-4665-99d6-97bebd4f0e07 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:12.325597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13af18-503a-4665-99d6-97bebd4f0e07 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:12.326094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13af18-503a-4665-99d6-97bebd4f0e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:12.345342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6e13af18-503a-4665-99d6-97bebd4f0e07 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:12.346516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6e13af18-503a-4665-99d6-97bebd4f0e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:12.421294 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 432/880] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:12 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:12.751518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a38b4-e53c-4ce6-98cd-60c267edfb1d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:12.870496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a38b4-e53c-4ce6-98cd-60c267edfb1d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:12.907011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976701da-3573-43fe-860f-b93b06e95c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:12.907744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976701da-3573-43fe-860f-b93b06e95c0a None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:12.908071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976701da-3573-43fe-860f-b93b06e95c0a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:12.908355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976701da-3573-43fe-860f-b93b06e95c0a None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:12.909037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976701da-3573-43fe-860f-b93b06e95c0a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:12.910509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976701da-3573-43fe-860f-b93b06e95c0a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:12.934445 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 449/881] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:36:12 2022] POST /identity/v3/services => generated 269 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:36:13.256784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f763a8-3822-4c5f-affb-44b67d7dc1bf None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:13.257357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f763a8-3822-4c5f-affb-44b67d7dc1bf None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:13.257357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f763a8-3822-4c5f-affb-44b67d7dc1bf None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:13.259036 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 433/882] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:13.264304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b8b94-478b-4f6c-b114-9f340152cf13 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:13.264600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b8b94-478b-4f6c-b114-9f340152cf13 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:13.264876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b8b94-478b-4f6c-b114-9f340152cf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:13.270525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee0e05-129c-40ad-8025-0ee435e56e17 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:13.270811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee0e05-129c-40ad-8025-0ee435e56e17 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:13.271088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee0e05-129c-40ad-8025-0ee435e56e17 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:13.273115 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 434/883] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:36:13.277545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fea59-53e7-4f99-b6e0-89fa306234ef None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:13.277831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fea59-53e7-4f99-b6e0-89fa306234ef None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:13.278107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fea59-53e7-4f99-b6e0-89fa306234ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:13.283964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-787b8b94-478b-4f6c-b114-9f340152cf13 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:13.285272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-787b8b94-478b-4f6c-b114-9f340152cf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:13.296642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5c9fea59-53e7-4f99-b6e0-89fa306234ef None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:13.297945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5c9fea59-53e7-4f99-b6e0-89fa306234ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:13.331168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:13.356271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:13.368659 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 450/884] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:13.375736 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 435/885] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:13.704738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b8b94-478b-4f6c-b114-9f340152cf13 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:13.710596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fea59-53e7-4f99-b6e0-89fa306234ef None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:13.820130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b8b94-478b-4f6c-b114-9f340152cf13 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:13.844365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fea59-53e7-4f99-b6e0-89fa306234ef None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:13.856430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a71b7-ec3b-401e-a538-6e48c764f2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:13.857151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a71b7-ec3b-401e-a538-6e48c764f2f7 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:13.857535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a71b7-ec3b-401e-a538-6e48c764f2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:13.857884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a71b7-ec3b-401e-a538-6e48c764f2f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:13.858569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a71b7-ec3b-401e-a538-6e48c764f2f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:13.860063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a71b7-ec3b-401e-a538-6e48c764f2f7 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-d69a71b7-ec3b-401e-a538-6e48c764f2f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:13.870030 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:13.871004 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:36:13.871861 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:13.876030 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 451/886] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:36:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:13.877093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a71b7-ec3b-401e-a538-6e48c764f2f7 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:13.886258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3bbbc-31ac-41c2-bc7c-3ed58d463573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:13.886902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3bbbc-31ac-41c2-bc7c-3ed58d463573 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:13.887317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3bbbc-31ac-41c2-bc7c-3ed58d463573 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:13.887626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3bbbc-31ac-41c2-bc7c-3ed58d463573 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:13.898613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3bbbc-31ac-41c2-bc7c-3ed58d463573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-07c3bbbc-31ac-41c2-bc7c-3ed58d463573 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:13.903538 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:13.905425 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:13.906496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:13.906496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:13.906496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:13.906496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:13.906496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:13.906496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:13.906496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:13.906496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:13.906496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:13.906496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:13.906496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 08 20:36:13.906496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:13.906496 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 436/887] 10.222.0.26 () {56 vars in 1120 bytes} [Sat Oct 8 20:36:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:13.911694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3bbbc-31ac-41c2-bc7c-3ed58d463573 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:13.923210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:13.965623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:14.010513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a71b7-ec3b-401e-a538-6e48c764f2f7 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.029576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3bbbc-31ac-41c2-bc7c-3ed58d463573 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.054634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa7a3f-6567-4124-9be9-7d054eb32fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.055891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa7a3f-6567-4124-9be9-7d054eb32fa8 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.056295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa7a3f-6567-4124-9be9-7d054eb32fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.056567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa7a3f-6567-4124-9be9-7d054eb32fa8 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.057303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa7a3f-6567-4124-9be9-7d054eb32fa8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:14.057683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa7a3f-6567-4124-9be9-7d054eb32fa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.059187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa7a3f-6567-4124-9be9-7d054eb32fa8 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.064327 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 452/888] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:36:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:14.070045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa7a3f-6567-4124-9be9-7d054eb32fa8 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.072051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60394947-e8f1-4860-bbc6-a29d789d9690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.073013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60394947-e8f1-4860-bbc6-a29d789d9690 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.073504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60394947-e8f1-4860-bbc6-a29d789d9690 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.074775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60394947-e8f1-4860-bbc6-a29d789d9690 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.075628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60394947-e8f1-4860-bbc6-a29d789d9690 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:14.076111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60394947-e8f1-4860-bbc6-a29d789d9690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.077699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60394947-e8f1-4860-bbc6-a29d789d9690 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.094873 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 437/889] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Oct 8 20:36:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:14.097272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60394947-e8f1-4860-bbc6-a29d789d9690 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.191603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:14.195719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa7a3f-6567-4124-9be9-7d054eb32fa8 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.206084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60394947-e8f1-4860-bbc6-a29d789d9690 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.213785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:14.238144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bfd69-e9b2-40f5-9fe5-a68027b06b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.238671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bfd69-e9b2-40f5-9fe5-a68027b06b3e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.239000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bfd69-e9b2-40f5-9fe5-a68027b06b3e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.239282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bfd69-e9b2-40f5-9fe5-a68027b06b3e None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.239825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bfd69-e9b2-40f5-9fe5-a68027b06b3e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:14.240124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bfd69-e9b2-40f5-9fe5-a68027b06b3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.241549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bfd69-e9b2-40f5-9fe5-a68027b06b3e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.243579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a1b65-d7bb-454b-920a-5540d3d52473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.244213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a1b65-d7bb-454b-920a-5540d3d52473 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.244491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a1b65-d7bb-454b-920a-5540d3d52473 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.244764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a1b65-d7bb-454b-920a-5540d3d52473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.247392 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 453/890] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:36:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:14.248521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463415de-6019-4d19-9d70-bbcb58ca8e73 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.248806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463415de-6019-4d19-9d70-bbcb58ca8e73 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.249077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463415de-6019-4d19-9d70-bbcb58ca8e73 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.250386 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 454/891] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:14.252917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463415de-6019-4d19-9d70-bbcb58ca8e73 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.262133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a1b65-d7bb-454b-920a-5540d3d52473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.264070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a1b65-d7bb-454b-920a-5540d3d52473 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-7b6a1b65-d7bb-454b-920a-5540d3d52473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:14.280184 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:14.281220 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:14.282169 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:14.282169 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:14.282169 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:14.282169 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 438/892] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:14.287266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53094b89-8346-489b-b9c9-2895a6cef773 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.287561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53094b89-8346-489b-b9c9-2895a6cef773 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.287818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53094b89-8346-489b-b9c9-2895a6cef773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.306300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-53094b89-8346-489b-b9c9-2895a6cef773 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:14.307473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-53094b89-8346-489b-b9c9-2895a6cef773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:14.367021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463415de-6019-4d19-9d70-bbcb58ca8e73 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.381220 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 439/893] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:14.381220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53094b89-8346-489b-b9c9-2895a6cef773 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.410790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aa24a-d259-4ef9-aabf-e903a53206d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.411576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aa24a-d259-4ef9-aabf-e903a53206d3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.411912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aa24a-d259-4ef9-aabf-e903a53206d3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.412247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aa24a-d259-4ef9-aabf-e903a53206d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.413008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056aa24a-d259-4ef9-aabf-e903a53206d3 None admin] RBAC: Adding query filter params (interface=public, service_id=873f6a8696754e3bad66bd39b8229167, region_id=RegionOne) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:14.413419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056aa24a-d259-4ef9-aabf-e903a53206d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.415628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056aa24a-d259-4ef9-aabf-e903a53206d3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.421491 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 455/894] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Oct 8 20:36:14 2022] GET /identity/v3/endpoints?service_id=873f6a8696754e3bad66bd39b8229167&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:14.426599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aa24a-d259-4ef9-aabf-e903a53206d3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.457432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:14.497091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:14.510235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53094b89-8346-489b-b9c9-2895a6cef773 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.540274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aa24a-d259-4ef9-aabf-e903a53206d3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.546144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa751a-a742-4699-abdc-d507ee9a6f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.546745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa751a-a742-4699-abdc-d507ee9a6f88 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.547068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa751a-a742-4699-abdc-d507ee9a6f88 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.547339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa751a-a742-4699-abdc-d507ee9a6f88 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.547972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa751a-a742-4699-abdc-d507ee9a6f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:14.548267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa751a-a742-4699-abdc-d507ee9a6f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.549812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa751a-a742-4699-abdc-d507ee9a6f88 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.566213 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 440/895] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:14.567550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa751a-a742-4699-abdc-d507ee9a6f88 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.578098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b8267-b628-4c9d-a643-ebc43dac01f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.579034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b8267-b628-4c9d-a643-ebc43dac01f9 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.579637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b8267-b628-4c9d-a643-ebc43dac01f9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.580227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b8267-b628-4c9d-a643-ebc43dac01f9 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.581101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b8267-b628-4c9d-a643-ebc43dac01f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.583072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b8267-b628-4c9d-a643-ebc43dac01f9 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.597531 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 456/896] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Oct 8 20:36:14 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:36:14.683186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa751a-a742-4699-abdc-d507ee9a6f88 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.722389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726b4fa-ca7d-45af-bf0c-8d7baa88218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.723033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726b4fa-ca7d-45af-bf0c-8d7baa88218c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.723363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726b4fa-ca7d-45af-bf0c-8d7baa88218c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.723636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726b4fa-ca7d-45af-bf0c-8d7baa88218c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.732200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726b4fa-ca7d-45af-bf0c-8d7baa88218c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.733690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726b4fa-ca7d-45af-bf0c-8d7baa88218c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-1726b4fa-ca7d-45af-bf0c-8d7baa88218c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:14.746750 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:14.747804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:14.748772 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:14.748772 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:14.748772 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:14.748772 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:14.748772 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:14.748772 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:14.748772 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:14.748772 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:14.748772 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 08 20:36:14.748772 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:14.748772 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 441/897] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Oct 8 20:36:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:14.752579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b8267-b628-4c9d-a643-ebc43dac01f9 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.754005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726b4fa-ca7d-45af-bf0c-8d7baa88218c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.766931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:14.875373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:14.885374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726b4fa-ca7d-45af-bf0c-8d7baa88218c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.885793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b8267-b628-4c9d-a643-ebc43dac01f9 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.922225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3e9cf-2866-43b7-9790-c21590e7b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.922948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3e9cf-2866-43b7-9790-c21590e7b76c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.923230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3e9cf-2866-43b7-9790-c21590e7b76c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.923502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3e9cf-2866-43b7-9790-c21590e7b76c None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.924230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3e9cf-2866-43b7-9790-c21590e7b76c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:14.924535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3e9cf-2866-43b7-9790-c21590e7b76c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.925997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3e9cf-2866-43b7-9790-c21590e7b76c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.927377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a8f28-a7fe-4c35-a096-4151f37223f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.928141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a8f28-a7fe-4c35-a096-4151f37223f3 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.928422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a8f28-a7fe-4c35-a096-4151f37223f3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.929476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a8f28-a7fe-4c35-a096-4151f37223f3 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.930772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a8f28-a7fe-4c35-a096-4151f37223f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.932192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a8f28-a7fe-4c35-a096-4151f37223f3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.947178 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 442/898] 10.222.0.26 () {56 vars in 1149 bytes} [Sat Oct 8 20:36:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:14.952892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3e9cf-2866-43b7-9790-c21590e7b76c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.954979 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 457/899] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:36:14 2022] POST /identity/v3/services => generated 241 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:36:15.041644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:15.085213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3e9cf-2866-43b7-9790-c21590e7b76c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:15.133001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6886f65-ade3-4f0a-9a25-e228164c9c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:15.133754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6886f65-ade3-4f0a-9a25-e228164c9c10 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:15.134038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6886f65-ade3-4f0a-9a25-e228164c9c10 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:15.134415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6886f65-ade3-4f0a-9a25-e228164c9c10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:15.215076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6886f65-ade3-4f0a-9a25-e228164c9c10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:15.216521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6886f65-ade3-4f0a-9a25-e228164c9c10 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:15.280296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:15.323340 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 443/900] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:14 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 08 20:36:15.328739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a8f28-a7fe-4c35-a096-4151f37223f3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:15.435106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a8f28-a7fe-4c35-a096-4151f37223f3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:15.470903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e34287-7920-4fc7-85f8-e1da20f49b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:15.471539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e34287-7920-4fc7-85f8-e1da20f49b3b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:15.471870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e34287-7920-4fc7-85f8-e1da20f49b3b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:15.472142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e34287-7920-4fc7-85f8-e1da20f49b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:15.486778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e34287-7920-4fc7-85f8-e1da20f49b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:15.488492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e34287-7920-4fc7-85f8-e1da20f49b3b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:15.496028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8ff0c-5a98-49de-b7d1-06781c77a2f2 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:15.496317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8ff0c-5a98-49de-b7d1-06781c77a2f2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:15.496597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8ff0c-5a98-49de-b7d1-06781c77a2f2 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:15.499764 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 444/901] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:15.505120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863933e9-e89d-4f79-97cc-7f87bb3d9431 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:15.505680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863933e9-e89d-4f79-97cc-7f87bb3d9431 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:15.506183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863933e9-e89d-4f79-97cc-7f87bb3d9431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-07e34287-7920-4fc7-85f8-e1da20f49b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:15.506414 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:15.507314 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:15.508828 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:15.508828 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:15.508828 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:15.508828 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 458/902] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:15.519962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e34287-7920-4fc7-85f8-e1da20f49b3b None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:15.519962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:15.538092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-863933e9-e89d-4f79-97cc-7f87bb3d9431 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:15.539305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-863933e9-e89d-4f79-97cc-7f87bb3d9431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:15.618263 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 445/903] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:15.641977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e34287-7920-4fc7-85f8-e1da20f49b3b None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:15.676688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75601e-4d04-47a9-8338-1be2a7f9c9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:15.677324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75601e-4d04-47a9-8338-1be2a7f9c9b8 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:15.677601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75601e-4d04-47a9-8338-1be2a7f9c9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:15.677868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75601e-4d04-47a9-8338-1be2a7f9c9b8 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:15.678500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75601e-4d04-47a9-8338-1be2a7f9c9b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:15.678795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75601e-4d04-47a9-8338-1be2a7f9c9b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:15.680165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75601e-4d04-47a9-8338-1be2a7f9c9b8 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:15.697084 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 459/904] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:15.698442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863933e9-e89d-4f79-97cc-7f87bb3d9431 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:15.800407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863933e9-e89d-4f79-97cc-7f87bb3d9431 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:15.803864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:15.836976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c911de6-5719-4652-a6a4-f2090e1c9b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:15.837635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c911de6-5719-4652-a6a4-f2090e1c9b7e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:15.837911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c911de6-5719-4652-a6a4-f2090e1c9b7e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:15.838178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c911de6-5719-4652-a6a4-f2090e1c9b7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:15.844967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c911de6-5719-4652-a6a4-f2090e1c9b7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:15.846426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c911de6-5719-4652-a6a4-f2090e1c9b7e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-8c911de6-5719-4652-a6a4-f2090e1c9b7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:15.858145 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:15.859065 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:15.859969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:15.859969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:15.859969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:15.859969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:15.859969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:15.859969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:15.859969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:15.859969 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:15.864311 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 446/905] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:15.865704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75601e-4d04-47a9-8338-1be2a7f9c9b8 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:15.931425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:15.963191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c911de6-5719-4652-a6a4-f2090e1c9b7e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:15.971249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75601e-4d04-47a9-8338-1be2a7f9c9b8 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:16.013939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c733b-efe2-4ee0-882c-4ff57d7f43d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:16.014557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c733b-efe2-4ee0-882c-4ff57d7f43d1 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:16.015218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c733b-efe2-4ee0-882c-4ff57d7f43d1 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:16.015494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c733b-efe2-4ee0-882c-4ff57d7f43d1 None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:16.016550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c733b-efe2-4ee0-882c-4ff57d7f43d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:16.016856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c733b-efe2-4ee0-882c-4ff57d7f43d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:16.018765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c733b-efe2-4ee0-882c-4ff57d7f43d1 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:16.037282 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 460/906] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:16.041324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c733b-efe2-4ee0-882c-4ff57d7f43d1 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:16.075700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c911de6-5719-4652-a6a4-f2090e1c9b7e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:16.111364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91fd1b-8c89-4494-81e8-9baa64f19a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:16.112178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91fd1b-8c89-4494-81e8-9baa64f19a9c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:16.112559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91fd1b-8c89-4494-81e8-9baa64f19a9c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:16.113200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91fd1b-8c89-4494-81e8-9baa64f19a9c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:16.113890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91fd1b-8c89-4494-81e8-9baa64f19a9c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:16.115422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91fd1b-8c89-4494-81e8-9baa64f19a9c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-1c91fd1b-8c89-4494-81e8-9baa64f19a9c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:16.125047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:16.126988 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:16.128110 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 447/907] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Oct 8 20:36:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:16.135386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91fd1b-8c89-4494-81e8-9baa64f19a9c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:16.168155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c733b-efe2-4ee0-882c-4ff57d7f43d1 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:16.196252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:16.197153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:16.212832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd0b99-cd35-41cb-b434-5c07f4ade3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:16.213486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd0b99-cd35-41cb-b434-5c07f4ade3c9 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:16.213765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd0b99-cd35-41cb-b434-5c07f4ade3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:16.214034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd0b99-cd35-41cb-b434-5c07f4ade3c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:16.215325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd0b99-cd35-41cb-b434-5c07f4ade3c9 None admin] RBAC: Adding query filter params (role.id=ec45800deb7c46b6aa34a3925199cf96, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=5a6d89a355d4415a95913449481b3e6b) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:16.215637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd0b99-cd35-41cb-b434-5c07f4ade3c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:16.217499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd0b99-cd35-41cb-b434-5c07f4ade3c9 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:16.229272 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 461/908] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:36:16 2022] GET /identity/v3/role_assignments?user.id=5a6d89a355d4415a95913449481b3e6b&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=ec45800deb7c46b6aa34a3925199cf96 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:16.269526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91fd1b-8c89-4494-81e8-9baa64f19a9c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:16.309872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e250-41a8-4f96-81d5-eae067e52dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:16.311320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e250-41a8-4f96-81d5-eae067e52dd4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:16.312062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e250-41a8-4f96-81d5-eae067e52dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:16.312519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e250-41a8-4f96-81d5-eae067e52dd4 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:16.313381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336e250-41a8-4f96-81d5-eae067e52dd4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:16.313880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336e250-41a8-4f96-81d5-eae067e52dd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:16.315582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336e250-41a8-4f96-81d5-eae067e52dd4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:16.322485 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 448/909] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Oct 8 20:36:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:16.328687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd0b99-cd35-41cb-b434-5c07f4ade3c9 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:16.444795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd0b99-cd35-41cb-b434-5c07f4ade3c9 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:16.481839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdf667-ee21-4714-b18e-257906849297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:16.482716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdf667-ee21-4714-b18e-257906849297 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:16.482716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdf667-ee21-4714-b18e-257906849297 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:16.482716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdf667-ee21-4714-b18e-257906849297 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:16.483294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdf667-ee21-4714-b18e-257906849297 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:16.483593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdf667-ee21-4714-b18e-257906849297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:16.485055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdf667-ee21-4714-b18e-257906849297 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:16.490842 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 462/910] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Oct 8 20:36:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:16.497121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e250-41a8-4f96-81d5-eae067e52dd4 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:16.593554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:16.602232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e250-41a8-4f96-81d5-eae067e52dd4 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:16.637686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4f00e-d2d0-4380-8c4a-0135decf418d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:16.638289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4f00e-d2d0-4380-8c4a-0135decf418d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:16.638592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4f00e-d2d0-4380-8c4a-0135decf418d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:16.638832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4f00e-d2d0-4380-8c4a-0135decf418d None admin] PATH_INFO: `/v3/endpoints` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:16.639532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4f00e-d2d0-4380-8c4a-0135decf418d None admin] RBAC: Adding query filter params (interface=public, service_id=4793f34aea2b4e31b6a91ef52290c93b, region_id=RegionOne) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:16.639840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4f00e-d2d0-4380-8c4a-0135decf418d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:16.641274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4f00e-d2d0-4380-8c4a-0135decf418d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:16.649167 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 449/911] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Oct 8 20:36:16 2022] GET /identity/v3/endpoints?service_id=4793f34aea2b4e31b6a91ef52290c93b&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:16.654715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdf667-ee21-4714-b18e-257906849297 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:16.716040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:16.769007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdf667-ee21-4714-b18e-257906849297 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:16.811956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adce1d1-be30-4fca-a6bf-c81679825a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:16.812625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adce1d1-be30-4fca-a6bf-c81679825a48 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:16.812911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adce1d1-be30-4fca-a6bf-c81679825a48 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:16.813200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adce1d1-be30-4fca-a6bf-c81679825a48 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:16.813826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adce1d1-be30-4fca-a6bf-c81679825a48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:16.815195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adce1d1-be30-4fca-a6bf-c81679825a48 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:16.822731 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 463/912] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Oct 8 20:36:16 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:36:17.162070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32612e2-0ca3-4168-b191-324d6b008405 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:17.162699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32612e2-0ca3-4168-b191-324d6b008405 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:17.163206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32612e2-0ca3-4168-b191-324d6b008405 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:17.165252 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 450/913] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:17.171133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea735d74-0f4c-43c1-bd72-cb8b0a65a798 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:17.171445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea735d74-0f4c-43c1-bd72-cb8b0a65a798 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:17.171695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea735d74-0f4c-43c1-bd72-cb8b0a65a798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:17.192181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ea735d74-0f4c-43c1-bd72-cb8b0a65a798 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:17.193409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ea735d74-0f4c-43c1-bd72-cb8b0a65a798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:17.263650 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 464/914] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:17.601231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b90215-a4cb-4409-9d29-426c08965f06 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:17.601791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b90215-a4cb-4409-9d29-426c08965f06 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:17.601791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b90215-a4cb-4409-9d29-426c08965f06 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:17.603252 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 451/915] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:17.604159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea735d74-0f4c-43c1-bd72-cb8b0a65a798 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:17.610558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab04af-b87c-4316-908e-d1522e64c8e5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:17.611124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab04af-b87c-4316-908e-d1522e64c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:17.611624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab04af-b87c-4316-908e-d1522e64c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:17.633941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f1ab04af-b87c-4316-908e-d1522e64c8e5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:17.635503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f1ab04af-b87c-4316-908e-d1522e64c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:17.664875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:17.719221 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 452/916] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:17.732388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea735d74-0f4c-43c1-bd72-cb8b0a65a798 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:17.768081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9521f-e937-4eea-8a6b-3a6fc2b4815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:17.768720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9521f-e937-4eea-8a6b-3a6fc2b4815f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:17.769000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9521f-e937-4eea-8a6b-3a6fc2b4815f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:17.769302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9521f-e937-4eea-8a6b-3a6fc2b4815f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:17.769889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9521f-e937-4eea-8a6b-3a6fc2b4815f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:17.771247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9521f-e937-4eea-8a6b-3a6fc2b4815f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-37a9521f-e937-4eea-8a6b-3a6fc2b4815f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:17.780309 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:17.781312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:17.782173 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 465/917] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:36:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:17.788983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab04af-b87c-4316-908e-d1522e64c8e5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:17.867294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:17.894277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab04af-b87c-4316-908e-d1522e64c8e5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:17.936036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf1276-b3d8-4f9a-b962-00fc9ca0194f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:17.937006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf1276-b3d8-4f9a-b962-00fc9ca0194f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:17.937530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf1276-b3d8-4f9a-b962-00fc9ca0194f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:17.938013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf1276-b3d8-4f9a-b962-00fc9ca0194f None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:17.938861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf1276-b3d8-4f9a-b962-00fc9ca0194f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:17.939365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf1276-b3d8-4f9a-b962-00fc9ca0194f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:17.940912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf1276-b3d8-4f9a-b962-00fc9ca0194f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:17.947017 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 453/918] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:36:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:17.953230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9521f-e937-4eea-8a6b-3a6fc2b4815f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:18.060466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9521f-e937-4eea-8a6b-3a6fc2b4815f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:18.071711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:18.080517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf1276-b3d8-4f9a-b962-00fc9ca0194f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:18.096399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ce5a5-dbff-4cf0-bbc6-c51eec4c8e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:18.097018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ce5a5-dbff-4cf0-bbc6-c51eec4c8e21 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.097330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ce5a5-dbff-4cf0-bbc6-c51eec4c8e21 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.097603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ce5a5-dbff-4cf0-bbc6-c51eec4c8e21 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.098295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ce5a5-dbff-4cf0-bbc6-c51eec4c8e21 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:18.098600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ce5a5-dbff-4cf0-bbc6-c51eec4c8e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:18.099975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ce5a5-dbff-4cf0-bbc6-c51eec4c8e21 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:18.105514 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 466/919] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Oct 8 20:36:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:18.112741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ce5a5-dbff-4cf0-bbc6-c51eec4c8e21 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:18.204011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf1276-b3d8-4f9a-b962-00fc9ca0194f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:18.222629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ce5a5-dbff-4cf0-bbc6-c51eec4c8e21 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:18.244725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d4c49-0d14-488c-a475-b2cb3c78deab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:18.245866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d4c49-0d14-488c-a475-b2cb3c78deab None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.246377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d4c49-0d14-488c-a475-b2cb3c78deab None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.246860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d4c49-0d14-488c-a475-b2cb3c78deab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.247666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d4c49-0d14-488c-a475-b2cb3c78deab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:18.249374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d4c49-0d14-488c-a475-b2cb3c78deab None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-859d4c49-0d14-488c-a475-b2cb3c78deab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:18.259870 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:18.260876 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:18.261788 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:18.263136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89159b13-6c85-4099-8708-98fe36a128ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:18.263753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89159b13-6c85-4099-8708-98fe36a128ff None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.264061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89159b13-6c85-4099-8708-98fe36a128ff None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.264376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89159b13-6c85-4099-8708-98fe36a128ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.265041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89159b13-6c85-4099-8708-98fe36a128ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:18.265727 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 454/920] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Oct 8 20:36:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:18.266499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89159b13-6c85-4099-8708-98fe36a128ff None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:18.277244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d4c49-0d14-488c-a475-b2cb3c78deab None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:18.278077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:18.291850 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 467/921] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:36:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:36:18.403802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d4c49-0d14-488c-a475-b2cb3c78deab None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:18.450563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc7aa4-428c-4974-89d7-0eac7aa1f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:18.451453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc7aa4-428c-4974-89d7-0eac7aa1f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.451883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc7aa4-428c-4974-89d7-0eac7aa1f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.452330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc7aa4-428c-4974-89d7-0eac7aa1f7a4 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.453142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc7aa4-428c-4974-89d7-0eac7aa1f7a4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:18.453617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc7aa4-428c-4974-89d7-0eac7aa1f7a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:18.455198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc7aa4-428c-4974-89d7-0eac7aa1f7a4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:18.461564 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 455/922] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Oct 8 20:36:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:18.470652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89159b13-6c85-4099-8708-98fe36a128ff None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:18.508902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:18.584918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89159b13-6c85-4099-8708-98fe36a128ff None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:18.625759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe6ced-d623-4bbc-aa9e-30d77087b22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:18.627202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe6ced-d623-4bbc-aa9e-30d77087b22e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.627717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe6ced-d623-4bbc-aa9e-30d77087b22e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.628207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe6ced-d623-4bbc-aa9e-30d77087b22e None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.629034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe6ced-d623-4bbc-aa9e-30d77087b22e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:18.629557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe6ced-d623-4bbc-aa9e-30d77087b22e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:18.631121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe6ced-d623-4bbc-aa9e-30d77087b22e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:18.637131 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 468/923] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Oct 8 20:36:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:18.643326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc7aa4-428c-4974-89d7-0eac7aa1f7a4 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:18.708585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:18.751549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc7aa4-428c-4974-89d7-0eac7aa1f7a4 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:18.791287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acce51-227b-4c6f-bda2-4e80a5dcca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:18.792301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acce51-227b-4c6f-bda2-4e80a5dcca9b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.792789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acce51-227b-4c6f-bda2-4e80a5dcca9b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.793292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acce51-227b-4c6f-bda2-4e80a5dcca9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.793739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159cea-d591-4eeb-b9ba-cd24be6c86d8 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.794027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159cea-d591-4eeb-b9ba-cd24be6c86d8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.794305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159cea-d591-4eeb-b9ba-cd24be6c86d8 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.794885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acce51-227b-4c6f-bda2-4e80a5dcca9b None admin] RBAC: Adding query filter params (interface=public, service_id=f18df168a0cc482f95464476ee13c1a2, region_id=RegionOne) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:18.795400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acce51-227b-4c6f-bda2-4e80a5dcca9b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:18.795883 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 469/924] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:18.797210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acce51-227b-4c6f-bda2-4e80a5dcca9b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:18.800837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533be9e-8389-4858-a7c0-349a314ea651 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.801120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533be9e-8389-4858-a7c0-349a314ea651 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.801427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533be9e-8389-4858-a7c0-349a314ea651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.805805 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 456/925] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Oct 8 20:36:18 2022] GET /identity/v3/endpoints?service_id=f18df168a0cc482f95464476ee13c1a2&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:18.814164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acce51-227b-4c6f-bda2-4e80a5dcca9b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:18.824219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8533be9e-8389-4858-a7c0-349a314ea651 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:18.825488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8533be9e-8389-4858-a7c0-349a314ea651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:18.913486 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 470/926] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:18.945730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acce51-227b-4c6f-bda2-4e80a5dcca9b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:18.975067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:18.985408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e159e3d-ed06-4f2f-9295-bb2e83e1d702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:18.986015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159e3d-ed06-4f2f-9295-bb2e83e1d702 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.986297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159e3d-ed06-4f2f-9295-bb2e83e1d702 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.986570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159e3d-ed06-4f2f-9295-bb2e83e1d702 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.987176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e159e3d-ed06-4f2f-9295-bb2e83e1d702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:18.988788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e159e3d-ed06-4f2f-9295-bb2e83e1d702 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:18.995230 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 457/927] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Oct 8 20:36:18 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:36:19.234101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533be9e-8389-4858-a7c0-349a314ea651 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:19.260756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:19.337983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533be9e-8389-4858-a7c0-349a314ea651 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:19.372711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0fff0-5fe2-41c8-a3fb-9566334b884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:19.373380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0fff0-5fe2-41c8-a3fb-9566334b884f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:19.373661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0fff0-5fe2-41c8-a3fb-9566334b884f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:19.373935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0fff0-5fe2-41c8-a3fb-9566334b884f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:19.384927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0fff0-5fe2-41c8-a3fb-9566334b884f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:19.387855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20b7c3-f932-49e3-9680-9a4ebea5e7c1 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:19.388145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20b7c3-f932-49e3-9680-9a4ebea5e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:19.388423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20b7c3-f932-49e3-9680-9a4ebea5e7c1 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-9ac0fff0-5fe2-41c8-a3fb-9566334b884f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:19.389775 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:19.390662 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:19.391890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:19.391890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:19.391890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:19.391890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:19.391890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:19.391890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:19.391890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:19.391890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:19.391890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:19.391890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:19.391890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 08 20:36:19.391890 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:19.391890 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 471/928] 10.222.0.26 () {56 vars in 1120 bytes} [Sat Oct 8 20:36:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:19.394105 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 458/929] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:19.396800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0fff0-5fe2-41c8-a3fb-9566334b884f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:19.400466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d47c2-bb26-43c9-b733-125556e46b5a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:19.400970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d47c2-bb26-43c9-b733-125556e46b5a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:19.401647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d47c2-bb26-43c9-b733-125556e46b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:19.419987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9f7d47c2-bb26-43c9-b733-125556e46b5a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:19.421521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9f7d47c2-bb26-43c9-b733-125556e46b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:19.483911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:19.505288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0fff0-5fe2-41c8-a3fb-9566334b884f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:19.505798 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 459/930] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:19.537383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9518df-f5cc-41a8-a1b4-ba2fa525448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:19.538001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9518df-f5cc-41a8-a1b4-ba2fa525448a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:19.538281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9518df-f5cc-41a8-a1b4-ba2fa525448a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:19.538550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9518df-f5cc-41a8-a1b4-ba2fa525448a None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:19.539750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9518df-f5cc-41a8-a1b4-ba2fa525448a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:19.540055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9518df-f5cc-41a8-a1b4-ba2fa525448a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:19.541457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9518df-f5cc-41a8-a1b4-ba2fa525448a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:19.550138 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 472/931] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Oct 8 20:36:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:19.556269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d47c2-bb26-43c9-b733-125556e46b5a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:19.662246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d47c2-bb26-43c9-b733-125556e46b5a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:19.683303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:19.698104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e975e-2fd8-4712-b574-a696a87a7214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:19.698735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e975e-2fd8-4712-b574-a696a87a7214 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:19.699016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e975e-2fd8-4712-b574-a696a87a7214 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:19.699292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e975e-2fd8-4712-b574-a696a87a7214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:19.710503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e975e-2fd8-4712-b574-a696a87a7214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:19.712493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e975e-2fd8-4712-b574-a696a87a7214 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-5b9e975e-2fd8-4712-b574-a696a87a7214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:19.728030 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:19.728972 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:19.730509 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:19.730509 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:19.730509 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:19.730509 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 460/932] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:19.734830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9518df-f5cc-41a8-a1b4-ba2fa525448a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:19.839164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9518df-f5cc-41a8-a1b4-ba2fa525448a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:19.848517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e975e-2fd8-4712-b574-a696a87a7214 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:19.874190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd0254-9f40-4089-84bd-21af927d038e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:19.874801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd0254-9f40-4089-84bd-21af927d038e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:19.875079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd0254-9f40-4089-84bd-21af927d038e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:19.875355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd0254-9f40-4089-84bd-21af927d038e None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:19.875993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd0254-9f40-4089-84bd-21af927d038e None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:19.876300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd0254-9f40-4089-84bd-21af927d038e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:19.877697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd0254-9f40-4089-84bd-21af927d038e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:19.895973 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 473/933] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:19.896861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd0254-9f40-4089-84bd-21af927d038e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:19.913529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:19.959204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e975e-2fd8-4712-b574-a696a87a7214 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:19.998812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189895e-a45c-4125-aff8-868ff9af190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:19.999733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189895e-a45c-4125-aff8-868ff9af190f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:20.000162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189895e-a45c-4125-aff8-868ff9af190f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:20.000582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189895e-a45c-4125-aff8-868ff9af190f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:20.001337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189895e-a45c-4125-aff8-868ff9af190f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:20.002836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189895e-a45c-4125-aff8-868ff9af190f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-7189895e-a45c-4125-aff8-868ff9af190f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:20.012694 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:20.013849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:36:20.014813 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:20.016349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd0254-9f40-4089-84bd-21af927d038e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:20.017366 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 461/934] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Oct 8 20:36:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:20.029219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189895e-a45c-4125-aff8-868ff9af190f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:20.056781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e08bd-eb07-4812-91dd-89f952762265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:20.057457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e08bd-eb07-4812-91dd-89f952762265 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:20.057736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e08bd-eb07-4812-91dd-89f952762265 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:20.058020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e08bd-eb07-4812-91dd-89f952762265 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:20.063244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:20.066002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e08bd-eb07-4812-91dd-89f952762265 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:20.067443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e08bd-eb07-4812-91dd-89f952762265 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-fc9e08bd-eb07-4812-91dd-89f952762265 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:20.081130 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:20.082123 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:20.083097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:20.083097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:20.083097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:20.083097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:20.083097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:20.083097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:20.083097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:20.083097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:20.083097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 08 20:36:20.083097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:20.085267 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 474/935] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Oct 8 20:36:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:20.088772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e08bd-eb07-4812-91dd-89f952762265 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:20.157890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189895e-a45c-4125-aff8-868ff9af190f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:20.176210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:20.209567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed25b3e-1520-4f6a-83ad-0660a078b45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:20.210085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e08bd-eb07-4812-91dd-89f952762265 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:20.210584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed25b3e-1520-4f6a-83ad-0660a078b45f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:20.211001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed25b3e-1520-4f6a-83ad-0660a078b45f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:20.211977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed25b3e-1520-4f6a-83ad-0660a078b45f None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:20.213022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed25b3e-1520-4f6a-83ad-0660a078b45f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:20.214380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed25b3e-1520-4f6a-83ad-0660a078b45f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:20.215904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed25b3e-1520-4f6a-83ad-0660a078b45f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:20.226583 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 462/936] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Oct 8 20:36:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:20.229111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed25b3e-1520-4f6a-83ad-0660a078b45f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:20.261176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51852f36-e588-42f5-bac4-6c7d2cf869c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:20.261849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51852f36-e588-42f5-bac4-6c7d2cf869c1 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:20.262362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51852f36-e588-42f5-bac4-6c7d2cf869c1 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:20.262660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51852f36-e588-42f5-bac4-6c7d2cf869c1 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:20.263806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51852f36-e588-42f5-bac4-6c7d2cf869c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:20.264117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51852f36-e588-42f5-bac4-6c7d2cf869c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:20.266617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51852f36-e588-42f5-bac4-6c7d2cf869c1 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:20.291048 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 475/937] 10.222.0.26 () {56 vars in 1149 bytes} [Sat Oct 8 20:36:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:20.295851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51852f36-e588-42f5-bac4-6c7d2cf869c1 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:20.373063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:20.377342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed25b3e-1520-4f6a-83ad-0660a078b45f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:20.422525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51852f36-e588-42f5-bac4-6c7d2cf869c1 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:20.425682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3531ece-f5b2-4a3f-ab2f-58d94cf41d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:20.429955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3531ece-f5b2-4a3f-ab2f-58d94cf41d1e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:20.430702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3531ece-f5b2-4a3f-ab2f-58d94cf41d1e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:20.430702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3531ece-f5b2-4a3f-ab2f-58d94cf41d1e None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:20.432016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3531ece-f5b2-4a3f-ab2f-58d94cf41d1e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:20.432405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3531ece-f5b2-4a3f-ab2f-58d94cf41d1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:20.434399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3531ece-f5b2-4a3f-ab2f-58d94cf41d1e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:20.441749 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 463/938] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Oct 8 20:36:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:20.447169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3531ece-f5b2-4a3f-ab2f-58d94cf41d1e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:20.453142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:20.467206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d19559-b11b-40b4-bb00-bae4c68958ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:20.468032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d19559-b11b-40b4-bb00-bae4c68958ce None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:20.468409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d19559-b11b-40b4-bb00-bae4c68958ce None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:20.468779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d19559-b11b-40b4-bb00-bae4c68958ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:20.491062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d19559-b11b-40b4-bb00-bae4c68958ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:20.492919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d19559-b11b-40b4-bb00-bae4c68958ce None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-01d19559-b11b-40b4-bb00-bae4c68958ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:20.512327 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:20.513586 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:20.514483 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:20.514483 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:20.514483 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:20.517142 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 476/939] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:20.518642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d19559-b11b-40b4-bb00-bae4c68958ce None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:20.584663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3531ece-f5b2-4a3f-ab2f-58d94cf41d1e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:20.620636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72806b76-4ab0-49b6-a369-5ffff63fc5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:20.621282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72806b76-4ab0-49b6-a369-5ffff63fc5a0 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:20.621567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72806b76-4ab0-49b6-a369-5ffff63fc5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:20.622232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72806b76-4ab0-49b6-a369-5ffff63fc5a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:20.622731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72806b76-4ab0-49b6-a369-5ffff63fc5a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:20.624154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72806b76-4ab0-49b6-a369-5ffff63fc5a0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:20.652004 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 464/940] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:36:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:36:20.652740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d19559-b11b-40b4-bb00-bae4c68958ce None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:20.705217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d30a34-94ef-4545-8c8f-8c176ebbdeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:20.706040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d30a34-94ef-4545-8c8f-8c176ebbdeca None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:20.706324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d30a34-94ef-4545-8c8f-8c176ebbdeca None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:20.706642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d30a34-94ef-4545-8c8f-8c176ebbdeca None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:20.707391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d30a34-94ef-4545-8c8f-8c176ebbdeca None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:20.707702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d30a34-94ef-4545-8c8f-8c176ebbdeca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:20.709130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d30a34-94ef-4545-8c8f-8c176ebbdeca None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:20.724202 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 477/941] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:20.730819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72806b76-4ab0-49b6-a369-5ffff63fc5a0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:20.757476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:20.852277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72806b76-4ab0-49b6-a369-5ffff63fc5a0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:20.891391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d9b90-911b-4b6a-b243-151cead05151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:20.892036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d9b90-911b-4b6a-b243-151cead05151 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:20.892314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d9b90-911b-4b6a-b243-151cead05151 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:20.892587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d9b90-911b-4b6a-b243-151cead05151 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:20.900157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d9b90-911b-4b6a-b243-151cead05151 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:20.901634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d9b90-911b-4b6a-b243-151cead05151 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-4b5d9b90-911b-4b6a-b243-151cead05151 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:20.912998 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:20.913933 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:20.914879 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:20.914879 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:20.914879 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:20.914879 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:20.914879 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:20.914879 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:20.914879 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:20.914879 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:20.914879 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 465/942] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:20.920204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d30a34-94ef-4545-8c8f-8c176ebbdeca None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:20.954470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:21.017454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d71499-1e4b-46d3-88be-f822f7db6c86 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:21.017740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d71499-1e4b-46d3-88be-f822f7db6c86 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:21.018001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d71499-1e4b-46d3-88be-f822f7db6c86 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:21.019758 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 466/943] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:36:21.025431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98596822-32c5-4b81-9f7c-d1d9b9a4aa73 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:21.025796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98596822-32c5-4b81-9f7c-d1d9b9a4aa73 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:21.025985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98596822-32c5-4b81-9f7c-d1d9b9a4aa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:21.028146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d30a34-94ef-4545-8c8f-8c176ebbdeca None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:21.047173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-98596822-32c5-4b81-9f7c-d1d9b9a4aa73 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:21.049959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-98596822-32c5-4b81-9f7c-d1d9b9a4aa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:21.074201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeb07f-36bb-48f1-84b6-ce2a6a48d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:21.075235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb07f-36bb-48f1-84b6-ce2a6a48d71c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:21.075769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb07f-36bb-48f1-84b6-ce2a6a48d71c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:21.076286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb07f-36bb-48f1-84b6-ce2a6a48d71c None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:21.077232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeb07f-36bb-48f1-84b6-ce2a6a48d71c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:21.077834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeb07f-36bb-48f1-84b6-ce2a6a48d71c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:21.079631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeb07f-36bb-48f1-84b6-ce2a6a48d71c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:21.093489 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 478/944] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:21.099187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeb07f-36bb-48f1-84b6-ce2a6a48d71c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:21.139867 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 467/945] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:21.200955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:21.210870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeb07f-36bb-48f1-84b6-ce2a6a48d71c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:21.246166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ac227-31f5-4365-87fb-4e239d9ea18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:21.247000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ac227-31f5-4365-87fb-4e239d9ea18c None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:21.247285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ac227-31f5-4365-87fb-4e239d9ea18c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:21.247559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ac227-31f5-4365-87fb-4e239d9ea18c None admin] PATH_INFO: `/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/5a6d89a355d4415a95913449481b3e6b/roles/ec45800deb7c46b6aa34a3925199cf96` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:21.249794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ac227-31f5-4365-87fb-4e239d9ea18c None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba1e9ad05694bbe8723c14f5e2b08f7, user_id=5a6d89a355d4415a95913449481b3e6b, role_id=ec45800deb7c46b6aa34a3925199cf96)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:21.251265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ac227-31f5-4365-87fb-4e239d9ea18c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:21.267609 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 479/946] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:36:21 2022] PUT /identity/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/5a6d89a355d4415a95913449481b3e6b/roles/ec45800deb7c46b6aa34a3925199cf96 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:36:21.476124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98596822-32c5-4b81-9f7c-d1d9b9a4aa73 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:21.489793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:21.501963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359b18a-c148-472d-870e-0d33b0004c39 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:21.502276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359b18a-c148-472d-870e-0d33b0004c39 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:21.502523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359b18a-c148-472d-870e-0d33b0004c39 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:21.503998 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 480/947] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:36:21.510252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faab46f-c430-4543-a566-83e73bb75191 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:21.510535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faab46f-c430-4543-a566-83e73bb75191 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:21.510814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faab46f-c430-4543-a566-83e73bb75191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:21.542332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3faab46f-c430-4543-a566-83e73bb75191 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:21.543451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3faab46f-c430-4543-a566-83e73bb75191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:21.590931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98596822-32c5-4b81-9f7c-d1d9b9a4aa73 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:21.631290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e780dcf-97b3-4f7c-b6fd-bd94cea00cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:21.632279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e780dcf-97b3-4f7c-b6fd-bd94cea00cc6 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:21.632780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e780dcf-97b3-4f7c-b6fd-bd94cea00cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:21.633331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e780dcf-97b3-4f7c-b6fd-bd94cea00cc6 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:21.634019 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 481/948] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:21.638516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e780dcf-97b3-4f7c-b6fd-bd94cea00cc6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:21.641235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e780dcf-97b3-4f7c-b6fd-bd94cea00cc6 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:21.641589 ncdv-master-1 devstack@keystone.service[99084]: WARNING keystone.server.flask.common [None req-1e780dcf-97b3-4f7c-b6fd-bd94cea00cc6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 08 20:36:21.659993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.sql.core [None req-1e780dcf-97b3-4f7c-b6fd-bd94cea00cc6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 08 20:36:21.659993 ncdv-master-1 devstack@keystone.service[99084]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 08 20:36:21.659993 ncdv-master-1 devstack@keystone.service[99084]: [parameters: {'id': 'ee8b13f248574450ba2b632db66739a2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 08 20:36:21.659993 ncdv-master-1 devstack@keystone.service[99084]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=99084) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 08 20:36:21.669712 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-1e780dcf-97b3-4f7c-b6fd-bd94cea00cc6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee8b13f248574450ba2b632db66739a2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee8b13f248574450ba2b632db66739a2. Oct 08 20:36:21.669712 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:21.669712 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:36:21.669712 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 20:36:21.669712 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:36:21.669712 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 20:36:21.669712 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:36:21.669712 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 20:36:21.669712 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:36:21.669712 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application conn.query(q) Oct 08 20:36:21.669712 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:36:21.669712 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:36:21.669712 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result.read() Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 08 20:36:21.670537 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application next(self.gen) Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application yield resource Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application next(self.gen) Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.session.rollback() Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.force_reraise() Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise self.value Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application session.commit() Oct 08 20:36:21.671549 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._prepare_impl() Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.session.flush() Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._flush(objects) Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application compat.raise_( Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application flush_context.execute() Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 08 20:36:21.672452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rec.execute(self) Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 08 20:36:21.674297 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application conn.query(q) Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result.read() Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:36:21.676202 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [parameters: {'id': 'ee8b13f248574450ba2b632db66739a2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:21.678675 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:21.686116 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:21.688294 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:21.688294 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 08 20:36:21.688294 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 08 20:36:21.688294 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:21.688294 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:21.688294 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 08 20:36:21.688294 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 08 20:36:21.688294 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee8b13f248574450ba2b632db66739a2. Oct 08 20:36:21.688294 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:21.688294 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 468/949] 10.222.0.26 () {60 vars in 1140 bytes} [Sat Oct 8 20:36:21 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:21.693703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faab46f-c430-4543-a566-83e73bb75191 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:21.768904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:21.788418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faab46f-c430-4543-a566-83e73bb75191 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:21.825572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0cc1c-e14a-4ffe-a9fb-e991b76db846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:21.826187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0cc1c-e14a-4ffe-a9fb-e991b76db846 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:21.826468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0cc1c-e14a-4ffe-a9fb-e991b76db846 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:21.826742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0cc1c-e14a-4ffe-a9fb-e991b76db846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:21.833979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0cc1c-e14a-4ffe-a9fb-e991b76db846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:21.835407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0cc1c-e14a-4ffe-a9fb-e991b76db846 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-f1b0cc1c-e14a-4ffe-a9fb-e991b76db846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:21.848385 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:21.850494 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:21.854025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:21.854025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:21.854025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:21.854025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:21.854025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:21.854025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:21.854025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:21.854025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:21.854025 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 482/950] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:21.858198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e780dcf-97b3-4f7c-b6fd-bd94cea00cc6 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:21.928727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:21.966492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e780dcf-97b3-4f7c-b6fd-bd94cea00cc6 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:21.986899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0cc1c-e14a-4ffe-a9fb-e991b76db846 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:22.006740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7199f-cf1c-4ba3-ba7d-a637b18dfd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:22.007514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7199f-cf1c-4ba3-ba7d-a637b18dfd9f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:22.007793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7199f-cf1c-4ba3-ba7d-a637b18dfd9f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:22.008492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7199f-cf1c-4ba3-ba7d-a637b18dfd9f None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:22.009168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7199f-cf1c-4ba3-ba7d-a637b18dfd9f None admin] RBAC: Adding query filter params (name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:22.009505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7199f-cf1c-4ba3-ba7d-a637b18dfd9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:22.011660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7199f-cf1c-4ba3-ba7d-a637b18dfd9f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:22.038040 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 469/951] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Oct 8 20:36:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:22.107479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0cc1c-e14a-4ffe-a9fb-e991b76db846 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:22.147881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf902b-5885-4d21-8691-40ed35d45194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:22.149040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf902b-5885-4d21-8691-40ed35d45194 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:22.149361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf902b-5885-4d21-8691-40ed35d45194 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:22.149636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf902b-5885-4d21-8691-40ed35d45194 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:22.150242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf902b-5885-4d21-8691-40ed35d45194 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:22.151760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf902b-5885-4d21-8691-40ed35d45194 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-acaf902b-5885-4d21-8691-40ed35d45194 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:22.161901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:22.165098 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:22.167260 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 483/952] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Oct 8 20:36:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:22.173298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7199f-cf1c-4ba3-ba7d-a637b18dfd9f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:22.289713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7199f-cf1c-4ba3-ba7d-a637b18dfd9f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:22.319633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:22.329401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42a60f-5ab0-40cc-97aa-cd54f43ab5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:22.330007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42a60f-5ab0-40cc-97aa-cd54f43ab5cd None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:22.330286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42a60f-5ab0-40cc-97aa-cd54f43ab5cd None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:22.330578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42a60f-5ab0-40cc-97aa-cd54f43ab5cd None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:22.331190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42a60f-5ab0-40cc-97aa-cd54f43ab5cd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:22.331514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42a60f-5ab0-40cc-97aa-cd54f43ab5cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:22.332849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42a60f-5ab0-40cc-97aa-cd54f43ab5cd None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:22.337909 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 470/953] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Oct 8 20:36:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:22.343635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf902b-5885-4d21-8691-40ed35d45194 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:22.355079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:22.459194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf902b-5885-4d21-8691-40ed35d45194 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:22.500147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd9c63-4fca-4259-8479-a8ddef473704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:22.500768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd9c63-4fca-4259-8479-a8ddef473704 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:22.501053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd9c63-4fca-4259-8479-a8ddef473704 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:22.501369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd9c63-4fca-4259-8479-a8ddef473704 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:22.502005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd9c63-4fca-4259-8479-a8ddef473704 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:22.502311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd9c63-4fca-4259-8479-a8ddef473704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:22.503679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd9c63-4fca-4259-8479-a8ddef473704 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:22.509034 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 484/954] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Oct 8 20:36:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:22.517574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42a60f-5ab0-40cc-97aa-cd54f43ab5cd None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:22.626340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42a60f-5ab0-40cc-97aa-cd54f43ab5cd None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:22.667417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17dc91-aff3-454e-951b-728ed1e8f257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:22.668319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17dc91-aff3-454e-951b-728ed1e8f257 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:22.668747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17dc91-aff3-454e-951b-728ed1e8f257 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:22.669179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17dc91-aff3-454e-951b-728ed1e8f257 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:22.670022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17dc91-aff3-454e-951b-728ed1e8f257 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:22.671532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17dc91-aff3-454e-951b-728ed1e8f257 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:22.694261 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 471/955] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:36:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:36:23.217465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf247bf5-8d85-40a6-ad55-8e07c19953c6 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:23.217995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf247bf5-8d85-40a6-ad55-8e07c19953c6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:23.217995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf247bf5-8d85-40a6-ad55-8e07c19953c6 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:23.219719 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 485/956] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:23.225291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005d19b-1208-4fb0-8c1b-c92e56c067ea None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:23.225712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005d19b-1208-4fb0-8c1b-c92e56c067ea None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:23.225857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005d19b-1208-4fb0-8c1b-c92e56c067ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:23.247393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d005d19b-1208-4fb0-8c1b-c92e56c067ea None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:23.248935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d005d19b-1208-4fb0-8c1b-c92e56c067ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:23.294078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:23.329676 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 472/957] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:23.658704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf247bf5-8d85-40a6-ad55-8e07c19953c6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:23.731783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:23.764747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf247bf5-8d85-40a6-ad55-8e07c19953c6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:23.799181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a3865-9ceb-4d12-907f-2ca7c39ce082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:23.799809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a3865-9ceb-4d12-907f-2ca7c39ce082 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:23.800128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a3865-9ceb-4d12-907f-2ca7c39ce082 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:23.800402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a3865-9ceb-4d12-907f-2ca7c39ce082 None admin] PATH_INFO: `/v3/services/compute` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:23.800974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a3865-9ceb-4d12-907f-2ca7c39ce082 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:23.802412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a3865-9ceb-4d12-907f-2ca7c39ce082 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-2c6a3865-9ceb-4d12-907f-2ca7c39ce082 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:23.811270 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:23.812306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:23.813518 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 486/958] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:23.821211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dde01-f11f-4d4b-84d1-bf41c57498fd None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:23.821540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a3865-9ceb-4d12-907f-2ca7c39ce082 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:23.821805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dde01-f11f-4d4b-84d1-bf41c57498fd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:23.821805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dde01-f11f-4d4b-84d1-bf41c57498fd None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:23.823249 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 473/959] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:23.831364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edee6ff-dc7b-407c-a26b-dec17e6dbd27 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:23.832038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edee6ff-dc7b-407c-a26b-dec17e6dbd27 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:23.832535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edee6ff-dc7b-407c-a26b-dec17e6dbd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:23.852512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7edee6ff-dc7b-407c-a26b-dec17e6dbd27 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:23.854252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7edee6ff-dc7b-407c-a26b-dec17e6dbd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:23.923424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a3865-9ceb-4d12-907f-2ca7c39ce082 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:23.929704 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 474/960] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:23.958361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dd224-0320-45f8-a26a-394700b5ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:23.958964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dd224-0320-45f8-a26a-394700b5ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:23.959241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dd224-0320-45f8-a26a-394700b5ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:23.959511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dd224-0320-45f8-a26a-394700b5ecd2 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:23.960132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dd224-0320-45f8-a26a-394700b5ecd2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:23.960431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dd224-0320-45f8-a26a-394700b5ecd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:23.962450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dd224-0320-45f8-a26a-394700b5ecd2 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:23.963535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:23.967749 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 487/961] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Oct 8 20:36:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:23.978470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edee6ff-dc7b-407c-a26b-dec17e6dbd27 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:24.085789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edee6ff-dc7b-407c-a26b-dec17e6dbd27 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:24.087657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:24.121840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3de09-caa4-48c2-861c-8222b863e079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:24.122469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3de09-caa4-48c2-861c-8222b863e079 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:24.122747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3de09-caa4-48c2-861c-8222b863e079 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:24.123071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3de09-caa4-48c2-861c-8222b863e079 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:24.123803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3de09-caa4-48c2-861c-8222b863e079 None admin] RBAC: Adding query filter params (type=compute) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:24.124158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3de09-caa4-48c2-861c-8222b863e079 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:24.125590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3de09-caa4-48c2-861c-8222b863e079 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:24.133773 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 475/962] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Oct 8 20:36:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:24.267976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dd224-0320-45f8-a26a-394700b5ecd2 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:24.380981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dd224-0320-45f8-a26a-394700b5ecd2 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:24.417702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de0d53-66cd-492f-8663-5f99ebf7a2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:24.418335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de0d53-66cd-492f-8663-5f99ebf7a2b0 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:24.418610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de0d53-66cd-492f-8663-5f99ebf7a2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:24.418876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de0d53-66cd-492f-8663-5f99ebf7a2b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:24.429462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de0d53-66cd-492f-8663-5f99ebf7a2b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-a4de0d53-66cd-492f-8663-5f99ebf7a2b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:24.442621 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:24.443599 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:24.444444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:24.444444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:24.444444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:24.444444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:24.444444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:24.444444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:24.444444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:24.444444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:24.444444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:24.444444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:24.444444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 08 20:36:24.444444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:24.444444 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 488/963] 10.222.0.26 () {56 vars in 1120 bytes} [Sat Oct 8 20:36:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:24.450419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3de09-caa4-48c2-861c-8222b863e079 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:24.556766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3de09-caa4-48c2-861c-8222b863e079 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:24.592483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b932cd6-ad33-47e1-942c-700d1762ab7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:24.593203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b932cd6-ad33-47e1-942c-700d1762ab7c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:24.593569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b932cd6-ad33-47e1-942c-700d1762ab7c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:24.593755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b932cd6-ad33-47e1-942c-700d1762ab7c None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:24.594414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b932cd6-ad33-47e1-942c-700d1762ab7c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:24.594710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b932cd6-ad33-47e1-942c-700d1762ab7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:24.596171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b932cd6-ad33-47e1-942c-700d1762ab7c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:24.604913 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 476/964] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Oct 8 20:36:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:24.610145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de0d53-66cd-492f-8663-5f99ebf7a2b0 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:24.674282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:24.715267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302c9e-335b-4d51-be7b-1606a0da66f2 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:24.715554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302c9e-335b-4d51-be7b-1606a0da66f2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:24.715836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302c9e-335b-4d51-be7b-1606a0da66f2 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:24.717453 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 477/965] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:36:24.719622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de0d53-66cd-492f-8663-5f99ebf7a2b0 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:24.722350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fa17d-7b5f-4d05-92eb-6b1d4893cc27 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:24.722633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fa17d-7b5f-4d05-92eb-6b1d4893cc27 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:24.722909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fa17d-7b5f-4d05-92eb-6b1d4893cc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:24.741054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e09fa17d-7b5f-4d05-92eb-6b1d4893cc27 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:24.742308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e09fa17d-7b5f-4d05-92eb-6b1d4893cc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:24.760491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19b8e4-2fac-4cc2-8f8b-701118bc354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:24.761689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19b8e4-2fac-4cc2-8f8b-701118bc354f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:24.762060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19b8e4-2fac-4cc2-8f8b-701118bc354f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:24.762409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19b8e4-2fac-4cc2-8f8b-701118bc354f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:24.772353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:24.776974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19b8e4-2fac-4cc2-8f8b-701118bc354f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:24.778816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19b8e4-2fac-4cc2-8f8b-701118bc354f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-dd19b8e4-2fac-4cc2-8f8b-701118bc354f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:24.800178 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:24.801424 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:24.802354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:24.802354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:24.802354 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:24.802354 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 489/966] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:24.807583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19b8e4-2fac-4cc2-8f8b-701118bc354f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:24.837239 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 478/967] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:24.922030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19b8e4-2fac-4cc2-8f8b-701118bc354f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:24.933322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:24.957890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d82f7-e961-45a0-a49c-d6feef819d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:24.958503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d82f7-e961-45a0-a49c-d6feef819d82 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:24.958785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d82f7-e961-45a0-a49c-d6feef819d82 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:24.959050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d82f7-e961-45a0-a49c-d6feef819d82 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:24.959691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d82f7-e961-45a0-a49c-d6feef819d82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:24.959991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d82f7-e961-45a0-a49c-d6feef819d82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:24.961463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d82f7-e961-45a0-a49c-d6feef819d82 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:24.973858 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 490/968] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:24.979104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fa17d-7b5f-4d05-92eb-6b1d4893cc27 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:25.082273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fa17d-7b5f-4d05-92eb-6b1d4893cc27 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:25.116842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a668c-9dcd-4b88-923a-eadf25959b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:25.118002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a668c-9dcd-4b88-923a-eadf25959b20 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:25.118278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a668c-9dcd-4b88-923a-eadf25959b20 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:25.118544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a668c-9dcd-4b88-923a-eadf25959b20 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:25.126103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a668c-9dcd-4b88-923a-eadf25959b20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:25.127518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a668c-9dcd-4b88-923a-eadf25959b20 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-477a668c-9dcd-4b88-923a-eadf25959b20 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:25.139992 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:25.141262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:25.142802 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:25.142802 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:25.142802 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:25.142802 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:25.142802 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:25.142802 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:25.142802 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:25.142802 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:25.142802 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 08 20:36:25.142802 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:25.142802 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 479/969] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Oct 8 20:36:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:25.147469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d82f7-e961-45a0-a49c-d6feef819d82 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:25.193224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a668c-9dcd-4b88-923a-eadf25959b20 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:25.213488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:25.266905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d82f7-e961-45a0-a49c-d6feef819d82 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:25.315603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d8ffb-04fa-4667-8832-e4dc97b2d242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:25.316944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d8ffb-04fa-4667-8832-e4dc97b2d242 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:25.317410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d8ffb-04fa-4667-8832-e4dc97b2d242 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:25.317641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a668c-9dcd-4b88-923a-eadf25959b20 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:25.317986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d8ffb-04fa-4667-8832-e4dc97b2d242 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:25.318868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d8ffb-04fa-4667-8832-e4dc97b2d242 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:25.319445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d8ffb-04fa-4667-8832-e4dc97b2d242 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:25.321333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d8ffb-04fa-4667-8832-e4dc97b2d242 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:25.341283 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 491/970] 10.222.0.26 () {56 vars in 1149 bytes} [Sat Oct 8 20:36:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:25.342914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68008712-fbb4-41d4-8fd5-20251ddf7337 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:25.343198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68008712-fbb4-41d4-8fd5-20251ddf7337 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:25.343468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68008712-fbb4-41d4-8fd5-20251ddf7337 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:25.349037 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 492/971] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:25.349618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68008712-fbb4-41d4-8fd5-20251ddf7337 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:25.371734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa005e-8d14-45c4-b4a9-ecf4e80f877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:25.372674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa005e-8d14-45c4-b4a9-ecf4e80f877c None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:25.373212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa005e-8d14-45c4-b4a9-ecf4e80f877c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:25.373674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa005e-8d14-45c4-b4a9-ecf4e80f877c None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:25.374492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa005e-8d14-45c4-b4a9-ecf4e80f877c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:25.376106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa005e-8d14-45c4-b4a9-ecf4e80f877c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:25.389564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:25.393464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.sql.core [None req-b1fa005e-8d14-45c4-b4a9-ecf4e80f877c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 08 20:36:25.393464 ncdv-master-1 devstack@keystone.service[99084]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 08 20:36:25.393464 ncdv-master-1 devstack@keystone.service[99084]: [parameters: {'user_id': '56e26bd6305547b49ece4d82ac385010', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 08 20:36:25.393464 ncdv-master-1 devstack@keystone.service[99084]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=99084) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-b1fa005e-8d14-45c4-b4a9-ecf4e80f877c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application conn.query(q) Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result.read() Oct 08 20:36:25.403307 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 20:36:25.404258 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application next(self.gen) Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application yield resource Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application next(self.gen) Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.session.rollback() Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.force_reraise() Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise self.value Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application session.commit() Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 08 20:36:25.405239 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._prepare_impl() Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.session.flush() Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._flush(objects) Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application compat.raise_( Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application flush_context.execute() Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rec.execute(self) Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 08 20:36:25.406167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:36:25.407047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application conn.query(q) Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result.read() Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:36:25.407904 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [parameters: {'user_id': '56e26bd6305547b49ece4d82ac385010', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:25.409008 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 08 20:36:25.410117 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 08 20:36:25.411433 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 08 20:36:25.411433 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 08 20:36:25.411433 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 08 20:36:25.411433 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 08 20:36:25.411433 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 08 20:36:25.411433 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:25.413794 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 480/972] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Oct 8 20:36:25 2022] POST /identity/v3/users => generated 160 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:25.416296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6fdb3-1fe0-4a9c-a36a-68a47937e927 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:25.416728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6fdb3-1fe0-4a9c-a36a-68a47937e927 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:25.417140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6fdb3-1fe0-4a9c-a36a-68a47937e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:25.443761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-31b6fdb3-1fe0-4a9c-a36a-68a47937e927 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:25.445600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-31b6fdb3-1fe0-4a9c-a36a-68a47937e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:25.468559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68008712-fbb4-41d4-8fd5-20251ddf7337 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:25.517557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e61bf6-36cb-4d14-9c6d-c61cc2adfcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:25.518181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61bf6-36cb-4d14-9c6d-c61cc2adfcc2 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:25.518455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61bf6-36cb-4d14-9c6d-c61cc2adfcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:25.518723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61bf6-36cb-4d14-9c6d-c61cc2adfcc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:25.531439 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 481/973] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:25.532075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6fdb3-1fe0-4a9c-a36a-68a47937e927 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:25.544003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:25.629096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e61bf6-36cb-4d14-9c6d-c61cc2adfcc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:25.631758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e61bf6-36cb-4d14-9c6d-c61cc2adfcc2 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:25.667354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:25.672882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6fdb3-1fe0-4a9c-a36a-68a47937e927 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:25.736708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e922db-3458-4843-9778-70b8e43f8422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:25.737699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e922db-3458-4843-9778-70b8e43f8422 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:25.738090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e922db-3458-4843-9778-70b8e43f8422 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:25.739125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e922db-3458-4843-9778-70b8e43f8422 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:25.753088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e922db-3458-4843-9778-70b8e43f8422 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:25.755422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e922db-3458-4843-9778-70b8e43f8422 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:25.768889 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 493/974] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:25 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:36:25.770073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e61bf6-36cb-4d14-9c6d-c61cc2adfcc2 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-21e922db-3458-4843-9778-70b8e43f8422 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:25.776436 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:25.777422 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:25.778396 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:25.778396 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:25.778396 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:25.778396 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:25.778396 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:25.778396 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:25.778396 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:25.778396 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:25.778396 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:36:25.778396 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:25.783215 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 482/975] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:36:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:25.784170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e922db-3458-4843-9778-70b8e43f8422 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:25.878547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:25.916775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e922db-3458-4843-9778-70b8e43f8422 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:25.928324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e61bf6-36cb-4d14-9c6d-c61cc2adfcc2 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:25.951484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53511428-6903-4465-91f4-7032a1064556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:25.952086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53511428-6903-4465-91f4-7032a1064556 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:25.952361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53511428-6903-4465-91f4-7032a1064556 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:25.952631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53511428-6903-4465-91f4-7032a1064556 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:25.953349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53511428-6903-4465-91f4-7032a1064556 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:25.953646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53511428-6903-4465-91f4-7032a1064556 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:25.955050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53511428-6903-4465-91f4-7032a1064556 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:25.956707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:25.966247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5312f-d9fc-42bf-817d-c0e03f632e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:25.966877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5312f-d9fc-42bf-817d-c0e03f632e10 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:25.967153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5312f-d9fc-42bf-817d-c0e03f632e10 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:25.967426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5312f-d9fc-42bf-817d-c0e03f632e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:25.977806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5312f-d9fc-42bf-817d-c0e03f632e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:25.979230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5312f-d9fc-42bf-817d-c0e03f632e10 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:25.993241 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 483/976] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Oct 8 20:36:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:25.994009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53511428-6903-4465-91f4-7032a1064556 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-43d5312f-d9fc-42bf-817d-c0e03f632e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:25.997545 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:25.998614 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:25.999513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:25.999513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:25.999513 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:25.999513 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 494/977] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:26.005699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5312f-d9fc-42bf-817d-c0e03f632e10 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:26.132207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5312f-d9fc-42bf-817d-c0e03f632e10 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:26.140848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53511428-6903-4465-91f4-7032a1064556 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:26.174405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:26.181826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637a090-6d9e-4256-bcfa-b328a0a773e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:26.182628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637a090-6d9e-4256-bcfa-b328a0a773e3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:26.182915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637a090-6d9e-4256-bcfa-b328a0a773e3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:26.183188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637a090-6d9e-4256-bcfa-b328a0a773e3 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:26.183839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637a090-6d9e-4256-bcfa-b328a0a773e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:26.184143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637a090-6d9e-4256-bcfa-b328a0a773e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:26.185357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05429339-755f-45ab-8e26-58fd23d8c5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:26.185666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637a090-6d9e-4256-bcfa-b328a0a773e3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:26.186389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429339-755f-45ab-8e26-58fd23d8c5a6 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:26.186818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429339-755f-45ab-8e26-58fd23d8c5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:26.187248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429339-755f-45ab-8e26-58fd23d8c5a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:26.188053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05429339-755f-45ab-8e26-58fd23d8c5a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:26.189695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05429339-755f-45ab-8e26-58fd23d8c5a6 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-05429339-755f-45ab-8e26-58fd23d8c5a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:26.200315 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:26.201689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:26.202714 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:26.204995 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 484/978] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Oct 8 20:36:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:26.205347 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 495/979] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:26.211995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637a090-6d9e-4256-bcfa-b328a0a773e3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:26.212613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05429339-755f-45ab-8e26-58fd23d8c5a6 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:26.268713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:26.344732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637a090-6d9e-4256-bcfa-b328a0a773e3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:26.356592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05429339-755f-45ab-8e26-58fd23d8c5a6 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:26.392729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e04039-a3c0-4ba3-9217-647167737524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:26.393432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e04039-a3c0-4ba3-9217-647167737524 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:26.393700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e04039-a3c0-4ba3-9217-647167737524 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:26.393969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e04039-a3c0-4ba3-9217-647167737524 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:26.398044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25970c66-e0c6-4236-b3ee-89fcba3b86f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:26.398949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25970c66-e0c6-4236-b3ee-89fcba3b86f0 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:26.399432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25970c66-e0c6-4236-b3ee-89fcba3b86f0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:26.399900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25970c66-e0c6-4236-b3ee-89fcba3b86f0 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:26.400711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25970c66-e0c6-4236-b3ee-89fcba3b86f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:26.400834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e04039-a3c0-4ba3-9217-647167737524 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:26.401359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25970c66-e0c6-4236-b3ee-89fcba3b86f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:26.402164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e04039-a3c0-4ba3-9217-647167737524 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:26.403088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25970c66-e0c6-4236-b3ee-89fcba3b86f0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:26.408434 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 485/980] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Oct 8 20:36:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-b5e04039-a3c0-4ba3-9217-647167737524 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:26.413277 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:26.414401 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:26.415459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:26.415459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:26.415459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:26.415459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:26.415459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:26.415459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:26.415459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:26.415459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:26.415459 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 496/981] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:26.416411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25970c66-e0c6-4236-b3ee-89fcba3b86f0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:26.419807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e04039-a3c0-4ba3-9217-647167737524 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:26.473675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:26.524131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25970c66-e0c6-4236-b3ee-89fcba3b86f0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:26.528856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:26.532446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e04039-a3c0-4ba3-9217-647167737524 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:26.562031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c5985-f6f0-4d3b-aeb6-fb2c5840f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:26.562641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c5985-f6f0-4d3b-aeb6-fb2c5840f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:26.562908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c5985-f6f0-4d3b-aeb6-fb2c5840f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:26.563175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c5985-f6f0-4d3b-aeb6-fb2c5840f6b3 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:26.563799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c5985-f6f0-4d3b-aeb6-fb2c5840f6b3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:26.564099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c5985-f6f0-4d3b-aeb6-fb2c5840f6b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:26.565592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c5985-f6f0-4d3b-aeb6-fb2c5840f6b3 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:26.568160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4de38b-f5b5-410c-87ac-c0fdced95f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:26.568760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4de38b-f5b5-410c-87ac-c0fdced95f8f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:26.569038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4de38b-f5b5-410c-87ac-c0fdced95f8f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:26.569341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4de38b-f5b5-410c-87ac-c0fdced95f8f None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:26.570022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4de38b-f5b5-410c-87ac-c0fdced95f8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:26.570316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4de38b-f5b5-410c-87ac-c0fdced95f8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:26.571269 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 486/982] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Oct 8 20:36:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:26.574590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4de38b-f5b5-410c-87ac-c0fdced95f8f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:26.576871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c5985-f6f0-4d3b-aeb6-fb2c5840f6b3 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:26.591567 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 497/983] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:26.592560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4de38b-f5b5-410c-87ac-c0fdced95f8f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:26.681370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c5985-f6f0-4d3b-aeb6-fb2c5840f6b3 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:26.695195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4de38b-f5b5-410c-87ac-c0fdced95f8f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:26.701201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:26.715294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0092d9-b89e-406a-a0fc-7f5e595df2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:26.715890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0092d9-b89e-406a-a0fc-7f5e595df2cc None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:26.716164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0092d9-b89e-406a-a0fc-7f5e595df2cc None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:26.716428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0092d9-b89e-406a-a0fc-7f5e595df2cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:26.717120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0092d9-b89e-406a-a0fc-7f5e595df2cc None admin] RBAC: Adding query filter params (interface=admin, service_id=f18df168a0cc482f95464476ee13c1a2, region_id=RegionOne) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:26.717456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0092d9-b89e-406a-a0fc-7f5e595df2cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:26.718820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0092d9-b89e-406a-a0fc-7f5e595df2cc None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:26.723637 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 487/984] 10.222.0.26 () {56 vars in 1249 bytes} [Sat Oct 8 20:36:26 2022] GET /identity/v3/endpoints?service_id=f18df168a0cc482f95464476ee13c1a2&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:26.724930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181f1dd-b59b-41f1-9f74-f74d20093100 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:26.725235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181f1dd-b59b-41f1-9f74-f74d20093100 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:26.725508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181f1dd-b59b-41f1-9f74-f74d20093100 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:26.727312 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 488/985] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:26.730041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181f1dd-b59b-41f1-9f74-f74d20093100 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:26.731552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005b662-6396-4017-9858-5cc3d59eea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:26.732011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005b662-6396-4017-9858-5cc3d59eea39 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:26.732292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005b662-6396-4017-9858-5cc3d59eea39 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:26.732595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005b662-6396-4017-9858-5cc3d59eea39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:26.733353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005b662-6396-4017-9858-5cc3d59eea39 None admin] RBAC: Adding query filter params (role.id=ec45800deb7c46b6aa34a3925199cf96, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=5a6d89a355d4415a95913449481b3e6b) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:26.733663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005b662-6396-4017-9858-5cc3d59eea39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:26.735081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005b662-6396-4017-9858-5cc3d59eea39 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:26.753270 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 498/986] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:36:26 2022] GET /identity/v3/role_assignments?user.id=5a6d89a355d4415a95913449481b3e6b&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=ec45800deb7c46b6aa34a3925199cf96 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:26.753270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9d8b7-7aa7-454d-aed2-f1593bb233af None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:26.753270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9d8b7-7aa7-454d-aed2-f1593bb233af None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:26.753270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9d8b7-7aa7-454d-aed2-f1593bb233af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:26.763429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3df9d8b7-7aa7-454d-aed2-f1593bb233af None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:26.764671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3df9d8b7-7aa7-454d-aed2-f1593bb233af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:26.783982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:26.838226 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 499/987] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:26.862556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181f1dd-b59b-41f1-9f74-f74d20093100 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:26.899819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c80bf-4dec-4aa6-a1aa-e13537c24412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:26.900474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c80bf-4dec-4aa6-a1aa-e13537c24412 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:26.900784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c80bf-4dec-4aa6-a1aa-e13537c24412 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:26.901057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c80bf-4dec-4aa6-a1aa-e13537c24412 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:26.901696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c80bf-4dec-4aa6-a1aa-e13537c24412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:26.903125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c80bf-4dec-4aa6-a1aa-e13537c24412 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:26.917724 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 489/988] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Oct 8 20:36:26 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:36:27.168654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9d8b7-7aa7-454d-aed2-f1593bb233af None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:27.294408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9d8b7-7aa7-454d-aed2-f1593bb233af None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:27.330778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d39ba-1c3f-40a7-842c-dd005eebf410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:27.331388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d39ba-1c3f-40a7-842c-dd005eebf410 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:27.331659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d39ba-1c3f-40a7-842c-dd005eebf410 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:27.331924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d39ba-1c3f-40a7-842c-dd005eebf410 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:27.332557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d39ba-1c3f-40a7-842c-dd005eebf410 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:27.334365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d39ba-1c3f-40a7-842c-dd005eebf410 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:27.349588 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 500/989] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:36:27 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:36:29.199594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258a825-4966-4310-8f2b-85ddc5e1d419 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:29.200171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258a825-4966-4310-8f2b-85ddc5e1d419 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:29.200171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258a825-4966-4310-8f2b-85ddc5e1d419 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:29.201531 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 490/990] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:29.206718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e0ae2-2964-4be9-b501-170b1199e9e1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:29.207121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e0ae2-2964-4be9-b501-170b1199e9e1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:29.207294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e0ae2-2964-4be9-b501-170b1199e9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:29.225571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-236e0ae2-2964-4be9-b501-170b1199e9e1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:29.227319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-236e0ae2-2964-4be9-b501-170b1199e9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:29.237367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:29.313994 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 501/991] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:29.321060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0c4f1-6bef-4573-840f-997f8d1b2c5c None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:29.321445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0c4f1-6bef-4573-840f-997f8d1b2c5c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:29.321795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0c4f1-6bef-4573-840f-997f8d1b2c5c None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:29.323390 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 491/992] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:29.329229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc636df-ef75-4e61-a0b3-37d49e35e7d5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:29.329564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc636df-ef75-4e61-a0b3-37d49e35e7d5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:29.329781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc636df-ef75-4e61-a0b3-37d49e35e7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:29.349856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7fc636df-ef75-4e61-a0b3-37d49e35e7d5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:29.351065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7fc636df-ef75-4e61-a0b3-37d49e35e7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:29.429231 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 502/993] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:29.643032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0c4f1-6bef-4573-840f-997f8d1b2c5c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:29.693934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:29.747270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0c4f1-6bef-4573-840f-997f8d1b2c5c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:29.757316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc636df-ef75-4e61-a0b3-37d49e35e7d5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:29.786410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5befe3b-08c5-4c91-8cae-68d2f40e06d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:29.787043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5befe3b-08c5-4c91-8cae-68d2f40e06d2 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:29.787323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5befe3b-08c5-4c91-8cae-68d2f40e06d2 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:29.787590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5befe3b-08c5-4c91-8cae-68d2f40e06d2 None admin] PATH_INFO: `/v3/services/image` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:29.788173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5befe3b-08c5-4c91-8cae-68d2f40e06d2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:29.789596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5befe3b-08c5-4c91-8cae-68d2f40e06d2 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-a5befe3b-08c5-4c91-8cae-68d2f40e06d2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:29.798276 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:29.799496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:29.800458 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 492/994] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Oct 8 20:36:29 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:29.801382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa517e-7a6a-4ac1-abcb-ea5def3839fb None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:29.801382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa517e-7a6a-4ac1-abcb-ea5def3839fb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:29.801382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa517e-7a6a-4ac1-abcb-ea5def3839fb None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:29.802373 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 493/995] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:29.805222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa517e-7a6a-4ac1-abcb-ea5def3839fb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:29.829469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:29.860823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc636df-ef75-4e61-a0b3-37d49e35e7d5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:29.894484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ed36a-30a2-4be5-9796-cbee0560ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:29.895107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ed36a-30a2-4be5-9796-cbee0560ebc5 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:29.895386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ed36a-30a2-4be5-9796-cbee0560ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:29.895656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ed36a-30a2-4be5-9796-cbee0560ebc5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:29.896237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ed36a-30a2-4be5-9796-cbee0560ebc5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:29.897620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ed36a-30a2-4be5-9796-cbee0560ebc5 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:29.906425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa517e-7a6a-4ac1-abcb-ea5def3839fb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-6c6ed36a-30a2-4be5-9796-cbee0560ebc5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:29.906799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:29.907917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:29.908767 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 503/996] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Oct 8 20:36:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:29.909640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33fa6d-f09b-46a0-8e0f-165f7d669797 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:29.909640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33fa6d-f09b-46a0-8e0f-165f7d669797 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:29.909778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33fa6d-f09b-46a0-8e0f-165f7d669797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:29.920518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:29.927835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8b33fa6d-f09b-46a0-8e0f-165f7d669797 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:29.929022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8b33fa6d-f09b-46a0-8e0f-165f7d669797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:29.942709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc50abc-74c2-49a5-8c06-b69b9094843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:29.943316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc50abc-74c2-49a5-8c06-b69b9094843b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:29.943622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc50abc-74c2-49a5-8c06-b69b9094843b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:29.943923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc50abc-74c2-49a5-8c06-b69b9094843b None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:29.944549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc50abc-74c2-49a5-8c06-b69b9094843b None admin] RBAC: Adding query filter params (name=image) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:29.944855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc50abc-74c2-49a5-8c06-b69b9094843b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:29.946768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc50abc-74c2-49a5-8c06-b69b9094843b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:29.951427 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 494/997] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:29.952188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc50abc-74c2-49a5-8c06-b69b9094843b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:29.998353 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 504/998] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:29.999117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33fa6d-f09b-46a0-8e0f-165f7d669797 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:30.050142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc50abc-74c2-49a5-8c06-b69b9094843b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:30.063119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:30.086196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69299028-3039-4d9f-b212-fe733ba5737c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:30.086802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69299028-3039-4d9f-b212-fe733ba5737c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:30.087082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69299028-3039-4d9f-b212-fe733ba5737c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:30.087352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69299028-3039-4d9f-b212-fe733ba5737c None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:30.087973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69299028-3039-4d9f-b212-fe733ba5737c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:30.088275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69299028-3039-4d9f-b212-fe733ba5737c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:30.089650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69299028-3039-4d9f-b212-fe733ba5737c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:30.097393 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 495/999] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Oct 8 20:36:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:30.099821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69299028-3039-4d9f-b212-fe733ba5737c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:30.108370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33fa6d-f09b-46a0-8e0f-165f7d669797 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:30.143186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:30.145812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bab5b1-9458-4591-93d0-b35e4f9bfba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:30.146424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bab5b1-9458-4591-93d0-b35e4f9bfba2 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:30.146706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bab5b1-9458-4591-93d0-b35e4f9bfba2 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:30.146979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bab5b1-9458-4591-93d0-b35e4f9bfba2 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:30.147607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bab5b1-9458-4591-93d0-b35e4f9bfba2 None admin] RBAC: Adding query filter params (type=image) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:30.147909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bab5b1-9458-4591-93d0-b35e4f9bfba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:30.149326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bab5b1-9458-4591-93d0-b35e4f9bfba2 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:30.154103 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 505/1000] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:29 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:30.207446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69299028-3039-4d9f-b212-fe733ba5737c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:30.246239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43e5ab-13ae-4c55-9062-d9fe3d13b97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:30.246870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43e5ab-13ae-4c55-9062-d9fe3d13b97f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:30.247152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43e5ab-13ae-4c55-9062-d9fe3d13b97f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:30.247425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43e5ab-13ae-4c55-9062-d9fe3d13b97f None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:30.248071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43e5ab-13ae-4c55-9062-d9fe3d13b97f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:30.248432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43e5ab-13ae-4c55-9062-d9fe3d13b97f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:30.249801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43e5ab-13ae-4c55-9062-d9fe3d13b97f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:30.260658 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 496/1001] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Oct 8 20:36:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:30.261823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bab5b1-9458-4591-93d0-b35e4f9bfba2 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:30.330110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43e5ab-13ae-4c55-9062-d9fe3d13b97f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:30.377085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bab5b1-9458-4591-93d0-b35e4f9bfba2 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:30.409602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:30.423547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633062c-ff25-40d4-8e7c-a845fcd3cbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:30.424402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633062c-ff25-40d4-8e7c-a845fcd3cbe6 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:30.424838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633062c-ff25-40d4-8e7c-a845fcd3cbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:30.425516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633062c-ff25-40d4-8e7c-a845fcd3cbe6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:30.426470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633062c-ff25-40d4-8e7c-a845fcd3cbe6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:30.427959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633062c-ff25-40d4-8e7c-a845fcd3cbe6 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:30.451856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43e5ab-13ae-4c55-9062-d9fe3d13b97f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:30.452104 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 506/1002] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:36:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:36:30.456845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:30.496030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbde9f2-b651-443a-bfee-40ccead325bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:30.496755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbde9f2-b651-443a-bfee-40ccead325bf None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:30.497035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbde9f2-b651-443a-bfee-40ccead325bf None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:30.497345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbde9f2-b651-443a-bfee-40ccead325bf None admin] PATH_INFO: `/v3/services/compute` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:30.497931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbde9f2-b651-443a-bfee-40ccead325bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:30.499347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbde9f2-b651-443a-bfee-40ccead325bf None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-9fbde9f2-b651-443a-bfee-40ccead325bf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:30.509500 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:30.510663 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:30.514378 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 497/1003] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:30.516989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633062c-ff25-40d4-8e7c-a845fcd3cbe6 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:30.629568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633062c-ff25-40d4-8e7c-a845fcd3cbe6 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:30.666724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c929a21-a75d-4c3d-911d-b9b354a5e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:30.667335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c929a21-a75d-4c3d-911d-b9b354a5e47a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:30.667612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c929a21-a75d-4c3d-911d-b9b354a5e47a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:30.667879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c929a21-a75d-4c3d-911d-b9b354a5e47a None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:30.668504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c929a21-a75d-4c3d-911d-b9b354a5e47a None admin] RBAC: Adding query filter params (name=compute) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:30.668805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c929a21-a75d-4c3d-911d-b9b354a5e47a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:30.670189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c929a21-a75d-4c3d-911d-b9b354a5e47a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:30.675254 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 507/1004] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Oct 8 20:36:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:30.681022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbde9f2-b651-443a-bfee-40ccead325bf None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:30.787724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbde9f2-b651-443a-bfee-40ccead325bf None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:30.823618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bff1e-866b-485b-96e8-2fbe3ad03e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:30.824219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bff1e-866b-485b-96e8-2fbe3ad03e5b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:30.824498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bff1e-866b-485b-96e8-2fbe3ad03e5b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:30.824825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bff1e-866b-485b-96e8-2fbe3ad03e5b None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:30.825473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bff1e-866b-485b-96e8-2fbe3ad03e5b None admin] RBAC: Adding query filter params (type=compute) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:30.825778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bff1e-866b-485b-96e8-2fbe3ad03e5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:30.827126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bff1e-866b-485b-96e8-2fbe3ad03e5b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:30.837298 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 498/1005] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Oct 8 20:36:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:30.838539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c929a21-a75d-4c3d-911d-b9b354a5e47a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:30.893348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:30.944006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c929a21-a75d-4c3d-911d-b9b354a5e47a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:30.986160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa7969-6034-42c9-9a4f-78c63f73bfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:30.986768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa7969-6034-42c9-9a4f-78c63f73bfde None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:30.987045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa7969-6034-42c9-9a4f-78c63f73bfde None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:30.987317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa7969-6034-42c9-9a4f-78c63f73bfde None admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:30.989750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa7969-6034-42c9-9a4f-78c63f73bfde None admin] RBAC: Adding query filter params (interface=public, service_id=a167460537b5496ca9d041f69d9f4231, region_id=RegionOne) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:30.989750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa7969-6034-42c9-9a4f-78c63f73bfde None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:30.990037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa7969-6034-42c9-9a4f-78c63f73bfde None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:30.999594 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 508/1006] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Oct 8 20:36:30 2022] GET /identity/v3/endpoints?service_id=a167460537b5496ca9d041f69d9f4231&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:31.001181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bff1e-866b-485b-96e8-2fbe3ad03e5b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:31.031397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:31.106475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bff1e-866b-485b-96e8-2fbe3ad03e5b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:31.139425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee6cfe-c28d-4173-aa9b-c86be2a36d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:31.140034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6cfe-c28d-4173-aa9b-c86be2a36d56 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:31.140306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6cfe-c28d-4173-aa9b-c86be2a36d56 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:31.140576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6cfe-c28d-4173-aa9b-c86be2a36d56 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:31.141175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee6cfe-c28d-4173-aa9b-c86be2a36d56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:31.142553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee6cfe-c28d-4173-aa9b-c86be2a36d56 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:31.149555 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 499/1007] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Oct 8 20:36:31 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:36:32.600170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4277d0a-27d1-4e82-95f4-31958779501c None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:32.600708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4277d0a-27d1-4e82-95f4-31958779501c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:32.600708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4277d0a-27d1-4e82-95f4-31958779501c None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:32.602909 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 509/1008] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:32.607867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002eb0d-1391-45ed-80d7-056527736ad5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:32.608246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002eb0d-1391-45ed-80d7-056527736ad5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:32.608425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002eb0d-1391-45ed-80d7-056527736ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:32.626657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7002eb0d-1391-45ed-80d7-056527736ad5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:32.627844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7002eb0d-1391-45ed-80d7-056527736ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:32.696558 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 500/1009] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:32 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:32.878967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8d988-4ed9-45b3-b739-8ec294ba12bd None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:32.879260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8d988-4ed9-45b3-b739-8ec294ba12bd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:32.879453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8d988-4ed9-45b3-b739-8ec294ba12bd None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:32.880885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 510/1010] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:32.886437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b71cc-f25a-4d51-99b7-8bd2a68b13bc None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:32.886726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b71cc-f25a-4d51-99b7-8bd2a68b13bc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:32.886998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b71cc-f25a-4d51-99b7-8bd2a68b13bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:32.905453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-507b71cc-f25a-4d51-99b7-8bd2a68b13bc None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:32.906616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-507b71cc-f25a-4d51-99b7-8bd2a68b13bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:32.922801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:32.976790 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 501/1011] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:32 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:33.023164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8d988-4ed9-45b3-b739-8ec294ba12bd None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:33.125977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8d988-4ed9-45b3-b739-8ec294ba12bd None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:33.146230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:33.166876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983b4cb-b50f-4f4b-8993-c7a4f0e2cb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:33.167492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983b4cb-b50f-4f4b-8993-c7a4f0e2cb62 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:33.167768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983b4cb-b50f-4f4b-8993-c7a4f0e2cb62 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:33.168036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983b4cb-b50f-4f4b-8993-c7a4f0e2cb62 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:33.168682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983b4cb-b50f-4f4b-8993-c7a4f0e2cb62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:33.170059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983b4cb-b50f-4f4b-8993-c7a4f0e2cb62 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:33.186612 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 511/1012] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:36:33 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:36:33.313234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b71cc-f25a-4d51-99b7-8bd2a68b13bc None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:33.426642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b71cc-f25a-4d51-99b7-8bd2a68b13bc None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:33.467812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90f0d0-8b71-494a-a6b6-f9e452cff423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:33.468446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f0d0-8b71-494a-a6b6-f9e452cff423 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:33.468722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f0d0-8b71-494a-a6b6-f9e452cff423 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:33.468993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f0d0-8b71-494a-a6b6-f9e452cff423 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:33.470123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90f0d0-8b71-494a-a6b6-f9e452cff423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:33.471550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90f0d0-8b71-494a-a6b6-f9e452cff423 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:33.477219 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 502/1013] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:33.479410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983b4cb-b50f-4f4b-8993-c7a4f0e2cb62 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:33.579799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fbfda-3fda-4998-829d-429ac18a0012 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:33.580078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fbfda-3fda-4998-829d-429ac18a0012 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:33.580644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fbfda-3fda-4998-829d-429ac18a0012 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:33.582102 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 503/1014] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:33.587854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986f1ef-e42a-4141-b279-f1c544505277 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:33.588112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983b4cb-b50f-4f4b-8993-c7a4f0e2cb62 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:33.588237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986f1ef-e42a-4141-b279-f1c544505277 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:33.588427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986f1ef-e42a-4141-b279-f1c544505277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:33.608068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a986f1ef-e42a-4141-b279-f1c544505277 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:33.609267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a986f1ef-e42a-4141-b279-f1c544505277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:33.620545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:33.623687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fe1af-d2af-41b1-a1bb-720e3cc463da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:33.624307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fe1af-d2af-41b1-a1bb-720e3cc463da None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:33.624983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fe1af-d2af-41b1-a1bb-720e3cc463da None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:33.624983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fe1af-d2af-41b1-a1bb-720e3cc463da None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:33.625586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fe1af-d2af-41b1-a1bb-720e3cc463da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:33.627103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fe1af-d2af-41b1-a1bb-720e3cc463da None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:33.659017 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 512/1015] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:36:33 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:36:33.701316 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 504/1016] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:33 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:34.025975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fe1af-d2af-41b1-a1bb-720e3cc463da None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:34.055672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:34.132414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fe1af-d2af-41b1-a1bb-720e3cc463da None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:34.167676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537693ba-2d84-44f7-8643-ab5f9d10d719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:34.168310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537693ba-2d84-44f7-8643-ab5f9d10d719 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:34.168589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537693ba-2d84-44f7-8643-ab5f9d10d719 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:34.168861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537693ba-2d84-44f7-8643-ab5f9d10d719 None admin] PATH_INFO: `/v3/services/compute` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:34.169468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537693ba-2d84-44f7-8643-ab5f9d10d719 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:34.170826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537693ba-2d84-44f7-8643-ab5f9d10d719 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-537693ba-2d84-44f7-8643-ab5f9d10d719 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:34.179504 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:34.180525 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:34.181420 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 513/1017] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:34.188098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986f1ef-e42a-4141-b279-f1c544505277 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:34.294435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986f1ef-e42a-4141-b279-f1c544505277 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:34.330216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f18d4-2b76-44e9-bc39-735cc45c76a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:34.331205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f18d4-2b76-44e9-bc39-735cc45c76a5 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:34.331727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f18d4-2b76-44e9-bc39-735cc45c76a5 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:34.332204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f18d4-2b76-44e9-bc39-735cc45c76a5 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:34.333023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f18d4-2b76-44e9-bc39-735cc45c76a5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:34.333555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f18d4-2b76-44e9-bc39-735cc45c76a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:34.335127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f18d4-2b76-44e9-bc39-735cc45c76a5 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:34.344727 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 505/1018] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Oct 8 20:36:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:34.346068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537693ba-2d84-44f7-8643-ab5f9d10d719 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:34.447625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:34.458279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537693ba-2d84-44f7-8643-ab5f9d10d719 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:34.499591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d917a-d5d2-4dc1-bdf4-fb89ceb144e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:34.500265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d917a-d5d2-4dc1-bdf4-fb89ceb144e9 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:34.500546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d917a-d5d2-4dc1-bdf4-fb89ceb144e9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:34.500819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d917a-d5d2-4dc1-bdf4-fb89ceb144e9 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:34.501480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d917a-d5d2-4dc1-bdf4-fb89ceb144e9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:34.501782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d917a-d5d2-4dc1-bdf4-fb89ceb144e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:34.503196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d917a-d5d2-4dc1-bdf4-fb89ceb144e9 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:34.508737 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 514/1019] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Oct 8 20:36:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:34.514275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f18d4-2b76-44e9-bc39-735cc45c76a5 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:34.529041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:34.619581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f18d4-2b76-44e9-bc39-735cc45c76a5 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:34.655274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc6a98-3473-408b-a329-d6108369e4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:34.655877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc6a98-3473-408b-a329-d6108369e4e4 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:34.656155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc6a98-3473-408b-a329-d6108369e4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:34.656424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc6a98-3473-408b-a329-d6108369e4e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:34.657091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc6a98-3473-408b-a329-d6108369e4e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:34.658489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc6a98-3473-408b-a329-d6108369e4e4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:34.685223 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 506/1020] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:36:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:36:35.641866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200d334-b64c-4475-9388-61a06e2ff564 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:35.642404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200d334-b64c-4475-9388-61a06e2ff564 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:35.642404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200d334-b64c-4475-9388-61a06e2ff564 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:35.643772 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 515/1021] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:35.649562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e3a06-4078-4714-b35e-d42d147de2b5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:35.649984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e3a06-4078-4714-b35e-d42d147de2b5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:35.650125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e3a06-4078-4714-b35e-d42d147de2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:35.670025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-303e3a06-4078-4714-b35e-d42d147de2b5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:35.671239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-303e3a06-4078-4714-b35e-d42d147de2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:35.733089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:35.749027 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 507/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:36.069599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200d334-b64c-4475-9388-61a06e2ff564 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:36.087765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7d5ad-f221-4f24-9afb-77fbe2841899 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:36.088047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7d5ad-f221-4f24-9afb-77fbe2841899 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:36.088313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7d5ad-f221-4f24-9afb-77fbe2841899 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:36.089789 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 508/1023] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:36.094724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8cdc3-edb6-48d6-8ebb-6d0baf064cf9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:36.095007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8cdc3-edb6-48d6-8ebb-6d0baf064cf9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:36.095278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8cdc3-edb6-48d6-8ebb-6d0baf064cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:36.113887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e5f8cdc3-edb6-48d6-8ebb-6d0baf064cf9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:36.115057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e5f8cdc3-edb6-48d6-8ebb-6d0baf064cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:36.177122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200d334-b64c-4475-9388-61a06e2ff564 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:36.182329 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 509/1024] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:36.210621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af73eb-b5c1-488b-82d9-f4b0fb358dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:36.211785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af73eb-b5c1-488b-82d9-f4b0fb358dde None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:36.212061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af73eb-b5c1-488b-82d9-f4b0fb358dde None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:36.212328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af73eb-b5c1-488b-82d9-f4b0fb358dde None admin] PATH_INFO: `/v3/services/image` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:36.212899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af73eb-b5c1-488b-82d9-f4b0fb358dde None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:36.214274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af73eb-b5c1-488b-82d9-f4b0fb358dde None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-a8af73eb-b5c1-488b-82d9-f4b0fb358dde None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:36.222906 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:36.223881 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:36.224735 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 516/1025] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Oct 8 20:36:36 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:36.230719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8cdc3-edb6-48d6-8ebb-6d0baf064cf9 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:36.326945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8cdc3-edb6-48d6-8ebb-6d0baf064cf9 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:36.349769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:36.362712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a107aa-8f8a-44a0-aec1-a7dc3abb504e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:36.363310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a107aa-8f8a-44a0-aec1-a7dc3abb504e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:36.363836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a107aa-8f8a-44a0-aec1-a7dc3abb504e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:36.364103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a107aa-8f8a-44a0-aec1-a7dc3abb504e None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:36.364719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a107aa-8f8a-44a0-aec1-a7dc3abb504e None admin] RBAC: Adding query filter params (name=image) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:36.365014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a107aa-8f8a-44a0-aec1-a7dc3abb504e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:36.366388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a107aa-8f8a-44a0-aec1-a7dc3abb504e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:36.371285 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 510/1026] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:36.376768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af73eb-b5c1-488b-82d9-f4b0fb358dde None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:36.399225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:36.492549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af73eb-b5c1-488b-82d9-f4b0fb358dde None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:36.504800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a107aa-8f8a-44a0-aec1-a7dc3abb504e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:36.528390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3ae2-1f76-44a4-855a-7f021c51b8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:36.528996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3ae2-1f76-44a4-855a-7f021c51b8b4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:36.529299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3ae2-1f76-44a4-855a-7f021c51b8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:36.529570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3ae2-1f76-44a4-855a-7f021c51b8b4 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:36.530200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d3ae2-1f76-44a4-855a-7f021c51b8b4 None admin] RBAC: Adding query filter params (type=image) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:36.530502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d3ae2-1f76-44a4-855a-7f021c51b8b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:36.531844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d3ae2-1f76-44a4-855a-7f021c51b8b4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:36.538768 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 517/1027] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:36.544692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3ae2-1f76-44a4-855a-7f021c51b8b4 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:36.615130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a107aa-8f8a-44a0-aec1-a7dc3abb504e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:36.634911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:36.650612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed14ef-8ba2-4d68-8915-0e4f6d31b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:36.651272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed14ef-8ba2-4d68-8915-0e4f6d31b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:36.651511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed14ef-8ba2-4d68-8915-0e4f6d31b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:36.651782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed14ef-8ba2-4d68-8915-0e4f6d31b6d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:36.652877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed14ef-8ba2-4d68-8915-0e4f6d31b6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:36.654331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed14ef-8ba2-4d68-8915-0e4f6d31b6d5 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:36.655889 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 511/1028] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:36.656008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3ae2-1f76-44a4-855a-7f021c51b8b4 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:36.661549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed14ef-8ba2-4d68-8915-0e4f6d31b6d5 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:36.692192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ecd22-8672-4003-a637-f13a1ce35e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:36.692750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ecd22-8672-4003-a637-f13a1ce35e93 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:36.693094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ecd22-8672-4003-a637-f13a1ce35e93 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:36.693502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ecd22-8672-4003-a637-f13a1ce35e93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:36.694213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ecd22-8672-4003-a637-f13a1ce35e93 None admin] RBAC: Adding query filter params (interface=public, service_id=e84faa7627cd471dbb6237142403f07a, region_id=RegionOne) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:36.694524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ecd22-8672-4003-a637-f13a1ce35e93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:36.696487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ecd22-8672-4003-a637-f13a1ce35e93 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:36.701661 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 518/1029] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Oct 8 20:36:36 2022] GET /identity/v3/endpoints?service_id=e84faa7627cd471dbb6237142403f07a&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:36.707329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ecd22-8672-4003-a637-f13a1ce35e93 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:36.719804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:36.769973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed14ef-8ba2-4d68-8915-0e4f6d31b6d5 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:36.810027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9382548-5ca2-4737-aa9d-3f8bebdc7727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:36.810633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9382548-5ca2-4737-aa9d-3f8bebdc7727 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:36.810921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9382548-5ca2-4737-aa9d-3f8bebdc7727 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:36.811180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9382548-5ca2-4737-aa9d-3f8bebdc7727 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:36.811833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9382548-5ca2-4737-aa9d-3f8bebdc7727 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:36.813281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9382548-5ca2-4737-aa9d-3f8bebdc7727 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:36.819063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ecd22-8672-4003-a637-f13a1ce35e93 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:36.838326 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 512/1030] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:36:36 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:36:36.860004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a94400-c6a4-450b-bfab-83e582430a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:36.860823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a94400-c6a4-450b-bfab-83e582430a61 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:36.861107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a94400-c6a4-450b-bfab-83e582430a61 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:36.861428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a94400-c6a4-450b-bfab-83e582430a61 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:36.862052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a94400-c6a4-450b-bfab-83e582430a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:36.863704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a94400-c6a4-450b-bfab-83e582430a61 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:36.872102 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 519/1031] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Oct 8 20:36:36 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:36:37.196422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcae27-c113-46ca-8224-b03cd74ef73d None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:37.196751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcae27-c113-46ca-8224-b03cd74ef73d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:37.196927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcae27-c113-46ca-8224-b03cd74ef73d None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:37.198384 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 513/1032] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:37.203291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fcf8f-f28c-4217-bf25-89f4f9a4c65a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:37.203575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fcf8f-f28c-4217-bf25-89f4f9a4c65a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:37.203848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fcf8f-f28c-4217-bf25-89f4f9a4c65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:37.222238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-be5fcf8f-f28c-4217-bf25-89f4f9a4c65a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:37.223409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-be5fcf8f-f28c-4217-bf25-89f4f9a4c65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:37.231602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:37.292716 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 520/1033] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:37.611517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcae27-c113-46ca-8224-b03cd74ef73d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:37.718246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcae27-c113-46ca-8224-b03cd74ef73d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:37.730063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:37.755390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea285be-d810-48da-9462-57a627c0cef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:37.756012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea285be-d810-48da-9462-57a627c0cef4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:37.756284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea285be-d810-48da-9462-57a627c0cef4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:37.756546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea285be-d810-48da-9462-57a627c0cef4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:37.766617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea285be-d810-48da-9462-57a627c0cef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-3ea285be-d810-48da-9462-57a627c0cef4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:37.771311 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:37.772244 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:37.773093 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:37.773093 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:37.773093 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:37.773093 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:37.773093 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:37.773093 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:37.773093 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:37.773093 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:37.773093 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:37.773093 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:37.773093 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 08 20:36:37.773093 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:37.775007 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 514/1034] 10.222.0.26 () {56 vars in 1120 bytes} [Sat Oct 8 20:36:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:37.778741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fcf8f-f28c-4217-bf25-89f4f9a4c65a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:37.876165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fcf8f-f28c-4217-bf25-89f4f9a4c65a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:37.909018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ba18b-5dc6-460f-b530-076f69438eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:37.909643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ba18b-5dc6-460f-b530-076f69438eb8 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:37.909919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ba18b-5dc6-460f-b530-076f69438eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:37.910186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ba18b-5dc6-460f-b530-076f69438eb8 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:37.910837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ba18b-5dc6-460f-b530-076f69438eb8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:37.911135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ba18b-5dc6-460f-b530-076f69438eb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:37.912481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ba18b-5dc6-460f-b530-076f69438eb8 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:37.925443 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 521/1035] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Oct 8 20:36:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:37.926560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea285be-d810-48da-9462-57a627c0cef4 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:38.033093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea285be-d810-48da-9462-57a627c0cef4 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:38.066283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc00c1a-20f8-4dbf-9fc8-f366510df67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:38.066910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00c1a-20f8-4dbf-9fc8-f366510df67e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:38.067184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00c1a-20f8-4dbf-9fc8-f366510df67e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:38.067452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00c1a-20f8-4dbf-9fc8-f366510df67e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:38.077904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc00c1a-20f8-4dbf-9fc8-f366510df67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:38.079326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc00c1a-20f8-4dbf-9fc8-f366510df67e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-4bc00c1a-20f8-4dbf-9fc8-f366510df67e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:38.094393 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:38.095409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:38.096344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:38.096344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:38.096344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:38.096344 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 515/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:38.102633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ba18b-5dc6-460f-b530-076f69438eb8 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:38.106607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:38.205241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ba18b-5dc6-460f-b530-076f69438eb8 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:38.238868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2af74-b712-4aec-929b-27a8c06912a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:38.239471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2af74-b712-4aec-929b-27a8c06912a3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:38.239743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2af74-b712-4aec-929b-27a8c06912a3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:38.240012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2af74-b712-4aec-929b-27a8c06912a3 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:38.240642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2af74-b712-4aec-929b-27a8c06912a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:38.240941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2af74-b712-4aec-929b-27a8c06912a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:38.242393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2af74-b712-4aec-929b-27a8c06912a3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:38.259293 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 522/1037] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:38.260423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc00c1a-20f8-4dbf-9fc8-f366510df67e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:38.285498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:38.361787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc00c1a-20f8-4dbf-9fc8-f366510df67e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:38.395499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96c155-9e0d-4939-a5a6-b1688f5b97af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:38.396116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96c155-9e0d-4939-a5a6-b1688f5b97af None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:38.396392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96c155-9e0d-4939-a5a6-b1688f5b97af None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:38.396659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96c155-9e0d-4939-a5a6-b1688f5b97af None admin] PATH_INFO: `/v3/users/nova` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:38.403896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96c155-9e0d-4939-a5a6-b1688f5b97af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:38.405337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96c155-9e0d-4939-a5a6-b1688f5b97af None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-6f96c155-9e0d-4939-a5a6-b1688f5b97af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:38.416114 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:38.417102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:38.418123 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:38.418123 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:38.418123 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:38.418123 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:38.418123 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:38.418123 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:38.418123 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:38.418123 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:38.418123 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:36:38.418123 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:38.418123 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 516/1038] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Oct 8 20:36:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:38.424572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2af74-b712-4aec-929b-27a8c06912a3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:38.502928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:38.541941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2af74-b712-4aec-929b-27a8c06912a3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:38.576309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac66477-5e87-40f3-b771-10857f838318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:38.576919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac66477-5e87-40f3-b771-10857f838318 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:38.577221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac66477-5e87-40f3-b771-10857f838318 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:38.577491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac66477-5e87-40f3-b771-10857f838318 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:38.578210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac66477-5e87-40f3-b771-10857f838318 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:38.578516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac66477-5e87-40f3-b771-10857f838318 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:38.579922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac66477-5e87-40f3-b771-10857f838318 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:38.596978 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 523/1039] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Oct 8 20:36:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:38.602559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96c155-9e0d-4939-a5a6-b1688f5b97af None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:38.687238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:38.707558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96c155-9e0d-4939-a5a6-b1688f5b97af None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:38.742121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1eea7-7c88-4cff-b9e5-aa9bc41aa7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:38.743394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1eea7-7c88-4cff-b9e5-aa9bc41aa7d0 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:38.743603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1eea7-7c88-4cff-b9e5-aa9bc41aa7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:38.743794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1eea7-7c88-4cff-b9e5-aa9bc41aa7d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:38.811335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1eea7-7c88-4cff-b9e5-aa9bc41aa7d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:38.812705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1eea7-7c88-4cff-b9e5-aa9bc41aa7d0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:38.894875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:38.923497 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 517/1040] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:38 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 08 20:36:38.925459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac66477-5e87-40f3-b771-10857f838318 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:39.031863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac66477-5e87-40f3-b771-10857f838318 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:39.054498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:39.069361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002e43f-d9c1-4b28-a80d-ad50ab7f9802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:39.069936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002e43f-d9c1-4b28-a80d-ad50ab7f9802 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:39.070217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002e43f-d9c1-4b28-a80d-ad50ab7f9802 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:39.071037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002e43f-d9c1-4b28-a80d-ad50ab7f9802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:39.081132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002e43f-d9c1-4b28-a80d-ad50ab7f9802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:39.082599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002e43f-d9c1-4b28-a80d-ad50ab7f9802 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-b002e43f-d9c1-4b28-a80d-ad50ab7f9802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:39.097158 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:39.098153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:39.099077 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:39.099077 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:39.099077 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:39.101264 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 524/1041] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:39.104521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1eea7-7c88-4cff-b9e5-aa9bc41aa7d0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:39.206634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1eea7-7c88-4cff-b9e5-aa9bc41aa7d0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:39.240376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7b57a-396a-4661-b6ef-9b9d649a572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:39.240994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7b57a-396a-4661-b6ef-9b9d649a572f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:39.241302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7b57a-396a-4661-b6ef-9b9d649a572f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:39.241579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7b57a-396a-4661-b6ef-9b9d649a572f None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:39.242827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7b57a-396a-4661-b6ef-9b9d649a572f None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:39.243131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7b57a-396a-4661-b6ef-9b9d649a572f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:39.244486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7b57a-396a-4661-b6ef-9b9d649a572f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:39.261149 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 518/1042] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:39.262836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002e43f-d9c1-4b28-a80d-ad50ab7f9802 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:39.324742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1583fa-8d07-4a5a-9e6d-fbdb198dad49 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:39.325026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1583fa-8d07-4a5a-9e6d-fbdb198dad49 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:39.325237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1583fa-8d07-4a5a-9e6d-fbdb198dad49 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:39.326689 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 519/1043] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:36:39.331586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f059f-047f-44a0-bd24-032d9bcf855b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:39.331874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f059f-047f-44a0-bd24-032d9bcf855b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:39.332152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f059f-047f-44a0-bd24-032d9bcf855b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:39.350023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-957f059f-047f-44a0-bd24-032d9bcf855b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:39.351191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-957f059f-047f-44a0-bd24-032d9bcf855b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:39.370107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002e43f-d9c1-4b28-a80d-ad50ab7f9802 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:39.387072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:39.403930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e0be3-7289-4577-8831-37e99b75f80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:39.404582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e0be3-7289-4577-8831-37e99b75f80f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:39.404918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e0be3-7289-4577-8831-37e99b75f80f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:39.405215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e0be3-7289-4577-8831-37e99b75f80f None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:39.411635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e0be3-7289-4577-8831-37e99b75f80f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:39.413054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e0be3-7289-4577-8831-37e99b75f80f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:39.418121 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 520/1044] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:39.419487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327952de-54c2-48dd-827c-dca0409387f7 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:39.419772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327952de-54c2-48dd-827c-dca0409387f7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:39.420044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327952de-54c2-48dd-827c-dca0409387f7 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:39.421405 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 521/1045] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:39.426495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9afd2-28ae-4842-bac4-6d65263d8b51 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:39.426781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9afd2-28ae-4842-bac4-6d65263d8b51 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:39.427058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9afd2-28ae-4842-bac4-6d65263d8b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-254e0be3-7289-4577-8831-37e99b75f80f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:39.428288 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:39.429136 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:39.430683 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:39.430683 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:39.430683 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:39.430683 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:39.430683 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:39.430683 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:39.430683 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:39.430683 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:39.430683 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 525/1046] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:39.435542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e0be3-7289-4577-8831-37e99b75f80f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:39.447863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-09d9afd2-28ae-4842-bac4-6d65263d8b51 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:39.449570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-09d9afd2-28ae-4842-bac4-6d65263d8b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:39.471103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:39.533289 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 522/1047] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:39.546210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e0be3-7289-4577-8831-37e99b75f80f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:39.580985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2df42-da4a-4f04-a155-db4620ca51c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:39.581539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2df42-da4a-4f04-a155-db4620ca51c7 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:39.581818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2df42-da4a-4f04-a155-db4620ca51c7 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:39.582091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2df42-da4a-4f04-a155-db4620ca51c7 None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:39.582775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2df42-da4a-4f04-a155-db4620ca51c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:39.583208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2df42-da4a-4f04-a155-db4620ca51c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:39.584621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2df42-da4a-4f04-a155-db4620ca51c7 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:39.600961 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 526/1048] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:39.603184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9afd2-28ae-4842-bac4-6d65263d8b51 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:39.706041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9afd2-28ae-4842-bac4-6d65263d8b51 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:39.707558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:39.742964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c13e0-7486-4eb8-9c64-cdf120cb7058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:39.743604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c13e0-7486-4eb8-9c64-cdf120cb7058 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:39.743947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c13e0-7486-4eb8-9c64-cdf120cb7058 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:39.744290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c13e0-7486-4eb8-9c64-cdf120cb7058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:39.745083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c13e0-7486-4eb8-9c64-cdf120cb7058 None admin] RBAC: Adding query filter params (role.id=ec45800deb7c46b6aa34a3925199cf96, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=187d6f51b1604327a4879e9e19b47963) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:39.745628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c13e0-7486-4eb8-9c64-cdf120cb7058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:39.746798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2df42-da4a-4f04-a155-db4620ca51c7 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:39.747066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c13e0-7486-4eb8-9c64-cdf120cb7058 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:39.753893 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 523/1049] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:36:39 2022] GET /identity/v3/role_assignments?user.id=187d6f51b1604327a4879e9e19b47963&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=ec45800deb7c46b6aa34a3925199cf96 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:39.851059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:39.860635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2df42-da4a-4f04-a155-db4620ca51c7 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:39.860827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c13e0-7486-4eb8-9c64-cdf120cb7058 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:39.898308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f493a3-fec1-4f8d-8319-9a40b490c57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:39.899490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f493a3-fec1-4f8d-8319-9a40b490c57c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:39.899772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f493a3-fec1-4f8d-8319-9a40b490c57c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:39.900049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f493a3-fec1-4f8d-8319-9a40b490c57c None admin] PATH_INFO: `/v3/services/image` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:39.900659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f493a3-fec1-4f8d-8319-9a40b490c57c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:39.902122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f493a3-fec1-4f8d-8319-9a40b490c57c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-f5f493a3-fec1-4f8d-8319-9a40b490c57c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:39.911531 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:39.912627 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:39.914001 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 527/1050] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Oct 8 20:36:39 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:39.919407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f493a3-fec1-4f8d-8319-9a40b490c57c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:39.991852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c13e0-7486-4eb8-9c64-cdf120cb7058 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:40.030113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f493a3-fec1-4f8d-8319-9a40b490c57c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:40.030629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41706a3-d0c2-4797-9550-20e5d084470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:40.030951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41706a3-d0c2-4797-9550-20e5d084470b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:40.031232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41706a3-d0c2-4797-9550-20e5d084470b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:40.031504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41706a3-d0c2-4797-9550-20e5d084470b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:40.044608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41706a3-d0c2-4797-9550-20e5d084470b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-d41706a3-d0c2-4797-9550-20e5d084470b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:40.049962 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:40.050940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:40.052410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:40.052410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:40.052410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:40.052410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:40.052410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:40.052410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:40.052410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:40.052410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:40.052410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:40.052410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:40.052410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:40.052410 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:40.052410 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 524/1051] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:36:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:40.056960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41706a3-d0c2-4797-9550-20e5d084470b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:40.072359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc688f2-df43-46ef-bc17-2e47436bd0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:40.073272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc688f2-df43-46ef-bc17-2e47436bd0ab None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:40.073733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc688f2-df43-46ef-bc17-2e47436bd0ab None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:40.074307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc688f2-df43-46ef-bc17-2e47436bd0ab None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:40.075244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc688f2-df43-46ef-bc17-2e47436bd0ab None admin] RBAC: Adding query filter params (name=image) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:40.075620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc688f2-df43-46ef-bc17-2e47436bd0ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:40.077034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc688f2-df43-46ef-bc17-2e47436bd0ab None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:40.082406 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 528/1052] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:40.084205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:40.088630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc688f2-df43-46ef-bc17-2e47436bd0ab None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:40.115107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:40.161930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41706a3-d0c2-4797-9550-20e5d084470b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:40.197462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdce8d-4a80-4f56-acaa-567854c5d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:40.198064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdce8d-4a80-4f56-acaa-567854c5d613 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:40.198340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdce8d-4a80-4f56-acaa-567854c5d613 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:40.198608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdce8d-4a80-4f56-acaa-567854c5d613 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:40.199266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdce8d-4a80-4f56-acaa-567854c5d613 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:40.199564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdce8d-4a80-4f56-acaa-567854c5d613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:40.199739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc688f2-df43-46ef-bc17-2e47436bd0ab None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:40.200911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdce8d-4a80-4f56-acaa-567854c5d613 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:40.210151 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 525/1053] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:36:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:40.216592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdce8d-4a80-4f56-acaa-567854c5d613 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:40.239053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212bfd2-0f6a-4ba0-852f-79e96aec0268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:40.239663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212bfd2-0f6a-4ba0-852f-79e96aec0268 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:40.239940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212bfd2-0f6a-4ba0-852f-79e96aec0268 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:40.240213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212bfd2-0f6a-4ba0-852f-79e96aec0268 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:40.241309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212bfd2-0f6a-4ba0-852f-79e96aec0268 None admin] RBAC: Adding query filter params (type=image) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:40.241619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212bfd2-0f6a-4ba0-852f-79e96aec0268 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:40.243278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212bfd2-0f6a-4ba0-852f-79e96aec0268 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:40.253713 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 529/1054] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:40.254674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212bfd2-0f6a-4ba0-852f-79e96aec0268 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:40.313712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:40.327872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdce8d-4a80-4f56-acaa-567854c5d613 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:40.345532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:40.364489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212bfd2-0f6a-4ba0-852f-79e96aec0268 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:40.365410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5bd44-e6d7-4e4d-bad3-428068acd044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:40.366230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5bd44-e6d7-4e4d-bad3-428068acd044 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:40.366506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5bd44-e6d7-4e4d-bad3-428068acd044 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:40.366782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5bd44-e6d7-4e4d-bad3-428068acd044 None admin] PATH_INFO: `/v3/users/a6d42ac8eefe47078dd4ba7965a8d63f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:40.380392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5bd44-e6d7-4e4d-bad3-428068acd044 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d42ac8eefe47078dd4ba7965a8d63f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:40.381837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5bd44-e6d7-4e4d-bad3-428068acd044 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:40.384730 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 526/1055] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:36:40 2022] GET /identity/v3/users/a6d42ac8eefe47078dd4ba7965a8d63f => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:40.389625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5bd44-e6d7-4e4d-bad3-428068acd044 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:40.404889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64c843-b9d6-4020-b64e-e9907116277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:40.405535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64c843-b9d6-4020-b64e-e9907116277c None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:40.405867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64c843-b9d6-4020-b64e-e9907116277c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:40.406145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64c843-b9d6-4020-b64e-e9907116277c None admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:40.406868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64c843-b9d6-4020-b64e-e9907116277c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:40.408236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64c843-b9d6-4020-b64e-e9907116277c None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:40.441287 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 530/1056] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:36:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:36:40.522691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5bd44-e6d7-4e4d-bad3-428068acd044 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:40.572567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f2ea-b181-44c5-934b-e6f69160e8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:40.573394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f2ea-b181-44c5-934b-e6f69160e8d8 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:40.573774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f2ea-b181-44c5-934b-e6f69160e8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:40.574162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f2ea-b181-44c5-934b-e6f69160e8d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:40.588435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:40.658647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3f2ea-b181-44c5-934b-e6f69160e8d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:40.660168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3f2ea-b181-44c5-934b-e6f69160e8d8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:40.761750 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 527/1057] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:36:40.767352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64c843-b9d6-4020-b64e-e9907116277c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:40.871391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64c843-b9d6-4020-b64e-e9907116277c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:40.905215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2a4bf-da62-4d0a-b13d-2a9055793432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:40.905845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2a4bf-da62-4d0a-b13d-2a9055793432 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:40.906124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2a4bf-da62-4d0a-b13d-2a9055793432 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:40.906398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2a4bf-da62-4d0a-b13d-2a9055793432 None admin] PATH_INFO: `/v3/projects/d2c726887ff24b55864024c18341cd1d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:40.907525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2a4bf-da62-4d0a-b13d-2a9055793432 None admin] RBAC: Authorizing `identity:get_project(project_id=d2c726887ff24b55864024c18341cd1d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:40.908992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2a4bf-da62-4d0a-b13d-2a9055793432 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:40.915758 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 531/1058] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:36:40 2022] GET /identity/v3/projects/d2c726887ff24b55864024c18341cd1d => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:40.916716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f2ea-b181-44c5-934b-e6f69160e8d8 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:40.960493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:41.018783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f2ea-b181-44c5-934b-e6f69160e8d8 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:41.057450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b831b-9026-4c01-9776-856814a92918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:41.058059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b831b-9026-4c01-9776-856814a92918 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:41.058335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b831b-9026-4c01-9776-856814a92918 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:41.058607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b831b-9026-4c01-9776-856814a92918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:41.059332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b831b-9026-4c01-9776-856814a92918 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=d2c726887ff24b55864024c18341cd1d, user.id=a6d42ac8eefe47078dd4ba7965a8d63f) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:41.059641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b831b-9026-4c01-9776-856814a92918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:41.061055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b831b-9026-4c01-9776-856814a92918 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:41.073537 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 528/1059] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:36:40 2022] GET /identity/v3/role_assignments?user.id=a6d42ac8eefe47078dd4ba7965a8d63f&scope.project.id=d2c726887ff24b55864024c18341cd1d&role.id=a409f81bd5744563a303a825783bed61 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:42.153741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fab165-1a60-43d2-adba-bf7b3953423b None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:42.154268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fab165-1a60-43d2-adba-bf7b3953423b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:42.154268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fab165-1a60-43d2-adba-bf7b3953423b None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:42.155637 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 532/1060] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:42.160611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9729c-e7d8-4090-8a14-d1391338acd2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:42.161010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9729c-e7d8-4090-8a14-d1391338acd2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:42.161175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9729c-e7d8-4090-8a14-d1391338acd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:42.179348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9eb9729c-e7d8-4090-8a14-d1391338acd2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:42.180542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9eb9729c-e7d8-4090-8a14-d1391338acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:42.247430 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 529/1061] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:42.568707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fab165-1a60-43d2-adba-bf7b3953423b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:42.581645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:42.679285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fab165-1a60-43d2-adba-bf7b3953423b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:42.714020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432777f4-1b74-43b4-aa1d-4a12940d350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:42.714642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432777f4-1b74-43b4-aa1d-4a12940d350c None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:42.714913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432777f4-1b74-43b4-aa1d-4a12940d350c None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:42.715180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432777f4-1b74-43b4-aa1d-4a12940d350c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:42.725427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432777f4-1b74-43b4-aa1d-4a12940d350c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-432777f4-1b74-43b4-aa1d-4a12940d350c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:42.730712 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:42.731717 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:42.732590 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:42.732590 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:42.732590 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:42.732590 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:42.732590 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:42.732590 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:42.732590 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:42.732590 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:42.732590 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:42.732590 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:42.732590 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 08 20:36:42.732590 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:42.736766 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 533/1062] 10.222.0.26 () {56 vars in 1120 bytes} [Sat Oct 8 20:36:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:42.738047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9729c-e7d8-4090-8a14-d1391338acd2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:42.774947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:42.842083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9729c-e7d8-4090-8a14-d1391338acd2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:42.876402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccd399-99e7-48e7-a216-99aeb51ef22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:42.877011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccd399-99e7-48e7-a216-99aeb51ef22e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:42.877321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccd399-99e7-48e7-a216-99aeb51ef22e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:42.877595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccd399-99e7-48e7-a216-99aeb51ef22e None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:42.878255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ccd399-99e7-48e7-a216-99aeb51ef22e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:42.878556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ccd399-99e7-48e7-a216-99aeb51ef22e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:42.879910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ccd399-99e7-48e7-a216-99aeb51ef22e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:42.888705 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 530/1063] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Oct 8 20:36:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:42.894227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432777f4-1b74-43b4-aa1d-4a12940d350c None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:42.896717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d08da-d500-4bbd-b050-0472b622649f None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:42.897223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d08da-d500-4bbd-b050-0472b622649f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:42.897924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d08da-d500-4bbd-b050-0472b622649f None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:42.900564 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 531/1064] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:42.905291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1014e3-6fd4-4abc-b4d9-4150b1a09f8d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:42.905577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1014e3-6fd4-4abc-b4d9-4150b1a09f8d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:42.905853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1014e3-6fd4-4abc-b4d9-4150b1a09f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:42.924899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ea1014e3-6fd4-4abc-b4d9-4150b1a09f8d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:42.926152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ea1014e3-6fd4-4abc-b4d9-4150b1a09f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:42.977639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:43.001240 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 532/1065] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:43.012121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432777f4-1b74-43b4-aa1d-4a12940d350c None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:43.049959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a10a9-88ec-4d7b-b505-31e46e613b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:43.050625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a10a9-88ec-4d7b-b505-31e46e613b7d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:43.050905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a10a9-88ec-4d7b-b505-31e46e613b7d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:43.051175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a10a9-88ec-4d7b-b505-31e46e613b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:43.063212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a10a9-88ec-4d7b-b505-31e46e613b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:43.064673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a10a9-88ec-4d7b-b505-31e46e613b7d None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-509a10a9-88ec-4d7b-b505-31e46e613b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:43.080348 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:43.081366 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:43.087370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:43.087370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:43.087370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:43.087370 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 534/1066] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:43.087612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1014e3-6fd4-4abc-b4d9-4150b1a09f8d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:43.116481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:43.194035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1014e3-6fd4-4abc-b4d9-4150b1a09f8d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:43.228047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01317748-0071-477c-aa5b-96e7703dbe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:43.228654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01317748-0071-477c-aa5b-96e7703dbe74 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:43.228935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01317748-0071-477c-aa5b-96e7703dbe74 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:43.229224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01317748-0071-477c-aa5b-96e7703dbe74 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:43.229873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01317748-0071-477c-aa5b-96e7703dbe74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:43.230180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01317748-0071-477c-aa5b-96e7703dbe74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:43.231538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01317748-0071-477c-aa5b-96e7703dbe74 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:43.243672 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 533/1067] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:43.249083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a10a9-88ec-4d7b-b505-31e46e613b7d None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:43.325375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01317748-0071-477c-aa5b-96e7703dbe74 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:43.349171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a10a9-88ec-4d7b-b505-31e46e613b7d None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:43.373840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:43.387053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0c1ee-a3b3-4ca5-82f4-bb02b5af6be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:43.387933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0c1ee-a3b3-4ca5-82f4-bb02b5af6be0 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:43.388218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0c1ee-a3b3-4ca5-82f4-bb02b5af6be0 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:43.388516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0c1ee-a3b3-4ca5-82f4-bb02b5af6be0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:43.397535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0c1ee-a3b3-4ca5-82f4-bb02b5af6be0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:43.398679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0c1ee-a3b3-4ca5-82f4-bb02b5af6be0 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-83b0c1ee-a3b3-4ca5-82f4-bb02b5af6be0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:43.409979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:43.411143 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:43.412127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:43.412127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:43.412127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:43.412127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:43.412127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:43.412127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:43.412127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:43.412127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:43.412127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:36:43.412127 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:43.412127 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 535/1068] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Oct 8 20:36:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:43.417480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0c1ee-a3b3-4ca5-82f4-bb02b5af6be0 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:43.420896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:43.434035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01317748-0071-477c-aa5b-96e7703dbe74 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:43.470740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057eb2ed-eb50-45b6-a6a0-33e67d4e6e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:43.471348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eb2ed-eb50-45b6-a6a0-33e67d4e6e97 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:43.471627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eb2ed-eb50-45b6-a6a0-33e67d4e6e97 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:43.471902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eb2ed-eb50-45b6-a6a0-33e67d4e6e97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:43.525091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0c1ee-a3b3-4ca5-82f4-bb02b5af6be0 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:43.543331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057eb2ed-eb50-45b6-a6a0-33e67d4e6e97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:43.544951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057eb2ed-eb50-45b6-a6a0-33e67d4e6e97 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:43.559031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02901c77-16a3-4c3a-8a9e-84d4ed4ee8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:43.559637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02901c77-16a3-4c3a-8a9e-84d4ed4ee8b8 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:43.559913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02901c77-16a3-4c3a-8a9e-84d4ed4ee8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:43.560189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02901c77-16a3-4c3a-8a9e-84d4ed4ee8b8 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:43.560914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02901c77-16a3-4c3a-8a9e-84d4ed4ee8b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:43.561245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02901c77-16a3-4c3a-8a9e-84d4ed4ee8b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:43.562649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02901c77-16a3-4c3a-8a9e-84d4ed4ee8b8 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:43.579530 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 536/1069] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Oct 8 20:36:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:43.580663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b474b-af19-4bf2-847c-207f256efd9f None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:43.580947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b474b-af19-4bf2-847c-207f256efd9f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:43.581243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b474b-af19-4bf2-847c-207f256efd9f None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:43.582582 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 537/1070] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:43.585102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b474b-af19-4bf2-847c-207f256efd9f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:43.628435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:43.635721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:43.649839 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 534/1071] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 08 20:36:43.650902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec66d5-0b44-46fe-8561-2c60b29d028c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:43.651183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec66d5-0b44-46fe-8561-2c60b29d028c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:43.651454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec66d5-0b44-46fe-8561-2c60b29d028c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:43.669545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-63ec66d5-0b44-46fe-8561-2c60b29d028c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:43.670744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-63ec66d5-0b44-46fe-8561-2c60b29d028c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:43.688419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b474b-af19-4bf2-847c-207f256efd9f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:43.722590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d67971-dc7d-4fef-9488-30e24c5360f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:43.723212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d67971-dc7d-4fef-9488-30e24c5360f7 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:43.723489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d67971-dc7d-4fef-9488-30e24c5360f7 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:43.723757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d67971-dc7d-4fef-9488-30e24c5360f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:43.734191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d67971-dc7d-4fef-9488-30e24c5360f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:43.735044 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 535/1072] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:43.735619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d67971-dc7d-4fef-9488-30e24c5360f7 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:43.735856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec66d5-0b44-46fe-8561-2c60b29d028c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-91d67971-dc7d-4fef-9488-30e24c5360f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:43.764018 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:43.765090 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:43.766070 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:43.766070 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:43.766070 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:43.766070 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 538/1073] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:43.771006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d67971-dc7d-4fef-9488-30e24c5360f7 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:43.837445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec66d5-0b44-46fe-8561-2c60b29d028c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:43.856343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:43.870376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:43.874827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4222f0-7bd6-41f5-a160-ebe504d5ac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:43.875411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4222f0-7bd6-41f5-a160-ebe504d5ac68 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:43.875721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4222f0-7bd6-41f5-a160-ebe504d5ac68 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:43.875970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4222f0-7bd6-41f5-a160-ebe504d5ac68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:43.880874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d67971-dc7d-4fef-9488-30e24c5360f7 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:43.887072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4222f0-7bd6-41f5-a160-ebe504d5ac68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:43.888980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4222f0-7bd6-41f5-a160-ebe504d5ac68 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-ac4222f0-7bd6-41f5-a160-ebe504d5ac68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:43.907215 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:43.908167 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:43.909078 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:43.909078 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:43.909078 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:43.909078 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 536/1074] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:43.914062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4222f0-7bd6-41f5-a160-ebe504d5ac68 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:43.922393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d50cad-0f5b-4eae-bd99-c8e6829ba69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:43.922994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d50cad-0f5b-4eae-bd99-c8e6829ba69e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:43.923545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d50cad-0f5b-4eae-bd99-c8e6829ba69e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:43.923655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d50cad-0f5b-4eae-bd99-c8e6829ba69e None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:43.924273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d50cad-0f5b-4eae-bd99-c8e6829ba69e None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:43.924570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d50cad-0f5b-4eae-bd99-c8e6829ba69e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:43.925932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d50cad-0f5b-4eae-bd99-c8e6829ba69e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:43.938698 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 539/1075] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:43.944224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d50cad-0f5b-4eae-bd99-c8e6829ba69e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:44.018770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4222f0-7bd6-41f5-a160-ebe504d5ac68 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:44.053165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d50cad-0f5b-4eae-bd99-c8e6829ba69e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:44.054072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ed733-1181-4441-9742-e3c944403705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:44.054682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ed733-1181-4441-9742-e3c944403705 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:44.054989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ed733-1181-4441-9742-e3c944403705 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:44.055263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ed733-1181-4441-9742-e3c944403705 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:44.055907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ed733-1181-4441-9742-e3c944403705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:44.056219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ed733-1181-4441-9742-e3c944403705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:44.057634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ed733-1181-4441-9742-e3c944403705 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:44.069763 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 537/1076] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:44.072324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ed733-1181-4441-9742-e3c944403705 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:44.091793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d1717-8625-445e-95ec-b27d620c1257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:44.092343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1717-8625-445e-95ec-b27d620c1257 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:44.092625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1717-8625-445e-95ec-b27d620c1257 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:44.092896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1717-8625-445e-95ec-b27d620c1257 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:44.100709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d1717-8625-445e-95ec-b27d620c1257 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:44.102272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d1717-8625-445e-95ec-b27d620c1257 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:44.110554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-7a9d1717-8625-445e-95ec-b27d620c1257 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:44.118395 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:44.119571 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:44.120679 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:44.120679 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:44.120679 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:44.120679 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:44.120679 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:44.120679 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:44.120679 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:44.120679 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:44.120679 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 540/1077] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:44.125365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d1717-8625-445e-95ec-b27d620c1257 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:44.144519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:44.190924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ed733-1181-4441-9742-e3c944403705 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:44.230096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b487dbd-4272-4cc3-93f8-5b366f756a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:44.230862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b487dbd-4272-4cc3-93f8-5b366f756a37 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:44.231141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b487dbd-4272-4cc3-93f8-5b366f756a37 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:44.231413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b487dbd-4272-4cc3-93f8-5b366f756a37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:44.242534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d1717-8625-445e-95ec-b27d620c1257 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:44.242997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b487dbd-4272-4cc3-93f8-5b366f756a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-2b487dbd-4272-4cc3-93f8-5b366f756a37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:44.247896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:44.248877 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:44.250514 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:44.250514 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:44.250514 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:44.250514 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:44.250514 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:44.250514 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:44.250514 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:44.250514 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:44.250514 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:44.250514 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:44.250514 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:44.250514 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:44.250514 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 538/1078] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:36:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:44.255242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b487dbd-4272-4cc3-93f8-5b366f756a37 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:44.286993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fde1d6-9ce6-4db5-a0cc-d345d185c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:44.287603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fde1d6-9ce6-4db5-a0cc-d345d185c37d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:44.287881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fde1d6-9ce6-4db5-a0cc-d345d185c37d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:44.288157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fde1d6-9ce6-4db5-a0cc-d345d185c37d None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:44.288848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fde1d6-9ce6-4db5-a0cc-d345d185c37d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:44.289155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fde1d6-9ce6-4db5-a0cc-d345d185c37d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:44.290609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fde1d6-9ce6-4db5-a0cc-d345d185c37d None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:44.307651 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 541/1079] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:44.314306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fde1d6-9ce6-4db5-a0cc-d345d185c37d None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:44.358192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:44.371865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b487dbd-4272-4cc3-93f8-5b366f756a37 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:44.399780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:44.413969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed264059-58cc-4db9-aebc-b700b7251768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:44.415214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed264059-58cc-4db9-aebc-b700b7251768 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:44.415492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed264059-58cc-4db9-aebc-b700b7251768 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:44.415763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed264059-58cc-4db9-aebc-b700b7251768 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:44.416917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed264059-58cc-4db9-aebc-b700b7251768 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:44.417285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed264059-58cc-4db9-aebc-b700b7251768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:44.418620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed264059-58cc-4db9-aebc-b700b7251768 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:44.427552 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 539/1080] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:36:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:44.433733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed264059-58cc-4db9-aebc-b700b7251768 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:44.436791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fde1d6-9ce6-4db5-a0cc-d345d185c37d None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:44.471579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecfe70-c07a-4c8c-86e1-bc78fea8f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:44.472230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecfe70-c07a-4c8c-86e1-bc78fea8f077 None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:44.472507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecfe70-c07a-4c8c-86e1-bc78fea8f077 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:44.472778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecfe70-c07a-4c8c-86e1-bc78fea8f077 None admin] PATH_INFO: `/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/187d6f51b1604327a4879e9e19b47963/roles/ec45800deb7c46b6aa34a3925199cf96` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:44.475450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecfe70-c07a-4c8c-86e1-bc78fea8f077 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba1e9ad05694bbe8723c14f5e2b08f7, user_id=187d6f51b1604327a4879e9e19b47963, role_id=ec45800deb7c46b6aa34a3925199cf96)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:44.477595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecfe70-c07a-4c8c-86e1-bc78fea8f077 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:44.493970 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 542/1081] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:36:44 2022] PUT /identity/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/187d6f51b1604327a4879e9e19b47963/roles/ec45800deb7c46b6aa34a3925199cf96 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:36:44.540192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed264059-58cc-4db9-aebc-b700b7251768 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:44.580790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149cd3f-aa21-4d9e-9c56-0410a5f47192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:44.581477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149cd3f-aa21-4d9e-9c56-0410a5f47192 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:44.581759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149cd3f-aa21-4d9e-9c56-0410a5f47192 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:44.582030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149cd3f-aa21-4d9e-9c56-0410a5f47192 None admin] PATH_INFO: `/v3/users/a6d42ac8eefe47078dd4ba7965a8d63f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:44.583210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149cd3f-aa21-4d9e-9c56-0410a5f47192 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d42ac8eefe47078dd4ba7965a8d63f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:44.584706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149cd3f-aa21-4d9e-9c56-0410a5f47192 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:44.586929 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 540/1082] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:36:44 2022] GET /identity/v3/users/a6d42ac8eefe47078dd4ba7965a8d63f => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:44.593066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecfe70-c07a-4c8c-86e1-bc78fea8f077 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:44.698502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecfe70-c07a-4c8c-86e1-bc78fea8f077 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:44.729621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:44.735221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b94b5b-3141-47ca-839c-4e5a67285af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:44.736034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94b5b-3141-47ca-839c-4e5a67285af2 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:44.736348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94b5b-3141-47ca-839c-4e5a67285af2 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:44.736818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94b5b-3141-47ca-839c-4e5a67285af2 None admin] PATH_INFO: `/v3/projects/d2c726887ff24b55864024c18341cd1d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:44.737953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b94b5b-3141-47ca-839c-4e5a67285af2 None admin] RBAC: Authorizing `identity:get_project(project_id=d2c726887ff24b55864024c18341cd1d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:44.739613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b94b5b-3141-47ca-839c-4e5a67285af2 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:44.741250 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 543/1083] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:36:44 2022] GET /identity/v3/projects/d2c726887ff24b55864024c18341cd1d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:44.747190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149cd3f-aa21-4d9e-9c56-0410a5f47192 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:44.769338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:44.845748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149cd3f-aa21-4d9e-9c56-0410a5f47192 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:44.878542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d81e17-bf9e-45d3-bfe6-c58711c850c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:44.879192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d81e17-bf9e-45d3-bfe6-c58711c850c3 None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:44.879471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d81e17-bf9e-45d3-bfe6-c58711c850c3 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:44.879746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d81e17-bf9e-45d3-bfe6-c58711c850c3 None admin] PATH_INFO: `/v3/projects/d2c726887ff24b55864024c18341cd1d/users/a6d42ac8eefe47078dd4ba7965a8d63f/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:44.881657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d81e17-bf9e-45d3-bfe6-c58711c850c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2c726887ff24b55864024c18341cd1d, user_id=a6d42ac8eefe47078dd4ba7965a8d63f, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:44.883592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d81e17-bf9e-45d3-bfe6-c58711c850c3 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:44.896327 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 541/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:36:44 2022] PUT /identity/v3/projects/d2c726887ff24b55864024c18341cd1d/users/a6d42ac8eefe47078dd4ba7965a8d63f/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:36:46.876490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71507877-b0d3-49a8-ac00-86d7da35ac69 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:46.876990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71507877-b0d3-49a8-ac00-86d7da35ac69 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:46.876990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71507877-b0d3-49a8-ac00-86d7da35ac69 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:46.878289 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 544/1085] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:46.883467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12227a9-6c63-4c7d-ba81-24a39d54c356 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:46.883861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12227a9-6c63-4c7d-ba81-24a39d54c356 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:46.884014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12227a9-6c63-4c7d-ba81-24a39d54c356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:46.902174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b12227a9-6c63-4c7d-ba81-24a39d54c356 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:46.903347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b12227a9-6c63-4c7d-ba81-24a39d54c356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:46.968111 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 542/1086] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:47.242445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae9727-826f-47f8-8ac6-d662630bb079 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:47.242733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae9727-826f-47f8-8ac6-d662630bb079 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:47.243007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae9727-826f-47f8-8ac6-d662630bb079 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:47.244338 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 545/1087] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:47.249525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4cfe8-98f0-442f-a189-e6879e9c312d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:47.249816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4cfe8-98f0-442f-a189-e6879e9c312d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:47.250093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4cfe8-98f0-442f-a189-e6879e9c312d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:47.268317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3be4cfe8-98f0-442f-a189-e6879e9c312d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:47.269535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3be4cfe8-98f0-442f-a189-e6879e9c312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:47.272266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:47.290384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae9727-826f-47f8-8ac6-d662630bb079 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:47.338151 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 543/1088] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:47.390514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae9727-826f-47f8-8ac6-d662630bb079 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:47.424032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4b45c-89d0-494f-96d4-13a320080cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:47.424652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4b45c-89d0-494f-96d4-13a320080cc1 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:47.424930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4b45c-89d0-494f-96d4-13a320080cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:47.425208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4b45c-89d0-494f-96d4-13a320080cc1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:47.435159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4b45c-89d0-494f-96d4-13a320080cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-7bf4b45c-89d0-494f-96d4-13a320080cc1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:47.439900 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:47.440912 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:47.442226 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:47.442226 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:47.442226 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:47.442226 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:47.442226 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:47.442226 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:47.442226 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:47.442226 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:47.442226 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:47.442226 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:47.442226 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 08 20:36:47.442226 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:47.442226 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 546/1089] 10.222.0.26 () {56 vars in 1120 bytes} [Sat Oct 8 20:36:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:47.447059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4cfe8-98f0-442f-a189-e6879e9c312d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:47.549349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4cfe8-98f0-442f-a189-e6879e9c312d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:47.582483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45293a-89fa-4af8-b219-91dd237a7d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:47.583087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45293a-89fa-4af8-b219-91dd237a7d4d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:47.583364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45293a-89fa-4af8-b219-91dd237a7d4d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:47.583634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45293a-89fa-4af8-b219-91dd237a7d4d None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:47.584291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45293a-89fa-4af8-b219-91dd237a7d4d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:47.584588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45293a-89fa-4af8-b219-91dd237a7d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:47.585969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45293a-89fa-4af8-b219-91dd237a7d4d None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:47.594060 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 544/1090] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Oct 8 20:36:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:47.599971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4b45c-89d0-494f-96d4-13a320080cc1 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:47.658687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45293a-89fa-4af8-b219-91dd237a7d4d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:47.659168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:47.661643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:47.700449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4b45c-89d0-494f-96d4-13a320080cc1 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:47.733635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db931b3-2db1-41a5-8799-a06878b44a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:47.734285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db931b3-2db1-41a5-8799-a06878b44a95 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:47.734558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db931b3-2db1-41a5-8799-a06878b44a95 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:47.734825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db931b3-2db1-41a5-8799-a06878b44a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:47.745040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db931b3-2db1-41a5-8799-a06878b44a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:47.746513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db931b3-2db1-41a5-8799-a06878b44a95 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:47.757205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45293a-89fa-4af8-b219-91dd237a7d4d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-8db931b3-2db1-41a5-8799-a06878b44a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:47.761244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:47.762391 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:47.763704 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:47.763704 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:47.763704 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:47.763704 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 547/1091] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:47.768030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db931b3-2db1-41a5-8799-a06878b44a95 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:47.791557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c64d6b-86f3-4c38-bfb7-8ed51f1b08fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:47.792178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c64d6b-86f3-4c38-bfb7-8ed51f1b08fc None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:47.792451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c64d6b-86f3-4c38-bfb7-8ed51f1b08fc None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:47.792718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c64d6b-86f3-4c38-bfb7-8ed51f1b08fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:47.803099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c64d6b-86f3-4c38-bfb7-8ed51f1b08fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-37c64d6b-86f3-4c38-bfb7-8ed51f1b08fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:47.808301 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:47.809469 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:47.810318 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:47.810318 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:47.810318 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:47.810318 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:47.810318 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:47.810318 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:47.810318 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:47.810318 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:47.810318 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:47.810318 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:47.810318 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:47.810318 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:36:47.810318 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 545/1092] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:36:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:47.815368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c64d6b-86f3-4c38-bfb7-8ed51f1b08fc None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:47.870227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db931b3-2db1-41a5-8799-a06878b44a95 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:47.875624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:47.883252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:47.904724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b95af1-9568-4610-805b-d4ed621c470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:47.905354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b95af1-9568-4610-805b-d4ed621c470b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:47.905629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b95af1-9568-4610-805b-d4ed621c470b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:47.905899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b95af1-9568-4610-805b-d4ed621c470b None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:47.906527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b95af1-9568-4610-805b-d4ed621c470b None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:47.906821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b95af1-9568-4610-805b-d4ed621c470b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:47.908165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b95af1-9568-4610-805b-d4ed621c470b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:47.915033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c64d6b-86f3-4c38-bfb7-8ed51f1b08fc None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:47.920062 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 548/1093] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:47.926061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b95af1-9568-4610-805b-d4ed621c470b None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:47.949053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e701f-8748-40d2-8f8d-4aefa6bcd548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:47.949684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e701f-8748-40d2-8f8d-4aefa6bcd548 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:47.949967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e701f-8748-40d2-8f8d-4aefa6bcd548 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:47.950243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e701f-8748-40d2-8f8d-4aefa6bcd548 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:47.951416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e701f-8748-40d2-8f8d-4aefa6bcd548 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:47.951416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e701f-8748-40d2-8f8d-4aefa6bcd548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:47.952696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e701f-8748-40d2-8f8d-4aefa6bcd548 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:47.961909 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 546/1094] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:36:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:47.967757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e701f-8748-40d2-8f8d-4aefa6bcd548 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:48.026492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b95af1-9568-4610-805b-d4ed621c470b None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:48.059739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43480e42-be2c-4d3e-8ff6-15698f1ce102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:48.060283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43480e42-be2c-4d3e-8ff6-15698f1ce102 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:48.060557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43480e42-be2c-4d3e-8ff6-15698f1ce102 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:48.060822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43480e42-be2c-4d3e-8ff6-15698f1ce102 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:48.066486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e701f-8748-40d2-8f8d-4aefa6bcd548 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:48.067637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43480e42-be2c-4d3e-8ff6-15698f1ce102 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:48.069064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43480e42-be2c-4d3e-8ff6-15698f1ce102 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-43480e42-be2c-4d3e-8ff6-15698f1ce102 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:48.081570 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:48.082673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:48.083779 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:48.083779 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:48.083779 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:48.083779 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:48.083779 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:48.083779 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:48.083779 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:48.083779 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:48.083779 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:36:48.083779 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:48.083779 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 549/1095] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Oct 8 20:36:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:48.088279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43480e42-be2c-4d3e-8ff6-15698f1ce102 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:48.090157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:48.101051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84dbf0-614f-438d-b56e-4dacd853749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:48.101753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84dbf0-614f-438d-b56e-4dacd853749a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:48.102036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84dbf0-614f-438d-b56e-4dacd853749a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:48.102311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84dbf0-614f-438d-b56e-4dacd853749a None admin] PATH_INFO: `/v3/users/a6d42ac8eefe47078dd4ba7965a8d63f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:48.103441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84dbf0-614f-438d-b56e-4dacd853749a None admin] RBAC: Authorizing `identity:get_user(user_id=a6d42ac8eefe47078dd4ba7965a8d63f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:48.104866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84dbf0-614f-438d-b56e-4dacd853749a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:48.106484 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 547/1096] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:36:47 2022] GET /identity/v3/users/a6d42ac8eefe47078dd4ba7965a8d63f => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:48.112031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84dbf0-614f-438d-b56e-4dacd853749a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:48.120149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:48.188652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43480e42-be2c-4d3e-8ff6-15698f1ce102 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:48.212937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84dbf0-614f-438d-b56e-4dacd853749a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:48.221645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e1901-623d-41aa-b772-38bb04e67fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:48.222313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e1901-623d-41aa-b772-38bb04e67fbe None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:48.222592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e1901-623d-41aa-b772-38bb04e67fbe None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:48.222860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e1901-623d-41aa-b772-38bb04e67fbe None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:48.223572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e1901-623d-41aa-b772-38bb04e67fbe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:48.223871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e1901-623d-41aa-b772-38bb04e67fbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:48.225300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e1901-623d-41aa-b772-38bb04e67fbe None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:48.242175 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 550/1097] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Oct 8 20:36:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:48.247965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379373a-ed37-4f10-a3be-652f2aa2a94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:48.248430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e1901-623d-41aa-b772-38bb04e67fbe None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:48.248562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379373a-ed37-4f10-a3be-652f2aa2a94e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:48.248823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379373a-ed37-4f10-a3be-652f2aa2a94e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:48.249091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379373a-ed37-4f10-a3be-652f2aa2a94e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:48.304673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:48.315771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379373a-ed37-4f10-a3be-652f2aa2a94e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:48.317167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379373a-ed37-4f10-a3be-652f2aa2a94e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:48.337358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:48.347047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e1901-623d-41aa-b772-38bb04e67fbe None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:48.382270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cc785-d167-4489-919f-a5db36bf7911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:48.382887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cc785-d167-4489-919f-a5db36bf7911 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:48.383762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cc785-d167-4489-919f-a5db36bf7911 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:48.384035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cc785-d167-4489-919f-a5db36bf7911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:48.414743 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 548/1098] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 08 20:36:48.420611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379373a-ed37-4f10-a3be-652f2aa2a94e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:48.450997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cc785-d167-4489-919f-a5db36bf7911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:48.452440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cc785-d167-4489-919f-a5db36bf7911 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:48.508727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:48.518015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379373a-ed37-4f10-a3be-652f2aa2a94e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:48.546176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:48.552624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7bddc-fab7-4faa-b9b7-c9f639d92ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:48.553277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7bddc-fab7-4faa-b9b7-c9f639d92ef5 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:48.553555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7bddc-fab7-4faa-b9b7-c9f639d92ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:48.553828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7bddc-fab7-4faa-b9b7-c9f639d92ef5 None admin] PATH_INFO: `/v3/projects/d2c726887ff24b55864024c18341cd1d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:48.554941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7bddc-fab7-4faa-b9b7-c9f639d92ef5 None admin] RBAC: Authorizing `identity:get_project(project_id=d2c726887ff24b55864024c18341cd1d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:48.556353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7bddc-fab7-4faa-b9b7-c9f639d92ef5 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:48.556922 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 551/1099] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 08 20:36:48.558166 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 549/1100] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:36:48 2022] GET /identity/v3/projects/d2c726887ff24b55864024c18341cd1d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:48.562691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cc785-d167-4489-919f-a5db36bf7911 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:48.563726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7bddc-fab7-4faa-b9b7-c9f639d92ef5 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:48.662435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7bddc-fab7-4faa-b9b7-c9f639d92ef5 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:48.663135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cc785-d167-4489-919f-a5db36bf7911 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:48.694022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba63266-d99b-45b8-8e83-829886d69105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:48.694611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba63266-d99b-45b8-8e83-829886d69105 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:48.694893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba63266-d99b-45b8-8e83-829886d69105 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:48.695161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba63266-d99b-45b8-8e83-829886d69105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:48.696371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba63266-d99b-45b8-8e83-829886d69105 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=d2c726887ff24b55864024c18341cd1d, user.id=a6d42ac8eefe47078dd4ba7965a8d63f) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:48.696673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba63266-d99b-45b8-8e83-829886d69105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:48.697358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec4376-213f-4673-9860-d0e669d4c340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:48.698008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec4376-213f-4673-9860-d0e669d4c340 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:48.698116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba63266-d99b-45b8-8e83-829886d69105 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:48.698289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec4376-213f-4673-9860-d0e669d4c340 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:48.698562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec4376-213f-4673-9860-d0e669d4c340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:48.703652 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 550/1101] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:36:48 2022] GET /identity/v3/role_assignments?user.id=a6d42ac8eefe47078dd4ba7965a8d63f&scope.project.id=d2c726887ff24b55864024c18341cd1d&role.id=a409f81bd5744563a303a825783bed61 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:48.708573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec4376-213f-4673-9860-d0e669d4c340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:48.710067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec4376-213f-4673-9860-d0e669d4c340 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-ddec4376-213f-4673-9860-d0e669d4c340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:48.726997 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:48.728217 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:48.729133 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:48.729133 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:48.729133 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:48.729133 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 552/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:48.734310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba63266-d99b-45b8-8e83-829886d69105 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:48.762088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:48.848046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba63266-d99b-45b8-8e83-829886d69105 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:48.884350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500bb82-e8aa-4415-bc70-ae4508c521ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:48.884975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500bb82-e8aa-4415-bc70-ae4508c521ab None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:48.885287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500bb82-e8aa-4415-bc70-ae4508c521ab None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:48.885563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500bb82-e8aa-4415-bc70-ae4508c521ab None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:48.886221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500bb82-e8aa-4415-bc70-ae4508c521ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:48.886527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500bb82-e8aa-4415-bc70-ae4508c521ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:48.887904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500bb82-e8aa-4415-bc70-ae4508c521ab None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:48.901132 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 551/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:48.906854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec4376-213f-4673-9860-d0e669d4c340 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:48.952894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:49.009914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec4376-213f-4673-9860-d0e669d4c340 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:49.043016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ff2ec-840b-44ae-b4a7-869898dfe7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:49.043641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ff2ec-840b-44ae-b4a7-869898dfe7c3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:49.043916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ff2ec-840b-44ae-b4a7-869898dfe7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:49.044185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ff2ec-840b-44ae-b4a7-869898dfe7c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:49.050823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ff2ec-840b-44ae-b4a7-869898dfe7c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:49.052236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ff2ec-840b-44ae-b4a7-869898dfe7c3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-696ff2ec-840b-44ae-b4a7-869898dfe7c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:49.063168 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:49.064072 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:49.064987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:49.064987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:49.064987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:49.064987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:49.064987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:49.064987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:49.064987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:49.064987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:36:49.064987 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 553/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:49.070188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500bb82-e8aa-4415-bc70-ae4508c521ab None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:49.152582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:49.169621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500bb82-e8aa-4415-bc70-ae4508c521ab None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:49.203871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bd8bf-ab41-4e89-b550-6ce5589632d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:49.204398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bd8bf-ab41-4e89-b550-6ce5589632d8 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:49.204678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bd8bf-ab41-4e89-b550-6ce5589632d8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:49.204951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bd8bf-ab41-4e89-b550-6ce5589632d8 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:49.205676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bd8bf-ab41-4e89-b550-6ce5589632d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:49.205980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bd8bf-ab41-4e89-b550-6ce5589632d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:49.207404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bd8bf-ab41-4e89-b550-6ce5589632d8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:49.219209 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 552/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:49.225211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ff2ec-840b-44ae-b4a7-869898dfe7c3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:49.323386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ff2ec-840b-44ae-b4a7-869898dfe7c3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:49.324912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:49.357728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cc6fe-28db-41c2-a71c-984198032e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:49.358325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cc6fe-28db-41c2-a71c-984198032e41 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:49.358604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cc6fe-28db-41c2-a71c-984198032e41 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:49.358878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cc6fe-28db-41c2-a71c-984198032e41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:49.359593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952cc6fe-28db-41c2-a71c-984198032e41 None admin] RBAC: Adding query filter params (role.id=ec45800deb7c46b6aa34a3925199cf96, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=187d6f51b1604327a4879e9e19b47963) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:49.359902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952cc6fe-28db-41c2-a71c-984198032e41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:49.361341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952cc6fe-28db-41c2-a71c-984198032e41 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:49.367181 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 554/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:36:49 2022] GET /identity/v3/role_assignments?user.id=187d6f51b1604327a4879e9e19b47963&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=ec45800deb7c46b6aa34a3925199cf96 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:51.126255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a054265-6cad-4c32-8d29-4030101a7953 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:51.126807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a054265-6cad-4c32-8d29-4030101a7953 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:51.126807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a054265-6cad-4c32-8d29-4030101a7953 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:51.128117 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 553/1107] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:51.133884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b09ff-0fee-437c-80c4-21f9145245e8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:51.134297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b09ff-0fee-437c-80c4-21f9145245e8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:51.134437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b09ff-0fee-437c-80c4-21f9145245e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:51.152638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f80b09ff-0fee-437c-80c4-21f9145245e8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:51.153912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f80b09ff-0fee-437c-80c4-21f9145245e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:51.218810 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 555/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:51.548694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a054265-6cad-4c32-8d29-4030101a7953 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:51.647363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a054265-6cad-4c32-8d29-4030101a7953 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:51.679259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab515032-996b-48dd-8ec7-b819efeb70c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:51.679894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab515032-996b-48dd-8ec7-b819efeb70c0 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:51.680169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab515032-996b-48dd-8ec7-b819efeb70c0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:51.680436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab515032-996b-48dd-8ec7-b819efeb70c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:51.681541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab515032-996b-48dd-8ec7-b819efeb70c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:51.683041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab515032-996b-48dd-8ec7-b819efeb70c0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:51.684567 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 554/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:51.690272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b09ff-0fee-437c-80c4-21f9145245e8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:51.780971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:51.786785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b09ff-0fee-437c-80c4-21f9145245e8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:51.820043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3154c-5bb4-4199-8fbe-0db2fecc51f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:51.821675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3154c-5bb4-4199-8fbe-0db2fecc51f9 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:51.822063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3154c-5bb4-4199-8fbe-0db2fecc51f9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:51.822486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3154c-5bb4-4199-8fbe-0db2fecc51f9 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:51.823644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3154c-5bb4-4199-8fbe-0db2fecc51f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:51.826099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3154c-5bb4-4199-8fbe-0db2fecc51f9 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:51.847826 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 556/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:36:51 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:36:54.252138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc59203-0a2b-496e-aec9-cf01315b9bd5 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:54.252667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc59203-0a2b-496e-aec9-cf01315b9bd5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:54.252667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc59203-0a2b-496e-aec9-cf01315b9bd5 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:54.254061 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 555/1111] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:54.260056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc62da-cd02-449a-9d09-19dee7ca558b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:54.260477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc62da-cd02-449a-9d09-19dee7ca558b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:54.260593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc62da-cd02-449a-9d09-19dee7ca558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:54.278212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b1fc62da-cd02-449a-9d09-19dee7ca558b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:54.279378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b1fc62da-cd02-449a-9d09-19dee7ca558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:54.343128 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 557/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:54.667891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc59203-0a2b-496e-aec9-cf01315b9bd5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:54.682744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:54.766446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc59203-0a2b-496e-aec9-cf01315b9bd5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:54.798424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe844a-caf3-40b0-88d7-0051eb928ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:54.799029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe844a-caf3-40b0-88d7-0051eb928ed3 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:54.799306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe844a-caf3-40b0-88d7-0051eb928ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:54.799574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe844a-caf3-40b0-88d7-0051eb928ed3 None admin] PATH_INFO: `/v3/roles/94f39d4bced64cc98e66bceafe049303` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:54.800923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe844a-caf3-40b0-88d7-0051eb928ed3 None admin] RBAC: Authorizing `identity:get_role(role_id=94f39d4bced64cc98e66bceafe049303)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:54.802295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe844a-caf3-40b0-88d7-0051eb928ed3 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:54.803577 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 556/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:36:54 2022] GET /identity/v3/roles/94f39d4bced64cc98e66bceafe049303 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:54.809919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc62da-cd02-449a-9d09-19dee7ca558b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:54.887846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:54.905822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc62da-cd02-449a-9d09-19dee7ca558b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:54.938916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7912-d485-4671-bc49-3dbc92266a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:54.939471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7912-d485-4671-bc49-3dbc92266a24 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:54.939752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7912-d485-4671-bc49-3dbc92266a24 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:54.940023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7912-d485-4671-bc49-3dbc92266a24 None admin] PATH_INFO: `/v3/users/5288e34169e748baaded22fee6803340` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:54.953049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e7912-d485-4671-bc49-3dbc92266a24 None admin] RBAC: Authorizing `identity:get_user(user_id=5288e34169e748baaded22fee6803340)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:54.954489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e7912-d485-4671-bc49-3dbc92266a24 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:54.956045 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 558/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:36:54 2022] GET /identity/v3/users/5288e34169e748baaded22fee6803340 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:54.961714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe844a-caf3-40b0-88d7-0051eb928ed3 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:55.041148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:55.060075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe844a-caf3-40b0-88d7-0051eb928ed3 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:55.091973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11c320-01cb-441c-a164-d93820ec30aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:55.092558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11c320-01cb-441c-a164-d93820ec30aa None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:55.092834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11c320-01cb-441c-a164-d93820ec30aa None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:55.093105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11c320-01cb-441c-a164-d93820ec30aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:55.157289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11c320-01cb-441c-a164-d93820ec30aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:55.158700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11c320-01cb-441c-a164-d93820ec30aa None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:55.234522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:55.254654 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 557/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:36:55.260662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7912-d485-4671-bc49-3dbc92266a24 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:55.355841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7912-d485-4671-bc49-3dbc92266a24 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:55.388686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d667c-3613-4d70-9acf-7dbd0cbfc75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:55.389323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d667c-3613-4d70-9acf-7dbd0cbfc75a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:55.389600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d667c-3613-4d70-9acf-7dbd0cbfc75a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:55.389869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d667c-3613-4d70-9acf-7dbd0cbfc75a None admin] PATH_INFO: `/v3/projects/d2c726887ff24b55864024c18341cd1d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:55.390961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d667c-3613-4d70-9acf-7dbd0cbfc75a None admin] RBAC: Authorizing `identity:get_project(project_id=d2c726887ff24b55864024c18341cd1d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:55.392362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d667c-3613-4d70-9acf-7dbd0cbfc75a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:55.393964 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 559/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:36:55 2022] GET /identity/v3/projects/d2c726887ff24b55864024c18341cd1d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:55.400158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11c320-01cb-441c-a164-d93820ec30aa None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:55.498048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11c320-01cb-441c-a164-d93820ec30aa None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:55.532441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe120ec-ef7b-4735-a24f-51514a5fa1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:55.533032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe120ec-ef7b-4735-a24f-51514a5fa1bd None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:55.533343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe120ec-ef7b-4735-a24f-51514a5fa1bd None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:55.533619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe120ec-ef7b-4735-a24f-51514a5fa1bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:55.534338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe120ec-ef7b-4735-a24f-51514a5fa1bd None admin] RBAC: Adding query filter params (role.id=94f39d4bced64cc98e66bceafe049303, scope.project.id=d2c726887ff24b55864024c18341cd1d, user.id=5288e34169e748baaded22fee6803340) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:55.534648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe120ec-ef7b-4735-a24f-51514a5fa1bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:55.536063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe120ec-ef7b-4735-a24f-51514a5fa1bd None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:55.541292 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 558/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:36:55 2022] GET /identity/v3/role_assignments?user.id=5288e34169e748baaded22fee6803340&scope.project.id=d2c726887ff24b55864024c18341cd1d&role.id=94f39d4bced64cc98e66bceafe049303 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:57.888112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138f437-4c51-4496-a596-20a9ba6c9192 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:57.888606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138f437-4c51-4496-a596-20a9ba6c9192 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:57.888606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138f437-4c51-4496-a596-20a9ba6c9192 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:57.889934 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 560/1118] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:57.894996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7739f-edbe-4656-82e3-012ccbedb3fe None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:57.895414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7739f-edbe-4656-82e3-012ccbedb3fe None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:57.895543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7739f-edbe-4656-82e3-012ccbedb3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:57.913730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a9e7739f-edbe-4656-82e3-012ccbedb3fe None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:57.915492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a9e7739f-edbe-4656-82e3-012ccbedb3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:57.953300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:57.980145 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 559/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:58.315713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138f437-4c51-4496-a596-20a9ba6c9192 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:58.326963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:58.414161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138f437-4c51-4496-a596-20a9ba6c9192 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:58.446219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41eee0-8858-4462-bd9a-519926f07c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:58.446828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41eee0-8858-4462-bd9a-519926f07c9e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:58.447103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41eee0-8858-4462-bd9a-519926f07c9e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:58.447373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41eee0-8858-4462-bd9a-519926f07c9e None admin] PATH_INFO: `/v3/roles/94f39d4bced64cc98e66bceafe049303` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:58.448740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41eee0-8858-4462-bd9a-519926f07c9e None admin] RBAC: Authorizing `identity:get_role(role_id=94f39d4bced64cc98e66bceafe049303)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:58.450103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41eee0-8858-4462-bd9a-519926f07c9e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:58.451368 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 561/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:36:58 2022] GET /identity/v3/roles/94f39d4bced64cc98e66bceafe049303 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:58.457021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7739f-edbe-4656-82e3-012ccbedb3fe None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:58.557159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7739f-edbe-4656-82e3-012ccbedb3fe None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:58.589368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b55f49-f0c9-4cc7-bc9d-ea2be77e981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:58.589925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b55f49-f0c9-4cc7-bc9d-ea2be77e981f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:58.590199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b55f49-f0c9-4cc7-bc9d-ea2be77e981f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:58.590466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b55f49-f0c9-4cc7-bc9d-ea2be77e981f None admin] PATH_INFO: `/v3/users/5288e34169e748baaded22fee6803340` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:58.591558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b55f49-f0c9-4cc7-bc9d-ea2be77e981f None admin] RBAC: Authorizing `identity:get_user(user_id=5288e34169e748baaded22fee6803340)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:58.592959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b55f49-f0c9-4cc7-bc9d-ea2be77e981f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:58.594537 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 560/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:36:58 2022] GET /identity/v3/users/5288e34169e748baaded22fee6803340 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:58.600301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41eee0-8858-4462-bd9a-519926f07c9e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:58.674526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:58.697951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41eee0-8858-4462-bd9a-519926f07c9e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:58.730187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039f3c8-4ea0-44e6-88c6-51ea9f8c9693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:58.730800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039f3c8-4ea0-44e6-88c6-51ea9f8c9693 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:58.731081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039f3c8-4ea0-44e6-88c6-51ea9f8c9693 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:58.731356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039f3c8-4ea0-44e6-88c6-51ea9f8c9693 None admin] PATH_INFO: `/v3/projects/d2c726887ff24b55864024c18341cd1d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:58.732459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039f3c8-4ea0-44e6-88c6-51ea9f8c9693 None admin] RBAC: Authorizing `identity:get_project(project_id=d2c726887ff24b55864024c18341cd1d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:58.733915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039f3c8-4ea0-44e6-88c6-51ea9f8c9693 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:58.735525 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 562/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:36:58 2022] GET /identity/v3/projects/d2c726887ff24b55864024c18341cd1d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:58.741741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b55f49-f0c9-4cc7-bc9d-ea2be77e981f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:58.783728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:58.838696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b55f49-f0c9-4cc7-bc9d-ea2be77e981f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:58.871340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb662-c64d-438e-a6a2-3567a6abdabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:58.871924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb662-c64d-438e-a6a2-3567a6abdabd None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:58.872204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb662-c64d-438e-a6a2-3567a6abdabd None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:58.872479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb662-c64d-438e-a6a2-3567a6abdabd None admin] PATH_INFO: `/v3/projects/d2c726887ff24b55864024c18341cd1d/users/5288e34169e748baaded22fee6803340/roles/94f39d4bced64cc98e66bceafe049303` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:58.874623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb662-c64d-438e-a6a2-3567a6abdabd None admin] RBAC: Authorizing `identity:create_grant(project_id=d2c726887ff24b55864024c18341cd1d, user_id=5288e34169e748baaded22fee6803340, role_id=94f39d4bced64cc98e66bceafe049303)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:58.876034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb662-c64d-438e-a6a2-3567a6abdabd None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:58.887739 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 561/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:36:58 2022] PUT /identity/v3/projects/d2c726887ff24b55864024c18341cd1d/users/5288e34169e748baaded22fee6803340/roles/94f39d4bced64cc98e66bceafe049303 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:37:01.239951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f5eb6-c367-4e06-a85c-209b29a07fc7 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:01.240575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f5eb6-c367-4e06-a85c-209b29a07fc7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:01.240575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f5eb6-c367-4e06-a85c-209b29a07fc7 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:01.241844 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 563/1124] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:01.247545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eda21-827c-4204-ae3c-8d46086861cb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:01.247952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eda21-827c-4204-ae3c-8d46086861cb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:01.248093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eda21-827c-4204-ae3c-8d46086861cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:01.265670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2a4eda21-827c-4204-ae3c-8d46086861cb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:01.266835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2a4eda21-827c-4204-ae3c-8d46086861cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:01.329615 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 562/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:37:01.653091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f5eb6-c367-4e06-a85c-209b29a07fc7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:01.751282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f5eb6-c367-4e06-a85c-209b29a07fc7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:01.784393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a3122-0cfd-4616-9375-b71063f1bab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:01.785013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3122-0cfd-4616-9375-b71063f1bab3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:01.785322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3122-0cfd-4616-9375-b71063f1bab3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:01.785598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3122-0cfd-4616-9375-b71063f1bab3 None admin] PATH_INFO: `/v3/roles/94f39d4bced64cc98e66bceafe049303` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:01.786974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a3122-0cfd-4616-9375-b71063f1bab3 None admin] RBAC: Authorizing `identity:get_role(role_id=94f39d4bced64cc98e66bceafe049303)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:01.788332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a3122-0cfd-4616-9375-b71063f1bab3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:01.790274 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 564/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:37:01 2022] GET /identity/v3/roles/94f39d4bced64cc98e66bceafe049303 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:01.796008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eda21-827c-4204-ae3c-8d46086861cb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:01.824699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:01.891413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eda21-827c-4204-ae3c-8d46086861cb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:01.924774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aeab6-cde5-4a80-8fa1-959b29b8c6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:01.925357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aeab6-cde5-4a80-8fa1-959b29b8c6ab None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:01.925633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aeab6-cde5-4a80-8fa1-959b29b8c6ab None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:01.925899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aeab6-cde5-4a80-8fa1-959b29b8c6ab None admin] PATH_INFO: `/v3/users/5288e34169e748baaded22fee6803340` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:01.926983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673aeab6-cde5-4a80-8fa1-959b29b8c6ab None admin] RBAC: Authorizing `identity:get_user(user_id=5288e34169e748baaded22fee6803340)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:01.928387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673aeab6-cde5-4a80-8fa1-959b29b8c6ab None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:01.929994 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 563/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:37:01 2022] GET /identity/v3/users/5288e34169e748baaded22fee6803340 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:01.935729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a3122-0cfd-4616-9375-b71063f1bab3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:01.950624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:02.033881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a3122-0cfd-4616-9375-b71063f1bab3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:02.066202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b968b7-8928-4d7f-96bf-3f41097fc90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:02.066793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b968b7-8928-4d7f-96bf-3f41097fc90f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:02.067070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b968b7-8928-4d7f-96bf-3f41097fc90f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:02.067342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b968b7-8928-4d7f-96bf-3f41097fc90f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:02.131844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b968b7-8928-4d7f-96bf-3f41097fc90f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:02.133828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b968b7-8928-4d7f-96bf-3f41097fc90f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:02.147008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:02.229007 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 565/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:37:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 08 20:37:02.234895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aeab6-cde5-4a80-8fa1-959b29b8c6ab None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:02.327774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:02.330957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aeab6-cde5-4a80-8fa1-959b29b8c6ab None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:02.363898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ffe40-30f4-47e0-83f3-c703f3c1317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:02.364781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ffe40-30f4-47e0-83f3-c703f3c1317f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:02.365059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ffe40-30f4-47e0-83f3-c703f3c1317f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:02.365361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ffe40-30f4-47e0-83f3-c703f3c1317f None admin] PATH_INFO: `/v3/projects/d2c726887ff24b55864024c18341cd1d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:02.366463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ffe40-30f4-47e0-83f3-c703f3c1317f None admin] RBAC: Authorizing `identity:get_project(project_id=d2c726887ff24b55864024c18341cd1d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:02.367932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ffe40-30f4-47e0-83f3-c703f3c1317f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:02.369569 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 564/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:37:02 2022] GET /identity/v3/projects/d2c726887ff24b55864024c18341cd1d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:02.375869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b968b7-8928-4d7f-96bf-3f41097fc90f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:02.469597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b968b7-8928-4d7f-96bf-3f41097fc90f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:02.482966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:02.503886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6a30a-7a58-40d6-8ca9-7c01b6532ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:02.504484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6a30a-7a58-40d6-8ca9-7c01b6532ca9 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:02.504764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6a30a-7a58-40d6-8ca9-7c01b6532ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:02.505036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6a30a-7a58-40d6-8ca9-7c01b6532ca9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:02.505793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6a30a-7a58-40d6-8ca9-7c01b6532ca9 None admin] RBAC: Adding query filter params (role.id=94f39d4bced64cc98e66bceafe049303, scope.project.id=d2c726887ff24b55864024c18341cd1d, user.id=5288e34169e748baaded22fee6803340) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:37:02.506099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6a30a-7a58-40d6-8ca9-7c01b6532ca9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:02.507507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6a30a-7a58-40d6-8ca9-7c01b6532ca9 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:02.513019 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 566/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:37:02 2022] GET /identity/v3/role_assignments?user.id=5288e34169e748baaded22fee6803340&scope.project.id=d2c726887ff24b55864024c18341cd1d&role.id=94f39d4bced64cc98e66bceafe049303 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:04.905024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0f66-50d0-48e1-a314-d88a7a5bde7c None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:04.905582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0f66-50d0-48e1-a314-d88a7a5bde7c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:04.905582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0f66-50d0-48e1-a314-d88a7a5bde7c None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:04.906841 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 565/1131] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:04.912130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d894f-62fd-460c-94f7-971479c08665 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:04.912565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d894f-62fd-460c-94f7-971479c08665 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:04.912692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d894f-62fd-460c-94f7-971479c08665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:04.930942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2f9d894f-62fd-460c-94f7-971479c08665 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:04.932106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2f9d894f-62fd-460c-94f7-971479c08665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:04.996871 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 567/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:37:05.325349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d0f66-50d0-48e1-a314-d88a7a5bde7c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:05.422950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d0f66-50d0-48e1-a314-d88a7a5bde7c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:05.454938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c692c06-0312-4d05-9b1f-eafd4ba6f990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:05.455555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692c06-0312-4d05-9b1f-eafd4ba6f990 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:05.455836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692c06-0312-4d05-9b1f-eafd4ba6f990 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:05.456111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692c06-0312-4d05-9b1f-eafd4ba6f990 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:05.457236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c692c06-0312-4d05-9b1f-eafd4ba6f990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:05.458666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c692c06-0312-4d05-9b1f-eafd4ba6f990 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:05.460213 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 566/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:37:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:05.466414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d894f-62fd-460c-94f7-971479c08665 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:05.564283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d894f-62fd-460c-94f7-971479c08665 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:05.571328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:05.597984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db727f5f-7ba2-420a-b0ab-b7fb5c7ded70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:05.598527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727f5f-7ba2-420a-b0ab-b7fb5c7ded70 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:05.598808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727f5f-7ba2-420a-b0ab-b7fb5c7ded70 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:05.599087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727f5f-7ba2-420a-b0ab-b7fb5c7ded70 None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:05.599729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db727f5f-7ba2-420a-b0ab-b7fb5c7ded70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:05.601147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db727f5f-7ba2-420a-b0ab-b7fb5c7ded70 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:05.626951 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 568/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:37:05 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:37:08.025542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401eb56-09b9-4286-aba6-592bc4f06584 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:08.026092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401eb56-09b9-4286-aba6-592bc4f06584 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:08.026092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401eb56-09b9-4286-aba6-592bc4f06584 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:08.027404 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 567/1135] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:08.032518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed605e3c-27d2-45b2-af53-109ba5b65463 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:08.032954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed605e3c-27d2-45b2-af53-109ba5b65463 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:08.033058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed605e3c-27d2-45b2-af53-109ba5b65463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:08.052103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ed605e3c-27d2-45b2-af53-109ba5b65463 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:08.053315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ed605e3c-27d2-45b2-af53-109ba5b65463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:08.118268 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 569/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:37:08.440452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401eb56-09b9-4286-aba6-592bc4f06584 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:08.476376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:08.539013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401eb56-09b9-4286-aba6-592bc4f06584 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:08.571468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042b412-e6e5-495f-8f61-75492feeeada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:08.572078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042b412-e6e5-495f-8f61-75492feeeada None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:08.572353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042b412-e6e5-495f-8f61-75492feeeada None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:08.572621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042b412-e6e5-495f-8f61-75492feeeada None admin] PATH_INFO: `/v3/domains/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:08.573710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042b412-e6e5-495f-8f61-75492feeeada None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:08.575108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042b412-e6e5-495f-8f61-75492feeeada None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:08.576649 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 568/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:37:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:08.582490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed605e3c-27d2-45b2-af53-109ba5b65463 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:08.665516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:08.677985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed605e3c-27d2-45b2-af53-109ba5b65463 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:08.710624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de945b-d0f8-47d1-8361-7822b858e6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:08.711795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de945b-d0f8-47d1-8361-7822b858e6e5 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:08.712069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de945b-d0f8-47d1-8361-7822b858e6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:08.712333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de945b-d0f8-47d1-8361-7822b858e6e5 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:08.712971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de945b-d0f8-47d1-8361-7822b858e6e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:08.714407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de945b-d0f8-47d1-8361-7822b858e6e5 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:08.734212 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 570/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:37:08 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:37:11.141750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a048-2d67-4505-b76a-17eb69265de4 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:11.142284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a048-2d67-4505-b76a-17eb69265de4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:11.142284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a048-2d67-4505-b76a-17eb69265de4 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:11.143618 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 569/1139] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:11.148832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa103c-3340-4757-bb45-0276fcb87df7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:11.149246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa103c-3340-4757-bb45-0276fcb87df7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:11.149423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa103c-3340-4757-bb45-0276fcb87df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:11.167574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b7aa103c-3340-4757-bb45-0276fcb87df7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:11.168752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b7aa103c-3340-4757-bb45-0276fcb87df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:11.232329 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 571/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:37:11.563751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782a048-2d67-4505-b76a-17eb69265de4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:11.661849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782a048-2d67-4505-b76a-17eb69265de4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:11.664120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:11.694697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780600f-78dc-478b-9ce5-c187cd12282c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:11.695302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780600f-78dc-478b-9ce5-c187cd12282c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:11.696109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780600f-78dc-478b-9ce5-c187cd12282c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:11.696377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780600f-78dc-478b-9ce5-c187cd12282c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:11.705986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780600f-78dc-478b-9ce5-c187cd12282c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-4780600f-78dc-478b-9ce5-c187cd12282c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:37:11.710659 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:37:11.712404 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:37:11.713835 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:37:11.713835 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:37:11.713835 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:37:11.713835 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:37:11.713835 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:37:11.713835 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:37:11.713835 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:37:11.713835 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:37:11.713835 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:37:11.713835 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:37:11.713835 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:37:11.713835 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:37:11.713835 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 570/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:37:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:37:11.718297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa103c-3340-4757-bb45-0276fcb87df7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:11.789482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:11.814665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa103c-3340-4757-bb45-0276fcb87df7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:11.847732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b13a3-c84d-4eb3-a423-4a53fb704ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:11.848325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b13a3-c84d-4eb3-a423-4a53fb704ec4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:11.848605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b13a3-c84d-4eb3-a423-4a53fb704ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:11.848878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b13a3-c84d-4eb3-a423-4a53fb704ec4 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:11.849567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b13a3-c84d-4eb3-a423-4a53fb704ec4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:37:11.849871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b13a3-c84d-4eb3-a423-4a53fb704ec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:11.851220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b13a3-c84d-4eb3-a423-4a53fb704ec4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:11.858992 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 572/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:37:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:11.865147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780600f-78dc-478b-9ce5-c187cd12282c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:11.963609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780600f-78dc-478b-9ce5-c187cd12282c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:11.995649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bee35-50aa-4557-a799-8f7b43c5ee81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:11.996260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bee35-50aa-4557-a799-8f7b43c5ee81 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:11.996532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bee35-50aa-4557-a799-8f7b43c5ee81 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:11.996795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bee35-50aa-4557-a799-8f7b43c5ee81 None admin] PATH_INFO: `/v3/users/8e58efe27ce74e67828e1fc63bc7a843` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:12.009662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bee35-50aa-4557-a799-8f7b43c5ee81 None admin] RBAC: Authorizing `identity:get_user(user_id=8e58efe27ce74e67828e1fc63bc7a843)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:12.011081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bee35-50aa-4557-a799-8f7b43c5ee81 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:12.012635 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 571/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:37:11 2022] GET /identity/v3/users/8e58efe27ce74e67828e1fc63bc7a843 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:12.018422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b13a3-c84d-4eb3-a423-4a53fb704ec4 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:12.115841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b13a3-c84d-4eb3-a423-4a53fb704ec4 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:12.148617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53bac4-52f7-49f7-9aad-8017fdd1d95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:12.149235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53bac4-52f7-49f7-9aad-8017fdd1d95b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:12.149814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53bac4-52f7-49f7-9aad-8017fdd1d95b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:12.149814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53bac4-52f7-49f7-9aad-8017fdd1d95b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:12.152993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:12.213377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53bac4-52f7-49f7-9aad-8017fdd1d95b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:12.214793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53bac4-52f7-49f7-9aad-8017fdd1d95b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:12.307548 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 573/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:37:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:37:12.313489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bee35-50aa-4557-a799-8f7b43c5ee81 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:12.337288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:12.409836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bee35-50aa-4557-a799-8f7b43c5ee81 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:12.442082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa02c64-b18d-4b25-b121-f649dca832da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:12.442700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa02c64-b18d-4b25-b121-f649dca832da None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:12.442977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa02c64-b18d-4b25-b121-f649dca832da None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:12.443247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa02c64-b18d-4b25-b121-f649dca832da None admin] PATH_INFO: `/v3/projects/fbb1ba7d330940a7aa90a144168ec1e4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:12.444339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa02c64-b18d-4b25-b121-f649dca832da None admin] RBAC: Authorizing `identity:get_project(project_id=fbb1ba7d330940a7aa90a144168ec1e4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:12.446382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa02c64-b18d-4b25-b121-f649dca832da None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:12.447968 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 572/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:37:12 2022] GET /identity/v3/projects/fbb1ba7d330940a7aa90a144168ec1e4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:12.453976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53bac4-52f7-49f7-9aad-8017fdd1d95b None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:12.487326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:12.549631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53bac4-52f7-49f7-9aad-8017fdd1d95b None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:12.582061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1132b-61d6-4a42-a9af-a808d0c38810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:12.582651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1132b-61d6-4a42-a9af-a808d0c38810 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:12.582927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1132b-61d6-4a42-a9af-a808d0c38810 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:12.583197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1132b-61d6-4a42-a9af-a808d0c38810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:12.583911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1132b-61d6-4a42-a9af-a808d0c38810 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=fbb1ba7d330940a7aa90a144168ec1e4, user.id=8e58efe27ce74e67828e1fc63bc7a843) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:37:12.584219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1132b-61d6-4a42-a9af-a808d0c38810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:12.585663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1132b-61d6-4a42-a9af-a808d0c38810 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:12.590841 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 574/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:37:12 2022] GET /identity/v3/role_assignments?user.id=8e58efe27ce74e67828e1fc63bc7a843&scope.project.id=fbb1ba7d330940a7aa90a144168ec1e4&role.id=a409f81bd5744563a303a825783bed61 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:14.935423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbd6be-7621-4122-9787-2406668f2fdb None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:14.935928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbd6be-7621-4122-9787-2406668f2fdb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:14.935928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbd6be-7621-4122-9787-2406668f2fdb None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:14.937244 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 573/1147] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:14.942355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca516dd1-b828-47c1-a4ab-5c7c5c1bf21f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:14.942770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca516dd1-b828-47c1-a4ab-5c7c5c1bf21f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:14.942915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca516dd1-b828-47c1-a4ab-5c7c5c1bf21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:14.961323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ca516dd1-b828-47c1-a4ab-5c7c5c1bf21f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:14.962499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ca516dd1-b828-47c1-a4ab-5c7c5c1bf21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:15.025919 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 575/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:37:15.350871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbd6be-7621-4122-9787-2406668f2fdb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:15.438859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:15.449719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbd6be-7621-4122-9787-2406668f2fdb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:15.482453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3bcd0-0d42-4b5c-b345-3a8721cc9e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:15.483071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3bcd0-0d42-4b5c-b345-3a8721cc9e5d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:15.483347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3bcd0-0d42-4b5c-b345-3a8721cc9e5d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:15.483614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3bcd0-0d42-4b5c-b345-3a8721cc9e5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:15.493664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3bcd0-0d42-4b5c-b345-3a8721cc9e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-aad3bcd0-0d42-4b5c-b345-3a8721cc9e5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:37:15.498336 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:37:15.499409 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:37:15.500429 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:37:15.500429 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:37:15.500429 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:37:15.500429 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:37:15.500429 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:37:15.500429 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:37:15.500429 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:37:15.500429 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:37:15.500429 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:37:15.500429 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:37:15.500429 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:37:15.500429 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:37:15.500429 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 574/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:37:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:37:15.505407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca516dd1-b828-47c1-a4ab-5c7c5c1bf21f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:15.535196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:15.602163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca516dd1-b828-47c1-a4ab-5c7c5c1bf21f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:15.634794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189c92f-6703-4268-802a-15139348941f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:15.635387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189c92f-6703-4268-802a-15139348941f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:15.635666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189c92f-6703-4268-802a-15139348941f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:15.635938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189c92f-6703-4268-802a-15139348941f None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:15.636594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189c92f-6703-4268-802a-15139348941f None admin] RBAC: Adding query filter params (name=admin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:37:15.636895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189c92f-6703-4268-802a-15139348941f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:15.638275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189c92f-6703-4268-802a-15139348941f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:15.646027 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 576/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:37:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:15.652401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3bcd0-0d42-4b5c-b345-3a8721cc9e5d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:15.747053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3bcd0-0d42-4b5c-b345-3a8721cc9e5d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:15.779846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfd19e-a7db-4875-8111-dabd7907f56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:15.780452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfd19e-a7db-4875-8111-dabd7907f56e None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:15.780727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfd19e-a7db-4875-8111-dabd7907f56e None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:15.780994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfd19e-a7db-4875-8111-dabd7907f56e None admin] PATH_INFO: `/v3/users/8e58efe27ce74e67828e1fc63bc7a843` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:15.782105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfd19e-a7db-4875-8111-dabd7907f56e None admin] RBAC: Authorizing `identity:get_user(user_id=8e58efe27ce74e67828e1fc63bc7a843)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:15.783499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfd19e-a7db-4875-8111-dabd7907f56e None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:15.785008 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 575/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:37:15 2022] GET /identity/v3/users/8e58efe27ce74e67828e1fc63bc7a843 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:15.790718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189c92f-6703-4268-802a-15139348941f None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:15.879633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:15.889266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189c92f-6703-4268-802a-15139348941f None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:15.920481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc2008-7467-4814-9da8-9b779305d164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:15.921094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc2008-7467-4814-9da8-9b779305d164 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:15.921398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc2008-7467-4814-9da8-9b779305d164 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:15.921666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc2008-7467-4814-9da8-9b779305d164 None admin] PATH_INFO: `/v3/projects/fbb1ba7d330940a7aa90a144168ec1e4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:15.922755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc2008-7467-4814-9da8-9b779305d164 None admin] RBAC: Authorizing `identity:get_project(project_id=fbb1ba7d330940a7aa90a144168ec1e4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:15.924156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc2008-7467-4814-9da8-9b779305d164 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:15.925770 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 577/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:37:15 2022] GET /identity/v3/projects/fbb1ba7d330940a7aa90a144168ec1e4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:15.932242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfd19e-a7db-4875-8111-dabd7907f56e None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:15.951379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:16.028474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfd19e-a7db-4875-8111-dabd7907f56e None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:16.060564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42433e44-e1b2-417f-8566-a94eecd67724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:16.061230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42433e44-e1b2-417f-8566-a94eecd67724 None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:16.061509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42433e44-e1b2-417f-8566-a94eecd67724 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:16.061779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42433e44-e1b2-417f-8566-a94eecd67724 None admin] PATH_INFO: `/v3/projects/fbb1ba7d330940a7aa90a144168ec1e4/users/8e58efe27ce74e67828e1fc63bc7a843/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:16.063632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42433e44-e1b2-417f-8566-a94eecd67724 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbb1ba7d330940a7aa90a144168ec1e4, user_id=8e58efe27ce74e67828e1fc63bc7a843, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:16.065042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42433e44-e1b2-417f-8566-a94eecd67724 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:16.078383 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 576/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:37:15 2022] PUT /identity/v3/projects/fbb1ba7d330940a7aa90a144168ec1e4/users/8e58efe27ce74e67828e1fc63bc7a843/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:37:18.454286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45a50b-d877-46cf-a99c-0f5fb519a3f1 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:18.454819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45a50b-d877-46cf-a99c-0f5fb519a3f1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:18.454819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45a50b-d877-46cf-a99c-0f5fb519a3f1 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:18.456187 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 578/1154] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:18.461412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f286020-c0f1-45b8-8728-ba748f1021a6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:18.461837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f286020-c0f1-45b8-8728-ba748f1021a6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:18.461968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f286020-c0f1-45b8-8728-ba748f1021a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:18.480268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7f286020-c0f1-45b8-8728-ba748f1021a6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:18.481492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7f286020-c0f1-45b8-8728-ba748f1021a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:18.546062 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 577/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:37:18.870730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45a50b-d877-46cf-a99c-0f5fb519a3f1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:18.968847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45a50b-d877-46cf-a99c-0f5fb519a3f1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:19.002153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03558cbc-437b-4acc-9321-7ae2979ec3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:19.002768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03558cbc-437b-4acc-9321-7ae2979ec3ad None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:19.003047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03558cbc-437b-4acc-9321-7ae2979ec3ad None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:19.003320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03558cbc-437b-4acc-9321-7ae2979ec3ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:19.013206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03558cbc-437b-4acc-9321-7ae2979ec3ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-03558cbc-437b-4acc-9321-7ae2979ec3ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:37:19.017935 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:37:19.019023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:37:19.019878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:37:19.019878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:37:19.019878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:37:19.019878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:37:19.019878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:37:19.019878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:37:19.019878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:37:19.019878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:37:19.019878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:37:19.019878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:37:19.019878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:37:19.019878 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:37:19.019878 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 579/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:37:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:37:19.025600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f286020-c0f1-45b8-8728-ba748f1021a6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:19.035473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:19.122015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f286020-c0f1-45b8-8728-ba748f1021a6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:19.155506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2c1d4-e647-49e2-90ab-e368b0d256a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:19.156119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2c1d4-e647-49e2-90ab-e368b0d256a1 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:19.156394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2c1d4-e647-49e2-90ab-e368b0d256a1 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:19.156691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2c1d4-e647-49e2-90ab-e368b0d256a1 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:19.157371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2c1d4-e647-49e2-90ab-e368b0d256a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:37:19.157671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2c1d4-e647-49e2-90ab-e368b0d256a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:19.159008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2c1d4-e647-49e2-90ab-e368b0d256a1 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:19.167265 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 578/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:37:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:19.173226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03558cbc-437b-4acc-9321-7ae2979ec3ad None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:19.194394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:19.268823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03558cbc-437b-4acc-9321-7ae2979ec3ad None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:19.304816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1a085-5d75-4679-af97-3f5f26c21813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:19.305470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1a085-5d75-4679-af97-3f5f26c21813 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:19.305748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1a085-5d75-4679-af97-3f5f26c21813 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:19.306019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1a085-5d75-4679-af97-3f5f26c21813 None admin] PATH_INFO: `/v3/users/8e58efe27ce74e67828e1fc63bc7a843` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:19.307137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1a085-5d75-4679-af97-3f5f26c21813 None admin] RBAC: Authorizing `identity:get_user(user_id=8e58efe27ce74e67828e1fc63bc7a843)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:19.308558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1a085-5d75-4679-af97-3f5f26c21813 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:19.310147 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 580/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:37:19 2022] GET /identity/v3/users/8e58efe27ce74e67828e1fc63bc7a843 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:19.315904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2c1d4-e647-49e2-90ab-e368b0d256a1 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:19.381876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:19.412032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2c1d4-e647-49e2-90ab-e368b0d256a1 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:19.443598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043da1c-ffda-4f8d-be84-8f5629051877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:19.444193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043da1c-ffda-4f8d-be84-8f5629051877 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:19.444475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043da1c-ffda-4f8d-be84-8f5629051877 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:19.444746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043da1c-ffda-4f8d-be84-8f5629051877 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:19.510914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043da1c-ffda-4f8d-be84-8f5629051877 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:19.512354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043da1c-ffda-4f8d-be84-8f5629051877 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:19.577583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:19.607985 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 579/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:37:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:37:19.613923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1a085-5d75-4679-af97-3f5f26c21813 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:19.699555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:19.711700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1a085-5d75-4679-af97-3f5f26c21813 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:19.744326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6348753-4234-42d0-8d05-2b6c20b229ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:19.744932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6348753-4234-42d0-8d05-2b6c20b229ff None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:19.745227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6348753-4234-42d0-8d05-2b6c20b229ff None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:19.745497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6348753-4234-42d0-8d05-2b6c20b229ff None admin] PATH_INFO: `/v3/projects/fbb1ba7d330940a7aa90a144168ec1e4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:19.746590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6348753-4234-42d0-8d05-2b6c20b229ff None admin] RBAC: Authorizing `identity:get_project(project_id=fbb1ba7d330940a7aa90a144168ec1e4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:19.747982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6348753-4234-42d0-8d05-2b6c20b229ff None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:19.749605 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 581/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:37:19 2022] GET /identity/v3/projects/fbb1ba7d330940a7aa90a144168ec1e4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:19.755764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043da1c-ffda-4f8d-be84-8f5629051877 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:19.850446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043da1c-ffda-4f8d-be84-8f5629051877 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:19.884423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca184d-47dc-4752-8fa5-3edc284aeba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:19.885010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca184d-47dc-4752-8fa5-3edc284aeba4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:19.885320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca184d-47dc-4752-8fa5-3edc284aeba4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:19.885594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca184d-47dc-4752-8fa5-3edc284aeba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:19.886306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca184d-47dc-4752-8fa5-3edc284aeba4 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=fbb1ba7d330940a7aa90a144168ec1e4, user.id=8e58efe27ce74e67828e1fc63bc7a843) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:37:19.886613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca184d-47dc-4752-8fa5-3edc284aeba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:19.888021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca184d-47dc-4752-8fa5-3edc284aeba4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:19.893549 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 580/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:37:19 2022] GET /identity/v3/role_assignments?user.id=8e58efe27ce74e67828e1fc63bc7a843&scope.project.id=fbb1ba7d330940a7aa90a144168ec1e4&role.id=a409f81bd5744563a303a825783bed61 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:22.281597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01838-1ef1-4feb-a6e2-41d969e7b56b None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:22.282157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01838-1ef1-4feb-a6e2-41d969e7b56b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:22.282157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01838-1ef1-4feb-a6e2-41d969e7b56b None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:22.283460 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 582/1162] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:22.288758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e026d-da09-4e93-b255-156ef4d48413 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:22.289179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e026d-da09-4e93-b255-156ef4d48413 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:22.289350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e026d-da09-4e93-b255-156ef4d48413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:22.307698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4c9e026d-da09-4e93-b255-156ef4d48413 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:22.308887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4c9e026d-da09-4e93-b255-156ef4d48413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:22.334868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:22.374693 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 581/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:37:22.699035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c01838-1ef1-4feb-a6e2-41d969e7b56b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:22.795338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c01838-1ef1-4feb-a6e2-41d969e7b56b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:22.828252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5930efd-afe0-4ba8-af6a-01856da9944b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:22.828842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5930efd-afe0-4ba8-af6a-01856da9944b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:22.829119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5930efd-afe0-4ba8-af6a-01856da9944b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:22.829426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5930efd-afe0-4ba8-af6a-01856da9944b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:22.852477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:22.894143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5930efd-afe0-4ba8-af6a-01856da9944b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:22.895581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5930efd-afe0-4ba8-af6a-01856da9944b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:22.988888 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 583/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:37:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:37:22.995878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e026d-da09-4e93-b255-156ef4d48413 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:23.088884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e026d-da09-4e93-b255-156ef4d48413 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:23.121594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc883ea-423c-467b-a923-6d636efe61b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:23.122203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc883ea-423c-467b-a923-6d636efe61b6 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:23.122477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc883ea-423c-467b-a923-6d636efe61b6 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:23.122742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc883ea-423c-467b-a923-6d636efe61b6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:23.129056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc883ea-423c-467b-a923-6d636efe61b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:23.130520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc883ea-423c-467b-a923-6d636efe61b6 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-cfc883ea-423c-467b-a923-6d636efe61b6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:37:23.142144 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:37:23.143402 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:37:23.144480 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 582/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Oct 8 20:37:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:37:23.149915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5930efd-afe0-4ba8-af6a-01856da9944b None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:23.203958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:23.246565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5930efd-afe0-4ba8-af6a-01856da9944b None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:23.278086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ef8e9-9050-49e1-bad9-a5416faf674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:23.278676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ef8e9-9050-49e1-bad9-a5416faf674f None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:23.278947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ef8e9-9050-49e1-bad9-a5416faf674f None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:23.279214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ef8e9-9050-49e1-bad9-a5416faf674f None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:23.279840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ef8e9-9050-49e1-bad9-a5416faf674f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:37:23.280140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ef8e9-9050-49e1-bad9-a5416faf674f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:23.281502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ef8e9-9050-49e1-bad9-a5416faf674f None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:23.288285 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 584/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Oct 8 20:37:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:25.650167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b522d98-aeec-4549-9057-355744383c48 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:25.650706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b522d98-aeec-4549-9057-355744383c48 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:25.650706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b522d98-aeec-4549-9057-355744383c48 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:25.652016 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 583/1167] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:25.657125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a09b60-1741-444c-bca1-54bb89d097e7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:25.657546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a09b60-1741-444c-bca1-54bb89d097e7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:25.657711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a09b60-1741-444c-bca1-54bb89d097e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:25.676062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b3a09b60-1741-444c-bca1-54bb89d097e7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:25.677275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b3a09b60-1741-444c-bca1-54bb89d097e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:25.740978 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 585/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:37:26.070043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b522d98-aeec-4549-9057-355744383c48 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:26.096292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:26.170048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b522d98-aeec-4549-9057-355744383c48 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:26.203177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ee180-eece-4cc0-9651-05d9ad1cb9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:26.203770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee180-eece-4cc0-9651-05d9ad1cb9b0 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:26.204047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee180-eece-4cc0-9651-05d9ad1cb9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:26.204315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee180-eece-4cc0-9651-05d9ad1cb9b0 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:26.204977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ee180-eece-4cc0-9651-05d9ad1cb9b0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:26.206360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ee180-eece-4cc0-9651-05d9ad1cb9b0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:26.222462 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 584/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Sat Oct 8 20:37:26 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:37:28.616103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18310f-fcea-411d-a80e-01f416370246 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:28.616619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18310f-fcea-411d-a80e-01f416370246 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:28.616619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18310f-fcea-411d-a80e-01f416370246 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:28.618526 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 586/1170] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:28.623659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e8e9-4001-4730-ae32-723a8bbb7ef8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:28.624080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e8e9-4001-4730-ae32-723a8bbb7ef8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:28.624208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e8e9-4001-4730-ae32-723a8bbb7ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:28.642433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2a91e8e9-4001-4730-ae32-723a8bbb7ef8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:28.643645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2a91e8e9-4001-4730-ae32-723a8bbb7ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:28.707372 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 585/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:37:29.028367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18310f-fcea-411d-a80e-01f416370246 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:29.077634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:29.127294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18310f-fcea-411d-a80e-01f416370246 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:29.161435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e44a15-ee60-498a-9d8a-f28833c2459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:29.162052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e44a15-ee60-498a-9d8a-f28833c2459b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:29.162324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e44a15-ee60-498a-9d8a-f28833c2459b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:29.162588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e44a15-ee60-498a-9d8a-f28833c2459b None admin] PATH_INFO: `/v3/domains/c9cd7eeb7d394f93ae3825d03fc21212` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:29.172922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e44a15-ee60-498a-9d8a-f28833c2459b None admin] RBAC: Authorizing `identity:get_domain(domain_id=c9cd7eeb7d394f93ae3825d03fc21212)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:29.174375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e44a15-ee60-498a-9d8a-f28833c2459b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:29.175929 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 587/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Sat Oct 8 20:37:29 2022] GET /identity/v3/domains/c9cd7eeb7d394f93ae3825d03fc21212 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:29.182427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91e8e9-4001-4730-ae32-723a8bbb7ef8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:29.197148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:29.278689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91e8e9-4001-4730-ae32-723a8bbb7ef8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:29.311198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656be37-5314-4e2f-a11d-206bfde4a991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:29.311791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656be37-5314-4e2f-a11d-206bfde4a991 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:29.312067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656be37-5314-4e2f-a11d-206bfde4a991 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:29.312335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656be37-5314-4e2f-a11d-206bfde4a991 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:29.312964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656be37-5314-4e2f-a11d-206bfde4a991 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:29.314408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656be37-5314-4e2f-a11d-206bfde4a991 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:29.340005 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 586/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:37:29 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:37:31.742113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051968e-20d2-4320-b0c0-799486e784c9 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:31.742733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051968e-20d2-4320-b0c0-799486e784c9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:31.742733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051968e-20d2-4320-b0c0-799486e784c9 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:31.743935 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 588/1174] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:31.749238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec632d-407f-4e96-a884-ee901dd619fa None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:31.749690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec632d-407f-4e96-a884-ee901dd619fa None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:31.749792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec632d-407f-4e96-a884-ee901dd619fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:31.767416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f5ec632d-407f-4e96-a884-ee901dd619fa None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:31.768582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f5ec632d-407f-4e96-a884-ee901dd619fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:31.825096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:31.833045 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 587/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:37:32.164934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051968e-20d2-4320-b0c0-799486e784c9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:32.266361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051968e-20d2-4320-b0c0-799486e784c9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:32.276955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:32.299755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce10743-16fb-49de-a58d-3aa44adeaa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:32.300367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce10743-16fb-49de-a58d-3aa44adeaa36 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:32.300643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce10743-16fb-49de-a58d-3aa44adeaa36 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:32.300912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce10743-16fb-49de-a58d-3aa44adeaa36 None admin] PATH_INFO: `/v3/domains/c9cd7eeb7d394f93ae3825d03fc21212` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:32.302047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce10743-16fb-49de-a58d-3aa44adeaa36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c9cd7eeb7d394f93ae3825d03fc21212)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:32.303456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce10743-16fb-49de-a58d-3aa44adeaa36 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:32.305529 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 589/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Sat Oct 8 20:37:32 2022] GET /identity/v3/domains/c9cd7eeb7d394f93ae3825d03fc21212 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:32.311323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec632d-407f-4e96-a884-ee901dd619fa None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:32.405838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec632d-407f-4e96-a884-ee901dd619fa None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:32.438464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9ac75-9621-470f-a0c0-ba931cac8d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:32.439000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9ac75-9621-470f-a0c0-ba931cac8d56 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:32.439276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9ac75-9621-470f-a0c0-ba931cac8d56 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:32.439547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9ac75-9621-470f-a0c0-ba931cac8d56 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:32.440191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9ac75-9621-470f-a0c0-ba931cac8d56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:32.441649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9ac75-9621-470f-a0c0-ba931cac8d56 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:32.462934 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 588/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:37:32 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:37:34.882217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7579078-c7b3-4716-8c8b-ed73c7a50001 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:34.882728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7579078-c7b3-4716-8c8b-ed73c7a50001 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:34.882728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7579078-c7b3-4716-8c8b-ed73c7a50001 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:34.884019 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 590/1178] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:34.889084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8bfb-97cf-492b-a39f-c66d158b152e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:34.889546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8bfb-97cf-492b-a39f-c66d158b152e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:34.889667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8bfb-97cf-492b-a39f-c66d158b152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:34.908518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-01ad8bfb-97cf-492b-a39f-c66d158b152e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:34.909739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-01ad8bfb-97cf-492b-a39f-c66d158b152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:34.954493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:34.974754 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 589/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:37:35.302275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7579078-c7b3-4716-8c8b-ed73c7a50001 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:35.401695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7579078-c7b3-4716-8c8b-ed73c7a50001 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:35.434179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e760f-7a7b-45b1-a12a-c5bab043cdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:35.434790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e760f-7a7b-45b1-a12a-c5bab043cdee None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:35.435065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e760f-7a7b-45b1-a12a-c5bab043cdee None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:35.435332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e760f-7a7b-45b1-a12a-c5bab043cdee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:35.445001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e760f-7a7b-45b1-a12a-c5bab043cdee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-1f4e760f-7a7b-45b1-a12a-c5bab043cdee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:37:35.449833 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:37:35.451011 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:37:35.451934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:37:35.451934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:37:35.451934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:37:35.451934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:37:35.451934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:37:35.451934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:37:35.451934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:37:35.451934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:37:35.451934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:37:35.451934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:37:35.451934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:37:35.451934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:37:35.451934 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 591/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:37:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:37:35.456935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8bfb-97cf-492b-a39f-c66d158b152e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:35.552389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8bfb-97cf-492b-a39f-c66d158b152e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:35.583907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd992e-d3a7-47c7-a6da-31c3973acfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:35.584501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd992e-d3a7-47c7-a6da-31c3973acfeb None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:35.584777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd992e-d3a7-47c7-a6da-31c3973acfeb None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:35.585047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd992e-d3a7-47c7-a6da-31c3973acfeb None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:35.585738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd992e-d3a7-47c7-a6da-31c3973acfeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:37:35.586569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd992e-d3a7-47c7-a6da-31c3973acfeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:35.587919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd992e-d3a7-47c7-a6da-31c3973acfeb None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:35.595612 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 590/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:37:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:35.601540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e760f-7a7b-45b1-a12a-c5bab043cdee None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:35.640471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:35.698428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e760f-7a7b-45b1-a12a-c5bab043cdee None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:35.730698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b239b99-20b6-4ce0-a1aa-cae1b67b8891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:35.731298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239b99-20b6-4ce0-a1aa-cae1b67b8891 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:35.731572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239b99-20b6-4ce0-a1aa-cae1b67b8891 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:35.731838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239b99-20b6-4ce0-a1aa-cae1b67b8891 None admin] PATH_INFO: `/v3/users/13b46fafdb4849718d9022efddaa2a84` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:35.744458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b239b99-20b6-4ce0-a1aa-cae1b67b8891 None admin] RBAC: Authorizing `identity:get_user(user_id=13b46fafdb4849718d9022efddaa2a84)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:35.745899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b239b99-20b6-4ce0-a1aa-cae1b67b8891 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:35.747435 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 592/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:37:35 2022] GET /identity/v3/users/13b46fafdb4849718d9022efddaa2a84 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:35.753434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd992e-d3a7-47c7-a6da-31c3973acfeb None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:35.797697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:35.850246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd992e-d3a7-47c7-a6da-31c3973acfeb None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:35.881946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485afabd-0e73-4f09-b037-4adc011483d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:35.882535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485afabd-0e73-4f09-b037-4adc011483d4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:35.882810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485afabd-0e73-4f09-b037-4adc011483d4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:35.883576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485afabd-0e73-4f09-b037-4adc011483d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:35.947556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485afabd-0e73-4f09-b037-4adc011483d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:35.948977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485afabd-0e73-4f09-b037-4adc011483d4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:35.990656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:36.043981 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 591/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:37:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:37:36.049937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b239b99-20b6-4ce0-a1aa-cae1b67b8891 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:36.140995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:36.147300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b239b99-20b6-4ce0-a1aa-cae1b67b8891 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:36.179649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63635cb9-0306-4405-95fb-9e27adb52a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:36.180781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635cb9-0306-4405-95fb-9e27adb52a83 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:36.181058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635cb9-0306-4405-95fb-9e27adb52a83 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:36.181362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635cb9-0306-4405-95fb-9e27adb52a83 None admin] PATH_INFO: `/v3/projects/8b12c1a9da01467497f005635cca3e96` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:36.182467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63635cb9-0306-4405-95fb-9e27adb52a83 None admin] RBAC: Authorizing `identity:get_project(project_id=8b12c1a9da01467497f005635cca3e96)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:36.183868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63635cb9-0306-4405-95fb-9e27adb52a83 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:36.185492 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 593/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:37:36 2022] GET /identity/v3/projects/8b12c1a9da01467497f005635cca3e96 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:36.191481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485afabd-0e73-4f09-b037-4adc011483d4 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:36.286636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485afabd-0e73-4f09-b037-4adc011483d4 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:36.319229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934cb0c-8a33-44eb-83e0-08cf8f9a4f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:36.319821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934cb0c-8a33-44eb-83e0-08cf8f9a4f58 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:36.320098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934cb0c-8a33-44eb-83e0-08cf8f9a4f58 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:36.320399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934cb0c-8a33-44eb-83e0-08cf8f9a4f58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:36.322273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934cb0c-8a33-44eb-83e0-08cf8f9a4f58 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=8b12c1a9da01467497f005635cca3e96, user.id=13b46fafdb4849718d9022efddaa2a84) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:37:36.322582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934cb0c-8a33-44eb-83e0-08cf8f9a4f58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:36.324017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934cb0c-8a33-44eb-83e0-08cf8f9a4f58 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:36.329165 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 592/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:37:36 2022] GET /identity/v3/role_assignments?user.id=13b46fafdb4849718d9022efddaa2a84&scope.project.id=8b12c1a9da01467497f005635cca3e96&role.id=a409f81bd5744563a303a825783bed61 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:38.668525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3f051-ff76-44e0-93d9-3245fd1fe92b None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:38.669056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3f051-ff76-44e0-93d9-3245fd1fe92b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:38.669056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3f051-ff76-44e0-93d9-3245fd1fe92b None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:38.670422 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 594/1186] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:38.675572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55f83f-58c7-4041-99bc-d3e6ac341a28 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:38.675971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55f83f-58c7-4041-99bc-d3e6ac341a28 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:38.676108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55f83f-58c7-4041-99bc-d3e6ac341a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:38.693825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5c55f83f-58c7-4041-99bc-d3e6ac341a28 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:38.694980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5c55f83f-58c7-4041-99bc-d3e6ac341a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:38.697401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:38.760787 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 593/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:37:39.083505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3f051-ff76-44e0-93d9-3245fd1fe92b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:39.182316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3f051-ff76-44e0-93d9-3245fd1fe92b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:39.214786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43e1b6-746f-46b4-b5e1-77ffbbcde9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:39.215394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43e1b6-746f-46b4-b5e1-77ffbbcde9bc None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:39.215671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43e1b6-746f-46b4-b5e1-77ffbbcde9bc None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:39.215940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43e1b6-746f-46b4-b5e1-77ffbbcde9bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:39.225688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43e1b6-746f-46b4-b5e1-77ffbbcde9bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-6d43e1b6-746f-46b4-b5e1-77ffbbcde9bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:37:39.230419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:37:39.231508 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:37:39.232722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:37:39.232722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:37:39.232722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:37:39.232722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:37:39.232722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:37:39.232722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:37:39.232722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:37:39.232722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:37:39.232722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:37:39.232722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:37:39.232722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:37:39.232722 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:37:39.232722 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 595/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:37:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:37:39.237409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55f83f-58c7-4041-99bc-d3e6ac341a28 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:39.334346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55f83f-58c7-4041-99bc-d3e6ac341a28 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:39.366373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c24b90-bbdb-4f15-b0fa-ba08fc4565b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:39.366964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c24b90-bbdb-4f15-b0fa-ba08fc4565b6 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:39.367742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c24b90-bbdb-4f15-b0fa-ba08fc4565b6 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:39.368036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c24b90-bbdb-4f15-b0fa-ba08fc4565b6 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:39.368691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c24b90-bbdb-4f15-b0fa-ba08fc4565b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:37:39.368993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c24b90-bbdb-4f15-b0fa-ba08fc4565b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:39.370382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c24b90-bbdb-4f15-b0fa-ba08fc4565b6 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:39.375126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:39.378775 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 594/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:37:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:39.384935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43e1b6-746f-46b4-b5e1-77ffbbcde9bc None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:39.412967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:39.484367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43e1b6-746f-46b4-b5e1-77ffbbcde9bc None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:39.517737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaf1de-9340-4112-9da9-4fdb612d9bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:39.518354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaf1de-9340-4112-9da9-4fdb612d9bbd None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:39.518659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaf1de-9340-4112-9da9-4fdb612d9bbd None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:39.518928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaf1de-9340-4112-9da9-4fdb612d9bbd None admin] PATH_INFO: `/v3/users/13b46fafdb4849718d9022efddaa2a84` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:39.520042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaf1de-9340-4112-9da9-4fdb612d9bbd None admin] RBAC: Authorizing `identity:get_user(user_id=13b46fafdb4849718d9022efddaa2a84)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:39.521479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaf1de-9340-4112-9da9-4fdb612d9bbd None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:39.523037 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 596/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:37:39 2022] GET /identity/v3/users/13b46fafdb4849718d9022efddaa2a84 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:39.528858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c24b90-bbdb-4f15-b0fa-ba08fc4565b6 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:39.625071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c24b90-bbdb-4f15-b0fa-ba08fc4565b6 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:39.656728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085698a-bb6f-46db-9dc0-dd7ed715e489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:39.657374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085698a-bb6f-46db-9dc0-dd7ed715e489 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:39.657656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085698a-bb6f-46db-9dc0-dd7ed715e489 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:39.657929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085698a-bb6f-46db-9dc0-dd7ed715e489 None admin] PATH_INFO: `/v3/projects/8b12c1a9da01467497f005635cca3e96` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:39.659025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085698a-bb6f-46db-9dc0-dd7ed715e489 None admin] RBAC: Authorizing `identity:get_project(project_id=8b12c1a9da01467497f005635cca3e96)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:39.660456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085698a-bb6f-46db-9dc0-dd7ed715e489 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:39.662062 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 595/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:37:39 2022] GET /identity/v3/projects/8b12c1a9da01467497f005635cca3e96 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:39.668304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaf1de-9340-4112-9da9-4fdb612d9bbd None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:39.756298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:39.765425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaf1de-9340-4112-9da9-4fdb612d9bbd None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:39.798053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed617e8-32c0-4f4c-b916-27724b457731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:39.798686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed617e8-32c0-4f4c-b916-27724b457731 None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:39.798961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed617e8-32c0-4f4c-b916-27724b457731 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:39.799230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed617e8-32c0-4f4c-b916-27724b457731 None admin] PATH_INFO: `/v3/projects/8b12c1a9da01467497f005635cca3e96/users/13b46fafdb4849718d9022efddaa2a84/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:39.801103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed617e8-32c0-4f4c-b916-27724b457731 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b12c1a9da01467497f005635cca3e96, user_id=13b46fafdb4849718d9022efddaa2a84, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:39.802547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed617e8-32c0-4f4c-b916-27724b457731 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:39.815033 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 597/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:37:39 2022] PUT /identity/v3/projects/8b12c1a9da01467497f005635cca3e96/users/13b46fafdb4849718d9022efddaa2a84/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:37:42.154051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138d4a1-3f7f-43c6-89a2-c3899497233b None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:42.154588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138d4a1-3f7f-43c6-89a2-c3899497233b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:42.154588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138d4a1-3f7f-43c6-89a2-c3899497233b None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:42.155907 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 596/1193] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:42.161176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea47919-e524-4035-8185-455a9c210d8d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:42.161627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea47919-e524-4035-8185-455a9c210d8d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:42.161744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea47919-e524-4035-8185-455a9c210d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:42.180104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2ea47919-e524-4035-8185-455a9c210d8d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:42.181311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2ea47919-e524-4035-8185-455a9c210d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:42.245433 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 598/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:37:42.570208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138d4a1-3f7f-43c6-89a2-c3899497233b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:42.640196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:42.673723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138d4a1-3f7f-43c6-89a2-c3899497233b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:42.706006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b68ce-1d97-42b8-ae49-846bf8ea1a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:42.706624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b68ce-1d97-42b8-ae49-846bf8ea1a8a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:42.706899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b68ce-1d97-42b8-ae49-846bf8ea1a8a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:42.707165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b68ce-1d97-42b8-ae49-846bf8ea1a8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:42.718257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b68ce-1d97-42b8-ae49-846bf8ea1a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-8c5b68ce-1d97-42b8-ae49-846bf8ea1a8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:37:42.722942 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:37:42.724038 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:37:42.725228 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:37:42.725228 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:37:42.725228 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:37:42.725228 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:37:42.725228 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:37:42.725228 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:37:42.725228 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:37:42.725228 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:37:42.725228 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:37:42.725228 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:37:42.725228 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:37:42.725228 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:37:42.725228 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 597/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:37:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:37:42.730791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea47919-e524-4035-8185-455a9c210d8d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:42.807976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:42.826464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea47919-e524-4035-8185-455a9c210d8d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:42.859175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17dce9-f87d-4069-88b6-585510f72fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:42.859750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17dce9-f87d-4069-88b6-585510f72fb7 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:42.860026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17dce9-f87d-4069-88b6-585510f72fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:42.860293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17dce9-f87d-4069-88b6-585510f72fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:42.860947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17dce9-f87d-4069-88b6-585510f72fb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:37:42.861264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17dce9-f87d-4069-88b6-585510f72fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:42.862599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17dce9-f87d-4069-88b6-585510f72fb7 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:42.870472 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 599/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:37:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:42.876215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b68ce-1d97-42b8-ae49-846bf8ea1a8a None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:42.971459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b68ce-1d97-42b8-ae49-846bf8ea1a8a None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:42.996945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:43.004900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c3407-3a69-45e7-8214-500f9ad98916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:43.005554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c3407-3a69-45e7-8214-500f9ad98916 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:43.005834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c3407-3a69-45e7-8214-500f9ad98916 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:43.006107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c3407-3a69-45e7-8214-500f9ad98916 None admin] PATH_INFO: `/v3/users/13b46fafdb4849718d9022efddaa2a84` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:43.007210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c3407-3a69-45e7-8214-500f9ad98916 None admin] RBAC: Authorizing `identity:get_user(user_id=13b46fafdb4849718d9022efddaa2a84)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:43.008666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c3407-3a69-45e7-8214-500f9ad98916 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:43.010268 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 598/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Oct 8 20:37:42 2022] GET /identity/v3/users/13b46fafdb4849718d9022efddaa2a84 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:43.016016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17dce9-f87d-4069-88b6-585510f72fb7 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:43.112712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17dce9-f87d-4069-88b6-585510f72fb7 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:43.144607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a2e40-a9cc-43a0-91c6-f1c6437dd1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:43.145225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a2e40-a9cc-43a0-91c6-f1c6437dd1e8 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:43.145493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a2e40-a9cc-43a0-91c6-f1c6437dd1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:43.145757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a2e40-a9cc-43a0-91c6-f1c6437dd1e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:43.159657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:43.210774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a2e40-a9cc-43a0-91c6-f1c6437dd1e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:43.212781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a2e40-a9cc-43a0-91c6-f1c6437dd1e8 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:43.305428 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 600/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:37:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:37:43.311258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c3407-3a69-45e7-8214-500f9ad98916 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:43.409258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c3407-3a69-45e7-8214-500f9ad98916 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:43.441125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5165c-8a78-46ef-aa3f-e7652498e3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:43.441774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5165c-8a78-46ef-aa3f-e7652498e3e8 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:43.442054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5165c-8a78-46ef-aa3f-e7652498e3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:43.442323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5165c-8a78-46ef-aa3f-e7652498e3e8 None admin] PATH_INFO: `/v3/projects/8b12c1a9da01467497f005635cca3e96` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:43.443413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5165c-8a78-46ef-aa3f-e7652498e3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=8b12c1a9da01467497f005635cca3e96)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:43.444840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5165c-8a78-46ef-aa3f-e7652498e3e8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:43.446973 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 599/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Oct 8 20:37:43 2022] GET /identity/v3/projects/8b12c1a9da01467497f005635cca3e96 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:43.453119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a2e40-a9cc-43a0-91c6-f1c6437dd1e8 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:43.497344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:43.549439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a2e40-a9cc-43a0-91c6-f1c6437dd1e8 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:43.582738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d079b-9cc8-43c7-bda2-8538cac4410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:43.583279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d079b-9cc8-43c7-bda2-8538cac4410a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:43.583557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d079b-9cc8-43c7-bda2-8538cac4410a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:43.583830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d079b-9cc8-43c7-bda2-8538cac4410a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:43.584549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d079b-9cc8-43c7-bda2-8538cac4410a None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=8b12c1a9da01467497f005635cca3e96, user.id=13b46fafdb4849718d9022efddaa2a84) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:37:43.584858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d079b-9cc8-43c7-bda2-8538cac4410a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:43.586339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d079b-9cc8-43c7-bda2-8538cac4410a None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:43.591871 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 601/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:37:43 2022] GET /identity/v3/role_assignments?user.id=13b46fafdb4849718d9022efddaa2a84&scope.project.id=8b12c1a9da01467497f005635cca3e96&role.id=a409f81bd5744563a303a825783bed61 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:37:53.437133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=68 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:53.589798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=46 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:46.437668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960cb6f-e888-4bfd-841f-715df7f1f041 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:46.438265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960cb6f-e888-4bfd-841f-715df7f1f041 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:46.438265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960cb6f-e888-4bfd-841f-715df7f1f041 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:46.439806 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 600/1201] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:46.448589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fcb4c-87f0-406b-ad25-663d4f120bd0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:46.448589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fcb4c-87f0-406b-ad25-663d4f120bd0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:46.448589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fcb4c-87f0-406b-ad25-663d4f120bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:46.467567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ec9fcb4c-87f0-406b-ad25-663d4f120bd0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:46.469007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ec9fcb4c-87f0-406b-ad25-663d4f120bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:46.558084 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 602/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:38:46.896209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960cb6f-e888-4bfd-841f-715df7f1f041 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:47.015654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960cb6f-e888-4bfd-841f-715df7f1f041 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:47.059250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f938d-7f02-4085-89d1-58b5684ad689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:47.060152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f938d-7f02-4085-89d1-58b5684ad689 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:47.060589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f938d-7f02-4085-89d1-58b5684ad689 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:47.061017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f938d-7f02-4085-89d1-58b5684ad689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:47.073688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f938d-7f02-4085-89d1-58b5684ad689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:47.077147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f938d-7f02-4085-89d1-58b5684ad689 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-2c1f938d-7f02-4085-89d1-58b5684ad689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:38:47.093437 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:38:47.094627 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:38:47.095624 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:38:47.095624 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:38:47.095624 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:38:47.097028 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 601/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:38:47.103345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fcb4c-87f0-406b-ad25-663d4f120bd0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:47.221224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fcb4c-87f0-406b-ad25-663d4f120bd0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:47.265051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:47.272758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907acc50-1897-45b8-8bcb-550fc442361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:47.273733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907acc50-1897-45b8-8bcb-550fc442361b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:47.274218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907acc50-1897-45b8-8bcb-550fc442361b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:47.274691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907acc50-1897-45b8-8bcb-550fc442361b None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:47.275380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907acc50-1897-45b8-8bcb-550fc442361b None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:38:47.275687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907acc50-1897-45b8-8bcb-550fc442361b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:47.277119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907acc50-1897-45b8-8bcb-550fc442361b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:47.291355 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 603/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:38:47.297300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f938d-7f02-4085-89d1-58b5684ad689 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:47.374929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:47.446163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f938d-7f02-4085-89d1-58b5684ad689 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:47.502169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022fd43-fc8b-4661-a160-84126de602dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:47.502830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022fd43-fc8b-4661-a160-84126de602dc None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:47.503231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022fd43-fc8b-4661-a160-84126de602dc None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:47.503689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022fd43-fc8b-4661-a160-84126de602dc None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:47.504833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022fd43-fc8b-4661-a160-84126de602dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:47.506511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022fd43-fc8b-4661-a160-84126de602dc None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:47.538155 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 602/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Oct 8 20:38:47 2022] POST /identity/v3/users => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:38:50.048077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffe556-e106-4284-92cd-1eaa03f8a741 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:50.048609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffe556-e106-4284-92cd-1eaa03f8a741 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:50.048609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffe556-e106-4284-92cd-1eaa03f8a741 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:50.050246 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 604/1206] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:38:50.056006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c66e53-e514-4d2c-85fb-6aba591df6ba None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:50.056568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c66e53-e514-4d2c-85fb-6aba591df6ba None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:50.056568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c66e53-e514-4d2c-85fb-6aba591df6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:50.076799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d2c66e53-e514-4d2c-85fb-6aba591df6ba None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:50.079519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d2c66e53-e514-4d2c-85fb-6aba591df6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:50.169130 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 603/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:38:50.502476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffe556-e106-4284-92cd-1eaa03f8a741 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:50.624224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffe556-e106-4284-92cd-1eaa03f8a741 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:50.666621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c918d-81a9-49fa-94b8-ea7af577f63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:50.667268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c918d-81a9-49fa-94b8-ea7af577f63e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:50.667545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c918d-81a9-49fa-94b8-ea7af577f63e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:50.667816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c918d-81a9-49fa-94b8-ea7af577f63e None admin] PATH_INFO: `/v3/roles/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:50.679288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c918d-81a9-49fa-94b8-ea7af577f63e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-e85c918d-81a9-49fa-94b8-ea7af577f63e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:38:50.684644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:38:50.686106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:38:50.687433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:38:50.687433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:38:50.687433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:38:50.687433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:38:50.687433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:38:50.687433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:38:50.687433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:38:50.687433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:38:50.687433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:38:50.687433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:38:50.687433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:38:50.687433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:38:50.687433 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 605/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:38:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:38:50.698292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c66e53-e514-4d2c-85fb-6aba591df6ba None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:50.738952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:50.804190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c66e53-e514-4d2c-85fb-6aba591df6ba None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:50.839768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afff9d-0cbf-44a8-9e98-bf57a33a73df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:50.840608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afff9d-0cbf-44a8-9e98-bf57a33a73df None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:50.840923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afff9d-0cbf-44a8-9e98-bf57a33a73df None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:50.841457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afff9d-0cbf-44a8-9e98-bf57a33a73df None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:50.842220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afff9d-0cbf-44a8-9e98-bf57a33a73df None admin] RBAC: Adding query filter params (name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:38:50.842626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afff9d-0cbf-44a8-9e98-bf57a33a73df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:50.844088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afff9d-0cbf-44a8-9e98-bf57a33a73df None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:50.852563 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 604/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:38:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:38:50.859330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c918d-81a9-49fa-94b8-ea7af577f63e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:50.916563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:50.971789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c918d-81a9-49fa-94b8-ea7af577f63e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:51.008426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f06e7-c755-4364-88e5-43d7fdc637ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:51.009066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f06e7-c755-4364-88e5-43d7fdc637ea None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:51.009398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f06e7-c755-4364-88e5-43d7fdc637ea None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:51.009669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f06e7-c755-4364-88e5-43d7fdc637ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:51.020552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f06e7-c755-4364-88e5-43d7fdc637ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:51.022031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f06e7-c755-4364-88e5-43d7fdc637ea None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-d42f06e7-c755-4364-88e5-43d7fdc637ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:38:51.038272 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:38:51.044796 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:38:51.045952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:38:51.045952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:38:51.045952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:38:51.045952 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 606/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:38:51.046191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afff9d-0cbf-44a8-9e98-bf57a33a73df None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:51.152007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:51.158250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afff9d-0cbf-44a8-9e98-bf57a33a73df None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:51.201312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370caf6-06c8-4367-aeb5-7398df4efb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:51.202206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370caf6-06c8-4367-aeb5-7398df4efb4c None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:51.202588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370caf6-06c8-4367-aeb5-7398df4efb4c None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:51.203136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370caf6-06c8-4367-aeb5-7398df4efb4c None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:51.204006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370caf6-06c8-4367-aeb5-7398df4efb4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:38:51.204426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370caf6-06c8-4367-aeb5-7398df4efb4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:51.206178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370caf6-06c8-4367-aeb5-7398df4efb4c None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:51.225156 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 605/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:38:51.226865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f06e7-c755-4364-88e5-43d7fdc637ea None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:51.337735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f06e7-c755-4364-88e5-43d7fdc637ea None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:51.339354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:51.379152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793dead-17e8-46de-9616-91e8999d084d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:51.379772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793dead-17e8-46de-9616-91e8999d084d None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:51.380044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793dead-17e8-46de-9616-91e8999d084d None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:51.380366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793dead-17e8-46de-9616-91e8999d084d None admin] PATH_INFO: `/v3/users/placement` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:51.390866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793dead-17e8-46de-9616-91e8999d084d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:51.392311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793dead-17e8-46de-9616-91e8999d084d None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-f793dead-17e8-46de-9616-91e8999d084d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:38:51.407043 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:38:51.408312 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:38:51.414091 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:38:51.414091 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:38:51.414091 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:38:51.414091 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:38:51.414091 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:38:51.414091 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:38:51.414091 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:38:51.414091 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:38:51.414091 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:38:51.414091 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:38:51.414091 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 607/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:38:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:38:51.414715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370caf6-06c8-4367-aeb5-7398df4efb4c None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:51.531313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370caf6-06c8-4367-aeb5-7398df4efb4c None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:51.567581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdf5eb-f2f9-4923-939c-1ec8d19159fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:51.568195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdf5eb-f2f9-4923-939c-1ec8d19159fa None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:51.568467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdf5eb-f2f9-4923-939c-1ec8d19159fa None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:51.568740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdf5eb-f2f9-4923-939c-1ec8d19159fa None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:51.569511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdf5eb-f2f9-4923-939c-1ec8d19159fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:38:51.569807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdf5eb-f2f9-4923-939c-1ec8d19159fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:51.571228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdf5eb-f2f9-4923-939c-1ec8d19159fa None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:51.594151 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 606/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Oct 8 20:38:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:38:51.599746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793dead-17e8-46de-9616-91e8999d084d None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:51.722141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793dead-17e8-46de-9616-91e8999d084d None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:51.760402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d581811-5074-4b2b-9e45-ba0a8554ea85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:51.761054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d581811-5074-4b2b-9e45-ba0a8554ea85 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:51.761367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d581811-5074-4b2b-9e45-ba0a8554ea85 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:51.762173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d581811-5074-4b2b-9e45-ba0a8554ea85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:51.797680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:51.846194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d581811-5074-4b2b-9e45-ba0a8554ea85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:51.847606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d581811-5074-4b2b-9e45-ba0a8554ea85 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:51.959594 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 608/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:38:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:38:51.965780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdf5eb-f2f9-4923-939c-1ec8d19159fa None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:51.986116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:52.091339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdf5eb-f2f9-4923-939c-1ec8d19159fa None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:52.137560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027bc1d-be76-4664-a1eb-172f4c55db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:52.137560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027bc1d-be76-4664-a1eb-172f4c55db03 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:52.137560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027bc1d-be76-4664-a1eb-172f4c55db03 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:52.137560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027bc1d-be76-4664-a1eb-172f4c55db03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:52.145849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027bc1d-be76-4664-a1eb-172f4c55db03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:52.147335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027bc1d-be76-4664-a1eb-172f4c55db03 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-0027bc1d-be76-4664-a1eb-172f4c55db03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:38:52.163680 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:38:52.165546 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:38:52.166574 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:38:52.166574 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:38:52.166574 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:38:52.166574 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 607/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:38:52.172404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d581811-5074-4b2b-9e45-ba0a8554ea85 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:52.241326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:52.283671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d581811-5074-4b2b-9e45-ba0a8554ea85 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:52.319729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e12117-142a-48c5-9276-9b53a4e9d0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:52.320376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e12117-142a-48c5-9276-9b53a4e9d0e3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:52.320740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e12117-142a-48c5-9276-9b53a4e9d0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:52.321164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e12117-142a-48c5-9276-9b53a4e9d0e3 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:52.321843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e12117-142a-48c5-9276-9b53a4e9d0e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:38:52.322221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e12117-142a-48c5-9276-9b53a4e9d0e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:52.323666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e12117-142a-48c5-9276-9b53a4e9d0e3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:52.336304 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 609/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:38:52.342146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027bc1d-be76-4664-a1eb-172f4c55db03 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:52.419486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:52.454976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027bc1d-be76-4664-a1eb-172f4c55db03 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:52.500915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c113c9-ca0a-4446-8d55-ad959b284d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:52.501576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c113c9-ca0a-4446-8d55-ad959b284d69 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:52.501906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c113c9-ca0a-4446-8d55-ad959b284d69 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:52.502162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c113c9-ca0a-4446-8d55-ad959b284d69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:52.509649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c113c9-ca0a-4446-8d55-ad959b284d69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:52.511267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c113c9-ca0a-4446-8d55-ad959b284d69 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-90c113c9-ca0a-4446-8d55-ad959b284d69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:38:52.524427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:38:52.525686 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:38:52.526754 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:38:52.526754 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:38:52.526754 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:38:52.526754 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:38:52.526754 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:38:52.526754 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:38:52.526754 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:38:52.526754 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:38:52.526754 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 608/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:38:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:38:52.533994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e12117-142a-48c5-9276-9b53a4e9d0e3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:52.665543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e12117-142a-48c5-9276-9b53a4e9d0e3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:52.692027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:52.711157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44693c9a-47f9-4d3c-8a45-d767707d6d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:52.711836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44693c9a-47f9-4d3c-8a45-d767707d6d17 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:52.712110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44693c9a-47f9-4d3c-8a45-d767707d6d17 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:52.712375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44693c9a-47f9-4d3c-8a45-d767707d6d17 None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:52.713063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44693c9a-47f9-4d3c-8a45-d767707d6d17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:38:52.713395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44693c9a-47f9-4d3c-8a45-d767707d6d17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:52.714845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44693c9a-47f9-4d3c-8a45-d767707d6d17 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:52.728364 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 610/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:38:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:38:52.735861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c113c9-ca0a-4446-8d55-ad959b284d69 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:52.854646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c113c9-ca0a-4446-8d55-ad959b284d69 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:52.889285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:52.895848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc3ec2-539c-426d-93b0-3ba1c278fd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:52.896571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3ec2-539c-426d-93b0-3ba1c278fd67 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:52.896949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3ec2-539c-426d-93b0-3ba1c278fd67 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:52.897370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3ec2-539c-426d-93b0-3ba1c278fd67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:52.898185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc3ec2-539c-426d-93b0-3ba1c278fd67 None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=2dc47f2448a042fca1a986695a350c94) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:38:52.898592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc3ec2-539c-426d-93b0-3ba1c278fd67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:52.900112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc3ec2-539c-426d-93b0-3ba1c278fd67 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:52.905693 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 609/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:38:52 2022] GET /identity/v3/role_assignments?user.id=2dc47f2448a042fca1a986695a350c94&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:38:55.371919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e7bb-e37c-4e38-a94d-108fcabf706a None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:55.372466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e7bb-e37c-4e38-a94d-108fcabf706a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:55.372466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e7bb-e37c-4e38-a94d-108fcabf706a None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:55.373991 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 611/1220] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:55.379240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099c9ec-0b8f-4bfd-a7fe-b0085f3b0eff None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:55.379628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099c9ec-0b8f-4bfd-a7fe-b0085f3b0eff None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:55.379777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099c9ec-0b8f-4bfd-a7fe-b0085f3b0eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:55.398596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4099c9ec-0b8f-4bfd-a7fe-b0085f3b0eff None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:55.399798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4099c9ec-0b8f-4bfd-a7fe-b0085f3b0eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:55.469998 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 610/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:38:55.799514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348e7bb-e37c-4e38-a94d-108fcabf706a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:55.919833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348e7bb-e37c-4e38-a94d-108fcabf706a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:55.957970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e9673-3bf3-4e89-bb59-47018659261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:55.958605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e9673-3bf3-4e89-bb59-47018659261e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:55.958883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e9673-3bf3-4e89-bb59-47018659261e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:55.959150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e9673-3bf3-4e89-bb59-47018659261e None admin] PATH_INFO: `/v3/roles/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:55.970124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e9673-3bf3-4e89-bb59-47018659261e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-a07e9673-3bf3-4e89-bb59-47018659261e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:38:55.974886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:38:55.976036 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:38:55.976907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:38:55.976907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:38:55.976907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:38:55.976907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:38:55.976907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:38:55.976907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:38:55.976907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:38:55.976907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:38:55.976907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:38:55.976907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:38:55.976907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:38:55.976907 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:38:55.976907 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 612/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:38:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:38:55.982160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099c9ec-0b8f-4bfd-a7fe-b0085f3b0eff None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:56.096038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099c9ec-0b8f-4bfd-a7fe-b0085f3b0eff None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:56.124378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:56.135812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d4e8a-7601-4eb6-9112-3d6eb20d3a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:56.136569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d4e8a-7601-4eb6-9112-3d6eb20d3a85 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:56.136880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d4e8a-7601-4eb6-9112-3d6eb20d3a85 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:56.137200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d4e8a-7601-4eb6-9112-3d6eb20d3a85 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:56.137927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d4e8a-7601-4eb6-9112-3d6eb20d3a85 None admin] RBAC: Adding query filter params (name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:38:56.138251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d4e8a-7601-4eb6-9112-3d6eb20d3a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:56.139733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d4e8a-7601-4eb6-9112-3d6eb20d3a85 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:56.147785 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 611/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:38:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:38:56.153859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e9673-3bf3-4e89-bb59-47018659261e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:56.205513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:56.268953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e9673-3bf3-4e89-bb59-47018659261e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:56.309397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b618c59-3ced-4227-a60c-deeb5a8f27fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:56.310135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b618c59-3ced-4227-a60c-deeb5a8f27fc None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:56.310466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b618c59-3ced-4227-a60c-deeb5a8f27fc None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:56.310776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b618c59-3ced-4227-a60c-deeb5a8f27fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:56.325597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b618c59-3ced-4227-a60c-deeb5a8f27fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:56.327409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b618c59-3ced-4227-a60c-deeb5a8f27fc None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-4b618c59-3ced-4227-a60c-deeb5a8f27fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:38:56.343811 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:38:56.349710 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:38:56.350947 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:38:56.350947 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:38:56.350947 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:38:56.350947 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 613/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:38:56.354286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d4e8a-7601-4eb6-9112-3d6eb20d3a85 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:56.464562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d4e8a-7601-4eb6-9112-3d6eb20d3a85 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:56.504199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a3fe3-7e72-4a63-b9e9-3e92da104141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:56.504797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3fe3-7e72-4a63-b9e9-3e92da104141 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:56.505077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3fe3-7e72-4a63-b9e9-3e92da104141 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:56.505378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3fe3-7e72-4a63-b9e9-3e92da104141 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:56.506019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a3fe3-7e72-4a63-b9e9-3e92da104141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:38:56.506321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a3fe3-7e72-4a63-b9e9-3e92da104141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:56.507681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a3fe3-7e72-4a63-b9e9-3e92da104141 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:56.520445 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 612/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:38:56.526403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b618c59-3ced-4227-a60c-deeb5a8f27fc None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:56.625756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:56.632596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b618c59-3ced-4227-a60c-deeb5a8f27fc None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:56.671819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775f021-9a8e-43df-a2e7-0b99189d4dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:56.672489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775f021-9a8e-43df-a2e7-0b99189d4dd1 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:56.672769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775f021-9a8e-43df-a2e7-0b99189d4dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:56.673039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775f021-9a8e-43df-a2e7-0b99189d4dd1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:56.681402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775f021-9a8e-43df-a2e7-0b99189d4dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:56.682912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775f021-9a8e-43df-a2e7-0b99189d4dd1 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-d775f021-9a8e-43df-a2e7-0b99189d4dd1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:38:56.694983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:38:56.696055 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:38:56.697046 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:38:56.697046 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:38:56.697046 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:38:56.697046 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:38:56.697046 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:38:56.697046 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:38:56.697046 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:38:56.697046 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:38:56.697046 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:38:56.697046 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:38:56.697046 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 614/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:38:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:38:56.702256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a3fe3-7e72-4a63-b9e9-3e92da104141 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:56.756721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:56.818261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a3fe3-7e72-4a63-b9e9-3e92da104141 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:56.857534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0829e4-4bf7-4f93-ac04-c52548a636b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:56.858139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0829e4-4bf7-4f93-ac04-c52548a636b0 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:56.858415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0829e4-4bf7-4f93-ac04-c52548a636b0 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:56.858685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0829e4-4bf7-4f93-ac04-c52548a636b0 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:56.859405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0829e4-4bf7-4f93-ac04-c52548a636b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:38:56.859704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0829e4-4bf7-4f93-ac04-c52548a636b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:56.861112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0829e4-4bf7-4f93-ac04-c52548a636b0 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:56.878815 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 613/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Oct 8 20:38:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:38:56.884520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775f021-9a8e-43df-a2e7-0b99189d4dd1 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:56.990701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775f021-9a8e-43df-a2e7-0b99189d4dd1 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:57.024703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bb47a-409c-4dd1-b7ac-15c4e5d253c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:57.025456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bb47a-409c-4dd1-b7ac-15c4e5d253c2 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:57.025734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bb47a-409c-4dd1-b7ac-15c4e5d253c2 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:57.026004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bb47a-409c-4dd1-b7ac-15c4e5d253c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:57.038179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bb47a-409c-4dd1-b7ac-15c4e5d253c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:57.039617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bb47a-409c-4dd1-b7ac-15c4e5d253c2 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-556bb47a-409c-4dd1-b7ac-15c4e5d253c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:38:57.054943 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:38:57.056096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:38:57.057274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:38:57.057274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:38:57.057274 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:38:57.057274 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 615/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:38:57.062071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0829e4-4bf7-4f93-ac04-c52548a636b0 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:57.175813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0829e4-4bf7-4f93-ac04-c52548a636b0 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:57.178825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:57.215840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79455ee3-e4e3-4e32-bbf2-91b98867836f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:57.216458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79455ee3-e4e3-4e32-bbf2-91b98867836f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:57.216738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79455ee3-e4e3-4e32-bbf2-91b98867836f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:57.217011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79455ee3-e4e3-4e32-bbf2-91b98867836f None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:57.217711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79455ee3-e4e3-4e32-bbf2-91b98867836f None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:38:57.218017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79455ee3-e4e3-4e32-bbf2-91b98867836f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:57.219458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79455ee3-e4e3-4e32-bbf2-91b98867836f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:57.232555 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 614/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:38:57.238335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bb47a-409c-4dd1-b7ac-15c4e5d253c2 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:57.248246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:57.346080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bb47a-409c-4dd1-b7ac-15c4e5d253c2 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:57.380455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d678cb-c945-4d0e-bbbc-2ff01b53b2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:57.381084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d678cb-c945-4d0e-bbbc-2ff01b53b2f3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:57.381396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d678cb-c945-4d0e-bbbc-2ff01b53b2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:57.381673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d678cb-c945-4d0e-bbbc-2ff01b53b2f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:57.388874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d678cb-c945-4d0e-bbbc-2ff01b53b2f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:57.390346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d678cb-c945-4d0e-bbbc-2ff01b53b2f3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-11d678cb-c945-4d0e-bbbc-2ff01b53b2f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:38:57.401378 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:38:57.403025 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:38:57.404268 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:38:57.404268 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:38:57.404268 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:38:57.404268 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:38:57.404268 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:38:57.404268 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:38:57.404268 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:38:57.404268 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:38:57.405347 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 616/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:38:57.408802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79455ee3-e4e3-4e32-bbf2-91b98867836f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:57.518648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79455ee3-e4e3-4e32-bbf2-91b98867836f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:57.553785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbc7a2-adeb-4f86-be83-c55053ed2e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:57.554391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbc7a2-adeb-4f86-be83-c55053ed2e12 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:57.554674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbc7a2-adeb-4f86-be83-c55053ed2e12 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:57.554950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbc7a2-adeb-4f86-be83-c55053ed2e12 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:57.555639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbc7a2-adeb-4f86-be83-c55053ed2e12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:38:57.555940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbc7a2-adeb-4f86-be83-c55053ed2e12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:57.557386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbc7a2-adeb-4f86-be83-c55053ed2e12 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:57.569475 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 615/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:38:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:38:57.576435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d678cb-c945-4d0e-bbbc-2ff01b53b2f3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:57.645747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:57.687487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d678cb-c945-4d0e-bbbc-2ff01b53b2f3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:57.722741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2906b9-8964-40d6-af7f-fd1d516ed9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:57.723490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2906b9-8964-40d6-af7f-fd1d516ed9bf None admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:57.723836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2906b9-8964-40d6-af7f-fd1d516ed9bf None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:57.724180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2906b9-8964-40d6-af7f-fd1d516ed9bf None admin] PATH_INFO: `/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/2dc47f2448a042fca1a986695a350c94/roles/f16d77e2bee5436dab21baa2ee33e03b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:57.739273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2906b9-8964-40d6-af7f-fd1d516ed9bf None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba1e9ad05694bbe8723c14f5e2b08f7, user_id=2dc47f2448a042fca1a986695a350c94, role_id=f16d77e2bee5436dab21baa2ee33e03b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:57.740636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2906b9-8964-40d6-af7f-fd1d516ed9bf None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:57.753456 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 617/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:38:57 2022] PUT /identity/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/2dc47f2448a042fca1a986695a350c94/roles/f16d77e2bee5436dab21baa2ee33e03b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:39:00.201597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f48668-e404-43c0-909a-a9a19d8c6520 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:00.202162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f48668-e404-43c0-909a-a9a19d8c6520 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:00.202162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f48668-e404-43c0-909a-a9a19d8c6520 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:00.203484 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 616/1233] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:00.209615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32988007-d082-4746-9e4e-9fee1ccd4ffa None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:00.210181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32988007-d082-4746-9e4e-9fee1ccd4ffa None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:00.210181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32988007-d082-4746-9e4e-9fee1ccd4ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:00.231261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-32988007-d082-4746-9e4e-9fee1ccd4ffa None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:00.232506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-32988007-d082-4746-9e4e-9fee1ccd4ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:00.306386 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 618/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:39:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:39:00.646687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f48668-e404-43c0-909a-a9a19d8c6520 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:00.675533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:00.763499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f48668-e404-43c0-909a-a9a19d8c6520 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:00.798995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f3e21-7762-4a1a-9466-0dcb31bcbf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:00.799647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f3e21-7762-4a1a-9466-0dcb31bcbf4d None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:00.799935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f3e21-7762-4a1a-9466-0dcb31bcbf4d None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:00.800179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f3e21-7762-4a1a-9466-0dcb31bcbf4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:00.811262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f3e21-7762-4a1a-9466-0dcb31bcbf4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-c61f3e21-7762-4a1a-9466-0dcb31bcbf4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:39:00.816102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:00.817061 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:00.818221 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:00.818221 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:00.818221 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:00.818221 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:00.818221 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:39:00.818221 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:39:00.818221 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:39:00.818221 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:39:00.818221 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:39:00.818221 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:39:00.818221 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:39:00.818221 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:39:00.818221 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 617/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Oct 8 20:39:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:00.823525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32988007-d082-4746-9e4e-9fee1ccd4ffa None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:00.873877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:00.937461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32988007-d082-4746-9e4e-9fee1ccd4ffa None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:00.971930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa84d0-7b6a-4a92-8622-6c99b04d66df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:00.972583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa84d0-7b6a-4a92-8622-6c99b04d66df None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:00.972855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa84d0-7b6a-4a92-8622-6c99b04d66df None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:00.973125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa84d0-7b6a-4a92-8622-6c99b04d66df None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:00.973831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa84d0-7b6a-4a92-8622-6c99b04d66df None admin] RBAC: Adding query filter params (name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:00.974137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa84d0-7b6a-4a92-8622-6c99b04d66df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:00.975477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa84d0-7b6a-4a92-8622-6c99b04d66df None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:00.984423 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 619/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Oct 8 20:39:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:39:00.990535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f3e21-7762-4a1a-9466-0dcb31bcbf4d None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:01.079628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:01.098040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f3e21-7762-4a1a-9466-0dcb31bcbf4d None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:01.135166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4ea0e-9fa8-4406-bd58-b8a37afca506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:01.136426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4ea0e-9fa8-4406-bd58-b8a37afca506 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:01.136778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4ea0e-9fa8-4406-bd58-b8a37afca506 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:01.137078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4ea0e-9fa8-4406-bd58-b8a37afca506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:01.147963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4ea0e-9fa8-4406-bd58-b8a37afca506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:01.149629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4ea0e-9fa8-4406-bd58-b8a37afca506 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-52c4ea0e-9fa8-4406-bd58-b8a37afca506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:39:01.166295 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:01.167827 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:39:01.169748 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:39:01.169748 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:01.169748 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:39:01.169748 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 618/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:39:01.174424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa84d0-7b6a-4a92-8622-6c99b04d66df None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:01.288406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa84d0-7b6a-4a92-8622-6c99b04d66df None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:01.298262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:01.325005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e07fb-b0a7-448c-9cec-2c18568ea4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:01.325652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e07fb-b0a7-448c-9cec-2c18568ea4d9 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:01.325933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e07fb-b0a7-448c-9cec-2c18568ea4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:01.326237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e07fb-b0a7-448c-9cec-2c18568ea4d9 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:01.326848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e07fb-b0a7-448c-9cec-2c18568ea4d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:01.327150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e07fb-b0a7-448c-9cec-2c18568ea4d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:01.328538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e07fb-b0a7-448c-9cec-2c18568ea4d9 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:01.344792 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 620/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:01.346945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4ea0e-9fa8-4406-bd58-b8a37afca506 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:01.456328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4ea0e-9fa8-4406-bd58-b8a37afca506 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:01.500438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e084b-06a0-4ad1-8543-4bbc64e7c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:01.501071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e084b-06a0-4ad1-8543-4bbc64e7c656 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:01.501383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e084b-06a0-4ad1-8543-4bbc64e7c656 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:01.501647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e084b-06a0-4ad1-8543-4bbc64e7c656 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:01.505501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:01.513004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e084b-06a0-4ad1-8543-4bbc64e7c656 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:01.514506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e084b-06a0-4ad1-8543-4bbc64e7c656 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-e80e084b-06a0-4ad1-8543-4bbc64e7c656 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:39:01.525975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:01.528794 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:01.530195 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:01.530195 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:01.530195 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:39:01.530195 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:39:01.530195 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:39:01.530195 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:39:01.530195 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:39:01.530195 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:39:01.530195 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:39:01.530195 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:39:01.530195 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 619/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:39:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:01.533163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e07fb-b0a7-448c-9cec-2c18568ea4d9 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:01.648102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e07fb-b0a7-448c-9cec-2c18568ea4d9 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:01.695946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc26acb-ade3-45f0-9797-7c6e4ba231fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:01.696606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26acb-ade3-45f0-9797-7c6e4ba231fd None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:01.696904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26acb-ade3-45f0-9797-7c6e4ba231fd None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:01.697315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26acb-ade3-45f0-9797-7c6e4ba231fd None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:01.698747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc26acb-ade3-45f0-9797-7c6e4ba231fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:01.699094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc26acb-ade3-45f0-9797-7c6e4ba231fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:01.701259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc26acb-ade3-45f0-9797-7c6e4ba231fd None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:01.724323 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 621/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Oct 8 20:39:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:01.730277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e084b-06a0-4ad1-8543-4bbc64e7c656 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:01.845394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e084b-06a0-4ad1-8543-4bbc64e7c656 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:01.882236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bace2-3ac8-47b2-9c26-1f7583dc55fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:01.882901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bace2-3ac8-47b2-9c26-1f7583dc55fe None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:01.883189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bace2-3ac8-47b2-9c26-1f7583dc55fe None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:01.883525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bace2-3ac8-47b2-9c26-1f7583dc55fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:01.951363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:01.959580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bace2-3ac8-47b2-9c26-1f7583dc55fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:01.961092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bace2-3ac8-47b2-9c26-1f7583dc55fe None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:02.074680 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 620/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:39:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:39:02.080589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc26acb-ade3-45f0-9797-7c6e4ba231fd None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:02.111394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:02.210165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc26acb-ade3-45f0-9797-7c6e4ba231fd None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:02.251120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bde03f-6802-468f-b784-15b9aededab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:02.252188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bde03f-6802-468f-b784-15b9aededab4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:02.252521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bde03f-6802-468f-b784-15b9aededab4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:02.252922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bde03f-6802-468f-b784-15b9aededab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:02.266047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bde03f-6802-468f-b784-15b9aededab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:02.267793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bde03f-6802-468f-b784-15b9aededab4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-84bde03f-6802-468f-b784-15b9aededab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:39:02.286940 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:02.288376 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:39:02.289978 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:39:02.289978 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:02.289978 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:02.289978 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 622/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:02.294566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bace2-3ac8-47b2-9c26-1f7583dc55fe None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:02.396186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:02.403557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bace2-3ac8-47b2-9c26-1f7583dc55fe None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:02.442980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1e22d-a2ac-4b20-b5f4-d264014e479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:02.443658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1e22d-a2ac-4b20-b5f4-d264014e479b None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:02.443952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1e22d-a2ac-4b20-b5f4-d264014e479b None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:02.444231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1e22d-a2ac-4b20-b5f4-d264014e479b None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:02.445023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1e22d-a2ac-4b20-b5f4-d264014e479b None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:02.445359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1e22d-a2ac-4b20-b5f4-d264014e479b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:02.446723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1e22d-a2ac-4b20-b5f4-d264014e479b None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:02.459430 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 621/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:02.465625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bde03f-6802-468f-b784-15b9aededab4 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:02.561261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:02.590174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bde03f-6802-468f-b784-15b9aededab4 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:02.632063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d54bd-d64e-467a-b2a7-ea506f51bea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:02.632692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d54bd-d64e-467a-b2a7-ea506f51bea7 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:02.632967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d54bd-d64e-467a-b2a7-ea506f51bea7 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:02.633266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d54bd-d64e-467a-b2a7-ea506f51bea7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:02.642158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d54bd-d64e-467a-b2a7-ea506f51bea7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:02.643769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d54bd-d64e-467a-b2a7-ea506f51bea7 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-431d54bd-d64e-467a-b2a7-ea506f51bea7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:39:02.656735 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:02.657984 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:02.659016 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:39:02.659016 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:39:02.659016 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:39:02.659016 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:39:02.659016 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:39:02.659016 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:39:02.659016 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:39:02.659016 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:02.659016 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 623/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:39:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:02.664179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1e22d-a2ac-4b20-b5f4-d264014e479b None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:02.783273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1e22d-a2ac-4b20-b5f4-d264014e479b None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:02.820005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29640c-2244-4e1b-9cce-8fe0058f27d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:02.820608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29640c-2244-4e1b-9cce-8fe0058f27d8 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:02.820920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29640c-2244-4e1b-9cce-8fe0058f27d8 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:02.821213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29640c-2244-4e1b-9cce-8fe0058f27d8 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:02.821883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29640c-2244-4e1b-9cce-8fe0058f27d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:02.822189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29640c-2244-4e1b-9cce-8fe0058f27d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:02.823658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29640c-2244-4e1b-9cce-8fe0058f27d8 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:02.836590 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 622/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:39:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:39:02.843513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d54bd-d64e-467a-b2a7-ea506f51bea7 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:02.959225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d54bd-d64e-467a-b2a7-ea506f51bea7 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:02.999621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8bae3-7fa9-437e-8061-92722c3b300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:03.000354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8bae3-7fa9-437e-8061-92722c3b300e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:03.000637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8bae3-7fa9-437e-8061-92722c3b300e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:03.000910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8bae3-7fa9-437e-8061-92722c3b300e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:03.001720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8bae3-7fa9-437e-8061-92722c3b300e None admin] RBAC: Adding query filter params (role.id=f16d77e2bee5436dab21baa2ee33e03b, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=2dc47f2448a042fca1a986695a350c94) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:03.002048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8bae3-7fa9-437e-8061-92722c3b300e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:03.003782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8bae3-7fa9-437e-8061-92722c3b300e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:03.010835 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 624/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:39:02 2022] GET /identity/v3/role_assignments?user.id=2dc47f2448a042fca1a986695a350c94&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=f16d77e2bee5436dab21baa2ee33e03b => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:39:05.692931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7d62c-7503-4242-80b7-66827b8e9999 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:05.693484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7d62c-7503-4242-80b7-66827b8e9999 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:05.693575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7d62c-7503-4242-80b7-66827b8e9999 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:05.694843 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 623/1247] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:05.700098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b5d34-bc8a-40c1-b7bf-518e6d16043c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:05.700556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b5d34-bc8a-40c1-b7bf-518e6d16043c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:05.700671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b5d34-bc8a-40c1-b7bf-518e6d16043c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:05.710597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:05.723511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-288b5d34-bc8a-40c1-b7bf-518e6d16043c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:05.724684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-288b5d34-bc8a-40c1-b7bf-518e6d16043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:05.794071 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 625/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:39:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:39:06.120181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7d62c-7503-4242-80b7-66827b8e9999 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:06.138402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:06.225017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7d62c-7503-4242-80b7-66827b8e9999 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:06.258805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2820d-8c64-42de-9a12-09d25824fe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:06.259417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2820d-8c64-42de-9a12-09d25824fe89 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:06.259694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2820d-8c64-42de-9a12-09d25824fe89 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:06.259964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2820d-8c64-42de-9a12-09d25824fe89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:06.269786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2820d-8c64-42de-9a12-09d25824fe89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-6ec2820d-8c64-42de-9a12-09d25824fe89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:39:06.274478 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:06.275623 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:06.277303 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:06.277303 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:06.277303 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:06.277303 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:06.277303 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:39:06.277303 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:39:06.277303 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:39:06.277303 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:39:06.277303 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:39:06.277303 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:39:06.277303 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:39:06.277303 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:39:06.277303 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 624/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:39:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:06.282218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b5d34-bc8a-40c1-b7bf-518e6d16043c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:06.377573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b5d34-bc8a-40c1-b7bf-518e6d16043c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:06.406727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:06.412068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e65dd-d0b2-48b6-8b9f-8a3a403667f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:06.413028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e65dd-d0b2-48b6-8b9f-8a3a403667f3 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:06.413028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e65dd-d0b2-48b6-8b9f-8a3a403667f3 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:06.413278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e65dd-d0b2-48b6-8b9f-8a3a403667f3 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:06.413943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e65dd-d0b2-48b6-8b9f-8a3a403667f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:06.414248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e65dd-d0b2-48b6-8b9f-8a3a403667f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:06.415607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e65dd-d0b2-48b6-8b9f-8a3a403667f3 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:06.423534 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 626/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:39:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:06.429340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2820d-8c64-42de-9a12-09d25824fe89 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:06.504366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:06.528200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2820d-8c64-42de-9a12-09d25824fe89 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:06.560342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4b8e1-3468-44f0-a9ba-1417cdbef3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:06.560947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4b8e1-3468-44f0-a9ba-1417cdbef3b9 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:06.561259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4b8e1-3468-44f0-a9ba-1417cdbef3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:06.561531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4b8e1-3468-44f0-a9ba-1417cdbef3b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:06.571143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4b8e1-3468-44f0-a9ba-1417cdbef3b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:06.572566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4b8e1-3468-44f0-a9ba-1417cdbef3b9 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-1be4b8e1-3468-44f0-a9ba-1417cdbef3b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:39:06.587047 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:06.588151 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:39:06.589888 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:39:06.589888 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:06.589888 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:39:06.589888 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 625/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:06.594612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e65dd-d0b2-48b6-8b9f-8a3a403667f3 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:06.691253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e65dd-d0b2-48b6-8b9f-8a3a403667f3 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:06.723603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c033b16-4e2d-44c3-ae44-4a07948a755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:06.724187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c033b16-4e2d-44c3-ae44-4a07948a755b None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:06.724452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c033b16-4e2d-44c3-ae44-4a07948a755b None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:06.724718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c033b16-4e2d-44c3-ae44-4a07948a755b None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:06.725376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c033b16-4e2d-44c3-ae44-4a07948a755b None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:06.725676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c033b16-4e2d-44c3-ae44-4a07948a755b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:06.727009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c033b16-4e2d-44c3-ae44-4a07948a755b None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:06.738804 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 627/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:06.745424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4b8e1-3468-44f0-a9ba-1417cdbef3b9 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:06.841059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4b8e1-3468-44f0-a9ba-1417cdbef3b9 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:06.865343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:06.874186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf90f-1ff8-4efe-aaec-96cef7078f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:06.874799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf90f-1ff8-4efe-aaec-96cef7078f63 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:06.875081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf90f-1ff8-4efe-aaec-96cef7078f63 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:06.875350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf90f-1ff8-4efe-aaec-96cef7078f63 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:06.882462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cf90f-1ff8-4efe-aaec-96cef7078f63 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:06.883879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cf90f-1ff8-4efe-aaec-96cef7078f63 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-744cf90f-1ff8-4efe-aaec-96cef7078f63 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:39:06.895163 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:06.896287 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:06.897510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:06.897510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:06.897510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:39:06.897510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:39:06.897510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:39:06.897510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:39:06.897510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:39:06.897510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:39:06.897510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:39:06.897510 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:39:06.897510 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 626/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:39:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:06.901932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c033b16-4e2d-44c3-ae44-4a07948a755b None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:06.955219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:06.998121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c033b16-4e2d-44c3-ae44-4a07948a755b None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:07.030461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f35b9f-47a9-4425-bcfd-dc5f54a32015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:07.031044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f35b9f-47a9-4425-bcfd-dc5f54a32015 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:07.031317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f35b9f-47a9-4425-bcfd-dc5f54a32015 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:07.031583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f35b9f-47a9-4425-bcfd-dc5f54a32015 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:07.032286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f35b9f-47a9-4425-bcfd-dc5f54a32015 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:07.032582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f35b9f-47a9-4425-bcfd-dc5f54a32015 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:07.034001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f35b9f-47a9-4425-bcfd-dc5f54a32015 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:07.050100 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 628/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Oct 8 20:39:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:07.055659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf90f-1ff8-4efe-aaec-96cef7078f63 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:07.152967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf90f-1ff8-4efe-aaec-96cef7078f63 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:07.199546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b0d3c-d4c8-47c8-bc64-768d3670abb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:07.200265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b0d3c-d4c8-47c8-bc64-768d3670abb7 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:07.200550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b0d3c-d4c8-47c8-bc64-768d3670abb7 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:07.200826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b0d3c-d4c8-47c8-bc64-768d3670abb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:07.254306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:07.266564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b0d3c-d4c8-47c8-bc64-768d3670abb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:07.268018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b0d3c-d4c8-47c8-bc64-768d3670abb7 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:07.362063 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 627/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:39:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:39:07.368159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f35b9f-47a9-4425-bcfd-dc5f54a32015 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:07.465828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f35b9f-47a9-4425-bcfd-dc5f54a32015 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:07.478722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:07.500150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2f65e-0550-45b4-acbd-2b4d5a8f46f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:07.500772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2f65e-0550-45b4-acbd-2b4d5a8f46f0 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:07.501049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2f65e-0550-45b4-acbd-2b4d5a8f46f0 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:07.501353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2f65e-0550-45b4-acbd-2b4d5a8f46f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:07.511095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2f65e-0550-45b4-acbd-2b4d5a8f46f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:07.512469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2f65e-0550-45b4-acbd-2b4d5a8f46f0 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-90f2f65e-0550-45b4-acbd-2b4d5a8f46f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:39:07.527000 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:07.528083 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:39:07.529211 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:39:07.529211 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:07.529211 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:07.529211 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 629/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:07.533748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b0d3c-d4c8-47c8-bc64-768d3670abb7 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:07.618044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:07.630174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b0d3c-d4c8-47c8-bc64-768d3670abb7 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:07.662920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf200f-2f01-4450-8a41-8992c8c94e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:07.663538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf200f-2f01-4450-8a41-8992c8c94e21 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:07.663814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf200f-2f01-4450-8a41-8992c8c94e21 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:07.664085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf200f-2f01-4450-8a41-8992c8c94e21 None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:07.664718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf200f-2f01-4450-8a41-8992c8c94e21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:07.665017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf200f-2f01-4450-8a41-8992c8c94e21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:07.667029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf200f-2f01-4450-8a41-8992c8c94e21 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:07.677695 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 628/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:07.683332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2f65e-0550-45b4-acbd-2b4d5a8f46f0 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:07.780726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2f65e-0550-45b4-acbd-2b4d5a8f46f0 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:07.813104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd78670-6dae-49a4-ba4f-9078c7947e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:07.813752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd78670-6dae-49a4-ba4f-9078c7947e64 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:07.814033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd78670-6dae-49a4-ba4f-9078c7947e64 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:07.814309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd78670-6dae-49a4-ba4f-9078c7947e64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:07.820685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd78670-6dae-49a4-ba4f-9078c7947e64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:07.822136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd78670-6dae-49a4-ba4f-9078c7947e64 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-7fd78670-6dae-49a4-ba4f-9078c7947e64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:39:07.833107 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:07.834149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:07.835089 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:39:07.835089 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:39:07.835089 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:39:07.835089 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:39:07.835089 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:39:07.835089 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:39:07.835089 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:39:07.835089 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:07.835089 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 630/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:39:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:07.840631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf200f-2f01-4450-8a41-8992c8c94e21 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:07.935207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf200f-2f01-4450-8a41-8992c8c94e21 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:07.967346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c052e-ce08-4936-82d1-315d03216548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:07.967929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c052e-ce08-4936-82d1-315d03216548 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:07.968204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c052e-ce08-4936-82d1-315d03216548 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:07.968472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c052e-ce08-4936-82d1-315d03216548 None admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:07.969147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c052e-ce08-4936-82d1-315d03216548 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:07.969547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c052e-ce08-4936-82d1-315d03216548 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:07.970870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c052e-ce08-4936-82d1-315d03216548 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:07.982112 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 629/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:39:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:07.988077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd78670-6dae-49a4-ba4f-9078c7947e64 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:08.013540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:08.086791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd78670-6dae-49a4-ba4f-9078c7947e64 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:08.119272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96762ca9-554f-4e2d-96f9-873155d3e5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:08.119892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96762ca9-554f-4e2d-96f9-873155d3e5d7 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:08.120171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96762ca9-554f-4e2d-96f9-873155d3e5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:08.120446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96762ca9-554f-4e2d-96f9-873155d3e5d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:08.121164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96762ca9-554f-4e2d-96f9-873155d3e5d7 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=2dc47f2448a042fca1a986695a350c94) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:08.121513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96762ca9-554f-4e2d-96f9-873155d3e5d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:08.122924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96762ca9-554f-4e2d-96f9-873155d3e5d7 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:08.128107 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 631/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:39:07 2022] GET /identity/v3/role_assignments?user.id=2dc47f2448a042fca1a986695a350c94&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=a409f81bd5744563a303a825783bed61 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:10.466617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28236a80-2cb2-4b50-b9b2-8e749f13286d None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:10.467150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28236a80-2cb2-4b50-b9b2-8e749f13286d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:10.467150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28236a80-2cb2-4b50-b9b2-8e749f13286d None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:10.468460 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 630/1261] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:10.473631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208381e7-b5d4-4c39-8a97-dd0e893d371a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:10.474064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208381e7-b5d4-4c39-8a97-dd0e893d371a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:10.474266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208381e7-b5d4-4c39-8a97-dd0e893d371a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:10.493852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-208381e7-b5d4-4c39-8a97-dd0e893d371a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:10.495068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-208381e7-b5d4-4c39-8a97-dd0e893d371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:10.559477 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 632/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:39:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:39:10.891238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28236a80-2cb2-4b50-b9b2-8e749f13286d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:10.902481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:10.989069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28236a80-2cb2-4b50-b9b2-8e749f13286d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:11.021871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6141ba-7fea-4723-bf8e-dfd73e34d9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:11.022478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6141ba-7fea-4723-bf8e-dfd73e34d9c4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:11.022754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6141ba-7fea-4723-bf8e-dfd73e34d9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:11.023025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6141ba-7fea-4723-bf8e-dfd73e34d9c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:11.033350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6141ba-7fea-4723-bf8e-dfd73e34d9c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-7c6141ba-7fea-4723-bf8e-dfd73e34d9c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:39:11.038032 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:11.039079 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:11.040309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:11.040309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:11.040309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:11.040309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:11.040309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:39:11.040309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:39:11.040309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:39:11.040309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:39:11.040309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:39:11.040309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:39:11.040309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:39:11.040309 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:39:11.040309 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 631/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:39:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:11.044984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208381e7-b5d4-4c39-8a97-dd0e893d371a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:11.062551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:11.140148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208381e7-b5d4-4c39-8a97-dd0e893d371a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:11.176266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6cfdc-53b1-4ce0-8839-0f04a8854e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:11.176903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6cfdc-53b1-4ce0-8839-0f04a8854e87 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:11.177244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6cfdc-53b1-4ce0-8839-0f04a8854e87 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:11.177550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6cfdc-53b1-4ce0-8839-0f04a8854e87 None admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:11.178317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6cfdc-53b1-4ce0-8839-0f04a8854e87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:11.178624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6cfdc-53b1-4ce0-8839-0f04a8854e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:11.180122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6cfdc-53b1-4ce0-8839-0f04a8854e87 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:11.188713 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 633/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:39:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:11.194430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6141ba-7fea-4723-bf8e-dfd73e34d9c4 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:11.258612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:11.290532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6141ba-7fea-4723-bf8e-dfd73e34d9c4 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:11.322939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f33eb9-7c37-4e09-b388-0403c84078d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:11.323555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f33eb9-7c37-4e09-b388-0403c84078d4 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:11.323835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f33eb9-7c37-4e09-b388-0403c84078d4 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:11.324104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f33eb9-7c37-4e09-b388-0403c84078d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:11.333782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f33eb9-7c37-4e09-b388-0403c84078d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:11.335206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f33eb9-7c37-4e09-b388-0403c84078d4 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-37f33eb9-7c37-4e09-b388-0403c84078d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:39:11.349685 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:11.350782 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:39:11.352021 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:39:11.352021 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:11.352021 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:39:11.352021 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 632/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:11.357091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6cfdc-53b1-4ce0-8839-0f04a8854e87 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:11.436405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:11.454915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6cfdc-53b1-4ce0-8839-0f04a8854e87 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:11.487957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405570a-a525-4336-8053-886e9df94ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:11.488563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405570a-a525-4336-8053-886e9df94ab5 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:11.488846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405570a-a525-4336-8053-886e9df94ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:11.489119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405570a-a525-4336-8053-886e9df94ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:11.489792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405570a-a525-4336-8053-886e9df94ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:11.490098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405570a-a525-4336-8053-886e9df94ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:11.491703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405570a-a525-4336-8053-886e9df94ab5 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:11.503331 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 634/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:11.509011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f33eb9-7c37-4e09-b388-0403c84078d4 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:11.606526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f33eb9-7c37-4e09-b388-0403c84078d4 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:11.625930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:11.640271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a7fb0-dc61-4c5f-9965-66f8dad79505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:11.640887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a7fb0-dc61-4c5f-9965-66f8dad79505 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:11.641167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a7fb0-dc61-4c5f-9965-66f8dad79505 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:11.641502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a7fb0-dc61-4c5f-9965-66f8dad79505 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:11.648572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a7fb0-dc61-4c5f-9965-66f8dad79505 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:11.650033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a7fb0-dc61-4c5f-9965-66f8dad79505 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-246a7fb0-dc61-4c5f-9965-66f8dad79505 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:39:11.660761 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:11.661901 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:11.662888 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:11.662888 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:11.662888 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:39:11.662888 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:39:11.662888 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:39:11.662888 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:39:11.662888 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:39:11.662888 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:39:11.662888 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:39:11.662888 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:39:11.662888 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 633/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:39:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:11.668239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405570a-a525-4336-8053-886e9df94ab5 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:11.764360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405570a-a525-4336-8053-886e9df94ab5 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:11.797096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13971b0e-7761-4138-b7aa-f2ab38671754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:11.797720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971b0e-7761-4138-b7aa-f2ab38671754 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:11.797999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971b0e-7761-4138-b7aa-f2ab38671754 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:11.798272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971b0e-7761-4138-b7aa-f2ab38671754 None admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:11.798990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13971b0e-7761-4138-b7aa-f2ab38671754 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:11.799296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13971b0e-7761-4138-b7aa-f2ab38671754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:11.800709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13971b0e-7761-4138-b7aa-f2ab38671754 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:11.809753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:11.818748 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 635/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Oct 8 20:39:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:11.824580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a7fb0-dc61-4c5f-9965-66f8dad79505 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:11.920891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a7fb0-dc61-4c5f-9965-66f8dad79505 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:11.953293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe409e-c7c8-457c-99e5-be02557088ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:11.953899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe409e-c7c8-457c-99e5-be02557088ea None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:11.954177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe409e-c7c8-457c-99e5-be02557088ea None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:11.954448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe409e-c7c8-457c-99e5-be02557088ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:11.964968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe409e-c7c8-457c-99e5-be02557088ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:11.966427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe409e-c7c8-457c-99e5-be02557088ea None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-e7fe409e-c7c8-457c-99e5-be02557088ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:39:11.980631 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:11.981800 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:39:11.982911 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:39:11.982911 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:11.982911 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:39:11.982911 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 634/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:11.987428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13971b0e-7761-4138-b7aa-f2ab38671754 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:12.081773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13971b0e-7761-4138-b7aa-f2ab38671754 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:12.114468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab911-8551-4041-bca0-b114f0957adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:12.115051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab911-8551-4041-bca0-b114f0957adc None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:12.115326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab911-8551-4041-bca0-b114f0957adc None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:12.115859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab911-8551-4041-bca0-b114f0957adc None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:12.116481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ab911-8551-4041-bca0-b114f0957adc None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:12.116778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ab911-8551-4041-bca0-b114f0957adc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:12.118134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ab911-8551-4041-bca0-b114f0957adc None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:12.128761 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 636/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:12.134190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe409e-c7c8-457c-99e5-be02557088ea None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:12.169219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:12.239607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe409e-c7c8-457c-99e5-be02557088ea None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:12.271278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a39bd-59f6-4e77-9a7a-4885e2ac2f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:12.271888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a39bd-59f6-4e77-9a7a-4885e2ac2f44 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:12.272162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a39bd-59f6-4e77-9a7a-4885e2ac2f44 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:12.272428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a39bd-59f6-4e77-9a7a-4885e2ac2f44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:12.279250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a39bd-59f6-4e77-9a7a-4885e2ac2f44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:12.280659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a39bd-59f6-4e77-9a7a-4885e2ac2f44 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-759a39bd-59f6-4e77-9a7a-4885e2ac2f44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:39:12.292055 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:12.293102 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:12.294234 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:39:12.294234 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:39:12.294234 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:39:12.294234 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:39:12.294234 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:39:12.294234 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:39:12.294234 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:39:12.294234 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:39:12.294234 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 635/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:39:12.299117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab911-8551-4041-bca0-b114f0957adc None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:12.357265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:12.397771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab911-8551-4041-bca0-b114f0957adc None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:12.430491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3c55d-b9c6-4247-9902-b0aa1728dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:12.431085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3c55d-b9c6-4247-9902-b0aa1728dab4 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:12.431361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3c55d-b9c6-4247-9902-b0aa1728dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:12.431628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3c55d-b9c6-4247-9902-b0aa1728dab4 None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:12.432375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3c55d-b9c6-4247-9902-b0aa1728dab4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:12.432668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3c55d-b9c6-4247-9902-b0aa1728dab4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:12.434097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3c55d-b9c6-4247-9902-b0aa1728dab4 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:12.445514 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 637/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:39:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:12.451944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a39bd-59f6-4e77-9a7a-4885e2ac2f44 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:12.541128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:12.550366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a39bd-59f6-4e77-9a7a-4885e2ac2f44 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:12.582509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af1861-e3ef-47fd-b4fd-14689f9b2e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:12.583171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af1861-e3ef-47fd-b4fd-14689f9b2e05 None admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:12.583446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af1861-e3ef-47fd-b4fd-14689f9b2e05 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:12.583720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af1861-e3ef-47fd-b4fd-14689f9b2e05 None admin] PATH_INFO: `/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/2dc47f2448a042fca1a986695a350c94/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:12.585567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af1861-e3ef-47fd-b4fd-14689f9b2e05 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba1e9ad05694bbe8723c14f5e2b08f7, user_id=2dc47f2448a042fca1a986695a350c94, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:12.586976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af1861-e3ef-47fd-b4fd-14689f9b2e05 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:12.599457 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 636/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Oct 8 20:39:12 2022] PUT /identity/v3/projects/1ba1e9ad05694bbe8723c14f5e2b08f7/users/2dc47f2448a042fca1a986695a350c94/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:39:14.924762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3d98-454e-49d7-9d95-237a6201b6b0 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:14.925330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3d98-454e-49d7-9d95-237a6201b6b0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:14.925330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3d98-454e-49d7-9d95-237a6201b6b0 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:14.926581 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 638/1274] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:14.931576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72f4a2-ba6b-43c5-981f-70b4974a6f14 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:14.932010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72f4a2-ba6b-43c5-981f-70b4974a6f14 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:14.932104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72f4a2-ba6b-43c5-981f-70b4974a6f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:14.950449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2e72f4a2-ba6b-43c5-981f-70b4974a6f14 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:14.951619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2e72f4a2-ba6b-43c5-981f-70b4974a6f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:15.015863 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 637/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:39:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:39:15.343437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee3d98-454e-49d7-9d95-237a6201b6b0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:15.441743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee3d98-454e-49d7-9d95-237a6201b6b0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:15.458015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:15.474195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e1269-c6e9-4f32-a2d5-c2914b83d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:15.474814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e1269-c6e9-4f32-a2d5-c2914b83d71a None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:15.475087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e1269-c6e9-4f32-a2d5-c2914b83d71a None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:15.475352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e1269-c6e9-4f32-a2d5-c2914b83d71a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:15.485829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e1269-c6e9-4f32-a2d5-c2914b83d71a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-097e1269-c6e9-4f32-a2d5-c2914b83d71a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:39:15.490787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:15.491901 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:15.493151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:15.493151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:15.493151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:15.493151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:15.493151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:39:15.493151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:39:15.493151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:39:15.493151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:39:15.493151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:39:15.493151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:39:15.493151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:39:15.493151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:15.493151 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 639/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Oct 8 20:39:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:15.498413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72f4a2-ba6b-43c5-981f-70b4974a6f14 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:15.575593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:15.593667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72f4a2-ba6b-43c5-981f-70b4974a6f14 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:15.626556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4b7b7-b357-463a-97a1-a65c16c35585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:15.627147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4b7b7-b357-463a-97a1-a65c16c35585 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:15.627425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4b7b7-b357-463a-97a1-a65c16c35585 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:15.627696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4b7b7-b357-463a-97a1-a65c16c35585 None admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:15.628349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4b7b7-b357-463a-97a1-a65c16c35585 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:15.628649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4b7b7-b357-463a-97a1-a65c16c35585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:15.630025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4b7b7-b357-463a-97a1-a65c16c35585 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:15.637709 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 638/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Oct 8 20:39:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:15.643414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e1269-c6e9-4f32-a2d5-c2914b83d71a None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:15.739238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e1269-c6e9-4f32-a2d5-c2914b83d71a None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:15.774732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f8adf-d50e-4a77-a35c-eb4ae6dbabd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:15.775857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f8adf-d50e-4a77-a35c-eb4ae6dbabd6 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:15.776131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f8adf-d50e-4a77-a35c-eb4ae6dbabd6 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:15.776397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f8adf-d50e-4a77-a35c-eb4ae6dbabd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:15.786047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f8adf-d50e-4a77-a35c-eb4ae6dbabd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:15.787465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f8adf-d50e-4a77-a35c-eb4ae6dbabd6 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-1f2f8adf-d50e-4a77-a35c-eb4ae6dbabd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:39:15.801967 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:15.803068 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:39:15.803972 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:39:15.803972 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:15.803972 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:15.803972 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 640/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:39:15.809296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4b7b7-b357-463a-97a1-a65c16c35585 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:15.905808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4b7b7-b357-463a-97a1-a65c16c35585 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:15.937986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86820751-8bb7-4cae-817c-96e6843d8d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:15.938575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820751-8bb7-4cae-817c-96e6843d8d0f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:15.938856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820751-8bb7-4cae-817c-96e6843d8d0f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:15.939126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820751-8bb7-4cae-817c-96e6843d8d0f None admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:15.939757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86820751-8bb7-4cae-817c-96e6843d8d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:15.940058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86820751-8bb7-4cae-817c-96e6843d8d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:15.941440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86820751-8bb7-4cae-817c-96e6843d8d0f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:15.952724 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 639/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:15.958225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f8adf-d50e-4a77-a35c-eb4ae6dbabd6 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:15.988569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:16.056117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f8adf-d50e-4a77-a35c-eb4ae6dbabd6 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:16.087944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6196ccb-e4e5-4aa8-92b0-5672e5dbb037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:16.088547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6196ccb-e4e5-4aa8-92b0-5672e5dbb037 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:16.088816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6196ccb-e4e5-4aa8-92b0-5672e5dbb037 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:16.089083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6196ccb-e4e5-4aa8-92b0-5672e5dbb037 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:16.096241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6196ccb-e4e5-4aa8-92b0-5672e5dbb037 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:16.097684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6196ccb-e4e5-4aa8-92b0-5672e5dbb037 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-c6196ccb-e4e5-4aa8-92b0-5672e5dbb037 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:39:16.108988 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:16.110124 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:16.111363 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:16.111363 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:16.111363 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:39:16.111363 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:39:16.111363 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:39:16.111363 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:39:16.111363 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:39:16.111363 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:39:16.111363 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:39:16.111363 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:16.111363 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 641/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:39:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:16.115968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86820751-8bb7-4cae-817c-96e6843d8d0f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:16.119716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:16.212313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86820751-8bb7-4cae-817c-96e6843d8d0f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:16.244565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc354641-bbc5-4d85-a266-cda0e82eba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:16.245155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354641-bbc5-4d85-a266-cda0e82eba90 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:16.245454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354641-bbc5-4d85-a266-cda0e82eba90 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:16.245719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354641-bbc5-4d85-a266-cda0e82eba90 None admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:16.246431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc354641-bbc5-4d85-a266-cda0e82eba90 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:16.246730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc354641-bbc5-4d85-a266-cda0e82eba90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:16.248123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc354641-bbc5-4d85-a266-cda0e82eba90 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:16.264608 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 640/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Oct 8 20:39:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:16.270286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6196ccb-e4e5-4aa8-92b0-5672e5dbb037 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:16.357976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:16.368001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6196ccb-e4e5-4aa8-92b0-5672e5dbb037 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:16.400940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ba111-b23a-42bb-8baf-5d5cad342131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:16.401557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ba111-b23a-42bb-8baf-5d5cad342131 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:16.401839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ba111-b23a-42bb-8baf-5d5cad342131 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:16.402112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ba111-b23a-42bb-8baf-5d5cad342131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:16.466900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ba111-b23a-42bb-8baf-5d5cad342131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:16.468267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ba111-b23a-42bb-8baf-5d5cad342131 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:16.553277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:16.563987 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 642/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Oct 8 20:39:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 08 20:39:16.569737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc354641-bbc5-4d85-a266-cda0e82eba90 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:16.628386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:16.665446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc354641-bbc5-4d85-a266-cda0e82eba90 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:16.698288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bfb88-335d-4cb6-956e-1df16b0d7f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:16.698897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bfb88-335d-4cb6-956e-1df16b0d7f59 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:16.699188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bfb88-335d-4cb6-956e-1df16b0d7f59 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:16.699437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bfb88-335d-4cb6-956e-1df16b0d7f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:16.708953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bfb88-335d-4cb6-956e-1df16b0d7f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:16.710408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bfb88-335d-4cb6-956e-1df16b0d7f59 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-729bfb88-335d-4cb6-956e-1df16b0d7f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:39:16.724319 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:16.725451 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:39:16.726360 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:39:16.726360 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:39:16.726360 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:39:16.726360 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 641/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:16.731064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ba111-b23a-42bb-8baf-5d5cad342131 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:16.827922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ba111-b23a-42bb-8baf-5d5cad342131 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:16.860579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454c147-bf13-4f38-9f8e-89a20ab775dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:16.861173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454c147-bf13-4f38-9f8e-89a20ab775dc None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:16.861481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454c147-bf13-4f38-9f8e-89a20ab775dc None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:16.861753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454c147-bf13-4f38-9f8e-89a20ab775dc None admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:16.862383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454c147-bf13-4f38-9f8e-89a20ab775dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:16.862686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454c147-bf13-4f38-9f8e-89a20ab775dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:16.864036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454c147-bf13-4f38-9f8e-89a20ab775dc None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:16.875638 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 643/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Oct 8 20:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:16.881258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bfb88-335d-4cb6-956e-1df16b0d7f59 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:16.977251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bfb88-335d-4cb6-956e-1df16b0d7f59 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:16.989851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:17.009049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461ea8-a6cb-47e3-aa35-302baa846c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:17.010210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461ea8-a6cb-47e3-aa35-302baa846c5f None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:17.010485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461ea8-a6cb-47e3-aa35-302baa846c5f None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:17.010751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461ea8-a6cb-47e3-aa35-302baa846c5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:17.016998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0461ea8-a6cb-47e3-aa35-302baa846c5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:17.018455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0461ea8-a6cb-47e3-aa35-302baa846c5f None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-b0461ea8-a6cb-47e3-aa35-302baa846c5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:39:17.029742 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:17.030725 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:17.031657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:39:17.031657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:39:17.031657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:39:17.031657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:39:17.031657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:39:17.031657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:39:17.031657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:39:17.031657 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 20:39:17.031657 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 642/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Oct 8 20:39:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:17.036532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454c147-bf13-4f38-9f8e-89a20ab775dc None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:17.084031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:17.132123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454c147-bf13-4f38-9f8e-89a20ab775dc None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:17.167671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624482f-8be3-42b7-bfae-b2fe4f464a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:17.168268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624482f-8be3-42b7-bfae-b2fe4f464a04 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:17.168544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624482f-8be3-42b7-bfae-b2fe4f464a04 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:17.168812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624482f-8be3-42b7-bfae-b2fe4f464a04 None admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:17.169520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624482f-8be3-42b7-bfae-b2fe4f464a04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:17.169820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624482f-8be3-42b7-bfae-b2fe4f464a04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:17.171219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624482f-8be3-42b7-bfae-b2fe4f464a04 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:17.182739 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 644/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Oct 8 20:39:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:17.188682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461ea8-a6cb-47e3-aa35-302baa846c5f None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:17.283988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461ea8-a6cb-47e3-aa35-302baa846c5f None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:17.315798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba73fa-fb1a-4df2-a94f-1659c4cbc656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:17.316377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba73fa-fb1a-4df2-a94f-1659c4cbc656 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:17.316650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba73fa-fb1a-4df2-a94f-1659c4cbc656 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:17.316916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba73fa-fb1a-4df2-a94f-1659c4cbc656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:17.317653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba73fa-fb1a-4df2-a94f-1659c4cbc656 None admin] RBAC: Adding query filter params (role.id=a409f81bd5744563a303a825783bed61, scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7, user.id=2dc47f2448a042fca1a986695a350c94) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:17.317954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba73fa-fb1a-4df2-a94f-1659c4cbc656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:17.319351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba73fa-fb1a-4df2-a94f-1659c4cbc656 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:17.325436 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 643/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Oct 8 20:39:17 2022] GET /identity/v3/role_assignments?user.id=2dc47f2448a042fca1a986695a350c94&scope.project.id=1ba1e9ad05694bbe8723c14f5e2b08f7&role.id=a409f81bd5744563a303a825783bed61 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:19.739729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43cac8-01b5-4370-be3a-10aee93ad1bc None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:19.740512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43cac8-01b5-4370-be3a-10aee93ad1bc None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:19.740512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43cac8-01b5-4370-be3a-10aee93ad1bc None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:19.741801 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 645/1288] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:19.747154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e298f-d3f8-4016-b653-9cb00dd36c8e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:19.747577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e298f-d3f8-4016-b653-9cb00dd36c8e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:19.747690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e298f-d3f8-4016-b653-9cb00dd36c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:19.765454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-732e298f-d3f8-4016-b653-9cb00dd36c8e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:19.766635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-732e298f-d3f8-4016-b653-9cb00dd36c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:19.799151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:19.835802 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 644/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:39:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:39:20.163857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43cac8-01b5-4370-be3a-10aee93ad1bc None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:20.275369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43cac8-01b5-4370-be3a-10aee93ad1bc None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:20.285588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:20.308612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d786d-107d-4c1b-80cc-91bbc0ab4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:20.309252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d786d-107d-4c1b-80cc-91bbc0ab4945 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:20.309533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d786d-107d-4c1b-80cc-91bbc0ab4945 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:20.309805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d786d-107d-4c1b-80cc-91bbc0ab4945 None admin] PATH_INFO: `/v3/services/placement` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:20.310376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d786d-107d-4c1b-80cc-91bbc0ab4945 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:20.311753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d786d-107d-4c1b-80cc-91bbc0ab4945 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-878d786d-107d-4c1b-80cc-91bbc0ab4945 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:20.320295 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:20.322096 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:20.323317 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 646/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Oct 8 20:39:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:20.327979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e298f-d3f8-4016-b653-9cb00dd36c8e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:20.422258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e298f-d3f8-4016-b653-9cb00dd36c8e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:20.456502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b9692-1287-40a1-82c8-ef0eba71935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:20.457025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b9692-1287-40a1-82c8-ef0eba71935a None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:20.457337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b9692-1287-40a1-82c8-ef0eba71935a None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:20.457608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b9692-1287-40a1-82c8-ef0eba71935a None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:20.458235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b9692-1287-40a1-82c8-ef0eba71935a None admin] RBAC: Adding query filter params (name=placement) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:20.458539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b9692-1287-40a1-82c8-ef0eba71935a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:20.459892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b9692-1287-40a1-82c8-ef0eba71935a None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:20.464688 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 645/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Oct 8 20:39:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:20.470393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d786d-107d-4c1b-80cc-91bbc0ab4945 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:20.567421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d786d-107d-4c1b-80cc-91bbc0ab4945 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:20.599483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ed4aa-328e-42ec-9ded-3471c7bc3eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:20.600069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ed4aa-328e-42ec-9ded-3471c7bc3eb2 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:20.600342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ed4aa-328e-42ec-9ded-3471c7bc3eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:20.600609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ed4aa-328e-42ec-9ded-3471c7bc3eb2 None admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:20.601333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ed4aa-328e-42ec-9ded-3471c7bc3eb2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:20.601638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ed4aa-328e-42ec-9ded-3471c7bc3eb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:20.603485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ed4aa-328e-42ec-9ded-3471c7bc3eb2 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:20.607698 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 647/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Oct 8 20:39:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:22.943932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e24ba-0939-47fe-9f71-d5232dc1ae25 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:22.944434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e24ba-0939-47fe-9f71-d5232dc1ae25 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:22.944434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e24ba-0939-47fe-9f71-d5232dc1ae25 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:22.945760 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 646/1293] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:22.950975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386e0e-ddd8-4024-b088-a9f5c3e8d83a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:22.951394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386e0e-ddd8-4024-b088-a9f5c3e8d83a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:22.951525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386e0e-ddd8-4024-b088-a9f5c3e8d83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:22.969417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-52386e0e-ddd8-4024-b088-a9f5c3e8d83a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:22.970591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-52386e0e-ddd8-4024-b088-a9f5c3e8d83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:23.000030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:23.035310 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 648/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:39:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:39:23.359412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e24ba-0939-47fe-9f71-d5232dc1ae25 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:23.389228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:23.457404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e24ba-0939-47fe-9f71-d5232dc1ae25 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:23.494626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295f581-2c47-4bfb-91d0-ddc188fbe732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:23.495219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295f581-2c47-4bfb-91d0-ddc188fbe732 None admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:23.495492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295f581-2c47-4bfb-91d0-ddc188fbe732 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:23.495757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295f581-2c47-4bfb-91d0-ddc188fbe732 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:23.496396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295f581-2c47-4bfb-91d0-ddc188fbe732 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:23.497774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295f581-2c47-4bfb-91d0-ddc188fbe732 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:23.511667 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 647/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Oct 8 20:39:23 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:39:25.876823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e131a-3a6f-42fa-a1ac-f0ca2cca8c68 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:25.877397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e131a-3a6f-42fa-a1ac-f0ca2cca8c68 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:25.877397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e131a-3a6f-42fa-a1ac-f0ca2cca8c68 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:25.878643 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 649/1296] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:25.883679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e8370-f20d-4b5d-a08a-d8fc086cbe70 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:25.884103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e8370-f20d-4b5d-a08a-d8fc086cbe70 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:25.884229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e8370-f20d-4b5d-a08a-d8fc086cbe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:25.901949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-af8e8370-f20d-4b5d-a08a-d8fc086cbe70 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:25.903129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-af8e8370-f20d-4b5d-a08a-d8fc086cbe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:25.973898 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 648/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:39:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:39:26.297983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e131a-3a6f-42fa-a1ac-f0ca2cca8c68 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:26.398017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e131a-3a6f-42fa-a1ac-f0ca2cca8c68 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:26.432254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fd802-5bf4-405b-9c08-ed0fc6aa724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:26.432884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd802-5bf4-405b-9c08-ed0fc6aa724e None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:26.433161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd802-5bf4-405b-9c08-ed0fc6aa724e None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:26.433459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd802-5bf4-405b-9c08-ed0fc6aa724e None admin] PATH_INFO: `/v3/services/placement` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:26.434034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fd802-5bf4-405b-9c08-ed0fc6aa724e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:26.435382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fd802-5bf4-405b-9c08-ed0fc6aa724e None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-cd7fd802-5bf4-405b-9c08-ed0fc6aa724e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:26.444023 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:26.445225 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:26.446134 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 650/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Oct 8 20:39:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:26.451349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e8370-f20d-4b5d-a08a-d8fc086cbe70 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:26.469946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:26.553916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e8370-f20d-4b5d-a08a-d8fc086cbe70 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:26.587189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d268b0-56c4-4ce2-97a2-917e7c9a4031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:26.587789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d268b0-56c4-4ce2-97a2-917e7c9a4031 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:26.588070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d268b0-56c4-4ce2-97a2-917e7c9a4031 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:26.588340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d268b0-56c4-4ce2-97a2-917e7c9a4031 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:26.588962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d268b0-56c4-4ce2-97a2-917e7c9a4031 None admin] RBAC: Adding query filter params (name=placement) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:26.589364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d268b0-56c4-4ce2-97a2-917e7c9a4031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:26.590718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d268b0-56c4-4ce2-97a2-917e7c9a4031 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:26.595698 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 649/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Oct 8 20:39:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:26.601853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fd802-5bf4-405b-9c08-ed0fc6aa724e None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:26.633042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:26.699556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fd802-5bf4-405b-9c08-ed0fc6aa724e None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:26.732322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f59ddc-c9d8-4a3c-af3a-ae17b9c33978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:26.732910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f59ddc-c9d8-4a3c-af3a-ae17b9c33978 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:26.733213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f59ddc-c9d8-4a3c-af3a-ae17b9c33978 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:26.733486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f59ddc-c9d8-4a3c-af3a-ae17b9c33978 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:26.734177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f59ddc-c9d8-4a3c-af3a-ae17b9c33978 None admin] RBAC: Adding query filter params (interface=public, service_id=bcf23d6613124898a8e24dad9d277fb3, region_id=RegionOne) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:26.734483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f59ddc-c9d8-4a3c-af3a-ae17b9c33978 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:26.735823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f59ddc-c9d8-4a3c-af3a-ae17b9c33978 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:26.740904 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 651/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Oct 8 20:39:26 2022] GET /identity/v3/endpoints?service_id=bcf23d6613124898a8e24dad9d277fb3&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:26.746682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d268b0-56c4-4ce2-97a2-917e7c9a4031 None admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:26.825675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:26.843784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d268b0-56c4-4ce2-97a2-917e7c9a4031 None admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:26.876536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ee15a-00e6-476f-829d-f2654c9b3088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:26.877121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee15a-00e6-476f-829d-f2654c9b3088 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:26.877430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee15a-00e6-476f-829d-f2654c9b3088 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:26.877699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee15a-00e6-476f-829d-f2654c9b3088 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:26.878291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ee15a-00e6-476f-829d-f2654c9b3088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:26.879638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ee15a-00e6-476f-829d-f2654c9b3088 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:26.886692 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 650/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Oct 8 20:39:26 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:39:29.241796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe303c4-77e9-4f69-af71-650d62a0c2c5 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:29.242348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe303c4-77e9-4f69-af71-650d62a0c2c5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:29.242348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe303c4-77e9-4f69-af71-650d62a0c2c5 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:29.244151 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 652/1302] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:29.249178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c67927-5114-4ab3-bed1-f016008fd382 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:29.249559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c67927-5114-4ab3-bed1-f016008fd382 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:29.249762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c67927-5114-4ab3-bed1-f016008fd382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:29.267929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-87c67927-5114-4ab3-bed1-f016008fd382 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:29.269096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-87c67927-5114-4ab3-bed1-f016008fd382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:29.332678 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 651/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:39:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:39:29.655701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe303c4-77e9-4f69-af71-650d62a0c2c5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:29.747769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:29.754773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe303c4-77e9-4f69-af71-650d62a0c2c5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:29.786713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb7187-7449-4d80-9511-7c64f83ec245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:29.787324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb7187-7449-4d80-9511-7c64f83ec245 None admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:29.787602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb7187-7449-4d80-9511-7c64f83ec245 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:29.787872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb7187-7449-4d80-9511-7c64f83ec245 None admin] PATH_INFO: `/v3/services/placement` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:29.788442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb7187-7449-4d80-9511-7c64f83ec245 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:29.790345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb7187-7449-4d80-9511-7c64f83ec245 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-6cfb7187-7449-4d80-9511-7c64f83ec245 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:39:29.798854 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:39:29.800005 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 20:39:29.801076 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 653/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Oct 8 20:39:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:39:29.806479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c67927-5114-4ab3-bed1-f016008fd382 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:29.879524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:29.901675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c67927-5114-4ab3-bed1-f016008fd382 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:29.934539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4514a-c478-41a0-98fe-3fa80eb0b870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:29.935074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4514a-c478-41a0-98fe-3fa80eb0b870 None admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:29.935352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4514a-c478-41a0-98fe-3fa80eb0b870 None admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:29.935631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4514a-c478-41a0-98fe-3fa80eb0b870 None admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:29.936254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4514a-c478-41a0-98fe-3fa80eb0b870 None admin] RBAC: Adding query filter params (name=placement) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:39:29.936585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4514a-c478-41a0-98fe-3fa80eb0b870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:29.937938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4514a-c478-41a0-98fe-3fa80eb0b870 None admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:29.942856 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 652/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Oct 8 20:39:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:39:29.948640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb7187-7449-4d80-9511-7c64f83ec245 None admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:30.047209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb7187-7449-4d80-9511-7c64f83ec245 None admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:30.078334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a3298-01ae-4ff7-a815-84100753b148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:30.078918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a3298-01ae-4ff7-a815-84100753b148 None admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:30.079191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a3298-01ae-4ff7-a815-84100753b148 None admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:30.079457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a3298-01ae-4ff7-a815-84100753b148 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:30.080115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a3298-01ae-4ff7-a815-84100753b148 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:30.081468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a3298-01ae-4ff7-a815-84100753b148 None admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:30.100401 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 654/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:39:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:39:39.940227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=30 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:40.096072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:42.219206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddaba9-08aa-4084-8790-bde029bd698f None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:42.219694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddaba9-08aa-4084-8790-bde029bd698f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:42.219776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddaba9-08aa-4084-8790-bde029bd698f None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:42.224932 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 653/1307] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:40:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:40:42.226359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2618797-6ef0-4600-8708-1dae00b0b83f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:42.226761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2618797-6ef0-4600-8708-1dae00b0b83f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:42.226929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2618797-6ef0-4600-8708-1dae00b0b83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:42.351729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e2618797-6ef0-4600-8708-1dae00b0b83f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:42.353405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e2618797-6ef0-4600-8708-1dae00b0b83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:42.484581 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 655/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:42.860735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f9c0-e8e9-4951-8601-44bec40dc963 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:42.861654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f9c0-e8e9-4951-8601-44bec40dc963 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:42.862156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f9c0-e8e9-4951-8601-44bec40dc963 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:42.864202 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 654/1309] 10.222.0.26 () {54 vars in 964 bytes} [Sat Oct 8 20:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:40:42.870677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a645e0-d053-4cac-b5b8-5b1eca54e39c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:42.871334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a645e0-d053-4cac-b5b8-5b1eca54e39c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:42.871771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a645e0-d053-4cac-b5b8-5b1eca54e39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:42.958325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-00a645e0-d053-4cac-b5b8-5b1eca54e39c None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:42.959571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-00a645e0-d053-4cac-b5b8-5b1eca54e39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:42.981054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:43.045482 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 656/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Sat Oct 8 20:40:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:43.055658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48f9c0-e8e9-4951-8601-44bec40dc963 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:40:43.057420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7c48f9c0-e8e9-4951-8601-44bec40dc963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:43.183173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48f9c0-e8e9-4951-8601-44bec40dc963 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:40:43.269512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33196eb-ee9c-4633-bb71-5bd90e0e0b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:40:43.271429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33196eb-ee9c-4633-bb71-5bd90e0e0b8f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:43.271863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33196eb-ee9c-4633-bb71-5bd90e0e0b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:43.272504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33196eb-ee9c-4633-bb71-5bd90e0e0b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:43.274419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d33196eb-ee9c-4633-bb71-5bd90e0e0b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:43.340692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:43.404528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33196eb-ee9c-4633-bb71-5bd90e0e0b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:40:43.406146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33196eb-ee9c-4633-bb71-5bd90e0e0b8f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:40:43.427385 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 655/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:40:46.224803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8365c-e856-4123-8c2a-122cb5cbd478 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:46.225363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8365c-e856-4123-8c2a-122cb5cbd478 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:46.225363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8365c-e856-4123-8c2a-122cb5cbd478 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:46.226869 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 657/1312] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:40:46.231808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b28f9-338a-44eb-8b52-a0e2c02e97af None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:46.232205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b28f9-338a-44eb-8b52-a0e2c02e97af None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:46.232351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b28f9-338a-44eb-8b52-a0e2c02e97af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:46.303079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-913b28f9-338a-44eb-8b52-a0e2c02e97af None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:46.304273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-913b28f9-338a-44eb-8b52-a0e2c02e97af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:46.405018 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 656/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:46.747179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8365c-e856-4123-8c2a-122cb5cbd478 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:40:46.748801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-26a8365c-e856-4123-8c2a-122cb5cbd478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:46.851996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8365c-e856-4123-8c2a-122cb5cbd478 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:40:46.924584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:46.927962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f9f62-ca83-4b6a-8a91-23f54efb3d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:40:46.928752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f9f62-ca83-4b6a-8a91-23f54efb3d9b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:46.929071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f9f62-ca83-4b6a-8a91-23f54efb3d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:46.929560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f9f62-ca83-4b6a-8a91-23f54efb3d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:46.931422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-210f9f62-ca83-4b6a-8a91-23f54efb3d9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:47.040218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f9f62-ca83-4b6a-8a91-23f54efb3d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:40:47.041591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f9f62-ca83-4b6a-8a91-23f54efb3d9b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:40:47.059934 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 658/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:40:49.787361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3c34-4790-412e-86f1-e395e818413f None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:49.787880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3c34-4790-412e-86f1-e395e818413f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:49.787880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3c34-4790-412e-86f1-e395e818413f None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:49.789167 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 657/1315] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:40:49.794432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2e6a-1a27-4656-a63a-012342d3333c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:49.794850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2e6a-1a27-4656-a63a-012342d3333c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:49.794982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2e6a-1a27-4656-a63a-012342d3333c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:49.859638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7fad2e6a-1a27-4656-a63a-012342d3333c None None] MFA Rules not processed for user `a6d309261b4e4134aae2ca007b31a433`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:49.861128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7fad2e6a-1a27-4656-a63a-012342d3333c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:49.912109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:49.955753 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 659/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:40:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:50.299145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef3c34-4790-412e-86f1-e395e818413f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:40:50.301227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e1ef3c34-4790-412e-86f1-e395e818413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:50.311753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:50.403626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef3c34-4790-412e-86f1-e395e818413f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:40:50.475749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ce4f-d8fa-47b3-bcf9-3f57e950a045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:40:50.476350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ce4f-d8fa-47b3-bcf9-3f57e950a045 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:50.476637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ce4f-d8fa-47b3-bcf9-3f57e950a045 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:50.476910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ce4f-d8fa-47b3-bcf9-3f57e950a045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:50.478560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-59d7ce4f-d8fa-47b3-bcf9-3f57e950a045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:50.540024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:50.586399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7ce4f-d8fa-47b3-bcf9-3f57e950a045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:40:50.587772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7ce4f-d8fa-47b3-bcf9-3f57e950a045 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:40:50.605713 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 658/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:40:50 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:40:53.519735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191fe60-d658-4434-8aeb-67a05fdf762f None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:53.520235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191fe60-d658-4434-8aeb-67a05fdf762f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:53.520324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191fe60-d658-4434-8aeb-67a05fdf762f None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:53.521668 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 660/1318] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:40:53.526753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622fdd8-9e0f-4f07-b7c0-c37fe15a0527 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:53.527181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622fdd8-9e0f-4f07-b7c0-c37fe15a0527 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:53.527309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622fdd8-9e0f-4f07-b7c0-c37fe15a0527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:53.593202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9622fdd8-9e0f-4f07-b7c0-c37fe15a0527 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:53.594407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9622fdd8-9e0f-4f07-b7c0-c37fe15a0527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:53.688254 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 659/1319] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:40:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:54.026435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191fe60-d658-4434-8aeb-67a05fdf762f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:40:54.027989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a191fe60-d658-4434-8aeb-67a05fdf762f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:54.131258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191fe60-d658-4434-8aeb-67a05fdf762f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:40:54.208203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f679ce9-0a0b-45f6-b628-a4b0def00570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:40:54.208801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f679ce9-0a0b-45f6-b628-a4b0def00570 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:54.209080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f679ce9-0a0b-45f6-b628-a4b0def00570 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:54.209381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f679ce9-0a0b-45f6-b628-a4b0def00570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:54.210958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6f679ce9-0a0b-45f6-b628-a4b0def00570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:54.217743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:54.319192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f679ce9-0a0b-45f6-b628-a4b0def00570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:40:54.320513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f679ce9-0a0b-45f6-b628-a4b0def00570 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:40:54.338474 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 661/1320] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:40:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:40:57.366982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79b080-a5b8-4ce6-a679-98cb92242bc9 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:57.367553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79b080-a5b8-4ce6-a679-98cb92242bc9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:57.367553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79b080-a5b8-4ce6-a679-98cb92242bc9 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:57.368863 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 660/1321] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:40:57.374246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc305c4-25a8-44a4-a4c9-615b8b74b85d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:57.374634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc305c4-25a8-44a4-a4c9-615b8b74b85d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:57.374797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc305c4-25a8-44a4-a4c9-615b8b74b85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:57.439368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ecc305c4-25a8-44a4-a4c9-615b8b74b85d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:57.440563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ecc305c4-25a8-44a4-a4c9-615b8b74b85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:57.498404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:57.538338 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 662/1322] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:57.880584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79b080-a5b8-4ce6-a679-98cb92242bc9 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:40:57.882349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bf79b080-a5b8-4ce6-a679-98cb92242bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:57.902812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:57.987763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79b080-a5b8-4ce6-a679-98cb92242bc9 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:40:58.062690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d735dbd-a0a3-4d7c-aa0b-1c8148b88b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:40:58.063291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d735dbd-a0a3-4d7c-aa0b-1c8148b88b23 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:58.063568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d735dbd-a0a3-4d7c-aa0b-1c8148b88b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:58.063839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d735dbd-a0a3-4d7c-aa0b-1c8148b88b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:58.066182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9d735dbd-a0a3-4d7c-aa0b-1c8148b88b23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:58.140137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:58.184679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d735dbd-a0a3-4d7c-aa0b-1c8148b88b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:40:58.186139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d735dbd-a0a3-4d7c-aa0b-1c8148b88b23 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:40:58.208996 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 661/1323] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:41:00.691363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00110bc8-ebac-42b2-a15c-ffda46a1c968 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:00.691923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00110bc8-ebac-42b2-a15c-ffda46a1c968 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:00.691923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00110bc8-ebac-42b2-a15c-ffda46a1c968 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:00.693419 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 663/1324] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:00.698540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8edd07-edde-446d-8468-1d5c61d9333d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:00.698964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8edd07-edde-446d-8468-1d5c61d9333d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:00.699078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8edd07-edde-446d-8468-1d5c61d9333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:00.763233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6d8edd07-edde-446d-8468-1d5c61d9333d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:00.764325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6d8edd07-edde-446d-8468-1d5c61d9333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:00.857281 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 662/1325] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:01.200931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00110bc8-ebac-42b2-a15c-ffda46a1c968 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:41:01.202582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-00110bc8-ebac-42b2-a15c-ffda46a1c968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:01.305726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00110bc8-ebac-42b2-a15c-ffda46a1c968 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:41:01.384415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5758da-858b-4b4f-8772-9b11a7491d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:41:01.385017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5758da-858b-4b4f-8772-9b11a7491d46 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:01.385318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5758da-858b-4b4f-8772-9b11a7491d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:01.385584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5758da-858b-4b4f-8772-9b11a7491d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:01.387169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cc5758da-858b-4b4f-8772-9b11a7491d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:01.404356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:01.500402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5758da-858b-4b4f-8772-9b11a7491d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:41:01.501864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5758da-858b-4b4f-8772-9b11a7491d46 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:41:01.521692 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 664/1326] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:41:03.986002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44d094-03aa-4e23-ad0b-8b4bc393ca3d None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:03.986552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44d094-03aa-4e23-ad0b-8b4bc393ca3d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:03.986552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44d094-03aa-4e23-ad0b-8b4bc393ca3d None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:03.988393 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 663/1327] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:41:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:03.993736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efa7c1-4d65-4c74-b1bc-0b018db58236 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:03.994161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efa7c1-4d65-4c74-b1bc-0b018db58236 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:03.994286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efa7c1-4d65-4c74-b1bc-0b018db58236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:04.059721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-22efa7c1-4d65-4c74-b1bc-0b018db58236 None None] MFA Rules not processed for user `a6d309261b4e4134aae2ca007b31a433`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:04.060899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-22efa7c1-4d65-4c74-b1bc-0b018db58236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:04.125617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:04.156885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 665/1328] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:41:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:04.505267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44d094-03aa-4e23-ad0b-8b4bc393ca3d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:41:04.506826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3a44d094-03aa-4e23-ad0b-8b4bc393ca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:04.537579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:04.610774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44d094-03aa-4e23-ad0b-8b4bc393ca3d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:41:04.684429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242b54d-3020-43d1-bded-447e6addf1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:41:04.685024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242b54d-3020-43d1-bded-447e6addf1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:04.685335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242b54d-3020-43d1-bded-447e6addf1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:04.685607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242b54d-3020-43d1-bded-447e6addf1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:04.687177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5242b54d-3020-43d1-bded-447e6addf1b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:04.765555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:04.798406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242b54d-3020-43d1-bded-447e6addf1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:41:04.800495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242b54d-3020-43d1-bded-447e6addf1b4 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:41:04.818431 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 664/1329] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:41:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:41:07.445483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d8b08-b66e-4352-bcd9-d29547f0f802 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:07.446070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d8b08-b66e-4352-bcd9-d29547f0f802 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:07.446175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d8b08-b66e-4352-bcd9-d29547f0f802 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:07.447578 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 666/1330] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:07.452830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749e78e-ad10-4190-9297-0061d97053b8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:07.453273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749e78e-ad10-4190-9297-0061d97053b8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:07.453553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749e78e-ad10-4190-9297-0061d97053b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:07.524445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7749e78e-ad10-4190-9297-0061d97053b8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:07.525686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7749e78e-ad10-4190-9297-0061d97053b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:07.620707 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 665/1331] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:07.958431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d8b08-b66e-4352-bcd9-d29547f0f802 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:41:07.960002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b55d8b08-b66e-4352-bcd9-d29547f0f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:08.062774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d8b08-b66e-4352-bcd9-d29547f0f802 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:41:08.154242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba7d5b-ded0-4781-af08-a06c4040647e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:41:08.154853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba7d5b-ded0-4781-af08-a06c4040647e service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:08.155129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba7d5b-ded0-4781-af08-a06c4040647e service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:08.155396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba7d5b-ded0-4781-af08-a06c4040647e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:08.157022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3cba7d5b-ded0-4781-af08-a06c4040647e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:08.188577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:08.280457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba7d5b-ded0-4781-af08-a06c4040647e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:41:08.282334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba7d5b-ded0-4781-af08-a06c4040647e service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:41:08.301916 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 667/1332] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:41:10.780985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e06d7-91cc-459f-916c-ad639f9c22b7 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:10.781540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e06d7-91cc-459f-916c-ad639f9c22b7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:10.781540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e06d7-91cc-459f-916c-ad639f9c22b7 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:10.782803 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 666/1333] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:10.788068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a291f-b163-4f58-be93-dc1e3607d459 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:10.788518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a291f-b163-4f58-be93-dc1e3607d459 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:10.788626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a291f-b163-4f58-be93-dc1e3607d459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:10.853474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-598a291f-b163-4f58-be93-dc1e3607d459 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:10.854678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-598a291f-b163-4f58-be93-dc1e3607d459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:10.927934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:10.950418 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 668/1334] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:11.294193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e06d7-91cc-459f-916c-ad639f9c22b7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:41:11.295855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-614e06d7-91cc-459f-916c-ad639f9c22b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:11.336837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:11.400185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e06d7-91cc-459f-916c-ad639f9c22b7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:41:11.473123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46d870-7388-4001-a090-8dc7b6e28e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:41:11.473768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46d870-7388-4001-a090-8dc7b6e28e96 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:11.474048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46d870-7388-4001-a090-8dc7b6e28e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:11.474320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46d870-7388-4001-a090-8dc7b6e28e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:11.475919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5e46d870-7388-4001-a090-8dc7b6e28e96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:11.559440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:11.584292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46d870-7388-4001-a090-8dc7b6e28e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:41:11.585757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46d870-7388-4001-a090-8dc7b6e28e96 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:41:11.603631 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 667/1335] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:41:14.284363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0472897-9f2d-4031-802c-979b109bee1c None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:14.284878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0472897-9f2d-4031-802c-979b109bee1c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:14.284878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0472897-9f2d-4031-802c-979b109bee1c None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:14.286307 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 669/1336] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:14.291320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfa20d-0700-4637-872b-a842b6ec325e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:14.291756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfa20d-0700-4637-872b-a842b6ec325e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:14.291889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfa20d-0700-4637-872b-a842b6ec325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:14.355838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b3bfa20d-0700-4637-872b-a842b6ec325e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:14.357013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b3bfa20d-0700-4637-872b-a842b6ec325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:14.451954 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 668/1337] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:41:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:14.790700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0472897-9f2d-4031-802c-979b109bee1c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:41:14.792229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e0472897-9f2d-4031-802c-979b109bee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:14.893295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0472897-9f2d-4031-802c-979b109bee1c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:41:14.965956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1d60a-6dd0-4216-b3f4-a7e44f70166b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:41:14.966541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1d60a-6dd0-4216-b3f4-a7e44f70166b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:14.966818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1d60a-6dd0-4216-b3f4-a7e44f70166b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:14.967084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1d60a-6dd0-4216-b3f4-a7e44f70166b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:14.968638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-12a1d60a-6dd0-4216-b3f4-a7e44f70166b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:15.003390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:15.074479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1d60a-6dd0-4216-b3f4-a7e44f70166b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:41:15.075808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1d60a-6dd0-4216-b3f4-a7e44f70166b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:41:15.093945 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 670/1338] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:41:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:41:19.384749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d70d-664a-4234-a255-29808136a41b None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:19.385451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d70d-664a-4234-a255-29808136a41b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:19.385451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d70d-664a-4234-a255-29808136a41b None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:19.386819 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 669/1339] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:19.392109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74ac61-3507-44c8-af70-cf9f889dff40 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:19.392548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74ac61-3507-44c8-af70-cf9f889dff40 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:19.392735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74ac61-3507-44c8-af70-cf9f889dff40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:19.458640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bf74ac61-3507-44c8-af70-cf9f889dff40 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:19.459853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bf74ac61-3507-44c8-af70-cf9f889dff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:19.550164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:19.561445 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 671/1340] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:19.914794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64dbc-4e32-4e72-b498-3fa49345bf75 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:19.915078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64dbc-4e32-4e72-b498-3fa49345bf75 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:19.915349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64dbc-4e32-4e72-b498-3fa49345bf75 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:19.916692 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 670/1341] 10.222.0.26 () {54 vars in 964 bytes} [Sat Oct 8 20:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:41:19.922830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cd9ad-7b59-4079-9fd6-3e6befd93af6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:19.923124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cd9ad-7b59-4079-9fd6-3e6befd93af6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:19.923401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cd9ad-7b59-4079-9fd6-3e6befd93af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:19.999345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d36cd9ad-7b59-4079-9fd6-3e6befd93af6 None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:20.000551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d36cd9ad-7b59-4079-9fd6-3e6befd93af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:20.076784 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 672/1342] 10.222.0.26 () {58 vars in 1061 bytes} [Sat Oct 8 20:41:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:20.086262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea64dbc-4e32-4e72-b498-3fa49345bf75 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:41:20.087790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3ea64dbc-4e32-4e72-b498-3fa49345bf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:20.136158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:20.191823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea64dbc-4e32-4e72-b498-3fa49345bf75 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:41:20.264113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be1ef4-ebbe-45e6-8ed5-4a6f7d8d7ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:41:20.264712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be1ef4-ebbe-45e6-8ed5-4a6f7d8d7ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:20.264988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be1ef4-ebbe-45e6-8ed5-4a6f7d8d7ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:20.265288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be1ef4-ebbe-45e6-8ed5-4a6f7d8d7ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:20.266863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-02be1ef4-ebbe-45e6-8ed5-4a6f7d8d7ff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:20.361950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:20.379028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be1ef4-ebbe-45e6-8ed5-4a6f7d8d7ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:41:20.380444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be1ef4-ebbe-45e6-8ed5-4a6f7d8d7ff8 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:41:20.398418 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 671/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:41:24.003836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835579ff-af6b-49c8-a22e-4c364d72d3c0 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:24.004403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835579ff-af6b-49c8-a22e-4c364d72d3c0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:24.004403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835579ff-af6b-49c8-a22e-4c364d72d3c0 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:24.005789 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 673/1344] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:24.011011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b3e8-f196-4ade-80dd-21348d7565eb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:24.011407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b3e8-f196-4ade-80dd-21348d7565eb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:24.011549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b3e8-f196-4ade-80dd-21348d7565eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:24.077412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dc64b3e8-f196-4ade-80dd-21348d7565eb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:24.078631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dc64b3e8-f196-4ade-80dd-21348d7565eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:24.178007 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 672/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:41:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:24.525126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835579ff-af6b-49c8-a22e-4c364d72d3c0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:41:24.526735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-835579ff-af6b-49c8-a22e-4c364d72d3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:24.621464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:24.639032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835579ff-af6b-49c8-a22e-4c364d72d3c0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:41:24.715812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bf8d7-271e-48b3-98a2-3d9ed633c529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:41:24.716420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bf8d7-271e-48b3-98a2-3d9ed633c529 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:24.716693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bf8d7-271e-48b3-98a2-3d9ed633c529 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:24.716956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bf8d7-271e-48b3-98a2-3d9ed633c529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:24.718576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-378bf8d7-271e-48b3-98a2-3d9ed633c529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:24.826715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bf8d7-271e-48b3-98a2-3d9ed633c529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:41:24.828132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bf8d7-271e-48b3-98a2-3d9ed633c529 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:41:24.845678 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 674/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:41:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:41:29.464009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256e615-2bf9-4006-9b34-691b84de2482 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:29.464553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256e615-2bf9-4006-9b34-691b84de2482 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:29.464648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256e615-2bf9-4006-9b34-691b84de2482 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:29.466049 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 673/1347] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:29.472226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fa2eb-708b-40d0-bae5-1feac9c10108 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:29.472697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fa2eb-708b-40d0-bae5-1feac9c10108 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:29.472928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fa2eb-708b-40d0-bae5-1feac9c10108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:29.489936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:29.549682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e36fa2eb-708b-40d0-bae5-1feac9c10108 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:29.550910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e36fa2eb-708b-40d0-bae5-1feac9c10108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:29.652386 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 675/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:41:29.992823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256e615-2bf9-4006-9b34-691b84de2482 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:41:29.994447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2256e615-2bf9-4006-9b34-691b84de2482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:30.055045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:30.106063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256e615-2bf9-4006-9b34-691b84de2482 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:41:30.190738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825d8f6-cd41-499e-b66c-8fcd2226b66b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:41:30.191344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825d8f6-cd41-499e-b66c-8fcd2226b66b service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:30.191616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825d8f6-cd41-499e-b66c-8fcd2226b66b service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:30.191874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825d8f6-cd41-499e-b66c-8fcd2226b66b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:30.193528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3825d8f6-cd41-499e-b66c-8fcd2226b66b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:30.313711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:30.319344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825d8f6-cd41-499e-b66c-8fcd2226b66b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:41:30.320967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825d8f6-cd41-499e-b66c-8fcd2226b66b service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:41:30.344348 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 674/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:41:35.665864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39482c-e1e0-42c3-833b-7dfe3bd23a1e None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:35.666339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39482c-e1e0-42c3-833b-7dfe3bd23a1e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:35.666339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39482c-e1e0-42c3-833b-7dfe3bd23a1e None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:35.667934 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 676/1350] 10.222.0.26 () {54 vars in 921 bytes} [Sat Oct 8 20:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:35.673541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cfa4c-b063-4df8-b702-e84cad945a6e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:35.673995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cfa4c-b063-4df8-b702-e84cad945a6e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:35.674092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cfa4c-b063-4df8-b702-e84cad945a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:35.753046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-936cfa4c-b063-4df8-b702-e84cad945a6e None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:35.754312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-936cfa4c-b063-4df8-b702-e84cad945a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:35.881683 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 675/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:41:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:39.650820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=59 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:40.403807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed90eb-031a-4bc6-9bab-a43f60b71cdf None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:40.403987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed90eb-031a-4bc6-9bab-a43f60b71cdf None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:40.404297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed90eb-031a-4bc6-9bab-a43f60b71cdf None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:40.406009 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 677/1352] 10.222.0.26 () {54 vars in 921 bytes} [Sat Oct 8 20:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:40.411960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369012e-997a-4875-89ec-d30f4b70b6a0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:40.412449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369012e-997a-4875-89ec-d30f4b70b6a0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:40.412542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369012e-997a-4875-89ec-d30f4b70b6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:40.473541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:40.505583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3369012e-997a-4875-89ec-d30f4b70b6a0 None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:40.507200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3369012e-997a-4875-89ec-d30f4b70b6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:40.623580 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 676/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:41:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:42.098977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab492-2c78-4ea7-8e24-4ea24e2e4b14 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:42.099403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab492-2c78-4ea7-8e24-4ea24e2e4b14 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:42.099515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab492-2c78-4ea7-8e24-4ea24e2e4b14 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:42.100860 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 678/1354] 10.222.0.26 () {54 vars in 921 bytes} [Sat Oct 8 20:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:42.105910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a05e2-4589-4bc8-9b38-bf059f81a1e8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:42.106370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a05e2-4589-4bc8-9b38-bf059f81a1e8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:42.106472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a05e2-4589-4bc8-9b38-bf059f81a1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:42.191311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a05a05e2-4589-4bc8-9b38-bf059f81a1e8 None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:42.192510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a05a05e2-4589-4bc8-9b38-bf059f81a1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:42.234544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:42.306726 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 677/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:41:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:46.119256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01caa-9625-4c52-b940-a6160d85e659 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:46.120101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01caa-9625-4c52-b940-a6160d85e659 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:46.120535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01caa-9625-4c52-b940-a6160d85e659 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:46.122177 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 679/1356] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:46.128077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497bd4-9403-4b5e-8bf2-a75c8ffd796c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:46.128519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497bd4-9403-4b5e-8bf2-a75c8ffd796c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:46.128660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497bd4-9403-4b5e-8bf2-a75c8ffd796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:46.203115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4e497bd4-9403-4b5e-8bf2-a75c8ffd796c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:46.204887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4e497bd4-9403-4b5e-8bf2-a75c8ffd796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:46.311616 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 678/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:46.678470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52f366-bd2f-483a-9a07-41a030f22b0e None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:46.678756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52f366-bd2f-483a-9a07-41a030f22b0e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:46.679230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52f366-bd2f-483a-9a07-41a030f22b0e None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:46.680559 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 680/1358] 10.222.0.26 () {54 vars in 961 bytes} [Sat Oct 8 20:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:46.688678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c72a48-d98d-48ee-8dfc-fb023a32bed0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:46.689290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c72a48-d98d-48ee-8dfc-fb023a32bed0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:46.689706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c72a48-d98d-48ee-8dfc-fb023a32bed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:46.710712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:46.776926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a5c72a48-d98d-48ee-8dfc-fb023a32bed0 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:46.778215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a5c72a48-d98d-48ee-8dfc-fb023a32bed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:46.899422 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 679/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Oct 8 20:41:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:46.907695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52f366-bd2f-483a-9a07-41a030f22b0e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:41:46.909307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f52f366-bd2f-483a-9a07-41a030f22b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:47.064073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52f366-bd2f-483a-9a07-41a030f22b0e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:41:47.139540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:47.183018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9874e2c-ce92-4b5a-b611-42bd817390eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:41:47.183776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9874e2c-ce92-4b5a-b611-42bd817390eb service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:47.184161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9874e2c-ce92-4b5a-b611-42bd817390eb service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:47.184533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9874e2c-ce92-4b5a-b611-42bd817390eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:47.186250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d9874e2c-ce92-4b5a-b611-42bd817390eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:47.280606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9874e2c-ce92-4b5a-b611-42bd817390eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:41:47.282271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9874e2c-ce92-4b5a-b611-42bd817390eb service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:41:47.309358 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 681/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:41:49.948763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba9901-03bd-4da6-95d2-dfb8f4772959 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:49.949363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba9901-03bd-4da6-95d2-dfb8f4772959 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:49.949363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba9901-03bd-4da6-95d2-dfb8f4772959 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:49.950772 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 680/1361] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:49.956950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91ac6e-99b1-4e15-bbbb-b086047c3803 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:49.957548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91ac6e-99b1-4e15-bbbb-b086047c3803 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:49.957548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91ac6e-99b1-4e15-bbbb-b086047c3803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:50.029688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4a91ac6e-99b1-4e15-bbbb-b086047c3803 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:50.030831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4a91ac6e-99b1-4e15-bbbb-b086047c3803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:50.070721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:50.139327 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 682/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:50.494926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba9901-03bd-4da6-95d2-dfb8f4772959 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:41:50.496434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6cba9901-03bd-4da6-95d2-dfb8f4772959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:50.569799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:50.656525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba9901-03bd-4da6-95d2-dfb8f4772959 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:41:50.774425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c5877-d00e-4aef-8d40-d1e59128c52e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:41:50.775087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c5877-d00e-4aef-8d40-d1e59128c52e service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:50.775087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c5877-d00e-4aef-8d40-d1e59128c52e service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:50.775247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c5877-d00e-4aef-8d40-d1e59128c52e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:50.776764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-969c5877-d00e-4aef-8d40-d1e59128c52e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:50.802857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:50.872178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c5877-d00e-4aef-8d40-d1e59128c52e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:41:50.874076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c5877-d00e-4aef-8d40-d1e59128c52e service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:41:50.892456 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 681/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:41:53.656527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34d40a-d0e0-4ffe-b17a-b0f8b09e74b8 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:53.657013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34d40a-d0e0-4ffe-b17a-b0f8b09e74b8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:53.657013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34d40a-d0e0-4ffe-b17a-b0f8b09e74b8 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:53.658472 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 683/1364] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:53.663796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035f028-1806-4b66-9363-0a99c2cbc642 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:53.664231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035f028-1806-4b66-9363-0a99c2cbc642 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:53.664329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035f028-1806-4b66-9363-0a99c2cbc642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:53.869810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0035f028-1806-4b66-9363-0a99c2cbc642 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:53.871034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0035f028-1806-4b66-9363-0a99c2cbc642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:54.009851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:54.014122 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 682/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:54.399856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd89e6-bb23-4854-80b1-a7630fc040ff None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:54.400149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd89e6-bb23-4854-80b1-a7630fc040ff None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:54.400450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd89e6-bb23-4854-80b1-a7630fc040ff None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:54.403057 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 684/1366] 10.222.0.26 () {54 vars in 961 bytes} [Sat Oct 8 20:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:54.409386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efaebb-5726-434f-94a1-e2a71c7c0860 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:54.409678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efaebb-5726-434f-94a1-e2a71c7c0860 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:54.409960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efaebb-5726-434f-94a1-e2a71c7c0860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:54.517211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-23efaebb-5726-434f-94a1-e2a71c7c0860 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:54.517211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-23efaebb-5726-434f-94a1-e2a71c7c0860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:54.713044 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 683/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Oct 8 20:41:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:54.722256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd89e6-bb23-4854-80b1-a7630fc040ff None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:41:54.723162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-03bd89e6-bb23-4854-80b1-a7630fc040ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:54.944938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd89e6-bb23-4854-80b1-a7630fc040ff None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:41:54.978104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:55.135920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845e2fa-74c8-44ed-af4e-cff4f5ca26d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:41:55.136806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845e2fa-74c8-44ed-af4e-cff4f5ca26d2 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:55.137284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845e2fa-74c8-44ed-af4e-cff4f5ca26d2 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:55.137736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845e2fa-74c8-44ed-af4e-cff4f5ca26d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:55.139587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7845e2fa-74c8-44ed-af4e-cff4f5ca26d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:55.244385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845e2fa-74c8-44ed-af4e-cff4f5ca26d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:41:55.246587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845e2fa-74c8-44ed-af4e-cff4f5ca26d2 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:41:55.299258 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 685/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:41:58.022258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a132301-66e7-4d94-8cc5-d5dc949f30e9 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:58.022258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a132301-66e7-4d94-8cc5-d5dc949f30e9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:58.022258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a132301-66e7-4d94-8cc5-d5dc949f30e9 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:58.024356 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 684/1369] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:58.030795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c79f2-dd50-4a9e-84b9-e7d572fa1915 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:58.031801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c79f2-dd50-4a9e-84b9-e7d572fa1915 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:58.032091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c79f2-dd50-4a9e-84b9-e7d572fa1915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:58.073290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:58.121710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-de1c79f2-dd50-4a9e-84b9-e7d572fa1915 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:58.123365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-de1c79f2-dd50-4a9e-84b9-e7d572fa1915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:58.286574 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 686/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:58.759065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a132301-66e7-4d94-8cc5-d5dc949f30e9 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:41:58.760995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6a132301-66e7-4d94-8cc5-d5dc949f30e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:58.815136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:58.838128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fd65d-5741-4835-b917-e443a3f3ece9 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:58.839049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fd65d-5741-4835-b917-e443a3f3ece9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:58.839049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fd65d-5741-4835-b917-e443a3f3ece9 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:58.840252 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 687/1371] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:58.846004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76883f0a-e2da-40c2-b396-9077c9a79696 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:58.846479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76883f0a-e2da-40c2-b396-9077c9a79696 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:58.846926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76883f0a-e2da-40c2-b396-9077c9a79696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:58.925038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-76883f0a-e2da-40c2-b396-9077c9a79696 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:58.926494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-76883f0a-e2da-40c2-b396-9077c9a79696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:58.945285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a132301-66e7-4d94-8cc5-d5dc949f30e9 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:41:58.982527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:59.030788 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 688/1372] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:41:59.078028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135be4f-9601-4c20-a9eb-6b26b3d6a74f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:41:59.078667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135be4f-9601-4c20-a9eb-6b26b3d6a74f service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:59.079003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135be4f-9601-4c20-a9eb-6b26b3d6a74f service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:59.079481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135be4f-9601-4c20-a9eb-6b26b3d6a74f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:59.081381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7135be4f-9601-4c20-a9eb-6b26b3d6a74f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:59.092487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:59.184094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135be4f-9601-4c20-a9eb-6b26b3d6a74f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:41:59.185711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135be4f-9601-4c20-a9eb-6b26b3d6a74f service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:41:59.204806 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 685/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:41:59.544468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1625b-cfd3-49e8-ae73-5e4515eeb4b9 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:59.544777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1625b-cfd3-49e8-ae73-5e4515eeb4b9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:59.545021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1625b-cfd3-49e8-ae73-5e4515eeb4b9 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:59.546393 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 689/1374] 10.222.0.26 () {54 vars in 963 bytes} [Sat Oct 8 20:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:41:59.551772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473d785-2bf9-454b-a704-f91644918d41 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:59.552060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473d785-2bf9-454b-a704-f91644918d41 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:59.552337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473d785-2bf9-454b-a704-f91644918d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:59.631169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2473d785-2bf9-454b-a704-f91644918d41 None None] MFA Rules not processed for user `7885df3b2ae34969852f76fbc94a7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:41:59.632373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2473d785-2bf9-454b-a704-f91644918d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:59.712224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:59.714912 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 686/1375] 10.222.0.26 () {58 vars in 1060 bytes} [Sat Oct 8 20:41:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:41:59.722840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1625b-cfd3-49e8-ae73-5e4515eeb4b9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:41:59.724428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-58a1625b-cfd3-49e8-ae73-5e4515eeb4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:59.838395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1625b-cfd3-49e8-ae73-5e4515eeb4b9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:41:59.925432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa61898-9a1c-4b9d-98d3-c242a9d824a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:41:59.926205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa61898-9a1c-4b9d-98d3-c242a9d824a7 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:41:59.926494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa61898-9a1c-4b9d-98d3-c242a9d824a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:41:59.926772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa61898-9a1c-4b9d-98d3-c242a9d824a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:41:59.928478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6fa61898-9a1c-4b9d-98d3-c242a9d824a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:41:59.939971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:00.053110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa61898-9a1c-4b9d-98d3-c242a9d824a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:00.054495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa61898-9a1c-4b9d-98d3-c242a9d824a7 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:00.074927 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 690/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:01.816692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416fb72-6462-4ba4-af6c-9235d48175b7 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:01.817497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416fb72-6462-4ba4-af6c-9235d48175b7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:01.817497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416fb72-6462-4ba4-af6c-9235d48175b7 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:01.818635 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 687/1377] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:01.824689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2ae54-4176-4faa-b808-2ef351c9f7e5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:01.825307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2ae54-4176-4faa-b808-2ef351c9f7e5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:01.825473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2ae54-4176-4faa-b808-2ef351c9f7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:01.902108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-aab2ae54-4176-4faa-b808-2ef351c9f7e5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:01.903355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-aab2ae54-4176-4faa-b808-2ef351c9f7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:01.968183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:02.009253 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 691/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:42:02.354253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416fb72-6462-4ba4-af6c-9235d48175b7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:02.355723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6416fb72-6462-4ba4-af6c-9235d48175b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:02.517103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416fb72-6462-4ba4-af6c-9235d48175b7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:02.592412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:02.634649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a99d33-570c-4634-abe9-f55c12786274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:02.635252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a99d33-570c-4634-abe9-f55c12786274 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:02.635530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a99d33-570c-4634-abe9-f55c12786274 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:02.635804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a99d33-570c-4634-abe9-f55c12786274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:02.637429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-38a99d33-570c-4634-abe9-f55c12786274 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:02.730726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a99d33-570c-4634-abe9-f55c12786274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:02.732311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a99d33-570c-4634-abe9-f55c12786274 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:02.753092 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 688/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:05.249217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019857b-01fc-4974-88aa-2322e90d96a2 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:05.249942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019857b-01fc-4974-88aa-2322e90d96a2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:05.249942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019857b-01fc-4974-88aa-2322e90d96a2 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:05.251487 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 692/1380] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:05.256817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887bc6b-9b36-4923-a863-df81d03ecba3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:05.257371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887bc6b-9b36-4923-a863-df81d03ecba3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:05.257371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887bc6b-9b36-4923-a863-df81d03ecba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:05.330992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f887bc6b-9b36-4923-a863-df81d03ecba3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:05.332603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f887bc6b-9b36-4923-a863-df81d03ecba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:05.372670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:05.442517 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 689/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:42:05.803573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019857b-01fc-4974-88aa-2322e90d96a2 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:05.805291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0019857b-01fc-4974-88aa-2322e90d96a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:05.967390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019857b-01fc-4974-88aa-2322e90d96a2 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:06.021711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:06.106577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4055431-3b89-4361-a307-75d49ae93a82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:06.107821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4055431-3b89-4361-a307-75d49ae93a82 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:06.108011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4055431-3b89-4361-a307-75d49ae93a82 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:06.108611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4055431-3b89-4361-a307-75d49ae93a82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:06.111349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a4055431-3b89-4361-a307-75d49ae93a82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:06.217507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4055431-3b89-4361-a307-75d49ae93a82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:06.219461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4055431-3b89-4361-a307-75d49ae93a82 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:06.240742 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 693/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:08.778309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb700415-d614-421a-887d-789c9825ad0f None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:08.778978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb700415-d614-421a-887d-789c9825ad0f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:08.779232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb700415-d614-421a-887d-789c9825ad0f None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:08.781420 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 690/1383] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:42:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:08.786884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c67562-569d-4172-b918-827111171626 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:08.787423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c67562-569d-4172-b918-827111171626 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:08.787423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c67562-569d-4172-b918-827111171626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:08.864580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-20c67562-569d-4172-b918-827111171626 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:08.865932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-20c67562-569d-4172-b918-827111171626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:08.868245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:08.988891 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 694/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:09.341272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb700415-d614-421a-887d-789c9825ad0f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:09.343833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eb700415-d614-421a-887d-789c9825ad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:09.518775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb700415-d614-421a-887d-789c9825ad0f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:09.545386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:09.673740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23924620-ffea-4114-b378-67a2f68b8f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:09.674278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23924620-ffea-4114-b378-67a2f68b8f53 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:09.674541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23924620-ffea-4114-b378-67a2f68b8f53 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:09.674808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23924620-ffea-4114-b378-67a2f68b8f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:09.676409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-23924620-ffea-4114-b378-67a2f68b8f53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:09.775877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23924620-ffea-4114-b378-67a2f68b8f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:09.778257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23924620-ffea-4114-b378-67a2f68b8f53 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:09.801533 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 691/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:12.560848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b375ba-4a3e-4d79-a2d7-7477449b1e3b None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:12.561492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b375ba-4a3e-4d79-a2d7-7477449b1e3b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:12.561492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b375ba-4a3e-4d79-a2d7-7477449b1e3b None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:12.563573 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 695/1386] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:12.569779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d43b-e9d1-4405-af06-b561b6a08818 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:12.570266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d43b-e9d1-4405-af06-b561b6a08818 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:12.570477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d43b-e9d1-4405-af06-b561b6a08818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:12.610382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:12.652843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9872d43b-e9d1-4405-af06-b561b6a08818 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:12.654500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9872d43b-e9d1-4405-af06-b561b6a08818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:12.766916 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 692/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:13.200735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b375ba-4a3e-4d79-a2d7-7477449b1e3b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:13.202309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-11b375ba-4a3e-4d79-a2d7-7477449b1e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:13.371206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:13.391957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b375ba-4a3e-4d79-a2d7-7477449b1e3b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:13.511961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220590a-8c52-4db2-95ca-f9f73f89011d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:13.512588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220590a-8c52-4db2-95ca-f9f73f89011d service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:13.512906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220590a-8c52-4db2-95ca-f9f73f89011d service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:13.513151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220590a-8c52-4db2-95ca-f9f73f89011d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:13.515407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a220590a-8c52-4db2-95ca-f9f73f89011d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:13.626557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220590a-8c52-4db2-95ca-f9f73f89011d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:13.629550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220590a-8c52-4db2-95ca-f9f73f89011d service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:13.636820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:13.659684 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 696/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:16.321640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571a6c6-8cc5-4a0a-b42a-95096e6302d1 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:16.322324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571a6c6-8cc5-4a0a-b42a-95096e6302d1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:16.322324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571a6c6-8cc5-4a0a-b42a-95096e6302d1 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:16.323636 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 693/1389] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:16.329012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cebe3-7094-4c3b-a3bf-7aaf8ac1d805 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:16.329553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cebe3-7094-4c3b-a3bf-7aaf8ac1d805 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:16.329662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cebe3-7094-4c3b-a3bf-7aaf8ac1d805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:16.397932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f92cebe3-7094-4c3b-a3bf-7aaf8ac1d805 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:16.399054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f92cebe3-7094-4c3b-a3bf-7aaf8ac1d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:16.484612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917dea8-e295-4266-b4b8-327e5f1d08c7 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:16.484926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917dea8-e295-4266-b4b8-327e5f1d08c7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:16.485332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917dea8-e295-4266-b4b8-327e5f1d08c7 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:16.486930 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 694/1390] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:42:16.491935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84e1ea-c8a0-40fd-949a-aa18cfca4732 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:16.492224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84e1ea-c8a0-40fd-949a-aa18cfca4732 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:16.492533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84e1ea-c8a0-40fd-949a-aa18cfca4732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:16.502077 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 697/1391] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:16.564292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ca84e1ea-c8a0-40fd-949a-aa18cfca4732 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:16.565574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ca84e1ea-c8a0-40fd-949a-aa18cfca4732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:16.619720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:16.664606 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 695/1392] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:42:16.860917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cebe3-7094-4c3b-a3bf-7aaf8ac1d805 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:16.862156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f92cebe3-7094-4c3b-a3bf-7aaf8ac1d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:16.930110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:16.973942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cebe3-7094-4c3b-a3bf-7aaf8ac1d805 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:17.021745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140742e-7da4-444e-9cb5-dbb94823d88f None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:17.022028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140742e-7da4-444e-9cb5-dbb94823d88f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:17.022303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140742e-7da4-444e-9cb5-dbb94823d88f None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:17.023668 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 696/1393] 10.222.0.26 () {54 vars in 962 bytes} [Sat Oct 8 20:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:42:17.028632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f4ffa-7cf7-4f08-98ea-3af28d8ff53b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:17.028989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f4ffa-7cf7-4f08-98ea-3af28d8ff53b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:17.029362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f4ffa-7cf7-4f08-98ea-3af28d8ff53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:17.086631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f21104-dbf3-441a-be00-01bb69ff4beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:17.087240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f21104-dbf3-441a-be00-01bb69ff4beb service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:17.087510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f21104-dbf3-441a-be00-01bb69ff4beb service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:17.087772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f21104-dbf3-441a-be00-01bb69ff4beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:17.089367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-88f21104-dbf3-441a-be00-01bb69ff4beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:17.105617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d25f4ffa-7cf7-4f08-98ea-3af28d8ff53b None None] MFA Rules not processed for user `6d82a39388514ff79b2235ff2ede6ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:17.106799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d25f4ffa-7cf7-4f08-98ea-3af28d8ff53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:17.156905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:17.180584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f21104-dbf3-441a-be00-01bb69ff4beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:17.182096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f21104-dbf3-441a-be00-01bb69ff4beb service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:17.184475 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 697/1394] 10.222.0.26 () {58 vars in 1059 bytes} [Sat Oct 8 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:42:17.192752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f4ffa-7cf7-4f08-98ea-3af28d8ff53b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:17.200108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f4ffa-7cf7-4f08-98ea-3af28d8ff53b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:17.201443 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 698/1395] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:42:17.249762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:17.280025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7a6c2-534b-45b4-bdf5-a43392c26d31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:17.280822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7a6c2-534b-45b4-bdf5-a43392c26d31 service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:17.281099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7a6c2-534b-45b4-bdf5-a43392c26d31 service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:17.281392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7a6c2-534b-45b4-bdf5-a43392c26d31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:17.283150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a9c7a6c2-534b-45b4-bdf5-a43392c26d31 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:17.406105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7a6c2-534b-45b4-bdf5-a43392c26d31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:17.407559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7a6c2-534b-45b4-bdf5-a43392c26d31 service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:17.428340 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 698/1396] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:42:18.013544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc4308-0aee-4270-ae0a-dcdccfe50467 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:18.014088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc4308-0aee-4270-ae0a-dcdccfe50467 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:18.014194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc4308-0aee-4270-ae0a-dcdccfe50467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:18.080407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ddfc4308-0aee-4270-ae0a-dcdccfe50467 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:18.081638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ddfc4308-0aee-4270-ae0a-dcdccfe50467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:18.168192 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 699/1397] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:18.217435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461ca1-90b5-4c6c-a2d9-4e8e4da2a308 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:18.217751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461ca1-90b5-4c6c-a2d9-4e8e4da2a308 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:18.218031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461ca1-90b5-4c6c-a2d9-4e8e4da2a308 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:18.219374 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 699/1398] 10.222.0.26 () {54 vars in 943 bytes} [Sat Oct 8 20:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:18.225531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbeb48-532f-4baf-b346-5cddbb321794 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:18.225809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbeb48-532f-4baf-b346-5cddbb321794 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:18.226080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbeb48-532f-4baf-b346-5cddbb321794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:18.296413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:18.306838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-98fbeb48-532f-4baf-b346-5cddbb321794 None None] MFA Rules not processed for user `5bd5adc10b4344e1847c23c2c0599e59`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:18.308091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-98fbeb48-532f-4baf-b346-5cddbb321794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:18.424869 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 700/1399] 10.222.0.26 () {58 vars in 1040 bytes} [Sat Oct 8 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:18.434624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2461ca1-90b5-4c6c-a2d9-4e8e4da2a308 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:18.436133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d2461ca1-90b5-4c6c-a2d9-4e8e4da2a308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:18.516071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:18.577783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2461ca1-90b5-4c6c-a2d9-4e8e4da2a308 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:18.689129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3597b88-0310-4d5b-b157-9c6a519b8786 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:18.689675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3597b88-0310-4d5b-b157-9c6a519b8786 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:18.689950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3597b88-0310-4d5b-b157-9c6a519b8786 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:18.690217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3597b88-0310-4d5b-b157-9c6a519b8786 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:18.691817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e3597b88-0310-4d5b-b157-9c6a519b8786 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:18.753284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:18.776109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3597b88-0310-4d5b-b157-9c6a519b8786 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:18.777730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3597b88-0310-4d5b-b157-9c6a519b8786 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:18.786240 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 700/1400] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:42:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:42:19.661336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6e4f-f898-4c8d-b154-f4b9e173eab8 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:19.662031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6e4f-f898-4c8d-b154-f4b9e173eab8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:19.662201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6e4f-f898-4c8d-b154-f4b9e173eab8 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:19.663789 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 701/1401] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:19.669520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0261d4a-2188-407b-93a0-ac7b071419ae None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:19.670523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0261d4a-2188-407b-93a0-ac7b071419ae None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:19.671798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0261d4a-2188-407b-93a0-ac7b071419ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:19.744701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a0261d4a-2188-407b-93a0-ac7b071419ae None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:19.745872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a0261d4a-2188-407b-93a0-ac7b071419ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:19.855566 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 701/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:20.206095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c6e4f-f898-4c8d-b154-f4b9e173eab8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:20.207640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-462c6e4f-f898-4c8d-b154-f4b9e173eab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:20.328589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:20.413954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c6e4f-f898-4c8d-b154-f4b9e173eab8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:20.550511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42032d-8f71-406f-99a4-b2dc77d94d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:20.555537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42032d-8f71-406f-99a4-b2dc77d94d42 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:20.556456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42032d-8f71-406f-99a4-b2dc77d94d42 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:20.556775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42032d-8f71-406f-99a4-b2dc77d94d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:20.558437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1c42032d-8f71-406f-99a4-b2dc77d94d42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:20.659010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:20.679509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42032d-8f71-406f-99a4-b2dc77d94d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:20.681686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42032d-8f71-406f-99a4-b2dc77d94d42 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:20.701547 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 702/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:23.189815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cabdf0-b665-4927-bde1-d47ed1824e1f None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:23.190525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cabdf0-b665-4927-bde1-d47ed1824e1f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:23.190525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cabdf0-b665-4927-bde1-d47ed1824e1f None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:23.192030 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 702/1404] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:23.197323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a21490-ec1f-4653-9204-613c108448d6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:23.197813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a21490-ec1f-4653-9204-613c108448d6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:23.197913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a21490-ec1f-4653-9204-613c108448d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:23.287799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-79a21490-ec1f-4653-9204-613c108448d6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:23.289046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-79a21490-ec1f-4653-9204-613c108448d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:23.400252 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 703/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:23.749038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cabdf0-b665-4927-bde1-d47ed1824e1f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:23.750641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-11cabdf0-b665-4927-bde1-d47ed1824e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:23.810030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:23.948166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cabdf0-b665-4927-bde1-d47ed1824e1f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:24.081064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2c1a8-2d42-4e99-966a-20a704121042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:24.081799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2c1a8-2d42-4e99-966a-20a704121042 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:24.082156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2c1a8-2d42-4e99-966a-20a704121042 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:24.082496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2c1a8-2d42-4e99-966a-20a704121042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:24.084178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-79b2c1a8-2d42-4e99-966a-20a704121042 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:24.098073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:24.215210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2c1a8-2d42-4e99-966a-20a704121042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:24.216548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2c1a8-2d42-4e99-966a-20a704121042 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:24.244905 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 703/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:26.732452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecdb33-9218-483b-af3a-1c482a737d0e None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:26.733401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecdb33-9218-483b-af3a-1c482a737d0e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:26.733401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecdb33-9218-483b-af3a-1c482a737d0e None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:26.734583 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 704/1407] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:26.739818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519590-30b6-4662-b33c-836fdb464fc2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:26.740280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519590-30b6-4662-b33c-836fdb464fc2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:26.740370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519590-30b6-4662-b33c-836fdb464fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:26.813676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2c519590-30b6-4662-b33c-836fdb464fc2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:26.813676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2c519590-30b6-4662-b33c-836fdb464fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:26.916218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:26.937235 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 704/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:27.294757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecdb33-9218-483b-af3a-1c482a737d0e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:27.296865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e6ecdb33-9218-483b-af3a-1c482a737d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:27.368878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:27.497428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecdb33-9218-483b-af3a-1c482a737d0e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:27.631318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcadf8-20e1-4adc-aaaf-82a64db2f823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:27.631882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcadf8-20e1-4adc-aaaf-82a64db2f823 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:27.632158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcadf8-20e1-4adc-aaaf-82a64db2f823 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:27.632425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcadf8-20e1-4adc-aaaf-82a64db2f823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:27.634114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-61dcadf8-20e1-4adc-aaaf-82a64db2f823 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:27.649055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:27.750525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcadf8-20e1-4adc-aaaf-82a64db2f823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:27.752149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcadf8-20e1-4adc-aaaf-82a64db2f823 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:27.770822 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 705/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:36.927355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:37.768602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=39 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:42.572742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da651e9e-fc73-4f55-967c-a965a8b5b47a None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:42.573338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da651e9e-fc73-4f55-967c-a965a8b5b47a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:42.573338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da651e9e-fc73-4f55-967c-a965a8b5b47a None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:42.574653 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 705/1410] 10.222.0.26 () {54 vars in 918 bytes} [Sat Oct 8 20:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:42.579788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f07a7-2bad-415b-b9be-d770812149cd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:42.580229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f07a7-2bad-415b-b9be-d770812149cd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:42.580361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f07a7-2bad-415b-b9be-d770812149cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:42.653872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2b4f07a7-2bad-415b-b9be-d770812149cd None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:42.655564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2b4f07a7-2bad-415b-b9be-d770812149cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:42.758578 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 706/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Oct 8 20:42:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:42.773201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addc7be-b5f4-48d8-a65c-05a1b98360c9 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:42.773489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addc7be-b5f4-48d8-a65c-05a1b98360c9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:42.773761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addc7be-b5f4-48d8-a65c-05a1b98360c9 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:42.775068 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 706/1412] 10.222.0.26 () {54 vars in 918 bytes} [Sat Oct 8 20:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:42.780173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e66cc-1d26-4ec3-87a2-8e345e516641 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:42.780460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e66cc-1d26-4ec3-87a2-8e345e516641 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:42.780739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e66cc-1d26-4ec3-87a2-8e345e516641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:42.853550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:42.856359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e82e66cc-1d26-4ec3-87a2-8e345e516641 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:42.858499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e82e66cc-1d26-4ec3-87a2-8e345e516641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:42.972093 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 707/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Oct 8 20:42:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:45.840114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bf6b3-0c2f-4c9e-996d-1c7114c077d0 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:45.840676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bf6b3-0c2f-4c9e-996d-1c7114c077d0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:45.840676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bf6b3-0c2f-4c9e-996d-1c7114c077d0 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:45.842093 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:45.847592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ca000-c686-48a0-88b8-12c68633ffc8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:45.848039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ca000-c686-48a0-88b8-12c68633ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:45.848138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ca000-c686-48a0-88b8-12c68633ffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:45.914550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f10ca000-c686-48a0-88b8-12c68633ffc8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:45.915746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f10ca000-c686-48a0-88b8-12c68633ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:45.971088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:46.014114 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:46.361299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bf6b3-0c2f-4c9e-996d-1c7114c077d0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:46.362818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a40bf6b3-0c2f-4c9e-996d-1c7114c077d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:46.506500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bf6b3-0c2f-4c9e-996d-1c7114c077d0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:46.578943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:46.618668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01018468-8e8e-4c01-811a-443c06c39334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:46.619298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01018468-8e8e-4c01-811a-443c06c39334 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:46.619578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01018468-8e8e-4c01-811a-443c06c39334 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:46.619851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01018468-8e8e-4c01-811a-443c06c39334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:46.621508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-01018468-8e8e-4c01-811a-443c06c39334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:46.709955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01018468-8e8e-4c01-811a-443c06c39334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:46.711560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01018468-8e8e-4c01-811a-443c06c39334 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:46.730007 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 708/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:48.460305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986cf24-07ca-4e3e-9061-9602e3739731 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:48.460860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986cf24-07ca-4e3e-9061-9602e3739731 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:48.460860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986cf24-07ca-4e3e-9061-9602e3739731 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:48.462697 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:48.468164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcda67-41be-466c-8cf5-c02f7de304c3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:48.468574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcda67-41be-466c-8cf5-c02f7de304c3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:48.468709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcda67-41be-466c-8cf5-c02f7de304c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:48.546762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f5dcda67-41be-466c-8cf5-c02f7de304c3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:48.547945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f5dcda67-41be-466c-8cf5-c02f7de304c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:48.573506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:48.642390 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:48.842551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986cf24-07ca-4e3e-9061-9602e3739731 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:48.843975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7986cf24-07ca-4e3e-9061-9602e3739731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:48.987491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986cf24-07ca-4e3e-9061-9602e3739731 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:49.027521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:49.100784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c6773-1825-4ddf-a3b6-8d7d3e3ba200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:49.101343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c6773-1825-4ddf-a3b6-8d7d3e3ba200 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:49.101631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c6773-1825-4ddf-a3b6-8d7d3e3ba200 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:49.101907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c6773-1825-4ddf-a3b6-8d7d3e3ba200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:49.103506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-350c6773-1825-4ddf-a3b6-8d7d3e3ba200 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:49.192945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c6773-1825-4ddf-a3b6-8d7d3e3ba200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:49.194566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c6773-1825-4ddf-a3b6-8d7d3e3ba200 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:49.212484 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 710/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:50.921378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8be804-841b-480b-8f82-f8b7061989b2 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:50.921910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8be804-841b-480b-8f82-f8b7061989b2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:50.921910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8be804-841b-480b-8f82-f8b7061989b2 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:50.923179 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:50.928019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e632681-ea45-4af8-b12c-0875f60a6e05 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:50.928402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e632681-ea45-4af8-b12c-0875f60a6e05 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:50.928696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e632681-ea45-4af8-b12c-0875f60a6e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:50.982962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:51.004673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6e632681-ea45-4af8-b12c-0875f60a6e05 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:51.005902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6e632681-ea45-4af8-b12c-0875f60a6e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:51.100897 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:51.262090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8be804-841b-480b-8f82-f8b7061989b2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:51.264082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9f8be804-841b-480b-8f82-f8b7061989b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:51.410775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8be804-841b-480b-8f82-f8b7061989b2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:51.422779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:51.523229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1003a7b-422e-463f-ad68-a7b5e4d28d34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:51.523758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1003a7b-422e-463f-ad68-a7b5e4d28d34 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:51.524036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1003a7b-422e-463f-ad68-a7b5e4d28d34 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:51.524308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1003a7b-422e-463f-ad68-a7b5e4d28d34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:51.525925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d1003a7b-422e-463f-ad68-a7b5e4d28d34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:51.613028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1003a7b-422e-463f-ad68-a7b5e4d28d34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:51.614633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1003a7b-422e-463f-ad68-a7b5e4d28d34 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:51.632838 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 711/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:53.298478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610559b4-2ca7-45a0-9c82-f9cb7f5a331b None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:53.299057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610559b4-2ca7-45a0-9c82-f9cb7f5a331b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:53.299057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610559b4-2ca7-45a0-9c82-f9cb7f5a331b None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:53.300413 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:53.305236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1e64-8934-4abb-a13f-b5d57cc78531 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:53.305641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1e64-8934-4abb-a13f-b5d57cc78531 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:53.305791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1e64-8934-4abb-a13f-b5d57cc78531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:53.325690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:53.386178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-52cb1e64-8934-4abb-a13f-b5d57cc78531 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:53.387423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-52cb1e64-8934-4abb-a13f-b5d57cc78531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:53.482791 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:53.642900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610559b4-2ca7-45a0-9c82-f9cb7f5a331b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:53.644397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-610559b4-2ca7-45a0-9c82-f9cb7f5a331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:53.754155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:53.789873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610559b4-2ca7-45a0-9c82-f9cb7f5a331b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:53.900463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f179c-0b3a-472b-922a-246e5ea0f1d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:53.900991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f179c-0b3a-472b-922a-246e5ea0f1d2 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:53.901301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f179c-0b3a-472b-922a-246e5ea0f1d2 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:53.901577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f179c-0b3a-472b-922a-246e5ea0f1d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:53.903184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f05f179c-0b3a-472b-922a-246e5ea0f1d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:53.980483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:53.994388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f179c-0b3a-472b-922a-246e5ea0f1d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:53.995989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f179c-0b3a-472b-922a-246e5ea0f1d2 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:54.015341 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 713/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:55.683839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821ff4-fab4-41f3-ac7a-98d28e182843 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:55.684367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821ff4-fab4-41f3-ac7a-98d28e182843 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:55.684367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821ff4-fab4-41f3-ac7a-98d28e182843 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:55.686242 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:55.691074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845ed8-f6d1-4149-80fd-738ae15b5cbf None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:55.691525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845ed8-f6d1-4149-80fd-738ae15b5cbf None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:55.691631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845ed8-f6d1-4149-80fd-738ae15b5cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:55.765468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-00845ed8-f6d1-4149-80fd-738ae15b5cbf None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:55.766669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-00845ed8-f6d1-4149-80fd-738ae15b5cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:55.860474 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:56.016978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be821ff4-fab4-41f3-ac7a-98d28e182843 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:56.018514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-be821ff4-fab4-41f3-ac7a-98d28e182843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:56.101593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:56.166308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be821ff4-fab4-41f3-ac7a-98d28e182843 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:56.278170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d1fef-2712-4a69-beb6-68bc0ef533c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:56.279229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d1fef-2712-4a69-beb6-68bc0ef533c3 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:56.279504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d1fef-2712-4a69-beb6-68bc0ef533c3 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:56.279770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d1fef-2712-4a69-beb6-68bc0ef533c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:56.281375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-230d1fef-2712-4a69-beb6-68bc0ef533c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:56.329361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:56.370442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d1fef-2712-4a69-beb6-68bc0ef533c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:56.372041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d1fef-2712-4a69-beb6-68bc0ef533c3 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:56.390374 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 714/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:57.999595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bbd89-8a9f-472b-a7ba-bb6f849a3e95 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:58.000162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bbd89-8a9f-472b-a7ba-bb6f849a3e95 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:58.000162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bbd89-8a9f-472b-a7ba-bb6f849a3e95 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:58.001523 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:58.006453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e260f6-62dd-4dc6-8e4d-3b661bdcaedd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:58.006912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e260f6-62dd-4dc6-8e4d-3b661bdcaedd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:58.007008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e260f6-62dd-4dc6-8e4d-3b661bdcaedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:58.083153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b8e260f6-62dd-4dc6-8e4d-3b661bdcaedd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:58.084348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b8e260f6-62dd-4dc6-8e4d-3b661bdcaedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:58.178442 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:58.339021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bbd89-8a9f-472b-a7ba-bb6f849a3e95 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:58.340555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-122bbd89-8a9f-472b-a7ba-bb6f849a3e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:58.389995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:58.485998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bbd89-8a9f-472b-a7ba-bb6f849a3e95 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:58.598276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cbc42-0e50-4044-9ee7-0e217677dcac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:58.598796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cbc42-0e50-4044-9ee7-0e217677dcac service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:58.599073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cbc42-0e50-4044-9ee7-0e217677dcac service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:58.599345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cbc42-0e50-4044-9ee7-0e217677dcac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:58.600948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-601cbc42-0e50-4044-9ee7-0e217677dcac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:58.608558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:58.695312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cbc42-0e50-4044-9ee7-0e217677dcac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:58.696905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cbc42-0e50-4044-9ee7-0e217677dcac service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:58.714706 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 716/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:00.315529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053648d-8091-4bfb-bc87-1b8664fe0150 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:00.316082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053648d-8091-4bfb-bc87-1b8664fe0150 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:00.316082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053648d-8091-4bfb-bc87-1b8664fe0150 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:00.317453 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:00.322307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f7d82-52c1-4ef0-9261-3fd350463105 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:00.322709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f7d82-52c1-4ef0-9261-3fd350463105 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:00.322869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f7d82-52c1-4ef0-9261-3fd350463105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:00.398892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-310f7d82-52c1-4ef0-9261-3fd350463105 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:00.400032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-310f7d82-52c1-4ef0-9261-3fd350463105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:00.467160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:00.496227 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:00.657093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053648d-8091-4bfb-bc87-1b8664fe0150 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:00.658638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2053648d-8091-4bfb-bc87-1b8664fe0150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:00.676539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:00.807102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053648d-8091-4bfb-bc87-1b8664fe0150 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:00.893365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:00.918199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddb295-583f-4fce-804d-2b2c7dad8faf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:00.918731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddb295-583f-4fce-804d-2b2c7dad8faf service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:00.919528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddb295-583f-4fce-804d-2b2c7dad8faf service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:00.919802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddb295-583f-4fce-804d-2b2c7dad8faf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:00.921501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-88ddb295-583f-4fce-804d-2b2c7dad8faf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:01.011964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddb295-583f-4fce-804d-2b2c7dad8faf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:01.013610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddb295-583f-4fce-804d-2b2c7dad8faf service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:01.031774 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 717/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:02.637355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a0ac0-467e-4993-b31c-49903a396c71 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:02.637948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a0ac0-467e-4993-b31c-49903a396c71 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:02.637948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a0ac0-467e-4993-b31c-49903a396c71 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:02.639360 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:02.644165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fe1ae-0bf6-43cd-996b-24fe1b8fabc8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:02.644563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fe1ae-0bf6-43cd-996b-24fe1b8fabc8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:02.644719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fe1ae-0bf6-43cd-996b-24fe1b8fabc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:02.720161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6a5fe1ae-0bf6-43cd-996b-24fe1b8fabc8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:02.721401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6a5fe1ae-0bf6-43cd-996b-24fe1b8fabc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:02.762974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:02.817261 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:02.976802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a0ac0-467e-4993-b31c-49903a396c71 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:02.978351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d3a0ac0-467e-4993-b31c-49903a396c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:03.121969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a0ac0-467e-4993-b31c-49903a396c71 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:03.175194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:03.233642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d3579-5878-4e76-83f3-1e512650685a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:03.234245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d3579-5878-4e76-83f3-1e512650685a service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:03.234518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d3579-5878-4e76-83f3-1e512650685a service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:03.234783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d3579-5878-4e76-83f3-1e512650685a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:03.236400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c16d3579-5878-4e76-83f3-1e512650685a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:03.330510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d3579-5878-4e76-83f3-1e512650685a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:03.332103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d3579-5878-4e76-83f3-1e512650685a service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:03.349550 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 719/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:04.960806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2af99-29ae-4cad-a774-b14a434c4400 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:04.961368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2af99-29ae-4cad-a774-b14a434c4400 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:04.961368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2af99-29ae-4cad-a774-b14a434c4400 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:04.962711 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:04.967644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a7d61-4a18-498b-a6b6-65031f53ae66 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:04.968051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a7d61-4a18-498b-a6b6-65031f53ae66 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:04.968197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a7d61-4a18-498b-a6b6-65031f53ae66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:05.042958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-821a7d61-4a18-498b-a6b6-65031f53ae66 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:05.044188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-821a7d61-4a18-498b-a6b6-65031f53ae66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:05.046202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:05.140707 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:05.299266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2af99-29ae-4cad-a774-b14a434c4400 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:05.300686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-17f2af99-29ae-4cad-a774-b14a434c4400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:05.444900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2af99-29ae-4cad-a774-b14a434c4400 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:05.471307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:05.558262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1e2f0-199d-43d3-a1a1-04c662f71ebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:05.558796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1e2f0-199d-43d3-a1a1-04c662f71ebd service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:05.559076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1e2f0-199d-43d3-a1a1-04c662f71ebd service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:05.559392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1e2f0-199d-43d3-a1a1-04c662f71ebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:05.560953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-13c1e2f0-199d-43d3-a1a1-04c662f71ebd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:05.648566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1e2f0-199d-43d3-a1a1-04c662f71ebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:05.650160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1e2f0-199d-43d3-a1a1-04c662f71ebd service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:05.668143 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 720/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:07.998685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2f8f2-709e-4eac-8711-191ee8b560da None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:07.999238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2f8f2-709e-4eac-8711-191ee8b560da None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:07.999340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2f8f2-709e-4eac-8711-191ee8b560da None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:08.000616 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:08.006009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89f17f-9fd1-418f-92c0-cd948f36179a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:08.006415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89f17f-9fd1-418f-92c0-cd948f36179a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:08.006532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89f17f-9fd1-418f-92c0-cd948f36179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:08.047115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:08.072430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0b89f17f-9fd1-418f-92c0-cd948f36179a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:08.073682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0b89f17f-9fd1-418f-92c0-cd948f36179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:08.170951 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:08.524417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2f8f2-709e-4eac-8711-191ee8b560da None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:08.525976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-abb2f8f2-709e-4eac-8711-191ee8b560da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:08.628605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2f8f2-709e-4eac-8711-191ee8b560da None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:08.661802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:08.704737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e198a69-cea8-4bed-b37e-55f8daf5852e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:08.705445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e198a69-cea8-4bed-b37e-55f8daf5852e service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:08.705736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e198a69-cea8-4bed-b37e-55f8daf5852e service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:08.705993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e198a69-cea8-4bed-b37e-55f8daf5852e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:08.707601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1e198a69-cea8-4bed-b37e-55f8daf5852e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:08.821839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e198a69-cea8-4bed-b37e-55f8daf5852e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:08.823197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e198a69-cea8-4bed-b37e-55f8daf5852e service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:08.841400 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 722/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:11.387200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7f89b-0fef-4435-bdb7-b0f22f2d2f11 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:11.387869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7f89b-0fef-4435-bdb7-b0f22f2d2f11 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:11.387869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7f89b-0fef-4435-bdb7-b0f22f2d2f11 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:11.389123 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:11.394411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e49c9-c561-424c-8719-afb9a6bddb7d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:11.394817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e49c9-c561-424c-8719-afb9a6bddb7d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:11.394968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e49c9-c561-424c-8719-afb9a6bddb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:11.461744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7e5e49c9-c561-424c-8719-afb9a6bddb7d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:11.462955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7e5e49c9-c561-424c-8719-afb9a6bddb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:11.475494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:11.559621 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:11.896242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7f89b-0fef-4435-bdb7-b0f22f2d2f11 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:11.897800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bfd7f89b-0fef-4435-bdb7-b0f22f2d2f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:12.000246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7f89b-0fef-4435-bdb7-b0f22f2d2f11 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:12.012748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:12.072824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f09c87-3dc5-4ad9-8825-361a23aa0a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:12.073443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f09c87-3dc5-4ad9-8825-361a23aa0a82 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:12.073717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f09c87-3dc5-4ad9-8825-361a23aa0a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:12.073985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f09c87-3dc5-4ad9-8825-361a23aa0a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:12.075583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-30f09c87-3dc5-4ad9-8825-361a23aa0a82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:12.183999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f09c87-3dc5-4ad9-8825-361a23aa0a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:12.186067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f09c87-3dc5-4ad9-8825-361a23aa0a82 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:12.203493 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 723/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:43:14.903426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6701e-8cb3-4a08-94bb-ceb70540f08f None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:14.903929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6701e-8cb3-4a08-94bb-ceb70540f08f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:14.903929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6701e-8cb3-4a08-94bb-ceb70540f08f None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:14.905259 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:14.910653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf75795-bb01-479a-8a78-70e2389a0670 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:14.911039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf75795-bb01-479a-8a78-70e2389a0670 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:14.911200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf75795-bb01-479a-8a78-70e2389a0670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:14.959101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:14.977340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6bf75795-bb01-479a-8a78-70e2389a0670 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:14.978549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6bf75795-bb01-479a-8a78-70e2389a0670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:15.071969 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:15.414324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6701e-8cb3-4a08-94bb-ceb70540f08f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:15.415901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-28b6701e-8cb3-4a08-94bb-ceb70540f08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:15.522636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6701e-8cb3-4a08-94bb-ceb70540f08f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:15.561979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:15.595819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e7dff-9db5-47e6-b70b-154645da0b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:15.596413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e7dff-9db5-47e6-b70b-154645da0b47 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:15.596689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e7dff-9db5-47e6-b70b-154645da0b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:15.596959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e7dff-9db5-47e6-b70b-154645da0b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:15.598575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1b6e7dff-9db5-47e6-b70b-154645da0b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:15.828701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e7dff-9db5-47e6-b70b-154645da0b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:15.830064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e7dff-9db5-47e6-b70b-154645da0b47 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:15.848325 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 725/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:18.450271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65bf76-b667-40b6-b4e1-f63114b7471d None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:18.450902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65bf76-b667-40b6-b4e1-f63114b7471d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:18.450902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65bf76-b667-40b6-b4e1-f63114b7471d None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:18.452114 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:18.457358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3bf24-ba46-46fb-befd-a9d28d0cab9f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:18.457804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3bf24-ba46-46fb-befd-a9d28d0cab9f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:18.457908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3bf24-ba46-46fb-befd-a9d28d0cab9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:18.524313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-88a3bf24-ba46-46fb-befd-a9d28d0cab9f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:18.525523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-88a3bf24-ba46-46fb-befd-a9d28d0cab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:18.546414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:18.620282 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:18.964442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65bf76-b667-40b6-b4e1-f63114b7471d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:18.966080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1d65bf76-b667-40b6-b4e1-f63114b7471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:19.069388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65bf76-b667-40b6-b4e1-f63114b7471d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:19.090075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:19.143518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f4491-ae46-4c37-a9ec-76b4cbc6af63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:19.144115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f4491-ae46-4c37-a9ec-76b4cbc6af63 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:19.144395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f4491-ae46-4c37-a9ec-76b4cbc6af63 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:19.144667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f4491-ae46-4c37-a9ec-76b4cbc6af63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:19.146284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cf9f4491-ae46-4c37-a9ec-76b4cbc6af63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:19.254194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f4491-ae46-4c37-a9ec-76b4cbc6af63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:19.255549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f4491-ae46-4c37-a9ec-76b4cbc6af63 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:19.274054 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 726/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:21.707623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6ad5e-c114-4048-9fed-cfb3e9b2f0e9 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:21.708209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6ad5e-c114-4048-9fed-cfb3e9b2f0e9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:21.708209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6ad5e-c114-4048-9fed-cfb3e9b2f0e9 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:21.709521 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:21.714661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdf7df-6a69-4504-b35c-d5699dcf5f54 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:21.715139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdf7df-6a69-4504-b35c-d5699dcf5f54 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:21.715239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdf7df-6a69-4504-b35c-d5699dcf5f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:21.781358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:21.784396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bacdf7df-6a69-4504-b35c-d5699dcf5f54 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:21.786212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bacdf7df-6a69-4504-b35c-d5699dcf5f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:21.880466 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:22.219923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6ad5e-c114-4048-9fed-cfb3e9b2f0e9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:22.221462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c8f6ad5e-c114-4048-9fed-cfb3e9b2f0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:22.322627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6ad5e-c114-4048-9fed-cfb3e9b2f0e9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:22.370914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:22.396007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b350ed-d8bd-4197-980c-d1ddb70ee1dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:22.396602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b350ed-d8bd-4197-980c-d1ddb70ee1dc service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:22.396876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b350ed-d8bd-4197-980c-d1ddb70ee1dc service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:22.397163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b350ed-d8bd-4197-980c-d1ddb70ee1dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:22.398746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c6b350ed-d8bd-4197-980c-d1ddb70ee1dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:22.508249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b350ed-d8bd-4197-980c-d1ddb70ee1dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:22.509709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b350ed-d8bd-4197-980c-d1ddb70ee1dc service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:22.528600 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 728/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:24.985033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c5140-048b-481b-b630-7a1d21e8c753 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:24.985611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c5140-048b-481b-b630-7a1d21e8c753 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:24.985611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c5140-048b-481b-b630-7a1d21e8c753 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:24.986950 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:24.992498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd71e39-1d01-4ce6-b117-70772d4c4ce9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:24.992928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd71e39-1d01-4ce6-b117-70772d4c4ce9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:24.993044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd71e39-1d01-4ce6-b117-70772d4c4ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:25.059119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-abd71e39-1d01-4ce6-b117-70772d4c4ce9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:25.060331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-abd71e39-1d01-4ce6-b117-70772d4c4ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:25.088712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:25.155707 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:43:25.498904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c5140-048b-481b-b630-7a1d21e8c753 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:25.500452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-761c5140-048b-481b-b630-7a1d21e8c753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:25.603990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c5140-048b-481b-b630-7a1d21e8c753 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:25.632483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:25.677636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e9a50-a595-40d3-a11c-51839ddec9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:25.678233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e9a50-a595-40d3-a11c-51839ddec9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:25.678503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e9a50-a595-40d3-a11c-51839ddec9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:25.678766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e9a50-a595-40d3-a11c-51839ddec9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:25.680367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-065e9a50-a595-40d3-a11c-51839ddec9f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:25.788754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e9a50-a595-40d3-a11c-51839ddec9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:25.790201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e9a50-a595-40d3-a11c-51839ddec9f2 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:25.807542 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 729/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:28.277860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a6ba1-ae63-4f4e-a158-67172898f668 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:28.278386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a6ba1-ae63-4f4e-a158-67172898f668 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:28.278503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a6ba1-ae63-4f4e-a158-67172898f668 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:28.279779 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:28.284976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589e108-dcdf-4dc6-9abd-2b70bb1085fc None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:28.285448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589e108-dcdf-4dc6-9abd-2b70bb1085fc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:28.285545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589e108-dcdf-4dc6-9abd-2b70bb1085fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:28.351471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2589e108-dcdf-4dc6-9abd-2b70bb1085fc None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:28.352666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2589e108-dcdf-4dc6-9abd-2b70bb1085fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:28.360998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:28.448708 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:28.793635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a6ba1-ae63-4f4e-a158-67172898f668 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:28.795755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6c7a6ba1-ae63-4f4e-a158-67172898f668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:28.897156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a6ba1-ae63-4f4e-a158-67172898f668 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:28.952471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:28.970652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6a78-c95b-47dc-be3f-4a80ff812779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:28.971248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6a78-c95b-47dc-be3f-4a80ff812779 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:28.971525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6a78-c95b-47dc-be3f-4a80ff812779 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:28.971820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6a78-c95b-47dc-be3f-4a80ff812779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:28.973426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1a3b6a78-c95b-47dc-be3f-4a80ff812779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:29.080383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b6a78-c95b-47dc-be3f-4a80ff812779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:29.081794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b6a78-c95b-47dc-be3f-4a80ff812779 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:29.100062 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 731/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:31.562897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5233c2-6cf3-4d5f-a0d2-4e76f012a84d None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:31.563465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5233c2-6cf3-4d5f-a0d2-4e76f012a84d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:31.563465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5233c2-6cf3-4d5f-a0d2-4e76f012a84d None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:31.564765 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:31.570269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72425-b490-4f7d-aba0-dcbf83c28211 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:31.570691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72425-b490-4f7d-aba0-dcbf83c28211 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:31.570810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72425-b490-4f7d-aba0-dcbf83c28211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:31.634740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d4c72425-b490-4f7d-aba0-dcbf83c28211 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:31.635857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d4c72425-b490-4f7d-aba0-dcbf83c28211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:31.673534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:31.732914 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:32.072587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5233c2-6cf3-4d5f-a0d2-4e76f012a84d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:32.074157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ff5233c2-6cf3-4d5f-a0d2-4e76f012a84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:32.176170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5233c2-6cf3-4d5f-a0d2-4e76f012a84d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:32.213864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:32.250039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e91f1-5b7d-4e64-b4a8-6627a468847f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:32.250633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e91f1-5b7d-4e64-b4a8-6627a468847f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:32.250908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e91f1-5b7d-4e64-b4a8-6627a468847f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:32.251176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e91f1-5b7d-4e64-b4a8-6627a468847f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:32.252746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-193e91f1-5b7d-4e64-b4a8-6627a468847f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:32.358792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e91f1-5b7d-4e64-b4a8-6627a468847f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:32.360159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e91f1-5b7d-4e64-b4a8-6627a468847f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:32.378061 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 732/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:34.820514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9448a-6475-459d-8e30-1071e330168a None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:34.821097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9448a-6475-459d-8e30-1071e330168a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:34.821097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9448a-6475-459d-8e30-1071e330168a None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:34.822352 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:34.827777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f57e5-debe-4e6b-845a-041ae7bf5462 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:34.828223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f57e5-debe-4e6b-845a-041ae7bf5462 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:34.828332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f57e5-debe-4e6b-845a-041ae7bf5462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:34.900440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f41f57e5-debe-4e6b-845a-041ae7bf5462 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:34.901680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f41f57e5-debe-4e6b-845a-041ae7bf5462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:34.920689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:34.997320 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:43:35.338898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9448a-6475-459d-8e30-1071e330168a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:35.340523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-78d9448a-6475-459d-8e30-1071e330168a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:35.441564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9448a-6475-459d-8e30-1071e330168a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:35.508909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:35.516537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997a4a9-a00b-4d03-87f3-75571a8fa128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:35.517288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997a4a9-a00b-4d03-87f3-75571a8fa128 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:35.517568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997a4a9-a00b-4d03-87f3-75571a8fa128 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:35.517838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997a4a9-a00b-4d03-87f3-75571a8fa128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:35.519408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d997a4a9-a00b-4d03-87f3-75571a8fa128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:35.627676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997a4a9-a00b-4d03-87f3-75571a8fa128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:35.628998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997a4a9-a00b-4d03-87f3-75571a8fa128 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:35.647443 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 734/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:38.031926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d446ec-f0e5-402d-b55e-e03b4292c7c5 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:38.032492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d446ec-f0e5-402d-b55e-e03b4292c7c5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:38.032492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d446ec-f0e5-402d-b55e-e03b4292c7c5 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:38.033875 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:38.039302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade4468-043a-4ae0-a225-79bdb81a712c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:38.039736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade4468-043a-4ae0-a225-79bdb81a712c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:38.039853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade4468-043a-4ae0-a225-79bdb81a712c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:38.104254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1ade4468-043a-4ae0-a225-79bdb81a712c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:38.105470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1ade4468-043a-4ae0-a225-79bdb81a712c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:38.153727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:38.205450 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:38.546070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d446ec-f0e5-402d-b55e-e03b4292c7c5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:38.547606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-69d446ec-f0e5-402d-b55e-e03b4292c7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:38.650359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d446ec-f0e5-402d-b55e-e03b4292c7c5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:38.698925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:38.725321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc85fe-004f-429b-8e5b-f8f96c0dfaef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:38.725929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc85fe-004f-429b-8e5b-f8f96c0dfaef service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:38.726210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc85fe-004f-429b-8e5b-f8f96c0dfaef service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:38.726484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc85fe-004f-429b-8e5b-f8f96c0dfaef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:38.728121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c7fc85fe-004f-429b-8e5b-f8f96c0dfaef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:38.837828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc85fe-004f-429b-8e5b-f8f96c0dfaef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:38.839254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc85fe-004f-429b-8e5b-f8f96c0dfaef service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:38.859858 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 735/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:48.203806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=22 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:48.856280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=66 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:03.348880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92b427-8cc5-4747-b292-772d6e8010b3 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:03.349513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92b427-8cc5-4747-b292-772d6e8010b3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:03.349513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92b427-8cc5-4747-b292-772d6e8010b3 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:03.350790 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 736/1471] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:44:03.356944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31c842-321f-4c9d-b9b7-2f7a86d0a5bc None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:03.357520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31c842-321f-4c9d-b9b7-2f7a86d0a5bc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:03.357520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31c842-321f-4c9d-b9b7-2f7a86d0a5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:03.423975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4d31c842-321f-4c9d-b9b7-2f7a86d0a5bc None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:44:03.425179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4d31c842-321f-4c9d-b9b7-2f7a86d0a5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:03.519933 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 736/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:44:03.878701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65965710-5c71-434a-9886-110f1ad2ad7b None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:03.878983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65965710-5c71-434a-9886-110f1ad2ad7b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:03.879257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65965710-5c71-434a-9886-110f1ad2ad7b None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:03.880584 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 737/1473] 10.222.0.26 () {54 vars in 962 bytes} [Sat Oct 8 20:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:44:03.885572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9576f7-0867-4297-a713-033c9eb64423 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:03.885857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9576f7-0867-4297-a713-033c9eb64423 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:03.886132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9576f7-0867-4297-a713-033c9eb64423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:03.960690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7b9576f7-0867-4297-a713-033c9eb64423 None None] MFA Rules not processed for user `6d82a39388514ff79b2235ff2ede6ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:44:03.961911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7b9576f7-0867-4297-a713-033c9eb64423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:03.983243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:04.037946 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 737/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Sat Oct 8 20:44:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:44:04.045805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65965710-5c71-434a-9886-110f1ad2ad7b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:44:04.047301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-65965710-5c71-434a-9886-110f1ad2ad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:04.149725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65965710-5c71-434a-9886-110f1ad2ad7b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:44:04.222545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0781686-ee63-4aeb-b55a-1460a1d53d8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:44:04.223142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0781686-ee63-4aeb-b55a-1460a1d53d8a service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:04.223429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0781686-ee63-4aeb-b55a-1460a1d53d8a service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:04.223679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0781686-ee63-4aeb-b55a-1460a1d53d8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:04.225269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b0781686-ee63-4aeb-b55a-1460a1d53d8a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:04.278466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:04.333108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0781686-ee63-4aeb-b55a-1460a1d53d8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:44:04.334590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0781686-ee63-4aeb-b55a-1460a1d53d8a service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:44:04.352614 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 738/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:44:06.859552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c3340-b7af-4867-bf25-572ea26b1893 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:06.860071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c3340-b7af-4867-bf25-572ea26b1893 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:06.860071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c3340-b7af-4867-bf25-572ea26b1893 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:06.861431 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 738/1476] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:44:06.866788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edda130-c7a0-4a85-b831-317aaa696291 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:06.867217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edda130-c7a0-4a85-b831-317aaa696291 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:06.867347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edda130-c7a0-4a85-b831-317aaa696291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:06.931986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7edda130-c7a0-4a85-b831-317aaa696291 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:44:06.933206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7edda130-c7a0-4a85-b831-317aaa696291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:07.028885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 739/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:44:07.365225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c3340-b7af-4867-bf25-572ea26b1893 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:44:07.366779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d20c3340-b7af-4867-bf25-572ea26b1893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:07.491936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c3340-b7af-4867-bf25-572ea26b1893 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:44:07.540487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:07.583818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd4f0b-3974-4144-9c1d-0d244b775ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:44:07.584441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd4f0b-3974-4144-9c1d-0d244b775ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:07.584715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd4f0b-3974-4144-9c1d-0d244b775ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:07.584982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd4f0b-3974-4144-9c1d-0d244b775ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:07.585918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd4f0b-3974-4144-9c1d-0d244b775ff8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:44:07.587645 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-35fd4f0b-3974-4144-9c1d-0d244b775ff8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:44:07.587645 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 20:44:07.587645 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 20:44:07.588798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd4f0b-3974-4144-9c1d-0d244b775ff8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:44:07.609812 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 739/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Oct 8 20:44:07 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:44:10.021328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e544f16-31fb-42bf-85b6-7f229e2f1515 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:10.021900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e544f16-31fb-42bf-85b6-7f229e2f1515 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:10.021900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e544f16-31fb-42bf-85b6-7f229e2f1515 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:10.023204 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 740/1479] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:44:10.028393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd82c5-5c86-4288-8cc3-ed89324ae4bd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:10.028819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd82c5-5c86-4288-8cc3-ed89324ae4bd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:10.028984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd82c5-5c86-4288-8cc3-ed89324ae4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:10.094604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-69dd82c5-5c86-4288-8cc3-ed89324ae4bd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:44:10.096083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-69dd82c5-5c86-4288-8cc3-ed89324ae4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:10.192709 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 740/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:44:10.581642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e544f16-31fb-42bf-85b6-7f229e2f1515 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:44:10.583277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2e544f16-31fb-42bf-85b6-7f229e2f1515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:10.592981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:10.728043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e544f16-31fb-42bf-85b6-7f229e2f1515 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:44:10.807195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:10.838799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbaee8c-d0f0-425f-b8c4-a787f4c58e9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:44:10.839394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaee8c-d0f0-425f-b8c4-a787f4c58e9a service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:10.839666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaee8c-d0f0-425f-b8c4-a787f4c58e9a service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:10.840443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaee8c-d0f0-425f-b8c4-a787f4c58e9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:10.842044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0dbaee8c-d0f0-425f-b8c4-a787f4c58e9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:10.929807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbaee8c-d0f0-425f-b8c4-a787f4c58e9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:44:10.931373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbaee8c-d0f0-425f-b8c4-a787f4c58e9a service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:44:10.949056 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 741/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:44:13.549458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983f75-6d53-41f3-80d6-ae302dd1a712 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:13.549999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983f75-6d53-41f3-80d6-ae302dd1a712 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:13.549999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983f75-6d53-41f3-80d6-ae302dd1a712 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:13.551336 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 741/1482] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:44:13.556614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee956658-3530-466f-85dc-f89bfe9590fd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:13.557072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee956658-3530-466f-85dc-f89bfe9590fd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:13.557218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee956658-3530-466f-85dc-f89bfe9590fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:13.622346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ee956658-3530-466f-85dc-f89bfe9590fd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:44:13.623541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ee956658-3530-466f-85dc-f89bfe9590fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:13.669008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:13.719216 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 742/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:44:14.063611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e983f75-6d53-41f3-80d6-ae302dd1a712 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:44:14.065135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3e983f75-6d53-41f3-80d6-ae302dd1a712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:14.089675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:14.170054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e983f75-6d53-41f3-80d6-ae302dd1a712 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:44:14.244437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16151d89-9fe8-46c3-ba3c-1d206d32e3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:44:14.245065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16151d89-9fe8-46c3-ba3c-1d206d32e3bc service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:14.245370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16151d89-9fe8-46c3-ba3c-1d206d32e3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:14.245641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16151d89-9fe8-46c3-ba3c-1d206d32e3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:14.247835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-16151d89-9fe8-46c3-ba3c-1d206d32e3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:14.321649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:14.357592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16151d89-9fe8-46c3-ba3c-1d206d32e3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:44:14.359022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16151d89-9fe8-46c3-ba3c-1d206d32e3bc service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:44:14.377673 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 742/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:44:16.836276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e934e-c027-46fc-b963-2214300df62a None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:16.836783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e934e-c027-46fc-b963-2214300df62a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:16.836783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e934e-c027-46fc-b963-2214300df62a None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:16.838127 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 743/1485] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:44:16.843854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87354da-b382-463c-a6c3-0a22fbbfb013 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:16.844302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87354da-b382-463c-a6c3-0a22fbbfb013 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:16.844407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87354da-b382-463c-a6c3-0a22fbbfb013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:16.909483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c87354da-b382-463c-a6c3-0a22fbbfb013 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:44:16.910664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c87354da-b382-463c-a6c3-0a22fbbfb013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:17.007065 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 743/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:44:17.348549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e934e-c027-46fc-b963-2214300df62a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:44:17.350133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-388e934e-c027-46fc-b963-2214300df62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:17.453901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e934e-c027-46fc-b963-2214300df62a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:44:17.526965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:17.528557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba8086-857d-4d25-a325-ccce3210255d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:44:17.529255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba8086-857d-4d25-a325-ccce3210255d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:17.529546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba8086-857d-4d25-a325-ccce3210255d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:17.530014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba8086-857d-4d25-a325-ccce3210255d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:17.532123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e3ba8086-857d-4d25-a325-ccce3210255d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:17.640566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba8086-857d-4d25-a325-ccce3210255d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:44:17.641904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba8086-857d-4d25-a325-ccce3210255d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:44:17.659445 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 744/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:44:20.246342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71917912-a9f8-490f-931c-88d0bab23a37 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:20.246857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71917912-a9f8-490f-931c-88d0bab23a37 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:20.246964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71917912-a9f8-490f-931c-88d0bab23a37 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:20.248209 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 744/1488] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:44:20.253607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e8990-1ddb-45bc-b58d-3c3220c792c2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:20.254015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e8990-1ddb-45bc-b58d-3c3220c792c2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:20.254169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e8990-1ddb-45bc-b58d-3c3220c792c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:20.319351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-802e8990-1ddb-45bc-b58d-3c3220c792c2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:44:20.320558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-802e8990-1ddb-45bc-b58d-3c3220c792c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:20.372973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:20.417859 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 745/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:44:20.763523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71917912-a9f8-490f-931c-88d0bab23a37 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:44:20.765045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-71917912-a9f8-490f-931c-88d0bab23a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:20.799962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:20.866549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71917912-a9f8-490f-931c-88d0bab23a37 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:44:20.938998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a135b-a5c1-4513-abd6-a25549dcc2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:44:20.939590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a135b-a5c1-4513-abd6-a25549dcc2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:20.939865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a135b-a5c1-4513-abd6-a25549dcc2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:20.940151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a135b-a5c1-4513-abd6-a25549dcc2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:20.941736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9d3a135b-a5c1-4513-abd6-a25549dcc2f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:21.023030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:21.052650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a135b-a5c1-4513-abd6-a25549dcc2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:44:21.054109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a135b-a5c1-4513-abd6-a25549dcc2f1 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:44:21.072776 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 745/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:44:23.695624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee27714-c781-4b9a-9bf5-b358e216d60c None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:23.696188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee27714-c781-4b9a-9bf5-b358e216d60c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:23.696188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee27714-c781-4b9a-9bf5-b358e216d60c None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:23.697549 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 746/1491] 10.222.0.26 () {54 vars in 927 bytes} [Sat Oct 8 20:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:44:23.703531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24916956-eceb-4703-8078-7ffbe9cf43dd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:23.703976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24916956-eceb-4703-8078-7ffbe9cf43dd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:23.704068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24916956-eceb-4703-8078-7ffbe9cf43dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:23.769659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-24916956-eceb-4703-8078-7ffbe9cf43dd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:44:23.770781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-24916956-eceb-4703-8078-7ffbe9cf43dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:23.864226 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 746/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Oct 8 20:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:44:24.208023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee27714-c781-4b9a-9bf5-b358e216d60c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:44:24.209591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cee27714-c781-4b9a-9bf5-b358e216d60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:24.311444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee27714-c781-4b9a-9bf5-b358e216d60c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:44:24.383363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8fe0d-fca9-4ff3-ac9e-096aae2622ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:44:24.383956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8fe0d-fca9-4ff3-ac9e-096aae2622ed service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:24.384345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8fe0d-fca9-4ff3-ac9e-096aae2622ed service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:24.384619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8fe0d-fca9-4ff3-ac9e-096aae2622ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:24.386238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-87f8fe0d-fca9-4ff3-ac9e-096aae2622ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:24.394958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:24.498723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8fe0d-fca9-4ff3-ac9e-096aae2622ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:44:24.500165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8fe0d-fca9-4ff3-ac9e-096aae2622ed service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:44:24.517920 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 747/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:44:33.862661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=82 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:34.515643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=50 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:46.642922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46952c2-8b70-4728-b724-c74f0aa90526 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:46.643458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46952c2-8b70-4728-b724-c74f0aa90526 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:46.643458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46952c2-8b70-4728-b724-c74f0aa90526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:46.724464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a46952c2-8b70-4728-b724-c74f0aa90526 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:46.725678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a46952c2-8b70-4728-b724-c74f0aa90526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:46.828436 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 747/1494] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:45:46.836437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c764a-a27e-4eba-b1e3-7725e564ab35 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:46.836937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c764a-a27e-4eba-b1e3-7725e564ab35 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:46.837056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c764a-a27e-4eba-b1e3-7725e564ab35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:46.857858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9f8c764a-a27e-4eba-b1e3-7725e564ab35 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:46.859039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9f8c764a-a27e-4eba-b1e3-7725e564ab35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:46.867427 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 748/1495] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:46.872469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46952c2-8b70-4728-b724-c74f0aa90526 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:46.881998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46952c2-8b70-4728-b724-c74f0aa90526 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:46.887267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d394422-6525-4115-9188-41ffa7979f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:46.887862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d394422-6525-4115-9188-41ffa7979f2e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:46.888141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d394422-6525-4115-9188-41ffa7979f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:46.888413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d394422-6525-4115-9188-41ffa7979f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:46.889060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d394422-6525-4115-9188-41ffa7979f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:45:46.889402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d394422-6525-4115-9188-41ffa7979f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:46.890403 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-3d394422-6525-4115-9188-41ffa7979f2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:45:46.890403 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 20:45:46.890403 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 20:45:46.891286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d394422-6525-4115-9188-41ffa7979f2e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:46.902573 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 748/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:45:46.910616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c764a-a27e-4eba-b1e3-7725e564ab35 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:46.919498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c764a-a27e-4eba-b1e3-7725e564ab35 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:46.923980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d24535-9f4e-4eaf-90af-ececad23a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:46.924566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d24535-9f4e-4eaf-90af-ececad23a4cb admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:46.924838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d24535-9f4e-4eaf-90af-ececad23a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:46.925105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d24535-9f4e-4eaf-90af-ececad23a4cb admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:46.925748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d24535-9f4e-4eaf-90af-ececad23a4cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:46.927475 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-48d24535-9f4e-4eaf-90af-ececad23a4cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:45:46.927475 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 20:45:46.927475 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 20:45:46.928619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d24535-9f4e-4eaf-90af-ececad23a4cb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:46.966407 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 749/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:45:46 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:45:46.970515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d394422-6525-4115-9188-41ffa7979f2e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:46.980460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d394422-6525-4115-9188-41ffa7979f2e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:47.030664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:47.037800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9c2d-b0f0-46c2-a0eb-413a87643603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:47.038393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9c2d-b0f0-46c2-a0eb-413a87643603 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:47.038667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9c2d-b0f0-46c2-a0eb-413a87643603 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:47.038935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9c2d-b0f0-46c2-a0eb-413a87643603 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:47.039555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff9c2d-b0f0-46c2-a0eb-413a87643603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:47.040544 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-37ff9c2d-b0f0-46c2-a0eb-413a87643603 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:45:47.040544 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 20:45:47.040544 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 20:45:47.041795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff9c2d-b0f0-46c2-a0eb-413a87643603 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:47.062365 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 749/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:45:46 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:45:47.066591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d24535-9f4e-4eaf-90af-ececad23a4cb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:47.077252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d24535-9f4e-4eaf-90af-ececad23a4cb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:47.081824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65264320-c5ec-4b71-8018-7a2ad45768fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:47.082415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264320-c5ec-4b71-8018-7a2ad45768fb admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:47.082693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264320-c5ec-4b71-8018-7a2ad45768fb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:47.082962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264320-c5ec-4b71-8018-7a2ad45768fb admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:47.083608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65264320-c5ec-4b71-8018-7a2ad45768fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:47.084596 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-65264320-c5ec-4b71-8018-7a2ad45768fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:45:47.084596 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 20:45:47.084596 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 20:45:47.085505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65264320-c5ec-4b71-8018-7a2ad45768fb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:47.097844 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 750/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:45:47.101730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9c2d-b0f0-46c2-a0eb-413a87643603 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:47.112431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9c2d-b0f0-46c2-a0eb-413a87643603 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:47.116936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdab69-e2ec-4d90-9a9a-885fec994b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:47.117550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdab69-e2ec-4d90-9a9a-885fec994b83 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:47.117826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdab69-e2ec-4d90-9a9a-885fec994b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:47.118093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdab69-e2ec-4d90-9a9a-885fec994b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:47.118731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdab69-e2ec-4d90-9a9a-885fec994b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:47.120347 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-71bdab69-e2ec-4d90-9a9a-885fec994b83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:45:47.120347 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 20:45:47.120347 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 20:45:47.121230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdab69-e2ec-4d90-9a9a-885fec994b83 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:47.134275 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 750/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:45:47.138187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65264320-c5ec-4b71-8018-7a2ad45768fb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:47.147792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65264320-c5ec-4b71-8018-7a2ad45768fb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:47.152311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0eaa3-04b1-4855-ba79-50c24ef39001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:47.152996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0eaa3-04b1-4855-ba79-50c24ef39001 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:47.153252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0eaa3-04b1-4855-ba79-50c24ef39001 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:47.153526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0eaa3-04b1-4855-ba79-50c24ef39001 admin admin] PATH_INFO: `/v3/projects/70e7a33fa5eb4e90b08754cc6debb796/users/68fc8ec985924c33a92a357ba19a66ac/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:47.168099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0eaa3-04b1-4855-ba79-50c24ef39001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e7a33fa5eb4e90b08754cc6debb796, user_id=68fc8ec985924c33a92a357ba19a66ac, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:47.169106 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-38d0eaa3-04b1-4855-ba79-50c24ef39001 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:45:47.169106 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 20:45:47.169106 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 20:45:47.171029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0eaa3-04b1-4855-ba79-50c24ef39001 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:47.184413 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 751/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:45:47 2022] PUT /identity/v3/projects/70e7a33fa5eb4e90b08754cc6debb796/users/68fc8ec985924c33a92a357ba19a66ac/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:45:47.196832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac4b2c-46aa-44b7-8a6c-0f114f33033a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:47.197116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac4b2c-46aa-44b7-8a6c-0f114f33033a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:47.197438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac4b2c-46aa-44b7-8a6c-0f114f33033a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:47.224745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-22ac4b2c-46aa-44b7-8a6c-0f114f33033a None None] MFA Rules not processed for user `68fc8ec985924c33a92a357ba19a66ac`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:47.225992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-22ac4b2c-46aa-44b7-8a6c-0f114f33033a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:47.288313 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 751/1502] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:45:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:47.302068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe584-7f5c-461a-b509-5f7afa5f0baa None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:47.302351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe584-7f5c-461a-b509-5f7afa5f0baa None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:47.302627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe584-7f5c-461a-b509-5f7afa5f0baa None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:47.303944 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 752/1503] 10.222.0.26 () {54 vars in 963 bytes} [Sat Oct 8 20:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:45:47.309227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5d84c-2ed9-40f2-b35b-c4497ae042bb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:47.309521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5d84c-2ed9-40f2-b35b-c4497ae042bb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:47.309800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5d84c-2ed9-40f2-b35b-c4497ae042bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:47.368254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7cc5d84c-2ed9-40f2-b35b-c4497ae042bb None None] MFA Rules not processed for user `7885df3b2ae34969852f76fbc94a7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:47.369499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7cc5d84c-2ed9-40f2-b35b-c4497ae042bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:47.444410 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 752/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Sat Oct 8 20:45:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:47.452164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fe584-7f5c-461a-b509-5f7afa5f0baa None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:47.462405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fe584-7f5c-461a-b509-5f7afa5f0baa None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:47.466335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed23fa-3a95-49f3-b122-35b0b4777530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:47.466914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed23fa-3a95-49f3-b122-35b0b4777530 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:47.467186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed23fa-3a95-49f3-b122-35b0b4777530 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:47.467452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed23fa-3a95-49f3-b122-35b0b4777530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:47.475356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed23fa-3a95-49f3-b122-35b0b4777530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:47.476763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed23fa-3a95-49f3-b122-35b0b4777530 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:47.486776 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 753/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:45:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:45:47.531989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74416e7-7a12-44f5-a541-d0b3b8787a57 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:47.532276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74416e7-7a12-44f5-a541-d0b3b8787a57 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:47.532553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74416e7-7a12-44f5-a541-d0b3b8787a57 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:47.533843 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 753/1506] 10.222.0.26 () {52 vars in 830 bytes} [Sat Oct 8 20:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:45:47.537325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed23fa-3a95-49f3-b122-35b0b4777530 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:47.597984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed23fa-3a95-49f3-b122-35b0b4777530 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:47.602619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:47.603234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:47.603511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:47.603789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] PATH_INFO: `/v3/users/68fc8ec985924c33a92a357ba19a66ac` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:47.605562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fc8ec985924c33a92a357ba19a66ac)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:47.606829 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:45:47.606829 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 20:45:47.606829 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 20:45:47.608020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:47.676398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fc8ec985924c33a92a357ba19a66ac'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:45:47.690688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fc8ec985924c33a92a357ba19a66ac'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:45:47.691367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fc8ec985924c33a92a357ba19a66ac'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:45:47.692078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fc8ec985924c33a92a357ba19a66ac'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:45:47.714614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fc8ec985924c33a92a357ba19a66ac'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:45:47.718459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:47.732223 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 754/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:45:47 2022] DELETE /identity/v3/users/68fc8ec985924c33a92a357ba19a66ac => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:45:47.738919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea48a92-12c3-46fa-baac-7c3c2a444d60 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:47.739404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea48a92-12c3-46fa-baac-7c3c2a444d60 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:47.739562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea48a92-12c3-46fa-baac-7c3c2a444d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:47.759316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6ea48a92-12c3-46fa-baac-7c3c2a444d60 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:47.760504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6ea48a92-12c3-46fa-baac-7c3c2a444d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:47.770060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:47.820467 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 754/1508] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:47.829991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:47.831380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:47.909873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c111a5-c1bc-4114-8dfa-fb119b0ab98f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:47.913580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e4ae9-995f-4577-9fa7-ef7be72a420f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:47.914186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e4ae9-995f-4577-9fa7-ef7be72a420f service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:47.914470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e4ae9-995f-4577-9fa7-ef7be72a420f service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:47.914746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e4ae9-995f-4577-9fa7-ef7be72a420f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:47.923660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e4ae9-995f-4577-9fa7-ef7be72a420f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:47.925074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e4ae9-995f-4577-9fa7-ef7be72a420f service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:47.934446 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 755/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:45:48.290268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea48a92-12c3-46fa-baac-7c3c2a444d60 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:48.291735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6ea48a92-12c3-46fa-baac-7c3c2a444d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:48.303582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea48a92-12c3-46fa-baac-7c3c2a444d60 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:48.308555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e20e4-6390-433b-9760-abc608eecce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:48.309332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e20e4-6390-433b-9760-abc608eecce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:48.309607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e20e4-6390-433b-9760-abc608eecce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:48.309877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e20e4-6390-433b-9760-abc608eecce0 admin admin] PATH_INFO: `/v3/projects/70e7a33fa5eb4e90b08754cc6debb796` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:48.310978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e20e4-6390-433b-9760-abc608eecce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e7a33fa5eb4e90b08754cc6debb796)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:48.311985 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-2d0e20e4-6390-433b-9760-abc608eecce0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:45:48.311985 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 20:45:48.311985 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 20:45:48.313167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e20e4-6390-433b-9760-abc608eecce0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:48.373345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2d0e20e4-6390-433b-9760-abc608eecce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e7a33fa5eb4e90b08754cc6debb796', 'request_id': 'req-2d0e20e4-6390-433b-9760-abc608eecce0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:45:48.382017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2d0e20e4-6390-433b-9760-abc608eecce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e7a33fa5eb4e90b08754cc6debb796', 'request_id': 'req-2d0e20e4-6390-433b-9760-abc608eecce0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:45:48.388853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2d0e20e4-6390-433b-9760-abc608eecce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e7a33fa5eb4e90b08754cc6debb796', 'request_id': 'req-2d0e20e4-6390-433b-9760-abc608eecce0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:45:48.406417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2d0e20e4-6390-433b-9760-abc608eecce0 admin admin] The token cache is being invalidate because project 70e7a33fa5eb4e90b08754cc6debb796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:45:48.406723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2d0e20e4-6390-433b-9760-abc608eecce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:45:48.407351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2d0e20e4-6390-433b-9760-abc608eecce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:45:48.408911 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 755/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:45:48 2022] DELETE /identity/v3/projects/70e7a33fa5eb4e90b08754cc6debb796 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:45:57.930282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:58.403450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:49:16.400442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a43a3-48f4-499f-92e5-e65626552ce9 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:16.400968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a43a3-48f4-499f-92e5-e65626552ce9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:16.400968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a43a3-48f4-499f-92e5-e65626552ce9 None None] PATH_INFO: `/v3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:16.402303 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 756/1511] 10.222.0.50 () {54 vars in 925 bytes} [Sat Oct 8 20:49:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:49:16.409544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028915d-592f-4084-8a79-d53d588349db None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:16.409965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028915d-592f-4084-8a79-d53d588349db None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:16.410122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028915d-592f-4084-8a79-d53d588349db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:16.460002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c028915d-592f-4084-8a79-d53d588349db None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:49:16.461206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c028915d-592f-4084-8a79-d53d588349db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:49:16.532580 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 756/1512] 10.222.0.50 () {58 vars in 1015 bytes} [Sat Oct 8 20:49:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:49:18.622228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e8d75-f501-406f-94d3-8008d37018ef None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:18.622719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e8d75-f501-406f-94d3-8008d37018ef None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:18.622837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e8d75-f501-406f-94d3-8008d37018ef None None] PATH_INFO: `/v3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:18.624823 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 757/1513] 10.222.0.45 () {54 vars in 925 bytes} [Sat Oct 8 20:49:18 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:49:18.631865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ec0aa-de7f-4e64-88d5-0a3b8eb5a89c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:18.632321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ec0aa-de7f-4e64-88d5-0a3b8eb5a89c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:18.632422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ec0aa-de7f-4e64-88d5-0a3b8eb5a89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:18.652580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7e4ec0aa-de7f-4e64-88d5-0a3b8eb5a89c None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:49:18.653807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7e4ec0aa-de7f-4e64-88d5-0a3b8eb5a89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:49:18.662730 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 757/1514] 10.222.0.45 () {58 vars in 1015 bytes} [Sat Oct 8 20:49:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:49:20.244873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10086427-61a7-4f42-a75c-9bf0ec5b1f0d None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:20.245362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10086427-61a7-4f42-a75c-9bf0ec5b1f0d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:20.245500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10086427-61a7-4f42-a75c-9bf0ec5b1f0d None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:20.246790 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 758/1515] 10.222.0.26 () {54 vars in 961 bytes} [Sat Oct 8 20:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:49:20.251801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94b775-36df-4ed8-a507-9710e18d22ea None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:20.252255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94b775-36df-4ed8-a507-9710e18d22ea None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:20.252383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94b775-36df-4ed8-a507-9710e18d22ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:20.271987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2e94b775-36df-4ed8-a507-9710e18d22ea None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:49:20.273175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2e94b775-36df-4ed8-a507-9710e18d22ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:49:20.282499 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 758/1516] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Oct 8 20:49:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:49:20.290198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10086427-61a7-4f42-a75c-9bf0ec5b1f0d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:49:20.303242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10086427-61a7-4f42-a75c-9bf0ec5b1f0d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:49:20.308131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfd93a-f6c2-4e68-9d2c-300534e9f3d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:49:20.308714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfd93a-f6c2-4e68-9d2c-300534e9f3d6 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:20.308991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfd93a-f6c2-4e68-9d2c-300534e9f3d6 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:20.309294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfd93a-f6c2-4e68-9d2c-300534e9f3d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:20.317776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfd93a-f6c2-4e68-9d2c-300534e9f3d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:49:20.319314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfd93a-f6c2-4e68-9d2c-300534e9f3d6 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:49:20.329277 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 759/1517] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:49:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:49:22.498630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94b775-36df-4ed8-a507-9710e18d22ea None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:49:22.508460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94b775-36df-4ed8-a507-9710e18d22ea None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:49:22.513531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d681a5-bec1-46c8-a685-b9987eed2d1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:49:22.514117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d681a5-bec1-46c8-a685-b9987eed2d1d service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:22.514393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d681a5-bec1-46c8-a685-b9987eed2d1d service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:22.514665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d681a5-bec1-46c8-a685-b9987eed2d1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:22.522744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d681a5-bec1-46c8-a685-b9987eed2d1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:49:22.524316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d681a5-bec1-46c8-a685-b9987eed2d1d service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:49:22.534294 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 759/1518] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:49:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:49:30.324816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:49:32.530397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=56 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:49:53.728426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bad377-187f-4a44-9ff9-52ab104a0f1b None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:53.729009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bad377-187f-4a44-9ff9-52ab104a0f1b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:53.729009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bad377-187f-4a44-9ff9-52ab104a0f1b None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:53.730485 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 760/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:49:53.735443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a76b7c-a5c9-4e81-ba03-246643a71a65 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:53.735852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a76b7c-a5c9-4e81-ba03-246643a71a65 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:53.735997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a76b7c-a5c9-4e81-ba03-246643a71a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:53.755413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-47a76b7c-a5c9-4e81-ba03-246643a71a65 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:49:53.756637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-47a76b7c-a5c9-4e81-ba03-246643a71a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:49:53.814813 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 760/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:49:53.975305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bad377-187f-4a44-9ff9-52ab104a0f1b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:49:53.976997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-06bad377-187f-4a44-9ff9-52ab104a0f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:49:54.079461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bad377-187f-4a44-9ff9-52ab104a0f1b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:49:54.084782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1491efa-aca1-4b0f-b0ac-011673c84848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:49:54.085407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1491efa-aca1-4b0f-b0ac-011673c84848 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:54.085686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1491efa-aca1-4b0f-b0ac-011673c84848 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:54.085951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1491efa-aca1-4b0f-b0ac-011673c84848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:54.093803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1491efa-aca1-4b0f-b0ac-011673c84848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:49:54.095345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1491efa-aca1-4b0f-b0ac-011673c84848 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:49:54.104403 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 761/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:49:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:49:55.739883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe46128-36e6-4ce7-aa0e-c04bb0292765 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:55.740406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe46128-36e6-4ce7-aa0e-c04bb0292765 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:55.740406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe46128-36e6-4ce7-aa0e-c04bb0292765 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:55.741733 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:49:55.746574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9746f1e-fb2c-4970-860b-4c74aa1443d2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:55.747015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9746f1e-fb2c-4970-860b-4c74aa1443d2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:55.747150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9746f1e-fb2c-4970-860b-4c74aa1443d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:55.767270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a9746f1e-fb2c-4970-860b-4c74aa1443d2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:49:55.768448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a9746f1e-fb2c-4970-860b-4c74aa1443d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:49:55.776111 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:49:55.938558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe46128-36e6-4ce7-aa0e-c04bb0292765 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:49:55.952715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe46128-36e6-4ce7-aa0e-c04bb0292765 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:49:55.958062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaea4d-c343-4843-80d4-f943d716a749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:49:55.958666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaea4d-c343-4843-80d4-f943d716a749 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:55.958940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaea4d-c343-4843-80d4-f943d716a749 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:55.959206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaea4d-c343-4843-80d4-f943d716a749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:55.966997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbaea4d-c343-4843-80d4-f943d716a749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:49:55.968577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbaea4d-c343-4843-80d4-f943d716a749 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:49:55.977685 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 762/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:50:00.190431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be681115-29a0-4fed-96c8-2e3188249a0e None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:00.190965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be681115-29a0-4fed-96c8-2e3188249a0e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:00.190965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be681115-29a0-4fed-96c8-2e3188249a0e None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:00.192362 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:50:00.197574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886dd9f-f93e-4b24-8cff-fcac8ebd7bd8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:00.198003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886dd9f-f93e-4b24-8cff-fcac8ebd7bd8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:00.198233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886dd9f-f93e-4b24-8cff-fcac8ebd7bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:00.218029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4886dd9f-f93e-4b24-8cff-fcac8ebd7bd8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:50:00.219851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4886dd9f-f93e-4b24-8cff-fcac8ebd7bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:50:00.227663 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:50:00.567120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be681115-29a0-4fed-96c8-2e3188249a0e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:50:00.568817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-be681115-29a0-4fed-96c8-2e3188249a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:50:00.625513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be681115-29a0-4fed-96c8-2e3188249a0e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:50:00.628990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4693dc-3f2b-4ea6-a829-3c74a96e9c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:50:00.629614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4693dc-3f2b-4ea6-a829-3c74a96e9c75 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:00.629889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4693dc-3f2b-4ea6-a829-3c74a96e9c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:00.630157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4693dc-3f2b-4ea6-a829-3c74a96e9c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:00.638835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4693dc-3f2b-4ea6-a829-3c74a96e9c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:50:00.640222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4693dc-3f2b-4ea6-a829-3c74a96e9c75 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:50:00.650162 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 764/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:50:03.002209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c156a-df26-4fff-ae3d-de91f75dd1c6 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:03.002787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c156a-df26-4fff-ae3d-de91f75dd1c6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:03.002787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c156a-df26-4fff-ae3d-de91f75dd1c6 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:03.004131 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:50:03.009412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873171d-b949-47f6-b0ce-def843a91fd9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:03.009806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873171d-b949-47f6-b0ce-def843a91fd9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:03.009957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873171d-b949-47f6-b0ce-def843a91fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:03.029822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4873171d-b949-47f6-b0ce-def843a91fd9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:50:03.031009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4873171d-b949-47f6-b0ce-def843a91fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:50:03.038843 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:50:03.388365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c156a-df26-4fff-ae3d-de91f75dd1c6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:50:03.399226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c156a-df26-4fff-ae3d-de91f75dd1c6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:50:03.402675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0ac80-706b-48e6-8bf4-5b6028b30aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:50:03.403262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0ac80-706b-48e6-8bf4-5b6028b30aae service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:03.403539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0ac80-706b-48e6-8bf4-5b6028b30aae service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:03.403812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0ac80-706b-48e6-8bf4-5b6028b30aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:03.412469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0ac80-706b-48e6-8bf4-5b6028b30aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:50:03.413928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0ac80-706b-48e6-8bf4-5b6028b30aae service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:50:03.423875 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 765/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:50:13.024441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=78 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:50:13.419256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=42 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:50:57.398061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05800f1-048b-4d88-9dc4-32bbb3f6611e None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:57.398614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05800f1-048b-4d88-9dc4-32bbb3f6611e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:57.398614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05800f1-048b-4d88-9dc4-32bbb3f6611e None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:57.399914 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 766/1531] 10.222.0.26 () {54 vars in 921 bytes} [Sat Oct 8 20:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:50:57.404981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163c62e-9f23-4a41-9ab1-597e47743fb2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:57.405438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163c62e-9f23-4a41-9ab1-597e47743fb2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:57.405703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163c62e-9f23-4a41-9ab1-597e47743fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:57.426327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3163c62e-9f23-4a41-9ab1-597e47743fb2 None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:50:57.427579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3163c62e-9f23-4a41-9ab1-597e47743fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:50:57.436387 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 766/1532] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:50:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:07.420714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:30.807531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11685b52-fed8-47ae-814f-255745f0a3a0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:30.808108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11685b52-fed8-47ae-814f-255745f0a3a0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:30.808108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11685b52-fed8-47ae-814f-255745f0a3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:30.834847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-11685b52-fed8-47ae-814f-255745f0a3a0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:30.836069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-11685b52-fed8-47ae-814f-255745f0a3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:30.847951 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 767/1533] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:30.857834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680ae7e-79d1-4db2-bde1-b6a2098e6b8d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:30.858384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680ae7e-79d1-4db2-bde1-b6a2098e6b8d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:30.858384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680ae7e-79d1-4db2-bde1-b6a2098e6b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:30.882254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4680ae7e-79d1-4db2-bde1-b6a2098e6b8d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:30.883490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4680ae7e-79d1-4db2-bde1-b6a2098e6b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:30.896784 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 767/1534] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:30.901586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11685b52-fed8-47ae-814f-255745f0a3a0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:30.911174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d4932-dcd2-4b5e-bcb3-0ed6c1551d81 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:30.911563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d4932-dcd2-4b5e-bcb3-0ed6c1551d81 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:30.911733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d4932-dcd2-4b5e-bcb3-0ed6c1551d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:30.916232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11685b52-fed8-47ae-814f-255745f0a3a0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:30.930168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25466e-733e-40b2-a4d3-9e3ccd2d26e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:30.930821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25466e-733e-40b2-a4d3-9e3ccd2d26e1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:30.931099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25466e-733e-40b2-a4d3-9e3ccd2d26e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:30.931369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25466e-733e-40b2-a4d3-9e3ccd2d26e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:30.932047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25466e-733e-40b2-a4d3-9e3ccd2d26e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:30.932367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25466e-733e-40b2-a4d3-9e3ccd2d26e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:30.938171 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-fd25466e-733e-40b2-a4d3-9e3ccd2d26e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:51:30.938171 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 20:51:30.938171 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 20:51:30.939093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25466e-733e-40b2-a4d3-9e3ccd2d26e1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:30.962265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cc8d4932-dcd2-4b5e-bcb3-0ed6c1551d81 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:30.966904 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 768/1535] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:30.967648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cc8d4932-dcd2-4b5e-bcb3-0ed6c1551d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:30.975238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25466e-733e-40b2-a4d3-9e3ccd2d26e1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:30.987903 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 768/1536] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:30.993215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25466e-733e-40b2-a4d3-9e3ccd2d26e1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:30.997278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ea8d6-2ab9-4a7d-9cbc-4780cc72b3ec None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:30.997564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ea8d6-2ab9-4a7d-9cbc-4780cc72b3ec None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:30.997842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ea8d6-2ab9-4a7d-9cbc-4780cc72b3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.007976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f893d9-27da-4c6d-83fc-6c1614bd6ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.008610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f893d9-27da-4c6d-83fc-6c1614bd6ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.008886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f893d9-27da-4c6d-83fc-6c1614bd6ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.009158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f893d9-27da-4c6d-83fc-6c1614bd6ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.009828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f893d9-27da-4c6d-83fc-6c1614bd6ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.011753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f893d9-27da-4c6d-83fc-6c1614bd6ff8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.037890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0e2ea8d6-2ab9-4a7d-9cbc-4780cc72b3ec None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:31.039123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0e2ea8d6-2ab9-4a7d-9cbc-4780cc72b3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:31.061275 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 769/1537] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:51:31.065756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ea8d6-2ab9-4a7d-9cbc-4780cc72b3ec None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.078564 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 769/1538] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:30 2022] POST /identity/v3/projects => generated 397 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:31.081289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ea8d6-2ab9-4a7d-9cbc-4780cc72b3ec None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.086313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f893d9-27da-4c6d-83fc-6c1614bd6ff8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.159852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a44b-653c-4928-b93b-5ab1c5905ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.160655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a44b-653c-4928-b93b-5ab1c5905ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.161042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a44b-653c-4928-b93b-5ab1c5905ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.161521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a44b-653c-4928-b93b-5ab1c5905ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.162220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0a44b-653c-4928-b93b-5ab1c5905ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:31.162628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0a44b-653c-4928-b93b-5ab1c5905ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.164336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0a44b-653c-4928-b93b-5ab1c5905ea8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.182757 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 770/1539] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:51:31.186798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a44b-653c-4928-b93b-5ab1c5905ea8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.197796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a44b-653c-4928-b93b-5ab1c5905ea8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.203616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27882bc2-16ff-4e2f-8197-edc2e4a52bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.204312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27882bc2-16ff-4e2f-8197-edc2e4a52bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.204798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27882bc2-16ff-4e2f-8197-edc2e4a52bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.205143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27882bc2-16ff-4e2f-8197-edc2e4a52bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.205949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27882bc2-16ff-4e2f-8197-edc2e4a52bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.206961 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-27882bc2-16ff-4e2f-8197-edc2e4a52bd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:51:31.206961 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 20:51:31.206961 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 20:51:31.208335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27882bc2-16ff-4e2f-8197-edc2e4a52bd1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.222355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f893d9-27da-4c6d-83fc-6c1614bd6ff8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.233319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacc1de-ab7b-47e9-8671-781b9e4010fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.234256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacc1de-ab7b-47e9-8671-781b9e4010fd admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.235017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacc1de-ab7b-47e9-8671-781b9e4010fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.235480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacc1de-ab7b-47e9-8671-781b9e4010fd admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.236320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacc1de-ab7b-47e9-8671-781b9e4010fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.237603 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-6bacc1de-ab7b-47e9-8671-781b9e4010fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:51:31.237603 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 20:51:31.237603 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 20:51:31.239218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacc1de-ab7b-47e9-8671-781b9e4010fd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.254573 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 771/1540] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:51:31.254573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36579669-ef5e-4ed1-94bf-2d1a787f891d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.254573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36579669-ef5e-4ed1-94bf-2d1a787f891d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.254573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36579669-ef5e-4ed1-94bf-2d1a787f891d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.276772 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 770/1541] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:31.278002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacc1de-ab7b-47e9-8671-781b9e4010fd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.290365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-36579669-ef5e-4ed1-94bf-2d1a787f891d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:31.291661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-36579669-ef5e-4ed1-94bf-2d1a787f891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:31.295245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacc1de-ab7b-47e9-8671-781b9e4010fd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.364021 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 772/1542] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:51:31.366328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cbbe1-389e-4203-a79e-f3bae1f19a1d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.366614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cbbe1-389e-4203-a79e-f3bae1f19a1d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.366890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cbbe1-389e-4203-a79e-f3bae1f19a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.403821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c39cbbe1-389e-4203-a79e-f3bae1f19a1d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:31.405303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c39cbbe1-389e-4203-a79e-f3bae1f19a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:31.414233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840c81c-9ce1-4eb6-8037-f7238a420008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.414233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840c81c-9ce1-4eb6-8037-f7238a420008 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.414233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840c81c-9ce1-4eb6-8037-f7238a420008 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.414233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840c81c-9ce1-4eb6-8037-f7238a420008 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.414602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840c81c-9ce1-4eb6-8037-f7238a420008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.415565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840c81c-9ce1-4eb6-8037-f7238a420008 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.418398 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 773/1543] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:31.419515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cbbe1-389e-4203-a79e-f3bae1f19a1d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.431213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cbbe1-389e-4203-a79e-f3bae1f19a1d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.439545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33cab9-0314-472d-a41e-8482433ab19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.440436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33cab9-0314-472d-a41e-8482433ab19a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.440875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33cab9-0314-472d-a41e-8482433ab19a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.441436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33cab9-0314-472d-a41e-8482433ab19a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.442414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33cab9-0314-472d-a41e-8482433ab19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.444262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33cab9-0314-472d-a41e-8482433ab19a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.444482 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 771/1544] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:31.446231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e8ea6-8d47-4859-8ace-9c43bbb6e317 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.446655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e8ea6-8d47-4859-8ace-9c43bbb6e317 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.446959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e8ea6-8d47-4859-8ace-9c43bbb6e317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.458757 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 774/1545] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:31.460451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908ea9-1f6e-4a36-9c85-ba636b4a3196 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.460976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908ea9-1f6e-4a36-9c85-ba636b4a3196 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.461525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908ea9-1f6e-4a36-9c85-ba636b4a3196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.471128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a74e8ea6-8d47-4859-8ace-9c43bbb6e317 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:31.472325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a74e8ea6-8d47-4859-8ace-9c43bbb6e317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:31.480574 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 772/1546] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:31.481962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db98d0-5062-47e7-bf73-85f113edc914 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.482391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db98d0-5062-47e7-bf73-85f113edc914 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.482802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db98d0-5062-47e7-bf73-85f113edc914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.489438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7a908ea9-1f6e-4a36-9c85-ba636b4a3196 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:31.489438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7a908ea9-1f6e-4a36-9c85-ba636b4a3196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:31.498483 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 775/1547] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:31.499751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea771-aafa-4710-8b94-c81f962721c9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.500649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea771-aafa-4710-8b94-c81f962721c9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.500924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea771-aafa-4710-8b94-c81f962721c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.511088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f2db98d0-5062-47e7-bf73-85f113edc914 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:31.512295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f2db98d0-5062-47e7-bf73-85f113edc914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:31.521141 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 773/1548] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:31.521489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1ddea771-aafa-4710-8b94-c81f962721c9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:31.521836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db98d0-5062-47e7-bf73-85f113edc914 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.522664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1ddea771-aafa-4710-8b94-c81f962721c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:31.530884 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 776/1549] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:31.532593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d370f3-0004-4105-b1e9-4dc654eba40d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.532879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d370f3-0004-4105-b1e9-4dc654eba40d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.533155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d370f3-0004-4105-b1e9-4dc654eba40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.534112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db98d0-5062-47e7-bf73-85f113edc914 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.539048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4b6a0-aadf-417d-bc8a-d5b47f484ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.539638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4b6a0-aadf-417d-bc8a-d5b47f484ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.539915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4b6a0-aadf-417d-bc8a-d5b47f484ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.540188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4b6a0-aadf-417d-bc8a-d5b47f484ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.540824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4b6a0-aadf-417d-bc8a-d5b47f484ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.542574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4b6a0-aadf-417d-bc8a-d5b47f484ec3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.552626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-71d370f3-0004-4105-b1e9-4dc654eba40d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:31.552994 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 774/1550] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:31.553984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-71d370f3-0004-4105-b1e9-4dc654eba40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:31.554247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0d1f0-92fd-42e7-833f-c887e5be3514 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.554533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0d1f0-92fd-42e7-833f-c887e5be3514 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.554803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0d1f0-92fd-42e7-833f-c887e5be3514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.562321 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 777/1551] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:31.563548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d370f3-0004-4105-b1e9-4dc654eba40d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.573418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d370f3-0004-4105-b1e9-4dc654eba40d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.574195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c6e0d1f0-92fd-42e7-833f-c887e5be3514 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:31.575408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c6e0d1f0-92fd-42e7-833f-c887e5be3514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:31.578005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f085f00-cec4-4061-b55e-9be25500110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.578597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f085f00-cec4-4061-b55e-9be25500110c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.578874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f085f00-cec4-4061-b55e-9be25500110c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.579171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f085f00-cec4-4061-b55e-9be25500110c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.579804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f085f00-cec4-4061-b55e-9be25500110c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.581414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f085f00-cec4-4061-b55e-9be25500110c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.583369 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 775/1552] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:31.584656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a59a22-eaa5-4359-ba40-ece84f22408f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.584924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a59a22-eaa5-4359-ba40-ece84f22408f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.585216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a59a22-eaa5-4359-ba40-ece84f22408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.597456 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 778/1553] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:31.598903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15883734-646d-47d5-a7bc-9835d2c35354 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.599187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15883734-646d-47d5-a7bc-9835d2c35354 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.599460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15883734-646d-47d5-a7bc-9835d2c35354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.600657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:31.606546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-35a59a22-eaa5-4359-ba40-ece84f22408f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:31.608751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:31.608869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-35a59a22-eaa5-4359-ba40-ece84f22408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:31.617340 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 776/1554] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:31.618082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a59a22-eaa5-4359-ba40-ece84f22408f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.620974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-15883734-646d-47d5-a7bc-9835d2c35354 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:31.622230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-15883734-646d-47d5-a7bc-9835d2c35354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:31.627311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a59a22-eaa5-4359-ba40-ece84f22408f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.630214 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 779/1555] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:31.630972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15883734-646d-47d5-a7bc-9835d2c35354 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.631865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa83380-8d52-4363-bde9-4a4c839b8706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.632450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa83380-8d52-4363-bde9-4a4c839b8706 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.632724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa83380-8d52-4363-bde9-4a4c839b8706 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.632992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa83380-8d52-4363-bde9-4a4c839b8706 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.633666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa83380-8d52-4363-bde9-4a4c839b8706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:31.633965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa83380-8d52-4363-bde9-4a4c839b8706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.635529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa83380-8d52-4363-bde9-4a4c839b8706 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.643358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15883734-646d-47d5-a7bc-9835d2c35354 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.651220 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 777/1556] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:31.651354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10b476-fbd5-435c-a6e4-3eeb88b09433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.651451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa83380-8d52-4363-bde9-4a4c839b8706 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.651536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b476-fbd5-435c-a6e4-3eeb88b09433 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.651536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b476-fbd5-435c-a6e4-3eeb88b09433 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.651536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b476-fbd5-435c-a6e4-3eeb88b09433 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.651536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10b476-fbd5-435c-a6e4-3eeb88b09433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:31.651536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10b476-fbd5-435c-a6e4-3eeb88b09433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.651536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10b476-fbd5-435c-a6e4-3eeb88b09433 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.670564 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 780/1557] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:31.670753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa83380-8d52-4363-bde9-4a4c839b8706 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.670836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55759ed-b1e8-4ed1-99a7-759c695e7675 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.670836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55759ed-b1e8-4ed1-99a7-759c695e7675 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.670836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55759ed-b1e8-4ed1-99a7-759c695e7675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.675225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31684d-32b5-4a49-895e-96c7cc4ccbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.675819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31684d-32b5-4a49-895e-96c7cc4ccbfe admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.676096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31684d-32b5-4a49-895e-96c7cc4ccbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.677178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31684d-32b5-4a49-895e-96c7cc4ccbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.677178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31684d-32b5-4a49-895e-96c7cc4ccbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.678586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31684d-32b5-4a49-895e-96c7cc4ccbfe admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.687122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e55759ed-b1e8-4ed1-99a7-759c695e7675 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:31.688302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e55759ed-b1e8-4ed1-99a7-759c695e7675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:31.689125 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 778/1558] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:31.690378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eae3c4-a74a-4075-8dad-0b3b76c82634 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.690664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eae3c4-a74a-4075-8dad-0b3b76c82634 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.691015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eae3c4-a74a-4075-8dad-0b3b76c82634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.698300 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 781/1559] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:31.699054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55759ed-b1e8-4ed1-99a7-759c695e7675 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.708891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55759ed-b1e8-4ed1-99a7-759c695e7675 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.710597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-73eae3c4-a74a-4075-8dad-0b3b76c82634 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:31.711785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-73eae3c4-a74a-4075-8dad-0b3b76c82634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:31.713691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a7101-8c6e-48b6-a8be-9046c2a47441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.714361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a7101-8c6e-48b6-a8be-9046c2a47441 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.714766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a7101-8c6e-48b6-a8be-9046c2a47441 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.715044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a7101-8c6e-48b6-a8be-9046c2a47441 admin admin] PATH_INFO: `/v3/projects/00af80afb88c49e9b6eba209af379f30/users/9fcee064c12e41079f451f88ab235dde/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.721295 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 779/1560] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:31.722086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eae3c4-a74a-4075-8dad-0b3b76c82634 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.730666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a7101-8c6e-48b6-a8be-9046c2a47441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00af80afb88c49e9b6eba209af379f30, user_id=9fcee064c12e41079f451f88ab235dde, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.731687 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-457a7101-8c6e-48b6-a8be-9046c2a47441 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:51:31.731687 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 20:51:31.731687 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 20:51:31.732809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eae3c4-a74a-4075-8dad-0b3b76c82634 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.733651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a7101-8c6e-48b6-a8be-9046c2a47441 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.738399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0950229-cb5d-4d06-9f63-e5da43951333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.739044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0950229-cb5d-4d06-9f63-e5da43951333 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.739357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0950229-cb5d-4d06-9f63-e5da43951333 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.739691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0950229-cb5d-4d06-9f63-e5da43951333 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.740455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0950229-cb5d-4d06-9f63-e5da43951333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:31.740856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0950229-cb5d-4d06-9f63-e5da43951333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.742621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0950229-cb5d-4d06-9f63-e5da43951333 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.749622 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 782/1561] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:31 2022] PUT /identity/v3/projects/00af80afb88c49e9b6eba209af379f30/users/9fcee064c12e41079f451f88ab235dde/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:31.752336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a7101-8c6e-48b6-a8be-9046c2a47441 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.766399 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 780/1562] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:31.767555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0950229-cb5d-4d06-9f63-e5da43951333 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.783725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0950229-cb5d-4d06-9f63-e5da43951333 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.814144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a7101-8c6e-48b6-a8be-9046c2a47441 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.818989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fe680-d98f-4a1e-a603-9a8080b56828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.819587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fe680-d98f-4a1e-a603-9a8080b56828 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.819894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fe680-d98f-4a1e-a603-9a8080b56828 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.820166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fe680-d98f-4a1e-a603-9a8080b56828 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.820809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fe680-d98f-4a1e-a603-9a8080b56828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:31.821111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fe680-d98f-4a1e-a603-9a8080b56828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.822738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fe680-d98f-4a1e-a603-9a8080b56828 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.833985 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 783/1563] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:31.834752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fe680-d98f-4a1e-a603-9a8080b56828 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.841553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef060a-a78c-48ed-8308-ea75455dde5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.842161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef060a-a78c-48ed-8308-ea75455dde5f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.842437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef060a-a78c-48ed-8308-ea75455dde5f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.842706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef060a-a78c-48ed-8308-ea75455dde5f admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.843333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef060a-a78c-48ed-8308-ea75455dde5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.844170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fe680-d98f-4a1e-a603-9a8080b56828 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.845306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef060a-a78c-48ed-8308-ea75455dde5f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.848672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488697d-f082-4985-96f7-8c8cedb0323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.849274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488697d-f082-4985-96f7-8c8cedb0323d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.849556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488697d-f082-4985-96f7-8c8cedb0323d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.849857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488697d-f082-4985-96f7-8c8cedb0323d admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.850800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488697d-f082-4985-96f7-8c8cedb0323d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.852289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488697d-f082-4985-96f7-8c8cedb0323d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.873589 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 781/1564] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:31.874371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef060a-a78c-48ed-8308-ea75455dde5f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.890709 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 784/1565] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:31.891545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488697d-f082-4985-96f7-8c8cedb0323d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.943658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef060a-a78c-48ed-8308-ea75455dde5f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.948334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43078c1-55d2-4146-90a9-04f0052e2487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.948990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43078c1-55d2-4146-90a9-04f0052e2487 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.949302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43078c1-55d2-4146-90a9-04f0052e2487 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.949579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43078c1-55d2-4146-90a9-04f0052e2487 admin admin] PATH_INFO: `/v3/projects/71f548b0b4c7465d9092382907f3f7b7/users/456b3248db044f03b200cfb5cc09c905/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.952275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488697d-f082-4985-96f7-8c8cedb0323d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.956913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765241d7-e157-4e4f-95e6-4aa8876876d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:31.957547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765241d7-e157-4e4f-95e6-4aa8876876d5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.957830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765241d7-e157-4e4f-95e6-4aa8876876d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.958105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765241d7-e157-4e4f-95e6-4aa8876876d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:31.958747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765241d7-e157-4e4f-95e6-4aa8876876d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:31.959053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765241d7-e157-4e4f-95e6-4aa8876876d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.960634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765241d7-e157-4e4f-95e6-4aa8876876d5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.964209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43078c1-55d2-4146-90a9-04f0052e2487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f548b0b4c7465d9092382907f3f7b7, user_id=456b3248db044f03b200cfb5cc09c905, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:31.966863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43078c1-55d2-4146-90a9-04f0052e2487 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:31.972210 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 785/1566] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:31.973169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765241d7-e157-4e4f-95e6-4aa8876876d5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:31.983719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765241d7-e157-4e4f-95e6-4aa8876876d5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:31.986546 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 782/1567] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:31 2022] PUT /identity/v3/projects/71f548b0b4c7465d9092382907f3f7b7/users/456b3248db044f03b200cfb5cc09c905/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:31.987790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2e443-ecc4-4df1-b6ce-fa461d8e5d5c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:31.988082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2e443-ecc4-4df1-b6ce-fa461d8e5d5c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:31.988355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2e443-ecc4-4df1-b6ce-fa461d8e5d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.011431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:32.016627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b6a2e443-ecc4-4df1-b6ce-fa461d8e5d5c None None] MFA Rules not processed for user `9fcee064c12e41079f451f88ab235dde`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:32.017886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b6a2e443-ecc4-4df1-b6ce-fa461d8e5d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:32.029688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:32.052535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4f091-fe3a-4b55-b25a-971f5d33bf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.053154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4f091-fe3a-4b55-b25a-971f5d33bf20 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.053471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4f091-fe3a-4b55-b25a-971f5d33bf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.053749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4f091-fe3a-4b55-b25a-971f5d33bf20 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.054419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4f091-fe3a-4b55-b25a-971f5d33bf20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:32.054725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4f091-fe3a-4b55-b25a-971f5d33bf20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.056338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4f091-fe3a-4b55-b25a-971f5d33bf20 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.068010 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 786/1568] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:32.068767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4f091-fe3a-4b55-b25a-971f5d33bf20 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.079402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4f091-fe3a-4b55-b25a-971f5d33bf20 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.084083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef201b-1951-4246-87cf-20d32a870bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.084681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef201b-1951-4246-87cf-20d32a870bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.084974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef201b-1951-4246-87cf-20d32a870bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.085259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef201b-1951-4246-87cf-20d32a870bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.089624 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 783/1569] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:32.089774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef201b-1951-4246-87cf-20d32a870bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.089856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2e443-ecc4-4df1-b6ce-fa461d8e5d5c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.089928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef201b-1951-4246-87cf-20d32a870bf8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.099608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2e443-ecc4-4df1-b6ce-fa461d8e5d5c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.104671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902345fb-866f-4a60-9b9d-195fbce3e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.105336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902345fb-866f-4a60-9b9d-195fbce3e8bb admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.105625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902345fb-866f-4a60-9b9d-195fbce3e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.105969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902345fb-866f-4a60-9b9d-195fbce3e8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.106736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902345fb-866f-4a60-9b9d-195fbce3e8bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.109024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902345fb-866f-4a60-9b9d-195fbce3e8bb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.117474 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 787/1570] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/projects => generated 395 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.118121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef201b-1951-4246-87cf-20d32a870bf8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.140003 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 784/1571] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.142073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902345fb-866f-4a60-9b9d-195fbce3e8bb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.180861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef201b-1951-4246-87cf-20d32a870bf8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.206078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902345fb-866f-4a60-9b9d-195fbce3e8bb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.210631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa390-9d64-40a0-a8e3-70ebe5e9d7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.211232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa390-9d64-40a0-a8e3-70ebe5e9d7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.211506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa390-9d64-40a0-a8e3-70ebe5e9d7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.211776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa390-9d64-40a0-a8e3-70ebe5e9d7f3 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.212400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaa390-9d64-40a0-a8e3-70ebe5e9d7f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.214422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaa390-9d64-40a0-a8e3-70ebe5e9d7f3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.236261 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 785/1572] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.236985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa390-9d64-40a0-a8e3-70ebe5e9d7f3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.242214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeb5af-b878-4a5c-a5c4-0ac5e41c8cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.242822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeb5af-b878-4a5c-a5c4-0ac5e41c8cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.243102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeb5af-b878-4a5c-a5c4-0ac5e41c8cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.243373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeb5af-b878-4a5c-a5c4-0ac5e41c8cd1 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.244183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeb5af-b878-4a5c-a5c4-0ac5e41c8cd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.246665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeb5af-b878-4a5c-a5c4-0ac5e41c8cd1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.248400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa390-9d64-40a0-a8e3-70ebe5e9d7f3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.253552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1907f74-81bd-419d-a2d2-15723a5c46e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.254127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1907f74-81bd-419d-a2d2-15723a5c46e4 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.254407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1907f74-81bd-419d-a2d2-15723a5c46e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.254665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1907f74-81bd-419d-a2d2-15723a5c46e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.255273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1907f74-81bd-419d-a2d2-15723a5c46e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.257128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1907f74-81bd-419d-a2d2-15723a5c46e4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.268356 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 788/1573] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.269615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75680e3b-dacd-4399-ba35-219d590244eb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.269894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75680e3b-dacd-4399-ba35-219d590244eb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.270161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75680e3b-dacd-4399-ba35-219d590244eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.290021 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 786/1574] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/projects => generated 409 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.290762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1907f74-81bd-419d-a2d2-15723a5c46e4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.298085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-75680e3b-dacd-4399-ba35-219d590244eb None None] MFA Rules not processed for user `456b3248db044f03b200cfb5cc09c905`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:32.299302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-75680e3b-dacd-4399-ba35-219d590244eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:32.315627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:32.352537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1907f74-81bd-419d-a2d2-15723a5c46e4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.357135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ecb6b-a739-49ca-a11e-ecd575775efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.357768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ecb6b-a739-49ca-a11e-ecd575775efd admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.358040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ecb6b-a739-49ca-a11e-ecd575775efd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.358305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ecb6b-a739-49ca-a11e-ecd575775efd admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.358924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ecb6b-a739-49ca-a11e-ecd575775efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.361238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ecb6b-a739-49ca-a11e-ecd575775efd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.364949 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 789/1575] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:32.365605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:32.366466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75680e3b-dacd-4399-ba35-219d590244eb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.378012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75680e3b-dacd-4399-ba35-219d590244eb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.382729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9b6f7-ce10-4725-9a50-af6cdfb083ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.383312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9b6f7-ce10-4725-9a50-af6cdfb083ec admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.383591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9b6f7-ce10-4725-9a50-af6cdfb083ec admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.383939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9b6f7-ce10-4725-9a50-af6cdfb083ec admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.384604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9b6f7-ce10-4725-9a50-af6cdfb083ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.386792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9b6f7-ce10-4725-9a50-af6cdfb083ec admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.398391 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 787/1576] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.398391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ecb6b-a739-49ca-a11e-ecd575775efd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.415538 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 790/1577] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/projects => generated 397 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.416949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9b6f7-ce10-4725-9a50-af6cdfb083ec admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.461679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ecb6b-a739-49ca-a11e-ecd575775efd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.478058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9b6f7-ce10-4725-9a50-af6cdfb083ec admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.483687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab61799-bfc8-42d8-9521-b122cf46d611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.485062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61799-bfc8-42d8-9521-b122cf46d611 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.485367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61799-bfc8-42d8-9521-b122cf46d611 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.485745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61799-bfc8-42d8-9521-b122cf46d611 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.486260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab61799-bfc8-42d8-9521-b122cf46d611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.488345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab61799-bfc8-42d8-9521-b122cf46d611 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.511120 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 791/1578] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.512185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab61799-bfc8-42d8-9521-b122cf46d611 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.521677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab61799-bfc8-42d8-9521-b122cf46d611 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.525749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201856d-0c9c-42dc-bbb0-585edd4bafff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.526203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74a809-82af-4649-8621-6aa20ff1b9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.526413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201856d-0c9c-42dc-bbb0-585edd4bafff admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.526621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201856d-0c9c-42dc-bbb0-585edd4bafff admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.526773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74a809-82af-4649-8621-6aa20ff1b9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.526918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201856d-0c9c-42dc-bbb0-585edd4bafff admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.527071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74a809-82af-4649-8621-6aa20ff1b9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.527321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74a809-82af-4649-8621-6aa20ff1b9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.527525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201856d-0c9c-42dc-bbb0-585edd4bafff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.527951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74a809-82af-4649-8621-6aa20ff1b9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.529473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201856d-0c9c-42dc-bbb0-585edd4bafff admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.529592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74a809-82af-4649-8621-6aa20ff1b9f3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.539479 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 792/1579] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:32.542259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74a809-82af-4649-8621-6aa20ff1b9f3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.556077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74a809-82af-4649-8621-6aa20ff1b9f3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.556236 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 788/1580] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.556236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201856d-0c9c-42dc-bbb0-585edd4bafff admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.561001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879163f-a325-4487-8aae-093c4670b680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.561637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879163f-a325-4487-8aae-093c4670b680 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.561918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879163f-a325-4487-8aae-093c4670b680 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.562190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879163f-a325-4487-8aae-093c4670b680 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.563442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879163f-a325-4487-8aae-093c4670b680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.565020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879163f-a325-4487-8aae-093c4670b680 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.566952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201856d-0c9c-42dc-bbb0-585edd4bafff admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.571843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b622fc1-b8e8-4d61-89cf-d1ecced8fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.572442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b622fc1-b8e8-4d61-89cf-d1ecced8fb8d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.572721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b622fc1-b8e8-4d61-89cf-d1ecced8fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.572991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b622fc1-b8e8-4d61-89cf-d1ecced8fb8d admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.573752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b622fc1-b8e8-4d61-89cf-d1ecced8fb8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.575710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b622fc1-b8e8-4d61-89cf-d1ecced8fb8d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.576124 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 793/1581] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:32.576887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879163f-a325-4487-8aae-093c4670b680 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.588254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879163f-a325-4487-8aae-093c4670b680 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.593071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d3cdf-0929-4076-a7c0-fad1deaf992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.593729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d3cdf-0929-4076-a7c0-fad1deaf992f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.594005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d3cdf-0929-4076-a7c0-fad1deaf992f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.594274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d3cdf-0929-4076-a7c0-fad1deaf992f admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.594885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d3cdf-0929-4076-a7c0-fad1deaf992f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.596800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d3cdf-0929-4076-a7c0-fad1deaf992f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.601312 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 789/1582] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/users => generated 305 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.601312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b622fc1-b8e8-4d61-89cf-d1ecced8fb8d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.608532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b622fc1-b8e8-4d61-89cf-d1ecced8fb8d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.613871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ad9a8-0b3d-4b50-8a0a-486e167e52f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.614483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ad9a8-0b3d-4b50-8a0a-486e167e52f1 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.614955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ad9a8-0b3d-4b50-8a0a-486e167e52f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.615236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ad9a8-0b3d-4b50-8a0a-486e167e52f1 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.615935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ad9a8-0b3d-4b50-8a0a-486e167e52f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.618076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ad9a8-0b3d-4b50-8a0a-486e167e52f1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.627509 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 794/1583] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.627509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d3cdf-0929-4076-a7c0-fad1deaf992f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.640215 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 790/1584] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/users => generated 291 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.641268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ad9a8-0b3d-4b50-8a0a-486e167e52f1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.652412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ad9a8-0b3d-4b50-8a0a-486e167e52f1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.673800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:32.692322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d3cdf-0929-4076-a7c0-fad1deaf992f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.696256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:32.696978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb41e7-8044-4972-bfb7-d44e27d35794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.697608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb41e7-8044-4972-bfb7-d44e27d35794 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.697966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb41e7-8044-4972-bfb7-d44e27d35794 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.698322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb41e7-8044-4972-bfb7-d44e27d35794 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.698823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb41e7-8044-4972-bfb7-d44e27d35794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.700833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb41e7-8044-4972-bfb7-d44e27d35794 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.710233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef149102-6e47-4193-8768-38647f929a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.710835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef149102-6e47-4193-8768-38647f929a43 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.711113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef149102-6e47-4193-8768-38647f929a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.711380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef149102-6e47-4193-8768-38647f929a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.712018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef149102-6e47-4193-8768-38647f929a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.713752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef149102-6e47-4193-8768-38647f929a43 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.721644 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 795/1585] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/users => generated 305 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.722448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb41e7-8044-4972-bfb7-d44e27d35794 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.724108 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 791/1586] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:32.724948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef149102-6e47-4193-8768-38647f929a43 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.731816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb41e7-8044-4972-bfb7-d44e27d35794 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.735703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef149102-6e47-4193-8768-38647f929a43 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.737091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d42357-bae4-471f-a10e-e7250e8c543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.737706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d42357-bae4-471f-a10e-e7250e8c543b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.737987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d42357-bae4-471f-a10e-e7250e8c543b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.738255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d42357-bae4-471f-a10e-e7250e8c543b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.738881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d42357-bae4-471f-a10e-e7250e8c543b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.740463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d42357-bae4-471f-a10e-e7250e8c543b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.740736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d3bb6-d880-4c36-8afb-74daf2c9934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.741358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d3bb6-d880-4c36-8afb-74daf2c9934d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.741755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d3bb6-d880-4c36-8afb-74daf2c9934d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.742029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d3bb6-d880-4c36-8afb-74daf2c9934d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.742660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d3bb6-d880-4c36-8afb-74daf2c9934d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.744233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d3bb6-d880-4c36-8afb-74daf2c9934d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.751006 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 796/1587] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:32.751792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d42357-bae4-471f-a10e-e7250e8c543b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.758228 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 792/1588] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:32.758228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d3bb6-d880-4c36-8afb-74daf2c9934d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.765306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d42357-bae4-471f-a10e-e7250e8c543b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.766210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d3bb6-d880-4c36-8afb-74daf2c9934d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.770809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d52f5-1891-401d-a20b-0f7e6f46f21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.771309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e59eb-89e3-48bc-8658-ccdc91f95d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.771526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d52f5-1891-401d-a20b-0f7e6f46f21e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.771808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d52f5-1891-401d-a20b-0f7e6f46f21e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.771900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e59eb-89e3-48bc-8658-ccdc91f95d43 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.772082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d52f5-1891-401d-a20b-0f7e6f46f21e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.772179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e59eb-89e3-48bc-8658-ccdc91f95d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.772431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e59eb-89e3-48bc-8658-ccdc91f95d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.772717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d52f5-1891-401d-a20b-0f7e6f46f21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.773064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e59eb-89e3-48bc-8658-ccdc91f95d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.774314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d52f5-1891-401d-a20b-0f7e6f46f21e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.774668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e59eb-89e3-48bc-8658-ccdc91f95d43 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.784799 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 797/1589] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:32.785604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d52f5-1891-401d-a20b-0f7e6f46f21e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.786632 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 793/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:32.787572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e59eb-89e3-48bc-8658-ccdc91f95d43 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.796163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d52f5-1891-401d-a20b-0f7e6f46f21e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.797921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e59eb-89e3-48bc-8658-ccdc91f95d43 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.801388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55e451-10fc-4ea2-bd80-d342b6ea2f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.801979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55e451-10fc-4ea2-bd80-d342b6ea2f7b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.802254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55e451-10fc-4ea2-bd80-d342b6ea2f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.802455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecebb2-ff70-4aee-83a9-9360b53f1467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.802554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55e451-10fc-4ea2-bd80-d342b6ea2f7b admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.803049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecebb2-ff70-4aee-83a9-9360b53f1467 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.803133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55e451-10fc-4ea2-bd80-d342b6ea2f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.803324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecebb2-ff70-4aee-83a9-9360b53f1467 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.803647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecebb2-ff70-4aee-83a9-9360b53f1467 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.804272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecebb2-ff70-4aee-83a9-9360b53f1467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.804980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55e451-10fc-4ea2-bd80-d342b6ea2f7b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.805874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecebb2-ff70-4aee-83a9-9360b53f1467 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.815918 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 794/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:32.816716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecebb2-ff70-4aee-83a9-9360b53f1467 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.826771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecebb2-ff70-4aee-83a9-9360b53f1467 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.831341 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 798/1592] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:32 2022] POST /identity/v3/users => generated 298 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:32.831341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55e451-10fc-4ea2-bd80-d342b6ea2f7b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.831557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f9bc6-d2ba-485a-ba81-962a91808728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.832042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9bc6-d2ba-485a-ba81-962a91808728 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.832317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9bc6-d2ba-485a-ba81-962a91808728 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.832584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9bc6-d2ba-485a-ba81-962a91808728 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.833240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f9bc6-d2ba-485a-ba81-962a91808728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.834805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f9bc6-d2ba-485a-ba81-962a91808728 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.838640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55e451-10fc-4ea2-bd80-d342b6ea2f7b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.844032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163748cf-b34c-4363-84ce-f6dc4344445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.844615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163748cf-b34c-4363-84ce-f6dc4344445c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.844890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163748cf-b34c-4363-84ce-f6dc4344445c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.845157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163748cf-b34c-4363-84ce-f6dc4344445c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.848627 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 795/1593] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:32.849072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163748cf-b34c-4363-84ce-f6dc4344445c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.849171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f9bc6-d2ba-485a-ba81-962a91808728 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.849300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163748cf-b34c-4363-84ce-f6dc4344445c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.855893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f9bc6-d2ba-485a-ba81-962a91808728 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.861358 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 799/1594] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:32.861358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163748cf-b34c-4363-84ce-f6dc4344445c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.862103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35917c3e-0ad1-4581-859d-4e84e99bc563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.862827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917c3e-0ad1-4581-859d-4e84e99bc563 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.863109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917c3e-0ad1-4581-859d-4e84e99bc563 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.863384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917c3e-0ad1-4581-859d-4e84e99bc563 admin admin] PATH_INFO: `/v3/projects/aaf0d79d755c496bacff7792e9d1a64b/users/ec2fb9dce59140eebf0a02fdf479a1d8/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.869750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163748cf-b34c-4363-84ce-f6dc4344445c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.874597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789df6e2-89e3-4acb-9de8-c40a970ec083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.875239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789df6e2-89e3-4acb-9de8-c40a970ec083 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.875520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789df6e2-89e3-4acb-9de8-c40a970ec083 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.875791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789df6e2-89e3-4acb-9de8-c40a970ec083 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.876426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789df6e2-89e3-4acb-9de8-c40a970ec083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.877852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35917c3e-0ad1-4581-859d-4e84e99bc563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf0d79d755c496bacff7792e9d1a64b, user_id=ec2fb9dce59140eebf0a02fdf479a1d8, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.878049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789df6e2-89e3-4acb-9de8-c40a970ec083 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.880475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35917c3e-0ad1-4581-859d-4e84e99bc563 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.888918 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 800/1595] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:32.889793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789df6e2-89e3-4acb-9de8-c40a970ec083 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.900337 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 796/1596] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:32 2022] PUT /identity/v3/projects/aaf0d79d755c496bacff7792e9d1a64b/users/ec2fb9dce59140eebf0a02fdf479a1d8/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:32.900618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789df6e2-89e3-4acb-9de8-c40a970ec083 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.901235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35917c3e-0ad1-4581-859d-4e84e99bc563 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.965973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51dc13e-67cc-4c8f-a5b6-10b287dac6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.966658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dc13e-67cc-4c8f-a5b6-10b287dac6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.966941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dc13e-67cc-4c8f-a5b6-10b287dac6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.967217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dc13e-67cc-4c8f-a5b6-10b287dac6f5 admin admin] PATH_INFO: `/v3/projects/d024396aef784f3291630c426a828cf0/users/d8da7d5210cf42bda150d342ff207bbd/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.967316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35917c3e-0ad1-4581-859d-4e84e99bc563 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.972733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933ebe1-7ccc-4c38-b82d-e806f91bd04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:32.973373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ebe1-7ccc-4c38-b82d-e806f91bd04a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:32.973654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ebe1-7ccc-4c38-b82d-e806f91bd04a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:32.973925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ebe1-7ccc-4c38-b82d-e806f91bd04a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:32.974657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933ebe1-7ccc-4c38-b82d-e806f91bd04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.976244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933ebe1-7ccc-4c38-b82d-e806f91bd04a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.981609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51dc13e-67cc-4c8f-a5b6-10b287dac6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d024396aef784f3291630c426a828cf0, user_id=d8da7d5210cf42bda150d342ff207bbd, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:32.985020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51dc13e-67cc-4c8f-a5b6-10b287dac6f5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:32.990393 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 797/1597] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:32.990393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933ebe1-7ccc-4c38-b82d-e806f91bd04a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:32.997721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933ebe1-7ccc-4c38-b82d-e806f91bd04a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:32.998709 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 801/1598] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:32 2022] PUT /identity/v3/projects/d024396aef784f3291630c426a828cf0/users/d8da7d5210cf42bda150d342ff207bbd/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:32.999464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51dc13e-67cc-4c8f-a5b6-10b287dac6f5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.057960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:33.063808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ee65b-bd6d-4f89-a9d5-863863bdef9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.064426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ee65b-bd6d-4f89-a9d5-863863bdef9e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.064704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ee65b-bd6d-4f89-a9d5-863863bdef9e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.065002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ee65b-bd6d-4f89-a9d5-863863bdef9e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.065780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ee65b-bd6d-4f89-a9d5-863863bdef9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.067604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ee65b-bd6d-4f89-a9d5-863863bdef9e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.069955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51dc13e-67cc-4c8f-a5b6-10b287dac6f5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:33.075161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21516b54-7730-4bf8-9259-613166bb8daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.075790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21516b54-7730-4bf8-9259-613166bb8daf admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.076064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21516b54-7730-4bf8-9259-613166bb8daf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.076332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21516b54-7730-4bf8-9259-613166bb8daf admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.076966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21516b54-7730-4bf8-9259-613166bb8daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.078616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21516b54-7730-4bf8-9259-613166bb8daf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.081031 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 798/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:33.082064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ee65b-bd6d-4f89-a9d5-863863bdef9e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.091723 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 802/1600] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:33.091723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21516b54-7730-4bf8-9259-613166bb8daf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.091965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ee65b-bd6d-4f89-a9d5-863863bdef9e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:33.096663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708dc9d-e656-45b8-86c9-4423992bf75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.097336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708dc9d-e656-45b8-86c9-4423992bf75a admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.097613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708dc9d-e656-45b8-86c9-4423992bf75a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.097881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708dc9d-e656-45b8-86c9-4423992bf75a admin admin] PATH_INFO: `/v3/projects/8ab2cecd5e434869b2ed2bd7692feb27/users/67d65cc462394a38bc4dd6c2f65f671e/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.100152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:33.100405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21516b54-7730-4bf8-9259-613166bb8daf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:33.105874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b77905-d0ee-4a3e-86ba-9a01726f0143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.106514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b77905-d0ee-4a3e-86ba-9a01726f0143 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.106788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b77905-d0ee-4a3e-86ba-9a01726f0143 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.107054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b77905-d0ee-4a3e-86ba-9a01726f0143 admin admin] PATH_INFO: `/v3/projects/d7e38a3e604b4b0a82db824aa872aef3/users/27df69ae40444039af536faf5d884284/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.115755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708dc9d-e656-45b8-86c9-4423992bf75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab2cecd5e434869b2ed2bd7692feb27, user_id=67d65cc462394a38bc4dd6c2f65f671e, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.118429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708dc9d-e656-45b8-86c9-4423992bf75a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.123538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b77905-d0ee-4a3e-86ba-9a01726f0143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e38a3e604b4b0a82db824aa872aef3, user_id=27df69ae40444039af536faf5d884284, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.126482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b77905-d0ee-4a3e-86ba-9a01726f0143 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.131207 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 799/1601] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:33 2022] PUT /identity/v3/projects/8ab2cecd5e434869b2ed2bd7692feb27/users/67d65cc462394a38bc4dd6c2f65f671e/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:33.132185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708dc9d-e656-45b8-86c9-4423992bf75a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.141426 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 803/1602] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:33 2022] PUT /identity/v3/projects/d7e38a3e604b4b0a82db824aa872aef3/users/27df69ae40444039af536faf5d884284/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:33.142822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6f58e-fc85-4518-9f7b-7af2bd6f30ed None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.143196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6f58e-fc85-4518-9f7b-7af2bd6f30ed None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.143476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6f58e-fc85-4518-9f7b-7af2bd6f30ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.173931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-92c6f58e-fc85-4518-9f7b-7af2bd6f30ed None None] MFA Rules not processed for user `ec2fb9dce59140eebf0a02fdf479a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:33.175188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-92c6f58e-fc85-4518-9f7b-7af2bd6f30ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:33.196111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708dc9d-e656-45b8-86c9-4423992bf75a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:33.239664 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 804/1603] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:33.243917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6f58e-fc85-4518-9f7b-7af2bd6f30ed None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.254144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097f641-3e78-42d4-a755-ee8e836f7e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.254807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097f641-3e78-42d4-a755-ee8e836f7e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.255084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097f641-3e78-42d4-a755-ee8e836f7e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.255351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097f641-3e78-42d4-a755-ee8e836f7e53 admin admin] PATH_INFO: `/v3/projects/0eae5cc31fc7412292ec30a394e28863/users/61756ba79b6e4b7e96b93e16abcd0676/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.271533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097f641-3e78-42d4-a755-ee8e836f7e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eae5cc31fc7412292ec30a394e28863, user_id=61756ba79b6e4b7e96b93e16abcd0676, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.274230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097f641-3e78-42d4-a755-ee8e836f7e53 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.288704 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 800/1604] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:33 2022] PUT /identity/v3/projects/0eae5cc31fc7412292ec30a394e28863/users/61756ba79b6e4b7e96b93e16abcd0676/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:33.289981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e370c5e-d11e-488f-b8b3-5f38e8a6af07 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.290838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e370c5e-d11e-488f-b8b3-5f38e8a6af07 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.291117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e370c5e-d11e-488f-b8b3-5f38e8a6af07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.306905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6f58e-fc85-4518-9f7b-7af2bd6f30ed None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:33.319529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9e370c5e-d11e-488f-b8b3-5f38e8a6af07 None None] MFA Rules not processed for user `d8da7d5210cf42bda150d342ff207bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:33.320747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9e370c5e-d11e-488f-b8b3-5f38e8a6af07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:33.363163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c057a67-d9ec-40c6-8c54-a5ae7096097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.364057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c057a67-d9ec-40c6-8c54-a5ae7096097e admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.364345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c057a67-d9ec-40c6-8c54-a5ae7096097e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.364654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c057a67-d9ec-40c6-8c54-a5ae7096097e admin admin] PATH_INFO: `/v3/projects/47654280a88d4269a3289e9acf6d005b/users/2e4e944ad6104c7ebb9fbdccc45818ee/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.367852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:33.380795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c057a67-d9ec-40c6-8c54-a5ae7096097e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47654280a88d4269a3289e9acf6d005b, user_id=2e4e944ad6104c7ebb9fbdccc45818ee, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.383679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c057a67-d9ec-40c6-8c54-a5ae7096097e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.388172 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 801/1605] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:33.390147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e370c5e-d11e-488f-b8b3-5f38e8a6af07 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.397577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:33.398399 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 805/1606] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:33 2022] PUT /identity/v3/projects/47654280a88d4269a3289e9acf6d005b/users/2e4e944ad6104c7ebb9fbdccc45818ee/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:33.399149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c057a67-d9ec-40c6-8c54-a5ae7096097e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.405119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e370c5e-d11e-488f-b8b3-5f38e8a6af07 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:33.461607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78ce8c-a92d-4f24-a8b8-301177b5e127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.462266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ce8c-a92d-4f24-a8b8-301177b5e127 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.462544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ce8c-a92d-4f24-a8b8-301177b5e127 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.462851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ce8c-a92d-4f24-a8b8-301177b5e127 admin admin] PATH_INFO: `/v3/projects/8720ff987d064701bfc63c45aaa05a47/users/704f5aa685f34b77b6918d12490b524a/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.468615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c057a67-d9ec-40c6-8c54-a5ae7096097e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:33.474235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22b97c-2fd5-485c-8cca-a4d262fef8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.475123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b97c-2fd5-485c-8cca-a4d262fef8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.475406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b97c-2fd5-485c-8cca-a4d262fef8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.475687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b97c-2fd5-485c-8cca-a4d262fef8f5 admin admin] PATH_INFO: `/v3/projects/ada4d7331157492ba501523521422ebf/users/5f043192a2e648ee88e8960381a454a3/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.482009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78ce8c-a92d-4f24-a8b8-301177b5e127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8720ff987d064701bfc63c45aaa05a47, user_id=704f5aa685f34b77b6918d12490b524a, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.485476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78ce8c-a92d-4f24-a8b8-301177b5e127 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.493309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22b97c-2fd5-485c-8cca-a4d262fef8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada4d7331157492ba501523521422ebf, user_id=5f043192a2e648ee88e8960381a454a3, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.495963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22b97c-2fd5-485c-8cca-a4d262fef8f5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.500981 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 802/1607] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:33 2022] PUT /identity/v3/projects/8720ff987d064701bfc63c45aaa05a47/users/704f5aa685f34b77b6918d12490b524a/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:33.501914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78ce8c-a92d-4f24-a8b8-301177b5e127 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.521216 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 806/1608] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:33 2022] PUT /identity/v3/projects/ada4d7331157492ba501523521422ebf/users/5f043192a2e648ee88e8960381a454a3/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:33.522983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb9dd2-a510-45e7-9932-acb8db0ef605 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.523396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb9dd2-a510-45e7-9932-acb8db0ef605 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.523776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb9dd2-a510-45e7-9932-acb8db0ef605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.552986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7ddb9dd2-a510-45e7-9932-acb8db0ef605 None None] MFA Rules not processed for user `67d65cc462394a38bc4dd6c2f65f671e`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:33.554228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7ddb9dd2-a510-45e7-9932-acb8db0ef605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:33.564222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78ce8c-a92d-4f24-a8b8-301177b5e127 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:33.619660 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 807/1609] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:33.620474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb9dd2-a510-45e7-9932-acb8db0ef605 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.624090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b8b4f-3c56-41ad-8079-665b32469e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.624701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b8b4f-3c56-41ad-8079-665b32469e9b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.625008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b8b4f-3c56-41ad-8079-665b32469e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.625302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b8b4f-3c56-41ad-8079-665b32469e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.625937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b8b4f-3c56-41ad-8079-665b32469e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.627513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b8b4f-3c56-41ad-8079-665b32469e9b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.632420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb9dd2-a510-45e7-9932-acb8db0ef605 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:33.637216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec157a-97ff-48be-9cba-12a640e27a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.637379 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 803/1610] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:33.637886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec157a-97ff-48be-9cba-12a640e27a28 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.638171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec157a-97ff-48be-9cba-12a640e27a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.638441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec157a-97ff-48be-9cba-12a640e27a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.638877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d645b-50dc-42c0-acc4-6d76837bc6da None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.639061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec157a-97ff-48be-9cba-12a640e27a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.639348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d645b-50dc-42c0-acc4-6d76837bc6da None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.639713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d645b-50dc-42c0-acc4-6d76837bc6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.641018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec157a-97ff-48be-9cba-12a640e27a28 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.668322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8f7d645b-50dc-42c0-acc4-6d76837bc6da None None] MFA Rules not processed for user `61756ba79b6e4b7e96b93e16abcd0676`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:33.669177 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 808/1611] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:33 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:33.669565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f7d645b-50dc-42c0-acc4-6d76837bc6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:33.670077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec157a-97ff-48be-9cba-12a640e27a28 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.689020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:33.710093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:33.735208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec157a-97ff-48be-9cba-12a640e27a28 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:33.739904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd1fc4-4aa6-4491-914c-1d67c6c291f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.740506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd1fc4-4aa6-4491-914c-1d67c6c291f8 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.740634 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 804/1612] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:33.744256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd1fc4-4aa6-4491-914c-1d67c6c291f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.744256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd1fc4-4aa6-4491-914c-1d67c6c291f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.744256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd1fc4-4aa6-4491-914c-1d67c6c291f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.744490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf23b-33c3-4bdd-9a10-f4bcdf864bea None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.744490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf23b-33c3-4bdd-9a10-f4bcdf864bea None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.744490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf23b-33c3-4bdd-9a10-f4bcdf864bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.744712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd1fc4-4aa6-4491-914c-1d67c6c291f8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.772623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8fbbf23b-33c3-4bdd-9a10-f4bcdf864bea None None] MFA Rules not processed for user `2e4e944ad6104c7ebb9fbdccc45818ee`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:33.773908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8fbbf23b-33c3-4bdd-9a10-f4bcdf864bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:33.777927 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 809/1613] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:33 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:33.779332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c181f8c-47ea-49cb-9a40-4a3b3d1d43de None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.779681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c181f8c-47ea-49cb-9a40-4a3b3d1d43de None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.780048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c181f8c-47ea-49cb-9a40-4a3b3d1d43de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.807257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9c181f8c-47ea-49cb-9a40-4a3b3d1d43de None None] MFA Rules not processed for user `704f5aa685f34b77b6918d12490b524a`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:33.808488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9c181f8c-47ea-49cb-9a40-4a3b3d1d43de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:33.842354 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 805/1614] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:33.843947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbf23b-33c3-4bdd-9a10-f4bcdf864bea None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.854458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbf23b-33c3-4bdd-9a10-f4bcdf864bea None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:33.876972 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 810/1615] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:33.881333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c181f8c-47ea-49cb-9a40-4a3b3d1d43de None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.912003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c436d-f169-4919-9c50-7677a431abef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.912618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c436d-f169-4919-9c50-7677a431abef admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.912895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c436d-f169-4919-9c50-7677a431abef admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.913177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c436d-f169-4919-9c50-7677a431abef admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.914470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c436d-f169-4919-9c50-7677a431abef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.916067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c436d-f169-4919-9c50-7677a431abef admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.926291 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 806/1616] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:33.927052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c436d-f169-4919-9c50-7677a431abef admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.936289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c436d-f169-4919-9c50-7677a431abef admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:33.942153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa535146-5914-4e60-882b-67caef45b2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.942771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa535146-5914-4e60-882b-67caef45b2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.943050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa535146-5914-4e60-882b-67caef45b2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.943332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa535146-5914-4e60-882b-67caef45b2f8 admin admin] PATH_INFO: `/v3/projects/d7e38a3e604b4b0a82db824aa872aef3/users/27df69ae40444039af536faf5d884284/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.944129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c181f8c-47ea-49cb-9a40-4a3b3d1d43de None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:33.945214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa535146-5914-4e60-882b-67caef45b2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e38a3e604b4b0a82db824aa872aef3, user_id=27df69ae40444039af536faf5d884284, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.947810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa535146-5914-4e60-882b-67caef45b2f8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.948599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87b505-c850-45b5-8c57-33c2556c1f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:33.949214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87b505-c850-45b5-8c57-33c2556c1f71 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:33.949496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87b505-c850-45b5-8c57-33c2556c1f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:33.949763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87b505-c850-45b5-8c57-33c2556c1f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:33.950381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87b505-c850-45b5-8c57-33c2556c1f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:33.952380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87b505-c850-45b5-8c57-33c2556c1f71 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:33.958158 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 807/1617] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:33 2022] PUT /identity/v3/projects/d7e38a3e604b4b0a82db824aa872aef3/users/27df69ae40444039af536faf5d884284/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:33.958929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa535146-5914-4e60-882b-67caef45b2f8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.979999 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 811/1618] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:33 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:33.981003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87b505-c850-45b5-8c57-33c2556c1f71 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:33.999104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:34.024383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:34.029706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa535146-5914-4e60-882b-67caef45b2f8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.052137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87b505-c850-45b5-8c57-33c2556c1f71 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.056743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347cfc0-92a2-4e52-b4e4-a96ac9c2b445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.057389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347cfc0-92a2-4e52-b4e4-a96ac9c2b445 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.057664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347cfc0-92a2-4e52-b4e4-a96ac9c2b445 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.057931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347cfc0-92a2-4e52-b4e4-a96ac9c2b445 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.058548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347cfc0-92a2-4e52-b4e4-a96ac9c2b445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.060428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347cfc0-92a2-4e52-b4e4-a96ac9c2b445 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.089785 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 812/1619] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:33 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:34.089785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347cfc0-92a2-4e52-b4e4-a96ac9c2b445 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.090798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba87ee-a572-4428-aa21-b0d364e7b30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.091416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba87ee-a572-4428-aa21-b0d364e7b30f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.091695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba87ee-a572-4428-aa21-b0d364e7b30f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.091968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba87ee-a572-4428-aa21-b0d364e7b30f admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.092589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba87ee-a572-4428-aa21-b0d364e7b30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.094563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba87ee-a572-4428-aa21-b0d364e7b30f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.120236 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 808/1620] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:33 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:34.120236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba87ee-a572-4428-aa21-b0d364e7b30f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.128156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba87ee-a572-4428-aa21-b0d364e7b30f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.155319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347cfc0-92a2-4e52-b4e4-a96ac9c2b445 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.159973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125132af-9b38-4e7f-a3a9-3f6f17f67875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.160576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125132af-9b38-4e7f-a3a9-3f6f17f67875 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.160861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125132af-9b38-4e7f-a3a9-3f6f17f67875 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.161133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125132af-9b38-4e7f-a3a9-3f6f17f67875 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.161784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125132af-9b38-4e7f-a3a9-3f6f17f67875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.163725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125132af-9b38-4e7f-a3a9-3f6f17f67875 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.183866 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 813/1621] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:34 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:34.184661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125132af-9b38-4e7f-a3a9-3f6f17f67875 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.189544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5145ae-8213-44b3-babd-43bdfb7047fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.190232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5145ae-8213-44b3-babd-43bdfb7047fe admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.190510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5145ae-8213-44b3-babd-43bdfb7047fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.190780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5145ae-8213-44b3-babd-43bdfb7047fe admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.191531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5145ae-8213-44b3-babd-43bdfb7047fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.193548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5145ae-8213-44b3-babd-43bdfb7047fe admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.221031 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 809/1622] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:34 2022] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:34.225037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5145ae-8213-44b3-babd-43bdfb7047fe admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.243279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125132af-9b38-4e7f-a3a9-3f6f17f67875 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.276955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:34.289312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5145ae-8213-44b3-babd-43bdfb7047fe admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.291194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96b9d2-3050-414c-8cf8-2a106e55f00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.291805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96b9d2-3050-414c-8cf8-2a106e55f00e service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.292083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96b9d2-3050-414c-8cf8-2a106e55f00e service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.292360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96b9d2-3050-414c-8cf8-2a106e55f00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.294340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e095bc-8a09-4b32-9161-ac5a7b84ffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.295070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e095bc-8a09-4b32-9161-ac5a7b84ffa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.295477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e095bc-8a09-4b32-9161-ac5a7b84ffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.295848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e095bc-8a09-4b32-9161-ac5a7b84ffa6 admin admin] PATH_INFO: `/v3/projects/ada4d7331157492ba501523521422ebf/users/5f043192a2e648ee88e8960381a454a3/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.298429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e095bc-8a09-4b32-9161-ac5a7b84ffa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada4d7331157492ba501523521422ebf, user_id=5f043192a2e648ee88e8960381a454a3, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.301026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e095bc-8a09-4b32-9161-ac5a7b84ffa6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.310772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:34.311725 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 810/1623] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:34 2022] PUT /identity/v3/projects/ada4d7331157492ba501523521422ebf/users/5f043192a2e648ee88e8960381a454a3/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:34.312966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7485477-0ac9-416c-a8b1-fb913296bade None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.313272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7485477-0ac9-416c-a8b1-fb913296bade None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.313548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7485477-0ac9-416c-a8b1-fb913296bade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.341243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f7485477-0ac9-416c-a8b1-fb913296bade None None] MFA Rules not processed for user `27df69ae40444039af536faf5d884284`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:34.342551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f7485477-0ac9-416c-a8b1-fb913296bade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:34.357079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96b9d2-3050-414c-8cf8-2a106e55f00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.358546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96b9d2-3050-414c-8cf8-2a106e55f00e service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.368118 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 814/1624] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:34.368891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96b9d2-3050-414c-8cf8-2a106e55f00e service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.379218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96b9d2-3050-414c-8cf8-2a106e55f00e service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.426381 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 811/1625] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:34.427350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7485477-0ac9-416c-a8b1-fb913296bade None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.444885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae86752-bf1e-4d32-afeb-146272e3a95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.445399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae86752-bf1e-4d32-afeb-146272e3a95c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.445681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae86752-bf1e-4d32-afeb-146272e3a95c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.445954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae86752-bf1e-4d32-afeb-146272e3a95c admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.446696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae86752-bf1e-4d32-afeb-146272e3a95c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.449911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae86752-bf1e-4d32-afeb-146272e3a95c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.482592 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 815/1626] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:34 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:34.482592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae86752-bf1e-4d32-afeb-146272e3a95c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.494330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae86752-bf1e-4d32-afeb-146272e3a95c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.499359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b830ee-7713-4e95-b83e-4c2486cff2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.500099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b830ee-7713-4e95-b83e-4c2486cff2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.500437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b830ee-7713-4e95-b83e-4c2486cff2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.500778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b830ee-7713-4e95-b83e-4c2486cff2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.501564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b830ee-7713-4e95-b83e-4c2486cff2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.503216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b830ee-7713-4e95-b83e-4c2486cff2b6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.507556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7485477-0ac9-416c-a8b1-fb913296bade None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.512715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2fdac-4e02-4d2d-bc7a-ff0e0ce04c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.513359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2fdac-4e02-4d2d-bc7a-ff0e0ce04c80 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.513666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2fdac-4e02-4d2d-bc7a-ff0e0ce04c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.513916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2fdac-4e02-4d2d-bc7a-ff0e0ce04c80 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.514645 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 816/1627] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:34.514747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2fdac-4e02-4d2d-bc7a-ff0e0ce04c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.516548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2fdac-4e02-4d2d-bc7a-ff0e0ce04c80 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.518731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b830ee-7713-4e95-b83e-4c2486cff2b6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.528964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b830ee-7713-4e95-b83e-4c2486cff2b6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.534499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b16e7e-87f2-47e8-8b25-6b2713678324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.535119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b16e7e-87f2-47e8-8b25-6b2713678324 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.535398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b16e7e-87f2-47e8-8b25-6b2713678324 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.535665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b16e7e-87f2-47e8-8b25-6b2713678324 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.536292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b16e7e-87f2-47e8-8b25-6b2713678324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.537910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b16e7e-87f2-47e8-8b25-6b2713678324 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.540266 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 812/1628] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:34 2022] POST /identity/v3/users => generated 303 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:34.541198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2fdac-4e02-4d2d-bc7a-ff0e0ce04c80 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.550573 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 817/1629] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:34.551663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2fdac-4e02-4d2d-bc7a-ff0e0ce04c80 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.551945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b08d6-ac61-4c96-90e7-2d89af25e5a6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.552226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b08d6-ac61-4c96-90e7-2d89af25e5a6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.552494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b08d6-ac61-4c96-90e7-2d89af25e5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.560557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a9871-006f-459f-9964-a7c2409596c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.561300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a9871-006f-459f-9964-a7c2409596c3 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.562318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a9871-006f-459f-9964-a7c2409596c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.562318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a9871-006f-459f-9964-a7c2409596c3 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.562694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a9871-006f-459f-9964-a7c2409596c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.564672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a9871-006f-459f-9964-a7c2409596c3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.583357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bb5b08d6-ac61-4c96-90e7-2d89af25e5a6 None None] MFA Rules not processed for user `5f043192a2e648ee88e8960381a454a3`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:34.584191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bb5b08d6-ac61-4c96-90e7-2d89af25e5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:34.590473 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 813/1630] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:34 2022] POST /identity/v3/users => generated 310 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:34.591900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fb72c-eab8-4400-b0af-6045a121547c None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.592371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fb72c-eab8-4400-b0af-6045a121547c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.592714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fb72c-eab8-4400-b0af-6045a121547c None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.594680 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 814/1631] 10.222.0.26 () {54 vars in 961 bytes} [Sat Oct 8 20:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:34.595445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fb72c-eab8-4400-b0af-6045a121547c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.611264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fb72c-eab8-4400-b0af-6045a121547c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.616828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e5927-f558-4b5e-b605-72b1c3154ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.617539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e5927-f558-4b5e-b605-72b1c3154ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.617948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e5927-f558-4b5e-b605-72b1c3154ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.618847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e5927-f558-4b5e-b605-72b1c3154ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.619036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e5927-f558-4b5e-b605-72b1c3154ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.620851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e5927-f558-4b5e-b605-72b1c3154ed3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.635491 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 815/1632] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:34.635491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e5927-f558-4b5e-b605-72b1c3154ed3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.646151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e5927-f558-4b5e-b605-72b1c3154ed3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.651692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eee832-4fb3-4bfb-89a6-19ff9d644a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.652356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eee832-4fb3-4bfb-89a6-19ff9d644a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.652640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eee832-4fb3-4bfb-89a6-19ff9d644a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.652917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eee832-4fb3-4bfb-89a6-19ff9d644a8b admin admin] PATH_INFO: `/v3/projects/aeb9e1f08ea8451d8fa0fc5efb056867/users/f2d87dfd9c954033b46429f8b1ecedd9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.664773 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 818/1633] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:34.670238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b08d6-ac61-4c96-90e7-2d89af25e5a6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.670661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eee832-4fb3-4bfb-89a6-19ff9d644a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb9e1f08ea8451d8fa0fc5efb056867, user_id=f2d87dfd9c954033b46429f8b1ecedd9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.674357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eee832-4fb3-4bfb-89a6-19ff9d644a8b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.689240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b08d6-ac61-4c96-90e7-2d89af25e5a6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.699420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:34.710967 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 816/1634] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:34 2022] PUT /identity/v3/projects/aeb9e1f08ea8451d8fa0fc5efb056867/users/f2d87dfd9c954033b46429f8b1ecedd9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:34.712801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eee832-4fb3-4bfb-89a6-19ff9d644a8b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.728023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:34.752336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4ba07-180b-4867-84c3-35763d1dd091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.753059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ba07-180b-4867-84c3-35763d1dd091 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.753427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ba07-180b-4867-84c3-35763d1dd091 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.753777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ba07-180b-4867-84c3-35763d1dd091 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.754494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4ba07-180b-4867-84c3-35763d1dd091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.756151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4ba07-180b-4867-84c3-35763d1dd091 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.766512 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 819/1635] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:34.767314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4ba07-180b-4867-84c3-35763d1dd091 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.777734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4ba07-180b-4867-84c3-35763d1dd091 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.783232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67979ee-313c-46d6-8674-c1986e7bfdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.783767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67979ee-313c-46d6-8674-c1986e7bfdb0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.784051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67979ee-313c-46d6-8674-c1986e7bfdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.784327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67979ee-313c-46d6-8674-c1986e7bfdb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.784964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67979ee-313c-46d6-8674-c1986e7bfdb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.786306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eee832-4fb3-4bfb-89a6-19ff9d644a8b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.786682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67979ee-313c-46d6-8674-c1986e7bfdb0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.791444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28438d0-d0e5-4c4d-af42-030065317303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.792106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28438d0-d0e5-4c4d-af42-030065317303 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.792431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28438d0-d0e5-4c4d-af42-030065317303 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.792707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28438d0-d0e5-4c4d-af42-030065317303 admin admin] PATH_INFO: `/v3/projects/bebdaec2d12147a1aabffeae21fb2db4/users/779254232db94232a7ff2bfa1104ef25/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.797566 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 820/1636] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:34.798774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d62f0e-caf1-4d4d-b317-5aa89f3e5743 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.799120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d62f0e-caf1-4d4d-b317-5aa89f3e5743 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.799460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d62f0e-caf1-4d4d-b317-5aa89f3e5743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.809661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28438d0-d0e5-4c4d-af42-030065317303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bebdaec2d12147a1aabffeae21fb2db4, user_id=779254232db94232a7ff2bfa1104ef25, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.812435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28438d0-d0e5-4c4d-af42-030065317303 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.825799 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 817/1637] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:34 2022] PUT /identity/v3/projects/bebdaec2d12147a1aabffeae21fb2db4/users/779254232db94232a7ff2bfa1104ef25/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:34.826586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28438d0-d0e5-4c4d-af42-030065317303 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.839708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b3d62f0e-caf1-4d4d-b317-5aa89f3e5743 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:34.840899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b3d62f0e-caf1-4d4d-b317-5aa89f3e5743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:34.891629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28438d0-d0e5-4c4d-af42-030065317303 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.896399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cda03-dc1b-4112-8c8d-1e419957fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.897049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cda03-dc1b-4112-8c8d-1e419957fc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.897364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cda03-dc1b-4112-8c8d-1e419957fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.897636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cda03-dc1b-4112-8c8d-1e419957fc3a admin admin] PATH_INFO: `/v3/projects/8eced9ca22ee49d5bf3f3e11032586ef/users/e41e0f81e2c841f083275c7dc04cce5b/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.908150 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 821/1638] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Oct 8 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:34.909481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d9648-125a-4b83-8ee1-256e3ad4f570 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.909837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d9648-125a-4b83-8ee1-256e3ad4f570 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.910181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d9648-125a-4b83-8ee1-256e3ad4f570 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.911683 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 822/1639] 10.222.0.26 () {54 vars in 961 bytes} [Sat Oct 8 20:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:34.912386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d9648-125a-4b83-8ee1-256e3ad4f570 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.912499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cda03-dc1b-4112-8c8d-1e419957fc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eced9ca22ee49d5bf3f3e11032586ef, user_id=e41e0f81e2c841f083275c7dc04cce5b, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.916044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cda03-dc1b-4112-8c8d-1e419957fc3a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.926037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d9648-125a-4b83-8ee1-256e3ad4f570 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.931096 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 818/1640] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:34 2022] PUT /identity/v3/projects/8eced9ca22ee49d5bf3f3e11032586ef/users/e41e0f81e2c841f083275c7dc04cce5b/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:34.932022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cda03-dc1b-4112-8c8d-1e419957fc3a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:34.981883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef83ce-3361-44d0-be85-64a00649cc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:34.982479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef83ce-3361-44d0-be85-64a00649cc68 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:34.982754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef83ce-3361-44d0-be85-64a00649cc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:34.983023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef83ce-3361-44d0-be85-64a00649cc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:34.983659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef83ce-3361-44d0-be85-64a00649cc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:34.986011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef83ce-3361-44d0-be85-64a00649cc68 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:34.995646 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 823/1641] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:34.996168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cda03-dc1b-4112-8c8d-1e419957fc3a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:34.996533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef83ce-3361-44d0-be85-64a00649cc68 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.002331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.003028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.003304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.003566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] PATH_INFO: `/v3/users/704f5aa685f34b77b6918d12490b524a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.004677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=704f5aa685f34b77b6918d12490b524a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.006369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef83ce-3361-44d0-be85-64a00649cc68 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.007045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.010844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ddd84-0ded-4215-bad7-c368e9e58db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.011533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ddd84-0ded-4215-bad7-c368e9e58db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.011736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ddd84-0ded-4215-bad7-c368e9e58db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.012004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ddd84-0ded-4215-bad7-c368e9e58db1 admin admin] PATH_INFO: `/v3/projects/82c66519e0dd4ef29876400cd42c0729/users/98f9c672a2164e76b458973a66b6203b/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.022416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:35.024070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:35.029356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ddd84-0ded-4215-bad7-c368e9e58db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c66519e0dd4ef29876400cd42c0729, user_id=98f9c672a2164e76b458973a66b6203b, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.032590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ddd84-0ded-4215-bad7-c368e9e58db1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.045008 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 824/1642] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:34 2022] PUT /identity/v3/projects/82c66519e0dd4ef29876400cd42c0729/users/98f9c672a2164e76b458973a66b6203b/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:35.045740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ddd84-0ded-4215-bad7-c368e9e58db1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.056057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '704f5aa685f34b77b6918d12490b524a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:35.062827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '704f5aa685f34b77b6918d12490b524a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:35.063494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '704f5aa685f34b77b6918d12490b524a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:35.064119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '704f5aa685f34b77b6918d12490b524a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:35.076198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '704f5aa685f34b77b6918d12490b524a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:35.088920 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 819/1643] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:34 2022] DELETE /identity/v3/users/704f5aa685f34b77b6918d12490b524a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:35.092048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.092048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:35.111501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ddd84-0ded-4215-bad7-c368e9e58db1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.154798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252e28e-7e67-4fd6-9aa2-ec6968a74feb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.160160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea01cc-497c-42ca-aee0-0e49cc0baa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.160769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea01cc-497c-42ca-aee0-0e49cc0baa83 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.161053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea01cc-497c-42ca-aee0-0e49cc0baa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.161361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea01cc-497c-42ca-aee0-0e49cc0baa83 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.162006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea01cc-497c-42ca-aee0-0e49cc0baa83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.163596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea01cc-497c-42ca-aee0-0e49cc0baa83 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.170338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a7d94-cf5c-4dd7-9cf6-8a7a5e8968d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.171068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a7d94-cf5c-4dd7-9cf6-8a7a5e8968d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.171354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a7d94-cf5c-4dd7-9cf6-8a7a5e8968d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.171643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a7d94-cf5c-4dd7-9cf6-8a7a5e8968d9 admin admin] PATH_INFO: `/v3/projects/7b1a2053ff2a4aecaabdb5995bb73eac/users/8ca491afc0a64f31a14c46178f9210f2/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.173931 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 820/1644] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:35.174725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea01cc-497c-42ca-aee0-0e49cc0baa83 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.176389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eeea01cc-497c-42ca-aee0-0e49cc0baa83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:35.191153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a7d94-cf5c-4dd7-9cf6-8a7a5e8968d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1a2053ff2a4aecaabdb5995bb73eac, user_id=8ca491afc0a64f31a14c46178f9210f2, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.193932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a7d94-cf5c-4dd7-9cf6-8a7a5e8968d9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.206997 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 825/1645] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:35 2022] PUT /identity/v3/projects/7b1a2053ff2a4aecaabdb5995bb73eac/users/8ca491afc0a64f31a14c46178f9210f2/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:35.208372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bfb8b-f9fc-47f6-b459-ceff3ebe008c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.208991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bfb8b-f9fc-47f6-b459-ceff3ebe008c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.209425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bfb8b-f9fc-47f6-b459-ceff3ebe008c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.228483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a99bfb8b-f9fc-47f6-b459-ceff3ebe008c None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:35.229774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a99bfb8b-f9fc-47f6-b459-ceff3ebe008c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:35.253407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea01cc-497c-42ca-aee0-0e49cc0baa83 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.279371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:35.299177 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 826/1646] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Oct 8 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:35.300069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bfb8b-f9fc-47f6-b459-ceff3ebe008c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.301582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a99bfb8b-f9fc-47f6-b459-ceff3ebe008c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:35.315601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:35.319252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62538b13-f956-437e-9d83-66a13c3e9f43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.319859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538b13-f956-437e-9d83-66a13c3e9f43 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.320132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538b13-f956-437e-9d83-66a13c3e9f43 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.320399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538b13-f956-437e-9d83-66a13c3e9f43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.322872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-62538b13-f956-437e-9d83-66a13c3e9f43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:35.371883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bfb8b-f9fc-47f6-b459-ceff3ebe008c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.377257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99035825-e86a-46ec-b8de-55d0cba842d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.377869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99035825-e86a-46ec-b8de-55d0cba842d0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.378142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99035825-e86a-46ec-b8de-55d0cba842d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.378414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99035825-e86a-46ec-b8de-55d0cba842d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.379046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99035825-e86a-46ec-b8de-55d0cba842d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.380618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99035825-e86a-46ec-b8de-55d0cba842d0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.386091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62538b13-f956-437e-9d83-66a13c3e9f43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.387367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62538b13-f956-437e-9d83-66a13c3e9f43 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.391617 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 827/1647] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:35.392454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99035825-e86a-46ec-b8de-55d0cba842d0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.394060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-99035825-e86a-46ec-b8de-55d0cba842d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:35.400607 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 821/1648] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:35 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:35.401517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62538b13-f956-437e-9d83-66a13c3e9f43 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.402963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-62538b13-f956-437e-9d83-66a13c3e9f43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:35.406753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99035825-e86a-46ec-b8de-55d0cba842d0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.412138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe2c7b-383d-4b11-9381-a9215ed44c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.412792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2c7b-383d-4b11-9381-a9215ed44c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.413267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2c7b-383d-4b11-9381-a9215ed44c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.413548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2c7b-383d-4b11-9381-a9215ed44c8c admin admin] PATH_INFO: `/v3/projects/aeb9e1f08ea8451d8fa0fc5efb056867/users/f2d87dfd9c954033b46429f8b1ecedd9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.415455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe2c7b-383d-4b11-9381-a9215ed44c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb9e1f08ea8451d8fa0fc5efb056867, user_id=f2d87dfd9c954033b46429f8b1ecedd9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.415561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62538b13-f956-437e-9d83-66a13c3e9f43 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.418156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe2c7b-383d-4b11-9381-a9215ed44c8c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.420125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb50f29-1262-4bb1-9636-c8e8e71010d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.420709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb50f29-1262-4bb1-9636-c8e8e71010d7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.420986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb50f29-1262-4bb1-9636-c8e8e71010d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.421294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb50f29-1262-4bb1-9636-c8e8e71010d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.422476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb50f29-1262-4bb1-9636-c8e8e71010d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.424004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb50f29-1262-4bb1-9636-c8e8e71010d7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.429548 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 828/1649] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:35 2022] PUT /identity/v3/projects/aeb9e1f08ea8451d8fa0fc5efb056867/users/f2d87dfd9c954033b46429f8b1ecedd9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:35.430539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a465ba-0340-41fe-a851-446f0282c1b3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.430823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a465ba-0340-41fe-a851-446f0282c1b3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.431099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a465ba-0340-41fe-a851-446f0282c1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.444387 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 822/1650] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:35.445961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb50f29-1262-4bb1-9636-c8e8e71010d7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.450213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-05a465ba-0340-41fe-a851-446f0282c1b3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:35.451410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-05a465ba-0340-41fe-a851-446f0282c1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:35.456829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb50f29-1262-4bb1-9636-c8e8e71010d7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.517947 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 829/1651] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:35.518925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a465ba-0340-41fe-a851-446f0282c1b3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.520411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-05a465ba-0340-41fe-a851-446f0282c1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:35.532542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a465ba-0340-41fe-a851-446f0282c1b3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.537118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1e99e-2f2d-4da5-a6c7-8376bb06de1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.537671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03654a2c-966c-4f97-8a2d-58ade0161e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.537948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1e99e-2f2d-4da5-a6c7-8376bb06de1c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.538323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1e99e-2f2d-4da5-a6c7-8376bb06de1c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.538410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03654a2c-966c-4f97-8a2d-58ade0161e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.538597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03654a2c-966c-4f97-8a2d-58ade0161e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.538853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1e99e-2f2d-4da5-a6c7-8376bb06de1c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.538939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03654a2c-966c-4f97-8a2d-58ade0161e04 admin admin] PATH_INFO: `/v3/projects/bebdaec2d12147a1aabffeae21fb2db4/users/779254232db94232a7ff2bfa1104ef25/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.539659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1e99e-2f2d-4da5-a6c7-8376bb06de1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.540772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03654a2c-966c-4f97-8a2d-58ade0161e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bebdaec2d12147a1aabffeae21fb2db4, user_id=779254232db94232a7ff2bfa1104ef25, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.541592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1e99e-2f2d-4da5-a6c7-8376bb06de1c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.543400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03654a2c-966c-4f97-8a2d-58ade0161e04 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.556810 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 830/1652] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:35.556957 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 823/1653] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:35 2022] PUT /identity/v3/projects/bebdaec2d12147a1aabffeae21fb2db4/users/779254232db94232a7ff2bfa1104ef25/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:35.556957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03654a2c-966c-4f97-8a2d-58ade0161e04 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.561345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1e99e-2f2d-4da5-a6c7-8376bb06de1c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.607364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:35.630364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03654a2c-966c-4f97-8a2d-58ade0161e04 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.636299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69166fc6-7ad4-49d3-98ee-639131160e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.636955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166fc6-7ad4-49d3-98ee-639131160e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.637257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166fc6-7ad4-49d3-98ee-639131160e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.637530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166fc6-7ad4-49d3-98ee-639131160e7d admin admin] PATH_INFO: `/v3/projects/8eced9ca22ee49d5bf3f3e11032586ef/users/e41e0f81e2c841f083275c7dc04cce5b/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.638974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1e99e-2f2d-4da5-a6c7-8376bb06de1c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.639531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69166fc6-7ad4-49d3-98ee-639131160e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eced9ca22ee49d5bf3f3e11032586ef, user_id=e41e0f81e2c841f083275c7dc04cce5b, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.643143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69166fc6-7ad4-49d3-98ee-639131160e7d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.656375 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 824/1654] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:35 2022] PUT /identity/v3/projects/8eced9ca22ee49d5bf3f3e11032586ef/users/e41e0f81e2c841f083275c7dc04cce5b/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:35.658518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad3d6-e8c4-4213-89fa-0d9eeeae8c05 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.658873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad3d6-e8c4-4213-89fa-0d9eeeae8c05 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.659218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad3d6-e8c4-4213-89fa-0d9eeeae8c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.667436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:35.696618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b4fad3d6-e8c4-4213-89fa-0d9eeeae8c05 None None] MFA Rules not processed for user `f2d87dfd9c954033b46429f8b1ecedd9`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:35.698031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b4fad3d6-e8c4-4213-89fa-0d9eeeae8c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:35.724312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a57bf-295d-486e-87da-44d5808644b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.725023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a57bf-295d-486e-87da-44d5808644b6 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.725395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a57bf-295d-486e-87da-44d5808644b6 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.725666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a57bf-295d-486e-87da-44d5808644b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.727940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a21a57bf-295d-486e-87da-44d5808644b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:35.780452 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 825/1655] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:35.781492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad3d6-e8c4-4213-89fa-0d9eeeae8c05 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.810651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a57bf-295d-486e-87da-44d5808644b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.812159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a57bf-295d-486e-87da-44d5808644b6 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.823039 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 831/1656] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:35.825068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a57bf-295d-486e-87da-44d5808644b6 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.826565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a21a57bf-295d-486e-87da-44d5808644b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:35.856813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad3d6-e8c4-4213-89fa-0d9eeeae8c05 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.864721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62f869-9095-48a0-a896-43eb578cfd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.865620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62f869-9095-48a0-a896-43eb578cfd37 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.866049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62f869-9095-48a0-a896-43eb578cfd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.866324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62f869-9095-48a0-a896-43eb578cfd37 admin admin] PATH_INFO: `/v3/projects/82c66519e0dd4ef29876400cd42c0729/users/98f9c672a2164e76b458973a66b6203b/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.868256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62f869-9095-48a0-a896-43eb578cfd37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c66519e0dd4ef29876400cd42c0729, user_id=98f9c672a2164e76b458973a66b6203b, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.871275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62f869-9095-48a0-a896-43eb578cfd37 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.885063 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 826/1657] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:35 2022] PUT /identity/v3/projects/82c66519e0dd4ef29876400cd42c0729/users/98f9c672a2164e76b458973a66b6203b/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:35.885864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62f869-9095-48a0-a896-43eb578cfd37 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:35.900305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a57bf-295d-486e-87da-44d5808644b6 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.947029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:35.951070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62f869-9095-48a0-a896-43eb578cfd37 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:35.958670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d7395-d859-4a80-9baf-157cded31224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.959339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b07771-313d-41c7-80d1-a0ffb7389c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:35.959493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d7395-d859-4a80-9baf-157cded31224 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.959817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d7395-d859-4a80-9baf-157cded31224 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.959935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b07771-313d-41c7-80d1-a0ffb7389c83 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.960200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d7395-d859-4a80-9baf-157cded31224 admin admin] PATH_INFO: `/v3/projects/7b1a2053ff2a4aecaabdb5995bb73eac/users/8ca491afc0a64f31a14c46178f9210f2/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.960297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b07771-313d-41c7-80d1-a0ffb7389c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.960471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b07771-313d-41c7-80d1-a0ffb7389c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.962287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d7395-d859-4a80-9baf-157cded31224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1a2053ff2a4aecaabdb5995bb73eac, user_id=8ca491afc0a64f31a14c46178f9210f2, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.965071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d7395-d859-4a80-9baf-157cded31224 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.970348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b07771-313d-41c7-80d1-a0ffb7389c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:35.972048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b07771-313d-41c7-80d1-a0ffb7389c83 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:35.975998 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 827/1658] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:35 2022] PUT /identity/v3/projects/7b1a2053ff2a4aecaabdb5995bb73eac/users/8ca491afc0a64f31a14c46178f9210f2/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:35.985120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f92143-b5be-4c5c-a4a0-1a2175e6c317 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.985120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f92143-b5be-4c5c-a4a0-1a2175e6c317 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.985120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f92143-b5be-4c5c-a4a0-1a2175e6c317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:35.991700 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 832/1659] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:35.992860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde7b8-50f3-4a48-9267-7be96f575eee None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:35.993145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde7b8-50f3-4a48-9267-7be96f575eee None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:35.993444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde7b8-50f3-4a48-9267-7be96f575eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.020046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-87f92143-b5be-4c5c-a4a0-1a2175e6c317 None None] MFA Rules not processed for user `779254232db94232a7ff2bfa1104ef25`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:36.021606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-87f92143-b5be-4c5c-a4a0-1a2175e6c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.029336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6cdde7b8-50f3-4a48-9267-7be96f575eee None None] MFA Rules not processed for user `e41e0f81e2c841f083275c7dc04cce5b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:36.031061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6cdde7b8-50f3-4a48-9267-7be96f575eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.037491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:36.111838 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 828/1660] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:36.113178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295918f1-7886-4735-bb58-81ff282203d9 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.113491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295918f1-7886-4735-bb58-81ff282203d9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.113770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295918f1-7886-4735-bb58-81ff282203d9 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.116143 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 829/1661] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:36.117328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830e724-1c09-48be-a60c-90d6efc1f05a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.117722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830e724-1c09-48be-a60c-90d6efc1f05a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.118115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830e724-1c09-48be-a60c-90d6efc1f05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.123107 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 833/1662] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:36.124512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bd850-6e32-4181-a778-1c8c1f54814c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.125416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bd850-6e32-4181-a778-1c8c1f54814c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.125755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bd850-6e32-4181-a778-1c8c1f54814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.147913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d830e724-1c09-48be-a60c-90d6efc1f05a None None] MFA Rules not processed for user `98f9c672a2164e76b458973a66b6203b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:36.149208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d830e724-1c09-48be-a60c-90d6efc1f05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.157713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-117bd850-6e32-4181-a778-1c8c1f54814c None None] MFA Rules not processed for user `8ca491afc0a64f31a14c46178f9210f2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:36.159149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-117bd850-6e32-4181-a778-1c8c1f54814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.256095 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 830/1663] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:36.257109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830e724-1c09-48be-a60c-90d6efc1f05a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:36.258532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d830e724-1c09-48be-a60c-90d6efc1f05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.278854 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 834/1664] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:36 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:36.279140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bd850-6e32-4181-a778-1c8c1f54814c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:36.349854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830e724-1c09-48be-a60c-90d6efc1f05a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:36.355137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e59688-bc02-4af2-b6fe-b94842895b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:36.355821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e59688-bc02-4af2-b6fe-b94842895b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.356097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e59688-bc02-4af2-b6fe-b94842895b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.356365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e59688-bc02-4af2-b6fe-b94842895b65 admin admin] PATH_INFO: `/v3/users/456b3248db044f03b200cfb5cc09c905` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.357843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e59688-bc02-4af2-b6fe-b94842895b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=456b3248db044f03b200cfb5cc09c905)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:36.360603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e59688-bc02-4af2-b6fe-b94842895b65 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:36.363220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:36.368605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bd850-6e32-4181-a778-1c8c1f54814c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:36.376757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63046934-0266-4217-9781-96d5bc519b7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:36.377923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63046934-0266-4217-9781-96d5bc519b7a service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.378502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63046934-0266-4217-9781-96d5bc519b7a service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.378791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63046934-0266-4217-9781-96d5bc519b7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.409004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:36.410003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-51e59688-bc02-4af2-b6fe-b94842895b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456b3248db044f03b200cfb5cc09c905'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:36.417136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-51e59688-bc02-4af2-b6fe-b94842895b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456b3248db044f03b200cfb5cc09c905'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:36.418592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-51e59688-bc02-4af2-b6fe-b94842895b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456b3248db044f03b200cfb5cc09c905'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:36.419353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-51e59688-bc02-4af2-b6fe-b94842895b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456b3248db044f03b200cfb5cc09c905'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:36.432071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-51e59688-bc02-4af2-b6fe-b94842895b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456b3248db044f03b200cfb5cc09c905'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:36.445734 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 831/1665] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:36 2022] DELETE /identity/v3/users/456b3248db044f03b200cfb5cc09c905 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:36.446990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837d86c-624a-473a-9b90-b24670077059 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.447273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837d86c-624a-473a-9b90-b24670077059 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.447544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837d86c-624a-473a-9b90-b24670077059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.450765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63046934-0266-4217-9781-96d5bc519b7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:36.452330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63046934-0266-4217-9781-96d5bc519b7a service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:36.462616 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 835/1666] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:36.463455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63046934-0266-4217-9781-96d5bc519b7a service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:36.466324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6837d86c-624a-473a-9b90-b24670077059 None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:36.467497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6837d86c-624a-473a-9b90-b24670077059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.477262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63046934-0266-4217-9781-96d5bc519b7a service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:36.542143 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 832/1667] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:51:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:36.548884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837d86c-624a-473a-9b90-b24670077059 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:36.549869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6837d86c-624a-473a-9b90-b24670077059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.554891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0eb9b0-16d8-4e4e-b1e8-65981a33d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:36.555497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0eb9b0-16d8-4e4e-b1e8-65981a33d50b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.555773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0eb9b0-16d8-4e4e-b1e8-65981a33d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.556042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0eb9b0-16d8-4e4e-b1e8-65981a33d50b admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.557147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0eb9b0-16d8-4e4e-b1e8-65981a33d50b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:36.559077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0eb9b0-16d8-4e4e-b1e8-65981a33d50b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:36.571094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837d86c-624a-473a-9b90-b24670077059 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:36.575742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:36.576414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.576696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.576972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] PATH_INFO: `/v3/projects/8720ff987d064701bfc63c45aaa05a47` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.578427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8720ff987d064701bfc63c45aaa05a47)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:36.579502 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:51:36.579502 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 20:51:36.579502 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 20:51:36.580676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:36.588563 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 836/1668] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:36 2022] POST /identity/v3/projects => generated 395 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:36.590221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938b556-86bf-4b06-aa9c-2e4a923c90a0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.590491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938b556-86bf-4b06-aa9c-2e4a923c90a0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.590768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938b556-86bf-4b06-aa9c-2e4a923c90a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.610860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2938b556-86bf-4b06-aa9c-2e4a923c90a0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:36.612039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2938b556-86bf-4b06-aa9c-2e4a923c90a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.638647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8720ff987d064701bfc63c45aaa05a47', 'request_id': 'req-053b49cd-e73d-4f29-b7c2-36adb7cdba23'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:36.646653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8720ff987d064701bfc63c45aaa05a47', 'request_id': 'req-053b49cd-e73d-4f29-b7c2-36adb7cdba23'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:36.653400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8720ff987d064701bfc63c45aaa05a47', 'request_id': 'req-053b49cd-e73d-4f29-b7c2-36adb7cdba23'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:36.668452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:36.673352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] The token cache is being invalidate because project 8720ff987d064701bfc63c45aaa05a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:36.673699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:36.673809 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 837/1669] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:36.674693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938b556-86bf-4b06-aa9c-2e4a923c90a0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:36.676011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2938b556-86bf-4b06-aa9c-2e4a923c90a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.677963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:36.685639 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 833/1670] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:36 2022] DELETE /identity/v3/projects/8720ff987d064701bfc63c45aaa05a47 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:36.685639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:36.685639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.730016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:36.752041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b49cd-e73d-4f29-b7c2-36adb7cdba23 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:36.756044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938b556-86bf-4b06-aa9c-2e4a923c90a0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:36.757160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9391c59-500c-49a5-97e4-ad660a0fa028 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:36.757805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9391c59-500c-49a5-97e4-ad660a0fa028 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.758092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9391c59-500c-49a5-97e4-ad660a0fa028 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.758361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9391c59-500c-49a5-97e4-ad660a0fa028 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.760091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e9391c59-500c-49a5-97e4-ad660a0fa028 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.771260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9391c59-500c-49a5-97e4-ad660a0fa028 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:36.772831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9391c59-500c-49a5-97e4-ad660a0fa028 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:36.783003 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 834/1671] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:36.783753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9391c59-500c-49a5-97e4-ad660a0fa028 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:36.785033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e9391c59-500c-49a5-97e4-ad660a0fa028 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.822836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616a8cc-a211-4ea6-ab22-d97625b8dfb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:36.824608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a8cc-a211-4ea6-ab22-d97625b8dfb8 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.824966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a8cc-a211-4ea6-ab22-d97625b8dfb8 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.825283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a8cc-a211-4ea6-ab22-d97625b8dfb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.827116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5616a8cc-a211-4ea6-ab22-d97625b8dfb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.854630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9391c59-500c-49a5-97e4-ad660a0fa028 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:36.860612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2ab00-2110-45cc-8bb7-615cc97a77cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:36.861459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2ab00-2110-45cc-8bb7-615cc97a77cd admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.861734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2ab00-2110-45cc-8bb7-615cc97a77cd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.862070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2ab00-2110-45cc-8bb7-615cc97a77cd admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.862921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2ab00-2110-45cc-8bb7-615cc97a77cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:36.865522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2ab00-2110-45cc-8bb7-615cc97a77cd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:36.901728 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 835/1672] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:36 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:36.901728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2ab00-2110-45cc-8bb7-615cc97a77cd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:36.903403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1af2ab00-2110-45cc-8bb7-615cc97a77cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.907282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616a8cc-a211-4ea6-ab22-d97625b8dfb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:36.908861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616a8cc-a211-4ea6-ab22-d97625b8dfb8 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:36.919061 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 838/1673] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:36.920628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75b49a-c83e-4a58-ac4b-290eb6354fcd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.921067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75b49a-c83e-4a58-ac4b-290eb6354fcd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.921464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75b49a-c83e-4a58-ac4b-290eb6354fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.944840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2e75b49a-c83e-4a58-ac4b-290eb6354fcd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:36.946534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2e75b49a-c83e-4a58-ac4b-290eb6354fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.955517 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 839/1674] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:36.961683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2ab00-2110-45cc-8bb7-615cc97a77cd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:36.962920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75b49a-c83e-4a58-ac4b-290eb6354fcd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:36.964324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2e75b49a-c83e-4a58-ac4b-290eb6354fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.966052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f088b-a5d7-49d9-abbc-dd7f78f5c516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:36.966851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f088b-a5d7-49d9-abbc-dd7f78f5c516 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.967204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f088b-a5d7-49d9-abbc-dd7f78f5c516 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.967552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f088b-a5d7-49d9-abbc-dd7f78f5c516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.969981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ed7f088b-a5d7-49d9-abbc-dd7f78f5c516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.980780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75b49a-c83e-4a58-ac4b-290eb6354fcd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:36.983254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f088b-a5d7-49d9-abbc-dd7f78f5c516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:36.985031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f088b-a5d7-49d9-abbc-dd7f78f5c516 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:36.991752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71dac7-7f3e-47e5-9f4f-f9f1f59afb28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:36.993420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71dac7-7f3e-47e5-9f4f-f9f1f59afb28 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:36.993714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71dac7-7f3e-47e5-9f4f-f9f1f59afb28 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:36.993994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71dac7-7f3e-47e5-9f4f-f9f1f59afb28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:36.995920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3b71dac7-7f3e-47e5-9f4f-f9f1f59afb28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:36.997277 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 836/1675] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:36.998099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f088b-a5d7-49d9-abbc-dd7f78f5c516 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.007306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f088b-a5d7-49d9-abbc-dd7f78f5c516 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.012235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdc323-5ce0-4af5-b2bd-08efbb79493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.012830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdc323-5ce0-4af5-b2bd-08efbb79493e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.013108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdc323-5ce0-4af5-b2bd-08efbb79493e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.013414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdc323-5ce0-4af5-b2bd-08efbb79493e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.014048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdc323-5ce0-4af5-b2bd-08efbb79493e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.016606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdc323-5ce0-4af5-b2bd-08efbb79493e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.032617 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 837/1676] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:37.032617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2504d5-510b-4e6e-aeb4-1e063afb5594 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.032617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2504d5-510b-4e6e-aeb4-1e063afb5594 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.032617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2504d5-510b-4e6e-aeb4-1e063afb5594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.054761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cd2504d5-510b-4e6e-aeb4-1e063afb5594 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:37.055994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cd2504d5-510b-4e6e-aeb4-1e063afb5594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:37.064465 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 838/1677] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:37.068164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2504d5-510b-4e6e-aeb4-1e063afb5594 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.069572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cd2504d5-510b-4e6e-aeb4-1e063afb5594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:37.071854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71dac7-7f3e-47e5-9f4f-f9f1f59afb28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.074666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71dac7-7f3e-47e5-9f4f-f9f1f59afb28 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.082856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:37.087588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2504d5-510b-4e6e-aeb4-1e063afb5594 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.089354 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 840/1678] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:37.090259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71dac7-7f3e-47e5-9f4f-f9f1f59afb28 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.094217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379831bc-7a41-46d9-a381-933fcfddb36a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.094842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379831bc-7a41-46d9-a381-933fcfddb36a service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.095126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379831bc-7a41-46d9-a381-933fcfddb36a service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.095401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379831bc-7a41-46d9-a381-933fcfddb36a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.097840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:37.099263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-379831bc-7a41-46d9-a381-933fcfddb36a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:37.103390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71dac7-7f3e-47e5-9f4f-f9f1f59afb28 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.111267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a611eff-9143-4dff-afa9-eb91945bf54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.111989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a611eff-9143-4dff-afa9-eb91945bf54f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.112331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a611eff-9143-4dff-afa9-eb91945bf54f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.112697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a611eff-9143-4dff-afa9-eb91945bf54f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.113519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a611eff-9143-4dff-afa9-eb91945bf54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.115421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a611eff-9143-4dff-afa9-eb91945bf54f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.128799 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 841/1679] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:37.129749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a611eff-9143-4dff-afa9-eb91945bf54f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.143098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a611eff-9143-4dff-afa9-eb91945bf54f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.162850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49492ec-ba61-45ed-ba51-80bc9db149fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.163640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49492ec-ba61-45ed-ba51-80bc9db149fd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.163919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49492ec-ba61-45ed-ba51-80bc9db149fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.164390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49492ec-ba61-45ed-ba51-80bc9db149fd admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.166177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49492ec-ba61-45ed-ba51-80bc9db149fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:37.166499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49492ec-ba61-45ed-ba51-80bc9db149fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.168167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49492ec-ba61-45ed-ba51-80bc9db149fd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.191511 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 842/1680] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:37.192706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49492ec-ba61-45ed-ba51-80bc9db149fd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.205493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49492ec-ba61-45ed-ba51-80bc9db149fd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.207563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379831bc-7a41-46d9-a381-933fcfddb36a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.210345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379831bc-7a41-46d9-a381-933fcfddb36a service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.211782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47e576-47d6-4859-ba38-54cbdeaf7fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.212604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47e576-47d6-4859-ba38-54cbdeaf7fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.212962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47e576-47d6-4859-ba38-54cbdeaf7fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.214019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47e576-47d6-4859-ba38-54cbdeaf7fd6 admin admin] PATH_INFO: `/v3/projects/482fd4a7abb2475b90f6ce367fdf296d/users/8d448cec797f4063b936ab9b2a3031b4/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.223449 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 839/1681] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:37 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:37.224743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379831bc-7a41-46d9-a381-933fcfddb36a service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.237591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379831bc-7a41-46d9-a381-933fcfddb36a service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.244353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df484ea-1b5c-428c-a381-98a4a1c8db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.245241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df484ea-1b5c-428c-a381-98a4a1c8db2b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.245926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df484ea-1b5c-428c-a381-98a4a1c8db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.246616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df484ea-1b5c-428c-a381-98a4a1c8db2b admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.247486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df484ea-1b5c-428c-a381-98a4a1c8db2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.249707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df484ea-1b5c-428c-a381-98a4a1c8db2b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.257385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47e576-47d6-4859-ba38-54cbdeaf7fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482fd4a7abb2475b90f6ce367fdf296d, user_id=8d448cec797f4063b936ab9b2a3031b4, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.260050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47e576-47d6-4859-ba38-54cbdeaf7fd6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.301574 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 840/1682] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:37 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:37.301778 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 843/1683] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:37 2022] PUT /identity/v3/projects/482fd4a7abb2475b90f6ce367fdf296d/users/8d448cec797f4063b936ab9b2a3031b4/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:37.301878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df484ea-1b5c-428c-a381-98a4a1c8db2b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.304015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b77ca-e2e6-4144-a270-c9c5dd7e6271 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.304390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b77ca-e2e6-4144-a270-c9c5dd7e6271 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.304816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b77ca-e2e6-4144-a270-c9c5dd7e6271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.364022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-511b77ca-e2e6-4144-a270-c9c5dd7e6271 None None] MFA Rules not processed for user `8d448cec797f4063b936ab9b2a3031b4`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:37.365351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-511b77ca-e2e6-4144-a270-c9c5dd7e6271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:37.413334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df484ea-1b5c-428c-a381-98a4a1c8db2b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.419513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0f173-df5d-4b62-9c50-fd27b583b4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.420457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f173-df5d-4b62-9c50-fd27b583b4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.421019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f173-df5d-4b62-9c50-fd27b583b4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.421446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f173-df5d-4b62-9c50-fd27b583b4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.422230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0f173-df5d-4b62-9c50-fd27b583b4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.424260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0f173-df5d-4b62-9c50-fd27b583b4e2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.454314 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 841/1684] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:37 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:37.454314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0f173-df5d-4b62-9c50-fd27b583b4e2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.454592 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 844/1685] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:51:37.455643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cad0f173-df5d-4b62-9c50-fd27b583b4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:37.456671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b77ca-e2e6-4144-a270-c9c5dd7e6271 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.469270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0f173-df5d-4b62-9c50-fd27b583b4e2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.477240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.477240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.477240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.477240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] PATH_INFO: `/v3/projects/71f548b0b4c7465d9092382907f3f7b7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.477679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f548b0b4c7465d9092382907f3f7b7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.479059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.550259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f548b0b4c7465d9092382907f3f7b7', 'request_id': 'req-09db95bf-bd2d-42e6-9abf-d7db308b2dea'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:37.554153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b77ca-e2e6-4144-a270-c9c5dd7e6271 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.558665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f548b0b4c7465d9092382907f3f7b7', 'request_id': 'req-09db95bf-bd2d-42e6-9abf-d7db308b2dea'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:37.563846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:37.566630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f548b0b4c7465d9092382907f3f7b7', 'request_id': 'req-09db95bf-bd2d-42e6-9abf-d7db308b2dea'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:37.581429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] The token cache is being invalidate because project 71f548b0b4c7465d9092382907f3f7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:37.581722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:37.582382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:37.583902 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 842/1686] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:37 2022] DELETE /identity/v3/projects/71f548b0b4c7465d9092382907f3f7b7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:37.584790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.586196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:37.599494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:37.623551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844aa32e-6cb9-4108-bb37-e7e00d4e2d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.624173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa32e-6cb9-4108-bb37-e7e00d4e2d87 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.624451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa32e-6cb9-4108-bb37-e7e00d4e2d87 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.625243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa32e-6cb9-4108-bb37-e7e00d4e2d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.627008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-844aa32e-6cb9-4108-bb37-e7e00d4e2d87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:37.653547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db95bf-bd2d-42e6-9abf-d7db308b2dea admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.658601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad1b40-b628-43a6-95e1-85a67ce265d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.659210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad1b40-b628-43a6-95e1-85a67ce265d3 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.659486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad1b40-b628-43a6-95e1-85a67ce265d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.659756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad1b40-b628-43a6-95e1-85a67ce265d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.660470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad1b40-b628-43a6-95e1-85a67ce265d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.662072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad1b40-b628-43a6-95e1-85a67ce265d3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.672193 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 843/1687] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:37.672957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad1b40-b628-43a6-95e1-85a67ce265d3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.674596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4aad1b40-b628-43a6-95e1-85a67ce265d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:37.690233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad1b40-b628-43a6-95e1-85a67ce265d3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.690367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844aa32e-6cb9-4108-bb37-e7e00d4e2d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.691935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844aa32e-6cb9-4108-bb37-e7e00d4e2d87 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.695709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bafbd-cbe9-4657-8f92-fa4bd35f54ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.696323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bafbd-cbe9-4657-8f92-fa4bd35f54ec service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.696629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bafbd-cbe9-4657-8f92-fa4bd35f54ec service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.696901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bafbd-cbe9-4657-8f92-fa4bd35f54ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.698618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-954bafbd-cbe9-4657-8f92-fa4bd35f54ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:37.701403 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 845/1688] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:37 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:37.702260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844aa32e-6cb9-4108-bb37-e7e00d4e2d87 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.703630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-844aa32e-6cb9-4108-bb37-e7e00d4e2d87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:37.720773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844aa32e-6cb9-4108-bb37-e7e00d4e2d87 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.727108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415a047-f671-46a0-b814-6e0ce6468e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.727853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415a047-f671-46a0-b814-6e0ce6468e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.728720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415a047-f671-46a0-b814-6e0ce6468e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.728720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415a047-f671-46a0-b814-6e0ce6468e2e admin admin] PATH_INFO: `/v3/users/5f043192a2e648ee88e8960381a454a3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.729757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415a047-f671-46a0-b814-6e0ce6468e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f043192a2e648ee88e8960381a454a3)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.730832 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-4415a047-f671-46a0-b814-6e0ce6468e2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:51:37.730832 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 20:51:37.730832 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 20:51:37.732197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415a047-f671-46a0-b814-6e0ce6468e2e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.787897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bafbd-cbe9-4657-8f92-fa4bd35f54ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.790951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bafbd-cbe9-4657-8f92-fa4bd35f54ec service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.800543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4415a047-f671-46a0-b814-6e0ce6468e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f043192a2e648ee88e8960381a454a3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:37.801703 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 844/1689] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:37.802606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bafbd-cbe9-4657-8f92-fa4bd35f54ec service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.818012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bafbd-cbe9-4657-8f92-fa4bd35f54ec service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.818848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4415a047-f671-46a0-b814-6e0ce6468e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f043192a2e648ee88e8960381a454a3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:37.819744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4415a047-f671-46a0-b814-6e0ce6468e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f043192a2e648ee88e8960381a454a3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:37.820545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4415a047-f671-46a0-b814-6e0ce6468e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f043192a2e648ee88e8960381a454a3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:37.824173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cb624-6bed-4b13-a8fd-4a5fcd086167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.824846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cb624-6bed-4b13-a8fd-4a5fcd086167 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.825159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cb624-6bed-4b13-a8fd-4a5fcd086167 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.825569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cb624-6bed-4b13-a8fd-4a5fcd086167 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.826404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cb624-6bed-4b13-a8fd-4a5fcd086167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.828325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cb624-6bed-4b13-a8fd-4a5fcd086167 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.843707 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 845/1690] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:37.844757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cb624-6bed-4b13-a8fd-4a5fcd086167 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.846906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ab8cb624-6bed-4b13-a8fd-4a5fcd086167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:37.862087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4415a047-f671-46a0-b814-6e0ce6468e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f043192a2e648ee88e8960381a454a3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:37.862538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cb624-6bed-4b13-a8fd-4a5fcd086167 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:37.868014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd43ca7-783f-462f-9ad0-0d3cbd3798ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:37.868895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd43ca7-783f-462f-9ad0-0d3cbd3798ba admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.869350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd43ca7-783f-462f-9ad0-0d3cbd3798ba admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.869750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd43ca7-783f-462f-9ad0-0d3cbd3798ba admin admin] PATH_INFO: `/v3/projects/4659f85445ab4c7497b0c04e4aaee542/users/f08bbc4d5e674d8d9d69be4a574dc7d8/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.899556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd43ca7-783f-462f-9ad0-0d3cbd3798ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4659f85445ab4c7497b0c04e4aaee542, user_id=f08bbc4d5e674d8d9d69be4a574dc7d8, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:37.902413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd43ca7-783f-462f-9ad0-0d3cbd3798ba admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:37.905911 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 846/1691] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:37 2022] DELETE /identity/v3/users/5f043192a2e648ee88e8960381a454a3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:37.907683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14558090-e3c8-47ad-9f7d-ea98fca8fadb None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:37.908760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14558090-e3c8-47ad-9f7d-ea98fca8fadb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:37.908760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14558090-e3c8-47ad-9f7d-ea98fca8fadb None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:37.910285 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 847/1692] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:37.911109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14558090-e3c8-47ad-9f7d-ea98fca8fadb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:37.912891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-14558090-e3c8-47ad-9f7d-ea98fca8fadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:37.934789 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 846/1693] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:37 2022] PUT /identity/v3/projects/4659f85445ab4c7497b0c04e4aaee542/users/f08bbc4d5e674d8d9d69be4a574dc7d8/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:37.934789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd43ca7-783f-462f-9ad0-0d3cbd3798ba admin admin] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:51:37.934789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3dd43ca7-783f-462f-9ad0-0d3cbd3798ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:37.990005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:38.028050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:38.043014 ncdv-master-1 devstack@keystone.service[99085]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-3dd43ca7-783f-462f-9ad0-0d3cbd3798ba admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 08 20:51:38.043456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd43ca7-783f-462f-9ad0-0d3cbd3798ba admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:38.050637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3dd43ca7-783f-462f-9ad0-0d3cbd3798ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.056504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14558090-e3c8-47ad-9f7d-ea98fca8fadb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:38.062016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:38.063262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.063689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.064085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] PATH_INFO: `/v3/users/ec2fb9dce59140eebf0a02fdf479a1d8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.066380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec2fb9dce59140eebf0a02fdf479a1d8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:38.068857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:38.182869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec2fb9dce59140eebf0a02fdf479a1d8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.186744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd43ca7-783f-462f-9ad0-0d3cbd3798ba admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:38.191346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec2fb9dce59140eebf0a02fdf479a1d8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.191864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec2fb9dce59140eebf0a02fdf479a1d8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.192589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec2fb9dce59140eebf0a02fdf479a1d8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.193335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa12cc3-62f7-47a4-ae8d-6a556f9ed91f tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98f9c672a2164e76b458973a66b6203b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c66519e0dd4ef29876400cd42c0729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:38.194009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa12cc3-62f7-47a4-ae8d-6a556f9ed91f tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.194307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa12cc3-62f7-47a4-ae8d-6a556f9ed91f tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.194582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa12cc3-62f7-47a4-ae8d-6a556f9ed91f tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] PATH_INFO: `/v3/projects/0eae5cc31fc7412292ec30a394e28863` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.196083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa12cc3-62f7-47a4-ae8d-6a556f9ed91f tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: Authorizing `identity:get_project(project_id=0eae5cc31fc7412292ec30a394e28863)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:38.198181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa12cc3-62f7-47a4-ae8d-6a556f9ed91f tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:38.200629 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 847/1694] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:51:37 2022] GET /identity/v3/projects/0eae5cc31fc7412292ec30a394e28863 => generated 395 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:38.201900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38228679-6ed0-4097-ad38-6368af6e8779 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.202172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38228679-6ed0-4097-ad38-6368af6e8779 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.202444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38228679-6ed0-4097-ad38-6368af6e8779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.221645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec2fb9dce59140eebf0a02fdf479a1d8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.238400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-38228679-6ed0-4097-ad38-6368af6e8779 None None] MFA Rules not processed for user `f08bbc4d5e674d8d9d69be4a574dc7d8`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:38.241381 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 848/1695] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:37 2022] DELETE /identity/v3/users/ec2fb9dce59140eebf0a02fdf479a1d8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:38.241381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:38.245222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-38228679-6ed0-4097-ad38-6368af6e8779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.245764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.326038 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 848/1696] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:38.327299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529c72e-7809-4e5d-a681-0a64b7de1afa None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.327583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529c72e-7809-4e5d-a681-0a64b7de1afa None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.328578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529c72e-7809-4e5d-a681-0a64b7de1afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.340804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fac01f-72c1-43d9-985e-bdadcd24714a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:38.346997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cdc0d-681f-47bf-9ef4-401ff67da3f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:38.348302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cdc0d-681f-47bf-9ef4-401ff67da3f1 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.348302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cdc0d-681f-47bf-9ef4-401ff67da3f1 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.348302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cdc0d-681f-47bf-9ef4-401ff67da3f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.348537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c529c72e-7809-4e5d-a681-0a64b7de1afa None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:38.349777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c529c72e-7809-4e5d-a681-0a64b7de1afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.350838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-992cdc0d-681f-47bf-9ef4-401ff67da3f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.431024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cdc0d-681f-47bf-9ef4-401ff67da3f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:38.432610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cdc0d-681f-47bf-9ef4-401ff67da3f1 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:38.442048 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 849/1697] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:38.443089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529c72e-7809-4e5d-a681-0a64b7de1afa None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:38.444607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c529c72e-7809-4e5d-a681-0a64b7de1afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.449387 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 849/1698] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:38.450468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cdc0d-681f-47bf-9ef4-401ff67da3f1 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:38.452273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-992cdc0d-681f-47bf-9ef4-401ff67da3f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.457523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529c72e-7809-4e5d-a681-0a64b7de1afa None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:38.463033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:38.463819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.463968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.464240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd admin admin] PATH_INFO: `/v3/projects/ada4d7331157492ba501523521422ebf` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.465619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada4d7331157492ba501523521422ebf)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:38.468331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:38.470870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cdc0d-681f-47bf-9ef4-401ff67da3f1 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:38.478147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:38.478299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01f9cd-29a2-476b-bee9-9f850307302a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:38.478299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f9cd-29a2-476b-bee9-9f850307302a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.478299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f9cd-29a2-476b-bee9-9f850307302a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.478299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f9cd-29a2-476b-bee9-9f850307302a admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.482198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01f9cd-29a2-476b-bee9-9f850307302a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:38.482198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01f9cd-29a2-476b-bee9-9f850307302a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:38.488402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:38.519610 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 850/1699] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:38 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:38.519610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01f9cd-29a2-476b-bee9-9f850307302a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:38.525295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3e01f9cd-29a2-476b-bee9-9f850307302a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.529454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada4d7331157492ba501523521422ebf', 'request_id': 'req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.538797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada4d7331157492ba501523521422ebf', 'request_id': 'req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.545944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada4d7331157492ba501523521422ebf', 'request_id': 'req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.559316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd admin admin] The token cache is being invalidate because project ada4d7331157492ba501523521422ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:38.559638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.560415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fd3f12d9-2306-4f72-ad1d-9bc62af5e9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.563969 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 850/1700] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:38 2022] DELETE /identity/v3/projects/ada4d7331157492ba501523521422ebf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:38.565262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e4fe3-8994-4fb1-ad6e-2550e197c251 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.565553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e4fe3-8994-4fb1-ad6e-2550e197c251 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.565831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e4fe3-8994-4fb1-ad6e-2550e197c251 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.567699 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 851/1701] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:38.568424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e4fe3-8994-4fb1-ad6e-2550e197c251 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:38.570146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5d8e4fe3-8994-4fb1-ad6e-2550e197c251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.614461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01f9cd-29a2-476b-bee9-9f850307302a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:38.619083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:38.619711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.619987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.620456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] PATH_INFO: `/v3/users/2e4e944ad6104c7ebb9fbdccc45818ee` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.621622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4e944ad6104c7ebb9fbdccc45818ee)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:38.623594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:38.638634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e4fe3-8994-4fb1-ad6e-2550e197c251 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:38.642196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195bec0-1136-44bc-850f-b489b1c393b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:38.642804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195bec0-1136-44bc-850f-b489b1c393b0 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.643082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195bec0-1136-44bc-850f-b489b1c393b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.643484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195bec0-1136-44bc-850f-b489b1c393b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.645995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1195bec0-1136-44bc-850f-b489b1c393b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.662992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195bec0-1136-44bc-850f-b489b1c393b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:38.664706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195bec0-1136-44bc-850f-b489b1c393b0 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:38.680097 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 852/1702] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:38.681252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195bec0-1136-44bc-850f-b489b1c393b0 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:38.683032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1195bec0-1136-44bc-850f-b489b1c393b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.705132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195bec0-1136-44bc-850f-b489b1c393b0 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:38.710162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4e944ad6104c7ebb9fbdccc45818ee'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.711136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cd8ed-8577-4ccb-9eb0-5f94730c9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:38.712301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cd8ed-8577-4ccb-9eb0-5f94730c9d35 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.712686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cd8ed-8577-4ccb-9eb0-5f94730c9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.713093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cd8ed-8577-4ccb-9eb0-5f94730c9d35 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.713813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cd8ed-8577-4ccb-9eb0-5f94730c9d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:38.717271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cd8ed-8577-4ccb-9eb0-5f94730c9d35 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:38.720140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4e944ad6104c7ebb9fbdccc45818ee'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.721604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4e944ad6104c7ebb9fbdccc45818ee'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.722264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4e944ad6104c7ebb9fbdccc45818ee'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.738330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4e944ad6104c7ebb9fbdccc45818ee'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:38.749146 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 853/1703] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:38 2022] POST /identity/v3/users => generated 293 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:38.752457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679472ad-22b8-4320-b0cb-9bd34058c24e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.752969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679472ad-22b8-4320-b0cb-9bd34058c24e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.753580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679472ad-22b8-4320-b0cb-9bd34058c24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.755259 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 851/1704] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:38 2022] DELETE /identity/v3/users/2e4e944ad6104c7ebb9fbdccc45818ee => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:38.756067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:51:38.757823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.778108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-679472ad-22b8-4320-b0cb-9bd34058c24e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:38.779820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-679472ad-22b8-4320-b0cb-9bd34058c24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.840572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:38.851732 ncdv-master-1 devstack@keystone.service[99084]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 08 20:51:38.852266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:38.855081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.879277 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 854/1705] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:38.879277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679472ad-22b8-4320-b0cb-9bd34058c24e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:38.879277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-679472ad-22b8-4320-b0cb-9bd34058c24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.894609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679472ad-22b8-4320-b0cb-9bd34058c24e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:38.901634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471410c6-e21f-43d9-8395-f6c135a1647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:38.902193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471410c6-e21f-43d9-8395-f6c135a1647b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.902522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471410c6-e21f-43d9-8395-f6c135a1647b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.902825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471410c6-e21f-43d9-8395-f6c135a1647b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.903687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471410c6-e21f-43d9-8395-f6c135a1647b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:38.907196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471410c6-e21f-43d9-8395-f6c135a1647b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:38.921898 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 855/1706] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:38.923734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eaf7b-35d0-47ac-afac-922bcbeca69b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.924019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eaf7b-35d0-47ac-afac-922bcbeca69b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.924288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eaf7b-35d0-47ac-afac-922bcbeca69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.949751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c66eaf7b-35d0-47ac-afac-922bcbeca69b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:38.950732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c66eaf7b-35d0-47ac-afac-922bcbeca69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:38.961759 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 856/1707] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:38.963205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aec96-fc2b-4e48-9190-bf1125a6314b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.963615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aec96-fc2b-4e48-9190-bf1125a6314b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.964026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aec96-fc2b-4e48-9190-bf1125a6314b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.968743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b7c08-ed1b-40d3-8ac7-2c3096fd96fe admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:38.974956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6e5cd-bdc8-41a9-ae1f-9d4093ab8dc5 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98f9c672a2164e76b458973a66b6203b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c66519e0dd4ef29876400cd42c0729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:38.975911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6e5cd-bdc8-41a9-ae1f-9d4093ab8dc5 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:38.976337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6e5cd-bdc8-41a9-ae1f-9d4093ab8dc5 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:38.976626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6e5cd-bdc8-41a9-ae1f-9d4093ab8dc5 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] PATH_INFO: `/v3/projects/0eae5cc31fc7412292ec30a394e28863` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:38.978251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6e5cd-bdc8-41a9-ae1f-9d4093ab8dc5 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: Authorizing `identity:get_project(project_id=0eae5cc31fc7412292ec30a394e28863)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:38.980496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6e5cd-bdc8-41a9-ae1f-9d4093ab8dc5 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:38.986572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:38.988142 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 852/1708] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:51:38 2022] GET /identity/v3/projects/0eae5cc31fc7412292ec30a394e28863 => generated 395 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:38.995772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6e5cd-bdc8-41a9-ae1f-9d4093ab8dc5 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:39.015378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7a6aec96-fc2b-4e48-9190-bf1125a6314b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:39.022225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7a6aec96-fc2b-4e48-9190-bf1125a6314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:39.036155 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 857/1709] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:39.041842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6e5cd-bdc8-41a9-ae1f-9d4093ab8dc5 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:39.042292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6aec96-fc2b-4e48-9190-bf1125a6314b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:39.044482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7a6aec96-fc2b-4e48-9190-bf1125a6314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:39.055714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59548b28-6367-48a2-a33a-d8ba6e253dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:39.055973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59548b28-6367-48a2-a33a-d8ba6e253dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.056253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59548b28-6367-48a2-a33a-d8ba6e253dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.056528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59548b28-6367-48a2-a33a-d8ba6e253dbd admin admin] PATH_INFO: `/v3/projects/4e5a5704ae154cc2b481cf302a0a50f7/users/e365c1ff12db4d0ca91d2c438c592785/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.079775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59548b28-6367-48a2-a33a-d8ba6e253dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5a5704ae154cc2b481cf302a0a50f7, user_id=e365c1ff12db4d0ca91d2c438c592785, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:39.083038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59548b28-6367-48a2-a33a-d8ba6e253dbd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:39.106010 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 853/1710] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:38 2022] PUT /identity/v3/projects/4e5a5704ae154cc2b481cf302a0a50f7/users/e365c1ff12db4d0ca91d2c438c592785/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:39.106010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59548b28-6367-48a2-a33a-d8ba6e253dbd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:39.106561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-59548b28-6367-48a2-a33a-d8ba6e253dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:39.118156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6aec96-fc2b-4e48-9190-bf1125a6314b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:39.200269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4541d2-012b-47ad-bc7e-6d10f644eae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:39.201322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4541d2-012b-47ad-bc7e-6d10f644eae9 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.201755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4541d2-012b-47ad-bc7e-6d10f644eae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.202269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4541d2-012b-47ad-bc7e-6d10f644eae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.212893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4541d2-012b-47ad-bc7e-6d10f644eae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:39.214890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4541d2-012b-47ad-bc7e-6d10f644eae9 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:39.215075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59548b28-6367-48a2-a33a-d8ba6e253dbd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:39.226213 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 858/1711] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:39.227029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4541d2-012b-47ad-bc7e-6d10f644eae9 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:39.236380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:39.236978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.237297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.237689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] PATH_INFO: `/v3/users/67d65cc462394a38bc4dd6c2f65f671e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.239134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d65cc462394a38bc4dd6c2f65f671e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:39.242094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:39.246480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4541d2-012b-47ad-bc7e-6d10f644eae9 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:39.252247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ca5e4-5f16-4346-8bc4-3794b4ac067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:39.253033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ca5e4-5f16-4346-8bc4-3794b4ac067c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.253353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ca5e4-5f16-4346-8bc4-3794b4ac067c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.253627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ca5e4-5f16-4346-8bc4-3794b4ac067c admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.254946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ca5e4-5f16-4346-8bc4-3794b4ac067c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:39.255256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ca5e4-5f16-4346-8bc4-3794b4ac067c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:39.257425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ca5e4-5f16-4346-8bc4-3794b4ac067c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:39.274773 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 859/1712] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:39.276225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9250ff-f9ee-40ed-b62e-6b0787797c0c None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.276511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9250ff-f9ee-40ed-b62e-6b0787797c0c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.276784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9250ff-f9ee-40ed-b62e-6b0787797c0c None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.278163 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 860/1713] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:39.278784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9250ff-f9ee-40ed-b62e-6b0787797c0c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:39.310374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9250ff-f9ee-40ed-b62e-6b0787797c0c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:39.317967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d65cc462394a38bc4dd6c2f65f671e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.318128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092dbf1-b497-4e4f-bb55-b90a1fe7c48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:39.318866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092dbf1-b497-4e4f-bb55-b90a1fe7c48f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.319587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092dbf1-b497-4e4f-bb55-b90a1fe7c48f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.320593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092dbf1-b497-4e4f-bb55-b90a1fe7c48f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.321363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092dbf1-b497-4e4f-bb55-b90a1fe7c48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:39.324075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092dbf1-b497-4e4f-bb55-b90a1fe7c48f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:39.336043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d65cc462394a38bc4dd6c2f65f671e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.337098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d65cc462394a38bc4dd6c2f65f671e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.337486 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 861/1714] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:39.338079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d65cc462394a38bc4dd6c2f65f671e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.338452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092dbf1-b497-4e4f-bb55-b90a1fe7c48f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:39.341597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8092dbf1-b497-4e4f-bb55-b90a1fe7c48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:39.353713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d65cc462394a38bc4dd6c2f65f671e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.360264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092dbf1-b497-4e4f-bb55-b90a1fe7c48f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:39.366759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:39.367698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.368210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.368596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:39.368725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] PATH_INFO: `/v3/projects/aaf0d79d755c496bacff7792e9d1a64b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.370056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf0d79d755c496bacff7792e9d1a64b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:39.372717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:39.378908 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 854/1715] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:39 2022] DELETE /identity/v3/users/67d65cc462394a38bc4dd6c2f65f671e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:39.380358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:39.382173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:39.458427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf0d79d755c496bacff7792e9d1a64b', 'request_id': 'req-acf2d370-80a6-4891-ae9d-15e845191b91'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.474811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf0d79d755c496bacff7792e9d1a64b', 'request_id': 'req-acf2d370-80a6-4891-ae9d-15e845191b91'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.475979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21506599-1226-49c3-b0ee-abb23b5272d1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:39.487542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf0d79d755c496bacff7792e9d1a64b', 'request_id': 'req-acf2d370-80a6-4891-ae9d-15e845191b91'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.504920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] The token cache is being invalidate because project aaf0d79d755c496bacff7792e9d1a64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:39.504920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.505840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.510174 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 862/1716] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:39 2022] DELETE /identity/v3/projects/aaf0d79d755c496bacff7792e9d1a64b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:39.511265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:51:39.512806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:39.530180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:39.549784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8890e22-6984-41f9-a264-a74cb65e3cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:39.551553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8890e22-6984-41f9-a264-a74cb65e3cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.551828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8890e22-6984-41f9-a264-a74cb65e3cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.552183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8890e22-6984-41f9-a264-a74cb65e3cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.552799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8890e22-6984-41f9-a264-a74cb65e3cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:39.557984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8890e22-6984-41f9-a264-a74cb65e3cd9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:39.606117 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 855/1717] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:39 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:39.606952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8890e22-6984-41f9-a264-a74cb65e3cd9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:39.608678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a8890e22-6984-41f9-a264-a74cb65e3cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:39.641923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:39.643345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:39.723408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8890e22-6984-41f9-a264-a74cb65e3cd9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:39.730138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc664cc-96b7-466f-89aa-19b317018357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:39.730861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc664cc-96b7-466f-89aa-19b317018357 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.731140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc664cc-96b7-466f-89aa-19b317018357 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.731526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc664cc-96b7-466f-89aa-19b317018357 admin admin] PATH_INFO: `/v3/projects/4e5a5704ae154cc2b481cf302a0a50f7/users/e365c1ff12db4d0ca91d2c438c592785/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.736098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc664cc-96b7-466f-89aa-19b317018357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5a5704ae154cc2b481cf302a0a50f7, user_id=e365c1ff12db4d0ca91d2c438c592785, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:39.743243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2d370-80a6-4891-ae9d-15e845191b91 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:39.752329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc664cc-96b7-466f-89aa-19b317018357 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:39.769122 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 856/1718] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:39 2022] PUT /identity/v3/projects/4e5a5704ae154cc2b481cf302a0a50f7/users/e365c1ff12db4d0ca91d2c438c592785/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:39.770563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85c86e-1342-41cc-92e1-253f3d258f7b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.770923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85c86e-1342-41cc-92e1-253f3d258f7b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.771269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85c86e-1342-41cc-92e1-253f3d258f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.800236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9a85c86e-1342-41cc-92e1-253f3d258f7b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:39.801630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9a85c86e-1342-41cc-92e1-253f3d258f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:39.827821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:39.838210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba430f1e-dc70-44be-92fe-be4e087a2b75 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98f9c672a2164e76b458973a66b6203b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c66519e0dd4ef29876400cd42c0729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:39.839033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba430f1e-dc70-44be-92fe-be4e087a2b75 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.839420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba430f1e-dc70-44be-92fe-be4e087a2b75 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.839756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba430f1e-dc70-44be-92fe-be4e087a2b75 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] PATH_INFO: `/v3/projects/0eae5cc31fc7412292ec30a394e28863` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.841469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba430f1e-dc70-44be-92fe-be4e087a2b75 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: Authorizing `identity:get_project(project_id=0eae5cc31fc7412292ec30a394e28863)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:39.844647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba430f1e-dc70-44be-92fe-be4e087a2b75 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:39.846544 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 863/1719] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:51:39 2022] GET /identity/v3/projects/0eae5cc31fc7412292ec30a394e28863 => generated 395 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:39.848021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f5e2c-9565-48ed-ab27-feaaa35342df None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.848377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f5e2c-9565-48ed-ab27-feaaa35342df None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.849572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f5e2c-9565-48ed-ab27-feaaa35342df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.876100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c81f5e2c-9565-48ed-ab27-feaaa35342df None None] MFA Rules not processed for user `d8da7d5210cf42bda150d342ff207bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:39.877858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c81f5e2c-9565-48ed-ab27-feaaa35342df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:39.887789 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 857/1720] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:39.887789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85c86e-1342-41cc-92e1-253f3d258f7b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:39.893268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9a85c86e-1342-41cc-92e1-253f3d258f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:39.906978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85c86e-1342-41cc-92e1-253f3d258f7b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:39.912368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed129112-301c-423d-8602-86c644efadf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:39.912940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed129112-301c-423d-8602-86c644efadf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.913286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed129112-301c-423d-8602-86c644efadf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.913541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed129112-301c-423d-8602-86c644efadf7 admin admin] PATH_INFO: `/v3/users/f2d87dfd9c954033b46429f8b1ecedd9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.914746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed129112-301c-423d-8602-86c644efadf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d87dfd9c954033b46429f8b1ecedd9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:39.916794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed129112-301c-423d-8602-86c644efadf7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:39.950390 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 864/1721] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:39.954310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f5e2c-9565-48ed-ab27-feaaa35342df None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:39.965227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c81f5e2c-9565-48ed-ab27-feaaa35342df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:39.969126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:39.972692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ed129112-301c-423d-8602-86c644efadf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d87dfd9c954033b46429f8b1ecedd9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.976480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f5e2c-9565-48ed-ab27-feaaa35342df None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:39.980755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ed129112-301c-423d-8602-86c644efadf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d87dfd9c954033b46429f8b1ecedd9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.981540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ed129112-301c-423d-8602-86c644efadf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d87dfd9c954033b46429f8b1ecedd9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.982220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ed129112-301c-423d-8602-86c644efadf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d87dfd9c954033b46429f8b1ecedd9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:39.983106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2178bc-4e49-4c7d-acee-c92a311e484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:39.983821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2178bc-4e49-4c7d-acee-c92a311e484e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:39.985047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2178bc-4e49-4c7d-acee-c92a311e484e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:39.985165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2178bc-4e49-4c7d-acee-c92a311e484e admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:39.985832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2178bc-4e49-4c7d-acee-c92a311e484e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:39.988031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2178bc-4e49-4c7d-acee-c92a311e484e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:39.997010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ed129112-301c-423d-8602-86c644efadf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d87dfd9c954033b46429f8b1ecedd9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.015355 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 865/1722] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:39 2022] POST /identity/v3/users => generated 294 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:40.015654 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 858/1723] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:39 2022] DELETE /identity/v3/users/f2d87dfd9c954033b46429f8b1ecedd9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:40.015744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2178bc-4e49-4c7d-acee-c92a311e484e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:40.016156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00447e83-1670-4260-9214-d0bbc115bf72 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:40.016156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00447e83-1670-4260-9214-d0bbc115bf72 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:40.016156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00447e83-1670-4260-9214-d0bbc115bf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:40.018977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d2178bc-4e49-4c7d-acee-c92a311e484e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.037649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2178bc-4e49-4c7d-acee-c92a311e484e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:40.047501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-00447e83-1670-4260-9214-d0bbc115bf72 None None] MFA Rules not processed for user `e365c1ff12db4d0ca91d2c438c592785`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:40.049632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-00447e83-1670-4260-9214-d0bbc115bf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.126067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:40.126870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:40.127264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:40.127683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] PATH_INFO: `/v3/projects/47654280a88d4269a3289e9acf6d005b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:40.129083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47654280a88d4269a3289e9acf6d005b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:40.131810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:40.149916 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 859/1724] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:40.149916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00447e83-1670-4260-9214-d0bbc115bf72 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:40.150598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-00447e83-1670-4260-9214-d0bbc115bf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.179812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:40.198683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47654280a88d4269a3289e9acf6d005b', 'request_id': 'req-ccd1deea-cf49-4e2a-bb80-d20457cdd677'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.210149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47654280a88d4269a3289e9acf6d005b', 'request_id': 'req-ccd1deea-cf49-4e2a-bb80-d20457cdd677'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.218240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47654280a88d4269a3289e9acf6d005b', 'request_id': 'req-ccd1deea-cf49-4e2a-bb80-d20457cdd677'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.230964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] The token cache is being invalidate because project 47654280a88d4269a3289e9acf6d005b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:40.231231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.231851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.232186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00447e83-1670-4260-9214-d0bbc115bf72 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:40.233631 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 866/1725] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:40 2022] DELETE /identity/v3/projects/47654280a88d4269a3289e9acf6d005b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:40.234285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:40.235746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.292937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8e886-ad2a-4cb1-89d6-7fe38810ef63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:40.294160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8e886-ad2a-4cb1-89d6-7fe38810ef63 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:40.294767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8e886-ad2a-4cb1-89d6-7fe38810ef63 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:40.295146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8e886-ad2a-4cb1-89d6-7fe38810ef63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:40.297298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-75a8e886-ad2a-4cb1-89d6-7fe38810ef63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.317214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1deea-cf49-4e2a-bb80-d20457cdd677 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:40.323423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296342fc-bc35-4f12-b072-a9c318add94d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:40.324140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296342fc-bc35-4f12-b072-a9c318add94d service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:40.324452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296342fc-bc35-4f12-b072-a9c318add94d service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:40.324792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296342fc-bc35-4f12-b072-a9c318add94d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:40.326663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-296342fc-bc35-4f12-b072-a9c318add94d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.339094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:40.381053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8e886-ad2a-4cb1-89d6-7fe38810ef63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:40.382562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8e886-ad2a-4cb1-89d6-7fe38810ef63 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:40.393092 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 860/1726] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:40.393857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8e886-ad2a-4cb1-89d6-7fe38810ef63 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:40.393955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296342fc-bc35-4f12-b072-a9c318add94d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:40.395243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-75a8e886-ad2a-4cb1-89d6-7fe38810ef63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.395724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296342fc-bc35-4f12-b072-a9c318add94d service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:40.407386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8e886-ad2a-4cb1-89d6-7fe38810ef63 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:40.412880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296002d2-4c0d-4217-bc71-d6d4d60679c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:40.413695 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 867/1727] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:40.413830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296002d2-4c0d-4217-bc71-d6d4d60679c4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:40.414014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296002d2-4c0d-4217-bc71-d6d4d60679c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:40.414296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296002d2-4c0d-4217-bc71-d6d4d60679c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:40.414482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296342fc-bc35-4f12-b072-a9c318add94d service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:40.414946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296002d2-4c0d-4217-bc71-d6d4d60679c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:40.416531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296002d2-4c0d-4217-bc71-d6d4d60679c4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:40.420646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-296342fc-bc35-4f12-b072-a9c318add94d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.429299 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 861/1728] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:40.430184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296002d2-4c0d-4217-bc71-d6d4d60679c4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:40.432314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-296002d2-4c0d-4217-bc71-d6d4d60679c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.447214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296342fc-bc35-4f12-b072-a9c318add94d service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:40.448914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296002d2-4c0d-4217-bc71-d6d4d60679c4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:40.455490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:40.455654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978659d7-24de-46d9-946f-14243795ae18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:40.456391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978659d7-24de-46d9-946f-14243795ae18 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:40.456688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:40.456793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978659d7-24de-46d9-946f-14243795ae18 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:40.457128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:40.457372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978659d7-24de-46d9-946f-14243795ae18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:40.457480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] PATH_INFO: `/v3/users/8ca491afc0a64f31a14c46178f9210f2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:40.458825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca491afc0a64f31a14c46178f9210f2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:40.459786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-978659d7-24de-46d9-946f-14243795ae18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.460832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:40.534571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca491afc0a64f31a14c46178f9210f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.542657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca491afc0a64f31a14c46178f9210f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.543345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca491afc0a64f31a14c46178f9210f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.543981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca491afc0a64f31a14c46178f9210f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.548093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978659d7-24de-46d9-946f-14243795ae18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:40.550279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978659d7-24de-46d9-946f-14243795ae18 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:40.557377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:40.559413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca491afc0a64f31a14c46178f9210f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.564489 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 868/1729] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:40.565663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978659d7-24de-46d9-946f-14243795ae18 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:40.567518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-978659d7-24de-46d9-946f-14243795ae18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.588528 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 862/1730] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:40 2022] DELETE /identity/v3/users/8ca491afc0a64f31a14c46178f9210f2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:40.592848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:40.595579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.595726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978659d7-24de-46d9-946f-14243795ae18 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:40.671809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:40.672935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:40.673482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:40.673937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] PATH_INFO: `/v3/projects/aeb9e1f08ea8451d8fa0fc5efb056867` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:40.675336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeb9e1f08ea8451d8fa0fc5efb056867)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:40.678575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:40.681450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a881e8-af74-4b71-89d4-2b6c65fd5081 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:40.686608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49f492-cb5b-4051-aa4b-8ab70c8274d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:40.687226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49f492-cb5b-4051-aa4b-8ab70c8274d7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:40.687510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49f492-cb5b-4051-aa4b-8ab70c8274d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:40.687783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49f492-cb5b-4051-aa4b-8ab70c8274d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:40.688585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49f492-cb5b-4051-aa4b-8ab70c8274d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:40.690223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49f492-cb5b-4051-aa4b-8ab70c8274d7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:40.701173 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 863/1731] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:40.702376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6eec-c5c1-43f7-b847-a085107db13f None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:40.702658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6eec-c5c1-43f7-b847-a085107db13f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:40.703452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6eec-c5c1-43f7-b847-a085107db13f None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:40.704921 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 864/1732] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:40.705957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6eec-c5c1-43f7-b847-a085107db13f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:40.707980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-16fc6eec-c5c1-43f7-b847-a085107db13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.754318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:40.755604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeb9e1f08ea8451d8fa0fc5efb056867', 'request_id': 'req-96cd0ade-7222-4882-82bb-75ad04f2d392'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.765264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeb9e1f08ea8451d8fa0fc5efb056867', 'request_id': 'req-96cd0ade-7222-4882-82bb-75ad04f2d392'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.774215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeb9e1f08ea8451d8fa0fc5efb056867', 'request_id': 'req-96cd0ade-7222-4882-82bb-75ad04f2d392'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.794640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] The token cache is being invalidate because project aeb9e1f08ea8451d8fa0fc5efb056867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:40.795079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.796553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:40.798526 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 869/1733] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:40 2022] DELETE /identity/v3/projects/aeb9e1f08ea8451d8fa0fc5efb056867 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:40.802799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:40.804070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.825807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6eec-c5c1-43f7-b847-a085107db13f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:40.889451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd0ade-7222-4882-82bb-75ad04f2d392 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:40.894923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14269467-17e2-459f-a7b4-56bd7dbe8549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:40.895640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14269467-17e2-459f-a7b4-56bd7dbe8549 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:40.895864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14269467-17e2-459f-a7b4-56bd7dbe8549 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:40.896139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14269467-17e2-459f-a7b4-56bd7dbe8549 admin admin] PATH_INFO: `/v3/projects/18029da9b9854f3caf3debd9556f1f24/users/c0eb2feb062947e78357b70e832e3edc/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:40.912395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14269467-17e2-459f-a7b4-56bd7dbe8549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18029da9b9854f3caf3debd9556f1f24, user_id=c0eb2feb062947e78357b70e832e3edc, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:40.915773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f689e-7477-450a-9f3f-e271d2f46f2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:40.916239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14269467-17e2-459f-a7b4-56bd7dbe8549 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:40.916513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f689e-7477-450a-9f3f-e271d2f46f2b service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:40.916853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f689e-7477-450a-9f3f-e271d2f46f2b service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:40.917220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f689e-7477-450a-9f3f-e271d2f46f2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:40.919235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5d6f689e-7477-450a-9f3f-e271d2f46f2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.941106 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 870/1734] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:40 2022] PUT /identity/v3/projects/18029da9b9854f3caf3debd9556f1f24/users/c0eb2feb062947e78357b70e832e3edc/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:40.941106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a635505-424e-4078-b8c9-bd9dfb3c5b27 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:40.941106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a635505-424e-4078-b8c9-bd9dfb3c5b27 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:40.941106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a635505-424e-4078-b8c9-bd9dfb3c5b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:40.943674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:40.958639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6a635505-424e-4078-b8c9-bd9dfb3c5b27 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:40.959955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6a635505-424e-4078-b8c9-bd9dfb3c5b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:40.996403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f689e-7477-450a-9f3f-e271d2f46f2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:40.998770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f689e-7477-450a-9f3f-e271d2f46f2b service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:41.008521 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 865/1735] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:40 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:41.009356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f689e-7477-450a-9f3f-e271d2f46f2b service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:41.010695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5d6f689e-7477-450a-9f3f-e271d2f46f2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.027059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f689e-7477-450a-9f3f-e271d2f46f2b service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:41.032822 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 871/1736] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:51:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:41.034671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68301622-cbb5-4f68-8424-bda243f5f0c9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.034957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68301622-cbb5-4f68-8424-bda243f5f0c9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.035229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68301622-cbb5-4f68-8424-bda243f5f0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.056248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-68301622-cbb5-4f68-8424-bda243f5f0c9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:41.057568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-68301622-cbb5-4f68-8424-bda243f5f0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.089784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:41.090417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.090708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.090982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] PATH_INFO: `/v3/projects/8ab2cecd5e434869b2ed2bd7692feb27` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.092082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab2cecd5e434869b2ed2bd7692feb27)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:41.094652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:41.103004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:41.122992 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 872/1737] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:41.124270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e576f-53f3-459a-8bdb-166d1e7ca12d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.124579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e576f-53f3-459a-8bdb-166d1e7ca12d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.124864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e576f-53f3-459a-8bdb-166d1e7ca12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.145968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab2cecd5e434869b2ed2bd7692feb27', 'request_id': 'req-efcab3f9-5086-445f-b459-249f07b9a9ef'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.152911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-091e576f-53f3-459a-8bdb-166d1e7ca12d None None] MFA Rules not processed for user `c0eb2feb062947e78357b70e832e3edc`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:41.153517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab2cecd5e434869b2ed2bd7692feb27', 'request_id': 'req-efcab3f9-5086-445f-b459-249f07b9a9ef'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.154340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-091e576f-53f3-459a-8bdb-166d1e7ca12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.159716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab2cecd5e434869b2ed2bd7692feb27', 'request_id': 'req-efcab3f9-5086-445f-b459-249f07b9a9ef'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.170541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] The token cache is being invalidate because project 8ab2cecd5e434869b2ed2bd7692feb27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:41.170830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.171488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.173676 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 866/1738] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:41 2022] DELETE /identity/v3/projects/8ab2cecd5e434869b2ed2bd7692feb27 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:41.174422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:41.175731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.226369 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 873/1739] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:41.227254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e576f-53f3-459a-8bdb-166d1e7ca12d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:41.228526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-091e576f-53f3-459a-8bdb-166d1e7ca12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.228952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:41.244329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcab3f9-5086-445f-b459-249f07b9a9ef admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:41.249324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:41.249986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.250262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.250532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] PATH_INFO: `/v3/projects/7b1a2053ff2a4aecaabdb5995bb73eac` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.251663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b1a2053ff2a4aecaabdb5995bb73eac)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:41.253578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:41.300909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b1a2053ff2a4aecaabdb5995bb73eac', 'request_id': 'req-5740650a-e2a6-4aeb-83ce-cdc35ee83279'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.306394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e576f-53f3-459a-8bdb-166d1e7ca12d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:41.307999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b1a2053ff2a4aecaabdb5995bb73eac', 'request_id': 'req-5740650a-e2a6-4aeb-83ce-cdc35ee83279'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.315596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b1a2053ff2a4aecaabdb5995bb73eac', 'request_id': 'req-5740650a-e2a6-4aeb-83ce-cdc35ee83279'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.330939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] The token cache is being invalidate because project 7b1a2053ff2a4aecaabdb5995bb73eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:41.331226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.331889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.334065 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 867/1740] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:41 2022] DELETE /identity/v3/projects/7b1a2053ff2a4aecaabdb5995bb73eac => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:41.334458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:41.336525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.376008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c6bb3-33c5-4ecc-91f4-88c0ffc1eac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:41.376673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c6bb3-33c5-4ecc-91f4-88c0ffc1eac5 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.376960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c6bb3-33c5-4ecc-91f4-88c0ffc1eac5 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.377260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c6bb3-33c5-4ecc-91f4-88c0ffc1eac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.379108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-112c6bb3-33c5-4ecc-91f4-88c0ffc1eac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.395068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:41.420683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740650a-e2a6-4aeb-83ce-cdc35ee83279 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:41.424479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70129333-8e64-4825-8caf-972b5733893c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:41.425075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70129333-8e64-4825-8caf-972b5733893c service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.425391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70129333-8e64-4825-8caf-972b5733893c service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.425654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70129333-8e64-4825-8caf-972b5733893c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.427390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-70129333-8e64-4825-8caf-972b5733893c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.440505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70129333-8e64-4825-8caf-972b5733893c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:41.441070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c6bb3-33c5-4ecc-91f4-88c0ffc1eac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:41.441959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70129333-8e64-4825-8caf-972b5733893c service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:41.442723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c6bb3-33c5-4ecc-91f4-88c0ffc1eac5 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:41.451617 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 874/1741] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:41.452439 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 868/1742] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:41.453376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fc934-f4a4-4167-bcc9-a033cbaf68e2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.453648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fc934-f4a4-4167-bcc9-a033cbaf68e2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.453763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70129333-8e64-4825-8caf-972b5733893c service glance] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:41.453947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fc934-f4a4-4167-bcc9-a033cbaf68e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.455156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-70129333-8e64-4825-8caf-972b5733893c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.475690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0b3fc934-f4a4-4167-bcc9-a033cbaf68e2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:41.477111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0b3fc934-f4a4-4167-bcc9-a033cbaf68e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.553616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70129333-8e64-4825-8caf-972b5733893c service glance] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:41.560561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:41.561299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.561588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.561864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] PATH_INFO: `/v3/users/e41e0f81e2c841f083275c7dc04cce5b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.563365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41e0f81e2c841f083275c7dc04cce5b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:41.566049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:41.571606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:41.601734 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 875/1743] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:41.602666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fc934-f4a4-4167-bcc9-a033cbaf68e2 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:41.604014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0b3fc934-f4a4-4167-bcc9-a033cbaf68e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.620076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fc934-f4a4-4167-bcc9-a033cbaf68e2 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:41.626478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f02e7b-b4d2-4e82-b375-f5681e4a2d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:41.627335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f02e7b-b4d2-4e82-b375-f5681e4a2d21 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.627680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f02e7b-b4d2-4e82-b375-f5681e4a2d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.627970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f02e7b-b4d2-4e82-b375-f5681e4a2d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.628742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f02e7b-b4d2-4e82-b375-f5681e4a2d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:41.630824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f02e7b-b4d2-4e82-b375-f5681e4a2d21 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:41.650865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41e0f81e2c841f083275c7dc04cce5b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.661613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41e0f81e2c841f083275c7dc04cce5b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.666079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41e0f81e2c841f083275c7dc04cce5b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.667139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41e0f81e2c841f083275c7dc04cce5b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.681596 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 876/1744] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:41 2022] POST /identity/v3/projects => generated 389 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:41.686027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce5c0c-ec94-41eb-bd75-8d0501848a1e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.686500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce5c0c-ec94-41eb-bd75-8d0501848a1e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.686954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce5c0c-ec94-41eb-bd75-8d0501848a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.696096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41e0f81e2c841f083275c7dc04cce5b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:41.715699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d6ce5c0c-ec94-41eb-bd75-8d0501848a1e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:41.717057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d6ce5c0c-ec94-41eb-bd75-8d0501848a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.722653 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 869/1745] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:41 2022] DELETE /identity/v3/users/e41e0f81e2c841f083275c7dc04cce5b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:41.726638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:41.727910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.800744 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 877/1746] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:41.803741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce5c0c-ec94-41eb-bd75-8d0501848a1e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:41.811027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d6ce5c0c-ec94-41eb-bd75-8d0501848a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.820368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3db0ad-b686-4058-8828-80c15061f448 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:41.825474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce5c0c-ec94-41eb-bd75-8d0501848a1e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:41.826332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2db09d-afde-4ba6-8350-c0ef3228086f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:41.827021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2db09d-afde-4ba6-8350-c0ef3228086f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.827381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2db09d-afde-4ba6-8350-c0ef3228086f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.827715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2db09d-afde-4ba6-8350-c0ef3228086f admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.829252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2db09d-afde-4ba6-8350-c0ef3228086f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:41.829625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2db09d-afde-4ba6-8350-c0ef3228086f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:41.831284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c1812-a70d-4832-b518-b77bf4bed194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:41.831451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2db09d-afde-4ba6-8350-c0ef3228086f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:41.832027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c1812-a70d-4832-b518-b77bf4bed194 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.832384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c1812-a70d-4832-b518-b77bf4bed194 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.832719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c1812-a70d-4832-b518-b77bf4bed194 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.833576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c1812-a70d-4832-b518-b77bf4bed194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:41.835659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c1812-a70d-4832-b518-b77bf4bed194 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:41.847338 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 870/1747] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:41.849049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f69679-a38a-42db-80ab-bfdb691908e2 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.849539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f69679-a38a-42db-80ab-bfdb691908e2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.850014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f69679-a38a-42db-80ab-bfdb691908e2 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.852066 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 871/1748] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:41.859214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faaa30-b24f-43d4-a92c-4e412f72ce24 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.859533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faaa30-b24f-43d4-a92c-4e412f72ce24 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.860441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faaa30-b24f-43d4-a92c-4e412f72ce24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.871756 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 878/1749] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:41 2022] POST /identity/v3/users => generated 301 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:41.872829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c1812-a70d-4832-b518-b77bf4bed194 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:41.885908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c1812-a70d-4832-b518-b77bf4bed194 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:41.898163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a4450-9515-4349-a5f6-83481dd3236d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:41.899076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a4450-9515-4349-a5f6-83481dd3236d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:41.899450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a4450-9515-4349-a5f6-83481dd3236d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:41.899901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a4450-9515-4349-a5f6-83481dd3236d admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:41.900794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a4450-9515-4349-a5f6-83481dd3236d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:41.901332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c9faaa30-b24f-43d4-a92c-4e412f72ce24 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:41.902930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c9faaa30-b24f-43d4-a92c-4e412f72ce24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.903662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a4450-9515-4349-a5f6-83481dd3236d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:41.914641 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 872/1750] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:41.914641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faaa30-b24f-43d4-a92c-4e412f72ce24 None None] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:51:41.916081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c9faaa30-b24f-43d4-a92c-4e412f72ce24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:41.923075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:41.943096 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 879/1751] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:41 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:41.944748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a4450-9515-4349-a5f6-83481dd3236d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.035448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faaa30-b24f-43d4-a92c-4e412f72ce24 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.036970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c9faaa30-b24f-43d4-a92c-4e412f72ce24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.037340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a4450-9515-4349-a5f6-83481dd3236d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.043893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7e3fd-4bb9-4526-87d0-bdac4400d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.044762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7e3fd-4bb9-4526-87d0-bdac4400d499 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.045215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7e3fd-4bb9-4526-87d0-bdac4400d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.045635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7e3fd-4bb9-4526-87d0-bdac4400d499 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.046276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7e3fd-4bb9-4526-87d0-bdac4400d499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.046374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:42.048718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7e3fd-4bb9-4526-87d0-bdac4400d499 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.064854 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 880/1752] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:42.066138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7e3fd-4bb9-4526-87d0-bdac4400d499 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.080140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7e3fd-4bb9-4526-87d0-bdac4400d499 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.086897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab7958-eaa8-44e5-811d-26d5a1d7b325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.087574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7958-eaa8-44e5-811d-26d5a1d7b325 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.087909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7958-eaa8-44e5-811d-26d5a1d7b325 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.088195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7958-eaa8-44e5-811d-26d5a1d7b325 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.088844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab7958-eaa8-44e5-811d-26d5a1d7b325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:42.089225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab7958-eaa8-44e5-811d-26d5a1d7b325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.091414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab7958-eaa8-44e5-811d-26d5a1d7b325 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.113757 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 881/1753] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:42.113757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab7958-eaa8-44e5-811d-26d5a1d7b325 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.122722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab7958-eaa8-44e5-811d-26d5a1d7b325 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.129869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a45c40-793e-4243-85ea-a63235a4abe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.136905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a45c40-793e-4243-85ea-a63235a4abe8 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.136905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a45c40-793e-4243-85ea-a63235a4abe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.136905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a45c40-793e-4243-85ea-a63235a4abe8 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.136905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a45c40-793e-4243-85ea-a63235a4abe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.136905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a45c40-793e-4243-85ea-a63235a4abe8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.163318 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 882/1754] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:42 2022] POST /identity/v3/users => generated 286 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:42.163318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a45c40-793e-4243-85ea-a63235a4abe8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.168587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faaa30-b24f-43d4-a92c-4e412f72ce24 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.173501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a45c40-793e-4243-85ea-a63235a4abe8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.183867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3f536-25cb-4fff-a742-1e357fdb4ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.186910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f536-25cb-4fff-a742-1e357fdb4ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.189729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f536-25cb-4fff-a742-1e357fdb4ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.190012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f536-25cb-4fff-a742-1e357fdb4ef7 admin admin] PATH_INFO: `/v3/projects/d7a06ab89ce048bfa723ff1d7b01fcbd/users/cc3c85542ba54f539dce400859fcc1eb/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.214448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3f536-25cb-4fff-a742-1e357fdb4ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a06ab89ce048bfa723ff1d7b01fcbd, user_id=cc3c85542ba54f539dce400859fcc1eb, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.217601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3f536-25cb-4fff-a742-1e357fdb4ef7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.238730 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 883/1755] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:42 2022] PUT /identity/v3/projects/d7a06ab89ce048bfa723ff1d7b01fcbd/users/cc3c85542ba54f539dce400859fcc1eb/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:42.246247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3f536-25cb-4fff-a742-1e357fdb4ef7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.251939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-33d3f536-25cb-4fff-a742-1e357fdb4ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.252081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67704c9-80b6-47c2-8003-5f1f189b0099 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98f9c672a2164e76b458973a66b6203b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c66519e0dd4ef29876400cd42c0729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.252081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67704c9-80b6-47c2-8003-5f1f189b0099 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.252081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67704c9-80b6-47c2-8003-5f1f189b0099 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.252322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67704c9-80b6-47c2-8003-5f1f189b0099 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] PATH_INFO: `/v3/projects/0eae5cc31fc7412292ec30a394e28863` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.252322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67704c9-80b6-47c2-8003-5f1f189b0099 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: Authorizing `identity:get_project(project_id=0eae5cc31fc7412292ec30a394e28863)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.252727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67704c9-80b6-47c2-8003-5f1f189b0099 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.255936 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 873/1756] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:51:41 2022] GET /identity/v3/projects/0eae5cc31fc7412292ec30a394e28863 => generated 395 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:42.256584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67704c9-80b6-47c2-8003-5f1f189b0099 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.268132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67704c9-80b6-47c2-8003-5f1f189b0099 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.351112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e95f7f-dd9d-4cd6-b3b5-4de893717042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.351819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e95f7f-dd9d-4cd6-b3b5-4de893717042 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.352103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e95f7f-dd9d-4cd6-b3b5-4de893717042 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.352407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e95f7f-dd9d-4cd6-b3b5-4de893717042 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.353147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e95f7f-dd9d-4cd6-b3b5-4de893717042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.355799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e95f7f-dd9d-4cd6-b3b5-4de893717042 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.359025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3f536-25cb-4fff-a742-1e357fdb4ef7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.365072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.365798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.366083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.366408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] PATH_INFO: `/v3/projects/8eced9ca22ee49d5bf3f3e11032586ef` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.367556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eced9ca22ee49d5bf3f3e11032586ef)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.369593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.387671 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 874/1757] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:42 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:42.387671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e95f7f-dd9d-4cd6-b3b5-4de893717042 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.411934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:42.422389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eced9ca22ee49d5bf3f3e11032586ef', 'request_id': 'req-4dfcde47-5558-4820-8a7e-dda9eae127e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:42.429888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eced9ca22ee49d5bf3f3e11032586ef', 'request_id': 'req-4dfcde47-5558-4820-8a7e-dda9eae127e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:42.432608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:42.435897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eced9ca22ee49d5bf3f3e11032586ef', 'request_id': 'req-4dfcde47-5558-4820-8a7e-dda9eae127e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:42.447864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] The token cache is being invalidate because project 8eced9ca22ee49d5bf3f3e11032586ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:42.448153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:42.448813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:42.450569 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 884/1758] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:42 2022] DELETE /identity/v3/projects/8eced9ca22ee49d5bf3f3e11032586ef => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:42.451277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.452594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.454093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e95f7f-dd9d-4cd6-b3b5-4de893717042 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.512539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d233c1-5d6f-4de8-a51f-8f7e94405233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.513148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d233c1-5d6f-4de8-a51f-8f7e94405233 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.513458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d233c1-5d6f-4de8-a51f-8f7e94405233 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.513738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d233c1-5d6f-4de8-a51f-8f7e94405233 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.514494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d233c1-5d6f-4de8-a51f-8f7e94405233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.516131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d233c1-5d6f-4de8-a51f-8f7e94405233 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.522628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcde47-5558-4820-8a7e-dda9eae127e4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.525702 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 875/1759] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:42.526952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b2fc0-7b86-4163-ae00-a9945fff47cb None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.527241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b2fc0-7b86-4163-ae00-a9945fff47cb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.527518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b2fc0-7b86-4163-ae00-a9945fff47cb None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.529125 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 876/1760] 10.222.0.26 () {54 vars in 961 bytes} [Sat Oct 8 20:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:42.529897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b2fc0-7b86-4163-ae00-a9945fff47cb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.530698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b95789-c102-4779-8c60-b690ed23d958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.531953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b95789-c102-4779-8c60-b690ed23d958 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.532174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-633b2fc0-7b86-4163-ae00-a9945fff47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.532273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b95789-c102-4779-8c60-b690ed23d958 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.532496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b95789-c102-4779-8c60-b690ed23d958 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.533172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b95789-c102-4779-8c60-b690ed23d958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.534780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b95789-c102-4779-8c60-b690ed23d958 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.545135 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 885/1761] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:42.546286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847df17-7f48-4133-a574-f81552c8eb71 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.546687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847df17-7f48-4133-a574-f81552c8eb71 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.547499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847df17-7f48-4133-a574-f81552c8eb71 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.548074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b2fc0-7b86-4163-ae00-a9945fff47cb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.548865 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 886/1762] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:42.549384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847df17-7f48-4133-a574-f81552c8eb71 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.551073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b847df17-7f48-4133-a574-f81552c8eb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.553245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68742c76-e02d-42da-b0af-82b2c5e17284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.554056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68742c76-e02d-42da-b0af-82b2c5e17284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.554342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68742c76-e02d-42da-b0af-82b2c5e17284 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.554619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68742c76-e02d-42da-b0af-82b2c5e17284 admin admin] PATH_INFO: `/v3/users/f08bbc4d5e674d8d9d69be4a574dc7d8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.555736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68742c76-e02d-42da-b0af-82b2c5e17284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f08bbc4d5e674d8d9d69be4a574dc7d8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.557663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68742c76-e02d-42da-b0af-82b2c5e17284 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.566222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847df17-7f48-4133-a574-f81552c8eb71 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.573370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be8d5b-26a1-4115-b83a-b883c61a1029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.573970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be8d5b-26a1-4115-b83a-b883c61a1029 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.574246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be8d5b-26a1-4115-b83a-b883c61a1029 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.574512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be8d5b-26a1-4115-b83a-b883c61a1029 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.575133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be8d5b-26a1-4115-b83a-b883c61a1029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.577015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be8d5b-26a1-4115-b83a-b883c61a1029 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.599090 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 887/1763] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:42 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:42.600307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c920d-fdba-482d-98bf-b12dc4222105 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.600607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c920d-fdba-482d-98bf-b12dc4222105 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.600860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c920d-fdba-482d-98bf-b12dc4222105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.611561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68742c76-e02d-42da-b0af-82b2c5e17284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f08bbc4d5e674d8d9d69be4a574dc7d8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:42.620768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68742c76-e02d-42da-b0af-82b2c5e17284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f08bbc4d5e674d8d9d69be4a574dc7d8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:42.621547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68742c76-e02d-42da-b0af-82b2c5e17284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f08bbc4d5e674d8d9d69be4a574dc7d8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:42.621717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1e7c920d-fdba-482d-98bf-b12dc4222105 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:42.622222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68742c76-e02d-42da-b0af-82b2c5e17284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f08bbc4d5e674d8d9d69be4a574dc7d8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:42.622923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1e7c920d-fdba-482d-98bf-b12dc4222105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.631086 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 888/1764] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:42.632004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c920d-fdba-482d-98bf-b12dc4222105 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.633461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1e7c920d-fdba-482d-98bf-b12dc4222105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.634674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68742c76-e02d-42da-b0af-82b2c5e17284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f08bbc4d5e674d8d9d69be4a574dc7d8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:42.645552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c920d-fdba-482d-98bf-b12dc4222105 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.650268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718e5e7-6d1d-47cd-b196-894369b3726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.650651 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 877/1765] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:42 2022] DELETE /identity/v3/users/f08bbc4d5e674d8d9d69be4a574dc7d8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:42.650870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718e5e7-6d1d-47cd-b196-894369b3726d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.651157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718e5e7-6d1d-47cd-b196-894369b3726d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.651430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718e5e7-6d1d-47cd-b196-894369b3726d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.651860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30caecb-4a07-4037-8ac6-efa54d28e051 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.652074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718e5e7-6d1d-47cd-b196-894369b3726d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.652163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30caecb-4a07-4037-8ac6-efa54d28e051 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.652400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30caecb-4a07-4037-8ac6-efa54d28e051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.653701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718e5e7-6d1d-47cd-b196-894369b3726d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.667369 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 889/1766] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:42.667369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718e5e7-6d1d-47cd-b196-894369b3726d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.667369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5718e5e7-6d1d-47cd-b196-894369b3726d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.674195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c30caecb-4a07-4037-8ac6-efa54d28e051 None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:42.675358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c30caecb-4a07-4037-8ac6-efa54d28e051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.680012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718e5e7-6d1d-47cd-b196-894369b3726d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.722955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:42.738847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b46e49-ec77-4494-ac46-73d77724297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.739601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b46e49-ec77-4494-ac46-73d77724297f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.739977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b46e49-ec77-4494-ac46-73d77724297f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.740351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b46e49-ec77-4494-ac46-73d77724297f admin admin] PATH_INFO: `/v3/projects/d7a06ab89ce048bfa723ff1d7b01fcbd/users/cc3c85542ba54f539dce400859fcc1eb/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.742404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b46e49-ec77-4494-ac46-73d77724297f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a06ab89ce048bfa723ff1d7b01fcbd, user_id=cc3c85542ba54f539dce400859fcc1eb, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.742895 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 878/1767] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Oct 8 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:42.743795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30caecb-4a07-4037-8ac6-efa54d28e051 None None] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:51:42.745128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c30caecb-4a07-4037-8ac6-efa54d28e051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.745479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b46e49-ec77-4494-ac46-73d77724297f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.757730 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 890/1768] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:42 2022] PUT /identity/v3/projects/d7a06ab89ce048bfa723ff1d7b01fcbd/users/cc3c85542ba54f539dce400859fcc1eb/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:42.758661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b46e49-ec77-4494-ac46-73d77724297f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.760196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-24b46e49-ec77-4494-ac46-73d77724297f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.788273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:42.819158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30caecb-4a07-4037-8ac6-efa54d28e051 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.820425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c30caecb-4a07-4037-8ac6-efa54d28e051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.830206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b46e49-ec77-4494-ac46-73d77724297f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.835100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40f84c-0a48-4c2c-a6f2-31717542993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.835751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40f84c-0a48-4c2c-a6f2-31717542993c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.836035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40f84c-0a48-4c2c-a6f2-31717542993c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.836312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40f84c-0a48-4c2c-a6f2-31717542993c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.836956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40f84c-0a48-4c2c-a6f2-31717542993c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.839469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40f84c-0a48-4c2c-a6f2-31717542993c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.851393 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 891/1769] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:42.852909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97e0ac-cf2d-400c-aa01-25aa94ce1a3f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.853209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97e0ac-cf2d-400c-aa01-25aa94ce1a3f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.853502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97e0ac-cf2d-400c-aa01-25aa94ce1a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.873413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6f97e0ac-cf2d-400c-aa01-25aa94ce1a3f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:42.874619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6f97e0ac-cf2d-400c-aa01-25aa94ce1a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.882720 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 892/1770] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:42.883688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30caecb-4a07-4037-8ac6-efa54d28e051 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.884713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb2d6d-bb6b-4eae-bffb-34eabfe2b78b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.885122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb2d6d-bb6b-4eae-bffb-34eabfe2b78b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.885581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb2d6d-bb6b-4eae-bffb-34eabfe2b78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.907966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-91eb2d6d-bb6b-4eae-bffb-34eabfe2b78b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:42.909166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-91eb2d6d-bb6b-4eae-bffb-34eabfe2b78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:42.917201 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 893/1771] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:42.921047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb2d6d-bb6b-4eae-bffb-34eabfe2b78b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.930740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb2d6d-bb6b-4eae-bffb-34eabfe2b78b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:42.935577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76347a90-67da-4ae9-b97d-a7694ca9f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.936233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347a90-67da-4ae9-b97d-a7694ca9f7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.936511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347a90-67da-4ae9-b97d-a7694ca9f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.936784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347a90-67da-4ae9-b97d-a7694ca9f7b5 admin admin] PATH_INFO: `/v3/projects/ef2fd17648b14068b5a681006f95ac9a/users/1916262d539f47998ee7bf15f882c37c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.947595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f39f57-cf90-4d1d-a69b-27c879f494d3 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98f9c672a2164e76b458973a66b6203b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c66519e0dd4ef29876400cd42c0729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:42.948231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39f57-cf90-4d1d-a69b-27c879f494d3 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.948523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39f57-cf90-4d1d-a69b-27c879f494d3 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.948808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39f57-cf90-4d1d-a69b-27c879f494d3 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] PATH_INFO: `/v3/projects/0eae5cc31fc7412292ec30a394e28863` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:42.950011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f39f57-cf90-4d1d-a69b-27c879f494d3 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: Authorizing `identity:get_project(project_id=0eae5cc31fc7412292ec30a394e28863)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.952059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f39f57-cf90-4d1d-a69b-27c879f494d3 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.952335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76347a90-67da-4ae9-b97d-a7694ca9f7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2fd17648b14068b5a681006f95ac9a, user_id=1916262d539f47998ee7bf15f882c37c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:42.954422 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 879/1772] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:51:42 2022] GET /identity/v3/projects/0eae5cc31fc7412292ec30a394e28863 => generated 395 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:42.955058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f39f57-cf90-4d1d-a69b-27c879f494d3 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:42.955512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76347a90-67da-4ae9-b97d-a7694ca9f7b5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:42.970443 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 894/1773] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:42 2022] PUT /identity/v3/projects/ef2fd17648b14068b5a681006f95ac9a/users/1916262d539f47998ee7bf15f882c37c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:42.971700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e43cfa-2ccb-4531-ac97-29c4394374ca None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:42.971987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e43cfa-2ccb-4531-ac97-29c4394374ca None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:42.972263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e43cfa-2ccb-4531-ac97-29c4394374ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.002924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-16e43cfa-2ccb-4531-ac97-29c4394374ca None None] MFA Rules not processed for user `cc3c85542ba54f539dce400859fcc1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:43.004129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-16e43cfa-2ccb-4531-ac97-29c4394374ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:43.008362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:43.038553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f39f57-cf90-4d1d-a69b-27c879f494d3 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:43.101925 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 895/1774] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:43.101925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e43cfa-2ccb-4531-ac97-29c4394374ca None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:43.110495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816df96-b03a-4f38-a550-3bcd4e15e456 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:43.111200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816df96-b03a-4f38-a550-3bcd4e15e456 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.111542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816df96-b03a-4f38-a550-3bcd4e15e456 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.111881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816df96-b03a-4f38-a550-3bcd4e15e456 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.113861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8816df96-b03a-4f38-a550-3bcd4e15e456 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:43.127002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816df96-b03a-4f38-a550-3bcd4e15e456 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:43.128700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816df96-b03a-4f38-a550-3bcd4e15e456 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:43.139089 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 880/1775] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:43.139894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816df96-b03a-4f38-a550-3bcd4e15e456 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:43.163645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e43cfa-2ccb-4531-ac97-29c4394374ca None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:43.168477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50038c-2946-4bb3-9da8-1403bc613736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:43.169069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50038c-2946-4bb3-9da8-1403bc613736 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.169380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50038c-2946-4bb3-9da8-1403bc613736 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.169658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50038c-2946-4bb3-9da8-1403bc613736 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.170381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50038c-2946-4bb3-9da8-1403bc613736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:43.172680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50038c-2946-4bb3-9da8-1403bc613736 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:43.185755 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 896/1776] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:43.186594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50038c-2946-4bb3-9da8-1403bc613736 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:43.188978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2f50038c-2946-4bb3-9da8-1403bc613736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:43.195025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:43.217168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816df96-b03a-4f38-a550-3bcd4e15e456 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:43.223445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67d832-9b6a-4c25-a93e-6e94386a9265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:43.224051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d832-9b6a-4c25-a93e-6e94386a9265 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.224329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d832-9b6a-4c25-a93e-6e94386a9265 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.224608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d832-9b6a-4c25-a93e-6e94386a9265 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.225277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67d832-9b6a-4c25-a93e-6e94386a9265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:43.225582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67d832-9b6a-4c25-a93e-6e94386a9265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:43.227214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67d832-9b6a-4c25-a93e-6e94386a9265 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:43.243988 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 881/1777] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:43.243988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0d0ed-26ea-4431-a5e4-862d381ffaf9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.243988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0d0ed-26ea-4431-a5e4-862d381ffaf9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.243988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0d0ed-26ea-4431-a5e4-862d381ffaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.266265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50038c-2946-4bb3-9da8-1403bc613736 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:43.270160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cacffd-dc6f-483c-86c7-3c2b2b7c5c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:43.270840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cacffd-dc6f-483c-86c7-3c2b2b7c5c68 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.271188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cacffd-dc6f-483c-86c7-3c2b2b7c5c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.271696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cacffd-dc6f-483c-86c7-3c2b2b7c5c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.272361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c2a0d0ed-26ea-4431-a5e4-862d381ffaf9 None None] MFA Rules not processed for user `1916262d539f47998ee7bf15f882c37c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:43.273608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c2a0d0ed-26ea-4431-a5e4-862d381ffaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:43.284238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cacffd-dc6f-483c-86c7-3c2b2b7c5c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:43.285836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cacffd-dc6f-483c-86c7-3c2b2b7c5c68 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:43.297797 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 897/1778] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:43.299157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e3b66-96e2-485e-9e2f-ddf5fa313b09 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.299542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e3b66-96e2-485e-9e2f-ddf5fa313b09 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.299921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e3b66-96e2-485e-9e2f-ddf5fa313b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.320292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8e0e3b66-96e2-485e-9e2f-ddf5fa313b09 None None] MFA Rules not processed for user `c0eb2feb062947e78357b70e832e3edc`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:43.321737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8e0e3b66-96e2-485e-9e2f-ddf5fa313b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:43.338798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:43.364767 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 882/1779] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:43.366213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceee7c-f16d-4a46-ba66-7eddaa97e592 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.366624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceee7c-f16d-4a46-ba66-7eddaa97e592 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.367042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceee7c-f16d-4a46-ba66-7eddaa97e592 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.369468 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 883/1780] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:43.370359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceee7c-f16d-4a46-ba66-7eddaa97e592 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:43.386743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceee7c-f16d-4a46-ba66-7eddaa97e592 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:43.393905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c5e28-a59b-4cec-936f-4d5ac04a0439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:43.394705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c5e28-a59b-4cec-936f-4d5ac04a0439 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.395764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c5e28-a59b-4cec-936f-4d5ac04a0439 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.396213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c5e28-a59b-4cec-936f-4d5ac04a0439 admin admin] PATH_INFO: `/v3/projects/00d9071ba2e34475baf046a4c42f9889/users/572574747ca24cadb63e09288452bd25/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.410002 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 898/1781] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:43.411178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e3b66-96e2-485e-9e2f-ddf5fa313b09 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:43.423765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c5e28-a59b-4cec-936f-4d5ac04a0439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d9071ba2e34475baf046a4c42f9889, user_id=572574747ca24cadb63e09288452bd25, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:43.426019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e3b66-96e2-485e-9e2f-ddf5fa313b09 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:43.426653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c5e28-a59b-4cec-936f-4d5ac04a0439 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:43.433688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e44fe-f2a9-4bd4-a373-5cc6dcc405fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:43.434588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e44fe-f2a9-4bd4-a373-5cc6dcc405fe admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.434963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e44fe-f2a9-4bd4-a373-5cc6dcc405fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.435302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e44fe-f2a9-4bd4-a373-5cc6dcc405fe admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.436039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e44fe-f2a9-4bd4-a373-5cc6dcc405fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:43.439617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e44fe-f2a9-4bd4-a373-5cc6dcc405fe admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:43.446189 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 884/1782] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:43 2022] PUT /identity/v3/projects/00d9071ba2e34475baf046a4c42f9889/users/572574747ca24cadb63e09288452bd25/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:43.447314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c5e28-a59b-4cec-936f-4d5ac04a0439 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:43.512857 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 899/1783] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:43 2022] POST /identity/v3/projects => generated 409 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:43.513763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e44fe-f2a9-4bd4-a373-5cc6dcc405fe admin admin] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:51:43.539588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c5e28-a59b-4cec-936f-4d5ac04a0439 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:43.610784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cb126-c905-400a-b4d3-78be24836a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:43.611745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb126-c905-400a-b4d3-78be24836a62 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.612027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb126-c905-400a-b4d3-78be24836a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.612300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb126-c905-400a-b4d3-78be24836a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.612987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cb126-c905-400a-b4d3-78be24836a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:43.615424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cb126-c905-400a-b4d3-78be24836a62 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:43.625614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e44fe-f2a9-4bd4-a373-5cc6dcc405fe admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:43.654872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:43.658056 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 885/1784] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:43 2022] POST /identity/v3/projects => generated 371 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:43.659326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bd5b0-145a-4d83-adbe-c9fb3c6cfdb9 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.660274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bd5b0-145a-4d83-adbe-c9fb3c6cfdb9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.660583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bd5b0-145a-4d83-adbe-c9fb3c6cfdb9 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.663258 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 886/1785] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:43.664481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8cc93-4efd-4d11-a0d1-9545dcf1d529 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.664681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8cc93-4efd-4d11-a0d1-9545dcf1d529 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.664968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8cc93-4efd-4d11-a0d1-9545dcf1d529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.697004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4df8cc93-4efd-4d11-a0d1-9545dcf1d529 None None] MFA Rules not processed for user `572574747ca24cadb63e09288452bd25`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:43.697816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4df8cc93-4efd-4d11-a0d1-9545dcf1d529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:43.730782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e44fe-f2a9-4bd4-a373-5cc6dcc405fe admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:43.786284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:43.813620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e99511-21f8-415d-b37f-4bba1a341b7b tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98f9c672a2164e76b458973a66b6203b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c66519e0dd4ef29876400cd42c0729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:43.814166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e99511-21f8-415d-b37f-4bba1a341b7b tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.814451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e99511-21f8-415d-b37f-4bba1a341b7b tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.814727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e99511-21f8-415d-b37f-4bba1a341b7b tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] PATH_INFO: `/v3/projects/482fd4a7abb2475b90f6ce367fdf296d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.816523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e99511-21f8-415d-b37f-4bba1a341b7b tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: Authorizing `identity:get_project(project_id=482fd4a7abb2475b90f6ce367fdf296d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:43.817901 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 887/1786] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:43.818869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8cc93-4efd-4d11-a0d1-9545dcf1d529 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:43.822241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e99511-21f8-415d-b37f-4bba1a341b7b tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:43.824184 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 900/1787] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:51:43 2022] GET /identity/v3/projects/482fd4a7abb2475b90f6ce367fdf296d => generated 395 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:43.824830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e99511-21f8-415d-b37f-4bba1a341b7b tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:43.897522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e99511-21f8-415d-b37f-4bba1a341b7b tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:43.902423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe62f6e-7bc7-4188-ae3d-80c7b9b51163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:43.902962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe62f6e-7bc7-4188-ae3d-80c7b9b51163 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.903241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe62f6e-7bc7-4188-ae3d-80c7b9b51163 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.903511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe62f6e-7bc7-4188-ae3d-80c7b9b51163 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.904543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe62f6e-7bc7-4188-ae3d-80c7b9b51163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:43.904992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8cc93-4efd-4d11-a0d1-9545dcf1d529 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:43.907187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe62f6e-7bc7-4188-ae3d-80c7b9b51163 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:43.910047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f355b8-6a03-4ba2-ba39-b524e35f434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:43.910551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f355b8-6a03-4ba2-ba39-b524e35f434b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.910823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f355b8-6a03-4ba2-ba39-b524e35f434b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.911091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f355b8-6a03-4ba2-ba39-b524e35f434b admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.911718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f355b8-6a03-4ba2-ba39-b524e35f434b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:43.913657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f355b8-6a03-4ba2-ba39-b524e35f434b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:43.940627 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 901/1788] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:43 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:43.940627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e6040-dcd3-42fd-8644-bcb21eb496b1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.940854 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 888/1789] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:43 2022] POST /identity/v3/users => generated 305 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:43.940938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e6040-dcd3-42fd-8644-bcb21eb496b1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.940938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e6040-dcd3-42fd-8644-bcb21eb496b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.941068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f355b8-6a03-4ba2-ba39-b524e35f434b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:43.942425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-20f355b8-6a03-4ba2-ba39-b524e35f434b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:43.955076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f355b8-6a03-4ba2-ba39-b524e35f434b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:43.960435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:43.961119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:43.961429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:43.961753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] PATH_INFO: `/v3/projects/4659f85445ab4c7497b0c04e4aaee542` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:43.962882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4659f85445ab4c7497b0c04e4aaee542)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:43.964772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:43.965313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-414e6040-dcd3-42fd-8644-bcb21eb496b1 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:43.966871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-414e6040-dcd3-42fd-8644-bcb21eb496b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:44.019467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4659f85445ab4c7497b0c04e4aaee542', 'request_id': 'req-64249976-83fd-4192-bd39-6a5fe493b3e8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:44.028627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4659f85445ab4c7497b0c04e4aaee542', 'request_id': 'req-64249976-83fd-4192-bd39-6a5fe493b3e8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:44.035366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:44.037243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4659f85445ab4c7497b0c04e4aaee542', 'request_id': 'req-64249976-83fd-4192-bd39-6a5fe493b3e8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:44.051066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] The token cache is being invalidate because project 4659f85445ab4c7497b0c04e4aaee542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:44.051351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:44.052105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:44.057236 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 889/1790] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:43 2022] DELETE /identity/v3/projects/4659f85445ab4c7497b0c04e4aaee542 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:44.058029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:44.058810 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 902/1791] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:51:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:44.059368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:44.059768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e6040-dcd3-42fd-8644-bcb21eb496b1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:44.071617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e6040-dcd3-42fd-8644-bcb21eb496b1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:44.134022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64249976-83fd-4192-bd39-6a5fe493b3e8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:44.138879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec99ea5-f842-4be8-a7cb-feff9d089a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:44.139568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec99ea5-f842-4be8-a7cb-feff9d089a48 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:44.139932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec99ea5-f842-4be8-a7cb-feff9d089a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:44.140292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec99ea5-f842-4be8-a7cb-feff9d089a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:44.140990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec99ea5-f842-4be8-a7cb-feff9d089a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:44.143015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec99ea5-f842-4be8-a7cb-feff9d089a48 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:44.145246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f2bd0-0481-4cb7-bd50-451bae6a7a60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:44.145873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f2bd0-0481-4cb7-bd50-451bae6a7a60 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:44.146150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f2bd0-0481-4cb7-bd50-451bae6a7a60 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:44.146422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f2bd0-0481-4cb7-bd50-451bae6a7a60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:44.148684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-018f2bd0-0481-4cb7-bd50-451bae6a7a60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:44.149062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:44.180676 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 890/1792] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:44 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:44.181793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec99ea5-f842-4be8-a7cb-feff9d089a48 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:44.183620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3ec99ea5-f842-4be8-a7cb-feff9d089a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:44.214970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f2bd0-0481-4cb7-bd50-451bae6a7a60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:44.216570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f2bd0-0481-4cb7-bd50-451bae6a7a60 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:44.226727 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 903/1793] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:44.227401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f2bd0-0481-4cb7-bd50-451bae6a7a60 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:44.228702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-018f2bd0-0481-4cb7-bd50-451bae6a7a60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:44.245764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f2bd0-0481-4cb7-bd50-451bae6a7a60 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:44.266009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec99ea5-f842-4be8-a7cb-feff9d089a48 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:44.274782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215a701-c7c3-4eab-8502-fa8aff5cbbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:44.275759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215a701-c7c3-4eab-8502-fa8aff5cbbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:44.276048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215a701-c7c3-4eab-8502-fa8aff5cbbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:44.276236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215a701-c7c3-4eab-8502-fa8aff5cbbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:44.276906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215a701-c7c3-4eab-8502-fa8aff5cbbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:44.278613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215a701-c7c3-4eab-8502-fa8aff5cbbf3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:44.289650 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 891/1794] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:44.294177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215a701-c7c3-4eab-8502-fa8aff5cbbf3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:44.296228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c215a701-c7c3-4eab-8502-fa8aff5cbbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:44.311009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215a701-c7c3-4eab-8502-fa8aff5cbbf3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:44.316912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:44.317267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5954e99-10a2-47ca-b34c-62384fbcf692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:44.317589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:44.317871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:44.317970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5954e99-10a2-47ca-b34c-62384fbcf692 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:44.318141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] PATH_INFO: `/v3/users/e365c1ff12db4d0ca91d2c438c592785` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:44.318309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5954e99-10a2-47ca-b34c-62384fbcf692 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:44.318565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5954e99-10a2-47ca-b34c-62384fbcf692 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:44.319347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e365c1ff12db4d0ca91d2c438c592785)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:44.319453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5954e99-10a2-47ca-b34c-62384fbcf692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:44.321064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5954e99-10a2-47ca-b34c-62384fbcf692 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:44.321354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:44.334766 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 904/1795] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:44.335911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5954e99-10a2-47ca-b34c-62384fbcf692 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:44.339943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b5954e99-10a2-47ca-b34c-62384fbcf692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:44.384312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:44.390342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e365c1ff12db4d0ca91d2c438c592785'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:44.400883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e365c1ff12db4d0ca91d2c438c592785'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:44.402684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e365c1ff12db4d0ca91d2c438c592785'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:44.404600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e365c1ff12db4d0ca91d2c438c592785'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:44.424676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5954e99-10a2-47ca-b34c-62384fbcf692 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:44.424861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e365c1ff12db4d0ca91d2c438c592785'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:44.429007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98c328-d7e0-4f11-ab84-17c718b4d7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:44.429695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98c328-d7e0-4f11-ab84-17c718b4d7bf service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:44.429979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98c328-d7e0-4f11-ab84-17c718b4d7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:44.430260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98c328-d7e0-4f11-ab84-17c718b4d7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:44.433152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bd98c328-d7e0-4f11-ab84-17c718b4d7bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:44.448297 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 892/1796] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:44 2022] DELETE /identity/v3/users/e365c1ff12db4d0ca91d2c438c592785 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:44.448297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:44.449782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:44.551948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:44.561685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98416488-8955-48d5-b6af-6b4bb0fb1204 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:44.563238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98c328-d7e0-4f11-ab84-17c718b4d7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:44.566174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98c328-d7e0-4f11-ab84-17c718b4d7bf service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:44.571603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74d0cb-5953-4d77-94b2-0544f796930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:44.573045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74d0cb-5953-4d77-94b2-0544f796930c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:44.573641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74d0cb-5953-4d77-94b2-0544f796930c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:44.574104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74d0cb-5953-4d77-94b2-0544f796930c admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:44.575701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74d0cb-5953-4d77-94b2-0544f796930c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:44.580596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74d0cb-5953-4d77-94b2-0544f796930c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:44.586071 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 905/1797] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:44.586904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98c328-d7e0-4f11-ab84-17c718b4d7bf service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:44.588553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bd98c328-d7e0-4f11-ab84-17c718b4d7bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:44.606710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98c328-d7e0-4f11-ab84-17c718b4d7bf service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:44.613297 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 893/1798] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:44 2022] POST /identity/v3/users => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:44.613297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74d0cb-5953-4d77-94b2-0544f796930c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:44.613997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6b74d0cb-5953-4d77-94b2-0544f796930c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:44.621136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff70af-133a-430f-8696-1c13b432063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:44.623126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff70af-133a-430f-8696-1c13b432063c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:44.623421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff70af-133a-430f-8696-1c13b432063c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:44.623704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff70af-133a-430f-8696-1c13b432063c admin admin] PATH_INFO: `/v3/projects/69d75ec37f6146ff9012467b91982ae7/users/63cd351416cb487f9596aab791bfcfa9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:44.627698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74d0cb-5953-4d77-94b2-0544f796930c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:44.633859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578889e-7944-4844-a39c-005e8ef1a263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:44.634492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578889e-7944-4844-a39c-005e8ef1a263 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:44.634773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578889e-7944-4844-a39c-005e8ef1a263 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:44.635046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578889e-7944-4844-a39c-005e8ef1a263 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:44.635707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578889e-7944-4844-a39c-005e8ef1a263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:44.637601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578889e-7944-4844-a39c-005e8ef1a263 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:44.649633 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 894/1799] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:44.650966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578889e-7944-4844-a39c-005e8ef1a263 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:44.669491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578889e-7944-4844-a39c-005e8ef1a263 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:44.671118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff70af-133a-430f-8696-1c13b432063c admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d75ec37f6146ff9012467b91982ae7, user_id=63cd351416cb487f9596aab791bfcfa9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:44.675474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2560b5-90a9-4d41-9253-0e9e23ba9d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:44.675704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff70af-133a-430f-8696-1c13b432063c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:44.676094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2560b5-90a9-4d41-9253-0e9e23ba9d57 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:44.676373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2560b5-90a9-4d41-9253-0e9e23ba9d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:44.676642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2560b5-90a9-4d41-9253-0e9e23ba9d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:44.677323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2560b5-90a9-4d41-9253-0e9e23ba9d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:44.679012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2560b5-90a9-4d41-9253-0e9e23ba9d57 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:44.697802 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 895/1800] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:44.697802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2560b5-90a9-4d41-9253-0e9e23ba9d57 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:44.709475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2560b5-90a9-4d41-9253-0e9e23ba9d57 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:44.723124 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 906/1801] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:44 2022] PUT /identity/v3/projects/69d75ec37f6146ff9012467b91982ae7/users/63cd351416cb487f9596aab791bfcfa9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:44.723124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff70af-133a-430f-8696-1c13b432063c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:44.791190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679d926-c27b-4a01-8c30-bcece6b714c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:44.791872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679d926-c27b-4a01-8c30-bcece6b714c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:44.792159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679d926-c27b-4a01-8c30-bcece6b714c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:44.792434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679d926-c27b-4a01-8c30-bcece6b714c1 admin admin] PATH_INFO: `/v3/projects/25e5719631704099bbe867f49e9cf46a/users/741ac01d74dc40928be925f0c2468c4b/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:44.830948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679d926-c27b-4a01-8c30-bcece6b714c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e5719631704099bbe867f49e9cf46a, user_id=741ac01d74dc40928be925f0c2468c4b, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:44.834246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679d926-c27b-4a01-8c30-bcece6b714c1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:44.869879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff70af-133a-430f-8696-1c13b432063c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:44.879801 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 896/1802] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:44 2022] PUT /identity/v3/projects/25e5719631704099bbe867f49e9cf46a/users/741ac01d74dc40928be925f0c2468c4b/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:44.880743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679d926-c27b-4a01-8c30-bcece6b714c1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:44.952323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:44.964810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068f79a-baab-436c-b641-24737fbe5c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:44.965861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068f79a-baab-436c-b641-24737fbe5c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:44.966141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068f79a-baab-436c-b641-24737fbe5c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:44.966418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068f79a-baab-436c-b641-24737fbe5c12 admin admin] PATH_INFO: `/v3/projects/db33d17d8b364b30986fc9b10f145d0d/users/5d95868598ec40d38931c8bf1c7223b3/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:44.985991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068f79a-baab-436c-b641-24737fbe5c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db33d17d8b364b30986fc9b10f145d0d, user_id=5d95868598ec40d38931c8bf1c7223b3, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:44.988978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068f79a-baab-436c-b641-24737fbe5c12 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:44.997819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679d926-c27b-4a01-8c30-bcece6b714c1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:45.007731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97baf50-51fc-4319-b695-5047be30a26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:45.008362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97baf50-51fc-4319-b695-5047be30a26e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:45.008648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97baf50-51fc-4319-b695-5047be30a26e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:45.008927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97baf50-51fc-4319-b695-5047be30a26e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:45.012032 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 907/1803] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:44 2022] PUT /identity/v3/projects/db33d17d8b364b30986fc9b10f145d0d/users/5d95868598ec40d38931c8bf1c7223b3/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:45.013676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97588781-34be-4083-af41-d89df9bec219 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:45.013874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97588781-34be-4083-af41-d89df9bec219 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:45.014286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97588781-34be-4083-af41-d89df9bec219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:45.016231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97baf50-51fc-4319-b695-5047be30a26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:45.018382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97baf50-51fc-4319-b695-5047be30a26e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:45.047578 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 897/1804] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:45.048455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97baf50-51fc-4319-b695-5047be30a26e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:45.052201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-97588781-34be-4083-af41-d89df9bec219 None None] MFA Rules not processed for user `741ac01d74dc40928be925f0c2468c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:45.052767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c97baf50-51fc-4319-b695-5047be30a26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:45.053461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-97588781-34be-4083-af41-d89df9bec219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:45.100578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97baf50-51fc-4319-b695-5047be30a26e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:45.151055 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 908/1805] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:45.152074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97588781-34be-4083-af41-d89df9bec219 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:45.155355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-97588781-34be-4083-af41-d89df9bec219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:45.199429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:45.221893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:45.222814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:45.223207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:45.223563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] PATH_INFO: `/v3/projects/4e5a5704ae154cc2b481cf302a0a50f7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:45.224781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e5a5704ae154cc2b481cf302a0a50f7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:45.227020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:45.255395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97588781-34be-4083-af41-d89df9bec219 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:45.265062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:45.266604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:45.266894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:45.267166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] PATH_INFO: `/v3/users/61756ba79b6e4b7e96b93e16abcd0676` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:45.268680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=61756ba79b6e4b7e96b93e16abcd0676)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:45.272468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:45.316426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5a5704ae154cc2b481cf302a0a50f7', 'request_id': 'req-019d8c18-d7ff-4207-a8cf-f817db703bbe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:45.330766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5a5704ae154cc2b481cf302a0a50f7', 'request_id': 'req-019d8c18-d7ff-4207-a8cf-f817db703bbe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:45.339184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5a5704ae154cc2b481cf302a0a50f7', 'request_id': 'req-019d8c18-d7ff-4207-a8cf-f817db703bbe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:45.354706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] The token cache is being invalidate because project 4e5a5704ae154cc2b481cf302a0a50f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:45.355006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:45.355671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:45.355984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61756ba79b6e4b7e96b93e16abcd0676'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:45.358037 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 898/1806] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:45 2022] DELETE /identity/v3/projects/4e5a5704ae154cc2b481cf302a0a50f7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:45.361885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:45.366212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:45.368452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61756ba79b6e4b7e96b93e16abcd0676'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:45.369178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61756ba79b6e4b7e96b93e16abcd0676'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:45.369844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61756ba79b6e4b7e96b93e16abcd0676'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:45.381307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:45.390075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61756ba79b6e4b7e96b93e16abcd0676'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:45.414497 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 909/1807] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:45 2022] DELETE /identity/v3/users/61756ba79b6e4b7e96b93e16abcd0676 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:45.414497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:45.416033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:45.457204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d8c18-d7ff-4207-a8cf-f817db703bbe admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:45.512706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400b075-13b5-4904-b7df-d35ef2f32c8f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:45.518848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2343d-8caa-44de-b545-66f86dbe3e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:45.519535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2343d-8caa-44de-b545-66f86dbe3e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:45.519826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2343d-8caa-44de-b545-66f86dbe3e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:45.520112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2343d-8caa-44de-b545-66f86dbe3e27 admin admin] PATH_INFO: `/v3/projects/69d75ec37f6146ff9012467b91982ae7/users/63cd351416cb487f9596aab791bfcfa9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:45.522363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2343d-8caa-44de-b545-66f86dbe3e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d75ec37f6146ff9012467b91982ae7, user_id=63cd351416cb487f9596aab791bfcfa9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:45.525607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2343d-8caa-44de-b545-66f86dbe3e27 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:45.541135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5866cf8-3d7e-4bf8-840e-370126f89a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:45.550905 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 910/1808] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:45 2022] PUT /identity/v3/projects/69d75ec37f6146ff9012467b91982ae7/users/63cd351416cb487f9596aab791bfcfa9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:45.551077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5866cf8-3d7e-4bf8-840e-370126f89a84 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:45.551077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5866cf8-3d7e-4bf8-840e-370126f89a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:45.551077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5866cf8-3d7e-4bf8-840e-370126f89a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:45.551628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2343d-8caa-44de-b545-66f86dbe3e27 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:45.551732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5866cf8-3d7e-4bf8-840e-370126f89a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:45.551817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-76d2343d-8caa-44de-b545-66f86dbe3e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:45.551893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5866cf8-3d7e-4bf8-840e-370126f89a84 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:45.561605 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 899/1809] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:45.562738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a4ae7-0916-4ab6-929f-8f204280ff9e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:45.563025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a4ae7-0916-4ab6-929f-8f204280ff9e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:45.563299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a4ae7-0916-4ab6-929f-8f204280ff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:45.593141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:45.634563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c53a4ae7-0916-4ab6-929f-8f204280ff9e None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:45.636138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c53a4ae7-0916-4ab6-929f-8f204280ff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:45.636827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2343d-8caa-44de-b545-66f86dbe3e27 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:45.642788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf0bbc-ccb2-46ec-8a98-b01e1d3a23fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:45.643544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf0bbc-ccb2-46ec-8a98-b01e1d3a23fc admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:45.644023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf0bbc-ccb2-46ec-8a98-b01e1d3a23fc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:45.644489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf0bbc-ccb2-46ec-8a98-b01e1d3a23fc admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:45.645316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf0bbc-ccb2-46ec-8a98-b01e1d3a23fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:45.647978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf0bbc-ccb2-46ec-8a98-b01e1d3a23fc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:45.687082 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 911/1810] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:45 2022] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:45.688625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c51bc-c29a-40df-b915-7c759f17f88f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:45.688983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c51bc-c29a-40df-b915-7c759f17f88f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:45.689488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c51bc-c29a-40df-b915-7c759f17f88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:45.721441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-042c51bc-c29a-40df-b915-7c759f17f88f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:45.723212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-042c51bc-c29a-40df-b915-7c759f17f88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:45.730250 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 900/1811] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:45.731661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34228f-7142-4d36-9fd7-6c838295008f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:45.731951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34228f-7142-4d36-9fd7-6c838295008f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:45.732232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34228f-7142-4d36-9fd7-6c838295008f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:45.765620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6b34228f-7142-4d36-9fd7-6c838295008f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:45.767183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6b34228f-7142-4d36-9fd7-6c838295008f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:45.878231 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 912/1812] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:45.879816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38ce77-70b9-4093-9959-8ff3d86dd19d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:45.880173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38ce77-70b9-4093-9959-8ff3d86dd19d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:45.881276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38ce77-70b9-4093-9959-8ff3d86dd19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:45.889201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:45.944883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4b38ce77-70b9-4093-9959-8ff3d86dd19d None None] MFA Rules not processed for user `63cd351416cb487f9596aab791bfcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:45.945378 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 901/1813] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:45.946016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4b38ce77-70b9-4093-9959-8ff3d86dd19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:45.946235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34228f-7142-4d36-9fd7-6c838295008f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:45.951949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6b34228f-7142-4d36-9fd7-6c838295008f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:45.977422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34228f-7142-4d36-9fd7-6c838295008f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:45.987521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883eacb-6c91-4e5a-9b21-8bde57347734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:45.988525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883eacb-6c91-4e5a-9b21-8bde57347734 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:45.989029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883eacb-6c91-4e5a-9b21-8bde57347734 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:45.989391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883eacb-6c91-4e5a-9b21-8bde57347734 admin admin] PATH_INFO: `/v3/projects/db33d17d8b364b30986fc9b10f145d0d/users/5d95868598ec40d38931c8bf1c7223b3/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:45.992386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883eacb-6c91-4e5a-9b21-8bde57347734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db33d17d8b364b30986fc9b10f145d0d, user_id=5d95868598ec40d38931c8bf1c7223b3, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:45.995202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883eacb-6c91-4e5a-9b21-8bde57347734 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:46.017462 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 902/1814] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:45 2022] PUT /identity/v3/projects/db33d17d8b364b30986fc9b10f145d0d/users/5d95868598ec40d38931c8bf1c7223b3/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:46.019220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883eacb-6c91-4e5a-9b21-8bde57347734 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:46.071022 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 913/1815] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:46.078394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5caa-ac02-4e38-8c46-2258bf154dde None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:46.078837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5caa-ac02-4e38-8c46-2258bf154dde None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:46.079184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5caa-ac02-4e38-8c46-2258bf154dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:46.101672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-070a5caa-ac02-4e38-8c46-2258bf154dde None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:46.103116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-070a5caa-ac02-4e38-8c46-2258bf154dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:46.149140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883eacb-6c91-4e5a-9b21-8bde57347734 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:46.160682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b5fc3-583f-492d-89f3-6896ce8234e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:46.161974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b5fc3-583f-492d-89f3-6896ce8234e3 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:46.161974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b5fc3-583f-492d-89f3-6896ce8234e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:46.162204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b5fc3-583f-492d-89f3-6896ce8234e3 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:46.162861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b5fc3-583f-492d-89f3-6896ce8234e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:46.165051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b5fc3-583f-492d-89f3-6896ce8234e3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:46.188247 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 903/1816] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:46 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:46.190043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b5fc3-583f-492d-89f3-6896ce8234e3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:46.197699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-772b5fc3-583f-492d-89f3-6896ce8234e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:46.212355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:46.222375 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 914/1817] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:46.222375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a5caa-ac02-4e38-8c46-2258bf154dde None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:46.222375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-070a5caa-ac02-4e38-8c46-2258bf154dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:46.299645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a5caa-ac02-4e38-8c46-2258bf154dde None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:46.303961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcd8e8-f44c-48bb-a833-acfb7c79bd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:46.304680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcd8e8-f44c-48bb-a833-acfb7c79bd40 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:46.305013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcd8e8-f44c-48bb-a833-acfb7c79bd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:46.305328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcd8e8-f44c-48bb-a833-acfb7c79bd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:46.319833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcd8e8-f44c-48bb-a833-acfb7c79bd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:46.321474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcd8e8-f44c-48bb-a833-acfb7c79bd40 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:46.334439 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 915/1818] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:46.336011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd4f70-86fc-455d-a19b-018c28122456 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:46.336433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd4f70-86fc-455d-a19b-018c28122456 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:46.336719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd4f70-86fc-455d-a19b-018c28122456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:46.339870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b5fc3-583f-492d-89f3-6896ce8234e3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:46.346033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b0d80-fd64-4fb7-9656-2fc6992b55a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:46.346809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0d80-fd64-4fb7-9656-2fc6992b55a7 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:46.347150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0d80-fd64-4fb7-9656-2fc6992b55a7 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:46.347557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0d80-fd64-4fb7-9656-2fc6992b55a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:46.387272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f1fd4f70-86fc-455d-a19b-018c28122456 None None] MFA Rules not processed for user `5d95868598ec40d38931c8bf1c7223b3`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:46.388563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f1fd4f70-86fc-455d-a19b-018c28122456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:46.432533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:46.445852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b0d80-fd64-4fb7-9656-2fc6992b55a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:46.448216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b0d80-fd64-4fb7-9656-2fc6992b55a7 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:46.463411 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 904/1819] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:51:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:46.464448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b0d80-fd64-4fb7-9656-2fc6992b55a7 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:46.469013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9c9b0d80-fd64-4fb7-9656-2fc6992b55a7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:46.539456 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 916/1820] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:46.544463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd4f70-86fc-455d-a19b-018c28122456 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:46.559620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd4f70-86fc-455d-a19b-018c28122456 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:46.566728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4594b-8910-4523-8cb1-77ca86402e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:46.567387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4594b-8910-4523-8cb1-77ca86402e5f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:46.567663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4594b-8910-4523-8cb1-77ca86402e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:46.568018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4594b-8910-4523-8cb1-77ca86402e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:46.568708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4594b-8910-4523-8cb1-77ca86402e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:46.570436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4594b-8910-4523-8cb1-77ca86402e5f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:46.584607 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 917/1821] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:46.585545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4594b-8910-4523-8cb1-77ca86402e5f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:46.606459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4594b-8910-4523-8cb1-77ca86402e5f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:46.629922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cb4e8-1061-48df-bad8-640c92750341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:46.630690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cb4e8-1061-48df-bad8-640c92750341 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:46.630968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cb4e8-1061-48df-bad8-640c92750341 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:46.632384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cb4e8-1061-48df-bad8-640c92750341 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:46.633109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cb4e8-1061-48df-bad8-640c92750341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:46.633448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cb4e8-1061-48df-bad8-640c92750341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:46.637646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cb4e8-1061-48df-bad8-640c92750341 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:46.681086 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 918/1822] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:46.694529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28f8cc-6de8-469f-868a-b0c61a33df92 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:46.697780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28f8cc-6de8-469f-868a-b0c61a33df92 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:46.698132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28f8cc-6de8-469f-868a-b0c61a33df92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:46.720759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b0d80-fd64-4fb7-9656-2fc6992b55a7 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:46.747759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3972b-c938-4ceb-b4fc-f570565cb9d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:46.749074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3972b-c938-4ceb-b4fc-f570565cb9d8 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:46.749309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3972b-c938-4ceb-b4fc-f570565cb9d8 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:46.749683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3972b-c938-4ceb-b4fc-f570565cb9d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:46.762135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-df28f8cc-6de8-469f-868a-b0c61a33df92 None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:46.766817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-df28f8cc-6de8-469f-868a-b0c61a33df92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:46.782628 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 919/1823] 10.222.0.50 () {58 vars in 1015 bytes} [Sat Oct 8 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:46.784504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28f8cc-6de8-469f-868a-b0c61a33df92 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:46.786246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-df28f8cc-6de8-469f-868a-b0c61a33df92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:46.805561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:46.861005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28f8cc-6de8-469f-868a-b0c61a33df92 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:46.875770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe6f1b-706e-42ae-80f5-94293f22323e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:46.876480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe6f1b-706e-42ae-80f5-94293f22323e service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:46.876781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe6f1b-706e-42ae-80f5-94293f22323e service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:46.876955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe6f1b-706e-42ae-80f5-94293f22323e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:46.897213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe6f1b-706e-42ae-80f5-94293f22323e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:46.897213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe6f1b-706e-42ae-80f5-94293f22323e service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:46.902541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3972b-c938-4ceb-b4fc-f570565cb9d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:46.904333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3972b-c938-4ceb-b4fc-f570565cb9d8 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:46.915844 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 905/1824] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:46.916854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3972b-c938-4ceb-b4fc-f570565cb9d8 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:46.919396 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 920/1825] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:46.929170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3972b-c938-4ceb-b4fc-f570565cb9d8 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:46.934408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe6f1b-706e-42ae-80f5-94293f22323e service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:46.941965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ccdc-a149-496d-a55a-6e6bbeeab09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:46.942910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ccdc-a149-496d-a55a-6e6bbeeab09e admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:46.943267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ccdc-a149-496d-a55a-6e6bbeeab09e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:46.944126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ccdc-a149-496d-a55a-6e6bbeeab09e admin admin] PATH_INFO: `/v3/projects/dce8bee46a4746e7a9e9eea8ee41f96f/users/65fcc45a91984476a8164a59a1e2ddfa/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:46.949116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe6f1b-706e-42ae-80f5-94293f22323e service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:46.971710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f912e83-f70d-4625-81f5-0dcd97242a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:46.973177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f912e83-f70d-4625-81f5-0dcd97242a03 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:46.973665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2ccdc-a149-496d-a55a-6e6bbeeab09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce8bee46a4746e7a9e9eea8ee41f96f, user_id=65fcc45a91984476a8164a59a1e2ddfa, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:46.974112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f912e83-f70d-4625-81f5-0dcd97242a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:46.975126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f912e83-f70d-4625-81f5-0dcd97242a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:46.976554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f912e83-f70d-4625-81f5-0dcd97242a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:46.980359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f912e83-f70d-4625-81f5-0dcd97242a03 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:46.987616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2ccdc-a149-496d-a55a-6e6bbeeab09e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:47.018850 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 906/1826] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:46 2022] PUT /identity/v3/projects/dce8bee46a4746e7a9e9eea8ee41f96f/users/65fcc45a91984476a8164a59a1e2ddfa/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:47.020001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ccdc-a149-496d-a55a-6e6bbeeab09e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:47.022051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7ef2ccdc-a149-496d-a55a-6e6bbeeab09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:47.050521 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 921/1827] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:46 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:47.052370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecef41-f4b1-4bd9-bab9-3b0771470ac1 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:47.052663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecef41-f4b1-4bd9-bab9-3b0771470ac1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:47.053082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecef41-f4b1-4bd9-bab9-3b0771470ac1 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:47.054568 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 922/1828] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:47.055717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecef41-f4b1-4bd9-bab9-3b0771470ac1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:47.057251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4eecef41-f4b1-4bd9-bab9-3b0771470ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:47.135681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ccdc-a149-496d-a55a-6e6bbeeab09e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:47.160263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecef41-f4b1-4bd9-bab9-3b0771470ac1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:47.167628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:47.168595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:47.168916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:47.169223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] PATH_INFO: `/v3/projects/0eae5cc31fc7412292ec30a394e28863` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:47.171106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eae5cc31fc7412292ec30a394e28863)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:47.174935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:47.213796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f73d4e-8bd5-4ed4-b68f-d4b30680417b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:47.213796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f73d4e-8bd5-4ed4-b68f-d4b30680417b service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:47.213796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f73d4e-8bd5-4ed4-b68f-d4b30680417b service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:47.213796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f73d4e-8bd5-4ed4-b68f-d4b30680417b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:47.237350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f73d4e-8bd5-4ed4-b68f-d4b30680417b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:47.238915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f73d4e-8bd5-4ed4-b68f-d4b30680417b service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:47.266794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:47.279747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eae5cc31fc7412292ec30a394e28863', 'request_id': 'req-f2cd6e76-6575-4296-99e3-ade9d8518373'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:47.287210 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 907/1829] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:47.288299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f73d4e-8bd5-4ed4-b68f-d4b30680417b service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:47.292589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eae5cc31fc7412292ec30a394e28863', 'request_id': 'req-f2cd6e76-6575-4296-99e3-ade9d8518373'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:47.303497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eae5cc31fc7412292ec30a394e28863', 'request_id': 'req-f2cd6e76-6575-4296-99e3-ade9d8518373'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:47.324623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] The token cache is being invalidate because project 0eae5cc31fc7412292ec30a394e28863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:47.325141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:47.326157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:47.330653 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 923/1830] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:47 2022] DELETE /identity/v3/projects/0eae5cc31fc7412292ec30a394e28863 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:47.330653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:47.330891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f73d4e-8bd5-4ed4-b68f-d4b30680417b service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:47.333716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:47.519326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:47.532936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725a44b-f505-4eb2-b164-b006908cfe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:47.533848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725a44b-f505-4eb2-b164-b006908cfe54 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:47.534303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725a44b-f505-4eb2-b164-b006908cfe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:47.534737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725a44b-f505-4eb2-b164-b006908cfe54 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:47.535719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725a44b-f505-4eb2-b164-b006908cfe54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:47.535837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd6e76-6575-4296-99e3-ade9d8518373 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:47.537827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725a44b-f505-4eb2-b164-b006908cfe54 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:47.554265 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 908/1831] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:47.554265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725a44b-f505-4eb2-b164-b006908cfe54 admin admin] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:51:47.557560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2725a44b-f505-4eb2-b164-b006908cfe54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:47.560662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28c77c-a7a5-4d61-9835-779ed6312591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:47.561462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28c77c-a7a5-4d61-9835-779ed6312591 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:47.561757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28c77c-a7a5-4d61-9835-779ed6312591 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:47.565628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28c77c-a7a5-4d61-9835-779ed6312591 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:47.566332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28c77c-a7a5-4d61-9835-779ed6312591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:47.568382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28c77c-a7a5-4d61-9835-779ed6312591 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:47.625438 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 924/1832] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:47 2022] POST /identity/v3/users => generated 295 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:47.626267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28c77c-a7a5-4d61-9835-779ed6312591 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:47.629958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9e28c77c-a7a5-4d61-9835-779ed6312591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:47.676193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28c77c-a7a5-4d61-9835-779ed6312591 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:47.686628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725a44b-f505-4eb2-b164-b006908cfe54 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:47.688292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:47.688952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:47.689085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2725a44b-f505-4eb2-b164-b006908cfe54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:47.689265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:47.689549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] PATH_INFO: `/v3/users/98f9c672a2164e76b458973a66b6203b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:47.690797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f9c672a2164e76b458973a66b6203b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:47.692794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:47.796250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f9c672a2164e76b458973a66b6203b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:47.810380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f9c672a2164e76b458973a66b6203b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:47.816127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f9c672a2164e76b458973a66b6203b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:47.816931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f9c672a2164e76b458973a66b6203b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:47.846937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f9c672a2164e76b458973a66b6203b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:47.882175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725a44b-f505-4eb2-b164-b006908cfe54 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:47.889351 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 925/1833] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:47 2022] DELETE /identity/v3/users/98f9c672a2164e76b458973a66b6203b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:47.890397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:47.891888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:47.964636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:48.049300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb287c-54d1-44f2-9293-b1ee9690c9fe admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:48.067848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad79c12-1a57-4b0d-b9d9-74412d7d7b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:48.069665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ffa7d-f49a-4f5f-9d0c-1fece0524945 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d95868598ec40d38931c8bf1c7223b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db33d17d8b364b30986fc9b10f145d0d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:48.070232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ffa7d-f49a-4f5f-9d0c-1fece0524945 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:48.070609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ffa7d-f49a-4f5f-9d0c-1fece0524945 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:48.071194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79c12-1a57-4b0d-b9d9-74412d7d7b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:48.073291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79c12-1a57-4b0d-b9d9-74412d7d7b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:48.074627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79c12-1a57-4b0d-b9d9-74412d7d7b0a admin admin] PATH_INFO: `/v3/projects/dce8bee46a4746e7a9e9eea8ee41f96f/users/65fcc45a91984476a8164a59a1e2ddfa/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:48.082935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ffa7d-f49a-4f5f-9d0c-1fece0524945 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] PATH_INFO: `/v3/projects/00d9071ba2e34475baf046a4c42f9889` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:48.085061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad79c12-1a57-4b0d-b9d9-74412d7d7b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce8bee46a4746e7a9e9eea8ee41f96f, user_id=65fcc45a91984476a8164a59a1e2ddfa, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:48.094659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ffa7d-f49a-4f5f-9d0c-1fece0524945 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorizing `identity:get_project(project_id=00d9071ba2e34475baf046a4c42f9889)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:48.095846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad79c12-1a57-4b0d-b9d9-74412d7d7b0a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:48.096958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ffa7d-f49a-4f5f-9d0c-1fece0524945 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:48.099626 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 909/1834] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:51:47 2022] GET /identity/v3/projects/00d9071ba2e34475baf046a4c42f9889 => generated 377 bytes in 547 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:48.100482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ffa7d-f49a-4f5f-9d0c-1fece0524945 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:48.102192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a30ffa7d-f49a-4f5f-9d0c-1fece0524945 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:48.130857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ffa7d-f49a-4f5f-9d0c-1fece0524945 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:48.149137 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 926/1835] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:47 2022] PUT /identity/v3/projects/dce8bee46a4746e7a9e9eea8ee41f96f/users/65fcc45a91984476a8164a59a1e2ddfa/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:48.149137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c988-b720-410b-89de-b5402f6c3646 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:48.150320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c988-b720-410b-89de-b5402f6c3646 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:48.150320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c988-b720-410b-89de-b5402f6c3646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:48.221749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:48.237834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9924c988-b720-410b-89de-b5402f6c3646 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:48.244653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9924c988-b720-410b-89de-b5402f6c3646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:48.286619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b387c13-d5c9-4980-9089-75978355a715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:48.287187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b387c13-d5c9-4980-9089-75978355a715 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:48.287489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b387c13-d5c9-4980-9089-75978355a715 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:48.287789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b387c13-d5c9-4980-9089-75978355a715 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:48.288555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b387c13-d5c9-4980-9089-75978355a715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:48.290164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b387c13-d5c9-4980-9089-75978355a715 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:48.336231 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 910/1836] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:48.342526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be67269-23c3-4c8b-8895-3e7d0fc3e8d1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:48.342815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be67269-23c3-4c8b-8895-3e7d0fc3e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:48.343097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be67269-23c3-4c8b-8895-3e7d0fc3e8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:48.446175 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 927/1837] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:48.451351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c988-b720-410b-89de-b5402f6c3646 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:48.482605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3be67269-23c3-4c8b-8895-3e7d0fc3e8d1 None None] MFA Rules not processed for user `65fcc45a91984476a8164a59a1e2ddfa`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:48.486616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3be67269-23c3-4c8b-8895-3e7d0fc3e8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:48.515652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c988-b720-410b-89de-b5402f6c3646 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:48.536876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949e084-8a6b-4ded-9e8d-0adf5eafe132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:48.537763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949e084-8a6b-4ded-9e8d-0adf5eafe132 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:48.538178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949e084-8a6b-4ded-9e8d-0adf5eafe132 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:48.538976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949e084-8a6b-4ded-9e8d-0adf5eafe132 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:48.541734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949e084-8a6b-4ded-9e8d-0adf5eafe132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:48.543826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949e084-8a6b-4ded-9e8d-0adf5eafe132 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:48.584769 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 928/1838] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:48.586186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949e084-8a6b-4ded-9e8d-0adf5eafe132 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:48.593025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4949e084-8a6b-4ded-9e8d-0adf5eafe132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:48.681695 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 911/1839] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:48.683779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0b247-dfcd-4a77-a0e8-be95a7fbe862 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:48.684242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0b247-dfcd-4a77-a0e8-be95a7fbe862 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:48.684665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0b247-dfcd-4a77-a0e8-be95a7fbe862 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:48.688773 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 912/1840] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:51:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:48.689791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0b247-dfcd-4a77-a0e8-be95a7fbe862 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:48.723232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0b247-dfcd-4a77-a0e8-be95a7fbe862 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:48.733887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dde04-8c1c-4845-8a63-92ebaf5bd28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:48.735153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dde04-8c1c-4845-8a63-92ebaf5bd28a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:48.736402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dde04-8c1c-4845-8a63-92ebaf5bd28a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:48.736853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dde04-8c1c-4845-8a63-92ebaf5bd28a admin admin] PATH_INFO: `/v3/projects/3ed33c5c5583407ba2abc7d01a848c80/users/9a8f1a93eeb149ecafc725099b645705/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:48.767621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949e084-8a6b-4ded-9e8d-0adf5eafe132 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:48.785995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dde04-8c1c-4845-8a63-92ebaf5bd28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed33c5c5583407ba2abc7d01a848c80, user_id=9a8f1a93eeb149ecafc725099b645705, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:48.791264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f085465-5726-4196-a29a-cb642ec7e2b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:48.794877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f085465-5726-4196-a29a-cb642ec7e2b1 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:48.796515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f085465-5726-4196-a29a-cb642ec7e2b1 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:48.797063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f085465-5726-4196-a29a-cb642ec7e2b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:48.798893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dde04-8c1c-4845-8a63-92ebaf5bd28a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:48.817867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f085465-5726-4196-a29a-cb642ec7e2b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:48.835935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f085465-5726-4196-a29a-cb642ec7e2b1 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:48.839049 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 913/1841] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:48 2022] PUT /identity/v3/projects/3ed33c5c5583407ba2abc7d01a848c80/users/9a8f1a93eeb149ecafc725099b645705/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:48.842247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dde04-8c1c-4845-8a63-92ebaf5bd28a admin admin] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:51:48.852877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cd7dde04-8c1c-4845-8a63-92ebaf5bd28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:48.864641 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 929/1842] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:51:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:48.872745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f085465-5726-4196-a29a-cb642ec7e2b1 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:48.874471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9f085465-5726-4196-a29a-cb642ec7e2b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:49.004188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:49.056971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dde04-8c1c-4845-8a63-92ebaf5bd28a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:49.060853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f085465-5726-4196-a29a-cb642ec7e2b1 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:49.061941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cd7dde04-8c1c-4845-8a63-92ebaf5bd28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:49.075563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8acc0-24c8-4624-8edb-63b3217ed925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:49.077264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8acc0-24c8-4624-8edb-63b3217ed925 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:49.080198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8acc0-24c8-4624-8edb-63b3217ed925 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:49.080604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8acc0-24c8-4624-8edb-63b3217ed925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:49.127577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:49.208965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dde04-8c1c-4845-8a63-92ebaf5bd28a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:49.222920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e48084-d843-485f-8ea9-42fabccb0860 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d95868598ec40d38931c8bf1c7223b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db33d17d8b364b30986fc9b10f145d0d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:49.223668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e48084-d843-485f-8ea9-42fabccb0860 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:49.225522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e48084-d843-485f-8ea9-42fabccb0860 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:49.225522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e48084-d843-485f-8ea9-42fabccb0860 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] PATH_INFO: `/v3/projects/00d9071ba2e34475baf046a4c42f9889` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:49.227701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8acc0-24c8-4624-8edb-63b3217ed925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:49.228788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e48084-d843-485f-8ea9-42fabccb0860 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorizing `identity:get_project(project_id=00d9071ba2e34475baf046a4c42f9889)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:49.231042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e48084-d843-485f-8ea9-42fabccb0860 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:49.233053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8acc0-24c8-4624-8edb-63b3217ed925 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:49.239231 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 914/1843] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:51:48 2022] GET /identity/v3/projects/00d9071ba2e34475baf046a4c42f9889 => generated 377 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:49.240591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d4a39-c121-4ab8-95c7-b65c67344640 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:49.240950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d4a39-c121-4ab8-95c7-b65c67344640 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:49.243608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d4a39-c121-4ab8-95c7-b65c67344640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:49.259054 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 930/1844] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:48 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:49.295747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8acc0-24c8-4624-8edb-63b3217ed925 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:49.312479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8acc0-24c8-4624-8edb-63b3217ed925 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:49.315778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-540d4a39-c121-4ab8-95c7-b65c67344640 None None] MFA Rules not processed for user `9a8f1a93eeb149ecafc725099b645705`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:49.317291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-540d4a39-c121-4ab8-95c7-b65c67344640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:49.334148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd9397-9259-4ab3-8dae-8937c8bff998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:49.336086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd9397-9259-4ab3-8dae-8937c8bff998 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:49.338308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd9397-9259-4ab3-8dae-8937c8bff998 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:49.345498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd9397-9259-4ab3-8dae-8937c8bff998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:49.350522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-64cd9397-9259-4ab3-8dae-8937c8bff998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:49.550347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd9397-9259-4ab3-8dae-8937c8bff998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:49.552038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd9397-9259-4ab3-8dae-8937c8bff998 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:49.554074 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 915/1845] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:49.558595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d4a39-c121-4ab8-95c7-b65c67344640 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:49.588821 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 931/1846] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:49 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:51:49.708114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d4a39-c121-4ab8-95c7-b65c67344640 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:49.724417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc3516-3bb1-42ed-8cad-3621ea3dac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:49.725342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc3516-3bb1-42ed-8cad-3621ea3dac95 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:49.727455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc3516-3bb1-42ed-8cad-3621ea3dac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:49.727872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc3516-3bb1-42ed-8cad-3621ea3dac95 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:49.728654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc3516-3bb1-42ed-8cad-3621ea3dac95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:49.731404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc3516-3bb1-42ed-8cad-3621ea3dac95 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:49.811975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd9397-9259-4ab3-8dae-8937c8bff998 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:49.815324 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 916/1847] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:49 2022] POST /identity/v3/projects => generated 391 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:51:49.817933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-64cd9397-9259-4ab3-8dae-8937c8bff998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:49.819211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc3516-3bb1-42ed-8cad-3621ea3dac95 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:49.849451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd9397-9259-4ab3-8dae-8937c8bff998 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:49.943166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:49.992613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc3516-3bb1-42ed-8cad-3621ea3dac95 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:49.999015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c9948-3c14-4481-9ad1-72d1a599cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:50.000526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c9948-3c14-4481-9ad1-72d1a599cc0a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:50.000913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c9948-3c14-4481-9ad1-72d1a599cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:50.001317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c9948-3c14-4481-9ad1-72d1a599cc0a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:50.002340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c9948-3c14-4481-9ad1-72d1a599cc0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:50.007494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c9948-3c14-4481-9ad1-72d1a599cc0a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:50.051936 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 917/1848] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:49 2022] POST /identity/v3/users => generated 302 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:50.054213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3a084-805f-4689-829a-a96d319310df None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:50.054619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3a084-805f-4689-829a-a96d319310df None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:50.055622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3a084-805f-4689-829a-a96d319310df None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:50.059920 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 918/1849] 10.222.0.26 () {54 vars in 921 bytes} [Sat Oct 8 20:51:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:50.063374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa184d-9fad-4850-a3e8-ad4b840ee321 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:50.063749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa184d-9fad-4850-a3e8-ad4b840ee321 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:50.065546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa184d-9fad-4850-a3e8-ad4b840ee321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:50.074521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:50.079097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:50.080284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:50.081461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] PATH_INFO: `/v3/projects/82c66519e0dd4ef29876400cd42c0729` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:50.085217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82c66519e0dd4ef29876400cd42c0729)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:50.089414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:50.112966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-96aa184d-9fad-4850-a3e8-ad4b840ee321 None None] MFA Rules not processed for user `572574747ca24cadb63e09288452bd25`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:50.114461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-96aa184d-9fad-4850-a3e8-ad4b840ee321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:50.235232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:50.249991 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 919/1850] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:50.250969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa184d-9fad-4850-a3e8-ad4b840ee321 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:50.274953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa184d-9fad-4850-a3e8-ad4b840ee321 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:50.291612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d8206-00b8-40c9-8dd8-c8211a962031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:50.292581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d8206-00b8-40c9-8dd8-c8211a962031 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:50.292970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d8206-00b8-40c9-8dd8-c8211a962031 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:50.293439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d8206-00b8-40c9-8dd8-c8211a962031 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:50.294298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d8206-00b8-40c9-8dd8-c8211a962031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:50.296191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d8206-00b8-40c9-8dd8-c8211a962031 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:50.318479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82c66519e0dd4ef29876400cd42c0729', 'request_id': 'req-0c66812f-3825-4027-9cf1-8f52bfaaea31'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:50.321245 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 920/1851] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:50.324124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a054-f069-4a9c-99d7-138799847fdc None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:50.325510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a054-f069-4a9c-99d7-138799847fdc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:50.325883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a054-f069-4a9c-99d7-138799847fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:50.336892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82c66519e0dd4ef29876400cd42c0729', 'request_id': 'req-0c66812f-3825-4027-9cf1-8f52bfaaea31'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:50.353895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82c66519e0dd4ef29876400cd42c0729', 'request_id': 'req-0c66812f-3825-4027-9cf1-8f52bfaaea31'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:50.369411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7be7a054-f069-4a9c-99d7-138799847fdc None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:50.372863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7be7a054-f069-4a9c-99d7-138799847fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:50.402335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] The token cache is being invalidate because project 82c66519e0dd4ef29876400cd42c0729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:50.402644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:50.405275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:50.409945 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 932/1852] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:49 2022] DELETE /identity/v3/projects/82c66519e0dd4ef29876400cd42c0729 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:50.411481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:50.415700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:50.561103 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 921/1853] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:50.562229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7a054-f069-4a9c-99d7-138799847fdc None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:50.572608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7be7a054-f069-4a9c-99d7-138799847fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:50.586513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66812f-3825-4027-9cf1-8f52bfaaea31 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:50.600429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:50.601165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:50.603369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:50.603662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] PATH_INFO: `/v3/users/741ac01d74dc40928be925f0c2468c4b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:50.607087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] RBAC: Authorizing `identity:delete_user(user_id=741ac01d74dc40928be925f0c2468c4b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:50.613307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:50.620300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7a054-f069-4a9c-99d7-138799847fdc None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:50.632144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b9998-aa03-42cd-b49a-c2aa33d48412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:50.633096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b9998-aa03-42cd-b49a-c2aa33d48412 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:50.633619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b9998-aa03-42cd-b49a-c2aa33d48412 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:50.634378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b9998-aa03-42cd-b49a-c2aa33d48412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:50.640880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5c1b9998-aa03-42cd-b49a-c2aa33d48412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:50.721905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '741ac01d74dc40928be925f0c2468c4b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:50.744383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '741ac01d74dc40928be925f0c2468c4b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:50.745330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '741ac01d74dc40928be925f0c2468c4b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:50.745971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '741ac01d74dc40928be925f0c2468c4b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:50.766385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '741ac01d74dc40928be925f0c2468c4b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:50.783628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:50.787683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b9998-aa03-42cd-b49a-c2aa33d48412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:50.790480 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 933/1854] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:50 2022] DELETE /identity/v3/users/741ac01d74dc40928be925f0c2468c4b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:50.791135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b9998-aa03-42cd-b49a-c2aa33d48412 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:50.791500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:50.792977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:50.810749 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 922/1855] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:50.811594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b9998-aa03-42cd-b49a-c2aa33d48412 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:50.814262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5c1b9998-aa03-42cd-b49a-c2aa33d48412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:50.837970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b9998-aa03-42cd-b49a-c2aa33d48412 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:50.838769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:50.903968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11715b38-3cc9-4c29-ac6e-8c3fac1a368a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:50.913066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8639956-72be-4ed0-a459-af43d50f5813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:50.914059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8639956-72be-4ed0-a459-af43d50f5813 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:50.914735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8639956-72be-4ed0-a459-af43d50f5813 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:50.915299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8639956-72be-4ed0-a459-af43d50f5813 admin admin] PATH_INFO: `/v3/projects/2c273e41881d4a7da8391a2e6cc7ba5a/users/2aeaa49cabb846a2b84639f38c07d5e1/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:50.918230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb402d59-b865-4f8f-a5c5-03d566b42d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:50.921737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb402d59-b865-4f8f-a5c5-03d566b42d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:50.922292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb402d59-b865-4f8f-a5c5-03d566b42d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:50.922685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb402d59-b865-4f8f-a5c5-03d566b42d4b admin admin] PATH_INFO: `/v3/users/8d448cec797f4063b936ab9b2a3031b4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:50.937781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb402d59-b865-4f8f-a5c5-03d566b42d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d448cec797f4063b936ab9b2a3031b4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:50.937781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb402d59-b865-4f8f-a5c5-03d566b42d4b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:50.965287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8639956-72be-4ed0-a459-af43d50f5813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c273e41881d4a7da8391a2e6cc7ba5a, user_id=2aeaa49cabb846a2b84639f38c07d5e1, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:50.972092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8639956-72be-4ed0-a459-af43d50f5813 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:50.996548 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 934/1856] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:50 2022] PUT /identity/v3/projects/2c273e41881d4a7da8391a2e6cc7ba5a/users/2aeaa49cabb846a2b84639f38c07d5e1/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:51.004360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eb6f4-d7c8-4a89-82f6-eaf140f2fdb3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:51.005414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eb6f4-d7c8-4a89-82f6-eaf140f2fdb3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:51.005735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eb6f4-d7c8-4a89-82f6-eaf140f2fdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:51.081363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cb402d59-b865-4f8f-a5c5-03d566b42d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d448cec797f4063b936ab9b2a3031b4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:51.083661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a41eb6f4-d7c8-4a89-82f6-eaf140f2fdb3 None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:51.085119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a41eb6f4-d7c8-4a89-82f6-eaf140f2fdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:51.101960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cb402d59-b865-4f8f-a5c5-03d566b42d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d448cec797f4063b936ab9b2a3031b4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:51.102690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cb402d59-b865-4f8f-a5c5-03d566b42d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d448cec797f4063b936ab9b2a3031b4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:51.108139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cb402d59-b865-4f8f-a5c5-03d566b42d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d448cec797f4063b936ab9b2a3031b4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:51.154160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cb402d59-b865-4f8f-a5c5-03d566b42d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d448cec797f4063b936ab9b2a3031b4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:51.178748 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 923/1857] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:50 2022] DELETE /identity/v3/users/8d448cec797f4063b936ab9b2a3031b4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:51.179892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f59a86-36ed-4982-84a0-6071bf932493 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:51.180179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f59a86-36ed-4982-84a0-6071bf932493 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:51.180449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f59a86-36ed-4982-84a0-6071bf932493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:51.219971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d0f59a86-36ed-4982-84a0-6071bf932493 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:51.221409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d0f59a86-36ed-4982-84a0-6071bf932493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:51.303272 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 935/1858] 10.222.0.45 () {58 vars in 1015 bytes} [Sat Oct 8 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:51.306269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eb6f4-d7c8-4a89-82f6-eaf140f2fdb3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:51.326483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a41eb6f4-d7c8-4a89-82f6-eaf140f2fdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:51.348462 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 924/1859] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:51.365579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f59a86-36ed-4982-84a0-6071bf932493 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:51.367309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d0f59a86-36ed-4982-84a0-6071bf932493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:51.394263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f59a86-36ed-4982-84a0-6071bf932493 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:51.404168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891b131-066a-486b-9ec7-db99bb643815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:51.404931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891b131-066a-486b-9ec7-db99bb643815 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:51.405944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891b131-066a-486b-9ec7-db99bb643815 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:51.407010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891b131-066a-486b-9ec7-db99bb643815 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:51.408249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891b131-066a-486b-9ec7-db99bb643815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:51.411274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891b131-066a-486b-9ec7-db99bb643815 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:51.430755 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 925/1860] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:51.432085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891b131-066a-486b-9ec7-db99bb643815 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:51.435301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e891b131-066a-486b-9ec7-db99bb643815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:51.445794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:51.580681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eb6f4-d7c8-4a89-82f6-eaf140f2fdb3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:51.608221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891b131-066a-486b-9ec7-db99bb643815 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:51.619022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a665184-14a5-4cce-9ead-20141957ee94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:51.621483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a665184-14a5-4cce-9ead-20141957ee94 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:51.621781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a665184-14a5-4cce-9ead-20141957ee94 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:51.622060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a665184-14a5-4cce-9ead-20141957ee94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:51.645835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a665184-14a5-4cce-9ead-20141957ee94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:51.649488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a665184-14a5-4cce-9ead-20141957ee94 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:51.687215 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 926/1861] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:51.694267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a665184-14a5-4cce-9ead-20141957ee94 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:51.718870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a665184-14a5-4cce-9ead-20141957ee94 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:51.731440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11f583-56e5-4a5f-acf7-2d1a5ed10ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:51.732547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11f583-56e5-4a5f-acf7-2d1a5ed10ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:51.733031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11f583-56e5-4a5f-acf7-2d1a5ed10ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:51.733456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11f583-56e5-4a5f-acf7-2d1a5ed10ceb admin admin] PATH_INFO: `/v3/projects/2c273e41881d4a7da8391a2e6cc7ba5a/users/2aeaa49cabb846a2b84639f38c07d5e1/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:51.736286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:51.741341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11f583-56e5-4a5f-acf7-2d1a5ed10ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c273e41881d4a7da8391a2e6cc7ba5a, user_id=2aeaa49cabb846a2b84639f38c07d5e1, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:51.753679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11f583-56e5-4a5f-acf7-2d1a5ed10ceb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:51.787369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c418-7dc9-4217-9dd8-d6a72e79e044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:51.788002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c418-7dc9-4217-9dd8-d6a72e79e044 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:51.788324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c418-7dc9-4217-9dd8-d6a72e79e044 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:51.788593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c418-7dc9-4217-9dd8-d6a72e79e044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:51.797684 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 927/1862] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:51 2022] PUT /identity/v3/projects/2c273e41881d4a7da8391a2e6cc7ba5a/users/2aeaa49cabb846a2b84639f38c07d5e1/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:51.800939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11f583-56e5-4a5f-acf7-2d1a5ed10ceb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:51.801275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0f35c418-7dc9-4217-9dd8-d6a72e79e044 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:51.804998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fb11f583-56e5-4a5f-acf7-2d1a5ed10ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:51.850877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35c418-7dc9-4217-9dd8-d6a72e79e044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:51.853334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35c418-7dc9-4217-9dd8-d6a72e79e044 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:51.883489 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 936/1863] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:51.888436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9642384-03a8-4557-9d66-41f4058b5ea6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:51.889560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9642384-03a8-4557-9d66-41f4058b5ea6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:51.891888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9642384-03a8-4557-9d66-41f4058b5ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:51.969552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e9642384-03a8-4557-9d66-41f4058b5ea6 None None] MFA Rules not processed for user `2aeaa49cabb846a2b84639f38c07d5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:51.970785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e9642384-03a8-4557-9d66-41f4058b5ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:52.127164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11f583-56e5-4a5f-acf7-2d1a5ed10ceb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:52.129933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e310fb-fd53-4045-8efa-941f194ab6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:52.130625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e310fb-fd53-4045-8efa-941f194ab6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:52.130915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e310fb-fd53-4045-8efa-941f194ab6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:52.131256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e310fb-fd53-4045-8efa-941f194ab6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:52.142773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e310fb-fd53-4045-8efa-941f194ab6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:52.145723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e310fb-fd53-4045-8efa-941f194ab6f4 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:52.151130 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 937/1864] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:51 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:52.152152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9642384-03a8-4557-9d66-41f4058b5ea6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:52.153365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e9642384-03a8-4557-9d66-41f4058b5ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:52.167216 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 928/1865] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:52.309686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9642384-03a8-4557-9d66-41f4058b5ea6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:52.324304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:52.325620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:52.326319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:52.326319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd admin admin] PATH_INFO: `/v3/projects/482fd4a7abb2475b90f6ce367fdf296d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:52.329151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=482fd4a7abb2475b90f6ce367fdf296d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:52.335373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:52.537057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482fd4a7abb2475b90f6ce367fdf296d', 'request_id': 'req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:52.560016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482fd4a7abb2475b90f6ce367fdf296d', 'request_id': 'req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:52.582123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482fd4a7abb2475b90f6ce367fdf296d', 'request_id': 'req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:52.602825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:52.615346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd admin admin] The token cache is being invalidate because project 482fd4a7abb2475b90f6ce367fdf296d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:52.615915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:52.617070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec439e2a-b9be-4a7d-b3e8-bacf7f864ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:52.624410 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 938/1866] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:52 2022] DELETE /identity/v3/projects/482fd4a7abb2475b90f6ce367fdf296d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:52.626774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc2689-fe4d-4f7d-87da-2bdd3219e173 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:52.627064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc2689-fe4d-4f7d-87da-2bdd3219e173 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:52.627354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc2689-fe4d-4f7d-87da-2bdd3219e173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:52.665756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ddbc2689-fe4d-4f7d-87da-2bdd3219e173 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:52.666963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ddbc2689-fe4d-4f7d-87da-2bdd3219e173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:52.837707 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 929/1867] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:52.840091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c492a6-7b44-44d0-90e4-60543ea30d39 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:52.840515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c492a6-7b44-44d0-90e4-60543ea30d39 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:52.841753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c492a6-7b44-44d0-90e4-60543ea30d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:52.960192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-36c492a6-7b44-44d0-90e4-60543ea30d39 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:52.961498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-36c492a6-7b44-44d0-90e4-60543ea30d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:52.987093 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 939/1868] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:52.991310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc2689-fe4d-4f7d-87da-2bdd3219e173 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:53.011948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc2689-fe4d-4f7d-87da-2bdd3219e173 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:53.017780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c201ba-63ba-47bc-b2f3-3be6664e7ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:53.018654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c201ba-63ba-47bc-b2f3-3be6664e7ddb admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:53.019156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c201ba-63ba-47bc-b2f3-3be6664e7ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:53.019603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c201ba-63ba-47bc-b2f3-3be6664e7ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:53.020285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c201ba-63ba-47bc-b2f3-3be6664e7ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:53.021411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c201ba-63ba-47bc-b2f3-3be6664e7ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:53.024926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c201ba-63ba-47bc-b2f3-3be6664e7ddb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:53.061719 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 930/1869] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:53.066616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c492a6-7b44-44d0-90e4-60543ea30d39 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:53.089626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c492a6-7b44-44d0-90e4-60543ea30d39 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:53.120989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a12b11-8742-485c-a9e6-e9c3a4a4dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:53.123249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a12b11-8742-485c-a9e6-e9c3a4a4dd25 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:53.124097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a12b11-8742-485c-a9e6-e9c3a4a4dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:53.124327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a12b11-8742-485c-a9e6-e9c3a4a4dd25 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:53.130163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c201ba-63ba-47bc-b2f3-3be6664e7ddb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:53.130493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a12b11-8742-485c-a9e6-e9c3a4a4dd25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:53.132526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a12b11-8742-485c-a9e6-e9c3a4a4dd25 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:53.134112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-36c201ba-63ba-47bc-b2f3-3be6664e7ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:53.252516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:53.278700 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 940/1870] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:53 2022] POST /identity/v3/projects => generated 401 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:53.283447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a12b11-8742-485c-a9e6-e9c3a4a4dd25 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:53.287234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-85a12b11-8742-485c-a9e6-e9c3a4a4dd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:53.367558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c201ba-63ba-47bc-b2f3-3be6664e7ddb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:53.442085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a12b11-8742-485c-a9e6-e9c3a4a4dd25 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:53.461608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:53.462327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:53.464064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:53.464448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] PATH_INFO: `/v3/projects/25e5719631704099bbe867f49e9cf46a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:53.467960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e5719631704099bbe867f49e9cf46a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:53.473278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:53.531219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5408704-fc5a-4df4-9767-0827e477a501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:53.533629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5408704-fc5a-4df4-9767-0827e477a501 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:53.533964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5408704-fc5a-4df4-9767-0827e477a501 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:53.534254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5408704-fc5a-4df4-9767-0827e477a501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:53.540210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b5408704-fc5a-4df4-9767-0827e477a501 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:53.593364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e5719631704099bbe867f49e9cf46a', 'request_id': 'req-de75396b-3c06-42a0-bee5-518ae84b4fc5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:53.611566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e5719631704099bbe867f49e9cf46a', 'request_id': 'req-de75396b-3c06-42a0-bee5-518ae84b4fc5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:53.633409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e5719631704099bbe867f49e9cf46a', 'request_id': 'req-de75396b-3c06-42a0-bee5-518ae84b4fc5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:53.670267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] The token cache is being invalidate because project 25e5719631704099bbe867f49e9cf46a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:53.671135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:53.673544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:53.683469 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 941/1871] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:53 2022] DELETE /identity/v3/projects/25e5719631704099bbe867f49e9cf46a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:53.686387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:53.690333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:53.707779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5408704-fc5a-4df4-9767-0827e477a501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:53.719061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5408704-fc5a-4df4-9767-0827e477a501 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:53.751640 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 931/1872] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:53 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:53.760014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5408704-fc5a-4df4-9767-0827e477a501 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:53.795234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5408704-fc5a-4df4-9767-0827e477a501 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:53.894377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75396b-3c06-42a0-bee5-518ae84b4fc5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:53.932440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae701854-fe90-4b73-aae4-482a49d9bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:53.933075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701854-fe90-4b73-aae4-482a49d9bea0 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:53.933378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701854-fe90-4b73-aae4-482a49d9bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:53.933647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701854-fe90-4b73-aae4-482a49d9bea0 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:53.934286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae701854-fe90-4b73-aae4-482a49d9bea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:53.934843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:53.936217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae701854-fe90-4b73-aae4-482a49d9bea0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:53.953614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bc454-172e-435a-b9dd-4c4a732cc234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:53.954489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bc454-172e-435a-b9dd-4c4a732cc234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:53.954799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bc454-172e-435a-b9dd-4c4a732cc234 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:53.955215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bc454-172e-435a-b9dd-4c4a732cc234 admin admin] PATH_INFO: `/v3/users/65fcc45a91984476a8164a59a1e2ddfa` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:53.957107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bc454-172e-435a-b9dd-4c4a732cc234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65fcc45a91984476a8164a59a1e2ddfa)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:53.959075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bc454-172e-435a-b9dd-4c4a732cc234 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:53.973599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:54.023167 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 942/1873] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:53 2022] POST /identity/v3/users => generated 301 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:54.028728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29ea99-a0b6-4e4f-9d32-d6171a052c77 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:54.029058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29ea99-a0b6-4e4f-9d32-d6171a052c77 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:54.029491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29ea99-a0b6-4e4f-9d32-d6171a052c77 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:54.054641 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 943/1874] 10.222.0.26 () {54 vars in 921 bytes} [Sat Oct 8 20:51:54 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:54.055657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29ea99-a0b6-4e4f-9d32-d6171a052c77 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:54.062496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f59bc454-172e-435a-b9dd-4c4a732cc234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65fcc45a91984476a8164a59a1e2ddfa'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:54.087776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f59bc454-172e-435a-b9dd-4c4a732cc234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65fcc45a91984476a8164a59a1e2ddfa'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:54.088723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f59bc454-172e-435a-b9dd-4c4a732cc234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65fcc45a91984476a8164a59a1e2ddfa'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:54.089483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f59bc454-172e-435a-b9dd-4c4a732cc234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65fcc45a91984476a8164a59a1e2ddfa'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:54.118287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f59bc454-172e-435a-b9dd-4c4a732cc234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65fcc45a91984476a8164a59a1e2ddfa'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:54.118503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29ea99-a0b6-4e4f-9d32-d6171a052c77 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:54.139873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c0c17-d8e7-4c8d-83e9-001583f5f1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:54.144128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c0c17-d8e7-4c8d-83e9-001583f5f1bc admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:54.144414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c0c17-d8e7-4c8d-83e9-001583f5f1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:54.145458 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 932/1875] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:53 2022] DELETE /identity/v3/users/65fcc45a91984476a8164a59a1e2ddfa => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:54.147128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdab8f-f16a-4008-88ee-954f6e3e1718 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:54.147555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdab8f-f16a-4008-88ee-954f6e3e1718 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:54.147935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdab8f-f16a-4008-88ee-954f6e3e1718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:54.158442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c0c17-d8e7-4c8d-83e9-001583f5f1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:54.160597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c0c17-d8e7-4c8d-83e9-001583f5f1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:54.170128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c0c17-d8e7-4c8d-83e9-001583f5f1bc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:54.190932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8ebdab8f-f16a-4008-88ee-954f6e3e1718 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:54.192424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8ebdab8f-f16a-4008-88ee-954f6e3e1718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:54.228041 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 944/1876] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:54.230943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c0c17-d8e7-4c8d-83e9-001583f5f1bc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:54.239558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9b7c0c17-d8e7-4c8d-83e9-001583f5f1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:54.297639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c0c17-d8e7-4c8d-83e9-001583f5f1bc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:54.338965 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 933/1877] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:54.439375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5bdf2-8369-49df-bda6-0fe86702ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:54.440155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5bdf2-8369-49df-bda6-0fe86702ba4a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:54.440436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5bdf2-8369-49df-bda6-0fe86702ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:54.440708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5bdf2-8369-49df-bda6-0fe86702ba4a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:54.441394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5bdf2-8369-49df-bda6-0fe86702ba4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:54.445331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5bdf2-8369-49df-bda6-0fe86702ba4a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:54.472244 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 945/1878] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:54.478661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdab8f-f16a-4008-88ee-954f6e3e1718 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:54.495679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdab8f-f16a-4008-88ee-954f6e3e1718 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:54.511548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b830b6-3b28-44d8-83ea-2d728d5dfff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:54.513758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b830b6-3b28-44d8-83ea-2d728d5dfff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:54.520752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b830b6-3b28-44d8-83ea-2d728d5dfff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:54.522677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b830b6-3b28-44d8-83ea-2d728d5dfff5 admin admin] PATH_INFO: `/v3/projects/5729227bda88440095bc3b342df17f68/users/803391b94e344fb8893f6b5c2b399d9d/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:54.599854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b830b6-3b28-44d8-83ea-2d728d5dfff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5729227bda88440095bc3b342df17f68, user_id=803391b94e344fb8893f6b5c2b399d9d, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:54.608235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b830b6-3b28-44d8-83ea-2d728d5dfff5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:54.634442 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 934/1879] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:54 2022] PUT /identity/v3/projects/5729227bda88440095bc3b342df17f68/users/803391b94e344fb8893f6b5c2b399d9d/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:54.647111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed30c2-43e3-4da1-834e-65d1ced57bf0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:54.647634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed30c2-43e3-4da1-834e-65d1ced57bf0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:54.647816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed30c2-43e3-4da1-834e-65d1ced57bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:54.716665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-84ed30c2-43e3-4da1-834e-65d1ced57bf0 None None] MFA Rules not processed for user `803391b94e344fb8893f6b5c2b399d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:54.718098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-84ed30c2-43e3-4da1-834e-65d1ced57bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:54.954881 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 946/1880] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:54.957409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b830b6-3b28-44d8-83ea-2d728d5dfff5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:55.098279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed30c2-43e3-4da1-834e-65d1ced57bf0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:55.105206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-84ed30c2-43e3-4da1-834e-65d1ced57bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:55.115229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:55.162478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b830b6-3b28-44d8-83ea-2d728d5dfff5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:55.168509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8991d7-7fd6-4a0e-8d8e-87c7b5eb4a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:55.170223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8991d7-7fd6-4a0e-8d8e-87c7b5eb4a41 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:55.170697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8991d7-7fd6-4a0e-8d8e-87c7b5eb4a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:55.179955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8991d7-7fd6-4a0e-8d8e-87c7b5eb4a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:55.180810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8991d7-7fd6-4a0e-8d8e-87c7b5eb4a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:55.186975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8991d7-7fd6-4a0e-8d8e-87c7b5eb4a41 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:55.243462 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 935/1881] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:54 2022] POST /identity/v3/projects => generated 401 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:55.244381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8991d7-7fd6-4a0e-8d8e-87c7b5eb4a41 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:55.247015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fd8991d7-7fd6-4a0e-8d8e-87c7b5eb4a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:55.271050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed30c2-43e3-4da1-834e-65d1ced57bf0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:55.300073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:55.420384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8991d7-7fd6-4a0e-8d8e-87c7b5eb4a41 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:55.436922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2c1c7-810e-4e73-98b3-33a38f6437cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:55.439030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2c1c7-810e-4e73-98b3-33a38f6437cb service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:55.439740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2c1c7-810e-4e73-98b3-33a38f6437cb service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:55.440467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2c1c7-810e-4e73-98b3-33a38f6437cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:55.444000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:55.446159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:55.447241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:55.448262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] PATH_INFO: `/v3/projects/dce8bee46a4746e7a9e9eea8ee41f96f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:55.450866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce8bee46a4746e7a9e9eea8ee41f96f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:55.457235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:55.468889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2c1c7-810e-4e73-98b3-33a38f6437cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:55.474654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2c1c7-810e-4e73-98b3-33a38f6437cb service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:55.503144 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 936/1882] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:55.519370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2c1c7-810e-4e73-98b3-33a38f6437cb service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:55.546745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2c1c7-810e-4e73-98b3-33a38f6437cb service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:55.559000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ce386-0474-47e8-a49f-81c5ba2762a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:55.560043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ce386-0474-47e8-a49f-81c5ba2762a6 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:55.560490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ce386-0474-47e8-a49f-81c5ba2762a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:55.560896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ce386-0474-47e8-a49f-81c5ba2762a6 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:55.561786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ce386-0474-47e8-a49f-81c5ba2762a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:55.565359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ce386-0474-47e8-a49f-81c5ba2762a6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:55.609096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce8bee46a4746e7a9e9eea8ee41f96f', 'request_id': 'req-ac5def77-4670-4be3-b9ab-252db6919302'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:55.620371 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 937/1883] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:55 2022] POST /identity/v3/users => generated 307 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:55.626250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ce386-0474-47e8-a49f-81c5ba2762a6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:55.636722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce8bee46a4746e7a9e9eea8ee41f96f', 'request_id': 'req-ac5def77-4670-4be3-b9ab-252db6919302'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:55.651164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ce386-0474-47e8-a49f-81c5ba2762a6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:55.673332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce8bee46a4746e7a9e9eea8ee41f96f', 'request_id': 'req-ac5def77-4670-4be3-b9ab-252db6919302'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:55.705500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] The token cache is being invalidate because project dce8bee46a4746e7a9e9eea8ee41f96f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:55.706064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:55.707109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:55.733178 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 947/1884] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:55 2022] DELETE /identity/v3/projects/dce8bee46a4746e7a9e9eea8ee41f96f => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:51:55.734725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:55.769144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:55.825481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258853a0-c015-4ac3-b626-6da0b2343ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:55.826111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258853a0-c015-4ac3-b626-6da0b2343ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:55.826395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258853a0-c015-4ac3-b626-6da0b2343ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:55.826770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258853a0-c015-4ac3-b626-6da0b2343ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:55.828085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258853a0-c015-4ac3-b626-6da0b2343ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:55.829794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258853a0-c015-4ac3-b626-6da0b2343ed0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:55.865096 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 938/1885] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:55.865790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649d1d7-d82f-43ec-b885-1263773571a0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:55.866074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649d1d7-d82f-43ec-b885-1263773571a0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:55.866710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649d1d7-d82f-43ec-b885-1263773571a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:55.922923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5649d1d7-d82f-43ec-b885-1263773571a0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:55.924244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5649d1d7-d82f-43ec-b885-1263773571a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:55.932780 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 939/1886] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:55.933713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649d1d7-d82f-43ec-b885-1263773571a0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:55.935078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5649d1d7-d82f-43ec-b885-1263773571a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:55.945378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5def77-4670-4be3-b9ab-252db6919302 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:55.960473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:55.962022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:55.962654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:55.963146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] PATH_INFO: `/v3/users/9a8f1a93eeb149ecafc725099b645705` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:55.964366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8f1a93eeb149ecafc725099b645705)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:55.967524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:55.967764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649d1d7-d82f-43ec-b885-1263773571a0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:55.976221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982983f-f562-46c3-8f52-02d262c0ed2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:55.976901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982983f-f562-46c3-8f52-02d262c0ed2a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:55.977202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982983f-f562-46c3-8f52-02d262c0ed2a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:55.977490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982983f-f562-46c3-8f52-02d262c0ed2a admin admin] PATH_INFO: `/v3/projects/87abe2b078e54502bd626fa172df49d1/users/6bf7e17231934826bdcd3a35e551b416/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:55.997445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982983f-f562-46c3-8f52-02d262c0ed2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87abe2b078e54502bd626fa172df49d1, user_id=6bf7e17231934826bdcd3a35e551b416, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:56.000853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982983f-f562-46c3-8f52-02d262c0ed2a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:56.026566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:56.049695 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 940/1887] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:55 2022] PUT /identity/v3/projects/87abe2b078e54502bd626fa172df49d1/users/6bf7e17231934826bdcd3a35e551b416/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:56.052586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b09981-3ab4-47ef-bdf0-7ed7c5e7d6e1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:56.052874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b09981-3ab4-47ef-bdf0-7ed7c5e7d6e1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:56.054423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b09981-3ab4-47ef-bdf0-7ed7c5e7d6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:56.064231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:56.068563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8f1a93eeb149ecafc725099b645705'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:56.088723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-84b09981-3ab4-47ef-bdf0-7ed7c5e7d6e1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:56.090931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-84b09981-3ab4-47ef-bdf0-7ed7c5e7d6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:56.104913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8f1a93eeb149ecafc725099b645705'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:56.107197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8f1a93eeb149ecafc725099b645705'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:56.107558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8f1a93eeb149ecafc725099b645705'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:56.139569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8f1a93eeb149ecafc725099b645705'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:56.174792 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 948/1888] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:55 2022] DELETE /identity/v3/users/9a8f1a93eeb149ecafc725099b645705 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:56.180170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:56.188147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:56.229337 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 941/1889] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:56.230813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b417a5c-0528-4001-9679-f2ed47e02aa0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:56.231121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b417a5c-0528-4001-9679-f2ed47e02aa0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:56.231400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b417a5c-0528-4001-9679-f2ed47e02aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:56.264239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2b417a5c-0528-4001-9679-f2ed47e02aa0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:56.266275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2b417a5c-0528-4001-9679-f2ed47e02aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:56.300803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16483e89-52c4-4c6a-8efc-a4200de6e077 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:56.307841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeed29e-012b-4618-9149-9db3ea77a367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:56.309399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeed29e-012b-4618-9149-9db3ea77a367 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:56.310169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeed29e-012b-4618-9149-9db3ea77a367 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:56.310523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeed29e-012b-4618-9149-9db3ea77a367 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:56.311872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeed29e-012b-4618-9149-9db3ea77a367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:56.315906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeed29e-012b-4618-9149-9db3ea77a367 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:56.334307 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 949/1890] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:56.335520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeed29e-012b-4618-9149-9db3ea77a367 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:56.347953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeed29e-012b-4618-9149-9db3ea77a367 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:56.352965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d58ec-9826-4dbd-87b8-8a9bc724685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:56.353690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d58ec-9826-4dbd-87b8-8a9bc724685e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:56.353951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d58ec-9826-4dbd-87b8-8a9bc724685e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:56.354239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d58ec-9826-4dbd-87b8-8a9bc724685e admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:56.354917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d58ec-9826-4dbd-87b8-8a9bc724685e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:51:56.355224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d58ec-9826-4dbd-87b8-8a9bc724685e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:56.357701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d58ec-9826-4dbd-87b8-8a9bc724685e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:56.376494 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 950/1891] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:51:56.377588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d58ec-9826-4dbd-87b8-8a9bc724685e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:56.389529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d58ec-9826-4dbd-87b8-8a9bc724685e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:56.397046 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 942/1892] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:56.398372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b417a5c-0528-4001-9679-f2ed47e02aa0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:56.403673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea88de1-5ac1-4c22-976b-dee3c81a56e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:56.404360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88de1-5ac1-4c22-976b-dee3c81a56e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:56.404641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88de1-5ac1-4c22-976b-dee3c81a56e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:56.404941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88de1-5ac1-4c22-976b-dee3c81a56e8 admin admin] PATH_INFO: `/v3/projects/87abe2b078e54502bd626fa172df49d1/users/6bf7e17231934826bdcd3a35e551b416/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:56.408975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea88de1-5ac1-4c22-976b-dee3c81a56e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87abe2b078e54502bd626fa172df49d1, user_id=6bf7e17231934826bdcd3a35e551b416, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:56.412802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b417a5c-0528-4001-9679-f2ed47e02aa0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:56.417119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea88de1-5ac1-4c22-976b-dee3c81a56e8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:56.420444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeba3b2-169b-40fb-b8ad-8872c50061f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:56.421975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeba3b2-169b-40fb-b8ad-8872c50061f3 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:56.422501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeba3b2-169b-40fb-b8ad-8872c50061f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:56.423174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeba3b2-169b-40fb-b8ad-8872c50061f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:56.424072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeba3b2-169b-40fb-b8ad-8872c50061f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:56.434932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeba3b2-169b-40fb-b8ad-8872c50061f3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:56.462424 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 951/1893] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:56 2022] PUT /identity/v3/projects/87abe2b078e54502bd626fa172df49d1/users/6bf7e17231934826bdcd3a35e551b416/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:56.464620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea88de1-5ac1-4c22-976b-dee3c81a56e8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:56.478758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8ea88de1-5ac1-4c22-976b-dee3c81a56e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:56.494188 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 943/1894] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:56 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:56.497515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfffb9-ffe9-4a41-af6b-327a957e8449 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:56.499486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfffb9-ffe9-4a41-af6b-327a957e8449 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:56.500053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfffb9-ffe9-4a41-af6b-327a957e8449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:56.571325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5bbfffb9-ffe9-4a41-af6b-327a957e8449 None None] MFA Rules not processed for user `6bf7e17231934826bdcd3a35e551b416`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:56.585978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5bbfffb9-ffe9-4a41-af6b-327a957e8449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:56.588005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea88de1-5ac1-4c22-976b-dee3c81a56e8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:56.676914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:56.691224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40cc40-4fe2-400d-ba5b-2c2a84c9864a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:56.694133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40cc40-4fe2-400d-ba5b-2c2a84c9864a service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:56.694415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40cc40-4fe2-400d-ba5b-2c2a84c9864a service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:56.694692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40cc40-4fe2-400d-ba5b-2c2a84c9864a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:56.696331 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 944/1895] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:56.697686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfffb9-ffe9-4a41-af6b-327a957e8449 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:56.714428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:56.832675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfffb9-ffe9-4a41-af6b-327a957e8449 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:56.838152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de79f78-3cf2-4227-98fa-d307268fe103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:56.839593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de79f78-3cf2-4227-98fa-d307268fe103 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:56.839934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de79f78-3cf2-4227-98fa-d307268fe103 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:56.840214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de79f78-3cf2-4227-98fa-d307268fe103 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:56.841161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de79f78-3cf2-4227-98fa-d307268fe103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:56.842204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40cc40-4fe2-400d-ba5b-2c2a84c9864a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:56.843176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de79f78-3cf2-4227-98fa-d307268fe103 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:56.844275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40cc40-4fe2-400d-ba5b-2c2a84c9864a service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:56.879506 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 945/1896] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:56 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:56.880431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de79f78-3cf2-4227-98fa-d307268fe103 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:56.882602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4de79f78-3cf2-4227-98fa-d307268fe103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:56.888103 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 952/1897] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:56.890773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40cc40-4fe2-400d-ba5b-2c2a84c9864a service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:56.921138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40cc40-4fe2-400d-ba5b-2c2a84c9864a service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:56.928676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34a282-0954-4fa3-ac54-9ab8fa1e099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:56.929294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34a282-0954-4fa3-ac54-9ab8fa1e099f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:56.929905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34a282-0954-4fa3-ac54-9ab8fa1e099f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:56.929905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34a282-0954-4fa3-ac54-9ab8fa1e099f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:56.930638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34a282-0954-4fa3-ac54-9ab8fa1e099f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:56.933149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34a282-0954-4fa3-ac54-9ab8fa1e099f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:56.950951 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 953/1898] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:56.954870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34a282-0954-4fa3-ac54-9ab8fa1e099f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:56.982593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34a282-0954-4fa3-ac54-9ab8fa1e099f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:57.005051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6e305-284f-4123-a02e-bc019023f21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:57.005890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6e305-284f-4123-a02e-bc019023f21a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:57.006267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6e305-284f-4123-a02e-bc019023f21a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:57.006640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6e305-284f-4123-a02e-bc019023f21a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:57.007414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6e305-284f-4123-a02e-bc019023f21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:57.009151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6e305-284f-4123-a02e-bc019023f21a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:57.021541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de79f78-3cf2-4227-98fa-d307268fe103 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:57.032140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f138a79-f76c-4947-b318-7f54d2d7472c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:57.032956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f138a79-f76c-4947-b318-7f54d2d7472c service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:57.033294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f138a79-f76c-4947-b318-7f54d2d7472c service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:57.033549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f138a79-f76c-4947-b318-7f54d2d7472c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:57.048056 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 954/1899] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:57.052597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6e305-284f-4123-a02e-bc019023f21a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:57.053512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f138a79-f76c-4947-b318-7f54d2d7472c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:57.055710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f138a79-f76c-4947-b318-7f54d2d7472c service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:57.072322 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 946/1900] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:56 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:57.092822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6e305-284f-4123-a02e-bc019023f21a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:57.111020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420567b-2e6a-4d77-b024-9ca57db7b73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:57.114087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420567b-2e6a-4d77-b024-9ca57db7b73f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:57.116013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420567b-2e6a-4d77-b024-9ca57db7b73f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:57.116013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420567b-2e6a-4d77-b024-9ca57db7b73f admin admin] PATH_INFO: `/v3/projects/92f0b7bc9a244bcba53e79c755511de2/users/c19e0020e3a24bccb3af89da6f784e81/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:57.177831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420567b-2e6a-4d77-b024-9ca57db7b73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f0b7bc9a244bcba53e79c755511de2, user_id=c19e0020e3a24bccb3af89da6f784e81, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:57.182472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420567b-2e6a-4d77-b024-9ca57db7b73f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:57.244404 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 955/1901] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:57 2022] PUT /identity/v3/projects/92f0b7bc9a244bcba53e79c755511de2/users/c19e0020e3a24bccb3af89da6f784e81/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:57.246864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231bbb8-5c75-455f-9c87-b90f9991a3da None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:57.247151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231bbb8-5c75-455f-9c87-b90f9991a3da None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:57.247432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231bbb8-5c75-455f-9c87-b90f9991a3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:57.352542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7231bbb8-5c75-455f-9c87-b90f9991a3da None None] MFA Rules not processed for user `c19e0020e3a24bccb3af89da6f784e81`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:57.358005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7231bbb8-5c75-455f-9c87-b90f9991a3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:57.594539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420567b-2e6a-4d77-b024-9ca57db7b73f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:57.609788 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 947/1902] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:51:57.616384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231bbb8-5c75-455f-9c87-b90f9991a3da None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:57.642497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:57.761508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420567b-2e6a-4d77-b024-9ca57db7b73f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:57.770387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231bbb8-5c75-455f-9c87-b90f9991a3da None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:57.777388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8f92e-20fc-4af3-abab-d0320b71ee91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:57.778021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8f92e-20fc-4af3-abab-d0320b71ee91 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:57.778362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8f92e-20fc-4af3-abab-d0320b71ee91 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:57.778664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8f92e-20fc-4af3-abab-d0320b71ee91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:57.783339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f6a8f92e-20fc-4af3-abab-d0320b71ee91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:57.784209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005f6c5-1626-4975-afa4-5c2825da405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:57.785172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005f6c5-1626-4975-afa4-5c2825da405f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:57.786444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005f6c5-1626-4975-afa4-5c2825da405f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:57.787021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005f6c5-1626-4975-afa4-5c2825da405f admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:57.787878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005f6c5-1626-4975-afa4-5c2825da405f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:57.790343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005f6c5-1626-4975-afa4-5c2825da405f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:57.880153 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 948/1903] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:51:57 2022] POST /identity/v3/projects => generated 383 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:57.881504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005f6c5-1626-4975-afa4-5c2825da405f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:57.894230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3005f6c5-1626-4975-afa4-5c2825da405f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:57.911243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:57.935651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8f92e-20fc-4af3-abab-d0320b71ee91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:57.956957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8f92e-20fc-4af3-abab-d0320b71ee91 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:57.996293 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 956/1904] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:57 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:57.997152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8f92e-20fc-4af3-abab-d0320b71ee91 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:58.016238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8f92e-20fc-4af3-abab-d0320b71ee91 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:58.074906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005f6c5-1626-4975-afa4-5c2825da405f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:58.085408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:58.086333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:58.086651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:58.086932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] PATH_INFO: `/v3/projects/3ed33c5c5583407ba2abc7d01a848c80` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:58.092634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed33c5c5583407ba2abc7d01a848c80)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:58.097309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:58.171248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5cdea-734b-4856-bcca-e744cd16e95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:58.186554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5cdea-734b-4856-bcca-e744cd16e95a admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:58.188040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5cdea-734b-4856-bcca-e744cd16e95a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:58.189090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5cdea-734b-4856-bcca-e744cd16e95a admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:58.192240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5cdea-734b-4856-bcca-e744cd16e95a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:58.199376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5cdea-734b-4856-bcca-e744cd16e95a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:58.237165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed33c5c5583407ba2abc7d01a848c80', 'request_id': 'req-bd1b40d7-e04e-4b55-8706-e5c1885d3113'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:58.252755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed33c5c5583407ba2abc7d01a848c80', 'request_id': 'req-bd1b40d7-e04e-4b55-8706-e5c1885d3113'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:58.255916 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 957/1905] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:51:57 2022] POST /identity/v3/users => generated 298 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:51:58.260309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5cdea-734b-4856-bcca-e744cd16e95a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:58.272575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed33c5c5583407ba2abc7d01a848c80', 'request_id': 'req-bd1b40d7-e04e-4b55-8706-e5c1885d3113'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:58.282303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5cdea-734b-4856-bcca-e744cd16e95a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:58.298975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] The token cache is being invalidate because project 3ed33c5c5583407ba2abc7d01a848c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:58.299277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:58.303416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:58.308015 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 949/1906] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:57 2022] DELETE /identity/v3/projects/3ed33c5c5583407ba2abc7d01a848c80 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:58.312927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:58.318812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:58.431615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:58.507671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713796f-0ac2-4126-b27f-8941fb5faece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:58.511597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713796f-0ac2-4126-b27f-8941fb5faece admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:58.512096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713796f-0ac2-4126-b27f-8941fb5faece admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:58.513541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713796f-0ac2-4126-b27f-8941fb5faece admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:58.515498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713796f-0ac2-4126-b27f-8941fb5faece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:58.521017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713796f-0ac2-4126-b27f-8941fb5faece admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:58.574268 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 958/1907] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:58.578328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713796f-0ac2-4126-b27f-8941fb5faece admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:58.580840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c713796f-0ac2-4126-b27f-8941fb5faece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:58.585987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b40d7-e04e-4b55-8706-e5c1885d3113 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:58.611528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713796f-0ac2-4126-b27f-8941fb5faece admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:58.613253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:58.614857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:58.615363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:58.616042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] PATH_INFO: `/v3/users/2aeaa49cabb846a2b84639f38c07d5e1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:58.623290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aeaa49cabb846a2b84639f38c07d5e1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:58.624625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec821a-0b0f-4172-9f78-599153247dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:58.625921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:58.626855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec821a-0b0f-4172-9f78-599153247dba admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:58.629232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec821a-0b0f-4172-9f78-599153247dba admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:58.629603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec821a-0b0f-4172-9f78-599153247dba admin admin] PATH_INFO: `/v3/projects/469c1c4ea6394cfab3c6651944254af8/users/fab1cc79a1864b86af7ba71f1be38534/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:58.661837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec821a-0b0f-4172-9f78-599153247dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=469c1c4ea6394cfab3c6651944254af8, user_id=fab1cc79a1864b86af7ba71f1be38534, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:58.664793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec821a-0b0f-4172-9f78-599153247dba admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:58.689597 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 959/1908] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:58 2022] PUT /identity/v3/projects/469c1c4ea6394cfab3c6651944254af8/users/fab1cc79a1864b86af7ba71f1be38534/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:58.694716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec821a-0b0f-4172-9f78-599153247dba admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:58.728405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aeaa49cabb846a2b84639f38c07d5e1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:58.748289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aeaa49cabb846a2b84639f38c07d5e1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:58.748289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aeaa49cabb846a2b84639f38c07d5e1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:58.748872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aeaa49cabb846a2b84639f38c07d5e1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:58.780222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aeaa49cabb846a2b84639f38c07d5e1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:58.802999 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 950/1909] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:58 2022] DELETE /identity/v3/users/2aeaa49cabb846a2b84639f38c07d5e1 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:58.805874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:58.850351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec821a-0b0f-4172-9f78-599153247dba admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:59.065434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b690310-7f19-49fd-b026-f465c9cd454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:59.066134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b690310-7f19-49fd-b026-f465c9cd454e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:59.066347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b690310-7f19-49fd-b026-f465c9cd454e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:59.066640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b690310-7f19-49fd-b026-f465c9cd454e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:59.067275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b690310-7f19-49fd-b026-f465c9cd454e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:59.071943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b690310-7f19-49fd-b026-f465c9cd454e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:59.084824 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 960/1910] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:51:59.094610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:59.098379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:59.128964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587aafd-7eb5-48ba-97e3-4bcb543053a8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:59.148079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880ffd4-60a6-4de8-acbc-c7d1a4a719f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:59.149246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ffd4-60a6-4de8-acbc-c7d1a4a719f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:59.149900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ffd4-60a6-4de8-acbc-c7d1a4a719f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:59.150869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ffd4-60a6-4de8-acbc-c7d1a4a719f8 admin admin] PATH_INFO: `/v3/projects/469c1c4ea6394cfab3c6651944254af8/users/fab1cc79a1864b86af7ba71f1be38534/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:59.155836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880ffd4-60a6-4de8-acbc-c7d1a4a719f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469c1c4ea6394cfab3c6651944254af8, user_id=fab1cc79a1864b86af7ba71f1be38534, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:59.159315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880ffd4-60a6-4de8-acbc-c7d1a4a719f8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:59.206528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d643c-58ce-4a00-9c17-8a9c1048123e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:59.209452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d643c-58ce-4a00-9c17-8a9c1048123e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:59.209452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d643c-58ce-4a00-9c17-8a9c1048123e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:59.210498 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 951/1911] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:51:59 2022] PUT /identity/v3/projects/469c1c4ea6394cfab3c6651944254af8/users/fab1cc79a1864b86af7ba71f1be38534/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:59.274937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880ffd4-60a6-4de8-acbc-c7d1a4a719f8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:59.276717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f880ffd4-60a6-4de8-acbc-c7d1a4a719f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:59.278229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-946d643c-58ce-4a00-9c17-8a9c1048123e None None] MFA Rules not processed for user `fab1cc79a1864b86af7ba71f1be38534`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:59.279916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-946d643c-58ce-4a00-9c17-8a9c1048123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:59.378601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880ffd4-60a6-4de8-acbc-c7d1a4a719f8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:59.383592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7f4a9-8a09-4734-8ddb-0c57775503b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:59.384359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7f4a9-8a09-4734-8ddb-0c57775503b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:59.384681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7f4a9-8a09-4734-8ddb-0c57775503b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:59.385077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7f4a9-8a09-4734-8ddb-0c57775503b5 admin admin] PATH_INFO: `/v3/users/803391b94e344fb8893f6b5c2b399d9d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:59.386364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7f4a9-8a09-4734-8ddb-0c57775503b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=803391b94e344fb8893f6b5c2b399d9d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:59.388999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7f4a9-8a09-4734-8ddb-0c57775503b5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:59.441462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:59.451902 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 961/1912] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:59.468962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70f7f4a9-8a09-4734-8ddb-0c57775503b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803391b94e344fb8893f6b5c2b399d9d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:59.495562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70f7f4a9-8a09-4734-8ddb-0c57775503b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803391b94e344fb8893f6b5c2b399d9d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:59.498941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70f7f4a9-8a09-4734-8ddb-0c57775503b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803391b94e344fb8893f6b5c2b399d9d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:59.500748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70f7f4a9-8a09-4734-8ddb-0c57775503b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803391b94e344fb8893f6b5c2b399d9d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:59.528873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70f7f4a9-8a09-4734-8ddb-0c57775503b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803391b94e344fb8893f6b5c2b399d9d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:59.550841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d643c-58ce-4a00-9c17-8a9c1048123e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:59.552015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-946d643c-58ce-4a00-9c17-8a9c1048123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:59.564263 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 952/1913] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:59 2022] DELETE /identity/v3/users/803391b94e344fb8893f6b5c2b399d9d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:51:59.568924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b95d6-40e6-44b2-9339-4e4f79e4ae0a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:59.569303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b95d6-40e6-44b2-9339-4e4f79e4ae0a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:59.569639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b95d6-40e6-44b2-9339-4e4f79e4ae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:59.575674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d643c-58ce-4a00-9c17-8a9c1048123e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:59.620128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bd3b95d6-40e6-44b2-9339-4e4f79e4ae0a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:59.621402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bd3b95d6-40e6-44b2-9339-4e4f79e4ae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:59.677210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f35233-bda7-4429-a564-dc7c1ce0d961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:59.677210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35233-bda7-4429-a564-dc7c1ce0d961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:59.677210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35233-bda7-4429-a564-dc7c1ce0d961 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:59.677210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35233-bda7-4429-a564-dc7c1ce0d961 admin admin] PATH_INFO: `/v3/projects/2c273e41881d4a7da8391a2e6cc7ba5a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:59.677696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f35233-bda7-4429-a564-dc7c1ce0d961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c273e41881d4a7da8391a2e6cc7ba5a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:59.677696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f35233-bda7-4429-a564-dc7c1ce0d961 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:59.695414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:59.702683 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 953/1914] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:59.703797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b95d6-40e6-44b2-9339-4e4f79e4ae0a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:59.705079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bd3b95d6-40e6-44b2-9339-4e4f79e4ae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:59.727054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-17f35233-bda7-4429-a564-dc7c1ce0d961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c273e41881d4a7da8391a2e6cc7ba5a', 'request_id': 'req-17f35233-bda7-4429-a564-dc7c1ce0d961'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:59.735438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-17f35233-bda7-4429-a564-dc7c1ce0d961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c273e41881d4a7da8391a2e6cc7ba5a', 'request_id': 'req-17f35233-bda7-4429-a564-dc7c1ce0d961'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:59.740949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-17f35233-bda7-4429-a564-dc7c1ce0d961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c273e41881d4a7da8391a2e6cc7ba5a', 'request_id': 'req-17f35233-bda7-4429-a564-dc7c1ce0d961'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:59.753766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-17f35233-bda7-4429-a564-dc7c1ce0d961 admin admin] The token cache is being invalidate because project 2c273e41881d4a7da8391a2e6cc7ba5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:51:59.754421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-17f35233-bda7-4429-a564-dc7c1ce0d961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:59.755392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-17f35233-bda7-4429-a564-dc7c1ce0d961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:51:59.757024 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 962/1915] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:51:59 2022] DELETE /identity/v3/projects/2c273e41881d4a7da8391a2e6cc7ba5a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:51:59.758469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524270f-0472-47bd-810e-387eaf1510cb None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:59.758753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524270f-0472-47bd-810e-387eaf1510cb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:59.759028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524270f-0472-47bd-810e-387eaf1510cb None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:59.760519 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 963/1916] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:51:59.761253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524270f-0472-47bd-810e-387eaf1510cb None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:59.762820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c524270f-0472-47bd-810e-387eaf1510cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:59.784539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b95d6-40e6-44b2-9339-4e4f79e4ae0a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:59.822221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524270f-0472-47bd-810e-387eaf1510cb None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:59.825877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b485ec2-de10-4b95-a7d8-c606e6e48f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:59.826483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b485ec2-de10-4b95-a7d8-c606e6e48f71 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:59.826764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b485ec2-de10-4b95-a7d8-c606e6e48f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:59.827036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b485ec2-de10-4b95-a7d8-c606e6e48f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:59.828921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:59.829048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0b485ec2-de10-4b95-a7d8-c606e6e48f71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:59.849957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae471b-cddb-4598-a7c8-2c70d1b7e0d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:59.850594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae471b-cddb-4598-a7c8-2c70d1b7e0d3 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:59.850873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae471b-cddb-4598-a7c8-2c70d1b7e0d3 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:59.851155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae471b-cddb-4598-a7c8-2c70d1b7e0d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:59.852874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-56ae471b-cddb-4598-a7c8-2c70d1b7e0d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:59.892220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b485ec2-de10-4b95-a7d8-c606e6e48f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:59.893603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b485ec2-de10-4b95-a7d8-c606e6e48f71 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:59.903173 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 964/1917] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:59.904382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee5627-abe1-47ad-b636-d5e0b39ae7df None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:59.904673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee5627-abe1-47ad-b636-d5e0b39ae7df None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:59.904999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee5627-abe1-47ad-b636-d5e0b39ae7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:59.917041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae471b-cddb-4598-a7c8-2c70d1b7e0d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:59.919148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae471b-cddb-4598-a7c8-2c70d1b7e0d3 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:59.925954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-51ee5627-abe1-47ad-b636-d5e0b39ae7df None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:59.927170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-51ee5627-abe1-47ad-b636-d5e0b39ae7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:59.930650 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 954/1918] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:59.931683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae471b-cddb-4598-a7c8-2c70d1b7e0d3 service nova] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:51:59.933319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-56ae471b-cddb-4598-a7c8-2c70d1b7e0d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:59.936010 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 965/1919] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:59.943097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee3cf-0759-48f6-bbe4-29a17002d398 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:59.943383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee3cf-0759-48f6-bbe4-29a17002d398 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:59.944330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee3cf-0759-48f6-bbe4-29a17002d398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:59.963879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae471b-cddb-4598-a7c8-2c70d1b7e0d3 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:59.966837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-56ae471b-cddb-4598-a7c8-2c70d1b7e0d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:59.970705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8f2ee3cf-0759-48f6-bbe4-29a17002d398 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:51:59.972059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f2ee3cf-0759-48f6-bbe4-29a17002d398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:51:59.985408 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 966/1920] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:51:59.990687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ee3cf-0759-48f6-bbe4-29a17002d398 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:00.004198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ee3cf-0759-48f6-bbe4-29a17002d398 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:00.010374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da28c92-77d6-46d8-8799-53d53bdbb830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:00.011403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da28c92-77d6-46d8-8799-53d53bdbb830 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.011880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da28c92-77d6-46d8-8799-53d53bdbb830 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.012326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da28c92-77d6-46d8-8799-53d53bdbb830 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.013806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da28c92-77d6-46d8-8799-53d53bdbb830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:00.014306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da28c92-77d6-46d8-8799-53d53bdbb830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:00.017261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da28c92-77d6-46d8-8799-53d53bdbb830 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:00.033238 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 967/1921] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:00.035496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da28c92-77d6-46d8-8799-53d53bdbb830 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:00.047532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da28c92-77d6-46d8-8799-53d53bdbb830 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:00.052172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cc0d4-33d0-4fe1-90bd-479c1111068b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:00.052780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cc0d4-33d0-4fe1-90bd-479c1111068b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.053059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cc0d4-33d0-4fe1-90bd-479c1111068b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.053474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cc0d4-33d0-4fe1-90bd-479c1111068b admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.054122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cc0d4-33d0-4fe1-90bd-479c1111068b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:00.056021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cc0d4-33d0-4fe1-90bd-479c1111068b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:00.069274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae471b-cddb-4598-a7c8-2c70d1b7e0d3 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:00.075538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0975c9-c0db-4194-a864-6793b0a7f3ab tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d95868598ec40d38931c8bf1c7223b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db33d17d8b364b30986fc9b10f145d0d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:00.076393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0975c9-c0db-4194-a864-6793b0a7f3ab tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.076677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0975c9-c0db-4194-a864-6793b0a7f3ab tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.077032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0975c9-c0db-4194-a864-6793b0a7f3ab tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] PATH_INFO: `/v3/projects/00d9071ba2e34475baf046a4c42f9889` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.078659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0975c9-c0db-4194-a864-6793b0a7f3ab tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorizing `identity:get_project(project_id=00d9071ba2e34475baf046a4c42f9889)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:00.080720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0975c9-c0db-4194-a864-6793b0a7f3ab tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:00.082954 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 955/1922] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:51:59 2022] GET /identity/v3/projects/00d9071ba2e34475baf046a4c42f9889 => generated 377 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:00.091409 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 968/1923] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:00 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:52:00.094003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0975c9-c0db-4194-a864-6793b0a7f3ab tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:00.108690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0975c9-c0db-4194-a864-6793b0a7f3ab tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:00.221407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8f3ca-ea4e-41ab-9a71-9dd1d7d76754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:00.222147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f3ca-ea4e-41ab-9a71-9dd1d7d76754 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.222530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f3ca-ea4e-41ab-9a71-9dd1d7d76754 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.223304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f3ca-ea4e-41ab-9a71-9dd1d7d76754 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.223908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8f3ca-ea4e-41ab-9a71-9dd1d7d76754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:00.227669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8f3ca-ea4e-41ab-9a71-9dd1d7d76754 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:00.269686 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 956/1924] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:00 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:00.271869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cc0d4-33d0-4fe1-90bd-479c1111068b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:00.285494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cc0d4-33d0-4fe1-90bd-479c1111068b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:00.292230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300753f-e6d0-4402-8f88-92080c6f92cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:00.293127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300753f-e6d0-4402-8f88-92080c6f92cd admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.293773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300753f-e6d0-4402-8f88-92080c6f92cd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.294166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300753f-e6d0-4402-8f88-92080c6f92cd admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.294891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300753f-e6d0-4402-8f88-92080c6f92cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:00.299666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300753f-e6d0-4402-8f88-92080c6f92cd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:00.301371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8f3ca-ea4e-41ab-9a71-9dd1d7d76754 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:00.303227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f0c8f3ca-ea4e-41ab-9a71-9dd1d7d76754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:00.311840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:00.340275 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 969/1925] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:00.341340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300753f-e6d0-4402-8f88-92080c6f92cd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:00.350566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8f3ca-ea4e-41ab-9a71-9dd1d7d76754 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:00.355580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300753f-e6d0-4402-8f88-92080c6f92cd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:00.361269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d13d3-aa18-42e2-9b4e-476c96b5f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:00.361958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d13d3-aa18-42e2-9b4e-476c96b5f83e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.362319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d13d3-aa18-42e2-9b4e-476c96b5f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.362632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d13d3-aa18-42e2-9b4e-476c96b5f83e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.363022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:00.363249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d13d3-aa18-42e2-9b4e-476c96b5f83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:00.363722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.364476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.364476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4 admin admin] PATH_INFO: `/v3/projects/5729227bda88440095bc3b342df17f68` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.364822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d13d3-aa18-42e2-9b4e-476c96b5f83e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:00.365556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5729227bda88440095bc3b342df17f68)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:00.368736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:00.372837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:00.385897 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 970/1926] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:00.387330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010f36-86eb-4023-aa56-247178f316e5 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.387569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010f36-86eb-4023-aa56-247178f316e5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.387891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010f36-86eb-4023-aa56-247178f316e5 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.389849 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 971/1927] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:00.391487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57010f36-86eb-4023-aa56-247178f316e5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:00.406517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57010f36-86eb-4023-aa56-247178f316e5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:00.411751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998630-2ed9-4c2d-bf0f-38d66c032932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:00.412436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998630-2ed9-4c2d-bf0f-38d66c032932 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.412712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998630-2ed9-4c2d-bf0f-38d66c032932 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.412986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998630-2ed9-4c2d-bf0f-38d66c032932 admin admin] PATH_INFO: `/v3/projects/c018a022039342cdb19954c2c8a0d8da/users/c9d2c3e8b57644d49a214838baf2ac4c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.433635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3998630-2ed9-4c2d-bf0f-38d66c032932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c018a022039342cdb19954c2c8a0d8da, user_id=c9d2c3e8b57644d49a214838baf2ac4c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:00.436568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3998630-2ed9-4c2d-bf0f-38d66c032932 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:00.449900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5729227bda88440095bc3b342df17f68', 'request_id': 'req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.457398 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 972/1928] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:00 2022] PUT /identity/v3/projects/c018a022039342cdb19954c2c8a0d8da/users/c9d2c3e8b57644d49a214838baf2ac4c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:00.457398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998630-2ed9-4c2d-bf0f-38d66c032932 admin admin] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:00.459156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d3998630-2ed9-4c2d-bf0f-38d66c032932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:00.464700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5729227bda88440095bc3b342df17f68', 'request_id': 'req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.483677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5729227bda88440095bc3b342df17f68', 'request_id': 'req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.504904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4 admin admin] The token cache is being invalidate because project 5729227bda88440095bc3b342df17f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:00.505378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.506275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2477e09a-0bef-43e0-9fd3-d89f6b242bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.508799 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 957/1929] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:00 2022] DELETE /identity/v3/projects/5729227bda88440095bc3b342df17f68 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:52:00.510484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4601b9-f932-4310-8d8a-e42c2a6df6b6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.510770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4601b9-f932-4310-8d8a-e42c2a6df6b6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.511288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4601b9-f932-4310-8d8a-e42c2a6df6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.541082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0b4601b9-f932-4310-8d8a-e42c2a6df6b6 None None] MFA Rules not processed for user `c9d2c3e8b57644d49a214838baf2ac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:00.542881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0b4601b9-f932-4310-8d8a-e42c2a6df6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:00.564812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998630-2ed9-4c2d-bf0f-38d66c032932 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:00.613663 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 958/1930] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:00.614512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4601b9-f932-4310-8d8a-e42c2a6df6b6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:00.615790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0b4601b9-f932-4310-8d8a-e42c2a6df6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:00.636354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998630-2ed9-4c2d-bf0f-38d66c032932 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:00.641664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08d111-ae2e-4832-b1e8-eb58a8e4a888 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d95868598ec40d38931c8bf1c7223b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db33d17d8b364b30986fc9b10f145d0d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:00.642303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d111-ae2e-4832-b1e8-eb58a8e4a888 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.642866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d111-ae2e-4832-b1e8-eb58a8e4a888 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.643148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d111-ae2e-4832-b1e8-eb58a8e4a888 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] PATH_INFO: `/v3/projects/00d9071ba2e34475baf046a4c42f9889` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.644288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08d111-ae2e-4832-b1e8-eb58a8e4a888 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorizing `identity:get_project(project_id=00d9071ba2e34475baf046a4c42f9889)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:00.646365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08d111-ae2e-4832-b1e8-eb58a8e4a888 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:00.648168 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 973/1931] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:00 2022] GET /identity/v3/projects/00d9071ba2e34475baf046a4c42f9889 => generated 377 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:00.648923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08d111-ae2e-4832-b1e8-eb58a8e4a888 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:00.650530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1b08d111-ae2e-4832-b1e8-eb58a8e4a888 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:00.690315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4601b9-f932-4310-8d8a-e42c2a6df6b6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:00.695646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:00.696899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.698098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.698587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] PATH_INFO: `/v3/users/6bf7e17231934826bdcd3a35e551b416` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.699863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf7e17231934826bdcd3a35e551b416)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:00.702330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:00.722297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08d111-ae2e-4832-b1e8-eb58a8e4a888 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:00.727028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa63e79-b474-43ef-936a-561f82c99390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:00.727660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa63e79-b474-43ef-936a-561f82c99390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.728463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa63e79-b474-43ef-936a-561f82c99390 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.728749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa63e79-b474-43ef-936a-561f82c99390 admin admin] PATH_INFO: `/v3/users/c19e0020e3a24bccb3af89da6f784e81` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.730114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa63e79-b474-43ef-936a-561f82c99390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19e0020e3a24bccb3af89da6f784e81)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:00.731736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:00.733077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa63e79-b474-43ef-936a-561f82c99390 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:00.735782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:00.769783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf7e17231934826bdcd3a35e551b416'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.777995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf7e17231934826bdcd3a35e551b416'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.778844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf7e17231934826bdcd3a35e551b416'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.779487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf7e17231934826bdcd3a35e551b416'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.792347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf7e17231934826bdcd3a35e551b416'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.801641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1aa63e79-b474-43ef-936a-561f82c99390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19e0020e3a24bccb3af89da6f784e81'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.806783 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 959/1932] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:00 2022] DELETE /identity/v3/users/6bf7e17231934826bdcd3a35e551b416 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:00.807794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:00.809199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:00.809883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1aa63e79-b474-43ef-936a-561f82c99390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19e0020e3a24bccb3af89da6f784e81'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.810613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1aa63e79-b474-43ef-936a-561f82c99390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19e0020e3a24bccb3af89da6f784e81'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.811322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1aa63e79-b474-43ef-936a-561f82c99390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19e0020e3a24bccb3af89da6f784e81'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.826441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1aa63e79-b474-43ef-936a-561f82c99390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19e0020e3a24bccb3af89da6f784e81'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:00.847772 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 974/1933] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:00 2022] DELETE /identity/v3/users/c19e0020e3a24bccb3af89da6f784e81 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:00.849318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ade45-4ee5-41cb-aa08-5eb459478c52 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.849621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ade45-4ee5-41cb-aa08-5eb459478c52 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.849887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ade45-4ee5-41cb-aa08-5eb459478c52 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.856132 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 975/1934] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:00.858175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec859c1-714b-46ba-8e37-b130c597104e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.858493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec859c1-714b-46ba-8e37-b130c597104e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.858728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec859c1-714b-46ba-8e37-b130c597104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.885888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5ec859c1-714b-46ba-8e37-b130c597104e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:00.888130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5ec859c1-714b-46ba-8e37-b130c597104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:00.916795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08e01b-84eb-4520-b1e2-16a461b324dd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:00.956672 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 976/1935] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:00.957718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec859c1-714b-46ba-8e37-b130c597104e None None] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:00.962790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5ec859c1-714b-46ba-8e37-b130c597104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:00.989585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb145-13fc-4a5a-bba0-ade4c0e9dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:00.990208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb145-13fc-4a5a-bba0-ade4c0e9dc02 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:00.990510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb145-13fc-4a5a-bba0-ade4c0e9dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:00.990839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb145-13fc-4a5a-bba0-ade4c0e9dc02 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:00.991536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eb145-13fc-4a5a-bba0-ade4c0e9dc02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:00.993409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eb145-13fc-4a5a-bba0-ade4c0e9dc02 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:01.023890 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 960/1936] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:00 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:01.025457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb145-13fc-4a5a-bba0-ade4c0e9dc02 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:01.030578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c61eb145-13fc-4a5a-bba0-ade4c0e9dc02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:01.063039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec859c1-714b-46ba-8e37-b130c597104e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:01.064336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5ec859c1-714b-46ba-8e37-b130c597104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:01.069061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:01.079855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:01.101224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb145-13fc-4a5a-bba0-ade4c0e9dc02 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:01.105614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55270198-8c61-4ee4-9ad1-f5263747db29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:01.106225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55270198-8c61-4ee4-9ad1-f5263747db29 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.106522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55270198-8c61-4ee4-9ad1-f5263747db29 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.106819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55270198-8c61-4ee4-9ad1-f5263747db29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.155571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec859c1-714b-46ba-8e37-b130c597104e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:01.186335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55270198-8c61-4ee4-9ad1-f5263747db29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:01.187758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55270198-8c61-4ee4-9ad1-f5263747db29 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:01.197987 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 961/1937] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:01.198861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55270198-8c61-4ee4-9ad1-f5263747db29 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:01.200392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-55270198-8c61-4ee4-9ad1-f5263747db29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:01.212939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55270198-8c61-4ee4-9ad1-f5263747db29 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:01.215523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2a16b-aec3-4ec5-9066-ca7a573a86ec tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d95868598ec40d38931c8bf1c7223b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db33d17d8b364b30986fc9b10f145d0d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:01.216171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2a16b-aec3-4ec5-9066-ca7a573a86ec tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.216474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2a16b-aec3-4ec5-9066-ca7a573a86ec tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.216827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2a16b-aec3-4ec5-9066-ca7a573a86ec tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] PATH_INFO: `/v3/projects/00d9071ba2e34475baf046a4c42f9889` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.219508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2a16b-aec3-4ec5-9066-ca7a573a86ec tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorizing `identity:get_project(project_id=00d9071ba2e34475baf046a4c42f9889)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:01.220621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a0cf-b486-4c0d-b826-3dfc24c0a8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:01.221329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a0cf-b486-4c0d-b826-3dfc24c0a8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.221599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a0cf-b486-4c0d-b826-3dfc24c0a8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.221872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a0cf-b486-4c0d-b826-3dfc24c0a8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.222623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a0cf-b486-4c0d-b826-3dfc24c0a8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:01.222897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2a16b-aec3-4ec5-9066-ca7a573a86ec tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:01.224593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a0cf-b486-4c0d-b826-3dfc24c0a8b0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:01.224717 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 977/1938] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:00 2022] GET /identity/v3/projects/00d9071ba2e34475baf046a4c42f9889 => generated 377 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:01.230799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2a16b-aec3-4ec5-9066-ca7a573a86ec tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:01.233746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-13a2a16b-aec3-4ec5-9066-ca7a573a86ec tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:01.256879 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 962/1939] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:01 2022] POST /identity/v3/users => generated 294 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:01.257346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2a16b-aec3-4ec5-9066-ca7a573a86ec tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:01.258787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a0cf-b486-4c0d-b826-3dfc24c0a8b0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:01.261050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8db83-f546-49ac-b3bf-06d562b64b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:01.261786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8db83-f546-49ac-b3bf-06d562b64b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.262133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8db83-f546-49ac-b3bf-06d562b64b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.262447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8db83-f546-49ac-b3bf-06d562b64b00 admin admin] PATH_INFO: `/v3/projects/87abe2b078e54502bd626fa172df49d1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.263912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8db83-f546-49ac-b3bf-06d562b64b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87abe2b078e54502bd626fa172df49d1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:01.267527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8db83-f546-49ac-b3bf-06d562b64b00 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:01.273384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a0cf-b486-4c0d-b826-3dfc24c0a8b0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:01.283680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b65ab6-791b-4be3-ad7f-6852e1c0362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:01.284362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b65ab6-791b-4be3-ad7f-6852e1c0362e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.284626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b65ab6-791b-4be3-ad7f-6852e1c0362e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.284898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b65ab6-791b-4be3-ad7f-6852e1c0362e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.285581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b65ab6-791b-4be3-ad7f-6852e1c0362e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:01.287949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b65ab6-791b-4be3-ad7f-6852e1c0362e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:01.303858 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 963/1940] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:52:01.308817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b65ab6-791b-4be3-ad7f-6852e1c0362e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:01.320164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b65ab6-791b-4be3-ad7f-6852e1c0362e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:01.331688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7a6be-a247-414f-9658-9f3d0d2733e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:01.332361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7a6be-a247-414f-9658-9f3d0d2733e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.332637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7a6be-a247-414f-9658-9f3d0d2733e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.332905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7a6be-a247-414f-9658-9f3d0d2733e0 admin admin] PATH_INFO: `/v3/projects/494b1dc313b5471f9d074129b4657b5c/users/c717a1aeb72f4a3d85ea82f849e9dfe4/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.345922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e8e8db83-f546-49ac-b3bf-06d562b64b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87abe2b078e54502bd626fa172df49d1', 'request_id': 'req-e8e8db83-f546-49ac-b3bf-06d562b64b00'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.351368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7a6be-a247-414f-9658-9f3d0d2733e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494b1dc313b5471f9d074129b4657b5c, user_id=c717a1aeb72f4a3d85ea82f849e9dfe4, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:01.354894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7a6be-a247-414f-9658-9f3d0d2733e0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:01.357481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e8e8db83-f546-49ac-b3bf-06d562b64b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87abe2b078e54502bd626fa172df49d1', 'request_id': 'req-e8e8db83-f546-49ac-b3bf-06d562b64b00'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.378944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e8e8db83-f546-49ac-b3bf-06d562b64b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87abe2b078e54502bd626fa172df49d1', 'request_id': 'req-e8e8db83-f546-49ac-b3bf-06d562b64b00'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.394961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e8e8db83-f546-49ac-b3bf-06d562b64b00 admin admin] The token cache is being invalidate because project 87abe2b078e54502bd626fa172df49d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:01.395401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e8e8db83-f546-49ac-b3bf-06d562b64b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.396134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e8e8db83-f546-49ac-b3bf-06d562b64b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.404102 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 978/1942] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:01 2022] DELETE /identity/v3/projects/87abe2b078e54502bd626fa172df49d1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:01.404265 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 964/1942] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:01 2022] PUT /identity/v3/projects/494b1dc313b5471f9d074129b4657b5c/users/c717a1aeb72f4a3d85ea82f849e9dfe4/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:01.404375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc921b6-ba62-4383-9e17-2a0c62dacf6d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.404375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc921b6-ba62-4383-9e17-2a0c62dacf6d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.404375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc921b6-ba62-4383-9e17-2a0c62dacf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.404570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e1ed3-85d4-4cc7-8772-4133a9f1ed1c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.404570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e1ed3-85d4-4cc7-8772-4133a9f1ed1c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.404570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e1ed3-85d4-4cc7-8772-4133a9f1ed1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.427150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e68e1ed3-85d4-4cc7-8772-4133a9f1ed1c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:01.428456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e68e1ed3-85d4-4cc7-8772-4133a9f1ed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:01.430160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9bc921b6-ba62-4383-9e17-2a0c62dacf6d None None] MFA Rules not processed for user `572574747ca24cadb63e09288452bd25`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:01.431534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9bc921b6-ba62-4383-9e17-2a0c62dacf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:01.498210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:01.516613 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 965/1943] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:01.516613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e1ed3-85d4-4cc7-8772-4133a9f1ed1c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:01.518220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e68e1ed3-85d4-4cc7-8772-4133a9f1ed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:01.526753 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 979/1944] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:01.526753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9025fe2-715f-4700-bb0f-204d8d469fc5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.526753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9025fe2-715f-4700-bb0f-204d8d469fc5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.526753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9025fe2-715f-4700-bb0f-204d8d469fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.539675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e1ed3-85d4-4cc7-8772-4133a9f1ed1c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:01.547743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4c204-8ed8-4157-95b6-356f1d7fedef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:01.550517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4c204-8ed8-4157-95b6-356f1d7fedef admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.550975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4c204-8ed8-4157-95b6-356f1d7fedef admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.551341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4c204-8ed8-4157-95b6-356f1d7fedef admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.552434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4c204-8ed8-4157-95b6-356f1d7fedef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:01.554349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4c204-8ed8-4157-95b6-356f1d7fedef admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:01.562751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a9025fe2-715f-4700-bb0f-204d8d469fc5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:01.564585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a9025fe2-715f-4700-bb0f-204d8d469fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:01.576125 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 980/1945] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:01.576125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9025fe2-715f-4700-bb0f-204d8d469fc5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:01.576125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a9025fe2-715f-4700-bb0f-204d8d469fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:01.588801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9025fe2-715f-4700-bb0f-204d8d469fc5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:01.592587 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 966/1946] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:01.592587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4c204-8ed8-4157-95b6-356f1d7fedef admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:01.594792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:01.595546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.595898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.596254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] PATH_INFO: `/v3/projects/92f0b7bc9a244bcba53e79c755511de2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.597494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f0b7bc9a244bcba53e79c755511de2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:01.599430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:01.606949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4c204-8ed8-4157-95b6-356f1d7fedef admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:01.612585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfdc1c-cc3d-43e6-b4a7-a90f0a7d4731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:01.613344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfdc1c-cc3d-43e6-b4a7-a90f0a7d4731 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.613639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfdc1c-cc3d-43e6-b4a7-a90f0a7d4731 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.613967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfdc1c-cc3d-43e6-b4a7-a90f0a7d4731 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.614616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfdc1c-cc3d-43e6-b4a7-a90f0a7d4731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:01.614975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfdc1c-cc3d-43e6-b4a7-a90f0a7d4731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:01.617250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfdc1c-cc3d-43e6-b4a7-a90f0a7d4731 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:01.634591 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 967/1947] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:01.635292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfdc1c-cc3d-43e6-b4a7-a90f0a7d4731 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:01.645740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfdc1c-cc3d-43e6-b4a7-a90f0a7d4731 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:01.649525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:01.663783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f0b7bc9a244bcba53e79c755511de2', 'request_id': 'req-289e146e-cb9c-43de-9e2f-bc3143ea10f6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.673728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f0b7bc9a244bcba53e79c755511de2', 'request_id': 'req-289e146e-cb9c-43de-9e2f-bc3143ea10f6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.681093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f0b7bc9a244bcba53e79c755511de2', 'request_id': 'req-289e146e-cb9c-43de-9e2f-bc3143ea10f6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.693863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] The token cache is being invalidate because project 92f0b7bc9a244bcba53e79c755511de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:01.694172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.694960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.696794 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 981/1948] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:01 2022] DELETE /identity/v3/projects/92f0b7bc9a244bcba53e79c755511de2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:01.700653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:01.702030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:01.712511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdca67-1ace-4449-8b88-325507a16777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:01.713297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdca67-1ace-4449-8b88-325507a16777 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.713736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdca67-1ace-4449-8b88-325507a16777 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.713934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdca67-1ace-4449-8b88-325507a16777 admin admin] PATH_INFO: `/v3/projects/494b1dc313b5471f9d074129b4657b5c/users/c717a1aeb72f4a3d85ea82f849e9dfe4/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.716245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdca67-1ace-4449-8b88-325507a16777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494b1dc313b5471f9d074129b4657b5c, user_id=c717a1aeb72f4a3d85ea82f849e9dfe4, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:01.720418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdca67-1ace-4449-8b88-325507a16777 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:01.734515 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 968/1949] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:01 2022] PUT /identity/v3/projects/494b1dc313b5471f9d074129b4657b5c/users/c717a1aeb72f4a3d85ea82f849e9dfe4/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:01.735915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdca67-1ace-4449-8b88-325507a16777 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:01.737605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b4fdca67-1ace-4449-8b88-325507a16777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:01.791894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e146e-cb9c-43de-9e2f-bc3143ea10f6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:01.822043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdca67-1ace-4449-8b88-325507a16777 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:01.830547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:01.831458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.831740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.832015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] PATH_INFO: `/v3/users/fab1cc79a1864b86af7ba71f1be38534` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.833927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab1cc79a1864b86af7ba71f1be38534)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:01.835956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:01.865685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68311018-045d-44a2-bb19-e2795f612ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:01.866460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68311018-045d-44a2-bb19-e2795f612ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.866846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68311018-045d-44a2-bb19-e2795f612ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.867211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68311018-045d-44a2-bb19-e2795f612ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.867918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68311018-045d-44a2-bb19-e2795f612ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:01.870075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68311018-045d-44a2-bb19-e2795f612ad2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:01.899734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:01.912432 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 982/1950] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:01 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:01.914596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449adcd-2a9d-4907-b872-5d88bf65b9f1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:01.915092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449adcd-2a9d-4907-b872-5d88bf65b9f1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:01.915555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449adcd-2a9d-4907-b872-5d88bf65b9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:01.927317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab1cc79a1864b86af7ba71f1be38534'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.935496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab1cc79a1864b86af7ba71f1be38534'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.936223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab1cc79a1864b86af7ba71f1be38534'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.936839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab1cc79a1864b86af7ba71f1be38534'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.955252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab1cc79a1864b86af7ba71f1be38534'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:01.955891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5449adcd-2a9d-4907-b872-5d88bf65b9f1 None None] MFA Rules not processed for user `c717a1aeb72f4a3d85ea82f849e9dfe4`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:01.957237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5449adcd-2a9d-4907-b872-5d88bf65b9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:01.986827 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 969/1951] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:01 2022] DELETE /identity/v3/users/fab1cc79a1864b86af7ba71f1be38534 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:01.990623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:01.993431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:02.025451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:02.086073 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 983/1952] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:02.087706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f0993-92c2-4fd8-97f9-da3dc0a47c86 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.088112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f0993-92c2-4fd8-97f9-da3dc0a47c86 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.088406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f0993-92c2-4fd8-97f9-da3dc0a47c86 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.090336 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 984/1953] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:02.096683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f0993-92c2-4fd8-97f9-da3dc0a47c86 None None] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:02.098587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4d3f0993-92c2-4fd8-97f9-da3dc0a47c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:02.099948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e4af6-44d1-471f-a5af-7101023aa776 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:02.120145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c281d-b207-411b-bc13-bfedb251642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:02.120783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c281d-b207-411b-bc13-bfedb251642a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.121067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c281d-b207-411b-bc13-bfedb251642a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.121377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c281d-b207-411b-bc13-bfedb251642a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.122025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c281d-b207-411b-bc13-bfedb251642a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:02.123963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c281d-b207-411b-bc13-bfedb251642a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:02.152583 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 970/1954] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:01 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:02.157209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c281d-b207-411b-bc13-bfedb251642a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:02.168672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c281d-b207-411b-bc13-bfedb251642a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:02.174882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dcc81-632d-406f-81dd-f142bcf8e07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:02.175494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dcc81-632d-406f-81dd-f142bcf8e07c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.175777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dcc81-632d-406f-81dd-f142bcf8e07c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.176082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dcc81-632d-406f-81dd-f142bcf8e07c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.176729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dcc81-632d-406f-81dd-f142bcf8e07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:02.178411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dcc81-632d-406f-81dd-f142bcf8e07c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:02.193309 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 971/1955] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:02.193309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dcc81-632d-406f-81dd-f142bcf8e07c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:02.196870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-733dcc81-632d-406f-81dd-f142bcf8e07c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:02.225318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f0993-92c2-4fd8-97f9-da3dc0a47c86 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:02.226725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4d3f0993-92c2-4fd8-97f9-da3dc0a47c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:02.282841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dcc81-632d-406f-81dd-f142bcf8e07c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:02.289620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0f065-1ed9-4571-b6e0-313ec4c237cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:02.290507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0f065-1ed9-4571-b6e0-313ec4c237cd service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.291025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0f065-1ed9-4571-b6e0-313ec4c237cd service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.291506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0f065-1ed9-4571-b6e0-313ec4c237cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.299189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f0993-92c2-4fd8-97f9-da3dc0a47c86 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:02.304571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37093f91-579b-4e8a-8460-784417f78404 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d95868598ec40d38931c8bf1c7223b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db33d17d8b364b30986fc9b10f145d0d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:02.305227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37093f91-579b-4e8a-8460-784417f78404 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.305537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37093f91-579b-4e8a-8460-784417f78404 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.305811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37093f91-579b-4e8a-8460-784417f78404 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] PATH_INFO: `/v3/projects/00d9071ba2e34475baf046a4c42f9889` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.306948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37093f91-579b-4e8a-8460-784417f78404 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorizing `identity:get_project(project_id=00d9071ba2e34475baf046a4c42f9889)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:02.308969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37093f91-579b-4e8a-8460-784417f78404 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:02.310647 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 985/1956] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:02 2022] GET /identity/v3/projects/00d9071ba2e34475baf046a4c42f9889 => generated 377 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:02.311488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37093f91-579b-4e8a-8460-784417f78404 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:02.324708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37093f91-579b-4e8a-8460-784417f78404 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:02.331056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb9fb9-1769-49a3-ab10-8530c8f1f470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:02.331674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb9fb9-1769-49a3-ab10-8530c8f1f470 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.332026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb9fb9-1769-49a3-ab10-8530c8f1f470 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.332376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb9fb9-1769-49a3-ab10-8530c8f1f470 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.333167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb9fb9-1769-49a3-ab10-8530c8f1f470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:02.334800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb9fb9-1769-49a3-ab10-8530c8f1f470 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:02.349894 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 986/1957] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:02.350794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb9fb9-1769-49a3-ab10-8530c8f1f470 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:02.352608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cadb9fb9-1769-49a3-ab10-8530c8f1f470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:02.379909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb9fb9-1769-49a3-ab10-8530c8f1f470 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:02.380481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0f065-1ed9-4571-b6e0-313ec4c237cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:02.383059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0f065-1ed9-4571-b6e0-313ec4c237cd service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:02.385640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc0294-919e-4e70-99d5-1c52a26f63d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:02.386468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc0294-919e-4e70-99d5-1c52a26f63d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.386720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc0294-919e-4e70-99d5-1c52a26f63d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.387002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc0294-919e-4e70-99d5-1c52a26f63d5 admin admin] PATH_INFO: `/v3/projects/469c1c4ea6394cfab3c6651944254af8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.388434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc0294-919e-4e70-99d5-1c52a26f63d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=469c1c4ea6394cfab3c6651944254af8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:02.392278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc0294-919e-4e70-99d5-1c52a26f63d5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:02.397370 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 972/1958] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:02.398560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0f065-1ed9-4571-b6e0-313ec4c237cd service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:02.400413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:02.416953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0f065-1ed9-4571-b6e0-313ec4c237cd service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:02.429301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fee891-17f0-43b0-9c83-9ab772a83ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:02.429301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fee891-17f0-43b0-9c83-9ab772a83ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.429301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fee891-17f0-43b0-9c83-9ab772a83ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.429301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fee891-17f0-43b0-9c83-9ab772a83ae9 admin admin] PATH_INFO: `/v3/projects/8ec5306c86e541b486255603bf57e98d/users/34b5a4b553664282a1df4e54375bbeaa/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.446236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fee891-17f0-43b0-9c83-9ab772a83ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec5306c86e541b486255603bf57e98d, user_id=34b5a4b553664282a1df4e54375bbeaa, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:02.449530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fee891-17f0-43b0-9c83-9ab772a83ae9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:02.465736 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 973/1959] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:02 2022] PUT /identity/v3/projects/8ec5306c86e541b486255603bf57e98d/users/34b5a4b553664282a1df4e54375bbeaa/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:02.466890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedc8d9-7faf-400c-9408-15eb9ab52abd None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.467278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedc8d9-7faf-400c-9408-15eb9ab52abd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.467607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedc8d9-7faf-400c-9408-15eb9ab52abd None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.469041 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 974/1960] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:02.477715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedc8d9-7faf-400c-9408-15eb9ab52abd None None] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:02.483001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fdfc0294-919e-4e70-99d5-1c52a26f63d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469c1c4ea6394cfab3c6651944254af8', 'request_id': 'req-fdfc0294-919e-4e70-99d5-1c52a26f63d5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:02.493653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fdfc0294-919e-4e70-99d5-1c52a26f63d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469c1c4ea6394cfab3c6651944254af8', 'request_id': 'req-fdfc0294-919e-4e70-99d5-1c52a26f63d5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:02.495797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:02.501333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fdfc0294-919e-4e70-99d5-1c52a26f63d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469c1c4ea6394cfab3c6651944254af8', 'request_id': 'req-fdfc0294-919e-4e70-99d5-1c52a26f63d5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:02.516269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fdfc0294-919e-4e70-99d5-1c52a26f63d5 admin admin] The token cache is being invalidate because project 469c1c4ea6394cfab3c6651944254af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:02.516562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fdfc0294-919e-4e70-99d5-1c52a26f63d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:02.517698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fdfc0294-919e-4e70-99d5-1c52a26f63d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:02.520475 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 987/1961] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:02 2022] DELETE /identity/v3/projects/469c1c4ea6394cfab3c6651944254af8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:02.522741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a70842-64ec-4e03-b77a-9c251b304f9e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.523033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a70842-64ec-4e03-b77a-9c251b304f9e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.523376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a70842-64ec-4e03-b77a-9c251b304f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.554530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-18a70842-64ec-4e03-b77a-9c251b304f9e None None] MFA Rules not processed for user `34b5a4b553664282a1df4e54375bbeaa`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:02.555817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-18a70842-64ec-4e03-b77a-9c251b304f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:02.582811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedc8d9-7faf-400c-9408-15eb9ab52abd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:02.640267 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 988/1962] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:02.641360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d4eef-7d64-497c-bfa5-183e8209f18d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.641653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d4eef-7d64-497c-bfa5-183e8209f18d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.641922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d4eef-7d64-497c-bfa5-183e8209f18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.662315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-664d4eef-7d64-497c-bfa5-183e8209f18d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:02.663742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-664d4eef-7d64-497c-bfa5-183e8209f18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:02.664906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedc8d9-7faf-400c-9408-15eb9ab52abd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:02.669728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf271bb9-cd34-4aed-b778-c6109df548d8 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d95868598ec40d38931c8bf1c7223b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db33d17d8b364b30986fc9b10f145d0d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:02.670364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf271bb9-cd34-4aed-b778-c6109df548d8 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.670863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf271bb9-cd34-4aed-b778-c6109df548d8 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.672235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf271bb9-cd34-4aed-b778-c6109df548d8 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] PATH_INFO: `/v3/projects/00d9071ba2e34475baf046a4c42f9889` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.673475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf271bb9-cd34-4aed-b778-c6109df548d8 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorizing `identity:get_project(project_id=00d9071ba2e34475baf046a4c42f9889)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:02.677306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf271bb9-cd34-4aed-b778-c6109df548d8 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:02.680678 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 975/1963] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:02 2022] GET /identity/v3/projects/00d9071ba2e34475baf046a4c42f9889 => generated 377 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:52:02.681576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf271bb9-cd34-4aed-b778-c6109df548d8 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:02.683899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bf271bb9-cd34-4aed-b778-c6109df548d8 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:02.767244 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 989/1964] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:02.767244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50a901-a33b-4aa9-9a59-fda69781a67f None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.767244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50a901-a33b-4aa9-9a59-fda69781a67f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.767244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50a901-a33b-4aa9-9a59-fda69781a67f None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.767244 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 990/1965] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:02.775036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fac4e-83c4-466b-92a7-1d7eb26df7c0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.775337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fac4e-83c4-466b-92a7-1d7eb26df7c0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.775627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fac4e-83c4-466b-92a7-1d7eb26df7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.799761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ac8fac4e-83c4-466b-92a7-1d7eb26df7c0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:02.801431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ac8fac4e-83c4-466b-92a7-1d7eb26df7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:02.806661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf271bb9-cd34-4aed-b778-c6109df548d8 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:02.812630 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 991/1966] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:02.812912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372baf7-b387-4c08-909d-cdd3c2f30820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:02.814122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372baf7-b387-4c08-909d-cdd3c2f30820 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.814122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372baf7-b387-4c08-909d-cdd3c2f30820 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.814303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372baf7-b387-4c08-909d-cdd3c2f30820 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.814781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372baf7-b387-4c08-909d-cdd3c2f30820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:02.816897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372baf7-b387-4c08-909d-cdd3c2f30820 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:02.817426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fac4e-83c4-466b-92a7-1d7eb26df7c0 None None] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:02.818926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ac8fac4e-83c4-466b-92a7-1d7eb26df7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:02.838647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fac4e-83c4-466b-92a7-1d7eb26df7c0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:02.840561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ac8fac4e-83c4-466b-92a7-1d7eb26df7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:02.856157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fac4e-83c4-466b-92a7-1d7eb26df7c0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:02.859534 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 976/1967] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:02 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:02.860989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372baf7-b387-4c08-909d-cdd3c2f30820 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:02.870582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:02.922731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:02.953281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597796e-5d62-4f27-96ba-47784d03c48b tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d95868598ec40d38931c8bf1c7223b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db33d17d8b364b30986fc9b10f145d0d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:02.954111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597796e-5d62-4f27-96ba-47784d03c48b tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.954752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597796e-5d62-4f27-96ba-47784d03c48b tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.955235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597796e-5d62-4f27-96ba-47784d03c48b tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] PATH_INFO: `/v3/projects/00d9071ba2e34475baf046a4c42f9889` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.956819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597796e-5d62-4f27-96ba-47784d03c48b tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorizing `identity:get_project(project_id=00d9071ba2e34475baf046a4c42f9889)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:02.959695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597796e-5d62-4f27-96ba-47784d03c48b tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:02.962281 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 992/1968] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:02 2022] GET /identity/v3/projects/00d9071ba2e34475baf046a4c42f9889 => generated 377 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:02.963035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597796e-5d62-4f27-96ba-47784d03c48b tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:02.964207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372baf7-b387-4c08-909d-cdd3c2f30820 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:02.974294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135b7d-b40a-438d-adea-7a4d10f17422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:02.974927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135b7d-b40a-438d-adea-7a4d10f17422 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.975209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135b7d-b40a-438d-adea-7a4d10f17422 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.975482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135b7d-b40a-438d-adea-7a4d10f17422 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.975873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597796e-5d62-4f27-96ba-47784d03c48b tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:02.976214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135b7d-b40a-438d-adea-7a4d10f17422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:02.976549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135b7d-b40a-438d-adea-7a4d10f17422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:02.978289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135b7d-b40a-438d-adea-7a4d10f17422 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:02.980480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d3724-e6ec-4517-b9e8-9d8785a2dc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:02.981073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d3724-e6ec-4517-b9e8-9d8785a2dc48 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.981430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d3724-e6ec-4517-b9e8-9d8785a2dc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.981634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d3724-e6ec-4517-b9e8-9d8785a2dc48 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.982254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d3724-e6ec-4517-b9e8-9d8785a2dc48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:02.984742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d3724-e6ec-4517-b9e8-9d8785a2dc48 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:02.992180 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 977/1969] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:02.992883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135b7d-b40a-438d-adea-7a4d10f17422 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:02.999078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f1135b7d-b40a-438d-adea-7a4d10f17422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:03.014846 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 993/1970] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:02 2022] POST /identity/v3/users => generated 298 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:03.015962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d3724-e6ec-4517-b9e8-9d8785a2dc48 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:03.021458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135b7d-b40a-438d-adea-7a4d10f17422 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:03.029542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d3724-e6ec-4517-b9e8-9d8785a2dc48 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:03.032291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674eda8-b69d-478a-a801-4c2fdd1784af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:03.032914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674eda8-b69d-478a-a801-4c2fdd1784af admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.033262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674eda8-b69d-478a-a801-4c2fdd1784af admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.033568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674eda8-b69d-478a-a801-4c2fdd1784af admin admin] PATH_INFO: `/v3/users/c9d2c3e8b57644d49a214838baf2ac4c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.036182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c612a-f6d1-47ee-a7d3-c5cd8d3d7081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:03.036182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c612a-f6d1-47ee-a7d3-c5cd8d3d7081 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.036415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c612a-f6d1-47ee-a7d3-c5cd8d3d7081 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.036809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c612a-f6d1-47ee-a7d3-c5cd8d3d7081 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.036900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674eda8-b69d-478a-a801-4c2fdd1784af admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d2c3e8b57644d49a214838baf2ac4c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:03.037354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c612a-f6d1-47ee-a7d3-c5cd8d3d7081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:03.038777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674eda8-b69d-478a-a801-4c2fdd1784af admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:03.039360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c612a-f6d1-47ee-a7d3-c5cd8d3d7081 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:03.073618 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 994/1971] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:03 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:03.074467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c612a-f6d1-47ee-a7d3-c5cd8d3d7081 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:03.100074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7674eda8-b69d-478a-a801-4c2fdd1784af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d2c3e8b57644d49a214838baf2ac4c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:03.107224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7674eda8-b69d-478a-a801-4c2fdd1784af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d2c3e8b57644d49a214838baf2ac4c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:03.107931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7674eda8-b69d-478a-a801-4c2fdd1784af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d2c3e8b57644d49a214838baf2ac4c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:03.108575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7674eda8-b69d-478a-a801-4c2fdd1784af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d2c3e8b57644d49a214838baf2ac4c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:03.122457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7674eda8-b69d-478a-a801-4c2fdd1784af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d2c3e8b57644d49a214838baf2ac4c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:03.135312 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 978/1972] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:02 2022] DELETE /identity/v3/users/c9d2c3e8b57644d49a214838baf2ac4c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:03.137938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878826-c174-4260-9e21-b82bb4b13741 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.137938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878826-c174-4260-9e21-b82bb4b13741 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.137938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878826-c174-4260-9e21-b82bb4b13741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.141980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c612a-f6d1-47ee-a7d3-c5cd8d3d7081 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:03.157179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-95878826-c174-4260-9e21-b82bb4b13741 None None] MFA Rules not processed for user `572574747ca24cadb63e09288452bd25`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:03.158465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-95878826-c174-4260-9e21-b82bb4b13741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:03.201959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de4908-1307-41ec-aedd-0b846118c45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:03.203488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de4908-1307-41ec-aedd-0b846118c45d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.203488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de4908-1307-41ec-aedd-0b846118c45d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.203698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de4908-1307-41ec-aedd-0b846118c45d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.204375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de4908-1307-41ec-aedd-0b846118c45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:03.206077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de4908-1307-41ec-aedd-0b846118c45d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:03.218967 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 995/1973] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:03.219830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de4908-1307-41ec-aedd-0b846118c45d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:03.221646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-08de4908-1307-41ec-aedd-0b846118c45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:03.228712 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 979/1974] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:03.230501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d748-a005-4400-99a6-565181b606cb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.230888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d748-a005-4400-99a6-565181b606cb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.231265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d748-a005-4400-99a6-565181b606cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.256181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ed24d748-a005-4400-99a6-565181b606cb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:03.258155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ed24d748-a005-4400-99a6-565181b606cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:03.262343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de4908-1307-41ec-aedd-0b846118c45d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:03.268150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb32843-5a96-4a88-a4bf-c1e5ca80c147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:03.268766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb32843-5a96-4a88-a4bf-c1e5ca80c147 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.269045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb32843-5a96-4a88-a4bf-c1e5ca80c147 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.269354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb32843-5a96-4a88-a4bf-c1e5ca80c147 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.273028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb32843-5a96-4a88-a4bf-c1e5ca80c147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:03.273165 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 980/1975] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:03.273165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d748-a005-4400-99a6-565181b606cb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:03.273383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb32843-5a96-4a88-a4bf-c1e5ca80c147 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:03.273915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ed24d748-a005-4400-99a6-565181b606cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:03.289905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d748-a005-4400-99a6-565181b606cb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:03.296934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327290b4-2592-4d62-a66f-4653281e11a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:03.298297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327290b4-2592-4d62-a66f-4653281e11a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.298697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327290b4-2592-4d62-a66f-4653281e11a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.299237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327290b4-2592-4d62-a66f-4653281e11a0 admin admin] PATH_INFO: `/v3/projects/bf6bdda0a68d45f3a5fcdcce0d228225/users/b65fc42a56e94989ac471009143cb059/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.319502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327290b4-2592-4d62-a66f-4653281e11a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6bdda0a68d45f3a5fcdcce0d228225, user_id=b65fc42a56e94989ac471009143cb059, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:03.322685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327290b4-2592-4d62-a66f-4653281e11a0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:03.329269 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 996/1976] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:03 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:03.331903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb32843-5a96-4a88-a4bf-c1e5ca80c147 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:03.338830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-abb32843-5a96-4a88-a4bf-c1e5ca80c147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:03.345907 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 981/1977] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:03 2022] PUT /identity/v3/projects/bf6bdda0a68d45f3a5fcdcce0d228225/users/b65fc42a56e94989ac471009143cb059/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:03.346992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327290b4-2592-4d62-a66f-4653281e11a0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:03.358435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:03.365843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:03.447643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327290b4-2592-4d62-a66f-4653281e11a0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:03.454839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb14f-0c30-435f-a5be-60c1ea9dedf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:03.455708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb14f-0c30-435f-a5be-60c1ea9dedf8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.455708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb14f-0c30-435f-a5be-60c1ea9dedf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.456002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb14f-0c30-435f-a5be-60c1ea9dedf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.456975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cb14f-0c30-435f-a5be-60c1ea9dedf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:03.459443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cb14f-0c30-435f-a5be-60c1ea9dedf8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:03.477446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb32843-5a96-4a88-a4bf-c1e5ca80c147 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:03.477645 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 982/1978] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:03.477645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb14f-0c30-435f-a5be-60c1ea9dedf8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:03.493895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb14f-0c30-435f-a5be-60c1ea9dedf8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:03.499055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4755d3-8566-45d3-9196-c781d5a9a4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:03.500385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4755d3-8566-45d3-9196-c781d5a9a4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.500765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4755d3-8566-45d3-9196-c781d5a9a4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.501358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4755d3-8566-45d3-9196-c781d5a9a4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.502118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4755d3-8566-45d3-9196-c781d5a9a4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:03.503941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4755d3-8566-45d3-9196-c781d5a9a4a5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:03.517693 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 983/1979] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:03.518382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4755d3-8566-45d3-9196-c781d5a9a4a5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:03.535592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4755d3-8566-45d3-9196-c781d5a9a4a5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:03.541130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe1cec-8763-47bb-8d4f-1a7ec4954280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:03.542060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe1cec-8763-47bb-8d4f-1a7ec4954280 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.542841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe1cec-8763-47bb-8d4f-1a7ec4954280 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.543217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe1cec-8763-47bb-8d4f-1a7ec4954280 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.544131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe1cec-8763-47bb-8d4f-1a7ec4954280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:03.545779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe1cec-8763-47bb-8d4f-1a7ec4954280 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:03.557335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f26876-392f-4d41-aa86-a580d8fc671b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:03.558287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f26876-392f-4d41-aa86-a580d8fc671b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.558864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f26876-392f-4d41-aa86-a580d8fc671b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.559324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f26876-392f-4d41-aa86-a580d8fc671b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.566871 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 984/1980] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:03.566871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe1cec-8763-47bb-8d4f-1a7ec4954280 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:03.575682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f26876-392f-4d41-aa86-a580d8fc671b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:03.576384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe1cec-8763-47bb-8d4f-1a7ec4954280 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:03.578392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f26876-392f-4d41-aa86-a580d8fc671b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:03.581413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3857568-5e6d-476b-9f1f-c597aa865d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:03.582082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857568-5e6d-476b-9f1f-c597aa865d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.582360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857568-5e6d-476b-9f1f-c597aa865d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.582637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857568-5e6d-476b-9f1f-c597aa865d7b admin admin] PATH_INFO: `/v3/projects/bf6bdda0a68d45f3a5fcdcce0d228225/users/b65fc42a56e94989ac471009143cb059/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.584756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3857568-5e6d-476b-9f1f-c597aa865d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6bdda0a68d45f3a5fcdcce0d228225, user_id=b65fc42a56e94989ac471009143cb059, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:03.587814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3857568-5e6d-476b-9f1f-c597aa865d7b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:03.594887 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 997/1981] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:03.595954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f26876-392f-4d41-aa86-a580d8fc671b service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:03.608841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f26876-392f-4d41-aa86-a580d8fc671b service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:03.615075 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 985/1982] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:03 2022] PUT /identity/v3/projects/bf6bdda0a68d45f3a5fcdcce0d228225/users/b65fc42a56e94989ac471009143cb059/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:03.625047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17d0a-4b10-4e5a-b561-de3811a9b612 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.625356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17d0a-4b10-4e5a-b561-de3811a9b612 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.625632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17d0a-4b10-4e5a-b561-de3811a9b612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.670603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-24c17d0a-4b10-4e5a-b561-de3811a9b612 None None] MFA Rules not processed for user `b65fc42a56e94989ac471009143cb059`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:03.672538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-24c17d0a-4b10-4e5a-b561-de3811a9b612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:03.684345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4cb10-0966-4411-be49-65e572f2364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:03.685138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4cb10-0966-4411-be49-65e572f2364f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.685457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4cb10-0966-4411-be49-65e572f2364f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.685732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4cb10-0966-4411-be49-65e572f2364f admin admin] PATH_INFO: `/v3/projects/fc20782544f24eb3a49a037ef01e1f8f/users/066b9f2cca3d4ede9addf111f5e30701/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.702504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4cb10-0966-4411-be49-65e572f2364f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc20782544f24eb3a49a037ef01e1f8f, user_id=066b9f2cca3d4ede9addf111f5e30701, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:03.705369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4cb10-0966-4411-be49-65e572f2364f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:03.721002 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 998/1983] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:03 2022] PUT /identity/v3/projects/fc20782544f24eb3a49a037ef01e1f8f/users/066b9f2cca3d4ede9addf111f5e30701/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:03.722456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4377d26-b36c-4cb8-8725-cfad4d4b0a85 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.722743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4377d26-b36c-4cb8-8725-cfad4d4b0a85 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.723083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4377d26-b36c-4cb8-8725-cfad4d4b0a85 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.724508 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 999/1984] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:03.732468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372df98a-c2d1-4b08-b14a-c0fa8a9e5b7d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.732936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372df98a-c2d1-4b08-b14a-c0fa8a9e5b7d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.733321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372df98a-c2d1-4b08-b14a-c0fa8a9e5b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:03.767197 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 986/1985] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:52:03.768133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17d0a-4b10-4e5a-b561-de3811a9b612 None None] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:03.770324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-24c17d0a-4b10-4e5a-b561-de3811a9b612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:03.772583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-372df98a-c2d1-4b08-b14a-c0fa8a9e5b7d None None] MFA Rules not processed for user `066b9f2cca3d4ede9addf111f5e30701`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:03.773743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-372df98a-c2d1-4b08-b14a-c0fa8a9e5b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:03.821627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:03.844290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:03.865955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17d0a-4b10-4e5a-b561-de3811a9b612 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:03.867258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-24c17d0a-4b10-4e5a-b561-de3811a9b612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:03.870432 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1000/1986] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:03.871337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372df98a-c2d1-4b08-b14a-c0fa8a9e5b7d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:03.873498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-372df98a-c2d1-4b08-b14a-c0fa8a9e5b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:03.946008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17d0a-4b10-4e5a-b561-de3811a9b612 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:03.959856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372df98a-c2d1-4b08-b14a-c0fa8a9e5b7d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:03.965449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741aa65-c877-474c-b8a6-4393fd508eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:03.966087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741aa65-c877-474c-b8a6-4393fd508eeb service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:03.966366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741aa65-c877-474c-b8a6-4393fd508eeb service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:03.966639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741aa65-c877-474c-b8a6-4393fd508eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:04.003940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c23968-56bf-45e5-b0b8-b5830742e386 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d95868598ec40d38931c8bf1c7223b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db33d17d8b364b30986fc9b10f145d0d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:04.004489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c23968-56bf-45e5-b0b8-b5830742e386 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:04.004774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c23968-56bf-45e5-b0b8-b5830742e386 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:04.005051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c23968-56bf-45e5-b0b8-b5830742e386 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] PATH_INFO: `/v3/projects/00d9071ba2e34475baf046a4c42f9889` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:04.006217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c23968-56bf-45e5-b0b8-b5830742e386 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorizing `identity:get_project(project_id=00d9071ba2e34475baf046a4c42f9889)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:04.008453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c23968-56bf-45e5-b0b8-b5830742e386 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:04.010295 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 987/1987] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:03 2022] GET /identity/v3/projects/00d9071ba2e34475baf046a4c42f9889 => generated 377 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:04.010878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c23968-56bf-45e5-b0b8-b5830742e386 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:04.030145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741aa65-c877-474c-b8a6-4393fd508eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:04.032971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741aa65-c877-474c-b8a6-4393fd508eeb service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:04.045897 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1001/1988] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:04.046772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741aa65-c877-474c-b8a6-4393fd508eeb service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:04.048096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0741aa65-c877-474c-b8a6-4393fd508eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:04.099197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c23968-56bf-45e5-b0b8-b5830742e386 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:04.112385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb06e8-966b-412c-9139-da610761def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:04.113011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb06e8-966b-412c-9139-da610761def4 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:04.113322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb06e8-966b-412c-9139-da610761def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:04.113594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb06e8-966b-412c-9139-da610761def4 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:04.114226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb06e8-966b-412c-9139-da610761def4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:04.116123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb06e8-966b-412c-9139-da610761def4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:04.151319 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 988/1989] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:04 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:04.151467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741aa65-c877-474c-b8a6-4393fd508eeb service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:04.155043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb06e8-966b-412c-9139-da610761def4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:04.163570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:04.191456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:04.253398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:04.254223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:04.254494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:04.254839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] PATH_INFO: `/v3/projects/c018a022039342cdb19954c2c8a0d8da` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:04.256052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c018a022039342cdb19954c2c8a0d8da)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:04.257979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb06e8-966b-412c-9139-da610761def4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:04.258429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:04.263634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b320ba8-d8e6-47dc-b31e-70c48dec72f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:04.264600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b320ba8-d8e6-47dc-b31e-70c48dec72f8 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:04.264961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b320ba8-d8e6-47dc-b31e-70c48dec72f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:04.265952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b320ba8-d8e6-47dc-b31e-70c48dec72f8 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:04.266795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b320ba8-d8e6-47dc-b31e-70c48dec72f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:04.268958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b320ba8-d8e6-47dc-b31e-70c48dec72f8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:04.298013 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 989/1990] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:04 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:52:04.299210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b320ba8-d8e6-47dc-b31e-70c48dec72f8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:04.301146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7b320ba8-d8e6-47dc-b31e-70c48dec72f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:04.314227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b320ba8-d8e6-47dc-b31e-70c48dec72f8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:04.330711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c018a022039342cdb19954c2c8a0d8da', 'request_id': 'req-b3c21c33-0b03-49f3-b726-79a43bac25e5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.341150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c018a022039342cdb19954c2c8a0d8da', 'request_id': 'req-b3c21c33-0b03-49f3-b726-79a43bac25e5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.349676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c018a022039342cdb19954c2c8a0d8da', 'request_id': 'req-b3c21c33-0b03-49f3-b726-79a43bac25e5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.365329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] The token cache is being invalidate because project c018a022039342cdb19954c2c8a0d8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:04.366199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.367133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.369268 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1002/1991] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:04 2022] DELETE /identity/v3/projects/c018a022039342cdb19954c2c8a0d8da => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:04.370139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:04.371432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:04.387796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:04.388501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:04.388890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:04.389266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] PATH_INFO: `/v3/users/572574747ca24cadb63e09288452bd25` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:04.391059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=572574747ca24cadb63e09288452bd25)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:04.393121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:04.445131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '572574747ca24cadb63e09288452bd25'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.452073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '572574747ca24cadb63e09288452bd25'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.452776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '572574747ca24cadb63e09288452bd25'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.453706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '572574747ca24cadb63e09288452bd25'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.456744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c21c33-0b03-49f3-b726-79a43bac25e5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:04.462495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4283f4d-b6f6-4973-a40c-40bc5867b548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:04.463037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4283f4d-b6f6-4973-a40c-40bc5867b548 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:04.463523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4283f4d-b6f6-4973-a40c-40bc5867b548 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:04.463899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4283f4d-b6f6-4973-a40c-40bc5867b548 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:04.464748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4283f4d-b6f6-4973-a40c-40bc5867b548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:04.466313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '572574747ca24cadb63e09288452bd25'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.466411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4283f4d-b6f6-4973-a40c-40bc5867b548 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:04.480278 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1003/1992] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:04.481612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4283f4d-b6f6-4973-a40c-40bc5867b548 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:04.483951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c4283f4d-b6f6-4973-a40c-40bc5867b548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:04.487029 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 990/1993] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:04 2022] DELETE /identity/v3/users/572574747ca24cadb63e09288452bd25 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:04.488098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:04.489682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:04.502544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4283f4d-b6f6-4973-a40c-40bc5867b548 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:04.543986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:04.548531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:04.589658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:04.590802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:04.591109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:04.591488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] PATH_INFO: `/v3/users/c717a1aeb72f4a3d85ea82f849e9dfe4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:04.592976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c717a1aeb72f4a3d85ea82f849e9dfe4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:04.595939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:04.597867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a996a2b-4d37-4865-a265-a61fbb7c1ab8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:04.607268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7675c-c043-4c7b-a86c-92a0811592ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:04.607952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7675c-c043-4c7b-a86c-92a0811592ea admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:04.608234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7675c-c043-4c7b-a86c-92a0811592ea admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:04.609591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7675c-c043-4c7b-a86c-92a0811592ea admin admin] PATH_INFO: `/v3/projects/607f44f98258408b9f7f77a248328f87/users/e42f1a0ff1fb47fdbf291e216b505294/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:04.633930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7675c-c043-4c7b-a86c-92a0811592ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=607f44f98258408b9f7f77a248328f87, user_id=e42f1a0ff1fb47fdbf291e216b505294, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:04.634433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7675c-c043-4c7b-a86c-92a0811592ea admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:04.652848 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 991/1994] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:04 2022] PUT /identity/v3/projects/607f44f98258408b9f7f77a248328f87/users/e42f1a0ff1fb47fdbf291e216b505294/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:04.654271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969f19d-5c40-42fb-a829-ed3ed2a7c0bb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:04.654681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969f19d-5c40-42fb-a829-ed3ed2a7c0bb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:04.655152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969f19d-5c40-42fb-a829-ed3ed2a7c0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:04.665924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c717a1aeb72f4a3d85ea82f849e9dfe4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.675797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c717a1aeb72f4a3d85ea82f849e9dfe4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.677169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c717a1aeb72f4a3d85ea82f849e9dfe4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.677752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e969f19d-5c40-42fb-a829-ed3ed2a7c0bb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:04.679014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c717a1aeb72f4a3d85ea82f849e9dfe4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.679151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e969f19d-5c40-42fb-a829-ed3ed2a7c0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:04.696788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c717a1aeb72f4a3d85ea82f849e9dfe4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.716102 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1004/1995] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:04 2022] DELETE /identity/v3/users/c717a1aeb72f4a3d85ea82f849e9dfe4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:04.717156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:04.720912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:04.762275 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 992/1996] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:04.763497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969f19d-5c40-42fb-a829-ed3ed2a7c0bb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:04.765028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e969f19d-5c40-42fb-a829-ed3ed2a7c0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:04.781832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969f19d-5c40-42fb-a829-ed3ed2a7c0bb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:04.815730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796f3d5-db3b-4899-ae2f-c39416ef85cb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:04.823609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:04.824731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:04.825956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:04.826595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] PATH_INFO: `/v3/users/34b5a4b553664282a1df4e54375bbeaa` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:04.828128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b5a4b553664282a1df4e54375bbeaa)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:04.831100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:04.870216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d8a8-86a0-4528-8812-5ff287837dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:04.870963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d8a8-86a0-4528-8812-5ff287837dfb admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:04.871494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d8a8-86a0-4528-8812-5ff287837dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:04.872199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d8a8-86a0-4528-8812-5ff287837dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:04.872620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57d8a8-86a0-4528-8812-5ff287837dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:04.875300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57d8a8-86a0-4528-8812-5ff287837dfb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:04.897043 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 993/1997] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:04.897043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d8a8-86a0-4528-8812-5ff287837dfb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:04.898498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fe57d8a8-86a0-4528-8812-5ff287837dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:04.912865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b5a4b553664282a1df4e54375bbeaa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.923712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b5a4b553664282a1df4e54375bbeaa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.924577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b5a4b553664282a1df4e54375bbeaa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.925586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b5a4b553664282a1df4e54375bbeaa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.931511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:04.949538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b5a4b553664282a1df4e54375bbeaa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:04.971336 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1005/1998] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:04 2022] DELETE /identity/v3/users/34b5a4b553664282a1df4e54375bbeaa => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:04.972255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:04.976251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.016737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d8a8-86a0-4528-8812-5ff287837dfb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:05.025281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:05.080476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fdf77-660e-4a1a-80eb-b2fe022b75d0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:05.086947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda737e-a335-48fe-9f1f-f3e878446157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:05.087196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f9334-f55a-478f-84df-5d1c29f712dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:05.087561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda737e-a335-48fe-9f1f-f3e878446157 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.087833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f9334-f55a-478f-84df-5d1c29f712dc admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.087945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda737e-a335-48fe-9f1f-f3e878446157 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.088109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda737e-a335-48fe-9f1f-f3e878446157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.088211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f9334-f55a-478f-84df-5d1c29f712dc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.088547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f9334-f55a-478f-84df-5d1c29f712dc admin admin] PATH_INFO: `/v3/projects/607f44f98258408b9f7f77a248328f87/users/e42f1a0ff1fb47fdbf291e216b505294/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.089934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4eda737e-a335-48fe-9f1f-f3e878446157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.090594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f9334-f55a-478f-84df-5d1c29f712dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=607f44f98258408b9f7f77a248328f87, user_id=e42f1a0ff1fb47fdbf291e216b505294, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:05.096241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f9334-f55a-478f-84df-5d1c29f712dc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:05.103327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda737e-a335-48fe-9f1f-f3e878446157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:05.105054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda737e-a335-48fe-9f1f-f3e878446157 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:05.108530 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1006/1999] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:04 2022] PUT /identity/v3/projects/607f44f98258408b9f7f77a248328f87/users/e42f1a0ff1fb47fdbf291e216b505294/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:05.111150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32eae4-557f-4667-956a-d7a204b2f9f3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.111552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32eae4-557f-4667-956a-d7a204b2f9f3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.111932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32eae4-557f-4667-956a-d7a204b2f9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.121623 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 994/2000] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:05.122406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda737e-a335-48fe-9f1f-f3e878446157 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:05.123781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4eda737e-a335-48fe-9f1f-f3e878446157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.132303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4a32eae4-557f-4667-956a-d7a204b2f9f3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:05.133630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4a32eae4-557f-4667-956a-d7a204b2f9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.136205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda737e-a335-48fe-9f1f-f3e878446157 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:05.224742 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1007/2001] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:05.229502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76debff9-caf2-4122-b746-90c156003969 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.229860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76debff9-caf2-4122-b746-90c156003969 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.230154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76debff9-caf2-4122-b746-90c156003969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.231339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:05.232038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.232771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.232771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] PATH_INFO: `/v3/projects/494b1dc313b5471f9d074129b4657b5c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.234242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494b1dc313b5471f9d074129b4657b5c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:05.239601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:05.264599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-76debff9-caf2-4122-b746-90c156003969 None None] MFA Rules not processed for user `e42f1a0ff1fb47fdbf291e216b505294`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:05.266561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-76debff9-caf2-4122-b746-90c156003969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.315935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494b1dc313b5471f9d074129b4657b5c', 'request_id': 'req-2ee89481-f9b1-4111-969c-044bf38903e7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:05.331596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494b1dc313b5471f9d074129b4657b5c', 'request_id': 'req-2ee89481-f9b1-4111-969c-044bf38903e7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:05.340765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494b1dc313b5471f9d074129b4657b5c', 'request_id': 'req-2ee89481-f9b1-4111-969c-044bf38903e7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:05.352640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:05.360505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] The token cache is being invalidate because project 494b1dc313b5471f9d074129b4657b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:05.361028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:05.362514 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1008/2002] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:05.362734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:05.372658 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 995/2003] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:05 2022] DELETE /identity/v3/projects/494b1dc313b5471f9d074129b4657b5c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:05.372658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:05.372658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.372989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab81433-6b4e-46a3-b129-1b0cf2e651ee None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.372989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab81433-6b4e-46a3-b129-1b0cf2e651ee None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.373145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab81433-6b4e-46a3-b129-1b0cf2e651ee None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.375456 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1009/2004] 10.222.0.26 () {54 vars in 921 bytes} [Sat Oct 8 20:52:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:05.376183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab81433-6b4e-46a3-b129-1b0cf2e651ee None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:05.378319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eab81433-6b4e-46a3-b129-1b0cf2e651ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.446465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:05.463331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee89481-f9b1-4111-969c-044bf38903e7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:05.471136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d01f7-f351-4789-898e-6c19aa4985d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:05.471784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d01f7-f351-4789-898e-6c19aa4985d5 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.472067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d01f7-f351-4789-898e-6c19aa4985d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.472343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d01f7-f351-4789-898e-6c19aa4985d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.475445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9e1d01f7-f351-4789-898e-6c19aa4985d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.511614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab81433-6b4e-46a3-b129-1b0cf2e651ee None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:05.523407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0c2c-e773-4515-8c6e-77ea8c0f9894 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:05.524049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0c2c-e773-4515-8c6e-77ea8c0f9894 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.524333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0c2c-e773-4515-8c6e-77ea8c0f9894 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.524611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0c2c-e773-4515-8c6e-77ea8c0f9894 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.525301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a0c2c-e773-4515-8c6e-77ea8c0f9894 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:05.525615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a0c2c-e773-4515-8c6e-77ea8c0f9894 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:05.527243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a0c2c-e773-4515-8c6e-77ea8c0f9894 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:05.547368 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1010/2005] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:05.557642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5e908-cd1b-4469-8b9e-21d71ba13489 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.557961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5e908-cd1b-4469-8b9e-21d71ba13489 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.560216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5e908-cd1b-4469-8b9e-21d71ba13489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.587066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d01f7-f351-4789-898e-6c19aa4985d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:05.588811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d01f7-f351-4789-898e-6c19aa4985d5 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:05.596033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-dcc5e908-cd1b-4469-8b9e-21d71ba13489 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:05.597314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dcc5e908-cd1b-4469-8b9e-21d71ba13489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.600945 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 996/2006] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:05.602253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be3115-7868-4fdc-95a1-8bf021a0fa3e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.602537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be3115-7868-4fdc-95a1-8bf021a0fa3e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.602860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be3115-7868-4fdc-95a1-8bf021a0fa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.605750 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1011/2007] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:05.606561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5e908-cd1b-4469-8b9e-21d71ba13489 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:05.611109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dcc5e908-cd1b-4469-8b9e-21d71ba13489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.623982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5e908-cd1b-4469-8b9e-21d71ba13489 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:05.629052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4e37b-6793-412f-901f-d68cd0fb8d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:05.629739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4e37b-6793-412f-901f-d68cd0fb8d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.630064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4e37b-6793-412f-901f-d68cd0fb8d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.630344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4e37b-6793-412f-901f-d68cd0fb8d46 admin admin] PATH_INFO: `/v3/projects/00d9071ba2e34475baf046a4c42f9889` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.631212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-10be3115-7868-4fdc-95a1-8bf021a0fa3e None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:05.631535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4e37b-6793-412f-901f-d68cd0fb8d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d9071ba2e34475baf046a4c42f9889)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:05.632470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-10be3115-7868-4fdc-95a1-8bf021a0fa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.633490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4e37b-6793-412f-901f-d68cd0fb8d46 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:05.689028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fba4e37b-6793-412f-901f-d68cd0fb8d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d9071ba2e34475baf046a4c42f9889', 'request_id': 'req-fba4e37b-6793-412f-901f-d68cd0fb8d46'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:05.697341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fba4e37b-6793-412f-901f-d68cd0fb8d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d9071ba2e34475baf046a4c42f9889', 'request_id': 'req-fba4e37b-6793-412f-901f-d68cd0fb8d46'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:05.704260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fba4e37b-6793-412f-901f-d68cd0fb8d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d9071ba2e34475baf046a4c42f9889', 'request_id': 'req-fba4e37b-6793-412f-901f-d68cd0fb8d46'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:05.717613 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 997/2008] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:05.719745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be3115-7868-4fdc-95a1-8bf021a0fa3e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:05.732958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be3115-7868-4fdc-95a1-8bf021a0fa3e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:05.737475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fba4e37b-6793-412f-901f-d68cd0fb8d46 admin admin] The token cache is being invalidate because project 00d9071ba2e34475baf046a4c42f9889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:05.737770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fba4e37b-6793-412f-901f-d68cd0fb8d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:05.738443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fba4e37b-6793-412f-901f-d68cd0fb8d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:05.746104 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1012/2009] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:05 2022] DELETE /identity/v3/projects/00d9071ba2e34475baf046a4c42f9889 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:05.750936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4561cf-aa42-4565-a89b-dc96678071d9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.751226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4561cf-aa42-4565-a89b-dc96678071d9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.751501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4561cf-aa42-4565-a89b-dc96678071d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.775893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ac4561cf-aa42-4565-a89b-dc96678071d9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:05.777086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ac4561cf-aa42-4565-a89b-dc96678071d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.814104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bf764-ce2b-4574-8b21-0901e4825725 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:05.814480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bf764-ce2b-4574-8b21-0901e4825725 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.814729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bf764-ce2b-4574-8b21-0901e4825725 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.815014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bf764-ce2b-4574-8b21-0901e4825725 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.815656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bf764-ce2b-4574-8b21-0901e4825725 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:05.818768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bf764-ce2b-4574-8b21-0901e4825725 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:05.865127 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1013/2010] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:05.866384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4561cf-aa42-4565-a89b-dc96678071d9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:05.870023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ac4561cf-aa42-4565-a89b-dc96678071d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.872335 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 998/2011] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:05 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:05.873215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bf764-ce2b-4574-8b21-0901e4825725 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:05.876157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-765bf764-ce2b-4574-8b21-0901e4825725 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:05.886145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:05.892720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:05.960424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bf764-ce2b-4574-8b21-0901e4825725 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:05.966179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:05.966803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:05.967250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:05.967581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] PATH_INFO: `/v3/users/5d95868598ec40d38931c8bf1c7223b3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:05.969008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d95868598ec40d38931c8bf1c7223b3)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:05.971222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:06.012562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4561cf-aa42-4565-a89b-dc96678071d9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:06.035715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d95868598ec40d38931c8bf1c7223b3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.043018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d95868598ec40d38931c8bf1c7223b3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.043727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d95868598ec40d38931c8bf1c7223b3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.044373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d95868598ec40d38931c8bf1c7223b3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.057403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d95868598ec40d38931c8bf1c7223b3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.076120 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 999/2012] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:05 2022] DELETE /identity/v3/users/5d95868598ec40d38931c8bf1c7223b3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:06.076120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:06.076120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:06.093573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18713088-8361-4f51-b622-35afaea85ac2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:06.094285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18713088-8361-4f51-b622-35afaea85ac2 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.094637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18713088-8361-4f51-b622-35afaea85ac2 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.095008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18713088-8361-4f51-b622-35afaea85ac2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.096893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-18713088-8361-4f51-b622-35afaea85ac2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:06.110696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18713088-8361-4f51-b622-35afaea85ac2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:06.112407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18713088-8361-4f51-b622-35afaea85ac2 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:06.123842 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1014/2013] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:06.125321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18713088-8361-4f51-b622-35afaea85ac2 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:06.126739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-18713088-8361-4f51-b622-35afaea85ac2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:06.173063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5adf3-8d34-4613-b65d-0dafa90b1a5e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:06.182095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49de7f-e82e-4cc5-9eee-1dd67271c740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:06.182973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49de7f-e82e-4cc5-9eee-1dd67271c740 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.183398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49de7f-e82e-4cc5-9eee-1dd67271c740 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.184371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49de7f-e82e-4cc5-9eee-1dd67271c740 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.185587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49de7f-e82e-4cc5-9eee-1dd67271c740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:06.186083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49de7f-e82e-4cc5-9eee-1dd67271c740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:06.190811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49de7f-e82e-4cc5-9eee-1dd67271c740 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:06.211541 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1000/2014] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:06.212836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49de7f-e82e-4cc5-9eee-1dd67271c740 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:06.217893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4b49de7f-e82e-4cc5-9eee-1dd67271c740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:06.232916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18713088-8361-4f51-b622-35afaea85ac2 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:06.238271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49de7f-e82e-4cc5-9eee-1dd67271c740 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:06.244061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:06.245003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.245322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.245604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] PATH_INFO: `/v3/projects/8ec5306c86e541b486255603bf57e98d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.246805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec5306c86e541b486255603bf57e98d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:06.248968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:06.273422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:06.311051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:06.313690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec5306c86e541b486255603bf57e98d', 'request_id': 'req-723786cd-1b00-4bd5-9676-609b01047c67'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.324643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec5306c86e541b486255603bf57e98d', 'request_id': 'req-723786cd-1b00-4bd5-9676-609b01047c67'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.332595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec5306c86e541b486255603bf57e98d', 'request_id': 'req-723786cd-1b00-4bd5-9676-609b01047c67'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.341557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e0709-52c6-4f93-be1f-c4e3a4f2137a tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:06.342284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e0709-52c6-4f93-be1f-c4e3a4f2137a tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.342643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e0709-52c6-4f93-be1f-c4e3a4f2137a tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.343109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e0709-52c6-4f93-be1f-c4e3a4f2137a tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.344002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e0709-52c6-4f93-be1f-c4e3a4f2137a tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:06.344424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e0709-52c6-4f93-be1f-c4e3a4f2137a tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:06.347336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e0709-52c6-4f93-be1f-c4e3a4f2137a tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:06.349472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] The token cache is being invalidate because project 8ec5306c86e541b486255603bf57e98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:06.350797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.352413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.357290 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1001/2015] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:06 2022] DELETE /identity/v3/projects/8ec5306c86e541b486255603bf57e98d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:06.358676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:06.362230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:06.367169 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1015/2016] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:06.368316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e0709-52c6-4f93-be1f-c4e3a4f2137a tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:06.378811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ac5e0709-52c6-4f93-be1f-c4e3a4f2137a tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:06.400561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e0709-52c6-4f93-be1f-c4e3a4f2137a tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:06.473173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:06.474210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.474595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.474715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723786cd-1b00-4bd5-9676-609b01047c67 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:06.475084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] PATH_INFO: `/v3/users/b65fc42a56e94989ac471009143cb059` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.476714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65fc42a56e94989ac471009143cb059)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:06.478855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:06.480403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58872c-e953-48e2-9455-5f9a04e564d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:06.481045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58872c-e953-48e2-9455-5f9a04e564d2 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.481407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58872c-e953-48e2-9455-5f9a04e564d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.481702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58872c-e953-48e2-9455-5f9a04e564d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.482364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58872c-e953-48e2-9455-5f9a04e564d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:06.484966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58872c-e953-48e2-9455-5f9a04e564d2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:06.518353 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1002/2017] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:06 2022] POST /identity/v3/projects => generated 359 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:06.519418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58872c-e953-48e2-9455-5f9a04e564d2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:06.522838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bf58872c-e953-48e2-9455-5f9a04e564d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:06.543067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65fc42a56e94989ac471009143cb059'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.556722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65fc42a56e94989ac471009143cb059'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.557629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65fc42a56e94989ac471009143cb059'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.558387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65fc42a56e94989ac471009143cb059'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.570840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65fc42a56e94989ac471009143cb059'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.590489 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1016/2018] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:06 2022] DELETE /identity/v3/users/b65fc42a56e94989ac471009143cb059 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:06.590489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:06.590772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:06.625522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58872c-e953-48e2-9455-5f9a04e564d2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:06.687529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:06.688994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:06.706144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6f22e-d8e2-4753-baf1-aa6bc9c960bd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:06.713284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:06.714234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.714613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.714987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] PATH_INFO: `/v3/projects/db33d17d8b364b30986fc9b10f145d0d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.716323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db33d17d8b364b30986fc9b10f145d0d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:06.718928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:06.752512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0521d3-3def-4cb0-8bdd-374d91cbc815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:06.753501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0521d3-3def-4cb0-8bdd-374d91cbc815 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.753790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0521d3-3def-4cb0-8bdd-374d91cbc815 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.754065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0521d3-3def-4cb0-8bdd-374d91cbc815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.756623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-be0521d3-3def-4cb0-8bdd-374d91cbc815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:06.817757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db33d17d8b364b30986fc9b10f145d0d', 'request_id': 'req-1f8e133d-e839-4cbb-b030-4dad59940375'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.847048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db33d17d8b364b30986fc9b10f145d0d', 'request_id': 'req-1f8e133d-e839-4cbb-b030-4dad59940375'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.853903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db33d17d8b364b30986fc9b10f145d0d', 'request_id': 'req-1f8e133d-e839-4cbb-b030-4dad59940375'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.868012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] The token cache is being invalidate because project db33d17d8b364b30986fc9b10f145d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:06.868365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.869110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.870969 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1017/2019] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:06 2022] DELETE /identity/v3/projects/db33d17d8b364b30986fc9b10f145d0d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:06.872566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:06.874106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:06.876550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0521d3-3def-4cb0-8bdd-374d91cbc815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:06.878483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0521d3-3def-4cb0-8bdd-374d91cbc815 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:06.889289 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1003/2020] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:06.891260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f10fe-1ec1-43ea-918b-4d12590b928b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.891548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f10fe-1ec1-43ea-918b-4d12590b928b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.891823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f10fe-1ec1-43ea-918b-4d12590b928b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.921940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3c4f10fe-1ec1-43ea-918b-4d12590b928b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:06.923250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3c4f10fe-1ec1-43ea-918b-4d12590b928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:07.014187 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1004/2021] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:07.021934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9929fc8-9a27-41a9-a003-63398ba518fe None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.021934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9929fc8-9a27-41a9-a003-63398ba518fe None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.021934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9929fc8-9a27-41a9-a003-63398ba518fe None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.021934 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1005/2022] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:07.023518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9929fc8-9a27-41a9-a003-63398ba518fe None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.025541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b9929fc8-9a27-41a9-a003-63398ba518fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:07.039384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e133d-e839-4cbb-b030-4dad59940375 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.045425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9929fc8-9a27-41a9-a003-63398ba518fe None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.047935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7e1c1-19d3-41d4-96b7-939291dfe703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.048682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7e1c1-19d3-41d4-96b7-939291dfe703 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.049107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7e1c1-19d3-41d4-96b7-939291dfe703 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.049565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7e1c1-19d3-41d4-96b7-939291dfe703 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.050298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7e1c1-19d3-41d4-96b7-939291dfe703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.051288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.051983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.052349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.052546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7e1c1-19d3-41d4-96b7-939291dfe703 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.052752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] PATH_INFO: `/v3/projects/bf6bdda0a68d45f3a5fcdcce0d228225` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.054046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6bdda0a68d45f3a5fcdcce0d228225)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.056022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.080286 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1018/2023] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:06 2022] POST /identity/v3/users => generated 280 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:07.081641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6f905-36a9-471e-a0cf-8ccdc35e8688 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.081987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6f905-36a9-471e-a0cf-8ccdc35e8688 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.082329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6f905-36a9-471e-a0cf-8ccdc35e8688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.103769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-07f6f905-36a9-471e-a0cf-8ccdc35e8688 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:07.105388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-07f6f905-36a9-471e-a0cf-8ccdc35e8688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:07.114694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6bdda0a68d45f3a5fcdcce0d228225', 'request_id': 'req-e12c4b7a-d5ae-429c-ad73-460601a56ac9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:07.130486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6bdda0a68d45f3a5fcdcce0d228225', 'request_id': 'req-e12c4b7a-d5ae-429c-ad73-460601a56ac9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:07.132019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:07.137879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6bdda0a68d45f3a5fcdcce0d228225', 'request_id': 'req-e12c4b7a-d5ae-429c-ad73-460601a56ac9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:07.152200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] The token cache is being invalidate because project bf6bdda0a68d45f3a5fcdcce0d228225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:07.152493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:07.153155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:07.154777 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1006/2024] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:07 2022] DELETE /identity/v3/projects/bf6bdda0a68d45f3a5fcdcce0d228225 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:07.155537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:07.157523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:07.170123 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1019/2025] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:07.171023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6f905-36a9-471e-a0cf-8ccdc35e8688 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.172438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-07f6f905-36a9-471e-a0cf-8ccdc35e8688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:07.183757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6f905-36a9-471e-a0cf-8ccdc35e8688 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.188751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6171f-9e79-4d2c-bb29-2166499d4c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.189442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6171f-9e79-4d2c-bb29-2166499d4c1b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.189727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6171f-9e79-4d2c-bb29-2166499d4c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.190414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6171f-9e79-4d2c-bb29-2166499d4c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.190676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6171f-9e79-4d2c-bb29-2166499d4c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.192257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6171f-9e79-4d2c-bb29-2166499d4c1b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.203462 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1020/2026] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:07.204671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff395a0-3027-4a22-b061-04212976b4f0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.204962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff395a0-3027-4a22-b061-04212976b4f0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.205259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff395a0-3027-4a22-b061-04212976b4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.212874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:07.228056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6ff395a0-3027-4a22-b061-04212976b4f0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:07.229360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6ff395a0-3027-4a22-b061-04212976b4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:07.236009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.237293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:07.242885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1021/2027] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:07.242885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff395a0-3027-4a22-b061-04212976b4f0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.247842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff395a0-3027-4a22-b061-04212976b4f0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.252936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e6784-f196-46db-af7f-f3fd137e5b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.253552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e6784-f196-46db-af7f-f3fd137e5b1f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.253826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e6784-f196-46db-af7f-f3fd137e5b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.254092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e6784-f196-46db-af7f-f3fd137e5b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.254730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e6784-f196-46db-af7f-f3fd137e5b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:07.255028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e6784-f196-46db-af7f-f3fd137e5b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.256583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e6784-f196-46db-af7f-f3fd137e5b1f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.268546 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1022/2028] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:07.269428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e6784-f196-46db-af7f-f3fd137e5b1f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.279466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e6784-f196-46db-af7f-f3fd137e5b1f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.284122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da2e8e-256a-42df-847c-e31f03d876e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.284696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da2e8e-256a-42df-847c-e31f03d876e1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.284976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da2e8e-256a-42df-847c-e31f03d876e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.285283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da2e8e-256a-42df-847c-e31f03d876e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.285997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da2e8e-256a-42df-847c-e31f03d876e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.287538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da2e8e-256a-42df-847c-e31f03d876e1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.298872 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1023/2029] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:07.300065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c63230-9be0-4be7-b89a-b6660f05bd67 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.300348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c63230-9be0-4be7-b89a-b6660f05bd67 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.300622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c63230-9be0-4be7-b89a-b6660f05bd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.306966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c4b7a-d5ae-429c-ad73-460601a56ac9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.312473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2921c-5faf-41ec-afbb-7f7bc863ebf7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.313229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2921c-5faf-41ec-afbb-7f7bc863ebf7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.313515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2921c-5faf-41ec-afbb-7f7bc863ebf7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.313786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2921c-5faf-41ec-afbb-7f7bc863ebf7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects/19bfa19b199e4458a43ca58c00e5df1a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.314931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2921c-5faf-41ec-afbb-7f7bc863ebf7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:get_project(project_id=19bfa19b199e4458a43ca58c00e5df1a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.316956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2921c-5faf-41ec-afbb-7f7bc863ebf7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.318844 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1007/2030] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:07 2022] GET /identity/v3/projects/19bfa19b199e4458a43ca58c00e5df1a => generated 369 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:07.319514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2921c-5faf-41ec-afbb-7f7bc863ebf7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.320209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-86c63230-9be0-4be7-b89a-b6660f05bd67 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:07.321770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-86c63230-9be0-4be7-b89a-b6660f05bd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:07.330849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2921c-5faf-41ec-afbb-7f7bc863ebf7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.331537 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1024/2031] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:07.332327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c63230-9be0-4be7-b89a-b6660f05bd67 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.342744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c63230-9be0-4be7-b89a-b6660f05bd67 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.344188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cab0c-f271-4df8-836a-151fd194fc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.344880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cab0c-f271-4df8-836a-151fd194fc89 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.345297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cab0c-f271-4df8-836a-151fd194fc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.345579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cab0c-f271-4df8-836a-151fd194fc89 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.346207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cab0c-f271-4df8-836a-151fd194fc89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.347910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598bd16-16f5-4c46-861b-81d5ab3ab158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.348157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cab0c-f271-4df8-836a-151fd194fc89 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.348745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598bd16-16f5-4c46-861b-81d5ab3ab158 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.349097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598bd16-16f5-4c46-861b-81d5ab3ab158 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.349467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598bd16-16f5-4c46-861b-81d5ab3ab158 admin admin] PATH_INFO: `/v3/projects/22c66d2590b846fcb22d0a78c403c9ec/users/3f02f0933de74b49b0d71d49b57a8e3b/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.365049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598bd16-16f5-4c46-861b-81d5ab3ab158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c66d2590b846fcb22d0a78c403c9ec, user_id=3f02f0933de74b49b0d71d49b57a8e3b, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.367982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598bd16-16f5-4c46-861b-81d5ab3ab158 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.382133 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1008/2032] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:07 2022] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:07.382133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cab0c-f271-4df8-836a-151fd194fc89 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.382385 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1025/2033] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:07 2022] PUT /identity/v3/projects/22c66d2590b846fcb22d0a78c403c9ec/users/3f02f0933de74b49b0d71d49b57a8e3b/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:07.383685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3bacf-b64d-4396-aa7c-fcc3ce007c3a None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.384065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3bacf-b64d-4396-aa7c-fcc3ce007c3a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.384340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3bacf-b64d-4396-aa7c-fcc3ce007c3a None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.387535 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1026/2034] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:07.391437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3bacf-b64d-4396-aa7c-fcc3ce007c3a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.445645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cab0c-f271-4df8-836a-151fd194fc89 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.450419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8d19-ee34-4528-ae11-5940c453f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.451020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8d19-ee34-4528-ae11-5940c453f906 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.451302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8d19-ee34-4528-ae11-5940c453f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.451575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8d19-ee34-4528-ae11-5940c453f906 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.452219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8d19-ee34-4528-ae11-5940c453f906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:07.452558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8d19-ee34-4528-ae11-5940c453f906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.454177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3bacf-b64d-4396-aa7c-fcc3ce007c3a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.454319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8d19-ee34-4528-ae11-5940c453f906 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.455647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:07.459271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9650a4-2bd6-42a8-b68e-b8d4e314f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.459864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9650a4-2bd6-42a8-b68e-b8d4e314f435 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.460167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9650a4-2bd6-42a8-b68e-b8d4e314f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.460440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9650a4-2bd6-42a8-b68e-b8d4e314f435 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.461055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9650a4-2bd6-42a8-b68e-b8d4e314f435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.463051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9650a4-2bd6-42a8-b68e-b8d4e314f435 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.472539 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1009/2035] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:07.473314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8d19-ee34-4528-ae11-5940c453f906 admin admin] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:07.478810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-80ab8d19-ee34-4528-ae11-5940c453f906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:07.489229 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1027/2036] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:07 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:52:07.489229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f57523-4c7b-4a8d-933d-c97732cc0338 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.489525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f57523-4c7b-4a8d-933d-c97732cc0338 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.489791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f57523-4c7b-4a8d-933d-c97732cc0338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.516729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-87f57523-4c7b-4a8d-933d-c97732cc0338 None None] MFA Rules not processed for user `3f02f0933de74b49b0d71d49b57a8e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:07.518145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-87f57523-4c7b-4a8d-933d-c97732cc0338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:07.558567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8d19-ee34-4528-ae11-5940c453f906 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.582434 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1028/2037] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:07.583174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f57523-4c7b-4a8d-933d-c97732cc0338 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.592969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f57523-4c7b-4a8d-933d-c97732cc0338 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.598056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc287d2e-6905-456b-805a-f1be406355f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.598641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc287d2e-6905-456b-805a-f1be406355f2 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.598917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc287d2e-6905-456b-805a-f1be406355f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.599180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc287d2e-6905-456b-805a-f1be406355f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.599793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc287d2e-6905-456b-805a-f1be406355f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.601694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc287d2e-6905-456b-805a-f1be406355f2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.622553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8d19-ee34-4528-ae11-5940c453f906 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.623657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:07.628015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ee7ce-df50-4eba-8b07-5b6b18801e96 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.628923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ee7ce-df50-4eba-8b07-5b6b18801e96 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.629268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ee7ce-df50-4eba-8b07-5b6b18801e96 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.629602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ee7ce-df50-4eba-8b07-5b6b18801e96 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects/19bfa19b199e4458a43ca58c00e5df1a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.630852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ee7ce-df50-4eba-8b07-5b6b18801e96 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:get_project(project_id=19bfa19b199e4458a43ca58c00e5df1a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.635250 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1029/2038] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:07 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:07.635250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc287d2e-6905-456b-805a-f1be406355f2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.635452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ee7ce-df50-4eba-8b07-5b6b18801e96 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.636112 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1010/2039] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:07 2022] GET /identity/v3/projects/19bfa19b199e4458a43ca58c00e5df1a => generated 369 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:07.637334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ee7ce-df50-4eba-8b07-5b6b18801e96 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.658143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ee7ce-df50-4eba-8b07-5b6b18801e96 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.733930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc287d2e-6905-456b-805a-f1be406355f2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.741768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec5256-826d-42cd-91be-5ff03598f0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.742759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec5256-826d-42cd-91be-5ff03598f0da admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.743153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec5256-826d-42cd-91be-5ff03598f0da admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.743587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec5256-826d-42cd-91be-5ff03598f0da admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.744640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec5256-826d-42cd-91be-5ff03598f0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.747349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec5256-826d-42cd-91be-5ff03598f0da admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.749806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772b465-927c-4f7d-a80a-7cac1d5474cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.750715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772b465-927c-4f7d-a80a-7cac1d5474cf admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.750998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772b465-927c-4f7d-a80a-7cac1d5474cf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.751272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772b465-927c-4f7d-a80a-7cac1d5474cf admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.751898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772b465-927c-4f7d-a80a-7cac1d5474cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.753863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772b465-927c-4f7d-a80a-7cac1d5474cf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.767159 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1030/2040] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:07.767159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec5256-826d-42cd-91be-5ff03598f0da admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.777361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec5256-826d-42cd-91be-5ff03598f0da admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.783174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c03d9-582d-47db-be7f-d459172a2be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.783321 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1011/2041] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:07 2022] POST /identity/v3/projects => generated 361 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:07.784057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c03d9-582d-47db-be7f-d459172a2be0 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.784339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c03d9-582d-47db-be7f-d459172a2be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.784614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c03d9-582d-47db-be7f-d459172a2be0 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.785275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c03d9-582d-47db-be7f-d459172a2be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.786633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2dc62-b902-4e38-a7a4-d1a8f5c2fbf1 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.787045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2dc62-b902-4e38-a7a4-d1a8f5c2fbf1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.787215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c03d9-582d-47db-be7f-d459172a2be0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.787309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2dc62-b902-4e38-a7a4-d1a8f5c2fbf1 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.789389 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1012/2042] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:07.790171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2dc62-b902-4e38-a7a4-d1a8f5c2fbf1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.810024 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1031/2043] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:07 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:07.810654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:07.810813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c03d9-582d-47db-be7f-d459172a2be0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.823362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c03d9-582d-47db-be7f-d459172a2be0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.859500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2dc62-b902-4e38-a7a4-d1a8f5c2fbf1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.864564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4988d7-7858-4f42-b0e1-938830fab8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.865317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4988d7-7858-4f42-b0e1-938830fab8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.865732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4988d7-7858-4f42-b0e1-938830fab8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.866118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4988d7-7858-4f42-b0e1-938830fab8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.866906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4988d7-7858-4f42-b0e1-938830fab8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.868577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4988d7-7858-4f42-b0e1-938830fab8b2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.879816 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1013/2044] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:07.880766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4988d7-7858-4f42-b0e1-938830fab8b2 admin admin] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:07.888800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4369a9-461a-41a6-8d76-5a6d90b190e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.889451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4369a9-461a-41a6-8d76-5a6d90b190e3 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.889734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4369a9-461a-41a6-8d76-5a6d90b190e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.890017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4369a9-461a-41a6-8d76-5a6d90b190e3 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.891222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4369a9-461a-41a6-8d76-5a6d90b190e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.893140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4369a9-461a-41a6-8d76-5a6d90b190e3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.917316 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1032/2045] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:07 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:07.918140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4369a9-461a-41a6-8d76-5a6d90b190e3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.928207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4369a9-461a-41a6-8d76-5a6d90b190e3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.932990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf22172-91f3-4e88-9bd8-f3c97f2692d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.933619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf22172-91f3-4e88-9bd8-f3c97f2692d2 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.933889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf22172-91f3-4e88-9bd8-f3c97f2692d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.934162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf22172-91f3-4e88-9bd8-f3c97f2692d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.934852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf22172-91f3-4e88-9bd8-f3c97f2692d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.936428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf22172-91f3-4e88-9bd8-f3c97f2692d2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.948293 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1033/2046] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:07.949087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf22172-91f3-4e88-9bd8-f3c97f2692d2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.960280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf22172-91f3-4e88-9bd8-f3c97f2692d2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.964979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e88095-9f5a-4682-8bee-4d39cb540c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.966433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88095-9f5a-4682-8bee-4d39cb540c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.966790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88095-9f5a-4682-8bee-4d39cb540c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.967200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88095-9f5a-4682-8bee-4d39cb540c42 admin admin] PATH_INFO: `/v3/projects/0945c84b75684f219c7b50ebb4a009ee/users/1dd0cdd95d29481faae2b41262b5585c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.974397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4988d7-7858-4f42-b0e1-938830fab8b2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.983610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e88095-9f5a-4682-8bee-4d39cb540c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0945c84b75684f219c7b50ebb4a009ee, user_id=1dd0cdd95d29481faae2b41262b5585c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.986755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e88095-9f5a-4682-8bee-4d39cb540c42 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:08.002082 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1034/2047] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:07 2022] PUT /identity/v3/projects/0945c84b75684f219c7b50ebb4a009ee/users/1dd0cdd95d29481faae2b41262b5585c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:08.002815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e88095-9f5a-4682-8bee-4d39cb540c42 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:08.043045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:08.050714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4988d7-7858-4f42-b0e1-938830fab8b2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:08.075526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e88095-9f5a-4682-8bee-4d39cb540c42 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:08.080478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbebfb-da61-48e8-9318-acbdc2813266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:08.081102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbebfb-da61-48e8-9318-acbdc2813266 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.081423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbebfb-da61-48e8-9318-acbdc2813266 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.081696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbebfb-da61-48e8-9318-acbdc2813266 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.082332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbebfb-da61-48e8-9318-acbdc2813266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:08.083973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbebfb-da61-48e8-9318-acbdc2813266 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:08.094307 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1035/2048] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:08.095116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbebfb-da61-48e8-9318-acbdc2813266 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:08.101829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:08.105993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbebfb-da61-48e8-9318-acbdc2813266 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:08.111823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de6b3d-e0e3-4d6b-bde3-336cdec5ef3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:08.112498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de6b3d-e0e3-4d6b-bde3-336cdec5ef3a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.112728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d35ec-c791-4a46-b675-0ea8ba9d7436 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:08.112903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de6b3d-e0e3-4d6b-bde3-336cdec5ef3a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.113258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de6b3d-e0e3-4d6b-bde3-336cdec5ef3a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.113410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d35ec-c791-4a46-b675-0ea8ba9d7436 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.113667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d35ec-c791-4a46-b675-0ea8ba9d7436 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.113942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d35ec-c791-4a46-b675-0ea8ba9d7436 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects/19bfa19b199e4458a43ca58c00e5df1a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.114147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de6b3d-e0e3-4d6b-bde3-336cdec5ef3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:08.115110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d35ec-c791-4a46-b675-0ea8ba9d7436 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:get_project(project_id=19bfa19b199e4458a43ca58c00e5df1a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:08.115862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de6b3d-e0e3-4d6b-bde3-336cdec5ef3a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:08.117153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d35ec-c791-4a46-b675-0ea8ba9d7436 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:08.118837 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1014/2049] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:07 2022] GET /identity/v3/projects/19bfa19b199e4458a43ca58c00e5df1a => generated 369 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:08.119996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617aa84-abd9-4b12-94ac-1eaefc8e3d38 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.120272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617aa84-abd9-4b12-94ac-1eaefc8e3d38 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.120544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617aa84-abd9-4b12-94ac-1eaefc8e3d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.130665 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1036/2050] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:08.130665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de6b3d-e0e3-4d6b-bde3-336cdec5ef3a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:08.158655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de6b3d-e0e3-4d6b-bde3-336cdec5ef3a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:08.166084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379896e-55b9-4d5f-b725-0d629a6fd204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:08.167011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379896e-55b9-4d5f-b725-0d629a6fd204 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.167308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0617aa84-abd9-4b12-94ac-1eaefc8e3d38 None None] MFA Rules not processed for user `1dd0cdd95d29481faae2b41262b5585c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:08.167464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379896e-55b9-4d5f-b725-0d629a6fd204 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.167835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379896e-55b9-4d5f-b725-0d629a6fd204 admin admin] PATH_INFO: `/v3/projects/6c2fcd31ca4d4f849a624fc7a6632c9e/users/d4ef7c1f545d46848adde1dd0ffc3baa/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.168547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0617aa84-abd9-4b12-94ac-1eaefc8e3d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:08.187666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379896e-55b9-4d5f-b725-0d629a6fd204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2fcd31ca4d4f849a624fc7a6632c9e, user_id=d4ef7c1f545d46848adde1dd0ffc3baa, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:08.191089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379896e-55b9-4d5f-b725-0d629a6fd204 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:08.216542 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1037/2051] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:08 2022] PUT /identity/v3/projects/6c2fcd31ca4d4f849a624fc7a6632c9e/users/d4ef7c1f545d46848adde1dd0ffc3baa/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:08.217805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379896e-55b9-4d5f-b725-0d629a6fd204 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:08.295077 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1015/2052] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:08.296468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617aa84-abd9-4b12-94ac-1eaefc8e3d38 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:08.307126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379896e-55b9-4d5f-b725-0d629a6fd204 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:08.307883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617aa84-abd9-4b12-94ac-1eaefc8e3d38 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:08.315734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42400de8-ace1-41ae-8908-5a09d3a580d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:08.316410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400de8-ace1-41ae-8908-5a09d3a580d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.316686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400de8-ace1-41ae-8908-5a09d3a580d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.316985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400de8-ace1-41ae-8908-5a09d3a580d2 admin admin] PATH_INFO: `/v3/projects/38dc8dd1b8ac461bbd49c39e660b4750/users/62cce2c01e8f40579463e3e9120659cf/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.337555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42400de8-ace1-41ae-8908-5a09d3a580d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38dc8dd1b8ac461bbd49c39e660b4750, user_id=62cce2c01e8f40579463e3e9120659cf, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:08.339290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42400de8-ace1-41ae-8908-5a09d3a580d2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:08.362047 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1038/2053] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:08 2022] PUT /identity/v3/projects/38dc8dd1b8ac461bbd49c39e660b4750/users/62cce2c01e8f40579463e3e9120659cf/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:08.362627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42400de8-ace1-41ae-8908-5a09d3a580d2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:08.403713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:08.405593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.406149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.407029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects/19bfa19b199e4458a43ca58c00e5df1a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.408493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:delete_project(project_id=19bfa19b199e4458a43ca58c00e5df1a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:08.411938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:08.458894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42400de8-ace1-41ae-8908-5a09d3a580d2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:08.464060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7442c67-2887-47ae-9e43-8e3644c4177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:08.465793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7442c67-2887-47ae-9e43-8e3644c4177a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.465793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7442c67-2887-47ae-9e43-8e3644c4177a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.465793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7442c67-2887-47ae-9e43-8e3644c4177a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.466069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7442c67-2887-47ae-9e43-8e3644c4177a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:08.467750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7442c67-2887-47ae-9e43-8e3644c4177a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:08.484608 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1039/2054] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:08.485919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7442c67-2887-47ae-9e43-8e3644c4177a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:08.499319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7442c67-2887-47ae-9e43-8e3644c4177a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:08.512784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19bfa19b199e4458a43ca58c00e5df1a', 'request_id': 'req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:08.518956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:08.525330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19bfa19b199e4458a43ca58c00e5df1a', 'request_id': 'req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:08.531774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19bfa19b199e4458a43ca58c00e5df1a', 'request_id': 'req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:08.543473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] The token cache is being invalidate because project 19bfa19b199e4458a43ca58c00e5df1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:08.543765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:08.544441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-55bc5be4-fce4-4724-a30e-e9fbedbb6e8e tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:08.546009 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1016/2055] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:08 2022] DELETE /identity/v3/projects/19bfa19b199e4458a43ca58c00e5df1a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:08.548056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ad341-bd23-43c0-a3bd-82afb931364e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.548342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ad341-bd23-43c0-a3bd-82afb931364e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.548620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ad341-bd23-43c0-a3bd-82afb931364e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.576225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d08821-bacf-432e-9f21-1feb9603739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:08.576841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d08821-bacf-432e-9f21-1feb9603739e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.577119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d08821-bacf-432e-9f21-1feb9603739e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.577427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d08821-bacf-432e-9f21-1feb9603739e admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.578130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d08821-bacf-432e-9f21-1feb9603739e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:08.579252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d13ad341-bd23-43c0-a3bd-82afb931364e None None] MFA Rules not processed for user `62cce2c01e8f40579463e3e9120659cf`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:08.580018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d08821-bacf-432e-9f21-1feb9603739e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:08.580476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d13ad341-bd23-43c0-a3bd-82afb931364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:08.584532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:08.608449 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1040/2056] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:08 2022] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:08.610054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d08821-bacf-432e-9f21-1feb9603739e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:08.612022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-17d08821-bacf-432e-9f21-1feb9603739e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:08.650454 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1017/2057] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:08.651630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c79e9-2fa2-48db-8050-5bf1c54d3c2f None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.651915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c79e9-2fa2-48db-8050-5bf1c54d3c2f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.652187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c79e9-2fa2-48db-8050-5bf1c54d3c2f None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.653429 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1018/2058] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:08.654802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c79e9-2fa2-48db-8050-5bf1c54d3c2f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:08.657598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3c6c79e9-2fa2-48db-8050-5bf1c54d3c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:08.687014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d08821-bacf-432e-9f21-1feb9603739e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:08.692320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559da75-2a3e-41c2-9396-18d63c477e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:08.692979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559da75-2a3e-41c2-9396-18d63c477e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.693281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559da75-2a3e-41c2-9396-18d63c477e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.693548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559da75-2a3e-41c2-9396-18d63c477e3a admin admin] PATH_INFO: `/v3/projects/6c2fcd31ca4d4f849a624fc7a6632c9e/users/d4ef7c1f545d46848adde1dd0ffc3baa/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.695481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559da75-2a3e-41c2-9396-18d63c477e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2fcd31ca4d4f849a624fc7a6632c9e, user_id=d4ef7c1f545d46848adde1dd0ffc3baa, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:08.698209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559da75-2a3e-41c2-9396-18d63c477e3a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:08.708748 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1041/2059] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:08 2022] PUT /identity/v3/projects/6c2fcd31ca4d4f849a624fc7a6632c9e/users/d4ef7c1f545d46848adde1dd0ffc3baa/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:08.709537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559da75-2a3e-41c2-9396-18d63c477e3a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:08.711079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f559da75-2a3e-41c2-9396-18d63c477e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:08.736345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c79e9-2fa2-48db-8050-5bf1c54d3c2f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:08.776566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559da75-2a3e-41c2-9396-18d63c477e3a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:08.782639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4e7e-5da0-44aa-b75b-eef8434b6d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:08.783240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4e7e-5da0-44aa-b75b-eef8434b6d4d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.783521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4e7e-5da0-44aa-b75b-eef8434b6d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.783798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4e7e-5da0-44aa-b75b-eef8434b6d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.784428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c4e7e-5da0-44aa-b75b-eef8434b6d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:08.786365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c4e7e-5da0-44aa-b75b-eef8434b6d4d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:08.794235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b0e4f-ee98-48d0-beb4-03bdecbae0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:08.794911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b0e4f-ee98-48d0-beb4-03bdecbae0df admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.795266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b0e4f-ee98-48d0-beb4-03bdecbae0df admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.795603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b0e4f-ee98-48d0-beb4-03bdecbae0df admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.796298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b0e4f-ee98-48d0-beb4-03bdecbae0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:08.798746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b0e4f-ee98-48d0-beb4-03bdecbae0df admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:08.814188 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1042/2060] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:08 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:08.815296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4e7e-5da0-44aa-b75b-eef8434b6d4d admin admin] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:08.816851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-845c4e7e-5da0-44aa-b75b-eef8434b6d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:08.823193 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1019/2061] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:08 2022] POST /identity/v3/users => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:08.827562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5667f-dcf2-4ed4-bcef-23f100c2a5ea None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.828177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5667f-dcf2-4ed4-bcef-23f100c2a5ea None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.828454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5667f-dcf2-4ed4-bcef-23f100c2a5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.836013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:08.858090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-27e5667f-dcf2-4ed4-bcef-23f100c2a5ea None None] MFA Rules not processed for user `d4ef7c1f545d46848adde1dd0ffc3baa`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:08.859912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-27e5667f-dcf2-4ed4-bcef-23f100c2a5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:08.891390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:08.902413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4e7e-5da0-44aa-b75b-eef8434b6d4d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:08.904003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-845c4e7e-5da0-44aa-b75b-eef8434b6d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:08.934322 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1020/2062] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:08.935151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5667f-dcf2-4ed4-bcef-23f100c2a5ea None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:08.969889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4e7e-5da0-44aa-b75b-eef8434b6d4d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:08.974701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628438e6-dc6f-4e53-b467-625763d81431 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:08.975328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628438e6-dc6f-4e53-b467-625763d81431 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:08.975607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628438e6-dc6f-4e53-b467-625763d81431 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:08.975875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628438e6-dc6f-4e53-b467-625763d81431 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects/fc20782544f24eb3a49a037ef01e1f8f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:08.977085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628438e6-dc6f-4e53-b467-625763d81431 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:get_project(project_id=fc20782544f24eb3a49a037ef01e1f8f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:08.979246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628438e6-dc6f-4e53-b467-625763d81431 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:08.981043 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1043/2063] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:08 2022] GET /identity/v3/projects/fc20782544f24eb3a49a037ef01e1f8f => generated 373 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:08.981785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628438e6-dc6f-4e53-b467-625763d81431 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.000537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5667f-dcf2-4ed4-bcef-23f100c2a5ea None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.005710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb25a9-1e46-4319-a86a-fa9b24be0d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.006415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb25a9-1e46-4319-a86a-fa9b24be0d60 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.006701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb25a9-1e46-4319-a86a-fa9b24be0d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.006977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb25a9-1e46-4319-a86a-fa9b24be0d60 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.007613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb25a9-1e46-4319-a86a-fa9b24be0d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.009598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb25a9-1e46-4319-a86a-fa9b24be0d60 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.034963 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1021/2064] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:08 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:09.034963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb25a9-1e46-4319-a86a-fa9b24be0d60 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.035225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8cfb25a9-1e46-4319-a86a-fa9b24be0d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:09.048867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628438e6-dc6f-4e53-b467-625763d81431 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.051068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb25a9-1e46-4319-a86a-fa9b24be0d60 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.053524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5534a5d-9fc9-4176-a501-b7f095cd15ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.054151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5534a5d-9fc9-4176-a501-b7f095cd15ba admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.054428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5534a5d-9fc9-4176-a501-b7f095cd15ba admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.054699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5534a5d-9fc9-4176-a501-b7f095cd15ba admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.056439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5534a5d-9fc9-4176-a501-b7f095cd15ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.056545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8c0c0-30b5-440d-8fe0-655278e6e033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.057060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8c0c0-30b5-440d-8fe0-655278e6e033 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.057166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5534a5d-9fc9-4176-a501-b7f095cd15ba admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.057376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8c0c0-30b5-440d-8fe0-655278e6e033 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.057641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8c0c0-30b5-440d-8fe0-655278e6e033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.066404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8c0c0-30b5-440d-8fe0-655278e6e033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.070449 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1044/2065] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:09.070449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5534a5d-9fc9-4176-a501-b7f095cd15ba admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.070755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8c0c0-30b5-440d-8fe0-655278e6e033 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.081116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5534a5d-9fc9-4176-a501-b7f095cd15ba admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.081429 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1022/2066] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:09.082185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8c0c0-30b5-440d-8fe0-655278e6e033 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.086282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19476e7-8a17-4924-9196-a9c744c4ea41 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.086994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19476e7-8a17-4924-9196-a9c744c4ea41 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.087377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19476e7-8a17-4924-9196-a9c744c4ea41 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.087756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19476e7-8a17-4924-9196-a9c744c4ea41 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.088531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19476e7-8a17-4924-9196-a9c744c4ea41 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:09.088944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19476e7-8a17-4924-9196-a9c744c4ea41 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.090678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19476e7-8a17-4924-9196-a9c744c4ea41 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.092953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8c0c0-30b5-440d-8fe0-655278e6e033 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.098861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3d3e3-1e46-46c5-a847-c6f339917e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.099505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3d3e3-1e46-46c5-a847-c6f339917e8b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.099724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3d3e3-1e46-46c5-a847-c6f339917e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.100002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3d3e3-1e46-46c5-a847-c6f339917e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.100641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3d3e3-1e46-46c5-a847-c6f339917e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.102239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3d3e3-1e46-46c5-a847-c6f339917e8b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.105796 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1045/2067] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:09.106715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19476e7-8a17-4924-9196-a9c744c4ea41 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.117726 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1023/2068] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:09.119168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3d3e3-1e46-46c5-a847-c6f339917e8b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.119567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19476e7-8a17-4924-9196-a9c744c4ea41 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.124528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e88f1-ca83-4a38-a3b8-5bc68c2840b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.125394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e88f1-ca83-4a38-a3b8-5bc68c2840b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.125772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e88f1-ca83-4a38-a3b8-5bc68c2840b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.126197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e88f1-ca83-4a38-a3b8-5bc68c2840b8 admin admin] PATH_INFO: `/v3/projects/7cb6f1a170084c72a1ef608cdeb3a2aa/users/a73f9036025641368e51b62cb6e691b6/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.133912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3d3e3-1e46-46c5-a847-c6f339917e8b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.138768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17311959-9f08-41b4-b712-8aaa26051ab5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.139488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311959-9f08-41b4-b712-8aaa26051ab5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.139768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311959-9f08-41b4-b712-8aaa26051ab5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.140557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311959-9f08-41b4-b712-8aaa26051ab5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.141353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17311959-9f08-41b4-b712-8aaa26051ab5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.143735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17311959-9f08-41b4-b712-8aaa26051ab5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.144870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e88f1-ca83-4a38-a3b8-5bc68c2840b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb6f1a170084c72a1ef608cdeb3a2aa, user_id=a73f9036025641368e51b62cb6e691b6, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.148303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e88f1-ca83-4a38-a3b8-5bc68c2840b8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.169008 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1046/2069] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:09 2022] PUT /identity/v3/projects/7cb6f1a170084c72a1ef608cdeb3a2aa/users/a73f9036025641368e51b62cb6e691b6/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:09.169008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e88f1-ca83-4a38-a3b8-5bc68c2840b8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.183957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:09.185235 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1024/2070] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:09 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:09.190958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17311959-9f08-41b4-b712-8aaa26051ab5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.244077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e88f1-ca83-4a38-a3b8-5bc68c2840b8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.290996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17311959-9f08-41b4-b712-8aaa26051ab5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.296656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87dc3c-aada-4e36-be76-ca504606849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.297469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87dc3c-aada-4e36-be76-ca504606849c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.297756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87dc3c-aada-4e36-be76-ca504606849c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.298032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87dc3c-aada-4e36-be76-ca504606849c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.298750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87dc3c-aada-4e36-be76-ca504606849c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.301884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87dc3c-aada-4e36-be76-ca504606849c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.313609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e047-59d3-4690-916c-7185b4d9a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.317505 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1025/2071] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:09.317666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e047-59d3-4690-916c-7185b4d9a267 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.317666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e047-59d3-4690-916c-7185b4d9a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.317666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e047-59d3-4690-916c-7185b4d9a267 admin admin] PATH_INFO: `/v3/projects/46499d6ac6d547a8b00ed75b08f7875a/users/fd477f1563fc49deb10ab71192150d87/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.317918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87dc3c-aada-4e36-be76-ca504606849c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.326077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:09.338399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255e047-59d3-4690-916c-7185b4d9a267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46499d6ac6d547a8b00ed75b08f7875a, user_id=fd477f1563fc49deb10ab71192150d87, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.342973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255e047-59d3-4690-916c-7185b4d9a267 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.364118 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1047/2072] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:09 2022] PUT /identity/v3/projects/46499d6ac6d547a8b00ed75b08f7875a/users/fd477f1563fc49deb10ab71192150d87/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:09.367202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e047-59d3-4690-916c-7185b4d9a267 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.399030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87dc3c-aada-4e36-be76-ca504606849c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.447049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e047-59d3-4690-916c-7185b4d9a267 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.453668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774e482-283c-4063-80fb-c9df6ec8dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.454428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774e482-283c-4063-80fb-c9df6ec8dc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.454784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774e482-283c-4063-80fb-c9df6ec8dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.455136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774e482-283c-4063-80fb-c9df6ec8dc87 admin admin] PATH_INFO: `/v3/projects/7cb6f1a170084c72a1ef608cdeb3a2aa/users/a73f9036025641368e51b62cb6e691b6/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.457443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774e482-283c-4063-80fb-c9df6ec8dc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb6f1a170084c72a1ef608cdeb3a2aa, user_id=a73f9036025641368e51b62cb6e691b6, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.460492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774e482-283c-4063-80fb-c9df6ec8dc87 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.473546 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1048/2073] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:09 2022] PUT /identity/v3/projects/7cb6f1a170084c72a1ef608cdeb3a2aa/users/a73f9036025641368e51b62cb6e691b6/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:09.474558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774e482-283c-4063-80fb-c9df6ec8dc87 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.496410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da0959-9bf3-49f4-ae54-e53357ebd517 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.498143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da0959-9bf3-49f4-ae54-e53357ebd517 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.498780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da0959-9bf3-49f4-ae54-e53357ebd517 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.499901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da0959-9bf3-49f4-ae54-e53357ebd517 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.500890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da0959-9bf3-49f4-ae54-e53357ebd517 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:09.501750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da0959-9bf3-49f4-ae54-e53357ebd517 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.503502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da0959-9bf3-49f4-ae54-e53357ebd517 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.537872 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1026/2074] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:09.537872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c097d0f-8489-4244-bb3e-0a12185ef9ac None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.537872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c097d0f-8489-4244-bb3e-0a12185ef9ac None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.537872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c097d0f-8489-4244-bb3e-0a12185ef9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.540350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:09.582251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774e482-283c-4063-80fb-c9df6ec8dc87 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.582922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9c097d0f-8489-4244-bb3e-0a12185ef9ac None None] MFA Rules not processed for user `a73f9036025641368e51b62cb6e691b6`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:09.584179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9c097d0f-8489-4244-bb3e-0a12185ef9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:09.589106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c04f2a-3a89-49c6-a768-57f047f2ae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.590865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c04f2a-3a89-49c6-a768-57f047f2ae52 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.591493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c04f2a-3a89-49c6-a768-57f047f2ae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.592108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c04f2a-3a89-49c6-a768-57f047f2ae52 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.593851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c04f2a-3a89-49c6-a768-57f047f2ae52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.596440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c04f2a-3a89-49c6-a768-57f047f2ae52 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.609345 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1049/2075] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:09.613566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c04f2a-3a89-49c6-a768-57f047f2ae52 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.626266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c04f2a-3a89-49c6-a768-57f047f2ae52 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.632359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001f90d-2d3e-4033-9931-e7dd23c60796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.633573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001f90d-2d3e-4033-9931-e7dd23c60796 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.633968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001f90d-2d3e-4033-9931-e7dd23c60796 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.634624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001f90d-2d3e-4033-9931-e7dd23c60796 admin admin] PATH_INFO: `/v3/projects/46499d6ac6d547a8b00ed75b08f7875a/users/fd477f1563fc49deb10ab71192150d87/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.639249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001f90d-2d3e-4033-9931-e7dd23c60796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46499d6ac6d547a8b00ed75b08f7875a, user_id=fd477f1563fc49deb10ab71192150d87, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.643153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001f90d-2d3e-4033-9931-e7dd23c60796 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.655597 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1050/2076] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:09 2022] PUT /identity/v3/projects/46499d6ac6d547a8b00ed75b08f7875a/users/fd477f1563fc49deb10ab71192150d87/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:09.670636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58de32-771a-42d8-965b-cf3980c05c8a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.676560 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1027/2077] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:09.677928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58de32-771a-42d8-965b-cf3980c05c8a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.678410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58de32-771a-42d8-965b-cf3980c05c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.689272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e07e6d-0f2d-4c2c-a915-f329811af6fc None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.689497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e07e6d-0f2d-4c2c-a915-f329811af6fc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.690543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e07e6d-0f2d-4c2c-a915-f329811af6fc None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.692601 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1028/2078] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:09.698063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e07e6d-0f2d-4c2c-a915-f329811af6fc None None] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:09.713558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-db58de32-771a-42d8-965b-cf3980c05c8a None None] MFA Rules not processed for user `fd477f1563fc49deb10ab71192150d87`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:09.714782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-db58de32-771a-42d8-965b-cf3980c05c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:09.748750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:09.792539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e07e6d-0f2d-4c2c-a915-f329811af6fc None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.797030 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1051/2079] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:09.857179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e07e6d-0f2d-4c2c-a915-f329811af6fc None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.862670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18b369-a2ec-4360-9f9b-4a43bbd71ac2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.863298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18b369-a2ec-4360-9f9b-4a43bbd71ac2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.863580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18b369-a2ec-4360-9f9b-4a43bbd71ac2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.863877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18b369-a2ec-4360-9f9b-4a43bbd71ac2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects/f37ffeaad9bb496e85255e18cdd81a57` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.864996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18b369-a2ec-4360-9f9b-4a43bbd71ac2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:get_project(project_id=f37ffeaad9bb496e85255e18cdd81a57)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:09.867070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18b369-a2ec-4360-9f9b-4a43bbd71ac2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:09.868707 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1029/2080] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:09 2022] GET /identity/v3/projects/f37ffeaad9bb496e85255e18cdd81a57 => generated 371 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:52:09.926074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58de32-771a-42d8-965b-cf3980c05c8a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.927283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18b369-a2ec-4360-9f9b-4a43bbd71ac2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:09.941994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18b369-a2ec-4360-9f9b-4a43bbd71ac2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:09.948053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef34bc8-5053-4d13-8856-28964107011a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:09.948649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34bc8-5053-4d13-8856-28964107011a service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:09.948943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34bc8-5053-4d13-8856-28964107011a service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:09.949204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34bc8-5053-4d13-8856-28964107011a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:09.951106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eef34bc8-5053-4d13-8856-28964107011a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:10.005060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58de32-771a-42d8-965b-cf3980c05c8a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:10.009855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:10.010661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:10.010920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:10.011266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] PATH_INFO: `/v3/users/3f02f0933de74b49b0d71d49b57a8e3b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:10.012476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f02f0933de74b49b0d71d49b57a8e3b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:10.014490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:10.014608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef34bc8-5053-4d13-8856-28964107011a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:10.016762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef34bc8-5053-4d13-8856-28964107011a service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:10.026215 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1030/2081] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:10.064273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:10.067007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f02f0933de74b49b0d71d49b57a8e3b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:10.078483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f02f0933de74b49b0d71d49b57a8e3b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:10.079560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f02f0933de74b49b0d71d49b57a8e3b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:10.080558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f02f0933de74b49b0d71d49b57a8e3b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:10.098514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f02f0933de74b49b0d71d49b57a8e3b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:10.119383 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1052/2082] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:09 2022] DELETE /identity/v3/users/3f02f0933de74b49b0d71d49b57a8e3b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:10.124442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f59fd-f12d-4eda-a05a-c4924edd2a77 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:10.124978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f59fd-f12d-4eda-a05a-c4924edd2a77 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:10.125348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f59fd-f12d-4eda-a05a-c4924edd2a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:10.130267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:10.132122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:10.147014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c19f59fd-f12d-4eda-a05a-c4924edd2a77 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:10.148496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c19f59fd-f12d-4eda-a05a-c4924edd2a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:10.212564 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1031/2083] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:10.226482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50997fd-213d-4b62-b284-a664a35d4434 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:10.226674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f59fd-f12d-4eda-a05a-c4924edd2a77 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:10.228203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c19f59fd-f12d-4eda-a05a-c4924edd2a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:10.233544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2f996-ce76-4f12-af1a-25101b9bc796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:10.235077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2f996-ce76-4f12-af1a-25101b9bc796 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:10.235077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2f996-ce76-4f12-af1a-25101b9bc796 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:10.235553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2f996-ce76-4f12-af1a-25101b9bc796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:10.237468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-93e2f996-ce76-4f12-af1a-25101b9bc796 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:10.256120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:10.319507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2f996-ce76-4f12-af1a-25101b9bc796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:10.323107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2f996-ce76-4f12-af1a-25101b9bc796 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:10.324030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f59fd-f12d-4eda-a05a-c4924edd2a77 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:10.329848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f621e-e576-4819-a70f-7a4013af63e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:10.331272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f621e-e576-4819-a70f-7a4013af63e8 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:10.331617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f621e-e576-4819-a70f-7a4013af63e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:10.331955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f621e-e576-4819-a70f-7a4013af63e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:10.336167 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1053/2084] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:10.355830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d090a-6468-44e8-8e90-1e235fbba095 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:10.356113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d090a-6468-44e8-8e90-1e235fbba095 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:10.356385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d090a-6468-44e8-8e90-1e235fbba095 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:10.358015 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1054/2085] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:10.365656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d090a-6468-44e8-8e90-1e235fbba095 None None] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:10.367923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-354d090a-6468-44e8-8e90-1e235fbba095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:10.371217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f621e-e576-4819-a70f-7a4013af63e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:10.373552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f621e-e576-4819-a70f-7a4013af63e8 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:10.394377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d090a-6468-44e8-8e90-1e235fbba095 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:10.395072 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1032/2086] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:52:10.396403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-354d090a-6468-44e8-8e90-1e235fbba095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:10.460740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:10.494692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d090a-6468-44e8-8e90-1e235fbba095 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:10.499349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793d331-ecf6-4194-9357-9eedb83ba73b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:10.500022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793d331-ecf6-4194-9357-9eedb83ba73b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:10.500301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793d331-ecf6-4194-9357-9eedb83ba73b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:10.500573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793d331-ecf6-4194-9357-9eedb83ba73b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects/f37ffeaad9bb496e85255e18cdd81a57` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:10.501726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793d331-ecf6-4194-9357-9eedb83ba73b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:get_project(project_id=f37ffeaad9bb496e85255e18cdd81a57)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:10.503765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793d331-ecf6-4194-9357-9eedb83ba73b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:10.505603 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1055/2087] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:10 2022] GET /identity/v3/projects/f37ffeaad9bb496e85255e18cdd81a57 => generated 371 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:52:10.554530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f621e-e576-4819-a70f-7a4013af63e8 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:10.565820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f621e-e576-4819-a70f-7a4013af63e8 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:10.573716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3bee0-2bff-4e49-8b40-07b964d337b9 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:10.574419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3bee0-2bff-4e49-8b40-07b964d337b9 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:10.574732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3bee0-2bff-4e49-8b40-07b964d337b9 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:10.575042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3bee0-2bff-4e49-8b40-07b964d337b9 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:10.575865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3bee0-2bff-4e49-8b40-07b964d337b9 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:10.576666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3bee0-2bff-4e49-8b40-07b964d337b9 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:10.578369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3bee0-2bff-4e49-8b40-07b964d337b9 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:10.593671 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1033/2088] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:10.597028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793d331-ecf6-4194-9357-9eedb83ba73b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:10.607397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793d331-ecf6-4194-9357-9eedb83ba73b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:10.613020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19711f-eb29-4cae-b724-d025ed2195c5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:10.613681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19711f-eb29-4cae-b724-d025ed2195c5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:10.613958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19711f-eb29-4cae-b724-d025ed2195c5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:10.614243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19711f-eb29-4cae-b724-d025ed2195c5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:10.614892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19711f-eb29-4cae-b724-d025ed2195c5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:10.616977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19711f-eb29-4cae-b724-d025ed2195c5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:10.652907 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1056/2089] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:10 2022] POST /identity/v3/users => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:10.658348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3bee0-2bff-4e49-8b40-07b964d337b9 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:10.677769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3bee0-2bff-4e49-8b40-07b964d337b9 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:10.683716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830e959-b157-4889-80a4-9f4349d72f97 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:10.684395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830e959-b157-4889-80a4-9f4349d72f97 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:10.684687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830e959-b157-4889-80a4-9f4349d72f97 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:10.684966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830e959-b157-4889-80a4-9f4349d72f97 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:10.685689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830e959-b157-4889-80a4-9f4349d72f97 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:10.686002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830e959-b157-4889-80a4-9f4349d72f97 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:10.687692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830e959-b157-4889-80a4-9f4349d72f97 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:10.706940 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1034/2090] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:10.765912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dab58-30a8-4307-8a15-b1a8f87497d1 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:10.766268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dab58-30a8-4307-8a15-b1a8f87497d1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:10.766552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dab58-30a8-4307-8a15-b1a8f87497d1 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:10.768302 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1057/2091] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:52:10.773653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830e959-b157-4889-80a4-9f4349d72f97 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:10.789956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830e959-b157-4889-80a4-9f4349d72f97 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:10.798127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dab58-30a8-4307-8a15-b1a8f87497d1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:10.800288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-047dab58-30a8-4307-8a15-b1a8f87497d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:10.801802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830e959-b157-4889-80a4-9f4349d72f97 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:10.807414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dacc50-391a-401a-86f5-56dc7c9d05d7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:10.808158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dacc50-391a-401a-86f5-56dc7c9d05d7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:10.808630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dacc50-391a-401a-86f5-56dc7c9d05d7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:10.808981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dacc50-391a-401a-86f5-56dc7c9d05d7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects/f37ffeaad9bb496e85255e18cdd81a57` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:10.810494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dacc50-391a-401a-86f5-56dc7c9d05d7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:get_project(project_id=f37ffeaad9bb496e85255e18cdd81a57)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:10.813635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dacc50-391a-401a-86f5-56dc7c9d05d7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:10.817300 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1035/2092] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:10 2022] GET /identity/v3/projects/f37ffeaad9bb496e85255e18cdd81a57 => generated 371 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:10.817907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dab58-30a8-4307-8a15-b1a8f87497d1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:10.818811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dacc50-391a-401a-86f5-56dc7c9d05d7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:10.823435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:10.824074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:10.824353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:10.824624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] PATH_INFO: `/v3/projects/22c66d2590b846fcb22d0a78c403c9ec` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:10.825781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c66d2590b846fcb22d0a78c403c9ec)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:10.829822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:10.840027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dacc50-391a-401a-86f5-56dc7c9d05d7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:10.849325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af03bae-2507-4ac5-8d2b-3313226c5b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:10.849936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af03bae-2507-4ac5-8d2b-3313226c5b69 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:10.850217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af03bae-2507-4ac5-8d2b-3313226c5b69 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:10.850492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af03bae-2507-4ac5-8d2b-3313226c5b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:10.852321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7af03bae-2507-4ac5-8d2b-3313226c5b69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:10.889174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c66d2590b846fcb22d0a78c403c9ec', 'request_id': 'req-59a42669-26b8-4997-9bee-88007949b6cf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:10.901741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c66d2590b846fcb22d0a78c403c9ec', 'request_id': 'req-59a42669-26b8-4997-9bee-88007949b6cf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:10.909811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c66d2590b846fcb22d0a78c403c9ec', 'request_id': 'req-59a42669-26b8-4997-9bee-88007949b6cf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:10.921875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] The token cache is being invalidate because project 22c66d2590b846fcb22d0a78c403c9ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:10.922231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:10.922945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:10.925414 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1058/2093] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:10 2022] DELETE /identity/v3/projects/22c66d2590b846fcb22d0a78c403c9ec => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:10.928356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af03bae-2507-4ac5-8d2b-3313226c5b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:10.928356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af03bae-2507-4ac5-8d2b-3313226c5b69 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:10.929436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:10.930960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:10.940926 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1036/2094] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:10.989293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af03bae-2507-4ac5-8d2b-3313226c5b69 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:10.991245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7af03bae-2507-4ac5-8d2b-3313226c5b69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:11.011574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af03bae-2507-4ac5-8d2b-3313226c5b69 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:11.018974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d19c20-c3a0-40fb-afe0-9d5815b6ebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:11.019751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d19c20-c3a0-40fb-afe0-9d5815b6ebfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:11.020042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d19c20-c3a0-40fb-afe0-9d5815b6ebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:11.020518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d19c20-c3a0-40fb-afe0-9d5815b6ebfe admin admin] PATH_INFO: `/v3/users/62cce2c01e8f40579463e3e9120659cf` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:11.021012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a42669-26b8-4997-9bee-88007949b6cf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:11.022406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d19c20-c3a0-40fb-afe0-9d5815b6ebfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=62cce2c01e8f40579463e3e9120659cf)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:11.024775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d19c20-c3a0-40fb-afe0-9d5815b6ebfe admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:11.027839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4fbd6-4d98-499e-acd7-7aecea608815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:11.028930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4fbd6-4d98-499e-acd7-7aecea608815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:11.028930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4fbd6-4d98-499e-acd7-7aecea608815 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:11.029225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4fbd6-4d98-499e-acd7-7aecea608815 admin admin] PATH_INFO: `/v3/users/d4ef7c1f545d46848adde1dd0ffc3baa` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:11.030416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4fbd6-4d98-499e-acd7-7aecea608815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ef7c1f545d46848adde1dd0ffc3baa)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:11.032569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4fbd6-4d98-499e-acd7-7aecea608815 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:11.098661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f1c4fbd6-4d98-499e-acd7-7aecea608815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ef7c1f545d46848adde1dd0ffc3baa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.108568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f1c4fbd6-4d98-499e-acd7-7aecea608815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ef7c1f545d46848adde1dd0ffc3baa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.110751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f1c4fbd6-4d98-499e-acd7-7aecea608815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ef7c1f545d46848adde1dd0ffc3baa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.111554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f1c4fbd6-4d98-499e-acd7-7aecea608815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ef7c1f545d46848adde1dd0ffc3baa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.111851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99d19c20-c3a0-40fb-afe0-9d5815b6ebfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62cce2c01e8f40579463e3e9120659cf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.118117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:11.130806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f1c4fbd6-4d98-499e-acd7-7aecea608815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ef7c1f545d46848adde1dd0ffc3baa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.133015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99d19c20-c3a0-40fb-afe0-9d5815b6ebfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62cce2c01e8f40579463e3e9120659cf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.136531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99d19c20-c3a0-40fb-afe0-9d5815b6ebfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62cce2c01e8f40579463e3e9120659cf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.137176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99d19c20-c3a0-40fb-afe0-9d5815b6ebfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62cce2c01e8f40579463e3e9120659cf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.149254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:11.160924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99d19c20-c3a0-40fb-afe0-9d5815b6ebfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62cce2c01e8f40579463e3e9120659cf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.162027 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1059/2095] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:10 2022] DELETE /identity/v3/users/d4ef7c1f545d46848adde1dd0ffc3baa => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:52:11.188880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56530017-fc69-4dfa-bbec-76950c145a6c None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:11.189231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56530017-fc69-4dfa-bbec-76950c145a6c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:11.189572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56530017-fc69-4dfa-bbec-76950c145a6c None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:11.191311 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1060/2096] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:52:11.198478 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1037/2097] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:10 2022] DELETE /identity/v3/users/62cce2c01e8f40579463e3e9120659cf => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:11.202207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56530017-fc69-4dfa-bbec-76950c145a6c None None] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:11.204186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-56530017-fc69-4dfa-bbec-76950c145a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:11.210937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493ac6b-4aa9-4b53-b931-cec9f3b35bdd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:11.211271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493ac6b-4aa9-4b53-b931-cec9f3b35bdd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:11.211558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493ac6b-4aa9-4b53-b931-cec9f3b35bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:11.233112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0493ac6b-4aa9-4b53-b931-cec9f3b35bdd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:11.234969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0493ac6b-4aa9-4b53-b931-cec9f3b35bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:11.314131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56530017-fc69-4dfa-bbec-76950c145a6c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:11.315432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-56530017-fc69-4dfa-bbec-76950c145a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:11.321861 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1038/2098] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:11.329709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493ac6b-4aa9-4b53-b931-cec9f3b35bdd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:11.331285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0493ac6b-4aa9-4b53-b931-cec9f3b35bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:11.356112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493ac6b-4aa9-4b53-b931-cec9f3b35bdd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:11.365075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bb4cc-d9a0-43b5-995b-5bd22aad0f8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:11.365257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bb4cc-d9a0-43b5-995b-5bd22aad0f8b service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:11.365540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bb4cc-d9a0-43b5-995b-5bd22aad0f8b service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:11.365840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bb4cc-d9a0-43b5-995b-5bd22aad0f8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:11.367815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ef6bb4cc-d9a0-43b5-995b-5bd22aad0f8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:11.424312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56530017-fc69-4dfa-bbec-76950c145a6c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:11.429414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b162d-2d14-410d-abbc-f3efdeab554b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:11.430217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b162d-2d14-410d-abbc-f3efdeab554b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:11.430436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b162d-2d14-410d-abbc-f3efdeab554b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:11.430715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b162d-2d14-410d-abbc-f3efdeab554b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects/f37ffeaad9bb496e85255e18cdd81a57` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:11.432188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b162d-2d14-410d-abbc-f3efdeab554b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:get_project(project_id=f37ffeaad9bb496e85255e18cdd81a57)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:11.434427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b162d-2d14-410d-abbc-f3efdeab554b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:11.436640 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1061/2099] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:11 2022] GET /identity/v3/projects/f37ffeaad9bb496e85255e18cdd81a57 => generated 371 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:11.437603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b162d-2d14-410d-abbc-f3efdeab554b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:11.439306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e81b162d-2d14-410d-abbc-f3efdeab554b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:11.456619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bb4cc-d9a0-43b5-995b-5bd22aad0f8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:11.462402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bb4cc-d9a0-43b5-995b-5bd22aad0f8b service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:11.477445 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1039/2100] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:11 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:11.478968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bb4cc-d9a0-43b5-995b-5bd22aad0f8b service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:11.492566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bb4cc-d9a0-43b5-995b-5bd22aad0f8b service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:11.498686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:11.499391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:11.499884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:11.500291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/users/c42077c05f1d4658a38021e39823f960` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:11.517835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c42077c05f1d4658a38021e39823f960)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:11.519997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:11.540129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b162d-2d14-410d-abbc-f3efdeab554b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:11.545088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328835f5-496a-428a-b8e2-501e06bf0d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:11.547055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328835f5-496a-428a-b8e2-501e06bf0d37 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:11.547349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328835f5-496a-428a-b8e2-501e06bf0d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:11.548375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328835f5-496a-428a-b8e2-501e06bf0d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:11.560089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328835f5-496a-428a-b8e2-501e06bf0d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:11.561901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328835f5-496a-428a-b8e2-501e06bf0d37 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:11.573444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42077c05f1d4658a38021e39823f960'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.583156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42077c05f1d4658a38021e39823f960'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.584015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42077c05f1d4658a38021e39823f960'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.585028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42077c05f1d4658a38021e39823f960'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.590035 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1062/2101] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:11.591490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:11.603804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42077c05f1d4658a38021e39823f960'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.618371 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1040/2102] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:11 2022] DELETE /identity/v3/users/c42077c05f1d4658a38021e39823f960 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:11.623192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328835f5-496a-428a-b8e2-501e06bf0d37 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:11.635420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328835f5-496a-428a-b8e2-501e06bf0d37 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:11.649108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:11.699421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161eda2e-cc7a-4226-ab2d-a6258c3e6612 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:11.700181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eda2e-cc7a-4226-ab2d-a6258c3e6612 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:11.700464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eda2e-cc7a-4226-ab2d-a6258c3e6612 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:11.700736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eda2e-cc7a-4226-ab2d-a6258c3e6612 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects/f37ffeaad9bb496e85255e18cdd81a57` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:11.701899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161eda2e-cc7a-4226-ab2d-a6258c3e6612 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f37ffeaad9bb496e85255e18cdd81a57)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:11.704436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161eda2e-cc7a-4226-ab2d-a6258c3e6612 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:11.715378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:11.717605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:11.769482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-161eda2e-cc7a-4226-ab2d-a6258c3e6612 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37ffeaad9bb496e85255e18cdd81a57', 'request_id': 'req-161eda2e-cc7a-4226-ab2d-a6258c3e6612'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.779689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-161eda2e-cc7a-4226-ab2d-a6258c3e6612 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37ffeaad9bb496e85255e18cdd81a57', 'request_id': 'req-161eda2e-cc7a-4226-ab2d-a6258c3e6612'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.794237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-161eda2e-cc7a-4226-ab2d-a6258c3e6612 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37ffeaad9bb496e85255e18cdd81a57', 'request_id': 'req-161eda2e-cc7a-4226-ab2d-a6258c3e6612'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.821781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-161eda2e-cc7a-4226-ab2d-a6258c3e6612 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] The token cache is being invalidate because project f37ffeaad9bb496e85255e18cdd81a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:11.822128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-161eda2e-cc7a-4226-ab2d-a6258c3e6612 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.823638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-161eda2e-cc7a-4226-ab2d-a6258c3e6612 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.827592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5495a6-922a-4be5-b842-025817f6c919 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:11.832102 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1063/2103] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:11 2022] DELETE /identity/v3/projects/f37ffeaad9bb496e85255e18cdd81a57 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:11.913155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:11.914077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:11.914405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:11.914784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994 admin admin] PATH_INFO: `/v3/projects/6c2fcd31ca4d4f849a624fc7a6632c9e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:11.916097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2fcd31ca4d4f849a624fc7a6632c9e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:11.918845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:11.974283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2fcd31ca4d4f849a624fc7a6632c9e', 'request_id': 'req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.983523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2fcd31ca4d4f849a624fc7a6632c9e', 'request_id': 'req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:11.990605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2fcd31ca4d4f849a624fc7a6632c9e', 'request_id': 'req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:12.004337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994 admin admin] The token cache is being invalidate because project 6c2fcd31ca4d4f849a624fc7a6632c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:12.004804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:12.005491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d9f6ef35-f6a2-49bf-bedf-3b0e3c28a994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:12.007097 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1041/2104] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:11 2022] DELETE /identity/v3/projects/6c2fcd31ca4d4f849a624fc7a6632c9e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:12.014274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4458ce2-8ebf-41c1-964b-8ae8f31a36e4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:12.014654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4458ce2-8ebf-41c1-964b-8ae8f31a36e4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:12.014936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4458ce2-8ebf-41c1-964b-8ae8f31a36e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:12.037773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d4458ce2-8ebf-41c1-964b-8ae8f31a36e4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:12.039074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d4458ce2-8ebf-41c1-964b-8ae8f31a36e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:12.121342 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1064/2105] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:12.123641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d88367-d351-4151-9ef0-3e1000901225 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:12.124065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d88367-d351-4151-9ef0-3e1000901225 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:12.124858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d88367-d351-4151-9ef0-3e1000901225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:12.149694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-67d88367-d351-4151-9ef0-3e1000901225 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:12.151070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-67d88367-d351-4151-9ef0-3e1000901225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:12.164672 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1042/2106] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:12.165801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4458ce2-8ebf-41c1-964b-8ae8f31a36e4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:12.177065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4458ce2-8ebf-41c1-964b-8ae8f31a36e4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:12.182602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66525b-86c2-41a3-836e-01ac759c031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:12.183607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66525b-86c2-41a3-836e-01ac759c031e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:12.184034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66525b-86c2-41a3-836e-01ac759c031e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:12.184452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66525b-86c2-41a3-836e-01ac759c031e admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:12.186019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66525b-86c2-41a3-836e-01ac759c031e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:12.186334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66525b-86c2-41a3-836e-01ac759c031e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:12.188763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66525b-86c2-41a3-836e-01ac759c031e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:12.205527 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1065/2107] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:52:12.210286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d88367-d351-4151-9ef0-3e1000901225 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:12.224098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721fbb4-6496-46ee-a976-c754f109f7e7 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:12.224394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721fbb4-6496-46ee-a976-c754f109f7e7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:12.224670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721fbb4-6496-46ee-a976-c754f109f7e7 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:12.224918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d88367-d351-4151-9ef0-3e1000901225 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:12.226320 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1066/2108] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:12.231167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721fbb4-6496-46ee-a976-c754f109f7e7 None None] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:12.231379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38100a8c-b172-4071-aa69-1484ab65919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:12.232041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38100a8c-b172-4071-aa69-1484ab65919e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:12.232308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38100a8c-b172-4071-aa69-1484ab65919e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:12.232578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38100a8c-b172-4071-aa69-1484ab65919e admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:12.233281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38100a8c-b172-4071-aa69-1484ab65919e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:12.234482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0721fbb4-6496-46ee-a976-c754f109f7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:12.236451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38100a8c-b172-4071-aa69-1484ab65919e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:12.242776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:12.274945 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1043/2109] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:12 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:12.276058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38100a8c-b172-4071-aa69-1484ab65919e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:12.305270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:12.391965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721fbb4-6496-46ee-a976-c754f109f7e7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:12.394501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0721fbb4-6496-46ee-a976-c754f109f7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:12.403352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38100a8c-b172-4071-aa69-1484ab65919e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:12.414154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ec8b5-48a6-44e3-85cf-ec38d40b6213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:12.414917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ec8b5-48a6-44e3-85cf-ec38d40b6213 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:12.415300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ec8b5-48a6-44e3-85cf-ec38d40b6213 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:12.415741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ec8b5-48a6-44e3-85cf-ec38d40b6213 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:12.417037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ec8b5-48a6-44e3-85cf-ec38d40b6213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:12.419299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ec8b5-48a6-44e3-85cf-ec38d40b6213 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:12.451461 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1044/2110] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:12 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:12.453303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ec8b5-48a6-44e3-85cf-ec38d40b6213 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:12.467928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ec8b5-48a6-44e3-85cf-ec38d40b6213 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:12.477930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19597ac7-eec2-4c7b-b1ec-e8df43400f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:12.478918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19597ac7-eec2-4c7b-b1ec-e8df43400f04 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:12.479389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19597ac7-eec2-4c7b-b1ec-e8df43400f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:12.479843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19597ac7-eec2-4c7b-b1ec-e8df43400f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:12.481040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19597ac7-eec2-4c7b-b1ec-e8df43400f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:12.485143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19597ac7-eec2-4c7b-b1ec-e8df43400f04 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:12.506780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721fbb4-6496-46ee-a976-c754f109f7e7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:12.509866 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1045/2111] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:12.511076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19597ac7-eec2-4c7b-b1ec-e8df43400f04 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:12.514634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-19597ac7-eec2-4c7b-b1ec-e8df43400f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:12.529072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19597ac7-eec2-4c7b-b1ec-e8df43400f04 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:12.535631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e88cb3-888d-474c-8a34-29aff4e271fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:12.536287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e88cb3-888d-474c-8a34-29aff4e271fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:12.536566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e88cb3-888d-474c-8a34-29aff4e271fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:12.536893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e88cb3-888d-474c-8a34-29aff4e271fe admin admin] PATH_INFO: `/v3/projects/38dc8dd1b8ac461bbd49c39e660b4750` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:12.538179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e88cb3-888d-474c-8a34-29aff4e271fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=38dc8dd1b8ac461bbd49c39e660b4750)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:12.540371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e88cb3-888d-474c-8a34-29aff4e271fe admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:12.599922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be07f9-2907-4548-9151-70a59f2bb857 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:12.601226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be07f9-2907-4548-9151-70a59f2bb857 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:12.601645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be07f9-2907-4548-9151-70a59f2bb857 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:12.602093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be07f9-2907-4548-9151-70a59f2bb857 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects/fc20782544f24eb3a49a037ef01e1f8f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:12.603611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be07f9-2907-4548-9151-70a59f2bb857 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:get_project(project_id=fc20782544f24eb3a49a037ef01e1f8f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:12.604246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e7e88cb3-888d-474c-8a34-29aff4e271fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38dc8dd1b8ac461bbd49c39e660b4750', 'request_id': 'req-e7e88cb3-888d-474c-8a34-29aff4e271fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:12.606433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be07f9-2907-4548-9151-70a59f2bb857 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:12.608122 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1067/2112] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:12 2022] GET /identity/v3/projects/fc20782544f24eb3a49a037ef01e1f8f => generated 373 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:52:12.609516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be07f9-2907-4548-9151-70a59f2bb857 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:12.617687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e7e88cb3-888d-474c-8a34-29aff4e271fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38dc8dd1b8ac461bbd49c39e660b4750', 'request_id': 'req-e7e88cb3-888d-474c-8a34-29aff4e271fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:12.622744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be07f9-2907-4548-9151-70a59f2bb857 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:12.640647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e7e88cb3-888d-474c-8a34-29aff4e271fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38dc8dd1b8ac461bbd49c39e660b4750', 'request_id': 'req-e7e88cb3-888d-474c-8a34-29aff4e271fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:12.672989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e7e88cb3-888d-474c-8a34-29aff4e271fe admin admin] The token cache is being invalidate because project 38dc8dd1b8ac461bbd49c39e660b4750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:12.674145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e7e88cb3-888d-474c-8a34-29aff4e271fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:12.675128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e7e88cb3-888d-474c-8a34-29aff4e271fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:12.677282 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1046/2113] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:12 2022] DELETE /identity/v3/projects/38dc8dd1b8ac461bbd49c39e660b4750 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:12.678929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406d743-0719-4600-93a8-a1a6cebcce4d None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:12.679291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406d743-0719-4600-93a8-a1a6cebcce4d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:12.679571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406d743-0719-4600-93a8-a1a6cebcce4d None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:12.681763 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1047/2114] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:12.686799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406d743-0719-4600-93a8-a1a6cebcce4d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:12.688540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9406d743-0719-4600-93a8-a1a6cebcce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:12.715497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46d558-68d2-4370-8b6a-59f2cc1db6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:12.716181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46d558-68d2-4370-8b6a-59f2cc1db6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:12.716487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46d558-68d2-4370-8b6a-59f2cc1db6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:12.716754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46d558-68d2-4370-8b6a-59f2cc1db6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:12.717432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46d558-68d2-4370-8b6a-59f2cc1db6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:12.719621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46d558-68d2-4370-8b6a-59f2cc1db6b5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:12.732447 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1068/2115] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:12.733420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46d558-68d2-4370-8b6a-59f2cc1db6b5 admin admin] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:12.739078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ae46d558-68d2-4370-8b6a-59f2cc1db6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:12.760868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:12.774303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:12.797453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406d743-0719-4600-93a8-a1a6cebcce4d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:12.805057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:12.805939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:12.806335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:12.806780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] PATH_INFO: `/v3/users/fd477f1563fc49deb10ab71192150d87` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:12.808835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd477f1563fc49deb10ab71192150d87)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:12.811520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:12.880967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46d558-68d2-4370-8b6a-59f2cc1db6b5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:12.882464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ae46d558-68d2-4370-8b6a-59f2cc1db6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:12.886468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd477f1563fc49deb10ab71192150d87'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:12.902513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd477f1563fc49deb10ab71192150d87'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:12.904847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd477f1563fc49deb10ab71192150d87'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:12.905810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd477f1563fc49deb10ab71192150d87'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:12.931576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd477f1563fc49deb10ab71192150d87'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:12.952367 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1048/2116] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:12 2022] DELETE /identity/v3/users/fd477f1563fc49deb10ab71192150d87 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:12.953762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:12.955278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:12.962215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46d558-68d2-4370-8b6a-59f2cc1db6b5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:13.040814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38897821-ab74-4ddf-a8e7-7c7c264b7ef2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:13.041477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38897821-ab74-4ddf-a8e7-7c7c264b7ef2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:13.042058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38897821-ab74-4ddf-a8e7-7c7c264b7ef2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:13.042456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38897821-ab74-4ddf-a8e7-7c7c264b7ef2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects/fc20782544f24eb3a49a037ef01e1f8f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:13.043721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38897821-ab74-4ddf-a8e7-7c7c264b7ef2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:get_project(project_id=fc20782544f24eb3a49a037ef01e1f8f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:13.047211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38897821-ab74-4ddf-a8e7-7c7c264b7ef2 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:13.050086 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1069/2117] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:12 2022] GET /identity/v3/projects/fc20782544f24eb3a49a037ef01e1f8f => generated 373 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:13.074575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964a73b-c72f-4324-a0a1-b20b4cd9b593 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:13.083368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed67a6c-4097-4045-a400-6b82da86c37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:13.084145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed67a6c-4097-4045-a400-6b82da86c37e admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:13.084532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed67a6c-4097-4045-a400-6b82da86c37e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:13.085046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed67a6c-4097-4045-a400-6b82da86c37e admin admin] PATH_INFO: `/v3/projects/0390dc00d3a24165b407814b3c9982f9/users/2b8c50ced9114ebf8abb7d40cee1c099/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:13.113397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed67a6c-4097-4045-a400-6b82da86c37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0390dc00d3a24165b407814b3c9982f9, user_id=2b8c50ced9114ebf8abb7d40cee1c099, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:13.117801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed67a6c-4097-4045-a400-6b82da86c37e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:13.149268 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1049/2118] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:12 2022] PUT /identity/v3/projects/0390dc00d3a24165b407814b3c9982f9/users/2b8c50ced9114ebf8abb7d40cee1c099/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:13.159567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e380f-0e1a-4720-86c0-57ad9eb7a479 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:13.160030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e380f-0e1a-4720-86c0-57ad9eb7a479 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:13.160675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e380f-0e1a-4720-86c0-57ad9eb7a479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:13.205810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fc2e380f-0e1a-4720-86c0-57ad9eb7a479 None None] MFA Rules not processed for user `2b8c50ced9114ebf8abb7d40cee1c099`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:13.207499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fc2e380f-0e1a-4720-86c0-57ad9eb7a479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:13.276213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:13.312903 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1070/2119] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:13.317462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed67a6c-4097-4045-a400-6b82da86c37e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:13.411291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:13.418503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e380f-0e1a-4720-86c0-57ad9eb7a479 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:13.420067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fc2e380f-0e1a-4720-86c0-57ad9eb7a479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:13.442092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed67a6c-4097-4045-a400-6b82da86c37e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:13.451099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e380f-0e1a-4720-86c0-57ad9eb7a479 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:13.457235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159642ec-6ecb-4202-9167-4ec4139c6c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:13.459606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159642ec-6ecb-4202-9167-4ec4139c6c02 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:13.459866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159642ec-6ecb-4202-9167-4ec4139c6c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:13.460142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159642ec-6ecb-4202-9167-4ec4139c6c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:13.460789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159642ec-6ecb-4202-9167-4ec4139c6c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:13.466717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a37e5-3436-44ff-875b-4f8beb9893f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:13.467422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a37e5-3436-44ff-875b-4f8beb9893f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:13.467704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a37e5-3436-44ff-875b-4f8beb9893f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:13.469705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159642ec-6ecb-4202-9167-4ec4139c6c02 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:13.470077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a37e5-3436-44ff-875b-4f8beb9893f0 admin admin] PATH_INFO: `/v3/projects/46499d6ac6d547a8b00ed75b08f7875a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:13.474969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a37e5-3436-44ff-875b-4f8beb9893f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46499d6ac6d547a8b00ed75b08f7875a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:13.477981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a37e5-3436-44ff-875b-4f8beb9893f0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:13.539555 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1050/2120] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:13 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:52:13.540613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159642ec-6ecb-4202-9167-4ec4139c6c02 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:13.615703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-993a37e5-3436-44ff-875b-4f8beb9893f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46499d6ac6d547a8b00ed75b08f7875a', 'request_id': 'req-993a37e5-3436-44ff-875b-4f8beb9893f0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:13.627438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-993a37e5-3436-44ff-875b-4f8beb9893f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46499d6ac6d547a8b00ed75b08f7875a', 'request_id': 'req-993a37e5-3436-44ff-875b-4f8beb9893f0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:13.649393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-993a37e5-3436-44ff-875b-4f8beb9893f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46499d6ac6d547a8b00ed75b08f7875a', 'request_id': 'req-993a37e5-3436-44ff-875b-4f8beb9893f0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:13.667495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-993a37e5-3436-44ff-875b-4f8beb9893f0 admin admin] The token cache is being invalidate because project 46499d6ac6d547a8b00ed75b08f7875a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:13.667958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-993a37e5-3436-44ff-875b-4f8beb9893f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:13.668951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-993a37e5-3436-44ff-875b-4f8beb9893f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:13.670578 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1071/2121] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:13 2022] DELETE /identity/v3/projects/46499d6ac6d547a8b00ed75b08f7875a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:52:13.676532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a83a2f-ebf4-4409-98a1-5c9d73bed20b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:13.677001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a83a2f-ebf4-4409-98a1-5c9d73bed20b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:13.677524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a83a2f-ebf4-4409-98a1-5c9d73bed20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:13.700150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159642ec-6ecb-4202-9167-4ec4139c6c02 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:13.701740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a6a83a2f-ebf4-4409-98a1-5c9d73bed20b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:13.703815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a6a83a2f-ebf4-4409-98a1-5c9d73bed20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:13.812616 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1072/2122] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:13.817924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed72510-cd18-487a-8479-57e912956261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:13.818564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed72510-cd18-487a-8479-57e912956261 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:13.818837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed72510-cd18-487a-8479-57e912956261 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:13.819303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed72510-cd18-487a-8479-57e912956261 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:13.819944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed72510-cd18-487a-8479-57e912956261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:13.821214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba7705-ca95-4cd8-a6f3-8cbf7ab16fc2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:13.821736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba7705-ca95-4cd8-a6f3-8cbf7ab16fc2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:13.822379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba7705-ca95-4cd8-a6f3-8cbf7ab16fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:13.823146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed72510-cd18-487a-8479-57e912956261 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:13.861944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2dba7705-ca95-4cd8-a6f3-8cbf7ab16fc2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:13.863326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2dba7705-ca95-4cd8-a6f3-8cbf7ab16fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:13.875957 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1051/2123] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:13 2022] POST /identity/v3/users => generated 294 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:13.885770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed72510-cd18-487a-8479-57e912956261 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:13.887565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6ed72510-cd18-487a-8479-57e912956261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:13.899440 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1073/2124] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:13.900501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba7705-ca95-4cd8-a6f3-8cbf7ab16fc2 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:13.901123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed72510-cd18-487a-8479-57e912956261 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:13.906140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254b7a0-c126-4788-ad25-00300391c9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:13.906796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254b7a0-c126-4788-ad25-00300391c9cf admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:13.907079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254b7a0-c126-4788-ad25-00300391c9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:13.907350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254b7a0-c126-4788-ad25-00300391c9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:13.907999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254b7a0-c126-4788-ad25-00300391c9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:13.920146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254b7a0-c126-4788-ad25-00300391c9cf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:13.921996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba7705-ca95-4cd8-a6f3-8cbf7ab16fc2 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:13.932734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581c2bc-4d6f-48e4-aada-26d8e51cdd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:13.933542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581c2bc-4d6f-48e4-aada-26d8e51cdd3b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:13.933828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581c2bc-4d6f-48e4-aada-26d8e51cdd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:13.934892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581c2bc-4d6f-48e4-aada-26d8e51cdd3b admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:13.937876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581c2bc-4d6f-48e4-aada-26d8e51cdd3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:13.938197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581c2bc-4d6f-48e4-aada-26d8e51cdd3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:13.940011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581c2bc-4d6f-48e4-aada-26d8e51cdd3b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:13.946130 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1052/2125] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:13.947661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254b7a0-c126-4788-ad25-00300391c9cf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:13.966843 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1074/2126] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:13.973254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254b7a0-c126-4788-ad25-00300391c9cf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:13.975956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581c2bc-4d6f-48e4-aada-26d8e51cdd3b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:13.990957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72796862-8571-4e4e-8274-a8de50f9a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:13.994871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72796862-8571-4e4e-8274-a8de50f9a832 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:13.995177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72796862-8571-4e4e-8274-a8de50f9a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:13.995537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72796862-8571-4e4e-8274-a8de50f9a832 admin admin] PATH_INFO: `/v3/projects/6b50d15d08bd43c9a52a79894afef944/users/c46fbf1e9a3d43468692e8f8e2015296/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.003674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581c2bc-4d6f-48e4-aada-26d8e51cdd3b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:14.009471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9047cda-bba5-4693-99d4-167b2b71e3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:14.010272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9047cda-bba5-4693-99d4-167b2b71e3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.010658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9047cda-bba5-4693-99d4-167b2b71e3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.011697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9047cda-bba5-4693-99d4-167b2b71e3c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.011974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9047cda-bba5-4693-99d4-167b2b71e3c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:14.014222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9047cda-bba5-4693-99d4-167b2b71e3c8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:14.040138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72796862-8571-4e4e-8274-a8de50f9a832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b50d15d08bd43c9a52a79894afef944, user_id=c46fbf1e9a3d43468692e8f8e2015296, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:14.047414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72796862-8571-4e4e-8274-a8de50f9a832 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:14.064589 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1075/2127] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:13 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:14.066234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e657a5e-96a6-449c-b74c-b72d725f28fa None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.066719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e657a5e-96a6-449c-b74c-b72d725f28fa None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.067997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e657a5e-96a6-449c-b74c-b72d725f28fa None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.071039 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1076/2128] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:14.072441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e657a5e-96a6-449c-b74c-b72d725f28fa None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:14.079903 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1053/2129] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:13 2022] PUT /identity/v3/projects/6b50d15d08bd43c9a52a79894afef944/users/c46fbf1e9a3d43468692e8f8e2015296/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:14.081541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72796862-8571-4e4e-8274-a8de50f9a832 admin admin] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:14.085580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-72796862-8571-4e4e-8274-a8de50f9a832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:14.146391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:14.180513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:14.196821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e657a5e-96a6-449c-b74c-b72d725f28fa None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:14.203683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e0d85-a2df-436e-a11c-3b3a8746aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:14.204514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e0d85-a2df-436e-a11c-3b3a8746aca8 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.204982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e0d85-a2df-436e-a11c-3b3a8746aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.205489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e0d85-a2df-436e-a11c-3b3a8746aca8 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.206310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e0d85-a2df-436e-a11c-3b3a8746aca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:14.208692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e0d85-a2df-436e-a11c-3b3a8746aca8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:14.227438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72796862-8571-4e4e-8274-a8de50f9a832 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:14.229615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-72796862-8571-4e4e-8274-a8de50f9a832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:14.235859 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1077/2130] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:14 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:14.237121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e0d85-a2df-436e-a11c-3b3a8746aca8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:14.251722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e0d85-a2df-436e-a11c-3b3a8746aca8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:14.257636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed344af-1633-4654-85fa-936daaa87821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:14.258304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed344af-1633-4654-85fa-936daaa87821 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.258591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed344af-1633-4654-85fa-936daaa87821 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.258869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed344af-1633-4654-85fa-936daaa87821 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.259528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed344af-1633-4654-85fa-936daaa87821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:14.261223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed344af-1633-4654-85fa-936daaa87821 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:14.276058 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1078/2131] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:14.276058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0abf6-7114-4c92-90f9-65b21923bf7b None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.276058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0abf6-7114-4c92-90f9-65b21923bf7b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.276058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0abf6-7114-4c92-90f9-65b21923bf7b None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.276502 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1079/2132] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:14.277332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0abf6-7114-4c92-90f9-65b21923bf7b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:14.292082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0abf6-7114-4c92-90f9-65b21923bf7b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:14.297838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b533508-d3b5-40b4-8364-532898e9ed3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:14.298709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b533508-d3b5-40b4-8364-532898e9ed3c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.299098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b533508-d3b5-40b4-8364-532898e9ed3c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.299388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b533508-d3b5-40b4-8364-532898e9ed3c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.300101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b533508-d3b5-40b4-8364-532898e9ed3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:14.301742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b533508-d3b5-40b4-8364-532898e9ed3c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:14.317335 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1080/2133] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:14.317335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b533508-d3b5-40b4-8364-532898e9ed3c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:14.324239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72796862-8571-4e4e-8274-a8de50f9a832 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:14.325100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b533508-d3b5-40b4-8364-532898e9ed3c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:14.330088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bdf27-5f2e-417c-a414-4aabaa17b62f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42f1a0ff1fb47fdbf291e216b505294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '607f44f98258408b9f7f77a248328f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:14.330747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bdf27-5f2e-417c-a414-4aabaa17b62f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.331026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bdf27-5f2e-417c-a414-4aabaa17b62f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.331297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bdf27-5f2e-417c-a414-4aabaa17b62f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] PATH_INFO: `/v3/projects/fc20782544f24eb3a49a037ef01e1f8f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.331623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144d0ef-8b9a-4946-9f29-68cca010603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:14.332291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144d0ef-8b9a-4946-9f29-68cca010603e admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.332398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bdf27-5f2e-417c-a414-4aabaa17b62f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorizing `identity:get_project(project_id=fc20782544f24eb3a49a037ef01e1f8f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:14.332572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144d0ef-8b9a-4946-9f29-68cca010603e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.332849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144d0ef-8b9a-4946-9f29-68cca010603e admin admin] PATH_INFO: `/v3/projects/6b50d15d08bd43c9a52a79894afef944/users/c46fbf1e9a3d43468692e8f8e2015296/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.334522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bdf27-5f2e-417c-a414-4aabaa17b62f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:14.334866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144d0ef-8b9a-4946-9f29-68cca010603e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b50d15d08bd43c9a52a79894afef944, user_id=c46fbf1e9a3d43468692e8f8e2015296, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:14.336438 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1054/2134] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:14 2022] GET /identity/v3/projects/fc20782544f24eb3a49a037ef01e1f8f => generated 373 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:14.337358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c38794-aac5-46f2-9bc4-a23ef393be96 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.337612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144d0ef-8b9a-4946-9f29-68cca010603e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:14.337733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c38794-aac5-46f2-9bc4-a23ef393be96 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.337897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c38794-aac5-46f2-9bc4-a23ef393be96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.354418 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1081/2135] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:14 2022] PUT /identity/v3/projects/6b50d15d08bd43c9a52a79894afef944/users/c46fbf1e9a3d43468692e8f8e2015296/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:14.355326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144d0ef-8b9a-4946-9f29-68cca010603e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:14.369366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f9c38794-aac5-46f2-9bc4-a23ef393be96 None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:14.370687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f9c38794-aac5-46f2-9bc4-a23ef393be96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:14.441765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144d0ef-8b9a-4946-9f29-68cca010603e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:14.447101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773765ad-adea-4276-bf23-baa19d7756df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:14.447861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773765ad-adea-4276-bf23-baa19d7756df admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.448590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773765ad-adea-4276-bf23-baa19d7756df admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.448590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773765ad-adea-4276-bf23-baa19d7756df admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.449415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773765ad-adea-4276-bf23-baa19d7756df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:14.451224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773765ad-adea-4276-bf23-baa19d7756df admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:14.462858 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1082/2136] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:14.463112 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1055/2137] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:14.464492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556e74e-a4b5-4549-9a99-54db3e087dfa None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.464919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556e74e-a4b5-4549-9a99-54db3e087dfa None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.465382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556e74e-a4b5-4549-9a99-54db3e087dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.467174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c38794-aac5-46f2-9bc4-a23ef393be96 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:14.481613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c38794-aac5-46f2-9bc4-a23ef393be96 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:14.498287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6763d-50d6-4859-80b9-4ca44a258a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:14.500023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6763d-50d6-4859-80b9-4ca44a258a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.500460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6763d-50d6-4859-80b9-4ca44a258a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.501000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6763d-50d6-4859-80b9-4ca44a258a5a admin admin] PATH_INFO: `/v3/projects/16530e0f2f0a4d23918261c9e21f9784/users/2cb78cce5f7c4c348045745f40b13129/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.510891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b556e74e-a4b5-4549-9a99-54db3e087dfa None None] MFA Rules not processed for user `c46fbf1e9a3d43468692e8f8e2015296`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:14.512342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b556e74e-a4b5-4549-9a99-54db3e087dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:14.518576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6763d-50d6-4859-80b9-4ca44a258a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=16530e0f2f0a4d23918261c9e21f9784, user_id=2cb78cce5f7c4c348045745f40b13129, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:14.521565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6763d-50d6-4859-80b9-4ca44a258a5a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:14.536011 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1056/2138] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:14 2022] PUT /identity/v3/projects/16530e0f2f0a4d23918261c9e21f9784/users/2cb78cce5f7c4c348045745f40b13129/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:52:14.544621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6763d-50d6-4859-80b9-4ca44a258a5a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:14.544621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8bd6763d-50d6-4859-80b9-4ca44a258a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:14.594652 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1083/2139] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:14.596246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234c152-cfff-4d6e-a782-b65b426a98d2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.596537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234c152-cfff-4d6e-a782-b65b426a98d2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.596811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234c152-cfff-4d6e-a782-b65b426a98d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.599580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:14.612565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:14.630573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6763d-50d6-4859-80b9-4ca44a258a5a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:14.631286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d234c152-cfff-4d6e-a782-b65b426a98d2 None None] MFA Rules not processed for user `2cb78cce5f7c4c348045745f40b13129`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:14.632566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d234c152-cfff-4d6e-a782-b65b426a98d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:14.646470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369445c-62c8-4c64-b3af-86b3841fa6c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:14.647122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369445c-62c8-4c64-b3af-86b3841fa6c6 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.647428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369445c-62c8-4c64-b3af-86b3841fa6c6 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.647855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369445c-62c8-4c64-b3af-86b3841fa6c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.658863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369445c-62c8-4c64-b3af-86b3841fa6c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:14.660713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369445c-62c8-4c64-b3af-86b3841fa6c6 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:14.680180 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1057/2140] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:14.710784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369445c-62c8-4c64-b3af-86b3841fa6c6 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:14.712733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f369445c-62c8-4c64-b3af-86b3841fa6c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:14.743145 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1084/2141] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:14.747050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234c152-cfff-4d6e-a782-b65b426a98d2 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:14.859835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369445c-62c8-4c64-b3af-86b3841fa6c6 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:14.865291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234c152-cfff-4d6e-a782-b65b426a98d2 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:14.870301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70d68b-6672-493f-85a8-a04c49222f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:14.870948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70d68b-6672-493f-85a8-a04c49222f87 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.871271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70d68b-6672-493f-85a8-a04c49222f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.871542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70d68b-6672-493f-85a8-a04c49222f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.872167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70d68b-6672-493f-85a8-a04c49222f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:14.872520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:14.873151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:14.873490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:14.873765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] PATH_INFO: `/v3/users/066b9f2cca3d4ede9addf111f5e30701` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:14.874704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70d68b-6672-493f-85a8-a04c49222f87 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:14.875519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] RBAC: Authorizing `identity:delete_user(user_id=066b9f2cca3d4ede9addf111f5e30701)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:14.877294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:14.909362 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1085/2142] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:14 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:14.910675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70d68b-6672-493f-85a8-a04c49222f87 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:14.953416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066b9f2cca3d4ede9addf111f5e30701'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:14.962690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066b9f2cca3d4ede9addf111f5e30701'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:14.963411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066b9f2cca3d4ede9addf111f5e30701'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:14.964101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066b9f2cca3d4ede9addf111f5e30701'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:14.982764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066b9f2cca3d4ede9addf111f5e30701'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:15.012519 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1058/2143] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:14 2022] DELETE /identity/v3/users/066b9f2cca3d4ede9addf111f5e30701 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:15.013382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:15.028137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:15.035192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70d68b-6672-493f-85a8-a04c49222f87 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:15.079366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:15.124176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ef6f4-0a8b-48e6-ba04-c99190f5145e tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46fbf1e9a3d43468692e8f8e2015296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b50d15d08bd43c9a52a79894afef944', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:15.125822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef6f4-0a8b-48e6-ba04-c99190f5145e tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:15.126530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef6f4-0a8b-48e6-ba04-c99190f5145e tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:15.126990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef6f4-0a8b-48e6-ba04-c99190f5145e tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:15.127867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ef6f4-0a8b-48e6-ba04-c99190f5145e tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:15.128325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ef6f4-0a8b-48e6-ba04-c99190f5145e tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:15.130291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ef6f4-0a8b-48e6-ba04-c99190f5145e tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:15.139768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:15.146996 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1086/2144] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:15.148484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae379db-0742-4948-88ef-f9e0d4377cbf None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:15.148943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae379db-0742-4948-88ef-f9e0d4377cbf None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:15.149445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae379db-0742-4948-88ef-f9e0d4377cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:15.152261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b023cea-54ac-4c7f-997a-9dc08dfd273d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:15.165725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4637c-122f-4249-8fd4-1a0827e2afbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:15.166947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4637c-122f-4249-8fd4-1a0827e2afbc admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:15.167237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4637c-122f-4249-8fd4-1a0827e2afbc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:15.167516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4637c-122f-4249-8fd4-1a0827e2afbc admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:15.168159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4637c-122f-4249-8fd4-1a0827e2afbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:15.170754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4637c-122f-4249-8fd4-1a0827e2afbc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:15.186297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9ae379db-0742-4948-88ef-f9e0d4377cbf None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:15.188890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9ae379db-0742-4948-88ef-f9e0d4377cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:15.199771 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1087/2145] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:15.200800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dab27-bbbc-4b47-99ea-4d80b0b44368 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:15.201293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dab27-bbbc-4b47-99ea-4d80b0b44368 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:15.201403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dab27-bbbc-4b47-99ea-4d80b0b44368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:15.207840 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1059/2146] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:15 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:15.207840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4637c-122f-4249-8fd4-1a0827e2afbc admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:15.209880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-68e4637c-122f-4249-8fd4-1a0827e2afbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:15.227969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4637c-122f-4249-8fd4-1a0827e2afbc admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:15.237101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8d8dab27-bbbc-4b47-99ea-4d80b0b44368 None None] MFA Rules not processed for user `c0eb2feb062947e78357b70e832e3edc`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:15.238563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8d8dab27-bbbc-4b47-99ea-4d80b0b44368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:15.242878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923da485-2c1a-490d-a326-de3c4fed8626 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46fbf1e9a3d43468692e8f8e2015296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b50d15d08bd43c9a52a79894afef944', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:15.243770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923da485-2c1a-490d-a326-de3c4fed8626 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:15.244268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923da485-2c1a-490d-a326-de3c4fed8626 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:15.245045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923da485-2c1a-490d-a326-de3c4fed8626 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:15.246024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923da485-2c1a-490d-a326-de3c4fed8626 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:15.248457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923da485-2c1a-490d-a326-de3c4fed8626 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:15.304258 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1060/2147] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:15 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:15.305162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923da485-2c1a-490d-a326-de3c4fed8626 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:15.316366 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1088/2148] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:15.317268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dab27-bbbc-4b47-99ea-4d80b0b44368 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:15.327603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8d8dab27-bbbc-4b47-99ea-4d80b0b44368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:15.401377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dab27-bbbc-4b47-99ea-4d80b0b44368 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:15.417700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923da485-2c1a-490d-a326-de3c4fed8626 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:15.423860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e2206-7b0b-4576-bb12-9f6c6c519b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:15.424498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e2206-7b0b-4576-bb12-9f6c6c519b63 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:15.424776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e2206-7b0b-4576-bb12-9f6c6c519b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:15.425281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e2206-7b0b-4576-bb12-9f6c6c519b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:15.425737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e2206-7b0b-4576-bb12-9f6c6c519b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:15.427507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e2206-7b0b-4576-bb12-9f6c6c519b63 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:15.440735 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1061/2149] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:15.442701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e2206-7b0b-4576-bb12-9f6c6c519b63 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:15.502066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7153e98-41df-4abd-a6a7-5958969e3e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:15.503764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7153e98-41df-4abd-a6a7-5958969e3e50 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:15.506074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7153e98-41df-4abd-a6a7-5958969e3e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:15.506557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7153e98-41df-4abd-a6a7-5958969e3e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:15.533953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7153e98-41df-4abd-a6a7-5958969e3e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:15.536180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7153e98-41df-4abd-a6a7-5958969e3e50 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:15.549612 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1089/2150] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:15.550298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7153e98-41df-4abd-a6a7-5958969e3e50 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:15.558271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e2206-7b0b-4576-bb12-9f6c6c519b63 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:15.563055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7153e98-41df-4abd-a6a7-5958969e3e50 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:15.564077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3124df-49d3-4ad0-8813-1737726e35ef tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46fbf1e9a3d43468692e8f8e2015296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b50d15d08bd43c9a52a79894afef944', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:15.564935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3124df-49d3-4ad0-8813-1737726e35ef tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:15.565503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3124df-49d3-4ad0-8813-1737726e35ef tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:15.566120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3124df-49d3-4ad0-8813-1737726e35ef tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:15.567039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3124df-49d3-4ad0-8813-1737726e35ef tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:15.567461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3124df-49d3-4ad0-8813-1737726e35ef tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:15.570460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f28505-d5e7-4f67-8998-56546a83dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:15.571158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f28505-d5e7-4f67-8998-56546a83dd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:15.571388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f28505-d5e7-4f67-8998-56546a83dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:15.571676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f28505-d5e7-4f67-8998-56546a83dd56 admin admin] PATH_INFO: `/v3/projects/abb9e8db275e48d8b505db56dc480f97/users/3c9dc54a05ec47d4863c4a3b44c92471/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:15.571790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3124df-49d3-4ad0-8813-1737726e35ef tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:15.588382 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1062/2151] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:15.595460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f28505-d5e7-4f67-8998-56546a83dd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb9e8db275e48d8b505db56dc480f97, user_id=3c9dc54a05ec47d4863c4a3b44c92471, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:15.599621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f28505-d5e7-4f67-8998-56546a83dd56 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:15.603762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:15.619724 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1090/2152] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:15 2022] PUT /identity/v3/projects/abb9e8db275e48d8b505db56dc480f97/users/3c9dc54a05ec47d4863c4a3b44c92471/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:15.624298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3124df-49d3-4ad0-8813-1737726e35ef tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:15.638933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3124df-49d3-4ad0-8813-1737726e35ef tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:15.727176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:15.746659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42106b48-24da-4441-93d6-231b35859be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:15.747286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42106b48-24da-4441-93d6-231b35859be1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:15.747572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42106b48-24da-4441-93d6-231b35859be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:15.748024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42106b48-24da-4441-93d6-231b35859be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:15.748967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42106b48-24da-4441-93d6-231b35859be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:15.751768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42106b48-24da-4441-93d6-231b35859be1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:15.771800 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1063/2153] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:52:15.773741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f28505-d5e7-4f67-8998-56546a83dd56 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:15.786025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f28505-d5e7-4f67-8998-56546a83dd56 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:15.793844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b12c08-a196-4163-a604-bb15781723d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:15.794833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b12c08-a196-4163-a604-bb15781723d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:15.795259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b12c08-a196-4163-a604-bb15781723d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:15.795588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b12c08-a196-4163-a604-bb15781723d9 admin admin] PATH_INFO: `/v3/projects/abb9e8db275e48d8b505db56dc480f97/users/3c9dc54a05ec47d4863c4a3b44c92471/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:15.798185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b12c08-a196-4163-a604-bb15781723d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb9e8db275e48d8b505db56dc480f97, user_id=3c9dc54a05ec47d4863c4a3b44c92471, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:15.801547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b12c08-a196-4163-a604-bb15781723d9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:15.826967 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1091/2154] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:15 2022] PUT /identity/v3/projects/abb9e8db275e48d8b505db56dc480f97/users/3c9dc54a05ec47d4863c4a3b44c92471/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:15.830014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d888c-2516-4520-a84c-486d6e0989cb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:15.830292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d888c-2516-4520-a84c-486d6e0989cb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:15.830612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d888c-2516-4520-a84c-486d6e0989cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:15.882560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0a0d888c-2516-4520-a84c-486d6e0989cb None None] MFA Rules not processed for user `3c9dc54a05ec47d4863c4a3b44c92471`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:15.884475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0a0d888c-2516-4520-a84c-486d6e0989cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:15.885703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b12c08-a196-4163-a604-bb15781723d9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:15.887964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c1b12c08-a196-4163-a604-bb15781723d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:15.993703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b12c08-a196-4163-a604-bb15781723d9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:15.994292 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1064/2155] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:16.001477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa480f3c-7303-4d16-b4fe-6ad55fab6473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:16.002103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa480f3c-7303-4d16-b4fe-6ad55fab6473 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:16.002370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa480f3c-7303-4d16-b4fe-6ad55fab6473 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:16.002791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa480f3c-7303-4d16-b4fe-6ad55fab6473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:16.006360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933296c-f1b7-4d70-af4a-4f05387b3e2b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:16.006656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933296c-f1b7-4d70-af4a-4f05387b3e2b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:16.007102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933296c-f1b7-4d70-af4a-4f05387b3e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:16.053678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f933296c-f1b7-4d70-af4a-4f05387b3e2b None None] MFA Rules not processed for user `2cb78cce5f7c4c348045745f40b13129`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:16.055398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f933296c-f1b7-4d70-af4a-4f05387b3e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:16.125989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa480f3c-7303-4d16-b4fe-6ad55fab6473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:16.128790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa480f3c-7303-4d16-b4fe-6ad55fab6473 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:16.157374 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1092/2156] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:52:16.161996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa480f3c-7303-4d16-b4fe-6ad55fab6473 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:16.168047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fa480f3c-7303-4d16-b4fe-6ad55fab6473 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:16.168185 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1065/2157] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:52:16.176387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556be1e-f131-450e-9ec2-3df717194deb None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:16.176676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556be1e-f131-450e-9ec2-3df717194deb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:16.176953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556be1e-f131-450e-9ec2-3df717194deb None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:16.178461 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1066/2158] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:52:16.186605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556be1e-f131-450e-9ec2-3df717194deb None None] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:16.218775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556be1e-f131-450e-9ec2-3df717194deb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:16.232864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556be1e-f131-450e-9ec2-3df717194deb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:16.239376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c234-2c5d-4646-963f-8fb479f239ce tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46fbf1e9a3d43468692e8f8e2015296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b50d15d08bd43c9a52a79894afef944', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:16.240353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c234-2c5d-4646-963f-8fb479f239ce tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:16.240740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c234-2c5d-4646-963f-8fb479f239ce tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:16.241376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c234-2c5d-4646-963f-8fb479f239ce tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] PATH_INFO: `/v3/projects/2599b63499b549eb96e3a5bac0f83b91` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:16.243272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8c234-2c5d-4646-963f-8fb479f239ce tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorizing `identity:get_project(project_id=2599b63499b549eb96e3a5bac0f83b91)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:16.246413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8c234-2c5d-4646-963f-8fb479f239ce tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:16.257402 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1067/2159] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:16 2022] GET /identity/v3/projects/2599b63499b549eb96e3a5bac0f83b91 => generated 371 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:16.295373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa480f3c-7303-4d16-b4fe-6ad55fab6473 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:16.302686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:16.303404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:16.303690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:16.303965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] PATH_INFO: `/v3/projects/fc20782544f24eb3a49a037ef01e1f8f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:16.305300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc20782544f24eb3a49a037ef01e1f8f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:16.307796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:16.339557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:16.384773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc20782544f24eb3a49a037ef01e1f8f', 'request_id': 'req-8f42106f-006c-4546-8d05-b013bcf94c41'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.398181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc20782544f24eb3a49a037ef01e1f8f', 'request_id': 'req-8f42106f-006c-4546-8d05-b013bcf94c41'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.408342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc20782544f24eb3a49a037ef01e1f8f', 'request_id': 'req-8f42106f-006c-4546-8d05-b013bcf94c41'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.424835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c234-2c5d-4646-963f-8fb479f239ce tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:16.430890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] The token cache is being invalidate because project fc20782544f24eb3a49a037ef01e1f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:16.431192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.432048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.434280 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1093/2160] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:16 2022] DELETE /identity/v3/projects/fc20782544f24eb3a49a037ef01e1f8f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:16.439411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:16.443497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:16.447986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c234-2c5d-4646-963f-8fb479f239ce tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:16.534371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42106f-006c-4546-8d05-b013bcf94c41 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:16.539770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02483fa9-2b7f-4880-a79b-5bc498147bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:16.540488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483fa9-2b7f-4880-a79b-5bc498147bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:16.540838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483fa9-2b7f-4880-a79b-5bc498147bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:16.541260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483fa9-2b7f-4880-a79b-5bc498147bd7 admin admin] PATH_INFO: `/v3/users/e42f1a0ff1fb47fdbf291e216b505294` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:16.542449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02483fa9-2b7f-4880-a79b-5bc498147bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42f1a0ff1fb47fdbf291e216b505294)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:16.544277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515be36-0570-4c40-a067-3d50a88cd915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:16.544670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02483fa9-2b7f-4880-a79b-5bc498147bd7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:16.544872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515be36-0570-4c40-a067-3d50a88cd915 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:16.545149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515be36-0570-4c40-a067-3d50a88cd915 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:16.545453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515be36-0570-4c40-a067-3d50a88cd915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:16.547843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7515be36-0570-4c40-a067-3d50a88cd915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:16.554632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:16.616294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-02483fa9-2b7f-4880-a79b-5bc498147bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42f1a0ff1fb47fdbf291e216b505294'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.624555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515be36-0570-4c40-a067-3d50a88cd915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:16.625538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-02483fa9-2b7f-4880-a79b-5bc498147bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42f1a0ff1fb47fdbf291e216b505294'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.626372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-02483fa9-2b7f-4880-a79b-5bc498147bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42f1a0ff1fb47fdbf291e216b505294'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.626513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515be36-0570-4c40-a067-3d50a88cd915 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:16.627240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-02483fa9-2b7f-4880-a79b-5bc498147bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42f1a0ff1fb47fdbf291e216b505294'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.641127 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1068/2161] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:16.642831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-02483fa9-2b7f-4880-a79b-5bc498147bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42f1a0ff1fb47fdbf291e216b505294'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.643119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515be36-0570-4c40-a067-3d50a88cd915 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:16.645391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7515be36-0570-4c40-a067-3d50a88cd915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:16.662114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515be36-0570-4c40-a067-3d50a88cd915 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:16.668689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d42a8-f663-45eb-862e-ed6c8c212a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:16.669605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d42a8-f663-45eb-862e-ed6c8c212a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:16.670017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d42a8-f663-45eb-862e-ed6c8c212a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:16.670333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d42a8-f663-45eb-862e-ed6c8c212a28 admin admin] PATH_INFO: `/v3/users/1dd0cdd95d29481faae2b41262b5585c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:16.672588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d42a8-f663-45eb-862e-ed6c8c212a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd0cdd95d29481faae2b41262b5585c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:16.674671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d42a8-f663-45eb-862e-ed6c8c212a28 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:16.675120 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1094/2162] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:16 2022] DELETE /identity/v3/users/e42f1a0ff1fb47fdbf291e216b505294 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:52:16.676898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc33a9-b331-48b4-bc56-9e31ad7a24a3 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:16.677245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc33a9-b331-48b4-bc56-9e31ad7a24a3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:16.677829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc33a9-b331-48b4-bc56-9e31ad7a24a3 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:16.678942 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1095/2163] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:16.686325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc33a9-b331-48b4-bc56-9e31ad7a24a3 None None] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:16.689922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-43dc33a9-b331-48b4-bc56-9e31ad7a24a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:16.761490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-126d42a8-f663-45eb-862e-ed6c8c212a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd0cdd95d29481faae2b41262b5585c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.776677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:16.785586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-126d42a8-f663-45eb-862e-ed6c8c212a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd0cdd95d29481faae2b41262b5585c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.786534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-126d42a8-f663-45eb-862e-ed6c8c212a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd0cdd95d29481faae2b41262b5585c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.788378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-126d42a8-f663-45eb-862e-ed6c8c212a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd0cdd95d29481faae2b41262b5585c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.809050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-126d42a8-f663-45eb-862e-ed6c8c212a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd0cdd95d29481faae2b41262b5585c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:16.832446 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1069/2164] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:16 2022] DELETE /identity/v3/users/1dd0cdd95d29481faae2b41262b5585c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:16.835595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cf76e-d500-46b7-bb63-4a49b8893d54 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:16.836163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cf76e-d500-46b7-bb63-4a49b8893d54 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:16.836384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cf76e-d500-46b7-bb63-4a49b8893d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:16.860964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a42cf76e-d500-46b7-bb63-4a49b8893d54 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:16.862323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a42cf76e-d500-46b7-bb63-4a49b8893d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:16.880710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc33a9-b331-48b4-bc56-9e31ad7a24a3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:16.884193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-43dc33a9-b331-48b4-bc56-9e31ad7a24a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:16.945705 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1070/2165] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:16.953600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cf76e-d500-46b7-bb63-4a49b8893d54 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:16.955091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a42cf76e-d500-46b7-bb63-4a49b8893d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:16.988445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:17.063189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cf76e-d500-46b7-bb63-4a49b8893d54 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:17.067214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e69e9-a7a5-4fb6-8152-885e761589dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:17.070023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e69e9-a7a5-4fb6-8152-885e761589dd service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:17.074828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e69e9-a7a5-4fb6-8152-885e761589dd service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:17.075141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e69e9-a7a5-4fb6-8152-885e761589dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:17.075246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc33a9-b331-48b4-bc56-9e31ad7a24a3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:17.091065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e69e9-a7a5-4fb6-8152-885e761589dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:17.091754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e69e9-a7a5-4fb6-8152-885e761589dd service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:17.105068 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1071/2166] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:17.105881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e69e9-a7a5-4fb6-8152-885e761589dd service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:17.107358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-649e69e9-a7a5-4fb6-8152-885e761589dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:17.141285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e69e9-a7a5-4fb6-8152-885e761589dd service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:17.155495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:17.155495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:17.157406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:17.157406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] PATH_INFO: `/v3/projects/607f44f98258408b9f7f77a248328f87` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:17.157874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=607f44f98258408b9f7f77a248328f87)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:17.159888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:17.220662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1048238-89a7-437d-855d-afe388563547 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46fbf1e9a3d43468692e8f8e2015296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b50d15d08bd43c9a52a79894afef944', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:17.221540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1048238-89a7-437d-855d-afe388563547 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:17.221902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1048238-89a7-437d-855d-afe388563547 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:17.222282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1048238-89a7-437d-855d-afe388563547 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] PATH_INFO: `/v3/projects/2599b63499b549eb96e3a5bac0f83b91` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:17.223786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1048238-89a7-437d-855d-afe388563547 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorizing `identity:get_project(project_id=2599b63499b549eb96e3a5bac0f83b91)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:17.229840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1048238-89a7-437d-855d-afe388563547 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:17.233230 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1096/2167] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:16 2022] GET /identity/v3/projects/2599b63499b549eb96e3a5bac0f83b91 => generated 371 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:17.254427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '607f44f98258408b9f7f77a248328f87', 'request_id': 'req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:17.268473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '607f44f98258408b9f7f77a248328f87', 'request_id': 'req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:17.278844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '607f44f98258408b9f7f77a248328f87', 'request_id': 'req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:17.305553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] The token cache is being invalidate because project 607f44f98258408b9f7f77a248328f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:17.306483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:17.307639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:17.311537 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1072/2168] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:17 2022] DELETE /identity/v3/projects/607f44f98258408b9f7f77a248328f87 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:17.318384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100729c-c114-4681-bd9c-57e65c847cb3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:17.318673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100729c-c114-4681-bd9c-57e65c847cb3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:17.319029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100729c-c114-4681-bd9c-57e65c847cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:17.341599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:17.345415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:17.367895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9100729c-c114-4681-bd9c-57e65c847cb3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:17.370082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9100729c-c114-4681-bd9c-57e65c847cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:17.485531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270438b3-7b80-4bb3-9af1-0b77c1db7e9b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:17.496270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1695f4-3a07-4602-90a3-b18c5b671f08 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46fbf1e9a3d43468692e8f8e2015296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b50d15d08bd43c9a52a79894afef944', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:17.497225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1695f4-3a07-4602-90a3-b18c5b671f08 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:17.497727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1695f4-3a07-4602-90a3-b18c5b671f08 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:17.497963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1695f4-3a07-4602-90a3-b18c5b671f08 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:17.499042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1695f4-3a07-4602-90a3-b18c5b671f08 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:17.499129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1695f4-3a07-4602-90a3-b18c5b671f08 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:17.501764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1695f4-3a07-4602-90a3-b18c5b671f08 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:17.539371 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1097/2169] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:17.539371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100729c-c114-4681-bd9c-57e65c847cb3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:17.539371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9100729c-c114-4681-bd9c-57e65c847cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:17.549928 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1073/2170] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:17.549928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1ef4a-0869-46be-9fe4-78881d3082c4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:17.549928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1ef4a-0869-46be-9fe4-78881d3082c4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:17.549928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1ef4a-0869-46be-9fe4-78881d3082c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:17.566159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100729c-c114-4681-bd9c-57e65c847cb3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:17.571750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:17.572416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:17.572703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:17.572981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] PATH_INFO: `/v3/projects/0945c84b75684f219c7b50ebb4a009ee` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:17.574271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0945c84b75684f219c7b50ebb4a009ee)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:17.577155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:17.585635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3ff1ef4a-0869-46be-9fe4-78881d3082c4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:17.587442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3ff1ef4a-0869-46be-9fe4-78881d3082c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:17.589134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:17.604829 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1074/2171] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:17.604829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1ef4a-0869-46be-9fe4-78881d3082c4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:17.619305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1ef4a-0869-46be-9fe4-78881d3082c4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:17.627044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b107b4-0c28-4885-b77f-177054530754 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46fbf1e9a3d43468692e8f8e2015296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b50d15d08bd43c9a52a79894afef944', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:17.627749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b107b4-0c28-4885-b77f-177054530754 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:17.628040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b107b4-0c28-4885-b77f-177054530754 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:17.628319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b107b4-0c28-4885-b77f-177054530754 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:17.628966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b107b4-0c28-4885-b77f-177054530754 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:17.632224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b107b4-0c28-4885-b77f-177054530754 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:17.683937 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1075/2172] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:17 2022] POST /identity/v3/users => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:17.684933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b107b4-0c28-4885-b77f-177054530754 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:17.699819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b107b4-0c28-4885-b77f-177054530754 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:17.711131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0945c84b75684f219c7b50ebb4a009ee', 'request_id': 'req-544aed4a-17e4-48c6-98ca-733de6224af6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:17.719834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:17.724547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0945c84b75684f219c7b50ebb4a009ee', 'request_id': 'req-544aed4a-17e4-48c6-98ca-733de6224af6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:17.738509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0945c84b75684f219c7b50ebb4a009ee', 'request_id': 'req-544aed4a-17e4-48c6-98ca-733de6224af6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:17.771098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] The token cache is being invalidate because project 0945c84b75684f219c7b50ebb4a009ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:17.771427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:17.772194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:17.778860 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1098/2173] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:17 2022] DELETE /identity/v3/projects/0945c84b75684f219c7b50ebb4a009ee => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:17.778860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:17.779537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:17.826855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf39d58-bed6-4f2f-9533-35aea165d760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:17.828321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf39d58-bed6-4f2f-9533-35aea165d760 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:17.828503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf39d58-bed6-4f2f-9533-35aea165d760 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:17.829753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf39d58-bed6-4f2f-9533-35aea165d760 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:17.830570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf39d58-bed6-4f2f-9533-35aea165d760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:17.831056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf39d58-bed6-4f2f-9533-35aea165d760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:17.833268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf39d58-bed6-4f2f-9533-35aea165d760 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:17.856620 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1076/2174] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:17.857631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf39d58-bed6-4f2f-9533-35aea165d760 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:17.864539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-faf39d58-bed6-4f2f-9533-35aea165d760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:17.882535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf39d58-bed6-4f2f-9533-35aea165d760 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:17.890411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca784909-0ef3-4df9-8a41-ff73adbcbf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:17.891649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca784909-0ef3-4df9-8a41-ff73adbcbf05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:17.892032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca784909-0ef3-4df9-8a41-ff73adbcbf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:17.892739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca784909-0ef3-4df9-8a41-ff73adbcbf05 admin admin] PATH_INFO: `/v3/users/a73f9036025641368e51b62cb6e691b6` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:17.894121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca784909-0ef3-4df9-8a41-ff73adbcbf05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73f9036025641368e51b62cb6e691b6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:17.896604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca784909-0ef3-4df9-8a41-ff73adbcbf05 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:17.900615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544aed4a-17e4-48c6-98ca-733de6224af6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:17.910754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75c733-c283-404d-aaf8-72c35f1769d3 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46fbf1e9a3d43468692e8f8e2015296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b50d15d08bd43c9a52a79894afef944', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:17.911385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75c733-c283-404d-aaf8-72c35f1769d3 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:17.911694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75c733-c283-404d-aaf8-72c35f1769d3 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:17.911935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75c733-c283-404d-aaf8-72c35f1769d3 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:17.912754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75c733-c283-404d-aaf8-72c35f1769d3 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:17.912989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75c733-c283-404d-aaf8-72c35f1769d3 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:17.915386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75c733-c283-404d-aaf8-72c35f1769d3 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:17.951346 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1099/2175] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:17.951346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75c733-c283-404d-aaf8-72c35f1769d3 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:17.951910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fa75c733-c283-404d-aaf8-72c35f1769d3 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:17.992820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75c733-c283-404d-aaf8-72c35f1769d3 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:18.001118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db5e22-caac-4ab8-9c0c-d5fe714e5e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:18.006159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ca784909-0ef3-4df9-8a41-ff73adbcbf05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73f9036025641368e51b62cb6e691b6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:18.016566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db5e22-caac-4ab8-9c0c-d5fe714e5e43 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:18.016935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db5e22-caac-4ab8-9c0c-d5fe714e5e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:18.017901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db5e22-caac-4ab8-9c0c-d5fe714e5e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:18.018081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db5e22-caac-4ab8-9c0c-d5fe714e5e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:18.021759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db5e22-caac-4ab8-9c0c-d5fe714e5e43 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:18.024886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ca784909-0ef3-4df9-8a41-ff73adbcbf05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73f9036025641368e51b62cb6e691b6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:18.025695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ca784909-0ef3-4df9-8a41-ff73adbcbf05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73f9036025641368e51b62cb6e691b6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:18.026345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ca784909-0ef3-4df9-8a41-ff73adbcbf05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73f9036025641368e51b62cb6e691b6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:18.042570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ca784909-0ef3-4df9-8a41-ff73adbcbf05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73f9036025641368e51b62cb6e691b6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:18.074396 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1077/2176] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:17 2022] DELETE /identity/v3/users/a73f9036025641368e51b62cb6e691b6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:18.074396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778a83-b6d6-4434-ac8c-5a94e0ec40c1 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:18.074396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778a83-b6d6-4434-ac8c-5a94e0ec40c1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:18.074396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778a83-b6d6-4434-ac8c-5a94e0ec40c1 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:18.074396 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1078/2177] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:18.080496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778a83-b6d6-4434-ac8c-5a94e0ec40c1 None None] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:18.084819 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1100/2178] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:17 2022] POST /identity/v3/projects => generated 395 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:18.085224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c4778a83-b6d6-4434-ac8c-5a94e0ec40c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:18.088985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db5e22-caac-4ab8-9c0c-d5fe714e5e43 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:18.092478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b6db5e22-caac-4ab8-9c0c-d5fe714e5e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:18.244222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db5e22-caac-4ab8-9c0c-d5fe714e5e43 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:18.258890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cade0-f4b1-4444-adf5-dfab6990e44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:18.259655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cade0-f4b1-4444-adf5-dfab6990e44e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:18.260423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cade0-f4b1-4444-adf5-dfab6990e44e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:18.260711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cade0-f4b1-4444-adf5-dfab6990e44e admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:18.261662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cade0-f4b1-4444-adf5-dfab6990e44e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:18.264037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cade0-f4b1-4444-adf5-dfab6990e44e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:18.279677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778a83-b6d6-4434-ac8c-5a94e0ec40c1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:18.279845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:18.280957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c4778a83-b6d6-4434-ac8c-5a94e0ec40c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:18.316993 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1101/2179] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:18 2022] POST /identity/v3/users => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:18.318919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cade0-f4b1-4444-adf5-dfab6990e44e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:18.331443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cade0-f4b1-4444-adf5-dfab6990e44e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:18.339697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d763d5-fc0e-4075-835c-554613acfd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:18.340548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d763d5-fc0e-4075-835c-554613acfd9f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:18.340942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d763d5-fc0e-4075-835c-554613acfd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:18.341367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d763d5-fc0e-4075-835c-554613acfd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:18.344050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d763d5-fc0e-4075-835c-554613acfd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:18.345050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d763d5-fc0e-4075-835c-554613acfd9f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:18.349788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:18.368892 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1102/2180] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:18.382368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d763d5-fc0e-4075-835c-554613acfd9f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:18.405220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d763d5-fc0e-4075-835c-554613acfd9f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:18.419852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8481182-e75f-4642-80a5-4f753886ce8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:18.421975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8481182-e75f-4642-80a5-4f753886ce8e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:18.422581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8481182-e75f-4642-80a5-4f753886ce8e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:18.422854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8481182-e75f-4642-80a5-4f753886ce8e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:18.423509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8481182-e75f-4642-80a5-4f753886ce8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:18.430097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8481182-e75f-4642-80a5-4f753886ce8e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:18.450193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778a83-b6d6-4434-ac8c-5a94e0ec40c1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:18.468732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078afeb-5888-491f-a235-eebdccfb159a tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46fbf1e9a3d43468692e8f8e2015296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b50d15d08bd43c9a52a79894afef944', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:18.470986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078afeb-5888-491f-a235-eebdccfb159a tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:18.471213 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1103/2181] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:18.471320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078afeb-5888-491f-a235-eebdccfb159a tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:18.471523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078afeb-5888-491f-a235-eebdccfb159a tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] PATH_INFO: `/v3/projects/2599b63499b549eb96e3a5bac0f83b91` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:18.472158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8481182-e75f-4642-80a5-4f753886ce8e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:18.479288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a8481182-e75f-4642-80a5-4f753886ce8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:18.483219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078afeb-5888-491f-a235-eebdccfb159a tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorizing `identity:get_project(project_id=2599b63499b549eb96e3a5bac0f83b91)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:18.496253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078afeb-5888-491f-a235-eebdccfb159a tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:18.498211 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1079/2182] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:18 2022] GET /identity/v3/projects/2599b63499b549eb96e3a5bac0f83b91 => generated 371 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:18.499108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078afeb-5888-491f-a235-eebdccfb159a tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:18.512691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078afeb-5888-491f-a235-eebdccfb159a tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:18.518424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ef3f8-6c01-4376-ab33-69973ff84e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:18.520782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ef3f8-6c01-4376-ab33-69973ff84e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:18.521072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ef3f8-6c01-4376-ab33-69973ff84e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:18.521454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ef3f8-6c01-4376-ab33-69973ff84e23 admin admin] PATH_INFO: `/v3/projects/4e5f13ede0474c1888ffb1f7168daf67/users/037c74c1e22148c6ba7612cb03d8bd02/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:18.521928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8481182-e75f-4642-80a5-4f753886ce8e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:18.537439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af03bec-5bbb-4535-9eda-be18effdfc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:18.538197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af03bec-5bbb-4535-9eda-be18effdfc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:18.538757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af03bec-5bbb-4535-9eda-be18effdfc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:18.539016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af03bec-5bbb-4535-9eda-be18effdfc49 admin admin] PATH_INFO: `/v3/projects/7cb6f1a170084c72a1ef608cdeb3a2aa` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:18.541430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af03bec-5bbb-4535-9eda-be18effdfc49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb6f1a170084c72a1ef608cdeb3a2aa)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:18.542339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ef3f8-6c01-4376-ab33-69973ff84e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5f13ede0474c1888ffb1f7168daf67, user_id=037c74c1e22148c6ba7612cb03d8bd02, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:18.544411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af03bec-5bbb-4535-9eda-be18effdfc49 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:18.547410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ef3f8-6c01-4376-ab33-69973ff84e23 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:18.584128 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1080/2183] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:18 2022] PUT /identity/v3/projects/4e5f13ede0474c1888ffb1f7168daf67/users/037c74c1e22148c6ba7612cb03d8bd02/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:18.597618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38d5dd-c116-4fed-b8a5-4f77e39afe8c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:18.597951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38d5dd-c116-4fed-b8a5-4f77e39afe8c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:18.598246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38d5dd-c116-4fed-b8a5-4f77e39afe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:18.626439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5af03bec-5bbb-4535-9eda-be18effdfc49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb6f1a170084c72a1ef608cdeb3a2aa', 'request_id': 'req-5af03bec-5bbb-4535-9eda-be18effdfc49'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:18.637763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5af03bec-5bbb-4535-9eda-be18effdfc49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb6f1a170084c72a1ef608cdeb3a2aa', 'request_id': 'req-5af03bec-5bbb-4535-9eda-be18effdfc49'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:18.645539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5af03bec-5bbb-4535-9eda-be18effdfc49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb6f1a170084c72a1ef608cdeb3a2aa', 'request_id': 'req-5af03bec-5bbb-4535-9eda-be18effdfc49'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:18.659194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5af03bec-5bbb-4535-9eda-be18effdfc49 admin admin] The token cache is being invalidate because project 7cb6f1a170084c72a1ef608cdeb3a2aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:18.659638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5af03bec-5bbb-4535-9eda-be18effdfc49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:18.660166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5af03bec-5bbb-4535-9eda-be18effdfc49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:18.661018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9f38d5dd-c116-4fed-b8a5-4f77e39afe8c None None] MFA Rules not processed for user `037c74c1e22148c6ba7612cb03d8bd02`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:18.662346 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1104/2184] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:18 2022] DELETE /identity/v3/projects/7cb6f1a170084c72a1ef608cdeb3a2aa => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:18.664439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9f38d5dd-c116-4fed-b8a5-4f77e39afe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:18.667578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d982-4e71-41a8-bcf2-3a0a7ed2afb8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:18.668050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d982-4e71-41a8-bcf2-3a0a7ed2afb8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:18.668342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d982-4e71-41a8-bcf2-3a0a7ed2afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:18.703760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a584d982-4e71-41a8-bcf2-3a0a7ed2afb8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:18.705288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a584d982-4e71-41a8-bcf2-3a0a7ed2afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:18.787436 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1081/2185] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:52:18.791590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38d5dd-c116-4fed-b8a5-4f77e39afe8c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:18.794131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9f38d5dd-c116-4fed-b8a5-4f77e39afe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:18.883813 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1105/2186] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:18.885096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3760c3-55bc-4d4a-a0ef-d75d65bbdfbc None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:18.885709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3760c3-55bc-4d4a-a0ef-d75d65bbdfbc None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:18.885992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3760c3-55bc-4d4a-a0ef-d75d65bbdfbc None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:18.887532 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1106/2187] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:18.897116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abbcda-c78c-4a43-9a6b-236f44155510 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:18.897542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abbcda-c78c-4a43-9a6b-236f44155510 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:18.897719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abbcda-c78c-4a43-9a6b-236f44155510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:18.938690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38d5dd-c116-4fed-b8a5-4f77e39afe8c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:18.940438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-96abbcda-c78c-4a43-9a6b-236f44155510 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:18.941939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-96abbcda-c78c-4a43-9a6b-236f44155510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:18.945482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa9187-518c-4369-a891-154808aadf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:18.946096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa9187-518c-4369-a891-154808aadf4c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:18.946371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa9187-518c-4369-a891-154808aadf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:18.946637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa9187-518c-4369-a891-154808aadf4c admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:18.947410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa9187-518c-4369-a891-154808aadf4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:18.949522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa9187-518c-4369-a891-154808aadf4c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:18.952013 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1107/2188] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:18.954236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abbcda-c78c-4a43-9a6b-236f44155510 None None] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:18.955550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-96abbcda-c78c-4a43-9a6b-236f44155510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:18.987848 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1082/2189] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:18 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:52:18.987848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa9187-518c-4369-a891-154808aadf4c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:19.000060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:19.068988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:19.097615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa9187-518c-4369-a891-154808aadf4c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:19.109983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5a0d4-9fea-4d40-8f5f-35fab1708089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:19.113138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a0d4-9fea-4d40-8f5f-35fab1708089 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:19.113449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a0d4-9fea-4d40-8f5f-35fab1708089 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:19.114780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a0d4-9fea-4d40-8f5f-35fab1708089 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:19.115473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5a0d4-9fea-4d40-8f5f-35fab1708089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:19.117792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5a0d4-9fea-4d40-8f5f-35fab1708089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:19.118389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abbcda-c78c-4a43-9a6b-236f44155510 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:19.121586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5a0d4-9fea-4d40-8f5f-35fab1708089 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:19.125832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-96abbcda-c78c-4a43-9a6b-236f44155510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:19.150662 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1083/2190] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:19.151994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5a0d4-9fea-4d40-8f5f-35fab1708089 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:19.171310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5a0d4-9fea-4d40-8f5f-35fab1708089 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:19.182262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64e50a-54e8-4d71-a67c-b3a56db9918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:19.182878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64e50a-54e8-4d71-a67c-b3a56db9918c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:19.183156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64e50a-54e8-4d71-a67c-b3a56db9918c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:19.183428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64e50a-54e8-4d71-a67c-b3a56db9918c admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:19.186241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64e50a-54e8-4d71-a67c-b3a56db9918c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:19.193332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64e50a-54e8-4d71-a67c-b3a56db9918c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:19.236601 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1084/2191] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:19 2022] POST /identity/v3/users => generated 303 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:19.241284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64e50a-54e8-4d71-a67c-b3a56db9918c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:19.261760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64e50a-54e8-4d71-a67c-b3a56db9918c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:19.270132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7d9e6-25fd-4435-994d-2a4e6f261a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:19.271226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7d9e6-25fd-4435-994d-2a4e6f261a39 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:19.271657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7d9e6-25fd-4435-994d-2a4e6f261a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:19.271949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7d9e6-25fd-4435-994d-2a4e6f261a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:19.272623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7d9e6-25fd-4435-994d-2a4e6f261a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:19.275783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7d9e6-25fd-4435-994d-2a4e6f261a39 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:19.309645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abbcda-c78c-4a43-9a6b-236f44155510 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:19.319957 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1085/2192] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:19 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:19.322058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7d9e6-25fd-4435-994d-2a4e6f261a39 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:19.396483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f3854-f8bf-4773-b7de-f1b82b0be9ad tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46fbf1e9a3d43468692e8f8e2015296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b50d15d08bd43c9a52a79894afef944', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:19.397127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f3854-f8bf-4773-b7de-f1b82b0be9ad tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:19.397444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f3854-f8bf-4773-b7de-f1b82b0be9ad tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:19.397714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f3854-f8bf-4773-b7de-f1b82b0be9ad tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] PATH_INFO: `/v3/projects/2599b63499b549eb96e3a5bac0f83b91` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:19.399252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f3854-f8bf-4773-b7de-f1b82b0be9ad tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorizing `identity:get_project(project_id=2599b63499b549eb96e3a5bac0f83b91)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:19.400884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f3854-f8bf-4773-b7de-f1b82b0be9ad tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:19.402904 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1108/2193] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:18 2022] GET /identity/v3/projects/2599b63499b549eb96e3a5bac0f83b91 => generated 371 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:19.403747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f3854-f8bf-4773-b7de-f1b82b0be9ad tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:19.420693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f3854-f8bf-4773-b7de-f1b82b0be9ad tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:19.507284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7d9e6-25fd-4435-994d-2a4e6f261a39 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:19.522105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2b37c-3a7a-4a67-ab81-22ce0ec723bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:19.522750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2b37c-3a7a-4a67-ab81-22ce0ec723bc admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:19.523029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2b37c-3a7a-4a67-ab81-22ce0ec723bc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:19.523299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2b37c-3a7a-4a67-ab81-22ce0ec723bc admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:19.524311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2b37c-3a7a-4a67-ab81-22ce0ec723bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:19.525965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2b37c-3a7a-4a67-ab81-22ce0ec723bc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:19.540967 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1086/2194] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:19.541854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2b37c-3a7a-4a67-ab81-22ce0ec723bc admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:19.558900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac63f75-098e-4617-9ccd-d04a591b053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:19.560070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac63f75-098e-4617-9ccd-d04a591b053b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:19.560462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac63f75-098e-4617-9ccd-d04a591b053b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:19.560746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac63f75-098e-4617-9ccd-d04a591b053b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:19.561474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac63f75-098e-4617-9ccd-d04a591b053b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:19.565005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac63f75-098e-4617-9ccd-d04a591b053b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:19.606362 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1109/2195] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:19 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:19.607281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac63f75-098e-4617-9ccd-d04a591b053b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:19.628329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac63f75-098e-4617-9ccd-d04a591b053b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:19.646466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1b9fc-8c0d-48c4-b065-65379f598e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:19.646466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1b9fc-8c0d-48c4-b065-65379f598e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:19.646466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1b9fc-8c0d-48c4-b065-65379f598e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:19.646979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1b9fc-8c0d-48c4-b065-65379f598e7e admin admin] PATH_INFO: `/v3/projects/2a09abdfb79747df96697a13a2415cd2/users/55a608d850cb40e09ee0afa7d5789577/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:19.685340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1b9fc-8c0d-48c4-b065-65379f598e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a09abdfb79747df96697a13a2415cd2, user_id=55a608d850cb40e09ee0afa7d5789577, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:19.696505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2b37c-3a7a-4a67-ab81-22ce0ec723bc admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:19.699335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1b9fc-8c0d-48c4-b065-65379f598e7e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:19.715858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:19.720707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46fbf1e9a3d43468692e8f8e2015296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b50d15d08bd43c9a52a79894afef944', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:19.721644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:19.722076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:19.722658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] PATH_INFO: `/v3/users/913dc107347c4ccbb378eb59ade56891` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:19.725898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:19.726065 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1110/2196] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:19 2022] PUT /identity/v3/projects/2a09abdfb79747df96697a13a2415cd2/users/55a608d850cb40e09ee0afa7d5789577/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:19.729277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1b9fc-8c0d-48c4-b065-65379f598e7e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:19.734432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-08a1b9fc-8c0d-48c4-b065-65379f598e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:19.751639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorizing `identity:delete_user(user_id=913dc107347c4ccbb378eb59ade56891)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:19.754682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:19.834431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1b9fc-8c0d-48c4-b065-65379f598e7e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:19.840877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:19.841663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:19.842050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:19.842484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] PATH_INFO: `/v3/users/1916262d539f47998ee7bf15f882c37c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:19.844373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1916262d539f47998ee7bf15f882c37c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:19.846493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:19.867970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913dc107347c4ccbb378eb59ade56891'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:19.889021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913dc107347c4ccbb378eb59ade56891'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:19.891930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913dc107347c4ccbb378eb59ade56891'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:19.894253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913dc107347c4ccbb378eb59ade56891'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:19.936508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913dc107347c4ccbb378eb59ade56891'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:19.947762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1916262d539f47998ee7bf15f882c37c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:19.957751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1916262d539f47998ee7bf15f882c37c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:19.959340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1916262d539f47998ee7bf15f882c37c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:19.960274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1916262d539f47998ee7bf15f882c37c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:19.960869 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1087/2197] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:19 2022] DELETE /identity/v3/users/913dc107347c4ccbb378eb59ade56891 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:19.964597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:19.964597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:19.984191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1916262d539f47998ee7bf15f882c37c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.020059 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1111/2198] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:19 2022] DELETE /identity/v3/users/1916262d539f47998ee7bf15f882c37c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:20.020059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:20.020059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:20.128352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec155743-4973-4da9-81dd-26f26010dafc tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:20.162042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1eb235-ffcf-4c14-86ca-6d0135f16830 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:20.166911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b79ee9-36ec-4b05-886e-5b8a6987fcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:20.167528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b79ee9-36ec-4b05-886e-5b8a6987fcdf admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:20.167843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b79ee9-36ec-4b05-886e-5b8a6987fcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:20.168059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b79ee9-36ec-4b05-886e-5b8a6987fcdf admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:20.168707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b79ee9-36ec-4b05-886e-5b8a6987fcdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:20.170931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b79ee9-36ec-4b05-886e-5b8a6987fcdf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:20.184147 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1112/2199] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:20.185086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b79ee9-36ec-4b05-886e-5b8a6987fcdf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:20.187652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-51b79ee9-36ec-4b05-886e-5b8a6987fcdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:20.217628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:20.260158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ef5b7-5b93-4882-aca7-40015dc7251c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:20.260951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ef5b7-5b93-4882-aca7-40015dc7251c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:20.261510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ef5b7-5b93-4882-aca7-40015dc7251c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:20.261693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ef5b7-5b93-4882-aca7-40015dc7251c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:20.265908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ef5b7-5b93-4882-aca7-40015dc7251c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:20.268317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ef5b7-5b93-4882-aca7-40015dc7251c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:20.297724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b79ee9-36ec-4b05-886e-5b8a6987fcdf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:20.303388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46fbf1e9a3d43468692e8f8e2015296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b50d15d08bd43c9a52a79894afef944', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:20.304161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:20.304549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:20.304936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] PATH_INFO: `/v3/projects/2599b63499b549eb96e3a5bac0f83b91` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:20.305712 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1088/2200] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:20.306403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2599b63499b549eb96e3a5bac0f83b91)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:20.307836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47755-62ef-453e-b7a5-3efe510da047 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:20.308130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47755-62ef-453e-b7a5-3efe510da047 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:20.308412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47755-62ef-453e-b7a5-3efe510da047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:20.309892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:20.383917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-69f47755-62ef-453e-b7a5-3efe510da047 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:20.387505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-69f47755-62ef-453e-b7a5-3efe510da047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:20.401216 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1089/2201] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:20.403071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f47755-62ef-453e-b7a5-3efe510da047 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:20.404496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-69f47755-62ef-453e-b7a5-3efe510da047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:20.420024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:20.427456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f47755-62ef-453e-b7a5-3efe510da047 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:20.428190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2599b63499b549eb96e3a5bac0f83b91', 'request_id': 'req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.439453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2599b63499b549eb96e3a5bac0f83b91', 'request_id': 'req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.465927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2599b63499b549eb96e3a5bac0f83b91', 'request_id': 'req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.490174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] The token cache is being invalidate because project 2599b63499b549eb96e3a5bac0f83b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:20.490627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.491951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.495090 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1113/2202] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:20 2022] DELETE /identity/v3/projects/2599b63499b549eb96e3a5bac0f83b91 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:20.496244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:20.500709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:20.513557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:20.514385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:20.514510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:20.514771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] PATH_INFO: `/v3/users/9fcee064c12e41079f451f88ab235dde` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:20.516814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fcee064c12e41079f451f88ab235dde)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:20.518827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:20.627922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de6b35-f82b-40c2-81b6-92e2d5ed56c4 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:20.630139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fcee064c12e41079f451f88ab235dde'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.638010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ccb03-77ad-4ac5-be9b-b89ac0d3a0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:20.638166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fcee064c12e41079f451f88ab235dde'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.638688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ccb03-77ad-4ac5-be9b-b89ac0d3a0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:20.638797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fcee064c12e41079f451f88ab235dde'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.639104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ccb03-77ad-4ac5-be9b-b89ac0d3a0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:20.639375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fcee064c12e41079f451f88ab235dde'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.639471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ccb03-77ad-4ac5-be9b-b89ac0d3a0f8 admin admin] PATH_INFO: `/v3/projects/2a09abdfb79747df96697a13a2415cd2/users/55a608d850cb40e09ee0afa7d5789577/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:20.642688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ccb03-77ad-4ac5-be9b-b89ac0d3a0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a09abdfb79747df96697a13a2415cd2, user_id=55a608d850cb40e09ee0afa7d5789577, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:20.646722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ccb03-77ad-4ac5-be9b-b89ac0d3a0f8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:20.653308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fcee064c12e41079f451f88ab235dde'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.660853 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1114/2203] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:20 2022] PUT /identity/v3/projects/2a09abdfb79747df96697a13a2415cd2/users/55a608d850cb40e09ee0afa7d5789577/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:20.661717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ccb03-77ad-4ac5-be9b-b89ac0d3a0f8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:20.663307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9b4ccb03-77ad-4ac5-be9b-b89ac0d3a0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:20.681125 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1090/2204] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:20 2022] DELETE /identity/v3/users/9fcee064c12e41079f451f88ab235dde => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:20.681125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:20.681125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:20.717623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:20.746336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12aab9-0187-4a4c-bc85-a6a3bf76cc3f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:20.748290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ccb03-77ad-4ac5-be9b-b89ac0d3a0f8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:20.750594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0555c50-3061-498a-a383-8d7730f03585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:20.751201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0555c50-3061-498a-a383-8d7730f03585 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:20.751481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0555c50-3061-498a-a383-8d7730f03585 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:20.751753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0555c50-3061-498a-a383-8d7730f03585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:20.753613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c0555c50-3061-498a-a383-8d7730f03585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:20.802562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:20.822063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d00a30-2713-4948-81ad-585784798498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:20.822713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d00a30-2713-4948-81ad-585784798498 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:20.822993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d00a30-2713-4948-81ad-585784798498 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:20.823260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d00a30-2713-4948-81ad-585784798498 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:20.823908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d00a30-2713-4948-81ad-585784798498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:20.825580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d00a30-2713-4948-81ad-585784798498 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:20.835907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0555c50-3061-498a-a383-8d7730f03585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:20.837316 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1115/2205] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:20.837434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0555c50-3061-498a-a383-8d7730f03585 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:20.838152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d00a30-2713-4948-81ad-585784798498 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:20.840171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-31d00a30-2713-4948-81ad-585784798498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:20.847495 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1091/2206] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:20.853738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d00a30-2713-4948-81ad-585784798498 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:20.855593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0555c50-3061-498a-a383-8d7730f03585 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:20.857497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c0555c50-3061-498a-a383-8d7730f03585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:20.861284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acde604-0ae4-4300-906e-2442c2b8be60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:20.861926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde604-0ae4-4300-906e-2442c2b8be60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:20.862304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde604-0ae4-4300-906e-2442c2b8be60 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:20.862585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde604-0ae4-4300-906e-2442c2b8be60 admin admin] PATH_INFO: `/v3/users/2b8c50ced9114ebf8abb7d40cee1c099` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:20.863735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acde604-0ae4-4300-906e-2442c2b8be60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8c50ced9114ebf8abb7d40cee1c099)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:20.865832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acde604-0ae4-4300-906e-2442c2b8be60 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:20.876600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0555c50-3061-498a-a383-8d7730f03585 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:20.885818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46bc7f-0da1-428d-aaea-67219c31148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:20.887923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46bc7f-0da1-428d-aaea-67219c31148f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:20.888715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46bc7f-0da1-428d-aaea-67219c31148f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:20.889007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46bc7f-0da1-428d-aaea-67219c31148f admin admin] PATH_INFO: `/v3/users/d8da7d5210cf42bda150d342ff207bbd` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:20.891718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46bc7f-0da1-428d-aaea-67219c31148f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8da7d5210cf42bda150d342ff207bbd)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:20.895165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46bc7f-0da1-428d-aaea-67219c31148f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:20.928991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7acde604-0ae4-4300-906e-2442c2b8be60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8c50ced9114ebf8abb7d40cee1c099'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.942444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7acde604-0ae4-4300-906e-2442c2b8be60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8c50ced9114ebf8abb7d40cee1c099'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.942665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7acde604-0ae4-4300-906e-2442c2b8be60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8c50ced9114ebf8abb7d40cee1c099'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.943261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7acde604-0ae4-4300-906e-2442c2b8be60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8c50ced9114ebf8abb7d40cee1c099'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.956283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df46bc7f-0da1-428d-aaea-67219c31148f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8da7d5210cf42bda150d342ff207bbd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.959259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7acde604-0ae4-4300-906e-2442c2b8be60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8c50ced9114ebf8abb7d40cee1c099'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.963818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df46bc7f-0da1-428d-aaea-67219c31148f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8da7d5210cf42bda150d342ff207bbd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.964580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df46bc7f-0da1-428d-aaea-67219c31148f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8da7d5210cf42bda150d342ff207bbd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.965497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df46bc7f-0da1-428d-aaea-67219c31148f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8da7d5210cf42bda150d342ff207bbd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.977282 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1116/2207] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:20 2022] DELETE /identity/v3/users/2b8c50ced9114ebf8abb7d40cee1c099 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:20.980201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df46bc7f-0da1-428d-aaea-67219c31148f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8da7d5210cf42bda150d342ff207bbd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:20.981484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5be51-7b42-4955-9241-f7e3ce3a5fc9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:20.982000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5be51-7b42-4955-9241-f7e3ce3a5fc9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:20.982345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5be51-7b42-4955-9241-f7e3ce3a5fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:20.995550 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1092/2208] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:20 2022] DELETE /identity/v3/users/d8da7d5210cf42bda150d342ff207bbd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:20.997597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d102e9-1109-44a8-97e8-fb7303ea1079 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:20.997881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d102e9-1109-44a8-97e8-fb7303ea1079 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:20.998600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d102e9-1109-44a8-97e8-fb7303ea1079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.017620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7fc5be51-7b42-4955-9241-f7e3ce3a5fc9 None None] MFA Rules not processed for user `55a608d850cb40e09ee0afa7d5789577`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:21.019661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7fc5be51-7b42-4955-9241-f7e3ce3a5fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.020229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-79d102e9-1109-44a8-97e8-fb7303ea1079 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:21.021688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-79d102e9-1109-44a8-97e8-fb7303ea1079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.079545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:21.122700 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1093/2209] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:21.126282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d102e9-1109-44a8-97e8-fb7303ea1079 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:21.127754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-79d102e9-1109-44a8-97e8-fb7303ea1079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.130113 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1117/2210] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:21.132574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbff76b-e9db-4de2-be12-31cf87e75f56 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:21.133083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbff76b-e9db-4de2-be12-31cf87e75f56 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:21.133614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbff76b-e9db-4de2-be12-31cf87e75f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.145164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d102e9-1109-44a8-97e8-fb7303ea1079 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:21.151882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fa8d0-4259-4fee-bc3a-49fdd3c048f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:21.153011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fa8d0-4259-4fee-bc3a-49fdd3c048f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:21.153453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fa8d0-4259-4fee-bc3a-49fdd3c048f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:21.153638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fa8d0-4259-4fee-bc3a-49fdd3c048f5 admin admin] PATH_INFO: `/v3/projects/b31e2061bb92458da18022f0d6ddd61e/users/d0a545f14f334ef0ae32cc9629de0c85/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.158027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6bbff76b-e9db-4de2-be12-31cf87e75f56 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:21.160118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6bbff76b-e9db-4de2-be12-31cf87e75f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.169143 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1118/2211] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:21.170225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9315d6-0dc6-44db-a8d9-98964d346306 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:21.170513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9315d6-0dc6-44db-a8d9-98964d346306 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:21.170827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9315d6-0dc6-44db-a8d9-98964d346306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.178195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fa8d0-4259-4fee-bc3a-49fdd3c048f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31e2061bb92458da18022f0d6ddd61e, user_id=d0a545f14f334ef0ae32cc9629de0c85, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:21.180864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fa8d0-4259-4fee-bc3a-49fdd3c048f5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:21.191709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7d9315d6-0dc6-44db-a8d9-98964d346306 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:21.192923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7d9315d6-0dc6-44db-a8d9-98964d346306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.206052 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1094/2212] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:21 2022] PUT /identity/v3/projects/b31e2061bb92458da18022f0d6ddd61e/users/d0a545f14f334ef0ae32cc9629de0c85/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:21.206052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25502114-1802-4fa5-8e3a-3b9fc73fed67 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:21.206052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25502114-1802-4fa5-8e3a-3b9fc73fed67 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:21.206052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25502114-1802-4fa5-8e3a-3b9fc73fed67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.222595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-25502114-1802-4fa5-8e3a-3b9fc73fed67 None None] MFA Rules not processed for user `037c74c1e22148c6ba7612cb03d8bd02`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:21.224025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-25502114-1802-4fa5-8e3a-3b9fc73fed67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.252697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:21.285506 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1119/2213] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:21.289436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9315d6-0dc6-44db-a8d9-98964d346306 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:21.291128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7d9315d6-0dc6-44db-a8d9-98964d346306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.315167 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1095/2214] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:21.315829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25502114-1802-4fa5-8e3a-3b9fc73fed67 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:21.317106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-25502114-1802-4fa5-8e3a-3b9fc73fed67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.355414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9315d6-0dc6-44db-a8d9-98964d346306 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:21.360749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f61bb-ea06-44d3-b7b6-dd495f48599e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:21.361386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f61bb-ea06-44d3-b7b6-dd495f48599e service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:21.361668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f61bb-ea06-44d3-b7b6-dd495f48599e service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:21.361941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f61bb-ea06-44d3-b7b6-dd495f48599e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.372019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f61bb-ea06-44d3-b7b6-dd495f48599e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:21.373614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f61bb-ea06-44d3-b7b6-dd495f48599e service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:21.384605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25502114-1802-4fa5-8e3a-3b9fc73fed67 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:21.384920 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1120/2215] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:21.397486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc91cb-6d79-4ff7-a6b6-f063771d2185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:21.399479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc91cb-6d79-4ff7-a6b6-f063771d2185 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:21.399815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc91cb-6d79-4ff7-a6b6-f063771d2185 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:21.400153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc91cb-6d79-4ff7-a6b6-f063771d2185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.400833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400eecf-0c74-414d-8622-3a60949a2d78 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:21.401072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400eecf-0c74-414d-8622-3a60949a2d78 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:21.401378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400eecf-0c74-414d-8622-3a60949a2d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.413298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc91cb-6d79-4ff7-a6b6-f063771d2185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:21.414744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc91cb-6d79-4ff7-a6b6-f063771d2185 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:21.427502 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1096/2216] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:21.428358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc91cb-6d79-4ff7-a6b6-f063771d2185 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:21.433376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a7fc91cb-6d79-4ff7-a6b6-f063771d2185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.445228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b400eecf-0c74-414d-8622-3a60949a2d78 None None] MFA Rules not processed for user `d0a545f14f334ef0ae32cc9629de0c85`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:21.447517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b400eecf-0c74-414d-8622-3a60949a2d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.451826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc91cb-6d79-4ff7-a6b6-f063771d2185 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:21.459289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:21.459904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:21.460304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:21.460700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] PATH_INFO: `/v3/projects/ef2fd17648b14068b5a681006f95ac9a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.462208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2fd17648b14068b5a681006f95ac9a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:21.465136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:21.551358 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1121/2217] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:21.552326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400eecf-0c74-414d-8622-3a60949a2d78 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:21.555449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2fd17648b14068b5a681006f95ac9a', 'request_id': 'req-d496dc92-515d-4e8a-a3df-c10b65d7404b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:21.563594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:21.568793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400eecf-0c74-414d-8622-3a60949a2d78 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:21.570802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2fd17648b14068b5a681006f95ac9a', 'request_id': 'req-d496dc92-515d-4e8a-a3df-c10b65d7404b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:21.580375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2fd17648b14068b5a681006f95ac9a', 'request_id': 'req-d496dc92-515d-4e8a-a3df-c10b65d7404b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:21.597401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] The token cache is being invalidate because project ef2fd17648b14068b5a681006f95ac9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:21.597766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:21.598433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:21.600445 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1097/2218] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:21 2022] DELETE /identity/v3/projects/ef2fd17648b14068b5a681006f95ac9a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:21.605387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:21.607028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.637420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07db001-ce01-41ad-95ae-94e88ba72ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:21.638368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07db001-ce01-41ad-95ae-94e88ba72ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:21.638685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07db001-ce01-41ad-95ae-94e88ba72ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:21.638925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07db001-ce01-41ad-95ae-94e88ba72ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.640852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d07db001-ce01-41ad-95ae-94e88ba72ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.692267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:21.746236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496dc92-515d-4e8a-a3df-c10b65d7404b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:21.748624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07db001-ce01-41ad-95ae-94e88ba72ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:21.750186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07db001-ce01-41ad-95ae-94e88ba72ec3 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:21.754788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49d009-2f5a-4aa9-895e-458aa3866398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:21.756368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49d009-2f5a-4aa9-895e-458aa3866398 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:21.757364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49d009-2f5a-4aa9-895e-458aa3866398 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:21.757859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49d009-2f5a-4aa9-895e-458aa3866398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.760115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ce49d009-2f5a-4aa9-895e-458aa3866398 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.761108 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1122/2219] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:21.761961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07db001-ce01-41ad-95ae-94e88ba72ec3 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:21.763274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d07db001-ce01-41ad-95ae-94e88ba72ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.775599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07db001-ce01-41ad-95ae-94e88ba72ec3 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:21.782270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df2a00-c94e-4b96-83b5-50d5fded082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:21.782900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2a00-c94e-4b96-83b5-50d5fded082e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:21.783222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2a00-c94e-4b96-83b5-50d5fded082e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:21.783500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2a00-c94e-4b96-83b5-50d5fded082e admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.784244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df2a00-c94e-4b96-83b5-50d5fded082e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:21.786780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df2a00-c94e-4b96-83b5-50d5fded082e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:21.830479 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1123/2220] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:21 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:21.835676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df2a00-c94e-4b96-83b5-50d5fded082e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:21.839148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-34df2a00-c94e-4b96-83b5-50d5fded082e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:21.862573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49d009-2f5a-4aa9-895e-458aa3866398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:21.865313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49d009-2f5a-4aa9-895e-458aa3866398 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:21.902443 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1098/2221] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:21 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:21.923090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49d009-2f5a-4aa9-895e-458aa3866398 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:21.956693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49d009-2f5a-4aa9-895e-458aa3866398 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:21.965761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009f6bd-80ff-4b38-a207-8f989ab9a00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:21.971560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df2a00-c94e-4b96-83b5-50d5fded082e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:21.982048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:21.982696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:21.983000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:21.983254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] PATH_INFO: `/v3/users/63cd351416cb487f9596aab791bfcfa9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.983377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009f6bd-80ff-4b38-a207-8f989ab9a00a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:21.984466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63cd351416cb487f9596aab791bfcfa9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:21.987142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009f6bd-80ff-4b38-a207-8f989ab9a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:21.987246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009f6bd-80ff-4b38-a207-8f989ab9a00a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:21.990501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009f6bd-80ff-4b38-a207-8f989ab9a00a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:21.990746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:21.992672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009f6bd-80ff-4b38-a207-8f989ab9a00a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:22.037922 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1099/2222] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:21 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:22.038789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009f6bd-80ff-4b38-a207-8f989ab9a00a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:22.041275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2009f6bd-80ff-4b38-a207-8f989ab9a00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:22.053862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:22.058650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009f6bd-80ff-4b38-a207-8f989ab9a00a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:22.064916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:22.065847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:22.066134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:22.066426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] PATH_INFO: `/v3/projects/00af80afb88c49e9b6eba209af379f30` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:22.066947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63cd351416cb487f9596aab791bfcfa9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.067747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00af80afb88c49e9b6eba209af379f30)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:22.070069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:22.074924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63cd351416cb487f9596aab791bfcfa9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.075726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63cd351416cb487f9596aab791bfcfa9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.076565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63cd351416cb487f9596aab791bfcfa9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.091548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63cd351416cb487f9596aab791bfcfa9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.113056 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1124/2223] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:21 2022] DELETE /identity/v3/users/63cd351416cb487f9596aab791bfcfa9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:22.113969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:22.115444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:22.128377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00af80afb88c49e9b6eba209af379f30', 'request_id': 'req-1ea3f652-445d-4093-bbae-be288a8a4168'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.138968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00af80afb88c49e9b6eba209af379f30', 'request_id': 'req-1ea3f652-445d-4093-bbae-be288a8a4168'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.148437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00af80afb88c49e9b6eba209af379f30', 'request_id': 'req-1ea3f652-445d-4093-bbae-be288a8a4168'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.166405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] The token cache is being invalidate because project 00af80afb88c49e9b6eba209af379f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:22.166793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.167484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.171000 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1100/2224] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:22 2022] DELETE /identity/v3/projects/00af80afb88c49e9b6eba209af379f30 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:22.174178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:22.178538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:22.211322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e247d56-4be5-497c-8c13-9cfa49c892e7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:22.217913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:22.219612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:22.220087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:22.221003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] PATH_INFO: `/v3/projects/0390dc00d3a24165b407814b3c9982f9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:22.222567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0390dc00d3a24165b407814b3c9982f9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:22.226042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:22.274673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:22.288833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0390dc00d3a24165b407814b3c9982f9', 'request_id': 'req-fdd244af-e221-470f-b492-e4d67d8b2722'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.292149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3f652-445d-4093-bbae-be288a8a4168 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:22.303684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0390dc00d3a24165b407814b3c9982f9', 'request_id': 'req-fdd244af-e221-470f-b492-e4d67d8b2722'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.312361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0390dc00d3a24165b407814b3c9982f9', 'request_id': 'req-fdd244af-e221-470f-b492-e4d67d8b2722'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.332028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] The token cache is being invalidate because project 0390dc00d3a24165b407814b3c9982f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:22.332679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.333457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.335687 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1125/2225] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:22 2022] DELETE /identity/v3/projects/0390dc00d3a24165b407814b3c9982f9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:22.337386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:22.338541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:22.403421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14410f3-7df8-4b88-9238-cdc703d9dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:22.404106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14410f3-7df8-4b88-9238-cdc703d9dd18 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:22.404393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14410f3-7df8-4b88-9238-cdc703d9dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:22.404667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14410f3-7df8-4b88-9238-cdc703d9dd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:22.405888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14410f3-7df8-4b88-9238-cdc703d9dd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:22.409732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14410f3-7df8-4b88-9238-cdc703d9dd18 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:22.426587 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1101/2226] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:22.426587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14410f3-7df8-4b88-9238-cdc703d9dd18 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:22.428229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d14410f3-7df8-4b88-9238-cdc703d9dd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:22.446918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14410f3-7df8-4b88-9238-cdc703d9dd18 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:22.452774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:22.453879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:22.454245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:22.454586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] PATH_INFO: `/v3/projects/d024396aef784f3291630c426a828cf0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:22.455939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d024396aef784f3291630c426a828cf0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:22.459811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:22.464087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:22.524509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd244af-e221-470f-b492-e4d67d8b2722 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:22.542632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:22.544522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:22.544806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:22.545384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] PATH_INFO: `/v3/users/27df69ae40444039af536faf5d884284` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:22.549588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] RBAC: Authorizing `identity:delete_user(user_id=27df69ae40444039af536faf5d884284)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:22.556467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:22.587242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd024396aef784f3291630c426a828cf0', 'request_id': 'req-dc7d3f66-b25a-4e65-a0c1-0062575a7111'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.621517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd024396aef784f3291630c426a828cf0', 'request_id': 'req-dc7d3f66-b25a-4e65-a0c1-0062575a7111'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.635196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd024396aef784f3291630c426a828cf0', 'request_id': 'req-dc7d3f66-b25a-4e65-a0c1-0062575a7111'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.665621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] The token cache is being invalidate because project d024396aef784f3291630c426a828cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:22.665953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.667018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.679754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27df69ae40444039af536faf5d884284'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.696034 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1102/2227] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:22 2022] DELETE /identity/v3/projects/d024396aef784f3291630c426a828cf0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:22.696034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:22.700631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27df69ae40444039af536faf5d884284'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.701605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27df69ae40444039af536faf5d884284'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.703011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27df69ae40444039af536faf5d884284'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.705642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:22.734597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27df69ae40444039af536faf5d884284'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:22.759744 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1126/2228] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:22 2022] DELETE /identity/v3/users/27df69ae40444039af536faf5d884284 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:22.761321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:22.762722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:22.814260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d3f66-b25a-4e65-a0c1-0062575a7111 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:22.873041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:22.886495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d936294-1c71-4814-975f-b5b8387fa79d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:22.898600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30335fb0-3da1-49c5-86a7-1790b742c8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:22.899473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30335fb0-3da1-49c5-86a7-1790b742c8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:22.899840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30335fb0-3da1-49c5-86a7-1790b742c8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:22.900543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30335fb0-3da1-49c5-86a7-1790b742c8ac admin admin] PATH_INFO: `/v3/projects/027467d0f1914e199b9603e4cce327d4/users/0b5ed4e062bc4a5385696d766d03a3f3/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:22.923760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30335fb0-3da1-49c5-86a7-1790b742c8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=027467d0f1914e199b9603e4cce327d4, user_id=0b5ed4e062bc4a5385696d766d03a3f3, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:22.926926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30335fb0-3da1-49c5-86a7-1790b742c8ac admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:22.946824 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1127/2229] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:22 2022] PUT /identity/v3/projects/027467d0f1914e199b9603e4cce327d4/users/0b5ed4e062bc4a5385696d766d03a3f3/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:22.947814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30335fb0-3da1-49c5-86a7-1790b742c8ac admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:22.949678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-30335fb0-3da1-49c5-86a7-1790b742c8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:22.993450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:22.994264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:22.994791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:22.994791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] PATH_INFO: `/v3/users/c46fbf1e9a3d43468692e8f8e2015296` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:23.011635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46fbf1e9a3d43468692e8f8e2015296)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:23.013013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:23.020438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:23.048739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30335fb0-3da1-49c5-86a7-1790b742c8ac admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:23.054926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:23.055789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:23.056384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:23.056842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] PATH_INFO: `/v3/users/779254232db94232a7ff2bfa1104ef25` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:23.058421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] RBAC: Authorizing `identity:delete_user(user_id=779254232db94232a7ff2bfa1104ef25)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:23.060762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:23.111521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46fbf1e9a3d43468692e8f8e2015296'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.127973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46fbf1e9a3d43468692e8f8e2015296'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.129486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46fbf1e9a3d43468692e8f8e2015296'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.130368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46fbf1e9a3d43468692e8f8e2015296'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.138608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '779254232db94232a7ff2bfa1104ef25'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.169533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '779254232db94232a7ff2bfa1104ef25'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.170206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46fbf1e9a3d43468692e8f8e2015296'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.173154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '779254232db94232a7ff2bfa1104ef25'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.174004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '779254232db94232a7ff2bfa1104ef25'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.201770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '779254232db94232a7ff2bfa1104ef25'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.209096 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1103/2230] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:22 2022] DELETE /identity/v3/users/c46fbf1e9a3d43468692e8f8e2015296 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:23.212416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:23.215499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:23.232575 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1128/2231] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:22 2022] DELETE /identity/v3/users/779254232db94232a7ff2bfa1104ef25 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:23.236792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:23.236792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:23.333722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3667f52-568f-4180-9e89-5c0f15d64b8f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:23.367212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab54657-9e3c-48cb-be90-68627361529a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:23.375625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e393a-39c3-49b0-b39e-d111890dd8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:23.376898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e393a-39c3-49b0-b39e-d111890dd8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:23.377755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e393a-39c3-49b0-b39e-d111890dd8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:23.378224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e393a-39c3-49b0-b39e-d111890dd8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:23.379749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e393a-39c3-49b0-b39e-d111890dd8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:23.382255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e393a-39c3-49b0-b39e-d111890dd8f9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:23.432890 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1129/2232] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:23.432890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e393a-39c3-49b0-b39e-d111890dd8f9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:23.434138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a80e393a-39c3-49b0-b39e-d111890dd8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:23.449158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e393a-39c3-49b0-b39e-d111890dd8f9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:23.456360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:23.457046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:23.457408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:23.458221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] PATH_INFO: `/v3/projects/d7e38a3e604b4b0a82db824aa872aef3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:23.458989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e38a3e604b4b0a82db824aa872aef3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:23.460890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:23.499448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:23.518253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f1486-e7c0-4edd-a466-aeb48d378f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:23.518717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1486-e7c0-4edd-a466-aeb48d378f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:23.519004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1486-e7c0-4edd-a466-aeb48d378f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:23.519281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1486-e7c0-4edd-a466-aeb48d378f98 admin admin] PATH_INFO: `/v3/projects/69d75ec37f6146ff9012467b91982ae7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:23.521155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f1486-e7c0-4edd-a466-aeb48d378f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d75ec37f6146ff9012467b91982ae7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:23.523159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f1486-e7c0-4edd-a466-aeb48d378f98 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:23.569596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e38a3e604b4b0a82db824aa872aef3', 'request_id': 'req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.574878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:23.581658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e38a3e604b4b0a82db824aa872aef3', 'request_id': 'req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.594386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e38a3e604b4b0a82db824aa872aef3', 'request_id': 'req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.611519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c9f1486-e7c0-4edd-a466-aeb48d378f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d75ec37f6146ff9012467b91982ae7', 'request_id': 'req-2c9f1486-e7c0-4edd-a466-aeb48d378f98'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.612252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] The token cache is being invalidate because project d7e38a3e604b4b0a82db824aa872aef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:23.613140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.613346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.628290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c9f1486-e7c0-4edd-a466-aeb48d378f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d75ec37f6146ff9012467b91982ae7', 'request_id': 'req-2c9f1486-e7c0-4edd-a466-aeb48d378f98'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.638298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c9f1486-e7c0-4edd-a466-aeb48d378f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d75ec37f6146ff9012467b91982ae7', 'request_id': 'req-2c9f1486-e7c0-4edd-a466-aeb48d378f98'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.642373 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1130/2233] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:23 2022] DELETE /identity/v3/projects/d7e38a3e604b4b0a82db824aa872aef3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:23.660368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:23.669108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:23.670760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c9f1486-e7c0-4edd-a466-aeb48d378f98 admin admin] The token cache is being invalidate because project 69d75ec37f6146ff9012467b91982ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:23.671198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c9f1486-e7c0-4edd-a466-aeb48d378f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.672061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c9f1486-e7c0-4edd-a466-aeb48d378f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:23.674211 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1104/2234] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:23 2022] DELETE /identity/v3/projects/69d75ec37f6146ff9012467b91982ae7 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:23.675636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904b165-21a2-4b40-9d20-58f5952e533c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:23.675998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904b165-21a2-4b40-9d20-58f5952e533c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:23.676341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904b165-21a2-4b40-9d20-58f5952e533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:23.699592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8904b165-21a2-4b40-9d20-58f5952e533c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:23.700827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8904b165-21a2-4b40-9d20-58f5952e533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:23.791708 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1105/2235] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:23.793401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cf7f1-1c3f-4ee7-a9b7-214532d94283 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:23.793840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cf7f1-1c3f-4ee7-a9b7-214532d94283 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:23.794295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cf7f1-1c3f-4ee7-a9b7-214532d94283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:23.810854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63d310-c7ff-43d8-b203-fb56cee0c2d0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:23.817215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f22369-0365-4181-b6da-31bb0c9a124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:23.817896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f22369-0365-4181-b6da-31bb0c9a124a admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:23.818182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f22369-0365-4181-b6da-31bb0c9a124a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:23.818468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f22369-0365-4181-b6da-31bb0c9a124a admin admin] PATH_INFO: `/v3/projects/027467d0f1914e199b9603e4cce327d4/users/0b5ed4e062bc4a5385696d766d03a3f3/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:23.819975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a25cf7f1-1c3f-4ee7-a9b7-214532d94283 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:23.820431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f22369-0365-4181-b6da-31bb0c9a124a admin admin] RBAC: Authorizing `identity:create_grant(project_id=027467d0f1914e199b9603e4cce327d4, user_id=0b5ed4e062bc4a5385696d766d03a3f3, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:23.821152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a25cf7f1-1c3f-4ee7-a9b7-214532d94283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:23.823315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f22369-0365-4181-b6da-31bb0c9a124a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:23.837614 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1106/2236] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:23.839065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cf7f1-1c3f-4ee7-a9b7-214532d94283 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:23.840666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a25cf7f1-1c3f-4ee7-a9b7-214532d94283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:23.853306 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1131/2237] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:23 2022] PUT /identity/v3/projects/027467d0f1914e199b9603e4cce327d4/users/0b5ed4e062bc4a5385696d766d03a3f3/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:23.854373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f22369-0365-4181-b6da-31bb0c9a124a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:23.872417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-05f22369-0365-4181-b6da-31bb0c9a124a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:23.879589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cf7f1-1c3f-4ee7-a9b7-214532d94283 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:23.980287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:23.981805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:23.982300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:23.982777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9 admin admin] PATH_INFO: `/v3/projects/bebdaec2d12147a1aabffeae21fb2db4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:23.984184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bebdaec2d12147a1aabffeae21fb2db4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:23.986647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:24.017208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f22369-0365-4181-b6da-31bb0c9a124a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:24.023774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343bccd-d44d-413f-8d2d-f915fbf4f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:24.024423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343bccd-d44d-413f-8d2d-f915fbf4f951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.024701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343bccd-d44d-413f-8d2d-f915fbf4f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.024971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343bccd-d44d-413f-8d2d-f915fbf4f951 admin admin] PATH_INFO: `/v3/projects/6b50d15d08bd43c9a52a79894afef944` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.026135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343bccd-d44d-413f-8d2d-f915fbf4f951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b50d15d08bd43c9a52a79894afef944)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:24.027585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:24.028355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343bccd-d44d-413f-8d2d-f915fbf4f951 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:24.054678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bebdaec2d12147a1aabffeae21fb2db4', 'request_id': 'req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:24.063346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bebdaec2d12147a1aabffeae21fb2db4', 'request_id': 'req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:24.069864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bebdaec2d12147a1aabffeae21fb2db4', 'request_id': 'req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:24.083617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9 admin admin] The token cache is being invalidate because project bebdaec2d12147a1aabffeae21fb2db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:24.083910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:24.084686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d76cf939-773a-42d1-ad1d-20b5dbcf57d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:24.085561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c343bccd-d44d-413f-8d2d-f915fbf4f951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b50d15d08bd43c9a52a79894afef944', 'request_id': 'req-c343bccd-d44d-413f-8d2d-f915fbf4f951'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:24.089250 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1107/2238] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:23 2022] DELETE /identity/v3/projects/bebdaec2d12147a1aabffeae21fb2db4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:24.089250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a71740-a637-42d6-8c31-3615e2c87d32 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.089250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a71740-a637-42d6-8c31-3615e2c87d32 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.089250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a71740-a637-42d6-8c31-3615e2c87d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.094353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c343bccd-d44d-413f-8d2d-f915fbf4f951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b50d15d08bd43c9a52a79894afef944', 'request_id': 'req-c343bccd-d44d-413f-8d2d-f915fbf4f951'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:24.101901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c343bccd-d44d-413f-8d2d-f915fbf4f951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b50d15d08bd43c9a52a79894afef944', 'request_id': 'req-c343bccd-d44d-413f-8d2d-f915fbf4f951'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:24.109639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f3a71740-a637-42d6-8c31-3615e2c87d32 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:24.111138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f3a71740-a637-42d6-8c31-3615e2c87d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:24.114170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c343bccd-d44d-413f-8d2d-f915fbf4f951 admin admin] The token cache is being invalidate because project 6b50d15d08bd43c9a52a79894afef944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:24.114534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c343bccd-d44d-413f-8d2d-f915fbf4f951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:24.115361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c343bccd-d44d-413f-8d2d-f915fbf4f951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:24.117022 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1132/2239] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:23 2022] DELETE /identity/v3/projects/6b50d15d08bd43c9a52a79894afef944 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:24.121947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f52db-4927-4688-adc7-ee71ab5973fa None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.121947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f52db-4927-4688-adc7-ee71ab5973fa None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.121947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f52db-4927-4688-adc7-ee71ab5973fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.134427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:24.141690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-814f52db-4927-4688-adc7-ee71ab5973fa None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:24.143781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-814f52db-4927-4688-adc7-ee71ab5973fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:24.179847 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1108/2240] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:24.181175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add89f7-f99e-4153-b42a-a1cd1a0af65d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.181593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add89f7-f99e-4153-b42a-a1cd1a0af65d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.182001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add89f7-f99e-4153-b42a-a1cd1a0af65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.205815 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1133/2241] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:24.207132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113006ed-54aa-4927-92e8-02ba88438239 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.207419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113006ed-54aa-4927-92e8-02ba88438239 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.207706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113006ed-54aa-4927-92e8-02ba88438239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.209566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4add89f7-f99e-4153-b42a-a1cd1a0af65d None None] MFA Rules not processed for user `0b5ed4e062bc4a5385696d766d03a3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:24.210775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4add89f7-f99e-4153-b42a-a1cd1a0af65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:24.227800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-113006ed-54aa-4927-92e8-02ba88438239 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:24.228999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-113006ed-54aa-4927-92e8-02ba88438239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:24.238593 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1134/2242] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:24.239749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc6f0f-18a7-452e-98bf-c5ad2664b55b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.240089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc6f0f-18a7-452e-98bf-c5ad2664b55b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.240346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc6f0f-18a7-452e-98bf-c5ad2664b55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.260024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8ecc6f0f-18a7-452e-98bf-c5ad2664b55b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:24.261243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8ecc6f0f-18a7-452e-98bf-c5ad2664b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:24.269129 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1135/2243] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:24.269924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc6f0f-18a7-452e-98bf-c5ad2664b55b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:24.279182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc6f0f-18a7-452e-98bf-c5ad2664b55b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:24.283782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86546a87-9536-46d2-8182-e0db375ea3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:24.284371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86546a87-9536-46d2-8182-e0db375ea3bc admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.284649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86546a87-9536-46d2-8182-e0db375ea3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.284940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86546a87-9536-46d2-8182-e0db375ea3bc admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.285633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86546a87-9536-46d2-8182-e0db375ea3bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:24.285870 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1109/2244] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:24.286204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86546a87-9536-46d2-8182-e0db375ea3bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:24.287788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86546a87-9536-46d2-8182-e0db375ea3bc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:24.290145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add89f7-f99e-4153-b42a-a1cd1a0af65d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:24.302157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add89f7-f99e-4153-b42a-a1cd1a0af65d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:24.304332 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1136/2245] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:24.305655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0920b86-d2dc-4f10-a5fb-f3d61bca5dc0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.305935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0920b86-d2dc-4f10-a5fb-f3d61bca5dc0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.306202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0920b86-d2dc-4f10-a5fb-f3d61bca5dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.307200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50117e24-2dbf-49cd-88d0-93441e79d3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:24.308116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50117e24-2dbf-49cd-88d0-93441e79d3eb admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.308403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50117e24-2dbf-49cd-88d0-93441e79d3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.308678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50117e24-2dbf-49cd-88d0-93441e79d3eb admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.309356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50117e24-2dbf-49cd-88d0-93441e79d3eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:24.309663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50117e24-2dbf-49cd-88d0-93441e79d3eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:24.311268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50117e24-2dbf-49cd-88d0-93441e79d3eb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:24.327613 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1110/2246] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:24.327613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca26ed5-bbe3-4c13-8a31-181edfdfa359 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.327613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca26ed5-bbe3-4c13-8a31-181edfdfa359 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.327613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca26ed5-bbe3-4c13-8a31-181edfdfa359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.328006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e0920b86-d2dc-4f10-a5fb-f3d61bca5dc0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:24.329132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e0920b86-d2dc-4f10-a5fb-f3d61bca5dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:24.336940 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1137/2247] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:24.337898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0920b86-d2dc-4f10-a5fb-f3d61bca5dc0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:24.339104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e0920b86-d2dc-4f10-a5fb-f3d61bca5dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:24.346445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7ca26ed5-bbe3-4c13-8a31-181edfdfa359 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:24.347737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7ca26ed5-bbe3-4c13-8a31-181edfdfa359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:24.356011 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1111/2248] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:24.356686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca26ed5-bbe3-4c13-8a31-181edfdfa359 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:24.367529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca26ed5-bbe3-4c13-8a31-181edfdfa359 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:24.372885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db199732-cb6f-48a2-ae2b-6a72f7bbfd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:24.373589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db199732-cb6f-48a2-ae2b-6a72f7bbfd07 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.373953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db199732-cb6f-48a2-ae2b-6a72f7bbfd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.374353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db199732-cb6f-48a2-ae2b-6a72f7bbfd07 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.375481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db199732-cb6f-48a2-ae2b-6a72f7bbfd07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:24.377388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db199732-cb6f-48a2-ae2b-6a72f7bbfd07 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:24.393778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:24.411546 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1112/2249] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:24 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:24.412546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db199732-cb6f-48a2-ae2b-6a72f7bbfd07 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:24.427583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0920b86-d2dc-4f10-a5fb-f3d61bca5dc0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:24.493335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db199732-cb6f-48a2-ae2b-6a72f7bbfd07 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:24.500124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714251d2-db40-4c5b-9034-74db2b044098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:24.500711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714251d2-db40-4c5b-9034-74db2b044098 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.501099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714251d2-db40-4c5b-9034-74db2b044098 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.501506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714251d2-db40-4c5b-9034-74db2b044098 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.502246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714251d2-db40-4c5b-9034-74db2b044098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:24.504461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714251d2-db40-4c5b-9034-74db2b044098 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:24.538310 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1113/2250] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:24 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:24.539345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714251d2-db40-4c5b-9034-74db2b044098 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:24.541730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebafd8-549d-4226-a7d5-c94fd71da05c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:24.542476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebafd8-549d-4226-a7d5-c94fd71da05c service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.542910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebafd8-549d-4226-a7d5-c94fd71da05c service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.543465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebafd8-549d-4226-a7d5-c94fd71da05c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.554563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:24.623261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebafd8-549d-4226-a7d5-c94fd71da05c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:24.624066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714251d2-db40-4c5b-9034-74db2b044098 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:24.624870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebafd8-549d-4226-a7d5-c94fd71da05c service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:24.630524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2706f91-5f7c-4327-b233-b9558688da47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:24.631153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2706f91-5f7c-4327-b233-b9558688da47 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.631727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2706f91-5f7c-4327-b233-b9558688da47 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.632015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2706f91-5f7c-4327-b233-b9558688da47 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.632736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2706f91-5f7c-4327-b233-b9558688da47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:24.633968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2706f91-5f7c-4327-b233-b9558688da47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:24.634909 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1138/2251] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:24.635603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2706f91-5f7c-4327-b233-b9558688da47 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:24.642475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebafd8-549d-4226-a7d5-c94fd71da05c service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:24.652260 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1114/2252] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:24.652260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2706f91-5f7c-4327-b233-b9558688da47 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:24.656950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebafd8-549d-4226-a7d5-c94fd71da05c service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:24.661909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2706f91-5f7c-4327-b233-b9558688da47 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:24.663384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20aa54-d2bb-4768-b074-cff46332d371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:24.664053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20aa54-d2bb-4768-b074-cff46332d371 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.664334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20aa54-d2bb-4768-b074-cff46332d371 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.664608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20aa54-d2bb-4768-b074-cff46332d371 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.665290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20aa54-d2bb-4768-b074-cff46332d371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:24.665647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20aa54-d2bb-4768-b074-cff46332d371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:24.667948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20aa54-d2bb-4768-b074-cff46332d371 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:24.683650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4746f-0783-4109-b87d-7053a7f61b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:24.684278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4746f-0783-4109-b87d-7053a7f61b60 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.684560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4746f-0783-4109-b87d-7053a7f61b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.691248 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1139/2253] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:24.692005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20aa54-d2bb-4768-b074-cff46332d371 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:24.693595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4746f-0783-4109-b87d-7053a7f61b60 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.694283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4746f-0783-4109-b87d-7053a7f61b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:24.696237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4746f-0783-4109-b87d-7053a7f61b60 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:24.724307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20aa54-d2bb-4768-b074-cff46332d371 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:24.736676 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1115/2254] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:24 2022] POST /identity/v3/users => generated 302 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:24.736676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4746f-0783-4109-b87d-7053a7f61b60 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:24.737877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4510608-ad06-47dd-aa19-35780d091ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:24.738493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4510608-ad06-47dd-aa19-35780d091ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.738771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4510608-ad06-47dd-aa19-35780d091ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.739039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4510608-ad06-47dd-aa19-35780d091ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.739662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4510608-ad06-47dd-aa19-35780d091ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:24.741587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4510608-ad06-47dd-aa19-35780d091ed4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:24.759780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4746f-0783-4109-b87d-7053a7f61b60 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:24.775895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f11724-d380-4fb7-b537-21839e8d778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:24.777073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f11724-d380-4fb7-b537-21839e8d778f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.777613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f11724-d380-4fb7-b537-21839e8d778f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.778044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f11724-d380-4fb7-b537-21839e8d778f admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.778938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f11724-d380-4fb7-b537-21839e8d778f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:24.784338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f11724-d380-4fb7-b537-21839e8d778f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:24.793090 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1140/2255] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:24 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:24.793956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4510608-ad06-47dd-aa19-35780d091ed4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:24.836336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4510608-ad06-47dd-aa19-35780d091ed4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:24.862860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479da05-fb7c-42e7-b12b-1230c24cdcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:24.863573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479da05-fb7c-42e7-b12b-1230c24cdcb6 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:24.863881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479da05-fb7c-42e7-b12b-1230c24cdcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:24.864227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479da05-fb7c-42e7-b12b-1230c24cdcb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:24.866730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479da05-fb7c-42e7-b12b-1230c24cdcb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:24.869714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479da05-fb7c-42e7-b12b-1230c24cdcb6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:24.876220 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1116/2256] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:24 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:24.877648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f11724-d380-4fb7-b537-21839e8d778f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:24.923532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:24.934071 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1141/2257] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:24 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:24.935407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479da05-fb7c-42e7-b12b-1230c24cdcb6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:24.959920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f11724-d380-4fb7-b537-21839e8d778f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.043787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479da05-fb7c-42e7-b12b-1230c24cdcb6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.050568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba01b8c-21f2-42d8-8b01-eb229bef7216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.051779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01b8c-21f2-42d8-8b01-eb229bef7216 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.053126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01b8c-21f2-42d8-8b01-eb229bef7216 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.053688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01b8c-21f2-42d8-8b01-eb229bef7216 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.053795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194df68a-b11a-4160-860a-6b723ea9ba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.055007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba01b8c-21f2-42d8-8b01-eb229bef7216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.055118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194df68a-b11a-4160-860a-6b723ea9ba46 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.055293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194df68a-b11a-4160-860a-6b723ea9ba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.055568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194df68a-b11a-4160-860a-6b723ea9ba46 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.056450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194df68a-b11a-4160-860a-6b723ea9ba46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.057641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba01b8c-21f2-42d8-8b01-eb229bef7216 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.058267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194df68a-b11a-4160-860a-6b723ea9ba46 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.070751 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1142/2258] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:25.071894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba01b8c-21f2-42d8-8b01-eb229bef7216 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.083136 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1117/2259] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:25.084008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194df68a-b11a-4160-860a-6b723ea9ba46 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.094731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-194df68a-b11a-4160-860a-6b723ea9ba46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:25.098177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba01b8c-21f2-42d8-8b01-eb229bef7216 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.105116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d068abe-2daf-4df6-8c99-eb7571547b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.105814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d068abe-2daf-4df6-8c99-eb7571547b1d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.106166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d068abe-2daf-4df6-8c99-eb7571547b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.106507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d068abe-2daf-4df6-8c99-eb7571547b1d admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.107222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d068abe-2daf-4df6-8c99-eb7571547b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.107666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194df68a-b11a-4160-860a-6b723ea9ba46 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.109800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d068abe-2daf-4df6-8c99-eb7571547b1d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.113696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.114533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.114815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.115089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] PATH_INFO: `/v3/users/d0a545f14f334ef0ae32cc9629de0c85` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.116689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a545f14f334ef0ae32cc9629de0c85)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.121363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.139311 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1143/2260] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:25 2022] POST /identity/v3/users => generated 286 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:25.141311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d068abe-2daf-4df6-8c99-eb7571547b1d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.155222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d068abe-2daf-4df6-8c99-eb7571547b1d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.161149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160aa7e-0330-4cb8-a014-9c309e1c415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.162408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160aa7e-0330-4cb8-a014-9c309e1c415f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.162699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160aa7e-0330-4cb8-a014-9c309e1c415f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.162971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160aa7e-0330-4cb8-a014-9c309e1c415f admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.163731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160aa7e-0330-4cb8-a014-9c309e1c415f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.165728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160aa7e-0330-4cb8-a014-9c309e1c415f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.200443 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1144/2261] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:25 2022] POST /identity/v3/users => generated 296 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:25.201353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160aa7e-0330-4cb8-a014-9c309e1c415f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.204349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a545f14f334ef0ae32cc9629de0c85'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:25.217378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a545f14f334ef0ae32cc9629de0c85'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:25.218837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a545f14f334ef0ae32cc9629de0c85'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:25.219642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a545f14f334ef0ae32cc9629de0c85'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:25.221681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160aa7e-0330-4cb8-a014-9c309e1c415f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.231029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638023-b724-4c75-9dfa-bca89dbcf98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.232832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638023-b724-4c75-9dfa-bca89dbcf98a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.233346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638023-b724-4c75-9dfa-bca89dbcf98a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.233990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638023-b724-4c75-9dfa-bca89dbcf98a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.234960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4638023-b724-4c75-9dfa-bca89dbcf98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.238111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4638023-b724-4c75-9dfa-bca89dbcf98a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.242446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a545f14f334ef0ae32cc9629de0c85'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:25.253109 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1145/2262] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:25.254289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638023-b724-4c75-9dfa-bca89dbcf98a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.256315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b4638023-b724-4c75-9dfa-bca89dbcf98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:25.267424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:25.278222 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1118/2263] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:25 2022] DELETE /identity/v3/users/d0a545f14f334ef0ae32cc9629de0c85 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:25.281324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.284805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:25.292086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638023-b724-4c75-9dfa-bca89dbcf98a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.369460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:25.375756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc51f87-24fc-492f-b766-38239981a800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.376565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc51f87-24fc-492f-b766-38239981a800 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.376892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc51f87-24fc-492f-b766-38239981a800 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.377172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc51f87-24fc-492f-b766-38239981a800 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.377870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc51f87-24fc-492f-b766-38239981a800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.379450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc51f87-24fc-492f-b766-38239981a800 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.387592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92abe8e-5339-4176-b511-4da1dc317c51 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.390617 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1146/2264] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:25.391251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc51f87-24fc-492f-b766-38239981a800 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.392888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3cc51f87-24fc-492f-b766-38239981a800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:25.397501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c64bf-1b9c-448a-a191-7f25087410c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.398129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c64bf-1b9c-448a-a191-7f25087410c2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.398418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c64bf-1b9c-448a-a191-7f25087410c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.399367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c64bf-1b9c-448a-a191-7f25087410c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.400025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c64bf-1b9c-448a-a191-7f25087410c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.401920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c64bf-1b9c-448a-a191-7f25087410c2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.406305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc51f87-24fc-492f-b766-38239981a800 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.413307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd53e9-f0f8-4d88-be77-d4f88f17d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.414191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd53e9-f0f8-4d88-be77-d4f88f17d868 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.414481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd53e9-f0f8-4d88-be77-d4f88f17d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.414758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd53e9-f0f8-4d88-be77-d4f88f17d868 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.415314 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1119/2265] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:25.416073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c64bf-1b9c-448a-a191-7f25087410c2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.417657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd53e9-f0f8-4d88-be77-d4f88f17d868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.419307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd53e9-f0f8-4d88-be77-d4f88f17d868 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.423008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-402c64bf-1b9c-448a-a191-7f25087410c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:25.432781 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1147/2266] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:25.434510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1719ff-217c-485c-9f78-485688cba7e3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.434955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1719ff-217c-485c-9f78-485688cba7e3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.435203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1719ff-217c-485c-9f78-485688cba7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.438152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c64bf-1b9c-448a-a191-7f25087410c2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.443915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36611a9-dafa-477c-8a3d-012e2cacb072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.444069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36611a9-dafa-477c-8a3d-012e2cacb072 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.444701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36611a9-dafa-477c-8a3d-012e2cacb072 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.444701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36611a9-dafa-477c-8a3d-012e2cacb072 admin admin] PATH_INFO: `/v3/projects/6ecc2dd2407b4819874bed09cb27959a/users/474ca64d1b1d4e30916b517645aba882/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.457747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-be1719ff-217c-485c-9f78-485688cba7e3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:25.459567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-be1719ff-217c-485c-9f78-485688cba7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:25.461801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36611a9-dafa-477c-8a3d-012e2cacb072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ecc2dd2407b4819874bed09cb27959a, user_id=474ca64d1b1d4e30916b517645aba882, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.464690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36611a9-dafa-477c-8a3d-012e2cacb072 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.468613 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1148/2267] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:25.469754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1719ff-217c-485c-9f78-485688cba7e3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.489362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1719ff-217c-485c-9f78-485688cba7e3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.491158 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1120/2268] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:25 2022] PUT /identity/v3/projects/6ecc2dd2407b4819874bed09cb27959a/users/474ca64d1b1d4e30916b517645aba882/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:25.498815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36611a9-dafa-477c-8a3d-012e2cacb072 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.578894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab17c6-c1a8-448d-a99f-a460d86c0fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.580790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab17c6-c1a8-448d-a99f-a460d86c0fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.585960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab17c6-c1a8-448d-a99f-a460d86c0fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.585960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab17c6-c1a8-448d-a99f-a460d86c0fe7 admin admin] PATH_INFO: `/v3/projects/3f2441394d754f499e27f6f35d5b3afa/users/98936da9b5d94165b386d2d0893ac142/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.615846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab17c6-c1a8-448d-a99f-a460d86c0fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2441394d754f499e27f6f35d5b3afa, user_id=98936da9b5d94165b386d2d0893ac142, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.618908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab17c6-c1a8-448d-a99f-a460d86c0fe7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.620780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36611a9-dafa-477c-8a3d-012e2cacb072 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.639346 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1149/2269] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:25 2022] PUT /identity/v3/projects/3f2441394d754f499e27f6f35d5b3afa/users/98936da9b5d94165b386d2d0893ac142/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:25.639346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab17c6-c1a8-448d-a99f-a460d86c0fe7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.639636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ff6ab-5281-41eb-a639-1016ca303df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.639636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff6ab-5281-41eb-a639-1016ca303df2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.639636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff6ab-5281-41eb-a639-1016ca303df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.639636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff6ab-5281-41eb-a639-1016ca303df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.640649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ff6ab-5281-41eb-a639-1016ca303df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.641732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ff6ab-5281-41eb-a639-1016ca303df2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.659916 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1121/2270] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:25.662683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ff6ab-5281-41eb-a639-1016ca303df2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.664701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d56ff6ab-5281-41eb-a639-1016ca303df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:25.715882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab17c6-c1a8-448d-a99f-a460d86c0fe7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.723746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6017db4-173e-4beb-8ea1-dca3be0e1c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.724475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6017db4-173e-4beb-8ea1-dca3be0e1c3c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.724796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6017db4-173e-4beb-8ea1-dca3be0e1c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.725126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6017db4-173e-4beb-8ea1-dca3be0e1c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.725986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6017db4-173e-4beb-8ea1-dca3be0e1c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.728110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6017db4-173e-4beb-8ea1-dca3be0e1c3c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.735034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:25.742694 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1150/2271] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:25.744600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bd158-83e0-4fd6-94ea-d13d34a11bba None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.745826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bd158-83e0-4fd6-94ea-d13d34a11bba None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.746587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bd158-83e0-4fd6-94ea-d13d34a11bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.751313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ff6ab-5281-41eb-a639-1016ca303df2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.771567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8a6bd158-83e0-4fd6-94ea-d13d34a11bba None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:25.772909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8a6bd158-83e0-4fd6-94ea-d13d34a11bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:25.781740 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1151/2272] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:25.782863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ded50-4da3-44f7-a502-87e8f682838c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.783144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ded50-4da3-44f7-a502-87e8f682838c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.783413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ded50-4da3-44f7-a502-87e8f682838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.803932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-447ded50-4da3-44f7-a502-87e8f682838c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:25.805153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-447ded50-4da3-44f7-a502-87e8f682838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:25.812936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03c12a-1638-4f49-9ccd-47eec7d9179e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.813637 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1152/2273] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:25.814019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03c12a-1638-4f49-9ccd-47eec7d9179e service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.814423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03c12a-1638-4f49-9ccd-47eec7d9179e service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.814537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ded50-4da3-44f7-a502-87e8f682838c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.814859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03c12a-1638-4f49-9ccd-47eec7d9179e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.824435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ded50-4da3-44f7-a502-87e8f682838c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.826958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03c12a-1638-4f49-9ccd-47eec7d9179e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.829392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03c12a-1638-4f49-9ccd-47eec7d9179e service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.836011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853a0a6-82a4-4b3b-8c4f-d6f9f9e47a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.837722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853a0a6-82a4-4b3b-8c4f-d6f9f9e47a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.838348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853a0a6-82a4-4b3b-8c4f-d6f9f9e47a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.839051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853a0a6-82a4-4b3b-8c4f-d6f9f9e47a29 admin admin] PATH_INFO: `/v3/projects/80de09fc7f694c1493d00b22d92e6b60/users/ad35ca769f7a427787320a2b14027814/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.843942 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1122/2274] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:25.844625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03c12a-1638-4f49-9ccd-47eec7d9179e service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.856032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03c12a-1638-4f49-9ccd-47eec7d9179e service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:25.863283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a38f57-8b90-4800-855b-ce358d70fece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:25.863597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a38f57-8b90-4800-855b-ce358d70fece admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:25.864024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a38f57-8b90-4800-855b-ce358d70fece admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:25.864367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a38f57-8b90-4800-855b-ce358d70fece admin admin] PATH_INFO: `/v3/projects/6d702b3083bc4cf5ba6b6fc6f3c3147e/users/360660f7bb4746c8b1397f4857f423f2/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:25.879762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:25.883629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a38f57-8b90-4800-855b-ce358d70fece admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d702b3083bc4cf5ba6b6fc6f3c3147e, user_id=360660f7bb4746c8b1397f4857f423f2, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.884649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853a0a6-82a4-4b3b-8c4f-d6f9f9e47a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80de09fc7f694c1493d00b22d92e6b60, user_id=ad35ca769f7a427787320a2b14027814, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:25.887728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853a0a6-82a4-4b3b-8c4f-d6f9f9e47a29 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.888047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a38f57-8b90-4800-855b-ce358d70fece admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:25.909018 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1153/2275] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:25 2022] PUT /identity/v3/projects/80de09fc7f694c1493d00b22d92e6b60/users/ad35ca769f7a427787320a2b14027814/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:25.910174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853a0a6-82a4-4b3b-8c4f-d6f9f9e47a29 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.911027 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1123/2276] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:25 2022] PUT /identity/v3/projects/6d702b3083bc4cf5ba6b6fc6f3c3147e/users/360660f7bb4746c8b1397f4857f423f2/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:25.912079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a38f57-8b90-4800-855b-ce358d70fece admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:25.993515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853a0a6-82a4-4b3b-8c4f-d6f9f9e47a29 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:26.015371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a38f57-8b90-4800-855b-ce358d70fece admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:26.021052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abda2f-7623-4437-b0dc-4c68b4edcddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:26.023674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abda2f-7623-4437-b0dc-4c68b4edcddd service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.024273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abda2f-7623-4437-b0dc-4c68b4edcddd service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.024801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abda2f-7623-4437-b0dc-4c68b4edcddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.062345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f131d-7d0c-4178-a087-d4776a8d6e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:26.062981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f131d-7d0c-4178-a087-d4776a8d6e8d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.063227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f131d-7d0c-4178-a087-d4776a8d6e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.063539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f131d-7d0c-4178-a087-d4776a8d6e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.131364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abda2f-7623-4437-b0dc-4c68b4edcddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:26.133827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abda2f-7623-4437-b0dc-4c68b4edcddd service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:26.144917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f131d-7d0c-4178-a087-d4776a8d6e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:26.146692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f131d-7d0c-4178-a087-d4776a8d6e8d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:26.147719 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1124/2277] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:26.149213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db26d0-6567-476f-a53c-fb7f42671f4f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.149582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db26d0-6567-476f-a53c-fb7f42671f4f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.149947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db26d0-6567-476f-a53c-fb7f42671f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.160159 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1154/2278] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:26.161746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249c8c9-da9d-49db-86a1-5561e79e7b4b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.162912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249c8c9-da9d-49db-86a1-5561e79e7b4b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.163910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249c8c9-da9d-49db-86a1-5561e79e7b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.192101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f6db26d0-6567-476f-a53c-fb7f42671f4f None None] MFA Rules not processed for user `ad35ca769f7a427787320a2b14027814`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:26.193361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f6db26d0-6567-476f-a53c-fb7f42671f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:26.233168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9249c8c9-da9d-49db-86a1-5561e79e7b4b None None] MFA Rules not processed for user `360660f7bb4746c8b1397f4857f423f2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:26.234491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9249c8c9-da9d-49db-86a1-5561e79e7b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:26.268233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:26.299425 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1125/2279] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:26.303867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db26d0-6567-476f-a53c-fb7f42671f4f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:26.340858 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1155/2280] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:26.342299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249c8c9-da9d-49db-86a1-5561e79e7b4b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:26.343747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db26d0-6567-476f-a53c-fb7f42671f4f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:26.357089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249c8c9-da9d-49db-86a1-5561e79e7b4b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:26.357749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc7347-432c-40b0-b04d-fbf9905e2d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:26.360385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc7347-432c-40b0-b04d-fbf9905e2d73 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.360918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc7347-432c-40b0-b04d-fbf9905e2d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.361259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc7347-432c-40b0-b04d-fbf9905e2d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.363289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc7347-432c-40b0-b04d-fbf9905e2d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:26.365004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5cde3-6ffc-4abf-a580-da1fb5ff02a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:26.365952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5cde3-6ffc-4abf-a580-da1fb5ff02a2 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.366445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5cde3-6ffc-4abf-a580-da1fb5ff02a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.367953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc7347-432c-40b0-b04d-fbf9905e2d73 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:26.368538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5cde3-6ffc-4abf-a580-da1fb5ff02a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.369854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5cde3-6ffc-4abf-a580-da1fb5ff02a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:26.372213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5cde3-6ffc-4abf-a580-da1fb5ff02a2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:26.424477 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1126/2281] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:26 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:52:26.429631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc7347-432c-40b0-b04d-fbf9905e2d73 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:26.430986 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1156/2282] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:26 2022] POST /identity/v3/projects => generated 393 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:26.434892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5cde3-6ffc-4abf-a580-da1fb5ff02a2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:26.448469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:26.525349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5cde3-6ffc-4abf-a580-da1fb5ff02a2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:26.532753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a4e2e-3a25-4c20-8bd0-e5236bad20d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:26.542486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc7347-432c-40b0-b04d-fbf9905e2d73 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:26.543405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a4e2e-3a25-4c20-8bd0-e5236bad20d4 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.543812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a4e2e-3a25-4c20-8bd0-e5236bad20d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.544097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a4e2e-3a25-4c20-8bd0-e5236bad20d4 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.545008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a4e2e-3a25-4c20-8bd0-e5236bad20d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:26.549659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4921c3-45db-4257-b362-679d81dd500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:26.549845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a4e2e-3a25-4c20-8bd0-e5236bad20d4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:26.550521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4921c3-45db-4257-b362-679d81dd500a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.550898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4921c3-45db-4257-b362-679d81dd500a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.551277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4921c3-45db-4257-b362-679d81dd500a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.552088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4921c3-45db-4257-b362-679d81dd500a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:26.554632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4921c3-45db-4257-b362-679d81dd500a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:26.584733 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1157/2283] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:26 2022] POST /identity/v3/users => generated 303 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:52:26.590295 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1127/2284] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:26 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:26.590941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a4e2e-3a25-4c20-8bd0-e5236bad20d4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:26.592040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4921c3-45db-4257-b362-679d81dd500a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:26.604484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a4e2e-3a25-4c20-8bd0-e5236bad20d4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:26.606366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4921c3-45db-4257-b362-679d81dd500a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:26.612479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4611f-2074-467e-8a22-0cee4742cdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:26.613285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4611f-2074-467e-8a22-0cee4742cdfc admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.613788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4611f-2074-467e-8a22-0cee4742cdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.614128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4611f-2074-467e-8a22-0cee4742cdfc admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.615045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4611f-2074-467e-8a22-0cee4742cdfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:26.615504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032309e-df52-4bcb-ab0f-c119e9fb1d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:26.616247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032309e-df52-4bcb-ab0f-c119e9fb1d4f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.616676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032309e-df52-4bcb-ab0f-c119e9fb1d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.617070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032309e-df52-4bcb-ab0f-c119e9fb1d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.617459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4611f-2074-467e-8a22-0cee4742cdfc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:26.618027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032309e-df52-4bcb-ab0f-c119e9fb1d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:26.620324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032309e-df52-4bcb-ab0f-c119e9fb1d4f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:26.635627 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1158/2285] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:26.639905 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1128/2286] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:26.641469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4611f-2074-467e-8a22-0cee4742cdfc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:26.644918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032309e-df52-4bcb-ab0f-c119e9fb1d4f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:26.656179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032309e-df52-4bcb-ab0f-c119e9fb1d4f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:26.658848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4611f-2074-467e-8a22-0cee4742cdfc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:26.661462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b5ab7-2acf-4a70-b9c0-4745e714fc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:26.662314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b5ab7-2acf-4a70-b9c0-4745e714fc22 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.662664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b5ab7-2acf-4a70-b9c0-4745e714fc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.663004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b5ab7-2acf-4a70-b9c0-4745e714fc22 admin admin] PATH_INFO: `/v3/projects/dac5ccb4d1b74021ac5625851f88c009/users/4b1b7b27c9b04fb897ebe2669d10c479/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.667960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94a26-6efe-4f81-8803-5b9ddfd4dae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:26.668898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94a26-6efe-4f81-8803-5b9ddfd4dae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.669367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94a26-6efe-4f81-8803-5b9ddfd4dae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.670024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94a26-6efe-4f81-8803-5b9ddfd4dae5 admin admin] PATH_INFO: `/v3/projects/c596034276f545769782627bd8668483/users/f5289e2d224a47e3951e19eee37ea5a8/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.690495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b5ab7-2acf-4a70-b9c0-4745e714fc22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac5ccb4d1b74021ac5625851f88c009, user_id=4b1b7b27c9b04fb897ebe2669d10c479, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:26.694255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b5ab7-2acf-4a70-b9c0-4745e714fc22 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:26.696710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a94a26-6efe-4f81-8803-5b9ddfd4dae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c596034276f545769782627bd8668483, user_id=f5289e2d224a47e3951e19eee37ea5a8, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:26.701769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a94a26-6efe-4f81-8803-5b9ddfd4dae5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:26.713003 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1129/2287] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:26 2022] PUT /identity/v3/projects/dac5ccb4d1b74021ac5625851f88c009/users/4b1b7b27c9b04fb897ebe2669d10c479/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:26.717490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b5ab7-2acf-4a70-b9c0-4745e714fc22 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:26.731925 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1159/2288] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:26 2022] PUT /identity/v3/projects/c596034276f545769782627bd8668483/users/f5289e2d224a47e3951e19eee37ea5a8/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:26.737870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94a26-6efe-4f81-8803-5b9ddfd4dae5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:26.853263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:26.874012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b5ab7-2acf-4a70-b9c0-4745e714fc22 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:26.883016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94a26-6efe-4f81-8803-5b9ddfd4dae5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:26.899264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b727e3-bf7c-4d6c-9cac-eb859c421ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:26.900205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b727e3-bf7c-4d6c-9cac-eb859c421ccd admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.900628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b727e3-bf7c-4d6c-9cac-eb859c421ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.901047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b727e3-bf7c-4d6c-9cac-eb859c421ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.902100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b727e3-bf7c-4d6c-9cac-eb859c421ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:26.903554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c3954-0b4f-4566-a2fa-4700db14f4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:26.904879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3954-0b4f-4566-a2fa-4700db14f4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.905028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b727e3-bf7c-4d6c-9cac-eb859c421ccd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:26.906095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3954-0b4f-4566-a2fa-4700db14f4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.906467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3954-0b4f-4566-a2fa-4700db14f4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.907425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c3954-0b4f-4566-a2fa-4700db14f4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:26.910326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c3954-0b4f-4566-a2fa-4700db14f4b4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:26.937883 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1160/2289] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:26.938927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b727e3-bf7c-4d6c-9cac-eb859c421ccd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:26.949221 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1130/2290] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:26.953895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c3954-0b4f-4566-a2fa-4700db14f4b4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:26.970298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b727e3-bf7c-4d6c-9cac-eb859c421ccd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:26.978596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bb964-2876-46b6-a65e-4c2778a519c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:26.979380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bb964-2876-46b6-a65e-4c2778a519c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.979952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bb964-2876-46b6-a65e-4c2778a519c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.979952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bb964-2876-46b6-a65e-4c2778a519c2 admin admin] PATH_INFO: `/v3/projects/c596034276f545769782627bd8668483/users/f5289e2d224a47e3951e19eee37ea5a8/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.988619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bb964-2876-46b6-a65e-4c2778a519c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c596034276f545769782627bd8668483, user_id=f5289e2d224a47e3951e19eee37ea5a8, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:26.991332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bb964-2876-46b6-a65e-4c2778a519c2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:27.009985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c3954-0b4f-4566-a2fa-4700db14f4b4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:27.022027 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1161/2291] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:26 2022] PUT /identity/v3/projects/c596034276f545769782627bd8668483/users/f5289e2d224a47e3951e19eee37ea5a8/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:27.033574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bb964-2876-46b6-a65e-4c2778a519c2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:27.038682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1f6bb964-2876-46b6-a65e-4c2778a519c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:27.129199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56214cd-0037-46ac-b6f6-abb483617a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:27.130634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56214cd-0037-46ac-b6f6-abb483617a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:27.146081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56214cd-0037-46ac-b6f6-abb483617a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:27.149719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56214cd-0037-46ac-b6f6-abb483617a41 admin admin] PATH_INFO: `/v3/projects/dac5ccb4d1b74021ac5625851f88c009/users/4b1b7b27c9b04fb897ebe2669d10c479/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:27.152418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56214cd-0037-46ac-b6f6-abb483617a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac5ccb4d1b74021ac5625851f88c009, user_id=4b1b7b27c9b04fb897ebe2669d10c479, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:27.158106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56214cd-0037-46ac-b6f6-abb483617a41 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:27.161509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:27.190948 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1131/2292] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:26 2022] PUT /identity/v3/projects/dac5ccb4d1b74021ac5625851f88c009/users/4b1b7b27c9b04fb897ebe2669d10c479/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:27.190948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc3aeb-e294-42a5-9021-d07d0682bea2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:27.190948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc3aeb-e294-42a5-9021-d07d0682bea2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:27.190948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc3aeb-e294-42a5-9021-d07d0682bea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:27.196016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bb964-2876-46b6-a65e-4c2778a519c2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:27.236634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d1fc3aeb-e294-42a5-9021-d07d0682bea2 None None] MFA Rules not processed for user `f5289e2d224a47e3951e19eee37ea5a8`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:27.238589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d1fc3aeb-e294-42a5-9021-d07d0682bea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:27.334770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:27.337540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:27.340392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:27.341070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] PATH_INFO: `/v3/projects/b31e2061bb92458da18022f0d6ddd61e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:27.347059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31e2061bb92458da18022f0d6ddd61e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:27.350705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:27.473494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31e2061bb92458da18022f0d6ddd61e', 'request_id': 'req-5901d761-7c9d-4af2-8383-d05f05c0561c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:27.474336 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1132/2293] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:27.479095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16678e4-8063-439d-9938-0e3a4d1c2910 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:27.480289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16678e4-8063-439d-9938-0e3a4d1c2910 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:27.481816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16678e4-8063-439d-9938-0e3a4d1c2910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:27.505815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31e2061bb92458da18022f0d6ddd61e', 'request_id': 'req-5901d761-7c9d-4af2-8383-d05f05c0561c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:27.515787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31e2061bb92458da18022f0d6ddd61e', 'request_id': 'req-5901d761-7c9d-4af2-8383-d05f05c0561c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:27.531452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] The token cache is being invalidate because project b31e2061bb92458da18022f0d6ddd61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:27.531696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:27.532332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:27.534301 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1162/2294] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:27 2022] DELETE /identity/v3/projects/b31e2061bb92458da18022f0d6ddd61e => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:27.535826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:27.538043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:27.550023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f16678e4-8063-439d-9938-0e3a4d1c2910 None None] MFA Rules not processed for user `4b1b7b27c9b04fb897ebe2669d10c479`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:27.551345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f16678e4-8063-439d-9938-0e3a4d1c2910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:27.558763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:27.648297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901d761-7c9d-4af2-8383-d05f05c0561c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:27.656041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc88de-3332-4f5c-a7b2-4d65472ff2a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:27.656806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc88de-3332-4f5c-a7b2-4d65472ff2a2 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:27.657213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc88de-3332-4f5c-a7b2-4d65472ff2a2 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:27.658481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc88de-3332-4f5c-a7b2-4d65472ff2a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:27.661744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e1dc88de-3332-4f5c-a7b2-4d65472ff2a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:27.730132 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1133/2295] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:27.731010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16678e4-8063-439d-9938-0e3a4d1c2910 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:27.732313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f16678e4-8063-439d-9938-0e3a4d1c2910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:27.787134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc88de-3332-4f5c-a7b2-4d65472ff2a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:27.789775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc88de-3332-4f5c-a7b2-4d65472ff2a2 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:27.801830 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1163/2296] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:27.803125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4b17-9f34-479e-96d9-b524870bd7a7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:27.803385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4b17-9f34-479e-96d9-b524870bd7a7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:27.803654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4b17-9f34-479e-96d9-b524870bd7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:27.838352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d13b4b17-9f34-479e-96d9-b524870bd7a7 None None] MFA Rules not processed for user `360660f7bb4746c8b1397f4857f423f2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:27.840046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d13b4b17-9f34-479e-96d9-b524870bd7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:27.873927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16678e4-8063-439d-9938-0e3a4d1c2910 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:27.892696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:27.893390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:27.893669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:27.893943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] PATH_INFO: `/v3/users/0b5ed4e062bc4a5385696d766d03a3f3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:27.895132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5ed4e062bc4a5385696d766d03a3f3)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:27.897077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:27.908307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:27.949246 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1164/2297] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:27.984786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5ed4e062bc4a5385696d766d03a3f3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:27.995644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5ed4e062bc4a5385696d766d03a3f3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:27.996658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5ed4e062bc4a5385696d766d03a3f3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:27.997895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5ed4e062bc4a5385696d766d03a3f3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:28.026837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5ed4e062bc4a5385696d766d03a3f3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:28.085171 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1134/2298] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:27 2022] DELETE /identity/v3/users/0b5ed4e062bc4a5385696d766d03a3f3 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:28.145224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4b17-9f34-479e-96d9-b524870bd7a7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:28.158638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:28.160217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:28.163826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4b17-9f34-479e-96d9-b524870bd7a7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:28.220175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:28.279921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d885f5-5ae9-4cb1-bc7f-96d329035dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:28.281120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d885f5-5ae9-4cb1-bc7f-96d329035dfe service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:28.281437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d885f5-5ae9-4cb1-bc7f-96d329035dfe service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:28.281710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d885f5-5ae9-4cb1-bc7f-96d329035dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:28.283706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e6d885f5-5ae9-4cb1-bc7f-96d329035dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:28.311929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1998b53-9caf-4df3-8361-0299a3df0a82 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:28.319314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:28.321334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:28.322208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:28.322502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] PATH_INFO: `/v3/users/ad35ca769f7a427787320a2b14027814` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:28.325428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad35ca769f7a427787320a2b14027814)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:28.329459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:28.418397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d885f5-5ae9-4cb1-bc7f-96d329035dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:28.422213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d885f5-5ae9-4cb1-bc7f-96d329035dfe service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:28.435376 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1165/2299] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:28.442729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad35ca769f7a427787320a2b14027814'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:28.459474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad35ca769f7a427787320a2b14027814'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:28.460265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad35ca769f7a427787320a2b14027814'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:28.461379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad35ca769f7a427787320a2b14027814'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:28.508385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad35ca769f7a427787320a2b14027814'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:28.538507 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1135/2300] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:28 2022] DELETE /identity/v3/users/ad35ca769f7a427787320a2b14027814 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:52:28.540346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d48de-6a23-4268-b1b3-38f06b53f559 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:28.540655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d48de-6a23-4268-b1b3-38f06b53f559 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:28.540906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d48de-6a23-4268-b1b3-38f06b53f559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:28.575948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c20d48de-6a23-4268-b1b3-38f06b53f559 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:28.577326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c20d48de-6a23-4268-b1b3-38f06b53f559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:28.654525 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1166/2301] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:28.726295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:28.727768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:28.733241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:28.804886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6403dc-631e-4d83-877c-25c58313bc0f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:28.809281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bac578-cbed-4d99-ae76-0aebb9b40e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:28.809907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bac578-cbed-4d99-ae76-0aebb9b40e6b service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:28.810706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bac578-cbed-4d99-ae76-0aebb9b40e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:28.810706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bac578-cbed-4d99-ae76-0aebb9b40e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:28.824151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bac578-cbed-4d99-ae76-0aebb9b40e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:28.825857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bac578-cbed-4d99-ae76-0aebb9b40e6b service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:28.841083 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1136/2302] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:29.584275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d48de-6a23-4268-b1b3-38f06b53f559 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:29.585935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c20d48de-6a23-4268-b1b3-38f06b53f559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:29.608338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d48de-6a23-4268-b1b3-38f06b53f559 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:29.622294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:29.627925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:29.628353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:29.628581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] PATH_INFO: `/v3/projects/027467d0f1914e199b9603e4cce327d4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:29.629878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=027467d0f1914e199b9603e4cce327d4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:29.631932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:29.742445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027467d0f1914e199b9603e4cce327d4', 'request_id': 'req-46e3c66a-1acd-46aa-addd-88a526e330d1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:29.770156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027467d0f1914e199b9603e4cce327d4', 'request_id': 'req-46e3c66a-1acd-46aa-addd-88a526e330d1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:29.786859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027467d0f1914e199b9603e4cce327d4', 'request_id': 'req-46e3c66a-1acd-46aa-addd-88a526e330d1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:29.820838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] The token cache is being invalidate because project 027467d0f1914e199b9603e4cce327d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:29.822152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:29.823575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:29.853287 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1167/2303] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:29 2022] DELETE /identity/v3/projects/027467d0f1914e199b9603e4cce327d4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:29.858520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfe091-96b9-4b47-ab5c-65accbdd9cff None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:29.859599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfe091-96b9-4b47-ab5c-65accbdd9cff None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:29.859678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfe091-96b9-4b47-ab5c-65accbdd9cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:29.887546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d0dfe091-96b9-4b47-ab5c-65accbdd9cff None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:29.889082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d0dfe091-96b9-4b47-ab5c-65accbdd9cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:29.995417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:29.997058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:30.009822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:30.151239 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1137/2304] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:30.152906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34404c-a2b9-40d3-b030-36cdde2ef49e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:30.153949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34404c-a2b9-40d3-b030-36cdde2ef49e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:30.154249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34404c-a2b9-40d3-b030-36cdde2ef49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:30.253265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3c66a-1acd-46aa-addd-88a526e330d1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:30.254949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1e34404c-a2b9-40d3-b030-36cdde2ef49e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:30.256240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1e34404c-a2b9-40d3-b030-36cdde2ef49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:30.310796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:30.313896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:30.315309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:30.316946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] PATH_INFO: `/v3/projects/80de09fc7f694c1493d00b22d92e6b60` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:30.333507 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1138/2305] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:52:30.334328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=80de09fc7f694c1493d00b22d92e6b60)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:30.334328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:30.342050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34404c-a2b9-40d3-b030-36cdde2ef49e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:30.378606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34404c-a2b9-40d3-b030-36cdde2ef49e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:30.405116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b7931-0da0-4457-9830-905c0f91a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:30.405891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b7931-0da0-4457-9830-905c0f91a9cd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:30.406178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b7931-0da0-4457-9830-905c0f91a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:30.407207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b7931-0da0-4457-9830-905c0f91a9cd admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:30.408270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b7931-0da0-4457-9830-905c0f91a9cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:30.408583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b7931-0da0-4457-9830-905c0f91a9cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:30.410251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b7931-0da0-4457-9830-905c0f91a9cd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:30.442432 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1139/2306] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:30.447015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b7931-0da0-4457-9830-905c0f91a9cd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:30.478014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b7931-0da0-4457-9830-905c0f91a9cd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:30.514990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80de09fc7f694c1493d00b22d92e6b60', 'request_id': 'req-ffd7b271-18ea-4675-8265-931f8cfa0b6f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:30.535524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80de09fc7f694c1493d00b22d92e6b60', 'request_id': 'req-ffd7b271-18ea-4675-8265-931f8cfa0b6f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:30.545361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80de09fc7f694c1493d00b22d92e6b60', 'request_id': 'req-ffd7b271-18ea-4675-8265-931f8cfa0b6f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:30.635361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] The token cache is being invalidate because project 80de09fc7f694c1493d00b22d92e6b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:30.635949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:30.638649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:30.643424 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1168/2307] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:29 2022] DELETE /identity/v3/projects/80de09fc7f694c1493d00b22d92e6b60 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:30.649127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:30.652972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:30.659775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58c242-c939-492b-88ca-859970629133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:30.660681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58c242-c939-492b-88ca-859970629133 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:30.661146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58c242-c939-492b-88ca-859970629133 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:30.661735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58c242-c939-492b-88ca-859970629133 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:30.662696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58c242-c939-492b-88ca-859970629133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:30.664946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58c242-c939-492b-88ca-859970629133 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:30.684499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7b271-18ea-4675-8265-931f8cfa0b6f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:30.696497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:30.697150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:30.697464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:30.697745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] PATH_INFO: `/v3/users/f5289e2d224a47e3951e19eee37ea5a8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:30.700225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5289e2d224a47e3951e19eee37ea5a8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:30.705358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:30.732067 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1140/2308] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:30 2022] POST /identity/v3/projects => generated 399 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:30.737074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58c242-c939-492b-88ca-859970629133 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:30.740153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0d58c242-c939-492b-88ca-859970629133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:30.755624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:30.797046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5289e2d224a47e3951e19eee37ea5a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:30.810094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5289e2d224a47e3951e19eee37ea5a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:30.811366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5289e2d224a47e3951e19eee37ea5a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:30.812104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5289e2d224a47e3951e19eee37ea5a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:30.837364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5289e2d224a47e3951e19eee37ea5a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:30.862476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58c242-c939-492b-88ca-859970629133 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:30.868271 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1169/2309] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:30 2022] DELETE /identity/v3/users/f5289e2d224a47e3951e19eee37ea5a8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:30.997010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f958584-2e98-4b0e-8c0d-b0f7df09f9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:30.999260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f958584-2e98-4b0e-8c0d-b0f7df09f9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:30.999747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f958584-2e98-4b0e-8c0d-b0f7df09f9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:31.000593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f958584-2e98-4b0e-8c0d-b0f7df09f9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:31.001642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f958584-2e98-4b0e-8c0d-b0f7df09f9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:31.004023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f958584-2e98-4b0e-8c0d-b0f7df09f9c1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:31.043110 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1141/2310] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:30 2022] POST /identity/v3/users => generated 300 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:52:31.046915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:31.048551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:31.085891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9836a8b-403b-4256-85be-8a2cd8d571a5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:31.092483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c270f9-9fc4-402f-9374-51379c952a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:31.116352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c270f9-9fc4-402f-9374-51379c952a29 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:31.118253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c270f9-9fc4-402f-9374-51379c952a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:31.118697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c270f9-9fc4-402f-9374-51379c952a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:31.120425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c270f9-9fc4-402f-9374-51379c952a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:31.122853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c270f9-9fc4-402f-9374-51379c952a29 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:31.133854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:31.152590 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1170/2311] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:31.154055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f958584-2e98-4b0e-8c0d-b0f7df09f9c1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:31.168928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f958584-2e98-4b0e-8c0d-b0f7df09f9c1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:31.175374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c09b9-9ba0-438b-a7df-232dfe13e0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:31.176008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c09b9-9ba0-438b-a7df-232dfe13e0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:31.176290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c09b9-9ba0-438b-a7df-232dfe13e0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:31.176567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c09b9-9ba0-438b-a7df-232dfe13e0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:31.177472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c09b9-9ba0-438b-a7df-232dfe13e0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:31.179117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c09b9-9ba0-438b-a7df-232dfe13e0b9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:31.227492 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1142/2312] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:31.228751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c270f9-9fc4-402f-9374-51379c952a29 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:31.241310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c270f9-9fc4-402f-9374-51379c952a29 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:31.250805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29e9d0-268d-4f18-bffa-e4bc4e9c3fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:31.253368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29e9d0-268d-4f18-bffa-e4bc4e9c3fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:31.253832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29e9d0-268d-4f18-bffa-e4bc4e9c3fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:31.254579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29e9d0-268d-4f18-bffa-e4bc4e9c3fd6 admin admin] PATH_INFO: `/v3/projects/d906d4ba6e8d4b44b75e12ad5d5cae54/users/3c1e311c770940b3a9f1270370d08920/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:31.297474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29e9d0-268d-4f18-bffa-e4bc4e9c3fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d906d4ba6e8d4b44b75e12ad5d5cae54, user_id=3c1e311c770940b3a9f1270370d08920, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:31.300574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29e9d0-268d-4f18-bffa-e4bc4e9c3fd6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:31.361274 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1171/2313] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:31 2022] PUT /identity/v3/projects/d906d4ba6e8d4b44b75e12ad5d5cae54/users/3c1e311c770940b3a9f1270370d08920/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:31.372998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac98ed7-00a6-4b74-b85f-998094e28694 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:31.373296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac98ed7-00a6-4b74-b85f-998094e28694 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:31.373492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac98ed7-00a6-4b74-b85f-998094e28694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:31.433741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5ac98ed7-00a6-4b74-b85f-998094e28694 None None] MFA Rules not processed for user `3c1e311c770940b3a9f1270370d08920`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:31.435040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5ac98ed7-00a6-4b74-b85f-998094e28694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:31.650307 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1143/2314] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:31.650987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29e9d0-268d-4f18-bffa-e4bc4e9c3fd6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:31.824593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29e9d0-268d-4f18-bffa-e4bc4e9c3fd6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:31.839409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b383f5-61eb-4aa2-8fad-ba45bc9a8f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:31.840050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b383f5-61eb-4aa2-8fad-ba45bc9a8f10 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:31.840766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b383f5-61eb-4aa2-8fad-ba45bc9a8f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:31.840766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b383f5-61eb-4aa2-8fad-ba45bc9a8f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:31.846986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b383f5-61eb-4aa2-8fad-ba45bc9a8f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:31.849206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b383f5-61eb-4aa2-8fad-ba45bc9a8f10 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:31.931278 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1172/2315] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:31 2022] POST /identity/v3/projects => generated 401 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:52:31.935198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac98ed7-00a6-4b74-b85f-998094e28694 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:31.954660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac98ed7-00a6-4b74-b85f-998094e28694 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:32.009257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:32.087142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d04ac3-ec7d-4855-9309-08dd18186563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:32.088819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d04ac3-ec7d-4855-9309-08dd18186563 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:32.089326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d04ac3-ec7d-4855-9309-08dd18186563 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:32.089794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d04ac3-ec7d-4855-9309-08dd18186563 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:32.091126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d04ac3-ec7d-4855-9309-08dd18186563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:32.095623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d04ac3-ec7d-4855-9309-08dd18186563 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:32.132891 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1144/2316] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:31 2022] POST /identity/v3/users => generated 307 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:32.134184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b383f5-61eb-4aa2-8fad-ba45bc9a8f10 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:32.152008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b383f5-61eb-4aa2-8fad-ba45bc9a8f10 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:32.160276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132dfcb-c068-44e0-a79b-bf5ce8af78a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:32.163053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132dfcb-c068-44e0-a79b-bf5ce8af78a9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:32.163375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132dfcb-c068-44e0-a79b-bf5ce8af78a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:32.163751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132dfcb-c068-44e0-a79b-bf5ce8af78a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:32.165532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132dfcb-c068-44e0-a79b-bf5ce8af78a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:32.169672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132dfcb-c068-44e0-a79b-bf5ce8af78a9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:32.189272 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1173/2317] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:32.191933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d04ac3-ec7d-4855-9309-08dd18186563 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:32.213954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d04ac3-ec7d-4855-9309-08dd18186563 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:32.228049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90534fbe-b89c-4e39-8293-fb8dcf3fae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:32.229049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90534fbe-b89c-4e39-8293-fb8dcf3fae48 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:32.229823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90534fbe-b89c-4e39-8293-fb8dcf3fae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:32.230456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90534fbe-b89c-4e39-8293-fb8dcf3fae48 admin admin] PATH_INFO: `/v3/projects/38f22d5aa06c46dda6c04cc24a5b7e70/users/3ee31a07d4ef4decb6b7655699f83707/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:32.250895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90534fbe-b89c-4e39-8293-fb8dcf3fae48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f22d5aa06c46dda6c04cc24a5b7e70, user_id=3ee31a07d4ef4decb6b7655699f83707, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:32.254220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90534fbe-b89c-4e39-8293-fb8dcf3fae48 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:32.271440 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1145/2318] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:32 2022] PUT /identity/v3/projects/38f22d5aa06c46dda6c04cc24a5b7e70/users/3ee31a07d4ef4decb6b7655699f83707/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:52:32.275306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132dfcb-c068-44e0-a79b-bf5ce8af78a9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:32.285884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132dfcb-c068-44e0-a79b-bf5ce8af78a9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:32.381169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4fc73-40bb-4755-8911-e800ab92eb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:32.381169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4fc73-40bb-4755-8911-e800ab92eb6d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:32.381169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4fc73-40bb-4755-8911-e800ab92eb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:32.381169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4fc73-40bb-4755-8911-e800ab92eb6d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:32.381633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4fc73-40bb-4755-8911-e800ab92eb6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:32.382549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4fc73-40bb-4755-8911-e800ab92eb6d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:32.402966 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1174/2319] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:32.405624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90534fbe-b89c-4e39-8293-fb8dcf3fae48 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:32.423496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90534fbe-b89c-4e39-8293-fb8dcf3fae48 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:32.430241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4fc73-40bb-4755-8911-e800ab92eb6d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:32.435298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f1c4fc73-40bb-4755-8911-e800ab92eb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:32.445698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1697fd-1e5f-4f5d-ab46-bb6604d306af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:32.448821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1697fd-1e5f-4f5d-ab46-bb6604d306af admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:32.449134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1697fd-1e5f-4f5d-ab46-bb6604d306af admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:32.449983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1697fd-1e5f-4f5d-ab46-bb6604d306af admin admin] PATH_INFO: `/v3/projects/38f22d5aa06c46dda6c04cc24a5b7e70/users/3ee31a07d4ef4decb6b7655699f83707/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:32.457099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1697fd-1e5f-4f5d-ab46-bb6604d306af admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f22d5aa06c46dda6c04cc24a5b7e70, user_id=3ee31a07d4ef4decb6b7655699f83707, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:32.463772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1697fd-1e5f-4f5d-ab46-bb6604d306af admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:32.470480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4fc73-40bb-4755-8911-e800ab92eb6d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:32.506116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c854d-de05-4a21-86fe-7207acde649c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:32.506780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c854d-de05-4a21-86fe-7207acde649c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:32.507067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c854d-de05-4a21-86fe-7207acde649c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:32.508286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c854d-de05-4a21-86fe-7207acde649c admin admin] PATH_INFO: `/v3/projects/c596034276f545769782627bd8668483` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:32.509613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c854d-de05-4a21-86fe-7207acde649c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c596034276f545769782627bd8668483)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:32.512116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c854d-de05-4a21-86fe-7207acde649c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:32.525257 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1146/2320] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:32 2022] PUT /identity/v3/projects/38f22d5aa06c46dda6c04cc24a5b7e70/users/3ee31a07d4ef4decb6b7655699f83707/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:32.526736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3c554-eddf-4a03-848b-cc1ede007f07 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:32.527025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3c554-eddf-4a03-848b-cc1ede007f07 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:32.527303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3c554-eddf-4a03-848b-cc1ede007f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:32.587357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d4c3c554-eddf-4a03-848b-cc1ede007f07 None None] MFA Rules not processed for user `3ee31a07d4ef4decb6b7655699f83707`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:32.588479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d4c3c554-eddf-4a03-848b-cc1ede007f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:32.635394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:32.648965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e83c854d-de05-4a21-86fe-7207acde649c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c596034276f545769782627bd8668483', 'request_id': 'req-e83c854d-de05-4a21-86fe-7207acde649c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:32.667570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e83c854d-de05-4a21-86fe-7207acde649c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c596034276f545769782627bd8668483', 'request_id': 'req-e83c854d-de05-4a21-86fe-7207acde649c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:32.680912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e83c854d-de05-4a21-86fe-7207acde649c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c596034276f545769782627bd8668483', 'request_id': 'req-e83c854d-de05-4a21-86fe-7207acde649c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:32.754993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e83c854d-de05-4a21-86fe-7207acde649c admin admin] The token cache is being invalidate because project c596034276f545769782627bd8668483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:32.759415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e83c854d-de05-4a21-86fe-7207acde649c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:32.761669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e83c854d-de05-4a21-86fe-7207acde649c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:32.770913 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1175/2321] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:32 2022] DELETE /identity/v3/projects/c596034276f545769782627bd8668483 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:52:32.778920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dd713-95b0-4c88-bfaf-a03c36767268 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:32.779222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dd713-95b0-4c88-bfaf-a03c36767268 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:32.779503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dd713-95b0-4c88-bfaf-a03c36767268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:32.864790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-478dd713-95b0-4c88-bfaf-a03c36767268 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:32.866055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-478dd713-95b0-4c88-bfaf-a03c36767268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:32.904965 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1147/2322] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:32 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:52:33.100409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4daf2a-ba65-477d-9b29-0a3b6f808f5d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:33.101416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4daf2a-ba65-477d-9b29-0a3b6f808f5d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:33.101873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4daf2a-ba65-477d-9b29-0a3b6f808f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:33.101992 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1176/2323] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:33.137629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dc4daf2a-ba65-477d-9b29-0a3b6f808f5d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:33.144365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dc4daf2a-ba65-477d-9b29-0a3b6f808f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:33.165828 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1148/2324] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:52:33.170842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dd713-95b0-4c88-bfaf-a03c36767268 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:33.189288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dd713-95b0-4c88-bfaf-a03c36767268 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:33.204677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9653bb4-b030-4dea-b44c-babade2cd368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:33.205318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9653bb4-b030-4dea-b44c-babade2cd368 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:33.205607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9653bb4-b030-4dea-b44c-babade2cd368 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:33.205910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9653bb4-b030-4dea-b44c-babade2cd368 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:33.207023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9653bb4-b030-4dea-b44c-babade2cd368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:33.207337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9653bb4-b030-4dea-b44c-babade2cd368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:33.210984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9653bb4-b030-4dea-b44c-babade2cd368 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:33.253584 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1177/2325] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:33.258661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4daf2a-ba65-477d-9b29-0a3b6f808f5d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:33.271253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4daf2a-ba65-477d-9b29-0a3b6f808f5d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:33.286538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65f700-eac4-43a7-88b5-62235a4ac96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:33.287526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65f700-eac4-43a7-88b5-62235a4ac96b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:33.288070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65f700-eac4-43a7-88b5-62235a4ac96b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:33.288559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65f700-eac4-43a7-88b5-62235a4ac96b admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:33.289434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65f700-eac4-43a7-88b5-62235a4ac96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:33.291579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65f700-eac4-43a7-88b5-62235a4ac96b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:33.357808 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1149/2326] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:33 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:33.363858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9653bb4-b030-4dea-b44c-babade2cd368 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:33.378444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9653bb4-b030-4dea-b44c-babade2cd368 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:33.457131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7389d1-50ca-41b2-87be-47d576ad7f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:33.457641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7389d1-50ca-41b2-87be-47d576ad7f9b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:33.458057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7389d1-50ca-41b2-87be-47d576ad7f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:33.458356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7389d1-50ca-41b2-87be-47d576ad7f9b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:33.459127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7389d1-50ca-41b2-87be-47d576ad7f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:33.461682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7389d1-50ca-41b2-87be-47d576ad7f9b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:33.501481 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1178/2327] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:33 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:33.502415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65f700-eac4-43a7-88b5-62235a4ac96b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:33.524230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65f700-eac4-43a7-88b5-62235a4ac96b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:33.532250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f424a-0744-4484-ac63-54cac0c5dd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:33.533277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f424a-0744-4484-ac63-54cac0c5dd77 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:33.533558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f424a-0744-4484-ac63-54cac0c5dd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:33.533826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f424a-0744-4484-ac63-54cac0c5dd77 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:33.534545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f424a-0744-4484-ac63-54cac0c5dd77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:33.536147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f424a-0744-4484-ac63-54cac0c5dd77 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:33.563885 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1150/2328] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:52:33.567104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7389d1-50ca-41b2-87be-47d576ad7f9b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:33.589089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7389d1-50ca-41b2-87be-47d576ad7f9b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:33.591189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f424a-0744-4484-ac63-54cac0c5dd77 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:33.597401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8a4f424a-0744-4484-ac63-54cac0c5dd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:33.617581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1f1bc-f054-44b9-865d-a550b57af854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:33.619350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1f1bc-f054-44b9-865d-a550b57af854 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:33.619899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1f1bc-f054-44b9-865d-a550b57af854 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:33.620856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1f1bc-f054-44b9-865d-a550b57af854 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:33.623089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1f1bc-f054-44b9-865d-a550b57af854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:33.629251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1f1bc-f054-44b9-865d-a550b57af854 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:33.663509 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1179/2329] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:33.664748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1f1bc-f054-44b9-865d-a550b57af854 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:33.672015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:33.697678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1f1bc-f054-44b9-865d-a550b57af854 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:33.714733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba14adf-e407-44f2-b6bf-551bcb5ab668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:33.715823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14adf-e407-44f2-b6bf-551bcb5ab668 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:33.717537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14adf-e407-44f2-b6bf-551bcb5ab668 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:33.718948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14adf-e407-44f2-b6bf-551bcb5ab668 admin admin] PATH_INFO: `/v3/projects/adaca3c55bdc4997af5fe503befd19e5/users/2f066e3f66ed43beb9ba3c98debe1ac2/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:33.765479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f424a-0744-4484-ac63-54cac0c5dd77 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:33.767504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba14adf-e407-44f2-b6bf-551bcb5ab668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adaca3c55bdc4997af5fe503befd19e5, user_id=2f066e3f66ed43beb9ba3c98debe1ac2, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:33.773179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba14adf-e407-44f2-b6bf-551bcb5ab668 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:33.775617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f362b3-5a06-4b22-8683-209c495bcc56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:33.776396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f362b3-5a06-4b22-8683-209c495bcc56 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:33.776861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f362b3-5a06-4b22-8683-209c495bcc56 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:33.777148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f362b3-5a06-4b22-8683-209c495bcc56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:33.807620 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1180/2330] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:33 2022] PUT /identity/v3/projects/adaca3c55bdc4997af5fe503befd19e5/users/2f066e3f66ed43beb9ba3c98debe1ac2/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:33.821527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c536e-ebc5-4b52-becf-a1a3e63f3b59 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:33.822052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c536e-ebc5-4b52-becf-a1a3e63f3b59 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:33.822521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c536e-ebc5-4b52-becf-a1a3e63f3b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:33.884896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f362b3-5a06-4b22-8683-209c495bcc56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:33.887059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f362b3-5a06-4b22-8683-209c495bcc56 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:33.891824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:33.909575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ad0c536e-ebc5-4b52-becf-a1a3e63f3b59 None None] MFA Rules not processed for user `2f066e3f66ed43beb9ba3c98debe1ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:33.911177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ad0c536e-ebc5-4b52-becf-a1a3e63f3b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:33.918818 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1151/2331] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:33 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:34.073844 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1181/2332] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:34.078381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f362b3-5a06-4b22-8683-209c495bcc56 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:34.098968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f362b3-5a06-4b22-8683-209c495bcc56 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:34.274854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb509f-4373-4c1f-946a-ded87d7a5a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:34.275574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb509f-4373-4c1f-946a-ded87d7a5a2e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:34.275741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb509f-4373-4c1f-946a-ded87d7a5a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:34.276171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb509f-4373-4c1f-946a-ded87d7a5a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:34.276817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb509f-4373-4c1f-946a-ded87d7a5a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:34.286365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb509f-4373-4c1f-946a-ded87d7a5a2e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:34.360475 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1152/2333] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:34 2022] POST /identity/v3/projects => generated 379 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:34.361565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c536e-ebc5-4b52-becf-a1a3e63f3b59 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:34.379426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c536e-ebc5-4b52-becf-a1a3e63f3b59 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:34.541346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7b216-2b77-43ab-91e2-51fb3ba09141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:34.542037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7b216-2b77-43ab-91e2-51fb3ba09141 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:34.542327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7b216-2b77-43ab-91e2-51fb3ba09141 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:34.543070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7b216-2b77-43ab-91e2-51fb3ba09141 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:34.543301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7b216-2b77-43ab-91e2-51fb3ba09141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:34.549168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7b216-2b77-43ab-91e2-51fb3ba09141 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:34.603810 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1182/2334] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:34 2022] POST /identity/v3/users => generated 296 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:34.606949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb509f-4373-4c1f-946a-ded87d7a5a2e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:34.625858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb509f-4373-4c1f-946a-ded87d7a5a2e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:34.638978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25f43f-9153-4ead-aaa3-425dfe6c9cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:34.641229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25f43f-9153-4ead-aaa3-425dfe6c9cae admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:34.641507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25f43f-9153-4ead-aaa3-425dfe6c9cae admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:34.641783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25f43f-9153-4ead-aaa3-425dfe6c9cae admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:34.642454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25f43f-9153-4ead-aaa3-425dfe6c9cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:34.644080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25f43f-9153-4ead-aaa3-425dfe6c9cae admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:34.677692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7b216-2b77-43ab-91e2-51fb3ba09141 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:34.680039 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1153/2335] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:34.700790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7b216-2b77-43ab-91e2-51fb3ba09141 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:34.719433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d43ad9-280e-448a-b631-01474f5e26f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:34.720141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d43ad9-280e-448a-b631-01474f5e26f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:34.720426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d43ad9-280e-448a-b631-01474f5e26f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:34.720709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d43ad9-280e-448a-b631-01474f5e26f0 admin admin] PATH_INFO: `/v3/projects/659887bd24984a1fb82f7658b10d6e91/users/b58472442d3244739243886fa15bdbfd/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:34.761394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25f43f-9153-4ead-aaa3-425dfe6c9cae admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:34.764354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ec25f43f-9153-4ead-aaa3-425dfe6c9cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:34.778948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d43ad9-280e-448a-b631-01474f5e26f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659887bd24984a1fb82f7658b10d6e91, user_id=b58472442d3244739243886fa15bdbfd, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:34.782022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d43ad9-280e-448a-b631-01474f5e26f0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:34.813217 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1183/2336] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:34 2022] PUT /identity/v3/projects/659887bd24984a1fb82f7658b10d6e91/users/b58472442d3244739243886fa15bdbfd/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:34.818463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d43ad9-280e-448a-b631-01474f5e26f0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:34.870545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:34.958347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25f43f-9153-4ead-aaa3-425dfe6c9cae admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:34.961867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d43ad9-280e-448a-b631-01474f5e26f0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:34.973670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cafde-b3c9-4216-8cca-35a5519188de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:34.975232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cafde-b3c9-4216-8cca-35a5519188de admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:34.975556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cafde-b3c9-4216-8cca-35a5519188de admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:34.975831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cafde-b3c9-4216-8cca-35a5519188de admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:34.976568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cafde-b3c9-4216-8cca-35a5519188de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:34.980564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cafde-b3c9-4216-8cca-35a5519188de admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:35.004248 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1184/2337] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:35.008814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cafde-b3c9-4216-8cca-35a5519188de admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:35.018170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:35.026923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cafde-b3c9-4216-8cca-35a5519188de admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:35.051862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0e445-cf0a-42e8-86b2-44d18a161d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:35.052604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0e445-cf0a-42e8-86b2-44d18a161d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:35.052885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0e445-cf0a-42e8-86b2-44d18a161d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:35.053290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0e445-cf0a-42e8-86b2-44d18a161d85 admin admin] PATH_INFO: `/v3/projects/659887bd24984a1fb82f7658b10d6e91/users/b58472442d3244739243886fa15bdbfd/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:35.057219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0e445-cf0a-42e8-86b2-44d18a161d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659887bd24984a1fb82f7658b10d6e91, user_id=b58472442d3244739243886fa15bdbfd, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:35.059909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0e445-cf0a-42e8-86b2-44d18a161d85 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:35.086635 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1185/2338] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:35 2022] PUT /identity/v3/projects/659887bd24984a1fb82f7658b10d6e91/users/b58472442d3244739243886fa15bdbfd/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:35.096904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb88522-8545-4f34-88d8-c5ef0c8c90c6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:35.097242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb88522-8545-4f34-88d8-c5ef0c8c90c6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:35.097479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb88522-8545-4f34-88d8-c5ef0c8c90c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:35.118735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142f27a-ee93-4a0c-bd6c-2fc408f78cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:35.119359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142f27a-ee93-4a0c-bd6c-2fc408f78cf5 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:35.119638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142f27a-ee93-4a0c-bd6c-2fc408f78cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:35.119906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142f27a-ee93-4a0c-bd6c-2fc408f78cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:35.124114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7142f27a-ee93-4a0c-bd6c-2fc408f78cf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:35.145453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bfb88522-8545-4f34-88d8-c5ef0c8c90c6 None None] MFA Rules not processed for user `b58472442d3244739243886fa15bdbfd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:35.147387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bfb88522-8545-4f34-88d8-c5ef0c8c90c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:35.211154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142f27a-ee93-4a0c-bd6c-2fc408f78cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:35.213248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142f27a-ee93-4a0c-bd6c-2fc408f78cf5 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:35.258317 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1154/2339] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:35.277490 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1186/2340] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:52:35.277976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142f27a-ee93-4a0c-bd6c-2fc408f78cf5 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:35.279397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7142f27a-ee93-4a0c-bd6c-2fc408f78cf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:35.295374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb88522-8545-4f34-88d8-c5ef0c8c90c6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:35.300053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142f27a-ee93-4a0c-bd6c-2fc408f78cf5 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:35.394470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:35.396540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:35.397610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:35.398130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] PATH_INFO: `/v3/users/3c1e311c770940b3a9f1270370d08920` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:35.402524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1e311c770940b3a9f1270370d08920)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:35.408320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:35.420678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:35.459498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb88522-8545-4f34-88d8-c5ef0c8c90c6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:35.468699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd93d0-57d8-4b15-bf82-fd59a647fab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:35.469704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd93d0-57d8-4b15-bf82-fd59a647fab2 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:35.470009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd93d0-57d8-4b15-bf82-fd59a647fab2 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:35.470265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd93d0-57d8-4b15-bf82-fd59a647fab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:35.488109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd93d0-57d8-4b15-bf82-fd59a647fab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:35.490024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd93d0-57d8-4b15-bf82-fd59a647fab2 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:35.507601 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1187/2341] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:52:35.528246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1e311c770940b3a9f1270370d08920'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:35.552169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1e311c770940b3a9f1270370d08920'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:35.554189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1e311c770940b3a9f1270370d08920'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:35.556416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1e311c770940b3a9f1270370d08920'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:35.591075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1e311c770940b3a9f1270370d08920'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:35.631244 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1155/2342] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:35 2022] DELETE /identity/v3/users/3c1e311c770940b3a9f1270370d08920 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:35.632759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf59b0-3b26-4e62-b781-7234f82a2262 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:35.633053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf59b0-3b26-4e62-b781-7234f82a2262 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:35.633353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf59b0-3b26-4e62-b781-7234f82a2262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:35.675799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2fdf59b0-3b26-4e62-b781-7234f82a2262 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:35.682510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2fdf59b0-3b26-4e62-b781-7234f82a2262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:35.842779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:35.876176 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1188/2343] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:52:35.920322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:35.923219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:36.053163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1949103-533a-4245-bfb6-39243a73f81d None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:36.068774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1949103-533a-4245-bfb6-39243a73f81d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:36.069220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1949103-533a-4245-bfb6-39243a73f81d None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:36.070933 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1189/2344] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:36 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:36.076465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1949103-533a-4245-bfb6-39243a73f81d None None] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:36.079047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d1949103-533a-4245-bfb6-39243a73f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:36.133647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c65e15-7625-4d86-a5c8-4885c30a83aa admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:36.142599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42936378-5c32-4a66-a965-930cca5ed55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:36.143330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42936378-5c32-4a66-a965-930cca5ed55d service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:36.143684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42936378-5c32-4a66-a965-930cca5ed55d service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:36.144037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42936378-5c32-4a66-a965-930cca5ed55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:36.162676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42936378-5c32-4a66-a965-930cca5ed55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:36.164269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42936378-5c32-4a66-a965-930cca5ed55d service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:36.204847 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1156/2345] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:36.288269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1949103-533a-4245-bfb6-39243a73f81d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:36.290402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d1949103-533a-4245-bfb6-39243a73f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:36.459200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1949103-533a-4245-bfb6-39243a73f81d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:36.466618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cd362-0e52-484a-9069-fd9156a92cdc tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58472442d3244739243886fa15bdbfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '659887bd24984a1fb82f7658b10d6e91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:36.467356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cd362-0e52-484a-9069-fd9156a92cdc tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:36.467706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cd362-0e52-484a-9069-fd9156a92cdc tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:36.468560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cd362-0e52-484a-9069-fd9156a92cdc tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] PATH_INFO: `/v3/projects/adaca3c55bdc4997af5fe503befd19e5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:36.470018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cd362-0e52-484a-9069-fd9156a92cdc tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] RBAC: Authorizing `identity:get_project(project_id=adaca3c55bdc4997af5fe503befd19e5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:36.472365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cd362-0e52-484a-9069-fd9156a92cdc tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:36.474920 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1190/2346] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:36 2022] GET /identity/v3/projects/adaca3c55bdc4997af5fe503befd19e5 => generated 379 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:52:36.571056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42936378-5c32-4a66-a965-930cca5ed55d service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:36.573178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-42936378-5c32-4a66-a965-930cca5ed55d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:36.601895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42936378-5c32-4a66-a965-930cca5ed55d service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:36.617053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b1791-f1c6-4570-b966-e94ab6b1d090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:36.617783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1791-f1c6-4570-b966-e94ab6b1d090 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:36.618244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1791-f1c6-4570-b966-e94ab6b1d090 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:36.618365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1791-f1c6-4570-b966-e94ab6b1d090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:36.631007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d82b1791-f1c6-4570-b966-e94ab6b1d090 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:36.750738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b1791-f1c6-4570-b966-e94ab6b1d090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:36.756786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b1791-f1c6-4570-b966-e94ab6b1d090 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:36.773019 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1157/2347] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:37.217470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942c094-2e69-456d-88ec-5a5e8feed919 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:37.218363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942c094-2e69-456d-88ec-5a5e8feed919 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:37.218819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942c094-2e69-456d-88ec-5a5e8feed919 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:37.220885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1191/2348] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:37.229214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b1791-f1c6-4570-b966-e94ab6b1d090 service nova] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:52:37.245253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b1791-f1c6-4570-b966-e94ab6b1d090 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:37.269385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b1791-f1c6-4570-b966-e94ab6b1d090 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:37.283330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c13158-ffdb-4f2b-a7e3-852a3095fc12 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58472442d3244739243886fa15bdbfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '659887bd24984a1fb82f7658b10d6e91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:37.284124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13158-ffdb-4f2b-a7e3-852a3095fc12 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:37.285831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13158-ffdb-4f2b-a7e3-852a3095fc12 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:37.285831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13158-ffdb-4f2b-a7e3-852a3095fc12 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] PATH_INFO: `/v3/projects/adaca3c55bdc4997af5fe503befd19e5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:37.287425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13158-ffdb-4f2b-a7e3-852a3095fc12 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] RBAC: Authorizing `identity:get_project(project_id=adaca3c55bdc4997af5fe503befd19e5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:37.294979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13158-ffdb-4f2b-a7e3-852a3095fc12 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:37.298866 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1158/2349] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:52:37 2022] GET /identity/v3/projects/adaca3c55bdc4997af5fe503befd19e5 => generated 379 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:37.840634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942c094-2e69-456d-88ec-5a5e8feed919 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:37.842478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4942c094-2e69-456d-88ec-5a5e8feed919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:37.871936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942c094-2e69-456d-88ec-5a5e8feed919 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:37.892968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:37.892968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:37.892968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:37.892968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] PATH_INFO: `/v3/projects/d906d4ba6e8d4b44b75e12ad5d5cae54` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:37.893490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d906d4ba6e8d4b44b75e12ad5d5cae54)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:37.893490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:37.978541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c13158-ffdb-4f2b-a7e3-852a3095fc12 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:37.980323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-54c13158-ffdb-4f2b-a7e3-852a3095fc12 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:38.026227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c13158-ffdb-4f2b-a7e3-852a3095fc12 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:38.037887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd906d4ba6e8d4b44b75e12ad5d5cae54', 'request_id': 'req-803de303-2b96-4ce3-acf3-e47cded07053'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.063317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd906d4ba6e8d4b44b75e12ad5d5cae54', 'request_id': 'req-803de303-2b96-4ce3-acf3-e47cded07053'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.073993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:38.085941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd906d4ba6e8d4b44b75e12ad5d5cae54', 'request_id': 'req-803de303-2b96-4ce3-acf3-e47cded07053'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.117936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] The token cache is being invalidate because project d906d4ba6e8d4b44b75e12ad5d5cae54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:38.118081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.119503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.129558 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1192/2350] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:37 2022] DELETE /identity/v3/projects/d906d4ba6e8d4b44b75e12ad5d5cae54 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:38.130677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:38.137731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:38.205821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:38.238539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:38.240733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:38.244022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:38.245285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] PATH_INFO: `/v3/users/c0eb2feb062947e78357b70e832e3edc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:38.251598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0eb2feb062947e78357b70e832e3edc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:38.258787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:38.357772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803de303-2b96-4ce3-acf3-e47cded07053 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:38.367995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49573e-06c4-4777-8b03-95184260c794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:38.369024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49573e-06c4-4777-8b03-95184260c794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:38.369332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49573e-06c4-4777-8b03-95184260c794 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:38.369656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49573e-06c4-4777-8b03-95184260c794 admin admin] PATH_INFO: `/v3/users/3ee31a07d4ef4decb6b7655699f83707` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:38.371519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49573e-06c4-4777-8b03-95184260c794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee31a07d4ef4decb6b7655699f83707)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:38.373455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49573e-06c4-4777-8b03-95184260c794 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:38.399662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0eb2feb062947e78357b70e832e3edc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.429781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0eb2feb062947e78357b70e832e3edc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.431562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0eb2feb062947e78357b70e832e3edc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.434734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0eb2feb062947e78357b70e832e3edc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.465150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0eb2feb062947e78357b70e832e3edc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.473858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c49573e-06c4-4777-8b03-95184260c794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee31a07d4ef4decb6b7655699f83707'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.488754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c49573e-06c4-4777-8b03-95184260c794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee31a07d4ef4decb6b7655699f83707'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.491374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c49573e-06c4-4777-8b03-95184260c794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee31a07d4ef4decb6b7655699f83707'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.492052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c49573e-06c4-4777-8b03-95184260c794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee31a07d4ef4decb6b7655699f83707'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.496002 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1159/2351] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:37 2022] DELETE /identity/v3/users/c0eb2feb062947e78357b70e832e3edc => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:38.496992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:38.500837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:38.551380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c49573e-06c4-4777-8b03-95184260c794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee31a07d4ef4decb6b7655699f83707'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:38.582166 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1193/2352] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:38 2022] DELETE /identity/v3/users/3ee31a07d4ef4decb6b7655699f83707 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:38.585412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf195c68-ea2e-4ed7-be0b-90f0f8c40f2c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:38.585883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf195c68-ea2e-4ed7-be0b-90f0f8c40f2c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:38.586264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf195c68-ea2e-4ed7-be0b-90f0f8c40f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:38.630296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bf195c68-ea2e-4ed7-be0b-90f0f8c40f2c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:38.632302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bf195c68-ea2e-4ed7-be0b-90f0f8c40f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:38.703035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d25cb-af76-47c8-bd09-390d23d93150 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:38.808560 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1194/2353] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:38.821946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:38.875283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf195c68-ea2e-4ed7-be0b-90f0f8c40f2c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:38.877239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bf195c68-ea2e-4ed7-be0b-90f0f8c40f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:38.915879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a8ab4-17dc-4cb8-bd0a-ff458f86e2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:38.917642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a8ab4-17dc-4cb8-bd0a-ff458f86e2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:38.920082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a8ab4-17dc-4cb8-bd0a-ff458f86e2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:38.921950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a8ab4-17dc-4cb8-bd0a-ff458f86e2c0 admin admin] PATH_INFO: `/v3/users/2f066e3f66ed43beb9ba3c98debe1ac2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:38.925589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a8ab4-17dc-4cb8-bd0a-ff458f86e2c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f066e3f66ed43beb9ba3c98debe1ac2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:38.934410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a8ab4-17dc-4cb8-bd0a-ff458f86e2c0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:39.041965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:39.089600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf195c68-ea2e-4ed7-be0b-90f0f8c40f2c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:39.099714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1639c0-efad-4149-be18-e8caa4eb5b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:39.100361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1639c0-efad-4149-be18-e8caa4eb5b06 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:39.100646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1639c0-efad-4149-be18-e8caa4eb5b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:39.100918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1639c0-efad-4149-be18-e8caa4eb5b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:39.112652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3e5a8ab4-17dc-4cb8-bd0a-ff458f86e2c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f066e3f66ed43beb9ba3c98debe1ac2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:39.135564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1639c0-efad-4149-be18-e8caa4eb5b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:39.136489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3e5a8ab4-17dc-4cb8-bd0a-ff458f86e2c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f066e3f66ed43beb9ba3c98debe1ac2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:39.137032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1639c0-efad-4149-be18-e8caa4eb5b06 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:39.137868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3e5a8ab4-17dc-4cb8-bd0a-ff458f86e2c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f066e3f66ed43beb9ba3c98debe1ac2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:39.139011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3e5a8ab4-17dc-4cb8-bd0a-ff458f86e2c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f066e3f66ed43beb9ba3c98debe1ac2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:39.178480 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1195/2354] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:39.181160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3e5a8ab4-17dc-4cb8-bd0a-ff458f86e2c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f066e3f66ed43beb9ba3c98debe1ac2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:39.182281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa9604-3338-4c9f-bc93-f0ca289f87d5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:39.183810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa9604-3338-4c9f-bc93-f0ca289f87d5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:39.184231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa9604-3338-4c9f-bc93-f0ca289f87d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:39.219042 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1160/2355] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:38 2022] DELETE /identity/v3/users/2f066e3f66ed43beb9ba3c98debe1ac2 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:39.229102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb28f-fc4e-49ae-acb5-b37fa7eb873a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:39.229435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb28f-fc4e-49ae-acb5-b37fa7eb873a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:39.229718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb28f-fc4e-49ae-acb5-b37fa7eb873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:39.255124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a1aa9604-3338-4c9f-bc93-f0ca289f87d5 None None] MFA Rules not processed for user `474ca64d1b1d4e30916b517645aba882`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:39.256579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a1aa9604-3338-4c9f-bc93-f0ca289f87d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:39.279407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a8ebb28f-fc4e-49ae-acb5-b37fa7eb873a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:39.285741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a8ebb28f-fc4e-49ae-acb5-b37fa7eb873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:39.363091 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1196/2356] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:39.367936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa9604-3338-4c9f-bc93-f0ca289f87d5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:39.370701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a1aa9604-3338-4c9f-bc93-f0ca289f87d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:39.466146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa9604-3338-4c9f-bc93-f0ca289f87d5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:39.483564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992fb93-4157-4d80-a1a8-d4acc33e8175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:39.484881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992fb93-4157-4d80-a1a8-d4acc33e8175 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:39.485375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992fb93-4157-4d80-a1a8-d4acc33e8175 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:39.486090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992fb93-4157-4d80-a1a8-d4acc33e8175 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:39.486922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992fb93-4157-4d80-a1a8-d4acc33e8175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:39.488961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992fb93-4157-4d80-a1a8-d4acc33e8175 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:39.611960 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1197/2357] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:39 2022] POST /identity/v3/projects => generated 369 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:39.616192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58808b18-6f08-4b6f-9fe8-50ac376e6c56 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:39.616412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58808b18-6f08-4b6f-9fe8-50ac376e6c56 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:39.616628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58808b18-6f08-4b6f-9fe8-50ac376e6c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:39.725763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-58808b18-6f08-4b6f-9fe8-50ac376e6c56 None None] MFA Rules not processed for user `98936da9b5d94165b386d2d0893ac142`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:39.727021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-58808b18-6f08-4b6f-9fe8-50ac376e6c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:39.855738 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1161/2358] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 625 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:39.855738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebb28f-fc4e-49ae-acb5-b37fa7eb873a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:39.856023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:39.894922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebb28f-fc4e-49ae-acb5-b37fa7eb873a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:39.939206 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1198/2359] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:39 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:39.942442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58808b18-6f08-4b6f-9fe8-50ac376e6c56 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:39.946222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-58808b18-6f08-4b6f-9fe8-50ac376e6c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:40.078354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb049-6b4f-41d5-9226-51d8c00b9841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:40.079106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb049-6b4f-41d5-9226-51d8c00b9841 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:40.080579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb049-6b4f-41d5-9226-51d8c00b9841 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:40.081471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb049-6b4f-41d5-9226-51d8c00b9841 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:40.082228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdb049-6b4f-41d5-9226-51d8c00b9841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:40.084239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdb049-6b4f-41d5-9226-51d8c00b9841 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:40.095303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58808b18-6f08-4b6f-9fe8-50ac376e6c56 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:40.101437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e82e85-fec3-4d5c-9609-12dc7aa17d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:40.102407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e82e85-fec3-4d5c-9609-12dc7aa17d5a service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:40.102868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e82e85-fec3-4d5c-9609-12dc7aa17d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:40.103319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e82e85-fec3-4d5c-9609-12dc7aa17d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:40.115971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e82e85-fec3-4d5c-9609-12dc7aa17d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:40.119043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e82e85-fec3-4d5c-9609-12dc7aa17d5a service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:40.122705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:40.136929 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1199/2360] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:40.139392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e82e85-fec3-4d5c-9609-12dc7aa17d5a service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:40.141453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-44e82e85-fec3-4d5c-9609-12dc7aa17d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:40.156123 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1162/2361] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:39 2022] POST /identity/v3/users => generated 291 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:40.157416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb049-6b4f-41d5-9226-51d8c00b9841 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:40.160168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0efdb049-6b4f-41d5-9226-51d8c00b9841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:40.168069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e82e85-fec3-4d5c-9609-12dc7aa17d5a service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:40.190371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecd9fc-777a-41db-bd5f-6095f698c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:40.191012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecd9fc-777a-41db-bd5f-6095f698c882 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:40.191298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecd9fc-777a-41db-bd5f-6095f698c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:40.191576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecd9fc-777a-41db-bd5f-6095f698c882 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:40.192218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecd9fc-777a-41db-bd5f-6095f698c882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:40.194161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecd9fc-777a-41db-bd5f-6095f698c882 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:40.200839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb049-6b4f-41d5-9226-51d8c00b9841 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:40.207296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:40.207937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:40.208301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:40.208590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] PATH_INFO: `/v3/projects/38f22d5aa06c46dda6c04cc24a5b7e70` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:40.210624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f22d5aa06c46dda6c04cc24a5b7e70)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:40.212660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:40.251659 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1200/2362] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:40 2022] POST /identity/v3/projects => generated 401 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:40.252745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecd9fc-777a-41db-bd5f-6095f698c882 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:40.259333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c3ecd9fc-777a-41db-bd5f-6095f698c882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:40.312863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f22d5aa06c46dda6c04cc24a5b7e70', 'request_id': 'req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:40.338097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f22d5aa06c46dda6c04cc24a5b7e70', 'request_id': 'req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:40.348777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f22d5aa06c46dda6c04cc24a5b7e70', 'request_id': 'req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:40.377487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] The token cache is being invalidate because project 38f22d5aa06c46dda6c04cc24a5b7e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:40.378879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:40.380285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:40.390028 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1163/2363] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:40 2022] DELETE /identity/v3/projects/38f22d5aa06c46dda6c04cc24a5b7e70 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:40.399853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:40.421531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecd9fc-777a-41db-bd5f-6095f698c882 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:40.424157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:40.531462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436f16c-a939-45d0-b38a-cf19b6c1579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:40.532433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436f16c-a939-45d0-b38a-cf19b6c1579b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:40.532734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436f16c-a939-45d0-b38a-cf19b6c1579b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:40.533649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436f16c-a939-45d0-b38a-cf19b6c1579b admin admin] PATH_INFO: `/v3/projects/18029da9b9854f3caf3debd9556f1f24` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:40.534884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436f16c-a939-45d0-b38a-cf19b6c1579b admin admin] RBAC: Authorizing `identity:delete_project(project_id=18029da9b9854f3caf3debd9556f1f24)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:40.536953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436f16c-a939-45d0-b38a-cf19b6c1579b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:40.556574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:40.569216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18f0b8-f6fe-4c3b-baf1-4e00bce12a09 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:40.581292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e9bc5-3381-4abe-aafa-be7b488c369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:40.582075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e9bc5-3381-4abe-aafa-be7b488c369d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:40.582428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e9bc5-3381-4abe-aafa-be7b488c369d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:40.584465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e9bc5-3381-4abe-aafa-be7b488c369d admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:40.589699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e9bc5-3381-4abe-aafa-be7b488c369d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:40.591553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e9bc5-3381-4abe-aafa-be7b488c369d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:40.614276 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1164/2364] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:40.615042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e9bc5-3381-4abe-aafa-be7b488c369d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:40.617027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-002e9bc5-3381-4abe-aafa-be7b488c369d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:40.637679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8436f16c-a939-45d0-b38a-cf19b6c1579b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18029da9b9854f3caf3debd9556f1f24', 'request_id': 'req-8436f16c-a939-45d0-b38a-cf19b6c1579b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:40.652485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8436f16c-a939-45d0-b38a-cf19b6c1579b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18029da9b9854f3caf3debd9556f1f24', 'request_id': 'req-8436f16c-a939-45d0-b38a-cf19b6c1579b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:40.661016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8436f16c-a939-45d0-b38a-cf19b6c1579b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18029da9b9854f3caf3debd9556f1f24', 'request_id': 'req-8436f16c-a939-45d0-b38a-cf19b6c1579b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:40.666664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e9bc5-3381-4abe-aafa-be7b488c369d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:40.676365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8436f16c-a939-45d0-b38a-cf19b6c1579b admin admin] The token cache is being invalidate because project 18029da9b9854f3caf3debd9556f1f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:40.676673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8436f16c-a939-45d0-b38a-cf19b6c1579b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:40.677459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8436f16c-a939-45d0-b38a-cf19b6c1579b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:40.682605 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1201/2365] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:40 2022] DELETE /identity/v3/projects/18029da9b9854f3caf3debd9556f1f24 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:40.683945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93965ef5-65e6-4dd7-b8b9-e2f77d3a7813 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:40.684237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93965ef5-65e6-4dd7-b8b9-e2f77d3a7813 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:40.684517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93965ef5-65e6-4dd7-b8b9-e2f77d3a7813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:40.729119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-93965ef5-65e6-4dd7-b8b9-e2f77d3a7813 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:40.730419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-93965ef5-65e6-4dd7-b8b9-e2f77d3a7813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:40.812254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf68f2-e7dc-4382-b2be-d60eb292c921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:40.813063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf68f2-e7dc-4382-b2be-d60eb292c921 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:40.813486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf68f2-e7dc-4382-b2be-d60eb292c921 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:40.813878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf68f2-e7dc-4382-b2be-d60eb292c921 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:40.814586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf68f2-e7dc-4382-b2be-d60eb292c921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:40.817338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf68f2-e7dc-4382-b2be-d60eb292c921 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:40.840219 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1202/2366] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:40.840219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93965ef5-65e6-4dd7-b8b9-e2f77d3a7813 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:40.840219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-93965ef5-65e6-4dd7-b8b9-e2f77d3a7813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:40.850769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93965ef5-65e6-4dd7-b8b9-e2f77d3a7813 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:40.857391 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1165/2367] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:40 2022] POST /identity/v3/users => generated 307 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:40.857563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6a25d-9ba3-403e-91dc-860cfd189550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:40.857563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6a25d-9ba3-403e-91dc-860cfd189550 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:40.857563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6a25d-9ba3-403e-91dc-860cfd189550 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:40.857825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf68f2-e7dc-4382-b2be-d60eb292c921 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:40.858087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6a25d-9ba3-403e-91dc-860cfd189550 admin admin] PATH_INFO: `/v3/projects/603c33329f8c46c288e987d1d1efaa8c/users/92974e07be4b45bab207d0f544fae05a/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:40.862536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5acf68f2-e7dc-4382-b2be-d60eb292c921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:40.874852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6a25d-9ba3-403e-91dc-860cfd189550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603c33329f8c46c288e987d1d1efaa8c, user_id=92974e07be4b45bab207d0f544fae05a, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:40.877494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:40.878910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6a25d-9ba3-403e-91dc-860cfd189550 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:40.889067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf68f2-e7dc-4382-b2be-d60eb292c921 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:40.903863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022546e-b1f5-4165-bd9b-75ce8c946f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:40.904341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022546e-b1f5-4165-bd9b-75ce8c946f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:40.904697 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1203/2368] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:40 2022] PUT /identity/v3/projects/603c33329f8c46c288e987d1d1efaa8c/users/92974e07be4b45bab207d0f544fae05a/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:40.906231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022546e-b1f5-4165-bd9b-75ce8c946f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:40.906534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022546e-b1f5-4165-bd9b-75ce8c946f43 admin admin] PATH_INFO: `/v3/users/cc3c85542ba54f539dce400859fcc1eb` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:40.906906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6a25d-9ba3-403e-91dc-860cfd189550 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:40.908892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022546e-b1f5-4165-bd9b-75ce8c946f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3c85542ba54f539dce400859fcc1eb)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:40.909579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cae6a25d-9ba3-403e-91dc-860cfd189550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:40.914082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022546e-b1f5-4165-bd9b-75ce8c946f43 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:40.989206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f022546e-b1f5-4165-bd9b-75ce8c946f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3c85542ba54f539dce400859fcc1eb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:40.995876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6a25d-9ba3-403e-91dc-860cfd189550 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:41.002699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:41.003451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:41.003803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:41.004178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] PATH_INFO: `/v3/projects/adaca3c55bdc4997af5fe503befd19e5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:41.004675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f022546e-b1f5-4165-bd9b-75ce8c946f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3c85542ba54f539dce400859fcc1eb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.005557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f022546e-b1f5-4165-bd9b-75ce8c946f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3c85542ba54f539dce400859fcc1eb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.005898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adaca3c55bdc4997af5fe503befd19e5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:41.006625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f022546e-b1f5-4165-bd9b-75ce8c946f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3c85542ba54f539dce400859fcc1eb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.008116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:41.023290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f022546e-b1f5-4165-bd9b-75ce8c946f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3c85542ba54f539dce400859fcc1eb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.050325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:41.059203 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1166/2369] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:40 2022] DELETE /identity/v3/users/cc3c85542ba54f539dce400859fcc1eb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:41.061262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2866d-f16c-416f-81d2-7c926bed4139 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:41.061665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2866d-f16c-416f-81d2-7c926bed4139 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:41.062506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2866d-f16c-416f-81d2-7c926bed4139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:41.093130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a0b2866d-f16c-416f-81d2-7c926bed4139 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:41.095253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adaca3c55bdc4997af5fe503befd19e5', 'request_id': 'req-fea2dd21-7b89-42af-9a0b-9462d698dcc5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.095688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a0b2866d-f16c-416f-81d2-7c926bed4139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:41.112747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adaca3c55bdc4997af5fe503befd19e5', 'request_id': 'req-fea2dd21-7b89-42af-9a0b-9462d698dcc5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.122134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adaca3c55bdc4997af5fe503befd19e5', 'request_id': 'req-fea2dd21-7b89-42af-9a0b-9462d698dcc5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.146398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] The token cache is being invalidate because project adaca3c55bdc4997af5fe503befd19e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:41.146704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.148213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.151196 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1204/2370] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:40 2022] DELETE /identity/v3/projects/adaca3c55bdc4997af5fe503befd19e5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:41.155064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:41.162210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:41.256215 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1167/2371] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:41.257387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2866d-f16c-416f-81d2-7c926bed4139 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:41.262652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a0b2866d-f16c-416f-81d2-7c926bed4139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:41.281962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2866d-f16c-416f-81d2-7c926bed4139 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:41.290294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812ec33-183d-4154-9e8f-562f5dfcf62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:41.292077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812ec33-183d-4154-9e8f-562f5dfcf62e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:41.292370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812ec33-183d-4154-9e8f-562f5dfcf62e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:41.292707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812ec33-183d-4154-9e8f-562f5dfcf62e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:41.293331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812ec33-183d-4154-9e8f-562f5dfcf62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:41.293944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2dd21-7b89-42af-9a0b-9462d698dcc5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:41.300182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812ec33-183d-4154-9e8f-562f5dfcf62e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:41.301129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6173a-c057-426e-a10e-1824615d6f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:41.303330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6173a-c057-426e-a10e-1824615d6f20 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:41.303612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6173a-c057-426e-a10e-1824615d6f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:41.305275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6173a-c057-426e-a10e-1824615d6f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:41.305275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6173a-c057-426e-a10e-1824615d6f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:41.306635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6173a-c057-426e-a10e-1824615d6f20 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:41.323646 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1205/2372] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:41.324478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6173a-c057-426e-a10e-1824615d6f20 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:41.326233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c6a6173a-c057-426e-a10e-1824615d6f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:41.330344 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1168/2373] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:41.331325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812ec33-183d-4154-9e8f-562f5dfcf62e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:41.342301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6173a-c057-426e-a10e-1824615d6f20 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:41.348972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:41.349657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:41.349933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:41.350200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] PATH_INFO: `/v3/users/b58472442d3244739243886fa15bdbfd` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:41.351353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58472442d3244739243886fa15bdbfd)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:41.353113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812ec33-183d-4154-9e8f-562f5dfcf62e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:41.353366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:41.372138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e6bd2-af30-44e5-a1f0-e469f924e9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:41.372770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e6bd2-af30-44e5-a1f0-e469f924e9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:41.373052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e6bd2-af30-44e5-a1f0-e469f924e9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:41.373361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e6bd2-af30-44e5-a1f0-e469f924e9c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:41.374016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e6bd2-af30-44e5-a1f0-e469f924e9c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:41.374920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e6bd2-af30-44e5-a1f0-e469f924e9c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:41.376518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e6bd2-af30-44e5-a1f0-e469f924e9c5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:41.401242 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1169/2374] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:41.401919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e6bd2-af30-44e5-a1f0-e469f924e9c5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:41.420086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e6bd2-af30-44e5-a1f0-e469f924e9c5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:41.435075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ede45e-5a87-44ff-94af-05c83a00871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:41.435758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ede45e-5a87-44ff-94af-05c83a00871c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:41.436083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ede45e-5a87-44ff-94af-05c83a00871c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:41.436365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ede45e-5a87-44ff-94af-05c83a00871c admin admin] PATH_INFO: `/v3/projects/5b99cddc64e94772b4dcfc14a84f5796/users/2495d40e2857401a83a78bcdbed948a7/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:41.468432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ede45e-5a87-44ff-94af-05c83a00871c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b99cddc64e94772b4dcfc14a84f5796, user_id=2495d40e2857401a83a78bcdbed948a7, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:41.471388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ede45e-5a87-44ff-94af-05c83a00871c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:41.488808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58472442d3244739243886fa15bdbfd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.510388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58472442d3244739243886fa15bdbfd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.511383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58472442d3244739243886fa15bdbfd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.515239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58472442d3244739243886fa15bdbfd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.533986 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1170/2375] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:41 2022] PUT /identity/v3/projects/5b99cddc64e94772b4dcfc14a84f5796/users/2495d40e2857401a83a78bcdbed948a7/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:41.535423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ede45e-5a87-44ff-94af-05c83a00871c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:41.541090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-74ede45e-5a87-44ff-94af-05c83a00871c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:41.554632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58472442d3244739243886fa15bdbfd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:41.590446 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1206/2376] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:41 2022] DELETE /identity/v3/users/b58472442d3244739243886fa15bdbfd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:41.592432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:41.594551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:41.612668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:41.630503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:41.699486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ede45e-5a87-44ff-94af-05c83a00871c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:41.702052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135c655-913e-4166-9ace-0b1a2f7f7a97 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:41.711663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ecb62-7a24-4ca3-92ef-c6a04d609999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:41.712539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8c79-d72c-4d2d-9f83-477d253bee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:41.713269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ecb62-7a24-4ca3-92ef-c6a04d609999 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:41.713611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8c79-d72c-4d2d-9f83-477d253bee54 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:41.713728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ecb62-7a24-4ca3-92ef-c6a04d609999 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:41.714025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ecb62-7a24-4ca3-92ef-c6a04d609999 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:41.714274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8c79-d72c-4d2d-9f83-477d253bee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:41.714704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8c79-d72c-4d2d-9f83-477d253bee54 admin admin] PATH_INFO: `/v3/projects/603c33329f8c46c288e987d1d1efaa8c/users/92974e07be4b45bab207d0f544fae05a/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:41.714941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ecb62-7a24-4ca3-92ef-c6a04d609999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:41.717735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ecb62-7a24-4ca3-92ef-c6a04d609999 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:41.719157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8c79-d72c-4d2d-9f83-477d253bee54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603c33329f8c46c288e987d1d1efaa8c, user_id=92974e07be4b45bab207d0f544fae05a, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:41.731014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8c79-d72c-4d2d-9f83-477d253bee54 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:41.753686 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1171/2377] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:41 2022] PUT /identity/v3/projects/603c33329f8c46c288e987d1d1efaa8c/users/92974e07be4b45bab207d0f544fae05a/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:41.754572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8c79-d72c-4d2d-9f83-477d253bee54 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:41.767068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1fea8c79-d72c-4d2d-9f83-477d253bee54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:41.804508 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1207/2378] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:41 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:41.808624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ecb62-7a24-4ca3-92ef-c6a04d609999 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:41.912420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8c79-d72c-4d2d-9f83-477d253bee54 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:41.952986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ecb62-7a24-4ca3-92ef-c6a04d609999 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:41.960231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767386e-0942-49d2-b5c2-6ee2ebb96306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:41.961017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767386e-0942-49d2-b5c2-6ee2ebb96306 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:41.961415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767386e-0942-49d2-b5c2-6ee2ebb96306 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:41.961743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767386e-0942-49d2-b5c2-6ee2ebb96306 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:41.962388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767386e-0942-49d2-b5c2-6ee2ebb96306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:41.964876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767386e-0942-49d2-b5c2-6ee2ebb96306 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:42.003942 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1208/2379] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:41 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:52:42.005119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767386e-0942-49d2-b5c2-6ee2ebb96306 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:42.030092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767386e-0942-49d2-b5c2-6ee2ebb96306 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:42.031535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c5cfe-4eb4-4dd5-b1c2-e6bf99a766ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:42.032961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c5cfe-4eb4-4dd5-b1c2-e6bf99a766ea admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:42.033391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c5cfe-4eb4-4dd5-b1c2-e6bf99a766ea admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:42.033767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c5cfe-4eb4-4dd5-b1c2-e6bf99a766ea admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:42.034530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c5cfe-4eb4-4dd5-b1c2-e6bf99a766ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:42.038016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c5cfe-4eb4-4dd5-b1c2-e6bf99a766ea admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:42.045101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cbff3-4515-4c12-b3c2-f7317d583b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:42.045790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cbff3-4515-4c12-b3c2-f7317d583b47 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:42.046674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cbff3-4515-4c12-b3c2-f7317d583b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:42.046975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cbff3-4515-4c12-b3c2-f7317d583b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:42.047784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cbff3-4515-4c12-b3c2-f7317d583b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:42.051853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cbff3-4515-4c12-b3c2-f7317d583b47 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:42.073744 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1209/2380] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:42.077149 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1172/2381] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:42.078404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cbff3-4515-4c12-b3c2-f7317d583b47 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:42.081538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c5cfe-4eb4-4dd5-b1c2-e6bf99a766ea admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:42.105835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cbff3-4515-4c12-b3c2-f7317d583b47 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:42.109165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c5cfe-4eb4-4dd5-b1c2-e6bf99a766ea admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:42.124763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81371df-b157-4c6c-be01-af88d0cb0ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:42.125753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f32c2-923f-4149-bbcd-63973a612beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:42.127105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f32c2-923f-4149-bbcd-63973a612beb admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:42.127420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81371df-b157-4c6c-be01-af88d0cb0ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:42.127715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81371df-b157-4c6c-be01-af88d0cb0ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:42.128042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f32c2-923f-4149-bbcd-63973a612beb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:42.128787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81371df-b157-4c6c-be01-af88d0cb0ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:42.129757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f32c2-923f-4149-bbcd-63973a612beb admin admin] PATH_INFO: `/v3/projects/5b99cddc64e94772b4dcfc14a84f5796/users/2495d40e2857401a83a78bcdbed948a7/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:42.130381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81371df-b157-4c6c-be01-af88d0cb0ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:42.133646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f32c2-923f-4149-bbcd-63973a612beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b99cddc64e94772b4dcfc14a84f5796, user_id=2495d40e2857401a83a78bcdbed948a7, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:42.134840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81371df-b157-4c6c-be01-af88d0cb0ac4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:42.141595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f32c2-923f-4149-bbcd-63973a612beb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:42.161152 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1210/2382] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:42.164349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81371df-b157-4c6c-be01-af88d0cb0ac4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:42.170557 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1173/2383] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:42 2022] PUT /identity/v3/projects/5b99cddc64e94772b4dcfc14a84f5796/users/2495d40e2857401a83a78bcdbed948a7/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:42.183497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81371df-b157-4c6c-be01-af88d0cb0ac4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:42.316549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689951f9-39f8-4bac-b7c3-7de1789b162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:42.317364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689951f9-39f8-4bac-b7c3-7de1789b162c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:42.317766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689951f9-39f8-4bac-b7c3-7de1789b162c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:42.318234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689951f9-39f8-4bac-b7c3-7de1789b162c admin admin] PATH_INFO: `/v3/projects/1d547f95cc6043b0bb9b6a94b2e354a5/users/bd637d2fa21649a1b00f27e7d86f3003/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:42.375842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689951f9-39f8-4bac-b7c3-7de1789b162c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d547f95cc6043b0bb9b6a94b2e354a5, user_id=bd637d2fa21649a1b00f27e7d86f3003, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:42.378606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689951f9-39f8-4bac-b7c3-7de1789b162c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:42.383451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f32c2-923f-4149-bbcd-63973a612beb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:42.385362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-752f32c2-923f-4149-bbcd-63973a612beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:42.388540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:42.414128 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1211/2384] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:42 2022] PUT /identity/v3/projects/1d547f95cc6043b0bb9b6a94b2e354a5/users/bd637d2fa21649a1b00f27e7d86f3003/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:42.415845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfbb83-97a5-4452-9d7e-f31677953e3d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:42.416167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfbb83-97a5-4452-9d7e-f31677953e3d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:42.416436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfbb83-97a5-4452-9d7e-f31677953e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:42.417327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f32c2-923f-4149-bbcd-63973a612beb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:42.478384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5fbfbb83-97a5-4452-9d7e-f31677953e3d None None] MFA Rules not processed for user `bd637d2fa21649a1b00f27e7d86f3003`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:42.479603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5fbfbb83-97a5-4452-9d7e-f31677953e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:42.557693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:42.581934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd37be-1783-46c9-8578-36d8032c2bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:42.582590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd37be-1783-46c9-8578-36d8032c2bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:42.583020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd37be-1783-46c9-8578-36d8032c2bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:42.583299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd37be-1783-46c9-8578-36d8032c2bfb admin admin] PATH_INFO: `/v3/projects/d7a06ab89ce048bfa723ff1d7b01fcbd` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:42.585865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd37be-1783-46c9-8578-36d8032c2bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a06ab89ce048bfa723ff1d7b01fcbd)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:42.593399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd37be-1783-46c9-8578-36d8032c2bfb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:42.617452 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1212/2385] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:42.620192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfbb83-97a5-4452-9d7e-f31677953e3d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:42.642178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfbb83-97a5-4452-9d7e-f31677953e3d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:42.657245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477cf44-0ae9-4e0b-a06a-9eed96c7c1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:42.658883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477cf44-0ae9-4e0b-a06a-9eed96c7c1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:42.659286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477cf44-0ae9-4e0b-a06a-9eed96c7c1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:42.661528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477cf44-0ae9-4e0b-a06a-9eed96c7c1c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:42.664047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477cf44-0ae9-4e0b-a06a-9eed96c7c1c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:42.667635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477cf44-0ae9-4e0b-a06a-9eed96c7c1c6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:42.710974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bbdd37be-1783-46c9-8578-36d8032c2bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a06ab89ce048bfa723ff1d7b01fcbd', 'request_id': 'req-bbdd37be-1783-46c9-8578-36d8032c2bfb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:42.759862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bbdd37be-1783-46c9-8578-36d8032c2bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a06ab89ce048bfa723ff1d7b01fcbd', 'request_id': 'req-bbdd37be-1783-46c9-8578-36d8032c2bfb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:42.774398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bbdd37be-1783-46c9-8578-36d8032c2bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a06ab89ce048bfa723ff1d7b01fcbd', 'request_id': 'req-bbdd37be-1783-46c9-8578-36d8032c2bfb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:42.793998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bbdd37be-1783-46c9-8578-36d8032c2bfb admin admin] The token cache is being invalidate because project d7a06ab89ce048bfa723ff1d7b01fcbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:42.794368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bbdd37be-1783-46c9-8578-36d8032c2bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:42.799370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bbdd37be-1783-46c9-8578-36d8032c2bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:42.803155 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1174/2386] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:42 2022] DELETE /identity/v3/projects/d7a06ab89ce048bfa723ff1d7b01fcbd => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:42.808874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61998f-2e72-4f6a-8262-17938ece0526 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:42.809261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61998f-2e72-4f6a-8262-17938ece0526 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:42.809617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61998f-2e72-4f6a-8262-17938ece0526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:42.848239 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1213/2387] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:42 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:42.849613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477cf44-0ae9-4e0b-a06a-9eed96c7c1c6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:42.855220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2477cf44-0ae9-4e0b-a06a-9eed96c7c1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:42.879531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6f61998f-2e72-4f6a-8262-17938ece0526 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:42.882958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6f61998f-2e72-4f6a-8262-17938ece0526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:43.095648 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1175/2388] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:43.104138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f17fe-537a-41cb-b84a-eaf57b9612a7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:43.104470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f17fe-537a-41cb-b84a-eaf57b9612a7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:43.107958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f17fe-537a-41cb-b84a-eaf57b9612a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:43.113051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477cf44-0ae9-4e0b-a06a-9eed96c7c1c6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:43.134697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215f1d4-dbab-48a6-a323-f0ece110f1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:43.135342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215f1d4-dbab-48a6-a323-f0ece110f1fe admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:43.135625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215f1d4-dbab-48a6-a323-f0ece110f1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:43.135906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215f1d4-dbab-48a6-a323-f0ece110f1fe admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:43.141305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215f1d4-dbab-48a6-a323-f0ece110f1fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:43.143139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215f1d4-dbab-48a6-a323-f0ece110f1fe admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:43.164774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d43f17fe-537a-41cb-b84a-eaf57b9612a7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:43.169177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d43f17fe-537a-41cb-b84a-eaf57b9612a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:43.196359 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1214/2389] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:42 2022] POST /identity/v3/users => generated 295 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:43.196879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215f1d4-dbab-48a6-a323-f0ece110f1fe admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:43.211440 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1176/2390] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:43.217347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f17fe-537a-41cb-b84a-eaf57b9612a7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:43.225682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215f1d4-dbab-48a6-a323-f0ece110f1fe admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:43.241964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dc00e-02b5-4f7b-a387-7de396764769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:43.242650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dc00e-02b5-4f7b-a387-7de396764769 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:43.242933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dc00e-02b5-4f7b-a387-7de396764769 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:43.243252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dc00e-02b5-4f7b-a387-7de396764769 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:43.243858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dc00e-02b5-4f7b-a387-7de396764769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:43.255101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dc00e-02b5-4f7b-a387-7de396764769 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:43.261435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f17fe-537a-41cb-b84a-eaf57b9612a7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:43.283322 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1215/2391] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:43.284125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dc00e-02b5-4f7b-a387-7de396764769 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:43.287648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e03dc00e-02b5-4f7b-a387-7de396764769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:43.290285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899c10b-3a0c-4348-b688-28a06606b548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:43.292150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899c10b-3a0c-4348-b688-28a06606b548 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:43.293816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899c10b-3a0c-4348-b688-28a06606b548 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:43.294100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899c10b-3a0c-4348-b688-28a06606b548 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:43.297123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899c10b-3a0c-4348-b688-28a06606b548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:43.299016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899c10b-3a0c-4348-b688-28a06606b548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:43.303378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899c10b-3a0c-4348-b688-28a06606b548 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:43.305768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dc00e-02b5-4f7b-a387-7de396764769 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:43.312564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:43.313586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:43.314083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:43.314800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] PATH_INFO: `/v3/projects/659887bd24984a1fb82f7658b10d6e91` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:43.316629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=659887bd24984a1fb82f7658b10d6e91)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:43.319191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:43.335489 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1177/2392] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:43.335489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899c10b-3a0c-4348-b688-28a06606b548 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:43.347471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899c10b-3a0c-4348-b688-28a06606b548 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:43.368997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d805f9-1e1f-45c7-a4cc-536d778e6ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:43.370141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d805f9-1e1f-45c7-a4cc-536d778e6ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:43.370665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d805f9-1e1f-45c7-a4cc-536d778e6ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:43.371582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d805f9-1e1f-45c7-a4cc-536d778e6ac1 admin admin] PATH_INFO: `/v3/projects/ec6f1e5c41214b2ebe25247fd75005db/users/0373b509f57048bc91dfb8f814c36a77/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:43.382286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:43.404500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d805f9-1e1f-45c7-a4cc-536d778e6ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6f1e5c41214b2ebe25247fd75005db, user_id=0373b509f57048bc91dfb8f814c36a77, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:43.407289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d805f9-1e1f-45c7-a4cc-536d778e6ac1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:43.407534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659887bd24984a1fb82f7658b10d6e91', 'request_id': 'req-bfc45461-50b3-44d0-a59c-89a1799ab5b5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:43.423517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659887bd24984a1fb82f7658b10d6e91', 'request_id': 'req-bfc45461-50b3-44d0-a59c-89a1799ab5b5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:43.431902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659887bd24984a1fb82f7658b10d6e91', 'request_id': 'req-bfc45461-50b3-44d0-a59c-89a1799ab5b5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:43.434817 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1178/2393] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:43 2022] PUT /identity/v3/projects/ec6f1e5c41214b2ebe25247fd75005db/users/0373b509f57048bc91dfb8f814c36a77/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:43.435292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d805f9-1e1f-45c7-a4cc-536d778e6ac1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:43.466480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] The token cache is being invalidate because project 659887bd24984a1fb82f7658b10d6e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:43.466775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:43.470615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:43.478123 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1216/2394] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:43 2022] DELETE /identity/v3/projects/659887bd24984a1fb82f7658b10d6e91 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:43.503394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:43.510364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:43.516316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:43.568376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d805f9-1e1f-45c7-a4cc-536d778e6ac1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:43.604077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e3e9f-2279-4467-a541-cbb4b18a591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:43.604728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e3e9f-2279-4467-a541-cbb4b18a591b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:43.605015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e3e9f-2279-4467-a541-cbb4b18a591b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:43.605394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e3e9f-2279-4467-a541-cbb4b18a591b admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:43.605948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e3e9f-2279-4467-a541-cbb4b18a591b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:43.631971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e3e9f-2279-4467-a541-cbb4b18a591b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:43.727699 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1179/2395] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:43 2022] POST /identity/v3/projects => generated 375 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:43.730565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6ea87-a7ac-413d-bd5c-5c08cfcfb0b6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:43.730565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6ea87-a7ac-413d-bd5c-5c08cfcfb0b6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:43.730565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6ea87-a7ac-413d-bd5c-5c08cfcfb0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:43.813684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc45461-50b3-44d0-a59c-89a1799ab5b5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:43.818896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-98b6ea87-a7ac-413d-bd5c-5c08cfcfb0b6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:43.820868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-98b6ea87-a7ac-413d-bd5c-5c08cfcfb0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:43.941270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fcf85-c89e-43f3-bb7f-51cc67a322c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:43.942120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fcf85-c89e-43f3-bb7f-51cc67a322c4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:43.942380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fcf85-c89e-43f3-bb7f-51cc67a322c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:43.942723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fcf85-c89e-43f3-bb7f-51cc67a322c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:43.944330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fcf85-c89e-43f3-bb7f-51cc67a322c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:43.946050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fcf85-c89e-43f3-bb7f-51cc67a322c4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:43.963135 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1180/2396] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:43.964076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6ea87-a7ac-413d-bd5c-5c08cfcfb0b6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:43.967621 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1217/2397] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:43.969431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fcf85-c89e-43f3-bb7f-51cc67a322c4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:43.976906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-98b6ea87-a7ac-413d-bd5c-5c08cfcfb0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:43.985473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fcf85-c89e-43f3-bb7f-51cc67a322c4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:43.994367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb056c-bb9c-418b-b55a-a5cfc005b6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:43.995089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb056c-bb9c-418b-b55a-a5cfc005b6af admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:43.995373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb056c-bb9c-418b-b55a-a5cfc005b6af admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:43.995648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb056c-bb9c-418b-b55a-a5cfc005b6af admin admin] PATH_INFO: `/v3/projects/ec6f1e5c41214b2ebe25247fd75005db/users/0373b509f57048bc91dfb8f814c36a77/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:43.998572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb056c-bb9c-418b-b55a-a5cfc005b6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6f1e5c41214b2ebe25247fd75005db, user_id=0373b509f57048bc91dfb8f814c36a77, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:44.005084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb056c-bb9c-418b-b55a-a5cfc005b6af admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:44.009962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6ea87-a7ac-413d-bd5c-5c08cfcfb0b6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:44.015677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981569b0-0173-4908-81f3-fdd9af0725a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:44.016410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981569b0-0173-4908-81f3-fdd9af0725a9 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:44.016694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981569b0-0173-4908-81f3-fdd9af0725a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:44.016965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981569b0-0173-4908-81f3-fdd9af0725a9 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:44.017807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981569b0-0173-4908-81f3-fdd9af0725a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:44.020079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981569b0-0173-4908-81f3-fdd9af0725a9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:44.033706 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1218/2398] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:43 2022] PUT /identity/v3/projects/ec6f1e5c41214b2ebe25247fd75005db/users/0373b509f57048bc91dfb8f814c36a77/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:44.035510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb07b5a-f6d7-4895-be66-b3a7d79eafd4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:44.036018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb07b5a-f6d7-4895-be66-b3a7d79eafd4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:44.036448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb07b5a-f6d7-4895-be66-b3a7d79eafd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:44.059947 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1181/2399] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:43 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:44.062355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5149b-186a-4934-a7cd-c3dddf36e24d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:44.062649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5149b-186a-4934-a7cd-c3dddf36e24d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:44.062960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5149b-186a-4934-a7cd-c3dddf36e24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:44.076050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1bb07b5a-f6d7-4895-be66-b3a7d79eafd4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:44.080651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1bb07b5a-f6d7-4895-be66-b3a7d79eafd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:44.117407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8cd5149b-186a-4934-a7cd-c3dddf36e24d None None] MFA Rules not processed for user `0373b509f57048bc91dfb8f814c36a77`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:44.118699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8cd5149b-186a-4934-a7cd-c3dddf36e24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:44.173535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:44.208043 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1219/2400] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:44.208763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb07b5a-f6d7-4895-be66-b3a7d79eafd4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:44.223613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb07b5a-f6d7-4895-be66-b3a7d79eafd4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:44.231593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ee8e2-711d-4737-808d-d64a1e5e7ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:44.232564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ee8e2-711d-4737-808d-d64a1e5e7ede admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:44.233141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ee8e2-711d-4737-808d-d64a1e5e7ede admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:44.234510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ee8e2-711d-4737-808d-d64a1e5e7ede admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:44.235581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ee8e2-711d-4737-808d-d64a1e5e7ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:44.238297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ee8e2-711d-4737-808d-d64a1e5e7ede admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:44.253736 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1220/2401] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:44.254968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ee8e2-711d-4737-808d-d64a1e5e7ede admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:44.263690 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1182/2402] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:44.264730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5149b-186a-4934-a7cd-c3dddf36e24d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:44.267336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ee8e2-711d-4737-808d-d64a1e5e7ede admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:44.273406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f08d6c-9d3b-4a6a-a8b0-73d93b500e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:44.274305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f08d6c-9d3b-4a6a-a8b0-73d93b500e5e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:44.274666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f08d6c-9d3b-4a6a-a8b0-73d93b500e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:44.275032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f08d6c-9d3b-4a6a-a8b0-73d93b500e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:44.275807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f08d6c-9d3b-4a6a-a8b0-73d93b500e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:44.276191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f08d6c-9d3b-4a6a-a8b0-73d93b500e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:44.278384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f08d6c-9d3b-4a6a-a8b0-73d93b500e5e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:44.290334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5149b-186a-4934-a7cd-c3dddf36e24d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:44.292254 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1221/2403] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:44.294299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf01169-7470-4a71-aa33-301ec5b12d64 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:44.294626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf01169-7470-4a71-aa33-301ec5b12d64 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:44.294939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf01169-7470-4a71-aa33-301ec5b12d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:44.305009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fc416-e03c-4ca6-9333-8b9fcb6f8243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:44.305660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fc416-e03c-4ca6-9333-8b9fcb6f8243 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:44.305941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fc416-e03c-4ca6-9333-8b9fcb6f8243 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:44.306214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fc416-e03c-4ca6-9333-8b9fcb6f8243 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:44.306872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fc416-e03c-4ca6-9333-8b9fcb6f8243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:44.309087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fc416-e03c-4ca6-9333-8b9fcb6f8243 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:44.320050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-dcf01169-7470-4a71-aa33-301ec5b12d64 None None] MFA Rules not processed for user `bd637d2fa21649a1b00f27e7d86f3003`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:44.321472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dcf01169-7470-4a71-aa33-301ec5b12d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:44.336389 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1183/2404] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:44.337343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fc416-e03c-4ca6-9333-8b9fcb6f8243 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:44.364229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fc416-e03c-4ca6-9333-8b9fcb6f8243 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:44.375223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40110d-5e37-465e-b67a-ec467cad76e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:44.375992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40110d-5e37-465e-b67a-ec467cad76e7 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:44.376342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40110d-5e37-465e-b67a-ec467cad76e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:44.376970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40110d-5e37-465e-b67a-ec467cad76e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:44.377540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40110d-5e37-465e-b67a-ec467cad76e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:44.382335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40110d-5e37-465e-b67a-ec467cad76e7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:44.407362 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1222/2405] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:44.408559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf01169-7470-4a71-aa33-301ec5b12d64 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:44.425031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:44.434279 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1184/2406] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:44 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:44.435125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40110d-5e37-465e-b67a-ec467cad76e7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:44.436749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf01169-7470-4a71-aa33-301ec5b12d64 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:44.441044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9d40110d-5e37-465e-b67a-ec467cad76e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:44.570004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8a616-9fcb-470b-aacf-600218560216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:44.570738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8a616-9fcb-470b-aacf-600218560216 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:44.571028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8a616-9fcb-470b-aacf-600218560216 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:44.571309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8a616-9fcb-470b-aacf-600218560216 admin admin] PATH_INFO: `/v3/projects/876d1525decf4f9ebb4096e1b6ac374b/users/801e079246714e2fadfcac464db3cac5/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:44.635734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8a616-9fcb-470b-aacf-600218560216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=876d1525decf4f9ebb4096e1b6ac374b, user_id=801e079246714e2fadfcac464db3cac5, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:44.645247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8a616-9fcb-470b-aacf-600218560216 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:44.685771 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1223/2407] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:44 2022] PUT /identity/v3/projects/876d1525decf4f9ebb4096e1b6ac374b/users/801e079246714e2fadfcac464db3cac5/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:44.686781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40110d-5e37-465e-b67a-ec467cad76e7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:44.686892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8a616-9fcb-470b-aacf-600218560216 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:44.876951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2afeee-83b5-49d3-bfdc-d24d6cc0b503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:44.877833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2afeee-83b5-49d3-bfdc-d24d6cc0b503 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:44.878222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2afeee-83b5-49d3-bfdc-d24d6cc0b503 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:44.878666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2afeee-83b5-49d3-bfdc-d24d6cc0b503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:44.881544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6f2afeee-83b5-49d3-bfdc-d24d6cc0b503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:44.902701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8a616-9fcb-470b-aacf-600218560216 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:44.920583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da95e9-dfe0-4083-8612-566881865877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:44.921876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da95e9-dfe0-4083-8612-566881865877 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:44.922160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da95e9-dfe0-4083-8612-566881865877 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:44.922439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da95e9-dfe0-4083-8612-566881865877 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:44.923090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da95e9-dfe0-4083-8612-566881865877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:44.930356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da95e9-dfe0-4083-8612-566881865877 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:44.945057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:44.977442 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1224/2408] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:44 2022] POST /identity/v3/users => generated 291 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:44.978317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da95e9-dfe0-4083-8612-566881865877 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:44.984242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-15da95e9-dfe0-4083-8612-566881865877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:44.992590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2afeee-83b5-49d3-bfdc-d24d6cc0b503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:44.994597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2afeee-83b5-49d3-bfdc-d24d6cc0b503 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:45.018165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da95e9-dfe0-4083-8612-566881865877 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:45.026506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:45.027291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:45.027587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:45.027872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] PATH_INFO: `/v3/users/037c74c1e22148c6ba7612cb03d8bd02` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:45.031641 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1185/2409] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:45.036940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=037c74c1e22148c6ba7612cb03d8bd02)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:45.037086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5d1e2-fbd0-4121-bda0-cfba2cad8479 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:45.037343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5d1e2-fbd0-4121-bda0-cfba2cad8479 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:45.037625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5d1e2-fbd0-4121-bda0-cfba2cad8479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:45.038939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:45.089324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-90c5d1e2-fbd0-4121-bda0-cfba2cad8479 None None] MFA Rules not processed for user `801e079246714e2fadfcac464db3cac5`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:45.092345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-90c5d1e2-fbd0-4121-bda0-cfba2cad8479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:45.131264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:45.174988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '037c74c1e22148c6ba7612cb03d8bd02'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:45.194740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '037c74c1e22148c6ba7612cb03d8bd02'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:45.195979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '037c74c1e22148c6ba7612cb03d8bd02'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:45.196738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '037c74c1e22148c6ba7612cb03d8bd02'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:45.254736 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1186/2410] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:45.254941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '037c74c1e22148c6ba7612cb03d8bd02'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:45.255048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5d1e2-fbd0-4121-bda0-cfba2cad8479 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:45.286581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5d1e2-fbd0-4121-bda0-cfba2cad8479 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:45.294029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41920aa3-2fc9-45c7-be9b-a93ea18e3d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:45.294493 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1225/2411] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:44 2022] DELETE /identity/v3/users/037c74c1e22148c6ba7612cb03d8bd02 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:45.295287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920aa3-2fc9-45c7-be9b-a93ea18e3d82 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:45.295403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:45.295711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920aa3-2fc9-45c7-be9b-a93ea18e3d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:45.296251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920aa3-2fc9-45c7-be9b-a93ea18e3d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:45.298591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:45.302092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41920aa3-2fc9-45c7-be9b-a93ea18e3d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:45.303895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41920aa3-2fc9-45c7-be9b-a93ea18e3d82 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:45.347059 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1187/2412] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:45.354502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e15e5-b456-415a-9151-368e79e7dc1d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:45.354900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e15e5-b456-415a-9151-368e79e7dc1d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:45.355227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e15e5-b456-415a-9151-368e79e7dc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:45.423088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8d7e15e5-b456-415a-9151-368e79e7dc1d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:45.428609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8d7e15e5-b456-415a-9151-368e79e7dc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:45.487566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87db92e-5490-48b0-9eb7-808dd2a56801 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:45.496188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43e895-f9fe-4098-9c70-0bba8ac26bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:45.497105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43e895-f9fe-4098-9c70-0bba8ac26bab admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:45.497416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43e895-f9fe-4098-9c70-0bba8ac26bab admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:45.497688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43e895-f9fe-4098-9c70-0bba8ac26bab admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:45.498383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43e895-f9fe-4098-9c70-0bba8ac26bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:45.501808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43e895-f9fe-4098-9c70-0bba8ac26bab admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:45.555655 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1226/2413] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:45 2022] POST /identity/v3/projects => generated 375 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:45.556795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43e895-f9fe-4098-9c70-0bba8ac26bab admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:45.559899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2b43e895-f9fe-4098-9c70-0bba8ac26bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:45.597471 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1188/2414] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:45.599065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e15e5-b456-415a-9151-368e79e7dc1d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:45.621859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e15e5-b456-415a-9151-368e79e7dc1d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:45.696705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:45.739747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43e895-f9fe-4098-9c70-0bba8ac26bab admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:45.751517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877e183-5e1a-420a-a774-4cd4a0b8b907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:45.752154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877e183-5e1a-420a-a774-4cd4a0b8b907 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:45.752436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877e183-5e1a-420a-a774-4cd4a0b8b907 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:45.752711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877e183-5e1a-420a-a774-4cd4a0b8b907 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:45.753399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877e183-5e1a-420a-a774-4cd4a0b8b907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:45.755014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877e183-5e1a-420a-a774-4cd4a0b8b907 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:45.782963 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1227/2415] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:45.784449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877e183-5e1a-420a-a774-4cd4a0b8b907 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:45.787126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1877e183-5e1a-420a-a774-4cd4a0b8b907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:45.792672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c562017-1a8e-453e-9904-2a2626cf902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:45.793994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c562017-1a8e-453e-9904-2a2626cf902b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:45.794450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c562017-1a8e-453e-9904-2a2626cf902b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:45.794893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c562017-1a8e-453e-9904-2a2626cf902b admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:45.796466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c562017-1a8e-453e-9904-2a2626cf902b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:45.805550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c562017-1a8e-453e-9904-2a2626cf902b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:45.854002 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1189/2416] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:45 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:45.855210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c562017-1a8e-453e-9904-2a2626cf902b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:45.869931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c562017-1a8e-453e-9904-2a2626cf902b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:45.878372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6110c-b292-42c3-afab-1eac640a2758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:45.880778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6110c-b292-42c3-afab-1eac640a2758 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:45.881530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6110c-b292-42c3-afab-1eac640a2758 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:45.881988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6110c-b292-42c3-afab-1eac640a2758 admin admin] PATH_INFO: `/v3/projects/f395d3de13ee4003826fbf2fc74707d2/users/b1c9a6bba3474698be5e75154b5f0700/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:45.902381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877e183-5e1a-420a-a774-4cd4a0b8b907 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:45.907221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6110c-b292-42c3-afab-1eac640a2758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f395d3de13ee4003826fbf2fc74707d2, user_id=b1c9a6bba3474698be5e75154b5f0700, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:45.910868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6110c-b292-42c3-afab-1eac640a2758 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:45.912883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3cb86-a20a-44fb-98a2-36e9f17bc21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:45.915410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3cb86-a20a-44fb-98a2-36e9f17bc21f service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:45.915818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3cb86-a20a-44fb-98a2-36e9f17bc21f service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:45.917331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3cb86-a20a-44fb-98a2-36e9f17bc21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:45.935871 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1190/2417] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:45 2022] PUT /identity/v3/projects/f395d3de13ee4003826fbf2fc74707d2/users/b1c9a6bba3474698be5e75154b5f0700/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:45.937210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6110c-b292-42c3-afab-1eac640a2758 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:45.948854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3cb86-a20a-44fb-98a2-36e9f17bc21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:45.951184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3cb86-a20a-44fb-98a2-36e9f17bc21f service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:45.989073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:45.997595 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1228/2418] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:45.999136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cf76b-26bb-4430-85b3-5fc2ba14608a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:45.999537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cf76b-26bb-4430-85b3-5fc2ba14608a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:46.000025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cf76b-26bb-4430-85b3-5fc2ba14608a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:46.082656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d85cf76b-26bb-4430-85b3-5fc2ba14608a None None] MFA Rules not processed for user `b1c9a6bba3474698be5e75154b5f0700`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:46.085041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d85cf76b-26bb-4430-85b3-5fc2ba14608a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:46.097123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6110c-b292-42c3-afab-1eac640a2758 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:46.104623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a16b9-4a62-4d28-892d-cefd42d9dce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:46.105688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a16b9-4a62-4d28-892d-cefd42d9dce5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:46.105966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a16b9-4a62-4d28-892d-cefd42d9dce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:46.106234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a16b9-4a62-4d28-892d-cefd42d9dce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:46.106926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a16b9-4a62-4d28-892d-cefd42d9dce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:46.109483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a16b9-4a62-4d28-892d-cefd42d9dce5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:46.123384 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1191/2419] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:46.127084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a16b9-4a62-4d28-892d-cefd42d9dce5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:46.144427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a16b9-4a62-4d28-892d-cefd42d9dce5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:46.150464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e3bf1-2a64-49bb-8790-87745dc749ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:46.151719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e3bf1-2a64-49bb-8790-87745dc749ab admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:46.152157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e3bf1-2a64-49bb-8790-87745dc749ab admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:46.152614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e3bf1-2a64-49bb-8790-87745dc749ab admin admin] PATH_INFO: `/v3/projects/234c04b1b9ea4b36a86cd71799f4adbb/users/abeb88c831bf46e8a16cbeb06c5bc68f/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:46.203986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e3bf1-2a64-49bb-8790-87745dc749ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=234c04b1b9ea4b36a86cd71799f4adbb, user_id=abeb88c831bf46e8a16cbeb06c5bc68f, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:46.207012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e3bf1-2a64-49bb-8790-87745dc749ab admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:46.223519 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1229/2420] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:46.232677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cf76b-26bb-4430-85b3-5fc2ba14608a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:46.237882 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1192/2421] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:46 2022] PUT /identity/v3/projects/234c04b1b9ea4b36a86cd71799f4adbb/users/abeb88c831bf46e8a16cbeb06c5bc68f/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:52:46.242068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e3bf1-2a64-49bb-8790-87745dc749ab admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:46.258865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cf76b-26bb-4430-85b3-5fc2ba14608a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:46.341460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e3bf1-2a64-49bb-8790-87745dc749ab admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:46.348852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd482e3-0924-4547-b2f1-24c25daf522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:46.351165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd482e3-0924-4547-b2f1-24c25daf522c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:46.351563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd482e3-0924-4547-b2f1-24c25daf522c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:46.351942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd482e3-0924-4547-b2f1-24c25daf522c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:46.354664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd482e3-0924-4547-b2f1-24c25daf522c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:46.357687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd482e3-0924-4547-b2f1-24c25daf522c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:46.375739 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1193/2422] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:46.389213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd482e3-0924-4547-b2f1-24c25daf522c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:46.396797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef5361-a419-4e41-a319-0bed59c2240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:46.397460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef5361-a419-4e41-a319-0bed59c2240d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:46.397741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef5361-a419-4e41-a319-0bed59c2240d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:46.398021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef5361-a419-4e41-a319-0bed59c2240d admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:46.399005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef5361-a419-4e41-a319-0bed59c2240d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:46.401132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef5361-a419-4e41-a319-0bed59c2240d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:46.402888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd482e3-0924-4547-b2f1-24c25daf522c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:46.414865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4898b-a5f2-4859-ba8c-437d4595a6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:46.415746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4898b-a5f2-4859-ba8c-437d4595a6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:46.416240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4898b-a5f2-4859-ba8c-437d4595a6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:46.416743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4898b-a5f2-4859-ba8c-437d4595a6ea admin admin] PATH_INFO: `/v3/projects/234c04b1b9ea4b36a86cd71799f4adbb/users/abeb88c831bf46e8a16cbeb06c5bc68f/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:46.422279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4898b-a5f2-4859-ba8c-437d4595a6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=234c04b1b9ea4b36a86cd71799f4adbb, user_id=abeb88c831bf46e8a16cbeb06c5bc68f, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:46.430618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4898b-a5f2-4859-ba8c-437d4595a6ea admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:46.451841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:46.459977 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1194/2423] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:46 2022] PUT /identity/v3/projects/234c04b1b9ea4b36a86cd71799f4adbb/users/abeb88c831bf46e8a16cbeb06c5bc68f/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:46.470718 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1230/2424] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:46 2022] POST /identity/v3/projects => generated 383 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:46.470863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4898b-a5f2-4859-ba8c-437d4595a6ea admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:46.472098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bcea8-7e5c-4c04-8434-936af97bb914 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:46.473004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bcea8-7e5c-4c04-8434-936af97bb914 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:46.473933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bcea8-7e5c-4c04-8434-936af97bb914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:46.546561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-390bcea8-7e5c-4c04-8434-936af97bb914 None None] MFA Rules not processed for user `abeb88c831bf46e8a16cbeb06c5bc68f`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:46.548354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-390bcea8-7e5c-4c04-8434-936af97bb914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:46.645690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4898b-a5f2-4859-ba8c-437d4595a6ea admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:46.704243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:46.719573 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1231/2425] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:46.761374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bcea8-7e5c-4c04-8434-936af97bb914 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:46.766357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-390bcea8-7e5c-4c04-8434-936af97bb914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:46.879294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde2ed4-a3f4-45f8-8002-37c6ef3a1115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:46.880684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde2ed4-a3f4-45f8-8002-37c6ef3a1115 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:46.881589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde2ed4-a3f4-45f8-8002-37c6ef3a1115 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:46.882236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde2ed4-a3f4-45f8-8002-37c6ef3a1115 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:46.883155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde2ed4-a3f4-45f8-8002-37c6ef3a1115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:46.885551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde2ed4-a3f4-45f8-8002-37c6ef3a1115 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:46.938851 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1195/2426] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:46 2022] POST /identity/v3/users => generated 298 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:46.941081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde2ed4-a3f4-45f8-8002-37c6ef3a1115 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:46.963360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde2ed4-a3f4-45f8-8002-37c6ef3a1115 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:46.969484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bcea8-7e5c-4c04-8434-936af97bb914 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:46.974132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ca048-c716-4b1d-b739-a517b7d2275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:46.976228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ca048-c716-4b1d-b739-a517b7d2275d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:46.976519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ca048-c716-4b1d-b739-a517b7d2275d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:46.977659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ca048-c716-4b1d-b739-a517b7d2275d admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:46.978324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ca048-c716-4b1d-b739-a517b7d2275d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:46.983090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dc95d-df77-4147-870f-5a67815c5fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:46.985697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ca048-c716-4b1d-b739-a517b7d2275d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:46.986986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc95d-df77-4147-870f-5a67815c5fc6 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:46.987384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc95d-df77-4147-870f-5a67815c5fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:46.987676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc95d-df77-4147-870f-5a67815c5fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:47.005355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dc95d-df77-4147-870f-5a67815c5fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:47.007850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dc95d-df77-4147-870f-5a67815c5fc6 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:47.011393 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1196/2427] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:47.014416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ca048-c716-4b1d-b739-a517b7d2275d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:47.035117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ca048-c716-4b1d-b739-a517b7d2275d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:47.043118 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1232/2428] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:47.050942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730349cb-7db5-4284-90e8-3d88a0bd0bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:47.051619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730349cb-7db5-4284-90e8-3d88a0bd0bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:47.051966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730349cb-7db5-4284-90e8-3d88a0bd0bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:47.052243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730349cb-7db5-4284-90e8-3d88a0bd0bdf admin admin] PATH_INFO: `/v3/projects/bcfed4f80643462f94514e9e70f24354/users/a7bc206b32fa43398ed92cc59127090e/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:47.088428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730349cb-7db5-4284-90e8-3d88a0bd0bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcfed4f80643462f94514e9e70f24354, user_id=a7bc206b32fa43398ed92cc59127090e, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:47.103112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730349cb-7db5-4284-90e8-3d88a0bd0bdf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:47.134802 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1197/2429] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:47 2022] PUT /identity/v3/projects/bcfed4f80643462f94514e9e70f24354/users/a7bc206b32fa43398ed92cc59127090e/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:47.138890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dc95d-df77-4147-870f-5a67815c5fc6 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:47.175220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dc95d-df77-4147-870f-5a67815c5fc6 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:47.370070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce884b79-bb78-4292-8929-d6fca1953215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:47.396404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce884b79-bb78-4292-8929-d6fca1953215 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:47.413679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce884b79-bb78-4292-8929-d6fca1953215 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:47.413976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce884b79-bb78-4292-8929-d6fca1953215 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:47.414691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce884b79-bb78-4292-8929-d6fca1953215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:47.423998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce884b79-bb78-4292-8929-d6fca1953215 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:47.466728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730349cb-7db5-4284-90e8-3d88a0bd0bdf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:47.467258 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1233/2430] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:47.480629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730349cb-7db5-4284-90e8-3d88a0bd0bdf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:47.495435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d7499-0034-4db1-9ff9-12ef23b2ae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:47.496113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7499-0034-4db1-9ff9-12ef23b2ae40 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:47.496390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7499-0034-4db1-9ff9-12ef23b2ae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:47.496661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7499-0034-4db1-9ff9-12ef23b2ae40 admin admin] PATH_INFO: `/v3/projects/bcfed4f80643462f94514e9e70f24354/users/a7bc206b32fa43398ed92cc59127090e/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:47.502593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d7499-0034-4db1-9ff9-12ef23b2ae40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcfed4f80643462f94514e9e70f24354, user_id=a7bc206b32fa43398ed92cc59127090e, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:47.507545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d7499-0034-4db1-9ff9-12ef23b2ae40 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:47.559051 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1198/2431] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:47 2022] PUT /identity/v3/projects/bcfed4f80643462f94514e9e70f24354/users/a7bc206b32fa43398ed92cc59127090e/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:47.569451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22766456-52ff-41d9-b5c5-40f80d1c3cc7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:47.569745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22766456-52ff-41d9-b5c5-40f80d1c3cc7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:47.570028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22766456-52ff-41d9-b5c5-40f80d1c3cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:47.594596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:47.629137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-22766456-52ff-41d9-b5c5-40f80d1c3cc7 None None] MFA Rules not processed for user `a7bc206b32fa43398ed92cc59127090e`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:47.634326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-22766456-52ff-41d9-b5c5-40f80d1c3cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:47.874839 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1234/2432] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:47.931209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d7499-0034-4db1-9ff9-12ef23b2ae40 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:47.933385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d47d7499-0034-4db1-9ff9-12ef23b2ae40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:48.096631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22766456-52ff-41d9-b5c5-40f80d1c3cc7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:48.178148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d7499-0034-4db1-9ff9-12ef23b2ae40 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:48.188881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:48.190188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:48.190634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:48.191063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] PATH_INFO: `/v3/projects/4e5f13ede0474c1888ffb1f7168daf67` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:48.192399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e5f13ede0474c1888ffb1f7168daf67)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:48.194864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:48.262695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22766456-52ff-41d9-b5c5-40f80d1c3cc7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:48.287415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5f13ede0474c1888ffb1f7168daf67', 'request_id': 'req-68c367b2-f5b1-472c-bf46-6689053247f4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:48.308885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5f13ede0474c1888ffb1f7168daf67', 'request_id': 'req-68c367b2-f5b1-472c-bf46-6689053247f4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:48.318403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:48.321799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5f13ede0474c1888ffb1f7168daf67', 'request_id': 'req-68c367b2-f5b1-472c-bf46-6689053247f4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:48.347910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] The token cache is being invalidate because project 4e5f13ede0474c1888ffb1f7168daf67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:48.348261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:48.349826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:48.365542 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1199/2433] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:47 2022] DELETE /identity/v3/projects/4e5f13ede0474c1888ffb1f7168daf67 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:48.370020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:48.373933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:48.424014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ff743-abb8-4a5d-8463-d60f766b5b7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:48.425227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ff743-abb8-4a5d-8463-d60f766b5b7a service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:48.425227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ff743-abb8-4a5d-8463-d60f766b5b7a service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:48.425227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ff743-abb8-4a5d-8463-d60f766b5b7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:48.432339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-110ff743-abb8-4a5d-8463-d60f766b5b7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:48.494411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c367b2-f5b1-472c-bf46-6689053247f4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:48.502969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:48.502969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:48.502969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:48.503486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] PATH_INFO: `/v3/users/55a608d850cb40e09ee0afa7d5789577` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:48.504767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55a608d850cb40e09ee0afa7d5789577)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:48.507028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:48.530491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:48.606456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ff743-abb8-4a5d-8463-d60f766b5b7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:48.608185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ff743-abb8-4a5d-8463-d60f766b5b7a service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:48.643694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55a608d850cb40e09ee0afa7d5789577'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:48.647245 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1235/2434] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:48.664723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55a608d850cb40e09ee0afa7d5789577'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:48.679516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55a608d850cb40e09ee0afa7d5789577'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:48.679516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55a608d850cb40e09ee0afa7d5789577'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:48.744445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55a608d850cb40e09ee0afa7d5789577'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:48.760247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ff743-abb8-4a5d-8463-d60f766b5b7a service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:48.762172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-110ff743-abb8-4a5d-8463-d60f766b5b7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:48.785414 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1200/2435] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:48 2022] DELETE /identity/v3/users/55a608d850cb40e09ee0afa7d5789577 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:52:48.786659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ff743-abb8-4a5d-8463-d60f766b5b7a service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:48.835908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:48.838733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:48.875922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b0e48-2a1b-425b-bd53-0ddf9ec57c6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:48.878017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b0e48-2a1b-425b-bd53-0ddf9ec57c6e service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:48.878359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b0e48-2a1b-425b-bd53-0ddf9ec57c6e service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:48.879032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b0e48-2a1b-425b-bd53-0ddf9ec57c6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:48.881542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ec9b0e48-2a1b-425b-bd53-0ddf9ec57c6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:48.962362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c28ee-082e-4eb2-a528-ca87083ec295 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:48.970320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:48.971250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:48.971638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:48.972026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] PATH_INFO: `/v3/users/b1c9a6bba3474698be5e75154b5f0700` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:48.973888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c9a6bba3474698be5e75154b5f0700)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:48.976678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:49.005445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:49.019081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b0e48-2a1b-425b-bd53-0ddf9ec57c6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:49.021479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b0e48-2a1b-425b-bd53-0ddf9ec57c6e service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:49.053531 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1236/2436] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:52:49.127137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c9a6bba3474698be5e75154b5f0700'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:49.143455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c9a6bba3474698be5e75154b5f0700'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:49.144464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c9a6bba3474698be5e75154b5f0700'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:49.145124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c9a6bba3474698be5e75154b5f0700'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:49.172355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c9a6bba3474698be5e75154b5f0700'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:49.195181 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1201/2437] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:48 2022] DELETE /identity/v3/users/b1c9a6bba3474698be5e75154b5f0700 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:49.199815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914409df-6b4b-4d83-8e11-7e2e8e6e4d01 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:49.200783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914409df-6b4b-4d83-8e11-7e2e8e6e4d01 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:49.201293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914409df-6b4b-4d83-8e11-7e2e8e6e4d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:49.263097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-914409df-6b4b-4d83-8e11-7e2e8e6e4d01 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:49.269582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-914409df-6b4b-4d83-8e11-7e2e8e6e4d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:49.474696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:49.507885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1237/2438] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:49.578907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:49.580640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:49.787081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba3225-6b50-4b0a-a7f3-bb0d856be377 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:49.801507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae2f1e-5dee-466e-b946-07dc672da2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:49.802145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae2f1e-5dee-466e-b946-07dc672da2bc service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:49.802425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae2f1e-5dee-466e-b946-07dc672da2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:49.802700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae2f1e-5dee-466e-b946-07dc672da2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:49.836915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae2f1e-5dee-466e-b946-07dc672da2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:49.838518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae2f1e-5dee-466e-b946-07dc672da2bc service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:49.909800 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1202/2439] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:50.234866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914409df-6b4b-4d83-8e11-7e2e8e6e4d01 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:50.239928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-914409df-6b4b-4d83-8e11-7e2e8e6e4d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:50.258502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914409df-6b4b-4d83-8e11-7e2e8e6e4d01 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:50.276175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a231de-5700-4537-9fdf-bf1d1818c456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:50.277052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a231de-5700-4537-9fdf-bf1d1818c456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:50.277696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a231de-5700-4537-9fdf-bf1d1818c456 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:50.278161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a231de-5700-4537-9fdf-bf1d1818c456 admin admin] PATH_INFO: `/v3/projects/2a09abdfb79747df96697a13a2415cd2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:50.280819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a231de-5700-4537-9fdf-bf1d1818c456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a09abdfb79747df96697a13a2415cd2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:50.282805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a231de-5700-4537-9fdf-bf1d1818c456 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:50.397934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-39a231de-5700-4537-9fdf-bf1d1818c456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a09abdfb79747df96697a13a2415cd2', 'request_id': 'req-39a231de-5700-4537-9fdf-bf1d1818c456'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:50.422939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-39a231de-5700-4537-9fdf-bf1d1818c456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a09abdfb79747df96697a13a2415cd2', 'request_id': 'req-39a231de-5700-4537-9fdf-bf1d1818c456'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:50.430712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-39a231de-5700-4537-9fdf-bf1d1818c456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a09abdfb79747df96697a13a2415cd2', 'request_id': 'req-39a231de-5700-4537-9fdf-bf1d1818c456'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:50.471462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-39a231de-5700-4537-9fdf-bf1d1818c456 admin admin] The token cache is being invalidate because project 2a09abdfb79747df96697a13a2415cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:50.471462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-39a231de-5700-4537-9fdf-bf1d1818c456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:50.471462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-39a231de-5700-4537-9fdf-bf1d1818c456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:50.474030 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1238/2440] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:50 2022] DELETE /identity/v3/projects/2a09abdfb79747df96697a13a2415cd2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:50.475691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f86b9-d55e-4530-b65f-bf9d3e4b5664 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:50.476385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f86b9-d55e-4530-b65f-bf9d3e4b5664 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:50.476733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f86b9-d55e-4530-b65f-bf9d3e4b5664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:50.540381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-263f86b9-d55e-4530-b65f-bf9d3e4b5664 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:50.561303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-263f86b9-d55e-4530-b65f-bf9d3e4b5664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:50.822815 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1203/2441] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:50.834304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4718493-ce79-49d9-a32b-be5ccce8e3ee None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:50.839658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4718493-ce79-49d9-a32b-be5ccce8e3ee None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:50.839987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4718493-ce79-49d9-a32b-be5ccce8e3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:50.944136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d4718493-ce79-49d9-a32b-be5ccce8e3ee None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:50.950707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d4718493-ce79-49d9-a32b-be5ccce8e3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:50.972342 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1239/2442] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:50.977751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f86b9-d55e-4530-b65f-bf9d3e4b5664 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:51.005273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f86b9-d55e-4530-b65f-bf9d3e4b5664 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:51.031696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874b3a2-f090-425b-99f9-409b4f14ad14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:51.032329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874b3a2-f090-425b-99f9-409b4f14ad14 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:51.032619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874b3a2-f090-425b-99f9-409b4f14ad14 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:51.032881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874b3a2-f090-425b-99f9-409b4f14ad14 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:51.036773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874b3a2-f090-425b-99f9-409b4f14ad14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:51.037106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874b3a2-f090-425b-99f9-409b4f14ad14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:51.038761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874b3a2-f090-425b-99f9-409b4f14ad14 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:51.076483 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1204/2443] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:51.082450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4718493-ce79-49d9-a32b-be5ccce8e3ee None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:51.103635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4718493-ce79-49d9-a32b-be5ccce8e3ee None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:51.117325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6157f-0e48-4a4c-b4f0-b2eea3366706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:51.118259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6157f-0e48-4a4c-b4f0-b2eea3366706 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:51.118719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6157f-0e48-4a4c-b4f0-b2eea3366706 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:51.119283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6157f-0e48-4a4c-b4f0-b2eea3366706 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:51.120142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6157f-0e48-4a4c-b4f0-b2eea3366706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:51.122697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6157f-0e48-4a4c-b4f0-b2eea3366706 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:51.208516 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1240/2444] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:51 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:51.213386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874b3a2-f090-425b-99f9-409b4f14ad14 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:51.234747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874b3a2-f090-425b-99f9-409b4f14ad14 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:51.327886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:51.556573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e0066-2601-4882-9e47-2ffb0cc339d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:51.557415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e0066-2601-4882-9e47-2ffb0cc339d1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:51.557873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e0066-2601-4882-9e47-2ffb0cc339d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:51.558326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e0066-2601-4882-9e47-2ffb0cc339d1 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:51.559127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e0066-2601-4882-9e47-2ffb0cc339d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:51.565785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e0066-2601-4882-9e47-2ffb0cc339d1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:51.632465 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1205/2445] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:51 2022] POST /identity/v3/users => generated 287 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:51.636841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6157f-0e48-4a4c-b4f0-b2eea3366706 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:51.713775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6157f-0e48-4a4c-b4f0-b2eea3366706 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:51.724496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0805e-2266-4a80-b49a-ac2c64ba68fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:51.725463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0805e-2266-4a80-b49a-ac2c64ba68fe admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:51.725899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0805e-2266-4a80-b49a-ac2c64ba68fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:51.726726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0805e-2266-4a80-b49a-ac2c64ba68fe admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:51.727813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0805e-2266-4a80-b49a-ac2c64ba68fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:51.730515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0805e-2266-4a80-b49a-ac2c64ba68fe admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:51.763524 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1241/2446] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:51.764707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e0066-2601-4882-9e47-2ffb0cc339d1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:51.784666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e0066-2601-4882-9e47-2ffb0cc339d1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:51.799229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a757c-c9f0-44d5-9554-a35b4cc325b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:51.804265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a757c-c9f0-44d5-9554-a35b4cc325b4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:51.804788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a757c-c9f0-44d5-9554-a35b4cc325b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:51.805338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a757c-c9f0-44d5-9554-a35b4cc325b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:51.806171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a757c-c9f0-44d5-9554-a35b4cc325b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:51.807956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a757c-c9f0-44d5-9554-a35b4cc325b4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:51.828980 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1206/2447] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:51.832608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0805e-2266-4a80-b49a-ac2c64ba68fe admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:51.870410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0805e-2266-4a80-b49a-ac2c64ba68fe admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:51.882779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b612319-41ab-4338-9873-945574c2c886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:51.886548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b612319-41ab-4338-9873-945574c2c886 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:51.890375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b612319-41ab-4338-9873-945574c2c886 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:51.890805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b612319-41ab-4338-9873-945574c2c886 admin admin] PATH_INFO: `/v3/projects/8c92fe04ab8248399d0acb932f82d607/users/5ef659f5a1a24c439528a7675bdd70f8/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:51.930113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b612319-41ab-4338-9873-945574c2c886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c92fe04ab8248399d0acb932f82d607, user_id=5ef659f5a1a24c439528a7675bdd70f8, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:51.933085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b612319-41ab-4338-9873-945574c2c886 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:51.963958 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1242/2448] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:51 2022] PUT /identity/v3/projects/8c92fe04ab8248399d0acb932f82d607/users/5ef659f5a1a24c439528a7675bdd70f8/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:51.975866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f093e-7b60-4ccf-b2d5-3d1dcd18bd3c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:51.976086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f093e-7b60-4ccf-b2d5-3d1dcd18bd3c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:51.976952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f093e-7b60-4ccf-b2d5-3d1dcd18bd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:52.035082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a30f093e-7b60-4ccf-b2d5-3d1dcd18bd3c None None] MFA Rules not processed for user `5ef659f5a1a24c439528a7675bdd70f8`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:52.036808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a30f093e-7b60-4ccf-b2d5-3d1dcd18bd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:52.149772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b612319-41ab-4338-9873-945574c2c886 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:52.151852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6b612319-41ab-4338-9873-945574c2c886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:52.237737 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1207/2449] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:52.239117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f093e-7b60-4ccf-b2d5-3d1dcd18bd3c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:52.370045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b612319-41ab-4338-9873-945574c2c886 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:52.385957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b9541-bfa5-4931-9783-34c351e18a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:52.388003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b9541-bfa5-4931-9783-34c351e18a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:52.389478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b9541-bfa5-4931-9783-34c351e18a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:52.389902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b9541-bfa5-4931-9783-34c351e18a31 admin admin] PATH_INFO: `/v3/users/801e079246714e2fadfcac464db3cac5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:52.392136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b9541-bfa5-4931-9783-34c351e18a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=801e079246714e2fadfcac464db3cac5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:52.396450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b9541-bfa5-4931-9783-34c351e18a31 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:52.400524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f093e-7b60-4ccf-b2d5-3d1dcd18bd3c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:52.414785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5429ec-1bef-4edd-a620-6cbc9bb4a3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:52.415479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5429ec-1bef-4edd-a620-6cbc9bb4a3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:52.415777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5429ec-1bef-4edd-a620-6cbc9bb4a3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:52.416033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5429ec-1bef-4edd-a620-6cbc9bb4a3a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:52.416673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5429ec-1bef-4edd-a620-6cbc9bb4a3a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:52.418635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5429ec-1bef-4edd-a620-6cbc9bb4a3a9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:52.449830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:52.491978 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1208/2450] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:52 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:52.493142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5429ec-1bef-4edd-a620-6cbc9bb4a3a9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:52.508469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-366b9541-bfa5-4931-9783-34c351e18a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '801e079246714e2fadfcac464db3cac5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:52.544951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:52.557753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-366b9541-bfa5-4931-9783-34c351e18a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '801e079246714e2fadfcac464db3cac5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:52.559711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-366b9541-bfa5-4931-9783-34c351e18a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '801e079246714e2fadfcac464db3cac5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:52.563873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-366b9541-bfa5-4931-9783-34c351e18a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '801e079246714e2fadfcac464db3cac5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:52.594439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-366b9541-bfa5-4931-9783-34c351e18a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '801e079246714e2fadfcac464db3cac5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:52.623589 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1243/2451] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:52 2022] DELETE /identity/v3/users/801e079246714e2fadfcac464db3cac5 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:52.627142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74133fc-9ceb-4aec-a791-377877ed9c5d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:52.627429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74133fc-9ceb-4aec-a791-377877ed9c5d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:52.627704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74133fc-9ceb-4aec-a791-377877ed9c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:52.669078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5429ec-1bef-4edd-a620-6cbc9bb4a3a9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:52.676536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d74133fc-9ceb-4aec-a791-377877ed9c5d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:52.677833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d74133fc-9ceb-4aec-a791-377877ed9c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:52.824450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54999bd1-cef5-4246-8a34-f00d99a383ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:52.826563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54999bd1-cef5-4246-8a34-f00d99a383ef admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:52.828814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54999bd1-cef5-4246-8a34-f00d99a383ef admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:52.830734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54999bd1-cef5-4246-8a34-f00d99a383ef admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:52.832145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54999bd1-cef5-4246-8a34-f00d99a383ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:52.843592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54999bd1-cef5-4246-8a34-f00d99a383ef admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:52.871198 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1244/2452] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:52.895299 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1209/2453] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:52 2022] POST /identity/v3/users => generated 295 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:52.899088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74133fc-9ceb-4aec-a791-377877ed9c5d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:52.900927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d74133fc-9ceb-4aec-a791-377877ed9c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:52.931984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74133fc-9ceb-4aec-a791-377877ed9c5d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:52.948581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c4370-f6d8-4de8-8cab-014faed41ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:52.950797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c4370-f6d8-4de8-8cab-014faed41ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:52.951161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c4370-f6d8-4de8-8cab-014faed41ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:52.954254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c4370-f6d8-4de8-8cab-014faed41ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:52.955164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c4370-f6d8-4de8-8cab-014faed41ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:52.956995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c4370-f6d8-4de8-8cab-014faed41ed7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:52.973050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54999bd1-cef5-4246-8a34-f00d99a383ef admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:52.975492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-54999bd1-cef5-4246-8a34-f00d99a383ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:53.011663 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1245/2454] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:52:53.013709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c4370-f6d8-4de8-8cab-014faed41ed7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:53.027459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c4370-f6d8-4de8-8cab-014faed41ed7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:53.035863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b84b27-2f96-4c44-80b7-7c67212897cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:53.037926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b84b27-2f96-4c44-80b7-7c67212897cd admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:53.038701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b84b27-2f96-4c44-80b7-7c67212897cd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:53.039307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b84b27-2f96-4c44-80b7-7c67212897cd admin admin] PATH_INFO: `/v3/projects/c03273e2eef34c34b49e692cbc851d3f/users/12654655fd1e4facb48253e20f29a346/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:53.074042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b84b27-2f96-4c44-80b7-7c67212897cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03273e2eef34c34b49e692cbc851d3f, user_id=12654655fd1e4facb48253e20f29a346, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:53.098146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b84b27-2f96-4c44-80b7-7c67212897cd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:53.137267 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1246/2455] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:53 2022] PUT /identity/v3/projects/c03273e2eef34c34b49e692cbc851d3f/users/12654655fd1e4facb48253e20f29a346/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:53.141541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b84b27-2f96-4c44-80b7-7c67212897cd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:53.215392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54999bd1-cef5-4246-8a34-f00d99a383ef admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:53.375432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b84b27-2f96-4c44-80b7-7c67212897cd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:53.391648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed32b3-31e9-426c-a07d-c7103454ae6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:53.392278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed32b3-31e9-426c-a07d-c7103454ae6a service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:53.392555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed32b3-31e9-426c-a07d-c7103454ae6a service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:53.392829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed32b3-31e9-426c-a07d-c7103454ae6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:53.395693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2262e7-c829-4259-8205-34d96f758ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:53.399281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2262e7-c829-4259-8205-34d96f758ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:53.399745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2262e7-c829-4259-8205-34d96f758ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:53.400925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2262e7-c829-4259-8205-34d96f758ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:53.401649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2262e7-c829-4259-8205-34d96f758ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:53.407419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2262e7-c829-4259-8205-34d96f758ac6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:53.414458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed32b3-31e9-426c-a07d-c7103454ae6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:53.415937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed32b3-31e9-426c-a07d-c7103454ae6a service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:53.427511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:53.443516 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1247/2456] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:53.444952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2262e7-c829-4259-8205-34d96f758ac6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:53.445796 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1210/2457] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:53.467570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2262e7-c829-4259-8205-34d96f758ac6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:53.507983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401454c-bf35-440b-bbd3-fb292593fb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:53.508682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401454c-bf35-440b-bbd3-fb292593fb78 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:53.508959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401454c-bf35-440b-bbd3-fb292593fb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:53.509286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401454c-bf35-440b-bbd3-fb292593fb78 admin admin] PATH_INFO: `/v3/projects/c03273e2eef34c34b49e692cbc851d3f/users/12654655fd1e4facb48253e20f29a346/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:53.511359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401454c-bf35-440b-bbd3-fb292593fb78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03273e2eef34c34b49e692cbc851d3f, user_id=12654655fd1e4facb48253e20f29a346, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:53.517544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401454c-bf35-440b-bbd3-fb292593fb78 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:53.566882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed32b3-31e9-426c-a07d-c7103454ae6a service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:53.568819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e4ed32b3-31e9-426c-a07d-c7103454ae6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:53.581094 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1248/2458] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:53 2022] PUT /identity/v3/projects/c03273e2eef34c34b49e692cbc851d3f/users/12654655fd1e4facb48253e20f29a346/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:53.583824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeb065-c116-4dd4-9f73-be03e43d3352 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:53.584128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeb065-c116-4dd4-9f73-be03e43d3352 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:53.584401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeb065-c116-4dd4-9f73-be03e43d3352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:53.595003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed32b3-31e9-426c-a07d-c7103454ae6a service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:53.611796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:53.661243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4deeb065-c116-4dd4-9f73-be03e43d3352 None None] MFA Rules not processed for user `12654655fd1e4facb48253e20f29a346`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:53.663312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4deeb065-c116-4dd4-9f73-be03e43d3352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:53.748787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:53.749640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:53.749982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:53.750428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] PATH_INFO: `/v3/projects/f395d3de13ee4003826fbf2fc74707d2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:53.762934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f395d3de13ee4003826fbf2fc74707d2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:53.765111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:53.844496 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1249/2459] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:53.858561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a28286-7335-4a5a-9e0c-bcf63cd94f91 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:53.858561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a28286-7335-4a5a-9e0c-bcf63cd94f91 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:53.859256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a28286-7335-4a5a-9e0c-bcf63cd94f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:53.898137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-57a28286-7335-4a5a-9e0c-bcf63cd94f91 None None] MFA Rules not processed for user `5ef659f5a1a24c439528a7675bdd70f8`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:53.899457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-57a28286-7335-4a5a-9e0c-bcf63cd94f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:53.900186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f395d3de13ee4003826fbf2fc74707d2', 'request_id': 'req-dc0105e7-9e08-48ea-85a0-aaed467f69ee'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:53.915663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f395d3de13ee4003826fbf2fc74707d2', 'request_id': 'req-dc0105e7-9e08-48ea-85a0-aaed467f69ee'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:53.934570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f395d3de13ee4003826fbf2fc74707d2', 'request_id': 'req-dc0105e7-9e08-48ea-85a0-aaed467f69ee'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:53.967467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] The token cache is being invalidate because project f395d3de13ee4003826fbf2fc74707d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:53.968504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:53.969571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:53.971829 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1211/2460] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:53 2022] DELETE /identity/v3/projects/f395d3de13ee4003826fbf2fc74707d2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:53.976612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:53.981013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:54.072067 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1250/2461] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:54.138744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0105e7-9e08-48ea-85a0-aaed467f69ee admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:54.146893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:54.147711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:54.149108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:54.156673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] PATH_INFO: `/v3/users/a7bc206b32fa43398ed92cc59127090e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:54.157962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7bc206b32fa43398ed92cc59127090e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:54.161432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:54.239451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:54.254326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7bc206b32fa43398ed92cc59127090e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:54.268564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7bc206b32fa43398ed92cc59127090e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:54.269875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7bc206b32fa43398ed92cc59127090e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:54.270827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7bc206b32fa43398ed92cc59127090e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:54.287587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7bc206b32fa43398ed92cc59127090e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:54.316750 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1212/2462] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:53 2022] DELETE /identity/v3/users/a7bc206b32fa43398ed92cc59127090e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:54.514922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a28286-7335-4a5a-9e0c-bcf63cd94f91 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:54.516545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-57a28286-7335-4a5a-9e0c-bcf63cd94f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:54.654953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a28286-7335-4a5a-9e0c-bcf63cd94f91 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:54.676436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:54.774307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb1778-a50b-4a06-8f6f-e0d111387e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:54.775074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb1778-a50b-4a06-8f6f-e0d111387e5f service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:54.776415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb1778-a50b-4a06-8f6f-e0d111387e5f service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:54.776976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb1778-a50b-4a06-8f6f-e0d111387e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:54.783587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bcdb1778-a50b-4a06-8f6f-e0d111387e5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:54.803045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:54.806043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:54.841028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57f495-be13-42b9-bad6-ec3572664106 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:54.858257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5fca4-6012-436c-8015-2fbad7d6ac0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:54.859419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5fca4-6012-436c-8015-2fbad7d6ac0a service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:54.859797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5fca4-6012-436c-8015-2fbad7d6ac0a service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:54.860175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5fca4-6012-436c-8015-2fbad7d6ac0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:54.863983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d1f5fca4-6012-436c-8015-2fbad7d6ac0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:54.937440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb1778-a50b-4a06-8f6f-e0d111387e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:54.941058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb1778-a50b-4a06-8f6f-e0d111387e5f service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:54.965692 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1251/2463] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:54.969517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899d595-a0d9-4bb1-8a20-aa6f11d46775 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:54.969517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899d595-a0d9-4bb1-8a20-aa6f11d46775 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:54.969517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899d595-a0d9-4bb1-8a20-aa6f11d46775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:55.019905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5fca4-6012-436c-8015-2fbad7d6ac0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:55.036081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5fca4-6012-436c-8015-2fbad7d6ac0a service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:55.059735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1899d595-a0d9-4bb1-8a20-aa6f11d46775 None None] MFA Rules not processed for user `2495d40e2857401a83a78bcdbed948a7`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:55.065160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1899d595-a0d9-4bb1-8a20-aa6f11d46775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:55.099670 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1213/2464] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:55.101087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5fca4-6012-436c-8015-2fbad7d6ac0a service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:55.105831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d1f5fca4-6012-436c-8015-2fbad7d6ac0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:55.352689 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1252/2465] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:54 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:55.360065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5fca4-6012-436c-8015-2fbad7d6ac0a service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:55.372823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:55.373378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:55.373662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:55.376106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] PATH_INFO: `/v3/projects/876d1525decf4f9ebb4096e1b6ac374b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:55.378035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=876d1525decf4f9ebb4096e1b6ac374b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:55.380145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:55.505214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '876d1525decf4f9ebb4096e1b6ac374b', 'request_id': 'req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:55.509257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:55.519104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '876d1525decf4f9ebb4096e1b6ac374b', 'request_id': 'req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:55.537533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '876d1525decf4f9ebb4096e1b6ac374b', 'request_id': 'req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:55.552642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] The token cache is being invalidate because project 876d1525decf4f9ebb4096e1b6ac374b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:55.553311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:55.554084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:55.557249 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1214/2466] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:55 2022] DELETE /identity/v3/projects/876d1525decf4f9ebb4096e1b6ac374b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:55.560443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899d595-a0d9-4bb1-8a20-aa6f11d46775 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:55.580018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899d595-a0d9-4bb1-8a20-aa6f11d46775 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:55.691829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:55.756583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:55.757302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:55.757596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:55.758420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] PATH_INFO: `/v3/users/abeb88c831bf46e8a16cbeb06c5bc68f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:55.759843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abeb88c831bf46e8a16cbeb06c5bc68f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:55.762318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:55.851743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abeb88c831bf46e8a16cbeb06c5bc68f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:55.865152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abeb88c831bf46e8a16cbeb06c5bc68f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:55.865932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abeb88c831bf46e8a16cbeb06c5bc68f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:55.866563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abeb88c831bf46e8a16cbeb06c5bc68f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:55.884067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abeb88c831bf46e8a16cbeb06c5bc68f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:55.919675 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1253/2467] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:55 2022] DELETE /identity/v3/users/abeb88c831bf46e8a16cbeb06c5bc68f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:56.026220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:56.028705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:56.058168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcccc5e-8548-406f-bd39-c9ef3d8640cf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:56.101334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:56.103610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:56.284918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f45890-ebbb-4c93-b907-4be39c10f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:56.286751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f45890-ebbb-4c93-b907-4be39c10f34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:56.287277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f45890-ebbb-4c93-b907-4be39c10f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:56.287931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f45890-ebbb-4c93-b907-4be39c10f34a admin admin] PATH_INFO: `/v3/projects/bcfed4f80643462f94514e9e70f24354` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:56.293666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f45890-ebbb-4c93-b907-4be39c10f34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcfed4f80643462f94514e9e70f24354)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:56.298926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f45890-ebbb-4c93-b907-4be39c10f34a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:56.322800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17e8d8-8ce0-4852-a10d-c742ecf95ec7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:56.339283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7c3fb-f0d7-49fd-8359-2177c2a7d900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:56.340729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c3fb-f0d7-49fd-8359-2177c2a7d900 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:56.343689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c3fb-f0d7-49fd-8359-2177c2a7d900 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:56.344307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c3fb-f0d7-49fd-8359-2177c2a7d900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:56.347688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-03c7c3fb-f0d7-49fd-8359-2177c2a7d900 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:56.433671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-65f45890-ebbb-4c93-b907-4be39c10f34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcfed4f80643462f94514e9e70f24354', 'request_id': 'req-65f45890-ebbb-4c93-b907-4be39c10f34a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:56.457279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-65f45890-ebbb-4c93-b907-4be39c10f34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcfed4f80643462f94514e9e70f24354', 'request_id': 'req-65f45890-ebbb-4c93-b907-4be39c10f34a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:56.474989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-65f45890-ebbb-4c93-b907-4be39c10f34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcfed4f80643462f94514e9e70f24354', 'request_id': 'req-65f45890-ebbb-4c93-b907-4be39c10f34a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:56.482195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:56.494952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7c3fb-f0d7-49fd-8359-2177c2a7d900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:56.498151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7c3fb-f0d7-49fd-8359-2177c2a7d900 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:56.506297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-65f45890-ebbb-4c93-b907-4be39c10f34a admin admin] The token cache is being invalidate because project bcfed4f80643462f94514e9e70f24354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:56.506711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-65f45890-ebbb-4c93-b907-4be39c10f34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:56.507998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-65f45890-ebbb-4c93-b907-4be39c10f34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:56.510061 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1215/2468] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:56 2022] DELETE /identity/v3/projects/bcfed4f80643462f94514e9e70f24354 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:56.514600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa30309-d06d-46c6-8b2a-da23ca28fb52 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:56.518119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa30309-d06d-46c6-8b2a-da23ca28fb52 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:56.518870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa30309-d06d-46c6-8b2a-da23ca28fb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:56.523206 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1254/2469] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:56 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:56.615793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7fa30309-d06d-46c6-8b2a-da23ca28fb52 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:56.617109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7fa30309-d06d-46c6-8b2a-da23ca28fb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:56.772094 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1216/2470] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:52:56.781015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8fd25-0ff7-47cd-a950-e076b8e4ba54 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:56.781447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8fd25-0ff7-47cd-a950-e076b8e4ba54 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:56.781791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8fd25-0ff7-47cd-a950-e076b8e4ba54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:56.834395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-38e8fd25-0ff7-47cd-a950-e076b8e4ba54 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:56.837171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-38e8fd25-0ff7-47cd-a950-e076b8e4ba54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:56.859409 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1255/2471] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:56.864291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa30309-d06d-46c6-8b2a-da23ca28fb52 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:56.879174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa30309-d06d-46c6-8b2a-da23ca28fb52 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:56.893107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf487d8-58be-491d-846a-fb743c79cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:56.894030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf487d8-58be-491d-846a-fb743c79cf5a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:56.894415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf487d8-58be-491d-846a-fb743c79cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:56.894711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf487d8-58be-491d-846a-fb743c79cf5a admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:56.917881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf487d8-58be-491d-846a-fb743c79cf5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:56.918253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf487d8-58be-491d-846a-fb743c79cf5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:56.920452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275e1af-f4e1-4d87-a519-57a6ca8f0b19 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:56.920666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275e1af-f4e1-4d87-a519-57a6ca8f0b19 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:56.921123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275e1af-f4e1-4d87-a519-57a6ca8f0b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:56.958511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf487d8-58be-491d-846a-fb743c79cf5a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:56.977736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:56.995257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6275e1af-f4e1-4d87-a519-57a6ca8f0b19 None None] MFA Rules not processed for user `5ef659f5a1a24c439528a7675bdd70f8`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:56.998434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6275e1af-f4e1-4d87-a519-57a6ca8f0b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:57.002719 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1217/2472] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:57.006150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf487d8-58be-491d-846a-fb743c79cf5a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:57.020009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf487d8-58be-491d-846a-fb743c79cf5a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:57.025573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185adc12-418a-4d1c-8d0d-8a0ebbed2c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:57.026518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185adc12-418a-4d1c-8d0d-8a0ebbed2c0f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:57.027451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185adc12-418a-4d1c-8d0d-8a0ebbed2c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:57.027956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185adc12-418a-4d1c-8d0d-8a0ebbed2c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:57.028959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185adc12-418a-4d1c-8d0d-8a0ebbed2c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:57.031264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185adc12-418a-4d1c-8d0d-8a0ebbed2c0f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:57.079574 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1218/2473] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:57 2022] POST /identity/v3/projects => generated 397 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:57.082023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185adc12-418a-4d1c-8d0d-8a0ebbed2c0f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:57.189686 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1256/2474] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:52:57.253838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185adc12-418a-4d1c-8d0d-8a0ebbed2c0f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:57.260780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f04ef-a1b4-4460-8d66-7dc130110b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:57.261436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f04ef-a1b4-4460-8d66-7dc130110b89 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:57.261719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f04ef-a1b4-4460-8d66-7dc130110b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:57.261997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f04ef-a1b4-4460-8d66-7dc130110b89 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:57.262644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f04ef-a1b4-4460-8d66-7dc130110b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:57.264914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f04ef-a1b4-4460-8d66-7dc130110b89 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:57.301016 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1219/2475] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:57 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:57.304931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275e1af-f4e1-4d87-a519-57a6ca8f0b19 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:57.316451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275e1af-f4e1-4d87-a519-57a6ca8f0b19 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:57.321366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751aaf7-3bed-4fc2-aedf-93652bb0b48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:57.322004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751aaf7-3bed-4fc2-aedf-93652bb0b48b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:57.322269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751aaf7-3bed-4fc2-aedf-93652bb0b48b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:57.322528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751aaf7-3bed-4fc2-aedf-93652bb0b48b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:57.323230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751aaf7-3bed-4fc2-aedf-93652bb0b48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:57.324793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751aaf7-3bed-4fc2-aedf-93652bb0b48b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:57.337712 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1257/2476] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:57.341893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f04ef-a1b4-4460-8d66-7dc130110b89 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:57.359928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f04ef-a1b4-4460-8d66-7dc130110b89 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:57.373814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc17c3f-3ea9-4984-93a2-f4e30a512f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:57.376246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc17c3f-3ea9-4984-93a2-f4e30a512f80 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:57.376833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc17c3f-3ea9-4984-93a2-f4e30a512f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:57.377882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc17c3f-3ea9-4984-93a2-f4e30a512f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:57.379021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc17c3f-3ea9-4984-93a2-f4e30a512f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:57.386757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc17c3f-3ea9-4984-93a2-f4e30a512f80 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:57.416452 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1220/2477] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:57.420439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751aaf7-3bed-4fc2-aedf-93652bb0b48b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:57.435652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751aaf7-3bed-4fc2-aedf-93652bb0b48b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:57.475826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ab825-7b85-4442-b3ca-03d53feda911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:57.476639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ab825-7b85-4442-b3ca-03d53feda911 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:57.476937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ab825-7b85-4442-b3ca-03d53feda911 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:57.477237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ab825-7b85-4442-b3ca-03d53feda911 admin admin] PATH_INFO: `/v3/projects/8ae60f71bc734a5d8d37eaba4078fc19/users/e69b3444633b4feb8c23c06e86f20929/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:57.540374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ab825-7b85-4442-b3ca-03d53feda911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae60f71bc734a5d8d37eaba4078fc19, user_id=e69b3444633b4feb8c23c06e86f20929, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:57.552100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ab825-7b85-4442-b3ca-03d53feda911 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:57.606666 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1258/2478] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:57 2022] PUT /identity/v3/projects/8ae60f71bc734a5d8d37eaba4078fc19/users/e69b3444633b4feb8c23c06e86f20929/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:57.616511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807d26b-1919-401f-92bd-60e0949660a1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:57.616905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807d26b-1919-401f-92bd-60e0949660a1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:57.617123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807d26b-1919-401f-92bd-60e0949660a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:57.693948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9807d26b-1919-401f-92bd-60e0949660a1 None None] MFA Rules not processed for user `e69b3444633b4feb8c23c06e86f20929`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:57.697046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9807d26b-1919-401f-92bd-60e0949660a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:57.714042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ab825-7b85-4442-b3ca-03d53feda911 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:57.718462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-748ab825-7b85-4442-b3ca-03d53feda911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:57.986412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ab825-7b85-4442-b3ca-03d53feda911 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:57.995609 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1221/2479] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:57.995609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807d26b-1919-401f-92bd-60e0949660a1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:57.996760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9807d26b-1919-401f-92bd-60e0949660a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:58.001578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:58.002246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:58.002569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:58.002914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] PATH_INFO: `/v3/projects/234c04b1b9ea4b36a86cd71799f4adbb` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:58.005927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=234c04b1b9ea4b36a86cd71799f4adbb)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:58.013431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:58.127500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '234c04b1b9ea4b36a86cd71799f4adbb', 'request_id': 'req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:58.141127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:58.145476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '234c04b1b9ea4b36a86cd71799f4adbb', 'request_id': 'req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:58.149044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:58.172224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '234c04b1b9ea4b36a86cd71799f4adbb', 'request_id': 'req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:58.198293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807d26b-1919-401f-92bd-60e0949660a1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:58.200774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] The token cache is being invalidate because project 234c04b1b9ea4b36a86cd71799f4adbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:58.202995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:58.210233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:58.217443 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1259/2480] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:57 2022] DELETE /identity/v3/projects/234c04b1b9ea4b36a86cd71799f4adbb => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:58.217443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:58.217443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:58.386255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315a243-8f75-4a48-8dd2-14ac0c6c50f2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:58.397042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16441ab-5e69-453c-b93b-040e945f4eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:58.397798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16441ab-5e69-453c-b93b-040e945f4eeb admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:58.398077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16441ab-5e69-453c-b93b-040e945f4eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:58.398352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16441ab-5e69-453c-b93b-040e945f4eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:58.398994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16441ab-5e69-453c-b93b-040e945f4eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:58.402850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16441ab-5e69-453c-b93b-040e945f4eeb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:58.438575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6190107-4a3b-4eb8-b093-953b0fbc9e91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:58.439388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190107-4a3b-4eb8-b093-953b0fbc9e91 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:58.439888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190107-4a3b-4eb8-b093-953b0fbc9e91 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:58.440483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190107-4a3b-4eb8-b093-953b0fbc9e91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:58.443196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e6190107-4a3b-4eb8-b093-953b0fbc9e91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:58.457472 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1260/2481] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:58 2022] POST /identity/v3/projects => generated 397 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:58.457472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f9373-0207-4ad8-a9da-6f4d2e2fe4c9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:58.457472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f9373-0207-4ad8-a9da-6f4d2e2fe4c9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:58.457472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f9373-0207-4ad8-a9da-6f4d2e2fe4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:58.510514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7c5f9373-0207-4ad8-a9da-6f4d2e2fe4c9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:58.511692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7c5f9373-0207-4ad8-a9da-6f4d2e2fe4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:58.623233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6190107-4a3b-4eb8-b093-953b0fbc9e91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:58.627446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6190107-4a3b-4eb8-b093-953b0fbc9e91 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:58.647776 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1222/2482] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:57 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:58.650137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f364dcb-63fc-435b-986f-3ac5b836c9b0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:58.650431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f364dcb-63fc-435b-986f-3ac5b836c9b0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:58.650934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f364dcb-63fc-435b-986f-3ac5b836c9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:58.686304 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1261/2483] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:58.686304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f9373-0207-4ad8-a9da-6f4d2e2fe4c9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:58.720753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f9373-0207-4ad8-a9da-6f4d2e2fe4c9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:58.726954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461e98e-40fb-4225-ae55-8ec7c0ac4b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:58.727719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461e98e-40fb-4225-ae55-8ec7c0ac4b53 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:58.728021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461e98e-40fb-4225-ae55-8ec7c0ac4b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:58.728300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461e98e-40fb-4225-ae55-8ec7c0ac4b53 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:58.729472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461e98e-40fb-4225-ae55-8ec7c0ac4b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:58.731107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461e98e-40fb-4225-ae55-8ec7c0ac4b53 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:58.765843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7f364dcb-63fc-435b-986f-3ac5b836c9b0 None None] MFA Rules not processed for user `92974e07be4b45bab207d0f544fae05a`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:58.769537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7f364dcb-63fc-435b-986f-3ac5b836c9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:58.776304 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1262/2484] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:58 2022] POST /identity/v3/users => generated 305 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:58.780874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0abe85-bad1-45b3-b9f0-d87a240c94df None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:58.788675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0abe85-bad1-45b3-b9f0-d87a240c94df None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:58.789020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0abe85-bad1-45b3-b9f0-d87a240c94df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:58.863963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9b0abe85-bad1-45b3-b9f0-d87a240c94df None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:58.867437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9b0abe85-bad1-45b3-b9f0-d87a240c94df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:58.897950 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1263/2485] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:58.897950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0abe85-bad1-45b3-b9f0-d87a240c94df None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:58.900118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9b0abe85-bad1-45b3-b9f0-d87a240c94df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:58.922955 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1223/2486] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:58.924467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f364dcb-63fc-435b-986f-3ac5b836c9b0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:58.931539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:58.949447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f364dcb-63fc-435b-986f-3ac5b836c9b0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:58.962548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2eb5c-9158-4deb-ab52-a2e091982b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:58.963520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2eb5c-9158-4deb-ab52-a2e091982b76 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:58.965579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2eb5c-9158-4deb-ab52-a2e091982b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:58.966813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2eb5c-9158-4deb-ab52-a2e091982b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:58.969522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2eb5c-9158-4deb-ab52-a2e091982b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:58.975308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2eb5c-9158-4deb-ab52-a2e091982b76 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:59.003994 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1224/2487] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:59.005219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2eb5c-9158-4deb-ab52-a2e091982b76 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:59.030964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2eb5c-9158-4deb-ab52-a2e091982b76 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:59.044685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25b23d-88a3-4062-b149-dd7ef44d91ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:59.045585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25b23d-88a3-4062-b149-dd7ef44d91ce admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:59.046852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:59.047909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25b23d-88a3-4062-b149-dd7ef44d91ce admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:59.047909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25b23d-88a3-4062-b149-dd7ef44d91ce admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:59.050849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25b23d-88a3-4062-b149-dd7ef44d91ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:52:59.051566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25b23d-88a3-4062-b149-dd7ef44d91ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:59.054992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25b23d-88a3-4062-b149-dd7ef44d91ce admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:59.078365 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1225/2488] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:52:59.079719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbcc3f-00ab-42c3-986d-0adcb9a66c80 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:59.080069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbcc3f-00ab-42c3-986d-0adcb9a66c80 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:59.080542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbcc3f-00ab-42c3-986d-0adcb9a66c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:59.108167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2edbcc3f-00ab-42c3-986d-0adcb9a66c80 None None] MFA Rules not processed for user `474ca64d1b1d4e30916b517645aba882`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:59.109867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2edbcc3f-00ab-42c3-986d-0adcb9a66c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:59.122589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0abe85-bad1-45b3-b9f0-d87a240c94df None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:59.137923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09187af-5c4d-4dd0-bc65-e53f479eccea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:59.139272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09187af-5c4d-4dd0-bc65-e53f479eccea service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:59.140262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09187af-5c4d-4dd0-bc65-e53f479eccea service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:59.143449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09187af-5c4d-4dd0-bc65-e53f479eccea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:59.147796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b09187af-5c4d-4dd0-bc65-e53f479eccea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:59.264294 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1226/2489] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:59.267480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbcc3f-00ab-42c3-986d-0adcb9a66c80 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:59.292684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbcc3f-00ab-42c3-986d-0adcb9a66c80 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:59.310403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09187af-5c4d-4dd0-bc65-e53f479eccea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:59.312191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09187af-5c4d-4dd0-bc65-e53f479eccea service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:59.313174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819865c-a17a-4987-8761-858c34565ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:59.314061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819865c-a17a-4987-8761-858c34565ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:59.314351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819865c-a17a-4987-8761-858c34565ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:59.314619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819865c-a17a-4987-8761-858c34565ea1 admin admin] PATH_INFO: `/v3/projects/5c949a6d8b88422381df2d64a4d41fe3/users/7dbc0efe76b3478380bde3a2c217da73/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:59.331107 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1264/2490] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:59.334202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09187af-5c4d-4dd0-bc65-e53f479eccea service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:59.376444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819865c-a17a-4987-8761-858c34565ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c949a6d8b88422381df2d64a4d41fe3, user_id=7dbc0efe76b3478380bde3a2c217da73, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:59.379692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819865c-a17a-4987-8761-858c34565ea1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:59.406060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09187af-5c4d-4dd0-bc65-e53f479eccea service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:59.407144 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1227/2491] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:59 2022] PUT /identity/v3/projects/5c949a6d8b88422381df2d64a4d41fe3/users/7dbc0efe76b3478380bde3a2c217da73/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:59.408554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b61269-1f79-42b1-a3c1-9d8781bc1793 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:59.408875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b61269-1f79-42b1-a3c1-9d8781bc1793 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:59.409165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b61269-1f79-42b1-a3c1-9d8781bc1793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:59.498287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-28b61269-1f79-42b1-a3c1-9d8781bc1793 None None] MFA Rules not processed for user `360660f7bb4746c8b1397f4857f423f2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:59.501811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-28b61269-1f79-42b1-a3c1-9d8781bc1793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:59.631429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577093-2be2-44f4-a471-106b848fd7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:59.632081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577093-2be2-44f4-a471-106b848fd7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:59.632360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577093-2be2-44f4-a471-106b848fd7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:59.632640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577093-2be2-44f4-a471-106b848fd7f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:59.633934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b577093-2be2-44f4-a471-106b848fd7f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:59.638010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b577093-2be2-44f4-a471-106b848fd7f7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:59.638728 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1228/2492] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:59.640000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b61269-1f79-42b1-a3c1-9d8781bc1793 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:59.666958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b61269-1f79-42b1-a3c1-9d8781bc1793 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:59.684810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4be588-f300-4277-b7c2-4d7fcd25f132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:59.685747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be588-f300-4277-b7c2-4d7fcd25f132 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:59.687128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be588-f300-4277-b7c2-4d7fcd25f132 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:59.687911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be588-f300-4277-b7c2-4d7fcd25f132 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:59.690037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4be588-f300-4277-b7c2-4d7fcd25f132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:59.692208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4be588-f300-4277-b7c2-4d7fcd25f132 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:59.702900 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1265/2493] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:52:59 2022] POST /identity/v3/projects => generated 387 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:59.704410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577093-2be2-44f4-a471-106b848fd7f7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:59.705024 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1229/2494] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:52:59.709540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4be588-f300-4277-b7c2-4d7fcd25f132 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:59.733932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4be588-f300-4277-b7c2-4d7fcd25f132 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:59.896613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577093-2be2-44f4-a471-106b848fd7f7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:59.903450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a8c19-0203-43e8-87f9-6bd85678ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:59.904130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a8c19-0203-43e8-87f9-6bd85678ef90 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:59.904502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a8c19-0203-43e8-87f9-6bd85678ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:59.909977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a8c19-0203-43e8-87f9-6bd85678ef90 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:59.910744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a8c19-0203-43e8-87f9-6bd85678ef90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:59.912974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a8c19-0203-43e8-87f9-6bd85678ef90 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:59.918759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:59.938670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:59.961728 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1266/2495] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:52:59 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:52:59.961728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a8c19-0203-43e8-87f9-6bd85678ef90 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:59.962831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-691a8c19-0203-43e8-87f9-6bd85678ef90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:59.966615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e788875-97af-42d7-ac9a-2ef0c2fc110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:59.974468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e788875-97af-42d7-ac9a-2ef0c2fc110d admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:59.974468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e788875-97af-42d7-ac9a-2ef0c2fc110d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:59.974468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e788875-97af-42d7-ac9a-2ef0c2fc110d admin admin] PATH_INFO: `/v3/projects/5c949a6d8b88422381df2d64a4d41fe3/users/7dbc0efe76b3478380bde3a2c217da73/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:59.981145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e788875-97af-42d7-ac9a-2ef0c2fc110d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c949a6d8b88422381df2d64a4d41fe3, user_id=7dbc0efe76b3478380bde3a2c217da73, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:00.003062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e788875-97af-42d7-ac9a-2ef0c2fc110d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:00.034361 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1230/2496] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:52:59 2022] PUT /identity/v3/projects/5c949a6d8b88422381df2d64a4d41fe3/users/7dbc0efe76b3478380bde3a2c217da73/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:00.035312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e788875-97af-42d7-ac9a-2ef0c2fc110d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:00.156937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e788875-97af-42d7-ac9a-2ef0c2fc110d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:00.157377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a8c19-0203-43e8-87f9-6bd85678ef90 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:00.164576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e09a52-5aff-45ee-a5f9-fb7b0ddf92b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:00.169423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e09a52-5aff-45ee-a5f9-fb7b0ddf92b7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:00.169858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e09a52-5aff-45ee-a5f9-fb7b0ddf92b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:00.170291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e09a52-5aff-45ee-a5f9-fb7b0ddf92b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:00.172081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e09a52-5aff-45ee-a5f9-fb7b0ddf92b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:00.173988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e09a52-5aff-45ee-a5f9-fb7b0ddf92b7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:00.194746 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1231/2497] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:00.197295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdd550-9a09-47b8-a887-d6dee226e040 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:00.197664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdd550-9a09-47b8-a887-d6dee226e040 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:00.198898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdd550-9a09-47b8-a887-d6dee226e040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:00.247433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f7fdd550-9a09-47b8-a887-d6dee226e040 None None] MFA Rules not processed for user `7dbc0efe76b3478380bde3a2c217da73`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:00.249409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f7fdd550-9a09-47b8-a887-d6dee226e040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:00.343871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0d1b8-662c-4633-8d19-03b5f8740282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:00.344524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0d1b8-662c-4633-8d19-03b5f8740282 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:00.345174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0d1b8-662c-4633-8d19-03b5f8740282 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:00.345174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0d1b8-662c-4633-8d19-03b5f8740282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:00.346769 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1232/2498] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:00 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:00.348018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6dd0d1b8-662c-4633-8d19-03b5f8740282 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:00.348716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdd550-9a09-47b8-a887-d6dee226e040 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:00.369340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdd550-9a09-47b8-a887-d6dee226e040 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:00.376955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb603f-fe7c-4d9e-8c17-277f921e0373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:00.390771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb603f-fe7c-4d9e-8c17-277f921e0373 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:00.391061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb603f-fe7c-4d9e-8c17-277f921e0373 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:00.391462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb603f-fe7c-4d9e-8c17-277f921e0373 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:00.392244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb603f-fe7c-4d9e-8c17-277f921e0373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:00.393956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb603f-fe7c-4d9e-8c17-277f921e0373 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:00.425257 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1233/2499] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:00.430153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb603f-fe7c-4d9e-8c17-277f921e0373 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:00.453851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb603f-fe7c-4d9e-8c17-277f921e0373 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:00.462355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0264ac7-c8ec-4f80-a757-550e67747f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:00.463899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0264ac7-c8ec-4f80-a757-550e67747f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:00.464192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0264ac7-c8ec-4f80-a757-550e67747f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:00.464471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0264ac7-c8ec-4f80-a757-550e67747f67 admin admin] PATH_INFO: `/v3/projects/a8ceba0633a540e484287f987a2a76ee/users/4e1a8c3544d54d51b06db838e76e1d9d/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:00.492315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0d1b8-662c-4633-8d19-03b5f8740282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:00.497511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0d1b8-662c-4633-8d19-03b5f8740282 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:00.503243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0264ac7-c8ec-4f80-a757-550e67747f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ceba0633a540e484287f987a2a76ee, user_id=4e1a8c3544d54d51b06db838e76e1d9d, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:00.509939 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1267/2500] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:00.511481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0264ac7-c8ec-4f80-a757-550e67747f67 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:00.557253 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1234/2501] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:00 2022] PUT /identity/v3/projects/a8ceba0633a540e484287f987a2a76ee/users/4e1a8c3544d54d51b06db838e76e1d9d/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:00.563274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc984b-4f9a-49c3-bae4-0ea4762573b5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:00.565687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc984b-4f9a-49c3-bae4-0ea4762573b5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:00.566160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc984b-4f9a-49c3-bae4-0ea4762573b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:00.631800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-39bc984b-4f9a-49c3-bae4-0ea4762573b5 None None] MFA Rules not processed for user `4e1a8c3544d54d51b06db838e76e1d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:00.634298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-39bc984b-4f9a-49c3-bae4-0ea4762573b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:00.670289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:00.737334 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1268/2502] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:00.741649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0264ac7-c8ec-4f80-a757-550e67747f67 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:00.803595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:00.852639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0264ac7-c8ec-4f80-a757-550e67747f67 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:00.881450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f3af9-0fa2-470b-8ffb-318f9520b0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:00.882416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f3af9-0fa2-470b-8ffb-318f9520b0ff admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:00.884334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f3af9-0fa2-470b-8ffb-318f9520b0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:00.884863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f3af9-0fa2-470b-8ffb-318f9520b0ff admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:00.886025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f3af9-0fa2-470b-8ffb-318f9520b0ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:00.890223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f3af9-0fa2-470b-8ffb-318f9520b0ff admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:00.951506 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1235/2503] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:00 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:00.956078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc984b-4f9a-49c3-bae4-0ea4762573b5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:00.963156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f3af9-0fa2-470b-8ffb-318f9520b0ff admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:00.972480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc984b-4f9a-49c3-bae4-0ea4762573b5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:01.105482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32360fd9-8747-4963-b85e-57234bc9458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:01.108271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32360fd9-8747-4963-b85e-57234bc9458c admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:01.110230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32360fd9-8747-4963-b85e-57234bc9458c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:01.111340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32360fd9-8747-4963-b85e-57234bc9458c admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:01.116147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32360fd9-8747-4963-b85e-57234bc9458c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:01.128596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32360fd9-8747-4963-b85e-57234bc9458c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:01.142287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f3af9-0fa2-470b-8ffb-318f9520b0ff admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:01.150552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7f958-d5a0-40ea-a399-e55599284b88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:01.151339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7f958-d5a0-40ea-a399-e55599284b88 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:01.151597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7f958-d5a0-40ea-a399-e55599284b88 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:01.151872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7f958-d5a0-40ea-a399-e55599284b88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:01.153788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-75b7f958-d5a0-40ea-a399-e55599284b88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:01.192514 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1269/2504] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:00 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:01.196741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32360fd9-8747-4963-b85e-57234bc9458c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:01.223851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32360fd9-8747-4963-b85e-57234bc9458c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:01.237566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc69e27-751b-454a-bdda-ff08bebfa021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:01.239061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc69e27-751b-454a-bdda-ff08bebfa021 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:01.239547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc69e27-751b-454a-bdda-ff08bebfa021 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:01.240304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc69e27-751b-454a-bdda-ff08bebfa021 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:01.242859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc69e27-751b-454a-bdda-ff08bebfa021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:01.251031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc69e27-751b-454a-bdda-ff08bebfa021 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:01.252226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7f958-d5a0-40ea-a399-e55599284b88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:01.255377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7f958-d5a0-40ea-a399-e55599284b88 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:01.270749 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1236/2505] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:00 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:53:01.272170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b6c18-b309-462b-ae1c-c477a1ceedd1 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:01.272535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b6c18-b309-462b-ae1c-c477a1ceedd1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:01.272821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b6c18-b309-462b-ae1c-c477a1ceedd1 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:01.273782 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1270/2506] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:01.274725 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1237/2507] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:53:01.281353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc69e27-751b-454a-bdda-ff08bebfa021 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:01.284928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fee91-b2f6-436d-8767-49810ab46311 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:01.284928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fee91-b2f6-436d-8767-49810ab46311 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:01.284928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fee91-b2f6-436d-8767-49810ab46311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:01.312214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc69e27-751b-454a-bdda-ff08bebfa021 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:01.325225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b25c66-f98b-45fb-aa86-1bf99bf59c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:01.327594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b25c66-f98b-45fb-aa86-1bf99bf59c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:01.327745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9a4fee91-b2f6-436d-8767-49810ab46311 None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:01.328573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b25c66-f98b-45fb-aa86-1bf99bf59c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:01.328871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b25c66-f98b-45fb-aa86-1bf99bf59c13 admin admin] PATH_INFO: `/v3/projects/af7873519be44aa0a7f7e15dec05bcb4/users/5ef0e956024c4a27b13a5d157d0185e2/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:01.330366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9a4fee91-b2f6-436d-8767-49810ab46311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:01.361400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b25c66-f98b-45fb-aa86-1bf99bf59c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7873519be44aa0a7f7e15dec05bcb4, user_id=5ef0e956024c4a27b13a5d157d0185e2, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:01.364717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b25c66-f98b-45fb-aa86-1bf99bf59c13 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:01.394670 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1271/2508] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:01 2022] PUT /identity/v3/projects/af7873519be44aa0a7f7e15dec05bcb4/users/5ef0e956024c4a27b13a5d157d0185e2/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:01.398580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b25c66-f98b-45fb-aa86-1bf99bf59c13 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:01.430111 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1238/2509] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:01.445694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fee91-b2f6-436d-8767-49810ab46311 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:01.447586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9a4fee91-b2f6-436d-8767-49810ab46311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:01.457404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:01.461907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fee91-b2f6-436d-8767-49810ab46311 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:01.510547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b25c66-f98b-45fb-aa86-1bf99bf59c13 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:01.516837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0f7aa-9550-4256-9561-28499ff2870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:01.517521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f7aa-9550-4256-9561-28499ff2870a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:01.517908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f7aa-9550-4256-9561-28499ff2870a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:01.518244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f7aa-9550-4256-9561-28499ff2870a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:01.519056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0f7aa-9550-4256-9561-28499ff2870a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:01.521757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0f7aa-9550-4256-9561-28499ff2870a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:01.538860 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1272/2510] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:53:01.545382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0f7aa-9550-4256-9561-28499ff2870a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:01.566543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0f7aa-9550-4256-9561-28499ff2870a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:01.573868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59781d47-8056-4e30-afda-960922e2c6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:01.574927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59781d47-8056-4e30-afda-960922e2c6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:01.575695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59781d47-8056-4e30-afda-960922e2c6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:01.576128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59781d47-8056-4e30-afda-960922e2c6c1 admin admin] PATH_INFO: `/v3/projects/af7873519be44aa0a7f7e15dec05bcb4/users/5ef0e956024c4a27b13a5d157d0185e2/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:01.579431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59781d47-8056-4e30-afda-960922e2c6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7873519be44aa0a7f7e15dec05bcb4, user_id=5ef0e956024c4a27b13a5d157d0185e2, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:01.583013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59781d47-8056-4e30-afda-960922e2c6c1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:01.594564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:01.601950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c45bd-4f37-40c1-bc30-a399725ade6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:01.602581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c45bd-4f37-40c1-bc30-a399725ade6b service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:01.602968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c45bd-4f37-40c1-bc30-a399725ade6b service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:01.603251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c45bd-4f37-40c1-bc30-a399725ade6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:01.605588 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1273/2511] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:01 2022] PUT /identity/v3/projects/af7873519be44aa0a7f7e15dec05bcb4/users/5ef0e956024c4a27b13a5d157d0185e2/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:01.617987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360610fd-610e-4579-b6bc-5eb18d493fa8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:01.618287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360610fd-610e-4579-b6bc-5eb18d493fa8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:01.618842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360610fd-610e-4579-b6bc-5eb18d493fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:01.622081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c45bd-4f37-40c1-bc30-a399725ade6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:01.625426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c45bd-4f37-40c1-bc30-a399725ade6b service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:01.648447 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1239/2512] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:01.660616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-360610fd-610e-4579-b6bc-5eb18d493fa8 None None] MFA Rules not processed for user `5ef0e956024c4a27b13a5d157d0185e2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:01.662181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-360610fd-610e-4579-b6bc-5eb18d493fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:01.815915 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1274/2513] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:53:02.610688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c45bd-4f37-40c1-bc30-a399725ade6b service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:02.775332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c45bd-4f37-40c1-bc30-a399725ade6b service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:02.938439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360610fd-610e-4579-b6bc-5eb18d493fa8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:03.023766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05ee82-0f62-4297-afba-21d2c1fc5480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:03.024576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05ee82-0f62-4297-afba-21d2c1fc5480 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:03.025799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05ee82-0f62-4297-afba-21d2c1fc5480 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:03.026204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05ee82-0f62-4297-afba-21d2c1fc5480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:03.051124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05ee82-0f62-4297-afba-21d2c1fc5480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:03.056278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05ee82-0f62-4297-afba-21d2c1fc5480 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:03.083828 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1240/2514] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:03.133901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360610fd-610e-4579-b6bc-5eb18d493fa8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:03.141086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b1a1d-2e9e-4977-acdb-e9288a25c997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:03.141889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b1a1d-2e9e-4977-acdb-e9288a25c997 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:03.142278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b1a1d-2e9e-4977-acdb-e9288a25c997 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:03.142648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b1a1d-2e9e-4977-acdb-e9288a25c997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:03.330510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b1a1d-2e9e-4977-acdb-e9288a25c997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:03.332453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b1a1d-2e9e-4977-acdb-e9288a25c997 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:03.354587 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1275/2515] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:02 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:53:03.845548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05ee82-0f62-4297-afba-21d2c1fc5480 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:03.864617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05ee82-0f62-4297-afba-21d2c1fc5480 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:03.877333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945c286-f76b-4cd9-abb6-ec115bffab9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:03.877946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945c286-f76b-4cd9-abb6-ec115bffab9c service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:03.878245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945c286-f76b-4cd9-abb6-ec115bffab9c service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:03.878599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945c286-f76b-4cd9-abb6-ec115bffab9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:03.962097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:04.022718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945c286-f76b-4cd9-abb6-ec115bffab9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:04.026295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945c286-f76b-4cd9-abb6-ec115bffab9c service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:04.076181 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1241/2516] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:04.689755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b1a1d-2e9e-4977-acdb-e9288a25c997 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:04.710903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:04.774984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b1a1d-2e9e-4977-acdb-e9288a25c997 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:04.780910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:04.781756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:04.782162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:04.782539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] PATH_INFO: `/v3/users/e69b3444633b4feb8c23c06e86f20929` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:04.784340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69b3444633b4feb8c23c06e86f20929)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:04.786763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:04.899438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69b3444633b4feb8c23c06e86f20929'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:04.911413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69b3444633b4feb8c23c06e86f20929'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:04.912667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69b3444633b4feb8c23c06e86f20929'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:04.913562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69b3444633b4feb8c23c06e86f20929'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:04.931012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69b3444633b4feb8c23c06e86f20929'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:04.954291 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1276/2517] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:04 2022] DELETE /identity/v3/users/e69b3444633b4feb8c23c06e86f20929 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:04.958502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004e5a2-5e1e-49c4-af6d-6c913570266a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:04.958990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004e5a2-5e1e-49c4-af6d-6c913570266a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:04.959070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004e5a2-5e1e-49c4-af6d-6c913570266a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:04.991290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5004e5a2-5e1e-49c4-af6d-6c913570266a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:04.992609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5004e5a2-5e1e-49c4-af6d-6c913570266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:05.080722 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1242/2518] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:05.092276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:05.097245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:05.203500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d4b68-b620-4b1b-bf1f-9fe546ffcddb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:05.207459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813a142-82e1-4b25-8488-e766e6b7586a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:05.208089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813a142-82e1-4b25-8488-e766e6b7586a service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:05.208491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813a142-82e1-4b25-8488-e766e6b7586a service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:05.208825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813a142-82e1-4b25-8488-e766e6b7586a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:05.221234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813a142-82e1-4b25-8488-e766e6b7586a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:05.222747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813a142-82e1-4b25-8488-e766e6b7586a service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:05.235074 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1277/2519] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:05.325151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004e5a2-5e1e-49c4-af6d-6c913570266a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:05.326674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5004e5a2-5e1e-49c4-af6d-6c913570266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:05.367576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004e5a2-5e1e-49c4-af6d-6c913570266a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:05.381100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:05.382247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:05.382920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:05.383432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] PATH_INFO: `/v3/users/4e1a8c3544d54d51b06db838e76e1d9d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:05.384863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e1a8c3544d54d51b06db838e76e1d9d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:05.387246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:05.564388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e1a8c3544d54d51b06db838e76e1d9d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:05.599096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e1a8c3544d54d51b06db838e76e1d9d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:05.600779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e1a8c3544d54d51b06db838e76e1d9d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:05.602182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e1a8c3544d54d51b06db838e76e1d9d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:05.634834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e1a8c3544d54d51b06db838e76e1d9d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:05.697323 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1243/2520] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:05 2022] DELETE /identity/v3/users/4e1a8c3544d54d51b06db838e76e1d9d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:05.704001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7579bc-f487-446b-ba4f-2de7b6dea1ce None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:05.704533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7579bc-f487-446b-ba4f-2de7b6dea1ce None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:05.704931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7579bc-f487-446b-ba4f-2de7b6dea1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:05.752609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ef7579bc-f487-446b-ba4f-2de7b6dea1ce None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:05.754123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ef7579bc-f487-446b-ba4f-2de7b6dea1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:05.806306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:05.888030 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1278/2521] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:05.932545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:05.934727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:06.084271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:06.103575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74071b-78d8-48b7-ac61-7fc1ccb2a01a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:06.115305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb970894-1fa6-4767-8b1d-181ce10dd4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:06.142223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb970894-1fa6-4767-8b1d-181ce10dd4bf service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:06.142760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb970894-1fa6-4767-8b1d-181ce10dd4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:06.143256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb970894-1fa6-4767-8b1d-181ce10dd4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:06.157913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb970894-1fa6-4767-8b1d-181ce10dd4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:06.159725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb970894-1fa6-4767-8b1d-181ce10dd4bf service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:06.174162 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1244/2522] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:06.403838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7579bc-f487-446b-ba4f-2de7b6dea1ce None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:06.406408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ef7579bc-f487-446b-ba4f-2de7b6dea1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:06.450066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7579bc-f487-446b-ba4f-2de7b6dea1ce None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:06.501514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:06.502174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:06.502450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:06.502720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] PATH_INFO: `/v3/projects/8ae60f71bc734a5d8d37eaba4078fc19` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:06.503864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae60f71bc734a5d8d37eaba4078fc19)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:06.506046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:06.596867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae60f71bc734a5d8d37eaba4078fc19', 'request_id': 'req-327e9187-ae10-4083-885a-f12251bacf26'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:06.608860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae60f71bc734a5d8d37eaba4078fc19', 'request_id': 'req-327e9187-ae10-4083-885a-f12251bacf26'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:06.617583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae60f71bc734a5d8d37eaba4078fc19', 'request_id': 'req-327e9187-ae10-4083-885a-f12251bacf26'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:06.641971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] The token cache is being invalidate because project 8ae60f71bc734a5d8d37eaba4078fc19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:06.642817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:06.643809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:06.648981 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1279/2523] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:06 2022] DELETE /identity/v3/projects/8ae60f71bc734a5d8d37eaba4078fc19 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:06.650414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb970894-1fa6-4767-8b1d-181ce10dd4bf service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:06.666552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb970894-1fa6-4767-8b1d-181ce10dd4bf service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:06.767509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:06.768377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:06.768776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:06.769057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] PATH_INFO: `/v3/users/7dbc0efe76b3478380bde3a2c217da73` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:06.771331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dbc0efe76b3478380bde3a2c217da73)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:06.773516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:06.834232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dbc0efe76b3478380bde3a2c217da73'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:06.844254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dbc0efe76b3478380bde3a2c217da73'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:06.845072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dbc0efe76b3478380bde3a2c217da73'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:06.845765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dbc0efe76b3478380bde3a2c217da73'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:06.861971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dbc0efe76b3478380bde3a2c217da73'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:06.885683 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1245/2524] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:06 2022] DELETE /identity/v3/users/7dbc0efe76b3478380bde3a2c217da73 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:07.699675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:07.703260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:07.763344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e9187-ae10-4083-885a-f12251bacf26 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:07.843968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70caeae5-a792-4838-bec0-77635b8e05ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:07.843968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caeae5-a792-4838-bec0-77635b8e05ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:07.843968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caeae5-a792-4838-bec0-77635b8e05ab admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:07.844276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caeae5-a792-4838-bec0-77635b8e05ab admin admin] PATH_INFO: `/v3/projects/a8ceba0633a540e484287f987a2a76ee` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:07.845536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70caeae5-a792-4838-bec0-77635b8e05ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ceba0633a540e484287f987a2a76ee)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:07.849705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70caeae5-a792-4838-bec0-77635b8e05ab admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:07.928987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-70caeae5-a792-4838-bec0-77635b8e05ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ceba0633a540e484287f987a2a76ee', 'request_id': 'req-70caeae5-a792-4838-bec0-77635b8e05ab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:07.943816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-70caeae5-a792-4838-bec0-77635b8e05ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ceba0633a540e484287f987a2a76ee', 'request_id': 'req-70caeae5-a792-4838-bec0-77635b8e05ab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:07.951685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:07.953081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-70caeae5-a792-4838-bec0-77635b8e05ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ceba0633a540e484287f987a2a76ee', 'request_id': 'req-70caeae5-a792-4838-bec0-77635b8e05ab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:07.969667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-70caeae5-a792-4838-bec0-77635b8e05ab admin admin] The token cache is being invalidate because project a8ceba0633a540e484287f987a2a76ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:07.970103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-70caeae5-a792-4838-bec0-77635b8e05ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:07.970942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-70caeae5-a792-4838-bec0-77635b8e05ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:07.976670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:07.985414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:07.988060 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1280/2525] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:07 2022] DELETE /identity/v3/projects/a8ceba0633a540e484287f987a2a76ee => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:08.007200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96cf53-23b9-4d53-b5b7-edb64e933ea2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:08.116729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:08.117493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:08.117841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:08.118180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] PATH_INFO: `/v3/users/5ef0e956024c4a27b13a5d157d0185e2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:08.121220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef0e956024c4a27b13a5d157d0185e2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:08.122904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:08.129320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:08.182839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef0e956024c4a27b13a5d157d0185e2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:08.197980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef0e956024c4a27b13a5d157d0185e2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:08.198780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef0e956024c4a27b13a5d157d0185e2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:08.199465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef0e956024c4a27b13a5d157d0185e2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:08.218234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef0e956024c4a27b13a5d157d0185e2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:08.248468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3296-b212-40f5-985c-b7b2158420e6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:08.248872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3296-b212-40f5-985c-b7b2158420e6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:08.249116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3296-b212-40f5-985c-b7b2158420e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:08.252128 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1246/2526] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:07 2022] DELETE /identity/v3/users/5ef0e956024c4a27b13a5d157d0185e2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:08.270920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a19b3296-b212-40f5-985c-b7b2158420e6 None None] MFA Rules not processed for user `98936da9b5d94165b386d2d0893ac142`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:08.272269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a19b3296-b212-40f5-985c-b7b2158420e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:08.366574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:08.367784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:08.413866 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1281/2527] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:08.415273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3296-b212-40f5-985c-b7b2158420e6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:08.417962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a19b3296-b212-40f5-985c-b7b2158420e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:08.544216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604b05a-b449-4894-8b8c-a289f9e037a1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:08.579615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:08.580878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:08.581502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:08.583313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8 admin admin] PATH_INFO: `/v3/projects/5c949a6d8b88422381df2d64a4d41fe3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:08.588854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c949a6d8b88422381df2d64a4d41fe3)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:08.591764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:08.606806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3296-b212-40f5-985c-b7b2158420e6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:08.622174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383e210-c991-49b5-b58a-8cce872a7396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:08.623158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383e210-c991-49b5-b58a-8cce872a7396 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:08.623615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383e210-c991-49b5-b58a-8cce872a7396 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:08.624302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383e210-c991-49b5-b58a-8cce872a7396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:08.627264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a383e210-c991-49b5-b58a-8cce872a7396 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:08.678328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c949a6d8b88422381df2d64a4d41fe3', 'request_id': 'req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:08.692520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c949a6d8b88422381df2d64a4d41fe3', 'request_id': 'req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:08.708632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c949a6d8b88422381df2d64a4d41fe3', 'request_id': 'req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:08.752362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8 admin admin] The token cache is being invalidate because project 5c949a6d8b88422381df2d64a4d41fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:08.752642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:08.753429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ba7106cf-d9e6-4a96-ac19-39c8a2e6eed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:08.757271 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1247/2528] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:08 2022] DELETE /identity/v3/projects/5c949a6d8b88422381df2d64a4d41fe3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:08.760875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1283-5a87-4510-afc8-d49ee9671533 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:08.761353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1283-5a87-4510-afc8-d49ee9671533 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:08.761594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1283-5a87-4510-afc8-d49ee9671533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:08.782831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383e210-c991-49b5-b58a-8cce872a7396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:08.784510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383e210-c991-49b5-b58a-8cce872a7396 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:08.802446 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1282/2529] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:08.816401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-83ef1283-5a87-4510-afc8-d49ee9671533 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:08.820258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-83ef1283-5a87-4510-afc8-d49ee9671533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:08.855413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:08.957258 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1248/2530] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:53:08.966350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a50fe-bdb1-478f-913b-125e61a6ca8b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:08.967083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a50fe-bdb1-478f-913b-125e61a6ca8b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:08.967615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a50fe-bdb1-478f-913b-125e61a6ca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:08.979886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1283-5a87-4510-afc8-d49ee9671533 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:08.981364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-83ef1283-5a87-4510-afc8-d49ee9671533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:08.994920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1283-5a87-4510-afc8-d49ee9671533 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:09.008348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e7b7e-ab54-4fcb-a135-7d2367e9418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:09.009076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e7b7e-ab54-4fcb-a135-7d2367e9418b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.009455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e7b7e-ab54-4fcb-a135-7d2367e9418b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.009750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e7b7e-ab54-4fcb-a135-7d2367e9418b admin admin] PATH_INFO: `/v3/projects/af7873519be44aa0a7f7e15dec05bcb4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.011324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e7b7e-ab54-4fcb-a135-7d2367e9418b admin admin] RBAC: Authorizing `identity:delete_project(project_id=af7873519be44aa0a7f7e15dec05bcb4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:09.013337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e7b7e-ab54-4fcb-a135-7d2367e9418b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:09.042710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-713a50fe-bdb1-478f-913b-125e61a6ca8b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:09.047617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-713a50fe-bdb1-478f-913b-125e61a6ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:09.064173 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1283/2531] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:09.066503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a50fe-bdb1-478f-913b-125e61a6ca8b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:09.077229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a50fe-bdb1-478f-913b-125e61a6ca8b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:09.082296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-271e7b7e-ab54-4fcb-a135-7d2367e9418b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7873519be44aa0a7f7e15dec05bcb4', 'request_id': 'req-271e7b7e-ab54-4fcb-a135-7d2367e9418b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:09.092720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-271e7b7e-ab54-4fcb-a135-7d2367e9418b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7873519be44aa0a7f7e15dec05bcb4', 'request_id': 'req-271e7b7e-ab54-4fcb-a135-7d2367e9418b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:09.106119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-271e7b7e-ab54-4fcb-a135-7d2367e9418b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7873519be44aa0a7f7e15dec05bcb4', 'request_id': 'req-271e7b7e-ab54-4fcb-a135-7d2367e9418b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:09.118223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:09.132561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-271e7b7e-ab54-4fcb-a135-7d2367e9418b admin admin] The token cache is being invalidate because project af7873519be44aa0a7f7e15dec05bcb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:09.132791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-271e7b7e-ab54-4fcb-a135-7d2367e9418b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:09.133976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-271e7b7e-ab54-4fcb-a135-7d2367e9418b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:09.138948 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1249/2532] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:08 2022] DELETE /identity/v3/projects/af7873519be44aa0a7f7e15dec05bcb4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:09.144231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990dc32-bcf1-46ac-a197-e6833f47a9ae None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.144667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990dc32-bcf1-46ac-a197-e6833f47a9ae None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.145053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990dc32-bcf1-46ac-a197-e6833f47a9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.168625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2990dc32-bcf1-46ac-a197-e6833f47a9ae None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:09.170095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2990dc32-bcf1-46ac-a197-e6833f47a9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:09.210690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce65e18-e163-45a8-a9c5-cc3d052f5a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:09.210690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce65e18-e163-45a8-a9c5-cc3d052f5a99 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.210690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce65e18-e163-45a8-a9c5-cc3d052f5a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.211454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce65e18-e163-45a8-a9c5-cc3d052f5a99 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.212124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce65e18-e163-45a8-a9c5-cc3d052f5a99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:53:09.213284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce65e18-e163-45a8-a9c5-cc3d052f5a99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:09.215282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce65e18-e163-45a8-a9c5-cc3d052f5a99 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:09.235059 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1284/2533] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:53:09.240059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce65e18-e163-45a8-a9c5-cc3d052f5a99 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:09.242025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4ce65e18-e163-45a8-a9c5-cc3d052f5a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:09.251063 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1250/2534] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:53:09.252675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048fa35-2b1b-4842-9b5a-7480ee22e33f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.253292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048fa35-2b1b-4842-9b5a-7480ee22e33f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.253756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048fa35-2b1b-4842-9b5a-7480ee22e33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.262531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce65e18-e163-45a8-a9c5-cc3d052f5a99 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:09.267526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb62907-0b33-4dac-b2f9-4c5f77802a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:09.268312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb62907-0b33-4dac-b2f9-4c5f77802a77 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.268851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb62907-0b33-4dac-b2f9-4c5f77802a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.269312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb62907-0b33-4dac-b2f9-4c5f77802a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.270086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb62907-0b33-4dac-b2f9-4c5f77802a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:09.272465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb62907-0b33-4dac-b2f9-4c5f77802a77 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:09.275845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b048fa35-2b1b-4842-9b5a-7480ee22e33f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:09.277143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b048fa35-2b1b-4842-9b5a-7480ee22e33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:09.289421 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1251/2535] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:09.291209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048fa35-2b1b-4842-9b5a-7480ee22e33f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:09.302731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048fa35-2b1b-4842-9b5a-7480ee22e33f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:09.309800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b37296-e837-4079-8e05-74a3800ead54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:09.310421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b37296-e837-4079-8e05-74a3800ead54 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.310723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b37296-e837-4079-8e05-74a3800ead54 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.311461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b37296-e837-4079-8e05-74a3800ead54 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.312132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b37296-e837-4079-8e05-74a3800ead54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:53:09.313114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b37296-e837-4079-8e05-74a3800ead54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:09.314846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b37296-e837-4079-8e05-74a3800ead54 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:09.326296 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1285/2536] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:09 2022] POST /identity/v3/projects => generated 397 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:53:09.327360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb62907-0b33-4dac-b2f9-4c5f77802a77 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:09.331804 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1252/2537] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:53:09.336069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b37296-e837-4079-8e05-74a3800ead54 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:09.347884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b37296-e837-4079-8e05-74a3800ead54 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:09.364320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:09.419343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb62907-0b33-4dac-b2f9-4c5f77802a77 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:09.430557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0de05-c396-4467-a446-fc687cc714b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:09.431190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0de05-c396-4467-a446-fc687cc714b5 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.431474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0de05-c396-4467-a446-fc687cc714b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.431751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0de05-c396-4467-a446-fc687cc714b5 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.432389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0de05-c396-4467-a446-fc687cc714b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:09.434354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0de05-c396-4467-a446-fc687cc714b5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:09.437289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d841a-5a9a-4949-ab67-af5809c97690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:09.438170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d841a-5a9a-4949-ab67-af5809c97690 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.438655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d841a-5a9a-4949-ab67-af5809c97690 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.439145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d841a-5a9a-4949-ab67-af5809c97690 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.439993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d841a-5a9a-4949-ab67-af5809c97690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:09.442127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d841a-5a9a-4949-ab67-af5809c97690 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:09.461821 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1286/2538] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:09 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:09.465655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0de05-c396-4467-a446-fc687cc714b5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:09.481341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0de05-c396-4467-a446-fc687cc714b5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:09.484970 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1253/2539] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:09 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:53:09.489449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d841a-5a9a-4949-ab67-af5809c97690 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:09.503031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e0838-e14e-498d-b1ed-95fae81c8102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:09.503849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0838-e14e-498d-b1ed-95fae81c8102 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.504144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0838-e14e-498d-b1ed-95fae81c8102 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.504422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0838-e14e-498d-b1ed-95fae81c8102 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.505118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e0838-e14e-498d-b1ed-95fae81c8102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:09.506813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e0838-e14e-498d-b1ed-95fae81c8102 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:09.518213 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1287/2540] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:53:09.522209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e0838-e14e-498d-b1ed-95fae81c8102 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:09.547113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e0838-e14e-498d-b1ed-95fae81c8102 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:09.617716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d841a-5a9a-4949-ab67-af5809c97690 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:09.625824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52ce18-c566-40f5-9fba-0562071ee423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:09.626928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52ce18-c566-40f5-9fba-0562071ee423 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.627496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52ce18-c566-40f5-9fba-0562071ee423 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.627917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52ce18-c566-40f5-9fba-0562071ee423 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.628684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52ce18-c566-40f5-9fba-0562071ee423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:09.631207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52ce18-c566-40f5-9fba-0562071ee423 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:09.633365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fceed4-72a9-47b9-a27e-f517cb0d8da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:09.634223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fceed4-72a9-47b9-a27e-f517cb0d8da6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.634778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fceed4-72a9-47b9-a27e-f517cb0d8da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.635241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fceed4-72a9-47b9-a27e-f517cb0d8da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.636065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fceed4-72a9-47b9-a27e-f517cb0d8da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:09.637906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fceed4-72a9-47b9-a27e-f517cb0d8da6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:09.653093 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1288/2541] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:53:09.658994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fceed4-72a9-47b9-a27e-f517cb0d8da6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:09.674358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fceed4-72a9-47b9-a27e-f517cb0d8da6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:09.677960 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1254/2542] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:09 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:09.681120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52ce18-c566-40f5-9fba-0562071ee423 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:09.684288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d949ea-f657-4938-b3a4-c34613348ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:09.685718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d949ea-f657-4938-b3a4-c34613348ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.686079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d949ea-f657-4938-b3a4-c34613348ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.686787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d949ea-f657-4938-b3a4-c34613348ff6 admin admin] PATH_INFO: `/v3/projects/ac5c7906a4714a1887cb823e1c3a6056/users/d54b1c5c00544be4b60132d09817c8d6/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.691734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:09.727053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52ce18-c566-40f5-9fba-0562071ee423 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:09.730493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d949ea-f657-4938-b3a4-c34613348ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5c7906a4714a1887cb823e1c3a6056, user_id=d54b1c5c00544be4b60132d09817c8d6, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:09.733623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d949ea-f657-4938-b3a4-c34613348ff6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:09.738577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1844-271e-44d9-a842-94da56366d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:09.739460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1844-271e-44d9-a842-94da56366d9a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.739841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1844-271e-44d9-a842-94da56366d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.740132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1844-271e-44d9-a842-94da56366d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.740895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb1844-271e-44d9-a842-94da56366d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:09.742919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb1844-271e-44d9-a842-94da56366d9a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:09.754034 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1289/2543] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:09 2022] PUT /identity/v3/projects/ac5c7906a4714a1887cb823e1c3a6056/users/d54b1c5c00544be4b60132d09817c8d6/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:09.759176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aeca8-6913-4dc4-bd29-58ae6919b8ee None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.759780 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1255/2544] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:09.761418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aeca8-6913-4dc4-bd29-58ae6919b8ee None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.761799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aeca8-6913-4dc4-bd29-58ae6919b8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.766155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1844-271e-44d9-a842-94da56366d9a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:09.781962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1844-271e-44d9-a842-94da56366d9a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:09.805420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e54aeca8-6913-4dc4-bd29-58ae6919b8ee None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:09.809317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e54aeca8-6913-4dc4-bd29-58ae6919b8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:09.883878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39a620-e5f2-4acd-9ce2-0d39707c3391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:09.903341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39a620-e5f2-4acd-9ce2-0d39707c3391 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.906046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39a620-e5f2-4acd-9ce2-0d39707c3391 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.906337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39a620-e5f2-4acd-9ce2-0d39707c3391 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:09.909136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39a620-e5f2-4acd-9ce2-0d39707c3391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:09.915733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39a620-e5f2-4acd-9ce2-0d39707c3391 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:09.927045 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1290/2545] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:09.946877 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1256/2546] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:09.950829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aeca8-6913-4dc4-bd29-58ae6919b8ee None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:09.962406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39a620-e5f2-4acd-9ce2-0d39707c3391 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:09.964250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0b39a620-e5f2-4acd-9ce2-0d39707c3391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:09.966664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aeca8-6913-4dc4-bd29-58ae6919b8ee None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:09.974655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd1795-7946-40a6-907f-0cc1b8931284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:09.974655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd1795-7946-40a6-907f-0cc1b8931284 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:09.974655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd1795-7946-40a6-907f-0cc1b8931284 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:09.974655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd1795-7946-40a6-907f-0cc1b8931284 admin admin] PATH_INFO: `/v3/projects/9629555b92094b109e7262b2414603b1/users/f5d1e95d8eb94ddb81dcceb128b2c544/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:10.006265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd1795-7946-40a6-907f-0cc1b8931284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9629555b92094b109e7262b2414603b1, user_id=f5d1e95d8eb94ddb81dcceb128b2c544, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:10.009005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd1795-7946-40a6-907f-0cc1b8931284 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:10.041938 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1291/2547] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:09 2022] PUT /identity/v3/projects/9629555b92094b109e7262b2414603b1/users/f5d1e95d8eb94ddb81dcceb128b2c544/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:10.045117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:10.060454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13dd19-5ec8-4015-a5f9-ac486151a24b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:10.060745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13dd19-5ec8-4015-a5f9-ac486151a24b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:10.061095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13dd19-5ec8-4015-a5f9-ac486151a24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:10.121083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8b13dd19-5ec8-4015-a5f9-ac486151a24b None None] MFA Rules not processed for user `f5d1e95d8eb94ddb81dcceb128b2c544`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:10.122143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39a620-e5f2-4acd-9ce2-0d39707c3391 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:10.122687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8b13dd19-5ec8-4015-a5f9-ac486151a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:10.203531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8755fa-a85e-4043-8cc6-8f8e3eddc82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:10.205152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8755fa-a85e-4043-8cc6-8f8e3eddc82c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:10.205670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8755fa-a85e-4043-8cc6-8f8e3eddc82c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:10.208139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8755fa-a85e-4043-8cc6-8f8e3eddc82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:10.262421 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1292/2548] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:53:10.267914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13dd19-5ec8-4015-a5f9-ac486151a24b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:10.345685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8755fa-a85e-4043-8cc6-8f8e3eddc82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:10.349250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8755fa-a85e-4043-8cc6-8f8e3eddc82c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:10.364730 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1257/2549] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:10.392763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:10.423740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13dd19-5ec8-4015-a5f9-ac486151a24b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:10.435552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ba30e-1920-4e31-9a48-750a2b0bc6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:10.438642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba30e-1920-4e31-9a48-750a2b0bc6cd admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:10.438642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba30e-1920-4e31-9a48-750a2b0bc6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:10.438642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba30e-1920-4e31-9a48-750a2b0bc6cd admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:10.438642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ba30e-1920-4e31-9a48-750a2b0bc6cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:10.440606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ba30e-1920-4e31-9a48-750a2b0bc6cd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:10.479486 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1293/2550] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:10 2022] POST /identity/v3/projects => generated 375 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:53:10.481038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8755fa-a85e-4043-8cc6-8f8e3eddc82c service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:10.492848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8755fa-a85e-4043-8cc6-8f8e3eddc82c service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:10.560135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14b913-5889-4270-9607-6fb61d9ff4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:10.560716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b913-5889-4270-9607-6fb61d9ff4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:10.561091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b913-5889-4270-9607-6fb61d9ff4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:10.561969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b913-5889-4270-9607-6fb61d9ff4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:10.562873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14b913-5889-4270-9607-6fb61d9ff4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:10.566899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14b913-5889-4270-9607-6fb61d9ff4e2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:10.597388 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1258/2551] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:10 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:10.601410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ba30e-1920-4e31-9a48-750a2b0bc6cd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:10.615499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ba30e-1920-4e31-9a48-750a2b0bc6cd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:10.622273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9eac6-67fa-4c33-92c1-16576962cdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:10.624635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9eac6-67fa-4c33-92c1-16576962cdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:10.624635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9eac6-67fa-4c33-92c1-16576962cdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:10.625085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9eac6-67fa-4c33-92c1-16576962cdd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:10.626565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9eac6-67fa-4c33-92c1-16576962cdd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:10.628664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9eac6-67fa-4c33-92c1-16576962cdd3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:10.660073 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1294/2552] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:10.660497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14b913-5889-4270-9607-6fb61d9ff4e2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:10.675215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14b913-5889-4270-9607-6fb61d9ff4e2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:10.683438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae0087-2cd9-47c8-bcce-2beb823220c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:10.684217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae0087-2cd9-47c8-bcce-2beb823220c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:10.684899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae0087-2cd9-47c8-bcce-2beb823220c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:10.684899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae0087-2cd9-47c8-bcce-2beb823220c0 admin admin] PATH_INFO: `/v3/projects/ed79d4f8cdaf4ae9a8d43388882b9d4d/users/7f7297f1533c48d99cbb2233039a1bb1/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:10.704085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:10.718178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae0087-2cd9-47c8-bcce-2beb823220c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed79d4f8cdaf4ae9a8d43388882b9d4d, user_id=7f7297f1533c48d99cbb2233039a1bb1, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:10.729209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae0087-2cd9-47c8-bcce-2beb823220c0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:10.765826 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1259/2553] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:10 2022] PUT /identity/v3/projects/ed79d4f8cdaf4ae9a8d43388882b9d4d/users/7f7297f1533c48d99cbb2233039a1bb1/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:10.767226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9eac6-67fa-4c33-92c1-16576962cdd3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:10.783651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9eac6-67fa-4c33-92c1-16576962cdd3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:10.885594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dcd34-cd75-40ba-b88a-80efbd03f854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:10.886245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dcd34-cd75-40ba-b88a-80efbd03f854 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:10.886631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dcd34-cd75-40ba-b88a-80efbd03f854 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:10.886973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dcd34-cd75-40ba-b88a-80efbd03f854 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:10.888076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dcd34-cd75-40ba-b88a-80efbd03f854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:10.891065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dcd34-cd75-40ba-b88a-80efbd03f854 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:10.900953 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1295/2554] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:53:10.905698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae0087-2cd9-47c8-bcce-2beb823220c0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:10.916578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae0087-2cd9-47c8-bcce-2beb823220c0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:10.922895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43975086-a7a4-4cdf-aa76-f8e9404e9b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:10.923846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43975086-a7a4-4cdf-aa76-f8e9404e9b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:10.924099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43975086-a7a4-4cdf-aa76-f8e9404e9b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:10.924438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43975086-a7a4-4cdf-aa76-f8e9404e9b3a admin admin] PATH_INFO: `/v3/projects/ed79d4f8cdaf4ae9a8d43388882b9d4d/users/7f7297f1533c48d99cbb2233039a1bb1/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:10.926481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43975086-a7a4-4cdf-aa76-f8e9404e9b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed79d4f8cdaf4ae9a8d43388882b9d4d, user_id=7f7297f1533c48d99cbb2233039a1bb1, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:10.929302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43975086-a7a4-4cdf-aa76-f8e9404e9b3a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:10.940704 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1260/2555] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:10 2022] PUT /identity/v3/projects/ed79d4f8cdaf4ae9a8d43388882b9d4d/users/7f7297f1533c48d99cbb2233039a1bb1/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:10.951161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bb244-91a7-4f22-8d42-5c4354022995 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:10.951463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bb244-91a7-4f22-8d42-5c4354022995 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:10.951796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bb244-91a7-4f22-8d42-5c4354022995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:10.985510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-292bb244-91a7-4f22-8d42-5c4354022995 None None] MFA Rules not processed for user `7f7297f1533c48d99cbb2233039a1bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:10.987402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-292bb244-91a7-4f22-8d42-5c4354022995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:11.083871 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1296/2556] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:53:11.095731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43975086-a7a4-4cdf-aa76-f8e9404e9b3a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:11.101401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-43975086-a7a4-4cdf-aa76-f8e9404e9b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:11.239697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43975086-a7a4-4cdf-aa76-f8e9404e9b3a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:11.248104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f60a84-9bfc-4691-8497-488c22753c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:11.249363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f60a84-9bfc-4691-8497-488c22753c84 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:11.249363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f60a84-9bfc-4691-8497-488c22753c84 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:11.249618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f60a84-9bfc-4691-8497-488c22753c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:11.260638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f60a84-9bfc-4691-8497-488c22753c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:11.262639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f60a84-9bfc-4691-8497-488c22753c84 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:11.282943 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1261/2557] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:11.335066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bb244-91a7-4f22-8d42-5c4354022995 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:11.337325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-292bb244-91a7-4f22-8d42-5c4354022995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:11.359718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bb244-91a7-4f22-8d42-5c4354022995 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:11.369818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a994b41-da80-4516-a315-8823edcc9e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:11.372810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a994b41-da80-4516-a315-8823edcc9e36 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:11.374859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a994b41-da80-4516-a315-8823edcc9e36 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:11.375141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a994b41-da80-4516-a315-8823edcc9e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:11.458817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:11.477928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a994b41-da80-4516-a315-8823edcc9e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:11.479561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a994b41-da80-4516-a315-8823edcc9e36 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:11.492270 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1297/2558] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:12.369044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f60a84-9bfc-4691-8497-488c22753c84 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:12.460892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f60a84-9bfc-4691-8497-488c22753c84 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:12.468404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:12.469576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:12.470095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:12.470812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] PATH_INFO: `/v3/users/f5d1e95d8eb94ddb81dcceb128b2c544` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:12.473471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d1e95d8eb94ddb81dcceb128b2c544)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:12.475961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:12.548641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d1e95d8eb94ddb81dcceb128b2c544'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:12.560613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d1e95d8eb94ddb81dcceb128b2c544'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:12.562052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d1e95d8eb94ddb81dcceb128b2c544'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:12.562908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d1e95d8eb94ddb81dcceb128b2c544'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:12.570062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:12.585534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d1e95d8eb94ddb81dcceb128b2c544'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:12.609999 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1262/2559] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:12 2022] DELETE /identity/v3/users/f5d1e95d8eb94ddb81dcceb128b2c544 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:12.612710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6508f6c-5908-4bd0-8da2-00d1aca310b9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:12.613683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6508f6c-5908-4bd0-8da2-00d1aca310b9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:12.614191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6508f6c-5908-4bd0-8da2-00d1aca310b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:12.642757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b6508f6c-5908-4bd0-8da2-00d1aca310b9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:12.651866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b6508f6c-5908-4bd0-8da2-00d1aca310b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:12.792307 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1298/2560] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:12.815369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:12.818573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:12.961689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03043f85-ceb3-45c9-93f9-2dbcede2de46 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:12.971170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff299a-a695-4863-8d6e-25b979e0f9ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:12.972111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff299a-a695-4863-8d6e-25b979e0f9ed service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:12.974051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff299a-a695-4863-8d6e-25b979e0f9ed service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:12.975032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff299a-a695-4863-8d6e-25b979e0f9ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:12.992999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff299a-a695-4863-8d6e-25b979e0f9ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:12.995341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff299a-a695-4863-8d6e-25b979e0f9ed service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:13.012847 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1263/2561] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:15.804863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6508f6c-5908-4bd0-8da2-00d1aca310b9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:15.806638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b6508f6c-5908-4bd0-8da2-00d1aca310b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:15.852206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6508f6c-5908-4bd0-8da2-00d1aca310b9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:15.877236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:15.880881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:15.881269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:15.881556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] PATH_INFO: `/v3/projects/9629555b92094b109e7262b2414603b1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:15.888669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9629555b92094b109e7262b2414603b1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:15.893118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:16.082729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9629555b92094b109e7262b2414603b1', 'request_id': 'req-9b2ca31f-b355-4760-8e34-4cef074a17c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:16.100723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9629555b92094b109e7262b2414603b1', 'request_id': 'req-9b2ca31f-b355-4760-8e34-4cef074a17c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:16.112360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9629555b92094b109e7262b2414603b1', 'request_id': 'req-9b2ca31f-b355-4760-8e34-4cef074a17c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:16.140870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] The token cache is being invalidate because project 9629555b92094b109e7262b2414603b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:16.141579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:16.144264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:16.147350 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1299/2562] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:15 2022] DELETE /identity/v3/projects/9629555b92094b109e7262b2414603b1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:16.151559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff299a-a695-4863-8d6e-25b979e0f9ed service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:16.169682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff299a-a695-4863-8d6e-25b979e0f9ed service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:16.274791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:16.275956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:16.276578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:16.277120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] PATH_INFO: `/v3/users/7f7297f1533c48d99cbb2233039a1bb1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:16.278613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7297f1533c48d99cbb2233039a1bb1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:16.282429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:16.405610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7297f1533c48d99cbb2233039a1bb1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:16.427632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7297f1533c48d99cbb2233039a1bb1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:16.428626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7297f1533c48d99cbb2233039a1bb1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:16.429466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7297f1533c48d99cbb2233039a1bb1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:16.464806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7297f1533c48d99cbb2233039a1bb1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:16.495462 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1264/2563] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:16 2022] DELETE /identity/v3/users/7f7297f1533c48d99cbb2233039a1bb1 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:17.292574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:17.294077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:17.320236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ca31f-b355-4760-8e34-4cef074a17c4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:17.500296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea342f-3334-4c0a-9f46-1da01e9329ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:17.500296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea342f-3334-4c0a-9f46-1da01e9329ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:17.500296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea342f-3334-4c0a-9f46-1da01e9329ec admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:17.500720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea342f-3334-4c0a-9f46-1da01e9329ec admin admin] PATH_INFO: `/v3/users/bd637d2fa21649a1b00f27e7d86f3003` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:17.524736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea342f-3334-4c0a-9f46-1da01e9329ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd637d2fa21649a1b00f27e7d86f3003)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:17.526950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea342f-3334-4c0a-9f46-1da01e9329ec admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:17.564273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:17.570000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:17.571445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:17.583854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:17.621289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b721c-8ff4-43c3-b376-83994b8ec87d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:17.642182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ee437-09fd-473a-a7bf-f94bee8faed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:17.642851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ee437-09fd-473a-a7bf-f94bee8faed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:17.643135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ee437-09fd-473a-a7bf-f94bee8faed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:17.643412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ee437-09fd-473a-a7bf-f94bee8faed0 admin admin] PATH_INFO: `/v3/projects/ed79d4f8cdaf4ae9a8d43388882b9d4d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:17.644580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ee437-09fd-473a-a7bf-f94bee8faed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed79d4f8cdaf4ae9a8d43388882b9d4d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:17.646662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ee437-09fd-473a-a7bf-f94bee8faed0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:17.648485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-daea342f-3334-4c0a-9f46-1da01e9329ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd637d2fa21649a1b00f27e7d86f3003'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:17.669367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-daea342f-3334-4c0a-9f46-1da01e9329ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd637d2fa21649a1b00f27e7d86f3003'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:17.671324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-daea342f-3334-4c0a-9f46-1da01e9329ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd637d2fa21649a1b00f27e7d86f3003'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:17.671872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-daea342f-3334-4c0a-9f46-1da01e9329ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd637d2fa21649a1b00f27e7d86f3003'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:17.708649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-daea342f-3334-4c0a-9f46-1da01e9329ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd637d2fa21649a1b00f27e7d86f3003'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:17.735602 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1300/2564] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:17 2022] DELETE /identity/v3/users/bd637d2fa21649a1b00f27e7d86f3003 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:17.741495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653c73a-a8c6-4ae2-a16c-816ad4089683 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:17.741925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653c73a-a8c6-4ae2-a16c-816ad4089683 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:17.742310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653c73a-a8c6-4ae2-a16c-816ad4089683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:17.759408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-601ee437-09fd-473a-a7bf-f94bee8faed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed79d4f8cdaf4ae9a8d43388882b9d4d', 'request_id': 'req-601ee437-09fd-473a-a7bf-f94bee8faed0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:17.767408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5653c73a-a8c6-4ae2-a16c-816ad4089683 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:17.769336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5653c73a-a8c6-4ae2-a16c-816ad4089683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:17.774726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-601ee437-09fd-473a-a7bf-f94bee8faed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed79d4f8cdaf4ae9a8d43388882b9d4d', 'request_id': 'req-601ee437-09fd-473a-a7bf-f94bee8faed0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:17.809693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-601ee437-09fd-473a-a7bf-f94bee8faed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed79d4f8cdaf4ae9a8d43388882b9d4d', 'request_id': 'req-601ee437-09fd-473a-a7bf-f94bee8faed0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:17.845017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-601ee437-09fd-473a-a7bf-f94bee8faed0 admin admin] The token cache is being invalidate because project ed79d4f8cdaf4ae9a8d43388882b9d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:17.847490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-601ee437-09fd-473a-a7bf-f94bee8faed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:17.850831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-601ee437-09fd-473a-a7bf-f94bee8faed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:17.858181 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1265/2565] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:17 2022] DELETE /identity/v3/projects/ed79d4f8cdaf4ae9a8d43388882b9d4d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:17.860671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29983a-7cec-4efd-9506-7868241e9e54 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:17.861487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29983a-7cec-4efd-9506-7868241e9e54 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:17.861608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29983a-7cec-4efd-9506-7868241e9e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:17.905706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-aa29983a-7cec-4efd-9506-7868241e9e54 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:17.910257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-aa29983a-7cec-4efd-9506-7868241e9e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:17.912760 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1301/2566] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:17.947493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653c73a-a8c6-4ae2-a16c-816ad4089683 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:17.949423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5653c73a-a8c6-4ae2-a16c-816ad4089683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:17.954687 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1266/2567] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:17.964324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd6ac0-78fd-41c5-87f5-8173cb1aad88 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:17.965067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd6ac0-78fd-41c5-87f5-8173cb1aad88 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:17.965582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd6ac0-78fd-41c5-87f5-8173cb1aad88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:18.018315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6bfd6ac0-78fd-41c5-87f5-8173cb1aad88 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:18.019640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6bfd6ac0-78fd-41c5-87f5-8173cb1aad88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:18.036568 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1267/2568] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:53:18.038461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd6ac0-78fd-41c5-87f5-8173cb1aad88 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:18.048665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd6ac0-78fd-41c5-87f5-8173cb1aad88 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:18.055807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f8283-4191-4793-b014-c4a588803652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:18.056430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f8283-4191-4793-b014-c4a588803652 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:18.056708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f8283-4191-4793-b014-c4a588803652 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:18.056975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f8283-4191-4793-b014-c4a588803652 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:18.057836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f8283-4191-4793-b014-c4a588803652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:53:18.058144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f8283-4191-4793-b014-c4a588803652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:18.064230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f8283-4191-4793-b014-c4a588803652 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:18.082484 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1268/2569] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:53:18.084980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f8283-4191-4793-b014-c4a588803652 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:18.098636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653c73a-a8c6-4ae2-a16c-816ad4089683 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:18.099124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f8283-4191-4793-b014-c4a588803652 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:18.103108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6480d8-2014-4e01-a966-1e8dbc2eb441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:18.103997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd815411-f245-47a5-bae3-01f720af54cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:18.104578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815411-f245-47a5-bae3-01f720af54cb admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:18.104894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815411-f245-47a5-bae3-01f720af54cb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:18.105049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6480d8-2014-4e01-a966-1e8dbc2eb441 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:18.105162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815411-f245-47a5-bae3-01f720af54cb admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:18.105668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6480d8-2014-4e01-a966-1e8dbc2eb441 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:18.105822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd815411-f245-47a5-bae3-01f720af54cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:18.106231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6480d8-2014-4e01-a966-1e8dbc2eb441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:18.107963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd815411-f245-47a5-bae3-01f720af54cb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:18.126074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6480d8-2014-4e01-a966-1e8dbc2eb441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:18.128617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6480d8-2014-4e01-a966-1e8dbc2eb441 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:18.144243 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1269/2570] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:18 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:18.145926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd815411-f245-47a5-bae3-01f720af54cb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:18.146651 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1302/2571] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:53:18.230554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd815411-f245-47a5-bae3-01f720af54cb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:18.241559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b83f5-9785-4a8d-9e75-c0154d72675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:18.245248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b83f5-9785-4a8d-9e75-c0154d72675f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:18.245754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b83f5-9785-4a8d-9e75-c0154d72675f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:18.246189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b83f5-9785-4a8d-9e75-c0154d72675f admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:18.247688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b83f5-9785-4a8d-9e75-c0154d72675f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:18.250693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b83f5-9785-4a8d-9e75-c0154d72675f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:18.280833 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1270/2572] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:18 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:18.284891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6480d8-2014-4e01-a966-1e8dbc2eb441 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:18.297854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6480d8-2014-4e01-a966-1e8dbc2eb441 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:18.317530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa0d93-b9e8-42b6-a7d9-17f4d52a7417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:18.317530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa0d93-b9e8-42b6-a7d9-17f4d52a7417 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:18.317530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa0d93-b9e8-42b6-a7d9-17f4d52a7417 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:18.317530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa0d93-b9e8-42b6-a7d9-17f4d52a7417 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:18.318148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa0d93-b9e8-42b6-a7d9-17f4d52a7417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:18.318238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa0d93-b9e8-42b6-a7d9-17f4d52a7417 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:18.341921 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1303/2573] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:18.343841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b83f5-9785-4a8d-9e75-c0154d72675f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:18.360883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b83f5-9785-4a8d-9e75-c0154d72675f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:18.376414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6be144-0db2-42b8-acf0-708bd180a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:18.377796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6be144-0db2-42b8-acf0-708bd180a9ff admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:18.378181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6be144-0db2-42b8-acf0-708bd180a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:18.379061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6be144-0db2-42b8-acf0-708bd180a9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:18.379180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6be144-0db2-42b8-acf0-708bd180a9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:18.380755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6be144-0db2-42b8-acf0-708bd180a9ff admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:18.409426 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1271/2574] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:18.411122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa0d93-b9e8-42b6-a7d9-17f4d52a7417 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:18.431726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa0d93-b9e8-42b6-a7d9-17f4d52a7417 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:18.447582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee712a-54da-4065-a85c-7e9be966ac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:18.448277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee712a-54da-4065-a85c-7e9be966ac99 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:18.448560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee712a-54da-4065-a85c-7e9be966ac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:18.448840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee712a-54da-4065-a85c-7e9be966ac99 admin admin] PATH_INFO: `/v3/projects/d2b884c2900a4c33996ab03dd7228508/users/6698c33836c648e39c8baeb65470aba3/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:18.504520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee712a-54da-4065-a85c-7e9be966ac99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b884c2900a4c33996ab03dd7228508, user_id=6698c33836c648e39c8baeb65470aba3, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:18.507486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee712a-54da-4065-a85c-7e9be966ac99 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:18.516742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:18.537768 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1304/2575] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:18 2022] PUT /identity/v3/projects/d2b884c2900a4c33996ab03dd7228508/users/6698c33836c648e39c8baeb65470aba3/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:18.550286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d173e9-b876-491a-8831-fc03a7b17abf None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:18.550826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d173e9-b876-491a-8831-fc03a7b17abf None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:18.551262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d173e9-b876-491a-8831-fc03a7b17abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:18.599022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-08d173e9-b876-491a-8831-fc03a7b17abf None None] MFA Rules not processed for user `6698c33836c648e39c8baeb65470aba3`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:18.600517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-08d173e9-b876-491a-8831-fc03a7b17abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:18.608691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:18.690497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee712a-54da-4065-a85c-7e9be966ac99 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:18.690497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-59ee712a-54da-4065-a85c-7e9be966ac99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:18.800422 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1272/2576] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:18.804549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d173e9-b876-491a-8831-fc03a7b17abf None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:18.882907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee712a-54da-4065-a85c-7e9be966ac99 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:18.891057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:18.891713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:18.892019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:18.892271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] PATH_INFO: `/v3/projects/1d547f95cc6043b0bb9b6a94b2e354a5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:18.893610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d547f95cc6043b0bb9b6a94b2e354a5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:18.895550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:18.964420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d173e9-b876-491a-8831-fc03a7b17abf None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:18.990378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d251ab7-3474-43bb-b1e5-3b7ad12fca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:18.991984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d251ab7-3474-43bb-b1e5-3b7ad12fca59 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:18.992684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d251ab7-3474-43bb-b1e5-3b7ad12fca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:18.994666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d251ab7-3474-43bb-b1e5-3b7ad12fca59 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:18.996968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d251ab7-3474-43bb-b1e5-3b7ad12fca59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:19.002581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d251ab7-3474-43bb-b1e5-3b7ad12fca59 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:19.023010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d547f95cc6043b0bb9b6a94b2e354a5', 'request_id': 'req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:19.039157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d547f95cc6043b0bb9b6a94b2e354a5', 'request_id': 'req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:19.057057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d547f95cc6043b0bb9b6a94b2e354a5', 'request_id': 'req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:19.065593 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1273/2577] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:18 2022] POST /identity/v3/projects => generated 393 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:19.068991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d251ab7-3474-43bb-b1e5-3b7ad12fca59 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:19.077433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] The token cache is being invalidate because project 1d547f95cc6043b0bb9b6a94b2e354a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:19.078008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:19.079062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:19.081270 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1305/2578] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:18 2022] DELETE /identity/v3/projects/1d547f95cc6043b0bb9b6a94b2e354a5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:19.097230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:19.101455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:19.168757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d251ab7-3474-43bb-b1e5-3b7ad12fca59 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:19.178219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652b201-f123-4b14-9e9b-65349b02cbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:19.179512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652b201-f123-4b14-9e9b-65349b02cbaa admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:19.180024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652b201-f123-4b14-9e9b-65349b02cbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:19.180323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652b201-f123-4b14-9e9b-65349b02cbaa admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:19.180974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652b201-f123-4b14-9e9b-65349b02cbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:19.183380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652b201-f123-4b14-9e9b-65349b02cbaa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:19.183924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e62e8-30c2-4737-87e8-0d8d26a9bdc5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:19.192136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c3d28-7310-42eb-b2f4-e327e638924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:19.192542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c3d28-7310-42eb-b2f4-e327e638924c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:19.192940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c3d28-7310-42eb-b2f4-e327e638924c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:19.193828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c3d28-7310-42eb-b2f4-e327e638924c admin admin] PATH_INFO: `/v3/users/0373b509f57048bc91dfb8f814c36a77` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:19.195023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c3d28-7310-42eb-b2f4-e327e638924c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0373b509f57048bc91dfb8f814c36a77)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:19.197027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c3d28-7310-42eb-b2f4-e327e638924c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:19.223364 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1274/2579] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:19 2022] POST /identity/v3/users => generated 303 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:19.224440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652b201-f123-4b14-9e9b-65349b02cbaa admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:19.228818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4652b201-f123-4b14-9e9b-65349b02cbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:19.246078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:19.263595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652b201-f123-4b14-9e9b-65349b02cbaa admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:19.276361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153540c-b2bf-4d94-b711-36b667c6e17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:19.277043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153540c-b2bf-4d94-b711-36b667c6e17b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:19.277372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153540c-b2bf-4d94-b711-36b667c6e17b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:19.277650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153540c-b2bf-4d94-b711-36b667c6e17b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:19.278811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153540c-b2bf-4d94-b711-36b667c6e17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:19.282087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153540c-b2bf-4d94-b711-36b667c6e17b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:19.292833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-771c3d28-7310-42eb-b2f4-e327e638924c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0373b509f57048bc91dfb8f814c36a77'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:19.306126 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1275/2580] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:53:19.308036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-771c3d28-7310-42eb-b2f4-e327e638924c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0373b509f57048bc91dfb8f814c36a77'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:19.309994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153540c-b2bf-4d94-b711-36b667c6e17b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:19.312149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e153540c-b2bf-4d94-b711-36b667c6e17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:19.313803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-771c3d28-7310-42eb-b2f4-e327e638924c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0373b509f57048bc91dfb8f814c36a77'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:19.314495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-771c3d28-7310-42eb-b2f4-e327e638924c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0373b509f57048bc91dfb8f814c36a77'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:19.328664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153540c-b2bf-4d94-b711-36b667c6e17b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:19.339432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-771c3d28-7310-42eb-b2f4-e327e638924c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0373b509f57048bc91dfb8f814c36a77'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:19.350784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97610d-d17d-4f52-a2ec-efe91126c478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:19.351536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97610d-d17d-4f52-a2ec-efe91126c478 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:19.351821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97610d-d17d-4f52-a2ec-efe91126c478 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:19.352102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97610d-d17d-4f52-a2ec-efe91126c478 admin admin] PATH_INFO: `/v3/projects/80d5150e61924399b7bb9754251cf1d4/users/75221f87641a419180f27f53ff4771ee/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:19.363653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:19.368449 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1306/2581] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:19 2022] DELETE /identity/v3/users/0373b509f57048bc91dfb8f814c36a77 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:19.401161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0f537-9819-484d-8720-6f171bc0e9a0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:19.402224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0f537-9819-484d-8720-6f171bc0e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:19.402224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0f537-9819-484d-8720-6f171bc0e9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:19.415036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97610d-d17d-4f52-a2ec-efe91126c478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d5150e61924399b7bb9754251cf1d4, user_id=75221f87641a419180f27f53ff4771ee, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:19.422507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97610d-d17d-4f52-a2ec-efe91126c478 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:19.441646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9eb0f537-9819-484d-8720-6f171bc0e9a0 None None] MFA Rules not processed for user `d54b1c5c00544be4b60132d09817c8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:19.444182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9eb0f537-9819-484d-8720-6f171bc0e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:19.456363 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1276/2582] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:19 2022] PUT /identity/v3/projects/80d5150e61924399b7bb9754251cf1d4/users/75221f87641a419180f27f53ff4771ee/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:19.462796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97610d-d17d-4f52-a2ec-efe91126c478 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:19.660252 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1307/2583] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:19 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:19.662997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97610d-d17d-4f52-a2ec-efe91126c478 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:19.664691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0f537-9819-484d-8720-6f171bc0e9a0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:19.666883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9eb0f537-9819-484d-8720-6f171bc0e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:19.672588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33429f99-5efb-4720-b726-514f6818b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:19.674209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33429f99-5efb-4720-b726-514f6818b3cf admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:19.674654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33429f99-5efb-4720-b726-514f6818b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:19.675082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33429f99-5efb-4720-b726-514f6818b3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:19.676136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33429f99-5efb-4720-b726-514f6818b3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:19.678926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33429f99-5efb-4720-b726-514f6818b3cf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:19.693042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0f537-9819-484d-8720-6f171bc0e9a0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:19.698104 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1277/2584] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:19.699913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33429f99-5efb-4720-b726-514f6818b3cf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:19.702862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2f9bb-5eaf-4910-8acc-14e12aea69bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:19.703414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2f9bb-5eaf-4910-8acc-14e12aea69bb admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:19.703695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2f9bb-5eaf-4910-8acc-14e12aea69bb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:19.703963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2f9bb-5eaf-4910-8acc-14e12aea69bb admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:19.704596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2f9bb-5eaf-4910-8acc-14e12aea69bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:19.711003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2f9bb-5eaf-4910-8acc-14e12aea69bb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:19.715103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33429f99-5efb-4720-b726-514f6818b3cf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:19.723705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f0ffd-9378-435b-9986-f73943349e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:19.724938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f0ffd-9378-435b-9986-f73943349e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:19.725471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f0ffd-9378-435b-9986-f73943349e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:19.726575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f0ffd-9378-435b-9986-f73943349e44 admin admin] PATH_INFO: `/v3/projects/80d5150e61924399b7bb9754251cf1d4/users/75221f87641a419180f27f53ff4771ee/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:19.728918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f0ffd-9378-435b-9986-f73943349e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d5150e61924399b7bb9754251cf1d4, user_id=75221f87641a419180f27f53ff4771ee, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:19.732941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f0ffd-9378-435b-9986-f73943349e44 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:19.774787 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1308/2586] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:19 2022] POST /identity/v3/projects => generated 397 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:19.775483 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1278/2586] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:19 2022] PUT /identity/v3/projects/80d5150e61924399b7bb9754251cf1d4/users/75221f87641a419180f27f53ff4771ee/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:19.776212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edec25-16c1-4ce4-839b-d49bdf099fdf None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:19.776501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edec25-16c1-4ce4-839b-d49bdf099fdf None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:19.776767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edec25-16c1-4ce4-839b-d49bdf099fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:19.779525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f0ffd-9378-435b-9986-f73943349e44 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:19.829970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a2edec25-16c1-4ce4-839b-d49bdf099fdf None None] MFA Rules not processed for user `75221f87641a419180f27f53ff4771ee`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:19.831521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a2edec25-16c1-4ce4-839b-d49bdf099fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:19.902826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f0ffd-9378-435b-9986-f73943349e44 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:20.028103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ef0e-f210-469a-80c7-7f77de679af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:20.029895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ef0e-f210-469a-80c7-7f77de679af9 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:20.031306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ef0e-f210-469a-80c7-7f77de679af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:20.031703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ef0e-f210-469a-80c7-7f77de679af9 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:20.032518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923ef0e-f210-469a-80c7-7f77de679af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:20.036751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923ef0e-f210-469a-80c7-7f77de679af9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:20.072190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:20.081037 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1309/2587] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:20.104933 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1279/2588] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:19 2022] POST /identity/v3/users => generated 305 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:20.109364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edec25-16c1-4ce4-839b-d49bdf099fdf None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:20.144646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edec25-16c1-4ce4-839b-d49bdf099fdf None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:20.160223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df79dfd-c526-4dc5-9051-5b121b494ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:20.161143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df79dfd-c526-4dc5-9051-5b121b494ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:20.161466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df79dfd-c526-4dc5-9051-5b121b494ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:20.161743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df79dfd-c526-4dc5-9051-5b121b494ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:20.162402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df79dfd-c526-4dc5-9051-5b121b494ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:20.164282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df79dfd-c526-4dc5-9051-5b121b494ab5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:20.185684 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1310/2589] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:20.189575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ef0e-f210-469a-80c7-7f77de679af9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:20.204878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:20.209922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ef0e-f210-469a-80c7-7f77de679af9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:20.228782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df79dfd-c526-4dc5-9051-5b121b494ab5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:20.230717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6df79dfd-c526-4dc5-9051-5b121b494ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:20.243040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c8bec-42b1-43a1-8a23-c1eef0c274db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:20.244599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c8bec-42b1-43a1-8a23-c1eef0c274db admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:20.245357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c8bec-42b1-43a1-8a23-c1eef0c274db admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:20.245357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c8bec-42b1-43a1-8a23-c1eef0c274db admin admin] PATH_INFO: `/v3/projects/49e7e27444f249baa1bea45c1769ecce/users/d449480e71eb4ac7a24dc84d5a0076b5/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:20.257624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df79dfd-c526-4dc5-9051-5b121b494ab5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:20.268994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:20.269636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:20.269928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:20.270282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] PATH_INFO: `/v3/projects/ec6f1e5c41214b2ebe25247fd75005db` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:20.271800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec6f1e5c41214b2ebe25247fd75005db)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:20.275014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:20.290343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c8bec-42b1-43a1-8a23-c1eef0c274db admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e7e27444f249baa1bea45c1769ecce, user_id=d449480e71eb4ac7a24dc84d5a0076b5, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:20.293007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c8bec-42b1-43a1-8a23-c1eef0c274db admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:20.319904 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1280/2590] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:20 2022] PUT /identity/v3/projects/49e7e27444f249baa1bea45c1769ecce/users/d449480e71eb4ac7a24dc84d5a0076b5/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:20.319904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c8bec-42b1-43a1-8a23-c1eef0c274db admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:20.383546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec6f1e5c41214b2ebe25247fd75005db', 'request_id': 'req-9ccf1773-4f4b-4195-8331-189d613f3423'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:20.402480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec6f1e5c41214b2ebe25247fd75005db', 'request_id': 'req-9ccf1773-4f4b-4195-8331-189d613f3423'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:20.411375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec6f1e5c41214b2ebe25247fd75005db', 'request_id': 'req-9ccf1773-4f4b-4195-8331-189d613f3423'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:20.438066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] The token cache is being invalidate because project ec6f1e5c41214b2ebe25247fd75005db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:20.438706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:20.440229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:20.442455 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1311/2591] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:20 2022] DELETE /identity/v3/projects/ec6f1e5c41214b2ebe25247fd75005db => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:20.443474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:20.445081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:20.448870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c8bec-42b1-43a1-8a23-c1eef0c274db admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:20.582649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f7b9a-5604-4d2f-855b-378a3f57a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:20.583510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f7b9a-5604-4d2f-855b-378a3f57a522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:20.583801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f7b9a-5604-4d2f-855b-378a3f57a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:20.584071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f7b9a-5604-4d2f-855b-378a3f57a522 admin admin] PATH_INFO: `/v3/users/6698c33836c648e39c8baeb65470aba3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:20.590216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f7b9a-5604-4d2f-855b-378a3f57a522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6698c33836c648e39c8baeb65470aba3)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:20.593361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f7b9a-5604-4d2f-855b-378a3f57a522 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:20.601402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf1773-4f4b-4195-8331-189d613f3423 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:20.621170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f820f3a-e4ed-4cf8-af94-58f88449e46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:20.622014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f820f3a-e4ed-4cf8-af94-58f88449e46d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:20.622404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f820f3a-e4ed-4cf8-af94-58f88449e46d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:20.622783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f820f3a-e4ed-4cf8-af94-58f88449e46d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:20.623549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f820f3a-e4ed-4cf8-af94-58f88449e46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:20.625350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f820f3a-e4ed-4cf8-af94-58f88449e46d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:20.643875 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1312/2592] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:20.645602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8ec40-5668-4bd0-88bf-5ad06e38ebc9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:20.646024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8ec40-5668-4bd0-88bf-5ad06e38ebc9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:20.646506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8ec40-5668-4bd0-88bf-5ad06e38ebc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:20.675407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-35b8ec40-5668-4bd0-88bf-5ad06e38ebc9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:20.676915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-35b8ec40-5668-4bd0-88bf-5ad06e38ebc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:20.694436 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1313/2593] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:20.694436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8ec40-5668-4bd0-88bf-5ad06e38ebc9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:20.701279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8ec40-5668-4bd0-88bf-5ad06e38ebc9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:20.710689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff5483-9061-4d47-814d-ff33f34b92e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:20.711626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff5483-9061-4d47-814d-ff33f34b92e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:20.712186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff5483-9061-4d47-814d-ff33f34b92e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:20.712608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff5483-9061-4d47-814d-ff33f34b92e8 admin admin] PATH_INFO: `/v3/projects/49e7e27444f249baa1bea45c1769ecce/users/d449480e71eb4ac7a24dc84d5a0076b5/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:20.718261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff5483-9061-4d47-814d-ff33f34b92e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e7e27444f249baa1bea45c1769ecce, user_id=d449480e71eb4ac7a24dc84d5a0076b5, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:20.722327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff5483-9061-4d47-814d-ff33f34b92e8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:20.724839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9e4f7b9a-5604-4d2f-855b-378a3f57a522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6698c33836c648e39c8baeb65470aba3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:20.734209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9e4f7b9a-5604-4d2f-855b-378a3f57a522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6698c33836c648e39c8baeb65470aba3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:20.735640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9e4f7b9a-5604-4d2f-855b-378a3f57a522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6698c33836c648e39c8baeb65470aba3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:20.737373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9e4f7b9a-5604-4d2f-855b-378a3f57a522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6698c33836c648e39c8baeb65470aba3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:20.740435 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1314/2594] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:20 2022] PUT /identity/v3/projects/49e7e27444f249baa1bea45c1769ecce/users/d449480e71eb4ac7a24dc84d5a0076b5/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:20.742126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cffa0-585f-478d-a735-22aaef69fb6b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:20.742642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cffa0-585f-478d-a735-22aaef69fb6b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:20.743064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cffa0-585f-478d-a735-22aaef69fb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:20.760892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9e4f7b9a-5604-4d2f-855b-378a3f57a522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6698c33836c648e39c8baeb65470aba3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:20.776287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b36cffa0-585f-478d-a735-22aaef69fb6b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:20.779768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b36cffa0-585f-478d-a735-22aaef69fb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:20.786691 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1281/2595] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:20 2022] DELETE /identity/v3/users/6698c33836c648e39c8baeb65470aba3 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:20.790711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac4ac-091b-411e-bc28-bde2c4b6bee3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:20.791121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac4ac-091b-411e-bc28-bde2c4b6bee3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:20.791514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac4ac-091b-411e-bc28-bde2c4b6bee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:20.811818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:20.819799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ecaac4ac-091b-411e-bc28-bde2c4b6bee3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:20.823918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ecaac4ac-091b-411e-bc28-bde2c4b6bee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:20.852930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:20.905125 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1315/2596] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:20.912355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cffa0-585f-478d-a735-22aaef69fb6b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:20.937854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cffa0-585f-478d-a735-22aaef69fb6b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:20.942046 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1282/2597] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:20.944357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8e6b2-fed0-43c0-b625-69a7ae5a2c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:20.945345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8e6b2-fed0-43c0-b625-69a7ae5a2c77 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:20.945626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8e6b2-fed0-43c0-b625-69a7ae5a2c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:20.945892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8e6b2-fed0-43c0-b625-69a7ae5a2c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:20.946595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8e6b2-fed0-43c0-b625-69a7ae5a2c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:53:20.947070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8e6b2-fed0-43c0-b625-69a7ae5a2c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:20.951268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaac4ac-091b-411e-bc28-bde2c4b6bee3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:20.951963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8e6b2-fed0-43c0-b625-69a7ae5a2c77 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:20.952938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ecaac4ac-091b-411e-bc28-bde2c4b6bee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:20.973777 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1316/2598] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:53:20.978832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8e6b2-fed0-43c0-b625-69a7ae5a2c77 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:21.001512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8e6b2-fed0-43c0-b625-69a7ae5a2c77 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:21.016095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34b43-1e38-4ee1-a2d5-4376ecb22990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:21.016726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34b43-1e38-4ee1-a2d5-4376ecb22990 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:21.017004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34b43-1e38-4ee1-a2d5-4376ecb22990 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:21.017297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34b43-1e38-4ee1-a2d5-4376ecb22990 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:21.020842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d34b43-1e38-4ee1-a2d5-4376ecb22990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:21.026822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d34b43-1e38-4ee1-a2d5-4376ecb22990 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:21.046469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaac4ac-091b-411e-bc28-bde2c4b6bee3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:21.051228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c822a-1217-450f-9441-3dc14370291d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:21.051955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c822a-1217-450f-9441-3dc14370291d service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:21.052311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c822a-1217-450f-9441-3dc14370291d service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:21.052654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c822a-1217-450f-9441-3dc14370291d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:21.066548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c822a-1217-450f-9441-3dc14370291d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:21.068273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c822a-1217-450f-9441-3dc14370291d service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:21.083392 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1283/2599] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:21.105104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c822a-1217-450f-9441-3dc14370291d service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:21.108720 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1317/2600] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:20 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:21.133263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c822a-1217-450f-9441-3dc14370291d service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:21.244338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c096b-6d7d-4b19-bf20-46c49d7c3fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:21.246356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c096b-6d7d-4b19-bf20-46c49d7c3fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:21.246902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c096b-6d7d-4b19-bf20-46c49d7c3fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:21.247382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c096b-6d7d-4b19-bf20-46c49d7c3fd9 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:21.248520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c096b-6d7d-4b19-bf20-46c49d7c3fd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:21.251970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c096b-6d7d-4b19-bf20-46c49d7c3fd9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:21.303855 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1284/2601] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:21 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:21.305132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34b43-1e38-4ee1-a2d5-4376ecb22990 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:21.323110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34b43-1e38-4ee1-a2d5-4376ecb22990 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:21.337361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357787b-af98-433f-8eed-44ecfdb61499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:21.337929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357787b-af98-433f-8eed-44ecfdb61499 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:21.338207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357787b-af98-433f-8eed-44ecfdb61499 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:21.338536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357787b-af98-433f-8eed-44ecfdb61499 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:21.339188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357787b-af98-433f-8eed-44ecfdb61499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:21.340783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357787b-af98-433f-8eed-44ecfdb61499 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:21.352295 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1318/2602] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:21.356829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c096b-6d7d-4b19-bf20-46c49d7c3fd9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:21.370351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c096b-6d7d-4b19-bf20-46c49d7c3fd9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:21.377468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450c92d-1a10-4e26-a568-af5606252b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:21.378676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450c92d-1a10-4e26-a568-af5606252b25 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:21.378912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450c92d-1a10-4e26-a568-af5606252b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:21.379199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450c92d-1a10-4e26-a568-af5606252b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:21.379928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450c92d-1a10-4e26-a568-af5606252b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:21.382240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450c92d-1a10-4e26-a568-af5606252b25 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:21.397918 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1285/2603] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:21.400177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357787b-af98-433f-8eed-44ecfdb61499 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:21.412682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357787b-af98-433f-8eed-44ecfdb61499 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:21.418832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d483d-c496-47be-8ac1-18693df3f73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:21.419765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d483d-c496-47be-8ac1-18693df3f73c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:21.420130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d483d-c496-47be-8ac1-18693df3f73c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:21.420476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d483d-c496-47be-8ac1-18693df3f73c admin admin] PATH_INFO: `/v3/projects/5a0eab6383b548a0a4e4167eb1f3e7aa/users/79acb9486e72400093cb901707c39e45/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:21.444164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d483d-c496-47be-8ac1-18693df3f73c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0eab6383b548a0a4e4167eb1f3e7aa, user_id=79acb9486e72400093cb901707c39e45, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:21.447708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d483d-c496-47be-8ac1-18693df3f73c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:21.466394 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1319/2604] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:21 2022] PUT /identity/v3/projects/5a0eab6383b548a0a4e4167eb1f3e7aa/users/79acb9486e72400093cb901707c39e45/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:21.477500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a0dd7-5556-4ccf-b906-b42c8d2bfa21 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:21.478076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a0dd7-5556-4ccf-b906-b42c8d2bfa21 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:21.478626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a0dd7-5556-4ccf-b906-b42c8d2bfa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:21.539744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-919a0dd7-5556-4ccf-b906-b42c8d2bfa21 None None] MFA Rules not processed for user `79acb9486e72400093cb901707c39e45`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:21.541659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-919a0dd7-5556-4ccf-b906-b42c8d2bfa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:21.573532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:21.696579 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1286/2605] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:21.826273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d483d-c496-47be-8ac1-18693df3f73c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:21.828080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-840d483d-c496-47be-8ac1-18693df3f73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:21.890799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a0dd7-5556-4ccf-b906-b42c8d2bfa21 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:21.893048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-919a0dd7-5556-4ccf-b906-b42c8d2bfa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:21.949538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d483d-c496-47be-8ac1-18693df3f73c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:21.959110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66f82f-478c-4dcc-9915-3ac23a21ad08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:21.959886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66f82f-478c-4dcc-9915-3ac23a21ad08 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:21.960263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66f82f-478c-4dcc-9915-3ac23a21ad08 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:21.960745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66f82f-478c-4dcc-9915-3ac23a21ad08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:21.976944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66f82f-478c-4dcc-9915-3ac23a21ad08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:21.981271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66f82f-478c-4dcc-9915-3ac23a21ad08 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:22.004491 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1320/2606] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:22.108735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a0dd7-5556-4ccf-b906-b42c8d2bfa21 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:22.114169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:22.114814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:22.115092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:22.115539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] PATH_INFO: `/v3/projects/d2b884c2900a4c33996ab03dd7228508` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:22.117025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b884c2900a4c33996ab03dd7228508)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:22.120166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:22.261171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b884c2900a4c33996ab03dd7228508', 'request_id': 'req-288d7172-ad49-4fa3-96f7-37c01fcacd31'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:22.280717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b884c2900a4c33996ab03dd7228508', 'request_id': 'req-288d7172-ad49-4fa3-96f7-37c01fcacd31'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:22.296104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b884c2900a4c33996ab03dd7228508', 'request_id': 'req-288d7172-ad49-4fa3-96f7-37c01fcacd31'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:22.319227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] The token cache is being invalidate because project d2b884c2900a4c33996ab03dd7228508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:22.319489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:22.320855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:22.341964 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1287/2607] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:21 2022] DELETE /identity/v3/projects/d2b884c2900a4c33996ab03dd7228508 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:22.346230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66f82f-478c-4dcc-9915-3ac23a21ad08 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:22.362775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66f82f-478c-4dcc-9915-3ac23a21ad08 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:22.471475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:22.472127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:22.472409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:22.472684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] PATH_INFO: `/v3/users/75221f87641a419180f27f53ff4771ee` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:22.474500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75221f87641a419180f27f53ff4771ee)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:22.476410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:22.485508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:22.587851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75221f87641a419180f27f53ff4771ee'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:22.606765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75221f87641a419180f27f53ff4771ee'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:22.610009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75221f87641a419180f27f53ff4771ee'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:22.610676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75221f87641a419180f27f53ff4771ee'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:22.661275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75221f87641a419180f27f53ff4771ee'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:22.688232 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1321/2608] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:22 2022] DELETE /identity/v3/users/75221f87641a419180f27f53ff4771ee => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:23.649498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:23.655582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:23.675622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d7172-ad49-4fa3-96f7-37c01fcacd31 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:23.743995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:23.767336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02f640-f4f6-48f6-8470-7e1b32369058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:23.768847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02f640-f4f6-48f6-8470-7e1b32369058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:23.770068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02f640-f4f6-48f6-8470-7e1b32369058 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:23.770502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02f640-f4f6-48f6-8470-7e1b32369058 admin admin] PATH_INFO: `/v3/projects/80d5150e61924399b7bb9754251cf1d4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:23.771890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02f640-f4f6-48f6-8470-7e1b32369058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d5150e61924399b7bb9754251cf1d4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:23.774312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02f640-f4f6-48f6-8470-7e1b32369058 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:23.841273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3c02f640-f4f6-48f6-8470-7e1b32369058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d5150e61924399b7bb9754251cf1d4', 'request_id': 'req-3c02f640-f4f6-48f6-8470-7e1b32369058'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:23.855188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3c02f640-f4f6-48f6-8470-7e1b32369058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d5150e61924399b7bb9754251cf1d4', 'request_id': 'req-3c02f640-f4f6-48f6-8470-7e1b32369058'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:23.881112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3c02f640-f4f6-48f6-8470-7e1b32369058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d5150e61924399b7bb9754251cf1d4', 'request_id': 'req-3c02f640-f4f6-48f6-8470-7e1b32369058'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:23.920024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:23.921729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:23.924681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3c02f640-f4f6-48f6-8470-7e1b32369058 admin admin] The token cache is being invalidate because project 80d5150e61924399b7bb9754251cf1d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:23.925241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3c02f640-f4f6-48f6-8470-7e1b32369058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:23.926676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3c02f640-f4f6-48f6-8470-7e1b32369058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:23.933914 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1288/2609] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:23 2022] DELETE /identity/v3/projects/80d5150e61924399b7bb9754251cf1d4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:23.935745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626efe5-0e48-4981-b0b3-6c80171fb8ee None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:23.936312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626efe5-0e48-4981-b0b3-6c80171fb8ee None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:23.936690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626efe5-0e48-4981-b0b3-6c80171fb8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:23.954591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fdfe0-0150-4517-8f3b-ea9845f82462 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:23.968836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e626efe5-0e48-4981-b0b3-6c80171fb8ee None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:23.970448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e626efe5-0e48-4981-b0b3-6c80171fb8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:24.064034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b936c9-c52e-4fdd-8ede-21e17cca7015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:24.064738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b936c9-c52e-4fdd-8ede-21e17cca7015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:24.065028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b936c9-c52e-4fdd-8ede-21e17cca7015 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:24.065385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b936c9-c52e-4fdd-8ede-21e17cca7015 admin admin] PATH_INFO: `/v3/users/79acb9486e72400093cb901707c39e45` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:24.066788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b936c9-c52e-4fdd-8ede-21e17cca7015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79acb9486e72400093cb901707c39e45)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:24.068853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b936c9-c52e-4fdd-8ede-21e17cca7015 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:24.070013 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1289/2610] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:24.078802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626efe5-0e48-4981-b0b3-6c80171fb8ee None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:24.080436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e626efe5-0e48-4981-b0b3-6c80171fb8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:24.157792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c6b936c9-c52e-4fdd-8ede-21e17cca7015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79acb9486e72400093cb901707c39e45'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:24.178501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c6b936c9-c52e-4fdd-8ede-21e17cca7015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79acb9486e72400093cb901707c39e45'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:24.180578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c6b936c9-c52e-4fdd-8ede-21e17cca7015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79acb9486e72400093cb901707c39e45'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:24.182420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c6b936c9-c52e-4fdd-8ede-21e17cca7015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79acb9486e72400093cb901707c39e45'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:24.220908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c6b936c9-c52e-4fdd-8ede-21e17cca7015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79acb9486e72400093cb901707c39e45'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:24.235256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:24.249304 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1322/2611] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:23 2022] DELETE /identity/v3/users/79acb9486e72400093cb901707c39e45 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:24.252731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc65a2a-ea29-49bc-8529-e53c69fe55bb None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:24.253525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc65a2a-ea29-49bc-8529-e53c69fe55bb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:24.254084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc65a2a-ea29-49bc-8529-e53c69fe55bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:24.255927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626efe5-0e48-4981-b0b3-6c80171fb8ee None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:24.279615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:24.285648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7fc65a2a-ea29-49bc-8529-e53c69fe55bb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:24.287318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7fc65a2a-ea29-49bc-8529-e53c69fe55bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:24.347056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b9fae-5ebc-49d2-9b3e-0fa24c2d40bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:24.347673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b9fae-5ebc-49d2-9b3e-0fa24c2d40bc service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:24.347954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b9fae-5ebc-49d2-9b3e-0fa24c2d40bc service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:24.348220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b9fae-5ebc-49d2-9b3e-0fa24c2d40bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:24.350038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-547b9fae-5ebc-49d2-9b3e-0fa24c2d40bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:24.399899 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1323/2612] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:24.401538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55eacc-a256-4868-909a-d3cbd0c35e34 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:24.402064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55eacc-a256-4868-909a-d3cbd0c35e34 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:24.402751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55eacc-a256-4868-909a-d3cbd0c35e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:24.444226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2d55eacc-a256-4868-909a-d3cbd0c35e34 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:24.449405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2d55eacc-a256-4868-909a-d3cbd0c35e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:24.461572 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1324/2613] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:24.482435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55eacc-a256-4868-909a-d3cbd0c35e34 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:24.494333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b9fae-5ebc-49d2-9b3e-0fa24c2d40bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:24.495967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b9fae-5ebc-49d2-9b3e-0fa24c2d40bc service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:24.507725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55eacc-a256-4868-909a-d3cbd0c35e34 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:24.508718 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1290/2614] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:24.509765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b9fae-5ebc-49d2-9b3e-0fa24c2d40bc service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:24.512321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-547b9fae-5ebc-49d2-9b3e-0fa24c2d40bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:24.513499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98d407-26b6-4691-9f54-f792fc57c4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:24.514231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98d407-26b6-4691-9f54-f792fc57c4cd admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:24.516355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98d407-26b6-4691-9f54-f792fc57c4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:24.516355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98d407-26b6-4691-9f54-f792fc57c4cd admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:24.517477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98d407-26b6-4691-9f54-f792fc57c4cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:53:24.517893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98d407-26b6-4691-9f54-f792fc57c4cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:24.520560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98d407-26b6-4691-9f54-f792fc57c4cd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:24.539153 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1325/2615] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:53:24.541098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98d407-26b6-4691-9f54-f792fc57c4cd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:24.572735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98d407-26b6-4691-9f54-f792fc57c4cd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:24.590031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e4a7d-fcdc-4d4d-8dcd-bd9387587864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:24.590677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e4a7d-fcdc-4d4d-8dcd-bd9387587864 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:24.590961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e4a7d-fcdc-4d4d-8dcd-bd9387587864 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:24.591232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e4a7d-fcdc-4d4d-8dcd-bd9387587864 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:24.595053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e4a7d-fcdc-4d4d-8dcd-bd9387587864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:24.598679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e4a7d-fcdc-4d4d-8dcd-bd9387587864 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:24.615510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b9fae-5ebc-49d2-9b3e-0fa24c2d40bc service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:24.620549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541730e-be11-4477-b8d7-df0173226033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:24.621421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541730e-be11-4477-b8d7-df0173226033 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:24.622096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541730e-be11-4477-b8d7-df0173226033 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:24.622485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541730e-be11-4477-b8d7-df0173226033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:24.635868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541730e-be11-4477-b8d7-df0173226033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:24.637759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541730e-be11-4477-b8d7-df0173226033 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:24.650884 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1291/2616] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:24.674603 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1326/2617] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:24 2022] POST /identity/v3/projects => generated 395 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:53:24.676083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541730e-be11-4477-b8d7-df0173226033 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:24.695733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541730e-be11-4477-b8d7-df0173226033 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:24.778578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:24.798437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888dd8b-b510-409f-a064-04cf9b15faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:24.800758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888dd8b-b510-409f-a064-04cf9b15faff admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:24.801057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888dd8b-b510-409f-a064-04cf9b15faff admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:24.803358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888dd8b-b510-409f-a064-04cf9b15faff admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:24.803669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888dd8b-b510-409f-a064-04cf9b15faff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:24.809802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888dd8b-b510-409f-a064-04cf9b15faff admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:24.868233 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1292/2618] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:24 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:24.872942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e4a7d-fcdc-4d4d-8dcd-bd9387587864 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:24.892816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e4a7d-fcdc-4d4d-8dcd-bd9387587864 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:24.906132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4b01-33d4-45b9-ae19-da4455ad9899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:24.906961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4b01-33d4-45b9-ae19-da4455ad9899 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:24.907324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4b01-33d4-45b9-ae19-da4455ad9899 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:24.910499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4b01-33d4-45b9-ae19-da4455ad9899 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:24.911304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca4b01-33d4-45b9-ae19-da4455ad9899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:24.912959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca4b01-33d4-45b9-ae19-da4455ad9899 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:24.974103 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1327/2619] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:24.978078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888dd8b-b510-409f-a064-04cf9b15faff admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:24.995316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888dd8b-b510-409f-a064-04cf9b15faff admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:25.008370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba39ca-6a1d-4d14-a049-b9011b007f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:25.008995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba39ca-6a1d-4d14-a049-b9011b007f97 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:25.010052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba39ca-6a1d-4d14-a049-b9011b007f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:25.010277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba39ca-6a1d-4d14-a049-b9011b007f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:25.011180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba39ca-6a1d-4d14-a049-b9011b007f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:25.012673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba39ca-6a1d-4d14-a049-b9011b007f97 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:25.051474 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1293/2620] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:25.055963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4b01-33d4-45b9-ae19-da4455ad9899 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:25.094100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4b01-33d4-45b9-ae19-da4455ad9899 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:25.111790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9e12a-eb82-4b35-9f0b-ffa1e0706dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:25.113434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9e12a-eb82-4b35-9f0b-ffa1e0706dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:25.113923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9e12a-eb82-4b35-9f0b-ffa1e0706dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:25.114429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9e12a-eb82-4b35-9f0b-ffa1e0706dd4 admin admin] PATH_INFO: `/v3/projects/3331a006d83d4c9c830633976a243b53/users/f2c6e2756bd54abea79d3ba13a314786/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:25.199413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9e12a-eb82-4b35-9f0b-ffa1e0706dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3331a006d83d4c9c830633976a243b53, user_id=f2c6e2756bd54abea79d3ba13a314786, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:25.206726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9e12a-eb82-4b35-9f0b-ffa1e0706dd4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:25.228006 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1328/2621] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:25 2022] PUT /identity/v3/projects/3331a006d83d4c9c830633976a243b53/users/f2c6e2756bd54abea79d3ba13a314786/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:25.262434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4878c-f4f9-4559-bdc7-4d4773004321 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:25.262864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4878c-f4f9-4559-bdc7-4d4773004321 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:25.263051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4878c-f4f9-4559-bdc7-4d4773004321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:25.339105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9e12a-eb82-4b35-9f0b-ffa1e0706dd4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:25.340831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0cc4878c-f4f9-4559-bdc7-4d4773004321 None None] MFA Rules not processed for user `f2c6e2756bd54abea79d3ba13a314786`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:25.343063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0cc4878c-f4f9-4559-bdc7-4d4773004321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:25.346585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-aac9e12a-eb82-4b35-9f0b-ffa1e0706dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:25.480117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9e12a-eb82-4b35-9f0b-ffa1e0706dd4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:25.496372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2cf99-d512-4dbf-965c-af9eb700800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:25.497860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2cf99-d512-4dbf-965c-af9eb700800a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:25.497860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2cf99-d512-4dbf-965c-af9eb700800a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:25.498154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2cf99-d512-4dbf-965c-af9eb700800a admin admin] PATH_INFO: `/v3/projects/5a0eab6383b548a0a4e4167eb1f3e7aa` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:25.499990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2cf99-d512-4dbf-965c-af9eb700800a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0eab6383b548a0a4e4167eb1f3e7aa)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:25.502702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2cf99-d512-4dbf-965c-af9eb700800a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:25.560042 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1294/2622] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:25 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:25.564793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4878c-f4f9-4559-bdc7-4d4773004321 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:25.576659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:25.608731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ada2cf99-d512-4dbf-965c-af9eb700800a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0eab6383b548a0a4e4167eb1f3e7aa', 'request_id': 'req-ada2cf99-d512-4dbf-965c-af9eb700800a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:25.610757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4878c-f4f9-4559-bdc7-4d4773004321 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:25.624471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ada2cf99-d512-4dbf-965c-af9eb700800a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0eab6383b548a0a4e4167eb1f3e7aa', 'request_id': 'req-ada2cf99-d512-4dbf-965c-af9eb700800a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:25.651599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ada2cf99-d512-4dbf-965c-af9eb700800a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0eab6383b548a0a4e4167eb1f3e7aa', 'request_id': 'req-ada2cf99-d512-4dbf-965c-af9eb700800a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:25.678316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ada2cf99-d512-4dbf-965c-af9eb700800a admin admin] The token cache is being invalidate because project 5a0eab6383b548a0a4e4167eb1f3e7aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:25.678923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ada2cf99-d512-4dbf-965c-af9eb700800a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:25.683408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ada2cf99-d512-4dbf-965c-af9eb700800a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:25.686030 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1329/2623] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:25 2022] DELETE /identity/v3/projects/5a0eab6383b548a0a4e4167eb1f3e7aa => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:25.691545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5f026-d057-4bd4-974b-b7991bc6579a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:25.692103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5f026-d057-4bd4-974b-b7991bc6579a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:25.692754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5f026-d057-4bd4-974b-b7991bc6579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:25.740978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-91e5f026-d057-4bd4-974b-b7991bc6579a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:25.742634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-91e5f026-d057-4bd4-974b-b7991bc6579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:25.746209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802241d5-ebde-4e8b-bc98-f604c6116890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:25.746879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802241d5-ebde-4e8b-bc98-f604c6116890 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:25.747160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802241d5-ebde-4e8b-bc98-f604c6116890 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:25.747436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802241d5-ebde-4e8b-bc98-f604c6116890 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:25.748079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802241d5-ebde-4e8b-bc98-f604c6116890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:25.754023 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1330/2624] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:25.761306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802241d5-ebde-4e8b-bc98-f604c6116890 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:25.851780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998a4ad-307a-4167-bea0-365c6fe259a1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:25.852133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998a4ad-307a-4167-bea0-365c6fe259a1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:25.852336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998a4ad-307a-4167-bea0-365c6fe259a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:25.874596 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1295/2625] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:25 2022] POST /identity/v3/projects => generated 395 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:53:25.878249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802241d5-ebde-4e8b-bc98-f604c6116890 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:25.880413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-802241d5-ebde-4e8b-bc98-f604c6116890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:25.934662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d998a4ad-307a-4167-bea0-365c6fe259a1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:25.935928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d998a4ad-307a-4167-bea0-365c6fe259a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:25.965659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:26.033596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802241d5-ebde-4e8b-bc98-f604c6116890 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:26.039417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb0b16-1def-42c7-94d4-2e105b2f0e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:26.040468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb0b16-1def-42c7-94d4-2e105b2f0e09 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:26.041338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb0b16-1def-42c7-94d4-2e105b2f0e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:26.041718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb0b16-1def-42c7-94d4-2e105b2f0e09 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:26.042550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb0b16-1def-42c7-94d4-2e105b2f0e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:26.052747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb0b16-1def-42c7-94d4-2e105b2f0e09 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:26.106181 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1296/2626] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:25 2022] POST /identity/v3/users => generated 304 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:53:26.113414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb0b16-1def-42c7-94d4-2e105b2f0e09 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:26.141925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb0b16-1def-42c7-94d4-2e105b2f0e09 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:26.144390 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1331/2627] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:53:26.148279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998a4ad-307a-4167-bea0-365c6fe259a1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:26.151078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f9630-a31f-417a-9a96-55819055e1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:26.151864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f9630-a31f-417a-9a96-55819055e1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:26.152144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f9630-a31f-417a-9a96-55819055e1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:26.152419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f9630-a31f-417a-9a96-55819055e1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:26.153074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f9630-a31f-417a-9a96-55819055e1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:26.155789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f9630-a31f-417a-9a96-55819055e1c8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:26.162141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998a4ad-307a-4167-bea0-365c6fe259a1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:26.169790 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1297/2628] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:26.174449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f9630-a31f-417a-9a96-55819055e1c8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:26.188561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5f756-0ada-4420-85ec-4970331ff1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:26.189347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5f756-0ada-4420-85ec-4970331ff1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:26.190060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5f756-0ada-4420-85ec-4970331ff1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:26.192965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5f756-0ada-4420-85ec-4970331ff1d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:26.193848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5f756-0ada-4420-85ec-4970331ff1d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:53:26.194229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5f756-0ada-4420-85ec-4970331ff1d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:26.194889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f9630-a31f-417a-9a96-55819055e1c8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:26.196186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5f756-0ada-4420-85ec-4970331ff1d5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:26.237994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70766c5a-e5c7-45f9-9d83-b856e3092f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:26.240615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70766c5a-e5c7-45f9-9d83-b856e3092f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:26.241212 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1332/2629] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:53:26.242772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc22d-e03c-4e4c-a9f2-ac1c0e1db2f6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:26.243103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc22d-e03c-4e4c-a9f2-ac1c0e1db2f6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:26.243382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc22d-e03c-4e4c-a9f2-ac1c0e1db2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:26.246005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70766c5a-e5c7-45f9-9d83-b856e3092f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:26.246313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70766c5a-e5c7-45f9-9d83-b856e3092f22 admin admin] PATH_INFO: `/v3/projects/a16ac9abd6054698bfb9e72d0b88469a/users/56e2d202846647e9906ea68f2ffa7f95/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:26.297555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70766c5a-e5c7-45f9-9d83-b856e3092f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16ac9abd6054698bfb9e72d0b88469a, user_id=56e2d202846647e9906ea68f2ffa7f95, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:26.300415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70766c5a-e5c7-45f9-9d83-b856e3092f22 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:26.311986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8b2cc22d-e03c-4e4c-a9f2-ac1c0e1db2f6 None None] MFA Rules not processed for user `5ef659f5a1a24c439528a7675bdd70f8`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:26.313144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8b2cc22d-e03c-4e4c-a9f2-ac1c0e1db2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:26.324752 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1298/2630] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:26 2022] PUT /identity/v3/projects/a16ac9abd6054698bfb9e72d0b88469a/users/56e2d202846647e9906ea68f2ffa7f95/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:26.325674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70766c5a-e5c7-45f9-9d83-b856e3092f22 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:26.450576 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1333/2631] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:26.450576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc22d-e03c-4e4c-a9f2-ac1c0e1db2f6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:26.463251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70766c5a-e5c7-45f9-9d83-b856e3092f22 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:26.501033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc22d-e03c-4e4c-a9f2-ac1c0e1db2f6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:26.504099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e6968-f553-488b-ad92-d6a68c8f79b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:26.504461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6968-f553-488b-ad92-d6a68c8f79b7 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:26.504716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6968-f553-488b-ad92-d6a68c8f79b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:26.504986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6968-f553-488b-ad92-d6a68c8f79b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:26.505645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e6968-f553-488b-ad92-d6a68c8f79b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:26.507569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e6968-f553-488b-ad92-d6a68c8f79b7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:26.516555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcb4b5-1aef-4c92-91f3-79572c4d87e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:26.519413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcb4b5-1aef-4c92-91f3-79572c4d87e9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:26.519692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcb4b5-1aef-4c92-91f3-79572c4d87e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:26.519966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcb4b5-1aef-4c92-91f3-79572c4d87e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:26.521124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcb4b5-1aef-4c92-91f3-79572c4d87e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:26.524907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcb4b5-1aef-4c92-91f3-79572c4d87e9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:26.560261 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1334/2632] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:26.562733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcb4b5-1aef-4c92-91f3-79572c4d87e9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:26.575455 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1299/2633] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:26 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:26.579633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e6968-f553-488b-ad92-d6a68c8f79b7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:26.586732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcb4b5-1aef-4c92-91f3-79572c4d87e9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:26.658125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:26.747082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d970581-e191-4b6a-b368-b5f973bf5ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:26.747950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d970581-e191-4b6a-b368-b5f973bf5ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:26.748287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d970581-e191-4b6a-b368-b5f973bf5ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:26.748663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d970581-e191-4b6a-b368-b5f973bf5ce0 admin admin] PATH_INFO: `/v3/projects/a16ac9abd6054698bfb9e72d0b88469a/users/56e2d202846647e9906ea68f2ffa7f95/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:26.754448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d970581-e191-4b6a-b368-b5f973bf5ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16ac9abd6054698bfb9e72d0b88469a, user_id=56e2d202846647e9906ea68f2ffa7f95, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:26.758594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e6968-f553-488b-ad92-d6a68c8f79b7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:26.759163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d970581-e191-4b6a-b368-b5f973bf5ce0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:26.768316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cc2f7-d7e4-4c77-b6c0-0e97504daaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:26.768979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc2f7-d7e4-4c77-b6c0-0e97504daaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:26.769281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc2f7-d7e4-4c77-b6c0-0e97504daaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:26.769554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc2f7-d7e4-4c77-b6c0-0e97504daaa1 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:26.770183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cc2f7-d7e4-4c77-b6c0-0e97504daaa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:26.772924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cc2f7-d7e4-4c77-b6c0-0e97504daaa1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:26.786086 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1335/2634] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:26 2022] PUT /identity/v3/projects/a16ac9abd6054698bfb9e72d0b88469a/users/56e2d202846647e9906ea68f2ffa7f95/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:26.787492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312c994-6ebb-413f-8ec4-159eb4ff3eae None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:26.787779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312c994-6ebb-413f-8ec4-159eb4ff3eae None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:26.788201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312c994-6ebb-413f-8ec4-159eb4ff3eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:26.822493 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1300/2635] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:26 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:26.822703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb894d37-dd2c-432e-bd0f-dc99400368ae None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:26.822852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb894d37-dd2c-432e-bd0f-dc99400368ae None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:26.823128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb894d37-dd2c-432e-bd0f-dc99400368ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:26.833125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9312c994-6ebb-413f-8ec4-159eb4ff3eae None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:26.835389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9312c994-6ebb-413f-8ec4-159eb4ff3eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:26.904362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bb894d37-dd2c-432e-bd0f-dc99400368ae None None] MFA Rules not processed for user `56e2d202846647e9906ea68f2ffa7f95`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:26.909390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bb894d37-dd2c-432e-bd0f-dc99400368ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:26.922850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:26.997335 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1336/2636] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:26.998334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312c994-6ebb-413f-8ec4-159eb4ff3eae None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:27.094573 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1301/2637] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:27.099586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb894d37-dd2c-432e-bd0f-dc99400368ae None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:27.103865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bb894d37-dd2c-432e-bd0f-dc99400368ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:27.131653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb894d37-dd2c-432e-bd0f-dc99400368ae None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:27.149079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d4170-906e-4d85-addd-e2163bfbafaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:27.149846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d4170-906e-4d85-addd-e2163bfbafaf service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:27.150121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d4170-906e-4d85-addd-e2163bfbafaf service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:27.150391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d4170-906e-4d85-addd-e2163bfbafaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:27.157661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312c994-6ebb-413f-8ec4-159eb4ff3eae None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:27.175048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d4170-906e-4d85-addd-e2163bfbafaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:27.177510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc715c3-87a6-4653-ad2c-a2de30017523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:27.178199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc715c3-87a6-4653-ad2c-a2de30017523 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:27.178474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc715c3-87a6-4653-ad2c-a2de30017523 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:27.178741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc715c3-87a6-4653-ad2c-a2de30017523 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:27.179383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc715c3-87a6-4653-ad2c-a2de30017523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:27.180562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d4170-906e-4d85-addd-e2163bfbafaf service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:27.188151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc715c3-87a6-4653-ad2c-a2de30017523 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:27.210571 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1302/2638] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:27.221626 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1337/2639] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:27.224898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d4170-906e-4d85-addd-e2163bfbafaf service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:27.244104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d4170-906e-4d85-addd-e2163bfbafaf service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:27.258161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be33979-ff90-44a9-9b42-b6d80075c8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:27.258747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be33979-ff90-44a9-9b42-b6d80075c8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:27.259021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be33979-ff90-44a9-9b42-b6d80075c8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:27.259288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be33979-ff90-44a9-9b42-b6d80075c8d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:27.259933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be33979-ff90-44a9-9b42-b6d80075c8d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:27.265811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be33979-ff90-44a9-9b42-b6d80075c8d3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:27.291780 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1303/2640] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:27.293446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc715c3-87a6-4653-ad2c-a2de30017523 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:27.320246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc715c3-87a6-4653-ad2c-a2de30017523 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:27.340927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238777f2-48a2-4e89-acd2-a7547eaedfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:27.343389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238777f2-48a2-4e89-acd2-a7547eaedfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:27.343389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238777f2-48a2-4e89-acd2-a7547eaedfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:27.343389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238777f2-48a2-4e89-acd2-a7547eaedfd2 admin admin] PATH_INFO: `/v3/projects/80eccd9b8a0a485ca72e1faa29a481d9/users/e729e2a59ddb47dfacfdb664dccf55a8/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:27.802083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238777f2-48a2-4e89-acd2-a7547eaedfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80eccd9b8a0a485ca72e1faa29a481d9, user_id=e729e2a59ddb47dfacfdb664dccf55a8, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:27.805525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238777f2-48a2-4e89-acd2-a7547eaedfd2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:27.845822 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1338/2641] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:27 2022] PUT /identity/v3/projects/80eccd9b8a0a485ca72e1faa29a481d9/users/e729e2a59ddb47dfacfdb664dccf55a8/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:27.850736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc49a13-d41e-44db-a6eb-b7e9b1a78c19 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:27.851326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc49a13-d41e-44db-a6eb-b7e9b1a78c19 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:27.851635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc49a13-d41e-44db-a6eb-b7e9b1a78c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:27.900176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4cc49a13-d41e-44db-a6eb-b7e9b1a78c19 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:27.904624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4cc49a13-d41e-44db-a6eb-b7e9b1a78c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:27.948850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238777f2-48a2-4e89-acd2-a7547eaedfd2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:27.951900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-238777f2-48a2-4e89-acd2-a7547eaedfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:28.128382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:28.131489 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1304/2642] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:28.204620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238777f2-48a2-4e89-acd2-a7547eaedfd2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:28.221726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee5c7d-4d6f-40a4-9fab-8c6bbedd47ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:28.222316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee5c7d-4d6f-40a4-9fab-8c6bbedd47ff service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:28.222597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee5c7d-4d6f-40a4-9fab-8c6bbedd47ff service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:28.225889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee5c7d-4d6f-40a4-9fab-8c6bbedd47ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:28.226662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc49a13-d41e-44db-a6eb-b7e9b1a78c19 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:28.228336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4cc49a13-d41e-44db-a6eb-b7e9b1a78c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:28.233772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c8ee5c7d-4d6f-40a4-9fab-8c6bbedd47ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:28.274398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee5c7d-4d6f-40a4-9fab-8c6bbedd47ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:28.275992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee5c7d-4d6f-40a4-9fab-8c6bbedd47ff service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:28.345417 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1339/2643] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:28.349867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee5c7d-4d6f-40a4-9fab-8c6bbedd47ff service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:28.354636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c8ee5c7d-4d6f-40a4-9fab-8c6bbedd47ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:28.368560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc49a13-d41e-44db-a6eb-b7e9b1a78c19 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:28.372400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776be920-99c7-40f2-961c-d5fc005ff4ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:28.373174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776be920-99c7-40f2-961c-d5fc005ff4ff service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:28.373503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776be920-99c7-40f2-961c-d5fc005ff4ff service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:28.374466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776be920-99c7-40f2-961c-d5fc005ff4ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:28.399990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776be920-99c7-40f2-961c-d5fc005ff4ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:28.401642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776be920-99c7-40f2-961c-d5fc005ff4ff service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:28.416233 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1305/2644] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:53:28.598449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee5c7d-4d6f-40a4-9fab-8c6bbedd47ff service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:28.608451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc010830-b555-4c81-9c1f-00b47fb94640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:28.609537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010830-b555-4c81-9c1f-00b47fb94640 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:28.610186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010830-b555-4c81-9c1f-00b47fb94640 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:28.610622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010830-b555-4c81-9c1f-00b47fb94640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:28.783144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc010830-b555-4c81-9c1f-00b47fb94640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:28.787824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc010830-b555-4c81-9c1f-00b47fb94640 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:28.814808 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1340/2645] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:28 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:29.924512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776be920-99c7-40f2-961c-d5fc005ff4ff service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:29.949223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776be920-99c7-40f2-961c-d5fc005ff4ff service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:29.960248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:29.961577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:29.962015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:29.962581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] PATH_INFO: `/v3/users/f2c6e2756bd54abea79d3ba13a314786` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:29.965236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c6e2756bd54abea79d3ba13a314786)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:29.968224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:30.009893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:30.181913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c6e2756bd54abea79d3ba13a314786'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:30.196918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c6e2756bd54abea79d3ba13a314786'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:30.198087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c6e2756bd54abea79d3ba13a314786'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:30.198858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c6e2756bd54abea79d3ba13a314786'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:30.231806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c6e2756bd54abea79d3ba13a314786'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:30.266760 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1306/2646] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:29 2022] DELETE /identity/v3/users/f2c6e2756bd54abea79d3ba13a314786 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:30.271350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b3fd5-a028-425e-8d9c-9eb7319dec3c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:30.271900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b3fd5-a028-425e-8d9c-9eb7319dec3c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:30.272271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b3fd5-a028-425e-8d9c-9eb7319dec3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:30.304832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-588b3fd5-a028-425e-8d9c-9eb7319dec3c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:30.306946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-588b3fd5-a028-425e-8d9c-9eb7319dec3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:30.427897 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1341/2647] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:53:30.474802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:30.476610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:30.574728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a074-ac1b-4223-9886-7ef031f1e122 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:30.575058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a074-ac1b-4223-9886-7ef031f1e122 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:30.575325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a074-ac1b-4223-9886-7ef031f1e122 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:30.577540 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1342/2648] 10.222.0.26 () {54 vars in 921 bytes} [Sat Oct 8 20:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:53:30.584360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d0564-f3dd-4162-81bf-850147505e6b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:30.584652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d0564-f3dd-4162-81bf-850147505e6b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:30.585130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d0564-f3dd-4162-81bf-850147505e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:30.599227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151696bf-19d1-45fe-b914-904a59ccb68f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:30.610662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:30.612388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d2a77-f7bc-4717-b8bd-4d72ff344fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:30.613027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2a77-f7bc-4717-b8bd-4d72ff344fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:30.613349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2a77-f7bc-4717-b8bd-4d72ff344fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:30.613620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2a77-f7bc-4717-b8bd-4d72ff344fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:30.622620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-af5d0564-f3dd-4162-81bf-850147505e6b None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:30.624391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-af5d0564-f3dd-4162-81bf-850147505e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:30.633653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d2a77-f7bc-4717-b8bd-4d72ff344fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:30.638136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d2a77-f7bc-4717-b8bd-4d72ff344fa0 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:30.669033 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1307/2649] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:30.671031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec264e24-55b1-4e8c-b1d7-b9717159a69e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:30.671320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec264e24-55b1-4e8c-b1d7-b9717159a69e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:30.671593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec264e24-55b1-4e8c-b1d7-b9717159a69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:30.739890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ec264e24-55b1-4e8c-b1d7-b9717159a69e None None] MFA Rules not processed for user `d449480e71eb4ac7a24dc84d5a0076b5`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:30.742756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ec264e24-55b1-4e8c-b1d7-b9717159a69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:30.842583 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1343/2650] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:53:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:53:30.862192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d0564-f3dd-4162-81bf-850147505e6b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:30.864664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-af5d0564-f3dd-4162-81bf-850147505e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:30.899250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d0564-f3dd-4162-81bf-850147505e6b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:30.911035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2de5f1-f337-4a55-90a9-4acfa9a0cc8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:30.911909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de5f1-f337-4a55-90a9-4acfa9a0cc8c service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:30.912195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de5f1-f337-4a55-90a9-4acfa9a0cc8c service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:30.912474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de5f1-f337-4a55-90a9-4acfa9a0cc8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:30.944114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2de5f1-f337-4a55-90a9-4acfa9a0cc8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:30.945719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2de5f1-f337-4a55-90a9-4acfa9a0cc8c service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:30.975078 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1344/2651] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:53:31.015686 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1308/2652] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:30 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:31.017588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763ae6-dc26-47f8-8a0f-883e86f5e0ba None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:31.018116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763ae6-dc26-47f8-8a0f-883e86f5e0ba None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:31.018619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763ae6-dc26-47f8-8a0f-883e86f5e0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:31.058684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3608-4449-4928-a29d-b650befcb510 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:31.059100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3608-4449-4928-a29d-b650befcb510 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:31.059740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3608-4449-4928-a29d-b650befcb510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:31.083751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a3763ae6-dc26-47f8-8a0f-883e86f5e0ba None None] MFA Rules not processed for user `d54b1c5c00544be4b60132d09817c8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:31.096914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a3763ae6-dc26-47f8-8a0f-883e86f5e0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:31.120185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8ebe3608-4449-4928-a29d-b650befcb510 None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:31.123037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8ebe3608-4449-4928-a29d-b650befcb510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:31.172577 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1309/2653] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:53:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:53:31.214441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe3608-4449-4928-a29d-b650befcb510 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:31.224895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe3608-4449-4928-a29d-b650befcb510 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:31.240726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c96057-c608-489c-8a11-e3a882203256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:31.243047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96057-c608-489c-8a11-e3a882203256 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:31.244059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96057-c608-489c-8a11-e3a882203256 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:31.245085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96057-c608-489c-8a11-e3a882203256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:31.274931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c96057-c608-489c-8a11-e3a882203256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:31.277499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c96057-c608-489c-8a11-e3a882203256 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:31.297486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:31.309257 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1310/2654] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:53:31.311001 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1345/2655] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:53:32.017689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c96057-c608-489c-8a11-e3a882203256 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:32.020231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-63c96057-c608-489c-8a11-e3a882203256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:32.052368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c96057-c608-489c-8a11-e3a882203256 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:32.068485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5b2c5-efef-498d-9152-ccbd33eef844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:32.070292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5b2c5-efef-498d-9152-ccbd33eef844 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:32.070768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5b2c5-efef-498d-9152-ccbd33eef844 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:32.071239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5b2c5-efef-498d-9152-ccbd33eef844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:32.073424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-50c5b2c5-efef-498d-9152-ccbd33eef844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:32.094411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5b2c5-efef-498d-9152-ccbd33eef844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:32.099073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5b2c5-efef-498d-9152-ccbd33eef844 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:32.116518 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1311/2656] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:32 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:32.637913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3763ae6-dc26-47f8-8a0f-883e86f5e0ba None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:32.640757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a3763ae6-dc26-47f8-8a0f-883e86f5e0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:32.705633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3763ae6-dc26-47f8-8a0f-883e86f5e0ba None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:32.741454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:32.745352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:32.746448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:32.746931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] PATH_INFO: `/v3/projects/3331a006d83d4c9c830633976a243b53` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:32.749136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3331a006d83d4c9c830633976a243b53)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:32.752610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:32.866696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3331a006d83d4c9c830633976a243b53', 'request_id': 'req-1d13f806-c28b-4d11-8b21-079868f11602'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:32.880843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3331a006d83d4c9c830633976a243b53', 'request_id': 'req-1d13f806-c28b-4d11-8b21-079868f11602'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:32.890724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3331a006d83d4c9c830633976a243b53', 'request_id': 'req-1d13f806-c28b-4d11-8b21-079868f11602'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:32.933720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] The token cache is being invalidate because project 3331a006d83d4c9c830633976a243b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:32.934059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:32.934767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:32.938179 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1346/2657] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:32 2022] DELETE /identity/v3/projects/3331a006d83d4c9c830633976a243b53 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:32.942803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5b2c5-efef-498d-9152-ccbd33eef844 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:32.958667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5b2c5-efef-498d-9152-ccbd33eef844 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:33.106120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9dcbd-1a66-46e1-ace4-7ae7ce8fa87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:33.107690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9dcbd-1a66-46e1-ace4-7ae7ce8fa87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:33.108973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9dcbd-1a66-46e1-ace4-7ae7ce8fa87d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:33.109163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9dcbd-1a66-46e1-ace4-7ae7ce8fa87d admin admin] PATH_INFO: `/v3/users/56e2d202846647e9906ea68f2ffa7f95` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:33.113612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9dcbd-1a66-46e1-ace4-7ae7ce8fa87d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e2d202846647e9906ea68f2ffa7f95)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:33.117003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9dcbd-1a66-46e1-ace4-7ae7ce8fa87d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:33.245296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-76e9dcbd-1a66-46e1-ace4-7ae7ce8fa87d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e2d202846647e9906ea68f2ffa7f95'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:33.272245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-76e9dcbd-1a66-46e1-ace4-7ae7ce8fa87d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e2d202846647e9906ea68f2ffa7f95'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:33.274531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-76e9dcbd-1a66-46e1-ace4-7ae7ce8fa87d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e2d202846647e9906ea68f2ffa7f95'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:33.281241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-76e9dcbd-1a66-46e1-ace4-7ae7ce8fa87d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e2d202846647e9906ea68f2ffa7f95'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:33.308055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-76e9dcbd-1a66-46e1-ace4-7ae7ce8fa87d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e2d202846647e9906ea68f2ffa7f95'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:33.346941 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1312/2658] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:32 2022] DELETE /identity/v3/users/56e2d202846647e9906ea68f2ffa7f95 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:34.882548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:34.884534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:34.916454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13f806-c28b-4d11-8b21-079868f11602 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:34.947693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:35.085485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:35.086196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:35.086473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:35.086751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb admin admin] PATH_INFO: `/v3/projects/a16ac9abd6054698bfb9e72d0b88469a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:35.096078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16ac9abd6054698bfb9e72d0b88469a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:35.098294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:35.192968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16ac9abd6054698bfb9e72d0b88469a', 'request_id': 'req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:35.214134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16ac9abd6054698bfb9e72d0b88469a', 'request_id': 'req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:35.220716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16ac9abd6054698bfb9e72d0b88469a', 'request_id': 'req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:35.251081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb admin admin] The token cache is being invalidate because project a16ac9abd6054698bfb9e72d0b88469a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:35.251369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:35.252626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-67c2f3b8-9b0c-47a9-9d29-f4b83ddfc6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:35.255162 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1347/2659] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:34 2022] DELETE /identity/v3/projects/a16ac9abd6054698bfb9e72d0b88469a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:35.262951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb87d-1bf2-43ce-bf03-50f0a20a2852 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:35.263539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb87d-1bf2-43ce-bf03-50f0a20a2852 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:35.264270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb87d-1bf2-43ce-bf03-50f0a20a2852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:35.314440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e2bfb87d-1bf2-43ce-bf03-50f0a20a2852 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:35.317787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e2bfb87d-1bf2-43ce-bf03-50f0a20a2852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:35.532723 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1313/2660] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:35.540816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62685bd8-f114-477a-9a49-cabd825de0ca None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:35.541911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62685bd8-f114-477a-9a49-cabd825de0ca None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:35.542732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62685bd8-f114-477a-9a49-cabd825de0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:35.585398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-62685bd8-f114-477a-9a49-cabd825de0ca None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:35.587059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-62685bd8-f114-477a-9a49-cabd825de0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:35.603328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb87d-1bf2-43ce-bf03-50f0a20a2852 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:35.620556 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1348/2661] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:35.622913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb87d-1bf2-43ce-bf03-50f0a20a2852 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:35.629592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1fde2-40e8-4dc0-be72-eae7aff8a94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:35.630622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1fde2-40e8-4dc0-be72-eae7aff8a94e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:35.630912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1fde2-40e8-4dc0-be72-eae7aff8a94e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:35.631188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1fde2-40e8-4dc0-be72-eae7aff8a94e admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:35.632166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1fde2-40e8-4dc0-be72-eae7aff8a94e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:53:35.632517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1fde2-40e8-4dc0-be72-eae7aff8a94e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:35.634175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1fde2-40e8-4dc0-be72-eae7aff8a94e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:35.637858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:35.661959 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1314/2662] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:53:35.666429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62685bd8-f114-477a-9a49-cabd825de0ca None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:35.682876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62685bd8-f114-477a-9a49-cabd825de0ca None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:35.698223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bf77b-7754-4647-9158-baa5b299f3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:35.699211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bf77b-7754-4647-9158-baa5b299f3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:35.699762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bf77b-7754-4647-9158-baa5b299f3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:35.700248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bf77b-7754-4647-9158-baa5b299f3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:35.701163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bf77b-7754-4647-9158-baa5b299f3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:35.704051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bf77b-7754-4647-9158-baa5b299f3d9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:35.807337 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1349/2663] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:35 2022] POST /identity/v3/projects => generated 405 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:35.811336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1fde2-40e8-4dc0-be72-eae7aff8a94e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:35.831888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1fde2-40e8-4dc0-be72-eae7aff8a94e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:36.001292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e99fd-5317-409a-abd9-c241d9225896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:36.002126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e99fd-5317-409a-abd9-c241d9225896 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:36.002409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e99fd-5317-409a-abd9-c241d9225896 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:36.002741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e99fd-5317-409a-abd9-c241d9225896 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:36.003437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e99fd-5317-409a-abd9-c241d9225896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:36.006504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e99fd-5317-409a-abd9-c241d9225896 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:36.069591 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1315/2664] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:35 2022] POST /identity/v3/users => generated 303 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:36.070116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bf77b-7754-4647-9158-baa5b299f3d9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:36.086614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bf77b-7754-4647-9158-baa5b299f3d9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:36.106490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc8668-1566-4c1f-a1c7-66b28043820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:36.110415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc8668-1566-4c1f-a1c7-66b28043820f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:36.110858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc8668-1566-4c1f-a1c7-66b28043820f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:36.112132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc8668-1566-4c1f-a1c7-66b28043820f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:36.114075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc8668-1566-4c1f-a1c7-66b28043820f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:36.117805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc8668-1566-4c1f-a1c7-66b28043820f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:36.166479 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1350/2665] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:53:36.170951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e99fd-5317-409a-abd9-c241d9225896 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:36.204926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e99fd-5317-409a-abd9-c241d9225896 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:36.241534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5197c7-326f-4d1d-b39f-902cf0a9fb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:36.244331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5197c7-326f-4d1d-b39f-902cf0a9fb64 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:36.245546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5197c7-326f-4d1d-b39f-902cf0a9fb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:36.247371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5197c7-326f-4d1d-b39f-902cf0a9fb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:36.248288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5197c7-326f-4d1d-b39f-902cf0a9fb64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:36.253766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5197c7-326f-4d1d-b39f-902cf0a9fb64 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:36.291829 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1316/2666] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:36.294002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc8668-1566-4c1f-a1c7-66b28043820f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:36.316014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc8668-1566-4c1f-a1c7-66b28043820f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:36.330376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfaeef-a293-4081-a068-c27db3acdee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:36.331328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfaeef-a293-4081-a068-c27db3acdee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:36.332553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfaeef-a293-4081-a068-c27db3acdee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:36.333019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfaeef-a293-4081-a068-c27db3acdee5 admin admin] PATH_INFO: `/v3/projects/7cb9284bfccb4ed6800b83e13b4a54f4/users/63ff2a5ba26244ac80dc887943494f5e/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:36.376633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfaeef-a293-4081-a068-c27db3acdee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb9284bfccb4ed6800b83e13b4a54f4, user_id=63ff2a5ba26244ac80dc887943494f5e, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:36.379659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfaeef-a293-4081-a068-c27db3acdee5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:36.397381 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1351/2667] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:36 2022] PUT /identity/v3/projects/7cb9284bfccb4ed6800b83e13b4a54f4/users/63ff2a5ba26244ac80dc887943494f5e/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:36.408639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c1121-b4d7-41c8-b412-d8cb53a37389 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:36.408931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c1121-b4d7-41c8-b412-d8cb53a37389 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:36.409269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c1121-b4d7-41c8-b412-d8cb53a37389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:36.446853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e12c1121-b4d7-41c8-b412-d8cb53a37389 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:36.448969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e12c1121-b4d7-41c8-b412-d8cb53a37389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:36.630825 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1317/2668] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:37.138741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfaeef-a293-4081-a068-c27db3acdee5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:37.150257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-01bfaeef-a293-4081-a068-c27db3acdee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:37.266408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:37.310670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfaeef-a293-4081-a068-c27db3acdee5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:37.331151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da53ee-6469-4c89-9ac3-d964271a9786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:37.341088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da53ee-6469-4c89-9ac3-d964271a9786 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:37.341854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da53ee-6469-4c89-9ac3-d964271a9786 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:37.342428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da53ee-6469-4c89-9ac3-d964271a9786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:37.378235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da53ee-6469-4c89-9ac3-d964271a9786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:37.382064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da53ee-6469-4c89-9ac3-d964271a9786 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:37.431528 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1352/2669] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:39.335412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c1121-b4d7-41c8-b412-d8cb53a37389 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:39.336987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e12c1121-b4d7-41c8-b412-d8cb53a37389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:39.365710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c1121-b4d7-41c8-b412-d8cb53a37389 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:39.375953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a79774-c97e-4833-a2cc-e7ceccd9d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:39.376706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79774-c97e-4833-a2cc-e7ceccd9d9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:39.377245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79774-c97e-4833-a2cc-e7ceccd9d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:39.377738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79774-c97e-4833-a2cc-e7ceccd9d9cf admin admin] PATH_INFO: `/v3/users/360660f7bb4746c8b1397f4857f423f2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:39.379145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a79774-c97e-4833-a2cc-e7ceccd9d9cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=360660f7bb4746c8b1397f4857f423f2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:39.381342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a79774-c97e-4833-a2cc-e7ceccd9d9cf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:39.400733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da53ee-6469-4c89-9ac3-d964271a9786 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:39.403021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-91da53ee-6469-4c89-9ac3-d964271a9786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:39.451885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da53ee-6469-4c89-9ac3-d964271a9786 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:39.490155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698402da-3777-4dfc-a33c-d6931cdae5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:39.498668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698402da-3777-4dfc-a33c-d6931cdae5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:39.501401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698402da-3777-4dfc-a33c-d6931cdae5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:39.501789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96a79774-c97e-4833-a2cc-e7ceccd9d9cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '360660f7bb4746c8b1397f4857f423f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:39.503084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698402da-3777-4dfc-a33c-d6931cdae5e1 admin admin] PATH_INFO: `/v3/users/2cb78cce5f7c4c348045745f40b13129` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:39.509975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698402da-3777-4dfc-a33c-d6931cdae5e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb78cce5f7c4c348045745f40b13129)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:39.518171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96a79774-c97e-4833-a2cc-e7ceccd9d9cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '360660f7bb4746c8b1397f4857f423f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:39.519692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698402da-3777-4dfc-a33c-d6931cdae5e1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:39.520634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96a79774-c97e-4833-a2cc-e7ceccd9d9cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '360660f7bb4746c8b1397f4857f423f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:39.522351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96a79774-c97e-4833-a2cc-e7ceccd9d9cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '360660f7bb4746c8b1397f4857f423f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:39.555795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:39.574060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96a79774-c97e-4833-a2cc-e7ceccd9d9cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '360660f7bb4746c8b1397f4857f423f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:39.622722 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1318/2670] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:39 2022] DELETE /identity/v3/users/360660f7bb4746c8b1397f4857f423f2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:39.624943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc35628-a201-42b9-8b37-7510b5eee9ae None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:39.625394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc35628-a201-42b9-8b37-7510b5eee9ae None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:39.625810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc35628-a201-42b9-8b37-7510b5eee9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:39.677304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dcc35628-a201-42b9-8b37-7510b5eee9ae None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:39.677545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-698402da-3777-4dfc-a33c-d6931cdae5e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb78cce5f7c4c348045745f40b13129'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:39.681700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dcc35628-a201-42b9-8b37-7510b5eee9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:39.694986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-698402da-3777-4dfc-a33c-d6931cdae5e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb78cce5f7c4c348045745f40b13129'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:39.708977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-698402da-3777-4dfc-a33c-d6931cdae5e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb78cce5f7c4c348045745f40b13129'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:39.710959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-698402da-3777-4dfc-a33c-d6931cdae5e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb78cce5f7c4c348045745f40b13129'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:39.743022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-698402da-3777-4dfc-a33c-d6931cdae5e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb78cce5f7c4c348045745f40b13129'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:39.782629 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1353/2671] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:39 2022] DELETE /identity/v3/users/2cb78cce5f7c4c348045745f40b13129 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:39.784846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9facc-f50c-4d5e-8eaa-c5a01304ee43 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:39.785394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9facc-f50c-4d5e-8eaa-c5a01304ee43 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:39.787545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9facc-f50c-4d5e-8eaa-c5a01304ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:39.836517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7be9facc-f50c-4d5e-8eaa-c5a01304ee43 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:39.838367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7be9facc-f50c-4d5e-8eaa-c5a01304ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:39.866447 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1319/2672] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:39.944540 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1354/2673] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:40.027864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc35628-a201-42b9-8b37-7510b5eee9ae None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:40.029722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dcc35628-a201-42b9-8b37-7510b5eee9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:40.166156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc35628-a201-42b9-8b37-7510b5eee9ae None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:40.290130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7111c51-772d-410f-8324-dc2dd25aba53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:40.290635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9facc-f50c-4d5e-8eaa-c5a01304ee43 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:40.291129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7111c51-772d-410f-8324-dc2dd25aba53 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:40.291564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7111c51-772d-410f-8324-dc2dd25aba53 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:40.291991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7111c51-772d-410f-8324-dc2dd25aba53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:40.292181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7be9facc-f50c-4d5e-8eaa-c5a01304ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:40.315384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7111c51-772d-410f-8324-dc2dd25aba53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:40.321350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7111c51-772d-410f-8324-dc2dd25aba53 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:40.336724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9facc-f50c-4d5e-8eaa-c5a01304ee43 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:40.349708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a39194-3eb6-498d-81ea-0cbb699b4d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:40.350735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a39194-3eb6-498d-81ea-0cbb699b4d36 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:40.352999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a39194-3eb6-498d-81ea-0cbb699b4d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:40.354546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a39194-3eb6-498d-81ea-0cbb699b4d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:40.368976 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1320/2674] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:40.408987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a39194-3eb6-498d-81ea-0cbb699b4d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:40.412304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a39194-3eb6-498d-81ea-0cbb699b4d36 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:40.441334 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1355/2675] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:42.029069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7111c51-772d-410f-8324-dc2dd25aba53 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:42.031286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a7111c51-772d-410f-8324-dc2dd25aba53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:42.070078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7111c51-772d-410f-8324-dc2dd25aba53 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:42.086528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27e921-53b3-48a0-9535-1198c2c13032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:42.087117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27e921-53b3-48a0-9535-1198c2c13032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:42.087596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27e921-53b3-48a0-9535-1198c2c13032 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:42.088084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27e921-53b3-48a0-9535-1198c2c13032 admin admin] PATH_INFO: `/v3/projects/6d702b3083bc4cf5ba6b6fc6f3c3147e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:42.090634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27e921-53b3-48a0-9535-1198c2c13032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d702b3083bc4cf5ba6b6fc6f3c3147e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:42.093399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27e921-53b3-48a0-9535-1198c2c13032 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:42.168861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:42.183975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac27e921-53b3-48a0-9535-1198c2c13032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'request_id': 'req-ac27e921-53b3-48a0-9535-1198c2c13032'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.209094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac27e921-53b3-48a0-9535-1198c2c13032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'request_id': 'req-ac27e921-53b3-48a0-9535-1198c2c13032'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.215478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac27e921-53b3-48a0-9535-1198c2c13032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'request_id': 'req-ac27e921-53b3-48a0-9535-1198c2c13032'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.237691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac27e921-53b3-48a0-9535-1198c2c13032 admin admin] The token cache is being invalidate because project 6d702b3083bc4cf5ba6b6fc6f3c3147e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:42.238364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac27e921-53b3-48a0-9535-1198c2c13032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.242837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac27e921-53b3-48a0-9535-1198c2c13032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.248127 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1321/2676] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:42 2022] DELETE /identity/v3/projects/6d702b3083bc4cf5ba6b6fc6f3c3147e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:42.249977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a39194-3eb6-498d-81ea-0cbb699b4d36 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:42.271033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a39194-3eb6-498d-81ea-0cbb699b4d36 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:42.338943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:42.356170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b643c-c6b9-4ccf-9d4b-079e129e08fd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:42.356428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b643c-c6b9-4ccf-9d4b-079e129e08fd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:42.357084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b643c-c6b9-4ccf-9d4b-079e129e08fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:42.361493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:42.363067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:42.364769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:42.365494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] PATH_INFO: `/v3/users/4b1b7b27c9b04fb897ebe2669d10c479` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:42.367509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1b7b27c9b04fb897ebe2669d10c479)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:42.370495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:42.413128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3a0b643c-c6b9-4ccf-9d4b-079e129e08fd None None] MFA Rules not processed for user `e729e2a59ddb47dfacfdb664dccf55a8`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:42.414892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3a0b643c-c6b9-4ccf-9d4b-079e129e08fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:42.494717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1b7b27c9b04fb897ebe2669d10c479'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.505669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1b7b27c9b04fb897ebe2669d10c479'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.506764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1b7b27c9b04fb897ebe2669d10c479'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.507443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1b7b27c9b04fb897ebe2669d10c479'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.529253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1b7b27c9b04fb897ebe2669d10c479'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.574738 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1356/2677] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:42 2022] DELETE /identity/v3/users/4b1b7b27c9b04fb897ebe2669d10c479 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:42.579102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:42.583170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:42.598995 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1322/2678] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:42.607788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b643c-c6b9-4ccf-9d4b-079e129e08fd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:42.610270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3a0b643c-c6b9-4ccf-9d4b-079e129e08fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:42.769397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261c3cf-8590-43c2-a3eb-d2741b4030c4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:42.780511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b643c-c6b9-4ccf-9d4b-079e129e08fd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:42.782444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:42.783106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:42.783384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:42.783660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] PATH_INFO: `/v3/projects/16530e0f2f0a4d23918261c9e21f9784` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:42.784867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] RBAC: Authorizing `identity:delete_project(project_id=16530e0f2f0a4d23918261c9e21f9784)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:42.786933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:42.899490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16530e0f2f0a4d23918261c9e21f9784', 'request_id': 'req-f491bc9e-1a34-463a-8910-47560b4f132a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.909628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:42.916089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16530e0f2f0a4d23918261c9e21f9784', 'request_id': 'req-f491bc9e-1a34-463a-8910-47560b4f132a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.927762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:42.931148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16530e0f2f0a4d23918261c9e21f9784', 'request_id': 'req-f491bc9e-1a34-463a-8910-47560b4f132a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.957949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5ad97-dc64-4cc8-8652-f5072e1051b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:42.958577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5ad97-dc64-4cc8-8652-f5072e1051b6 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:42.958854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5ad97-dc64-4cc8-8652-f5072e1051b6 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:42.959122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5ad97-dc64-4cc8-8652-f5072e1051b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:42.964040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] The token cache is being invalidate because project 16530e0f2f0a4d23918261c9e21f9784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:42.964331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.966992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:42.973861 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1357/2679] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:42 2022] DELETE /identity/v3/projects/16530e0f2f0a4d23918261c9e21f9784 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:42.974898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:42.977780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:43.084327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5ad97-dc64-4cc8-8652-f5072e1051b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:43.089822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5ad97-dc64-4cc8-8652-f5072e1051b6 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:43.116272 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1323/2680] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:53:43.121421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491bc9e-1a34-463a-8910-47560b4f132a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:43.128699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e0d29-59bc-4231-a606-d3bcc19c68a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:43.129493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0d29-59bc-4231-a606-d3bcc19c68a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:43.129983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0d29-59bc-4231-a606-d3bcc19c68a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:43.131059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0d29-59bc-4231-a606-d3bcc19c68a1 admin admin] PATH_INFO: `/v3/users/3c9dc54a05ec47d4863c4a3b44c92471` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:43.132526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e0d29-59bc-4231-a606-d3bcc19c68a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c9dc54a05ec47d4863c4a3b44c92471)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:43.134874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e0d29-59bc-4231-a606-d3bcc19c68a1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:43.203789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d42e0d29-59bc-4231-a606-d3bcc19c68a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c9dc54a05ec47d4863c4a3b44c92471'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:43.213342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d42e0d29-59bc-4231-a606-d3bcc19c68a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c9dc54a05ec47d4863c4a3b44c92471'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:43.215301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d42e0d29-59bc-4231-a606-d3bcc19c68a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c9dc54a05ec47d4863c4a3b44c92471'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:43.216217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d42e0d29-59bc-4231-a606-d3bcc19c68a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c9dc54a05ec47d4863c4a3b44c92471'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:43.238048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d42e0d29-59bc-4231-a606-d3bcc19c68a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c9dc54a05ec47d4863c4a3b44c92471'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:43.261248 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1358/2681] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:53:42 2022] DELETE /identity/v3/users/3c9dc54a05ec47d4863c4a3b44c92471 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:43.379325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5ad97-dc64-4cc8-8652-f5072e1051b6 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:43.381304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-23b5ad97-dc64-4cc8-8652-f5072e1051b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:43.413364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5ad97-dc64-4cc8-8652-f5072e1051b6 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:43.534275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:43.536272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:43.536670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:43.537009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc admin admin] PATH_INFO: `/v3/projects/dac5ccb4d1b74021ac5625851f88c009` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:43.538626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac5ccb4d1b74021ac5625851f88c009)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:43.542472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:43.637535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac5ccb4d1b74021ac5625851f88c009', 'request_id': 'req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:43.663350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac5ccb4d1b74021ac5625851f88c009', 'request_id': 'req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:43.674067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac5ccb4d1b74021ac5625851f88c009', 'request_id': 'req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:43.689159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc admin admin] The token cache is being invalidate because project dac5ccb4d1b74021ac5625851f88c009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:43.689743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:43.690681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8ed53805-13dd-4ee6-b1d4-f423214fd5bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:43.696898 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1324/2682] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:43 2022] DELETE /identity/v3/projects/dac5ccb4d1b74021ac5625851f88c009 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:43.698397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bce05a-493a-47dd-b56b-b4580b077588 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:43.698753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bce05a-493a-47dd-b56b-b4580b077588 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:43.699105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bce05a-493a-47dd-b56b-b4580b077588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:43.721922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-08bce05a-493a-47dd-b56b-b4580b077588 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:43.723517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-08bce05a-493a-47dd-b56b-b4580b077588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:43.856311 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1359/2683] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:53:43.859109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a2417-fa6b-407a-993d-de463ae4e599 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:43.859974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a2417-fa6b-407a-993d-de463ae4e599 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:43.860417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a2417-fa6b-407a-993d-de463ae4e599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:43.882152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4b3a2417-fa6b-407a-993d-de463ae4e599 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:43.883865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4b3a2417-fa6b-407a-993d-de463ae4e599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:43.900012 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1325/2684] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:43.901043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bce05a-493a-47dd-b56b-b4580b077588 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:43.917487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bce05a-493a-47dd-b56b-b4580b077588 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:43.925463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26540626-127d-493c-9c73-5c3c0c9b6840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:43.926088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26540626-127d-493c-9c73-5c3c0c9b6840 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:43.926542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26540626-127d-493c-9c73-5c3c0c9b6840 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:43.926674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26540626-127d-493c-9c73-5c3c0c9b6840 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:43.927280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26540626-127d-493c-9c73-5c3c0c9b6840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:53:43.927565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26540626-127d-493c-9c73-5c3c0c9b6840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:43.929223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26540626-127d-493c-9c73-5c3c0c9b6840 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:43.936537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:43.949717 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1360/2685] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:53:43.953382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a2417-fa6b-407a-993d-de463ae4e599 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:43.969175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a2417-fa6b-407a-993d-de463ae4e599 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:43.978054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe44b6-3a4f-4f5d-ac96-ca0dfeb49804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:43.980282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe44b6-3a4f-4f5d-ac96-ca0dfeb49804 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:43.980720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe44b6-3a4f-4f5d-ac96-ca0dfeb49804 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:43.981326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe44b6-3a4f-4f5d-ac96-ca0dfeb49804 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:43.983743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe44b6-3a4f-4f5d-ac96-ca0dfeb49804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:43.988507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe44b6-3a4f-4f5d-ac96-ca0dfeb49804 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:44.011875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:44.039146 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1326/2686] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:43 2022] POST /identity/v3/projects => generated 393 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:44.043024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26540626-127d-493c-9c73-5c3c0c9b6840 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:44.058183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26540626-127d-493c-9c73-5c3c0c9b6840 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:44.138936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59159a-cad1-4f72-92b0-2bbbf70e5b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:44.141700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59159a-cad1-4f72-92b0-2bbbf70e5b08 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:44.142199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59159a-cad1-4f72-92b0-2bbbf70e5b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:44.142982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59159a-cad1-4f72-92b0-2bbbf70e5b08 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:44.143983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59159a-cad1-4f72-92b0-2bbbf70e5b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:44.148161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59159a-cad1-4f72-92b0-2bbbf70e5b08 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:44.190908 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1361/2687] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:44 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:53:44.204254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe44b6-3a4f-4f5d-ac96-ca0dfeb49804 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:44.220076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe44b6-3a4f-4f5d-ac96-ca0dfeb49804 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:44.231513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70952eb9-8acb-4431-a27d-c3a5ef419a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:44.232135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70952eb9-8acb-4431-a27d-c3a5ef419a8f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:44.232414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70952eb9-8acb-4431-a27d-c3a5ef419a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:44.232681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70952eb9-8acb-4431-a27d-c3a5ef419a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:44.233442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70952eb9-8acb-4431-a27d-c3a5ef419a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:44.236087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70952eb9-8acb-4431-a27d-c3a5ef419a8f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:44.251948 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1327/2688] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:44.256327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59159a-cad1-4f72-92b0-2bbbf70e5b08 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:44.271366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59159a-cad1-4f72-92b0-2bbbf70e5b08 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:44.277340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120da5d-aa5b-4792-9cb6-a062a70a07a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:44.278005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120da5d-aa5b-4792-9cb6-a062a70a07a9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:44.278297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120da5d-aa5b-4792-9cb6-a062a70a07a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:44.278538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120da5d-aa5b-4792-9cb6-a062a70a07a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:44.279434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120da5d-aa5b-4792-9cb6-a062a70a07a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:44.282918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120da5d-aa5b-4792-9cb6-a062a70a07a9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:44.321452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70952eb9-8acb-4431-a27d-c3a5ef419a8f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:44.332041 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1362/2689] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:44.336292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70952eb9-8acb-4431-a27d-c3a5ef419a8f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:44.343405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601bf1f-3052-4cb0-91d9-e57b22d47315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:44.344711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601bf1f-3052-4cb0-91d9-e57b22d47315 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:44.344990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601bf1f-3052-4cb0-91d9-e57b22d47315 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:44.345289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601bf1f-3052-4cb0-91d9-e57b22d47315 admin admin] PATH_INFO: `/v3/projects/65a10eeae3da4b9a979b8c1167039014/users/2f72559f9cbb4544af3008e574d554ee/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:44.380331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601bf1f-3052-4cb0-91d9-e57b22d47315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a10eeae3da4b9a979b8c1167039014, user_id=2f72559f9cbb4544af3008e574d554ee, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:44.383131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601bf1f-3052-4cb0-91d9-e57b22d47315 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:44.409998 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1328/2690] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:44 2022] PUT /identity/v3/projects/65a10eeae3da4b9a979b8c1167039014/users/2f72559f9cbb4544af3008e574d554ee/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:44.423382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababb1ca-d2ce-4951-b548-0cdc43e6fc74 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:44.424114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababb1ca-d2ce-4951-b548-0cdc43e6fc74 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:44.424114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababb1ca-d2ce-4951-b548-0cdc43e6fc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:44.495733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ababb1ca-d2ce-4951-b548-0cdc43e6fc74 None None] MFA Rules not processed for user `2f72559f9cbb4544af3008e574d554ee`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:44.497049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ababb1ca-d2ce-4951-b548-0cdc43e6fc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:44.618833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601bf1f-3052-4cb0-91d9-e57b22d47315 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:44.620228 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1363/2691] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:44.628004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababb1ca-d2ce-4951-b548-0cdc43e6fc74 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:44.629439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ababb1ca-d2ce-4951-b548-0cdc43e6fc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:44.776864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababb1ca-d2ce-4951-b548-0cdc43e6fc74 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:44.781890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601bf1f-3052-4cb0-91d9-e57b22d47315 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:44.788209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043f453-e51f-4f17-ad52-5f51ff994dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:44.788866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043f453-e51f-4f17-ad52-5f51ff994dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:44.789142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043f453-e51f-4f17-ad52-5f51ff994dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:44.789464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043f453-e51f-4f17-ad52-5f51ff994dfc admin admin] PATH_INFO: `/v3/projects/abb9e8db275e48d8b505db56dc480f97` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:44.792481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043f453-e51f-4f17-ad52-5f51ff994dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb9e8db275e48d8b505db56dc480f97)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:44.794305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d859a-3964-429c-96bb-eb45d638135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:44.795004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d859a-3964-429c-96bb-eb45d638135e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:44.795290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d859a-3964-429c-96bb-eb45d638135e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:44.797509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043f453-e51f-4f17-ad52-5f51ff994dfc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:44.798701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d859a-3964-429c-96bb-eb45d638135e admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:44.799423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d859a-3964-429c-96bb-eb45d638135e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:44.804135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d859a-3964-429c-96bb-eb45d638135e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:44.815710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:44.880686 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1329/2692] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:44 2022] POST /identity/v3/projects => generated 391 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:44.882015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d859a-3964-429c-96bb-eb45d638135e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:44.944518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e043f453-e51f-4f17-ad52-5f51ff994dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb9e8db275e48d8b505db56dc480f97', 'request_id': 'req-e043f453-e51f-4f17-ad52-5f51ff994dfc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:44.967708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e043f453-e51f-4f17-ad52-5f51ff994dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb9e8db275e48d8b505db56dc480f97', 'request_id': 'req-e043f453-e51f-4f17-ad52-5f51ff994dfc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:44.978163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e043f453-e51f-4f17-ad52-5f51ff994dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb9e8db275e48d8b505db56dc480f97', 'request_id': 'req-e043f453-e51f-4f17-ad52-5f51ff994dfc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:44.996222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d859a-3964-429c-96bb-eb45d638135e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:45.005684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e043f453-e51f-4f17-ad52-5f51ff994dfc admin admin] The token cache is being invalidate because project abb9e8db275e48d8b505db56dc480f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:53:45.006536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e043f453-e51f-4f17-ad52-5f51ff994dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:45.008182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e043f453-e51f-4f17-ad52-5f51ff994dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:53:45.012782 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1364/2693] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:53:44 2022] DELETE /identity/v3/projects/abb9e8db275e48d8b505db56dc480f97 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:53:45.019389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdeb38-5d1b-4ec8-a6aa-ebcf166f7aa8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:45.019999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdeb38-5d1b-4ec8-a6aa-ebcf166f7aa8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:45.020405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdeb38-5d1b-4ec8-a6aa-ebcf166f7aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:45.063437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4afdeb38-5d1b-4ec8-a6aa-ebcf166f7aa8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:45.065200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4afdeb38-5d1b-4ec8-a6aa-ebcf166f7aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:45.082984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:45.100471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b5284-7daf-433e-985f-b2bf10645f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:45.101632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b5284-7daf-433e-985f-b2bf10645f3e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:45.102210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b5284-7daf-433e-985f-b2bf10645f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:45.102635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b5284-7daf-433e-985f-b2bf10645f3e admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:45.103998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b5284-7daf-433e-985f-b2bf10645f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:45.107011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b5284-7daf-433e-985f-b2bf10645f3e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:45.182959 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1330/2694] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:44 2022] POST /identity/v3/users => generated 302 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:45.187167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b5284-7daf-433e-985f-b2bf10645f3e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:45.189375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ae7b5284-7daf-433e-985f-b2bf10645f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:45.206265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b5284-7daf-433e-985f-b2bf10645f3e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:45.212375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614a755-d9b4-40b1-8a79-eb532022c1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:45.213457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614a755-d9b4-40b1-8a79-eb532022c1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:45.213903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614a755-d9b4-40b1-8a79-eb532022c1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:45.214337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614a755-d9b4-40b1-8a79-eb532022c1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:45.215585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614a755-d9b4-40b1-8a79-eb532022c1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:45.217494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614a755-d9b4-40b1-8a79-eb532022c1e7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:45.222799 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1365/2695] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:45.230485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582ab1d-a640-46b3-a8f9-b497f2596dce None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:45.230791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582ab1d-a640-46b3-a8f9-b497f2596dce None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:45.231076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582ab1d-a640-46b3-a8f9-b497f2596dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:45.241688 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1331/2696] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:45.246708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614a755-d9b4-40b1-8a79-eb532022c1e7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:45.278408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b582ab1d-a640-46b3-a8f9-b497f2596dce None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:45.279805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b582ab1d-a640-46b3-a8f9-b497f2596dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:45.279946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614a755-d9b4-40b1-8a79-eb532022c1e7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:45.287706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2012d3-0427-4258-9715-bbe0b99e62d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:45.290115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2012d3-0427-4258-9715-bbe0b99e62d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:45.290404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2012d3-0427-4258-9715-bbe0b99e62d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:45.290684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2012d3-0427-4258-9715-bbe0b99e62d2 admin admin] PATH_INFO: `/v3/projects/84c8793c7efa4d158f9c346fab39c923/users/d53fb3fbba5f4b419e00fbf075b62959/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:45.295480 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1366/2697] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:53:45.299744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582ab1d-a640-46b3-a8f9-b497f2596dce None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:45.313733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582ab1d-a640-46b3-a8f9-b497f2596dce None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:45.320319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fe980-127d-4337-8a80-ebdc40269017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:45.321278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fe980-127d-4337-8a80-ebdc40269017 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:45.321757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fe980-127d-4337-8a80-ebdc40269017 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:45.322208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fe980-127d-4337-8a80-ebdc40269017 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:45.324314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fe980-127d-4337-8a80-ebdc40269017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:53:45.324943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fe980-127d-4337-8a80-ebdc40269017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:45.329749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fe980-127d-4337-8a80-ebdc40269017 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:45.330807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2012d3-0427-4258-9715-bbe0b99e62d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c8793c7efa4d158f9c346fab39c923, user_id=d53fb3fbba5f4b419e00fbf075b62959, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:45.333929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2012d3-0427-4258-9715-bbe0b99e62d2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:45.349085 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1367/2698] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:53:45.353496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fe980-127d-4337-8a80-ebdc40269017 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:45.357154 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1332/2699] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:45 2022] PUT /identity/v3/projects/84c8793c7efa4d158f9c346fab39c923/users/d53fb3fbba5f4b419e00fbf075b62959/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:45.358961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2012d3-0427-4258-9715-bbe0b99e62d2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:45.384756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fe980-127d-4337-8a80-ebdc40269017 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:45.446455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2012d3-0427-4258-9715-bbe0b99e62d2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:45.452095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b01dd-1589-4cf1-9e51-ca20bb587d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:45.452932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b01dd-1589-4cf1-9e51-ca20bb587d59 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:45.453244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b01dd-1589-4cf1-9e51-ca20bb587d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:45.453747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b01dd-1589-4cf1-9e51-ca20bb587d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:45.454423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b01dd-1589-4cf1-9e51-ca20bb587d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:45.456057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b01dd-1589-4cf1-9e51-ca20bb587d59 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:45.470940 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1333/2700] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:45.495016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b01dd-1589-4cf1-9e51-ca20bb587d59 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:45.520282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b01dd-1589-4cf1-9e51-ca20bb587d59 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:45.538971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d49bb4-7554-4557-bcab-fa6f55463dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:45.538971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49bb4-7554-4557-bcab-fa6f55463dba admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:45.538971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49bb4-7554-4557-bcab-fa6f55463dba admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:45.538971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49bb4-7554-4557-bcab-fa6f55463dba admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:45.539409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d49bb4-7554-4557-bcab-fa6f55463dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:45.539883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5550b83-5abe-423a-95c1-c6c0a7a2f69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:45.540679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5550b83-5abe-423a-95c1-c6c0a7a2f69a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:45.540959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5550b83-5abe-423a-95c1-c6c0a7a2f69a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:45.541348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5550b83-5abe-423a-95c1-c6c0a7a2f69a admin admin] PATH_INFO: `/v3/projects/84c8793c7efa4d158f9c346fab39c923/users/d53fb3fbba5f4b419e00fbf075b62959/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:45.544894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5550b83-5abe-423a-95c1-c6c0a7a2f69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c8793c7efa4d158f9c346fab39c923, user_id=d53fb3fbba5f4b419e00fbf075b62959, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:45.547264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d49bb4-7554-4557-bcab-fa6f55463dba admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:45.553171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5550b83-5abe-423a-95c1-c6c0a7a2f69a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:45.585242 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1334/2701] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:45 2022] PUT /identity/v3/projects/84c8793c7efa4d158f9c346fab39c923/users/d53fb3fbba5f4b419e00fbf075b62959/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:45.627839 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1368/2702] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:45 2022] POST /identity/v3/projects => generated 379 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:53:45.631785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5550b83-5abe-423a-95c1-c6c0a7a2f69a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:45.677569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de23a6-6709-4db5-9fc8-5162190bbb55 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:45.677929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de23a6-6709-4db5-9fc8-5162190bbb55 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:45.678150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de23a6-6709-4db5-9fc8-5162190bbb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:45.685905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:45.728489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d2de23a6-6709-4db5-9fc8-5162190bbb55 None None] MFA Rules not processed for user `d53fb3fbba5f4b419e00fbf075b62959`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:45.729817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d2de23a6-6709-4db5-9fc8-5162190bbb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:45.819310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5550b83-5abe-423a-95c1-c6c0a7a2f69a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:45.853956 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1369/2703] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:45.880893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b45c4e-ea77-4e05-ab64-5f65fa6b6c1c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:45.881208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b45c4e-ea77-4e05-ab64-5f65fa6b6c1c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:45.881487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b45c4e-ea77-4e05-ab64-5f65fa6b6c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:45.907466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:45.933223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-85b45c4e-ea77-4e05-ab64-5f65fa6b6c1c None None] MFA Rules not processed for user `2f72559f9cbb4544af3008e574d554ee`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:45.935698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-85b45c4e-ea77-4e05-ab64-5f65fa6b6c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:45.962750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7c8f6-98ba-45d5-82b0-941771fe9908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:45.963443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7c8f6-98ba-45d5-82b0-941771fe9908 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:45.963663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7c8f6-98ba-45d5-82b0-941771fe9908 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:45.963935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7c8f6-98ba-45d5-82b0-941771fe9908 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:45.964574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7c8f6-98ba-45d5-82b0-941771fe9908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:45.966548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7c8f6-98ba-45d5-82b0-941771fe9908 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:46.043571 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1335/2704] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:45 2022] POST /identity/v3/users => generated 290 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:46.049071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7c8f6-98ba-45d5-82b0-941771fe9908 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:46.083911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7c8f6-98ba-45d5-82b0-941771fe9908 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:46.104721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b87dd-5bad-4a47-871f-be291ba7bf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:46.105548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b87dd-5bad-4a47-871f-be291ba7bf3e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:46.105982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b87dd-5bad-4a47-871f-be291ba7bf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:46.107409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b87dd-5bad-4a47-871f-be291ba7bf3e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:46.112437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b87dd-5bad-4a47-871f-be291ba7bf3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:46.118765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b87dd-5bad-4a47-871f-be291ba7bf3e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:46.135249 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1370/2705] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:46.150404 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1336/2706] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:46.154266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b45c4e-ea77-4e05-ab64-5f65fa6b6c1c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:46.172922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b45c4e-ea77-4e05-ab64-5f65fa6b6c1c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:46.188262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcd256-3e4d-41b9-bd07-391e3b4e579a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:46.188902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcd256-3e4d-41b9-bd07-391e3b4e579a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:46.189175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcd256-3e4d-41b9-bd07-391e3b4e579a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:46.189486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcd256-3e4d-41b9-bd07-391e3b4e579a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:46.190155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcd256-3e4d-41b9-bd07-391e3b4e579a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:46.191757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcd256-3e4d-41b9-bd07-391e3b4e579a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:46.208507 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1371/2707] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:46.216417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b87dd-5bad-4a47-871f-be291ba7bf3e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:46.255760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b87dd-5bad-4a47-871f-be291ba7bf3e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:46.271918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff010f-8653-41bc-86f1-c6fc80dcc0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:46.272942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff010f-8653-41bc-86f1-c6fc80dcc0e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:46.273413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff010f-8653-41bc-86f1-c6fc80dcc0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:46.273845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff010f-8653-41bc-86f1-c6fc80dcc0e0 admin admin] PATH_INFO: `/v3/projects/6a09d8f87c174336a1d216e396adfd33/users/68e264d0c2b54a5f8d1bd197b84a104a/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:46.316871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff010f-8653-41bc-86f1-c6fc80dcc0e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a09d8f87c174336a1d216e396adfd33, user_id=68e264d0c2b54a5f8d1bd197b84a104a, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:46.320541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff010f-8653-41bc-86f1-c6fc80dcc0e0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:46.346887 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1337/2708] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:46 2022] PUT /identity/v3/projects/6a09d8f87c174336a1d216e396adfd33/users/68e264d0c2b54a5f8d1bd197b84a104a/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:46.352197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300a3d6-3502-4d00-aa05-49446351c6c3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:46.352604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300a3d6-3502-4d00-aa05-49446351c6c3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:46.353360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300a3d6-3502-4d00-aa05-49446351c6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:46.388385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9300a3d6-3502-4d00-aa05-49446351c6c3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:46.390120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9300a3d6-3502-4d00-aa05-49446351c6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:46.513043 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1372/2709] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:46.538550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff010f-8653-41bc-86f1-c6fc80dcc0e0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:46.540954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-68ff010f-8653-41bc-86f1-c6fc80dcc0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:46.700088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff010f-8653-41bc-86f1-c6fc80dcc0e0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:46.711118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa3d1d-8d3b-4634-9425-c43ce97074e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:46.712884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa3d1d-8d3b-4634-9425-c43ce97074e4 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:46.713167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa3d1d-8d3b-4634-9425-c43ce97074e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:46.713463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa3d1d-8d3b-4634-9425-c43ce97074e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:46.744140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa3d1d-8d3b-4634-9425-c43ce97074e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:46.747042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa3d1d-8d3b-4634-9425-c43ce97074e4 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:46.776066 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1338/2710] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:46.977805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300a3d6-3502-4d00-aa05-49446351c6c3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:46.979584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9300a3d6-3502-4d00-aa05-49446351c6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:47.053900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:47.184713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300a3d6-3502-4d00-aa05-49446351c6c3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:47.194692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f930c-9546-4273-a067-fa8fbd91fdcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:47.196509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f930c-9546-4273-a067-fa8fbd91fdcc service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:47.196816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f930c-9546-4273-a067-fa8fbd91fdcc service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:47.197101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f930c-9546-4273-a067-fa8fbd91fdcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:47.204115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d59f930c-9546-4273-a067-fa8fbd91fdcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:47.295197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f930c-9546-4273-a067-fa8fbd91fdcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:47.297654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f930c-9546-4273-a067-fa8fbd91fdcc service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:47.311496 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1373/2711] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:52.303137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a27435-68bc-4374-b737-8d045d593ca8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:52.303752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a27435-68bc-4374-b737-8d045d593ca8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:52.303929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a27435-68bc-4374-b737-8d045d593ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:52.346904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e0a27435-68bc-4374-b737-8d045d593ca8 None None] MFA Rules not processed for user `63ff2a5ba26244ac80dc887943494f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:52.348599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e0a27435-68bc-4374-b737-8d045d593ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:52.616928 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1339/2712] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:52 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:52.621585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f930c-9546-4273-a067-fa8fbd91fdcc service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:52.623057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d59f930c-9546-4273-a067-fa8fbd91fdcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:52.644753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f930c-9546-4273-a067-fa8fbd91fdcc service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:52.666172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528f617-3612-44c7-ba17-17c741defa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:52.669018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528f617-3612-44c7-ba17-17c741defa7b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:52.669364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528f617-3612-44c7-ba17-17c741defa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:52.669842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528f617-3612-44c7-ba17-17c741defa7b admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:52.672159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528f617-3612-44c7-ba17-17c741defa7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:52.674768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528f617-3612-44c7-ba17-17c741defa7b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:52.758018 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1374/2713] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:53:52 2022] POST /identity/v3/projects => generated 405 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:52.762963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a27435-68bc-4374-b737-8d045d593ca8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:52.782506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a27435-68bc-4374-b737-8d045d593ca8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:52.812214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:52.877491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed12501-56ef-4fe1-902b-3afe0b58d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:52.878384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed12501-56ef-4fe1-902b-3afe0b58d17e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:52.880592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed12501-56ef-4fe1-902b-3afe0b58d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:52.880990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed12501-56ef-4fe1-902b-3afe0b58d17e admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:52.881797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed12501-56ef-4fe1-902b-3afe0b58d17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:52.884841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed12501-56ef-4fe1-902b-3afe0b58d17e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:52.940253 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1340/2714] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:53:52 2022] POST /identity/v3/users => generated 309 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:53:52.944482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528f617-3612-44c7-ba17-17c741defa7b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:52.959577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528f617-3612-44c7-ba17-17c741defa7b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:52.985922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953578a4-bcec-431c-8987-49fd1220cfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:52.988311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953578a4-bcec-431c-8987-49fd1220cfcb admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:52.989449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953578a4-bcec-431c-8987-49fd1220cfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:52.989805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953578a4-bcec-431c-8987-49fd1220cfcb admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:52.991730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953578a4-bcec-431c-8987-49fd1220cfcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:52.995748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953578a4-bcec-431c-8987-49fd1220cfcb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:53.035824 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1375/2715] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:53.037158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed12501-56ef-4fe1-902b-3afe0b58d17e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:53.052557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed12501-56ef-4fe1-902b-3afe0b58d17e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:53.071954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83bcd6-3753-4eda-8877-151108986f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:53.072648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83bcd6-3753-4eda-8877-151108986f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:53.073055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83bcd6-3753-4eda-8877-151108986f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:53.073398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83bcd6-3753-4eda-8877-151108986f1a admin admin] PATH_INFO: `/v3/projects/db71ecf35c014e3d97554da83faba8f4/users/76d3901fef7c4564a5bcdc6bf540bf47/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:53.103775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83bcd6-3753-4eda-8877-151108986f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db71ecf35c014e3d97554da83faba8f4, user_id=76d3901fef7c4564a5bcdc6bf540bf47, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:53.110519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83bcd6-3753-4eda-8877-151108986f1a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:53.131679 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1341/2716] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:53 2022] PUT /identity/v3/projects/db71ecf35c014e3d97554da83faba8f4/users/76d3901fef7c4564a5bcdc6bf540bf47/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:53.135689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953578a4-bcec-431c-8987-49fd1220cfcb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:53.149459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953578a4-bcec-431c-8987-49fd1220cfcb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:53.241180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee771eb-54fa-4f62-8b6c-40c963bc0584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:53.242247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee771eb-54fa-4f62-8b6c-40c963bc0584 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:53.242711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee771eb-54fa-4f62-8b6c-40c963bc0584 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:53.243325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee771eb-54fa-4f62-8b6c-40c963bc0584 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:53.244381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee771eb-54fa-4f62-8b6c-40c963bc0584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:53.248068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee771eb-54fa-4f62-8b6c-40c963bc0584 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:53.269845 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1376/2717] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:53:53.274452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83bcd6-3753-4eda-8877-151108986f1a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:53.296560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83bcd6-3753-4eda-8877-151108986f1a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:53.304265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03592607-7f39-4226-8feb-b681586e8ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:53.306285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03592607-7f39-4226-8feb-b681586e8ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:53.306846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03592607-7f39-4226-8feb-b681586e8ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:53.307581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03592607-7f39-4226-8feb-b681586e8ac6 admin admin] PATH_INFO: `/v3/projects/db71ecf35c014e3d97554da83faba8f4/users/76d3901fef7c4564a5bcdc6bf540bf47/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:53.311832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03592607-7f39-4226-8feb-b681586e8ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db71ecf35c014e3d97554da83faba8f4, user_id=76d3901fef7c4564a5bcdc6bf540bf47, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:53.315653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03592607-7f39-4226-8feb-b681586e8ac6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:53.332738 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1342/2718] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:53:53 2022] PUT /identity/v3/projects/db71ecf35c014e3d97554da83faba8f4/users/76d3901fef7c4564a5bcdc6bf540bf47/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:53:54.624976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee771eb-54fa-4f62-8b6c-40c963bc0584 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:54.679032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:54.771344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee771eb-54fa-4f62-8b6c-40c963bc0584 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:54.912746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c162ca-8207-4baf-9e31-1e4dddef336c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:54.914049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c162ca-8207-4baf-9e31-1e4dddef336c service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:54.914359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c162ca-8207-4baf-9e31-1e4dddef336c service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:54.914641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c162ca-8207-4baf-9e31-1e4dddef336c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:55.022715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c162ca-8207-4baf-9e31-1e4dddef336c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:55.026670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c162ca-8207-4baf-9e31-1e4dddef336c service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:55.039866 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1377/2719] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:54 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:55.726499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03592607-7f39-4226-8feb-b681586e8ac6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:55.746163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03592607-7f39-4226-8feb-b681586e8ac6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:55.756356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b873ce-032f-4609-8784-65753c6843d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:55.757770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b873ce-032f-4609-8784-65753c6843d2 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:55.758265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b873ce-032f-4609-8784-65753c6843d2 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:55.758707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b873ce-032f-4609-8784-65753c6843d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:55.760759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d0b873ce-032f-4609-8784-65753c6843d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:55.874609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b873ce-032f-4609-8784-65753c6843d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:55.878336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b873ce-032f-4609-8784-65753c6843d2 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:55.921622 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1343/2720] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:53:57.725540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c162ca-8207-4baf-9e31-1e4dddef336c service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:57.727131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d2c162ca-8207-4baf-9e31-1e4dddef336c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:57.781879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c162ca-8207-4baf-9e31-1e4dddef336c service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:57.796513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d1768-1e44-4be2-8503-05fe99c8ed3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:57.797500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1768-1e44-4be2-8503-05fe99c8ed3e service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:57.797954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1768-1e44-4be2-8503-05fe99c8ed3e service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:57.798378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1768-1e44-4be2-8503-05fe99c8ed3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:57.800730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b30d1768-1e44-4be2-8503-05fe99c8ed3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:57.933719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:57.961399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d1768-1e44-4be2-8503-05fe99c8ed3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:57.966947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d1768-1e44-4be2-8503-05fe99c8ed3e service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:58.000933 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1378/2721] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:57 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:53:58.401081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9844723-90f3-4f75-8361-c105d9e4b853 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:58.402002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9844723-90f3-4f75-8361-c105d9e4b853 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:58.402435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9844723-90f3-4f75-8361-c105d9e4b853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:58.465860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b9844723-90f3-4f75-8361-c105d9e4b853 None None] MFA Rules not processed for user `68e264d0c2b54a5f8d1bd197b84a104a`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:58.476547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b9844723-90f3-4f75-8361-c105d9e4b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:58.616849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:58.636620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ba42-2a09-4adc-97a1-7d2ce80f3398 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:58.636995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ba42-2a09-4adc-97a1-7d2ce80f3398 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:58.637210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ba42-2a09-4adc-97a1-7d2ce80f3398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:58.637421 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1344/2722] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:58.672186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3109ba42-2a09-4adc-97a1-7d2ce80f3398 None None] MFA Rules not processed for user `68e264d0c2b54a5f8d1bd197b84a104a`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:58.673461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3109ba42-2a09-4adc-97a1-7d2ce80f3398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:58.696959 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1379/2723] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:58.893445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dfe3a-43bf-4bec-a74b-d31cae0b33b5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:58.894144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dfe3a-43bf-4bec-a74b-d31cae0b33b5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:58.894665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dfe3a-43bf-4bec-a74b-d31cae0b33b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:58.923406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-368dfe3a-43bf-4bec-a74b-d31cae0b33b5 None None] MFA Rules not processed for user `474ca64d1b1d4e30916b517645aba882`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:53:58.928040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-368dfe3a-43bf-4bec-a74b-d31cae0b33b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:53:59.067495 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1345/2724] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:53:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:53:59.205720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109ba42-2a09-4adc-97a1-7d2ce80f3398 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:53:59.227352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109ba42-2a09-4adc-97a1-7d2ce80f3398 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:53:59.238261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa54d27-22ed-4d38-9d5f-75206350578d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:53:59.239381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa54d27-22ed-4d38-9d5f-75206350578d service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:53:59.239725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa54d27-22ed-4d38-9d5f-75206350578d service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:53:59.240084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa54d27-22ed-4d38-9d5f-75206350578d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:53:59.264340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa54d27-22ed-4d38-9d5f-75206350578d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:53:59.266508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa54d27-22ed-4d38-9d5f-75206350578d service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:53:59.285212 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1380/2725] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:53:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:03.571631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f566f-1dd3-4771-8e70-5fea9713df9c None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:03.579153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f566f-1dd3-4771-8e70-5fea9713df9c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:03.579899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f566f-1dd3-4771-8e70-5fea9713df9c None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:03.583334 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1346/2726] 10.222.0.26 () {54 vars in 921 bytes} [Sat Oct 8 20:54:03 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:54:03.591315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a166313-62aa-4436-8a2e-fa4b35436fa8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:03.592815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a166313-62aa-4436-8a2e-fa4b35436fa8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:03.593361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a166313-62aa-4436-8a2e-fa4b35436fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:03.619500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9a166313-62aa-4436-8a2e-fa4b35436fa8 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:03.621701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9a166313-62aa-4436-8a2e-fa4b35436fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:03.665032 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1381/2727] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:04.169775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f566f-1dd3-4771-8e70-5fea9713df9c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:04.263174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f566f-1dd3-4771-8e70-5fea9713df9c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:04.269090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a940ad0-8c78-43da-aae0-2aafccc2f764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:04.269915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a940ad0-8c78-43da-aae0-2aafccc2f764 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:04.270195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a940ad0-8c78-43da-aae0-2aafccc2f764 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:04.270464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a940ad0-8c78-43da-aae0-2aafccc2f764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:04.302838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a940ad0-8c78-43da-aae0-2aafccc2f764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:04.321008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184806-0d8d-4e5f-8ac7-17ca0ddb89f6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:04.321483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184806-0d8d-4e5f-8ac7-17ca0ddb89f6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:04.321604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184806-0d8d-4e5f-8ac7-17ca0ddb89f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:04.322831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a940ad0-8c78-43da-aae0-2aafccc2f764 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:04.343526 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1347/2728] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:04.382397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8b184806-0d8d-4e5f-8ac7-17ca0ddb89f6 None None] MFA Rules not processed for user `76d3901fef7c4564a5bcdc6bf540bf47`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:04.384587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8b184806-0d8d-4e5f-8ac7-17ca0ddb89f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:04.394353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6882-2df7-45be-89c6-12851bc7bc41 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:04.394887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6882-2df7-45be-89c6-12851bc7bc41 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:04.395512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6882-2df7-45be-89c6-12851bc7bc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:04.439867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-91bb6882-2df7-45be-89c6-12851bc7bc41 None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:04.445860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-91bb6882-2df7-45be-89c6-12851bc7bc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:04.472230 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1348/2729] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:54:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:54:04.530840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb6882-2df7-45be-89c6-12851bc7bc41 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:04.543302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb6882-2df7-45be-89c6-12851bc7bc41 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:04.552111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ef058-a393-4a9b-bb88-daff803c53ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:04.552735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ef058-a393-4a9b-bb88-daff803c53ee service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:04.553072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ef058-a393-4a9b-bb88-daff803c53ee service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:04.553447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ef058-a393-4a9b-bb88-daff803c53ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:04.554477 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1382/2730] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:04 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:04.577831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ef058-a393-4a9b-bb88-daff803c53ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:04.579335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ef058-a393-4a9b-bb88-daff803c53ee service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:04.597272 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1349/2731] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:54:12.233812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e763bd-1246-42a8-ba22-87d1bd7f003e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:12.234827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e763bd-1246-42a8-ba22-87d1bd7f003e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:12.235137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e763bd-1246-42a8-ba22-87d1bd7f003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:12.262127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c3e763bd-1246-42a8-ba22-87d1bd7f003e None None] MFA Rules not processed for user `98936da9b5d94165b386d2d0893ac142`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:12.273471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c3e763bd-1246-42a8-ba22-87d1bd7f003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:12.452336 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1383/2732] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:12 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:12.625056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2abe-9b3d-4c84-930b-3904964ab1bb None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:12.625621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2abe-9b3d-4c84-930b-3904964ab1bb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:12.625726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2abe-9b3d-4c84-930b-3904964ab1bb None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:12.627402 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1350/2733] 10.222.0.26 () {54 vars in 921 bytes} [Sat Oct 8 20:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:54:12.637479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479ef38-7b9f-41d8-a83d-eeb30c7df5ec None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:12.638038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479ef38-7b9f-41d8-a83d-eeb30c7df5ec None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:12.638362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479ef38-7b9f-41d8-a83d-eeb30c7df5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:12.661632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8479ef38-7b9f-41d8-a83d-eeb30c7df5ec None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:12.662853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8479ef38-7b9f-41d8-a83d-eeb30c7df5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:12.718498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:12.748809 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1384/2734] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:54:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:12.773809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c2abe-9b3d-4c84-930b-3904964ab1bb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:12.775627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d70c2abe-9b3d-4c84-930b-3904964ab1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:12.799093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c2abe-9b3d-4c84-930b-3904964ab1bb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:12.805620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852366b-f858-4980-a202-cf658253ae86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:12.806798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852366b-f858-4980-a202-cf658253ae86 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:12.807369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852366b-f858-4980-a202-cf658253ae86 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:12.807827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852366b-f858-4980-a202-cf658253ae86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:12.817808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852366b-f858-4980-a202-cf658253ae86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:12.819781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852366b-f858-4980-a202-cf658253ae86 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:12.849281 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1351/2735] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:19.185373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479ef38-7b9f-41d8-a83d-eeb30c7df5ec None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:19.197801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479ef38-7b9f-41d8-a83d-eeb30c7df5ec None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:19.205324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35f975-02fc-4ace-995d-6471372451b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:19.206399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35f975-02fc-4ace-995d-6471372451b3 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:19.207407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35f975-02fc-4ace-995d-6471372451b3 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:19.207689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35f975-02fc-4ace-995d-6471372451b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:19.209914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bb35f975-02fc-4ace-995d-6471372451b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:19.222180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35f975-02fc-4ace-995d-6471372451b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:19.224000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35f975-02fc-4ace-995d-6471372451b3 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:19.235262 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1385/2736] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:20.601271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852366b-f858-4980-a202-cf658253ae86 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:20.602515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5852366b-f858-4980-a202-cf658253ae86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:20.724431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852366b-f858-4980-a202-cf658253ae86 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:20.731615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:20.733886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:20.734459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:20.735805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] PATH_INFO: `/v3/users/e729e2a59ddb47dfacfdb664dccf55a8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:20.738211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e729e2a59ddb47dfacfdb664dccf55a8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:20.741034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:20.767019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:20.823712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e729e2a59ddb47dfacfdb664dccf55a8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:20.836828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e729e2a59ddb47dfacfdb664dccf55a8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:20.839198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e729e2a59ddb47dfacfdb664dccf55a8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:20.841165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e729e2a59ddb47dfacfdb664dccf55a8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:20.866063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e729e2a59ddb47dfacfdb664dccf55a8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:20.898281 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1352/2737] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:54:20 2022] DELETE /identity/v3/users/e729e2a59ddb47dfacfdb664dccf55a8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:21.589963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35f975-02fc-4ace-995d-6471372451b3 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:21.625134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35f975-02fc-4ace-995d-6471372451b3 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:21.734703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:21.736258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:21.808662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:21.809427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:21.809770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:21.810108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c admin admin] PATH_INFO: `/v3/projects/80eccd9b8a0a485ca72e1faa29a481d9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:21.811871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c admin admin] RBAC: Authorizing `identity:delete_project(project_id=80eccd9b8a0a485ca72e1faa29a481d9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:21.813888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:21.861038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca9d10-0346-454c-a843-b6ef2e95692d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:21.898040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80eccd9b8a0a485ca72e1faa29a481d9', 'request_id': 'req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:21.905351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc5d0e-3cf0-43e0-9154-8edb0018e55e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:21.907293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc5d0e-3cf0-43e0-9154-8edb0018e55e service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:21.908505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc5d0e-3cf0-43e0-9154-8edb0018e55e service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:21.911134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc5d0e-3cf0-43e0-9154-8edb0018e55e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:21.914919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5dfc5d0e-3cf0-43e0-9154-8edb0018e55e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:21.920909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80eccd9b8a0a485ca72e1faa29a481d9', 'request_id': 'req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:21.960780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80eccd9b8a0a485ca72e1faa29a481d9', 'request_id': 'req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:21.978438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc5d0e-3cf0-43e0-9154-8edb0018e55e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:21.980285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc5d0e-3cf0-43e0-9154-8edb0018e55e service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:21.981240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c admin admin] The token cache is being invalidate because project 80eccd9b8a0a485ca72e1faa29a481d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:54:21.981930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:21.983135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3c1cee4e-67cb-4c46-8b45-77c0f3a6840c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:21.985908 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1386/2738] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:21 2022] DELETE /identity/v3/projects/80eccd9b8a0a485ca72e1faa29a481d9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:21.994222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc42062-3b22-425c-8f83-da6c5daf5024 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:21.994516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc42062-3b22-425c-8f83-da6c5daf5024 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:21.994795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc42062-3b22-425c-8f83-da6c5daf5024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:22.005570 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1353/2739] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:22.039343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0cc42062-3b22-425c-8f83-da6c5daf5024 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:22.040565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0cc42062-3b22-425c-8f83-da6c5daf5024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:22.063389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b401e-f631-47df-be2f-fed537bc1e9d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:22.063910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b401e-f631-47df-be2f-fed537bc1e9d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:22.064795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b401e-f631-47df-be2f-fed537bc1e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:22.115462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-892b401e-f631-47df-be2f-fed537bc1e9d None None] MFA Rules not processed for user `d54b1c5c00544be4b60132d09817c8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:22.116648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-892b401e-f631-47df-be2f-fed537bc1e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:22.145377 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1387/2740] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:22.147019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb33b8-36d2-4562-ab06-de33f223966d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:22.147515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb33b8-36d2-4562-ab06-de33f223966d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:22.147990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb33b8-36d2-4562-ab06-de33f223966d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:22.159630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:22.173011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cfbb33b8-36d2-4562-ab06-de33f223966d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:22.175604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cfbb33b8-36d2-4562-ab06-de33f223966d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:22.189272 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1388/2741] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:22.190652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb33b8-36d2-4562-ab06-de33f223966d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:22.216958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb33b8-36d2-4562-ab06-de33f223966d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:22.222209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e31f7-d6c9-49a2-9594-8af483306da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:22.222775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e31f7-d6c9-49a2-9594-8af483306da7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:22.222991 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1354/2742] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:22.223461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e31f7-d6c9-49a2-9594-8af483306da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:22.223732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e31f7-d6c9-49a2-9594-8af483306da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:22.224604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e31f7-d6c9-49a2-9594-8af483306da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:54:22.225108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e31f7-d6c9-49a2-9594-8af483306da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:22.226715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e31f7-d6c9-49a2-9594-8af483306da7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:22.245365 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1389/2743] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:54:22.245956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b401e-f631-47df-be2f-fed537bc1e9d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:22.269906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b401e-f631-47df-be2f-fed537bc1e9d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:22.282770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3b33d-d5ff-4ab4-ae42-499578e9ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:22.284740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3b33d-d5ff-4ab4-ae42-499578e9ce60 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:22.285990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3b33d-d5ff-4ab4-ae42-499578e9ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:22.286456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3b33d-d5ff-4ab4-ae42-499578e9ce60 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:22.287103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3b33d-d5ff-4ab4-ae42-499578e9ce60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:22.291580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3b33d-d5ff-4ab4-ae42-499578e9ce60 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:22.342531 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1355/2744] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:54:22 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:54:22.347695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e31f7-d6c9-49a2-9594-8af483306da7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:22.365761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e31f7-d6c9-49a2-9594-8af483306da7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:22.443669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bced2-5577-4c1b-a03a-318dfda84a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:22.444429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bced2-5577-4c1b-a03a-318dfda84a51 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:22.444818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bced2-5577-4c1b-a03a-318dfda84a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:22.445161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bced2-5577-4c1b-a03a-318dfda84a51 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:22.445913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bced2-5577-4c1b-a03a-318dfda84a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:22.448099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bced2-5577-4c1b-a03a-318dfda84a51 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:22.477298 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1390/2745] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:54:22 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:54:22.482644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3b33d-d5ff-4ab4-ae42-499578e9ce60 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:22.492038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:22.498001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3b33d-d5ff-4ab4-ae42-499578e9ce60 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:22.504550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e40596-5ebd-4111-a8b0-4efcc31fad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:22.505560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e40596-5ebd-4111-a8b0-4efcc31fad3e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:22.505954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e40596-5ebd-4111-a8b0-4efcc31fad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:22.506662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e40596-5ebd-4111-a8b0-4efcc31fad3e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:22.507539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e40596-5ebd-4111-a8b0-4efcc31fad3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:22.510085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e40596-5ebd-4111-a8b0-4efcc31fad3e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:22.525579 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1356/2746] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:22.529889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bced2-5577-4c1b-a03a-318dfda84a51 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:22.549839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bced2-5577-4c1b-a03a-318dfda84a51 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:22.566854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25440-b4b0-4f1e-a593-12adc0a117ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:22.567678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25440-b4b0-4f1e-a593-12adc0a117ed admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:22.568225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25440-b4b0-4f1e-a593-12adc0a117ed admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:22.568470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25440-b4b0-4f1e-a593-12adc0a117ed admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:22.569351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b25440-b4b0-4f1e-a593-12adc0a117ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:22.572197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b25440-b4b0-4f1e-a593-12adc0a117ed admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:22.590619 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1391/2747] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:54:22.602028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e40596-5ebd-4111-a8b0-4efcc31fad3e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:22.621875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25440-b4b0-4f1e-a593-12adc0a117ed admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:22.628009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e40596-5ebd-4111-a8b0-4efcc31fad3e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:22.632034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a2b25440-b4b0-4f1e-a593-12adc0a117ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:22.646922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecaff07-b453-42c6-9254-f2d36d8fd3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:22.647605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaff07-b453-42c6-9254-f2d36d8fd3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:22.647883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaff07-b453-42c6-9254-f2d36d8fd3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:22.648156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaff07-b453-42c6-9254-f2d36d8fd3c8 admin admin] PATH_INFO: `/v3/projects/de62b954fc67442cb9b0e2ea6e37414f/users/f82f5f91550d44f599d4aa33c34864dc/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:22.666811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25440-b4b0-4f1e-a593-12adc0a117ed admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:22.683626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:22.685408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:22.686382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:22.686815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] PATH_INFO: `/v3/users/63ff2a5ba26244ac80dc887943494f5e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:22.687759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecaff07-b453-42c6-9254-f2d36d8fd3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de62b954fc67442cb9b0e2ea6e37414f, user_id=f82f5f91550d44f599d4aa33c34864dc, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:22.690542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ff2a5ba26244ac80dc887943494f5e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:22.698171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecaff07-b453-42c6-9254-f2d36d8fd3c8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:22.699825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:22.734837 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1357/2748] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:54:22 2022] PUT /identity/v3/projects/de62b954fc67442cb9b0e2ea6e37414f/users/f82f5f91550d44f599d4aa33c34864dc/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:54:22.747052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be7522-991d-40f7-b789-cf99a6e1f782 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:22.747347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be7522-991d-40f7-b789-cf99a6e1f782 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:22.747624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be7522-991d-40f7-b789-cf99a6e1f782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:22.787071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-39be7522-991d-40f7-b789-cf99a6e1f782 None None] MFA Rules not processed for user `f82f5f91550d44f599d4aa33c34864dc`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:22.789793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-39be7522-991d-40f7-b789-cf99a6e1f782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:22.800216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ff2a5ba26244ac80dc887943494f5e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:22.814830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ff2a5ba26244ac80dc887943494f5e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:22.815930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ff2a5ba26244ac80dc887943494f5e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:22.816915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ff2a5ba26244ac80dc887943494f5e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:22.833056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ff2a5ba26244ac80dc887943494f5e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:22.862645 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1392/2749] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:54:22 2022] DELETE /identity/v3/users/63ff2a5ba26244ac80dc887943494f5e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:22.880205 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1358/2750] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:54:23.194224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:23.197075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:23.221049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be7522-991d-40f7-b789-cf99a6e1f782 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:23.222557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-39be7522-991d-40f7-b789-cf99a6e1f782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:23.277880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:23.309317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a138601-686a-433a-bd7a-612acfec1cb0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:23.314693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:23.315347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:23.315629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:23.315910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] PATH_INFO: `/v3/projects/7cb9284bfccb4ed6800b83e13b4a54f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:23.319237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb9284bfccb4ed6800b83e13b4a54f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:23.321340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:23.323270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be7522-991d-40f7-b789-cf99a6e1f782 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:23.378606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb9284bfccb4ed6800b83e13b4a54f4', 'request_id': 'req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:23.386837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:23.388399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb9284bfccb4ed6800b83e13b4a54f4', 'request_id': 'req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:23.396699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb9284bfccb4ed6800b83e13b4a54f4', 'request_id': 'req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:23.401596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad174ae9-2b5f-421c-9f2d-c511f1e7dda6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:23.402217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad174ae9-2b5f-421c-9f2d-c511f1e7dda6 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:23.402501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad174ae9-2b5f-421c-9f2d-c511f1e7dda6 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:23.402781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad174ae9-2b5f-421c-9f2d-c511f1e7dda6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:23.408670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] The token cache is being invalidate because project 7cb9284bfccb4ed6800b83e13b4a54f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:54:23.409005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:23.410207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:23.411886 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1393/2751] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:23 2022] DELETE /identity/v3/projects/7cb9284bfccb4ed6800b83e13b4a54f4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:23.415564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:23.417214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:23.472702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad174ae9-2b5f-421c-9f2d-c511f1e7dda6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:23.481399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad174ae9-2b5f-421c-9f2d-c511f1e7dda6 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:23.498878 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1359/2752] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:54:23.511727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07c307-865e-419c-ad1d-a8d7fa9e8f8d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:23.517980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4aa819-64bb-4f11-9a10-4e43c716bfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:23.518709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4aa819-64bb-4f11-9a10-4e43c716bfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:23.519071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4aa819-64bb-4f11-9a10-4e43c716bfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:23.519713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4aa819-64bb-4f11-9a10-4e43c716bfaf admin admin] PATH_INFO: `/v3/users/76d3901fef7c4564a5bcdc6bf540bf47` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:23.521040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4aa819-64bb-4f11-9a10-4e43c716bfaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d3901fef7c4564a5bcdc6bf540bf47)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:23.523401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4aa819-64bb-4f11-9a10-4e43c716bfaf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:23.585330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a4aa819-64bb-4f11-9a10-4e43c716bfaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d3901fef7c4564a5bcdc6bf540bf47'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:23.594369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a4aa819-64bb-4f11-9a10-4e43c716bfaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d3901fef7c4564a5bcdc6bf540bf47'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:23.595182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a4aa819-64bb-4f11-9a10-4e43c716bfaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d3901fef7c4564a5bcdc6bf540bf47'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:23.596661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a4aa819-64bb-4f11-9a10-4e43c716bfaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d3901fef7c4564a5bcdc6bf540bf47'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:23.606263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:23.612549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a4aa819-64bb-4f11-9a10-4e43c716bfaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d3901fef7c4564a5bcdc6bf540bf47'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:23.634413 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1394/2753] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:54:23 2022] DELETE /identity/v3/users/76d3901fef7c4564a5bcdc6bf540bf47 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:54:23.907550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad174ae9-2b5f-421c-9f2d-c511f1e7dda6 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:23.949394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad174ae9-2b5f-421c-9f2d-c511f1e7dda6 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:24.082157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf68efd-e077-4717-9587-0ea5306a9a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:24.085870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf68efd-e077-4717-9587-0ea5306a9a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:24.086227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf68efd-e077-4717-9587-0ea5306a9a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:24.087864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf68efd-e077-4717-9587-0ea5306a9a0f admin admin] PATH_INFO: `/v3/projects/db71ecf35c014e3d97554da83faba8f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:24.091252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf68efd-e077-4717-9587-0ea5306a9a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=db71ecf35c014e3d97554da83faba8f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:24.096330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf68efd-e077-4717-9587-0ea5306a9a0f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:24.188751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7bf68efd-e077-4717-9587-0ea5306a9a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db71ecf35c014e3d97554da83faba8f4', 'request_id': 'req-7bf68efd-e077-4717-9587-0ea5306a9a0f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:24.204083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7bf68efd-e077-4717-9587-0ea5306a9a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db71ecf35c014e3d97554da83faba8f4', 'request_id': 'req-7bf68efd-e077-4717-9587-0ea5306a9a0f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:24.215244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7bf68efd-e077-4717-9587-0ea5306a9a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db71ecf35c014e3d97554da83faba8f4', 'request_id': 'req-7bf68efd-e077-4717-9587-0ea5306a9a0f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:24.257756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7bf68efd-e077-4717-9587-0ea5306a9a0f admin admin] The token cache is being invalidate because project db71ecf35c014e3d97554da83faba8f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:54:24.257984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7bf68efd-e077-4717-9587-0ea5306a9a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:24.260534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7bf68efd-e077-4717-9587-0ea5306a9a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:24.265931 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1360/2754] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:23 2022] DELETE /identity/v3/projects/db71ecf35c014e3d97554da83faba8f4 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:24.267699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75edb35-2cc3-4064-bfce-84c32f49a2fd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:24.268054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75edb35-2cc3-4064-bfce-84c32f49a2fd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:24.268430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75edb35-2cc3-4064-bfce-84c32f49a2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:24.320784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b75edb35-2cc3-4064-bfce-84c32f49a2fd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:24.322291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b75edb35-2cc3-4064-bfce-84c32f49a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:24.453442 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1395/2755] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:24.461289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb521ba9-4c62-4360-99e7-3d8a5dfa48c1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:24.461923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb521ba9-4c62-4360-99e7-3d8a5dfa48c1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:24.462356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb521ba9-4c62-4360-99e7-3d8a5dfa48c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:24.507856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cb521ba9-4c62-4360-99e7-3d8a5dfa48c1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:24.513361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cb521ba9-4c62-4360-99e7-3d8a5dfa48c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:24.571010 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1361/2756] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:24.572219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75edb35-2cc3-4064-bfce-84c32f49a2fd None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:24.586857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75edb35-2cc3-4064-bfce-84c32f49a2fd None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:24.595329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c66c81-4e14-4b37-8f78-3bae176d173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:24.595957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66c81-4e14-4b37-8f78-3bae176d173b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:24.596335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66c81-4e14-4b37-8f78-3bae176d173b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:24.596678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66c81-4e14-4b37-8f78-3bae176d173b admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:24.597568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c66c81-4e14-4b37-8f78-3bae176d173b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:54:24.597943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c66c81-4e14-4b37-8f78-3bae176d173b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:24.599600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c66c81-4e14-4b37-8f78-3bae176d173b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:24.619949 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1396/2757] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:54:24.624778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb521ba9-4c62-4360-99e7-3d8a5dfa48c1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:24.639766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb521ba9-4c62-4360-99e7-3d8a5dfa48c1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:24.651982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae514c2-1ae6-4f36-9a38-e825bced8aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:24.652842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae514c2-1ae6-4f36-9a38-e825bced8aab admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:24.653129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae514c2-1ae6-4f36-9a38-e825bced8aab admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:24.653452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae514c2-1ae6-4f36-9a38-e825bced8aab admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:24.654251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae514c2-1ae6-4f36-9a38-e825bced8aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:24.657395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae514c2-1ae6-4f36-9a38-e825bced8aab admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:24.676910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:24.696142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c66c81-4e14-4b37-8f78-3bae176d173b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:24.704796 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1362/2758] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:54:24 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:54:24.709004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c66c81-4e14-4b37-8f78-3bae176d173b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:24.823342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e3fa1-0d4d-41e3-af66-39ac86aa04be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:24.824085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3fa1-0d4d-41e3-af66-39ac86aa04be admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:24.824366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3fa1-0d4d-41e3-af66-39ac86aa04be admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:24.824691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3fa1-0d4d-41e3-af66-39ac86aa04be admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:24.825480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e3fa1-0d4d-41e3-af66-39ac86aa04be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:24.827712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e3fa1-0d4d-41e3-af66-39ac86aa04be admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:24.855806 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1397/2759] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:54:24 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:54:24.860276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae514c2-1ae6-4f36-9a38-e825bced8aab admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:24.874956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae514c2-1ae6-4f36-9a38-e825bced8aab admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:24.880801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7b18f-adf2-44ee-b67e-6862c069fc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:24.882314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7b18f-adf2-44ee-b67e-6862c069fc23 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:24.882838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7b18f-adf2-44ee-b67e-6862c069fc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:24.883500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7b18f-adf2-44ee-b67e-6862c069fc23 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:24.884397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7b18f-adf2-44ee-b67e-6862c069fc23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:24.886454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7b18f-adf2-44ee-b67e-6862c069fc23 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:24.901093 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1363/2760] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:24.905686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e3fa1-0d4d-41e3-af66-39ac86aa04be admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:24.918754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e3fa1-0d4d-41e3-af66-39ac86aa04be admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:24.926051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70a581-e281-4573-96f8-4da028649a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:24.927180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70a581-e281-4573-96f8-4da028649a8b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:24.927711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70a581-e281-4573-96f8-4da028649a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:24.928295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70a581-e281-4573-96f8-4da028649a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:24.929179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70a581-e281-4573-96f8-4da028649a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:24.931083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70a581-e281-4573-96f8-4da028649a8b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:24.947196 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1398/2761] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:24.952222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7b18f-adf2-44ee-b67e-6862c069fc23 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:24.972149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7b18f-adf2-44ee-b67e-6862c069fc23 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:24.986547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded7569-1c47-4488-b5d3-e0cb49f76704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:24.987683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded7569-1c47-4488-b5d3-e0cb49f76704 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:24.988398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded7569-1c47-4488-b5d3-e0cb49f76704 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:24.989068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded7569-1c47-4488-b5d3-e0cb49f76704 admin admin] PATH_INFO: `/v3/projects/d340283be3b640cba49addd0de8d368f/users/03f62e0626944d26b5883fae9b0e581b/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:25.017084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded7569-1c47-4488-b5d3-e0cb49f76704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d340283be3b640cba49addd0de8d368f, user_id=03f62e0626944d26b5883fae9b0e581b, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:25.020475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded7569-1c47-4488-b5d3-e0cb49f76704 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:25.046590 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1364/2762] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:54:24 2022] PUT /identity/v3/projects/d340283be3b640cba49addd0de8d368f/users/03f62e0626944d26b5883fae9b0e581b/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:25.059167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e9a48-55c3-4171-90b5-9039d48e79f5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:25.059452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e9a48-55c3-4171-90b5-9039d48e79f5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:25.059990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e9a48-55c3-4171-90b5-9039d48e79f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:25.120097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d05e9a48-55c3-4171-90b5-9039d48e79f5 None None] MFA Rules not processed for user `03f62e0626944d26b5883fae9b0e581b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:25.122201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d05e9a48-55c3-4171-90b5-9039d48e79f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:25.155816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded7569-1c47-4488-b5d3-e0cb49f76704 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:25.157851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bded7569-1c47-4488-b5d3-e0cb49f76704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:25.200333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:25.233602 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1399/2763] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:25.238286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e9a48-55c3-4171-90b5-9039d48e79f5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:25.319017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded7569-1c47-4488-b5d3-e0cb49f76704 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:25.325478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23439e73-b42d-405d-bbc2-6d40e20fd8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:25.327020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23439e73-b42d-405d-bbc2-6d40e20fd8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:25.327510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23439e73-b42d-405d-bbc2-6d40e20fd8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:25.327961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23439e73-b42d-405d-bbc2-6d40e20fd8eb admin admin] PATH_INFO: `/v3/users/f82f5f91550d44f599d4aa33c34864dc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:25.329420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23439e73-b42d-405d-bbc2-6d40e20fd8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82f5f91550d44f599d4aa33c34864dc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:25.331933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23439e73-b42d-405d-bbc2-6d40e20fd8eb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:25.367044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e9a48-55c3-4171-90b5-9039d48e79f5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:25.380016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b6ebd-225f-40c6-90ba-6e204ef8d8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:25.381046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b6ebd-225f-40c6-90ba-6e204ef8d8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:25.381835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b6ebd-225f-40c6-90ba-6e204ef8d8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:25.382309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b6ebd-225f-40c6-90ba-6e204ef8d8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:25.383904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b6ebd-225f-40c6-90ba-6e204ef8d8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:25.391556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b6ebd-225f-40c6-90ba-6e204ef8d8e1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:25.416291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-23439e73-b42d-405d-bbc2-6d40e20fd8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82f5f91550d44f599d4aa33c34864dc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:25.428972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-23439e73-b42d-405d-bbc2-6d40e20fd8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82f5f91550d44f599d4aa33c34864dc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:25.430815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-23439e73-b42d-405d-bbc2-6d40e20fd8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82f5f91550d44f599d4aa33c34864dc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:25.432544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-23439e73-b42d-405d-bbc2-6d40e20fd8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82f5f91550d44f599d4aa33c34864dc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:25.457433 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1400/2764] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:54:25 2022] POST /identity/v3/projects => generated 387 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:54:25.458680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b6ebd-225f-40c6-90ba-6e204ef8d8e1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:25.460947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-180b6ebd-225f-40c6-90ba-6e204ef8d8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:25.461391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-23439e73-b42d-405d-bbc2-6d40e20fd8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82f5f91550d44f599d4aa33c34864dc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:25.507291 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1365/2765] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:54:25 2022] DELETE /identity/v3/users/f82f5f91550d44f599d4aa33c34864dc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:54:25.510001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecdd17-a15b-4f5a-b32a-8ba4c1f54c85 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:25.510293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecdd17-a15b-4f5a-b32a-8ba4c1f54c85 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:25.510571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecdd17-a15b-4f5a-b32a-8ba4c1f54c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:25.563804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-eaecdd17-a15b-4f5a-b32a-8ba4c1f54c85 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:25.565449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eaecdd17-a15b-4f5a-b32a-8ba4c1f54c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:25.622215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b6ebd-225f-40c6-90ba-6e204ef8d8e1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:25.648273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:25.684363 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1366/2766] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:25.703228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecdd17-a15b-4f5a-b32a-8ba4c1f54c85 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:25.705051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eaecdd17-a15b-4f5a-b32a-8ba4c1f54c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:25.754283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca135e5-d560-434b-860c-697b06f4ddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:25.755132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca135e5-d560-434b-860c-697b06f4ddec admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:25.755593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca135e5-d560-434b-860c-697b06f4ddec admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:25.755876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca135e5-d560-434b-860c-697b06f4ddec admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:25.757424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca135e5-d560-434b-860c-697b06f4ddec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:25.759686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca135e5-d560-434b-860c-697b06f4ddec admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:25.798305 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1401/2767] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:54:25 2022] POST /identity/v3/users => generated 300 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:54:25.802267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca135e5-d560-434b-860c-697b06f4ddec admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:25.808652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:25.816942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca135e5-d560-434b-860c-697b06f4ddec admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:25.820197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecdd17-a15b-4f5a-b32a-8ba4c1f54c85 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:25.824657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc587c-da50-44c7-ac07-f8852f18d988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:25.825338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc587c-da50-44c7-ac07-f8852f18d988 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:25.825627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc587c-da50-44c7-ac07-f8852f18d988 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:25.825889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc587c-da50-44c7-ac07-f8852f18d988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:25.825999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7b5ea-a0a3-4230-9586-1fbbda8e49d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:25.827234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7b5ea-a0a3-4230-9586-1fbbda8e49d8 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:25.827673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7b5ea-a0a3-4230-9586-1fbbda8e49d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:25.828013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7b5ea-a0a3-4230-9586-1fbbda8e49d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:25.829403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7b5ea-a0a3-4230-9586-1fbbda8e49d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:25.831375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7b5ea-a0a3-4230-9586-1fbbda8e49d8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:25.837978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc587c-da50-44c7-ac07-f8852f18d988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:25.839731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc587c-da50-44c7-ac07-f8852f18d988 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:25.848711 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1402/2768] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:25.850200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7b5ea-a0a3-4230-9586-1fbbda8e49d8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:25.855539 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1367/2769] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:25.866752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7b5ea-a0a3-4230-9586-1fbbda8e49d8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:25.872458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87642536-476d-41b9-8016-93a6e49a0c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:25.873894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87642536-476d-41b9-8016-93a6e49a0c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:25.874472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87642536-476d-41b9-8016-93a6e49a0c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:25.874822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87642536-476d-41b9-8016-93a6e49a0c29 admin admin] PATH_INFO: `/v3/projects/8d3f0d1e6c074a82b8eaab02d139a481/users/9834f9570e054995a78f3e3885628bdb/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:25.892580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87642536-476d-41b9-8016-93a6e49a0c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3f0d1e6c074a82b8eaab02d139a481, user_id=9834f9570e054995a78f3e3885628bdb, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:25.896039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87642536-476d-41b9-8016-93a6e49a0c29 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:25.922418 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1403/2770] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:54:25 2022] PUT /identity/v3/projects/8d3f0d1e6c074a82b8eaab02d139a481/users/9834f9570e054995a78f3e3885628bdb/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:54:25.926392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc587c-da50-44c7-ac07-f8852f18d988 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:25.939849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc587c-da50-44c7-ac07-f8852f18d988 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:26.050247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89047b46-c415-4671-a153-40a14df7c86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:26.050895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89047b46-c415-4671-a153-40a14df7c86c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:26.051164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89047b46-c415-4671-a153-40a14df7c86c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:26.051402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89047b46-c415-4671-a153-40a14df7c86c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:26.052062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89047b46-c415-4671-a153-40a14df7c86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:26.055010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89047b46-c415-4671-a153-40a14df7c86c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:26.068852 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1368/2771] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:26.073485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87642536-476d-41b9-8016-93a6e49a0c29 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:26.088975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87642536-476d-41b9-8016-93a6e49a0c29 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:26.099464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b132d2-a716-414e-aeb1-ef9c60aeb7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:26.100391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b132d2-a716-414e-aeb1-ef9c60aeb7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:26.100822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b132d2-a716-414e-aeb1-ef9c60aeb7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:26.101320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b132d2-a716-414e-aeb1-ef9c60aeb7b8 admin admin] PATH_INFO: `/v3/projects/8d3f0d1e6c074a82b8eaab02d139a481/users/9834f9570e054995a78f3e3885628bdb/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:26.103477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b132d2-a716-414e-aeb1-ef9c60aeb7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3f0d1e6c074a82b8eaab02d139a481, user_id=9834f9570e054995a78f3e3885628bdb, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:26.106361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b132d2-a716-414e-aeb1-ef9c60aeb7b8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:26.121092 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1404/2772] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:54:26 2022] PUT /identity/v3/projects/8d3f0d1e6c074a82b8eaab02d139a481/users/9834f9570e054995a78f3e3885628bdb/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:26.132327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3877f6-987e-4620-a05b-52d72245b413 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:26.132855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3877f6-987e-4620-a05b-52d72245b413 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:26.133276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3877f6-987e-4620-a05b-52d72245b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:26.193365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ef3877f6-987e-4620-a05b-52d72245b413 None None] MFA Rules not processed for user `9834f9570e054995a78f3e3885628bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:26.195974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ef3877f6-987e-4620-a05b-52d72245b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:26.314252 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1369/2773] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:26.451823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b132d2-a716-414e-aeb1-ef9c60aeb7b8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:26.454743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f7b132d2-a716-414e-aeb1-ef9c60aeb7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:26.594722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b132d2-a716-414e-aeb1-ef9c60aeb7b8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:26.599165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3877f6-987e-4620-a05b-52d72245b413 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:26.600811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ef3877f6-987e-4620-a05b-52d72245b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:26.603580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30357bfe-a266-429e-8418-7423c804f060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:26.604419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30357bfe-a266-429e-8418-7423c804f060 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:26.604874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30357bfe-a266-429e-8418-7423c804f060 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:26.605525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30357bfe-a266-429e-8418-7423c804f060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:26.610880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:26.622774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30357bfe-a266-429e-8418-7423c804f060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:26.625306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30357bfe-a266-429e-8418-7423c804f060 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:26.655686 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1405/2774] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:26.750638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3877f6-987e-4620-a05b-52d72245b413 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:26.766460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96876b64-7a98-44af-9bb9-8283f2144f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:26.767855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96876b64-7a98-44af-9bb9-8283f2144f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:26.767989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96876b64-7a98-44af-9bb9-8283f2144f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:26.768917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96876b64-7a98-44af-9bb9-8283f2144f6c admin admin] PATH_INFO: `/v3/projects/de62b954fc67442cb9b0e2ea6e37414f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:26.770864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96876b64-7a98-44af-9bb9-8283f2144f6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=de62b954fc67442cb9b0e2ea6e37414f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:26.776915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96876b64-7a98-44af-9bb9-8283f2144f6c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:26.963223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96876b64-7a98-44af-9bb9-8283f2144f6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de62b954fc67442cb9b0e2ea6e37414f', 'request_id': 'req-96876b64-7a98-44af-9bb9-8283f2144f6c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:26.979954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96876b64-7a98-44af-9bb9-8283f2144f6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de62b954fc67442cb9b0e2ea6e37414f', 'request_id': 'req-96876b64-7a98-44af-9bb9-8283f2144f6c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:27.007014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96876b64-7a98-44af-9bb9-8283f2144f6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de62b954fc67442cb9b0e2ea6e37414f', 'request_id': 'req-96876b64-7a98-44af-9bb9-8283f2144f6c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:27.034813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96876b64-7a98-44af-9bb9-8283f2144f6c admin admin] The token cache is being invalidate because project de62b954fc67442cb9b0e2ea6e37414f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:54:27.035449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96876b64-7a98-44af-9bb9-8283f2144f6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:27.036351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96876b64-7a98-44af-9bb9-8283f2144f6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:27.048228 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1370/2775] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:26 2022] DELETE /identity/v3/projects/de62b954fc67442cb9b0e2ea6e37414f => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:27.050078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46224ed2-f72d-41e7-8116-026847665b14 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:27.051107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46224ed2-f72d-41e7-8116-026847665b14 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:27.051508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46224ed2-f72d-41e7-8116-026847665b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:27.093720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-46224ed2-f72d-41e7-8116-026847665b14 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:27.095962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-46224ed2-f72d-41e7-8116-026847665b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:27.220688 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1406/2776] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:27.228998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55d365-7799-488c-8087-c64cfc1ddfd6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:27.229517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55d365-7799-488c-8087-c64cfc1ddfd6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:27.229629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55d365-7799-488c-8087-c64cfc1ddfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:27.269807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1c55d365-7799-488c-8087-c64cfc1ddfd6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:27.271722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1c55d365-7799-488c-8087-c64cfc1ddfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:27.284421 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1371/2777] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:27.288680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46224ed2-f72d-41e7-8116-026847665b14 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:27.303330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46224ed2-f72d-41e7-8116-026847665b14 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:27.312447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f88a43-d9e8-42b8-8c32-8c0683153118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:27.313229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f88a43-d9e8-42b8-8c32-8c0683153118 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:27.313552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f88a43-d9e8-42b8-8c32-8c0683153118 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:27.313838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f88a43-d9e8-42b8-8c32-8c0683153118 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:27.314481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f88a43-d9e8-42b8-8c32-8c0683153118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:54:27.314794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f88a43-d9e8-42b8-8c32-8c0683153118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:27.318604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f88a43-d9e8-42b8-8c32-8c0683153118 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:27.338838 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1407/2778] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:54:27.339443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55d365-7799-488c-8087-c64cfc1ddfd6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:27.350998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55d365-7799-488c-8087-c64cfc1ddfd6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:27.373478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f035d76-a5f0-4108-8b49-ba285f771bf2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:27.373869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f035d76-a5f0-4108-8b49-ba285f771bf2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:27.374250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f035d76-a5f0-4108-8b49-ba285f771bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:27.375147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76b014-54aa-41b1-ab4d-941509f47dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:27.375765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76b014-54aa-41b1-ab4d-941509f47dbc admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:27.378554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76b014-54aa-41b1-ab4d-941509f47dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:27.378554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76b014-54aa-41b1-ab4d-941509f47dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:27.378554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76b014-54aa-41b1-ab4d-941509f47dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:27.378916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76b014-54aa-41b1-ab4d-941509f47dbc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:27.410587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5f035d76-a5f0-4108-8b49-ba285f771bf2 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:27.413278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5f035d76-a5f0-4108-8b49-ba285f771bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:27.440619 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1372/2779] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:54:27 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:54:27.441928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76b014-54aa-41b1-ab4d-941509f47dbc admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:27.453596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:27.534193 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1408/2780] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:54:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:54:27.586571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76b014-54aa-41b1-ab4d-941509f47dbc admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:27.589074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f035d76-a5f0-4108-8b49-ba285f771bf2 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:27.593351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5f035d76-a5f0-4108-8b49-ba285f771bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:27.594490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57edef4-0a63-48fd-ad8d-2167f9c59a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:27.595334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57edef4-0a63-48fd-ad8d-2167f9c59a9a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:27.595753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57edef4-0a63-48fd-ad8d-2167f9c59a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:27.596239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57edef4-0a63-48fd-ad8d-2167f9c59a9a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:27.597001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57edef4-0a63-48fd-ad8d-2167f9c59a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:27.599626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57edef4-0a63-48fd-ad8d-2167f9c59a9a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:27.625100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:27.646398 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1373/2781] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:54:27 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:54:27.649130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57edef4-0a63-48fd-ad8d-2167f9c59a9a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:27.670844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57edef4-0a63-48fd-ad8d-2167f9c59a9a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:27.688324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf96e3-7523-4bbd-b391-b5f4a8177a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:27.688547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf96e3-7523-4bbd-b391-b5f4a8177a5d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:27.688839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf96e3-7523-4bbd-b391-b5f4a8177a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:27.689464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf96e3-7523-4bbd-b391-b5f4a8177a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:27.689799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf96e3-7523-4bbd-b391-b5f4a8177a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:27.691403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf96e3-7523-4bbd-b391-b5f4a8177a5d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:27.729883 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1374/2782] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:27.735319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf96e3-7523-4bbd-b391-b5f4a8177a5d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:27.763534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf96e3-7523-4bbd-b391-b5f4a8177a5d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:27.780155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324e47d-6cc7-42c8-8c2e-21da8d7757cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:27.780929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324e47d-6cc7-42c8-8c2e-21da8d7757cb admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:27.783139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324e47d-6cc7-42c8-8c2e-21da8d7757cb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:27.783139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324e47d-6cc7-42c8-8c2e-21da8d7757cb admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:27.785061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f035d76-a5f0-4108-8b49-ba285f771bf2 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:27.785572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324e47d-6cc7-42c8-8c2e-21da8d7757cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:27.787686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324e47d-6cc7-42c8-8c2e-21da8d7757cb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:27.812856 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1375/2783] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:27.816329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324e47d-6cc7-42c8-8c2e-21da8d7757cb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:27.832800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324e47d-6cc7-42c8-8c2e-21da8d7757cb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:27.876125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daee3d-bf5c-4e66-b436-9798af7efde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:27.877035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daee3d-bf5c-4e66-b436-9798af7efde2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:27.877613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daee3d-bf5c-4e66-b436-9798af7efde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:27.878200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daee3d-bf5c-4e66-b436-9798af7efde2 admin admin] PATH_INFO: `/v3/projects/bcb3706a1680419384f4fe9660e87732/users/6bce55d7f67347aaaa4c2a687bdff183/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:27.951953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daee3d-bf5c-4e66-b436-9798af7efde2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb3706a1680419384f4fe9660e87732, user_id=6bce55d7f67347aaaa4c2a687bdff183, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:27.962701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daee3d-bf5c-4e66-b436-9798af7efde2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:27.992744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aecfc-0c52-425f-821a-6af41b99c7f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:28.008755 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1376/2784] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:54:27 2022] PUT /identity/v3/projects/bcb3706a1680419384f4fe9660e87732/users/6bce55d7f67347aaaa4c2a687bdff183/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:28.009017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aecfc-0c52-425f-821a-6af41b99c7f6 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:28.009017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aecfc-0c52-425f-821a-6af41b99c7f6 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:28.009017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aecfc-0c52-425f-821a-6af41b99c7f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:28.010038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ca416-0ba1-464e-a824-452a4a07279a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:28.010380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ca416-0ba1-464e-a824-452a4a07279a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:28.010780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ca416-0ba1-464e-a824-452a4a07279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:28.117336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f41ca416-0ba1-464e-a824-452a4a07279a None None] MFA Rules not processed for user `6bce55d7f67347aaaa4c2a687bdff183`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:28.133151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f41ca416-0ba1-464e-a824-452a4a07279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:28.252179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55aecfc-0c52-425f-821a-6af41b99c7f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:28.254184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55aecfc-0c52-425f-821a-6af41b99c7f6 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:28.279015 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1409/2785] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:54:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:28.279997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aecfc-0c52-425f-821a-6af41b99c7f6 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:28.281516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e55aecfc-0c52-425f-821a-6af41b99c7f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:28.299761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aecfc-0c52-425f-821a-6af41b99c7f6 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:28.347601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:28.350665 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1377/2786] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:28.364455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ca416-0ba1-464e-a824-452a4a07279a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:28.366123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f41ca416-0ba1-464e-a824-452a4a07279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:28.542117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:28.546608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:28.546895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:28.547173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] PATH_INFO: `/v3/users/03f62e0626944d26b5883fae9b0e581b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:28.557539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f62e0626944d26b5883fae9b0e581b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:28.558539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ca416-0ba1-464e-a824-452a4a07279a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:28.564626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfb26c-91d9-4dba-b950-7aa3990824d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:28.566187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfb26c-91d9-4dba-b950-7aa3990824d8 service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:28.566476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfb26c-91d9-4dba-b950-7aa3990824d8 service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:28.566725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:28.568270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfb26c-91d9-4dba-b950-7aa3990824d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:28.581146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfb26c-91d9-4dba-b950-7aa3990824d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:28.583221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfb26c-91d9-4dba-b950-7aa3990824d8 service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:28.596677 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1378/2787] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:54:28.723484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f62e0626944d26b5883fae9b0e581b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:28.741453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f62e0626944d26b5883fae9b0e581b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:28.742651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f62e0626944d26b5883fae9b0e581b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:28.744922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f62e0626944d26b5883fae9b0e581b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:28.763601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f62e0626944d26b5883fae9b0e581b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:28.793936 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1410/2788] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:54:28 2022] DELETE /identity/v3/users/03f62e0626944d26b5883fae9b0e581b => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:28.798521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7305e9-4676-45fa-8d67-8c3331804178 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:28.799541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7305e9-4676-45fa-8d67-8c3331804178 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:28.800782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7305e9-4676-45fa-8d67-8c3331804178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:28.872852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cd7305e9-4676-45fa-8d67-8c3331804178 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:28.877644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cd7305e9-4676-45fa-8d67-8c3331804178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:29.057711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:29.144360 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1379/2789] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:54:29.175677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:29.177234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:29.307872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cba1c8-07a9-4abc-af7d-c6ff3118b2e4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:29.318700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c158e-3944-4554-bcff-19da63c46c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:29.319729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c158e-3944-4554-bcff-19da63c46c86 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:29.320042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c158e-3944-4554-bcff-19da63c46c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:29.320316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c158e-3944-4554-bcff-19da63c46c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:29.347026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c158e-3944-4554-bcff-19da63c46c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:29.347026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c158e-3944-4554-bcff-19da63c46c86 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:29.364353 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1411/2790] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:29.879373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b6e41-ef5b-4d42-8701-41df6e46eaf1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:29.879373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b6e41-ef5b-4d42-8701-41df6e46eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:29.879373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b6e41-ef5b-4d42-8701-41df6e46eaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:29.923037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9d7b6e41-ef5b-4d42-8701-41df6e46eaf1 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:29.927933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9d7b6e41-ef5b-4d42-8701-41df6e46eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:30.067961 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1380/2791] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:30.079101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c158e-3944-4554-bcff-19da63c46c86 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:30.080608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f18c158e-3944-4554-bcff-19da63c46c86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:30.169664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:30.233991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c158e-3944-4554-bcff-19da63c46c86 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:30.240984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748be0a-746b-4eda-8615-7f3805e56a11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:30.242151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748be0a-746b-4eda-8615-7f3805e56a11 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:30.242513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748be0a-746b-4eda-8615-7f3805e56a11 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:30.242807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748be0a-746b-4eda-8615-7f3805e56a11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:30.259679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748be0a-746b-4eda-8615-7f3805e56a11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:30.261376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748be0a-746b-4eda-8615-7f3805e56a11 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:30.271352 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1412/2792] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:54:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:30.891317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b6e41-ef5b-4d42-8701-41df6e46eaf1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:30.893601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9d7b6e41-ef5b-4d42-8701-41df6e46eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:30.925098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b6e41-ef5b-4d42-8701-41df6e46eaf1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:30.930013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ec294-3250-4e06-8544-9a896e14a210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:30.930587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ec294-3250-4e06-8544-9a896e14a210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:30.930879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ec294-3250-4e06-8544-9a896e14a210 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:30.931203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ec294-3250-4e06-8544-9a896e14a210 admin admin] PATH_INFO: `/v3/projects/d340283be3b640cba49addd0de8d368f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:30.933172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ec294-3250-4e06-8544-9a896e14a210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d340283be3b640cba49addd0de8d368f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:30.935245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ec294-3250-4e06-8544-9a896e14a210 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:31.003963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-668ec294-3250-4e06-8544-9a896e14a210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd340283be3b640cba49addd0de8d368f', 'request_id': 'req-668ec294-3250-4e06-8544-9a896e14a210'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:31.021953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-668ec294-3250-4e06-8544-9a896e14a210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd340283be3b640cba49addd0de8d368f', 'request_id': 'req-668ec294-3250-4e06-8544-9a896e14a210'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:31.038062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-668ec294-3250-4e06-8544-9a896e14a210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd340283be3b640cba49addd0de8d368f', 'request_id': 'req-668ec294-3250-4e06-8544-9a896e14a210'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:31.053982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-668ec294-3250-4e06-8544-9a896e14a210 admin admin] The token cache is being invalidate because project d340283be3b640cba49addd0de8d368f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:54:31.054481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-668ec294-3250-4e06-8544-9a896e14a210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:31.055298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-668ec294-3250-4e06-8544-9a896e14a210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:31.062242 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1381/2793] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:30 2022] DELETE /identity/v3/projects/d340283be3b640cba49addd0de8d368f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:31.063061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748be0a-746b-4eda-8615-7f3805e56a11 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:31.086316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748be0a-746b-4eda-8615-7f3805e56a11 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:31.204461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1397-adc6-442f-ae6b-c06b9fe5882a None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:31.206468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1397-adc6-442f-ae6b-c06b9fe5882a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:31.206755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1397-adc6-442f-ae6b-c06b9fe5882a None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:31.210261 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1382/2794] 10.222.0.26 () {54 vars in 921 bytes} [Sat Oct 8 20:54:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:54:31.262050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354c3b3-bd62-4d99-9434-fe738b0aab0b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:31.262345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354c3b3-bd62-4d99-9434-fe738b0aab0b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:31.262665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354c3b3-bd62-4d99-9434-fe738b0aab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:31.342097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5354c3b3-bd62-4d99-9434-fe738b0aab0b None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:31.350373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5354c3b3-bd62-4d99-9434-fe738b0aab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:31.363396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:31.367975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:31.371101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:31.371630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] PATH_INFO: `/v3/users/9834f9570e054995a78f3e3885628bdb` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:31.376788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9834f9570e054995a78f3e3885628bdb)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:31.387453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:31.620108 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1383/2795] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:54:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:31.622747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9834f9570e054995a78f3e3885628bdb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:31.660186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9834f9570e054995a78f3e3885628bdb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:31.661018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9834f9570e054995a78f3e3885628bdb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:31.661754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9834f9570e054995a78f3e3885628bdb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:31.690398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9834f9570e054995a78f3e3885628bdb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:31.704830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354c3b3-bd62-4d99-9434-fe738b0aab0b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:31.706465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5354c3b3-bd62-4d99-9434-fe738b0aab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:31.724008 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1413/2796] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:54:31 2022] DELETE /identity/v3/users/9834f9570e054995a78f3e3885628bdb => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:31.729936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354c3b3-bd62-4d99-9434-fe738b0aab0b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:31.735680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:31.790690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:31.792324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:31.919043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984a9f9-788a-4d5a-9fda-eb7d14c67454 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:31.922293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a9f9-788a-4d5a-9fda-eb7d14c67454 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:31.922777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a9f9-788a-4d5a-9fda-eb7d14c67454 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:31.923624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a9f9-788a-4d5a-9fda-eb7d14c67454 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:31.929149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0984a9f9-788a-4d5a-9fda-eb7d14c67454 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:31.940515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:31.979925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984a9f9-788a-4d5a-9fda-eb7d14c67454 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:31.983277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf11366-f9f7-4b31-87ea-b7c7f476a2cb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:31.987050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984a9f9-788a-4d5a-9fda-eb7d14c67454 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:32.010628 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1384/2797] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:54:32.020115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fe4db-48cf-4191-95a4-65dd9179f17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:32.020896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fe4db-48cf-4191-95a4-65dd9179f17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:32.021228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fe4db-48cf-4191-95a4-65dd9179f17b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:32.021570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fe4db-48cf-4191-95a4-65dd9179f17b admin admin] PATH_INFO: `/v3/users/68e264d0c2b54a5f8d1bd197b84a104a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:32.024180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fe4db-48cf-4191-95a4-65dd9179f17b admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e264d0c2b54a5f8d1bd197b84a104a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:32.030358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fe4db-48cf-4191-95a4-65dd9179f17b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:32.176361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ee2fe4db-48cf-4191-95a4-65dd9179f17b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e264d0c2b54a5f8d1bd197b84a104a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:32.195658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ee2fe4db-48cf-4191-95a4-65dd9179f17b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e264d0c2b54a5f8d1bd197b84a104a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:32.196760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ee2fe4db-48cf-4191-95a4-65dd9179f17b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e264d0c2b54a5f8d1bd197b84a104a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:32.199480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ee2fe4db-48cf-4191-95a4-65dd9179f17b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e264d0c2b54a5f8d1bd197b84a104a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:32.222670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ee2fe4db-48cf-4191-95a4-65dd9179f17b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e264d0c2b54a5f8d1bd197b84a104a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:32.244130 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1414/2798] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:54:31 2022] DELETE /identity/v3/users/68e264d0c2b54a5f8d1bd197b84a104a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:32.829238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984a9f9-788a-4d5a-9fda-eb7d14c67454 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:32.831020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0984a9f9-788a-4d5a-9fda-eb7d14c67454 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:32.860773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984a9f9-788a-4d5a-9fda-eb7d14c67454 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:32.980318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b048f-d3d6-4721-a3da-d125e7baba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:32.981326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b048f-d3d6-4721-a3da-d125e7baba5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:32.981616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b048f-d3d6-4721-a3da-d125e7baba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:32.982640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b048f-d3d6-4721-a3da-d125e7baba5f admin admin] PATH_INFO: `/v3/projects/8d3f0d1e6c074a82b8eaab02d139a481` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:32.984863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b048f-d3d6-4721-a3da-d125e7baba5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3f0d1e6c074a82b8eaab02d139a481)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:32.989526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b048f-d3d6-4721-a3da-d125e7baba5f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:33.085785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-276b048f-d3d6-4721-a3da-d125e7baba5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3f0d1e6c074a82b8eaab02d139a481', 'request_id': 'req-276b048f-d3d6-4721-a3da-d125e7baba5f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:33.102413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-276b048f-d3d6-4721-a3da-d125e7baba5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3f0d1e6c074a82b8eaab02d139a481', 'request_id': 'req-276b048f-d3d6-4721-a3da-d125e7baba5f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:33.113446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-276b048f-d3d6-4721-a3da-d125e7baba5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3f0d1e6c074a82b8eaab02d139a481', 'request_id': 'req-276b048f-d3d6-4721-a3da-d125e7baba5f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:33.137611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-276b048f-d3d6-4721-a3da-d125e7baba5f admin admin] The token cache is being invalidate because project 8d3f0d1e6c074a82b8eaab02d139a481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:54:33.140484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-276b048f-d3d6-4721-a3da-d125e7baba5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:33.142658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-276b048f-d3d6-4721-a3da-d125e7baba5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:33.147942 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1385/2799] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:32 2022] DELETE /identity/v3/projects/8d3f0d1e6c074a82b8eaab02d139a481 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:33.155015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abd4fa-5628-47fe-a9fd-7b05c8f5fb4c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:33.155569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abd4fa-5628-47fe-a9fd-7b05c8f5fb4c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:33.156547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abd4fa-5628-47fe-a9fd-7b05c8f5fb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:33.204248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e2abd4fa-5628-47fe-a9fd-7b05c8f5fb4c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:33.210513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e2abd4fa-5628-47fe-a9fd-7b05c8f5fb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:33.394473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cc6b2-f01a-4e1e-8c77-eb08ea89ca21 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:33.395234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cc6b2-f01a-4e1e-8c77-eb08ea89ca21 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:33.395630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cc6b2-f01a-4e1e-8c77-eb08ea89ca21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:33.456593 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1415/2800] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:33.457976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abd4fa-5628-47fe-a9fd-7b05c8f5fb4c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:33.461080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e2abd4fa-5628-47fe-a9fd-7b05c8f5fb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:33.468272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-508cc6b2-f01a-4e1e-8c77-eb08ea89ca21 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:33.470943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-508cc6b2-f01a-4e1e-8c77-eb08ea89ca21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:33.494706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abd4fa-5628-47fe-a9fd-7b05c8f5fb4c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:33.507608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:33.508442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:33.519360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:33.521683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] PATH_INFO: `/v3/projects/6a09d8f87c174336a1d216e396adfd33` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:33.527585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a09d8f87c174336a1d216e396adfd33)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:33.537213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:33.552144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:33.629319 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1386/2801] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:33.630561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151135ff-0eda-4e30-880e-839e76468062 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:33.630923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151135ff-0eda-4e30-880e-839e76468062 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:33.631205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151135ff-0eda-4e30-880e-839e76468062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:33.688126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-151135ff-0eda-4e30-880e-839e76468062 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:33.691031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-151135ff-0eda-4e30-880e-839e76468062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:33.705346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a09d8f87c174336a1d216e396adfd33', 'request_id': 'req-260654ac-3c85-441d-9581-ef3a574a1253'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:33.719392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a09d8f87c174336a1d216e396adfd33', 'request_id': 'req-260654ac-3c85-441d-9581-ef3a574a1253'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:33.727137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:33.730777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a09d8f87c174336a1d216e396adfd33', 'request_id': 'req-260654ac-3c85-441d-9581-ef3a574a1253'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:33.752388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] The token cache is being invalidate because project 6a09d8f87c174336a1d216e396adfd33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:54:33.753030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:33.754259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:33.757289 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1416/2802] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:33 2022] DELETE /identity/v3/projects/6a09d8f87c174336a1d216e396adfd33 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:33.758329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:33.760238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:33.835901 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1387/2803] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:33.837928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1c4d1-23c8-483f-b7b0-14daa9ef916e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:33.838178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1c4d1-23c8-483f-b7b0-14daa9ef916e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:33.838545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1c4d1-23c8-483f-b7b0-14daa9ef916e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:33.861893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260654ac-3c85-441d-9581-ef3a574a1253 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:33.869217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f10071-ecd6-41db-8e60-06ee24668a9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:33.870087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10071-ecd6-41db-8e60-06ee24668a9e service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:33.870529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10071-ecd6-41db-8e60-06ee24668a9e service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:33.870961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10071-ecd6-41db-8e60-06ee24668a9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:33.873307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-71f10071-ecd6-41db-8e60-06ee24668a9e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:33.884633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d5a1c4d1-23c8-483f-b7b0-14daa9ef916e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:33.884633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d5a1c4d1-23c8-483f-b7b0-14daa9ef916e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:33.913534 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1388/2804] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:33.914533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1c4d1-23c8-483f-b7b0-14daa9ef916e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:33.941416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1c4d1-23c8-483f-b7b0-14daa9ef916e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:33.962366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05747915-e7d3-43e5-a174-fee6c85350ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:33.963881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f10071-ecd6-41db-8e60-06ee24668a9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:33.964823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05747915-e7d3-43e5-a174-fee6c85350ae admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:33.965237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05747915-e7d3-43e5-a174-fee6c85350ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:33.965764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05747915-e7d3-43e5-a174-fee6c85350ae admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:33.966449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f10071-ecd6-41db-8e60-06ee24668a9e service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:33.968896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05747915-e7d3-43e5-a174-fee6c85350ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:54:33.969345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05747915-e7d3-43e5-a174-fee6c85350ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:33.971066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05747915-e7d3-43e5-a174-fee6c85350ae admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:33.977921 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1417/2805] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:54:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:33.981493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb5b73-e6dd-4135-a636-69abf664a97e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:33.982763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb5b73-e6dd-4135-a636-69abf664a97e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:33.983304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb5b73-e6dd-4135-a636-69abf664a97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:34.011032 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1389/2806] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:54:34.017467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05747915-e7d3-43e5-a174-fee6c85350ae admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:34.039481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05747915-e7d3-43e5-a174-fee6c85350ae admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:34.051141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-53eb5b73-e6dd-4135-a636-69abf664a97e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:34.052792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-53eb5b73-e6dd-4135-a636-69abf664a97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:34.062823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64203c5-6dcc-4fe0-90fe-4dc0afba6c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:34.063678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64203c5-6dcc-4fe0-90fe-4dc0afba6c6b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:34.064094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64203c5-6dcc-4fe0-90fe-4dc0afba6c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:34.064482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64203c5-6dcc-4fe0-90fe-4dc0afba6c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:34.065316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64203c5-6dcc-4fe0-90fe-4dc0afba6c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:34.067202 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1418/2807] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:34.068356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64203c5-6dcc-4fe0-90fe-4dc0afba6c6b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:34.070744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb5b73-e6dd-4135-a636-69abf664a97e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:34.114650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb5b73-e6dd-4135-a636-69abf664a97e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:34.123336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25935dfa-c913-4e11-a549-361b55456c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:34.124932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25935dfa-c913-4e11-a549-361b55456c74 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:34.125227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25935dfa-c913-4e11-a549-361b55456c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:34.126096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25935dfa-c913-4e11-a549-361b55456c74 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:34.127780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25935dfa-c913-4e11-a549-361b55456c74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:54:34.128837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25935dfa-c913-4e11-a549-361b55456c74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:34.131847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25935dfa-c913-4e11-a549-361b55456c74 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:34.136995 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1390/2808] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:54:34 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:54:34.141834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64203c5-6dcc-4fe0-90fe-4dc0afba6c6b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:34.161701 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1419/2809] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:54:34.164580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25935dfa-c913-4e11-a549-361b55456c74 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:34.177780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25935dfa-c913-4e11-a549-361b55456c74 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:34.306499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64203c5-6dcc-4fe0-90fe-4dc0afba6c6b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:34.319851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06367e69-79a9-4d45-8c7d-8fe5531dd091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:34.320496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06367e69-79a9-4d45-8c7d-8fe5531dd091 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:34.321529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06367e69-79a9-4d45-8c7d-8fe5531dd091 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:34.323225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06367e69-79a9-4d45-8c7d-8fe5531dd091 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:34.323882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06367e69-79a9-4d45-8c7d-8fe5531dd091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:34.328824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06367e69-79a9-4d45-8c7d-8fe5531dd091 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:34.353463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b3216-1e91-4a0c-9834-dcea9dca679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:34.356344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b3216-1e91-4a0c-9834-dcea9dca679a admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:34.358942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b3216-1e91-4a0c-9834-dcea9dca679a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:34.359489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b3216-1e91-4a0c-9834-dcea9dca679a admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:34.364199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b3216-1e91-4a0c-9834-dcea9dca679a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:34.370949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b3216-1e91-4a0c-9834-dcea9dca679a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:34.379121 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1391/2810] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:54:34 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:54:34.383421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06367e69-79a9-4d45-8c7d-8fe5531dd091 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:34.405264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06367e69-79a9-4d45-8c7d-8fe5531dd091 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:34.416883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5d70c-ae78-4db7-b27b-ea0337ed111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:34.417555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5d70c-ae78-4db7-b27b-ea0337ed111f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:34.420548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5d70c-ae78-4db7-b27b-ea0337ed111f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:34.420926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5d70c-ae78-4db7-b27b-ea0337ed111f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:34.421606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5d70c-ae78-4db7-b27b-ea0337ed111f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:34.426310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5d70c-ae78-4db7-b27b-ea0337ed111f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:34.436446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:34.462844 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1392/2811] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:34.465571 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1420/2812] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:54:34 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:54:34.471291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5d70c-ae78-4db7-b27b-ea0337ed111f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:34.476323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b3216-1e91-4a0c-9834-dcea9dca679a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:34.488471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5d70c-ae78-4db7-b27b-ea0337ed111f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:34.499161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:34.654829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6c08f-badd-4c4c-a0ef-0be918d09db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:34.660412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6c08f-badd-4c4c-a0ef-0be918d09db2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:34.660629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6c08f-badd-4c4c-a0ef-0be918d09db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:34.661058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6c08f-badd-4c4c-a0ef-0be918d09db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:34.664761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6c08f-badd-4c4c-a0ef-0be918d09db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:34.666525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6c08f-badd-4c4c-a0ef-0be918d09db2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:34.705598 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1393/2813] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:34.707454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6c08f-badd-4c4c-a0ef-0be918d09db2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:34.708580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b3216-1e91-4a0c-9834-dcea9dca679a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:34.766824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b476fce-e55c-4dce-b9e6-34de04040a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:34.766824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476fce-e55c-4dce-b9e6-34de04040a64 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:34.766824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476fce-e55c-4dce-b9e6-34de04040a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:34.766824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476fce-e55c-4dce-b9e6-34de04040a64 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:34.775770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b476fce-e55c-4dce-b9e6-34de04040a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:34.775770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b476fce-e55c-4dce-b9e6-34de04040a64 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:34.776073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6c08f-badd-4c4c-a0ef-0be918d09db2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:34.800245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afc981-8ba1-4034-9e80-abe8014fb4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:34.800980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afc981-8ba1-4034-9e80-abe8014fb4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:34.801289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afc981-8ba1-4034-9e80-abe8014fb4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:34.801568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afc981-8ba1-4034-9e80-abe8014fb4b0 admin admin] PATH_INFO: `/v3/projects/6001cf381fcd472da6e006e7bce01644/users/ec419187582e4ab1bde6ccc15119d12e/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:34.825461 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1421/2814] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:54:34 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:54:34.828707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b476fce-e55c-4dce-b9e6-34de04040a64 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:34.848038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afc981-8ba1-4034-9e80-abe8014fb4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6001cf381fcd472da6e006e7bce01644, user_id=ec419187582e4ab1bde6ccc15119d12e, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:34.853216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b476fce-e55c-4dce-b9e6-34de04040a64 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:34.854651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afc981-8ba1-4034-9e80-abe8014fb4b0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:34.864506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58533ba6-83b7-45eb-9260-3b11d7500a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:34.865133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58533ba6-83b7-45eb-9260-3b11d7500a01 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:34.865441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58533ba6-83b7-45eb-9260-3b11d7500a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:34.865755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58533ba6-83b7-45eb-9260-3b11d7500a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:34.867378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58533ba6-83b7-45eb-9260-3b11d7500a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:34.878542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58533ba6-83b7-45eb-9260-3b11d7500a01 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:34.893942 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1394/2815] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:54:34 2022] PUT /identity/v3/projects/6001cf381fcd472da6e006e7bce01644/users/ec419187582e4ab1bde6ccc15119d12e/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:34.895767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ac4ca-e912-4a24-a311-997960474c40 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:34.896758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ac4ca-e912-4a24-a311-997960474c40 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:34.897045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ac4ca-e912-4a24-a311-997960474c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:34.920822 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1422/2816] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:34.924541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58533ba6-83b7-45eb-9260-3b11d7500a01 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:34.946214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58533ba6-83b7-45eb-9260-3b11d7500a01 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:34.970194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b25ac4ca-e912-4a24-a311-997960474c40 None None] MFA Rules not processed for user `ec419187582e4ab1bde6ccc15119d12e`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:34.971578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b25ac4ca-e912-4a24-a311-997960474c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:35.142767 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1395/2817] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:35.168780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a9ed2-0d0c-45d3-a521-baf38745522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:35.170357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a9ed2-0d0c-45d3-a521-baf38745522f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:35.174178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a9ed2-0d0c-45d3-a521-baf38745522f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:35.174559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a9ed2-0d0c-45d3-a521-baf38745522f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:35.175320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a9ed2-0d0c-45d3-a521-baf38745522f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:35.181134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a9ed2-0d0c-45d3-a521-baf38745522f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:35.228497 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1423/2818] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:35.232113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ac4ca-e912-4a24-a311-997960474c40 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:35.250023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ac4ca-e912-4a24-a311-997960474c40 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:35.265733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a5775-f668-4f85-88a0-50804aa75584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:35.268831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a5775-f668-4f85-88a0-50804aa75584 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:35.269144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a5775-f668-4f85-88a0-50804aa75584 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:35.270122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a5775-f668-4f85-88a0-50804aa75584 admin admin] PATH_INFO: `/v3/projects/1c784548feb8459fa303989fe3fbc9f2/users/294063d975784298b250340c0a820c24/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:35.310308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a5775-f668-4f85-88a0-50804aa75584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c784548feb8459fa303989fe3fbc9f2, user_id=294063d975784298b250340c0a820c24, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:35.313832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a5775-f668-4f85-88a0-50804aa75584 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:35.355374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a9ed2-0d0c-45d3-a521-baf38745522f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:35.358980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f85a9ed2-0d0c-45d3-a521-baf38745522f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:35.370862 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1396/2819] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:54:35 2022] PUT /identity/v3/projects/1c784548feb8459fa303989fe3fbc9f2/users/294063d975784298b250340c0a820c24/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:35.374476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72359-0fe1-4e2c-bba3-aec1323a3791 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:35.374858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72359-0fe1-4e2c-bba3-aec1323a3791 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:35.375360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72359-0fe1-4e2c-bba3-aec1323a3791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:35.407889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9ea72359-0fe1-4e2c-bba3-aec1323a3791 None None] MFA Rules not processed for user `294063d975784298b250340c0a820c24`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:35.409315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9ea72359-0fe1-4e2c-bba3-aec1323a3791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:35.492157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:35.497867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a9ed2-0d0c-45d3-a521-baf38745522f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:35.503965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:35.569976 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1397/2820] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:35.606312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea72359-0fe1-4e2c-bba3-aec1323a3791 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:35.609113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9ea72359-0fe1-4e2c-bba3-aec1323a3791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:35.628144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d308e-e1fa-4a20-be8f-f85f84682be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:35.629179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d308e-e1fa-4a20-be8f-f85f84682be7 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:35.629489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d308e-e1fa-4a20-be8f-f85f84682be7 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:35.629762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d308e-e1fa-4a20-be8f-f85f84682be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:35.782491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d308e-e1fa-4a20-be8f-f85f84682be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:35.786469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d308e-e1fa-4a20-be8f-f85f84682be7 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:35.792630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea72359-0fe1-4e2c-bba3-aec1323a3791 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:35.814115 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1424/2821] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:35.821123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedddc7-03a8-4792-b4fb-559985219652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:35.821770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedddc7-03a8-4792-b4fb-559985219652 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:35.822446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedddc7-03a8-4792-b4fb-559985219652 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:35.822723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedddc7-03a8-4792-b4fb-559985219652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:35.851535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedddc7-03a8-4792-b4fb-559985219652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:35.853138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedddc7-03a8-4792-b4fb-559985219652 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:35.885668 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1398/2822] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:54:36.213953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570192e3-dd91-4b10-81c4-b4050fa9a306 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:36.214289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570192e3-dd91-4b10-81c4-b4050fa9a306 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:36.214508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570192e3-dd91-4b10-81c4-b4050fa9a306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:36.256069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-570192e3-dd91-4b10-81c4-b4050fa9a306 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:36.259822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-570192e3-dd91-4b10-81c4-b4050fa9a306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:36.442758 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1425/2823] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:54:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:36.456464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedddc7-03a8-4792-b4fb-559985219652 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:36.649709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedddc7-03a8-4792-b4fb-559985219652 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:36.664482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1680e-d38a-4723-99db-08be679c394c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:36.665514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1680e-d38a-4723-99db-08be679c394c service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:36.666789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1680e-d38a-4723-99db-08be679c394c service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:36.667302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1680e-d38a-4723-99db-08be679c394c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:36.680441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1680e-d38a-4723-99db-08be679c394c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:36.682738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1680e-d38a-4723-99db-08be679c394c service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:36.705448 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1399/2824] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:54:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:36.887473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f96058-16dd-4e09-8806-caa8b069c881 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:36.887863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f96058-16dd-4e09-8806-caa8b069c881 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:36.892006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f96058-16dd-4e09-8806-caa8b069c881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:36.927135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-85f96058-16dd-4e09-8806-caa8b069c881 None None] MFA Rules not processed for user `ec419187582e4ab1bde6ccc15119d12e`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:36.929006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-85f96058-16dd-4e09-8806-caa8b069c881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:36.941269 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1426/2825] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:36.980345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92e129-06f0-4f2e-9725-aad7c673c97e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:36.980802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92e129-06f0-4f2e-9725-aad7c673c97e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:36.981223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92e129-06f0-4f2e-9725-aad7c673c97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:37.014331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7b92e129-06f0-4f2e-9725-aad7c673c97e None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:37.015588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7b92e129-06f0-4f2e-9725-aad7c673c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:37.029776 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1400/2826] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:54:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:37.038355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f96058-16dd-4e09-8806-caa8b069c881 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:37.053033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f96058-16dd-4e09-8806-caa8b069c881 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:37.059203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c503d-d3bd-48af-8633-1cbe08905bce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:37.061388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c503d-d3bd-48af-8633-1cbe08905bce service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:37.061388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c503d-d3bd-48af-8633-1cbe08905bce service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:37.061388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c503d-d3bd-48af-8633-1cbe08905bce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:37.075087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c503d-d3bd-48af-8633-1cbe08905bce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:37.077104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c503d-d3bd-48af-8633-1cbe08905bce service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:37.094693 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1427/2827] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:54:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:37.782064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712696-1240-4dd1-b17c-2df1303ac6e2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:37.782064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712696-1240-4dd1-b17c-2df1303ac6e2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:37.782064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712696-1240-4dd1-b17c-2df1303ac6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:37.824736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fd712696-1240-4dd1-b17c-2df1303ac6e2 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:37.826320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fd712696-1240-4dd1-b17c-2df1303ac6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:37.852477 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1401/2828] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 20:54:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:37.867719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c503d-d3bd-48af-8633-1cbe08905bce service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:37.889585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c503d-d3bd-48af-8633-1cbe08905bce service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:37.900167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a512a-5c66-46f5-a0cb-37ebcf832dcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:37.901055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a512a-5c66-46f5-a0cb-37ebcf832dcb service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:37.901524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a512a-5c66-46f5-a0cb-37ebcf832dcb service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:37.902534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a512a-5c66-46f5-a0cb-37ebcf832dcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:37.915786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a512a-5c66-46f5-a0cb-37ebcf832dcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:37.917827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a512a-5c66-46f5-a0cb-37ebcf832dcb service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:37.930092 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1428/2829] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:54:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:38.253461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd712696-1240-4dd1-b17c-2df1303ac6e2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:38.351767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:38.405499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd712696-1240-4dd1-b17c-2df1303ac6e2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:38.416912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:38.417459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:38.417885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:38.418270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] PATH_INFO: `/v3/users/ec419187582e4ab1bde6ccc15119d12e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:38.421299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec419187582e4ab1bde6ccc15119d12e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:38.423634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:38.533801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec419187582e4ab1bde6ccc15119d12e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:38.552469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec419187582e4ab1bde6ccc15119d12e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:38.553897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec419187582e4ab1bde6ccc15119d12e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:38.556510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec419187582e4ab1bde6ccc15119d12e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:38.604155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec419187582e4ab1bde6ccc15119d12e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:38.667705 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1402/2830] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:54:38 2022] DELETE /identity/v3/users/ec419187582e4ab1bde6ccc15119d12e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:38.673627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e9140-6808-472d-9fe7-a10282846632 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:38.674308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e9140-6808-472d-9fe7-a10282846632 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:38.674551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e9140-6808-472d-9fe7-a10282846632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:38.715740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0a6e9140-6808-472d-9fe7-a10282846632 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:38.717834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0a6e9140-6808-472d-9fe7-a10282846632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:38.742827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:38.849789 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1429/2831] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:38.869152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:38.870868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:38.983009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e931d-983e-4668-8b20-a7b59616317f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:38.990969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13793993-10b4-4ed5-95c1-c876a77bb091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:38.991597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13793993-10b4-4ed5-95c1-c876a77bb091 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:38.991881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13793993-10b4-4ed5-95c1-c876a77bb091 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:38.992189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13793993-10b4-4ed5-95c1-c876a77bb091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:39.013428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13793993-10b4-4ed5-95c1-c876a77bb091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:39.015531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13793993-10b4-4ed5-95c1-c876a77bb091 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:39.039906 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1403/2832] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:39.160958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6afe8c-6550-475a-b80e-e42ab2ba5ca3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:39.160958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6afe8c-6550-475a-b80e-e42ab2ba5ca3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:39.160958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6afe8c-6550-475a-b80e-e42ab2ba5ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:39.184607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ed6afe8c-6550-475a-b80e-e42ab2ba5ca3 None None] MFA Rules not processed for user `6bce55d7f67347aaaa4c2a687bdff183`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:39.186754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ed6afe8c-6550-475a-b80e-e42ab2ba5ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:39.414442 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1430/2833] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:39.682684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13793993-10b4-4ed5-95c1-c876a77bb091 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:39.684245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-13793993-10b4-4ed5-95c1-c876a77bb091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:39.710968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13793993-10b4-4ed5-95c1-c876a77bb091 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:39.720819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:39.722421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:39.722997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:39.723470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] PATH_INFO: `/v3/users/294063d975784298b250340c0a820c24` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:39.725440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] RBAC: Authorizing `identity:delete_user(user_id=294063d975784298b250340c0a820c24)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:39.734934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:39.823563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294063d975784298b250340c0a820c24'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:39.829670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:39.832177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294063d975784298b250340c0a820c24'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:39.833079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294063d975784298b250340c0a820c24'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:39.833891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294063d975784298b250340c0a820c24'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:39.852282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294063d975784298b250340c0a820c24'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:39.898013 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1404/2834] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:54:39 2022] DELETE /identity/v3/users/294063d975784298b250340c0a820c24 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:39.904840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcfbe7-c92b-4873-a751-4333a1b19624 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:39.907255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcfbe7-c92b-4873-a751-4333a1b19624 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:39.907922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcfbe7-c92b-4873-a751-4333a1b19624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:39.940172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:39.942058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:39.969735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8abcfbe7-c92b-4873-a751-4333a1b19624 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:39.973355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8abcfbe7-c92b-4873-a751-4333a1b19624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:40.112134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72eec7-4107-4cfb-81f2-85397972467a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:40.115287 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1431/2835] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:54:40.127500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:40.128402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:40.129066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:40.130113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcfbe7-c92b-4873-a751-4333a1b19624 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:40.131900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8abcfbe7-c92b-4873-a751-4333a1b19624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:40.135023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d admin admin] PATH_INFO: `/v3/projects/6001cf381fcd472da6e006e7bce01644` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:40.140633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6001cf381fcd472da6e006e7bce01644)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:40.144216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:40.295903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6001cf381fcd472da6e006e7bce01644', 'request_id': 'req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:40.308887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcfbe7-c92b-4873-a751-4333a1b19624 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:40.344051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6001cf381fcd472da6e006e7bce01644', 'request_id': 'req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:40.357971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:40.377435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6001cf381fcd472da6e006e7bce01644', 'request_id': 'req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:40.421775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de1bd2-3922-432c-947e-cd2be1bbab7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:40.422450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de1bd2-3922-432c-947e-cd2be1bbab7d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:40.425843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de1bd2-3922-432c-947e-cd2be1bbab7d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:40.426173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de1bd2-3922-432c-947e-cd2be1bbab7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:40.433597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d admin admin] The token cache is being invalidate because project 6001cf381fcd472da6e006e7bce01644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:54:40.435292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:40.441905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dcf8f4bd-ce17-4c12-b4b5-7e254696274d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:40.466164 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1405/2836] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:39 2022] DELETE /identity/v3/projects/6001cf381fcd472da6e006e7bce01644 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:54:40.466164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3c2b9-5bd1-408c-a971-6d583e18ce15 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:40.466164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3c2b9-5bd1-408c-a971-6d583e18ce15 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:40.466164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3c2b9-5bd1-408c-a971-6d583e18ce15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:40.521623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de1bd2-3922-432c-947e-cd2be1bbab7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:40.526296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de1bd2-3922-432c-947e-cd2be1bbab7d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:40.533655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-54b3c2b9-5bd1-408c-a971-6d583e18ce15 None None] MFA Rules not processed for user `6bce55d7f67347aaaa4c2a687bdff183`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:40.537110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-54b3c2b9-5bd1-408c-a971-6d583e18ce15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:40.542513 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1432/2837] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:54:40.544319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036895c-c4c0-4023-9171-7419804504f3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:40.544611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036895c-c4c0-4023-9171-7419804504f3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:40.545670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036895c-c4c0-4023-9171-7419804504f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:40.569542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e036895c-c4c0-4023-9171-7419804504f3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:40.570754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e036895c-c4c0-4023-9171-7419804504f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:40.580696 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1433/2838] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:40.589389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8bd5-e982-4e10-9987-e92dcf1ed68e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:40.589753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8bd5-e982-4e10-9987-e92dcf1ed68e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:40.589940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8bd5-e982-4e10-9987-e92dcf1ed68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:40.619455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-14ff8bd5-e982-4e10-9987-e92dcf1ed68e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:40.621587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-14ff8bd5-e982-4e10-9987-e92dcf1ed68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:40.634699 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1434/2839] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:40.635792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8bd5-e982-4e10-9987-e92dcf1ed68e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:40.647811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8bd5-e982-4e10-9987-e92dcf1ed68e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:40.657945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8d295-18e6-4872-a552-e198d999aabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:40.658585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8d295-18e6-4872-a552-e198d999aabd admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:40.658850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8d295-18e6-4872-a552-e198d999aabd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:40.659124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8d295-18e6-4872-a552-e198d999aabd admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:40.660513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8d295-18e6-4872-a552-e198d999aabd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:54:40.660823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8d295-18e6-4872-a552-e198d999aabd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:40.662637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8d295-18e6-4872-a552-e198d999aabd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:40.670927 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1406/2840] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:40.684273 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1435/2841] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:54:40.690249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3c2b9-5bd1-408c-a971-6d583e18ce15 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:40.707637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3c2b9-5bd1-408c-a971-6d583e18ce15 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:40.713997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8168d0e-5976-4939-b04d-ca7b12ecdc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:40.715475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8168d0e-5976-4939-b04d-ca7b12ecdc17 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:40.715944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8168d0e-5976-4939-b04d-ca7b12ecdc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:40.716209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8168d0e-5976-4939-b04d-ca7b12ecdc17 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:40.717792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8168d0e-5976-4939-b04d-ca7b12ecdc17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:40.720367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8168d0e-5976-4939-b04d-ca7b12ecdc17 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:40.736422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:40.806785 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1407/2842] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:54:40 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:54:40.807326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8d295-18e6-4872-a552-e198d999aabd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:40.826912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8d295-18e6-4872-a552-e198d999aabd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:41.022077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f6e9d-0c39-4394-9464-161b2d3ea70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:41.022728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f6e9d-0c39-4394-9464-161b2d3ea70e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:41.025015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f6e9d-0c39-4394-9464-161b2d3ea70e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:41.025363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f6e9d-0c39-4394-9464-161b2d3ea70e admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:41.026958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f6e9d-0c39-4394-9464-161b2d3ea70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:41.032393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f6e9d-0c39-4394-9464-161b2d3ea70e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:41.088145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8168d0e-5976-4939-b04d-ca7b12ecdc17 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:41.100174 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1436/2843] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:54:40 2022] POST /identity/v3/users => generated 295 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:54:41.104415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8168d0e-5976-4939-b04d-ca7b12ecdc17 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:41.112115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e44f6-5835-4b6a-b22d-5285a82ae789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:41.112998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e44f6-5835-4b6a-b22d-5285a82ae789 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:41.113298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e44f6-5835-4b6a-b22d-5285a82ae789 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:41.113572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e44f6-5835-4b6a-b22d-5285a82ae789 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:41.114232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e44f6-5835-4b6a-b22d-5285a82ae789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:41.121220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e44f6-5835-4b6a-b22d-5285a82ae789 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:41.146863 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1408/2844] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:41.147958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f6e9d-0c39-4394-9464-161b2d3ea70e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:41.164440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f6e9d-0c39-4394-9464-161b2d3ea70e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:41.179088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8b992-c5c9-4367-8312-066542682ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:41.179088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8b992-c5c9-4367-8312-066542682ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:41.179088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8b992-c5c9-4367-8312-066542682ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:41.179450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8b992-c5c9-4367-8312-066542682ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:41.179948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8b992-c5c9-4367-8312-066542682ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:41.184692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8b992-c5c9-4367-8312-066542682ff5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:41.232218 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1437/2845] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:41.234655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e44f6-5835-4b6a-b22d-5285a82ae789 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:41.250172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e44f6-5835-4b6a-b22d-5285a82ae789 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:41.259421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc30e9-77a8-435b-850d-9e39ee8c6cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:41.260004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc30e9-77a8-435b-850d-9e39ee8c6cad admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:41.260264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc30e9-77a8-435b-850d-9e39ee8c6cad admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:41.260546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc30e9-77a8-435b-850d-9e39ee8c6cad admin admin] PATH_INFO: `/v3/projects/ec51fae793a147d88e5d956352f18b92/users/bc0c5c9593754f1cb98f9689b29606a2/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:41.301774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc30e9-77a8-435b-850d-9e39ee8c6cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec51fae793a147d88e5d956352f18b92, user_id=bc0c5c9593754f1cb98f9689b29606a2, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:41.304521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc30e9-77a8-435b-850d-9e39ee8c6cad admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:41.335501 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1409/2846] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:54:41 2022] PUT /identity/v3/projects/ec51fae793a147d88e5d956352f18b92/users/bc0c5c9593754f1cb98f9689b29606a2/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:41.340360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b9c3d-b201-4a8a-a647-7f4c9529edac None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:41.340955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b9c3d-b201-4a8a-a647-7f4c9529edac None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:41.340955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b9c3d-b201-4a8a-a647-7f4c9529edac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:41.382676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-aa0b9c3d-b201-4a8a-a647-7f4c9529edac None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:41.384762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-aa0b9c3d-b201-4a8a-a647-7f4c9529edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:41.446349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:41.589515 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1438/2847] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:41.596665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc30e9-77a8-435b-850d-9e39ee8c6cad admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:41.598809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-95fc30e9-77a8-435b-850d-9e39ee8c6cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:41.768889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc30e9-77a8-435b-850d-9e39ee8c6cad admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:41.775589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d8cf4-2347-4ec7-b796-ce0a48c620d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:41.780385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d8cf4-2347-4ec7-b796-ce0a48c620d2 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:41.780835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d8cf4-2347-4ec7-b796-ce0a48c620d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:41.781231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d8cf4-2347-4ec7-b796-ce0a48c620d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:41.802445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d8cf4-2347-4ec7-b796-ce0a48c620d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:41.804998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d8cf4-2347-4ec7-b796-ce0a48c620d2 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:41.840774 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1410/2848] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:42.260890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b9c3d-b201-4a8a-a647-7f4c9529edac None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:42.262801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-aa0b9c3d-b201-4a8a-a647-7f4c9529edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:42.310227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b9c3d-b201-4a8a-a647-7f4c9529edac None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:42.333004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:42.337641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:42.338838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:42.339127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff admin admin] PATH_INFO: `/v3/projects/1c784548feb8459fa303989fe3fbc9f2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:42.343967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c784548feb8459fa303989fe3fbc9f2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:42.352140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:42.548649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c784548feb8459fa303989fe3fbc9f2', 'request_id': 'req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:42.565056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c784548feb8459fa303989fe3fbc9f2', 'request_id': 'req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:42.577249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c784548feb8459fa303989fe3fbc9f2', 'request_id': 'req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:42.594483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff admin admin] The token cache is being invalidate because project 1c784548feb8459fa303989fe3fbc9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:54:42.595163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:42.596049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06743dfe-38cd-4aaa-8f25-d8de7151a5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:42.598053 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1439/2849] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:42 2022] DELETE /identity/v3/projects/1c784548feb8459fa303989fe3fbc9f2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:54:42.603038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735fdaa-415f-4cb6-b414-b8ca535e050f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:42.603575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735fdaa-415f-4cb6-b414-b8ca535e050f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:42.603575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735fdaa-415f-4cb6-b414-b8ca535e050f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:42.640590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6735fdaa-415f-4cb6-b414-b8ca535e050f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:42.643292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6735fdaa-415f-4cb6-b414-b8ca535e050f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:42.792284 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1411/2850] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:42.800051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffc351-1e78-4185-9901-aa079f9dd6b0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:42.800453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffc351-1e78-4185-9901-aa079f9dd6b0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:42.800653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffc351-1e78-4185-9901-aa079f9dd6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:42.825691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-afffc351-1e78-4185-9901-aa079f9dd6b0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:42.827497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-afffc351-1e78-4185-9901-aa079f9dd6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:42.842515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735fdaa-415f-4cb6-b414-b8ca535e050f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:42.849624 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1440/2851] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:42.853581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735fdaa-415f-4cb6-b414-b8ca535e050f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:42.860188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b26f0-8427-4e15-854d-a5dc29a792f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:42.860930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b26f0-8427-4e15-854d-a5dc29a792f8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:42.861376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b26f0-8427-4e15-854d-a5dc29a792f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:42.861754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b26f0-8427-4e15-854d-a5dc29a792f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:42.862521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b26f0-8427-4e15-854d-a5dc29a792f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:54:42.863213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b26f0-8427-4e15-854d-a5dc29a792f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:42.867583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b26f0-8427-4e15-854d-a5dc29a792f8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:42.887324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffc351-1e78-4185-9901-aa079f9dd6b0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:42.893951 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1412/2852] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:54:42.898046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffc351-1e78-4185-9901-aa079f9dd6b0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:42.903079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807a6df-91a6-4be9-8000-93f4ab4aa4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:42.903810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807a6df-91a6-4be9-8000-93f4ab4aa4aa admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:42.904255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807a6df-91a6-4be9-8000-93f4ab4aa4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:42.904638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807a6df-91a6-4be9-8000-93f4ab4aa4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:42.905431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807a6df-91a6-4be9-8000-93f4ab4aa4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:42.907891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807a6df-91a6-4be9-8000-93f4ab4aa4aa admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:42.963942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b26f0-8427-4e15-854d-a5dc29a792f8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:42.972898 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1441/2853] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:54:42 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:54:42.980885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b26f0-8427-4e15-854d-a5dc29a792f8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:43.078945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:43.132571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19b81b-be47-4f4e-b04e-ae7f5b2acafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:43.132831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19b81b-be47-4f4e-b04e-ae7f5b2acafd admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:43.133202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19b81b-be47-4f4e-b04e-ae7f5b2acafd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:43.133581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19b81b-be47-4f4e-b04e-ae7f5b2acafd admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:43.134602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19b81b-be47-4f4e-b04e-ae7f5b2acafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:43.136619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19b81b-be47-4f4e-b04e-ae7f5b2acafd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:43.181379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807a6df-91a6-4be9-8000-93f4ab4aa4aa admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:43.190278 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1413/2854] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:54:42 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:54:43.207225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807a6df-91a6-4be9-8000-93f4ab4aa4aa admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:43.216538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52d261-0601-4a4d-a7d3-7e096b251ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:43.217670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52d261-0601-4a4d-a7d3-7e096b251ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:43.218176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52d261-0601-4a4d-a7d3-7e096b251ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:43.218737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52d261-0601-4a4d-a7d3-7e096b251ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:43.219657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52d261-0601-4a4d-a7d3-7e096b251ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:43.221762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52d261-0601-4a4d-a7d3-7e096b251ba6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:43.234462 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1442/2855] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:54:43.238324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19b81b-be47-4f4e-b04e-ae7f5b2acafd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:43.254113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19b81b-be47-4f4e-b04e-ae7f5b2acafd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:43.265811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eecfd7-3735-4de3-8300-7897fe5239ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:43.267588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eecfd7-3735-4de3-8300-7897fe5239ee admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:43.268615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eecfd7-3735-4de3-8300-7897fe5239ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:43.269152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eecfd7-3735-4de3-8300-7897fe5239ee admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:43.270238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eecfd7-3735-4de3-8300-7897fe5239ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:43.272837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eecfd7-3735-4de3-8300-7897fe5239ee admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:43.288178 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1414/2856] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:54:43.291736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52d261-0601-4a4d-a7d3-7e096b251ba6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:43.305567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52d261-0601-4a4d-a7d3-7e096b251ba6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:43.330124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99d2a8-d7a5-4eef-b428-7970cc7f900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:43.331839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99d2a8-d7a5-4eef-b428-7970cc7f900c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:43.332369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99d2a8-d7a5-4eef-b428-7970cc7f900c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:43.333126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99d2a8-d7a5-4eef-b428-7970cc7f900c admin admin] PATH_INFO: `/v3/projects/d472cd177a254b2fb9e943acfef5c8b3/users/9b6fd92e51694e3a87dd5e72123cabf4/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:43.396330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99d2a8-d7a5-4eef-b428-7970cc7f900c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d472cd177a254b2fb9e943acfef5c8b3, user_id=9b6fd92e51694e3a87dd5e72123cabf4, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:43.404746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99d2a8-d7a5-4eef-b428-7970cc7f900c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:43.440099 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1443/2857] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:54:43 2022] PUT /identity/v3/projects/d472cd177a254b2fb9e943acfef5c8b3/users/9b6fd92e51694e3a87dd5e72123cabf4/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:43.524883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab208c6-b802-4f09-8cfb-6faa2c51d285 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:43.525539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab208c6-b802-4f09-8cfb-6faa2c51d285 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:43.526052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab208c6-b802-4f09-8cfb-6faa2c51d285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:43.568048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cab208c6-b802-4f09-8cfb-6faa2c51d285 None None] MFA Rules not processed for user `9b6fd92e51694e3a87dd5e72123cabf4`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:43.569415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cab208c6-b802-4f09-8cfb-6faa2c51d285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:43.694880 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1415/2858] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:44.026899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99d2a8-d7a5-4eef-b428-7970cc7f900c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:44.029914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-db99d2a8-d7a5-4eef-b428-7970cc7f900c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:44.218508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:44.342324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99d2a8-d7a5-4eef-b428-7970cc7f900c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:44.361923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20698a8a-6274-4916-9705-1c050a4ce150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:44.362966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698a8a-6274-4916-9705-1c050a4ce150 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:44.363271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698a8a-6274-4916-9705-1c050a4ce150 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:44.363536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698a8a-6274-4916-9705-1c050a4ce150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:44.390702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20698a8a-6274-4916-9705-1c050a4ce150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:44.395131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20698a8a-6274-4916-9705-1c050a4ce150 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:44.438920 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1444/2859] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:44.518851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab208c6-b802-4f09-8cfb-6faa2c51d285 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:44.682363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab208c6-b802-4f09-8cfb-6faa2c51d285 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:44.694108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:44.694768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:44.695054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:44.695613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] PATH_INFO: `/v3/users/9b6fd92e51694e3a87dd5e72123cabf4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:44.697941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6fd92e51694e3a87dd5e72123cabf4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:44.699887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:44.825990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6fd92e51694e3a87dd5e72123cabf4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:44.829299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:44.836666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6fd92e51694e3a87dd5e72123cabf4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:44.838761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6fd92e51694e3a87dd5e72123cabf4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:44.840209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6fd92e51694e3a87dd5e72123cabf4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:44.865582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6fd92e51694e3a87dd5e72123cabf4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:44.923651 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1416/2860] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:54:44 2022] DELETE /identity/v3/users/9b6fd92e51694e3a87dd5e72123cabf4 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:44.927992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c600aa0-f5e4-4c45-a0e7-02841382e25a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:44.928366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c600aa0-f5e4-4c45-a0e7-02841382e25a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:44.928717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c600aa0-f5e4-4c45-a0e7-02841382e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:44.966125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2c600aa0-f5e4-4c45-a0e7-02841382e25a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:44.966125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2c600aa0-f5e4-4c45-a0e7-02841382e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:45.106638 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1445/2861] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:45.130061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:45.131988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:45.286943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828082c-68de-4a6a-8fcd-2fb07d253d2d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:45.302611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999058b-5fc2-4364-b549-d0b6b8dc64c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:45.303608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999058b-5fc2-4364-b549-d0b6b8dc64c6 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:45.304107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999058b-5fc2-4364-b549-d0b6b8dc64c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:45.304597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999058b-5fc2-4364-b549-d0b6b8dc64c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:45.331110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999058b-5fc2-4364-b549-d0b6b8dc64c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:45.334200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999058b-5fc2-4364-b549-d0b6b8dc64c6 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:45.352772 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1417/2862] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:46.459236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c600aa0-f5e4-4c45-a0e7-02841382e25a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:46.460896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2c600aa0-f5e4-4c45-a0e7-02841382e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:46.480365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c600aa0-f5e4-4c45-a0e7-02841382e25a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:46.496609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58979813-0f58-4072-9eed-f8a3303f84ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:46.498328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58979813-0f58-4072-9eed-f8a3303f84ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:46.499142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58979813-0f58-4072-9eed-f8a3303f84ba admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:46.499651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58979813-0f58-4072-9eed-f8a3303f84ba admin admin] PATH_INFO: `/v3/projects/d472cd177a254b2fb9e943acfef5c8b3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:46.501265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58979813-0f58-4072-9eed-f8a3303f84ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d472cd177a254b2fb9e943acfef5c8b3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:46.503649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58979813-0f58-4072-9eed-f8a3303f84ba admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:46.586409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-58979813-0f58-4072-9eed-f8a3303f84ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd472cd177a254b2fb9e943acfef5c8b3', 'request_id': 'req-58979813-0f58-4072-9eed-f8a3303f84ba'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:46.603196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-58979813-0f58-4072-9eed-f8a3303f84ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd472cd177a254b2fb9e943acfef5c8b3', 'request_id': 'req-58979813-0f58-4072-9eed-f8a3303f84ba'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:46.617958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-58979813-0f58-4072-9eed-f8a3303f84ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd472cd177a254b2fb9e943acfef5c8b3', 'request_id': 'req-58979813-0f58-4072-9eed-f8a3303f84ba'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:46.650816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-58979813-0f58-4072-9eed-f8a3303f84ba admin admin] The token cache is being invalidate because project d472cd177a254b2fb9e943acfef5c8b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:54:46.651355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-58979813-0f58-4072-9eed-f8a3303f84ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:46.652222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-58979813-0f58-4072-9eed-f8a3303f84ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:54:46.654911 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1446/2863] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:46 2022] DELETE /identity/v3/projects/d472cd177a254b2fb9e943acfef5c8b3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:46.660276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a21fad-560a-4c13-b8bf-0c633c456c8a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:46.661843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a21fad-560a-4c13-b8bf-0c633c456c8a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:46.662440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a21fad-560a-4c13-b8bf-0c633c456c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:46.750041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-46a21fad-560a-4c13-b8bf-0c633c456c8a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:46.753899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-46a21fad-560a-4c13-b8bf-0c633c456c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:46.921463 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1418/2864] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:46.923209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b902c-444a-4059-983e-133617f20169 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:46.923494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b902c-444a-4059-983e-133617f20169 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:46.923770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b902c-444a-4059-983e-133617f20169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:46.956565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5b8b902c-444a-4059-983e-133617f20169 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:46.957835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5b8b902c-444a-4059-983e-133617f20169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:46.978728 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1447/2865] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:46.984178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a21fad-560a-4c13-b8bf-0c633c456c8a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:47.000870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a21fad-560a-4c13-b8bf-0c633c456c8a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:47.009641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b99634-3fcf-4b3a-8570-b613766be8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:47.010377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b99634-3fcf-4b3a-8570-b613766be8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:47.010788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b99634-3fcf-4b3a-8570-b613766be8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:47.011137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b99634-3fcf-4b3a-8570-b613766be8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:47.015813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b99634-3fcf-4b3a-8570-b613766be8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:54:47.016134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b99634-3fcf-4b3a-8570-b613766be8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:47.017901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b99634-3fcf-4b3a-8570-b613766be8e0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:47.047799 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1419/2866] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:54:47.052400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b902c-444a-4059-983e-133617f20169 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:47.062515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b902c-444a-4059-983e-133617f20169 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:47.075215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc30be-9ef2-4da1-868b-b7644a028ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:47.075863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc30be-9ef2-4da1-868b-b7644a028ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:47.086540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc30be-9ef2-4da1-868b-b7644a028ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:47.087029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc30be-9ef2-4da1-868b-b7644a028ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:47.087890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc30be-9ef2-4da1-868b-b7644a028ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:47.089910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc30be-9ef2-4da1-868b-b7644a028ff6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:47.156771 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1448/2867] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:54:47 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:54:47.162251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b99634-3fcf-4b3a-8570-b613766be8e0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:47.176256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b99634-3fcf-4b3a-8570-b613766be8e0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:47.304075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:47.325751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8979b0-ed4a-4b37-b9c4-1dfe2d97b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:47.326934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8979b0-ed4a-4b37-b9c4-1dfe2d97b098 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:47.327217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8979b0-ed4a-4b37-b9c4-1dfe2d97b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:47.327484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8979b0-ed4a-4b37-b9c4-1dfe2d97b098 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:47.328122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8979b0-ed4a-4b37-b9c4-1dfe2d97b098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:47.330128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8979b0-ed4a-4b37-b9c4-1dfe2d97b098 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:47.381825 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1420/2868] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:54:47 2022] POST /identity/v3/users => generated 284 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:54:47.385729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc30be-9ef2-4da1-868b-b7644a028ff6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:47.403808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc30be-9ef2-4da1-868b-b7644a028ff6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:47.428239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a75942-5c2d-45f4-ace3-5e16c1abbc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:47.429059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a75942-5c2d-45f4-ace3-5e16c1abbc0d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:47.429464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a75942-5c2d-45f4-ace3-5e16c1abbc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:47.429975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a75942-5c2d-45f4-ace3-5e16c1abbc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:47.430731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a75942-5c2d-45f4-ace3-5e16c1abbc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:47.434231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a75942-5c2d-45f4-ace3-5e16c1abbc0d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:47.477217 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1449/2869] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:47.481033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8979b0-ed4a-4b37-b9c4-1dfe2d97b098 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:47.513450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8979b0-ed4a-4b37-b9c4-1dfe2d97b098 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:47.527916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b332f2-c717-4eba-ac30-b9e3f3a1c4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:47.530617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b332f2-c717-4eba-ac30-b9e3f3a1c4de admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:47.531061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b332f2-c717-4eba-ac30-b9e3f3a1c4de admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:47.534191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b332f2-c717-4eba-ac30-b9e3f3a1c4de admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:47.535104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b332f2-c717-4eba-ac30-b9e3f3a1c4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:47.537038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b332f2-c717-4eba-ac30-b9e3f3a1c4de admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:47.575712 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1421/2870] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:47.577272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a75942-5c2d-45f4-ace3-5e16c1abbc0d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:47.591407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a75942-5c2d-45f4-ace3-5e16c1abbc0d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:47.605630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdb698-6ea9-46ae-978b-8c5be156ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:47.606423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb698-6ea9-46ae-978b-8c5be156ce1a admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:47.608270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb698-6ea9-46ae-978b-8c5be156ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:47.611511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb698-6ea9-46ae-978b-8c5be156ce1a admin admin] PATH_INFO: `/v3/projects/4e277ebf9cbf4cb0b6be14efbec504bf/users/f6cf9c6c133947f3aecee3a913a32328/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:47.641103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:47.733942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdb698-6ea9-46ae-978b-8c5be156ce1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e277ebf9cbf4cb0b6be14efbec504bf, user_id=f6cf9c6c133947f3aecee3a913a32328, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:47.738431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdb698-6ea9-46ae-978b-8c5be156ce1a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:47.836785 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1450/2871] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:54:47 2022] PUT /identity/v3/projects/4e277ebf9cbf4cb0b6be14efbec504bf/users/f6cf9c6c133947f3aecee3a913a32328/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:47.839347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e284ed-b11f-4f34-b06f-87073bf9a84a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:47.839889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e284ed-b11f-4f34-b06f-87073bf9a84a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:47.839889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e284ed-b11f-4f34-b06f-87073bf9a84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:47.896552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-39e284ed-b11f-4f34-b06f-87073bf9a84a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:47.897872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-39e284ed-b11f-4f34-b06f-87073bf9a84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:48.067710 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1422/2872] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:54:48.144637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdb698-6ea9-46ae-978b-8c5be156ce1a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:48.146642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d6bdb698-6ea9-46ae-978b-8c5be156ce1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:48.293946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdb698-6ea9-46ae-978b-8c5be156ce1a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:48.299398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608f9c8-6049-489a-96b0-b6617b2c1e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:48.311395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608f9c8-6049-489a-96b0-b6617b2c1e2f service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:48.312036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608f9c8-6049-489a-96b0-b6617b2c1e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:48.312315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608f9c8-6049-489a-96b0-b6617b2c1e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:48.347554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608f9c8-6049-489a-96b0-b6617b2c1e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:48.350053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608f9c8-6049-489a-96b0-b6617b2c1e2f service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:48.367659 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1451/2873] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:52.917488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6c6c3-4ca6-4054-858b-983b6f95f9a3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:52.918012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6c6c3-4ca6-4054-858b-983b6f95f9a3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:52.921598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6c6c3-4ca6-4054-858b-983b6f95f9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:52.972431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-75f6c6c3-4ca6-4054-858b-983b6f95f9a3 None None] MFA Rules not processed for user `474ca64d1b1d4e30916b517645aba882`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:52.974215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-75f6c6c3-4ca6-4054-858b-983b6f95f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:53.093997 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1423/2874] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:56.362326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235cb24-abd1-4ee6-a826-571c0378a16f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:56.366132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235cb24-abd1-4ee6-a826-571c0378a16f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:56.366637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235cb24-abd1-4ee6-a826-571c0378a16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:56.455750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b235cb24-abd1-4ee6-a826-571c0378a16f None None] MFA Rules not processed for user `bc0c5c9593754f1cb98f9689b29606a2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:56.459486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b235cb24-abd1-4ee6-a826-571c0378a16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:56.686413 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1452/2875] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:56.687072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6c6c3-4ca6-4054-858b-983b6f95f9a3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:56.688552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-75f6c6c3-4ca6-4054-858b-983b6f95f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:56.717788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6c6c3-4ca6-4054-858b-983b6f95f9a3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:56.733111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae0c58-c6ea-43df-9aa6-a4819fbc755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:56.735271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae0c58-c6ea-43df-9aa6-a4819fbc755b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:56.736463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae0c58-c6ea-43df-9aa6-a4819fbc755b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:56.736920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae0c58-c6ea-43df-9aa6-a4819fbc755b admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:56.737777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae0c58-c6ea-43df-9aa6-a4819fbc755b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:56.740284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae0c58-c6ea-43df-9aa6-a4819fbc755b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:56.792539 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1424/2876] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:54:56 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:54:56.797619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235cb24-abd1-4ee6-a826-571c0378a16f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:56.816140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235cb24-abd1-4ee6-a826-571c0378a16f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:57.069166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d92bc-4af3-402c-ba5a-046f866d34b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:57.070330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d92bc-4af3-402c-ba5a-046f866d34b9 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:57.072866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d92bc-4af3-402c-ba5a-046f866d34b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:57.073287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d92bc-4af3-402c-ba5a-046f866d34b9 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:57.074077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d92bc-4af3-402c-ba5a-046f866d34b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:57.079210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d92bc-4af3-402c-ba5a-046f866d34b9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:57.118895 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1453/2877] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:54:56 2022] POST /identity/v3/users => generated 301 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:54:57.119343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae0c58-c6ea-43df-9aa6-a4819fbc755b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:57.132211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae0c58-c6ea-43df-9aa6-a4819fbc755b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:57.147356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2ca86-c05c-4869-92ff-09a14d5da3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:57.148371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2ca86-c05c-4869-92ff-09a14d5da3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:57.148876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2ca86-c05c-4869-92ff-09a14d5da3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:57.149524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2ca86-c05c-4869-92ff-09a14d5da3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:57.150697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2ca86-c05c-4869-92ff-09a14d5da3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:57.152919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2ca86-c05c-4869-92ff-09a14d5da3c1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:57.186217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d92bc-4af3-402c-ba5a-046f866d34b9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:57.188179 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1425/2878] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:54:57.208382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d92bc-4af3-402c-ba5a-046f866d34b9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:57.218713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7032ae5-a9fd-4e5e-ac1d-fb904abdab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:57.220347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7032ae5-a9fd-4e5e-ac1d-fb904abdab7e admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:57.220928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7032ae5-a9fd-4e5e-ac1d-fb904abdab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:57.221552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7032ae5-a9fd-4e5e-ac1d-fb904abdab7e admin admin] PATH_INFO: `/v3/projects/4574b2bedd2d4882beb2232e281c9562/users/99cb54b2c0404ec5bae71cb1365a3cd5/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:57.229388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:57.260618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7032ae5-a9fd-4e5e-ac1d-fb904abdab7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4574b2bedd2d4882beb2232e281c9562, user_id=99cb54b2c0404ec5bae71cb1365a3cd5, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:57.264372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7032ae5-a9fd-4e5e-ac1d-fb904abdab7e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:57.296469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2ca86-c05c-4869-92ff-09a14d5da3c1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:57.303606 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1454/2879] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:54:57 2022] PUT /identity/v3/projects/4574b2bedd2d4882beb2232e281c9562/users/99cb54b2c0404ec5bae71cb1365a3cd5/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:54:57.345090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2ca86-c05c-4869-92ff-09a14d5da3c1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:57.478222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:57.507414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d529e-4d76-4958-b340-ed42bd0a1a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:57.508755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d529e-4d76-4958-b340-ed42bd0a1a05 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:57.509341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d529e-4d76-4958-b340-ed42bd0a1a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:57.510455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d529e-4d76-4958-b340-ed42bd0a1a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:57.511772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d529e-4d76-4958-b340-ed42bd0a1a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:57.514365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d529e-4d76-4958-b340-ed42bd0a1a05 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:57.537728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7032ae5-a9fd-4e5e-ac1d-fb904abdab7e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:57.550732 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1426/2880] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:54:57.553908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7032ae5-a9fd-4e5e-ac1d-fb904abdab7e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:57.560865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42514e-be90-4717-945b-8ddcaa6a54fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:57.562870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42514e-be90-4717-945b-8ddcaa6a54fd admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:57.563363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42514e-be90-4717-945b-8ddcaa6a54fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:57.563831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42514e-be90-4717-945b-8ddcaa6a54fd admin admin] PATH_INFO: `/v3/projects/4574b2bedd2d4882beb2232e281c9562/users/99cb54b2c0404ec5bae71cb1365a3cd5/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:57.568106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42514e-be90-4717-945b-8ddcaa6a54fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4574b2bedd2d4882beb2232e281c9562, user_id=99cb54b2c0404ec5bae71cb1365a3cd5, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:57.572863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42514e-be90-4717-945b-8ddcaa6a54fd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:57.588071 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1455/2881] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:54:57 2022] PUT /identity/v3/projects/4574b2bedd2d4882beb2232e281c9562/users/99cb54b2c0404ec5bae71cb1365a3cd5/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:54:59.755615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b88a5c-0ab1-4e5d-be01-d36786c1198b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:59.756574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b88a5c-0ab1-4e5d-be01-d36786c1198b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:59.757013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b88a5c-0ab1-4e5d-be01-d36786c1198b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:59.784064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a3b88a5c-0ab1-4e5d-be01-d36786c1198b None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:59.785879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a3b88a5c-0ab1-4e5d-be01-d36786c1198b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:59.894991 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1427/2882] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:59.913320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42514e-be90-4717-945b-8ddcaa6a54fd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:59.915131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1e42514e-be90-4717-945b-8ddcaa6a54fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:00.036052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42514e-be90-4717-945b-8ddcaa6a54fd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:00.042041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422f242-553d-4651-a8aa-cb0e4ceb1e63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:00.042669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422f242-553d-4651-a8aa-cb0e4ceb1e63 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:00.042942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422f242-553d-4651-a8aa-cb0e4ceb1e63 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:00.043403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422f242-553d-4651-a8aa-cb0e4ceb1e63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:00.063619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422f242-553d-4651-a8aa-cb0e4ceb1e63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:00.068615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422f242-553d-4651-a8aa-cb0e4ceb1e63 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:00.111916 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1456/2883] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:54:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:01.629518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eecef-c9bb-4a3b-ba55-02b0d8dbafbd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:01.630338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eecef-c9bb-4a3b-ba55-02b0d8dbafbd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:01.630771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eecef-c9bb-4a3b-ba55-02b0d8dbafbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:01.757643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-036eecef-c9bb-4a3b-ba55-02b0d8dbafbd None None] MFA Rules not processed for user `f6cf9c6c133947f3aecee3a913a32328`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:01.760845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-036eecef-c9bb-4a3b-ba55-02b0d8dbafbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:01.969587 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1428/2884] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:02.101352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422f242-553d-4651-a8aa-cb0e4ceb1e63 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:02.103949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7422f242-553d-4651-a8aa-cb0e4ceb1e63 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:02.387068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422f242-553d-4651-a8aa-cb0e4ceb1e63 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:02.402715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af001a6-4600-4e95-a1f7-de0d1ab9e632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:02.403898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af001a6-4600-4e95-a1f7-de0d1ab9e632 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:02.404561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af001a6-4600-4e95-a1f7-de0d1ab9e632 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:02.405107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af001a6-4600-4e95-a1f7-de0d1ab9e632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:02.424373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af001a6-4600-4e95-a1f7-de0d1ab9e632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:02.426755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af001a6-4600-4e95-a1f7-de0d1ab9e632 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:02.440801 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1457/2885] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:55:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:55:08.982948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9111e0a-5b05-4cc9-b9d1-e65d9cb2c04b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:08.984220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9111e0a-5b05-4cc9-b9d1-e65d9cb2c04b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:08.984800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9111e0a-5b05-4cc9-b9d1-e65d9cb2c04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:09.009309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e9111e0a-5b05-4cc9-b9d1-e65d9cb2c04b None None] MFA Rules not processed for user `f6cf9c6c133947f3aecee3a913a32328`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:09.011838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e9111e0a-5b05-4cc9-b9d1-e65d9cb2c04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:09.028038 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1429/2886] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:12.433702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=77,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:14.038876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd40bd3-456b-4fe6-9589-2876a17b75d5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:14.039523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd40bd3-456b-4fe6-9589-2876a17b75d5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:14.039523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd40bd3-456b-4fe6-9589-2876a17b75d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:14.091516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-dbd40bd3-456b-4fe6-9589-2876a17b75d5 None None] MFA Rules not processed for user `99cb54b2c0404ec5bae71cb1365a3cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:14.094477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dbd40bd3-456b-4fe6-9589-2876a17b75d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:14.211944 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1458/2887] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:14 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:14.226038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9111e0a-5b05-4cc9-b9d1-e65d9cb2c04b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:14.227545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e9111e0a-5b05-4cc9-b9d1-e65d9cb2c04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:14.307372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9111e0a-5b05-4cc9-b9d1-e65d9cb2c04b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:14.311716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7b807-6f22-481c-9ebc-ce06750bf362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:14.312325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7b807-6f22-481c-9ebc-ce06750bf362 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:14.312602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7b807-6f22-481c-9ebc-ce06750bf362 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:14.312874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7b807-6f22-481c-9ebc-ce06750bf362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:14.347110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:14.385260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7b807-6f22-481c-9ebc-ce06750bf362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:14.387253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7b807-6f22-481c-9ebc-ce06750bf362 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:14.402985 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1430/2888] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:55:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:55:16.798617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2770305-16b5-4c01-b1ad-34d8c06116b5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:16.799547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2770305-16b5-4c01-b1ad-34d8c06116b5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:16.800922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2770305-16b5-4c01-b1ad-34d8c06116b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:16.838939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a2770305-16b5-4c01-b1ad-34d8c06116b5 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:16.841870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a2770305-16b5-4c01-b1ad-34d8c06116b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:16.870974 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1459/2889] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:55:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:16.920781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7b807-6f22-481c-9ebc-ce06750bf362 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:16.956017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7b807-6f22-481c-9ebc-ce06750bf362 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:16.975821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca7f3d-3194-40ea-a394-5b13d271ab01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:16.976566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca7f3d-3194-40ea-a394-5b13d271ab01 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:16.976943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca7f3d-3194-40ea-a394-5b13d271ab01 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:16.977366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca7f3d-3194-40ea-a394-5b13d271ab01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:16.992073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca7f3d-3194-40ea-a394-5b13d271ab01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:16.995492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca7f3d-3194-40ea-a394-5b13d271ab01 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:17.016197 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1431/2890] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:55:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 20:55:20.092042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d202d-9be9-4f86-a01d-346ecece1acf None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:20.092680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d202d-9be9-4f86-a01d-346ecece1acf None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:20.092680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d202d-9be9-4f86-a01d-346ecece1acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:20.165087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-196d202d-9be9-4f86-a01d-346ecece1acf None None] MFA Rules not processed for user `d54b1c5c00544be4b60132d09817c8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:20.173020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-196d202d-9be9-4f86-a01d-346ecece1acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:20.323089 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1460/2891] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:55:27.011901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=21 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:30.298175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ce058-c531-46f5-9807-d61c3e957a9a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:30.299018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ce058-c531-46f5-9807-d61c3e957a9a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:30.299018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ce058-c531-46f5-9807-d61c3e957a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:30.303508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=62 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:30.322989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ac7ce058-c531-46f5-9807-d61c3e957a9a None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:30.324192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ac7ce058-c531-46f5-9807-d61c3e957a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:30.331924 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1432/2892] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 20:55:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:30.344708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d202d-9be9-4f86-a01d-346ecece1acf None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:30.357887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d202d-9be9-4f86-a01d-346ecece1acf None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:30.363356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bf3d0-34d8-4b08-8441-e800933124b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:30.364220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf3d0-34d8-4b08-8441-e800933124b3 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:30.364496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf3d0-34d8-4b08-8441-e800933124b3 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:30.364930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf3d0-34d8-4b08-8441-e800933124b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:30.374203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bf3d0-34d8-4b08-8441-e800933124b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:30.375802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bf3d0-34d8-4b08-8441-e800933124b3 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:30.385239 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1461/2893] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:55:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 20:55:38.072577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bc19f-03a0-4581-bf42-bd1d6c2c3b3f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:38.073119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bc19f-03a0-4581-bf42-bd1d6c2c3b3f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:38.073119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bc19f-03a0-4581-bf42-bd1d6c2c3b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:38.098396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ef6bc19f-03a0-4581-bf42-bd1d6c2c3b3f None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:38.100124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ef6bc19f-03a0-4581-bf42-bd1d6c2c3b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:38.109896 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1433/2894] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:55:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:38.131448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bf3d0-34d8-4b08-8441-e800933124b3 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:38.148986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bf3d0-34d8-4b08-8441-e800933124b3 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:38.165134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80eb10-7285-4a11-b69c-961ff0d8cdbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:38.165947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80eb10-7285-4a11-b69c-961ff0d8cdbe service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:38.166462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80eb10-7285-4a11-b69c-961ff0d8cdbe service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:38.166855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80eb10-7285-4a11-b69c-961ff0d8cdbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:38.190068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80eb10-7285-4a11-b69c-961ff0d8cdbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:38.192535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80eb10-7285-4a11-b69c-961ff0d8cdbe service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:38.217228 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1462/2895] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:55:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:39.684047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bc19f-03a0-4581-bf42-bd1d6c2c3b3f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:39.688436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ef6bc19f-03a0-4581-bf42-bd1d6c2c3b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:39.808349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bc19f-03a0-4581-bf42-bd1d6c2c3b3f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:39.814076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:39.814906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:39.815259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:39.815608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] PATH_INFO: `/v3/users/5ef659f5a1a24c439528a7675bdd70f8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:39.816871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef659f5a1a24c439528a7675bdd70f8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:39.819120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:39.928288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef659f5a1a24c439528a7675bdd70f8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:39.936674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef659f5a1a24c439528a7675bdd70f8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:39.937728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef659f5a1a24c439528a7675bdd70f8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:39.938389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef659f5a1a24c439528a7675bdd70f8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:39.953117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef659f5a1a24c439528a7675bdd70f8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:39.975264 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1434/2896] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:55:39 2022] DELETE /identity/v3/users/5ef659f5a1a24c439528a7675bdd70f8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:39.976673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0242f1d-e57a-4263-bc9b-0009f4d153a1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:39.977169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0242f1d-e57a-4263-bc9b-0009f4d153a1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:39.977446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0242f1d-e57a-4263-bc9b-0009f4d153a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:40.045636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b0242f1d-e57a-4263-bc9b-0009f4d153a1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:40.047168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b0242f1d-e57a-4263-bc9b-0009f4d153a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:40.179693 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1463/2897] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:40.190332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:40.191788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:40.309548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeac802-0d23-40d9-a371-e8f6091281af admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:40.316130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cc141-d592-497c-9ebd-9b7ea86ee571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:40.316768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cc141-d592-497c-9ebd-9b7ea86ee571 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:40.317249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cc141-d592-497c-9ebd-9b7ea86ee571 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:40.317533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cc141-d592-497c-9ebd-9b7ea86ee571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:40.344910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cc141-d592-497c-9ebd-9b7ea86ee571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:40.346588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cc141-d592-497c-9ebd-9b7ea86ee571 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:40.371612 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1435/2898] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:55:40.682121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0242f1d-e57a-4263-bc9b-0009f4d153a1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:40.683558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b0242f1d-e57a-4263-bc9b-0009f4d153a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:40.726781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0242f1d-e57a-4263-bc9b-0009f4d153a1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:40.755924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:40.756581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:40.757850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:40.758871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] PATH_INFO: `/v3/projects/8c92fe04ab8248399d0acb932f82d607` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:40.760347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c92fe04ab8248399d0acb932f82d607)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:40.762610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:40.848581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c92fe04ab8248399d0acb932f82d607', 'request_id': 'req-0d256217-df2d-4e90-95e9-6d1d5a952bbf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:40.864667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c92fe04ab8248399d0acb932f82d607', 'request_id': 'req-0d256217-df2d-4e90-95e9-6d1d5a952bbf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:40.876297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c92fe04ab8248399d0acb932f82d607', 'request_id': 'req-0d256217-df2d-4e90-95e9-6d1d5a952bbf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:40.895622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] The token cache is being invalidate because project 8c92fe04ab8248399d0acb932f82d607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:55:40.896304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:40.900012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:40.903225 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1464/2899] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:40 2022] DELETE /identity/v3/projects/8c92fe04ab8248399d0acb932f82d607 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:40.907258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cc141-d592-497c-9ebd-9b7ea86ee571 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:40.922806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cc141-d592-497c-9ebd-9b7ea86ee571 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:40.930638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:41.031783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e032-2ecb-42cc-97b6-3b4bccc6a4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:41.032947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e032-2ecb-42cc-97b6-3b4bccc6a4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:41.033264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e032-2ecb-42cc-97b6-3b4bccc6a4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:41.033680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e032-2ecb-42cc-97b6-3b4bccc6a4e4 admin admin] PATH_INFO: `/v3/users/12654655fd1e4facb48253e20f29a346` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:41.035465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4e032-2ecb-42cc-97b6-3b4bccc6a4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12654655fd1e4facb48253e20f29a346)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:41.038497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4e032-2ecb-42cc-97b6-3b4bccc6a4e4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:41.166379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ae4e032-2ecb-42cc-97b6-3b4bccc6a4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12654655fd1e4facb48253e20f29a346'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:41.183860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ae4e032-2ecb-42cc-97b6-3b4bccc6a4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12654655fd1e4facb48253e20f29a346'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:41.186726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ae4e032-2ecb-42cc-97b6-3b4bccc6a4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12654655fd1e4facb48253e20f29a346'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:41.188502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ae4e032-2ecb-42cc-97b6-3b4bccc6a4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12654655fd1e4facb48253e20f29a346'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:41.240885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ae4e032-2ecb-42cc-97b6-3b4bccc6a4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12654655fd1e4facb48253e20f29a346'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:41.264834 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1436/2900] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:55:40 2022] DELETE /identity/v3/users/12654655fd1e4facb48253e20f29a346 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:41.832831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:41.834569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:41.862072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d256217-df2d-4e90-95e9-6d1d5a952bbf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:42.025094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:42.037868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00647ed-22a3-4462-bff2-161bebacf932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:42.039495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00647ed-22a3-4462-bff2-161bebacf932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:42.040155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00647ed-22a3-4462-bff2-161bebacf932 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:42.040653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00647ed-22a3-4462-bff2-161bebacf932 admin admin] PATH_INFO: `/v3/projects/c03273e2eef34c34b49e692cbc851d3f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:42.042378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00647ed-22a3-4462-bff2-161bebacf932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03273e2eef34c34b49e692cbc851d3f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:42.045467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00647ed-22a3-4462-bff2-161bebacf932 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:42.205091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b00647ed-22a3-4462-bff2-161bebacf932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03273e2eef34c34b49e692cbc851d3f', 'request_id': 'req-b00647ed-22a3-4462-bff2-161bebacf932'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:42.220125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b00647ed-22a3-4462-bff2-161bebacf932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03273e2eef34c34b49e692cbc851d3f', 'request_id': 'req-b00647ed-22a3-4462-bff2-161bebacf932'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:42.232892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b00647ed-22a3-4462-bff2-161bebacf932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03273e2eef34c34b49e692cbc851d3f', 'request_id': 'req-b00647ed-22a3-4462-bff2-161bebacf932'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:42.277696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b00647ed-22a3-4462-bff2-161bebacf932 admin admin] The token cache is being invalidate because project c03273e2eef34c34b49e692cbc851d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:55:42.278023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b00647ed-22a3-4462-bff2-161bebacf932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:42.291811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b00647ed-22a3-4462-bff2-161bebacf932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:42.291811 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1465/2901] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:41 2022] DELETE /identity/v3/projects/c03273e2eef34c34b49e692cbc851d3f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:42.298469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1adb-eb9f-4694-848a-b26fb643e477 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:42.298937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1adb-eb9f-4694-848a-b26fb643e477 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:42.299094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1adb-eb9f-4694-848a-b26fb643e477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:42.349944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8fbf1adb-eb9f-4694-848a-b26fb643e477 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:42.351465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8fbf1adb-eb9f-4694-848a-b26fb643e477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:42.585244 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1437/2902] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:42.590560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec664d8-f972-4a9f-b241-4d5360d70aca None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:42.590846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec664d8-f972-4a9f-b241-4d5360d70aca None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:42.591872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec664d8-f972-4a9f-b241-4d5360d70aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:42.632980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7ec664d8-f972-4a9f-b241-4d5360d70aca None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:42.632980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7ec664d8-f972-4a9f-b241-4d5360d70aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:42.665308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf1adb-eb9f-4694-848a-b26fb643e477 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:42.687125 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1466/2903] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:42.775879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf1adb-eb9f-4694-848a-b26fb643e477 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:42.916491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1646af7-0a6b-4538-a9d5-a2c413211b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:42.916491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1646af7-0a6b-4538-a9d5-a2c413211b33 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:42.916491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1646af7-0a6b-4538-a9d5-a2c413211b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:42.916491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1646af7-0a6b-4538-a9d5-a2c413211b33 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:42.917271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1646af7-0a6b-4538-a9d5-a2c413211b33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:55:42.917271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1646af7-0a6b-4538-a9d5-a2c413211b33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:42.917271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1646af7-0a6b-4538-a9d5-a2c413211b33 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:42.917271 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1438/2904] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:55:42.928136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec664d8-f972-4a9f-b241-4d5360d70aca None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:42.996938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec664d8-f972-4a9f-b241-4d5360d70aca None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:43.008223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02aacba-f302-4479-b3c2-fcff5304ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:43.010137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aacba-f302-4479-b3c2-fcff5304ce82 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:43.010662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aacba-f302-4479-b3c2-fcff5304ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:43.010945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aacba-f302-4479-b3c2-fcff5304ce82 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:43.011593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02aacba-f302-4479-b3c2-fcff5304ce82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:43.014272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02aacba-f302-4479-b3c2-fcff5304ce82 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:43.116738 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1467/2905] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:55:42 2022] POST /identity/v3/projects => generated 395 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:55:43.118666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1646af7-0a6b-4538-a9d5-a2c413211b33 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:43.163042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1646af7-0a6b-4538-a9d5-a2c413211b33 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:43.187886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:43.431330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c7e8d-2926-47e8-848a-9021b7aaee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:43.432455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c7e8d-2926-47e8-848a-9021b7aaee73 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:43.432780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c7e8d-2926-47e8-848a-9021b7aaee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:43.433063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c7e8d-2926-47e8-848a-9021b7aaee73 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:43.452087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c7e8d-2926-47e8-848a-9021b7aaee73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:43.459610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c7e8d-2926-47e8-848a-9021b7aaee73 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:43.561439 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1439/2906] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:55:43 2022] POST /identity/v3/users => generated 298 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:55:43.565257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02aacba-f302-4479-b3c2-fcff5304ce82 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:43.583129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02aacba-f302-4479-b3c2-fcff5304ce82 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:43.590112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3134112-e012-4180-b886-ddf981b884c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:43.598935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3134112-e012-4180-b886-ddf981b884c4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:43.598935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3134112-e012-4180-b886-ddf981b884c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:43.598935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3134112-e012-4180-b886-ddf981b884c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:43.599334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3134112-e012-4180-b886-ddf981b884c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:43.600924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3134112-e012-4180-b886-ddf981b884c4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:43.642688 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1468/2907] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:55:43.644917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c7e8d-2926-47e8-848a-9021b7aaee73 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:43.669110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c7e8d-2926-47e8-848a-9021b7aaee73 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:43.675310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5b1b4-29d5-4dd4-af77-06aa8e0e7421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:43.676312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5b1b4-29d5-4dd4-af77-06aa8e0e7421 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:43.676851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5b1b4-29d5-4dd4-af77-06aa8e0e7421 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:43.677147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5b1b4-29d5-4dd4-af77-06aa8e0e7421 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:43.678549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5b1b4-29d5-4dd4-af77-06aa8e0e7421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:43.680686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5b1b4-29d5-4dd4-af77-06aa8e0e7421 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:43.700600 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1440/2908] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:55:43.703991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3134112-e012-4180-b886-ddf981b884c4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:43.729737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3134112-e012-4180-b886-ddf981b884c4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:43.747613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6c36-aa27-421a-9bf4-fdceab1a53a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:43.749595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6c36-aa27-421a-9bf4-fdceab1a53a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:43.750011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6c36-aa27-421a-9bf4-fdceab1a53a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:43.750626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6c36-aa27-421a-9bf4-fdceab1a53a0 admin admin] PATH_INFO: `/v3/projects/2ae26877c42a41b2914951b495c1268b/users/44cf341eb3c04d57902c24a67e8a95d2/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:43.804778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6c36-aa27-421a-9bf4-fdceab1a53a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae26877c42a41b2914951b495c1268b, user_id=44cf341eb3c04d57902c24a67e8a95d2, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:43.814065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6c36-aa27-421a-9bf4-fdceab1a53a0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:43.865128 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1469/2909] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:55:43 2022] PUT /identity/v3/projects/2ae26877c42a41b2914951b495c1268b/users/44cf341eb3c04d57902c24a67e8a95d2/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:43.959403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e87c35-1f3c-4d9d-b40c-dfa48f382944 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:43.960642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e87c35-1f3c-4d9d-b40c-dfa48f382944 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:43.961172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e87c35-1f3c-4d9d-b40c-dfa48f382944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:44.047163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-51e87c35-1f3c-4d9d-b40c-dfa48f382944 None None] MFA Rules not processed for user `44cf341eb3c04d57902c24a67e8a95d2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:44.048035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-51e87c35-1f3c-4d9d-b40c-dfa48f382944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:44.192643 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1441/2910] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:44.195756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6c36-aa27-421a-9bf4-fdceab1a53a0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:44.318920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6c36-aa27-421a-9bf4-fdceab1a53a0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:44.333357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2802db9-e319-4e77-93e3-6ec7fbd269a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:44.333997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2802db9-e319-4e77-93e3-6ec7fbd269a5 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:44.334278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2802db9-e319-4e77-93e3-6ec7fbd269a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:44.334552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2802db9-e319-4e77-93e3-6ec7fbd269a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:44.335188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2802db9-e319-4e77-93e3-6ec7fbd269a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:44.337098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2802db9-e319-4e77-93e3-6ec7fbd269a5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:44.400543 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1470/2911] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:55:44 2022] POST /identity/v3/projects => generated 393 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:55:44.405063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e87c35-1f3c-4d9d-b40c-dfa48f382944 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:44.429731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e87c35-1f3c-4d9d-b40c-dfa48f382944 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:44.657358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd899820-ced7-42ad-8dc8-a7d635f4c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:44.660225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd899820-ced7-42ad-8dc8-a7d635f4c59e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:44.660518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd899820-ced7-42ad-8dc8-a7d635f4c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:44.660804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd899820-ced7-42ad-8dc8-a7d635f4c59e admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:44.663266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd899820-ced7-42ad-8dc8-a7d635f4c59e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:44.666251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd899820-ced7-42ad-8dc8-a7d635f4c59e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:44.704966 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1442/2912] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:55:44 2022] POST /identity/v3/users => generated 303 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:55:44.710927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2802db9-e319-4e77-93e3-6ec7fbd269a5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:44.749117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2802db9-e319-4e77-93e3-6ec7fbd269a5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:44.764548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bd034-1054-4cf2-aa19-259668460f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:44.765678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bd034-1054-4cf2-aa19-259668460f3d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:44.765958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bd034-1054-4cf2-aa19-259668460f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:44.766279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bd034-1054-4cf2-aa19-259668460f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:44.767101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bd034-1054-4cf2-aa19-259668460f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:44.769491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bd034-1054-4cf2-aa19-259668460f3d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:44.786023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:44.812572 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1471/2913] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:55:44.815021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd899820-ced7-42ad-8dc8-a7d635f4c59e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:44.830879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd899820-ced7-42ad-8dc8-a7d635f4c59e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:44.841029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1307470-92ce-4cce-9485-5d44725e5e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:44.842639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307470-92ce-4cce-9485-5d44725e5e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:44.843367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307470-92ce-4cce-9485-5d44725e5e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:44.843802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307470-92ce-4cce-9485-5d44725e5e71 admin admin] PATH_INFO: `/v3/projects/a9a1a3f02f524180b925264f294c0533/users/addae14475864554b3791a0fa9d39fae/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:44.899556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:44.908304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1307470-92ce-4cce-9485-5d44725e5e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a1a3f02f524180b925264f294c0533, user_id=addae14475864554b3791a0fa9d39fae, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:44.914803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1307470-92ce-4cce-9485-5d44725e5e71 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:44.934567 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1443/2914] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:55:44 2022] PUT /identity/v3/projects/a9a1a3f02f524180b925264f294c0533/users/addae14475864554b3791a0fa9d39fae/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:44.940769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bd034-1054-4cf2-aa19-259668460f3d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:44.955126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bd034-1054-4cf2-aa19-259668460f3d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:45.085654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836766e0-7e8b-4f02-b359-f4b728d067ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:45.086187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836766e0-7e8b-4f02-b359-f4b728d067ae admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:45.087138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836766e0-7e8b-4f02-b359-f4b728d067ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:45.087430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836766e0-7e8b-4f02-b359-f4b728d067ae admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:45.088622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836766e0-7e8b-4f02-b359-f4b728d067ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:45.090847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836766e0-7e8b-4f02-b359-f4b728d067ae admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:45.119056 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1472/2915] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:55:45.124017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1307470-92ce-4cce-9485-5d44725e5e71 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:45.139829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1307470-92ce-4cce-9485-5d44725e5e71 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:45.147480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d4e2b-de3c-4175-ab17-242c4d75b451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:45.148335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d4e2b-de3c-4175-ab17-242c4d75b451 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:45.148915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d4e2b-de3c-4175-ab17-242c4d75b451 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:45.149387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d4e2b-de3c-4175-ab17-242c4d75b451 admin admin] PATH_INFO: `/v3/projects/a9a1a3f02f524180b925264f294c0533/users/addae14475864554b3791a0fa9d39fae/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:45.151632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d4e2b-de3c-4175-ab17-242c4d75b451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a1a3f02f524180b925264f294c0533, user_id=addae14475864554b3791a0fa9d39fae, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:45.155841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d4e2b-de3c-4175-ab17-242c4d75b451 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:45.188139 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1444/2916] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:55:45 2022] PUT /identity/v3/projects/a9a1a3f02f524180b925264f294c0533/users/addae14475864554b3791a0fa9d39fae/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:45.198626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317d2c-6e4a-468e-8594-ec61d53d099c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:45.199187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317d2c-6e4a-468e-8594-ec61d53d099c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:45.199187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317d2c-6e4a-468e-8594-ec61d53d099c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:45.251435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-13317d2c-6e4a-468e-8594-ec61d53d099c None None] MFA Rules not processed for user `addae14475864554b3791a0fa9d39fae`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:45.252661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-13317d2c-6e4a-468e-8594-ec61d53d099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:45.409284 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1473/2917] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:45.422646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d4e2b-de3c-4175-ab17-242c4d75b451 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:45.425155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4e8d4e2b-de3c-4175-ab17-242c4d75b451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:45.625077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d4e2b-de3c-4175-ab17-242c4d75b451 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:45.631645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df8e9b-c26e-46be-bec5-b466dad48e0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:45.632723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df8e9b-c26e-46be-bec5-b466dad48e0f service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:45.633137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df8e9b-c26e-46be-bec5-b466dad48e0f service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:45.633566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df8e9b-c26e-46be-bec5-b466dad48e0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:45.673259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df8e9b-c26e-46be-bec5-b466dad48e0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:45.680490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df8e9b-c26e-46be-bec5-b466dad48e0f service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:45.700264 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1445/2918] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:55:45 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:55:46.248193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317d2c-6e4a-468e-8594-ec61d53d099c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:46.250489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-13317d2c-6e4a-468e-8594-ec61d53d099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:46.270279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317d2c-6e4a-468e-8594-ec61d53d099c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:46.280552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90749044-7fcc-4b50-8c6c-45997448f0f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:46.282279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90749044-7fcc-4b50-8c6c-45997448f0f8 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:46.282767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90749044-7fcc-4b50-8c6c-45997448f0f8 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:46.283201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90749044-7fcc-4b50-8c6c-45997448f0f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:46.377029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90749044-7fcc-4b50-8c6c-45997448f0f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:46.379014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90749044-7fcc-4b50-8c6c-45997448f0f8 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:46.404445 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1474/2919] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:55:46 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:55:46.424255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df8e9b-c26e-46be-bec5-b466dad48e0f service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:46.564702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df8e9b-c26e-46be-bec5-b466dad48e0f service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:46.570744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:46.571627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:46.572083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:46.572531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] PATH_INFO: `/v3/users/44cf341eb3c04d57902c24a67e8a95d2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:46.573970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44cf341eb3c04d57902c24a67e8a95d2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:46.576894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:46.693412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44cf341eb3c04d57902c24a67e8a95d2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:46.709979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44cf341eb3c04d57902c24a67e8a95d2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:46.711087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44cf341eb3c04d57902c24a67e8a95d2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:46.712519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44cf341eb3c04d57902c24a67e8a95d2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:46.743014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:46.768105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44cf341eb3c04d57902c24a67e8a95d2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:46.792821 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1446/2920] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:55:46 2022] DELETE /identity/v3/users/44cf341eb3c04d57902c24a67e8a95d2 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:46.799131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16aa2d-4fb9-4f7e-ab4e-ab3dbb3efce9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:46.799789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16aa2d-4fb9-4f7e-ab4e-ab3dbb3efce9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:46.800303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16aa2d-4fb9-4f7e-ab4e-ab3dbb3efce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:46.857440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:46.970903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7c16aa2d-4fb9-4f7e-ab4e-ab3dbb3efce9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:46.972181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7c16aa2d-4fb9-4f7e-ab4e-ab3dbb3efce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:47.108689 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1475/2921] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:47.119453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:47.121276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:47.253172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878b96c-67bf-4f96-ad9b-d62f4e2554e2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:47.259125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29b64d-efea-4ab3-b859-b8423689f8d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:47.259746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29b64d-efea-4ab3-b859-b8423689f8d0 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:47.260020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29b64d-efea-4ab3-b859-b8423689f8d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:47.260293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29b64d-efea-4ab3-b859-b8423689f8d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:47.289696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29b64d-efea-4ab3-b859-b8423689f8d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:47.293559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29b64d-efea-4ab3-b859-b8423689f8d0 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:47.310427 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1447/2922] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:55:48.044009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16aa2d-4fb9-4f7e-ab4e-ab3dbb3efce9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:48.059713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7c16aa2d-4fb9-4f7e-ab4e-ab3dbb3efce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:48.087106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16aa2d-4fb9-4f7e-ab4e-ab3dbb3efce9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:48.093011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:48.093783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:48.093946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:48.094356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] PATH_INFO: `/v3/projects/2ae26877c42a41b2914951b495c1268b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:48.105581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae26877c42a41b2914951b495c1268b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:48.108253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:48.202528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae26877c42a41b2914951b495c1268b', 'request_id': 'req-df7beb82-3a18-4655-b9fe-e927a80edf03'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:48.219786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae26877c42a41b2914951b495c1268b', 'request_id': 'req-df7beb82-3a18-4655-b9fe-e927a80edf03'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:48.233078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae26877c42a41b2914951b495c1268b', 'request_id': 'req-df7beb82-3a18-4655-b9fe-e927a80edf03'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:48.261580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] The token cache is being invalidate because project 2ae26877c42a41b2914951b495c1268b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:55:48.263762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:48.267320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:48.274262 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1476/2923] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:48 2022] DELETE /identity/v3/projects/2ae26877c42a41b2914951b495c1268b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:48.274603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29b64d-efea-4ab3-b859-b8423689f8d0 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:48.291812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29b64d-efea-4ab3-b859-b8423689f8d0 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:48.508787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934bfe0-efa1-4abe-a20f-b60acdd95940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:48.512228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934bfe0-efa1-4abe-a20f-b60acdd95940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:48.512521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934bfe0-efa1-4abe-a20f-b60acdd95940 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:48.512787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934bfe0-efa1-4abe-a20f-b60acdd95940 admin admin] PATH_INFO: `/v3/users/addae14475864554b3791a0fa9d39fae` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:48.517979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934bfe0-efa1-4abe-a20f-b60acdd95940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=addae14475864554b3791a0fa9d39fae)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:48.519953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934bfe0-efa1-4abe-a20f-b60acdd95940 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:48.700615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e934bfe0-efa1-4abe-a20f-b60acdd95940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'addae14475864554b3791a0fa9d39fae'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:48.788417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e934bfe0-efa1-4abe-a20f-b60acdd95940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'addae14475864554b3791a0fa9d39fae'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:48.789423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e934bfe0-efa1-4abe-a20f-b60acdd95940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'addae14475864554b3791a0fa9d39fae'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:48.790749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e934bfe0-efa1-4abe-a20f-b60acdd95940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'addae14475864554b3791a0fa9d39fae'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:48.814247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e934bfe0-efa1-4abe-a20f-b60acdd95940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'addae14475864554b3791a0fa9d39fae'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:48.846945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:48.874929 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1448/2924] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:55:48 2022] DELETE /identity/v3/users/addae14475864554b3791a0fa9d39fae => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:49.859357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:49.862646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:49.894043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7beb82-3a18-4655-b9fe-e927a80edf03 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:49.971815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:50.037795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be46516-3df0-4811-bbce-c6598106a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:50.039007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be46516-3df0-4811-bbce-c6598106a25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:50.040680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be46516-3df0-4811-bbce-c6598106a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:50.044333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be46516-3df0-4811-bbce-c6598106a25c admin admin] PATH_INFO: `/v3/projects/a9a1a3f02f524180b925264f294c0533` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:50.045973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be46516-3df0-4811-bbce-c6598106a25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a1a3f02f524180b925264f294c0533)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:50.051609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be46516-3df0-4811-bbce-c6598106a25c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:50.168952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9be46516-3df0-4811-bbce-c6598106a25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a1a3f02f524180b925264f294c0533', 'request_id': 'req-9be46516-3df0-4811-bbce-c6598106a25c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:50.230332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9be46516-3df0-4811-bbce-c6598106a25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a1a3f02f524180b925264f294c0533', 'request_id': 'req-9be46516-3df0-4811-bbce-c6598106a25c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:50.252180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9be46516-3df0-4811-bbce-c6598106a25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a1a3f02f524180b925264f294c0533', 'request_id': 'req-9be46516-3df0-4811-bbce-c6598106a25c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:50.299958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9be46516-3df0-4811-bbce-c6598106a25c admin admin] The token cache is being invalidate because project a9a1a3f02f524180b925264f294c0533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:55:50.300416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9be46516-3df0-4811-bbce-c6598106a25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:50.301927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9be46516-3df0-4811-bbce-c6598106a25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:50.310794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda652df-a4da-43c9-8aad-ded65fd6a972 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:50.311513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda652df-a4da-43c9-8aad-ded65fd6a972 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:50.311513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda652df-a4da-43c9-8aad-ded65fd6a972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:50.315291 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1477/2925] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:49 2022] DELETE /identity/v3/projects/a9a1a3f02f524180b925264f294c0533 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:50.450367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fda652df-a4da-43c9-8aad-ded65fd6a972 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:50.452021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fda652df-a4da-43c9-8aad-ded65fd6a972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:50.561079 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1449/2926] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:50.571377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9447cc-f90c-4586-aac1-dea9912117b0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:50.571865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9447cc-f90c-4586-aac1-dea9912117b0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:50.572317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9447cc-f90c-4586-aac1-dea9912117b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:50.651291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8d9447cc-f90c-4586-aac1-dea9912117b0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:50.674871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8d9447cc-f90c-4586-aac1-dea9912117b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:50.704303 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1478/2927] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:50.712620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda652df-a4da-43c9-8aad-ded65fd6a972 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:50.761045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda652df-a4da-43c9-8aad-ded65fd6a972 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:50.798805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4596b9d-3dce-46bd-a4a0-bed120e13479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:50.799903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4596b9d-3dce-46bd-a4a0-bed120e13479 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:50.799903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4596b9d-3dce-46bd-a4a0-bed120e13479 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:50.800222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4596b9d-3dce-46bd-a4a0-bed120e13479 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:50.800862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4596b9d-3dce-46bd-a4a0-bed120e13479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:55:50.821317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4596b9d-3dce-46bd-a4a0-bed120e13479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:50.830579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4596b9d-3dce-46bd-a4a0-bed120e13479 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:50.888267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9447cc-f90c-4586-aac1-dea9912117b0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:50.889916 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1450/2928] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:55:50.905954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9447cc-f90c-4586-aac1-dea9912117b0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:50.923842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa85890-959d-4260-8f1b-67cf6f352788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:50.923842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa85890-959d-4260-8f1b-67cf6f352788 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:50.923842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa85890-959d-4260-8f1b-67cf6f352788 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:50.923842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa85890-959d-4260-8f1b-67cf6f352788 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:50.924294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa85890-959d-4260-8f1b-67cf6f352788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:50.937573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa85890-959d-4260-8f1b-67cf6f352788 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:51.082577 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1479/2929] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:55:50 2022] POST /identity/v3/projects => generated 401 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:55:51.084392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4596b9d-3dce-46bd-a4a0-bed120e13479 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:51.103205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4596b9d-3dce-46bd-a4a0-bed120e13479 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:51.333531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44e885-89dc-4238-a2ef-01e914ba4634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:51.334311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e885-89dc-4238-a2ef-01e914ba4634 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:51.334593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e885-89dc-4238-a2ef-01e914ba4634 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:51.338788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e885-89dc-4238-a2ef-01e914ba4634 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:51.339226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e885-89dc-4238-a2ef-01e914ba4634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:51.347538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e885-89dc-4238-a2ef-01e914ba4634 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:51.479761 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1451/2930] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:55:51 2022] POST /identity/v3/users => generated 301 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:55:51.480025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa85890-959d-4260-8f1b-67cf6f352788 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:51.508948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa85890-959d-4260-8f1b-67cf6f352788 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:51.517561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d932c-40ec-45eb-a1b7-70295d4ca35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:51.537650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d932c-40ec-45eb-a1b7-70295d4ca35c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:51.537650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d932c-40ec-45eb-a1b7-70295d4ca35c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:51.537650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d932c-40ec-45eb-a1b7-70295d4ca35c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:51.537650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d932c-40ec-45eb-a1b7-70295d4ca35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:51.537650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d932c-40ec-45eb-a1b7-70295d4ca35c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:51.610530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44e885-89dc-4238-a2ef-01e914ba4634 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:51.624909 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1480/2931] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:55:51.628101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44e885-89dc-4238-a2ef-01e914ba4634 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:51.643345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08dbab-cb5e-469b-a872-a2ec3cfcdd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:51.644591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08dbab-cb5e-469b-a872-a2ec3cfcdd42 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:51.645205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08dbab-cb5e-469b-a872-a2ec3cfcdd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:51.646590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08dbab-cb5e-469b-a872-a2ec3cfcdd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:51.647475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08dbab-cb5e-469b-a872-a2ec3cfcdd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:51.649873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08dbab-cb5e-469b-a872-a2ec3cfcdd42 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:51.698461 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1452/2932] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:55:51.701794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d932c-40ec-45eb-a1b7-70295d4ca35c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:51.732461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d932c-40ec-45eb-a1b7-70295d4ca35c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:51.747110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf14e9b-8b40-421e-9a1a-1766a7809dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:51.748769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf14e9b-8b40-421e-9a1a-1766a7809dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:51.749338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf14e9b-8b40-421e-9a1a-1766a7809dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:51.749934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf14e9b-8b40-421e-9a1a-1766a7809dc4 admin admin] PATH_INFO: `/v3/projects/1874c43f0ba44061baef5745d0c36f1b/users/5802e80dc756411a80f70b229f0f4876/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:51.796791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf14e9b-8b40-421e-9a1a-1766a7809dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1874c43f0ba44061baef5745d0c36f1b, user_id=5802e80dc756411a80f70b229f0f4876, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:51.804246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf14e9b-8b40-421e-9a1a-1766a7809dc4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:51.873601 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1481/2933] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:55:51 2022] PUT /identity/v3/projects/1874c43f0ba44061baef5745d0c36f1b/users/5802e80dc756411a80f70b229f0f4876/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:51.876720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40353493-66ff-491e-ba10-b60b19699dac None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:51.877305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40353493-66ff-491e-ba10-b60b19699dac None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:51.878391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40353493-66ff-491e-ba10-b60b19699dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:51.963484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-40353493-66ff-491e-ba10-b60b19699dac None None] MFA Rules not processed for user `5802e80dc756411a80f70b229f0f4876`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:51.965509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-40353493-66ff-491e-ba10-b60b19699dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:52.030569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:52.135968 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1453/2934] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:51 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:52.155192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf14e9b-8b40-421e-9a1a-1766a7809dc4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:52.161145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-abf14e9b-8b40-421e-9a1a-1766a7809dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:52.353004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:52.494417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf14e9b-8b40-421e-9a1a-1766a7809dc4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:52.504643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700990a7-1a7e-425e-9eaa-d7a9b9796de2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:52.505686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700990a7-1a7e-425e-9eaa-d7a9b9796de2 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:52.506180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700990a7-1a7e-425e-9eaa-d7a9b9796de2 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:52.506626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700990a7-1a7e-425e-9eaa-d7a9b9796de2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:52.538882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700990a7-1a7e-425e-9eaa-d7a9b9796de2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:52.541364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700990a7-1a7e-425e-9eaa-d7a9b9796de2 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:52.568806 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1482/2935] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:55:52 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:55:52.694658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40353493-66ff-491e-ba10-b60b19699dac None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:52.894745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40353493-66ff-491e-ba10-b60b19699dac None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:52.931070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:52.932346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:52.932729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:52.933120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] PATH_INFO: `/v3/users/5802e80dc756411a80f70b229f0f4876` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:52.934457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] RBAC: Authorizing `identity:delete_user(user_id=5802e80dc756411a80f70b229f0f4876)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:52.937425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:53.145669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5802e80dc756411a80f70b229f0f4876'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:53.186849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5802e80dc756411a80f70b229f0f4876'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:53.189409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5802e80dc756411a80f70b229f0f4876'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:53.195716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5802e80dc756411a80f70b229f0f4876'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:53.224133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5802e80dc756411a80f70b229f0f4876'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:53.301838 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1454/2936] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:55:52 2022] DELETE /identity/v3/users/5802e80dc756411a80f70b229f0f4876 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:53.306375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e0a70-da03-4ac6-b689-8f5ad53b26fa None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:53.306945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e0a70-da03-4ac6-b689-8f5ad53b26fa None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:53.306945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e0a70-da03-4ac6-b689-8f5ad53b26fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:53.351447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-771e0a70-da03-4ac6-b689-8f5ad53b26fa None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:53.356115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-771e0a70-da03-4ac6-b689-8f5ad53b26fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:53.546917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:53.549005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:53.568362 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1483/2937] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:55:53.597100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d82ce-9a13-44e3-ab3f-ea635ca730df admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:53.598822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e0a70-da03-4ac6-b689-8f5ad53b26fa None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:53.603013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-771e0a70-da03-4ac6-b689-8f5ad53b26fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:53.615111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:53.615785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:53.616211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:53.616499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] PATH_INFO: `/v3/users/98936da9b5d94165b386d2d0893ac142` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:53.617873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=98936da9b5d94165b386d2d0893ac142)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:53.619901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:53.774164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:53.789788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98936da9b5d94165b386d2d0893ac142'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:53.811075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98936da9b5d94165b386d2d0893ac142'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:53.815382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98936da9b5d94165b386d2d0893ac142'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:53.821792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98936da9b5d94165b386d2d0893ac142'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:53.826241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e0a70-da03-4ac6-b689-8f5ad53b26fa None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:53.835497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ccd8a-8b0d-4094-9165-7178df213637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:53.836363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ccd8a-8b0d-4094-9165-7178df213637 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:53.836641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ccd8a-8b0d-4094-9165-7178df213637 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:53.837118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ccd8a-8b0d-4094-9165-7178df213637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:53.840588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-620ccd8a-8b0d-4094-9165-7178df213637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:53.871284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98936da9b5d94165b386d2d0893ac142'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:53.886688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ccd8a-8b0d-4094-9165-7178df213637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:53.890366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ccd8a-8b0d-4094-9165-7178df213637 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:53.937124 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1484/2938] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:55:53.954976 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1455/2939] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:55:53 2022] DELETE /identity/v3/users/98936da9b5d94165b386d2d0893ac142 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:54.539384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ccd8a-8b0d-4094-9165-7178df213637 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:54.543928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-620ccd8a-8b0d-4094-9165-7178df213637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:54.562083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ccd8a-8b0d-4094-9165-7178df213637 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:54.572985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:54.579410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:54.681026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:54.708845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be78182-ed19-4dca-8aba-edd02d50771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:54.709795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78182-ed19-4dca-8aba-edd02d50771f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:54.710604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78182-ed19-4dca-8aba-edd02d50771f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:54.710904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78182-ed19-4dca-8aba-edd02d50771f admin admin] PATH_INFO: `/v3/projects/1874c43f0ba44061baef5745d0c36f1b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:54.712643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be78182-ed19-4dca-8aba-edd02d50771f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1874c43f0ba44061baef5745d0c36f1b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:54.715288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be78182-ed19-4dca-8aba-edd02d50771f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:54.726737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166e8a8-a30f-44e3-bb77-4c69650121bb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:54.733437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:54.734256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:54.734640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:54.735479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] PATH_INFO: `/v3/projects/3f2441394d754f499e27f6f35d5b3afa` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:54.736742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2441394d754f499e27f6f35d5b3afa)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:54.739047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:54.830800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3be78182-ed19-4dca-8aba-edd02d50771f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1874c43f0ba44061baef5745d0c36f1b', 'request_id': 'req-3be78182-ed19-4dca-8aba-edd02d50771f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:54.847515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2441394d754f499e27f6f35d5b3afa', 'request_id': 'req-996cf65a-819f-47c7-96c3-18153a262f86'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:54.852704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3be78182-ed19-4dca-8aba-edd02d50771f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1874c43f0ba44061baef5745d0c36f1b', 'request_id': 'req-3be78182-ed19-4dca-8aba-edd02d50771f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:54.859106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2441394d754f499e27f6f35d5b3afa', 'request_id': 'req-996cf65a-819f-47c7-96c3-18153a262f86'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:54.863401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3be78182-ed19-4dca-8aba-edd02d50771f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1874c43f0ba44061baef5745d0c36f1b', 'request_id': 'req-3be78182-ed19-4dca-8aba-edd02d50771f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:54.868575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2441394d754f499e27f6f35d5b3afa', 'request_id': 'req-996cf65a-819f-47c7-96c3-18153a262f86'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:54.885744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3be78182-ed19-4dca-8aba-edd02d50771f admin admin] The token cache is being invalidate because project 1874c43f0ba44061baef5745d0c36f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:55:54.886087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3be78182-ed19-4dca-8aba-edd02d50771f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:54.886725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3be78182-ed19-4dca-8aba-edd02d50771f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:54.889031 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1485/2940] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:54 2022] DELETE /identity/v3/projects/1874c43f0ba44061baef5745d0c36f1b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:54.894483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0cc8f-e130-42b3-9651-444bcfc0bef4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:54.894770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0cc8f-e130-42b3-9651-444bcfc0bef4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:54.895208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0cc8f-e130-42b3-9651-444bcfc0bef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:54.911186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] The token cache is being invalidate because project 3f2441394d754f499e27f6f35d5b3afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:55:54.911479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:54.912731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:54.915952 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1456/2941] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:54 2022] DELETE /identity/v3/projects/3f2441394d754f499e27f6f35d5b3afa => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:54.920802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4ac0cc8f-e130-42b3-9651-444bcfc0bef4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:54.922691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4ac0cc8f-e130-42b3-9651-444bcfc0bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:54.924785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:54.929669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:55.023864 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1486/2942] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:55.033882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8059fbb-3a66-4221-bf1f-d3c38c27fe18 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:55.034205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8059fbb-3a66-4221-bf1f-d3c38c27fe18 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:55.034596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8059fbb-3a66-4221-bf1f-d3c38c27fe18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:55.071563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:55.074808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d8059fbb-3a66-4221-bf1f-d3c38c27fe18 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:55.079329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d8059fbb-3a66-4221-bf1f-d3c38c27fe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:55.093752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cf65a-819f-47c7-96c3-18153a262f86 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:55.094830 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1487/2943] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:55.097451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8059fbb-3a66-4221-bf1f-d3c38c27fe18 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:55.099575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:55.100445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:55.100772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:55.101057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] PATH_INFO: `/v3/users/2495d40e2857401a83a78bcdbed948a7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:55.102287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2495d40e2857401a83a78bcdbed948a7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:55.104692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:55.127995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8059fbb-3a66-4221-bf1f-d3c38c27fe18 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:55.139156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde89e9a-edd0-4a85-8042-9b9744965b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:55.140175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde89e9a-edd0-4a85-8042-9b9744965b42 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:55.140424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde89e9a-edd0-4a85-8042-9b9744965b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:55.140729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde89e9a-edd0-4a85-8042-9b9744965b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:55.144051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde89e9a-edd0-4a85-8042-9b9744965b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:55:55.144505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde89e9a-edd0-4a85-8042-9b9744965b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:55.149243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde89e9a-edd0-4a85-8042-9b9744965b42 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:55.188494 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1488/2944] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:55:55.199160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde89e9a-edd0-4a85-8042-9b9744965b42 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:55.202405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2495d40e2857401a83a78bcdbed948a7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:55.210750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2495d40e2857401a83a78bcdbed948a7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:55.211643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2495d40e2857401a83a78bcdbed948a7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:55.212303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2495d40e2857401a83a78bcdbed948a7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:55.228933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2495d40e2857401a83a78bcdbed948a7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:55.236545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde89e9a-edd0-4a85-8042-9b9744965b42 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:55.250894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aa75d-46b7-4260-b058-3cf602d7e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:55.251878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa75d-46b7-4260-b058-3cf602d7e86d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:55.251878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa75d-46b7-4260-b058-3cf602d7e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:55.252142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa75d-46b7-4260-b058-3cf602d7e86d admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:55.253381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200aa75d-46b7-4260-b058-3cf602d7e86d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:55.256738 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1457/2945] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:55:54 2022] DELETE /identity/v3/users/2495d40e2857401a83a78bcdbed948a7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:55.264603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200aa75d-46b7-4260-b058-3cf602d7e86d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:55.345745 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1489/2946] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:55:55 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:55:55.347052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:55.348589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:55.514861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6a5ea-0b81-44d8-afbb-fcbeacc07756 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:55.610434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86f429-1c6b-4832-a00a-eaa1ec1ec72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:55.611894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86f429-1c6b-4832-a00a-eaa1ec1ec72f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:55.612225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86f429-1c6b-4832-a00a-eaa1ec1ec72f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:55.612551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86f429-1c6b-4832-a00a-eaa1ec1ec72f admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:55.613314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86f429-1c6b-4832-a00a-eaa1ec1ec72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:55.615607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86f429-1c6b-4832-a00a-eaa1ec1ec72f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:55.652165 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1458/2947] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:55:55 2022] POST /identity/v3/users => generated 291 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:55:55.656859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aa75d-46b7-4260-b058-3cf602d7e86d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:55.669989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aa75d-46b7-4260-b058-3cf602d7e86d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:55.683838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6a64e-30aa-4d25-b5c6-f7ec4d72bcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:55.684472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6a64e-30aa-4d25-b5c6-f7ec4d72bcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:55.684786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6a64e-30aa-4d25-b5c6-f7ec4d72bcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:55.685055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6a64e-30aa-4d25-b5c6-f7ec4d72bcf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:55.686751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6a64e-30aa-4d25-b5c6-f7ec4d72bcf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:55.690511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6a64e-30aa-4d25-b5c6-f7ec4d72bcf2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:55.704013 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1490/2948] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:55:55.707671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86f429-1c6b-4832-a00a-eaa1ec1ec72f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:55.724980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86f429-1c6b-4832-a00a-eaa1ec1ec72f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:55.730829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e08bed-f6b8-40c6-a5f0-92f3d4f1568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:55.731514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e08bed-f6b8-40c6-a5f0-92f3d4f1568f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:55.731873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e08bed-f6b8-40c6-a5f0-92f3d4f1568f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:55.734100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e08bed-f6b8-40c6-a5f0-92f3d4f1568f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:55.735009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e08bed-f6b8-40c6-a5f0-92f3d4f1568f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:55.737281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e08bed-f6b8-40c6-a5f0-92f3d4f1568f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:55.739723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:55.752953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6a64e-30aa-4d25-b5c6-f7ec4d72bcf2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:55.759258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e1f6a64e-30aa-4d25-b5c6-f7ec4d72bcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:55.787745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6a64e-30aa-4d25-b5c6-f7ec4d72bcf2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:55.811989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:55.813120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:55.813120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:55.813394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd admin admin] PATH_INFO: `/v3/projects/5b99cddc64e94772b4dcfc14a84f5796` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:55.814482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b99cddc64e94772b4dcfc14a84f5796)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:55.817349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:55.834666 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1459/2949] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:55:55.839333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e08bed-f6b8-40c6-a5f0-92f3d4f1568f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:55.855696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:55.884038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e08bed-f6b8-40c6-a5f0-92f3d4f1568f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:55.954641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b99cddc64e94772b4dcfc14a84f5796', 'request_id': 'req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:55.974107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b99cddc64e94772b4dcfc14a84f5796', 'request_id': 'req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:55.982276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b99cddc64e94772b4dcfc14a84f5796', 'request_id': 'req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:56.003644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd admin admin] The token cache is being invalidate because project 5b99cddc64e94772b4dcfc14a84f5796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:55:56.004102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:56.004897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d49ce8e5-7dbb-422a-ad4a-bff25f6c11cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:56.006792 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1491/2950] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:55 2022] DELETE /identity/v3/projects/5b99cddc64e94772b4dcfc14a84f5796 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:56.008377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac98459-2677-42c7-8dd9-899d42599613 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.008762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac98459-2677-42c7-8dd9-899d42599613 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.009136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac98459-2677-42c7-8dd9-899d42599613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.030771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9012d3-2234-4dc8-b5bd-eb9749a1482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:56.031815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9012d3-2234-4dc8-b5bd-eb9749a1482a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.034548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9012d3-2234-4dc8-b5bd-eb9749a1482a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.035273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9012d3-2234-4dc8-b5bd-eb9749a1482a admin admin] PATH_INFO: `/v3/projects/1be94d02ab5244f98337fb9b90e74746/users/5ac1323815364df4a3a4d4dbbb9d70dd/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.058593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9012d3-2234-4dc8-b5bd-eb9749a1482a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be94d02ab5244f98337fb9b90e74746, user_id=5ac1323815364df4a3a4d4dbbb9d70dd, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:56.063202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9012d3-2234-4dc8-b5bd-eb9749a1482a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:56.073705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-eac98459-2677-42c7-8dd9-899d42599613 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:56.075827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eac98459-2677-42c7-8dd9-899d42599613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:56.095277 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1460/2951] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:55:55 2022] PUT /identity/v3/projects/1be94d02ab5244f98337fb9b90e74746/users/5ac1323815364df4a3a4d4dbbb9d70dd/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:56.097704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dbf26-d2fd-4004-bb3c-7cc374ffee1c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.105686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dbf26-d2fd-4004-bb3c-7cc374ffee1c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.106186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dbf26-d2fd-4004-bb3c-7cc374ffee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.130756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cc0dbf26-d2fd-4004-bb3c-7cc374ffee1c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:56.132345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cc0dbf26-d2fd-4004-bb3c-7cc374ffee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:56.179130 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1492/2952] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:56.181750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999edf72-a1a5-4639-a1d2-2be513f88c9a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.182384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999edf72-a1a5-4639-a1d2-2be513f88c9a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.188833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999edf72-a1a5-4639-a1d2-2be513f88c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.217943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-999edf72-a1a5-4639-a1d2-2be513f88c9a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:56.220313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-999edf72-a1a5-4639-a1d2-2be513f88c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:56.230276 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1461/2953] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:56.239481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dbf26-d2fd-4004-bb3c-7cc374ffee1c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:56.242374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cc0dbf26-d2fd-4004-bb3c-7cc374ffee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:56.322470 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1493/2954] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:56.324837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5181c-2070-4994-9344-f5c98e005701 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.327245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5181c-2070-4994-9344-f5c98e005701 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.327552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5181c-2070-4994-9344-f5c98e005701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.365211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dbf26-d2fd-4004-bb3c-7cc374ffee1c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:56.365421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c1c5181c-2070-4994-9344-f5c98e005701 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:56.365421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c1c5181c-2070-4994-9344-f5c98e005701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:56.365620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e83c56-d7ea-4ac1-a4c4-9913556db2b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:56.365620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83c56-d7ea-4ac1-a4c4-9913556db2b8 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.365620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83c56-d7ea-4ac1-a4c4-9913556db2b8 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.365620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83c56-d7ea-4ac1-a4c4-9913556db2b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.377470 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1494/2955] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:56.378333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5181c-2070-4994-9344-f5c98e005701 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:56.379634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c1c5181c-2070-4994-9344-f5c98e005701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:56.382901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e83c56-d7ea-4ac1-a4c4-9913556db2b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:56.384589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e83c56-d7ea-4ac1-a4c4-9913556db2b8 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:56.393928 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1462/2956] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:55:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:56.394835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e83c56-d7ea-4ac1-a4c4-9913556db2b8 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:56.405756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e83c56-d7ea-4ac1-a4c4-9913556db2b8 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:56.414251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df816d30-3076-4a26-ace1-5ec68e549935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:56.415321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df816d30-3076-4a26-ace1-5ec68e549935 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.415609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df816d30-3076-4a26-ace1-5ec68e549935 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.415897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df816d30-3076-4a26-ace1-5ec68e549935 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.416564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df816d30-3076-4a26-ace1-5ec68e549935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:55:56.416939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df816d30-3076-4a26-ace1-5ec68e549935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:56.418686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df816d30-3076-4a26-ace1-5ec68e549935 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:56.422512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:56.438650 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1463/2957] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:55:56.441714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df816d30-3076-4a26-ace1-5ec68e549935 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:56.464684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:56.468734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df816d30-3076-4a26-ace1-5ec68e549935 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:56.476400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e0589-9c62-43ff-906c-dbeab1123c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:56.476934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e0589-9c62-43ff-906c-dbeab1123c1a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.477258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e0589-9c62-43ff-906c-dbeab1123c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.477551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e0589-9c62-43ff-906c-dbeab1123c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.478168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e0589-9c62-43ff-906c-dbeab1123c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:56.482866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e0589-9c62-43ff-906c-dbeab1123c1a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:56.522080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5181c-2070-4994-9344-f5c98e005701 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:56.528925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d54aa-bcb2-4058-8780-7f4973307c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:56.530305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d54aa-bcb2-4058-8780-7f4973307c75 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.530608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d54aa-bcb2-4058-8780-7f4973307c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.530908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d54aa-bcb2-4058-8780-7f4973307c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.547736 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1464/2958] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:55:56 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:55:56.547901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d54aa-bcb2-4058-8780-7f4973307c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:56.548832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d54aa-bcb2-4058-8780-7f4973307c75 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:56.553154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e0589-9c62-43ff-906c-dbeab1123c1a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:56.563091 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1495/2959] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:55:56.660852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e0589-9c62-43ff-906c-dbeab1123c1a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:56.680496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75e56d-2750-4aba-a65f-4682c40e3e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:56.681240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75e56d-2750-4aba-a65f-4682c40e3e88 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.683211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75e56d-2750-4aba-a65f-4682c40e3e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.683559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75e56d-2750-4aba-a65f-4682c40e3e88 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.684276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75e56d-2750-4aba-a65f-4682c40e3e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:56.691437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75e56d-2750-4aba-a65f-4682c40e3e88 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:56.744106 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1465/2960] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:55:56 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:55:56.745865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d54aa-bcb2-4058-8780-7f4973307c75 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:56.763900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d54aa-bcb2-4058-8780-7f4973307c75 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:56.784290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721dc25-af54-4adf-9e2b-6ec9d22e9aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:56.785495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721dc25-af54-4adf-9e2b-6ec9d22e9aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.785897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721dc25-af54-4adf-9e2b-6ec9d22e9aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.786299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721dc25-af54-4adf-9e2b-6ec9d22e9aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.787713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721dc25-af54-4adf-9e2b-6ec9d22e9aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:56.790499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721dc25-af54-4adf-9e2b-6ec9d22e9aa6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:56.823593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75e56d-2750-4aba-a65f-4682c40e3e88 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:56.834738 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1496/2961] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:55:56.840150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75e56d-2750-4aba-a65f-4682c40e3e88 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:56.852499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affd788-cf28-438a-a4da-ea3c0051eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:56.853455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affd788-cf28-438a-a4da-ea3c0051eb1c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.853744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affd788-cf28-438a-a4da-ea3c0051eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.854134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affd788-cf28-438a-a4da-ea3c0051eb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.854680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affd788-cf28-438a-a4da-ea3c0051eb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:56.861419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affd788-cf28-438a-a4da-ea3c0051eb1c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:56.897810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721dc25-af54-4adf-9e2b-6ec9d22e9aa6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:56.904643 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1466/2962] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:55:56.909336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721dc25-af54-4adf-9e2b-6ec9d22e9aa6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:56.914730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f8503-3306-4f07-9035-bbe9e1e60aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:56.915490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8503-3306-4f07-9035-bbe9e1e60aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.916180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8503-3306-4f07-9035-bbe9e1e60aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.916540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8503-3306-4f07-9035-bbe9e1e60aa4 admin admin] PATH_INFO: `/v3/projects/1fd0249867ab4ad6b1e9a0388c9e25be/users/0842c774f38f47d096bc1c3691691751/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.940774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f8503-3306-4f07-9035-bbe9e1e60aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd0249867ab4ad6b1e9a0388c9e25be, user_id=0842c774f38f47d096bc1c3691691751, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:56.944236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f8503-3306-4f07-9035-bbe9e1e60aa4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:56.984290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe1a19-4844-47f2-85f0-3cb184c2f271 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:56.984944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe1a19-4844-47f2-85f0-3cb184c2f271 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:56.985435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe1a19-4844-47f2-85f0-3cb184c2f271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:56.995400 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1497/2963] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:55:56 2022] PUT /identity/v3/projects/1fd0249867ab4ad6b1e9a0388c9e25be/users/0842c774f38f47d096bc1c3691691751/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:57.061711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5bbe1a19-4844-47f2-85f0-3cb184c2f271 None None] MFA Rules not processed for user `0842c774f38f47d096bc1c3691691751`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:57.063569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5bbe1a19-4844-47f2-85f0-3cb184c2f271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:57.241381 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1467/2964] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:57.245805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f8503-3306-4f07-9035-bbe9e1e60aa4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:57.379855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f8503-3306-4f07-9035-bbe9e1e60aa4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:57.391262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d52f3d-9289-45d2-be94-b7294bc37606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:57.391922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d52f3d-9289-45d2-be94-b7294bc37606 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:57.392209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d52f3d-9289-45d2-be94-b7294bc37606 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:57.392489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d52f3d-9289-45d2-be94-b7294bc37606 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:57.393145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d52f3d-9289-45d2-be94-b7294bc37606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:57.395108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d52f3d-9289-45d2-be94-b7294bc37606 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:57.462637 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1498/2965] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:55:57 2022] POST /identity/v3/projects => generated 389 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:55:57.467074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe1a19-4844-47f2-85f0-3cb184c2f271 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:57.482126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe1a19-4844-47f2-85f0-3cb184c2f271 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:57.569359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:57.626362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d7b1f-425a-4600-8ea5-77673a781af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:57.629622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d7b1f-425a-4600-8ea5-77673a781af6 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:57.629898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d7b1f-425a-4600-8ea5-77673a781af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:57.630167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d7b1f-425a-4600-8ea5-77673a781af6 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:57.630845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d7b1f-425a-4600-8ea5-77673a781af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:57.637526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d7b1f-425a-4600-8ea5-77673a781af6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:57.675171 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1468/2966] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:55:57 2022] POST /identity/v3/users => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:55:57.679032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d52f3d-9289-45d2-be94-b7294bc37606 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:57.694471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d52f3d-9289-45d2-be94-b7294bc37606 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:57.724551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af4d27-bd1c-4ded-a34f-df9bebcd5ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:57.725209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af4d27-bd1c-4ded-a34f-df9bebcd5ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:57.725730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af4d27-bd1c-4ded-a34f-df9bebcd5ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:57.726085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af4d27-bd1c-4ded-a34f-df9bebcd5ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:57.727292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af4d27-bd1c-4ded-a34f-df9bebcd5ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:57.728521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af4d27-bd1c-4ded-a34f-df9bebcd5ce7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:57.762440 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1499/2967] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:55:57.766956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d7b1f-425a-4600-8ea5-77673a781af6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:57.780840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d7b1f-425a-4600-8ea5-77673a781af6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:57.792709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d73804-1ae1-484f-9be7-38e87a84cd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:57.793406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d73804-1ae1-484f-9be7-38e87a84cd20 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:57.793694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d73804-1ae1-484f-9be7-38e87a84cd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:57.794527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d73804-1ae1-484f-9be7-38e87a84cd20 admin admin] PATH_INFO: `/v3/projects/e22f10ad8b4140c0a1ebd06c8a14899b/users/fce8e310cf0247be8e319b6823a64f6c/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:57.832727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d73804-1ae1-484f-9be7-38e87a84cd20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22f10ad8b4140c0a1ebd06c8a14899b, user_id=fce8e310cf0247be8e319b6823a64f6c, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:57.835435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d73804-1ae1-484f-9be7-38e87a84cd20 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:57.864862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af4d27-bd1c-4ded-a34f-df9bebcd5ce7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:57.865311 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1469/2968] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:55:57 2022] PUT /identity/v3/projects/e22f10ad8b4140c0a1ebd06c8a14899b/users/fce8e310cf0247be8e319b6823a64f6c/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:57.888303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af4d27-bd1c-4ded-a34f-df9bebcd5ce7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:58.004385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11159c1b-04a6-4a7a-b94c-5c320517fd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:58.005032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159c1b-04a6-4a7a-b94c-5c320517fd83 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:58.005330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159c1b-04a6-4a7a-b94c-5c320517fd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:58.005607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159c1b-04a6-4a7a-b94c-5c320517fd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:58.006256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11159c1b-04a6-4a7a-b94c-5c320517fd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:58.008011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11159c1b-04a6-4a7a-b94c-5c320517fd83 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:58.055343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d73804-1ae1-484f-9be7-38e87a84cd20 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:58.055900 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1500/2969] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:55:58.068863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d73804-1ae1-484f-9be7-38e87a84cd20 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:58.085067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f73a2-e611-4572-9d7f-326cb9b9b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:58.085775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f73a2-e611-4572-9d7f-326cb9b9b5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:58.086058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f73a2-e611-4572-9d7f-326cb9b9b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:58.086335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f73a2-e611-4572-9d7f-326cb9b9b5a1 admin admin] PATH_INFO: `/v3/projects/e22f10ad8b4140c0a1ebd06c8a14899b/users/fce8e310cf0247be8e319b6823a64f6c/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:58.088323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f73a2-e611-4572-9d7f-326cb9b9b5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22f10ad8b4140c0a1ebd06c8a14899b, user_id=fce8e310cf0247be8e319b6823a64f6c, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:58.091879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f73a2-e611-4572-9d7f-326cb9b9b5a1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:58.123331 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1470/2970] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:55:58 2022] PUT /identity/v3/projects/e22f10ad8b4140c0a1ebd06c8a14899b/users/fce8e310cf0247be8e319b6823a64f6c/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:58.141027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccdcc6-28af-43f9-af8d-e633e8bfa60c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:58.141027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccdcc6-28af-43f9-af8d-e633e8bfa60c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:58.141027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccdcc6-28af-43f9-af8d-e633e8bfa60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:58.188977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:58.196425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-90ccdcc6-28af-43f9-af8d-e633e8bfa60c None None] MFA Rules not processed for user `fce8e310cf0247be8e319b6823a64f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:55:58.197835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-90ccdcc6-28af-43f9-af8d-e633e8bfa60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:58.347476 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1501/2971] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:55:58.359756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f73a2-e611-4572-9d7f-326cb9b9b5a1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:58.361672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b08f73a2-e611-4572-9d7f-326cb9b9b5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:58.665226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f73a2-e611-4572-9d7f-326cb9b9b5a1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:58.698738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a64a38-6e86-4231-9fb6-428bf620a9bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:58.699649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64a38-6e86-4231-9fb6-428bf620a9bd service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:58.700090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64a38-6e86-4231-9fb6-428bf620a9bd service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:58.701219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64a38-6e86-4231-9fb6-428bf620a9bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:58.737862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a64a38-6e86-4231-9fb6-428bf620a9bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:58.743398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a64a38-6e86-4231-9fb6-428bf620a9bd service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:58.818924 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1471/2972] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:55:58 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:55:58.879522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccdcc6-28af-43f9-af8d-e633e8bfa60c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:58.898305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccdcc6-28af-43f9-af8d-e633e8bfa60c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:58.938167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de420bb-7950-4ace-b488-70ea1fa6437e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:58.938810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de420bb-7950-4ace-b488-70ea1fa6437e service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:58.939098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de420bb-7950-4ace-b488-70ea1fa6437e service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:58.939373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de420bb-7950-4ace-b488-70ea1fa6437e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:59.175533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de420bb-7950-4ace-b488-70ea1fa6437e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:59.177399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de420bb-7950-4ace-b488-70ea1fa6437e service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:59.212804 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1502/2973] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:55:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:56:00.065015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a64a38-6e86-4231-9fb6-428bf620a9bd service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:00.213165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a64a38-6e86-4231-9fb6-428bf620a9bd service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:00.226307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:00.227370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:00.229834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:00.231044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] PATH_INFO: `/v3/users/0842c774f38f47d096bc1c3691691751` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:00.235077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0842c774f38f47d096bc1c3691691751)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:00.237344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:00.345665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:00.423192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0842c774f38f47d096bc1c3691691751'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:00.448058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0842c774f38f47d096bc1c3691691751'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:00.449543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0842c774f38f47d096bc1c3691691751'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:00.453005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0842c774f38f47d096bc1c3691691751'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:00.519568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0842c774f38f47d096bc1c3691691751'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:00.556359 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1472/2974] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:56:00 2022] DELETE /identity/v3/users/0842c774f38f47d096bc1c3691691751 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:00.560848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f3b17-e832-439b-aeb1-e18edca58cf1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:00.561376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f3b17-e832-439b-aeb1-e18edca58cf1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:00.561376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f3b17-e832-439b-aeb1-e18edca58cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:00.646662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-373f3b17-e832-439b-aeb1-e18edca58cf1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:00.648587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-373f3b17-e832-439b-aeb1-e18edca58cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:00.873709 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1503/2975] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:00.880771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:00.882350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:01.008036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262cd6d-c4ee-4cba-b535-8440175a3a65 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:01.023510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b08e4-7081-4da4-ae28-57914a221e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:01.026124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b08e4-7081-4da4-ae28-57914a221e37 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:01.029564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b08e4-7081-4da4-ae28-57914a221e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:01.030168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b08e4-7081-4da4-ae28-57914a221e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:01.060896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b08e4-7081-4da4-ae28-57914a221e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:01.067553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b08e4-7081-4da4-ae28-57914a221e37 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:01.116199 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1473/2976] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:56:01.601519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f3b17-e832-439b-aeb1-e18edca58cf1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:01.603047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-373f3b17-e832-439b-aeb1-e18edca58cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:01.629443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f3b17-e832-439b-aeb1-e18edca58cf1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:01.642114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:01.644300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:01.644932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:01.645862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] PATH_INFO: `/v3/projects/1fd0249867ab4ad6b1e9a0388c9e25be` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:01.649885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd0249867ab4ad6b1e9a0388c9e25be)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:01.657435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:01.731147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:01.756268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd0249867ab4ad6b1e9a0388c9e25be', 'request_id': 'req-c65f3e19-9d88-440f-b621-643fd606120b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:01.773493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd0249867ab4ad6b1e9a0388c9e25be', 'request_id': 'req-c65f3e19-9d88-440f-b621-643fd606120b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:01.782283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd0249867ab4ad6b1e9a0388c9e25be', 'request_id': 'req-c65f3e19-9d88-440f-b621-643fd606120b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:01.797527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] The token cache is being invalidate because project 1fd0249867ab4ad6b1e9a0388c9e25be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:56:01.798243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:01.799361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:01.802301 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1504/2977] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:01 2022] DELETE /identity/v3/projects/1fd0249867ab4ad6b1e9a0388c9e25be => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:01.806610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b08e4-7081-4da4-ae28-57914a221e37 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:01.826392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b08e4-7081-4da4-ae28-57914a221e37 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:01.971644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817479b1-cbdd-45fa-adf4-ff2145d41e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:01.972567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817479b1-cbdd-45fa-adf4-ff2145d41e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:01.973044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817479b1-cbdd-45fa-adf4-ff2145d41e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:01.973535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817479b1-cbdd-45fa-adf4-ff2145d41e00 admin admin] PATH_INFO: `/v3/users/fce8e310cf0247be8e319b6823a64f6c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:01.975051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817479b1-cbdd-45fa-adf4-ff2145d41e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce8e310cf0247be8e319b6823a64f6c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:01.978850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817479b1-cbdd-45fa-adf4-ff2145d41e00 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:02.080439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:02.083707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-817479b1-cbdd-45fa-adf4-ff2145d41e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce8e310cf0247be8e319b6823a64f6c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:02.099523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-817479b1-cbdd-45fa-adf4-ff2145d41e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce8e310cf0247be8e319b6823a64f6c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:02.100382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-817479b1-cbdd-45fa-adf4-ff2145d41e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce8e310cf0247be8e319b6823a64f6c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:02.101165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-817479b1-cbdd-45fa-adf4-ff2145d41e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce8e310cf0247be8e319b6823a64f6c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:02.146170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-817479b1-cbdd-45fa-adf4-ff2145d41e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce8e310cf0247be8e319b6823a64f6c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:02.176724 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1474/2978] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:56:01 2022] DELETE /identity/v3/users/fce8e310cf0247be8e319b6823a64f6c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:56:03.959728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:03.962522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:04.002261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f3e19-9d88-440f-b621-643fd606120b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:04.179467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9513fc-8129-4572-adc3-cccf8e56ff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:04.182665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9513fc-8129-4572-adc3-cccf8e56ff8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:04.182976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9513fc-8129-4572-adc3-cccf8e56ff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:04.183261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9513fc-8129-4572-adc3-cccf8e56ff8d admin admin] PATH_INFO: `/v3/projects/e22f10ad8b4140c0a1ebd06c8a14899b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:04.186134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9513fc-8129-4572-adc3-cccf8e56ff8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22f10ad8b4140c0a1ebd06c8a14899b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:04.188051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9513fc-8129-4572-adc3-cccf8e56ff8d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:04.364062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ea9513fc-8129-4572-adc3-cccf8e56ff8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22f10ad8b4140c0a1ebd06c8a14899b', 'request_id': 'req-ea9513fc-8129-4572-adc3-cccf8e56ff8d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:04.384828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ea9513fc-8129-4572-adc3-cccf8e56ff8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22f10ad8b4140c0a1ebd06c8a14899b', 'request_id': 'req-ea9513fc-8129-4572-adc3-cccf8e56ff8d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:04.398053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ea9513fc-8129-4572-adc3-cccf8e56ff8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22f10ad8b4140c0a1ebd06c8a14899b', 'request_id': 'req-ea9513fc-8129-4572-adc3-cccf8e56ff8d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:04.431912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ea9513fc-8129-4572-adc3-cccf8e56ff8d admin admin] The token cache is being invalidate because project e22f10ad8b4140c0a1ebd06c8a14899b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:56:04.439064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ea9513fc-8129-4572-adc3-cccf8e56ff8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:04.443956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ea9513fc-8129-4572-adc3-cccf8e56ff8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:04.446675 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1505/2979] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:03 2022] DELETE /identity/v3/projects/e22f10ad8b4140c0a1ebd06c8a14899b => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:04.451567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9b112-e506-47d0-b804-40ded87b7921 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:04.452087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9b112-e506-47d0-b804-40ded87b7921 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:04.452347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9b112-e506-47d0-b804-40ded87b7921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:04.489621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b3a9b112-e506-47d0-b804-40ded87b7921 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:04.498269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b3a9b112-e506-47d0-b804-40ded87b7921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:04.656468 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1475/2980] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:04.658511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074312d-6886-40e9-8961-ecdec44fc988 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:04.658842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074312d-6886-40e9-8961-ecdec44fc988 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:04.659114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074312d-6886-40e9-8961-ecdec44fc988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:04.716928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b074312d-6886-40e9-8961-ecdec44fc988 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:04.723630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b074312d-6886-40e9-8961-ecdec44fc988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:04.735944 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1506/2981] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:56:04.741074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9b112-e506-47d0-b804-40ded87b7921 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:04.754886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9b112-e506-47d0-b804-40ded87b7921 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:04.761550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2ac5-4ca3-42ab-80a8-4f489ddf509e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:04.762937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2ac5-4ca3-42ab-80a8-4f489ddf509e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:04.763476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2ac5-4ca3-42ab-80a8-4f489ddf509e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:04.764003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2ac5-4ca3-42ab-80a8-4f489ddf509e admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:04.764959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e2ac5-4ca3-42ab-80a8-4f489ddf509e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:56:04.765674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e2ac5-4ca3-42ab-80a8-4f489ddf509e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:04.767776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e2ac5-4ca3-42ab-80a8-4f489ddf509e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:04.821936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074312d-6886-40e9-8961-ecdec44fc988 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:04.828511 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1476/2982] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:56:04.836338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074312d-6886-40e9-8961-ecdec44fc988 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:04.848968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99f7d9-4182-4c56-a5db-8f324d39b6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:04.849770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99f7d9-4182-4c56-a5db-8f324d39b6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:04.850155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99f7d9-4182-4c56-a5db-8f324d39b6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:04.850554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99f7d9-4182-4c56-a5db-8f324d39b6a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:04.851352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99f7d9-4182-4c56-a5db-8f324d39b6a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:04.858581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99f7d9-4182-4c56-a5db-8f324d39b6a5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:04.933259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2ac5-4ca3-42ab-80a8-4f489ddf509e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:04.942551 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1507/2983] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:56:04 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:56:04.947403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2ac5-4ca3-42ab-80a8-4f489ddf509e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:05.070286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875452a-194d-48c5-a525-88f5f00b0e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:05.071962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875452a-194d-48c5-a525-88f5f00b0e0f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:05.071962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875452a-194d-48c5-a525-88f5f00b0e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:05.073352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875452a-194d-48c5-a525-88f5f00b0e0f admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:05.075577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875452a-194d-48c5-a525-88f5f00b0e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:05.080044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875452a-194d-48c5-a525-88f5f00b0e0f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:05.152226 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1477/2984] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:56:04 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:56:05.156143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99f7d9-4182-4c56-a5db-8f324d39b6a5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:05.178213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99f7d9-4182-4c56-a5db-8f324d39b6a5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:05.190845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158d049-b2c0-43af-b462-bbaadaae182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:05.191734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158d049-b2c0-43af-b462-bbaadaae182a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:05.193335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158d049-b2c0-43af-b462-bbaadaae182a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:05.193734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158d049-b2c0-43af-b462-bbaadaae182a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:05.194971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158d049-b2c0-43af-b462-bbaadaae182a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:05.200448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158d049-b2c0-43af-b462-bbaadaae182a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:05.244293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875452a-194d-48c5-a525-88f5f00b0e0f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:05.244748 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1508/2985] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:56:05.272302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875452a-194d-48c5-a525-88f5f00b0e0f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:05.292100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad738c-fbb3-455e-b6ff-ce4e50ada017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:05.292964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad738c-fbb3-455e-b6ff-ce4e50ada017 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:05.293424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad738c-fbb3-455e-b6ff-ce4e50ada017 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:05.293806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad738c-fbb3-455e-b6ff-ce4e50ada017 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:05.297286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad738c-fbb3-455e-b6ff-ce4e50ada017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:05.299029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad738c-fbb3-455e-b6ff-ce4e50ada017 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:05.340511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158d049-b2c0-43af-b462-bbaadaae182a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:05.342871 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1478/2986] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:56:05.352015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158d049-b2c0-43af-b462-bbaadaae182a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:05.374160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128945d-6923-45be-8062-db56639c21ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:05.375203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128945d-6923-45be-8062-db56639c21ab admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:05.375203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128945d-6923-45be-8062-db56639c21ab admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:05.375486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128945d-6923-45be-8062-db56639c21ab admin admin] PATH_INFO: `/v3/projects/d7550f7ad9dc45ba9c9bfb0a5a11a774/users/05f0f7a60257437eaa8702b664916979/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:05.400801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:05.426655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128945d-6923-45be-8062-db56639c21ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7550f7ad9dc45ba9c9bfb0a5a11a774, user_id=05f0f7a60257437eaa8702b664916979, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:05.429364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128945d-6923-45be-8062-db56639c21ab admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:05.473638 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1509/2987] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:56:05 2022] PUT /identity/v3/projects/d7550f7ad9dc45ba9c9bfb0a5a11a774/users/05f0f7a60257437eaa8702b664916979/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:05.486224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c89033-7fa6-42ac-8a4f-d80a6e568651 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:05.486742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c89033-7fa6-42ac-8a4f-d80a6e568651 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:05.487002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c89033-7fa6-42ac-8a4f-d80a6e568651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:05.544161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-86c89033-7fa6-42ac-8a4f-d80a6e568651 None None] MFA Rules not processed for user `05f0f7a60257437eaa8702b664916979`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:05.546702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-86c89033-7fa6-42ac-8a4f-d80a6e568651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:05.579040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:05.708554 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1479/2988] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:05.714042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128945d-6923-45be-8062-db56639c21ab admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:05.945198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128945d-6923-45be-8062-db56639c21ab admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:05.957862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91562b1-4c38-4dc8-81cb-dc45bf7a3ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:05.959204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91562b1-4c38-4dc8-81cb-dc45bf7a3ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:05.959204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91562b1-4c38-4dc8-81cb-dc45bf7a3ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:05.959204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91562b1-4c38-4dc8-81cb-dc45bf7a3ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:05.959867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91562b1-4c38-4dc8-81cb-dc45bf7a3ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:05.963432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91562b1-4c38-4dc8-81cb-dc45bf7a3ce6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:06.021116 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1510/2989] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:56:05 2022] POST /identity/v3/projects => generated 387 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:56:06.025132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c89033-7fa6-42ac-8a4f-d80a6e568651 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:06.060503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c89033-7fa6-42ac-8a4f-d80a6e568651 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:06.233289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effae7c-462b-45f8-84a4-651ed3ba86fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:06.233964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effae7c-462b-45f8-84a4-651ed3ba86fe admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:06.234205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effae7c-462b-45f8-84a4-651ed3ba86fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:06.235450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effae7c-462b-45f8-84a4-651ed3ba86fe admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:06.235849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effae7c-462b-45f8-84a4-651ed3ba86fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:06.238030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effae7c-462b-45f8-84a4-651ed3ba86fe admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:06.271794 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1480/2990] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:56:06 2022] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:56:06.277037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91562b1-4c38-4dc8-81cb-dc45bf7a3ce6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:06.304617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91562b1-4c38-4dc8-81cb-dc45bf7a3ce6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:06.341277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bd75a-c238-4e09-bdae-9e4ed17a0d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:06.341921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bd75a-c238-4e09-bdae-9e4ed17a0d23 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:06.342207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bd75a-c238-4e09-bdae-9e4ed17a0d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:06.342560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bd75a-c238-4e09-bdae-9e4ed17a0d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:06.345977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bd75a-c238-4e09-bdae-9e4ed17a0d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:06.347638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bd75a-c238-4e09-bdae-9e4ed17a0d23 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:06.381029 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1511/2991] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:56:06.388701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effae7c-462b-45f8-84a4-651ed3ba86fe admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:06.410323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effae7c-462b-45f8-84a4-651ed3ba86fe admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:06.424180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edd21c-4fc9-40ad-9e28-6f77b2eb012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:06.425279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edd21c-4fc9-40ad-9e28-6f77b2eb012a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:06.425574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edd21c-4fc9-40ad-9e28-6f77b2eb012a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:06.425900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edd21c-4fc9-40ad-9e28-6f77b2eb012a admin admin] PATH_INFO: `/v3/projects/4a1046f826864ce2aeafe7c6fa76d27d/users/3d7dcc4a842b44ad916158a902ee0878/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:06.454208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edd21c-4fc9-40ad-9e28-6f77b2eb012a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1046f826864ce2aeafe7c6fa76d27d, user_id=3d7dcc4a842b44ad916158a902ee0878, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:06.458454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edd21c-4fc9-40ad-9e28-6f77b2eb012a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:06.514026 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1481/2992] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:56:06 2022] PUT /identity/v3/projects/4a1046f826864ce2aeafe7c6fa76d27d/users/3d7dcc4a842b44ad916158a902ee0878/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:06.515231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bd75a-c238-4e09-bdae-9e4ed17a0d23 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:06.531833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bd75a-c238-4e09-bdae-9e4ed17a0d23 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:06.711570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf1c07-3816-4552-9671-f4f448e75ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:06.712553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf1c07-3816-4552-9671-f4f448e75ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:06.712838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf1c07-3816-4552-9671-f4f448e75ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:06.713112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf1c07-3816-4552-9671-f4f448e75ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:06.713806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf1c07-3816-4552-9671-f4f448e75ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:06.716027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf1c07-3816-4552-9671-f4f448e75ad2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:06.744983 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1512/2993] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:56:06.749928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edd21c-4fc9-40ad-9e28-6f77b2eb012a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:06.776404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edd21c-4fc9-40ad-9e28-6f77b2eb012a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:06.791863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c5e75-bc0d-4e5f-8d6a-29f1ea9caef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:06.792851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c5e75-bc0d-4e5f-8d6a-29f1ea9caef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:06.793964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c5e75-bc0d-4e5f-8d6a-29f1ea9caef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:06.794608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c5e75-bc0d-4e5f-8d6a-29f1ea9caef7 admin admin] PATH_INFO: `/v3/projects/4a1046f826864ce2aeafe7c6fa76d27d/users/3d7dcc4a842b44ad916158a902ee0878/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:06.799017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c5e75-bc0d-4e5f-8d6a-29f1ea9caef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1046f826864ce2aeafe7c6fa76d27d, user_id=3d7dcc4a842b44ad916158a902ee0878, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:06.803246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c5e75-bc0d-4e5f-8d6a-29f1ea9caef7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:06.819860 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1482/2994] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:56:06 2022] PUT /identity/v3/projects/4a1046f826864ce2aeafe7c6fa76d27d/users/3d7dcc4a842b44ad916158a902ee0878/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:06.830757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23042a44-9661-4fca-8672-6db4a1333092 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:06.831214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23042a44-9661-4fca-8672-6db4a1333092 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:06.832831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23042a44-9661-4fca-8672-6db4a1333092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:06.882626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-23042a44-9661-4fca-8672-6db4a1333092 None None] MFA Rules not processed for user `3d7dcc4a842b44ad916158a902ee0878`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:06.889529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-23042a44-9661-4fca-8672-6db4a1333092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:06.987567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:07.036133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fb398-e407-4659-b5b5-617071e14fff None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:07.036615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fb398-e407-4659-b5b5-617071e14fff None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:07.037008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fb398-e407-4659-b5b5-617071e14fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:07.103590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-879fb398-e407-4659-b5b5-617071e14fff None None] MFA Rules not processed for user `5ac1323815364df4a3a4d4dbbb9d70dd`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:07.105045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-879fb398-e407-4659-b5b5-617071e14fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:07.122385 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1513/2995] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:07.126381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b406-22db-4a1e-9498-4fc75cc68e65 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:07.127181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b406-22db-4a1e-9498-4fc75cc68e65 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:07.128046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b406-22db-4a1e-9498-4fc75cc68e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:07.185983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6b39b406-22db-4a1e-9498-4fc75cc68e65 None None] MFA Rules not processed for user `05f0f7a60257437eaa8702b664916979`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:07.189410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6b39b406-22db-4a1e-9498-4fc75cc68e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:07.254481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:07.278593 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1483/2996] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:07.286614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fb398-e407-4659-b5b5-617071e14fff None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:07.288122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-879fb398-e407-4659-b5b5-617071e14fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:07.342849 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1514/2997] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:07.356662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b406-22db-4a1e-9498-4fc75cc68e65 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:07.358819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6b39b406-22db-4a1e-9498-4fc75cc68e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:07.489415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fb398-e407-4659-b5b5-617071e14fff None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:07.505460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12612f-5366-4b4c-b412-b445ab5e20b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:07.506499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12612f-5366-4b4c-b412-b445ab5e20b5 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:07.507656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12612f-5366-4b4c-b412-b445ab5e20b5 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:07.509604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12612f-5366-4b4c-b412-b445ab5e20b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:07.531310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12612f-5366-4b4c-b412-b445ab5e20b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:07.533245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12612f-5366-4b4c-b412-b445ab5e20b5 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:07.563684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b406-22db-4a1e-9498-4fc75cc68e65 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:07.579160 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1484/2998] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:56:07.588789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec215a97-0ccb-4b2d-b9b3-718bd4917aa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:07.589212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec215a97-0ccb-4b2d-b9b3-718bd4917aa5 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:07.589478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec215a97-0ccb-4b2d-b9b3-718bd4917aa5 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:07.589751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec215a97-0ccb-4b2d-b9b3-718bd4917aa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:07.630355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec215a97-0ccb-4b2d-b9b3-718bd4917aa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:07.631976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec215a97-0ccb-4b2d-b9b3-718bd4917aa5 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:07.689391 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1515/2999] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:56:08.071434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a0c16-cb58-4082-a239-63555f9abb78 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:08.071727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a0c16-cb58-4082-a239-63555f9abb78 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:08.073532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a0c16-cb58-4082-a239-63555f9abb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:08.123074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bd7a0c16-cb58-4082-a239-63555f9abb78 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:08.125709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bd7a0c16-cb58-4082-a239-63555f9abb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:08.296621 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1485/3000] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:56:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:56:08.319148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec215a97-0ccb-4b2d-b9b3-718bd4917aa5 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:08.321164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ec215a97-0ccb-4b2d-b9b3-718bd4917aa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:08.501460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec215a97-0ccb-4b2d-b9b3-718bd4917aa5 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:08.508264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dad36e-cb3d-45a7-9cc5-8b6aa346ebc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:08.509120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dad36e-cb3d-45a7-9cc5-8b6aa346ebc2 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:08.509833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dad36e-cb3d-45a7-9cc5-8b6aa346ebc2 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:08.510272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dad36e-cb3d-45a7-9cc5-8b6aa346ebc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:08.526556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dad36e-cb3d-45a7-9cc5-8b6aa346ebc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:08.531557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dad36e-cb3d-45a7-9cc5-8b6aa346ebc2 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:08.560295 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1516/3001] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:56:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:56:16.415499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1516f-5df6-4c80-9842-f58c4a16953f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:16.416519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1516f-5df6-4c80-9842-f58c4a16953f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:16.417001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1516f-5df6-4c80-9842-f58c4a16953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:16.478416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a1e1516f-5df6-4c80-9842-f58c4a16953f None None] MFA Rules not processed for user `5ac1323815364df4a3a4d4dbbb9d70dd`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:16.478416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a1e1516f-5df6-4c80-9842-f58c4a16953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:16.514459 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1486/3002] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:18.555702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:18.924078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73131c45-857a-4622-8c2a-5feea6fa9f31 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:18.925685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73131c45-857a-4622-8c2a-5feea6fa9f31 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:18.926124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73131c45-857a-4622-8c2a-5feea6fa9f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:18.974030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-73131c45-857a-4622-8c2a-5feea6fa9f31 None None] MFA Rules not processed for user `bc0c5c9593754f1cb98f9689b29606a2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:18.980990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-73131c45-857a-4622-8c2a-5feea6fa9f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:19.136793 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1517/3003] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:19.138811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b9cee-3511-4535-9feb-40f3d506d4eb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:19.139698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b9cee-3511-4535-9feb-40f3d506d4eb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:19.140237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b9cee-3511-4535-9feb-40f3d506d4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:19.189517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-428b9cee-3511-4535-9feb-40f3d506d4eb None None] MFA Rules not processed for user `bc0c5c9593754f1cb98f9689b29606a2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:19.191738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-428b9cee-3511-4535-9feb-40f3d506d4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:19.205314 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1487/3004] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:23.996942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593edf7c-7f86-4d7d-9d5b-10bb478eb58e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:23.997490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593edf7c-7f86-4d7d-9d5b-10bb478eb58e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:23.997614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593edf7c-7f86-4d7d-9d5b-10bb478eb58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:24.072532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-593edf7c-7f86-4d7d-9d5b-10bb478eb58e None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:24.078761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-593edf7c-7f86-4d7d-9d5b-10bb478eb58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:24.113270 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1518/3005] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:24.127875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b9cee-3511-4535-9feb-40f3d506d4eb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:24.146180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b9cee-3511-4535-9feb-40f3d506d4eb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:24.175178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640dda95-62ee-43e8-bacb-ba2f447a674b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:24.176124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dda95-62ee-43e8-bacb-ba2f447a674b service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:24.176569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dda95-62ee-43e8-bacb-ba2f447a674b service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:24.176998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dda95-62ee-43e8-bacb-ba2f447a674b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:24.204085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640dda95-62ee-43e8-bacb-ba2f447a674b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:24.212486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640dda95-62ee-43e8-bacb-ba2f447a674b service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:24.247597 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1488/3006] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:56:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:56:28.643273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2120f8-505d-4db9-99cd-a62ed5cf2b47 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:28.643880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2120f8-505d-4db9-99cd-a62ed5cf2b47 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:28.643880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2120f8-505d-4db9-99cd-a62ed5cf2b47 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:28.645634 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1519/3007] 10.222.0.26 () {54 vars in 921 bytes} [Sat Oct 8 20:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:56:28.656183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad477faf-76f0-43d4-b1c8-ab1f86d522ea None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:28.656772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad477faf-76f0-43d4-b1c8-ab1f86d522ea None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:28.656772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad477faf-76f0-43d4-b1c8-ab1f86d522ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:28.704645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ad477faf-76f0-43d4-b1c8-ab1f86d522ea None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:28.707417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ad477faf-76f0-43d4-b1c8-ab1f86d522ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:28.722836 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1489/3008] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:56:28.767816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2120f8-505d-4db9-99cd-a62ed5cf2b47 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:28.770373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9b2120f8-505d-4db9-99cd-a62ed5cf2b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:28.969741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2120f8-505d-4db9-99cd-a62ed5cf2b47 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:28.981067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8166049-364a-438b-8083-ff2d78a6c767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:28.981878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8166049-364a-438b-8083-ff2d78a6c767 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:28.982877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8166049-364a-438b-8083-ff2d78a6c767 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:28.983208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8166049-364a-438b-8083-ff2d78a6c767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:29.029270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8166049-364a-438b-8083-ff2d78a6c767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:29.030866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8166049-364a-438b-8083-ff2d78a6c767 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:29.052844 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1520/3009] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:56:36.224059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694621b-628f-470e-8129-bfd91a6df053 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:36.224813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694621b-628f-470e-8129-bfd91a6df053 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:36.224813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694621b-628f-470e-8129-bfd91a6df053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:36.253283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c694621b-628f-470e-8129-bfd91a6df053 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:36.255769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c694621b-628f-470e-8129-bfd91a6df053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:36.268904 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1490/3010] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 20:56:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:56:36.334947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8166049-364a-438b-8083-ff2d78a6c767 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:36.374334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8166049-364a-438b-8083-ff2d78a6c767 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:36.386561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e649508-5da7-4088-9d98-b9a9fabc2325 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:36.387524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e649508-5da7-4088-9d98-b9a9fabc2325 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:36.388080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e649508-5da7-4088-9d98-b9a9fabc2325 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:36.388674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e649508-5da7-4088-9d98-b9a9fabc2325 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:36.405164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e649508-5da7-4088-9d98-b9a9fabc2325 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:36.407524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e649508-5da7-4088-9d98-b9a9fabc2325 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:36.425107 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1521/3011] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:56:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:56:37.658636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871e359-fe3c-466d-917c-f59da6dd58f4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:37.659159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871e359-fe3c-466d-917c-f59da6dd58f4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:37.659159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871e359-fe3c-466d-917c-f59da6dd58f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:37.679606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=79 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:37.711631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3871e359-fe3c-466d-917c-f59da6dd58f4 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:37.712857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3871e359-fe3c-466d-917c-f59da6dd58f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:37.721119 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1491/3012] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 20:56:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:37.737259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e649508-5da7-4088-9d98-b9a9fabc2325 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:37.749664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e649508-5da7-4088-9d98-b9a9fabc2325 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:37.754697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7e2a1-ed9b-4a4e-9932-9c35875a0ab2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:37.755297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7e2a1-ed9b-4a4e-9932-9c35875a0ab2 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:37.755575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7e2a1-ed9b-4a4e-9932-9c35875a0ab2 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:37.755845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7e2a1-ed9b-4a4e-9932-9c35875a0ab2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:37.765125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7e2a1-ed9b-4a4e-9932-9c35875a0ab2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:37.766719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7e2a1-ed9b-4a4e-9932-9c35875a0ab2 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:37.775074 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1522/3013] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:56:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:56:38.423834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be171765-26c6-463f-a1a6-df59597f6790 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:38.424117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be171765-26c6-463f-a1a6-df59597f6790 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:38.424390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be171765-26c6-463f-a1a6-df59597f6790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:38.445749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-be171765-26c6-463f-a1a6-df59597f6790 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:38.447109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-be171765-26c6-463f-a1a6-df59597f6790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:38.459029 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1492/3014] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 20:56:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:38.474348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7e2a1-ed9b-4a4e-9932-9c35875a0ab2 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:38.488013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7e2a1-ed9b-4a4e-9932-9c35875a0ab2 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:38.495793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa62d36-d7a0-4c0d-9ade-7ed579c1c302 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:38.496535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa62d36-d7a0-4c0d-9ade-7ed579c1c302 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:38.496958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa62d36-d7a0-4c0d-9ade-7ed579c1c302 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:38.497499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa62d36-d7a0-4c0d-9ade-7ed579c1c302 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:38.507839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa62d36-d7a0-4c0d-9ade-7ed579c1c302 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:38.509470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa62d36-d7a0-4c0d-9ade-7ed579c1c302 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:38.519425 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1523/3015] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:56:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:56:39.592141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44920a-c602-4eb6-bbf6-0dda52cb2395 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:39.593492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44920a-c602-4eb6-bbf6-0dda52cb2395 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:39.594125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44920a-c602-4eb6-bbf6-0dda52cb2395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:39.620722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ad44920a-c602-4eb6-bbf6-0dda52cb2395 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:39.622321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ad44920a-c602-4eb6-bbf6-0dda52cb2395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:39.635752 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1493/3016] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:39.652293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa62d36-d7a0-4c0d-9ade-7ed579c1c302 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:39.674647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa62d36-d7a0-4c0d-9ade-7ed579c1c302 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:39.691858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fec27-e159-42ca-94fa-68471d86be57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:39.691858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fec27-e159-42ca-94fa-68471d86be57 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:39.691858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fec27-e159-42ca-94fa-68471d86be57 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:39.691858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fec27-e159-42ca-94fa-68471d86be57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:39.734292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fec27-e159-42ca-94fa-68471d86be57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:39.736472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fec27-e159-42ca-94fa-68471d86be57 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:39.778035 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1524/3017] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:56:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 20:56:40.668312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44920a-c602-4eb6-bbf6-0dda52cb2395 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:40.669749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ad44920a-c602-4eb6-bbf6-0dda52cb2395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:40.809742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44920a-c602-4eb6-bbf6-0dda52cb2395 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:40.815449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:40.816512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:40.817126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:40.818362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] PATH_INFO: `/v3/users/f6cf9c6c133947f3aecee3a913a32328` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:40.820404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6cf9c6c133947f3aecee3a913a32328)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:40.826098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:40.941664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6cf9c6c133947f3aecee3a913a32328'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:40.969728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6cf9c6c133947f3aecee3a913a32328'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:40.985754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6cf9c6c133947f3aecee3a913a32328'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:40.987767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6cf9c6c133947f3aecee3a913a32328'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:41.026925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6cf9c6c133947f3aecee3a913a32328'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:41.073701 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1494/3018] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:56:40 2022] DELETE /identity/v3/users/f6cf9c6c133947f3aecee3a913a32328 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:42.008207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fec27-e159-42ca-94fa-68471d86be57 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:42.023576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fec27-e159-42ca-94fa-68471d86be57 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:42.131427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:42.139011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa00fa8-0a05-4a98-9879-37ce7e2f2798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:42.141880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa00fa8-0a05-4a98-9879-37ce7e2f2798 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:42.142369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa00fa8-0a05-4a98-9879-37ce7e2f2798 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:42.142943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa00fa8-0a05-4a98-9879-37ce7e2f2798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:42.148524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-faa00fa8-0a05-4a98-9879-37ce7e2f2798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:42.213921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:42.216231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:42.325398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa00fa8-0a05-4a98-9879-37ce7e2f2798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:42.326921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa00fa8-0a05-4a98-9879-37ce7e2f2798 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:42.354770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c8f10-2fa3-45e2-9cda-12d3d3a55536 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:42.360391 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1525/3019] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:56:42.364296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:42.365071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:42.365391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:42.365662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1 admin admin] PATH_INFO: `/v3/projects/4e277ebf9cbf4cb0b6be14efbec504bf` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:42.367422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e277ebf9cbf4cb0b6be14efbec504bf)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:42.370963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:42.374802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:42.505648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e277ebf9cbf4cb0b6be14efbec504bf', 'request_id': 'req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:42.528260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e277ebf9cbf4cb0b6be14efbec504bf', 'request_id': 'req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:42.538079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e277ebf9cbf4cb0b6be14efbec504bf', 'request_id': 'req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:42.584643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1 admin admin] The token cache is being invalidate because project 4e277ebf9cbf4cb0b6be14efbec504bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:56:42.585818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:42.586611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ef8c7aa8-7cc6-417f-9b62-b06e105d77d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:42.596887 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1495/3020] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:42 2022] DELETE /identity/v3/projects/4e277ebf9cbf4cb0b6be14efbec504bf => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:42.602533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0ec8f-8a20-4d3e-8834-c25527842c11 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:42.602931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0ec8f-8a20-4d3e-8834-c25527842c11 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:42.603113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0ec8f-8a20-4d3e-8834-c25527842c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:42.640635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-76e0ec8f-8a20-4d3e-8834-c25527842c11 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:42.642228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-76e0ec8f-8a20-4d3e-8834-c25527842c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:42.833385 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1526/3021] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:42.843634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6af45-760e-4e74-8664-2ceef9b28c55 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:42.844245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6af45-760e-4e74-8664-2ceef9b28c55 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:42.844681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6af45-760e-4e74-8664-2ceef9b28c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:42.880250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-51c6af45-760e-4e74-8664-2ceef9b28c55 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:42.884086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-51c6af45-760e-4e74-8664-2ceef9b28c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:42.896934 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1496/3022] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:42.902015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0ec8f-8a20-4d3e-8834-c25527842c11 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:42.915500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0ec8f-8a20-4d3e-8834-c25527842c11 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:42.922044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d76c11-93c9-4d13-97c6-063736185c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:42.922940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d76c11-93c9-4d13-97c6-063736185c0a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:42.923453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d76c11-93c9-4d13-97c6-063736185c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:42.923869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d76c11-93c9-4d13-97c6-063736185c0a admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:42.924640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d76c11-93c9-4d13-97c6-063736185c0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:56:42.925075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d76c11-93c9-4d13-97c6-063736185c0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:42.927074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d76c11-93c9-4d13-97c6-063736185c0a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:42.945590 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1527/3023] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:56:42.945802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6af45-760e-4e74-8664-2ceef9b28c55 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:42.966000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6af45-760e-4e74-8664-2ceef9b28c55 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:42.975608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdc18b-a7a7-4d1a-93a4-beba1c455080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:42.976565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdc18b-a7a7-4d1a-93a4-beba1c455080 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:42.977093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdc18b-a7a7-4d1a-93a4-beba1c455080 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:42.977689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdc18b-a7a7-4d1a-93a4-beba1c455080 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:42.979324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdc18b-a7a7-4d1a-93a4-beba1c455080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:42.981660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdc18b-a7a7-4d1a-93a4-beba1c455080 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:43.023126 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1497/3024] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:56:42 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:56:43.024478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d76c11-93c9-4d13-97c6-063736185c0a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:43.038177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d76c11-93c9-4d13-97c6-063736185c0a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:43.111917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cade9-e0c2-4940-b617-b27d8e431968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:43.112849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cade9-e0c2-4940-b617-b27d8e431968 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:43.113270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cade9-e0c2-4940-b617-b27d8e431968 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:43.113648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cade9-e0c2-4940-b617-b27d8e431968 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:43.114398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cade9-e0c2-4940-b617-b27d8e431968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:43.116494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cade9-e0c2-4940-b617-b27d8e431968 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:43.147540 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1528/3025] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:56:43 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:56:43.148402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdc18b-a7a7-4d1a-93a4-beba1c455080 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:43.162790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdc18b-a7a7-4d1a-93a4-beba1c455080 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:43.169388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7ac88-5853-4963-9522-043d960746ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:43.170451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7ac88-5853-4963-9522-043d960746ac admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:43.170451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7ac88-5853-4963-9522-043d960746ac admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:43.170991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7ac88-5853-4963-9522-043d960746ac admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:43.172056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7ac88-5853-4963-9522-043d960746ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:43.174526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7ac88-5853-4963-9522-043d960746ac admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:43.194412 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1498/3026] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:56:43.194639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cade9-e0c2-4940-b617-b27d8e431968 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:43.206493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cade9-e0c2-4940-b617-b27d8e431968 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:43.212020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bf5b7-2d70-40fd-a065-f9d54d81e255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:43.213594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bf5b7-2d70-40fd-a065-f9d54d81e255 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:43.214239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bf5b7-2d70-40fd-a065-f9d54d81e255 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:43.214621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bf5b7-2d70-40fd-a065-f9d54d81e255 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:43.215785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bf5b7-2d70-40fd-a065-f9d54d81e255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:43.217557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bf5b7-2d70-40fd-a065-f9d54d81e255 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:43.219233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:43.238728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7ac88-5853-4963-9522-043d960746ac admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:43.239436 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1529/3027] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:56:43.253757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7ac88-5853-4963-9522-043d960746ac admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:43.266288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972887b-f1c8-44a0-913b-4d4c48e108fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:43.266963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972887b-f1c8-44a0-913b-4d4c48e108fa admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:43.267243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972887b-f1c8-44a0-913b-4d4c48e108fa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:43.267520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972887b-f1c8-44a0-913b-4d4c48e108fa admin admin] PATH_INFO: `/v3/projects/1e6beec34e0e4af180cd798eb7ef4ad0/users/56649c9113d84e6390d58d84ab089380/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:43.292880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972887b-f1c8-44a0-913b-4d4c48e108fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6beec34e0e4af180cd798eb7ef4ad0, user_id=56649c9113d84e6390d58d84ab089380, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:43.295947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972887b-f1c8-44a0-913b-4d4c48e108fa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:43.326771 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1499/3028] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:56:43 2022] PUT /identity/v3/projects/1e6beec34e0e4af180cd798eb7ef4ad0/users/56649c9113d84e6390d58d84ab089380/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:56:43.331798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3557ac-2e8c-4e0b-b7ac-fd1df005202e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:43.333141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3557ac-2e8c-4e0b-b7ac-fd1df005202e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:43.333931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3557ac-2e8c-4e0b-b7ac-fd1df005202e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:43.358568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1b3557ac-2e8c-4e0b-b7ac-fd1df005202e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:43.360083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1b3557ac-2e8c-4e0b-b7ac-fd1df005202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:43.460285 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1530/3029] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:43.490284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972887b-f1c8-44a0-913b-4d4c48e108fa admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:43.493433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1972887b-f1c8-44a0-913b-4d4c48e108fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:43.575327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972887b-f1c8-44a0-913b-4d4c48e108fa admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:43.581367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29913ad-3006-40f8-831c-9d28017f8305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:43.581977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29913ad-3006-40f8-831c-9d28017f8305 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:43.582264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29913ad-3006-40f8-831c-9d28017f8305 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:43.582539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29913ad-3006-40f8-831c-9d28017f8305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:43.594884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29913ad-3006-40f8-831c-9d28017f8305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:43.596515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29913ad-3006-40f8-831c-9d28017f8305 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:43.608281 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1500/3030] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:56:44.792150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3557ac-2e8c-4e0b-b7ac-fd1df005202e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:44.809940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3557ac-2e8c-4e0b-b7ac-fd1df005202e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:44.814744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1b65a-02db-4ab4-9bbc-8223e7b26749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:44.816268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1b65a-02db-4ab4-9bbc-8223e7b26749 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:44.816620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1b65a-02db-4ab4-9bbc-8223e7b26749 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:44.816927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1b65a-02db-4ab4-9bbc-8223e7b26749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:44.821155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-83a1b65a-02db-4ab4-9bbc-8223e7b26749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:45.017671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1b65a-02db-4ab4-9bbc-8223e7b26749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:45.019251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1b65a-02db-4ab4-9bbc-8223e7b26749 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:45.034338 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1531/3031] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:56:46.828452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29913ad-3006-40f8-831c-9d28017f8305 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:46.836740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c29913ad-3006-40f8-831c-9d28017f8305 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:46.870943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29913ad-3006-40f8-831c-9d28017f8305 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:46.889309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c14b8-ae83-4e41-aeb1-cf4a7aa76681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:46.890064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c14b8-ae83-4e41-aeb1-cf4a7aa76681 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:46.890518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c14b8-ae83-4e41-aeb1-cf4a7aa76681 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:46.890924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c14b8-ae83-4e41-aeb1-cf4a7aa76681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:46.893015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8c8c14b8-ae83-4e41-aeb1-cf4a7aa76681 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:46.893537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1b65a-02db-4ab4-9bbc-8223e7b26749 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:46.894916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-83a1b65a-02db-4ab4-9bbc-8223e7b26749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:46.914131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1b65a-02db-4ab4-9bbc-8223e7b26749 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:46.925462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a79a1-90e6-416f-a3a1-4f585009679b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:46.926827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a79a1-90e6-416f-a3a1-4f585009679b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:46.929373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a79a1-90e6-416f-a3a1-4f585009679b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:46.929856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a79a1-90e6-416f-a3a1-4f585009679b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:46.934096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b75a79a1-90e6-416f-a3a1-4f585009679b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:46.948698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a79a1-90e6-416f-a3a1-4f585009679b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:46.973278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a79a1-90e6-416f-a3a1-4f585009679b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:46.986113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:47.002186 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1532/3032] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:56:47.061129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c14b8-ae83-4e41-aeb1-cf4a7aa76681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:47.063706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c14b8-ae83-4e41-aeb1-cf4a7aa76681 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:47.088482 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1501/3033] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:56:48.412960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294efc0-ba9a-4319-89b8-6ed6356cbc13 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:48.413860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294efc0-ba9a-4319-89b8-6ed6356cbc13 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:48.414293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294efc0-ba9a-4319-89b8-6ed6356cbc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:48.455753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5294efc0-ba9a-4319-89b8-6ed6356cbc13 None None] MFA Rules not processed for user `05f0f7a60257437eaa8702b664916979`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:48.458681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5294efc0-ba9a-4319-89b8-6ed6356cbc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:48.611394 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1533/3034] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:50.067776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c14b8-ae83-4e41-aeb1-cf4a7aa76681 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:50.069460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8c8c14b8-ae83-4e41-aeb1-cf4a7aa76681 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:50.112687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c14b8-ae83-4e41-aeb1-cf4a7aa76681 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:50.120803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:50.121474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:50.121774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:50.122030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] PATH_INFO: `/v3/users/2f72559f9cbb4544af3008e574d554ee` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:50.123868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f72559f9cbb4544af3008e574d554ee)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:50.125828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:50.256257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f72559f9cbb4544af3008e574d554ee'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:50.278239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f72559f9cbb4544af3008e574d554ee'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:50.279388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f72559f9cbb4544af3008e574d554ee'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:50.280218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f72559f9cbb4544af3008e574d554ee'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:50.306809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f72559f9cbb4544af3008e574d554ee'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:50.335315 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1502/3035] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:56:50 2022] DELETE /identity/v3/users/2f72559f9cbb4544af3008e574d554ee => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:50.340456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380db415-6859-4c92-8799-800ee82d2321 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:50.340954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380db415-6859-4c92-8799-800ee82d2321 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:50.341134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380db415-6859-4c92-8799-800ee82d2321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:50.379393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-380db415-6859-4c92-8799-800ee82d2321 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:50.384082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-380db415-6859-4c92-8799-800ee82d2321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:50.405637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:50.512775 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1534/3036] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:50.555257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:50.557126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:50.661711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50f3c1-dc90-451b-a015-b2c832a2b61e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:50.673111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7a4e6-0c24-4508-b67a-77e36f35f9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:50.674144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7a4e6-0c24-4508-b67a-77e36f35f9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:50.674657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7a4e6-0c24-4508-b67a-77e36f35f9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:50.676056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7a4e6-0c24-4508-b67a-77e36f35f9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:50.702751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7a4e6-0c24-4508-b67a-77e36f35f9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:50.704317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7a4e6-0c24-4508-b67a-77e36f35f9e6 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:50.716778 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1503/3037] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:56:50.845634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380db415-6859-4c92-8799-800ee82d2321 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:50.847274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-380db415-6859-4c92-8799-800ee82d2321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:50.969082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380db415-6859-4c92-8799-800ee82d2321 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:50.982055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01628a57-9060-46a2-8d83-701439885399 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:50.982838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01628a57-9060-46a2-8d83-701439885399 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:50.983740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01628a57-9060-46a2-8d83-701439885399 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:50.987156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01628a57-9060-46a2-8d83-701439885399 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:50.990539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-01628a57-9060-46a2-8d83-701439885399 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:51.015108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01628a57-9060-46a2-8d83-701439885399 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:51.017883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01628a57-9060-46a2-8d83-701439885399 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:51.037865 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1535/3038] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:56:53.959493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a74b9d-42c4-4365-9f02-9a391135ef1f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:53.960001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a74b9d-42c4-4365-9f02-9a391135ef1f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:53.960088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a74b9d-42c4-4365-9f02-9a391135ef1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:53.987955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-45a74b9d-42c4-4365-9f02-9a391135ef1f None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:53.989208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-45a74b9d-42c4-4365-9f02-9a391135ef1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:53.994939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01628a57-9060-46a2-8d83-701439885399 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:53.996358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-01628a57-9060-46a2-8d83-701439885399 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:54.018947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01628a57-9060-46a2-8d83-701439885399 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:54.030671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:54.031896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:54.032371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:54.032838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] PATH_INFO: `/v3/projects/65a10eeae3da4b9a979b8c1167039014` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:54.034603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a10eeae3da4b9a979b8c1167039014)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:54.036914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:54.119415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:54.176189 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1504/3039] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 20:56:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:54.195758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a74b9d-42c4-4365-9f02-9a391135ef1f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:54.199276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-45a74b9d-42c4-4365-9f02-9a391135ef1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:54.205490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a10eeae3da4b9a979b8c1167039014', 'request_id': 'req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:54.224393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a10eeae3da4b9a979b8c1167039014', 'request_id': 'req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:54.239621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a10eeae3da4b9a979b8c1167039014', 'request_id': 'req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:54.264721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] The token cache is being invalidate because project 65a10eeae3da4b9a979b8c1167039014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:56:54.265749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:54.268694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:54.271309 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1536/3040] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:53 2022] DELETE /identity/v3/projects/65a10eeae3da4b9a979b8c1167039014 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:56:54.276824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:54.279933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:54.389355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:54.420249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a74b9d-42c4-4365-9f02-9a391135ef1f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:54.464764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9f17e-1ac8-44bb-9c1b-95e78a35cd8f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:54.481645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:54.482687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:54.483256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:54.483725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] PATH_INFO: `/v3/users/d53fb3fbba5f4b419e00fbf075b62959` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:54.486152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53fb3fbba5f4b419e00fbf075b62959)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:54.488528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:54.522276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46526c2b-1ec3-4904-baee-0a8b69791e1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:54.525576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46526c2b-1ec3-4904-baee-0a8b69791e1d service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:54.525957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46526c2b-1ec3-4904-baee-0a8b69791e1d service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:54.526316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46526c2b-1ec3-4904-baee-0a8b69791e1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:54.528358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-46526c2b-1ec3-4904-baee-0a8b69791e1d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:54.583455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53fb3fbba5f4b419e00fbf075b62959'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:54.605703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53fb3fbba5f4b419e00fbf075b62959'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:54.606535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53fb3fbba5f4b419e00fbf075b62959'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:54.607305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53fb3fbba5f4b419e00fbf075b62959'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:54.622691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53fb3fbba5f4b419e00fbf075b62959'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:54.641554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46526c2b-1ec3-4904-baee-0a8b69791e1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:54.647121 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1537/3041] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:56:54 2022] DELETE /identity/v3/users/d53fb3fbba5f4b419e00fbf075b62959 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:54.647300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46526c2b-1ec3-4904-baee-0a8b69791e1d service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:54.659922 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1505/3042] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:56:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 20:56:55.091414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:55.092972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:55.216423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c1ba4-586c-4994-aa17-2438e4b54af4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:55.229631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401b82b-d4f8-4340-b4bb-02119d6794c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:55.230675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401b82b-d4f8-4340-b4bb-02119d6794c4 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:55.236787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401b82b-d4f8-4340-b4bb-02119d6794c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:55.236787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401b82b-d4f8-4340-b4bb-02119d6794c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:55.238145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3401b82b-d4f8-4340-b4bb-02119d6794c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:55.252560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401b82b-d4f8-4340-b4bb-02119d6794c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:55.254823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401b82b-d4f8-4340-b4bb-02119d6794c4 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:55.272307 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1538/3043] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:56:55.315132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcc125-2778-4d28-9128-9c13b78ca075 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:55.316416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcc125-2778-4d28-9128-9c13b78ca075 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:55.316901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcc125-2778-4d28-9128-9c13b78ca075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:55.336348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dc374-f71d-4794-be16-9b3b3c153502 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:55.336645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dc374-f71d-4794-be16-9b3b3c153502 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:55.338085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dc374-f71d-4794-be16-9b3b3c153502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:55.354283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dbdcc125-2778-4d28-9128-9c13b78ca075 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:55.356743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dbdcc125-2778-4d28-9128-9c13b78ca075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:55.386123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:55.386342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-698dc374-f71d-4794-be16-9b3b3c153502 None None] MFA Rules not processed for user `474ca64d1b1d4e30916b517645aba882`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:55.390298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-698dc374-f71d-4794-be16-9b3b3c153502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:55.441944 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1506/3044] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 20:56:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:56:55.465175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcc125-2778-4d28-9128-9c13b78ca075 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:55.466098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:55.470376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dbdcc125-2778-4d28-9128-9c13b78ca075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:55.493225 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1539/3045] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:56:55.591204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcc125-2778-4d28-9128-9c13b78ca075 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:55.597293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e7c38-7c0f-44f6-89be-f84bf9408c7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:55.598501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7c38-7c0f-44f6-89be-f84bf9408c7e service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:55.598790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7c38-7c0f-44f6-89be-f84bf9408c7e service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:55.599133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7c38-7c0f-44f6-89be-f84bf9408c7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:55.615418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e7c38-7c0f-44f6-89be-f84bf9408c7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:55.617293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e7c38-7c0f-44f6-89be-f84bf9408c7e service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:55.628115 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1507/3046] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:56:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:56:55.993783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd173ba-1da5-4080-9e92-43710dfad30f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:55.994763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd173ba-1da5-4080-9e92-43710dfad30f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:55.995721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd173ba-1da5-4080-9e92-43710dfad30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:56.038743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9fd173ba-1da5-4080-9e92-43710dfad30f None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:56.041665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9fd173ba-1da5-4080-9e92-43710dfad30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:56.062409 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1540/3047] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 20:56:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:56.073911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e7c38-7c0f-44f6-89be-f84bf9408c7e service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:56.092340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e7c38-7c0f-44f6-89be-f84bf9408c7e service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:56.113459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31dcbb2-b19b-4d84-9f77-2355f5101184 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:56.114368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dcbb2-b19b-4d84-9f77-2355f5101184 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:56.114786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dcbb2-b19b-4d84-9f77-2355f5101184 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:56.115454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dcbb2-b19b-4d84-9f77-2355f5101184 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:56.147642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd173ba-1da5-4080-9e92-43710dfad30f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:56.150828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9fd173ba-1da5-4080-9e92-43710dfad30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:56.168112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31dcbb2-b19b-4d84-9f77-2355f5101184 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:56.171636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31dcbb2-b19b-4d84-9f77-2355f5101184 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:56.213625 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1508/3048] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:56:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 20:56:56.322820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd173ba-1da5-4080-9e92-43710dfad30f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:56.336049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60baeec4-0dfd-41dd-9339-69e65832c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:56.337636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baeec4-0dfd-41dd-9339-69e65832c879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:56.338094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baeec4-0dfd-41dd-9339-69e65832c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:56.338568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baeec4-0dfd-41dd-9339-69e65832c879 admin admin] PATH_INFO: `/v3/projects/84c8793c7efa4d158f9c346fab39c923` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:56.339962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60baeec4-0dfd-41dd-9339-69e65832c879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c8793c7efa4d158f9c346fab39c923)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:56.342949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60baeec4-0dfd-41dd-9339-69e65832c879 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:56.422654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31dcbb2-b19b-4d84-9f77-2355f5101184 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:56.425817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d31dcbb2-b19b-4d84-9f77-2355f5101184 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:56.429271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-60baeec4-0dfd-41dd-9339-69e65832c879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c8793c7efa4d158f9c346fab39c923', 'request_id': 'req-60baeec4-0dfd-41dd-9339-69e65832c879'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:56.448809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-60baeec4-0dfd-41dd-9339-69e65832c879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c8793c7efa4d158f9c346fab39c923', 'request_id': 'req-60baeec4-0dfd-41dd-9339-69e65832c879'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:56.456878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31dcbb2-b19b-4d84-9f77-2355f5101184 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:56.461853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-60baeec4-0dfd-41dd-9339-69e65832c879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c8793c7efa4d158f9c346fab39c923', 'request_id': 'req-60baeec4-0dfd-41dd-9339-69e65832c879'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:56.487857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-60baeec4-0dfd-41dd-9339-69e65832c879 admin admin] The token cache is being invalidate because project 84c8793c7efa4d158f9c346fab39c923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:56:56.488407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-60baeec4-0dfd-41dd-9339-69e65832c879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:56.489380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-60baeec4-0dfd-41dd-9339-69e65832c879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:56.494060 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1541/3049] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:56 2022] DELETE /identity/v3/projects/84c8793c7efa4d158f9c346fab39c923 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:56.499305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1a9e-a640-4ee9-84cc-e3e4fea02f55 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:56.499933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1a9e-a640-4ee9-84cc-e3e4fea02f55 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:56.500417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1a9e-a640-4ee9-84cc-e3e4fea02f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:56.551198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3d2a1a9e-a640-4ee9-84cc-e3e4fea02f55 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:56.559046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d2a1a9e-a640-4ee9-84cc-e3e4fea02f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:56.575450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa69ce-61b8-4702-b458-4b97dfc15822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:56.576297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa69ce-61b8-4702-b458-4b97dfc15822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:56.576789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa69ce-61b8-4702-b458-4b97dfc15822 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:56.577319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa69ce-61b8-4702-b458-4b97dfc15822 admin admin] PATH_INFO: `/v3/users/6bce55d7f67347aaaa4c2a687bdff183` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:56.580104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa69ce-61b8-4702-b458-4b97dfc15822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bce55d7f67347aaaa4c2a687bdff183)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:56.582817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa69ce-61b8-4702-b458-4b97dfc15822 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:56.683882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4bfa69ce-61b8-4702-b458-4b97dfc15822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bce55d7f67347aaaa4c2a687bdff183'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:56.691218 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1542/3050] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:56.701629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdbbfe-0aae-4757-a5cf-c2a4181a216f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:56.701629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdbbfe-0aae-4757-a5cf-c2a4181a216f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:56.702917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdbbfe-0aae-4757-a5cf-c2a4181a216f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:56.703685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:56.707648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4bfa69ce-61b8-4702-b458-4b97dfc15822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bce55d7f67347aaaa4c2a687bdff183'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:56.709586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4bfa69ce-61b8-4702-b458-4b97dfc15822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bce55d7f67347aaaa4c2a687bdff183'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:56.710704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4bfa69ce-61b8-4702-b458-4b97dfc15822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bce55d7f67347aaaa4c2a687bdff183'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:56.727424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4bfa69ce-61b8-4702-b458-4b97dfc15822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bce55d7f67347aaaa4c2a687bdff183'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:56.772028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3abdbbfe-0aae-4757-a5cf-c2a4181a216f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:56.773723 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1509/3051] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:56:56 2022] DELETE /identity/v3/users/6bce55d7f67347aaaa4c2a687bdff183 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:56.775178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3abdbbfe-0aae-4757-a5cf-c2a4181a216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:56.805005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf2b46-8501-49aa-99ae-292cc415f4b9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:56.805760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf2b46-8501-49aa-99ae-292cc415f4b9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:56.806227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf2b46-8501-49aa-99ae-292cc415f4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:56.814514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:56.857475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1caf2b46-8501-49aa-99ae-292cc415f4b9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:56.859597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1caf2b46-8501-49aa-99ae-292cc415f4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:56.936575 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1543/3052] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:56.938353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f9c65-55b6-478b-a2ba-261fe73847e3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:56.939945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f9c65-55b6-478b-a2ba-261fe73847e3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:56.945150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f9c65-55b6-478b-a2ba-261fe73847e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:56.974907 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1510/3053] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:56.976614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf2b46-8501-49aa-99ae-292cc415f4b9 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:57.012401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf2b46-8501-49aa-99ae-292cc415f4b9 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:57.016220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e20f9c65-55b6-478b-a2ba-261fe73847e3 None None] MFA Rules not processed for user `56649c9113d84e6390d58d84ab089380`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:57.017816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e20f9c65-55b6-478b-a2ba-261fe73847e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:57.027540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf9600-e14e-4e0d-a63b-bb8cfd22ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:57.029789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf9600-e14e-4e0d-a63b-bb8cfd22ed7a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:57.031348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf9600-e14e-4e0d-a63b-bb8cfd22ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:57.032561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf9600-e14e-4e0d-a63b-bb8cfd22ed7a admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:57.034312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf9600-e14e-4e0d-a63b-bb8cfd22ed7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:56:57.037040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf9600-e14e-4e0d-a63b-bb8cfd22ed7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:57.041220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf9600-e14e-4e0d-a63b-bb8cfd22ed7a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:57.082476 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1511/3054] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:56:57.083338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf9600-e14e-4e0d-a63b-bb8cfd22ed7a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:57.089241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3baf9600-e14e-4e0d-a63b-bb8cfd22ed7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:57.198361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf9600-e14e-4e0d-a63b-bb8cfd22ed7a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:57.201429 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1544/3055] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:57.202358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f9c65-55b6-478b-a2ba-261fe73847e3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:57.224701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ad9c8-4d3d-4cf5-b060-3f22b444f258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:57.230935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ad9c8-4d3d-4cf5-b060-3f22b444f258 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:57.233955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ad9c8-4d3d-4cf5-b060-3f22b444f258 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:57.235364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ad9c8-4d3d-4cf5-b060-3f22b444f258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:57.263691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f9c65-55b6-478b-a2ba-261fe73847e3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:57.268841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ad9c8-4d3d-4cf5-b060-3f22b444f258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:57.270550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ad9c8-4d3d-4cf5-b060-3f22b444f258 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:57.290824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb59020-3ac1-4f16-9ae3-04caee62d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:57.291591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb59020-3ac1-4f16-9ae3-04caee62d1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:57.291969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb59020-3ac1-4f16-9ae3-04caee62d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:57.292374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb59020-3ac1-4f16-9ae3-04caee62d1e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:57.293202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb59020-3ac1-4f16-9ae3-04caee62d1e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:57.298477 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1512/3056] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:56:57.306285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb59020-3ac1-4f16-9ae3-04caee62d1e9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:57.390080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ad9c8-4d3d-4cf5-b060-3f22b444f258 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:57.395451 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1545/3057] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:56:57 2022] POST /identity/v3/projects => generated 403 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:56:57.403796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ad9c8-4d3d-4cf5-b060-3f22b444f258 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:57.483818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacc39f-3c72-4495-9c65-46c116994e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:57.484505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacc39f-3c72-4495-9c65-46c116994e0d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:57.485049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacc39f-3c72-4495-9c65-46c116994e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:57.485545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacc39f-3c72-4495-9c65-46c116994e0d admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:57.486803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacc39f-3c72-4495-9c65-46c116994e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:57.488963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacc39f-3c72-4495-9c65-46c116994e0d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:57.501882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:57.530038 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1513/3058] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:56:57 2022] POST /identity/v3/users => generated 302 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:56:57.534050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb59020-3ac1-4f16-9ae3-04caee62d1e9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:57.545700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb59020-3ac1-4f16-9ae3-04caee62d1e9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:57.551558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a76bf1-60e3-4b86-a4fd-d302603c636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:57.552355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a76bf1-60e3-4b86-a4fd-d302603c636c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:57.552717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a76bf1-60e3-4b86-a4fd-d302603c636c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:57.553067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a76bf1-60e3-4b86-a4fd-d302603c636c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:57.553825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a76bf1-60e3-4b86-a4fd-d302603c636c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:57.555652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a76bf1-60e3-4b86-a4fd-d302603c636c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:57.569453 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1546/3059] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:56:57.573897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacc39f-3c72-4495-9c65-46c116994e0d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:57.589928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacc39f-3c72-4495-9c65-46c116994e0d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:57.597148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef630d-bcdc-4960-9dad-3d9e7a78aafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:57.598221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef630d-bcdc-4960-9dad-3d9e7a78aafb admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:57.598959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef630d-bcdc-4960-9dad-3d9e7a78aafb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:57.599426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef630d-bcdc-4960-9dad-3d9e7a78aafb admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:57.600281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef630d-bcdc-4960-9dad-3d9e7a78aafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:57.602982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef630d-bcdc-4960-9dad-3d9e7a78aafb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:57.649954 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1514/3060] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:56:57.657712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a76bf1-60e3-4b86-a4fd-d302603c636c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:57.673756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a76bf1-60e3-4b86-a4fd-d302603c636c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:57.685315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7746ee-ce95-42d2-b287-6e9ffcc283cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:57.686043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7746ee-ce95-42d2-b287-6e9ffcc283cb admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:57.686335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7746ee-ce95-42d2-b287-6e9ffcc283cb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:57.686691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7746ee-ce95-42d2-b287-6e9ffcc283cb admin admin] PATH_INFO: `/v3/projects/06d641c6b7084a95b2964aeec2be6b77/users/fbaa704ca5484cd1970ab5e781685536/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:57.723637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7746ee-ce95-42d2-b287-6e9ffcc283cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d641c6b7084a95b2964aeec2be6b77, user_id=fbaa704ca5484cd1970ab5e781685536, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:57.730442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7746ee-ce95-42d2-b287-6e9ffcc283cb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:57.769422 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1547/3061] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:56:57 2022] PUT /identity/v3/projects/06d641c6b7084a95b2964aeec2be6b77/users/fbaa704ca5484cd1970ab5e781685536/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:57.777220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e7373-a540-4752-b142-ce8aa2fa4b83 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:57.777787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e7373-a540-4752-b142-ce8aa2fa4b83 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:57.778257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e7373-a540-4752-b142-ce8aa2fa4b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:57.794796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7746ee-ce95-42d2-b287-6e9ffcc283cb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:57.796621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4d7746ee-ce95-42d2-b287-6e9ffcc283cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:57.812310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0c0e7373-a540-4752-b142-ce8aa2fa4b83 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:57.828388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0c0e7373-a540-4752-b142-ce8aa2fa4b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:57.921565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:57.967462 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1515/3062] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:57.967778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7746ee-ce95-42d2-b287-6e9ffcc283cb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:57.976495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f8b0-923a-4a57-80dc-fca4dd7bb475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:57.977133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f8b0-923a-4a57-80dc-fca4dd7bb475 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:57.978258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f8b0-923a-4a57-80dc-fca4dd7bb475 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:57.978393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f8b0-923a-4a57-80dc-fca4dd7bb475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:57.981252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d052f8b0-923a-4a57-80dc-fca4dd7bb475 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:57.998490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f8b0-923a-4a57-80dc-fca4dd7bb475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:58.000801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f8b0-923a-4a57-80dc-fca4dd7bb475 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:58.015176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e7373-a540-4752-b142-ce8aa2fa4b83 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:58.032628 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1548/3063] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:56:58.092143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f8b0-923a-4a57-80dc-fca4dd7bb475 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:58.108094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f8b0-923a-4a57-80dc-fca4dd7bb475 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:58.109574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e7373-a540-4752-b142-ce8aa2fa4b83 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:58.115814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dc24f-179d-49cb-a12c-cca9b345512c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:58.116606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dc24f-179d-49cb-a12c-cca9b345512c service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:58.116955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dc24f-179d-49cb-a12c-cca9b345512c service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:58.117475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dc24f-179d-49cb-a12c-cca9b345512c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:58.119096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808cbb6-4a2e-4b3b-895d-b1fca721a840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:58.119842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808cbb6-4a2e-4b3b-895d-b1fca721a840 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:58.121338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808cbb6-4a2e-4b3b-895d-b1fca721a840 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:58.121744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808cbb6-4a2e-4b3b-895d-b1fca721a840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:58.155955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808cbb6-4a2e-4b3b-895d-b1fca721a840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:58.160902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808cbb6-4a2e-4b3b-895d-b1fca721a840 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:58.199073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dc24f-179d-49cb-a12c-cca9b345512c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:58.204329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dc24f-179d-49cb-a12c-cca9b345512c service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:58.207415 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1516/3064] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:56:58.231755 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1549/3065] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:56:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:56:58.544128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808cbb6-4a2e-4b3b-895d-b1fca721a840 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:58.546134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c808cbb6-4a2e-4b3b-895d-b1fca721a840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:58.563254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808cbb6-4a2e-4b3b-895d-b1fca721a840 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:58.569107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79fcde-0313-4e8e-95b4-7561be4d8f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:58.570509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79fcde-0313-4e8e-95b4-7561be4d8f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:58.571251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79fcde-0313-4e8e-95b4-7561be4d8f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:58.572206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79fcde-0313-4e8e-95b4-7561be4d8f49 admin admin] PATH_INFO: `/v3/projects/bcb3706a1680419384f4fe9660e87732` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:58.574223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79fcde-0313-4e8e-95b4-7561be4d8f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb3706a1680419384f4fe9660e87732)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:58.577717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79fcde-0313-4e8e-95b4-7561be4d8f49 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:58.684167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ce79fcde-0313-4e8e-95b4-7561be4d8f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb3706a1680419384f4fe9660e87732', 'request_id': 'req-ce79fcde-0313-4e8e-95b4-7561be4d8f49'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:58.701785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ce79fcde-0313-4e8e-95b4-7561be4d8f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb3706a1680419384f4fe9660e87732', 'request_id': 'req-ce79fcde-0313-4e8e-95b4-7561be4d8f49'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:58.718165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ce79fcde-0313-4e8e-95b4-7561be4d8f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb3706a1680419384f4fe9660e87732', 'request_id': 'req-ce79fcde-0313-4e8e-95b4-7561be4d8f49'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:58.742006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ce79fcde-0313-4e8e-95b4-7561be4d8f49 admin admin] The token cache is being invalidate because project bcb3706a1680419384f4fe9660e87732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:56:58.742412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ce79fcde-0313-4e8e-95b4-7561be4d8f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:58.744547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ce79fcde-0313-4e8e-95b4-7561be4d8f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:56:58.749653 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1517/3066] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:58 2022] DELETE /identity/v3/projects/bcb3706a1680419384f4fe9660e87732 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:58.751759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad6ac4-3173-43cf-b204-ef0c8c92858e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:58.752296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad6ac4-3173-43cf-b204-ef0c8c92858e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:58.752781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad6ac4-3173-43cf-b204-ef0c8c92858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:58.793270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0fad6ac4-3173-43cf-b204-ef0c8c92858e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:58.794704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0fad6ac4-3173-43cf-b204-ef0c8c92858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:58.872603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8d0fd-cecb-47ed-9940-8d64229be333 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:58.873334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8d0fd-cecb-47ed-9940-8d64229be333 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:58.873849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8d0fd-cecb-47ed-9940-8d64229be333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:58.881998 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1550/3067] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:58.890745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:58.899808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-45f8d0fd-cecb-47ed-9940-8d64229be333 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:58.901775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-45f8d0fd-cecb-47ed-9940-8d64229be333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:58.922752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad6ac4-3173-43cf-b204-ef0c8c92858e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:58.923715 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1518/3068] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:56:58.935042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad6ac4-3173-43cf-b204-ef0c8c92858e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:58.940111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c271c32-42e4-42c6-997a-3a4e12c26e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:58.940944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c271c32-42e4-42c6-997a-3a4e12c26e68 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:58.941416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c271c32-42e4-42c6-997a-3a4e12c26e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:58.941884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c271c32-42e4-42c6-997a-3a4e12c26e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:58.942680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c271c32-42e4-42c6-997a-3a4e12c26e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:56:58.943152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c271c32-42e4-42c6-997a-3a4e12c26e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:58.944916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c271c32-42e4-42c6-997a-3a4e12c26e68 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:58.962484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8d0fd-cecb-47ed-9940-8d64229be333 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:58.968462 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1551/3069] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:56:58.973242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8d0fd-cecb-47ed-9940-8d64229be333 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:58.980134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef678f-a8e5-4398-8572-b7c250274e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:58.980972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef678f-a8e5-4398-8572-b7c250274e17 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:58.981463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef678f-a8e5-4398-8572-b7c250274e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:58.981884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef678f-a8e5-4398-8572-b7c250274e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:58.982663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef678f-a8e5-4398-8572-b7c250274e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:58.984706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef678f-a8e5-4398-8572-b7c250274e17 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:59.042055 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1519/3070] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:56:58 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:56:59.046033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c271c32-42e4-42c6-997a-3a4e12c26e68 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:59.082918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c271c32-42e4-42c6-997a-3a4e12c26e68 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:59.218381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f01a0f-d9dc-48dd-b94c-718e84aeda51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:59.219214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f01a0f-d9dc-48dd-b94c-718e84aeda51 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:59.219546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f01a0f-d9dc-48dd-b94c-718e84aeda51 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:59.219972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f01a0f-d9dc-48dd-b94c-718e84aeda51 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:59.220820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f01a0f-d9dc-48dd-b94c-718e84aeda51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:59.223176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f01a0f-d9dc-48dd-b94c-718e84aeda51 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:59.243018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:59.264755 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1552/3071] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:56:59 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:56:59.269020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef678f-a8e5-4398-8572-b7c250274e17 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:59.287450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef678f-a8e5-4398-8572-b7c250274e17 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:59.302596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a7ed4-7c11-4a51-bd96-0497476cdd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:59.303212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a7ed4-7c11-4a51-bd96-0497476cdd10 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:59.303492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a7ed4-7c11-4a51-bd96-0497476cdd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:59.304006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a7ed4-7c11-4a51-bd96-0497476cdd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:59.304673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a7ed4-7c11-4a51-bd96-0497476cdd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:59.306417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a7ed4-7c11-4a51-bd96-0497476cdd10 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:59.333256 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1520/3072] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:56:59.335682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f01a0f-d9dc-48dd-b94c-718e84aeda51 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:59.348669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f01a0f-d9dc-48dd-b94c-718e84aeda51 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:59.354393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cb808-efc9-4bfd-bdd2-2bc2d743f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:59.355093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cb808-efc9-4bfd-bdd2-2bc2d743f10b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:59.355444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cb808-efc9-4bfd-bdd2-2bc2d743f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:59.355788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cb808-efc9-4bfd-bdd2-2bc2d743f10b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:59.356503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cb808-efc9-4bfd-bdd2-2bc2d743f10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:59.359623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cb808-efc9-4bfd-bdd2-2bc2d743f10b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:59.372693 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1553/3073] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:56:59.376850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a7ed4-7c11-4a51-bd96-0497476cdd10 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:56:59.391834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a7ed4-7c11-4a51-bd96-0497476cdd10 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:56:59.399517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b2fb5-afdd-45ac-a77f-9c0004638c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:56:59.400019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b2fb5-afdd-45ac-a77f-9c0004638c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:59.400398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b2fb5-afdd-45ac-a77f-9c0004638c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:59.400741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b2fb5-afdd-45ac-a77f-9c0004638c96 admin admin] PATH_INFO: `/v3/projects/14d8376dc21744b6b8592e7373367b74/users/6e30edb713e5441ea615922db8ba8c9c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:59.426989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b2fb5-afdd-45ac-a77f-9c0004638c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d8376dc21744b6b8592e7373367b74, user_id=6e30edb713e5441ea615922db8ba8c9c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:56:59.430877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b2fb5-afdd-45ac-a77f-9c0004638c96 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:56:59.457343 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1521/3074] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:56:59 2022] PUT /identity/v3/projects/14d8376dc21744b6b8592e7373367b74/users/6e30edb713e5441ea615922db8ba8c9c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:56:59.468157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2db7f-2a0b-40a7-875b-1a47f6022139 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:56:59.468396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2db7f-2a0b-40a7-875b-1a47f6022139 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:56:59.469101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2db7f-2a0b-40a7-875b-1a47f6022139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:56:59.523629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-26b2db7f-2a0b-40a7-875b-1a47f6022139 None None] MFA Rules not processed for user `6e30edb713e5441ea615922db8ba8c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:56:59.525100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-26b2db7f-2a0b-40a7-875b-1a47f6022139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:56:59.637302 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1554/3075] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:56:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:01.026952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b2fb5-afdd-45ac-a77f-9c0004638c96 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:01.029726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8b9b2fb5-afdd-45ac-a77f-9c0004638c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:01.164793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b2fb5-afdd-45ac-a77f-9c0004638c96 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:01.176980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cff565-2ff0-441f-836d-ead92afa726f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:01.179671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cff565-2ff0-441f-836d-ead92afa726f service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:01.180429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cff565-2ff0-441f-836d-ead92afa726f service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:01.181469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cff565-2ff0-441f-836d-ead92afa726f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:01.204668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cff565-2ff0-441f-836d-ead92afa726f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:01.206901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cff565-2ff0-441f-836d-ead92afa726f service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:01.221421 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1522/3076] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:57:01.609158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2db7f-2a0b-40a7-875b-1a47f6022139 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:01.616018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-26b2db7f-2a0b-40a7-875b-1a47f6022139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:01.644372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2db7f-2a0b-40a7-875b-1a47f6022139 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:01.652458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92fe79-2dac-4efc-a6a1-1ddf0f3ff202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:01.653940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92fe79-2dac-4efc-a6a1-1ddf0f3ff202 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:01.654436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92fe79-2dac-4efc-a6a1-1ddf0f3ff202 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:01.654946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92fe79-2dac-4efc-a6a1-1ddf0f3ff202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:01.657718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bb92fe79-2dac-4efc-a6a1-1ddf0f3ff202 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:01.677238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92fe79-2dac-4efc-a6a1-1ddf0f3ff202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:01.679339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92fe79-2dac-4efc-a6a1-1ddf0f3ff202 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:01.692448 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1555/3077] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:57:07.119726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cff565-2ff0-441f-836d-ead92afa726f service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:07.238287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cff565-2ff0-441f-836d-ead92afa726f service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:07.244726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:07.245900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:07.246787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:07.247521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] PATH_INFO: `/v3/users/6e30edb713e5441ea615922db8ba8c9c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:07.249743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e30edb713e5441ea615922db8ba8c9c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:07.252916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:07.296506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:07.334427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e30edb713e5441ea615922db8ba8c9c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:07.347623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e30edb713e5441ea615922db8ba8c9c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:07.349675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e30edb713e5441ea615922db8ba8c9c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:07.351322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e30edb713e5441ea615922db8ba8c9c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:07.370239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e30edb713e5441ea615922db8ba8c9c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:07.408337 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1523/3078] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:57:07 2022] DELETE /identity/v3/users/6e30edb713e5441ea615922db8ba8c9c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:07.413369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1ec46-7ec3-41f6-b1f8-d3e5f481c3fd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:07.415985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1ec46-7ec3-41f6-b1f8-d3e5f481c3fd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:07.416525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1ec46-7ec3-41f6-b1f8-d3e5f481c3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:07.445851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-58a1ec46-7ec3-41f6-b1f8-d3e5f481c3fd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:07.447775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-58a1ec46-7ec3-41f6-b1f8-d3e5f481c3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:07.544555 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1556/3079] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:57:07.555610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:07.557179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:07.642191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c0696-0379-4170-8622-3d13c0f1abba admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:07.646684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8297aa5-6b34-46bf-a49d-f851fb905be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:07.647424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8297aa5-6b34-46bf-a49d-f851fb905be3 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:07.647778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8297aa5-6b34-46bf-a49d-f851fb905be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:07.648234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8297aa5-6b34-46bf-a49d-f851fb905be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:07.661068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8297aa5-6b34-46bf-a49d-f851fb905be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:07.662954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8297aa5-6b34-46bf-a49d-f851fb905be3 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:07.710218 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1524/3080] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:57:08.135701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1ec46-7ec3-41f6-b1f8-d3e5f481c3fd None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:08.137283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-58a1ec46-7ec3-41f6-b1f8-d3e5f481c3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:08.211924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8297aa5-6b34-46bf-a49d-f851fb905be3 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:08.214807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e8297aa5-6b34-46bf-a49d-f851fb905be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:08.223987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:08.235512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8297aa5-6b34-46bf-a49d-f851fb905be3 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:08.243944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574547e-c78b-4369-abae-849279e27a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:08.245842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574547e-c78b-4369-abae-849279e27a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:08.246126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574547e-c78b-4369-abae-849279e27a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:08.246404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574547e-c78b-4369-abae-849279e27a8a admin admin] PATH_INFO: `/v3/projects/14d8376dc21744b6b8592e7373367b74` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:08.249490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574547e-c78b-4369-abae-849279e27a8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d8376dc21744b6b8592e7373367b74)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:08.251146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574547e-c78b-4369-abae-849279e27a8a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:08.257901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1ec46-7ec3-41f6-b1f8-d3e5f481c3fd None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:08.264900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1a0ff-cc42-4d7d-9731-5392b7e6b13b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:08.265731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1a0ff-cc42-4d7d-9731-5392b7e6b13b service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:08.266013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1a0ff-cc42-4d7d-9731-5392b7e6b13b service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:08.266289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1a0ff-cc42-4d7d-9731-5392b7e6b13b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:08.268189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b6d1a0ff-cc42-4d7d-9731-5392b7e6b13b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:08.285384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1a0ff-cc42-4d7d-9731-5392b7e6b13b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:08.285798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1a0ff-cc42-4d7d-9731-5392b7e6b13b service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:08.300030 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1557/3081] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:57:08.359099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b574547e-c78b-4369-abae-849279e27a8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d8376dc21744b6b8592e7373367b74', 'request_id': 'req-b574547e-c78b-4369-abae-849279e27a8a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:08.375674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b574547e-c78b-4369-abae-849279e27a8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d8376dc21744b6b8592e7373367b74', 'request_id': 'req-b574547e-c78b-4369-abae-849279e27a8a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:08.392831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b574547e-c78b-4369-abae-849279e27a8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d8376dc21744b6b8592e7373367b74', 'request_id': 'req-b574547e-c78b-4369-abae-849279e27a8a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:08.420552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b574547e-c78b-4369-abae-849279e27a8a admin admin] The token cache is being invalidate because project 14d8376dc21744b6b8592e7373367b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:57:08.421239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b574547e-c78b-4369-abae-849279e27a8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:08.423490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b574547e-c78b-4369-abae-849279e27a8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:08.426235 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1525/3082] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:57:08 2022] DELETE /identity/v3/projects/14d8376dc21744b6b8592e7373367b74 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:08.431435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef514f-3d19-4b8e-b8dd-fb276bf19009 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:08.431878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef514f-3d19-4b8e-b8dd-fb276bf19009 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:08.431978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef514f-3d19-4b8e-b8dd-fb276bf19009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:08.472495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-24ef514f-3d19-4b8e-b8dd-fb276bf19009 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:08.474514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-24ef514f-3d19-4b8e-b8dd-fb276bf19009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:08.582249 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1558/3083] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:08.589968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6a34a-61e6-439d-bd6f-a8c81407f2d6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:08.590282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6a34a-61e6-439d-bd6f-a8c81407f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:08.590563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6a34a-61e6-439d-bd6f-a8c81407f2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:08.620181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0fb6a34a-61e6-439d-bd6f-a8c81407f2d6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:08.621447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0fb6a34a-61e6-439d-bd6f-a8c81407f2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:08.634573 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1526/3084] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:08.635903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef514f-3d19-4b8e-b8dd-fb276bf19009 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:08.648342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef514f-3d19-4b8e-b8dd-fb276bf19009 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:08.657481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966415bc-f429-4403-99bd-18871e6dc7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:08.658513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966415bc-f429-4403-99bd-18871e6dc7cf admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:08.659493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966415bc-f429-4403-99bd-18871e6dc7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:08.660155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966415bc-f429-4403-99bd-18871e6dc7cf admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:08.661454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966415bc-f429-4403-99bd-18871e6dc7cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:57:08.662066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966415bc-f429-4403-99bd-18871e6dc7cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:08.669717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966415bc-f429-4403-99bd-18871e6dc7cf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:08.687272 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1559/3085] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:57:08.691983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6a34a-61e6-439d-bd6f-a8c81407f2d6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:08.702583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6a34a-61e6-439d-bd6f-a8c81407f2d6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:08.707729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4686504-6149-4373-badc-85b45c4e9a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:08.708420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4686504-6149-4373-badc-85b45c4e9a9e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:08.708702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4686504-6149-4373-badc-85b45c4e9a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:08.708977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4686504-6149-4373-badc-85b45c4e9a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:08.709641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4686504-6149-4373-badc-85b45c4e9a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:08.712133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4686504-6149-4373-badc-85b45c4e9a9e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:08.746333 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1527/3086] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:57:08 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:57:08.750633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966415bc-f429-4403-99bd-18871e6dc7cf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:08.762139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966415bc-f429-4403-99bd-18871e6dc7cf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:08.776912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eedd3a-39ea-4b70-bd50-e6caad6b5780 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:08.777689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eedd3a-39ea-4b70-bd50-e6caad6b5780 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:08.778091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eedd3a-39ea-4b70-bd50-e6caad6b5780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:08.786986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:08.810157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-87eedd3a-39ea-4b70-bd50-e6caad6b5780 None None] MFA Rules not processed for user `5ac1323815364df4a3a4d4dbbb9d70dd`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:08.811568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-87eedd3a-39ea-4b70-bd50-e6caad6b5780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:08.846933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10684fa-3a4f-4b8e-b6cf-8aef89d8dd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:08.847955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10684fa-3a4f-4b8e-b6cf-8aef89d8dd20 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:08.848380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10684fa-3a4f-4b8e-b6cf-8aef89d8dd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:08.853021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10684fa-3a4f-4b8e-b6cf-8aef89d8dd20 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:08.853945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10684fa-3a4f-4b8e-b6cf-8aef89d8dd20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:08.856195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10684fa-3a4f-4b8e-b6cf-8aef89d8dd20 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:08.892357 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1560/3087] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:57:08 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:08.896290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10684fa-3a4f-4b8e-b6cf-8aef89d8dd20 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:08.911138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10684fa-3a4f-4b8e-b6cf-8aef89d8dd20 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:08.921563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fb6a4-59db-4912-8f9d-1f44954ae631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:08.921563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fb6a4-59db-4912-8f9d-1f44954ae631 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:08.921935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fb6a4-59db-4912-8f9d-1f44954ae631 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:08.922488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fb6a4-59db-4912-8f9d-1f44954ae631 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:08.923130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fb6a4-59db-4912-8f9d-1f44954ae631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:08.925403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fb6a4-59db-4912-8f9d-1f44954ae631 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:08.942339 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1561/3088] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:57:08.948355 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1528/3089] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:57:08.952939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fb6a4-59db-4912-8f9d-1f44954ae631 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:08.967823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fb6a4-59db-4912-8f9d-1f44954ae631 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:08.974533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840e30e-560e-4adc-ab8e-cb7f47408cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:08.976210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840e30e-560e-4adc-ab8e-cb7f47408cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:08.977039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840e30e-560e-4adc-ab8e-cb7f47408cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:08.977576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840e30e-560e-4adc-ab8e-cb7f47408cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:08.978440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840e30e-560e-4adc-ab8e-cb7f47408cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:08.981585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840e30e-560e-4adc-ab8e-cb7f47408cc3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:09.000658 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1562/3090] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:57:09.001906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eedd3a-39ea-4b70-bd50-e6caad6b5780 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:09.026237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eedd3a-39ea-4b70-bd50-e6caad6b5780 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:09.031997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8932a-7cbd-4497-93a3-a7ea4728c30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:09.033199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8932a-7cbd-4497-93a3-a7ea4728c30b admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:09.033199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8932a-7cbd-4497-93a3-a7ea4728c30b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:09.033598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8932a-7cbd-4497-93a3-a7ea4728c30b admin admin] PATH_INFO: `/v3/projects/5cdaf5b9230f4e09949a39a5cbe72011/users/5d9facf5ea0743cb821cec1b40f6b609/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:09.057886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8932a-7cbd-4497-93a3-a7ea4728c30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdaf5b9230f4e09949a39a5cbe72011, user_id=5d9facf5ea0743cb821cec1b40f6b609, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:09.064277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8932a-7cbd-4497-93a3-a7ea4728c30b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:09.104041 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1529/3091] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:57:09 2022] PUT /identity/v3/projects/5cdaf5b9230f4e09949a39a5cbe72011/users/5d9facf5ea0743cb821cec1b40f6b609/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:57:09.113296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952802c-839d-402b-9e5f-46c8770b255c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:09.113566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952802c-839d-402b-9e5f-46c8770b255c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:09.113843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952802c-839d-402b-9e5f-46c8770b255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:09.142608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3952802c-839d-402b-9e5f-46c8770b255c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:09.144086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3952802c-839d-402b-9e5f-46c8770b255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:09.179220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:09.227085 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1563/3092] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:09.245703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8932a-7cbd-4497-93a3-a7ea4728c30b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:09.248201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7fa8932a-7cbd-4497-93a3-a7ea4728c30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:09.319971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8932a-7cbd-4497-93a3-a7ea4728c30b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:09.326360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a161b6-70ae-4ce3-b3b0-e75b043d7063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:09.326991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a161b6-70ae-4ce3-b3b0-e75b043d7063 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:09.327342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a161b6-70ae-4ce3-b3b0-e75b043d7063 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:09.327626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a161b6-70ae-4ce3-b3b0-e75b043d7063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:09.343504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a161b6-70ae-4ce3-b3b0-e75b043d7063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:09.345955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a161b6-70ae-4ce3-b3b0-e75b043d7063 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:09.364004 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1530/3093] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:57:09.645957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487060b9-6f68-48ea-97ae-4df6031515ca None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:09.647627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487060b9-6f68-48ea-97ae-4df6031515ca None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:09.647627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487060b9-6f68-48ea-97ae-4df6031515ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:09.681613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-487060b9-6f68-48ea-97ae-4df6031515ca None None] MFA Rules not processed for user `d54b1c5c00544be4b60132d09817c8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:09.687647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-487060b9-6f68-48ea-97ae-4df6031515ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:09.839754 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1564/3094] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:14.839178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a161b6-70ae-4ce3-b3b0-e75b043d7063 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:14.841680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e1a161b6-70ae-4ce3-b3b0-e75b043d7063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:14.858548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a161b6-70ae-4ce3-b3b0-e75b043d7063 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:14.867774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:14.869999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:14.870775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:14.871288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] PATH_INFO: `/v3/users/56649c9113d84e6390d58d84ab089380` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:14.876421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56649c9113d84e6390d58d84ab089380)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:14.885139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:14.984658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56649c9113d84e6390d58d84ab089380'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:14.996029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56649c9113d84e6390d58d84ab089380'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:14.996863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56649c9113d84e6390d58d84ab089380'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:14.997581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56649c9113d84e6390d58d84ab089380'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:15.024655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56649c9113d84e6390d58d84ab089380'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:15.049695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:15.066431 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1531/3095] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:57:14 2022] DELETE /identity/v3/users/56649c9113d84e6390d58d84ab089380 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:57:15.091495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cd7d8-cdfa-43ee-9e3f-d81fa1c1540e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:15.091971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cd7d8-cdfa-43ee-9e3f-d81fa1c1540e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:15.092079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cd7d8-cdfa-43ee-9e3f-d81fa1c1540e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:15.154503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e31cd7d8-cdfa-43ee-9e3f-d81fa1c1540e None None] MFA Rules not processed for user `fbaa704ca5484cd1970ab5e781685536`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:15.156143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e31cd7d8-cdfa-43ee-9e3f-d81fa1c1540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:15.282920 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1565/3096] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:15.758821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:15.760465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:15.919008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cd7d8-cdfa-43ee-9e3f-d81fa1c1540e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:15.920630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e31cd7d8-cdfa-43ee-9e3f-d81fa1c1540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:15.923208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9f04f-e083-4a62-87d1-c612ab636cd5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:15.931352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186e549-113e-4bf2-8eb0-5f3d38359ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:15.932439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186e549-113e-4bf2-8eb0-5f3d38359ed5 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:15.932884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186e549-113e-4bf2-8eb0-5f3d38359ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:15.934368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186e549-113e-4bf2-8eb0-5f3d38359ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:15.950663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186e549-113e-4bf2-8eb0-5f3d38359ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:15.966770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186e549-113e-4bf2-8eb0-5f3d38359ed5 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:15.988739 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1532/3097] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:15 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:57:16.093720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cd7d8-cdfa-43ee-9e3f-d81fa1c1540e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:16.098367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b876544-d816-41db-a928-70d8bf50d9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:16.099423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b876544-d816-41db-a928-70d8bf50d9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:16.099862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b876544-d816-41db-a928-70d8bf50d9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:16.100455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b876544-d816-41db-a928-70d8bf50d9e2 admin admin] PATH_INFO: `/v3/projects/1e6beec34e0e4af180cd798eb7ef4ad0` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:16.102596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b876544-d816-41db-a928-70d8bf50d9e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6beec34e0e4af180cd798eb7ef4ad0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:16.107371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b876544-d816-41db-a928-70d8bf50d9e2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:16.190091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:16.272908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6b876544-d816-41db-a928-70d8bf50d9e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6beec34e0e4af180cd798eb7ef4ad0', 'request_id': 'req-6b876544-d816-41db-a928-70d8bf50d9e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:16.297009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6b876544-d816-41db-a928-70d8bf50d9e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6beec34e0e4af180cd798eb7ef4ad0', 'request_id': 'req-6b876544-d816-41db-a928-70d8bf50d9e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:16.308180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6b876544-d816-41db-a928-70d8bf50d9e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6beec34e0e4af180cd798eb7ef4ad0', 'request_id': 'req-6b876544-d816-41db-a928-70d8bf50d9e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:16.346604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6b876544-d816-41db-a928-70d8bf50d9e2 admin admin] The token cache is being invalidate because project 1e6beec34e0e4af180cd798eb7ef4ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:57:16.347354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6b876544-d816-41db-a928-70d8bf50d9e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:16.348720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6b876544-d816-41db-a928-70d8bf50d9e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:16.351168 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1566/3098] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:57:15 2022] DELETE /identity/v3/projects/1e6beec34e0e4af180cd798eb7ef4ad0 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:16.356789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5572f-7349-4fac-bfcd-4c8af03fd66c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:16.357210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5572f-7349-4fac-bfcd-4c8af03fd66c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:16.357606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5572f-7349-4fac-bfcd-4c8af03fd66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:16.404986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-caa5572f-7349-4fac-bfcd-4c8af03fd66c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:16.407461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-caa5572f-7349-4fac-bfcd-4c8af03fd66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:16.548719 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1533/3099] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:16.557419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba616856-72e9-4c0c-90eb-77a7d4a2a175 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:16.557731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba616856-72e9-4c0c-90eb-77a7d4a2a175 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:16.557977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba616856-72e9-4c0c-90eb-77a7d4a2a175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:16.603205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ba616856-72e9-4c0c-90eb-77a7d4a2a175 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:16.607921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ba616856-72e9-4c0c-90eb-77a7d4a2a175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:16.632090 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1567/3100] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:16.636001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5572f-7349-4fac-bfcd-4c8af03fd66c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:16.652443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5572f-7349-4fac-bfcd-4c8af03fd66c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:16.661101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee701974-1641-4981-ac80-56f46a6c186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:16.662026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee701974-1641-4981-ac80-56f46a6c186d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:16.662445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee701974-1641-4981-ac80-56f46a6c186d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:16.662701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee701974-1641-4981-ac80-56f46a6c186d admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:16.663571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee701974-1641-4981-ac80-56f46a6c186d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:57:16.664635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee701974-1641-4981-ac80-56f46a6c186d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:16.666780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee701974-1641-4981-ac80-56f46a6c186d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:16.686990 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1534/3101] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:57:16.690021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba616856-72e9-4c0c-90eb-77a7d4a2a175 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:16.709850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba616856-72e9-4c0c-90eb-77a7d4a2a175 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:16.725380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2614d2b-e21f-4ca5-9afc-1e83fd637e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:16.727337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2614d2b-e21f-4ca5-9afc-1e83fd637e7e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:16.731611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2614d2b-e21f-4ca5-9afc-1e83fd637e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:16.732088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2614d2b-e21f-4ca5-9afc-1e83fd637e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:16.732844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2614d2b-e21f-4ca5-9afc-1e83fd637e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:16.736282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2614d2b-e21f-4ca5-9afc-1e83fd637e7e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:16.793297 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1568/3102] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:57:16 2022] POST /identity/v3/projects => generated 395 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:57:16.797988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee701974-1641-4981-ac80-56f46a6c186d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:16.833667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee701974-1641-4981-ac80-56f46a6c186d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:17.000272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beb802-2d91-4cf7-8e3b-00d1f958a12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:17.000898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beb802-2d91-4cf7-8e3b-00d1f958a12f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:17.004791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beb802-2d91-4cf7-8e3b-00d1f958a12f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:17.005127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beb802-2d91-4cf7-8e3b-00d1f958a12f admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:17.009526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45beb802-2d91-4cf7-8e3b-00d1f958a12f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:17.011601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45beb802-2d91-4cf7-8e3b-00d1f958a12f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:17.111776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:17.138230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2614d2b-e21f-4ca5-9afc-1e83fd637e7e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:17.159819 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1535/3103] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:57:16 2022] POST /identity/v3/users => generated 298 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:17.172146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2614d2b-e21f-4ca5-9afc-1e83fd637e7e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:17.188645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f6c62-a42b-4db7-a428-024800a51067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:17.189296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f6c62-a42b-4db7-a428-024800a51067 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:17.191466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f6c62-a42b-4db7-a428-024800a51067 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:17.191781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f6c62-a42b-4db7-a428-024800a51067 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:17.192524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f6c62-a42b-4db7-a428-024800a51067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:17.194258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f6c62-a42b-4db7-a428-024800a51067 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:17.208560 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1569/3104] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:57:17.213584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beb802-2d91-4cf7-8e3b-00d1f958a12f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:17.227442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beb802-2d91-4cf7-8e3b-00d1f958a12f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:17.233809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbeec50-108b-473f-92b8-25318dd2ceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:17.235020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbeec50-108b-473f-92b8-25318dd2ceec admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:17.235743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbeec50-108b-473f-92b8-25318dd2ceec admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:17.236226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbeec50-108b-473f-92b8-25318dd2ceec admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:17.239274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbeec50-108b-473f-92b8-25318dd2ceec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:17.242714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbeec50-108b-473f-92b8-25318dd2ceec admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:17.264673 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1536/3105] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:57:17.268078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f6c62-a42b-4db7-a428-024800a51067 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:17.279404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f6c62-a42b-4db7-a428-024800a51067 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:17.284753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd930886-f74c-46e6-ad68-b7cb1b5978e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:17.285576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd930886-f74c-46e6-ad68-b7cb1b5978e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:17.286662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd930886-f74c-46e6-ad68-b7cb1b5978e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:17.286662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd930886-f74c-46e6-ad68-b7cb1b5978e7 admin admin] PATH_INFO: `/v3/projects/6c97b3b7fa484f97bdf40224f7cc34d4/users/01ec70849cfa44368a91df8b3410aba8/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:17.334626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd930886-f74c-46e6-ad68-b7cb1b5978e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c97b3b7fa484f97bdf40224f7cc34d4, user_id=01ec70849cfa44368a91df8b3410aba8, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:17.338585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd930886-f74c-46e6-ad68-b7cb1b5978e7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:17.359936 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1570/3106] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:57:17 2022] PUT /identity/v3/projects/6c97b3b7fa484f97bdf40224f7cc34d4/users/01ec70849cfa44368a91df8b3410aba8/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:17.365732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea33c3-3891-44e5-a216-5e8bbcd87edb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:17.365953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea33c3-3891-44e5-a216-5e8bbcd87edb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:17.366232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea33c3-3891-44e5-a216-5e8bbcd87edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:17.389349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dfea33c3-3891-44e5-a216-5e8bbcd87edb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:17.390604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dfea33c3-3891-44e5-a216-5e8bbcd87edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:17.580524 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1537/3107] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:17.706330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd930886-f74c-46e6-ad68-b7cb1b5978e7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:17.708714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fd930886-f74c-46e6-ad68-b7cb1b5978e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:17.836196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd930886-f74c-46e6-ad68-b7cb1b5978e7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:17.845086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f652bf-5f8c-47c4-8121-3aaa2652f2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:17.846368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f652bf-5f8c-47c4-8121-3aaa2652f2bc service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:17.846654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f652bf-5f8c-47c4-8121-3aaa2652f2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:17.846932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f652bf-5f8c-47c4-8121-3aaa2652f2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:17.872352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f652bf-5f8c-47c4-8121-3aaa2652f2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:17.874022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f652bf-5f8c-47c4-8121-3aaa2652f2bc service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:17.911444 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1571/3108] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:57:24.875335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008f2f5-7e1d-4b22-9449-248957353230 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:24.881790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008f2f5-7e1d-4b22-9449-248957353230 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:24.882344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008f2f5-7e1d-4b22-9449-248957353230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:25.002907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4008f2f5-7e1d-4b22-9449-248957353230 None None] MFA Rules not processed for user `5d9facf5ea0743cb821cec1b40f6b609`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:25.008672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4008f2f5-7e1d-4b22-9449-248957353230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:25.188209 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1538/3109] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:25.814242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f652bf-5f8c-47c4-8121-3aaa2652f2bc service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:25.816041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-21f652bf-5f8c-47c4-8121-3aaa2652f2bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:25.926698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:25.970368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f652bf-5f8c-47c4-8121-3aaa2652f2bc service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:25.977646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4737fc0-7a29-4e6c-843f-4bbca2b9de77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:25.978327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737fc0-7a29-4e6c-843f-4bbca2b9de77 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:25.978604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737fc0-7a29-4e6c-843f-4bbca2b9de77 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:25.978874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737fc0-7a29-4e6c-843f-4bbca2b9de77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:25.988276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4737fc0-7a29-4e6c-843f-4bbca2b9de77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:25.989937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4737fc0-7a29-4e6c-843f-4bbca2b9de77 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:26.000779 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1572/3110] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:57:29.477527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008f2f5-7e1d-4b22-9449-248957353230 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:29.479663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4008f2f5-7e1d-4b22-9449-248957353230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:29.518634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008f2f5-7e1d-4b22-9449-248957353230 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:29.531189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fe5a5-88d3-42f0-a81e-be450f574934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:29.532605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fe5a5-88d3-42f0-a81e-be450f574934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:29.534558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fe5a5-88d3-42f0-a81e-be450f574934 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:29.535170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fe5a5-88d3-42f0-a81e-be450f574934 admin admin] PATH_INFO: `/v3/users/fbaa704ca5484cd1970ab5e781685536` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:29.537153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fe5a5-88d3-42f0-a81e-be450f574934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbaa704ca5484cd1970ab5e781685536)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:29.541288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fe5a5-88d3-42f0-a81e-be450f574934 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:29.641227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-329fe5a5-88d3-42f0-a81e-be450f574934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbaa704ca5484cd1970ab5e781685536'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:29.651226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-329fe5a5-88d3-42f0-a81e-be450f574934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbaa704ca5484cd1970ab5e781685536'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:29.653709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-329fe5a5-88d3-42f0-a81e-be450f574934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbaa704ca5484cd1970ab5e781685536'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:29.654528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-329fe5a5-88d3-42f0-a81e-be450f574934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbaa704ca5484cd1970ab5e781685536'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:29.694419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-329fe5a5-88d3-42f0-a81e-be450f574934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbaa704ca5484cd1970ab5e781685536'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:29.698845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:29.724430 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1539/3111] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:57:29 2022] DELETE /identity/v3/users/fbaa704ca5484cd1970ab5e781685536 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:30.510285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4737fc0-7a29-4e6c-843f-4bbca2b9de77 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:30.527928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4737fc0-7a29-4e6c-843f-4bbca2b9de77 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:30.722160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:30.724048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:30.724531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:30.726429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de admin admin] PATH_INFO: `/v3/projects/06d641c6b7084a95b2964aeec2be6b77` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:30.728607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d641c6b7084a95b2964aeec2be6b77)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:30.731086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:30.916190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d641c6b7084a95b2964aeec2be6b77', 'request_id': 'req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:30.933729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d641c6b7084a95b2964aeec2be6b77', 'request_id': 'req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:30.942077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d641c6b7084a95b2964aeec2be6b77', 'request_id': 'req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:30.970537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de admin admin] The token cache is being invalidate because project 06d641c6b7084a95b2964aeec2be6b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:57:30.971108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:30.971978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1d0aef4f-a8a7-42b1-8745-94a6765aa4de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:30.974444 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1573/3112] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:57:30 2022] DELETE /identity/v3/projects/06d641c6b7084a95b2964aeec2be6b77 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:30.982291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b8e75-cdda-4324-9f65-153e17f82a47 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:30.982882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b8e75-cdda-4324-9f65-153e17f82a47 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:30.983046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b8e75-cdda-4324-9f65-153e17f82a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:31.076137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-762b8e75-cdda-4324-9f65-153e17f82a47 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:31.077406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-762b8e75-cdda-4324-9f65-153e17f82a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:31.230387 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1540/3113] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:31.238717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1870a-9ceb-4298-a09e-b1d731a2e5b0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:31.239000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1870a-9ceb-4298-a09e-b1d731a2e5b0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:31.239542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1870a-9ceb-4298-a09e-b1d731a2e5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:31.284556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4bc1870a-9ceb-4298-a09e-b1d731a2e5b0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:31.285804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4bc1870a-9ceb-4298-a09e-b1d731a2e5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:31.296432 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1574/3114] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:31.300317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b8e75-cdda-4324-9f65-153e17f82a47 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:31.312914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b8e75-cdda-4324-9f65-153e17f82a47 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:31.320164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635da74-f18e-4eda-8691-eda6fea4d2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:31.321664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635da74-f18e-4eda-8691-eda6fea4d2cb admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:31.322119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635da74-f18e-4eda-8691-eda6fea4d2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:31.323313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635da74-f18e-4eda-8691-eda6fea4d2cb admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:31.323313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635da74-f18e-4eda-8691-eda6fea4d2cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:57:31.323555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635da74-f18e-4eda-8691-eda6fea4d2cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:31.325351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635da74-f18e-4eda-8691-eda6fea4d2cb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:31.341132 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1541/3115] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:57:31.345524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1870a-9ceb-4298-a09e-b1d731a2e5b0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:31.355617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1870a-9ceb-4298-a09e-b1d731a2e5b0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:31.361475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bdc65-4ceb-49d5-ad81-86a753bdf2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:31.362582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bdc65-4ceb-49d5-ad81-86a753bdf2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:31.362582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bdc65-4ceb-49d5-ad81-86a753bdf2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:31.362983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bdc65-4ceb-49d5-ad81-86a753bdf2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:31.363768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bdc65-4ceb-49d5-ad81-86a753bdf2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:31.366882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bdc65-4ceb-49d5-ad81-86a753bdf2f6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:31.433225 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1575/3116] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:57:31 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:31.440662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635da74-f18e-4eda-8691-eda6fea4d2cb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:31.492329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635da74-f18e-4eda-8691-eda6fea4d2cb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:31.580561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42bc2-1d4c-4098-b2f5-b9facc388171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:31.581208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42bc2-1d4c-4098-b2f5-b9facc388171 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:31.581494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42bc2-1d4c-4098-b2f5-b9facc388171 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:31.581924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42bc2-1d4c-4098-b2f5-b9facc388171 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:31.582707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd42bc2-1d4c-4098-b2f5-b9facc388171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:31.586538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd42bc2-1d4c-4098-b2f5-b9facc388171 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:31.640327 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1542/3117] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:57:31 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:31.645774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bdc65-4ceb-49d5-ad81-86a753bdf2f6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:31.662454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bdc65-4ceb-49d5-ad81-86a753bdf2f6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:31.687844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb070f-6c83-44ee-9613-c51ed88d5606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:31.688498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb070f-6c83-44ee-9613-c51ed88d5606 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:31.688780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb070f-6c83-44ee-9613-c51ed88d5606 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:31.689055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb070f-6c83-44ee-9613-c51ed88d5606 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:31.689736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb070f-6c83-44ee-9613-c51ed88d5606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:31.699954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb070f-6c83-44ee-9613-c51ed88d5606 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:31.746463 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1576/3118] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:57:31.749617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42bc2-1d4c-4098-b2f5-b9facc388171 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:31.768628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42bc2-1d4c-4098-b2f5-b9facc388171 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:31.788217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0390e6f-f901-4e76-b2e7-d888c78fab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:31.792666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0390e6f-f901-4e76-b2e7-d888c78fab76 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:31.793637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0390e6f-f901-4e76-b2e7-d888c78fab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:31.793976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0390e6f-f901-4e76-b2e7-d888c78fab76 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:31.813268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0390e6f-f901-4e76-b2e7-d888c78fab76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:31.831086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0390e6f-f901-4e76-b2e7-d888c78fab76 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:31.872159 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1543/3119] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:57:31.873381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb070f-6c83-44ee-9613-c51ed88d5606 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:31.908484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb070f-6c83-44ee-9613-c51ed88d5606 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:31.922166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f06b9-fbbc-43eb-b17b-d2f151b27116 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:31.922166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f06b9-fbbc-43eb-b17b-d2f151b27116 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:31.922166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f06b9-fbbc-43eb-b17b-d2f151b27116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:31.943238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d3fb9-8f26-443b-aab9-1c1e4362d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:31.944409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d3fb9-8f26-443b-aab9-1c1e4362d309 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:31.944911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d3fb9-8f26-443b-aab9-1c1e4362d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:31.945433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d3fb9-8f26-443b-aab9-1c1e4362d309 admin admin] PATH_INFO: `/v3/projects/d24a29bd6efb40609e31fbb6dba839e8/users/322606d4cb0f45d3ac2eceab4999d45b/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:31.971525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1d6f06b9-fbbc-43eb-b17b-d2f151b27116 None None] MFA Rules not processed for user `5d9facf5ea0743cb821cec1b40f6b609`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:31.979553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1d6f06b9-fbbc-43eb-b17b-d2f151b27116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:31.993127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d3fb9-8f26-443b-aab9-1c1e4362d309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24a29bd6efb40609e31fbb6dba839e8, user_id=322606d4cb0f45d3ac2eceab4999d45b, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:31.996536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d3fb9-8f26-443b-aab9-1c1e4362d309 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:31.999954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:32.075303 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1577/3120] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:57:31 2022] PUT /identity/v3/projects/d24a29bd6efb40609e31fbb6dba839e8/users/322606d4cb0f45d3ac2eceab4999d45b/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:32.082637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00490d3d-a9fb-4e13-b5be-014901073aee None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:32.083380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00490d3d-a9fb-4e13-b5be-014901073aee None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:32.085631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00490d3d-a9fb-4e13-b5be-014901073aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:32.132928 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1544/3121] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:32.143995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-00490d3d-a9fb-4e13-b5be-014901073aee None None] MFA Rules not processed for user `322606d4cb0f45d3ac2eceab4999d45b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:32.146101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-00490d3d-a9fb-4e13-b5be-014901073aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:32.189694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a938df3-da46-4f74-9f96-59e63bf772b3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:32.190101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a938df3-da46-4f74-9f96-59e63bf772b3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:32.190450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a938df3-da46-4f74-9f96-59e63bf772b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:32.233917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:32.365230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9a938df3-da46-4f74-9f96-59e63bf772b3 None None] MFA Rules not processed for user `01ec70849cfa44368a91df8b3410aba8`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:32.370499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9a938df3-da46-4f74-9f96-59e63bf772b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:32.410195 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1578/3122] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:32.413213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce399da-ecb2-4b33-9289-518e8ba6f27c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:32.413512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce399da-ecb2-4b33-9289-518e8ba6f27c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:32.413787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce399da-ecb2-4b33-9289-518e8ba6f27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:32.512259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1ce399da-ecb2-4b33-9289-518e8ba6f27c None None] MFA Rules not processed for user `322606d4cb0f45d3ac2eceab4999d45b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:32.514201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1ce399da-ecb2-4b33-9289-518e8ba6f27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:32.532460 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1579/3123] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:32.559522 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1545/3124] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:57:32.570993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdc5aa-63ee-42a4-9c35-5813cc95d48e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:32.571274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdc5aa-63ee-42a4-9c35-5813cc95d48e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:32.571626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdc5aa-63ee-42a4-9c35-5813cc95d48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:32.615700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-07cdc5aa-63ee-42a4-9c35-5813cc95d48e None None] MFA Rules not processed for user `01ec70849cfa44368a91df8b3410aba8`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:32.617098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-07cdc5aa-63ee-42a4-9c35-5813cc95d48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:32.637713 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1580/3125] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:33.348328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a938df3-da46-4f74-9f96-59e63bf772b3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:33.351657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9a938df3-da46-4f74-9f96-59e63bf772b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:33.518094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a938df3-da46-4f74-9f96-59e63bf772b3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:33.534708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d0dfd-3927-40ac-81ea-118e66bc7ad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:33.535335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d0dfd-3927-40ac-81ea-118e66bc7ad9 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:33.535902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d0dfd-3927-40ac-81ea-118e66bc7ad9 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:33.536200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d0dfd-3927-40ac-81ea-118e66bc7ad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:33.552984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d0dfd-3927-40ac-81ea-118e66bc7ad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:33.554855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d0dfd-3927-40ac-81ea-118e66bc7ad9 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:33.597527 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1546/3126] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:57:33.680535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdc5aa-63ee-42a4-9c35-5813cc95d48e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:33.683158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-07cdc5aa-63ee-42a4-9c35-5813cc95d48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:33.747407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdc5aa-63ee-42a4-9c35-5813cc95d48e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:33.764215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a6ac3-5f72-4adc-b9ba-8b4ade676ac8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:33.765152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a6ac3-5f72-4adc-b9ba-8b4ade676ac8 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:33.765695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a6ac3-5f72-4adc-b9ba-8b4ade676ac8 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:33.766196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a6ac3-5f72-4adc-b9ba-8b4ade676ac8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:33.776852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a6ac3-5f72-4adc-b9ba-8b4ade676ac8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:33.779103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a6ac3-5f72-4adc-b9ba-8b4ade676ac8 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:33.792850 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1581/3127] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:33 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:57:35.013283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d0dfd-3927-40ac-81ea-118e66bc7ad9 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:35.015430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-992d0dfd-3927-40ac-81ea-118e66bc7ad9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:35.233382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d0dfd-3927-40ac-81ea-118e66bc7ad9 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:35.233382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:35.233382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:35.233382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:35.235328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] PATH_INFO: `/v3/users/05f0f7a60257437eaa8702b664916979` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:35.237447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f0f7a60257437eaa8702b664916979)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:35.245861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:35.297793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:35.424055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f0f7a60257437eaa8702b664916979'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:35.465768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f0f7a60257437eaa8702b664916979'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:35.468517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f0f7a60257437eaa8702b664916979'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:35.469490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f0f7a60257437eaa8702b664916979'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:35.498821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f0f7a60257437eaa8702b664916979'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:35.566683 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1547/3128] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:57:35 2022] DELETE /identity/v3/users/05f0f7a60257437eaa8702b664916979 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:35.567526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35474d7-366e-4d4d-a8cc-b4dee0ffe8e5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:35.567999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35474d7-366e-4d4d-a8cc-b4dee0ffe8e5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:35.568128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35474d7-366e-4d4d-a8cc-b4dee0ffe8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:35.591064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d35474d7-366e-4d4d-a8cc-b4dee0ffe8e5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:35.592567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d35474d7-366e-4d4d-a8cc-b4dee0ffe8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:35.729858 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1582/3129] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:35.768860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:35.784114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:35.923734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddba0df-8af3-40cc-8414-490eadd9c479 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:35.935566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bddb1f-5aef-4ec2-a80a-9eeefc83e406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:35.936403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bddb1f-5aef-4ec2-a80a-9eeefc83e406 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:35.936853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bddb1f-5aef-4ec2-a80a-9eeefc83e406 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:35.937312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bddb1f-5aef-4ec2-a80a-9eeefc83e406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:35.959683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bddb1f-5aef-4ec2-a80a-9eeefc83e406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:35.961150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bddb1f-5aef-4ec2-a80a-9eeefc83e406 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:36.003344 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1548/3130] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:57:36.528430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35474d7-366e-4d4d-a8cc-b4dee0ffe8e5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:36.530423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d35474d7-366e-4d4d-a8cc-b4dee0ffe8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:36.558901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35474d7-366e-4d4d-a8cc-b4dee0ffe8e5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:36.575072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:36.578531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:36.580227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:36.583297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] PATH_INFO: `/v3/projects/d7550f7ad9dc45ba9c9bfb0a5a11a774` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:36.589135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7550f7ad9dc45ba9c9bfb0a5a11a774)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:36.599147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:36.732449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'request_id': 'req-298544a3-597b-4a56-8c16-8ecb14a5e7f1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:36.737265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=2,keystone:SELECT=94,keystone:DELETE=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:36.747049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'request_id': 'req-298544a3-597b-4a56-8c16-8ecb14a5e7f1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:36.772879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'request_id': 'req-298544a3-597b-4a56-8c16-8ecb14a5e7f1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:36.836316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] The token cache is being invalidate because project d7550f7ad9dc45ba9c9bfb0a5a11a774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:57:36.837017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:36.853034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:36.863719 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1583/3131] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:57:36 2022] DELETE /identity/v3/projects/d7550f7ad9dc45ba9c9bfb0a5a11a774 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:36.867941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bddb1f-5aef-4ec2-a80a-9eeefc83e406 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:36.879357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bddb1f-5aef-4ec2-a80a-9eeefc83e406 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:37.056590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad59de0-5a0e-4c78-b74e-791f52e3d5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:37.058757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad59de0-5a0e-4c78-b74e-791f52e3d5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:37.060053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad59de0-5a0e-4c78-b74e-791f52e3d5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:37.061106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad59de0-5a0e-4c78-b74e-791f52e3d5b3 admin admin] PATH_INFO: `/v3/users/3d7dcc4a842b44ad916158a902ee0878` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:37.064560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad59de0-5a0e-4c78-b74e-791f52e3d5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7dcc4a842b44ad916158a902ee0878)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:37.068862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad59de0-5a0e-4c78-b74e-791f52e3d5b3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:37.202639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:37.227193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ad59de0-5a0e-4c78-b74e-791f52e3d5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7dcc4a842b44ad916158a902ee0878'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:37.253497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ad59de0-5a0e-4c78-b74e-791f52e3d5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7dcc4a842b44ad916158a902ee0878'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:37.259191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ad59de0-5a0e-4c78-b74e-791f52e3d5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7dcc4a842b44ad916158a902ee0878'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:37.260116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ad59de0-5a0e-4c78-b74e-791f52e3d5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7dcc4a842b44ad916158a902ee0878'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:37.376818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ad59de0-5a0e-4c78-b74e-791f52e3d5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7dcc4a842b44ad916158a902ee0878'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:37.419462 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1549/3132] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:57:36 2022] DELETE /identity/v3/users/3d7dcc4a842b44ad916158a902ee0878 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:38.253081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:38.254805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:38.295485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298544a3-597b-4a56-8c16-8ecb14a5e7f1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:38.473929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b4aab-7dd5-4f91-a093-042238c7592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:38.475023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b4aab-7dd5-4f91-a093-042238c7592c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:38.475513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b4aab-7dd5-4f91-a093-042238c7592c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:38.475969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b4aab-7dd5-4f91-a093-042238c7592c admin admin] PATH_INFO: `/v3/projects/4a1046f826864ce2aeafe7c6fa76d27d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:38.482681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b4aab-7dd5-4f91-a093-042238c7592c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1046f826864ce2aeafe7c6fa76d27d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:38.489589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b4aab-7dd5-4f91-a093-042238c7592c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:38.622982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-076b4aab-7dd5-4f91-a093-042238c7592c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1046f826864ce2aeafe7c6fa76d27d', 'request_id': 'req-076b4aab-7dd5-4f91-a093-042238c7592c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:38.642303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-076b4aab-7dd5-4f91-a093-042238c7592c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1046f826864ce2aeafe7c6fa76d27d', 'request_id': 'req-076b4aab-7dd5-4f91-a093-042238c7592c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:38.654788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-076b4aab-7dd5-4f91-a093-042238c7592c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1046f826864ce2aeafe7c6fa76d27d', 'request_id': 'req-076b4aab-7dd5-4f91-a093-042238c7592c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:38.683860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-076b4aab-7dd5-4f91-a093-042238c7592c admin admin] The token cache is being invalidate because project 4a1046f826864ce2aeafe7c6fa76d27d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:57:38.684525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-076b4aab-7dd5-4f91-a093-042238c7592c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:38.685630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-076b4aab-7dd5-4f91-a093-042238c7592c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:38.688705 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1584/3133] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:57:38 2022] DELETE /identity/v3/projects/4a1046f826864ce2aeafe7c6fa76d27d => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:38.694942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1ef59-459a-4b2e-a939-f100fc612d18 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:38.695906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1ef59-459a-4b2e-a939-f100fc612d18 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:38.696489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1ef59-459a-4b2e-a939-f100fc612d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:38.732851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-acb1ef59-459a-4b2e-a939-f100fc612d18 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:38.735667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-acb1ef59-459a-4b2e-a939-f100fc612d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:38.956524 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1550/3134] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:57:38.957843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d414a6c-2483-404f-a146-e057aedcd558 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:38.958326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d414a6c-2483-404f-a146-e057aedcd558 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:38.958783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d414a6c-2483-404f-a146-e057aedcd558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:39.011161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5d414a6c-2483-404f-a146-e057aedcd558 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:39.012405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5d414a6c-2483-404f-a146-e057aedcd558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:39.029804 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1585/3135] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:39.034293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1ef59-459a-4b2e-a939-f100fc612d18 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:39.050184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1ef59-459a-4b2e-a939-f100fc612d18 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:39.056926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dc260-2655-4b1d-9cc4-f88ec820b300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:39.057593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dc260-2655-4b1d-9cc4-f88ec820b300 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:39.057878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dc260-2655-4b1d-9cc4-f88ec820b300 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:39.058158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dc260-2655-4b1d-9cc4-f88ec820b300 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:39.058824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dc260-2655-4b1d-9cc4-f88ec820b300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:57:39.059131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dc260-2655-4b1d-9cc4-f88ec820b300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:39.060773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dc260-2655-4b1d-9cc4-f88ec820b300 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:39.082474 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1551/3136] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:57:39.087650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d414a6c-2483-404f-a146-e057aedcd558 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:39.101457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d414a6c-2483-404f-a146-e057aedcd558 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:39.113527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de20ce5-1656-4398-a5de-cfc06c1a1f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:39.114206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de20ce5-1656-4398-a5de-cfc06c1a1f00 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:39.114482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de20ce5-1656-4398-a5de-cfc06c1a1f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:39.114752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de20ce5-1656-4398-a5de-cfc06c1a1f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:39.115389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de20ce5-1656-4398-a5de-cfc06c1a1f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:39.117763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de20ce5-1656-4398-a5de-cfc06c1a1f00 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:39.182857 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1586/3137] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:57:39 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:39.184795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dc260-2655-4b1d-9cc4-f88ec820b300 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:39.204846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dc260-2655-4b1d-9cc4-f88ec820b300 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:39.352561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8e6a1-6107-4666-b447-c5cbe08a1cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:39.353222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8e6a1-6107-4666-b447-c5cbe08a1cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:39.353547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8e6a1-6107-4666-b447-c5cbe08a1cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:39.353824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8e6a1-6107-4666-b447-c5cbe08a1cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:39.354751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8e6a1-6107-4666-b447-c5cbe08a1cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:39.356397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8e6a1-6107-4666-b447-c5cbe08a1cf0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:39.398488 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1552/3138] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:57:39 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:39.402342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de20ce5-1656-4398-a5de-cfc06c1a1f00 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:39.421119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de20ce5-1656-4398-a5de-cfc06c1a1f00 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:39.435710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d11303-df29-42b6-b19a-39cdfb34602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:39.436776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d11303-df29-42b6-b19a-39cdfb34602f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:39.437568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d11303-df29-42b6-b19a-39cdfb34602f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:39.438406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d11303-df29-42b6-b19a-39cdfb34602f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:39.439398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d11303-df29-42b6-b19a-39cdfb34602f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:39.442934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d11303-df29-42b6-b19a-39cdfb34602f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:39.458727 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1587/3139] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:57:39.460288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8e6a1-6107-4666-b447-c5cbe08a1cf0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:39.491279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8e6a1-6107-4666-b447-c5cbe08a1cf0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:39.502656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294967f-c2c4-4921-bc11-be9943553da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:39.503371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294967f-c2c4-4921-bc11-be9943553da1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:39.503720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294967f-c2c4-4921-bc11-be9943553da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:39.504008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294967f-c2c4-4921-bc11-be9943553da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:39.504945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294967f-c2c4-4921-bc11-be9943553da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:39.506951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294967f-c2c4-4921-bc11-be9943553da1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:39.519677 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1553/3140] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:57:39.524409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d11303-df29-42b6-b19a-39cdfb34602f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:39.535436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d11303-df29-42b6-b19a-39cdfb34602f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:39.541413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819abd7-44e5-4fd3-969d-075d5312bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:39.544074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819abd7-44e5-4fd3-969d-075d5312bcf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:39.544548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819abd7-44e5-4fd3-969d-075d5312bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:39.544988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819abd7-44e5-4fd3-969d-075d5312bcf9 admin admin] PATH_INFO: `/v3/projects/c2abd858364046f6a47ae3c4438bb45c/users/33df735b659c4f01911934003bb14858/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:39.570523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819abd7-44e5-4fd3-969d-075d5312bcf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2abd858364046f6a47ae3c4438bb45c, user_id=33df735b659c4f01911934003bb14858, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:39.574986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819abd7-44e5-4fd3-969d-075d5312bcf9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:39.608351 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1588/3141] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:57:39 2022] PUT /identity/v3/projects/c2abd858364046f6a47ae3c4438bb45c/users/33df735b659c4f01911934003bb14858/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:39.610228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9958e0-122f-43a8-a382-60dbc470ffb0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:39.610525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9958e0-122f-43a8-a382-60dbc470ffb0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:39.610963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9958e0-122f-43a8-a382-60dbc470ffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:39.747018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ae9958e0-122f-43a8-a382-60dbc470ffb0 None None] MFA Rules not processed for user `33df735b659c4f01911934003bb14858`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:39.748493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ae9958e0-122f-43a8-a382-60dbc470ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:39.780499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:39.900325 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1554/3142] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:57:39.909485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819abd7-44e5-4fd3-969d-075d5312bcf9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:39.925816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:40.089046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819abd7-44e5-4fd3-969d-075d5312bcf9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:40.095436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25125f-3334-44d3-a47d-861102635a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:40.096432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25125f-3334-44d3-a47d-861102635a7e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:40.097065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25125f-3334-44d3-a47d-861102635a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:40.097634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25125f-3334-44d3-a47d-861102635a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:40.099084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25125f-3334-44d3-a47d-861102635a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:40.103318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25125f-3334-44d3-a47d-861102635a7e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:40.180709 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1589/3143] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:57:39 2022] POST /identity/v3/projects => generated 375 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:40.184611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9958e0-122f-43a8-a382-60dbc470ffb0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:40.202177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9958e0-122f-43a8-a382-60dbc470ffb0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:40.356274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f7667-3e47-4bf6-b923-b6b6add3e601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:40.358765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f7667-3e47-4bf6-b923-b6b6add3e601 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:40.359325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f7667-3e47-4bf6-b923-b6b6add3e601 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:40.360072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f7667-3e47-4bf6-b923-b6b6add3e601 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:40.361017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f7667-3e47-4bf6-b923-b6b6add3e601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:40.364235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f7667-3e47-4bf6-b923-b6b6add3e601 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:40.395096 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1555/3144] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:57:40 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:40.399471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25125f-3334-44d3-a47d-861102635a7e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:40.410435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25125f-3334-44d3-a47d-861102635a7e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:40.417352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc2406-44d4-4224-9206-57e2fa46f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:40.419148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc2406-44d4-4224-9206-57e2fa46f3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:40.419734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc2406-44d4-4224-9206-57e2fa46f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:40.420144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc2406-44d4-4224-9206-57e2fa46f3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:40.421758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc2406-44d4-4224-9206-57e2fa46f3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:40.423944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc2406-44d4-4224-9206-57e2fa46f3a8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:40.438209 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1590/3145] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:57:40.443419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f7667-3e47-4bf6-b923-b6b6add3e601 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:40.457396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f7667-3e47-4bf6-b923-b6b6add3e601 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:40.463585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a8091-d845-4627-8a91-67399a6a628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:40.464433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a8091-d845-4627-8a91-67399a6a628e admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:40.464826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a8091-d845-4627-8a91-67399a6a628e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:40.465234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a8091-d845-4627-8a91-67399a6a628e admin admin] PATH_INFO: `/v3/projects/8b492f106f2f4cb9a89898e7f84702c7/users/e73b9108d84c49338a37659e565e5370/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:40.493341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a8091-d845-4627-8a91-67399a6a628e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b492f106f2f4cb9a89898e7f84702c7, user_id=e73b9108d84c49338a37659e565e5370, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:40.497541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a8091-d845-4627-8a91-67399a6a628e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:40.514370 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1556/3146] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:57:40 2022] PUT /identity/v3/projects/8b492f106f2f4cb9a89898e7f84702c7/users/e73b9108d84c49338a37659e565e5370/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:40.518628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc2406-44d4-4224-9206-57e2fa46f3a8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:40.529855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc2406-44d4-4224-9206-57e2fa46f3a8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:40.618329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883b1e4-0109-4066-b20a-675933c7e972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:40.619100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883b1e4-0109-4066-b20a-675933c7e972 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:40.619501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883b1e4-0109-4066-b20a-675933c7e972 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:40.619870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883b1e4-0109-4066-b20a-675933c7e972 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:40.620602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883b1e4-0109-4066-b20a-675933c7e972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:40.622904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883b1e4-0109-4066-b20a-675933c7e972 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:40.635662 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1591/3147] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:57:40.639701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a8091-d845-4627-8a91-67399a6a628e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:40.654140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a8091-d845-4627-8a91-67399a6a628e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:40.661084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b583e-e710-46fd-8138-ea932bdb5ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:40.662743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b583e-e710-46fd-8138-ea932bdb5ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:40.663211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b583e-e710-46fd-8138-ea932bdb5ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:40.663668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b583e-e710-46fd-8138-ea932bdb5ffa admin admin] PATH_INFO: `/v3/projects/8b492f106f2f4cb9a89898e7f84702c7/users/e73b9108d84c49338a37659e565e5370/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:40.666260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b583e-e710-46fd-8138-ea932bdb5ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b492f106f2f4cb9a89898e7f84702c7, user_id=e73b9108d84c49338a37659e565e5370, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:40.670526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b583e-e710-46fd-8138-ea932bdb5ffa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:40.684561 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1557/3148] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:57:40 2022] PUT /identity/v3/projects/8b492f106f2f4cb9a89898e7f84702c7/users/e73b9108d84c49338a37659e565e5370/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:40.694829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2f417-92be-450b-857f-fa33789873c5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:40.695115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2f417-92be-450b-857f-fa33789873c5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:40.695392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2f417-92be-450b-857f-fa33789873c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:40.732108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7ff2f417-92be-450b-857f-fa33789873c5 None None] MFA Rules not processed for user `e73b9108d84c49338a37659e565e5370`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:40.735187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7ff2f417-92be-450b-857f-fa33789873c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:40.852289 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1592/3149] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:40.854901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b583e-e710-46fd-8138-ea932bdb5ffa admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:40.881351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b583e-e710-46fd-8138-ea932bdb5ffa admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:40.887365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43138bcb-0cf7-43c2-b55e-49b7f9d6cc2e tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73b9108d84c49338a37659e565e5370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b492f106f2f4cb9a89898e7f84702c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:40.888695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43138bcb-0cf7-43c2-b55e-49b7f9d6cc2e tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:40.889928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43138bcb-0cf7-43c2-b55e-49b7f9d6cc2e tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:40.890361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43138bcb-0cf7-43c2-b55e-49b7f9d6cc2e tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:40.891221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43138bcb-0cf7-43c2-b55e-49b7f9d6cc2e tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:57:40.892150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43138bcb-0cf7-43c2-b55e-49b7f9d6cc2e tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:40.894531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43138bcb-0cf7-43c2-b55e-49b7f9d6cc2e tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:40.923689 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1558/3150] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:57:40.924826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2f417-92be-450b-857f-fa33789873c5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:40.929906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:40.937453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2f417-92be-450b-857f-fa33789873c5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:40.953937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b8c6b-278e-4fdc-a56d-36ffd793415c tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73b9108d84c49338a37659e565e5370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b492f106f2f4cb9a89898e7f84702c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:40.954780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b8c6b-278e-4fdc-a56d-36ffd793415c tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:40.955242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b8c6b-278e-4fdc-a56d-36ffd793415c tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:40.955684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b8c6b-278e-4fdc-a56d-36ffd793415c tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:40.956487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b8c6b-278e-4fdc-a56d-36ffd793415c tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:40.959515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b8c6b-278e-4fdc-a56d-36ffd793415c tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:41.013141 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1593/3151] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:57:40 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:41.018979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43138bcb-0cf7-43c2-b55e-49b7f9d6cc2e tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:41.047694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43138bcb-0cf7-43c2-b55e-49b7f9d6cc2e tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:41.117623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:41.130877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142684f-6088-437b-bbe1-890a2c6386fe tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73b9108d84c49338a37659e565e5370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b492f106f2f4cb9a89898e7f84702c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:41.131891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142684f-6088-437b-bbe1-890a2c6386fe tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:41.132034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142684f-6088-437b-bbe1-890a2c6386fe tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:41.132474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142684f-6088-437b-bbe1-890a2c6386fe tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:41.133903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142684f-6088-437b-bbe1-890a2c6386fe tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:57:41.133903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142684f-6088-437b-bbe1-890a2c6386fe tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:41.135914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142684f-6088-437b-bbe1-890a2c6386fe tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:41.151080 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1559/3152] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:57:41.692704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b8c6b-278e-4fdc-a56d-36ffd793415c tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:41.694808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5e4b8c6b-278e-4fdc-a56d-36ffd793415c tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:41.801571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b8c6b-278e-4fdc-a56d-36ffd793415c tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:41.808658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92884b94-c332-4af3-abaf-101c0ccd29a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:41.809609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92884b94-c332-4af3-abaf-101c0ccd29a1 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:41.810089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92884b94-c332-4af3-abaf-101c0ccd29a1 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:41.810462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92884b94-c332-4af3-abaf-101c0ccd29a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:41.822426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92884b94-c332-4af3-abaf-101c0ccd29a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:41.824532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92884b94-c332-4af3-abaf-101c0ccd29a1 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:41.836903 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1594/3153] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:57:41.854448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ee547-5b20-42bd-80cc-71759c8d84db None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:41.854794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ee547-5b20-42bd-80cc-71759c8d84db None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:41.855041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ee547-5b20-42bd-80cc-71759c8d84db None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:41.856672 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1560/3154] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:57:41.862803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92884b94-c332-4af3-abaf-101c0ccd29a1 service nova] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:57:41.876627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92884b94-c332-4af3-abaf-101c0ccd29a1 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:41.886895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92884b94-c332-4af3-abaf-101c0ccd29a1 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:41.892232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d01f03-27d1-42b5-bdb5-7631d0ddc707 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73b9108d84c49338a37659e565e5370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b492f106f2f4cb9a89898e7f84702c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:41.893322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d01f03-27d1-42b5-bdb5-7631d0ddc707 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:41.893802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d01f03-27d1-42b5-bdb5-7631d0ddc707 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:41.894346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d01f03-27d1-42b5-bdb5-7631d0ddc707 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] PATH_INFO: `/v3/projects/c5a6c10b0c084c5bafadf90a0b8667f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:41.895868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d01f03-27d1-42b5-bdb5-7631d0ddc707 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorizing `identity:get_project(project_id=c5a6c10b0c084c5bafadf90a0b8667f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:41.898914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d01f03-27d1-42b5-bdb5-7631d0ddc707 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:41.909358 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1595/3155] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:57:41 2022] GET /identity/v3/projects/c5a6c10b0c084c5bafadf90a0b8667f4 => generated 371 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:57:42.618842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8b934-aca9-4002-8eaa-f599dd4b8c2c None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:42.619364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8b934-aca9-4002-8eaa-f599dd4b8c2c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:42.620275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8b934-aca9-4002-8eaa-f599dd4b8c2c None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:42.621892 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1561/3156] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:57:42.628545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d01f03-27d1-42b5-bdb5-7631d0ddc707 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:57:42.648828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d01f03-27d1-42b5-bdb5-7631d0ddc707 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:42.661249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d01f03-27d1-42b5-bdb5-7631d0ddc707 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:42.667061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93579e09-ad81-4133-9920-0ed998f7d430 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73b9108d84c49338a37659e565e5370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b492f106f2f4cb9a89898e7f84702c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:42.667833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93579e09-ad81-4133-9920-0ed998f7d430 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:42.668129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93579e09-ad81-4133-9920-0ed998f7d430 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:42.668405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93579e09-ad81-4133-9920-0ed998f7d430 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] PATH_INFO: `/v3/projects/c5a6c10b0c084c5bafadf90a0b8667f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:42.670157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93579e09-ad81-4133-9920-0ed998f7d430 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorizing `identity:get_project(project_id=c5a6c10b0c084c5bafadf90a0b8667f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:42.672590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93579e09-ad81-4133-9920-0ed998f7d430 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:42.688573 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1596/3157] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:57:42 2022] GET /identity/v3/projects/c5a6c10b0c084c5bafadf90a0b8667f4 => generated 371 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:57:42.726410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8b934-aca9-4002-8eaa-f599dd4b8c2c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:42.749403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8b934-aca9-4002-8eaa-f599dd4b8c2c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:42.772747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d06297-271d-4385-aad8-e646f91392aa tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73b9108d84c49338a37659e565e5370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b492f106f2f4cb9a89898e7f84702c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:42.773834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d06297-271d-4385-aad8-e646f91392aa tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:42.774216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d06297-271d-4385-aad8-e646f91392aa tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:42.774593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d06297-271d-4385-aad8-e646f91392aa tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:42.775355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d06297-271d-4385-aad8-e646f91392aa tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:57:42.775749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d06297-271d-4385-aad8-e646f91392aa tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:42.778793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d06297-271d-4385-aad8-e646f91392aa tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:42.802196 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1562/3158] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:57:42.806867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93579e09-ad81-4133-9920-0ed998f7d430 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:42.819804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93579e09-ad81-4133-9920-0ed998f7d430 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:42.825715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6ba1e-9fad-45bb-8683-0480cd85ac67 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73b9108d84c49338a37659e565e5370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b492f106f2f4cb9a89898e7f84702c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:42.826681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ba1e-9fad-45bb-8683-0480cd85ac67 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:42.827201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ba1e-9fad-45bb-8683-0480cd85ac67 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:42.827760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ba1e-9fad-45bb-8683-0480cd85ac67 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:42.828586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6ba1e-9fad-45bb-8683-0480cd85ac67 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:42.831329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6ba1e-9fad-45bb-8683-0480cd85ac67 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:42.867438 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1597/3159] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:57:42 2022] POST /identity/v3/users => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:42.868683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d06297-271d-4385-aad8-e646f91392aa tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:42.879272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d06297-271d-4385-aad8-e646f91392aa tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:42.884675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92314d-c65b-4a12-b4e8-fa92b3de9640 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73b9108d84c49338a37659e565e5370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b492f106f2f4cb9a89898e7f84702c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:42.885170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92314d-c65b-4a12-b4e8-fa92b3de9640 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:42.885480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92314d-c65b-4a12-b4e8-fa92b3de9640 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:42.885911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92314d-c65b-4a12-b4e8-fa92b3de9640 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:42.886616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92314d-c65b-4a12-b4e8-fa92b3de9640 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:57:42.887132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92314d-c65b-4a12-b4e8-fa92b3de9640 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:42.889413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92314d-c65b-4a12-b4e8-fa92b3de9640 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:42.905899 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1563/3160] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:57:43.353592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca4e55-87da-43d3-9d5f-cecc6a464c94 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:43.353879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca4e55-87da-43d3-9d5f-cecc6a464c94 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:43.354151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca4e55-87da-43d3-9d5f-cecc6a464c94 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:43.355487 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1598/3161] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:57:43.361169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92314d-c65b-4a12-b4e8-fa92b3de9640 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:57:43.364273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fd92314d-c65b-4a12-b4e8-fa92b3de9640 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:43.406409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92314d-c65b-4a12-b4e8-fa92b3de9640 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:43.430670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92314d-c65b-4a12-b4e8-fa92b3de9640 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:43.440300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b59c9-11cd-4845-abb9-2e0984fb3afc tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73b9108d84c49338a37659e565e5370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b492f106f2f4cb9a89898e7f84702c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:43.441415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b59c9-11cd-4845-abb9-2e0984fb3afc tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:43.441710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b59c9-11cd-4845-abb9-2e0984fb3afc tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:43.441984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b59c9-11cd-4845-abb9-2e0984fb3afc tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] PATH_INFO: `/v3/projects/c5a6c10b0c084c5bafadf90a0b8667f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:43.453179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b59c9-11cd-4845-abb9-2e0984fb3afc tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorizing `identity:get_project(project_id=c5a6c10b0c084c5bafadf90a0b8667f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:43.455433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b59c9-11cd-4845-abb9-2e0984fb3afc tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:43.462439 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1564/3162] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:57:43 2022] GET /identity/v3/projects/c5a6c10b0c084c5bafadf90a0b8667f4 => generated 371 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:57:44.498396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f8154-0140-4d92-affa-14aa7f8aa886 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:44.499287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f8154-0140-4d92-affa-14aa7f8aa886 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:44.499761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f8154-0140-4d92-affa-14aa7f8aa886 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:44.501134 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1599/3163] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:57:44.507302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b59c9-11cd-4845-abb9-2e0984fb3afc tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 20:57:44.520585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b59c9-11cd-4845-abb9-2e0984fb3afc tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:44.532436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b59c9-11cd-4845-abb9-2e0984fb3afc tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:44.538642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e4018-34c4-4535-9336-ec97a239ee81 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73b9108d84c49338a37659e565e5370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b492f106f2f4cb9a89898e7f84702c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:44.539457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e4018-34c4-4535-9336-ec97a239ee81 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:44.539801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e4018-34c4-4535-9336-ec97a239ee81 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:44.540083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e4018-34c4-4535-9336-ec97a239ee81 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] PATH_INFO: `/v3/projects/c5a6c10b0c084c5bafadf90a0b8667f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:44.541316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e4018-34c4-4535-9336-ec97a239ee81 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorizing `identity:get_project(project_id=c5a6c10b0c084c5bafadf90a0b8667f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:44.543401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e4018-34c4-4535-9336-ec97a239ee81 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:44.545135 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1565/3164] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 20:57:44 2022] GET /identity/v3/projects/c5a6c10b0c084c5bafadf90a0b8667f4 => generated 371 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:57:44.586478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f8154-0140-4d92-affa-14aa7f8aa886 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:44.601748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f8154-0140-4d92-affa-14aa7f8aa886 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:44.606664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73b9108d84c49338a37659e565e5370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b492f106f2f4cb9a89898e7f84702c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:44.607726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:44.608174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:44.608611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] PATH_INFO: `/v3/users/d1a8a7b2445349d88f5ee3d8fbb27029` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:44.628234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d1a8a7b2445349d88f5ee3d8fbb27029)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:44.631091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:44.704364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a8a7b2445349d88f5ee3d8fbb27029'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:44.718727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a8a7b2445349d88f5ee3d8fbb27029'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:44.733102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a8a7b2445349d88f5ee3d8fbb27029'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:44.745656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a8a7b2445349d88f5ee3d8fbb27029'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:44.784984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a8a7b2445349d88f5ee3d8fbb27029'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:44.787600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:44.813701 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1600/3165] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:57:44 2022] DELETE /identity/v3/users/d1a8a7b2445349d88f5ee3d8fbb27029 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:44.817866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e4018-34c4-4535-9336-ec97a239ee81 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:44.821553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-477e4018-34c4-4535-9336-ec97a239ee81 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:44.838464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e4018-34c4-4535-9336-ec97a239ee81 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:44.942869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfef4b-f1c4-4166-912c-cb78dc796800 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73b9108d84c49338a37659e565e5370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b492f106f2f4cb9a89898e7f84702c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:44.943548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfef4b-f1c4-4166-912c-cb78dc796800 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:44.943834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfef4b-f1c4-4166-912c-cb78dc796800 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:44.944113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfef4b-f1c4-4166-912c-cb78dc796800 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] PATH_INFO: `/v3/projects/c5a6c10b0c084c5bafadf90a0b8667f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:44.945881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfef4b-f1c4-4166-912c-cb78dc796800 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c5a6c10b0c084c5bafadf90a0b8667f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:44.947810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfef4b-f1c4-4166-912c-cb78dc796800 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:45.023962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-14cfef4b-f1c4-4166-912c-cb78dc796800 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a6c10b0c084c5bafadf90a0b8667f4', 'request_id': 'req-14cfef4b-f1c4-4166-912c-cb78dc796800'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:45.038099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-14cfef4b-f1c4-4166-912c-cb78dc796800 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a6c10b0c084c5bafadf90a0b8667f4', 'request_id': 'req-14cfef4b-f1c4-4166-912c-cb78dc796800'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:45.048528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-14cfef4b-f1c4-4166-912c-cb78dc796800 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a6c10b0c084c5bafadf90a0b8667f4', 'request_id': 'req-14cfef4b-f1c4-4166-912c-cb78dc796800'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:45.065405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-14cfef4b-f1c4-4166-912c-cb78dc796800 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] The token cache is being invalidate because project c5a6c10b0c084c5bafadf90a0b8667f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:57:45.067079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-14cfef4b-f1c4-4166-912c-cb78dc796800 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:45.068457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-14cfef4b-f1c4-4166-912c-cb78dc796800 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:45.071148 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1566/3166] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:57:44 2022] DELETE /identity/v3/projects/c5a6c10b0c084c5bafadf90a0b8667f4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:45.077491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:45.081431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:45.206536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446dc98-109b-4a77-ad4e-8866af80e884 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:45.309685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:45.310680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:45.311270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:45.311842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] PATH_INFO: `/v3/users/33df735b659c4f01911934003bb14858` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:45.314050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=33df735b659c4f01911934003bb14858)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:45.316735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:45.401386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33df735b659c4f01911934003bb14858'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:45.410424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33df735b659c4f01911934003bb14858'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:45.411330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33df735b659c4f01911934003bb14858'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:45.412681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33df735b659c4f01911934003bb14858'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:45.433143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33df735b659c4f01911934003bb14858'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:45.463622 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1601/3167] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:57:45 2022] DELETE /identity/v3/users/33df735b659c4f01911934003bb14858 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:57:45.468506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544bd7f-afe5-411a-97bf-b6dc56f6241a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:45.468807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544bd7f-afe5-411a-97bf-b6dc56f6241a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:45.469082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544bd7f-afe5-411a-97bf-b6dc56f6241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:45.512436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3544bd7f-afe5-411a-97bf-b6dc56f6241a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:45.513708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3544bd7f-afe5-411a-97bf-b6dc56f6241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:45.553946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:45.604669 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1567/3168] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:45.622742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:45.624503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:45.691761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:45.792449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30121b-265d-4ed8-8f63-627975996acb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:45.797273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa75a47-89d1-4ea9-8e28-14fd75eb88a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:45.798022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa75a47-89d1-4ea9-8e28-14fd75eb88a4 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:45.798354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa75a47-89d1-4ea9-8e28-14fd75eb88a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:45.798674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa75a47-89d1-4ea9-8e28-14fd75eb88a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:45.809698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa75a47-89d1-4ea9-8e28-14fd75eb88a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:45.811262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa75a47-89d1-4ea9-8e28-14fd75eb88a4 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:45.823628 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1602/3169] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:57:46.839276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544bd7f-afe5-411a-97bf-b6dc56f6241a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:46.841697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3544bd7f-afe5-411a-97bf-b6dc56f6241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:46.863045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544bd7f-afe5-411a-97bf-b6dc56f6241a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:46.903579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:46.906004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:46.917691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:46.920218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] PATH_INFO: `/v3/projects/c2abd858364046f6a47ae3c4438bb45c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:46.922853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2abd858364046f6a47ae3c4438bb45c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:46.928972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:47.080298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2abd858364046f6a47ae3c4438bb45c', 'request_id': 'req-522f03cf-9194-4154-99cb-2209b99d19f9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:47.097778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2abd858364046f6a47ae3c4438bb45c', 'request_id': 'req-522f03cf-9194-4154-99cb-2209b99d19f9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:47.108852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2abd858364046f6a47ae3c4438bb45c', 'request_id': 'req-522f03cf-9194-4154-99cb-2209b99d19f9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:47.128050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] The token cache is being invalidate because project c2abd858364046f6a47ae3c4438bb45c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:57:47.128831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:47.131796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:47.133950 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1568/3170] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:57:46 2022] DELETE /identity/v3/projects/c2abd858364046f6a47ae3c4438bb45c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:47.138645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa75a47-89d1-4ea9-8e28-14fd75eb88a4 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:47.157356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa75a47-89d1-4ea9-8e28-14fd75eb88a4 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:47.258463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f901a8d-cf7f-4ae8-8570-eb9d6fb03c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:47.259552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f901a8d-cf7f-4ae8-8570-eb9d6fb03c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:47.259552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f901a8d-cf7f-4ae8-8570-eb9d6fb03c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:47.259913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f901a8d-cf7f-4ae8-8570-eb9d6fb03c66 admin admin] PATH_INFO: `/v3/users/e73b9108d84c49338a37659e565e5370` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:47.261278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f901a8d-cf7f-4ae8-8570-eb9d6fb03c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73b9108d84c49338a37659e565e5370)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:47.263621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f901a8d-cf7f-4ae8-8570-eb9d6fb03c66 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:47.391167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f901a8d-cf7f-4ae8-8570-eb9d6fb03c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73b9108d84c49338a37659e565e5370'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:47.399916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f901a8d-cf7f-4ae8-8570-eb9d6fb03c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73b9108d84c49338a37659e565e5370'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:47.400649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f901a8d-cf7f-4ae8-8570-eb9d6fb03c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73b9108d84c49338a37659e565e5370'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:47.401481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f901a8d-cf7f-4ae8-8570-eb9d6fb03c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73b9108d84c49338a37659e565e5370'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:47.419141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f901a8d-cf7f-4ae8-8570-eb9d6fb03c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73b9108d84c49338a37659e565e5370'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:47.439950 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1603/3171] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:57:47 2022] DELETE /identity/v3/users/e73b9108d84c49338a37659e565e5370 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:48.000395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:48.002849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:48.032891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f03cf-9194-4154-99cb-2209b99d19f9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:48.151985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:48.153168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:48.153482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:48.153761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e admin admin] PATH_INFO: `/v3/projects/8b492f106f2f4cb9a89898e7f84702c7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:48.154939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b492f106f2f4cb9a89898e7f84702c7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:48.156911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:48.251707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b492f106f2f4cb9a89898e7f84702c7', 'request_id': 'req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:48.261138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b492f106f2f4cb9a89898e7f84702c7', 'request_id': 'req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:48.263890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:48.268715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b492f106f2f4cb9a89898e7f84702c7', 'request_id': 'req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:48.291650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e admin admin] The token cache is being invalidate because project 8b492f106f2f4cb9a89898e7f84702c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:57:48.292263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:48.293874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fdb54c34-f0ab-4a48-b655-e67e9ea8853e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:48.297505 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1569/3172] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:57:47 2022] DELETE /identity/v3/projects/8b492f106f2f4cb9a89898e7f84702c7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:48.304251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e23489-b157-4d96-81a9-61cc38446313 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:48.305513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e23489-b157-4d96-81a9-61cc38446313 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:48.305722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e23489-b157-4d96-81a9-61cc38446313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:48.327123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-37e23489-b157-4d96-81a9-61cc38446313 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:48.328880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-37e23489-b157-4d96-81a9-61cc38446313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:48.378689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:48.436559 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1604/3173] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:48.437878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b88ed-127b-4677-b904-672d7f49203e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:48.438170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b88ed-127b-4677-b904-672d7f49203e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:48.438476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b88ed-127b-4677-b904-672d7f49203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:48.477862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8f3b88ed-127b-4677-b904-672d7f49203e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:48.479271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8f3b88ed-127b-4677-b904-672d7f49203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:48.493432 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1570/3174] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:48.498480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e23489-b157-4d96-81a9-61cc38446313 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:48.514410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e23489-b157-4d96-81a9-61cc38446313 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:48.519122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b45e6-c29a-44da-97bf-5a72c02a51a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:48.520015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b45e6-c29a-44da-97bf-5a72c02a51a9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:48.520300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b45e6-c29a-44da-97bf-5a72c02a51a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:48.520576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b45e6-c29a-44da-97bf-5a72c02a51a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:48.521488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b45e6-c29a-44da-97bf-5a72c02a51a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:57:48.521798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b45e6-c29a-44da-97bf-5a72c02a51a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:48.523548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b45e6-c29a-44da-97bf-5a72c02a51a9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:48.540186 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1605/3175] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:57:48.541478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b88ed-127b-4677-b904-672d7f49203e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:48.552033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b88ed-127b-4677-b904-672d7f49203e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:48.559892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a0e17-a315-4233-b59a-8ae339d75844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:48.560512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a0e17-a315-4233-b59a-8ae339d75844 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:48.561232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a0e17-a315-4233-b59a-8ae339d75844 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:48.561232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a0e17-a315-4233-b59a-8ae339d75844 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:48.561700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a0e17-a315-4233-b59a-8ae339d75844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:48.563975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a0e17-a315-4233-b59a-8ae339d75844 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:48.597229 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1571/3176] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:57:48 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:48.601243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b45e6-c29a-44da-97bf-5a72c02a51a9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:48.612456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b45e6-c29a-44da-97bf-5a72c02a51a9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:48.702669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868484c7-6851-4753-aa4e-6e526ddd3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:48.703467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868484c7-6851-4753-aa4e-6e526ddd3deb admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:48.703754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868484c7-6851-4753-aa4e-6e526ddd3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:48.704150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868484c7-6851-4753-aa4e-6e526ddd3deb admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:48.704816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868484c7-6851-4753-aa4e-6e526ddd3deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:48.706883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868484c7-6851-4753-aa4e-6e526ddd3deb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:48.737795 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1606/3177] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:57:48 2022] POST /identity/v3/users => generated 305 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:48.739137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a0e17-a315-4233-b59a-8ae339d75844 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:48.751096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a0e17-a315-4233-b59a-8ae339d75844 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:48.758410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066a108-2e36-4a5c-9eff-acad78fdaea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:48.759095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066a108-2e36-4a5c-9eff-acad78fdaea8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:48.759443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066a108-2e36-4a5c-9eff-acad78fdaea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:48.759792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066a108-2e36-4a5c-9eff-acad78fdaea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:48.760574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066a108-2e36-4a5c-9eff-acad78fdaea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:48.762367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066a108-2e36-4a5c-9eff-acad78fdaea8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:48.777686 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1572/3178] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:57:48.781227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868484c7-6851-4753-aa4e-6e526ddd3deb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:48.792897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868484c7-6851-4753-aa4e-6e526ddd3deb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:48.799056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab07ae0-245d-4645-8675-0a11697f6eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:48.799681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab07ae0-245d-4645-8675-0a11697f6eee admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:48.800346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab07ae0-245d-4645-8675-0a11697f6eee admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:48.801236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab07ae0-245d-4645-8675-0a11697f6eee admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:48.801903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab07ae0-245d-4645-8675-0a11697f6eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:48.804172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab07ae0-245d-4645-8675-0a11697f6eee admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:48.817604 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1607/3179] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:57:48.823210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066a108-2e36-4a5c-9eff-acad78fdaea8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:48.833856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066a108-2e36-4a5c-9eff-acad78fdaea8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:48.840070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732523e8-571b-4fc2-b570-5e33819508e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:48.842086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732523e8-571b-4fc2-b570-5e33819508e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:48.842418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732523e8-571b-4fc2-b570-5e33819508e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:48.842774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732523e8-571b-4fc2-b570-5e33819508e3 admin admin] PATH_INFO: `/v3/projects/c39bfbba482642dcac3ecd4ae942c19c/users/245c5a9a9a7d4f2abdc3e3138305dc93/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:48.862797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732523e8-571b-4fc2-b570-5e33819508e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39bfbba482642dcac3ecd4ae942c19c, user_id=245c5a9a9a7d4f2abdc3e3138305dc93, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:48.868185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732523e8-571b-4fc2-b570-5e33819508e3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:48.892298 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1573/3180] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:57:48 2022] PUT /identity/v3/projects/c39bfbba482642dcac3ecd4ae942c19c/users/245c5a9a9a7d4f2abdc3e3138305dc93/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:48.898018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e74f61-7d6e-46e2-9010-93694c8a2fdc None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:48.898215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e74f61-7d6e-46e2-9010-93694c8a2fdc None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:48.898387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e74f61-7d6e-46e2-9010-93694c8a2fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:48.932792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-79e74f61-7d6e-46e2-9010-93694c8a2fdc None None] MFA Rules not processed for user `245c5a9a9a7d4f2abdc3e3138305dc93`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:48.934387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-79e74f61-7d6e-46e2-9010-93694c8a2fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:49.012497 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1608/3181] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:48 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:49.016726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732523e8-571b-4fc2-b570-5e33819508e3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:49.079307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732523e8-571b-4fc2-b570-5e33819508e3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:49.084760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718644dd-15c0-4733-8100-bc7e8abbd079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:49.085402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718644dd-15c0-4733-8100-bc7e8abbd079 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:49.085685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718644dd-15c0-4733-8100-bc7e8abbd079 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:49.085958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718644dd-15c0-4733-8100-bc7e8abbd079 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:49.086592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718644dd-15c0-4733-8100-bc7e8abbd079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:49.088511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718644dd-15c0-4733-8100-bc7e8abbd079 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:49.121395 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1574/3182] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:57:49 2022] POST /identity/v3/projects => generated 407 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:49.123115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e74f61-7d6e-46e2-9010-93694c8a2fdc None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:49.137236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e74f61-7d6e-46e2-9010-93694c8a2fdc None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:49.173476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:49.201523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e0298-e385-4f4b-b634-61795e2ac77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:49.202142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e0298-e385-4f4b-b634-61795e2ac77c admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:49.202420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e0298-e385-4f4b-b634-61795e2ac77c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:49.202686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e0298-e385-4f4b-b634-61795e2ac77c admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:49.203315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e0298-e385-4f4b-b634-61795e2ac77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:49.205232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e0298-e385-4f4b-b634-61795e2ac77c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:49.227870 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1609/3183] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:57:49 2022] POST /identity/v3/users => generated 310 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:49.231794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718644dd-15c0-4733-8100-bc7e8abbd079 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:49.243482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718644dd-15c0-4733-8100-bc7e8abbd079 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:49.248785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47b29c-fa01-4089-a292-fb421702910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:49.249700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47b29c-fa01-4089-a292-fb421702910e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:49.249984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47b29c-fa01-4089-a292-fb421702910e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:49.250559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47b29c-fa01-4089-a292-fb421702910e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:49.251055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47b29c-fa01-4089-a292-fb421702910e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:49.252810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47b29c-fa01-4089-a292-fb421702910e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:49.265857 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1575/3184] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:57:49.269877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e0298-e385-4f4b-b634-61795e2ac77c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:49.283526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e0298-e385-4f4b-b634-61795e2ac77c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:49.289854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f78f75-d1d6-46ee-a183-50e50e7e4c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:49.291154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f78f75-d1d6-46ee-a183-50e50e7e4c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:49.291539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f78f75-d1d6-46ee-a183-50e50e7e4c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:49.291973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f78f75-d1d6-46ee-a183-50e50e7e4c7b admin admin] PATH_INFO: `/v3/projects/b678b407eead4bd9b55532913c8b3901/users/50a5a20872c741e4b07e0eeb85da4191/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:49.313435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f78f75-d1d6-46ee-a183-50e50e7e4c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b678b407eead4bd9b55532913c8b3901, user_id=50a5a20872c741e4b07e0eeb85da4191, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:49.316707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f78f75-d1d6-46ee-a183-50e50e7e4c7b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:49.350068 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1610/3185] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:57:49 2022] PUT /identity/v3/projects/b678b407eead4bd9b55532913c8b3901/users/50a5a20872c741e4b07e0eeb85da4191/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:57:49.351902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47b29c-fa01-4089-a292-fb421702910e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:49.366440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47b29c-fa01-4089-a292-fb421702910e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:49.534920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:49.555901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499e095-b425-46dc-9e2c-a80d73a3dd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:49.556529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e095-b425-46dc-9e2c-a80d73a3dd10 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:49.556816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e095-b425-46dc-9e2c-a80d73a3dd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:49.557087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e095-b425-46dc-9e2c-a80d73a3dd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:49.557775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499e095-b425-46dc-9e2c-a80d73a3dd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:49.559363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499e095-b425-46dc-9e2c-a80d73a3dd10 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:49.572210 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1576/3186] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:57:49.576729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f78f75-d1d6-46ee-a183-50e50e7e4c7b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:49.590982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f78f75-d1d6-46ee-a183-50e50e7e4c7b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:49.602375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e6d61-918b-47d8-a827-0dcfcd510d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:49.603056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e6d61-918b-47d8-a827-0dcfcd510d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:49.603337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e6d61-918b-47d8-a827-0dcfcd510d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:49.603623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e6d61-918b-47d8-a827-0dcfcd510d33 admin admin] PATH_INFO: `/v3/projects/b678b407eead4bd9b55532913c8b3901/users/50a5a20872c741e4b07e0eeb85da4191/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:49.606794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e6d61-918b-47d8-a827-0dcfcd510d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b678b407eead4bd9b55532913c8b3901, user_id=50a5a20872c741e4b07e0eeb85da4191, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:49.609733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e6d61-918b-47d8-a827-0dcfcd510d33 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:49.641141 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1611/3187] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:57:49 2022] PUT /identity/v3/projects/b678b407eead4bd9b55532913c8b3901/users/50a5a20872c741e4b07e0eeb85da4191/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:57:49.653227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751adbe-8f89-4fb6-a6a3-2f827dc3f76c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:49.653227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751adbe-8f89-4fb6-a6a3-2f827dc3f76c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:49.653227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751adbe-8f89-4fb6-a6a3-2f827dc3f76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:49.700541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b751adbe-8f89-4fb6-a6a3-2f827dc3f76c None None] MFA Rules not processed for user `50a5a20872c741e4b07e0eeb85da4191`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:49.702030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b751adbe-8f89-4fb6-a6a3-2f827dc3f76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:49.884509 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1577/3188] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:49 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:49.893634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e6d61-918b-47d8-a827-0dcfcd510d33 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:50.050765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e6d61-918b-47d8-a827-0dcfcd510d33 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:50.056576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:50.057834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:50.058275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:50.058686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] PATH_INFO: `/v3/users/245c5a9a9a7d4f2abdc3e3138305dc93` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:50.059918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=245c5a9a9a7d4f2abdc3e3138305dc93)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:50.061939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:50.154956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245c5a9a9a7d4f2abdc3e3138305dc93'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:50.163432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245c5a9a9a7d4f2abdc3e3138305dc93'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:50.164278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245c5a9a9a7d4f2abdc3e3138305dc93'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:50.164959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245c5a9a9a7d4f2abdc3e3138305dc93'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:50.186276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245c5a9a9a7d4f2abdc3e3138305dc93'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:50.217592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1720a-c443-409a-b501-891906a49d2c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:50.218149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1720a-c443-409a-b501-891906a49d2c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:50.218149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1720a-c443-409a-b501-891906a49d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:50.221016 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1612/3189] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:57:49 2022] DELETE /identity/v3/users/245c5a9a9a7d4f2abdc3e3138305dc93 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:50.254615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5cf1720a-c443-409a-b501-891906a49d2c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:50.257605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5cf1720a-c443-409a-b501-891906a49d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:50.412938 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1578/3190] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:50.432792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:50.435071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:50.447974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:50.557106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfae8b6-2ca9-4a0d-93d7-4479e42d1260 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:50.561173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a30962-4970-4d5c-8351-bbba3ac0ef04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:50.561896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a30962-4970-4d5c-8351-bbba3ac0ef04 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:50.562714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a30962-4970-4d5c-8351-bbba3ac0ef04 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:50.562999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a30962-4970-4d5c-8351-bbba3ac0ef04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:50.575593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a30962-4970-4d5c-8351-bbba3ac0ef04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:50.578467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a30962-4970-4d5c-8351-bbba3ac0ef04 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:50.590883 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1613/3191] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:57:50.895290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1720a-c443-409a-b501-891906a49d2c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:50.898725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5cf1720a-c443-409a-b501-891906a49d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:50.917857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1720a-c443-409a-b501-891906a49d2c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:50.925603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:50.926613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:50.926973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:50.927555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] PATH_INFO: `/v3/projects/c39bfbba482642dcac3ecd4ae942c19c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:50.928997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39bfbba482642dcac3ecd4ae942c19c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:50.931084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:50.985263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39bfbba482642dcac3ecd4ae942c19c', 'request_id': 'req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:50.993473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39bfbba482642dcac3ecd4ae942c19c', 'request_id': 'req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:50.999598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39bfbba482642dcac3ecd4ae942c19c', 'request_id': 'req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:51.013006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] The token cache is being invalidate because project c39bfbba482642dcac3ecd4ae942c19c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:57:51.013427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:51.014083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:51.015622 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1579/3192] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:57:50 2022] DELETE /identity/v3/projects/c39bfbba482642dcac3ecd4ae942c19c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:51.020173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a30962-4970-4d5c-8351-bbba3ac0ef04 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:51.031772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a30962-4970-4d5c-8351-bbba3ac0ef04 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:51.115333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fc631-4024-4cfc-b914-1c94672c47d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:51.116296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc631-4024-4cfc-b914-1c94672c47d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:51.117467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc631-4024-4cfc-b914-1c94672c47d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:51.118084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc631-4024-4cfc-b914-1c94672c47d0 admin admin] PATH_INFO: `/v3/users/50a5a20872c741e4b07e0eeb85da4191` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:51.120099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fc631-4024-4cfc-b914-1c94672c47d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a5a20872c741e4b07e0eeb85da4191)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:51.122342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fc631-4024-4cfc-b914-1c94672c47d0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:51.219996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-599fc631-4024-4cfc-b914-1c94672c47d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a5a20872c741e4b07e0eeb85da4191'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:51.241603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-599fc631-4024-4cfc-b914-1c94672c47d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a5a20872c741e4b07e0eeb85da4191'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:51.242429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-599fc631-4024-4cfc-b914-1c94672c47d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a5a20872c741e4b07e0eeb85da4191'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:51.243949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-599fc631-4024-4cfc-b914-1c94672c47d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a5a20872c741e4b07e0eeb85da4191'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:51.277207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-599fc631-4024-4cfc-b914-1c94672c47d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a5a20872c741e4b07e0eeb85da4191'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:51.305515 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1614/3193] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:57:51 2022] DELETE /identity/v3/users/50a5a20872c741e4b07e0eeb85da4191 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:52.186704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:52.188469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:52.206128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:52.238980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28ecf2-1990-4e4c-b607-c457ec8d12ec admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:52.376674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d183c-94e5-4414-894c-671362fa4a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:52.378962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d183c-94e5-4414-894c-671362fa4a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:52.379340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d183c-94e5-4414-894c-671362fa4a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:52.381315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d183c-94e5-4414-894c-671362fa4a5f admin admin] PATH_INFO: `/v3/projects/b678b407eead4bd9b55532913c8b3901` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:52.383756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d183c-94e5-4414-894c-671362fa4a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b678b407eead4bd9b55532913c8b3901)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:52.387605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d183c-94e5-4414-894c-671362fa4a5f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:52.479304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e70d183c-94e5-4414-894c-671362fa4a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b678b407eead4bd9b55532913c8b3901', 'request_id': 'req-e70d183c-94e5-4414-894c-671362fa4a5f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:52.498626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e70d183c-94e5-4414-894c-671362fa4a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b678b407eead4bd9b55532913c8b3901', 'request_id': 'req-e70d183c-94e5-4414-894c-671362fa4a5f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:52.510467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e70d183c-94e5-4414-894c-671362fa4a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b678b407eead4bd9b55532913c8b3901', 'request_id': 'req-e70d183c-94e5-4414-894c-671362fa4a5f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:52.533101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e70d183c-94e5-4414-894c-671362fa4a5f admin admin] The token cache is being invalidate because project b678b407eead4bd9b55532913c8b3901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:57:52.533525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e70d183c-94e5-4414-894c-671362fa4a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:52.534210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e70d183c-94e5-4414-894c-671362fa4a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:57:52.543663 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1580/3194] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:57:52 2022] DELETE /identity/v3/projects/b678b407eead4bd9b55532913c8b3901 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:52.545411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cefeb5-5369-47f6-ace2-90839c445204 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:52.546212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cefeb5-5369-47f6-ace2-90839c445204 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:52.546685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cefeb5-5369-47f6-ace2-90839c445204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:52.585320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-67cefeb5-5369-47f6-ace2-90839c445204 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:52.587204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-67cefeb5-5369-47f6-ace2-90839c445204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:52.617344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:52.666648 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1615/3195] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:52.674528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b271d-dab5-4798-a210-8af4b867b2fb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:52.675561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b271d-dab5-4798-a210-8af4b867b2fb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:52.675561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b271d-dab5-4798-a210-8af4b867b2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:52.706587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-383b271d-dab5-4798-a210-8af4b867b2fb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:52.708923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-383b271d-dab5-4798-a210-8af4b867b2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:52.725800 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1581/3196] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:52.730169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cefeb5-5369-47f6-ace2-90839c445204 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:52.751832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cefeb5-5369-47f6-ace2-90839c445204 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:52.759559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deb77e-0920-4818-be39-1cf092c7f316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:52.760364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deb77e-0920-4818-be39-1cf092c7f316 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:52.760709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deb77e-0920-4818-be39-1cf092c7f316 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:52.761002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deb77e-0920-4818-be39-1cf092c7f316 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:52.761749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06deb77e-0920-4818-be39-1cf092c7f316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:57:52.762163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06deb77e-0920-4818-be39-1cf092c7f316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:52.764971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06deb77e-0920-4818-be39-1cf092c7f316 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:52.788218 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1616/3197] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:57:52.792819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b271d-dab5-4798-a210-8af4b867b2fb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:52.803882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b271d-dab5-4798-a210-8af4b867b2fb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:52.809172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c1ebf-1e1b-4c70-b1e6-7bfc2461c6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:52.809959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c1ebf-1e1b-4c70-b1e6-7bfc2461c6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:52.810446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c1ebf-1e1b-4c70-b1e6-7bfc2461c6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:52.810822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c1ebf-1e1b-4c70-b1e6-7bfc2461c6b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:52.811706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c1ebf-1e1b-4c70-b1e6-7bfc2461c6b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:52.814158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c1ebf-1e1b-4c70-b1e6-7bfc2461c6b2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:52.852636 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1582/3198] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:57:52 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:52.853612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deb77e-0920-4818-be39-1cf092c7f316 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:52.866167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deb77e-0920-4818-be39-1cf092c7f316 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:52.934913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ecd80-63ea-4797-99a6-a78d0110e2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:52.935799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ecd80-63ea-4797-99a6-a78d0110e2fa admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:52.936240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ecd80-63ea-4797-99a6-a78d0110e2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:52.936669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ecd80-63ea-4797-99a6-a78d0110e2fa admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:52.937511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ecd80-63ea-4797-99a6-a78d0110e2fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:52.939657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ecd80-63ea-4797-99a6-a78d0110e2fa admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:52.971217 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1617/3199] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:57:52 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:57:52.971532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c1ebf-1e1b-4c70-b1e6-7bfc2461c6b2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:52.983733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c1ebf-1e1b-4c70-b1e6-7bfc2461c6b2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:52.988834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303a9d7-dab3-4a1f-804f-3962369ecc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:52.990612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303a9d7-dab3-4a1f-804f-3962369ecc76 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:52.990612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303a9d7-dab3-4a1f-804f-3962369ecc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:52.990612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303a9d7-dab3-4a1f-804f-3962369ecc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:52.991252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303a9d7-dab3-4a1f-804f-3962369ecc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:52.992832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303a9d7-dab3-4a1f-804f-3962369ecc76 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:53.006866 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1583/3200] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:57:53.008626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ecd80-63ea-4797-99a6-a78d0110e2fa admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:53.024231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ecd80-63ea-4797-99a6-a78d0110e2fa admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:53.035722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0171c-d44a-4dd0-8fbd-34efd5ba33fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:53.038904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0171c-d44a-4dd0-8fbd-34efd5ba33fb admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:53.039987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0171c-d44a-4dd0-8fbd-34efd5ba33fb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:53.040211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0171c-d44a-4dd0-8fbd-34efd5ba33fb admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:53.040991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0171c-d44a-4dd0-8fbd-34efd5ba33fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:53.044749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0171c-d44a-4dd0-8fbd-34efd5ba33fb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:53.078488 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1618/3201] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:57:53.079454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303a9d7-dab3-4a1f-804f-3962369ecc76 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:53.092446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303a9d7-dab3-4a1f-804f-3962369ecc76 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:53.102047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52778f-db03-48a5-99b6-02f554293d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:53.102047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52778f-db03-48a5-99b6-02f554293d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:53.102047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52778f-db03-48a5-99b6-02f554293d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:53.102047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52778f-db03-48a5-99b6-02f554293d0d admin admin] PATH_INFO: `/v3/projects/8472b054404c46a99b81aba34d6b9f40/users/67ddc3cd3c374bacbe5bf5e0877380e2/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:53.122127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52778f-db03-48a5-99b6-02f554293d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8472b054404c46a99b81aba34d6b9f40, user_id=67ddc3cd3c374bacbe5bf5e0877380e2, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:53.124924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52778f-db03-48a5-99b6-02f554293d0d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:53.145154 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1584/3202] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:57:53 2022] PUT /identity/v3/projects/8472b054404c46a99b81aba34d6b9f40/users/67ddc3cd3c374bacbe5bf5e0877380e2/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:53.218318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b5bd5-4ba5-477a-b82c-cbbb1daa21de None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:53.218639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b5bd5-4ba5-477a-b82c-cbbb1daa21de None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:53.219603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b5bd5-4ba5-477a-b82c-cbbb1daa21de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:53.249711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-228b5bd5-4ba5-477a-b82c-cbbb1daa21de None None] MFA Rules not processed for user `67ddc3cd3c374bacbe5bf5e0877380e2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:53.251021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-228b5bd5-4ba5-477a-b82c-cbbb1daa21de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:53.355878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52778f-db03-48a5-99b6-02f554293d0d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:53.356573 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1619/3203] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:53.438364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:53.525754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52778f-db03-48a5-99b6-02f554293d0d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:53.533283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcae25-b3b6-4948-ac0b-fce9d8cb2166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:53.534201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcae25-b3b6-4948-ac0b-fce9d8cb2166 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:53.535061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcae25-b3b6-4948-ac0b-fce9d8cb2166 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:53.535535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcae25-b3b6-4948-ac0b-fce9d8cb2166 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:53.536753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcae25-b3b6-4948-ac0b-fce9d8cb2166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:53.539557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcae25-b3b6-4948-ac0b-fce9d8cb2166 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:53.587674 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1585/3204] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:57:53 2022] POST /identity/v3/projects => generated 381 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:57:53.589511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b5bd5-4ba5-477a-b82c-cbbb1daa21de None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:53.607140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b5bd5-4ba5-477a-b82c-cbbb1daa21de None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:53.636358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:53.681928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a340314-38d9-40d4-844a-36d3c0fde59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:53.682462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a340314-38d9-40d4-844a-36d3c0fde59a admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:53.683077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a340314-38d9-40d4-844a-36d3c0fde59a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:53.683358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a340314-38d9-40d4-844a-36d3c0fde59a admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:53.684004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a340314-38d9-40d4-844a-36d3c0fde59a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:53.685960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a340314-38d9-40d4-844a-36d3c0fde59a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:53.711742 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1620/3205] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:57:53 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:57:53.715788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcae25-b3b6-4948-ac0b-fce9d8cb2166 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:53.728728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcae25-b3b6-4948-ac0b-fce9d8cb2166 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:53.734269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50b907-d192-4a5a-8480-db1dfb12e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:53.734879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50b907-d192-4a5a-8480-db1dfb12e98a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:53.735181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50b907-d192-4a5a-8480-db1dfb12e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:53.735706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50b907-d192-4a5a-8480-db1dfb12e98a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:53.736360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50b907-d192-4a5a-8480-db1dfb12e98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:53.738118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50b907-d192-4a5a-8480-db1dfb12e98a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:53.750418 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1586/3206] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:57:53.758703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a340314-38d9-40d4-844a-36d3c0fde59a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:53.779300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a340314-38d9-40d4-844a-36d3c0fde59a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:53.785998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2c79d-3145-4e7f-9f30-f236a318094e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:53.787359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2c79d-3145-4e7f-9f30-f236a318094e admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:53.787745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2c79d-3145-4e7f-9f30-f236a318094e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:53.788189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2c79d-3145-4e7f-9f30-f236a318094e admin admin] PATH_INFO: `/v3/projects/e137b8738e66438297ac69c3769b28b4/users/f839a4674f1b4b94a0783ccf8882dca6/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:53.811597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2c79d-3145-4e7f-9f30-f236a318094e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e137b8738e66438297ac69c3769b28b4, user_id=f839a4674f1b4b94a0783ccf8882dca6, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:53.814773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2c79d-3145-4e7f-9f30-f236a318094e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:53.842010 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1621/3207] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:57:53 2022] PUT /identity/v3/projects/e137b8738e66438297ac69c3769b28b4/users/f839a4674f1b4b94a0783ccf8882dca6/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:53.846010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50b907-d192-4a5a-8480-db1dfb12e98a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:53.858354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50b907-d192-4a5a-8480-db1dfb12e98a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:53.948994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81469555-89a6-4393-a47f-aca1e2d58a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:53.949701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81469555-89a6-4393-a47f-aca1e2d58a51 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:53.949986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81469555-89a6-4393-a47f-aca1e2d58a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:53.950266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81469555-89a6-4393-a47f-aca1e2d58a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:53.950929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81469555-89a6-4393-a47f-aca1e2d58a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:53.952612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81469555-89a6-4393-a47f-aca1e2d58a51 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:53.968169 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1587/3208] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:57:53.969395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2c79d-3145-4e7f-9f30-f236a318094e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:53.982979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2c79d-3145-4e7f-9f30-f236a318094e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:53.988244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75ccef-ee67-4173-81e9-59990cd8b0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:53.988919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75ccef-ee67-4173-81e9-59990cd8b0c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:53.989830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75ccef-ee67-4173-81e9-59990cd8b0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:53.990115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75ccef-ee67-4173-81e9-59990cd8b0c5 admin admin] PATH_INFO: `/v3/projects/e137b8738e66438297ac69c3769b28b4/users/f839a4674f1b4b94a0783ccf8882dca6/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:53.992315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75ccef-ee67-4173-81e9-59990cd8b0c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e137b8738e66438297ac69c3769b28b4, user_id=f839a4674f1b4b94a0783ccf8882dca6, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:53.995469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75ccef-ee67-4173-81e9-59990cd8b0c5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:54.021692 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1622/3209] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:57:53 2022] PUT /identity/v3/projects/e137b8738e66438297ac69c3769b28b4/users/f839a4674f1b4b94a0783ccf8882dca6/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:57:54.023557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adfa4c-be67-40ed-8943-e81d7d5daa02 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:54.023855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adfa4c-be67-40ed-8943-e81d7d5daa02 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:54.024237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adfa4c-be67-40ed-8943-e81d7d5daa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:54.057309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d5adfa4c-be67-40ed-8943-e81d7d5daa02 None None] MFA Rules not processed for user `f839a4674f1b4b94a0783ccf8882dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:54.058635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d5adfa4c-be67-40ed-8943-e81d7d5daa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:54.181149 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1588/3210] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:54.196342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec55e04-5b88-4f93-9399-8fa75117fb82 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:54.196702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec55e04-5b88-4f93-9399-8fa75117fb82 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:54.196914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec55e04-5b88-4f93-9399-8fa75117fb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:54.220739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7ec55e04-5b88-4f93-9399-8fa75117fb82 None None] MFA Rules not processed for user `67ddc3cd3c374bacbe5bf5e0877380e2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:57:54.221898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7ec55e04-5b88-4f93-9399-8fa75117fb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:54.312269 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1623/3211] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:57:54.398665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adfa4c-be67-40ed-8943-e81d7d5daa02 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:57:54.401370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d5adfa4c-be67-40ed-8943-e81d7d5daa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:57:54.439659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:54.509245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adfa4c-be67-40ed-8943-e81d7d5daa02 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:57:54.516651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91193336-7e28-4ff5-8919-9b37afb54ca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:57:54.517667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91193336-7e28-4ff5-8919-9b37afb54ca9 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:57:54.518838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91193336-7e28-4ff5-8919-9b37afb54ca9 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:57:54.519344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91193336-7e28-4ff5-8919-9b37afb54ca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:57:54.531682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91193336-7e28-4ff5-8919-9b37afb54ca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:57:54.533710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91193336-7e28-4ff5-8919-9b37afb54ca9 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:57:54.545584 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1589/3212] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:57:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:58:00.654604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec55e04-5b88-4f93-9399-8fa75117fb82 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:00.685039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec55e04-5b88-4f93-9399-8fa75117fb82 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:00.691263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbac801-2c23-47ed-bae4-6c98474e3dd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:00.693260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbac801-2c23-47ed-bae4-6c98474e3dd7 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:00.695122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbac801-2c23-47ed-bae4-6c98474e3dd7 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:00.695122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbac801-2c23-47ed-bae4-6c98474e3dd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:00.699919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4bbac801-2c23-47ed-bae4-6c98474e3dd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:00.802764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbac801-2c23-47ed-bae4-6c98474e3dd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:00.804776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbac801-2c23-47ed-bae4-6c98474e3dd7 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:00.822668 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1624/3213] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:58:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:58:04.540728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=23 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:04.731010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360f0c4-e6c5-4aa8-b361-a8f2841fe8e3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:04.731300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360f0c4-e6c5-4aa8-b361-a8f2841fe8e3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:04.731576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360f0c4-e6c5-4aa8-b361-a8f2841fe8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:04.752104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1360f0c4-e6c5-4aa8-b361-a8f2841fe8e3 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:04.753345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1360f0c4-e6c5-4aa8-b361-a8f2841fe8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:04.813660 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1590/3214] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:58:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:04.864197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbac801-2c23-47ed-bae4-6c98474e3dd7 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:04.865658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4bbac801-2c23-47ed-bae4-6c98474e3dd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:04.888284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:04.939370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbac801-2c23-47ed-bae4-6c98474e3dd7 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:04.945270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15f6f7-f49f-4838-9f32-4b31f54c954a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:04.946764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f6f7-f49f-4838-9f32-4b31f54c954a service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:04.946764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f6f7-f49f-4838-9f32-4b31f54c954a service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:04.946764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f6f7-f49f-4838-9f32-4b31f54c954a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:04.955789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15f6f7-f49f-4838-9f32-4b31f54c954a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:04.958448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15f6f7-f49f-4838-9f32-4b31f54c954a service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:04.966898 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1625/3215] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:58:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:58:09.844465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360f0c4-e6c5-4aa8-b361-a8f2841fe8e3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:09.847376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1360f0c4-e6c5-4aa8-b361-a8f2841fe8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:09.973735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360f0c4-e6c5-4aa8-b361-a8f2841fe8e3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:09.978520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5ef2c-292c-4d9d-a0c1-2948e7f83de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:09.979476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5ef2c-292c-4d9d-a0c1-2948e7f83de0 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:09.980220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5ef2c-292c-4d9d-a0c1-2948e7f83de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:09.980556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5ef2c-292c-4d9d-a0c1-2948e7f83de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:09.983984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d9a5ef2c-292c-4d9d-a0c1-2948e7f83de0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:10.209917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5ef2c-292c-4d9d-a0c1-2948e7f83de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:10.214827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5ef2c-292c-4d9d-a0c1-2948e7f83de0 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:10.265681 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1591/3216] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:58:10.655006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15f6f7-f49f-4838-9f32-4b31f54c954a service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:10.657712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4f15f6f7-f49f-4838-9f32-4b31f54c954a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:10.712807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15f6f7-f49f-4838-9f32-4b31f54c954a service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:10.721545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0136de-aca8-4c6f-b28e-bd90585b34be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:10.722610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0136de-aca8-4c6f-b28e-bd90585b34be service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:10.723696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0136de-aca8-4c6f-b28e-bd90585b34be service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:10.724216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0136de-aca8-4c6f-b28e-bd90585b34be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:10.755097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0136de-aca8-4c6f-b28e-bd90585b34be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:10.758708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0136de-aca8-4c6f-b28e-bd90585b34be service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:10.794666 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1626/3217] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:58:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:58:11.046414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5ef2c-292c-4d9d-a0c1-2948e7f83de0 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:11.048484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d9a5ef2c-292c-4d9d-a0c1-2948e7f83de0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:11.070064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5ef2c-292c-4d9d-a0c1-2948e7f83de0 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:11.085883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:11.086566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:11.087075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:11.087595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] PATH_INFO: `/v3/users/5ac1323815364df4a3a4d4dbbb9d70dd` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:11.089156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac1323815364df4a3a4d4dbbb9d70dd)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:11.091637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:11.195480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac1323815364df4a3a4d4dbbb9d70dd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:11.202101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:11.213983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac1323815364df4a3a4d4dbbb9d70dd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:11.214825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac1323815364df4a3a4d4dbbb9d70dd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:11.221705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac1323815364df4a3a4d4dbbb9d70dd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:11.258245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac1323815364df4a3a4d4dbbb9d70dd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:11.288218 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1592/3218] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:58:11 2022] DELETE /identity/v3/users/5ac1323815364df4a3a4d4dbbb9d70dd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:58:11.738354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e0af2-42b7-43fc-8837-ac6a764997c2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:11.738901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e0af2-42b7-43fc-8837-ac6a764997c2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:11.739047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e0af2-42b7-43fc-8837-ac6a764997c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:11.760759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:11.762566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:11.764117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0a4e0af2-42b7-43fc-8837-ac6a764997c2 None None] MFA Rules not processed for user `67ddc3cd3c374bacbe5bf5e0877380e2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:11.765920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0a4e0af2-42b7-43fc-8837-ac6a764997c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:11.865505 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1627/3219] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:11.918594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5268da9-525e-4ed3-9a86-8dc2c23dcf51 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:11.925167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d8389-0512-4f8f-84b1-9463a3d533cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:11.926436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d8389-0512-4f8f-84b1-9463a3d533cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:11.926999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d8389-0512-4f8f-84b1-9463a3d533cc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:11.927752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d8389-0512-4f8f-84b1-9463a3d533cc admin admin] PATH_INFO: `/v3/projects/1be94d02ab5244f98337fb9b90e74746` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:11.928925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d8389-0512-4f8f-84b1-9463a3d533cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be94d02ab5244f98337fb9b90e74746)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:11.931522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d8389-0512-4f8f-84b1-9463a3d533cc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:12.030543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b87d8389-0512-4f8f-84b1-9463a3d533cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be94d02ab5244f98337fb9b90e74746', 'request_id': 'req-b87d8389-0512-4f8f-84b1-9463a3d533cc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:12.041035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b87d8389-0512-4f8f-84b1-9463a3d533cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be94d02ab5244f98337fb9b90e74746', 'request_id': 'req-b87d8389-0512-4f8f-84b1-9463a3d533cc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:12.054198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b87d8389-0512-4f8f-84b1-9463a3d533cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be94d02ab5244f98337fb9b90e74746', 'request_id': 'req-b87d8389-0512-4f8f-84b1-9463a3d533cc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:12.074504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b87d8389-0512-4f8f-84b1-9463a3d533cc admin admin] The token cache is being invalidate because project 1be94d02ab5244f98337fb9b90e74746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:58:12.075096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b87d8389-0512-4f8f-84b1-9463a3d533cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:12.076868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b87d8389-0512-4f8f-84b1-9463a3d533cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:12.080930 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1593/3220] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:11 2022] DELETE /identity/v3/projects/1be94d02ab5244f98337fb9b90e74746 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:58:12.087067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9889-c442-4e16-ae90-8be156c60b24 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:12.087632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9889-c442-4e16-ae90-8be156c60b24 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:12.088160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9889-c442-4e16-ae90-8be156c60b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:12.121098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bf5e9889-c442-4e16-ae90-8be156c60b24 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:12.122785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bf5e9889-c442-4e16-ae90-8be156c60b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:12.218680 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1628/3221] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:12.227980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca543b-38f1-4ae2-b430-df07f7c878b4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:12.228878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca543b-38f1-4ae2-b430-df07f7c878b4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:12.228878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca543b-38f1-4ae2-b430-df07f7c878b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:12.254492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4dca543b-38f1-4ae2-b430-df07f7c878b4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:12.257148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4dca543b-38f1-4ae2-b430-df07f7c878b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:12.272451 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1594/3222] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:12.273475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9889-c442-4e16-ae90-8be156c60b24 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:12.291503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9889-c442-4e16-ae90-8be156c60b24 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:12.304448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7bb21-fe00-48d6-a7c5-5308a0d51e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:12.305305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7bb21-fe00-48d6-a7c5-5308a0d51e59 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:12.305674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7bb21-fe00-48d6-a7c5-5308a0d51e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:12.306026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7bb21-fe00-48d6-a7c5-5308a0d51e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:12.310058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7bb21-fe00-48d6-a7c5-5308a0d51e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:58:12.310453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7bb21-fe00-48d6-a7c5-5308a0d51e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:12.316845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7bb21-fe00-48d6-a7c5-5308a0d51e59 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:12.357950 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1629/3223] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:58:12.359453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca543b-38f1-4ae2-b430-df07f7c878b4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:12.376883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca543b-38f1-4ae2-b430-df07f7c878b4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:12.400257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf1379-73a8-48fa-b8a9-a6ddb4303bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:12.401017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf1379-73a8-48fa-b8a9-a6ddb4303bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:12.401625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf1379-73a8-48fa-b8a9-a6ddb4303bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:12.402086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf1379-73a8-48fa-b8a9-a6ddb4303bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:12.402896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf1379-73a8-48fa-b8a9-a6ddb4303bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:12.405064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf1379-73a8-48fa-b8a9-a6ddb4303bd5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:12.500542 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1595/3224] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:58:12 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:58:12.509003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7bb21-fe00-48d6-a7c5-5308a0d51e59 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:12.527391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7bb21-fe00-48d6-a7c5-5308a0d51e59 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:12.568343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:12.610590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a55ac1-9358-42a2-b6cb-ed909ad0aeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:12.610590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a55ac1-9358-42a2-b6cb-ed909ad0aeec admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:12.610590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a55ac1-9358-42a2-b6cb-ed909ad0aeec admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:12.610590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a55ac1-9358-42a2-b6cb-ed909ad0aeec admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:12.611113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a55ac1-9358-42a2-b6cb-ed909ad0aeec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:12.612704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a55ac1-9358-42a2-b6cb-ed909ad0aeec admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:12.655492 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1630/3225] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:58:12 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:58:12.658130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf1379-73a8-48fa-b8a9-a6ddb4303bd5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:12.671134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf1379-73a8-48fa-b8a9-a6ddb4303bd5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:12.678055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d0312-ebfe-42b1-a268-959a6ac0dcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:12.678769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d0312-ebfe-42b1-a268-959a6ac0dcba admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:12.678924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d0312-ebfe-42b1-a268-959a6ac0dcba admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:12.679205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d0312-ebfe-42b1-a268-959a6ac0dcba admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:12.679858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d0312-ebfe-42b1-a268-959a6ac0dcba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:12.681504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d0312-ebfe-42b1-a268-959a6ac0dcba admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:12.702154 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1596/3226] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:58:12.706019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a55ac1-9358-42a2-b6cb-ed909ad0aeec admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:12.758727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a55ac1-9358-42a2-b6cb-ed909ad0aeec admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:12.772569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912714b4-4ff6-4e2b-9002-ef604a915fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:12.773879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912714b4-4ff6-4e2b-9002-ef604a915fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:12.774169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912714b4-4ff6-4e2b-9002-ef604a915fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:12.774447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912714b4-4ff6-4e2b-9002-ef604a915fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:12.775311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912714b4-4ff6-4e2b-9002-ef604a915fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:12.782027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912714b4-4ff6-4e2b-9002-ef604a915fa7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:12.807130 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1631/3227] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:58:12.808479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d0312-ebfe-42b1-a268-959a6ac0dcba admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:12.822977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d0312-ebfe-42b1-a268-959a6ac0dcba admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:12.828330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd397ca-fb14-4bc1-ae3d-f3147dde59fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:12.828996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd397ca-fb14-4bc1-ae3d-f3147dde59fd admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:12.829336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd397ca-fb14-4bc1-ae3d-f3147dde59fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:12.829618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd397ca-fb14-4bc1-ae3d-f3147dde59fd admin admin] PATH_INFO: `/v3/projects/a82999f8bc36455bafd8eed23c68e733/users/3d96135705514061bef9306753143357/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:12.868806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd397ca-fb14-4bc1-ae3d-f3147dde59fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a82999f8bc36455bafd8eed23c68e733, user_id=3d96135705514061bef9306753143357, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:12.872187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd397ca-fb14-4bc1-ae3d-f3147dde59fd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:12.875183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:13.006806 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1597/3228] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:58:12 2022] PUT /identity/v3/projects/a82999f8bc36455bafd8eed23c68e733/users/3d96135705514061bef9306753143357/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:58:13.008015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab534be-72fc-489c-a259-e8ee8c20d1b3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:13.008308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab534be-72fc-489c-a259-e8ee8c20d1b3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:13.008585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab534be-72fc-489c-a259-e8ee8c20d1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:13.094277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-eab534be-72fc-489c-a259-e8ee8c20d1b3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:13.097943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eab534be-72fc-489c-a259-e8ee8c20d1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:13.300355 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1632/3229] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:58:13.357372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd397ca-fb14-4bc1-ae3d-f3147dde59fd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:13.360395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7fd397ca-fb14-4bc1-ae3d-f3147dde59fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:13.604618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd397ca-fb14-4bc1-ae3d-f3147dde59fd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:13.610353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a68f91-876a-477b-9d16-0553ad40721f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:13.611222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a68f91-876a-477b-9d16-0553ad40721f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:13.611699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a68f91-876a-477b-9d16-0553ad40721f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:13.612272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a68f91-876a-477b-9d16-0553ad40721f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:13.638016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a68f91-876a-477b-9d16-0553ad40721f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:13.639596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a68f91-876a-477b-9d16-0553ad40721f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:13.653493 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1598/3230] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:58:23.277226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=48,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:23.647044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:29.832502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2813a96-75ed-409e-9503-26635d055a02 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:29.833120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2813a96-75ed-409e-9503-26635d055a02 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:29.833258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2813a96-75ed-409e-9503-26635d055a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:29.889272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f2813a96-75ed-409e-9503-26635d055a02 None None] MFA Rules not processed for user `3d96135705514061bef9306753143357`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:29.890991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f2813a96-75ed-409e-9503-26635d055a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:29.985786 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1633/3231] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:31.226594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a68f91-876a-477b-9d16-0553ad40721f service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:31.231672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-15a68f91-876a-477b-9d16-0553ad40721f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:31.376742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a68f91-876a-477b-9d16-0553ad40721f service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:31.386287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20df2ef-d113-4dd5-9a93-ee5c96eb639a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:31.387151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20df2ef-d113-4dd5-9a93-ee5c96eb639a service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:31.387738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20df2ef-d113-4dd5-9a93-ee5c96eb639a service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:31.388296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20df2ef-d113-4dd5-9a93-ee5c96eb639a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:31.403385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20df2ef-d113-4dd5-9a93-ee5c96eb639a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:31.406395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20df2ef-d113-4dd5-9a93-ee5c96eb639a service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:31.425062 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1599/3232] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:58:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:58:32.701336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2813a96-75ed-409e-9503-26635d055a02 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:32.703480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f2813a96-75ed-409e-9503-26635d055a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:32.741226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2813a96-75ed-409e-9503-26635d055a02 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:32.751455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cb46d-7c63-4e77-8b1d-cd18547f4f14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:32.752361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cb46d-7c63-4e77-8b1d-cd18547f4f14 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:32.753377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cb46d-7c63-4e77-8b1d-cd18547f4f14 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:32.753820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cb46d-7c63-4e77-8b1d-cd18547f4f14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:32.755986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d88cb46d-7c63-4e77-8b1d-cd18547f4f14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:32.847342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cb46d-7c63-4e77-8b1d-cd18547f4f14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:32.861395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cb46d-7c63-4e77-8b1d-cd18547f4f14 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:32.878445 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1634/3233] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:58:32 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:58:33.663980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe72c5-f2dc-4711-ad98-58501de58e34 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:33.665127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe72c5-f2dc-4711-ad98-58501de58e34 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:33.667116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe72c5-f2dc-4711-ad98-58501de58e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:33.739007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3cbe72c5-f2dc-4711-ad98-58501de58e34 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:33.740551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3cbe72c5-f2dc-4711-ad98-58501de58e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:33.904466 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1600/3234] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:33.920628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cb46d-7c63-4e77-8b1d-cd18547f4f14 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:33.923814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d88cb46d-7c63-4e77-8b1d-cd18547f4f14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:34.082312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cb46d-7c63-4e77-8b1d-cd18547f4f14 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:34.097023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf4d9b-90a9-4294-b284-5318c6585090 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:34.097977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf4d9b-90a9-4294-b284-5318c6585090 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:34.098498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf4d9b-90a9-4294-b284-5318c6585090 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:34.099028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf4d9b-90a9-4294-b284-5318c6585090 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:34.128802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf4d9b-90a9-4294-b284-5318c6585090 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:34.130818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf4d9b-90a9-4294-b284-5318c6585090 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:34.159424 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1635/3235] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:58:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:58:35.196272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe72c5-f2dc-4711-ad98-58501de58e34 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:35.207893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe72c5-f2dc-4711-ad98-58501de58e34 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:35.213790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443b784-4852-410f-8864-3f7f33db6ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:35.215418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443b784-4852-410f-8864-3f7f33db6ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:35.216007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443b784-4852-410f-8864-3f7f33db6ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:35.216540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443b784-4852-410f-8864-3f7f33db6ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:35.219019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c443b784-4852-410f-8864-3f7f33db6ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:35.231430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443b784-4852-410f-8864-3f7f33db6ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:35.233475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443b784-4852-410f-8864-3f7f33db6ad6 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:35.257316 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1601/3236] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:58:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:58:35.650098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf4d9b-90a9-4294-b284-5318c6585090 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:35.652534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dfdf4d9b-90a9-4294-b284-5318c6585090 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:35.676654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf4d9b-90a9-4294-b284-5318c6585090 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:35.684772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:35.685922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:35.686592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:35.687171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] PATH_INFO: `/v3/users/474ca64d1b1d4e30916b517645aba882` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:35.689263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=474ca64d1b1d4e30916b517645aba882)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:35.710934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:35.733211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:35.800925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474ca64d1b1d4e30916b517645aba882'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:35.812037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474ca64d1b1d4e30916b517645aba882'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:35.812805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474ca64d1b1d4e30916b517645aba882'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:35.813865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474ca64d1b1d4e30916b517645aba882'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:35.837259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474ca64d1b1d4e30916b517645aba882'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:35.863443 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1636/3237] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:58:35 2022] DELETE /identity/v3/users/474ca64d1b1d4e30916b517645aba882 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:58:36.392092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443b784-4852-410f-8864-3f7f33db6ad6 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:36.412919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443b784-4852-410f-8864-3f7f33db6ad6 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:36.563960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:36.564604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:36.564909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:36.565731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8 admin admin] PATH_INFO: `/v3/projects/6ecc2dd2407b4819874bed09cb27959a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:36.569350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ecc2dd2407b4819874bed09cb27959a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:36.575182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:36.600744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:36.645877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ecc2dd2407b4819874bed09cb27959a', 'request_id': 'req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:36.662562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ecc2dd2407b4819874bed09cb27959a', 'request_id': 'req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:36.674191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ecc2dd2407b4819874bed09cb27959a', 'request_id': 'req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:36.695903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8 admin admin] The token cache is being invalidate because project 6ecc2dd2407b4819874bed09cb27959a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:58:36.697036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:36.697710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cfdad82d-cdce-4c85-9ccd-670fdfed5bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:36.699982 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1602/3238] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:36 2022] DELETE /identity/v3/projects/6ecc2dd2407b4819874bed09cb27959a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:58:36.703984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:36.707627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:36.724461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2a63a-4d54-4ee4-958b-72f85a66a5e2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:36.794644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02630a-3a24-404b-bd3f-ac7cf7b8c66b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:36.794939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02630a-3a24-404b-bd3f-ac7cf7b8c66b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:36.795217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02630a-3a24-404b-bd3f-ac7cf7b8c66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:36.826312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8b02630a-3a24-404b-bd3f-ac7cf7b8c66b None None] MFA Rules not processed for user `3d96135705514061bef9306753143357`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:36.827301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8b02630a-3a24-404b-bd3f-ac7cf7b8c66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:36.856506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b23dd2-8df0-44a2-99c8-ed808a0dd4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:36.857262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b23dd2-8df0-44a2-99c8-ed808a0dd4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:36.857475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b23dd2-8df0-44a2-99c8-ed808a0dd4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:36.859126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b23dd2-8df0-44a2-99c8-ed808a0dd4b6 admin admin] PATH_INFO: `/v3/users/92974e07be4b45bab207d0f544fae05a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:36.870040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b23dd2-8df0-44a2-99c8-ed808a0dd4b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92974e07be4b45bab207d0f544fae05a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:36.871989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b23dd2-8df0-44a2-99c8-ed808a0dd4b6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:36.959537 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1603/3239] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:58:36.972221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f4b23dd2-8df0-44a2-99c8-ed808a0dd4b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92974e07be4b45bab207d0f544fae05a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:36.983314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f4b23dd2-8df0-44a2-99c8-ed808a0dd4b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92974e07be4b45bab207d0f544fae05a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:36.984167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f4b23dd2-8df0-44a2-99c8-ed808a0dd4b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92974e07be4b45bab207d0f544fae05a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:36.984732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f4b23dd2-8df0-44a2-99c8-ed808a0dd4b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92974e07be4b45bab207d0f544fae05a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:37.014207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f4b23dd2-8df0-44a2-99c8-ed808a0dd4b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92974e07be4b45bab207d0f544fae05a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:37.047186 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1637/3240] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:58:36 2022] DELETE /identity/v3/users/92974e07be4b45bab207d0f544fae05a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:58:38.334187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02630a-3a24-404b-bd3f-ac7cf7b8c66b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:38.337709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8b02630a-3a24-404b-bd3f-ac7cf7b8c66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:38.358594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02630a-3a24-404b-bd3f-ac7cf7b8c66b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:38.429359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:38.429994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:38.430271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:38.430581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec admin admin] PATH_INFO: `/v3/projects/603c33329f8c46c288e987d1d1efaa8c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:38.431725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=603c33329f8c46c288e987d1d1efaa8c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:38.433653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:38.507974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603c33329f8c46c288e987d1d1efaa8c', 'request_id': 'req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:38.511728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:38.516719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603c33329f8c46c288e987d1d1efaa8c', 'request_id': 'req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:38.524793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603c33329f8c46c288e987d1d1efaa8c', 'request_id': 'req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:38.550565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec admin admin] The token cache is being invalidate because project 603c33329f8c46c288e987d1d1efaa8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:58:38.550969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:38.551812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5cfafa01-d57b-414a-a3d0-8319ca0c82ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:38.553827 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1604/3241] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:38 2022] DELETE /identity/v3/projects/603c33329f8c46c288e987d1d1efaa8c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:58:38.559958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e740f-cb1d-49b7-9ab0-1c001b7afd5e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:38.560553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e740f-cb1d-49b7-9ab0-1c001b7afd5e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:38.560553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e740f-cb1d-49b7-9ab0-1c001b7afd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:38.592686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-683e740f-cb1d-49b7-9ab0-1c001b7afd5e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:38.594476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-683e740f-cb1d-49b7-9ab0-1c001b7afd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:38.600310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:38.677674 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1638/3242] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:38.686288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a3a03-910b-4616-a066-7243cf4bc8b6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:38.686921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a3a03-910b-4616-a066-7243cf4bc8b6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:38.687427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a3a03-910b-4616-a066-7243cf4bc8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:38.712045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0f9a3a03-910b-4616-a066-7243cf4bc8b6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:38.715024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0f9a3a03-910b-4616-a066-7243cf4bc8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:38.731482 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1605/3243] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:38.732881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e740f-cb1d-49b7-9ab0-1c001b7afd5e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:38.748215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e740f-cb1d-49b7-9ab0-1c001b7afd5e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:38.757470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd5e30-4d85-4540-9d63-8581a755ecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:38.758987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd5e30-4d85-4540-9d63-8581a755ecb0 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:38.759444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd5e30-4d85-4540-9d63-8581a755ecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:38.759992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd5e30-4d85-4540-9d63-8581a755ecb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:38.760925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd5e30-4d85-4540-9d63-8581a755ecb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:58:38.761437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd5e30-4d85-4540-9d63-8581a755ecb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:38.763445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd5e30-4d85-4540-9d63-8581a755ecb0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:38.779816 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1639/3244] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:58:38.784048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a3a03-910b-4616-a066-7243cf4bc8b6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:38.798641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a3a03-910b-4616-a066-7243cf4bc8b6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:38.822121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72005e5b-253a-4230-9c60-7a47a41198cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:38.823018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72005e5b-253a-4230-9c60-7a47a41198cd admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:38.823299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72005e5b-253a-4230-9c60-7a47a41198cd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:38.823570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72005e5b-253a-4230-9c60-7a47a41198cd admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:38.824219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72005e5b-253a-4230-9c60-7a47a41198cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:38.826500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72005e5b-253a-4230-9c60-7a47a41198cd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:38.903393 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1606/3245] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:58:38 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:58:38.904249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd5e30-4d85-4540-9d63-8581a755ecb0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:38.918604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd5e30-4d85-4540-9d63-8581a755ecb0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:39.052862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539362b1-e446-4edd-84d2-631745e9ea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:39.054360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539362b1-e446-4edd-84d2-631745e9ea2d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:39.057096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539362b1-e446-4edd-84d2-631745e9ea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:39.059074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539362b1-e446-4edd-84d2-631745e9ea2d admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:39.061464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539362b1-e446-4edd-84d2-631745e9ea2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:39.069750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539362b1-e446-4edd-84d2-631745e9ea2d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:39.125662 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1640/3246] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:58:38 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:58:39.130092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72005e5b-253a-4230-9c60-7a47a41198cd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:39.141979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72005e5b-253a-4230-9c60-7a47a41198cd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:39.148244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71811221-b497-4fea-ae08-d667fc928938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:39.148981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71811221-b497-4fea-ae08-d667fc928938 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:39.149413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71811221-b497-4fea-ae08-d667fc928938 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:39.149808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71811221-b497-4fea-ae08-d667fc928938 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:39.150536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71811221-b497-4fea-ae08-d667fc928938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:39.152497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71811221-b497-4fea-ae08-d667fc928938 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:39.166778 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1607/3247] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:58:39.171009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539362b1-e446-4edd-84d2-631745e9ea2d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:39.189574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539362b1-e446-4edd-84d2-631745e9ea2d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:39.204744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c109c-ff77-49df-8be5-41a7f5ed5535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:39.204927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c109c-ff77-49df-8be5-41a7f5ed5535 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:39.205167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c109c-ff77-49df-8be5-41a7f5ed5535 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:39.206163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c109c-ff77-49df-8be5-41a7f5ed5535 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:39.207353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c109c-ff77-49df-8be5-41a7f5ed5535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:39.212781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c109c-ff77-49df-8be5-41a7f5ed5535 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:39.234772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71811221-b497-4fea-ae08-d667fc928938 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:39.242594 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1641/3248] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:58:39.250778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71811221-b497-4fea-ae08-d667fc928938 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:39.258265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee0546-0d70-412a-bad9-a0b94b036053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:39.259438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee0546-0d70-412a-bad9-a0b94b036053 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:39.259738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee0546-0d70-412a-bad9-a0b94b036053 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:39.260040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee0546-0d70-412a-bad9-a0b94b036053 admin admin] PATH_INFO: `/v3/projects/90f1fb9485564af489b2b7bcf77b54a5/users/f5c7e0962b264d15aae60bd10c959c74/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:39.288307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee0546-0d70-412a-bad9-a0b94b036053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f1fb9485564af489b2b7bcf77b54a5, user_id=f5c7e0962b264d15aae60bd10c959c74, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:39.291562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee0546-0d70-412a-bad9-a0b94b036053 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:39.332466 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1608/3249] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:58:39 2022] PUT /identity/v3/projects/90f1fb9485564af489b2b7bcf77b54a5/users/f5c7e0962b264d15aae60bd10c959c74/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:58:39.333583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e695a6-ace4-47f7-8fd1-1138d17ad200 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:39.333887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e695a6-ace4-47f7-8fd1-1138d17ad200 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:39.334171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e695a6-ace4-47f7-8fd1-1138d17ad200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:39.372634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a3e695a6-ace4-47f7-8fd1-1138d17ad200 None None] MFA Rules not processed for user `f5c7e0962b264d15aae60bd10c959c74`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:39.374058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a3e695a6-ace4-47f7-8fd1-1138d17ad200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:39.552166 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1642/3250] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:39.553712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee0546-0d70-412a-bad9-a0b94b036053 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:39.675510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee0546-0d70-412a-bad9-a0b94b036053 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:39.696856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0df6b-967f-433a-84ab-acc6703e0cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:39.699095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0df6b-967f-433a-84ab-acc6703e0cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:39.699512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0df6b-967f-433a-84ab-acc6703e0cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:39.699863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0df6b-967f-433a-84ab-acc6703e0cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:39.700612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0df6b-967f-433a-84ab-acc6703e0cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:39.706455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0df6b-967f-433a-84ab-acc6703e0cb2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:39.797902 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1609/3251] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:58:39 2022] POST /identity/v3/projects => generated 391 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:58:39.799263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e695a6-ace4-47f7-8fd1-1138d17ad200 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:39.819486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:39.833294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e695a6-ace4-47f7-8fd1-1138d17ad200 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:39.991002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb060-a987-4a47-a73f-d66c8b9f4720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:39.991978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb060-a987-4a47-a73f-d66c8b9f4720 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:39.992431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb060-a987-4a47-a73f-d66c8b9f4720 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:39.992891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb060-a987-4a47-a73f-d66c8b9f4720 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:39.993751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcb060-a987-4a47-a73f-d66c8b9f4720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:39.995884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcb060-a987-4a47-a73f-d66c8b9f4720 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:40.121288 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1643/3252] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:58:39 2022] POST /identity/v3/users => generated 302 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:58:40.123090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0df6b-967f-433a-84ab-acc6703e0cb2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:40.143593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0df6b-967f-433a-84ab-acc6703e0cb2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:40.162978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c69130-9d76-4cc6-8602-2e0705665d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:40.164893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c69130-9d76-4cc6-8602-2e0705665d18 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:40.166590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c69130-9d76-4cc6-8602-2e0705665d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:40.167031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c69130-9d76-4cc6-8602-2e0705665d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:40.168090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c69130-9d76-4cc6-8602-2e0705665d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:40.175679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c69130-9d76-4cc6-8602-2e0705665d18 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:40.208172 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1610/3253] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:58:40.209488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb060-a987-4a47-a73f-d66c8b9f4720 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:40.231859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb060-a987-4a47-a73f-d66c8b9f4720 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:40.238198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149910bc-2ab1-4ef5-a0f8-6912fe6640ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:40.238877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149910bc-2ab1-4ef5-a0f8-6912fe6640ba admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:40.239370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149910bc-2ab1-4ef5-a0f8-6912fe6640ba admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:40.239624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149910bc-2ab1-4ef5-a0f8-6912fe6640ba admin admin] PATH_INFO: `/v3/projects/a85df4e3b04f4ee0910c1a3f1ef94ced/users/6bc06833e5114397a01949658af14d47/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:40.273319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149910bc-2ab1-4ef5-a0f8-6912fe6640ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85df4e3b04f4ee0910c1a3f1ef94ced, user_id=6bc06833e5114397a01949658af14d47, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:40.276417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149910bc-2ab1-4ef5-a0f8-6912fe6640ba admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:40.316530 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1644/3254] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:58:40 2022] PUT /identity/v3/projects/a85df4e3b04f4ee0910c1a3f1ef94ced/users/6bc06833e5114397a01949658af14d47/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:58:40.320576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c69130-9d76-4cc6-8602-2e0705665d18 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:40.338479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c69130-9d76-4cc6-8602-2e0705665d18 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:40.422346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:40.441154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13782b5c-d939-486c-a478-3585e0e822f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:40.442193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13782b5c-d939-486c-a478-3585e0e822f4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:40.442579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13782b5c-d939-486c-a478-3585e0e822f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:40.443033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13782b5c-d939-486c-a478-3585e0e822f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:40.443878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13782b5c-d939-486c-a478-3585e0e822f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:40.445657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13782b5c-d939-486c-a478-3585e0e822f4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:40.468141 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1611/3255] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:58:40.468521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149910bc-2ab1-4ef5-a0f8-6912fe6640ba admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:40.481360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149910bc-2ab1-4ef5-a0f8-6912fe6640ba admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:40.488793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc86b3-f4f1-49c4-ba7f-40aad26b740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:40.489581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc86b3-f4f1-49c4-ba7f-40aad26b740a admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:40.489857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc86b3-f4f1-49c4-ba7f-40aad26b740a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:40.490148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc86b3-f4f1-49c4-ba7f-40aad26b740a admin admin] PATH_INFO: `/v3/projects/a85df4e3b04f4ee0910c1a3f1ef94ced/users/6bc06833e5114397a01949658af14d47/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:40.492626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc86b3-f4f1-49c4-ba7f-40aad26b740a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85df4e3b04f4ee0910c1a3f1ef94ced, user_id=6bc06833e5114397a01949658af14d47, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:40.495560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc86b3-f4f1-49c4-ba7f-40aad26b740a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:40.513235 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1645/3256] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:58:40 2022] PUT /identity/v3/projects/a85df4e3b04f4ee0910c1a3f1ef94ced/users/6bc06833e5114397a01949658af14d47/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:58:40.523368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc8deb-fc8c-4a30-bd3e-2cacac4732f2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:40.523733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc8deb-fc8c-4a30-bd3e-2cacac4732f2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:40.524084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc8deb-fc8c-4a30-bd3e-2cacac4732f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:40.556747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-70bc8deb-fc8c-4a30-bd3e-2cacac4732f2 None None] MFA Rules not processed for user `6bc06833e5114397a01949658af14d47`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:40.558199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-70bc8deb-fc8c-4a30-bd3e-2cacac4732f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:40.656593 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1612/3257] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:40.731509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc86b3-f4f1-49c4-ba7f-40aad26b740a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:40.733589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-18bc86b3-f4f1-49c4-ba7f-40aad26b740a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:40.811855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc86b3-f4f1-49c4-ba7f-40aad26b740a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:40.818029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e915d-2da0-43bf-a0ee-a4fc25aee4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:40.818720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e915d-2da0-43bf-a0ee-a4fc25aee4ac service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:40.819558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e915d-2da0-43bf-a0ee-a4fc25aee4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:40.820045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e915d-2da0-43bf-a0ee-a4fc25aee4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:40.823661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-873e915d-2da0-43bf-a0ee-a4fc25aee4ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:40.835187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e915d-2da0-43bf-a0ee-a4fc25aee4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:40.836918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e915d-2da0-43bf-a0ee-a4fc25aee4ac service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:40.847239 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1646/3258] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:58:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:58:41.805381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd056ba-e0bd-4185-8e4b-f616895867e8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:41.805863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd056ba-e0bd-4185-8e4b-f616895867e8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:41.805953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd056ba-e0bd-4185-8e4b-f616895867e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:41.851194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3cd056ba-e0bd-4185-8e4b-f616895867e8 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:41.854823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3cd056ba-e0bd-4185-8e4b-f616895867e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:41.940840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e915d-2da0-43bf-a0ee-a4fc25aee4ac service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:41.943847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-873e915d-2da0-43bf-a0ee-a4fc25aee4ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:41.985655 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1613/3259] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:58:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:42.014924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd056ba-e0bd-4185-8e4b-f616895867e8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:42.016692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3cd056ba-e0bd-4185-8e4b-f616895867e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:42.039758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:42.063138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e915d-2da0-43bf-a0ee-a4fc25aee4ac service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:42.094365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46374b-6588-463b-8737-984806fc3dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:42.096008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46374b-6588-463b-8737-984806fc3dfe service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:42.096697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46374b-6588-463b-8737-984806fc3dfe service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:42.097394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46374b-6588-463b-8737-984806fc3dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:42.113833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46374b-6588-463b-8737-984806fc3dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:42.118364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46374b-6588-463b-8737-984806fc3dfe service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:42.142230 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1647/3260] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:58:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:58:42.151410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd056ba-e0bd-4185-8e4b-f616895867e8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:42.163559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5c91b-b67a-443d-b3c5-c3edebef7955 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:42.164308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5c91b-b67a-443d-b3c5-c3edebef7955 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:42.164592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5c91b-b67a-443d-b3c5-c3edebef7955 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:42.165106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5c91b-b67a-443d-b3c5-c3edebef7955 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:42.182231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5c91b-b67a-443d-b3c5-c3edebef7955 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:42.186040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5c91b-b67a-443d-b3c5-c3edebef7955 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:42.207512 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1614/3261] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:58:42.273533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46374b-6588-463b-8737-984806fc3dfe service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:42.277227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6d46374b-6588-463b-8737-984806fc3dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:42.330350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46374b-6588-463b-8737-984806fc3dfe service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:42.342517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b23342-4302-4f28-a810-9a0a205a5aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:42.343809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b23342-4302-4f28-a810-9a0a205a5aab service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:42.344091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b23342-4302-4f28-a810-9a0a205a5aab service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:42.346642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b23342-4302-4f28-a810-9a0a205a5aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:42.351383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d5b23342-4302-4f28-a810-9a0a205a5aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:42.618448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b23342-4302-4f28-a810-9a0a205a5aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:42.620472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b23342-4302-4f28-a810-9a0a205a5aab service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:42.652233 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1648/3262] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:58:42.849385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5c91b-b67a-443d-b3c5-c3edebef7955 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:42.875751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5c91b-b67a-443d-b3c5-c3edebef7955 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:42.901663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e0cb4-0193-4482-840a-79222b3de27d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:42.902288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e0cb4-0193-4482-840a-79222b3de27d service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:42.906954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e0cb4-0193-4482-840a-79222b3de27d service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:42.909255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e0cb4-0193-4482-840a-79222b3de27d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:42.933059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:43.069490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e0cb4-0193-4482-840a-79222b3de27d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:43.071194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e0cb4-0193-4482-840a-79222b3de27d service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:43.105952 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1615/3263] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:58:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:58:43.129002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b23342-4302-4f28-a810-9a0a205a5aab service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:43.139558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b23342-4302-4f28-a810-9a0a205a5aab service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:43.159538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:43.160291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:43.164972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:43.165779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] PATH_INFO: `/v3/users/f5c7e0962b264d15aae60bd10c959c74` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:43.167831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c7e0962b264d15aae60bd10c959c74)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:43.171963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:43.287891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c7e0962b264d15aae60bd10c959c74'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:43.307979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c7e0962b264d15aae60bd10c959c74'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:43.308967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c7e0962b264d15aae60bd10c959c74'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:43.313137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c7e0962b264d15aae60bd10c959c74'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:43.374908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c7e0962b264d15aae60bd10c959c74'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:43.445668 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1649/3264] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:58:43 2022] DELETE /identity/v3/users/f5c7e0962b264d15aae60bd10c959c74 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:58:43.447429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2740412-f1b0-4e7a-a0c6-2b5d6534258e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:43.447733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2740412-f1b0-4e7a-a0c6-2b5d6534258e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:43.447994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2740412-f1b0-4e7a-a0c6-2b5d6534258e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:43.494985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b2740412-f1b0-4e7a-a0c6-2b5d6534258e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:43.496412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b2740412-f1b0-4e7a-a0c6-2b5d6534258e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:43.714545 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1616/3265] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:43.741856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:43.743707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:43.859412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3307cf-1b33-4186-b335-3e4bdbffd741 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:43.869754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7518b-1978-472c-889a-7b82b4fa7fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:43.870575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7518b-1978-472c-889a-7b82b4fa7fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:43.872620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7518b-1978-472c-889a-7b82b4fa7fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:43.873045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7518b-1978-472c-889a-7b82b4fa7fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:43.885382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:43.904178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7518b-1978-472c-889a-7b82b4fa7fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:43.910286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7518b-1978-472c-889a-7b82b4fa7fd7 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:43.935549 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1650/3266] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:58:44.439380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb718e4-fdb4-4487-97a1-d1654b0039bf None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:44.440334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb718e4-fdb4-4487-97a1-d1654b0039bf None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:44.440915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb718e4-fdb4-4487-97a1-d1654b0039bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:44.498499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5cb718e4-fdb4-4487-97a1-d1654b0039bf None None] MFA Rules not processed for user `67ddc3cd3c374bacbe5bf5e0877380e2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:44.500045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5cb718e4-fdb4-4487-97a1-d1654b0039bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:44.725682 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1617/3267] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:45.496950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7518b-1978-472c-889a-7b82b4fa7fd7 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:45.498559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-73f7518b-1978-472c-889a-7b82b4fa7fd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:45.521547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7518b-1978-472c-889a-7b82b4fa7fd7 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:45.535451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:45.536360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:45.536826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:45.537298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] PATH_INFO: `/v3/projects/90f1fb9485564af489b2b7bcf77b54a5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:45.538840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f1fb9485564af489b2b7bcf77b54a5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:45.555888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:45.706988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f1fb9485564af489b2b7bcf77b54a5', 'request_id': 'req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:45.742695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f1fb9485564af489b2b7bcf77b54a5', 'request_id': 'req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:45.757079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f1fb9485564af489b2b7bcf77b54a5', 'request_id': 'req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:45.799540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] The token cache is being invalidate because project 90f1fb9485564af489b2b7bcf77b54a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:58:45.800436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:45.801524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:45.807898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb718e4-fdb4-4487-97a1-d1654b0039bf None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:45.809401 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1651/3268] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:45 2022] DELETE /identity/v3/projects/90f1fb9485564af489b2b7bcf77b54a5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:58:45.866518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb718e4-fdb4-4487-97a1-d1654b0039bf None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:45.982202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:46.008735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97c9a2-4e36-490e-9bc9-bb91fb349470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:46.009413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97c9a2-4e36-490e-9bc9-bb91fb349470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:46.009700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97c9a2-4e36-490e-9bc9-bb91fb349470 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:46.009978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97c9a2-4e36-490e-9bc9-bb91fb349470 admin admin] PATH_INFO: `/v3/users/6bc06833e5114397a01949658af14d47` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:46.018602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97c9a2-4e36-490e-9bc9-bb91fb349470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc06833e5114397a01949658af14d47)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:46.028017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97c9a2-4e36-490e-9bc9-bb91fb349470 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:46.178680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1b97c9a2-4e36-490e-9bc9-bb91fb349470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc06833e5114397a01949658af14d47'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:46.209364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1b97c9a2-4e36-490e-9bc9-bb91fb349470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc06833e5114397a01949658af14d47'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:46.215584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1b97c9a2-4e36-490e-9bc9-bb91fb349470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc06833e5114397a01949658af14d47'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:46.224463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1b97c9a2-4e36-490e-9bc9-bb91fb349470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc06833e5114397a01949658af14d47'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:46.261671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1b97c9a2-4e36-490e-9bc9-bb91fb349470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc06833e5114397a01949658af14d47'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:46.290284 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1618/3269] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:58:45 2022] DELETE /identity/v3/users/6bc06833e5114397a01949658af14d47 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:58:47.971972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:47.974469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:48.004235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ee3ec-f8ea-49fa-9e26-9ae48a2b64e4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:48.171866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe11800-ef0c-45d0-94f3-0453b4a4828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:48.175225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11800-ef0c-45d0-94f3-0453b4a4828f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:48.175862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11800-ef0c-45d0-94f3-0453b4a4828f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:48.176408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11800-ef0c-45d0-94f3-0453b4a4828f admin admin] PATH_INFO: `/v3/projects/a85df4e3b04f4ee0910c1a3f1ef94ced` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:48.192152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe11800-ef0c-45d0-94f3-0453b4a4828f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85df4e3b04f4ee0910c1a3f1ef94ced)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:48.199821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe11800-ef0c-45d0-94f3-0453b4a4828f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:48.413469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ebe11800-ef0c-45d0-94f3-0453b4a4828f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85df4e3b04f4ee0910c1a3f1ef94ced', 'request_id': 'req-ebe11800-ef0c-45d0-94f3-0453b4a4828f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:48.433312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ebe11800-ef0c-45d0-94f3-0453b4a4828f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85df4e3b04f4ee0910c1a3f1ef94ced', 'request_id': 'req-ebe11800-ef0c-45d0-94f3-0453b4a4828f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:48.449833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ebe11800-ef0c-45d0-94f3-0453b4a4828f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85df4e3b04f4ee0910c1a3f1ef94ced', 'request_id': 'req-ebe11800-ef0c-45d0-94f3-0453b4a4828f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:48.482983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ebe11800-ef0c-45d0-94f3-0453b4a4828f admin admin] The token cache is being invalidate because project a85df4e3b04f4ee0910c1a3f1ef94ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:58:48.485128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ebe11800-ef0c-45d0-94f3-0453b4a4828f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:48.488451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ebe11800-ef0c-45d0-94f3-0453b4a4828f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:58:48.493693 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1652/3270] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:47 2022] DELETE /identity/v3/projects/a85df4e3b04f4ee0910c1a3f1ef94ced => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:58:48.500451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288cb0d-2221-4589-94a5-a1dab7095c70 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:48.501146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288cb0d-2221-4589-94a5-a1dab7095c70 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:48.501146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288cb0d-2221-4589-94a5-a1dab7095c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:48.557215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0288cb0d-2221-4589-94a5-a1dab7095c70 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:48.561958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0288cb0d-2221-4589-94a5-a1dab7095c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:48.704737 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1619/3271] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:48.715170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90446a5-6816-4d61-8426-87c0daa5db94 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:48.715694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90446a5-6816-4d61-8426-87c0daa5db94 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:48.716130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90446a5-6816-4d61-8426-87c0daa5db94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:48.744221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:48.762670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b90446a5-6816-4d61-8426-87c0daa5db94 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:48.769610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b90446a5-6816-4d61-8426-87c0daa5db94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:48.796942 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1653/3272] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:48.802244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288cb0d-2221-4589-94a5-a1dab7095c70 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:48.816187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288cb0d-2221-4589-94a5-a1dab7095c70 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:48.832420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7432f25-1a8a-49fd-92a5-f7106061b020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:48.833247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432f25-1a8a-49fd-92a5-f7106061b020 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:48.833766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432f25-1a8a-49fd-92a5-f7106061b020 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:48.834306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432f25-1a8a-49fd-92a5-f7106061b020 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:48.835203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7432f25-1a8a-49fd-92a5-f7106061b020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:58:48.835742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7432f25-1a8a-49fd-92a5-f7106061b020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:48.841986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7432f25-1a8a-49fd-92a5-f7106061b020 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:48.875803 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1620/3273] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:58:48.881436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90446a5-6816-4d61-8426-87c0daa5db94 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:48.911619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90446a5-6816-4d61-8426-87c0daa5db94 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:48.917162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a954848-acc0-4e4f-97ad-6f1db56c4441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:48.918174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a954848-acc0-4e4f-97ad-6f1db56c4441 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:48.918760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a954848-acc0-4e4f-97ad-6f1db56c4441 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:48.919300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a954848-acc0-4e4f-97ad-6f1db56c4441 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:48.920912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a954848-acc0-4e4f-97ad-6f1db56c4441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:48.924672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a954848-acc0-4e4f-97ad-6f1db56c4441 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:49.025841 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1654/3274] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:58:48 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:58:49.029236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7432f25-1a8a-49fd-92a5-f7106061b020 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:49.047645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7432f25-1a8a-49fd-92a5-f7106061b020 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:49.216724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2e64e-b9c2-4df4-ab57-53b6f8888466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:49.217407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2e64e-b9c2-4df4-ab57-53b6f8888466 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:49.218080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2e64e-b9c2-4df4-ab57-53b6f8888466 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:49.218310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2e64e-b9c2-4df4-ab57-53b6f8888466 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:49.219737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2e64e-b9c2-4df4-ab57-53b6f8888466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:49.222145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2e64e-b9c2-4df4-ab57-53b6f8888466 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:49.243849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:49.281329 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1621/3275] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:58:49 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:58:49.282304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a954848-acc0-4e4f-97ad-6f1db56c4441 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:49.303892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a954848-acc0-4e4f-97ad-6f1db56c4441 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:49.317895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580311c-383c-4220-a511-264783f54523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:49.320996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580311c-383c-4220-a511-264783f54523 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:49.322124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580311c-383c-4220-a511-264783f54523 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:49.323347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580311c-383c-4220-a511-264783f54523 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:49.327345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580311c-383c-4220-a511-264783f54523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:49.335151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580311c-383c-4220-a511-264783f54523 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:49.371211 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1655/3276] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:58:49.374172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2e64e-b9c2-4df4-ab57-53b6f8888466 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:49.404696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2e64e-b9c2-4df4-ab57-53b6f8888466 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:49.443813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfcd83-fb69-4bd7-a926-e0761d14b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:49.446040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfcd83-fb69-4bd7-a926-e0761d14b92c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:49.446329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfcd83-fb69-4bd7-a926-e0761d14b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:49.451690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfcd83-fb69-4bd7-a926-e0761d14b92c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:49.452474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfcd83-fb69-4bd7-a926-e0761d14b92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:49.459146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfcd83-fb69-4bd7-a926-e0761d14b92c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:49.512961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580311c-383c-4220-a511-264783f54523 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:49.513252 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1622/3277] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:58:49.541770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580311c-383c-4220-a511-264783f54523 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:49.558964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a27d58-53a9-417c-9624-f02abfd1856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:49.562978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a27d58-53a9-417c-9624-f02abfd1856c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:49.564008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a27d58-53a9-417c-9624-f02abfd1856c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:49.564497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a27d58-53a9-417c-9624-f02abfd1856c admin admin] PATH_INFO: `/v3/projects/e191d6217f024a17a14184071ac674c7/users/3d2ddfa343e748c089129b0039a12ac0/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:49.641811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a27d58-53a9-417c-9624-f02abfd1856c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e191d6217f024a17a14184071ac674c7, user_id=3d2ddfa343e748c089129b0039a12ac0, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:49.676656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a27d58-53a9-417c-9624-f02abfd1856c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:49.724467 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1656/3278] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:58:49 2022] PUT /identity/v3/projects/e191d6217f024a17a14184071ac674c7/users/3d2ddfa343e748c089129b0039a12ac0/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:58:49.729894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a092dcc-1b68-444f-95fe-bd5d351b1d01 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:49.730488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a092dcc-1b68-444f-95fe-bd5d351b1d01 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:49.730969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a092dcc-1b68-444f-95fe-bd5d351b1d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:49.775779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2a092dcc-1b68-444f-95fe-bd5d351b1d01 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:58:49.777262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2a092dcc-1b68-444f-95fe-bd5d351b1d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:50.043145 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1623/3279] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:58:50.114214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a27d58-53a9-417c-9624-f02abfd1856c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:58:50.117773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-13a27d58-53a9-417c-9624-f02abfd1856c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:58:50.401481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a27d58-53a9-417c-9624-f02abfd1856c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:58:50.406840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78439434-2a9a-444e-a942-0b327d74909d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:58:50.411702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78439434-2a9a-444e-a942-0b327d74909d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:58:50.412274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78439434-2a9a-444e-a942-0b327d74909d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:58:50.412740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78439434-2a9a-444e-a942-0b327d74909d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:58:50.461599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78439434-2a9a-444e-a942-0b327d74909d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:58:50.464536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78439434-2a9a-444e-a942-0b327d74909d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:58:50.512123 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1657/3280] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:00.002212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=3,keystone:SELECT=34 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:00.494965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:04.018134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a092dcc-1b68-444f-95fe-bd5d351b1d01 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:04.025470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2a092dcc-1b68-444f-95fe-bd5d351b1d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:04.067314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a092dcc-1b68-444f-95fe-bd5d351b1d01 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:04.088734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:04.092639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:04.095823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:04.096342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] PATH_INFO: `/v3/users/5d9facf5ea0743cb821cec1b40f6b609` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:04.105528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d9facf5ea0743cb821cec1b40f6b609)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:04.117110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:04.125445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78439434-2a9a-444e-a942-0b327d74909d service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:04.128357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-78439434-2a9a-444e-a942-0b327d74909d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:04.178752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78439434-2a9a-444e-a942-0b327d74909d service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:04.214274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c75ab-4634-4425-b0f1-1cfb8035b666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:04.219311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c75ab-4634-4425-b0f1-1cfb8035b666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:04.220654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c75ab-4634-4425-b0f1-1cfb8035b666 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:04.222731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c75ab-4634-4425-b0f1-1cfb8035b666 admin admin] PATH_INFO: `/v3/users/01ec70849cfa44368a91df8b3410aba8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:04.230949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c75ab-4634-4425-b0f1-1cfb8035b666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ec70849cfa44368a91df8b3410aba8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:04.237988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c75ab-4634-4425-b0f1-1cfb8035b666 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:04.279708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d9facf5ea0743cb821cec1b40f6b609'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:04.293930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d9facf5ea0743cb821cec1b40f6b609'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:04.297552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d9facf5ea0743cb821cec1b40f6b609'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:04.297552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d9facf5ea0743cb821cec1b40f6b609'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:04.311652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d9facf5ea0743cb821cec1b40f6b609'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:04.348887 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1624/3281] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:59:04 2022] DELETE /identity/v3/users/5d9facf5ea0743cb821cec1b40f6b609 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:59:04.371533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7f1c75ab-4634-4425-b0f1-1cfb8035b666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ec70849cfa44368a91df8b3410aba8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:04.385128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7f1c75ab-4634-4425-b0f1-1cfb8035b666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ec70849cfa44368a91df8b3410aba8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:04.386782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7f1c75ab-4634-4425-b0f1-1cfb8035b666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ec70849cfa44368a91df8b3410aba8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:04.387481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7f1c75ab-4634-4425-b0f1-1cfb8035b666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ec70849cfa44368a91df8b3410aba8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:04.436208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7f1c75ab-4634-4425-b0f1-1cfb8035b666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ec70849cfa44368a91df8b3410aba8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:04.492880 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1658/3282] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:59:04 2022] DELETE /identity/v3/users/01ec70849cfa44368a91df8b3410aba8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:59:05.204712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:05.206876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:05.328359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b645e-b871-4bc4-b585-59c275ea75f5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:05.601998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fb05e-a2c1-4644-8ff0-0094bc287609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:05.602669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fb05e-a2c1-4644-8ff0-0094bc287609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:05.603044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fb05e-a2c1-4644-8ff0-0094bc287609 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:05.603500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fb05e-a2c1-4644-8ff0-0094bc287609 admin admin] PATH_INFO: `/v3/projects/6c97b3b7fa484f97bdf40224f7cc34d4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:05.606344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fb05e-a2c1-4644-8ff0-0094bc287609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c97b3b7fa484f97bdf40224f7cc34d4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:05.612296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fb05e-a2c1-4644-8ff0-0094bc287609 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:05.681648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:05.783585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-007fb05e-a2c1-4644-8ff0-0094bc287609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c97b3b7fa484f97bdf40224f7cc34d4', 'request_id': 'req-007fb05e-a2c1-4644-8ff0-0094bc287609'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:05.814931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-007fb05e-a2c1-4644-8ff0-0094bc287609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c97b3b7fa484f97bdf40224f7cc34d4', 'request_id': 'req-007fb05e-a2c1-4644-8ff0-0094bc287609'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:05.827670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-007fb05e-a2c1-4644-8ff0-0094bc287609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c97b3b7fa484f97bdf40224f7cc34d4', 'request_id': 'req-007fb05e-a2c1-4644-8ff0-0094bc287609'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:05.887662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-007fb05e-a2c1-4644-8ff0-0094bc287609 admin admin] The token cache is being invalidate because project 6c97b3b7fa484f97bdf40224f7cc34d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:59:05.887662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-007fb05e-a2c1-4644-8ff0-0094bc287609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:05.893564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-007fb05e-a2c1-4644-8ff0-0094bc287609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:05.904173 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1625/3283] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:05 2022] DELETE /identity/v3/projects/6c97b3b7fa484f97bdf40224f7cc34d4 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:59:05.910041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eafab-73f7-4587-a0c0-de7946b480ec None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:05.911046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eafab-73f7-4587-a0c0-de7946b480ec None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:05.911669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eafab-73f7-4587-a0c0-de7946b480ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:05.979228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bc3eafab-73f7-4587-a0c0-de7946b480ec None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:05.984307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bc3eafab-73f7-4587-a0c0-de7946b480ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:06.187707 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1659/3284] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:06.195592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97209e1-9c2a-49b2-827a-17afe8870bf6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:06.196019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97209e1-9c2a-49b2-827a-17afe8870bf6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:06.196568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97209e1-9c2a-49b2-827a-17afe8870bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:06.254231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d97209e1-9c2a-49b2-827a-17afe8870bf6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:06.255520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d97209e1-9c2a-49b2-827a-17afe8870bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:06.284086 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1626/3285] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:06.285030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eafab-73f7-4587-a0c0-de7946b480ec None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:06.317049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eafab-73f7-4587-a0c0-de7946b480ec None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:06.356220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872d951-dca3-41ab-a37f-15cb4e6a900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:06.363024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872d951-dca3-41ab-a37f-15cb4e6a900e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:06.363659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872d951-dca3-41ab-a37f-15cb4e6a900e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:06.364524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872d951-dca3-41ab-a37f-15cb4e6a900e admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:06.372699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872d951-dca3-41ab-a37f-15cb4e6a900e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:59:06.372936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872d951-dca3-41ab-a37f-15cb4e6a900e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:06.381554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872d951-dca3-41ab-a37f-15cb4e6a900e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:06.462798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97209e1-9c2a-49b2-827a-17afe8870bf6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:06.464061 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1660/3286] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:59:06.494433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97209e1-9c2a-49b2-827a-17afe8870bf6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:06.505050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0fbe7-15d0-41ff-b87c-4e5183ea32de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:06.506087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0fbe7-15d0-41ff-b87c-4e5183ea32de admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:06.506369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0fbe7-15d0-41ff-b87c-4e5183ea32de admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:06.506655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0fbe7-15d0-41ff-b87c-4e5183ea32de admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:06.507320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0fbe7-15d0-41ff-b87c-4e5183ea32de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:06.509311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0fbe7-15d0-41ff-b87c-4e5183ea32de admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:06.587115 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1627/3287] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:59:06 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:59:06.591533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872d951-dca3-41ab-a37f-15cb4e6a900e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:06.623761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872d951-dca3-41ab-a37f-15cb4e6a900e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:07.006306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb9a02-8c1b-4b8d-981f-75b6d2b55b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:07.007611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9a02-8c1b-4b8d-981f-75b6d2b55b9e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:07.012039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9a02-8c1b-4b8d-981f-75b6d2b55b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:07.012594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9a02-8c1b-4b8d-981f-75b6d2b55b9e admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:07.013512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb9a02-8c1b-4b8d-981f-75b6d2b55b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:07.017829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb9a02-8c1b-4b8d-981f-75b6d2b55b9e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:07.036768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:07.069530 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1661/3288] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:59:06 2022] POST /identity/v3/users => generated 297 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:59:07.073893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0fbe7-15d0-41ff-b87c-4e5183ea32de admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:07.096196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0fbe7-15d0-41ff-b87c-4e5183ea32de admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:07.114506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1086e8-c0ba-4f48-b615-81c34c6349c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:07.118230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1086e8-c0ba-4f48-b615-81c34c6349c8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:07.121360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1086e8-c0ba-4f48-b615-81c34c6349c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:07.121360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1086e8-c0ba-4f48-b615-81c34c6349c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:07.124035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1086e8-c0ba-4f48-b615-81c34c6349c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:07.130326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1086e8-c0ba-4f48-b615-81c34c6349c8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:07.186568 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1628/3289] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:59:07.191390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab639c-2df5-434d-92b4-a85ce725bc32 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:07.192335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab639c-2df5-434d-92b4-a85ce725bc32 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:07.192509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab639c-2df5-434d-92b4-a85ce725bc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:07.202126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1086e8-c0ba-4f48-b615-81c34c6349c8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:07.219767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1086e8-c0ba-4f48-b615-81c34c6349c8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:07.226986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be25b74-5727-4936-8ce6-8e6d0b9037a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:07.228073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be25b74-5727-4936-8ce6-8e6d0b9037a6 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:07.229389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be25b74-5727-4936-8ce6-8e6d0b9037a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:07.229914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be25b74-5727-4936-8ce6-8e6d0b9037a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:07.230810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be25b74-5727-4936-8ce6-8e6d0b9037a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:07.233078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be25b74-5727-4936-8ce6-8e6d0b9037a6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:07.262063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f9ab639c-2df5-434d-92b4-a85ce725bc32 None None] MFA Rules not processed for user `3d2ddfa343e748c089129b0039a12ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:07.262297 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1629/3290] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:59:07.263027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f9ab639c-2df5-434d-92b4-a85ce725bc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:07.267253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be25b74-5727-4936-8ce6-8e6d0b9037a6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:07.284163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be25b74-5727-4936-8ce6-8e6d0b9037a6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:07.291904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f7433-f1eb-4145-b3d7-25c7958aa9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:07.293358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f7433-f1eb-4145-b3d7-25c7958aa9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:07.294039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f7433-f1eb-4145-b3d7-25c7958aa9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:07.294566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f7433-f1eb-4145-b3d7-25c7958aa9ff admin admin] PATH_INFO: `/v3/projects/8b00ee5e7828469f95bd90548d35982a/users/1698dee4a2bf4ea19a6ee0c3d5cb5c09/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:07.323709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f7433-f1eb-4145-b3d7-25c7958aa9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b00ee5e7828469f95bd90548d35982a, user_id=1698dee4a2bf4ea19a6ee0c3d5cb5c09, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:07.327107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f7433-f1eb-4145-b3d7-25c7958aa9ff admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:07.395370 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1630/3291] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:59:07 2022] PUT /identity/v3/projects/8b00ee5e7828469f95bd90548d35982a/users/1698dee4a2bf4ea19a6ee0c3d5cb5c09/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:59:07.400977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b999-281e-47df-a414-25b1d2c50fb4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:07.403980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b999-281e-47df-a414-25b1d2c50fb4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:07.404533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b999-281e-47df-a414-25b1d2c50fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:07.452609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6524b999-281e-47df-a414-25b1d2c50fb4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:07.456082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6524b999-281e-47df-a414-25b1d2c50fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:07.463613 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1662/3292] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:07.469498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab639c-2df5-434d-92b4-a85ce725bc32 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:07.472383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f9ab639c-2df5-434d-92b4-a85ce725bc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:07.540770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab639c-2df5-434d-92b4-a85ce725bc32 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:07.677760 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1631/3293] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:07.682282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524b999-281e-47df-a414-25b1d2c50fb4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:07.683770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6524b999-281e-47df-a414-25b1d2c50fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:07.704177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524b999-281e-47df-a414-25b1d2c50fb4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:07.711161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:07.711939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:07.712347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:07.712730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] PATH_INFO: `/v3/projects/5cdaf5b9230f4e09949a39a5cbe72011` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:07.713955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cdaf5b9230f4e09949a39a5cbe72011)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:07.716835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:07.765823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4457a-6e7f-45a4-9124-2c7a07969b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:07.767055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4457a-6e7f-45a4-9124-2c7a07969b9e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:07.767360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4457a-6e7f-45a4-9124-2c7a07969b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:07.770860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4457a-6e7f-45a4-9124-2c7a07969b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:07.771622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4457a-6e7f-45a4-9124-2c7a07969b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:07.777811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4457a-6e7f-45a4-9124-2c7a07969b9e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:07.804108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:07.871563 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1663/3294] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:59:07 2022] POST /identity/v3/projects => generated 383 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:59:07.874319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cdaf5b9230f4e09949a39a5cbe72011', 'request_id': 'req-de3b8e59-be85-4e7a-b80b-4c27be1988b5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:07.875336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4457a-6e7f-45a4-9124-2c7a07969b9e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:07.880532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-41c4457a-6e7f-45a4-9124-2c7a07969b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:07.911762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cdaf5b9230f4e09949a39a5cbe72011', 'request_id': 'req-de3b8e59-be85-4e7a-b80b-4c27be1988b5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:07.936196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cdaf5b9230f4e09949a39a5cbe72011', 'request_id': 'req-de3b8e59-be85-4e7a-b80b-4c27be1988b5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:07.992343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] The token cache is being invalidate because project 5cdaf5b9230f4e09949a39a5cbe72011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:59:07.993102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:07.994142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:07.996734 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1632/3295] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:07 2022] DELETE /identity/v3/projects/5cdaf5b9230f4e09949a39a5cbe72011 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:59:07.998201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:08.000807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:08.090083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4457a-6e7f-45a4-9124-2c7a07969b9e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:08.107827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa7b4b-79e6-464e-b42e-735bcf17274a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:08.108638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa7b4b-79e6-464e-b42e-735bcf17274a service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:08.108921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa7b4b-79e6-464e-b42e-735bcf17274a service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:08.112232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa7b4b-79e6-464e-b42e-735bcf17274a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:08.117597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f1aa7b4b-79e6-464e-b42e-735bcf17274a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:08.184049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:08.281540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b8e59-be85-4e7a-b80b-4c27be1988b5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:08.296495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa7b4b-79e6-464e-b42e-735bcf17274a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:08.299698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa7b4b-79e6-464e-b42e-735bcf17274a service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:08.308356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d18b8a-db4e-41f3-bb10-63e4bca443a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:08.312118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d18b8a-db4e-41f3-bb10-63e4bca443a7 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:08.317574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d18b8a-db4e-41f3-bb10-63e4bca443a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:08.318054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d18b8a-db4e-41f3-bb10-63e4bca443a7 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:08.318939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d18b8a-db4e-41f3-bb10-63e4bca443a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:08.321506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d18b8a-db4e-41f3-bb10-63e4bca443a7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:08.361146 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1664/3296] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:08.364398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bba060-4ce6-4d0a-ace6-47afa4554539 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:08.364699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bba060-4ce6-4d0a-ace6-47afa4554539 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:08.365047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bba060-4ce6-4d0a-ace6-47afa4554539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:08.400314 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1633/3297] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:59:07 2022] POST /identity/v3/users => generated 298 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:59:08.406745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-70bba060-4ce6-4d0a-ace6-47afa4554539 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:08.408527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-70bba060-4ce6-4d0a-ace6-47afa4554539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:08.412560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d18b8a-db4e-41f3-bb10-63e4bca443a7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:08.423321 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1665/3298] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:08.434389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83ff9-b1be-420b-9de3-7f83b6d5a96a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:08.434725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83ff9-b1be-420b-9de3-7f83b6d5a96a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:08.435342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83ff9-b1be-420b-9de3-7f83b6d5a96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:08.446464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d18b8a-db4e-41f3-bb10-63e4bca443a7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:08.460626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04990633-86e6-459d-b0d0-052486c7bbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:08.463580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04990633-86e6-459d-b0d0-052486c7bbcf admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:08.464263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04990633-86e6-459d-b0d0-052486c7bbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:08.465589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04990633-86e6-459d-b0d0-052486c7bbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:08.466942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04990633-86e6-459d-b0d0-052486c7bbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:08.484212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04990633-86e6-459d-b0d0-052486c7bbcf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:08.503349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9df83ff9-b1be-420b-9de3-7f83b6d5a96a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:08.509059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9df83ff9-b1be-420b-9de3-7f83b6d5a96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:08.514302 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1634/3299] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:59:08.518770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04990633-86e6-459d-b0d0-052486c7bbcf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:08.539508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04990633-86e6-459d-b0d0-052486c7bbcf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:08.549951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc6824-cfda-4637-b994-1c0cd4fdb3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:08.551014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc6824-cfda-4637-b994-1c0cd4fdb3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:08.551517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc6824-cfda-4637-b994-1c0cd4fdb3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:08.552331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc6824-cfda-4637-b994-1c0cd4fdb3ff admin admin] PATH_INFO: `/v3/projects/cff16d5d25424e24a25a40e1b0373536/users/fb0f01bd824f47bdbb676f945f6462fb/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:08.566005 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1666/3300] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:08.570739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df83ff9-b1be-420b-9de3-7f83b6d5a96a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:08.591724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc6824-cfda-4637-b994-1c0cd4fdb3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff16d5d25424e24a25a40e1b0373536, user_id=fb0f01bd824f47bdbb676f945f6462fb, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:08.595414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc6824-cfda-4637-b994-1c0cd4fdb3ff admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:08.614870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df83ff9-b1be-420b-9de3-7f83b6d5a96a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:08.625815 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1635/3301] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:59:08 2022] PUT /identity/v3/projects/cff16d5d25424e24a25a40e1b0373536/users/fb0f01bd824f47bdbb676f945f6462fb/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:59:08.630135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc6824-cfda-4637-b994-1c0cd4fdb3ff admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:08.646540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65042306-6c9b-4577-8b9d-0ac0af72043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:08.648944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65042306-6c9b-4577-8b9d-0ac0af72043e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:08.649578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65042306-6c9b-4577-8b9d-0ac0af72043e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:08.649822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65042306-6c9b-4577-8b9d-0ac0af72043e admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:08.652428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65042306-6c9b-4577-8b9d-0ac0af72043e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:59:08.659892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65042306-6c9b-4577-8b9d-0ac0af72043e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:08.665928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65042306-6c9b-4577-8b9d-0ac0af72043e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:08.731444 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1667/3302] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:59:08.732768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65042306-6c9b-4577-8b9d-0ac0af72043e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:08.770081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65042306-6c9b-4577-8b9d-0ac0af72043e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:08.784539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc6824-cfda-4637-b994-1c0cd4fdb3ff admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:08.792344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f340d-dce4-4926-91b3-7d3e93b2c93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:08.793818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f340d-dce4-4926-91b3-7d3e93b2c93e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:08.793921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f340d-dce4-4926-91b3-7d3e93b2c93e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:08.794170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f340d-dce4-4926-91b3-7d3e93b2c93e admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:08.794834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f340d-dce4-4926-91b3-7d3e93b2c93e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:08.796708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f340d-dce4-4926-91b3-7d3e93b2c93e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:08.797655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f76f34-6066-47ce-b77d-545709b4b4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:08.798582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f76f34-6066-47ce-b77d-545709b4b4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:08.799118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f76f34-6066-47ce-b77d-545709b4b4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:08.799614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f76f34-6066-47ce-b77d-545709b4b4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:08.800641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f76f34-6066-47ce-b77d-545709b4b4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:08.804112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f76f34-6066-47ce-b77d-545709b4b4f0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:08.831866 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1636/3303] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:59:08.842447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f76f34-6066-47ce-b77d-545709b4b4f0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:08.865275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f76f34-6066-47ce-b77d-545709b4b4f0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:08.897002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35042d0f-c8be-4620-9e50-2e71e5f294e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:08.897739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35042d0f-c8be-4620-9e50-2e71e5f294e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:08.898021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35042d0f-c8be-4620-9e50-2e71e5f294e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:08.899360 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1668/3304] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:59:08 2022] POST /identity/v3/projects => generated 397 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:59:08.900439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f340d-dce4-4926-91b3-7d3e93b2c93e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:08.903542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35042d0f-c8be-4620-9e50-2e71e5f294e7 admin admin] PATH_INFO: `/v3/projects/cff16d5d25424e24a25a40e1b0373536/users/fb0f01bd824f47bdbb676f945f6462fb/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:08.910210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35042d0f-c8be-4620-9e50-2e71e5f294e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff16d5d25424e24a25a40e1b0373536, user_id=fb0f01bd824f47bdbb676f945f6462fb, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:08.921637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35042d0f-c8be-4620-9e50-2e71e5f294e7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:08.940941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:08.967792 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1637/3305] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:59:08 2022] PUT /identity/v3/projects/cff16d5d25424e24a25a40e1b0373536/users/fb0f01bd824f47bdbb676f945f6462fb/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:59:09.165416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f340d-dce4-4926-91b3-7d3e93b2c93e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:09.323395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32210e29-3cb8-44af-85ff-76800b4d7c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:09.324169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32210e29-3cb8-44af-85ff-76800b4d7c91 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:09.327786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32210e29-3cb8-44af-85ff-76800b4d7c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:09.328182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32210e29-3cb8-44af-85ff-76800b4d7c91 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:09.330764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32210e29-3cb8-44af-85ff-76800b4d7c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:09.336906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32210e29-3cb8-44af-85ff-76800b4d7c91 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:09.397138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35042d0f-c8be-4620-9e50-2e71e5f294e7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:09.398673 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1669/3306] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:59:08 2022] POST /identity/v3/users => generated 299 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:59:09.415881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35042d0f-c8be-4620-9e50-2e71e5f294e7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:09.424252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2375e-7144-47af-bf4f-f198f185355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:09.425304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2375e-7144-47af-bf4f-f198f185355c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:09.425636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2375e-7144-47af-bf4f-f198f185355c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:09.426018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2375e-7144-47af-bf4f-f198f185355c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:09.426862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2375e-7144-47af-bf4f-f198f185355c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:09.429333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2375e-7144-47af-bf4f-f198f185355c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:09.450870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32210e29-3cb8-44af-85ff-76800b4d7c91 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:09.458599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:09.460355 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1638/3307] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:59:09.465821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32210e29-3cb8-44af-85ff-76800b4d7c91 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:09.475880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3995b49-ff3a-4c88-889d-1e9ba7a81565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:09.475880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3995b49-ff3a-4c88-889d-1e9ba7a81565 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:09.476247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3995b49-ff3a-4c88-889d-1e9ba7a81565 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:09.476540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3995b49-ff3a-4c88-889d-1e9ba7a81565 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:09.481056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3995b49-ff3a-4c88-889d-1e9ba7a81565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:09.481056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3995b49-ff3a-4c88-889d-1e9ba7a81565 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:09.504085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2375e-7144-47af-bf4f-f198f185355c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:09.516524 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1670/3308] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:59:09.518669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2375e-7144-47af-bf4f-f198f185355c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:09.525633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc253-95d2-40ce-93e4-8bd519269a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:09.526347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc253-95d2-40ce-93e4-8bd519269a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:09.526734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc253-95d2-40ce-93e4-8bd519269a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:09.527072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc253-95d2-40ce-93e4-8bd519269a7e admin admin] PATH_INFO: `/v3/projects/de0921d976db440c8f59ba2f065642a0/users/6bee8de1c3524b0f8a0dd73898637aa7/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:09.555109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddc253-95d2-40ce-93e4-8bd519269a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0921d976db440c8f59ba2f065642a0, user_id=6bee8de1c3524b0f8a0dd73898637aa7, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:09.559043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddc253-95d2-40ce-93e4-8bd519269a7e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:09.590912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f26ba7-7a0c-4fd6-afb1-902f2c112943 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:09.591528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f26ba7-7a0c-4fd6-afb1-902f2c112943 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:09.592301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f26ba7-7a0c-4fd6-afb1-902f2c112943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:09.597932 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1639/3309] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:59:09 2022] PUT /identity/v3/projects/de0921d976db440c8f59ba2f065642a0/users/6bee8de1c3524b0f8a0dd73898637aa7/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:59:09.626597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-80f26ba7-7a0c-4fd6-afb1-902f2c112943 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:09.628147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-80f26ba7-7a0c-4fd6-afb1-902f2c112943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:09.760238 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1671/3310] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:10.219009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc253-95d2-40ce-93e4-8bd519269a7e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:10.220852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e1ddc253-95d2-40ce-93e4-8bd519269a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:10.427258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc253-95d2-40ce-93e4-8bd519269a7e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:10.434488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c652d-78df-4689-b4ac-2967d7225ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:10.435490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c652d-78df-4689-b4ac-2967d7225ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:10.435997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c652d-78df-4689-b4ac-2967d7225ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:10.436511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c652d-78df-4689-b4ac-2967d7225ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:10.456546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c652d-78df-4689-b4ac-2967d7225ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:10.459279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c652d-78df-4689-b4ac-2967d7225ec6 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:10.479655 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1640/3311] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:10.751894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214236-1f8f-466d-ae95-6a88208b6d4c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:10.752819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214236-1f8f-466d-ae95-6a88208b6d4c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:10.752982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61214236-1f8f-466d-ae95-6a88208b6d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:10.794509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-61214236-1f8f-466d-ae95-6a88208b6d4c None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:10.795796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-61214236-1f8f-466d-ae95-6a88208b6d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:10.953175 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1672/3312] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 20:59:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:10.961456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c652d-78df-4689-b4ac-2967d7225ec6 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:10.963240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8e8c652d-78df-4689-b4ac-2967d7225ec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:11.162505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c652d-78df-4689-b4ac-2967d7225ec6 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:11.175765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5b354-09fc-47de-b753-53741efbc3e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:11.176609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5b354-09fc-47de-b753-53741efbc3e3 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:11.176970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5b354-09fc-47de-b753-53741efbc3e3 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:11.177380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5b354-09fc-47de-b753-53741efbc3e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:11.197803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5b354-09fc-47de-b753-53741efbc3e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:11.199565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5b354-09fc-47de-b753-53741efbc3e3 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:11.224064 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1641/3313] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 20:59:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:59:17.147811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61214236-1f8f-466d-ae95-6a88208b6d4c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:17.149213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-61214236-1f8f-466d-ae95-6a88208b6d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:17.182146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61214236-1f8f-466d-ae95-6a88208b6d4c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:17.200401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:17.201065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:17.201376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:17.201659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] PATH_INFO: `/v3/users/d54b1c5c00544be4b60132d09817c8d6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:17.203505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54b1c5c00544be4b60132d09817c8d6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:17.205558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:17.282276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c28a47-fc23-44f0-979a-cd07beabb9f6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:17.282815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c28a47-fc23-44f0-979a-cd07beabb9f6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:17.282815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c28a47-fc23-44f0-979a-cd07beabb9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:17.327674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-70c28a47-fc23-44f0-979a-cd07beabb9f6 None None] MFA Rules not processed for user `67ddc3cd3c374bacbe5bf5e0877380e2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:17.329516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-70c28a47-fc23-44f0-979a-cd07beabb9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:17.349412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54b1c5c00544be4b60132d09817c8d6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:17.360898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54b1c5c00544be4b60132d09817c8d6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:17.361823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54b1c5c00544be4b60132d09817c8d6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:17.362522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54b1c5c00544be4b60132d09817c8d6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:17.380489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54b1c5c00544be4b60132d09817c8d6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:17.410081 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1673/3314] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:59:17 2022] DELETE /identity/v3/users/d54b1c5c00544be4b60132d09817c8d6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:59:17.434929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:17.459407 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1642/3315] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:17.524068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:17.525620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:17.544782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:17.686974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26202ed-fca6-4eee-b790-8efcefe5d002 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:17.710333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:17.711007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:17.713408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:17.713800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] PATH_INFO: `/v3/users/322606d4cb0f45d3ac2eceab4999d45b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:17.715045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=322606d4cb0f45d3ac2eceab4999d45b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:17.720950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:17.868928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '322606d4cb0f45d3ac2eceab4999d45b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:17.892025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '322606d4cb0f45d3ac2eceab4999d45b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:17.896923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '322606d4cb0f45d3ac2eceab4999d45b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:17.899356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '322606d4cb0f45d3ac2eceab4999d45b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:17.938151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '322606d4cb0f45d3ac2eceab4999d45b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:17.971096 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1674/3316] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:59:17 2022] DELETE /identity/v3/users/322606d4cb0f45d3ac2eceab4999d45b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:59:17.977501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56668047-5289-4d7b-8abf-cd5c1cd9c5d2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:17.977781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56668047-5289-4d7b-8abf-cd5c1cd9c5d2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:17.978270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56668047-5289-4d7b-8abf-cd5c1cd9c5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:18.020277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-56668047-5289-4d7b-8abf-cd5c1cd9c5d2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:18.024812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-56668047-5289-4d7b-8abf-cd5c1cd9c5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:18.209624 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1643/3317] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:18.225957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:18.228039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:18.241011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56668047-5289-4d7b-8abf-cd5c1cd9c5d2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:18.243130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-56668047-5289-4d7b-8abf-cd5c1cd9c5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:18.267552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656307f9-879c-4b0b-9fda-7c8f89e55b7a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:18.296251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:18.296902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:18.297970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:18.298425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] PATH_INFO: `/v3/projects/ac5c7906a4714a1887cb823e1c3a6056` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:18.299826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5c7906a4714a1887cb823e1c3a6056)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:18.304338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:18.407091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56668047-5289-4d7b-8abf-cd5c1cd9c5d2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:18.451137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5c7906a4714a1887cb823e1c3a6056', 'request_id': 'req-24003710-843f-4332-a531-49ef6b781bb7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:18.472582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5c7906a4714a1887cb823e1c3a6056', 'request_id': 'req-24003710-843f-4332-a531-49ef6b781bb7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:18.489687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5c7906a4714a1887cb823e1c3a6056', 'request_id': 'req-24003710-843f-4332-a531-49ef6b781bb7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:18.507163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] The token cache is being invalidate because project ac5c7906a4714a1887cb823e1c3a6056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:59:18.507522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:18.508334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:18.510372 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1675/3318] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:18 2022] DELETE /identity/v3/projects/ac5c7906a4714a1887cb823e1c3a6056 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:59:18.518511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:18.523473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:18.551469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e64c3-b707-462a-9790-67c32fad2903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:18.552102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e64c3-b707-462a-9790-67c32fad2903 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:18.552386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e64c3-b707-462a-9790-67c32fad2903 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:18.552664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e64c3-b707-462a-9790-67c32fad2903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:18.557222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-491e64c3-b707-462a-9790-67c32fad2903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:18.564870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:18.699440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24003710-843f-4332-a531-49ef6b781bb7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:18.705829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:18.706871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:18.707407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:18.708098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] PATH_INFO: `/v3/users/d449480e71eb4ac7a24dc84d5a0076b5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:18.709619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e64c3-b707-462a-9790-67c32fad2903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:18.709909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d449480e71eb4ac7a24dc84d5a0076b5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:18.711698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e64c3-b707-462a-9790-67c32fad2903 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:18.713223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:18.733988 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1644/3319] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:18.845354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd449480e71eb4ac7a24dc84d5a0076b5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:18.876303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd449480e71eb4ac7a24dc84d5a0076b5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:18.878293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd449480e71eb4ac7a24dc84d5a0076b5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:18.879360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd449480e71eb4ac7a24dc84d5a0076b5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:18.912235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd449480e71eb4ac7a24dc84d5a0076b5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:18.945423 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1676/3320] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:59:18 2022] DELETE /identity/v3/users/d449480e71eb4ac7a24dc84d5a0076b5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:59:19.893105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e64c3-b707-462a-9790-67c32fad2903 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:19.902137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:19.914746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e64c3-b707-462a-9790-67c32fad2903 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:19.933621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:19.936748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:20.099463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212f9e9-a645-4abe-8b72-a3e14004afec admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:20.105131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:20.109178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:20.109528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:20.110095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] PATH_INFO: `/v3/projects/49e7e27444f249baa1bea45c1769ecce` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:20.111687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e7e27444f249baa1bea45c1769ecce)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:20.117345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:20.124936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e04aa-d43d-4134-a0d9-454eb93648ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:20.125723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e04aa-d43d-4134-a0d9-454eb93648ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:20.126011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e04aa-d43d-4134-a0d9-454eb93648ba admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:20.126288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e04aa-d43d-4134-a0d9-454eb93648ba admin admin] PATH_INFO: `/v3/projects/d24a29bd6efb40609e31fbb6dba839e8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:20.132098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e04aa-d43d-4134-a0d9-454eb93648ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24a29bd6efb40609e31fbb6dba839e8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:20.145453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e04aa-d43d-4134-a0d9-454eb93648ba admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:20.255967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e7e27444f249baa1bea45c1769ecce', 'request_id': 'req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:20.281165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e7e27444f249baa1bea45c1769ecce', 'request_id': 'req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:20.284241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:20.290318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e7e27444f249baa1bea45c1769ecce', 'request_id': 'req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:20.305816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-930e04aa-d43d-4134-a0d9-454eb93648ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24a29bd6efb40609e31fbb6dba839e8', 'request_id': 'req-930e04aa-d43d-4134-a0d9-454eb93648ba'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:20.330440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-930e04aa-d43d-4134-a0d9-454eb93648ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24a29bd6efb40609e31fbb6dba839e8', 'request_id': 'req-930e04aa-d43d-4134-a0d9-454eb93648ba'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:20.341596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-930e04aa-d43d-4134-a0d9-454eb93648ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24a29bd6efb40609e31fbb6dba839e8', 'request_id': 'req-930e04aa-d43d-4134-a0d9-454eb93648ba'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:20.345435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] The token cache is being invalidate because project 49e7e27444f249baa1bea45c1769ecce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:59:20.346287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:20.347861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:20.352574 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1645/3321] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:19 2022] DELETE /identity/v3/projects/49e7e27444f249baa1bea45c1769ecce => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:59:20.353813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:20.357938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:20.369128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-930e04aa-d43d-4134-a0d9-454eb93648ba admin admin] The token cache is being invalidate because project d24a29bd6efb40609e31fbb6dba839e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:59:20.369427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-930e04aa-d43d-4134-a0d9-454eb93648ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:20.373466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-930e04aa-d43d-4134-a0d9-454eb93648ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:59:20.380234 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1677/3322] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:19 2022] DELETE /identity/v3/projects/d24a29bd6efb40609e31fbb6dba839e8 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:59:20.382443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947dd1e-0e02-463c-8a8f-83f2f94cd6c6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:20.384299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947dd1e-0e02-463c-8a8f-83f2f94cd6c6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:20.385368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947dd1e-0e02-463c-8a8f-83f2f94cd6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:20.418612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e947dd1e-0e02-463c-8a8f-83f2f94cd6c6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:20.419891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e947dd1e-0e02-463c-8a8f-83f2f94cd6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:20.565705 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1678/3323] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:20.569616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641224-afcb-449c-8352-641a160a7f2d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:20.569911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641224-afcb-449c-8352-641a160a7f2d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:20.570187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641224-afcb-449c-8352-641a160a7f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:20.616990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-67641224-afcb-449c-8352-641a160a7f2d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:20.619382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-67641224-afcb-449c-8352-641a160a7f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:20.639354 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1679/3324] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:20.640370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947034a-73a3-48cd-99c3-1dc622c7e75b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:20.641249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947034a-73a3-48cd-99c3-1dc622c7e75b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:20.641493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947034a-73a3-48cd-99c3-1dc622c7e75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:20.665170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a89e3-a6c5-40a3-964b-5b872e43da2f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:20.680932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9947034a-73a3-48cd-99c3-1dc622c7e75b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:20.682528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9947034a-73a3-48cd-99c3-1dc622c7e75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:20.693341 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1680/3325] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:20.694619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d4098-8cef-4f29-89f6-40ffea6d9de9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:20.695010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d4098-8cef-4f29-89f6-40ffea6d9de9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:20.695284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d4098-8cef-4f29-89f6-40ffea6d9de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:20.696101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:20.727200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-111d4098-8cef-4f29-89f6-40ffea6d9de9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:20.728718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-111d4098-8cef-4f29-89f6-40ffea6d9de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:20.739320 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1681/3326] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:20.740255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d4098-8cef-4f29-89f6-40ffea6d9de9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:20.755899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d4098-8cef-4f29-89f6-40ffea6d9de9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:20.761841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311279c-b035-4477-9067-4f769396e58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:20.762459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311279c-b035-4477-9067-4f769396e58b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:20.762736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311279c-b035-4477-9067-4f769396e58b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:20.763007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311279c-b035-4477-9067-4f769396e58b admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:20.763785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311279c-b035-4477-9067-4f769396e58b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:59:20.764090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311279c-b035-4477-9067-4f769396e58b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:20.766576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311279c-b035-4477-9067-4f769396e58b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:20.785248 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1682/3327] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:59:20.786198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311279c-b035-4477-9067-4f769396e58b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:20.803128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311279c-b035-4477-9067-4f769396e58b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:20.812095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248d277-8172-4b57-be64-ec298c2c144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:20.812757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d277-8172-4b57-be64-ec298c2c144f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:20.813034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d277-8172-4b57-be64-ec298c2c144f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:20.813339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d277-8172-4b57-be64-ec298c2c144f admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:20.813991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248d277-8172-4b57-be64-ec298c2c144f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:59:20.814293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248d277-8172-4b57-be64-ec298c2c144f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:20.816038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248d277-8172-4b57-be64-ec298c2c144f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:20.833413 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1683/3328] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 20:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:59:20.835828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248d277-8172-4b57-be64-ec298c2c144f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:20.852587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248d277-8172-4b57-be64-ec298c2c144f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:20.853996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e43cd-34f4-47d1-9c74-87983765b00d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:20.854899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e43cd-34f4-47d1-9c74-87983765b00d service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:20.854899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e43cd-34f4-47d1-9c74-87983765b00d service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:20.855153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e43cd-34f4-47d1-9c74-87983765b00d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:20.858049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-815e43cd-34f4-47d1-9c74-87983765b00d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:20.869592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463e4b4-f978-4b26-9ab0-2a7b04612cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:20.870133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463e4b4-f978-4b26-9ab0-2a7b04612cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:20.870330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e43cd-34f4-47d1-9c74-87983765b00d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:20.870460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463e4b4-f978-4b26-9ab0-2a7b04612cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:20.870721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463e4b4-f978-4b26-9ab0-2a7b04612cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:20.871291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463e4b4-f978-4b26-9ab0-2a7b04612cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:20.871927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e43cd-34f4-47d1-9c74-87983765b00d service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:20.873176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463e4b4-f978-4b26-9ab0-2a7b04612cc8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:20.888510 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1646/3329] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:20.889488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e43cd-34f4-47d1-9c74-87983765b00d service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:20.912756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e43cd-34f4-47d1-9c74-87983765b00d service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:20.923301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed20a85-d607-4e03-8913-a3c6644080cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:20.923927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20a85-d607-4e03-8913-a3c6644080cc admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:20.924949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20a85-d607-4e03-8913-a3c6644080cc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:20.925434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20a85-d607-4e03-8913-a3c6644080cc admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:20.926389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed20a85-d607-4e03-8913-a3c6644080cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:20.929348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed20a85-d607-4e03-8913-a3c6644080cc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:20.952945 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1684/3330] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:59:20 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:59:20.958222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463e4b4-f978-4b26-9ab0-2a7b04612cc8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:20.983402 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1647/3331] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:59:20 2022] POST /identity/v3/projects => generated 399 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:59:20.985156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed20a85-d607-4e03-8913-a3c6644080cc admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:21.128472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:21.168480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed20a85-d607-4e03-8913-a3c6644080cc admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:21.169925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463e4b4-f978-4b26-9ab0-2a7b04612cc8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:21.183863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c53f71-9811-409f-aa8b-f8fef68db54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:21.185097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c53f71-9811-409f-aa8b-f8fef68db54b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:21.185097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c53f71-9811-409f-aa8b-f8fef68db54b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:21.185348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c53f71-9811-409f-aa8b-f8fef68db54b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:21.185866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c53f71-9811-409f-aa8b-f8fef68db54b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:21.187548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960ba12-38da-4b27-be5a-3dba19a7c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:21.188886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c53f71-9811-409f-aa8b-f8fef68db54b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:21.189040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960ba12-38da-4b27-be5a-3dba19a7c48b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:21.189040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960ba12-38da-4b27-be5a-3dba19a7c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:21.189294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960ba12-38da-4b27-be5a-3dba19a7c48b admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:21.198227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960ba12-38da-4b27-be5a-3dba19a7c48b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:21.203209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960ba12-38da-4b27-be5a-3dba19a7c48b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:21.228573 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1685/3332] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:59:20 2022] POST /identity/v3/users => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:59:21.230126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c53f71-9811-409f-aa8b-f8fef68db54b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:21.263970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c53f71-9811-409f-aa8b-f8fef68db54b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:21.277320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483db84-463a-4e93-8a8a-3baecfc4f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:21.278032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483db84-463a-4e93-8a8a-3baecfc4f717 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:21.278378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483db84-463a-4e93-8a8a-3baecfc4f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:21.278655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483db84-463a-4e93-8a8a-3baecfc4f717 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:21.279473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483db84-463a-4e93-8a8a-3baecfc4f717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:21.287572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483db84-463a-4e93-8a8a-3baecfc4f717 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:21.288812 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1648/3333] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:59:20 2022] POST /identity/v3/users => generated 300 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:59:21.297834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960ba12-38da-4b27-be5a-3dba19a7c48b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:21.321029 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1686/3334] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:59:21.324722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483db84-463a-4e93-8a8a-3baecfc4f717 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:21.331637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960ba12-38da-4b27-be5a-3dba19a7c48b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:21.346903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483db84-463a-4e93-8a8a-3baecfc4f717 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:21.354485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3739f7-4f94-459e-995a-f433aabb7e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:21.356047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfafd0-7248-4ffc-866f-d13d52894b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:21.356821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3739f7-4f94-459e-995a-f433aabb7e4d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:21.357002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfafd0-7248-4ffc-866f-d13d52894b93 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:21.357371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfafd0-7248-4ffc-866f-d13d52894b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:21.357595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfafd0-7248-4ffc-866f-d13d52894b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:21.358081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3739f7-4f94-459e-995a-f433aabb7e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:21.358240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfafd0-7248-4ffc-866f-d13d52894b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:21.358815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3739f7-4f94-459e-995a-f433aabb7e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:21.360475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfafd0-7248-4ffc-866f-d13d52894b93 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:21.362201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3739f7-4f94-459e-995a-f433aabb7e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:21.364896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3739f7-4f94-459e-995a-f433aabb7e4d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:21.393211 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1687/3335] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:59:21.393836 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1649/3336] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:59:21.395725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfafd0-7248-4ffc-866f-d13d52894b93 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:21.396775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3739f7-4f94-459e-995a-f433aabb7e4d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:21.413593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfafd0-7248-4ffc-866f-d13d52894b93 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:21.427765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf4282-0e39-4638-b533-c8160e32b7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:21.428719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf4282-0e39-4638-b533-c8160e32b7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:21.429215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf4282-0e39-4638-b533-c8160e32b7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:21.429648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf4282-0e39-4638-b533-c8160e32b7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:21.430452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf4282-0e39-4638-b533-c8160e32b7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:21.431950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3739f7-4f94-459e-995a-f433aabb7e4d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:21.432470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf4282-0e39-4638-b533-c8160e32b7b0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:21.450188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6b3a7-4a51-4b41-8fed-93691918adf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:21.452720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6b3a7-4a51-4b41-8fed-93691918adf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:21.453243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6b3a7-4a51-4b41-8fed-93691918adf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:21.453695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6b3a7-4a51-4b41-8fed-93691918adf2 admin admin] PATH_INFO: `/v3/projects/0ffdae031c4f47d599acb30f1d3c87b9/users/5266cd6be4514b3eac30a195f6b25772/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:21.459675 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1688/3337] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:59:21.463447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf4282-0e39-4638-b533-c8160e32b7b0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:21.495533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf4282-0e39-4638-b533-c8160e32b7b0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:21.504485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6b3a7-4a51-4b41-8fed-93691918adf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ffdae031c4f47d599acb30f1d3c87b9, user_id=5266cd6be4514b3eac30a195f6b25772, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:21.510204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6b3a7-4a51-4b41-8fed-93691918adf2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:21.510588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff0e25-39b9-4879-bc1e-e1ab7ba3dc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:21.511483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff0e25-39b9-4879-bc1e-e1ab7ba3dc8d admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:21.511934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff0e25-39b9-4879-bc1e-e1ab7ba3dc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:21.512376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff0e25-39b9-4879-bc1e-e1ab7ba3dc8d admin admin] PATH_INFO: `/v3/projects/76b10172715d423eb887d6c5b171defb/users/f06caf10b6fa43a3a2ad34858594e329/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:21.553508 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1650/3338] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:59:21 2022] PUT /identity/v3/projects/0ffdae031c4f47d599acb30f1d3c87b9/users/5266cd6be4514b3eac30a195f6b25772/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:59:21.557412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff0e25-39b9-4879-bc1e-e1ab7ba3dc8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b10172715d423eb887d6c5b171defb, user_id=f06caf10b6fa43a3a2ad34858594e329, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:21.561819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff0e25-39b9-4879-bc1e-e1ab7ba3dc8d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:21.565389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da5487-45c6-4f5f-acc2-fa182e625dff None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:21.565861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da5487-45c6-4f5f-acc2-fa182e625dff None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:21.566296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da5487-45c6-4f5f-acc2-fa182e625dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:21.613783 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1689/3339] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:59:21 2022] PUT /identity/v3/projects/76b10172715d423eb887d6c5b171defb/users/f06caf10b6fa43a3a2ad34858594e329/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:59:21.621102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e3a2-bdf6-4380-8ca8-5bad836b3bed None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:21.621435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e3a2-bdf6-4380-8ca8-5bad836b3bed None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:21.625092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e3a2-bdf6-4380-8ca8-5bad836b3bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:21.646963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-93da5487-45c6-4f5f-acc2-fa182e625dff None None] MFA Rules not processed for user `5266cd6be4514b3eac30a195f6b25772`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:21.652807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-93da5487-45c6-4f5f-acc2-fa182e625dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:21.667997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0b64e3a2-bdf6-4380-8ca8-5bad836b3bed None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:21.670554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0b64e3a2-bdf6-4380-8ca8-5bad836b3bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:21.732477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:21.819096 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1651/3340] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:21.825807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da5487-45c6-4f5f-acc2-fa182e625dff None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:21.841315 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1690/3341] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:21.881546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64e3a2-bdf6-4380-8ca8-5bad836b3bed None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:21.881546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0b64e3a2-bdf6-4380-8ca8-5bad836b3bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:21.894513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da5487-45c6-4f5f-acc2-fa182e625dff None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:21.907153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94735db-bc5f-4369-830a-fca8127f9a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:21.908022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94735db-bc5f-4369-830a-fca8127f9a81 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:21.908022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94735db-bc5f-4369-830a-fca8127f9a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:21.909762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94735db-bc5f-4369-830a-fca8127f9a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:21.910046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94735db-bc5f-4369-830a-fca8127f9a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:21.920881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94735db-bc5f-4369-830a-fca8127f9a81 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:22.003136 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1652/3342] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 20:59:21 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:59:22.009775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94735db-bc5f-4369-830a-fca8127f9a81 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:22.040359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64e3a2-bdf6-4380-8ca8-5bad836b3bed None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:22.193929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94735db-bc5f-4369-830a-fca8127f9a81 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:22.200130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15e884-a343-43b3-b143-55b202ee5353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:22.200833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15e884-a343-43b3-b143-55b202ee5353 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:22.201127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15e884-a343-43b3-b143-55b202ee5353 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:22.201530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15e884-a343-43b3-b143-55b202ee5353 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:22.202185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15e884-a343-43b3-b143-55b202ee5353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:22.205315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15e884-a343-43b3-b143-55b202ee5353 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:22.241937 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1653/3343] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 20:59:22 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:59:22.245983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:22.248957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15e884-a343-43b3-b143-55b202ee5353 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:22.268359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15e884-a343-43b3-b143-55b202ee5353 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:22.276136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294131c-f71b-4c64-aab8-383d46d7c0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:22.278974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a035ca6-67b0-4468-8d7a-5f332e76d3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:22.279855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a035ca6-67b0-4468-8d7a-5f332e76d3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:22.280020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294131c-f71b-4c64-aab8-383d46d7c0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:22.280199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294131c-f71b-4c64-aab8-383d46d7c0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:22.281974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294131c-f71b-4c64-aab8-383d46d7c0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:22.282895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a035ca6-67b0-4468-8d7a-5f332e76d3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:22.283406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a035ca6-67b0-4468-8d7a-5f332e76d3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:22.284608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a035ca6-67b0-4468-8d7a-5f332e76d3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:22.290594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a035ca6-67b0-4468-8d7a-5f332e76d3f9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:22.316917 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1654/3344] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:59:22.320638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294131c-f71b-4c64-aab8-383d46d7c0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:22.321015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a035ca6-67b0-4468-8d7a-5f332e76d3f9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:22.323244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294131c-f71b-4c64-aab8-383d46d7c0d2 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:22.336808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a035ca6-67b0-4468-8d7a-5f332e76d3f9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:22.349958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e07990-4e80-409e-9bf2-af4a08ed30b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:22.350749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e07990-4e80-409e-9bf2-af4a08ed30b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:22.351100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e07990-4e80-409e-9bf2-af4a08ed30b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:22.351563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e07990-4e80-409e-9bf2-af4a08ed30b9 admin admin] PATH_INFO: `/v3/projects/6cbd4579af204aa6b396906ca1430d3c/users/82eecd716629401493db6a979b7887cf/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:22.354637 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1691/3345] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:59:22.403226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e07990-4e80-409e-9bf2-af4a08ed30b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cbd4579af204aa6b396906ca1430d3c, user_id=82eecd716629401493db6a979b7887cf, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:22.408805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e07990-4e80-409e-9bf2-af4a08ed30b9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:22.440590 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1655/3346] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:59:22 2022] PUT /identity/v3/projects/6cbd4579af204aa6b396906ca1430d3c/users/82eecd716629401493db6a979b7887cf/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:59:22.447722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294131c-f71b-4c64-aab8-383d46d7c0d2 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:22.497072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294131c-f71b-4c64-aab8-383d46d7c0d2 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:22.657456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133fc50-50ae-4cef-8f24-beda8b9994f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:22.659305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133fc50-50ae-4cef-8f24-beda8b9994f0 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:22.661068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133fc50-50ae-4cef-8f24-beda8b9994f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:22.661880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133fc50-50ae-4cef-8f24-beda8b9994f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:22.664794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133fc50-50ae-4cef-8f24-beda8b9994f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:22.669048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133fc50-50ae-4cef-8f24-beda8b9994f0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:22.701732 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1692/3347] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:59:22.708180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e07990-4e80-409e-9bf2-af4a08ed30b9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:22.729147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e07990-4e80-409e-9bf2-af4a08ed30b9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:22.741469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8dacb-ec4e-48f8-8789-f6f0fb1556ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:22.745525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8dacb-ec4e-48f8-8789-f6f0fb1556ee admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:22.745938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8dacb-ec4e-48f8-8789-f6f0fb1556ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:22.746223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8dacb-ec4e-48f8-8789-f6f0fb1556ee admin admin] PATH_INFO: `/v3/projects/6cbd4579af204aa6b396906ca1430d3c/users/82eecd716629401493db6a979b7887cf/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:22.753694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8dacb-ec4e-48f8-8789-f6f0fb1556ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cbd4579af204aa6b396906ca1430d3c, user_id=82eecd716629401493db6a979b7887cf, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:22.763374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8dacb-ec4e-48f8-8789-f6f0fb1556ee admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:22.833112 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1656/3348] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 20:59:22 2022] PUT /identity/v3/projects/6cbd4579af204aa6b396906ca1430d3c/users/82eecd716629401493db6a979b7887cf/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:59:22.846639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74455-d752-4c08-942b-4a886b282171 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:22.846991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74455-d752-4c08-942b-4a886b282171 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:22.848713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74455-d752-4c08-942b-4a886b282171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:22.926533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c5d74455-d752-4c08-942b-4a886b282171 None None] MFA Rules not processed for user `82eecd716629401493db6a979b7887cf`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:22.930946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c5d74455-d752-4c08-942b-4a886b282171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:23.146302 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1693/3349] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:23.165697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef9fe-a299-4d19-8ba5-aca4d5d1d142 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:23.166598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef9fe-a299-4d19-8ba5-aca4d5d1d142 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:23.167076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef9fe-a299-4d19-8ba5-aca4d5d1d142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:23.230584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-eb1ef9fe-a299-4d19-8ba5-aca4d5d1d142 None None] MFA Rules not processed for user `5266cd6be4514b3eac30a195f6b25772`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:23.234891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eb1ef9fe-a299-4d19-8ba5-aca4d5d1d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:23.344164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:23.377215 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1657/3350] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:23.393531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d74455-d752-4c08-942b-4a886b282171 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:23.395169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c5d74455-d752-4c08-942b-4a886b282171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:23.560563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:23.574447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d74455-d752-4c08-942b-4a886b282171 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:23.596652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1054f-306d-4db9-b557-486f9a3a2f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:23.599001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1054f-306d-4db9-b557-486f9a3a2f72 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:23.599297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1054f-306d-4db9-b557-486f9a3a2f72 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:23.600934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1054f-306d-4db9-b557-486f9a3a2f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:23.636495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1054f-306d-4db9-b557-486f9a3a2f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:23.639034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1054f-306d-4db9-b557-486f9a3a2f72 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:23.666944 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1694/3351] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:25.929671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ef9fe-a299-4d19-8ba5-aca4d5d1d142 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:25.931513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eb1ef9fe-a299-4d19-8ba5-aca4d5d1d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:26.178697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ef9fe-a299-4d19-8ba5-aca4d5d1d142 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:26.195438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af94cfd-bc95-46e3-9f61-dcd23d26a816 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:26.198305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af94cfd-bc95-46e3-9f61-dcd23d26a816 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:26.198631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af94cfd-bc95-46e3-9f61-dcd23d26a816 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:26.199035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af94cfd-bc95-46e3-9f61-dcd23d26a816 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:26.208171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5af94cfd-bc95-46e3-9f61-dcd23d26a816 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:26.242298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af94cfd-bc95-46e3-9f61-dcd23d26a816 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:26.247170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af94cfd-bc95-46e3-9f61-dcd23d26a816 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:26.284947 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1658/3352] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:27.801214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523bf5a-55fa-4964-9012-1278e25686b6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:27.801214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523bf5a-55fa-4964-9012-1278e25686b6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:27.801214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523bf5a-55fa-4964-9012-1278e25686b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:27.883663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2523bf5a-55fa-4964-9012-1278e25686b6 None None] MFA Rules not processed for user `6bee8de1c3524b0f8a0dd73898637aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:27.884972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2523bf5a-55fa-4964-9012-1278e25686b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:28.170691 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1695/3353] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:28.182162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f29af-0ba8-48cb-a806-55a5abb7ebd3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:28.182704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f29af-0ba8-48cb-a806-55a5abb7ebd3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:28.182704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f29af-0ba8-48cb-a806-55a5abb7ebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:28.255845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-807f29af-0ba8-48cb-a806-55a5abb7ebd3 None None] MFA Rules not processed for user `6bee8de1c3524b0f8a0dd73898637aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:28.257454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-807f29af-0ba8-48cb-a806-55a5abb7ebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:28.285854 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1659/3354] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:28.294400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523bf5a-55fa-4964-9012-1278e25686b6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:28.297687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2523bf5a-55fa-4964-9012-1278e25686b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:28.367739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523bf5a-55fa-4964-9012-1278e25686b6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:28.388226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8850-788f-45bc-b06a-74945b7d4f20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:28.389715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8850-788f-45bc-b06a-74945b7d4f20 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:28.390957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8850-788f-45bc-b06a-74945b7d4f20 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:28.391680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8850-788f-45bc-b06a-74945b7d4f20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:28.408010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b8850-788f-45bc-b06a-74945b7d4f20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:28.414861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b8850-788f-45bc-b06a-74945b7d4f20 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:28.449712 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1696/3355] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:28 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:28.525359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20a124-b5a0-4b1e-a8a7-ee15d5021cc3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:28.525359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20a124-b5a0-4b1e-a8a7-ee15d5021cc3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:28.525359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20a124-b5a0-4b1e-a8a7-ee15d5021cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:28.587231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ab20a124-b5a0-4b1e-a8a7-ee15d5021cc3 None None] MFA Rules not processed for user `fb0f01bd824f47bdbb676f945f6462fb`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:28.589949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ab20a124-b5a0-4b1e-a8a7-ee15d5021cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:28.884422 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1660/3356] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:29.246362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8850-788f-45bc-b06a-74945b7d4f20 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:29.263428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8850-788f-45bc-b06a-74945b7d4f20 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:29.279084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe63c57-5757-4c74-8ea3-ea7a36222c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:29.279742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe63c57-5757-4c74-8ea3-ea7a36222c47 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:29.280144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe63c57-5757-4c74-8ea3-ea7a36222c47 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:29.280434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe63c57-5757-4c74-8ea3-ea7a36222c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:29.283777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ebe63c57-5757-4c74-8ea3-ea7a36222c47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:29.411682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886d842-d181-40fa-bc66-401b9834941e None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:29.412726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886d842-d181-40fa-bc66-401b9834941e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:29.413451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886d842-d181-40fa-bc66-401b9834941e None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:29.416895 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1661/3357] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 20:59:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:59:29.425971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805ab2c-9c30-4fa6-a67f-ab22be866d85 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:29.426715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805ab2c-9c30-4fa6-a67f-ab22be866d85 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:29.427346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805ab2c-9c30-4fa6-a67f-ab22be866d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:29.429665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe63c57-5757-4c74-8ea3-ea7a36222c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:29.434267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe63c57-5757-4c74-8ea3-ea7a36222c47 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:29.455511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d805ab2c-9c30-4fa6-a67f-ab22be866d85 None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:29.458742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d805ab2c-9c30-4fa6-a67f-ab22be866d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:29.460206 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1697/3358] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:29.645804 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1662/3359] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 20:59:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:59:29.707962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe63c57-5757-4c74-8ea3-ea7a36222c47 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:29.715313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ebe63c57-5757-4c74-8ea3-ea7a36222c47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:29.756773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe63c57-5757-4c74-8ea3-ea7a36222c47 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:29.771344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f750f-74d9-4c5c-9701-8fbbc279405d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:29.773083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f750f-74d9-4c5c-9701-8fbbc279405d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:29.774024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f750f-74d9-4c5c-9701-8fbbc279405d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:29.775030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f750f-74d9-4c5c-9701-8fbbc279405d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:29.788230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f750f-74d9-4c5c-9701-8fbbc279405d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:29.790907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f750f-74d9-4c5c-9701-8fbbc279405d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:29.822271 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1698/3360] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:32.335446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fc27a-31e2-4199-bb2c-f9e8154a06e1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:32.335937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fc27a-31e2-4199-bb2c-f9e8154a06e1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:32.336195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fc27a-31e2-4199-bb2c-f9e8154a06e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:32.396219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:32.415315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4d7fc27a-31e2-4199-bb2c-f9e8154a06e1 None None] MFA Rules not processed for user `1698dee4a2bf4ea19a6ee0c3d5cb5c09`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:32.420922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4d7fc27a-31e2-4199-bb2c-f9e8154a06e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:32.725290 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1663/3361] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:32.727857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15bf3a-659c-4941-8b5e-c8bf3a7962fd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:32.728483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15bf3a-659c-4941-8b5e-c8bf3a7962fd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:32.728483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15bf3a-659c-4941-8b5e-c8bf3a7962fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:32.797069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1f15bf3a-659c-4941-8b5e-c8bf3a7962fd None None] MFA Rules not processed for user `1698dee4a2bf4ea19a6ee0c3d5cb5c09`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:32.798399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1f15bf3a-659c-4941-8b5e-c8bf3a7962fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:32.831610 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1699/3362] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:32.844611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fc27a-31e2-4199-bb2c-f9e8154a06e1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:32.874127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fc27a-31e2-4199-bb2c-f9e8154a06e1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:32.889492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df8fc8-a172-476d-a959-71420431f86e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:32.890719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df8fc8-a172-476d-a959-71420431f86e service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:32.891048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df8fc8-a172-476d-a959-71420431f86e service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:32.891332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df8fc8-a172-476d-a959-71420431f86e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:32.911040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df8fc8-a172-476d-a959-71420431f86e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:32.912713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df8fc8-a172-476d-a959-71420431f86e service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:32.942303 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1664/3363] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:32 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:36.472331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812ce3-2013-4824-bfa6-e6db9c5c4c0a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:36.472876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812ce3-2013-4824-bfa6-e6db9c5c4c0a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:36.472876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812ce3-2013-4824-bfa6-e6db9c5c4c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:36.548180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-57812ce3-2013-4824-bfa6-e6db9c5c4c0a None None] MFA Rules not processed for user `1698dee4a2bf4ea19a6ee0c3d5cb5c09`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:36.549534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-57812ce3-2013-4824-bfa6-e6db9c5c4c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:36.580807 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1700/3364] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:36.941655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305d73d-4cb6-4f74-ad71-a019e6530a0e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:36.942137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305d73d-4cb6-4f74-ad71-a019e6530a0e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:36.942355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305d73d-4cb6-4f74-ad71-a019e6530a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:36.987418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d305d73d-4cb6-4f74-ad71-a019e6530a0e None None] MFA Rules not processed for user `3d2ddfa343e748c089129b0039a12ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:36.990682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d305d73d-4cb6-4f74-ad71-a019e6530a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:37.005555 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1665/3365] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:46.522079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=82 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:46.977224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=36 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:48.037294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48c70-115e-48cb-b461-b385211859bc None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:48.038394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48c70-115e-48cb-b461-b385211859bc None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:48.038679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48c70-115e-48cb-b461-b385211859bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:48.131139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3cf48c70-115e-48cb-b461-b385211859bc None None] MFA Rules not processed for user `f06caf10b6fa43a3a2ad34858594e329`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:48.135200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3cf48c70-115e-48cb-b461-b385211859bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:48.300319 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1701/3366] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:48.313005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21980f3c-5e47-47e8-a700-44ee4ed98442 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:48.314409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21980f3c-5e47-47e8-a700-44ee4ed98442 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:48.315034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21980f3c-5e47-47e8-a700-44ee4ed98442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:48.351482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-21980f3c-5e47-47e8-a700-44ee4ed98442 None None] MFA Rules not processed for user `f06caf10b6fa43a3a2ad34858594e329`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:48.353389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-21980f3c-5e47-47e8-a700-44ee4ed98442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:48.369330 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1666/3367] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:48.384137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf48c70-115e-48cb-b461-b385211859bc None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:48.404537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf48c70-115e-48cb-b461-b385211859bc None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:48.415059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd476353-8f80-4056-a9b1-e37c2b91b8cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:48.416038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd476353-8f80-4056-a9b1-e37c2b91b8cd service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:48.416527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd476353-8f80-4056-a9b1-e37c2b91b8cd service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:48.416890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd476353-8f80-4056-a9b1-e37c2b91b8cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:48.427958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd476353-8f80-4056-a9b1-e37c2b91b8cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:48.430377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd476353-8f80-4056-a9b1-e37c2b91b8cd service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:48.450209 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1702/3368] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:50.071792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bfad5-3fad-41c7-aab5-e7320a106185 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:50.072590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bfad5-3fad-41c7-aab5-e7320a106185 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:50.073016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bfad5-3fad-41c7-aab5-e7320a106185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:50.096636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8c6bfad5-3fad-41c7-aab5-e7320a106185 None None] MFA Rules not processed for user `67ddc3cd3c374bacbe5bf5e0877380e2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:59:50.098375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8c6bfad5-3fad-41c7-aab5-e7320a106185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:50.178119 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1667/3369] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:59:51.318686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd476353-8f80-4056-a9b1-e37c2b91b8cd service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:51.335923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd476353-8f80-4056-a9b1-e37c2b91b8cd service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:51.351096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d1d77-4de5-4052-83d8-f5359af20a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:51.351915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d1d77-4de5-4052-83d8-f5359af20a7a service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:51.352194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d1d77-4de5-4052-83d8-f5359af20a7a service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:51.352617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d1d77-4de5-4052-83d8-f5359af20a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:51.379210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d1d77-4de5-4052-83d8-f5359af20a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:51.381524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d1d77-4de5-4052-83d8-f5359af20a7a service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:51.402604 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1703/3370] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:59:52.402131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bfad5-3fad-41c7-aab5-e7320a106185 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:52.405379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8c6bfad5-3fad-41c7-aab5-e7320a106185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:52.429078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bfad5-3fad-41c7-aab5-e7320a106185 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:52.437121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cbee4-68e2-4b50-b697-8ff88c330391 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:52.438023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cbee4-68e2-4b50-b697-8ff88c330391 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:52.438613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cbee4-68e2-4b50-b697-8ff88c330391 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:52.439032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cbee4-68e2-4b50-b697-8ff88c330391 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:52.443095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5c2cbee4-68e2-4b50-b697-8ff88c330391 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:52.462428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cbee4-68e2-4b50-b697-8ff88c330391 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:52.467970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cbee4-68e2-4b50-b697-8ff88c330391 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:52.533737 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1668/3371] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:52.994834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d1d77-4de5-4052-83d8-f5359af20a7a service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:53.011333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d1d77-4de5-4052-83d8-f5359af20a7a service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:53.023152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9169dea-03fc-4c5f-8e44-90f99f14745c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:53.024665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9169dea-03fc-4c5f-8e44-90f99f14745c service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:53.025580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9169dea-03fc-4c5f-8e44-90f99f14745c service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:53.026225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9169dea-03fc-4c5f-8e44-90f99f14745c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:53.029464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a9169dea-03fc-4c5f-8e44-90f99f14745c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:53.044932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9169dea-03fc-4c5f-8e44-90f99f14745c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:53.046785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9169dea-03fc-4c5f-8e44-90f99f14745c service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:53.058624 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1704/3372] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:59:53.207862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cbee4-68e2-4b50-b697-8ff88c330391 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:59:53.226861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cbee4-68e2-4b50-b697-8ff88c330391 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:59:53.236559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c26339-be6c-4a93-af8b-1caa75b535aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:59:53.238310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c26339-be6c-4a93-af8b-1caa75b535aa service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:59:53.238849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c26339-be6c-4a93-af8b-1caa75b535aa service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:59:53.239518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c26339-be6c-4a93-af8b-1caa75b535aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:59:53.242395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c4c26339-be6c-4a93-af8b-1caa75b535aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:59:53.262864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c26339-be6c-4a93-af8b-1caa75b535aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:59:53.264575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c26339-be6c-4a93-af8b-1caa75b535aa service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:59:53.278855 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1669/3373] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 20:59:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:00:03.053383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=50 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:03.272067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=40 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:06.774883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9169dea-03fc-4c5f-8e44-90f99f14745c service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:06.793553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9169dea-03fc-4c5f-8e44-90f99f14745c service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:06.800545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da8aed-1f5a-4dea-999a-0eff9a394f4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:06.801418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da8aed-1f5a-4dea-999a-0eff9a394f4b service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:06.801860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da8aed-1f5a-4dea-999a-0eff9a394f4b service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:06.802202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da8aed-1f5a-4dea-999a-0eff9a394f4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:06.804313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-09da8aed-1f5a-4dea-999a-0eff9a394f4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:06.820599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da8aed-1f5a-4dea-999a-0eff9a394f4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:06.823295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da8aed-1f5a-4dea-999a-0eff9a394f4b service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:06.839544 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1705/3374] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:00:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:00:06.872456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c26339-be6c-4a93-af8b-1caa75b535aa service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:06.875797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c4c26339-be6c-4a93-af8b-1caa75b535aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:06.961518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c26339-be6c-4a93-af8b-1caa75b535aa service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:06.966174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cfd31-e7c4-4960-932b-29ea50a08e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:06.967413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cfd31-e7c4-4960-932b-29ea50a08e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:06.967689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cfd31-e7c4-4960-932b-29ea50a08e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:06.968089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cfd31-e7c4-4960-932b-29ea50a08e00 admin admin] PATH_INFO: `/v3/users/6bee8de1c3524b0f8a0dd73898637aa7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:06.969259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cfd31-e7c4-4960-932b-29ea50a08e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bee8de1c3524b0f8a0dd73898637aa7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:06.971159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cfd31-e7c4-4960-932b-29ea50a08e00 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:07.028083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c28cfd31-e7c4-4960-932b-29ea50a08e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bee8de1c3524b0f8a0dd73898637aa7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:07.035908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c28cfd31-e7c4-4960-932b-29ea50a08e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bee8de1c3524b0f8a0dd73898637aa7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:07.036656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c28cfd31-e7c4-4960-932b-29ea50a08e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bee8de1c3524b0f8a0dd73898637aa7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:07.037166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c28cfd31-e7c4-4960-932b-29ea50a08e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bee8de1c3524b0f8a0dd73898637aa7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:07.050173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c28cfd31-e7c4-4960-932b-29ea50a08e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bee8de1c3524b0f8a0dd73898637aa7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:07.066505 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1670/3375] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:00:06 2022] DELETE /identity/v3/users/6bee8de1c3524b0f8a0dd73898637aa7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:00:07.385759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da8aed-1f5a-4dea-999a-0eff9a394f4b service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:07.399021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da8aed-1f5a-4dea-999a-0eff9a394f4b service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:07.486318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:07.486959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:07.487235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:07.487506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4 admin admin] PATH_INFO: `/v3/projects/de0921d976db440c8f59ba2f065642a0` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:07.488829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0921d976db440c8f59ba2f065642a0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:07.490741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:07.549525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0921d976db440c8f59ba2f065642a0', 'request_id': 'req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:07.559429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0921d976db440c8f59ba2f065642a0', 'request_id': 'req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:07.566943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0921d976db440c8f59ba2f065642a0', 'request_id': 'req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:07.581475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4 admin admin] The token cache is being invalidate because project de0921d976db440c8f59ba2f065642a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:00:07.581883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:07.582757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cf64dfa9-ea0e-4d5a-8788-a1ae95348dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:07.584303 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1706/3376] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:00:07 2022] DELETE /identity/v3/projects/de0921d976db440c8f59ba2f065642a0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:00:07.589654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ec923-4953-4f9c-9256-9c48f8488fe3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:07.590148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ec923-4953-4f9c-9256-9c48f8488fe3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:07.590413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ec923-4953-4f9c-9256-9c48f8488fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:07.625451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cc8ec923-4953-4f9c-9256-9c48f8488fe3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:07.626977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cc8ec923-4953-4f9c-9256-9c48f8488fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:07.713099 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1671/3377] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:00:07.722693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171bff3-1cd7-431a-ba32-938091970783 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:07.723224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171bff3-1cd7-431a-ba32-938091970783 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:07.723622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171bff3-1cd7-431a-ba32-938091970783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:07.764342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9171bff3-1cd7-431a-ba32-938091970783 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:07.766119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9171bff3-1cd7-431a-ba32-938091970783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:07.774787 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1707/3378] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:00:07.780219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ec923-4953-4f9c-9256-9c48f8488fe3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:07.794081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ec923-4953-4f9c-9256-9c48f8488fe3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:07.801640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415a000-38fa-442b-9a6c-1327852ba4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:07.802644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415a000-38fa-442b-9a6c-1327852ba4be admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:07.803075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415a000-38fa-442b-9a6c-1327852ba4be admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:07.803498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415a000-38fa-442b-9a6c-1327852ba4be admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:07.804304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415a000-38fa-442b-9a6c-1327852ba4be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:00:07.805452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415a000-38fa-442b-9a6c-1327852ba4be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:07.807140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415a000-38fa-442b-9a6c-1327852ba4be admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:07.823600 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1672/3379] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:00:07.828788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171bff3-1cd7-431a-ba32-938091970783 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:07.851753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171bff3-1cd7-431a-ba32-938091970783 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:07.859893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87dfb3-d2bf-4444-9e20-7b49567d114b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:07.860645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87dfb3-d2bf-4444-9e20-7b49567d114b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:07.861097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87dfb3-d2bf-4444-9e20-7b49567d114b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:07.861586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87dfb3-d2bf-4444-9e20-7b49567d114b admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:07.862359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87dfb3-d2bf-4444-9e20-7b49567d114b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:07.864529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87dfb3-d2bf-4444-9e20-7b49567d114b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:07.897220 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1708/3380] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:00:07 2022] POST /identity/v3/projects => generated 391 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:00:07.901484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415a000-38fa-442b-9a6c-1327852ba4be admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:07.912747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415a000-38fa-442b-9a6c-1327852ba4be admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:07.916839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:07.982735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46d7cc-7dd5-4bef-965f-4d1eab32bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:07.983353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d7cc-7dd5-4bef-965f-4d1eab32bca0 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:07.983838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d7cc-7dd5-4bef-965f-4d1eab32bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:07.984134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d7cc-7dd5-4bef-965f-4d1eab32bca0 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:07.984862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46d7cc-7dd5-4bef-965f-4d1eab32bca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:07.987564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46d7cc-7dd5-4bef-965f-4d1eab32bca0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:08.017244 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1673/3381] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:00:07 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:00:08.021697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87dfb3-d2bf-4444-9e20-7b49567d114b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:08.036523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87dfb3-d2bf-4444-9e20-7b49567d114b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:08.042909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807465ac-8343-465a-a7cd-4928d22e24c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:08.044107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807465ac-8343-465a-a7cd-4928d22e24c5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:08.045080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807465ac-8343-465a-a7cd-4928d22e24c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:08.045551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807465ac-8343-465a-a7cd-4928d22e24c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:08.046378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807465ac-8343-465a-a7cd-4928d22e24c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:08.048146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807465ac-8343-465a-a7cd-4928d22e24c5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:08.063794 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1709/3382] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:00:08.067887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46d7cc-7dd5-4bef-965f-4d1eab32bca0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:08.081538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46d7cc-7dd5-4bef-965f-4d1eab32bca0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:08.086487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e66184-aa66-48e6-bcd7-36ae94e38a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:08.087271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e66184-aa66-48e6-bcd7-36ae94e38a89 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:08.087761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e66184-aa66-48e6-bcd7-36ae94e38a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:08.088074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e66184-aa66-48e6-bcd7-36ae94e38a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:08.089205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e66184-aa66-48e6-bcd7-36ae94e38a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:08.092672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e66184-aa66-48e6-bcd7-36ae94e38a89 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:08.108464 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1674/3383] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:00:08.108713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807465ac-8343-465a-a7cd-4928d22e24c5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:08.141273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807465ac-8343-465a-a7cd-4928d22e24c5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:08.166371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0250b-ace4-4017-83d4-d4c3d545b626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:08.167672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0250b-ace4-4017-83d4-d4c3d545b626 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:08.168075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0250b-ace4-4017-83d4-d4c3d545b626 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:08.168770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0250b-ace4-4017-83d4-d4c3d545b626 admin admin] PATH_INFO: `/v3/projects/ac791938e6384c8c8473ffd65cf867a8/users/463a3aac627c43d7af0dbc9facb52076/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:08.200153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0250b-ace4-4017-83d4-d4c3d545b626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac791938e6384c8c8473ffd65cf867a8, user_id=463a3aac627c43d7af0dbc9facb52076, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:08.204393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0250b-ace4-4017-83d4-d4c3d545b626 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:08.225020 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1710/3384] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:00:08 2022] PUT /identity/v3/projects/ac791938e6384c8c8473ffd65cf867a8/users/463a3aac627c43d7af0dbc9facb52076/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:00:08.231055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7366f2-e9f0-4555-8093-30db0acc0557 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:08.231403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7366f2-e9f0-4555-8093-30db0acc0557 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:08.231777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7366f2-e9f0-4555-8093-30db0acc0557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:08.256131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6b7366f2-e9f0-4555-8093-30db0acc0557 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:08.257518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6b7366f2-e9f0-4555-8093-30db0acc0557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:08.342309 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1675/3385] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:00:08.353472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0250b-ace4-4017-83d4-d4c3d545b626 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:08.355536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c9c0250b-ace4-4017-83d4-d4c3d545b626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:08.373367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:08.436227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0250b-ace4-4017-83d4-d4c3d545b626 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:08.441334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb464e2e-4453-48d5-8eeb-71789136201d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:08.441334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464e2e-4453-48d5-8eeb-71789136201d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:08.441334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464e2e-4453-48d5-8eeb-71789136201d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:08.441634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464e2e-4453-48d5-8eeb-71789136201d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:08.453696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb464e2e-4453-48d5-8eeb-71789136201d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:08.455285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb464e2e-4453-48d5-8eeb-71789136201d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:08.467179 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1711/3386] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:00:09.130951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf4d04-11d0-454b-9811-e2fe5ee1e0da None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:09.131457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf4d04-11d0-454b-9811-e2fe5ee1e0da None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:09.132134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf4d04-11d0-454b-9811-e2fe5ee1e0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:09.190248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1abf4d04-11d0-454b-9811-e2fe5ee1e0da None None] MFA Rules not processed for user `67ddc3cd3c374bacbe5bf5e0877380e2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:09.194272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1abf4d04-11d0-454b-9811-e2fe5ee1e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:09.324976 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1676/3387] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:00:16.641886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa38f9-7a75-4390-bd7c-2e299104664d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:16.642862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa38f9-7a75-4390-bd7c-2e299104664d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:16.643912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa38f9-7a75-4390-bd7c-2e299104664d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:16.707129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-eaaa38f9-7a75-4390-bd7c-2e299104664d None None] MFA Rules not processed for user `463a3aac627c43d7af0dbc9facb52076`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:16.708375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eaaa38f9-7a75-4390-bd7c-2e299104664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:16.797867 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1712/3388] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:00:16.803869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff445b-01aa-4242-88d1-5a549e9a02fb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:16.804839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff445b-01aa-4242-88d1-5a549e9a02fb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:16.805327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff445b-01aa-4242-88d1-5a549e9a02fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:16.826246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6aff445b-01aa-4242-88d1-5a549e9a02fb None None] MFA Rules not processed for user `463a3aac627c43d7af0dbc9facb52076`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:16.827573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6aff445b-01aa-4242-88d1-5a549e9a02fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:16.869703 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1677/3389] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:00:16.880088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa38f9-7a75-4390-bd7c-2e299104664d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:16.881593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eaaa38f9-7a75-4390-bd7c-2e299104664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:17.097332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa38f9-7a75-4390-bd7c-2e299104664d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:17.103461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1af4a-f4d5-46c1-8137-0f0274fd7a54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:17.104099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1af4a-f4d5-46c1-8137-0f0274fd7a54 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:17.104422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1af4a-f4d5-46c1-8137-0f0274fd7a54 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:17.104742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1af4a-f4d5-46c1-8137-0f0274fd7a54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:17.119545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1af4a-f4d5-46c1-8137-0f0274fd7a54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:17.121251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1af4a-f4d5-46c1-8137-0f0274fd7a54 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:17.132551 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1713/3390] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:00:25.551165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182941a-722f-4967-a0e4-e89907182a4f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:25.551724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182941a-722f-4967-a0e4-e89907182a4f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:25.551724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182941a-722f-4967-a0e4-e89907182a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:25.616303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0182941a-722f-4967-a0e4-e89907182a4f None None] MFA Rules not processed for user `f06caf10b6fa43a3a2ad34858594e329`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:25.626826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0182941a-722f-4967-a0e4-e89907182a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:25.670093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:25.764388 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1678/3391] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:00:27.127663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:35.608021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b21fb-7810-4b68-8710-359e6c080751 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:35.609121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b21fb-7810-4b68-8710-359e6c080751 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:35.609735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b21fb-7810-4b68-8710-359e6c080751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:35.633566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-584b21fb-7810-4b68-8710-359e6c080751 None None] MFA Rules not processed for user `5266cd6be4514b3eac30a195f6b25772`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:35.634758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-584b21fb-7810-4b68-8710-359e6c080751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:35.728680 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1714/3392] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:00:35.744201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=14 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:37.610566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182941a-722f-4967-a0e4-e89907182a4f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:37.613418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0182941a-722f-4967-a0e4-e89907182a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:37.705550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b21fb-7810-4b68-8710-359e6c080751 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:37.708127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-584b21fb-7810-4b68-8710-359e6c080751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:37.711695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182941a-722f-4967-a0e4-e89907182a4f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:37.718820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbb83e-e648-4c14-879c-bcb6b70528ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:37.719485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbb83e-e648-4c14-879c-bcb6b70528ce service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:37.719839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbb83e-e648-4c14-879c-bcb6b70528ce service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:37.720148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbb83e-e648-4c14-879c-bcb6b70528ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:37.722102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dcfbb83e-e648-4c14-879c-bcb6b70528ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:37.734224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b21fb-7810-4b68-8710-359e6c080751 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:37.736733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbb83e-e648-4c14-879c-bcb6b70528ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:37.738459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbb83e-e648-4c14-879c-bcb6b70528ce service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:37.741265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d46bd-c793-4828-963e-c7d080eb484a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:37.742004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d46bd-c793-4828-963e-c7d080eb484a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:37.742615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d46bd-c793-4828-963e-c7d080eb484a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:37.743310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d46bd-c793-4828-963e-c7d080eb484a admin admin] PATH_INFO: `/v3/users/3d96135705514061bef9306753143357` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:37.746285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d46bd-c793-4828-963e-c7d080eb484a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d96135705514061bef9306753143357)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:37.750057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d46bd-c793-4828-963e-c7d080eb484a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:37.764644 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1679/3393] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:00:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:00:37.838673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-062d46bd-c793-4828-963e-c7d080eb484a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d96135705514061bef9306753143357'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:37.849433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-062d46bd-c793-4828-963e-c7d080eb484a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d96135705514061bef9306753143357'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:37.850623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-062d46bd-c793-4828-963e-c7d080eb484a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d96135705514061bef9306753143357'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:37.851363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-062d46bd-c793-4828-963e-c7d080eb484a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d96135705514061bef9306753143357'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:37.872147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-062d46bd-c793-4828-963e-c7d080eb484a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d96135705514061bef9306753143357'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:37.889499 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1715/3394] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:00:37 2022] DELETE /identity/v3/users/3d96135705514061bef9306753143357 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:00:38.101738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbb83e-e648-4c14-879c-bcb6b70528ce service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:38.118243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbb83e-e648-4c14-879c-bcb6b70528ce service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:38.234263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c5bde-f354-493a-a1eb-6b7455fbfacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:38.234905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c5bde-f354-493a-a1eb-6b7455fbfacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:38.235188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c5bde-f354-493a-a1eb-6b7455fbfacd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:38.235459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c5bde-f354-493a-a1eb-6b7455fbfacd admin admin] PATH_INFO: `/v3/projects/a82999f8bc36455bafd8eed23c68e733` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:38.236566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c5bde-f354-493a-a1eb-6b7455fbfacd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a82999f8bc36455bafd8eed23c68e733)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:38.238484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c5bde-f354-493a-a1eb-6b7455fbfacd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:38.285546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d73c5bde-f354-493a-a1eb-6b7455fbfacd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a82999f8bc36455bafd8eed23c68e733', 'request_id': 'req-d73c5bde-f354-493a-a1eb-6b7455fbfacd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:38.292673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d73c5bde-f354-493a-a1eb-6b7455fbfacd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a82999f8bc36455bafd8eed23c68e733', 'request_id': 'req-d73c5bde-f354-493a-a1eb-6b7455fbfacd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:38.298996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d73c5bde-f354-493a-a1eb-6b7455fbfacd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a82999f8bc36455bafd8eed23c68e733', 'request_id': 'req-d73c5bde-f354-493a-a1eb-6b7455fbfacd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:38.310465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d73c5bde-f354-493a-a1eb-6b7455fbfacd admin admin] The token cache is being invalidate because project a82999f8bc36455bafd8eed23c68e733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:00:38.310748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d73c5bde-f354-493a-a1eb-6b7455fbfacd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:38.311388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d73c5bde-f354-493a-a1eb-6b7455fbfacd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:00:38.312839 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1680/3395] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:00:38 2022] DELETE /identity/v3/projects/a82999f8bc36455bafd8eed23c68e733 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:00:38.317908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b01f6-ba14-4907-a85e-6e5c500e9915 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:38.318193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b01f6-ba14-4907-a85e-6e5c500e9915 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:38.318464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b01f6-ba14-4907-a85e-6e5c500e9915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:38.339102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fd7b01f6-ba14-4907-a85e-6e5c500e9915 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:38.340305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fd7b01f6-ba14-4907-a85e-6e5c500e9915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:38.405471 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1716/3396] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:00:38.412818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e0d02-81fd-4f80-8000-24a903a74c6b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:38.413100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e0d02-81fd-4f80-8000-24a903a74c6b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:38.413402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e0d02-81fd-4f80-8000-24a903a74c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:38.435439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-179e0d02-81fd-4f80-8000-24a903a74c6b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:38.436656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-179e0d02-81fd-4f80-8000-24a903a74c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:38.448712 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1681/3397] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:00:38.449907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b01f6-ba14-4907-a85e-6e5c500e9915 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:38.461514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b01f6-ba14-4907-a85e-6e5c500e9915 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:38.467854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd506738-82e2-44b4-9f80-208dbc95bf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:38.468469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd506738-82e2-44b4-9f80-208dbc95bf71 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:38.468749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd506738-82e2-44b4-9f80-208dbc95bf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:38.469021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd506738-82e2-44b4-9f80-208dbc95bf71 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:38.469888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd506738-82e2-44b4-9f80-208dbc95bf71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:00:38.470082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd506738-82e2-44b4-9f80-208dbc95bf71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:38.471914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd506738-82e2-44b4-9f80-208dbc95bf71 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:38.497853 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1717/3398] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:00:38.500159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e0d02-81fd-4f80-8000-24a903a74c6b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:38.509728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e0d02-81fd-4f80-8000-24a903a74c6b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:38.514642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda1a02-ff84-407f-a30f-55e42131a733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:38.515267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda1a02-ff84-407f-a30f-55e42131a733 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:38.515544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda1a02-ff84-407f-a30f-55e42131a733 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:38.515813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda1a02-ff84-407f-a30f-55e42131a733 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:38.516448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda1a02-ff84-407f-a30f-55e42131a733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:38.518378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda1a02-ff84-407f-a30f-55e42131a733 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:38.530120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:38.552281 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1682/3399] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:00:38 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:00:38.553521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd506738-82e2-44b4-9f80-208dbc95bf71 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:38.560320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:38.563834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd506738-82e2-44b4-9f80-208dbc95bf71 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:38.628285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5674eba-bd87-456e-8982-3ff19cdf949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:38.628898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5674eba-bd87-456e-8982-3ff19cdf949b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:38.629174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5674eba-bd87-456e-8982-3ff19cdf949b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:38.629477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5674eba-bd87-456e-8982-3ff19cdf949b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:38.630121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5674eba-bd87-456e-8982-3ff19cdf949b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:38.632014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5674eba-bd87-456e-8982-3ff19cdf949b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:38.654999 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1718/3400] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:00:38 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:00:38.659414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda1a02-ff84-407f-a30f-55e42131a733 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:38.670794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda1a02-ff84-407f-a30f-55e42131a733 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:38.675744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00fe86-3ad8-4c13-a554-5243de44b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:38.676544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00fe86-3ad8-4c13-a554-5243de44b751 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:38.676932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00fe86-3ad8-4c13-a554-5243de44b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:38.677230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00fe86-3ad8-4c13-a554-5243de44b751 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:38.677875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00fe86-3ad8-4c13-a554-5243de44b751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:38.679445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00fe86-3ad8-4c13-a554-5243de44b751 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:38.690543 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1683/3401] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:00:38.694485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5674eba-bd87-456e-8982-3ff19cdf949b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:38.709548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5674eba-bd87-456e-8982-3ff19cdf949b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:38.716032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bcdf1-3c9b-4e0e-8f79-d8cd7bf6f605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:38.716934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bcdf1-3c9b-4e0e-8f79-d8cd7bf6f605 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:38.717356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bcdf1-3c9b-4e0e-8f79-d8cd7bf6f605 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:38.722427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bcdf1-3c9b-4e0e-8f79-d8cd7bf6f605 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:38.723195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bcdf1-3c9b-4e0e-8f79-d8cd7bf6f605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:38.725450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bcdf1-3c9b-4e0e-8f79-d8cd7bf6f605 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:38.741341 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1719/3402] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:00:38.747141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00fe86-3ad8-4c13-a554-5243de44b751 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:38.759214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00fe86-3ad8-4c13-a554-5243de44b751 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:38.767479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeee53a-5552-440c-95f7-8edd4bdde76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:38.768216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee53a-5552-440c-95f7-8edd4bdde76a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:38.768568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee53a-5552-440c-95f7-8edd4bdde76a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:38.768928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee53a-5552-440c-95f7-8edd4bdde76a admin admin] PATH_INFO: `/v3/projects/ad3679a59b504731b5f56e52788fd645/users/56c7aebdf00342b1ba80833663f8c0a9/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:38.785710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeee53a-5552-440c-95f7-8edd4bdde76a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3679a59b504731b5f56e52788fd645, user_id=56c7aebdf00342b1ba80833663f8c0a9, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:38.788340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeee53a-5552-440c-95f7-8edd4bdde76a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:38.808562 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1684/3403] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:00:38 2022] PUT /identity/v3/projects/ad3679a59b504731b5f56e52788fd645/users/56c7aebdf00342b1ba80833663f8c0a9/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:00:38.813843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00f96c-2872-45f8-8e7a-0b72f909187a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:38.814172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00f96c-2872-45f8-8e7a-0b72f909187a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:38.814731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00f96c-2872-45f8-8e7a-0b72f909187a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:38.834562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9c00f96c-2872-45f8-8e7a-0b72f909187a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:38.835772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9c00f96c-2872-45f8-8e7a-0b72f909187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:38.899382 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1720/3404] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:00:38.911297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeee53a-5552-440c-95f7-8edd4bdde76a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:38.913535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3eeee53a-5552-440c-95f7-8edd4bdde76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:38.974037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeee53a-5552-440c-95f7-8edd4bdde76a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:38.977896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420d322-9445-47f5-90ba-405ef29bae88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:38.978570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420d322-9445-47f5-90ba-405ef29bae88 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:38.979029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420d322-9445-47f5-90ba-405ef29bae88 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:38.979621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420d322-9445-47f5-90ba-405ef29bae88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:38.991551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420d322-9445-47f5-90ba-405ef29bae88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:38.993146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420d322-9445-47f5-90ba-405ef29bae88 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:39.015361 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1685/3405] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:00:48.682258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dee35-fa42-4322-84d6-6c4fae4133f9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:48.682914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dee35-fa42-4322-84d6-6c4fae4133f9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:48.682914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dee35-fa42-4322-84d6-6c4fae4133f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:48.718641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-596dee35-fa42-4322-84d6-6c4fae4133f9 None None] MFA Rules not processed for user `56c7aebdf00342b1ba80833663f8c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:48.720045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-596dee35-fa42-4322-84d6-6c4fae4133f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:48.797715 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1721/3406] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:00:48.866289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420d322-9445-47f5-90ba-405ef29bae88 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:48.867950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9420d322-9445-47f5-90ba-405ef29bae88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:48.952236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420d322-9445-47f5-90ba-405ef29bae88 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:48.958853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a7e92-8b8b-49e1-a7b6-c5aa640d505d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:48.959465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a7e92-8b8b-49e1-a7b6-c5aa640d505d service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:48.959747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a7e92-8b8b-49e1-a7b6-c5aa640d505d service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:48.960018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a7e92-8b8b-49e1-a7b6-c5aa640d505d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:48.969046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a7e92-8b8b-49e1-a7b6-c5aa640d505d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:48.970658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a7e92-8b8b-49e1-a7b6-c5aa640d505d service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:48.980493 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1686/3407] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:00:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:00:51.395732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e146-6771-4300-aa83-37910639239a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:51.396289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e146-6771-4300-aa83-37910639239a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:51.396289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e146-6771-4300-aa83-37910639239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:51.445881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4892e146-6771-4300-aa83-37910639239a None None] MFA Rules not processed for user `56c7aebdf00342b1ba80833663f8c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:51.448090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4892e146-6771-4300-aa83-37910639239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:51.458959 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1722/3408] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:00:58.816734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a7e92-8b8b-49e1-a7b6-c5aa640d505d service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:00:58.819303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d12a7e92-8b8b-49e1-a7b6-c5aa640d505d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:58.839755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a7e92-8b8b-49e1-a7b6-c5aa640d505d service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:00:58.846639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f2186-a85c-4f11-803d-ef50802b345c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:00:58.847379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2186-a85c-4f11-803d-ef50802b345c service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:58.847885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2186-a85c-4f11-803d-ef50802b345c service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:58.848238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2186-a85c-4f11-803d-ef50802b345c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:58.850291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2c1f2186-a85c-4f11-803d-ef50802b345c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:58.924018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:58.950450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f2186-a85c-4f11-803d-ef50802b345c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:00:58.952057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f2186-a85c-4f11-803d-ef50802b345c service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:00:58.963876 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1687/3409] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:00:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:00:59.807336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1090d0-ae5b-49af-81b1-3be0dd67e90b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:00:59.807849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1090d0-ae5b-49af-81b1-3be0dd67e90b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:00:59.808014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1090d0-ae5b-49af-81b1-3be0dd67e90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:00:59.824354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:59.832030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-db1090d0-ae5b-49af-81b1-3be0dd67e90b None None] MFA Rules not processed for user `f06caf10b6fa43a3a2ad34858594e329`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:00:59.833358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-db1090d0-ae5b-49af-81b1-3be0dd67e90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:00:59.896838 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1723/3410] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:00.797040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9976c-350a-4308-9054-ed636c7edb1d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:00.797565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9976c-350a-4308-9054-ed636c7edb1d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:00.797920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9976c-350a-4308-9054-ed636c7edb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:00.822469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b5a45-8def-40ad-9078-fb772fd8174b None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:00.822927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b5a45-8def-40ad-9078-fb772fd8174b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:00.823845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b5a45-8def-40ad-9078-fb772fd8174b None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:00.825514 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1724/3411] 10.222.0.26 () {54 vars in 921 bytes} [Sat Oct 8 21:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 21:01:00.834427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a438868-6316-4a6c-83ca-e660e7bdcd66 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:00.834779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a438868-6316-4a6c-83ca-e660e7bdcd66 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:00.835149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a438868-6316-4a6c-83ca-e660e7bdcd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:00.840357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a0a9976c-350a-4308-9054-ed636c7edb1d None None] MFA Rules not processed for user `3d2ddfa343e748c089129b0039a12ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:00.841982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a0a9976c-350a-4308-9054-ed636c7edb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:00.904040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2a438868-6316-4a6c-83ca-e660e7bdcd66 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:00.905322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2a438868-6316-4a6c-83ca-e660e7bdcd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:00.929560 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1688/3412] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:00.938840 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1725/3413] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:01:00.954692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9976c-350a-4308-9054-ed636c7edb1d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:00.958382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a0a9976c-350a-4308-9054-ed636c7edb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:00.977291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9976c-350a-4308-9054-ed636c7edb1d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:00.985000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4a03f-3415-41ba-981b-6218a34355ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:00.985909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4a03f-3415-41ba-981b-6218a34355ec service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:00.986411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4a03f-3415-41ba-981b-6218a34355ec service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:00.986901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4a03f-3415-41ba-981b-6218a34355ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:01.018626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4a03f-3415-41ba-981b-6218a34355ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:01.024042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4a03f-3415-41ba-981b-6218a34355ec service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:01.054236 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1689/3414] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:01:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:01:05.147717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a438868-6316-4a6c-83ca-e660e7bdcd66 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:05.149828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2a438868-6316-4a6c-83ca-e660e7bdcd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:05.169834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a438868-6316-4a6c-83ca-e660e7bdcd66 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:05.175943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:05.176832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:05.177501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:05.177947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] PATH_INFO: `/v3/users/67ddc3cd3c374bacbe5bf5e0877380e2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:05.179611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ddc3cd3c374bacbe5bf5e0877380e2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:05.181967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:05.248131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ddc3cd3c374bacbe5bf5e0877380e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:05.256732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ddc3cd3c374bacbe5bf5e0877380e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:05.257638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ddc3cd3c374bacbe5bf5e0877380e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:05.258371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ddc3cd3c374bacbe5bf5e0877380e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:05.272919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ddc3cd3c374bacbe5bf5e0877380e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:05.292525 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1726/3415] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:01:05 2022] DELETE /identity/v3/users/67ddc3cd3c374bacbe5bf5e0877380e2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:05.297443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e685-be5c-4ee6-93d8-7818889fc7db None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:05.297998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e685-be5c-4ee6-93d8-7818889fc7db None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:05.298466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e685-be5c-4ee6-93d8-7818889fc7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:05.321588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e8a9e685-be5c-4ee6-93d8-7818889fc7db None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:05.323127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e8a9e685-be5c-4ee6-93d8-7818889fc7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:05.394506 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1690/3416] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:05.412482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:05.414668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:05.496073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52005d-7f30-48f4-bf21-04fb49b60075 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:05.499997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659c80a-a41b-4928-901a-038eaa2077b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:05.500610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659c80a-a41b-4928-901a-038eaa2077b4 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:05.500889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659c80a-a41b-4928-901a-038eaa2077b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:05.501161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659c80a-a41b-4928-901a-038eaa2077b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:05.511464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659c80a-a41b-4928-901a-038eaa2077b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:05.512898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659c80a-a41b-4928-901a-038eaa2077b4 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:05.527063 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1727/3417] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:01:06.158940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e685-be5c-4ee6-93d8-7818889fc7db None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:06.161924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e8a9e685-be5c-4ee6-93d8-7818889fc7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:06.181866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e685-be5c-4ee6-93d8-7818889fc7db None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:06.190979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:06.192179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:06.192671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:06.193452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] PATH_INFO: `/v3/projects/8472b054404c46a99b81aba34d6b9f40` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:06.195250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8472b054404c46a99b81aba34d6b9f40)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:06.197493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:06.290901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8472b054404c46a99b81aba34d6b9f40', 'request_id': 'req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:06.308253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8472b054404c46a99b81aba34d6b9f40', 'request_id': 'req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:06.316474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8472b054404c46a99b81aba34d6b9f40', 'request_id': 'req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:06.317885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:06.340748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] The token cache is being invalidate because project 8472b054404c46a99b81aba34d6b9f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:01:06.341073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:06.342352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:06.344378 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1691/3418] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:01:06 2022] DELETE /identity/v3/projects/8472b054404c46a99b81aba34d6b9f40 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:06.364244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659c80a-a41b-4928-901a-038eaa2077b4 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:06.377272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659c80a-a41b-4928-901a-038eaa2077b4 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:06.412749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:06.493441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cb7de-ef9e-4e2d-981f-cb94fff182b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:06.494442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cb7de-ef9e-4e2d-981f-cb94fff182b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:06.494906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cb7de-ef9e-4e2d-981f-cb94fff182b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:06.495327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cb7de-ef9e-4e2d-981f-cb94fff182b2 admin admin] PATH_INFO: `/v3/users/f839a4674f1b4b94a0783ccf8882dca6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:06.496777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cb7de-ef9e-4e2d-981f-cb94fff182b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f839a4674f1b4b94a0783ccf8882dca6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:06.499633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cb7de-ef9e-4e2d-981f-cb94fff182b2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:06.586536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-726cb7de-ef9e-4e2d-981f-cb94fff182b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f839a4674f1b4b94a0783ccf8882dca6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:06.595830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-726cb7de-ef9e-4e2d-981f-cb94fff182b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f839a4674f1b4b94a0783ccf8882dca6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:06.596792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-726cb7de-ef9e-4e2d-981f-cb94fff182b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f839a4674f1b4b94a0783ccf8882dca6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:06.597601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-726cb7de-ef9e-4e2d-981f-cb94fff182b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f839a4674f1b4b94a0783ccf8882dca6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:06.615276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-726cb7de-ef9e-4e2d-981f-cb94fff182b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f839a4674f1b4b94a0783ccf8882dca6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:06.632140 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1728/3419] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:01:06 2022] DELETE /identity/v3/users/f839a4674f1b4b94a0783ccf8882dca6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:07.282497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:07.284080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:07.300378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdb6a9-2e2a-4bd9-9037-99363ab62c56 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:07.410110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ed797-417c-4326-a7c7-8268af9190d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:07.411637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ed797-417c-4326-a7c7-8268af9190d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:07.412156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ed797-417c-4326-a7c7-8268af9190d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:07.412639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ed797-417c-4326-a7c7-8268af9190d3 admin admin] PATH_INFO: `/v3/projects/e137b8738e66438297ac69c3769b28b4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:07.414067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ed797-417c-4326-a7c7-8268af9190d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e137b8738e66438297ac69c3769b28b4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:07.416443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ed797-417c-4326-a7c7-8268af9190d3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:07.515845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d3ed797-417c-4326-a7c7-8268af9190d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e137b8738e66438297ac69c3769b28b4', 'request_id': 'req-8d3ed797-417c-4326-a7c7-8268af9190d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:07.534297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d3ed797-417c-4326-a7c7-8268af9190d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e137b8738e66438297ac69c3769b28b4', 'request_id': 'req-8d3ed797-417c-4326-a7c7-8268af9190d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:07.543416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d3ed797-417c-4326-a7c7-8268af9190d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e137b8738e66438297ac69c3769b28b4', 'request_id': 'req-8d3ed797-417c-4326-a7c7-8268af9190d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:07.571625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d3ed797-417c-4326-a7c7-8268af9190d3 admin admin] The token cache is being invalidate because project e137b8738e66438297ac69c3769b28b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:01:07.571922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d3ed797-417c-4326-a7c7-8268af9190d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:07.572591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d3ed797-417c-4326-a7c7-8268af9190d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:07.576752 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1692/3420] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:01:07 2022] DELETE /identity/v3/projects/e137b8738e66438297ac69c3769b28b4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:07.582174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b82e54-9363-4e54-a2d7-0d4c4075ba48 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:07.583149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b82e54-9363-4e54-a2d7-0d4c4075ba48 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:07.583622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b82e54-9363-4e54-a2d7-0d4c4075ba48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:07.615930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c4b82e54-9363-4e54-a2d7-0d4c4075ba48 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:07.620423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c4b82e54-9363-4e54-a2d7-0d4c4075ba48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:07.693235 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1729/3421] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:07.702774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5e2ed-56c5-47d4-93c0-3339709f1117 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:07.705336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5e2ed-56c5-47d4-93c0-3339709f1117 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:07.705336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5e2ed-56c5-47d4-93c0-3339709f1117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:07.727237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dbc5e2ed-56c5-47d4-93c0-3339709f1117 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:07.728312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dbc5e2ed-56c5-47d4-93c0-3339709f1117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:07.742722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b82e54-9363-4e54-a2d7-0d4c4075ba48 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:07.749806 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1693/3422] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:07.754389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b82e54-9363-4e54-a2d7-0d4c4075ba48 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:07.759568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f40d0-99b1-4e1c-a36d-a726da0cbbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:07.760363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f40d0-99b1-4e1c-a36d-a726da0cbbca admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:07.761331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f40d0-99b1-4e1c-a36d-a726da0cbbca admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:07.761813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f40d0-99b1-4e1c-a36d-a726da0cbbca admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:07.762653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f40d0-99b1-4e1c-a36d-a726da0cbbca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:01:07.763051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f40d0-99b1-4e1c-a36d-a726da0cbbca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:07.764883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f40d0-99b1-4e1c-a36d-a726da0cbbca admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:07.787573 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1730/3423] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:01:07.792128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5e2ed-56c5-47d4-93c0-3339709f1117 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:07.807957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5e2ed-56c5-47d4-93c0-3339709f1117 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:07.814591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11e9f5-21bf-42b5-a854-35abfc7f5181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:07.814782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11e9f5-21bf-42b5-a854-35abfc7f5181 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:07.815711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11e9f5-21bf-42b5-a854-35abfc7f5181 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:07.815711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11e9f5-21bf-42b5-a854-35abfc7f5181 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:07.816636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11e9f5-21bf-42b5-a854-35abfc7f5181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:07.818285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11e9f5-21bf-42b5-a854-35abfc7f5181 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:07.864438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f40d0-99b1-4e1c-a36d-a726da0cbbca admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:07.876928 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1694/3424] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:01:07 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:01:07.880805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f40d0-99b1-4e1c-a36d-a726da0cbbca admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:07.913566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:07.968026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a457e-eb45-4259-94bb-fe4b159f7c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:07.968026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a457e-eb45-4259-94bb-fe4b159f7c27 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:07.968026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a457e-eb45-4259-94bb-fe4b159f7c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:07.968026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a457e-eb45-4259-94bb-fe4b159f7c27 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:07.968455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a457e-eb45-4259-94bb-fe4b159f7c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:07.968789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a457e-eb45-4259-94bb-fe4b159f7c27 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:07.995967 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1731/3425] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:01:07 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:01:07.999884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11e9f5-21bf-42b5-a854-35abfc7f5181 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:08.012720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11e9f5-21bf-42b5-a854-35abfc7f5181 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:08.023551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae23b61-ba30-44ed-9ca2-448ef57d05ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:08.024464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae23b61-ba30-44ed-9ca2-448ef57d05ad admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:08.024893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae23b61-ba30-44ed-9ca2-448ef57d05ad admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:08.025378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae23b61-ba30-44ed-9ca2-448ef57d05ad admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:08.026279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae23b61-ba30-44ed-9ca2-448ef57d05ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:08.028175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae23b61-ba30-44ed-9ca2-448ef57d05ad admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:08.041537 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1695/3426] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:01:08.045838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a457e-eb45-4259-94bb-fe4b159f7c27 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:08.060371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a457e-eb45-4259-94bb-fe4b159f7c27 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:08.066297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5c7ea-fc6d-48af-b45d-42d932439fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:08.067107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5c7ea-fc6d-48af-b45d-42d932439fbc admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:08.067536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5c7ea-fc6d-48af-b45d-42d932439fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:08.067957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5c7ea-fc6d-48af-b45d-42d932439fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:08.068742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5c7ea-fc6d-48af-b45d-42d932439fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:08.071127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5c7ea-fc6d-48af-b45d-42d932439fbc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:08.090777 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1732/3427] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:01:08.094859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae23b61-ba30-44ed-9ca2-448ef57d05ad admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:08.119297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae23b61-ba30-44ed-9ca2-448ef57d05ad admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:08.125698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2afdd-acc9-431a-ad12-dd08b63e4208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:08.126370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2afdd-acc9-431a-ad12-dd08b63e4208 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:08.127016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2afdd-acc9-431a-ad12-dd08b63e4208 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:08.127016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2afdd-acc9-431a-ad12-dd08b63e4208 admin admin] PATH_INFO: `/v3/projects/9e0310d9e59942729d685e6eb06c6460/users/5e3216124a4f41b2b931a16c750649df/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:08.144726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2afdd-acc9-431a-ad12-dd08b63e4208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0310d9e59942729d685e6eb06c6460, user_id=5e3216124a4f41b2b931a16c750649df, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:08.148076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2afdd-acc9-431a-ad12-dd08b63e4208 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:08.179833 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1696/3428] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:01:08 2022] PUT /identity/v3/projects/9e0310d9e59942729d685e6eb06c6460/users/5e3216124a4f41b2b931a16c750649df/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:08.182139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0b9c4-6fac-42c8-832e-eba72515fb74 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:08.182986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0b9c4-6fac-42c8-832e-eba72515fb74 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:08.183282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0b9c4-6fac-42c8-832e-eba72515fb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:08.205223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-52e0b9c4-6fac-42c8-832e-eba72515fb74 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:08.206872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-52e0b9c4-6fac-42c8-832e-eba72515fb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:08.289835 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1733/3429] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:08.337950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2afdd-acc9-431a-ad12-dd08b63e4208 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:08.342450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c5d2afdd-acc9-431a-ad12-dd08b63e4208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:08.394743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:08.461097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2afdd-acc9-431a-ad12-dd08b63e4208 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:08.465942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc8957-7e60-4213-b50d-25e2b2dd51ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:08.466632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc8957-7e60-4213-b50d-25e2b2dd51ec service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:08.467219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc8957-7e60-4213-b50d-25e2b2dd51ec service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:08.467552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc8957-7e60-4213-b50d-25e2b2dd51ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:08.477909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc8957-7e60-4213-b50d-25e2b2dd51ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:08.479743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc8957-7e60-4213-b50d-25e2b2dd51ec service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:08.491353 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1697/3430] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:01:11.531961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0b9c4-6fac-42c8-832e-eba72515fb74 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:11.533466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-52e0b9c4-6fac-42c8-832e-eba72515fb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:11.555015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0b9c4-6fac-42c8-832e-eba72515fb74 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:11.559822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7404643-00ab-4642-9bd1-f117f00e9bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:11.560677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7404643-00ab-4642-9bd1-f117f00e9bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:11.560956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7404643-00ab-4642-9bd1-f117f00e9bba admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:11.561285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7404643-00ab-4642-9bd1-f117f00e9bba admin admin] PATH_INFO: `/v3/users/463a3aac627c43d7af0dbc9facb52076` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:11.562643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7404643-00ab-4642-9bd1-f117f00e9bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=463a3aac627c43d7af0dbc9facb52076)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:11.564920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7404643-00ab-4642-9bd1-f117f00e9bba admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:11.645589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c7404643-00ab-4642-9bd1-f117f00e9bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463a3aac627c43d7af0dbc9facb52076'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:11.656780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c7404643-00ab-4642-9bd1-f117f00e9bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463a3aac627c43d7af0dbc9facb52076'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:11.658093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c7404643-00ab-4642-9bd1-f117f00e9bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463a3aac627c43d7af0dbc9facb52076'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:11.670891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c7404643-00ab-4642-9bd1-f117f00e9bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463a3aac627c43d7af0dbc9facb52076'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:11.704657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c7404643-00ab-4642-9bd1-f117f00e9bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463a3aac627c43d7af0dbc9facb52076'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:11.743831 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1734/3431] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:01:11 2022] DELETE /identity/v3/users/463a3aac627c43d7af0dbc9facb52076 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:12.120713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc8957-7e60-4213-b50d-25e2b2dd51ec service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:12.131132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc8957-7e60-4213-b50d-25e2b2dd51ec service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:12.204462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134a638-1b18-4753-b7ab-44642841ebd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:12.205647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134a638-1b18-4753-b7ab-44642841ebd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:12.206139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134a638-1b18-4753-b7ab-44642841ebd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:12.206666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134a638-1b18-4753-b7ab-44642841ebd5 admin admin] PATH_INFO: `/v3/projects/ac791938e6384c8c8473ffd65cf867a8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:12.208324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134a638-1b18-4753-b7ab-44642841ebd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac791938e6384c8c8473ffd65cf867a8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:12.210716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134a638-1b18-4753-b7ab-44642841ebd5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:12.277038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0134a638-1b18-4753-b7ab-44642841ebd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac791938e6384c8c8473ffd65cf867a8', 'request_id': 'req-0134a638-1b18-4753-b7ab-44642841ebd5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:12.293017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0134a638-1b18-4753-b7ab-44642841ebd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac791938e6384c8c8473ffd65cf867a8', 'request_id': 'req-0134a638-1b18-4753-b7ab-44642841ebd5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:12.308211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0134a638-1b18-4753-b7ab-44642841ebd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac791938e6384c8c8473ffd65cf867a8', 'request_id': 'req-0134a638-1b18-4753-b7ab-44642841ebd5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:12.325099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0134a638-1b18-4753-b7ab-44642841ebd5 admin admin] The token cache is being invalidate because project ac791938e6384c8c8473ffd65cf867a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:01:12.325680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0134a638-1b18-4753-b7ab-44642841ebd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:12.326527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0134a638-1b18-4753-b7ab-44642841ebd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:12.330606 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1698/3432] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:01:12 2022] DELETE /identity/v3/projects/ac791938e6384c8c8473ffd65cf867a8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:12.335596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74373b-e070-4a35-9e8b-39ab2e2adcac None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:12.337587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74373b-e070-4a35-9e8b-39ab2e2adcac None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:12.337587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74373b-e070-4a35-9e8b-39ab2e2adcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:12.378361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7f74373b-e070-4a35-9e8b-39ab2e2adcac None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:12.380198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7f74373b-e070-4a35-9e8b-39ab2e2adcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:12.410870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:12.552457 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1735/3433] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:12.561334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f281662-52f3-48bd-b3d2-3496b20aec92 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:12.561789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f281662-52f3-48bd-b3d2-3496b20aec92 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:12.562235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f281662-52f3-48bd-b3d2-3496b20aec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:12.614450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6f281662-52f3-48bd-b3d2-3496b20aec92 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:12.615703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6f281662-52f3-48bd-b3d2-3496b20aec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:12.654364 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1699/3434] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:12.659066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74373b-e070-4a35-9e8b-39ab2e2adcac None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:12.669683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74373b-e070-4a35-9e8b-39ab2e2adcac None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:12.683887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b3055-0014-421e-beb3-0f9723f0d130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:12.684568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b3055-0014-421e-beb3-0f9723f0d130 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:12.684854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b3055-0014-421e-beb3-0f9723f0d130 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:12.685126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b3055-0014-421e-beb3-0f9723f0d130 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:12.685865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b3055-0014-421e-beb3-0f9723f0d130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:01:12.686169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b3055-0014-421e-beb3-0f9723f0d130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:12.689680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b3055-0014-421e-beb3-0f9723f0d130 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:12.706304 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1736/3435] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:01:12.707784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f281662-52f3-48bd-b3d2-3496b20aec92 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:12.719607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f281662-52f3-48bd-b3d2-3496b20aec92 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:12.726666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b7b77-dda6-4feb-b67f-134f20395fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:12.727909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b7b77-dda6-4feb-b67f-134f20395fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:12.728371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b7b77-dda6-4feb-b67f-134f20395fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:12.729615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b7b77-dda6-4feb-b67f-134f20395fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:12.732289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b7b77-dda6-4feb-b67f-134f20395fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:12.736574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b7b77-dda6-4feb-b67f-134f20395fb1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:12.811408 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1700/3436] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:01:12 2022] POST /identity/v3/projects => generated 399 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:01:12.815513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b3055-0014-421e-beb3-0f9723f0d130 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:12.825989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b3055-0014-421e-beb3-0f9723f0d130 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:12.975370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa479bca-854b-4c6c-855d-7d8d8e06c0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:12.975594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa479bca-854b-4c6c-855d-7d8d8e06c0ef admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:12.975796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa479bca-854b-4c6c-855d-7d8d8e06c0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:12.975972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa479bca-854b-4c6c-855d-7d8d8e06c0ef admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:12.976610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa479bca-854b-4c6c-855d-7d8d8e06c0ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:12.979166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa479bca-854b-4c6c-855d-7d8d8e06c0ef admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:13.028243 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1737/3437] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:01:12 2022] POST /identity/v3/users => generated 300 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:01:13.032163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b7b77-dda6-4feb-b67f-134f20395fb1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:13.046011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b7b77-dda6-4feb-b67f-134f20395fb1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:13.051170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45b59f-c343-46e0-99bd-9da35bcfd9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:13.051784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45b59f-c343-46e0-99bd-9da35bcfd9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:13.052106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45b59f-c343-46e0-99bd-9da35bcfd9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:13.052383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45b59f-c343-46e0-99bd-9da35bcfd9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:13.053023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45b59f-c343-46e0-99bd-9da35bcfd9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:13.054777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45b59f-c343-46e0-99bd-9da35bcfd9c3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:13.070127 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1701/3438] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:01:13.074292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa479bca-854b-4c6c-855d-7d8d8e06c0ef admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:13.096415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa479bca-854b-4c6c-855d-7d8d8e06c0ef admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:13.115809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fc57c-a470-44d7-add6-d2bc89a634e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:13.116566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fc57c-a470-44d7-add6-d2bc89a634e5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:13.116898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fc57c-a470-44d7-add6-d2bc89a634e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:13.117174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fc57c-a470-44d7-add6-d2bc89a634e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:13.118104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fc57c-a470-44d7-add6-d2bc89a634e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:13.120592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fc57c-a470-44d7-add6-d2bc89a634e5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:13.155915 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1738/3439] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:01:13.162335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45b59f-c343-46e0-99bd-9da35bcfd9c3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:13.189867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45b59f-c343-46e0-99bd-9da35bcfd9c3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:13.207744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335869-3918-4465-ae77-06154c315064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:13.209125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335869-3918-4465-ae77-06154c315064 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:13.210987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335869-3918-4465-ae77-06154c315064 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:13.211270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335869-3918-4465-ae77-06154c315064 admin admin] PATH_INFO: `/v3/projects/8c917d40fe85495081525a0d2952f888/users/612551711ec44a9b856a706a1c4c46e7/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:13.245139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:13.263421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42335869-3918-4465-ae77-06154c315064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c917d40fe85495081525a0d2952f888, user_id=612551711ec44a9b856a706a1c4c46e7, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:13.272015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42335869-3918-4465-ae77-06154c315064 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:13.300234 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1702/3440] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:01:13 2022] PUT /identity/v3/projects/8c917d40fe85495081525a0d2952f888/users/612551711ec44a9b856a706a1c4c46e7/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:13.305909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd35e-9005-4f13-9f54-816d121b11ce None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:13.306232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd35e-9005-4f13-9f54-816d121b11ce None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:13.306486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd35e-9005-4f13-9f54-816d121b11ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:13.341988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-10fdd35e-9005-4f13-9f54-816d121b11ce None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:13.343786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-10fdd35e-9005-4f13-9f54-816d121b11ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:13.471766 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1739/3441] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:13.516468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335869-3918-4465-ae77-06154c315064 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:13.519954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-42335869-3918-4465-ae77-06154c315064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:13.602880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335869-3918-4465-ae77-06154c315064 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:13.607601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca972683-5984-4fd7-aa21-49a2dbc62ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:13.608457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972683-5984-4fd7-aa21-49a2dbc62ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:13.608753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972683-5984-4fd7-aa21-49a2dbc62ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:13.609145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972683-5984-4fd7-aa21-49a2dbc62ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:13.621458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca972683-5984-4fd7-aa21-49a2dbc62ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:13.623278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca972683-5984-4fd7-aa21-49a2dbc62ae3 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:13.637522 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1703/3442] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:01:13.738015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c32cfc-6a80-49b8-adfe-0d09cc93de1b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:13.738390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c32cfc-6a80-49b8-adfe-0d09cc93de1b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:13.738390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c32cfc-6a80-49b8-adfe-0d09cc93de1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:13.762618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d9c32cfc-6a80-49b8-adfe-0d09cc93de1b None None] MFA Rules not processed for user `1698dee4a2bf4ea19a6ee0c3d5cb5c09`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:13.764174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d9c32cfc-6a80-49b8-adfe-0d09cc93de1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:13.789127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:13.869163 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1740/3443] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:21.844949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b454f1e-bfce-46f7-9c5e-cfa0716e4e4b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:21.845613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b454f1e-bfce-46f7-9c5e-cfa0716e4e4b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:21.845922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b454f1e-bfce-46f7-9c5e-cfa0716e4e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:21.888433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2b454f1e-bfce-46f7-9c5e-cfa0716e4e4b None None] MFA Rules not processed for user `5e3216124a4f41b2b931a16c750649df`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:21.889892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2b454f1e-bfce-46f7-9c5e-cfa0716e4e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:22.042453 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1704/3444] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:22.044775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c32cfc-6a80-49b8-adfe-0d09cc93de1b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:22.046174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d9c32cfc-6a80-49b8-adfe-0d09cc93de1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:22.117177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c32cfc-6a80-49b8-adfe-0d09cc93de1b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:22.122328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f318da-dd73-4dde-a3a9-6e18eedcff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:22.123196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f318da-dd73-4dde-a3a9-6e18eedcff1e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:22.123571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f318da-dd73-4dde-a3a9-6e18eedcff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:22.124040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f318da-dd73-4dde-a3a9-6e18eedcff1e admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:22.124693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f318da-dd73-4dde-a3a9-6e18eedcff1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:22.126815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f318da-dd73-4dde-a3a9-6e18eedcff1e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:22.198591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b454f1e-bfce-46f7-9c5e-cfa0716e4e4b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:22.199806 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1741/3445] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:01:22 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:01:22.216827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b454f1e-bfce-46f7-9c5e-cfa0716e4e4b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:22.334176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c925e-d250-4f86-b203-971239c6c677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:22.335213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c925e-d250-4f86-b203-971239c6c677 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:22.335683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c925e-d250-4f86-b203-971239c6c677 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:22.335959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c925e-d250-4f86-b203-971239c6c677 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:22.336810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c925e-d250-4f86-b203-971239c6c677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:22.339936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c925e-d250-4f86-b203-971239c6c677 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:22.388055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f318da-dd73-4dde-a3a9-6e18eedcff1e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:22.401104 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1705/3446] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:01:22 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:01:22.402983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f318da-dd73-4dde-a3a9-6e18eedcff1e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:22.409522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8068f40-1491-4c36-95a5-7b6633cc4dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:22.410602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068f40-1491-4c36-95a5-7b6633cc4dbd admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:22.410990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068f40-1491-4c36-95a5-7b6633cc4dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:22.411491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068f40-1491-4c36-95a5-7b6633cc4dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:22.413032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8068f40-1491-4c36-95a5-7b6633cc4dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:22.414752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8068f40-1491-4c36-95a5-7b6633cc4dbd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:22.433367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c925e-d250-4f86-b203-971239c6c677 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:22.445715 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1742/3447] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:01:22.447079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c925e-d250-4f86-b203-971239c6c677 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:22.454357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce87c21-d6f6-4e50-bae7-0b6ae7f4b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:22.455211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce87c21-d6f6-4e50-bae7-0b6ae7f4b6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:22.455496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce87c21-d6f6-4e50-bae7-0b6ae7f4b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:22.455771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce87c21-d6f6-4e50-bae7-0b6ae7f4b6ca admin admin] PATH_INFO: `/v3/projects/66f3dd8b3d034ecf9b72e603c0ef9d6e/users/6e4ea2c363454c75bf52e6809b508b0f/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:22.471078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:22.497685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce87c21-d6f6-4e50-bae7-0b6ae7f4b6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f3dd8b3d034ecf9b72e603c0ef9d6e, user_id=6e4ea2c363454c75bf52e6809b508b0f, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:22.503649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce87c21-d6f6-4e50-bae7-0b6ae7f4b6ca admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:22.544518 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1706/3448] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:01:22 2022] PUT /identity/v3/projects/66f3dd8b3d034ecf9b72e603c0ef9d6e/users/6e4ea2c363454c75bf52e6809b508b0f/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:22.548633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8068f40-1491-4c36-95a5-7b6633cc4dbd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:22.566242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8068f40-1491-4c36-95a5-7b6633cc4dbd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:22.688581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95a09b-9870-4747-b901-c2f54ea84225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:22.689328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95a09b-9870-4747-b901-c2f54ea84225 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:22.689650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95a09b-9870-4747-b901-c2f54ea84225 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:22.690006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95a09b-9870-4747-b901-c2f54ea84225 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:22.690661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95a09b-9870-4747-b901-c2f54ea84225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:22.692497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95a09b-9870-4747-b901-c2f54ea84225 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:22.742133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce87c21-d6f6-4e50-bae7-0b6ae7f4b6ca admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:22.750646 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1743/3449] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:01:22.758657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce87c21-d6f6-4e50-bae7-0b6ae7f4b6ca admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:22.792777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bb132-a4f4-44d7-9abd-87d6f21efd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:22.793127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bb132-a4f4-44d7-9abd-87d6f21efd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:22.795510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bb132-a4f4-44d7-9abd-87d6f21efd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:22.795995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bb132-a4f4-44d7-9abd-87d6f21efd3f admin admin] PATH_INFO: `/v3/projects/66f3dd8b3d034ecf9b72e603c0ef9d6e/users/6e4ea2c363454c75bf52e6809b508b0f/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:22.803074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bb132-a4f4-44d7-9abd-87d6f21efd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f3dd8b3d034ecf9b72e603c0ef9d6e, user_id=6e4ea2c363454c75bf52e6809b508b0f, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:22.806708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bb132-a4f4-44d7-9abd-87d6f21efd3f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:22.821964 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1707/3450] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:01:22 2022] PUT /identity/v3/projects/66f3dd8b3d034ecf9b72e603c0ef9d6e/users/6e4ea2c363454c75bf52e6809b508b0f/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:23.745404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75a192-0470-4ecd-b7d3-aae3ff24160d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:23.745875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75a192-0470-4ecd-b7d3-aae3ff24160d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:23.745993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75a192-0470-4ecd-b7d3-aae3ff24160d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:23.812200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3a75a192-0470-4ecd-b7d3-aae3ff24160d None None] MFA Rules not processed for user `612551711ec44a9b856a706a1c4c46e7`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:23.814241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3a75a192-0470-4ecd-b7d3-aae3ff24160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:23.970642 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1744/3451] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:23.981326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02f493-958a-4a3c-a3f3-93c0ea24ed02 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:23.982324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02f493-958a-4a3c-a3f3-93c0ea24ed02 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:23.983096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02f493-958a-4a3c-a3f3-93c0ea24ed02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:24.035389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8b02f493-958a-4a3c-a3f3-93c0ea24ed02 None None] MFA Rules not processed for user `612551711ec44a9b856a706a1c4c46e7`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:24.037209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8b02f493-958a-4a3c-a3f3-93c0ea24ed02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:24.054590 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1708/3452] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:24.065447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75a192-0470-4ecd-b7d3-aae3ff24160d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:24.070467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3a75a192-0470-4ecd-b7d3-aae3ff24160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:24.135961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:24.267099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75a192-0470-4ecd-b7d3-aae3ff24160d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:24.273237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424242c-25d5-4728-850b-246094ef815b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:24.274019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424242c-25d5-4728-850b-246094ef815b service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:24.274356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424242c-25d5-4728-850b-246094ef815b service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:24.274728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424242c-25d5-4728-850b-246094ef815b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:24.285971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424242c-25d5-4728-850b-246094ef815b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:24.287635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424242c-25d5-4728-850b-246094ef815b service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:24.307348 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1745/3453] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:01:24 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:01:32.335468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02f493-958a-4a3c-a3f3-93c0ea24ed02 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:32.339008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8b02f493-958a-4a3c-a3f3-93c0ea24ed02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:32.382590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02f493-958a-4a3c-a3f3-93c0ea24ed02 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:32.389927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f31dc-6e6b-49e3-8db9-2d46413e3599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:32.390805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f31dc-6e6b-49e3-8db9-2d46413e3599 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:32.391430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f31dc-6e6b-49e3-8db9-2d46413e3599 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:32.392132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f31dc-6e6b-49e3-8db9-2d46413e3599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:32.394391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4c6f31dc-6e6b-49e3-8db9-2d46413e3599 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:32.499539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f31dc-6e6b-49e3-8db9-2d46413e3599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:32.503304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f31dc-6e6b-49e3-8db9-2d46413e3599 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:32.543837 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1709/3454] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:01:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:01:34.301283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=24 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:40.196991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9453c45-7901-44d8-af93-81656e5a6f5f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:40.197687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9453c45-7901-44d8-af93-81656e5a6f5f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:40.197687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9453c45-7901-44d8-af93-81656e5a6f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:40.254776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e9453c45-7901-44d8-af93-81656e5a6f5f None None] MFA Rules not processed for user `6e4ea2c363454c75bf52e6809b508b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:40.256025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e9453c45-7901-44d8-af93-81656e5a6f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:40.345350 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1746/3455] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:40.358576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f31dc-6e6b-49e3-8db9-2d46413e3599 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:40.360145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4c6f31dc-6e6b-49e3-8db9-2d46413e3599 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:40.460085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f31dc-6e6b-49e3-8db9-2d46413e3599 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:40.468296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97179166-b057-4030-b811-5f0e307449f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:40.469277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179166-b057-4030-b811-5f0e307449f1 service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:40.469723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179166-b057-4030-b811-5f0e307449f1 service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:40.470414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179166-b057-4030-b811-5f0e307449f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:40.484692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97179166-b057-4030-b811-5f0e307449f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:40.486432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97179166-b057-4030-b811-5f0e307449f1 service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:40.511202 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1710/3456] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:01:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:01:42.656145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9453c45-7901-44d8-af93-81656e5a6f5f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:42.658868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e9453c45-7901-44d8-af93-81656e5a6f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:42.820596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9453c45-7901-44d8-af93-81656e5a6f5f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:42.829749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d44e0c-0ef2-4b3f-bb21-5a0e5a12f5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:42.842503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44e0c-0ef2-4b3f-bb21-5a0e5a12f5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:42.843178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44e0c-0ef2-4b3f-bb21-5a0e5a12f5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:42.847038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44e0c-0ef2-4b3f-bb21-5a0e5a12f5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:42.856415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f1d44e0c-0ef2-4b3f-bb21-5a0e5a12f5f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:42.913598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d44e0c-0ef2-4b3f-bb21-5a0e5a12f5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:42.915567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d44e0c-0ef2-4b3f-bb21-5a0e5a12f5f0 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:43.010148 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1747/3457] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:01:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:01:45.391079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97179166-b057-4030-b811-5f0e307449f1 service glance] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:45.414328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97179166-b057-4030-b811-5f0e307449f1 service glance] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:45.433292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5af297-4117-4eb7-9a6e-b1017a306a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:45.434041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5af297-4117-4eb7-9a6e-b1017a306a6c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:45.435547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5af297-4117-4eb7-9a6e-b1017a306a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:45.436892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5af297-4117-4eb7-9a6e-b1017a306a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:45.445063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cb5af297-4117-4eb7-9a6e-b1017a306a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:45.539158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5af297-4117-4eb7-9a6e-b1017a306a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:45.564810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5af297-4117-4eb7-9a6e-b1017a306a6c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:45.614714 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1711/3458] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:01:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:01:47.436103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d44e0c-0ef2-4b3f-bb21-5a0e5a12f5f0 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:47.437704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f1d44e0c-0ef2-4b3f-bb21-5a0e5a12f5f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:47.632815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d44e0c-0ef2-4b3f-bb21-5a0e5a12f5f0 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:47.644718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:47.646656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:47.646956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:47.647242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] PATH_INFO: `/v3/users/f06caf10b6fa43a3a2ad34858594e329` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:47.650641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f06caf10b6fa43a3a2ad34858594e329)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:47.653061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:47.757530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:47.795303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f06caf10b6fa43a3a2ad34858594e329'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:47.833908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f06caf10b6fa43a3a2ad34858594e329'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:47.835283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f06caf10b6fa43a3a2ad34858594e329'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:47.835919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f06caf10b6fa43a3a2ad34858594e329'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:47.892319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f06caf10b6fa43a3a2ad34858594e329'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:47.933552 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1748/3459] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:01:47 2022] DELETE /identity/v3/users/f06caf10b6fa43a3a2ad34858594e329 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:48.051145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb51d-e6b6-4f73-9dd7-27f163a59173 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:48.052020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb51d-e6b6-4f73-9dd7-27f163a59173 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:48.052691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb51d-e6b6-4f73-9dd7-27f163a59173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:48.084564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-59deb51d-e6b6-4f73-9dd7-27f163a59173 None None] MFA Rules not processed for user `5266cd6be4514b3eac30a195f6b25772`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:48.088815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-59deb51d-e6b6-4f73-9dd7-27f163a59173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:48.220441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:48.258702 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1712/3460] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:01:48.454763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:48.456365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:48.595975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb8fae-cb30-409a-b5a7-3e61a565d6c7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:48.604769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:48.606297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:48.606793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:48.607295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3 admin admin] PATH_INFO: `/v3/projects/76b10172715d423eb887d6c5b171defb` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:48.609004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b10172715d423eb887d6c5b171defb)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:48.618516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:48.687158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b10172715d423eb887d6c5b171defb', 'request_id': 'req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:48.695418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b10172715d423eb887d6c5b171defb', 'request_id': 'req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:48.704246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b10172715d423eb887d6c5b171defb', 'request_id': 'req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:48.718173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3 admin admin] The token cache is being invalidate because project 76b10172715d423eb887d6c5b171defb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:01:48.718929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:48.719976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8f4aa00-4cf7-4329-9a74-f5397ad089b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:48.722317 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1749/3461] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:01:48 2022] DELETE /identity/v3/projects/76b10172715d423eb887d6c5b171defb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:01:48.728259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1826-fe50-496a-a105-dcad15a7a0b8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:48.728553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1826-fe50-496a-a105-dcad15a7a0b8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:48.728830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1826-fe50-496a-a105-dcad15a7a0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:48.750325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e6ac1826-fe50-496a-a105-dcad15a7a0b8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:48.752808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e6ac1826-fe50-496a-a105-dcad15a7a0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:48.826464 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1713/3462] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:48.836061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652d9ed-165f-4b48-b06d-74a39d212eca None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:48.836374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652d9ed-165f-4b48-b06d-74a39d212eca None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:48.836760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652d9ed-165f-4b48-b06d-74a39d212eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:48.844811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1826-fe50-496a-a105-dcad15a7a0b8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:48.850728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e6ac1826-fe50-496a-a105-dcad15a7a0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:48.876728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5652d9ed-165f-4b48-b06d-74a39d212eca None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:48.878865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5652d9ed-165f-4b48-b06d-74a39d212eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:48.941537 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1750/3463] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:48.944903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652d9ed-165f-4b48-b06d-74a39d212eca None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:48.971878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652d9ed-165f-4b48-b06d-74a39d212eca None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:48.983716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82024c87-cb2a-4f65-a038-10f80b71d57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:48.984496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82024c87-cb2a-4f65-a038-10f80b71d57c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:48.984792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82024c87-cb2a-4f65-a038-10f80b71d57c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:48.985040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82024c87-cb2a-4f65-a038-10f80b71d57c admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:48.985795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82024c87-cb2a-4f65-a038-10f80b71d57c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:01:48.986104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82024c87-cb2a-4f65-a038-10f80b71d57c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:48.987761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82024c87-cb2a-4f65-a038-10f80b71d57c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:49.005869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1826-fe50-496a-a105-dcad15a7a0b8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:49.006433 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1751/3464] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:01:49.007352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82024c87-cb2a-4f65-a038-10f80b71d57c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:49.015201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3640c-5f62-4490-b46f-767385b24594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:49.016006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3640c-5f62-4490-b46f-767385b24594 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:49.016290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3640c-5f62-4490-b46f-767385b24594 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:49.016578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3640c-5f62-4490-b46f-767385b24594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:49.019155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82024c87-cb2a-4f65-a038-10f80b71d57c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:49.022912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a9f3640c-5f62-4490-b46f-767385b24594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:49.026060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c373681-84fc-4159-9997-0690e9a8fe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:49.027027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c373681-84fc-4159-9997-0690e9a8fe9f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:49.027391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c373681-84fc-4159-9997-0690e9a8fe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:49.027732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c373681-84fc-4159-9997-0690e9a8fe9f admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:49.028443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c373681-84fc-4159-9997-0690e9a8fe9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:49.031236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c373681-84fc-4159-9997-0690e9a8fe9f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:49.048096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3640c-5f62-4490-b46f-767385b24594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:49.049266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3640c-5f62-4490-b46f-767385b24594 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:49.067243 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1714/3465] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:01:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:01:49.067841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:49.090225 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1752/3466] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:01:49 2022] POST /identity/v3/projects => generated 357 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:01:49.094719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3640c-5f62-4490-b46f-767385b24594 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:49.114851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3640c-5f62-4490-b46f-767385b24594 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:49.224532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eee469-0368-4103-9273-3fd6f320f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:49.225536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eee469-0368-4103-9273-3fd6f320f893 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:49.226050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eee469-0368-4103-9273-3fd6f320f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:49.226596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eee469-0368-4103-9273-3fd6f320f893 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:49.229352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eee469-0368-4103-9273-3fd6f320f893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:49.232874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eee469-0368-4103-9273-3fd6f320f893 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:49.278469 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1715/3467] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:01:49 2022] POST /identity/v3/users => generated 279 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:01:49.282691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c373681-84fc-4159-9997-0690e9a8fe9f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:49.301977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c373681-84fc-4159-9997-0690e9a8fe9f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:49.309840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4c379-ea13-4180-ac8c-05600e0f1855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:49.310742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4c379-ea13-4180-ac8c-05600e0f1855 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:49.311086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4c379-ea13-4180-ac8c-05600e0f1855 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:49.311433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4c379-ea13-4180-ac8c-05600e0f1855 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:49.312167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4c379-ea13-4180-ac8c-05600e0f1855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:49.315274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4c379-ea13-4180-ac8c-05600e0f1855 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:49.337114 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1753/3468] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:01:49.341014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eee469-0368-4103-9273-3fd6f320f893 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:49.361796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eee469-0368-4103-9273-3fd6f320f893 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:49.391642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e9c8c-0446-4961-92f1-b490470607eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:49.392518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9c8c-0446-4961-92f1-b490470607eb admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:49.392873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9c8c-0446-4961-92f1-b490470607eb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:49.395127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9c8c-0446-4961-92f1-b490470607eb admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:49.395894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e9c8c-0446-4961-92f1-b490470607eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:49.400482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e9c8c-0446-4961-92f1-b490470607eb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:49.434329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4c379-ea13-4180-ac8c-05600e0f1855 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:49.434922 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1716/3469] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:01:49.460313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4c379-ea13-4180-ac8c-05600e0f1855 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:49.468896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac06a4-e3bd-4eab-8ab6-afb6b534f895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:49.470126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac06a4-e3bd-4eab-8ab6-afb6b534f895 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:49.470403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac06a4-e3bd-4eab-8ab6-afb6b534f895 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:49.470675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac06a4-e3bd-4eab-8ab6-afb6b534f895 admin admin] PATH_INFO: `/v3/projects/a39e9b192fc049ee9309917315fa445e/users/a1597188d5e442129ab514480d190c9b/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:49.495573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac06a4-e3bd-4eab-8ab6-afb6b534f895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39e9b192fc049ee9309917315fa445e, user_id=a1597188d5e442129ab514480d190c9b, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:49.500192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac06a4-e3bd-4eab-8ab6-afb6b534f895 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:49.541743 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1754/3470] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:01:49 2022] PUT /identity/v3/projects/a39e9b192fc049ee9309917315fa445e/users/a1597188d5e442129ab514480d190c9b/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:49.551638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd0c6a-aec2-44c2-b17a-a29a09a49402 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:49.551921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd0c6a-aec2-44c2-b17a-a29a09a49402 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:49.552196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd0c6a-aec2-44c2-b17a-a29a09a49402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:49.601790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-47fd0c6a-aec2-44c2-b17a-a29a09a49402 None None] MFA Rules not processed for user `a1597188d5e442129ab514480d190c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:49.604531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-47fd0c6a-aec2-44c2-b17a-a29a09a49402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:49.616296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:49.757706 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1717/3471] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:01:50.121353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac06a4-e3bd-4eab-8ab6-afb6b534f895 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:50.123621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1eac06a4-e3bd-4eab-8ab6-afb6b534f895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:50.457841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac06a4-e3bd-4eab-8ab6-afb6b534f895 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:50.509619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613093cb-858f-417b-aaf7-6fb79243bed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:50.510270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613093cb-858f-417b-aaf7-6fb79243bed4 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:50.510535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613093cb-858f-417b-aaf7-6fb79243bed4 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:50.510807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613093cb-858f-417b-aaf7-6fb79243bed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:50.547084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613093cb-858f-417b-aaf7-6fb79243bed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:50.549089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613093cb-858f-417b-aaf7-6fb79243bed4 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:50.569927 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1755/3472] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:01:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:01:50.706309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd0c6a-aec2-44c2-b17a-a29a09a49402 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:51.041102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd0c6a-aec2-44c2-b17a-a29a09a49402 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:51.065935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:51.066813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:51.069474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:51.071141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] PATH_INFO: `/v3/users/a1597188d5e442129ab514480d190c9b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:51.078097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1597188d5e442129ab514480d190c9b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:51.094402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:51.270259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1597188d5e442129ab514480d190c9b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:51.286102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1597188d5e442129ab514480d190c9b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:51.289726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1597188d5e442129ab514480d190c9b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:51.291899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1597188d5e442129ab514480d190c9b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:51.352783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1597188d5e442129ab514480d190c9b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:51.379151 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1718/3473] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:01:50 2022] DELETE /identity/v3/users/a1597188d5e442129ab514480d190c9b => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:51.380909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae033312-5bd1-4f58-aa8f-fd7febe70e6d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:51.381276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae033312-5bd1-4f58-aa8f-fd7febe70e6d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:51.381601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae033312-5bd1-4f58-aa8f-fd7febe70e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:51.423726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ae033312-5bd1-4f58-aa8f-fd7febe70e6d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:51.425138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ae033312-5bd1-4f58-aa8f-fd7febe70e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:51.650402 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1756/3474] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:51.676261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:51.678093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:51.841618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:51.932755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62112f80-928e-4580-9606-9a0432776b65 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:51.942957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888395e5-c6e6-4a2d-a235-c36a3b371253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:51.944836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888395e5-c6e6-4a2d-a235-c36a3b371253 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:51.946706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888395e5-c6e6-4a2d-a235-c36a3b371253 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:51.946988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888395e5-c6e6-4a2d-a235-c36a3b371253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:52.004763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888395e5-c6e6-4a2d-a235-c36a3b371253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:52.022501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888395e5-c6e6-4a2d-a235-c36a3b371253 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:52.054931 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1719/3475] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:01:53.018744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae033312-5bd1-4f58-aa8f-fd7febe70e6d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:53.020417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ae033312-5bd1-4f58-aa8f-fd7febe70e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:53.045135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae033312-5bd1-4f58-aa8f-fd7febe70e6d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:53.064916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:53.065948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:53.066425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:53.066890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6 admin admin] PATH_INFO: `/v3/projects/a39e9b192fc049ee9309917315fa445e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:53.068235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a39e9b192fc049ee9309917315fa445e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:53.070506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:53.167132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:53.184990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a39e9b192fc049ee9309917315fa445e', 'request_id': 'req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:53.200828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a39e9b192fc049ee9309917315fa445e', 'request_id': 'req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:53.213654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a39e9b192fc049ee9309917315fa445e', 'request_id': 'req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:53.241639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6 admin admin] The token cache is being invalidate because project a39e9b192fc049ee9309917315fa445e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:01:53.241639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:53.241639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d40d0d38-d5e4-4c99-8be2-880549bdf1c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:01:53.241639 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1757/3476] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:01:53 2022] DELETE /identity/v3/projects/a39e9b192fc049ee9309917315fa445e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:53.246705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48b4e4-2690-46d6-8003-8ae471f18d17 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:53.247243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48b4e4-2690-46d6-8003-8ae471f18d17 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:53.247243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48b4e4-2690-46d6-8003-8ae471f18d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:53.268519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0d48b4e4-2690-46d6-8003-8ae471f18d17 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:53.270163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0d48b4e4-2690-46d6-8003-8ae471f18d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:53.431821 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1720/3477] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:53.433550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77bcdc-fe23-4894-a016-b56c05b6ca0b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:53.433844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77bcdc-fe23-4894-a016-b56c05b6ca0b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:53.434120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77bcdc-fe23-4894-a016-b56c05b6ca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:53.494583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6a77bcdc-fe23-4894-a016-b56c05b6ca0b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:53.496114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6a77bcdc-fe23-4894-a016-b56c05b6ca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:53.523164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48b4e4-2690-46d6-8003-8ae471f18d17 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:53.527629 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1758/3478] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:53.543634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48b4e4-2690-46d6-8003-8ae471f18d17 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:53.558467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdcda3-5a25-40be-990b-f15620545b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:53.558973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdcda3-5a25-40be-990b-f15620545b6b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:53.559259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdcda3-5a25-40be-990b-f15620545b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:53.559538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdcda3-5a25-40be-990b-f15620545b6b admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:53.560204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdcda3-5a25-40be-990b-f15620545b6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:01:53.560511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdcda3-5a25-40be-990b-f15620545b6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:53.562159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdcda3-5a25-40be-990b-f15620545b6b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:53.599440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77bcdc-fe23-4894-a016-b56c05b6ca0b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:53.604508 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1721/3479] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:01:53.617343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77bcdc-fe23-4894-a016-b56c05b6ca0b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:53.625947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca93086-8195-4076-8f86-94fc34916479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:53.626865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca93086-8195-4076-8f86-94fc34916479 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:53.627312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca93086-8195-4076-8f86-94fc34916479 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:53.627746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca93086-8195-4076-8f86-94fc34916479 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:53.628545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca93086-8195-4076-8f86-94fc34916479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:53.630649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca93086-8195-4076-8f86-94fc34916479 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:53.695452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdcda3-5a25-40be-990b-f15620545b6b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:53.701594 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1759/3480] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:01:53 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:01:53.714399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdcda3-5a25-40be-990b-f15620545b6b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:53.856707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d438a-8f33-4bcc-a231-0a5132245370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:53.857732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d438a-8f33-4bcc-a231-0a5132245370 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:53.858019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d438a-8f33-4bcc-a231-0a5132245370 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:53.858293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d438a-8f33-4bcc-a231-0a5132245370 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:53.858934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d438a-8f33-4bcc-a231-0a5132245370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:53.860871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d438a-8f33-4bcc-a231-0a5132245370 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:53.916917 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1722/3481] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:01:53 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:01:53.918011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca93086-8195-4076-8f86-94fc34916479 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:53.935602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca93086-8195-4076-8f86-94fc34916479 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:53.950176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0446cd-e490-4a67-aed2-0ef204cbf310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:53.953727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0446cd-e490-4a67-aed2-0ef204cbf310 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:53.954367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0446cd-e490-4a67-aed2-0ef204cbf310 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:53.955010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0446cd-e490-4a67-aed2-0ef204cbf310 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:53.955926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0446cd-e490-4a67-aed2-0ef204cbf310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:53.958667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0446cd-e490-4a67-aed2-0ef204cbf310 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:53.997503 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1760/3482] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:01:53.999173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d438a-8f33-4bcc-a231-0a5132245370 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:54.017885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d438a-8f33-4bcc-a231-0a5132245370 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:54.057229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55c08a-aa84-4ee4-8c51-5d3590b61fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:54.057570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c08a-aa84-4ee4-8c51-5d3590b61fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:54.058009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c08a-aa84-4ee4-8c51-5d3590b61fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:54.058127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c08a-aa84-4ee4-8c51-5d3590b61fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:54.063104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55c08a-aa84-4ee4-8c51-5d3590b61fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:54.073420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55c08a-aa84-4ee4-8c51-5d3590b61fc1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:54.123830 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1723/3483] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:01:54.127723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0446cd-e490-4a67-aed2-0ef204cbf310 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:54.155080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0446cd-e490-4a67-aed2-0ef204cbf310 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:54.172815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717871f-afa8-4297-a4f5-4c4dde84ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:54.174507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717871f-afa8-4297-a4f5-4c4dde84ab88 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:54.175063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717871f-afa8-4297-a4f5-4c4dde84ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:54.175585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717871f-afa8-4297-a4f5-4c4dde84ab88 admin admin] PATH_INFO: `/v3/projects/4735bf74f33a4739800d766c82d973d4/users/40f60e33f334465fac1148669de3f00c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:54.219345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717871f-afa8-4297-a4f5-4c4dde84ab88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4735bf74f33a4739800d766c82d973d4, user_id=40f60e33f334465fac1148669de3f00c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:54.222063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717871f-afa8-4297-a4f5-4c4dde84ab88 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:54.255658 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1761/3484] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:01:54 2022] PUT /identity/v3/projects/4735bf74f33a4739800d766c82d973d4/users/40f60e33f334465fac1148669de3f00c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:01:54.259447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1214a7-3063-4436-bab0-aa60682da3a2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:54.262488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1214a7-3063-4436-bab0-aa60682da3a2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:54.262784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1214a7-3063-4436-bab0-aa60682da3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:54.351418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cd1214a7-3063-4436-bab0-aa60682da3a2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:54.352081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cd1214a7-3063-4436-bab0-aa60682da3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:54.469133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:54.535335 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1724/3485] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:54.560060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717871f-afa8-4297-a4f5-4c4dde84ab88 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:54.563006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e717871f-afa8-4297-a4f5-4c4dde84ab88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:54.777560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717871f-afa8-4297-a4f5-4c4dde84ab88 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:54.787503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb553e-5e04-4b44-9339-9353132d7c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:54.798465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb553e-5e04-4b44-9339-9353132d7c6d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:54.798998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb553e-5e04-4b44-9339-9353132d7c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:54.799384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb553e-5e04-4b44-9339-9353132d7c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:54.825527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb553e-5e04-4b44-9339-9353132d7c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:54.827541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb553e-5e04-4b44-9339-9353132d7c6d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:54.855790 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1762/3486] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:01:55.364149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362cf6a-816c-4b26-8eba-c8384e31a375 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:55.364746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362cf6a-816c-4b26-8eba-c8384e31a375 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:55.364746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362cf6a-816c-4b26-8eba-c8384e31a375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:55.463899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c362cf6a-816c-4b26-8eba-c8384e31a375 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:01:55.465135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c362cf6a-816c-4b26-8eba-c8384e31a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:55.628863 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1725/3487] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:01:55.701030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb553e-5e04-4b44-9339-9353132d7c6d service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:01:55.702559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eefb553e-5e04-4b44-9339-9353132d7c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:01:55.809657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:55.863206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb553e-5e04-4b44-9339-9353132d7c6d service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:01:55.871142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0a93e-3932-4d7f-8161-d1c4e52cb3d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:01:55.872190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0a93e-3932-4d7f-8161-d1c4e52cb3d3 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:01:55.872774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0a93e-3932-4d7f-8161-d1c4e52cb3d3 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:01:55.873261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0a93e-3932-4d7f-8161-d1c4e52cb3d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:01:55.921249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0a93e-3932-4d7f-8161-d1c4e52cb3d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:01:55.927375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0a93e-3932-4d7f-8161-d1c4e52cb3d3 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:01:55.966542 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1763/3488] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:01:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:02:00.405890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362cf6a-816c-4b26-8eba-c8384e31a375 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:00.407405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c362cf6a-816c-4b26-8eba-c8384e31a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:00.435496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362cf6a-816c-4b26-8eba-c8384e31a375 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:00.455773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:00.456437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:00.456721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:00.457001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] PATH_INFO: `/v3/users/3d2ddfa343e748c089129b0039a12ac0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:00.463566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2ddfa343e748c089129b0039a12ac0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:00.472927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:00.577552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2ddfa343e748c089129b0039a12ac0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:00.595504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2ddfa343e748c089129b0039a12ac0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:00.596586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2ddfa343e748c089129b0039a12ac0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:00.598228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2ddfa343e748c089129b0039a12ac0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:00.642871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2ddfa343e748c089129b0039a12ac0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:00.674113 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1726/3489] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:02:00 2022] DELETE /identity/v3/users/3d2ddfa343e748c089129b0039a12ac0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:02.119154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0a93e-3932-4d7f-8161-d1c4e52cb3d3 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:02.142953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0a93e-3932-4d7f-8161-d1c4e52cb3d3 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:02.299971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:02.302677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:02.305602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:02.306064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] PATH_INFO: `/v3/projects/e191d6217f024a17a14184071ac674c7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:02.311961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e191d6217f024a17a14184071ac674c7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:02.335666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:02.518775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e191d6217f024a17a14184071ac674c7', 'request_id': 'req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:02.543155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e191d6217f024a17a14184071ac674c7', 'request_id': 'req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:02.550685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e191d6217f024a17a14184071ac674c7', 'request_id': 'req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:02.579370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] The token cache is being invalidate because project e191d6217f024a17a14184071ac674c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:02:02.579743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:02.580914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:02.585379 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1764/3490] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:02:02 2022] DELETE /identity/v3/projects/e191d6217f024a17a14184071ac674c7 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:02.589778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:02.592068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:02.623512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc877a-b55b-44ba-bb13-3a89301e63df admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:02.688388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:02.787838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622088d-b35f-4236-a266-a964aeb431c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:02.789808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622088d-b35f-4236-a266-a964aeb431c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:02.789808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622088d-b35f-4236-a266-a964aeb431c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:02.789808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622088d-b35f-4236-a266-a964aeb431c2 admin admin] PATH_INFO: `/v3/users/fb0f01bd824f47bdbb676f945f6462fb` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:02.792288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622088d-b35f-4236-a266-a964aeb431c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0f01bd824f47bdbb676f945f6462fb)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:02.794411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622088d-b35f-4236-a266-a964aeb431c2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:02.922197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0622088d-b35f-4236-a266-a964aeb431c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0f01bd824f47bdbb676f945f6462fb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:02.933814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0622088d-b35f-4236-a266-a964aeb431c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0f01bd824f47bdbb676f945f6462fb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:02.933814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0622088d-b35f-4236-a266-a964aeb431c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0f01bd824f47bdbb676f945f6462fb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:02.933814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0622088d-b35f-4236-a266-a964aeb431c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0f01bd824f47bdbb676f945f6462fb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:02.957059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0622088d-b35f-4236-a266-a964aeb431c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0f01bd824f47bdbb676f945f6462fb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:03.008417 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1727/3491] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:02:02 2022] DELETE /identity/v3/users/fb0f01bd824f47bdbb676f945f6462fb => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:03.247501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:03.250785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:03.275668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7219f-9fd3-4bfd-acd8-1d4f431114ed admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:03.352574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:03.353891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:03.354351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:03.354781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e admin admin] PATH_INFO: `/v3/projects/cff16d5d25424e24a25a40e1b0373536` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:03.356348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff16d5d25424e24a25a40e1b0373536)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:03.358419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:03.374257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:03.443195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff16d5d25424e24a25a40e1b0373536', 'request_id': 'req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:03.478243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff16d5d25424e24a25a40e1b0373536', 'request_id': 'req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:03.498944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff16d5d25424e24a25a40e1b0373536', 'request_id': 'req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:03.519313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e admin admin] The token cache is being invalidate because project cff16d5d25424e24a25a40e1b0373536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:02:03.521390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:03.521390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-352c1901-fdd8-449a-aac7-6bcfc00ccb6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:03.524509 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1765/3492] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:02:03 2022] DELETE /identity/v3/projects/cff16d5d25424e24a25a40e1b0373536 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:03.530193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e410932-fd62-4921-a708-0de8d4f9697f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:03.530623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e410932-fd62-4921-a708-0de8d4f9697f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:03.531005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e410932-fd62-4921-a708-0de8d4f9697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:03.564349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9e410932-fd62-4921-a708-0de8d4f9697f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:03.566023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9e410932-fd62-4921-a708-0de8d4f9697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:03.659573 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1728/3493] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:03.661971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805310e-32e3-4a8d-b85c-678914c33768 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:03.662918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805310e-32e3-4a8d-b85c-678914c33768 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:03.662918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805310e-32e3-4a8d-b85c-678914c33768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:03.698188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c805310e-32e3-4a8d-b85c-678914c33768 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:03.698188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c805310e-32e3-4a8d-b85c-678914c33768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:03.705381 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1766/3494] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:03.710055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e410932-fd62-4921-a708-0de8d4f9697f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:03.720680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e410932-fd62-4921-a708-0de8d4f9697f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:03.725257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1134474-c5c2-4166-8f6a-970e11136c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:03.725870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1134474-c5c2-4166-8f6a-970e11136c04 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:03.726150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1134474-c5c2-4166-8f6a-970e11136c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:03.726423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1134474-c5c2-4166-8f6a-970e11136c04 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:03.727224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1134474-c5c2-4166-8f6a-970e11136c04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:02:03.727973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1134474-c5c2-4166-8f6a-970e11136c04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:03.729657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1134474-c5c2-4166-8f6a-970e11136c04 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:03.745352 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1729/3495] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:02:03.746390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805310e-32e3-4a8d-b85c-678914c33768 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:03.757555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805310e-32e3-4a8d-b85c-678914c33768 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:03.763856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e215df-d69c-4c5a-90a6-8c6de6d8cb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:03.764499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e215df-d69c-4c5a-90a6-8c6de6d8cb46 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:03.764846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e215df-d69c-4c5a-90a6-8c6de6d8cb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:03.765126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e215df-d69c-4c5a-90a6-8c6de6d8cb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:03.765845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e215df-d69c-4c5a-90a6-8c6de6d8cb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:03.768538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e215df-d69c-4c5a-90a6-8c6de6d8cb46 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:03.808632 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1767/3496] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:02:03 2022] POST /identity/v3/projects => generated 411 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:02:03.812711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1134474-c5c2-4166-8f6a-970e11136c04 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:03.826676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1134474-c5c2-4166-8f6a-970e11136c04 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:03.866822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:03.911781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e215df-d69c-4c5a-90a6-8c6de6d8cb46 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:03.913887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e6e215df-d69c-4c5a-90a6-8c6de6d8cb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:03.929046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13731f-cd32-4a99-a3b1-ee87adf5bc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:03.930613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13731f-cd32-4a99-a3b1-ee87adf5bc86 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:03.931261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13731f-cd32-4a99-a3b1-ee87adf5bc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:03.931883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13731f-cd32-4a99-a3b1-ee87adf5bc86 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:03.933073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13731f-cd32-4a99-a3b1-ee87adf5bc86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:03.936319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13731f-cd32-4a99-a3b1-ee87adf5bc86 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:03.980557 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1730/3497] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:02:03 2022] POST /identity/v3/users => generated 306 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:02:03.985050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13731f-cd32-4a99-a3b1-ee87adf5bc86 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:03.999348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13731f-cd32-4a99-a3b1-ee87adf5bc86 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:04.006049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc4b79-8143-4c54-89f8-588b9f4ff15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:04.007276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc4b79-8143-4c54-89f8-588b9f4ff15e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:04.009025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc4b79-8143-4c54-89f8-588b9f4ff15e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:04.009612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc4b79-8143-4c54-89f8-588b9f4ff15e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:04.011075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc4b79-8143-4c54-89f8-588b9f4ff15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:04.013566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc4b79-8143-4c54-89f8-588b9f4ff15e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:04.034101 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1731/3498] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:02:04.039532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc4b79-8143-4c54-89f8-588b9f4ff15e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:04.060276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc4b79-8143-4c54-89f8-588b9f4ff15e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:04.069510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea4973-7e31-4418-b23e-3d40329d5233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:04.071109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea4973-7e31-4418-b23e-3d40329d5233 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:04.072216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea4973-7e31-4418-b23e-3d40329d5233 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:04.072664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea4973-7e31-4418-b23e-3d40329d5233 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:04.074792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea4973-7e31-4418-b23e-3d40329d5233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:04.077543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea4973-7e31-4418-b23e-3d40329d5233 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:04.100826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e215df-d69c-4c5a-90a6-8c6de6d8cb46 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:04.111753 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1732/3499] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:02:04.113934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea4973-7e31-4418-b23e-3d40329d5233 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:04.114289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b9d5f-f4ae-46a9-9c65-6d5a5f37dfff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:04.115489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9d5f-f4ae-46a9-9c65-6d5a5f37dfff service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:04.115764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9d5f-f4ae-46a9-9c65-6d5a5f37dfff service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:04.116674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9d5f-f4ae-46a9-9c65-6d5a5f37dfff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:04.120282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bf3b9d5f-f4ae-46a9-9c65-6d5a5f37dfff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:04.129759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea4973-7e31-4418-b23e-3d40329d5233 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:04.137161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81185873-1630-4f39-8388-17652fc37fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:04.139623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81185873-1630-4f39-8388-17652fc37fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:04.139623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81185873-1630-4f39-8388-17652fc37fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:04.139623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81185873-1630-4f39-8388-17652fc37fd9 admin admin] PATH_INFO: `/v3/projects/2f51fe43d7c143ebb6d53f5942941c9d/users/95cfeacf062f486c985ca772f2f36faf/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:04.145472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b9d5f-f4ae-46a9-9c65-6d5a5f37dfff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:04.147323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b9d5f-f4ae-46a9-9c65-6d5a5f37dfff service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:04.158020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81185873-1630-4f39-8388-17652fc37fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f51fe43d7c143ebb6d53f5942941c9d, user_id=95cfeacf062f486c985ca772f2f36faf, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:04.161698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81185873-1630-4f39-8388-17652fc37fd9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:04.163805 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1768/3500] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:04.180796 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1733/3501] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:02:04 2022] PUT /identity/v3/projects/2f51fe43d7c143ebb6d53f5942941c9d/users/95cfeacf062f486c985ca772f2f36faf/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:04.187058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755daccb-daba-4432-88a8-bf2577abbf47 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:04.187317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755daccb-daba-4432-88a8-bf2577abbf47 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:04.187774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755daccb-daba-4432-88a8-bf2577abbf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:04.215137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-755daccb-daba-4432-88a8-bf2577abbf47 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:04.216550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-755daccb-daba-4432-88a8-bf2577abbf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:04.338252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:04.364457 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1769/3502] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:04.372254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81185873-1630-4f39-8388-17652fc37fd9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:04.380497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-81185873-1630-4f39-8388-17652fc37fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:04.469355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81185873-1630-4f39-8388-17652fc37fd9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:04.474768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff9cd9-27b9-4acb-909f-b89f8c504d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:04.475560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff9cd9-27b9-4acb-909f-b89f8c504d65 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:04.475849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff9cd9-27b9-4acb-909f-b89f8c504d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:04.476123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff9cd9-27b9-4acb-909f-b89f8c504d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:04.497654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff9cd9-27b9-4acb-909f-b89f8c504d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:04.499272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff9cd9-27b9-4acb-909f-b89f8c504d65 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:04.511983 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1734/3503] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:02:08.748702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755daccb-daba-4432-88a8-bf2577abbf47 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:08.764020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755daccb-daba-4432-88a8-bf2577abbf47 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:08.775108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cbfc5-d775-4cac-a328-9b4711c93dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:08.776176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cbfc5-d775-4cac-a328-9b4711c93dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:08.778847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cbfc5-d775-4cac-a328-9b4711c93dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:08.779245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cbfc5-d775-4cac-a328-9b4711c93dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:08.781363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bf1cbfc5-d775-4cac-a328-9b4711c93dd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:08.819025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cbfc5-d775-4cac-a328-9b4711c93dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:08.822623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cbfc5-d775-4cac-a328-9b4711c93dd7 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:08.854614 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1770/3504] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:12.681107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0672e-d598-4100-9028-1bdbfd4c19d5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:12.681973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0672e-d598-4100-9028-1bdbfd4c19d5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:12.682406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0672e-d598-4100-9028-1bdbfd4c19d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:12.770969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-23b0672e-d598-4100-9028-1bdbfd4c19d5 None None] MFA Rules not processed for user `40f60e33f334465fac1148669de3f00c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:12.773215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-23b0672e-d598-4100-9028-1bdbfd4c19d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:12.916218 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1735/3505] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:12.953084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cbfc5-d775-4cac-a328-9b4711c93dd7 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:12.955823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bf1cbfc5-d775-4cac-a328-9b4711c93dd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:12.978576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cbfc5-d775-4cac-a328-9b4711c93dd7 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:12.987923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03c21d-c9dc-4893-8757-555c9b8f6479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:12.989826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c21d-c9dc-4893-8757-555c9b8f6479 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:12.990123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c21d-c9dc-4893-8757-555c9b8f6479 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:12.991755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c21d-c9dc-4893-8757-555c9b8f6479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:13.009034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03c21d-c9dc-4893-8757-555c9b8f6479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:13.011299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03c21d-c9dc-4893-8757-555c9b8f6479 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:13.033862 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1771/3506] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:14.864656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0672e-d598-4100-9028-1bdbfd4c19d5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:14.869279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-23b0672e-d598-4100-9028-1bdbfd4c19d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:14.897481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0672e-d598-4100-9028-1bdbfd4c19d5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:14.908603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:14.910539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:14.911133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:14.911581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] PATH_INFO: `/v3/users/612551711ec44a9b856a706a1c4c46e7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:14.913123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=612551711ec44a9b856a706a1c4c46e7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:14.915985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:14.922886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:15.036035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612551711ec44a9b856a706a1c4c46e7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:15.054368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612551711ec44a9b856a706a1c4c46e7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:15.055135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612551711ec44a9b856a706a1c4c46e7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:15.055789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612551711ec44a9b856a706a1c4c46e7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:15.078057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612551711ec44a9b856a706a1c4c46e7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:15.102973 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1736/3507] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:02:14 2022] DELETE /identity/v3/users/612551711ec44a9b856a706a1c4c46e7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:15.756902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03c21d-c9dc-4893-8757-555c9b8f6479 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:15.811116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:15.812594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:15.982351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03c21d-c9dc-4893-8757-555c9b8f6479 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:16.002703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2b437-e83f-41aa-8136-fcb87558de57 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:16.041513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb8fb8-540f-4a25-a2d2-4da572a799fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:16.043101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb8fb8-540f-4a25-a2d2-4da572a799fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:16.045759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb8fb8-540f-4a25-a2d2-4da572a799fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:16.046990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb8fb8-540f-4a25-a2d2-4da572a799fd admin admin] PATH_INFO: `/v3/projects/8c917d40fe85495081525a0d2952f888` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:16.056220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb8fb8-540f-4a25-a2d2-4da572a799fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c917d40fe85495081525a0d2952f888)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:16.063656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb8fb8-540f-4a25-a2d2-4da572a799fd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:16.270105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4f1dd-abe9-4776-9a51-012eafa98918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:16.271179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4f1dd-abe9-4776-9a51-012eafa98918 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:16.271522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4f1dd-abe9-4776-9a51-012eafa98918 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:16.275161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4f1dd-abe9-4776-9a51-012eafa98918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:16.280662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9ca4f1dd-abe9-4776-9a51-012eafa98918 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:16.288417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cffb8fb8-540f-4a25-a2d2-4da572a799fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c917d40fe85495081525a0d2952f888', 'request_id': 'req-cffb8fb8-540f-4a25-a2d2-4da572a799fd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:16.313450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cffb8fb8-540f-4a25-a2d2-4da572a799fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c917d40fe85495081525a0d2952f888', 'request_id': 'req-cffb8fb8-540f-4a25-a2d2-4da572a799fd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:16.327001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cffb8fb8-540f-4a25-a2d2-4da572a799fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c917d40fe85495081525a0d2952f888', 'request_id': 'req-cffb8fb8-540f-4a25-a2d2-4da572a799fd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:16.345691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cffb8fb8-540f-4a25-a2d2-4da572a799fd admin admin] The token cache is being invalidate because project 8c917d40fe85495081525a0d2952f888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:02:16.346230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cffb8fb8-540f-4a25-a2d2-4da572a799fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:16.347063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cffb8fb8-540f-4a25-a2d2-4da572a799fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:16.349336 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1737/3508] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:02:15 2022] DELETE /identity/v3/projects/8c917d40fe85495081525a0d2952f888 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:16.355901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4f1dd-abe9-4776-9a51-012eafa98918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:16.364657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4f1dd-abe9-4776-9a51-012eafa98918 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:16.372553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78f03f-8db4-4762-8238-d92ef3991d47 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:16.373574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78f03f-8db4-4762-8238-d92ef3991d47 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:16.374628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78f03f-8db4-4762-8238-d92ef3991d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:16.406547 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1772/3509] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:16.426327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cf78f03f-8db4-4762-8238-d92ef3991d47 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:16.430175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cf78f03f-8db4-4762-8238-d92ef3991d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:16.441401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:16.599063 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1738/3510] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:16.607248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac09809-4c07-4eb6-aa2f-7365c658135c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:16.607768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac09809-4c07-4eb6-aa2f-7365c658135c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:16.608072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac09809-4c07-4eb6-aa2f-7365c658135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:16.660581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7ac09809-4c07-4eb6-aa2f-7365c658135c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:16.661931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7ac09809-4c07-4eb6-aa2f-7365c658135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:16.709043 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1773/3511] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:16.712850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78f03f-8db4-4762-8238-d92ef3991d47 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:16.726838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78f03f-8db4-4762-8238-d92ef3991d47 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:16.740697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00237-5eda-4b57-acc1-0b0ad134503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:16.742324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00237-5eda-4b57-acc1-0b0ad134503b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:16.742835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00237-5eda-4b57-acc1-0b0ad134503b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:16.743349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00237-5eda-4b57-acc1-0b0ad134503b admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:16.744252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad00237-5eda-4b57-acc1-0b0ad134503b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:02:16.744808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad00237-5eda-4b57-acc1-0b0ad134503b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:16.748789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad00237-5eda-4b57-acc1-0b0ad134503b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:16.784719 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1739/3512] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:02:16.790322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac09809-4c07-4eb6-aa2f-7365c658135c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:16.804256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac09809-4c07-4eb6-aa2f-7365c658135c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:16.818868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cfcb1-eba8-4b50-9ea7-46f2f25261fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:16.820634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cfcb1-eba8-4b50-9ea7-46f2f25261fc admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:16.821134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cfcb1-eba8-4b50-9ea7-46f2f25261fc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:16.821664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cfcb1-eba8-4b50-9ea7-46f2f25261fc admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:16.822637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cfcb1-eba8-4b50-9ea7-46f2f25261fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:16.827766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cfcb1-eba8-4b50-9ea7-46f2f25261fc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:16.894861 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1774/3513] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:02:16 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:02:16.899671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00237-5eda-4b57-acc1-0b0ad134503b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:16.912452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00237-5eda-4b57-acc1-0b0ad134503b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:17.059995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14cc60-9efb-4b66-987a-1a6b11e36703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:17.061081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14cc60-9efb-4b66-987a-1a6b11e36703 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:17.061514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14cc60-9efb-4b66-987a-1a6b11e36703 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:17.062636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14cc60-9efb-4b66-987a-1a6b11e36703 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:17.063817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14cc60-9efb-4b66-987a-1a6b11e36703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:17.071312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14cc60-9efb-4b66-987a-1a6b11e36703 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:17.117687 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1740/3514] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:02:16 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:02:17.121756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cfcb1-eba8-4b50-9ea7-46f2f25261fc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:17.138770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cfcb1-eba8-4b50-9ea7-46f2f25261fc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:17.156505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d88681-5f50-4d58-9c8f-9b367c4fd913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:17.158896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d88681-5f50-4d58-9c8f-9b367c4fd913 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:17.160169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d88681-5f50-4d58-9c8f-9b367c4fd913 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:17.160740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d88681-5f50-4d58-9c8f-9b367c4fd913 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:17.164806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d88681-5f50-4d58-9c8f-9b367c4fd913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:17.170281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d88681-5f50-4d58-9c8f-9b367c4fd913 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:17.200479 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1775/3515] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:02:17.206310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14cc60-9efb-4b66-987a-1a6b11e36703 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:17.225911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14cc60-9efb-4b66-987a-1a6b11e36703 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:17.248287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfd671-a2c8-4138-a090-7f14747be117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:17.249107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfd671-a2c8-4138-a090-7f14747be117 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:17.249524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfd671-a2c8-4138-a090-7f14747be117 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:17.249929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfd671-a2c8-4138-a090-7f14747be117 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:17.250883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfd671-a2c8-4138-a090-7f14747be117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:17.252709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfd671-a2c8-4138-a090-7f14747be117 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:17.272675 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1741/3516] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:02:17.276888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d88681-5f50-4d58-9c8f-9b367c4fd913 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:17.294299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d88681-5f50-4d58-9c8f-9b367c4fd913 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:17.312838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590bf91-9afb-47cf-8520-30d9cb7ea264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:17.315015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590bf91-9afb-47cf-8520-30d9cb7ea264 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:17.317858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590bf91-9afb-47cf-8520-30d9cb7ea264 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:17.318318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590bf91-9afb-47cf-8520-30d9cb7ea264 admin admin] PATH_INFO: `/v3/projects/75b2a56286924e2d953bebe717ce591b/users/bf2e13f1952a4e5bb23d57dd7fa31875/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:17.367392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:17.383657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19a2bd-d11c-4256-919d-80abc474d19f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:17.384127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19a2bd-d11c-4256-919d-80abc474d19f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:17.384760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19a2bd-d11c-4256-919d-80abc474d19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:17.386035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590bf91-9afb-47cf-8520-30d9cb7ea264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b2a56286924e2d953bebe717ce591b, user_id=bf2e13f1952a4e5bb23d57dd7fa31875, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:17.389720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590bf91-9afb-47cf-8520-30d9cb7ea264 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:17.420752 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1776/3517] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:02:17 2022] PUT /identity/v3/projects/75b2a56286924e2d953bebe717ce591b/users/bf2e13f1952a4e5bb23d57dd7fa31875/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:17.425277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4c19a2bd-d11c-4256-919d-80abc474d19f None None] MFA Rules not processed for user `40f60e33f334465fac1148669de3f00c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:17.426233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fa11e-60ca-44cb-9008-9c598839f017 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:17.426793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4c19a2bd-d11c-4256-919d-80abc474d19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:17.427555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fa11e-60ca-44cb-9008-9c598839f017 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:17.428009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fa11e-60ca-44cb-9008-9c598839f017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:17.460308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bb1fa11e-60ca-44cb-9008-9c598839f017 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:17.462124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bb1fa11e-60ca-44cb-9008-9c598839f017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:17.565833 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1742/3518] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:17.575551 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1777/3519] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:17.587024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19a2bd-d11c-4256-919d-80abc474d19f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:17.588464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4c19a2bd-d11c-4256-919d-80abc474d19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:17.657100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:17.738702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19a2bd-d11c-4256-919d-80abc474d19f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:17.754178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58807279-7514-41fc-a7da-a18f9f23227d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:17.755018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58807279-7514-41fc-a7da-a18f9f23227d service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:17.755486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58807279-7514-41fc-a7da-a18f9f23227d service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:17.756699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58807279-7514-41fc-a7da-a18f9f23227d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:17.790638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58807279-7514-41fc-a7da-a18f9f23227d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:17.792420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58807279-7514-41fc-a7da-a18f9f23227d service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:17.817987 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1743/3520] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:18.242003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fa11e-60ca-44cb-9008-9c598839f017 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:18.243978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bb1fa11e-60ca-44cb-9008-9c598839f017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:18.275479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fa11e-60ca-44cb-9008-9c598839f017 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:18.303578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0c018-22ee-402b-812f-65e0d6a61f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:18.314720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0c018-22ee-402b-812f-65e0d6a61f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:18.315230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0c018-22ee-402b-812f-65e0d6a61f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:18.315837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0c018-22ee-402b-812f-65e0d6a61f6c admin admin] PATH_INFO: `/v3/users/56c7aebdf00342b1ba80833663f8c0a9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:18.319976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0c018-22ee-402b-812f-65e0d6a61f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c7aebdf00342b1ba80833663f8c0a9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:18.334751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0c018-22ee-402b-812f-65e0d6a61f6c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:18.601228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-37a0c018-22ee-402b-812f-65e0d6a61f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c7aebdf00342b1ba80833663f8c0a9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:18.633014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-37a0c018-22ee-402b-812f-65e0d6a61f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c7aebdf00342b1ba80833663f8c0a9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:18.639172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-37a0c018-22ee-402b-812f-65e0d6a61f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c7aebdf00342b1ba80833663f8c0a9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:18.641981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-37a0c018-22ee-402b-812f-65e0d6a61f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c7aebdf00342b1ba80833663f8c0a9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:18.705504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-37a0c018-22ee-402b-812f-65e0d6a61f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c7aebdf00342b1ba80833663f8c0a9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:18.750551 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1778/3521] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:02:18 2022] DELETE /identity/v3/users/56c7aebdf00342b1ba80833663f8c0a9 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:19.372787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58807279-7514-41fc-a7da-a18f9f23227d service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:19.385680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58807279-7514-41fc-a7da-a18f9f23227d service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:19.509523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:19.510225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:19.510508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:19.510784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] PATH_INFO: `/v3/projects/ad3679a59b504731b5f56e52788fd645` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:19.512756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3679a59b504731b5f56e52788fd645)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:19.514782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:19.609674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3679a59b504731b5f56e52788fd645', 'request_id': 'req-a33d6e52-9672-4212-9527-71e8885514a5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:19.634275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3679a59b504731b5f56e52788fd645', 'request_id': 'req-a33d6e52-9672-4212-9527-71e8885514a5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:19.654611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3679a59b504731b5f56e52788fd645', 'request_id': 'req-a33d6e52-9672-4212-9527-71e8885514a5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:19.681862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] The token cache is being invalidate because project ad3679a59b504731b5f56e52788fd645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:02:19.682170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:19.684242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:19.692557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42898819-b1e1-4893-a3fc-37b5aa1b8056 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:19.693108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42898819-b1e1-4893-a3fc-37b5aa1b8056 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:19.693108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42898819-b1e1-4893-a3fc-37b5aa1b8056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:19.696447 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1744/3522] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:02:19 2022] DELETE /identity/v3/projects/ad3679a59b504731b5f56e52788fd645 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:19.733035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-42898819-b1e1-4893-a3fc-37b5aa1b8056 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:19.737856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-42898819-b1e1-4893-a3fc-37b5aa1b8056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:19.806413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:19.808102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:19.863991 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1779/3523] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:19.865914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3e7cc-ddec-4310-940a-fb076a2e481a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:19.866356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3e7cc-ddec-4310-940a-fb076a2e481a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:19.866843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3e7cc-ddec-4310-940a-fb076a2e481a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:19.880482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:19.918234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fee3e7cc-ddec-4310-940a-fb076a2e481a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:19.919840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fee3e7cc-ddec-4310-940a-fb076a2e481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:19.938626 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1780/3524] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:19.943148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3e7cc-ddec-4310-940a-fb076a2e481a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:19.956842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3e7cc-ddec-4310-940a-fb076a2e481a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:19.966908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8c526-a9df-4b11-bd93-7d6f70affff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:19.967734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d6e52-9672-4212-9527-71e8885514a5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:19.967993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8c526-a9df-4b11-bd93-7d6f70affff0 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:19.968449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8c526-a9df-4b11-bd93-7d6f70affff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:19.968902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8c526-a9df-4b11-bd93-7d6f70affff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:19.969783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8c526-a9df-4b11-bd93-7d6f70affff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:02:19.970443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8c526-a9df-4b11-bd93-7d6f70affff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:19.972321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8c526-a9df-4b11-bd93-7d6f70affff0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:19.980539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19104e-8467-4d85-bc8e-e39dcf5d1a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:19.984107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19104e-8467-4d85-bc8e-e39dcf5d1a6d service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:19.984107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19104e-8467-4d85-bc8e-e39dcf5d1a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:19.984322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19104e-8467-4d85-bc8e-e39dcf5d1a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:19.994351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5e19104e-8467-4d85-bc8e-e39dcf5d1a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:20.000281 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1781/3525] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:02:20.001164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8c526-a9df-4b11-bd93-7d6f70affff0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:20.016612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8c526-a9df-4b11-bd93-7d6f70affff0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:20.021419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:20.021966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbda5a-7911-46f9-840f-40cbf571848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:20.022719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbda5a-7911-46f9-840f-40cbf571848a admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:20.023077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbda5a-7911-46f9-840f-40cbf571848a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:20.023350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbda5a-7911-46f9-840f-40cbf571848a admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:20.024052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbda5a-7911-46f9-840f-40cbf571848a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:20.026229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbda5a-7911-46f9-840f-40cbf571848a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:20.033701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19104e-8467-4d85-bc8e-e39dcf5d1a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:20.039108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19104e-8467-4d85-bc8e-e39dcf5d1a6d service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:20.059530 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1745/3526] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:02:20.068009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19104e-8467-4d85-bc8e-e39dcf5d1a6d service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:20.069061 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1782/3527] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:02:20 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:02:20.084356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19104e-8467-4d85-bc8e-e39dcf5d1a6d service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:20.268773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb5f35-5ce5-4fcf-80e4-a719591b18ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:20.269666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb5f35-5ce5-4fcf-80e4-a719591b18ef admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:20.270013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb5f35-5ce5-4fcf-80e4-a719591b18ef admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:20.270306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb5f35-5ce5-4fcf-80e4-a719591b18ef admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:20.272676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb5f35-5ce5-4fcf-80e4-a719591b18ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:20.275120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb5f35-5ce5-4fcf-80e4-a719591b18ef admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:20.311486 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1746/3528] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:02:20 2022] POST /identity/v3/users => generated 291 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:02:20.313376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbda5a-7911-46f9-840f-40cbf571848a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:20.334584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbda5a-7911-46f9-840f-40cbf571848a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:20.362942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd376b2-1cde-4e72-b3ee-fee53503e0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:20.364542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd376b2-1cde-4e72-b3ee-fee53503e0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:20.366192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd376b2-1cde-4e72-b3ee-fee53503e0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:20.367331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd376b2-1cde-4e72-b3ee-fee53503e0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:20.371757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd376b2-1cde-4e72-b3ee-fee53503e0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:20.374637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd376b2-1cde-4e72-b3ee-fee53503e0a2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:20.412576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb5f35-5ce5-4fcf-80e4-a719591b18ef admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:20.414596 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1783/3529] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:02:20.419806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd376b2-1cde-4e72-b3ee-fee53503e0a2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:20.426543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ebd376b2-1cde-4e72-b3ee-fee53503e0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:20.435514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb5f35-5ce5-4fcf-80e4-a719591b18ef admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:20.443304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a4fc2-e175-415c-9e9a-1cb8a4b77222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:20.444399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a4fc2-e175-415c-9e9a-1cb8a4b77222 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:20.445057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a4fc2-e175-415c-9e9a-1cb8a4b77222 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:20.445716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a4fc2-e175-415c-9e9a-1cb8a4b77222 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:20.446787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a4fc2-e175-415c-9e9a-1cb8a4b77222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:20.448805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a4fc2-e175-415c-9e9a-1cb8a4b77222 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:20.464529 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1747/3530] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:02:20.468542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a4fc2-e175-415c-9e9a-1cb8a4b77222 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:20.504135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a4fc2-e175-415c-9e9a-1cb8a4b77222 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:20.517523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c44e2-48f4-4a04-9721-6306c40cb429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:20.518307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c44e2-48f4-4a04-9721-6306c40cb429 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:20.518567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c44e2-48f4-4a04-9721-6306c40cb429 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:20.518966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c44e2-48f4-4a04-9721-6306c40cb429 admin admin] PATH_INFO: `/v3/projects/0b70cb43c39e4e0ba89680d7b8459c01/users/0f6088285b46499a98162b6237517174/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:20.565406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c44e2-48f4-4a04-9721-6306c40cb429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b70cb43c39e4e0ba89680d7b8459c01, user_id=0f6088285b46499a98162b6237517174, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:20.571120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c44e2-48f4-4a04-9721-6306c40cb429 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:20.608544 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1748/3531] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:02:20 2022] PUT /identity/v3/projects/0b70cb43c39e4e0ba89680d7b8459c01/users/0f6088285b46499a98162b6237517174/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:02:20.610949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34226373-3fa9-4ef6-9b5b-c1907473002d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:20.611225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34226373-3fa9-4ef6-9b5b-c1907473002d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:20.611512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34226373-3fa9-4ef6-9b5b-c1907473002d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:20.651595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-34226373-3fa9-4ef6-9b5b-c1907473002d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:20.654894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd376b2-1cde-4e72-b3ee-fee53503e0a2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:20.657754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-34226373-3fa9-4ef6-9b5b-c1907473002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:20.803696 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1749/3532] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:02:20.806424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764181d-a5e1-4a92-8f0c-08fed5eaa1ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:20.807821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764181d-a5e1-4a92-8f0c-08fed5eaa1ab service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:20.808404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764181d-a5e1-4a92-8f0c-08fed5eaa1ab service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:20.809291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764181d-a5e1-4a92-8f0c-08fed5eaa1ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:20.811834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3764181d-a5e1-4a92-8f0c-08fed5eaa1ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:20.837053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764181d-a5e1-4a92-8f0c-08fed5eaa1ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:20.845350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764181d-a5e1-4a92-8f0c-08fed5eaa1ab service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:20.968144 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1784/3533] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:20.968335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34226373-3fa9-4ef6-9b5b-c1907473002d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:20.970365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-34226373-3fa9-4ef6-9b5b-c1907473002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:21.199206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34226373-3fa9-4ef6-9b5b-c1907473002d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:21.206509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdfec1-6aed-409c-806e-53dbe0b3546b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:21.207214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdfec1-6aed-409c-806e-53dbe0b3546b service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:21.207720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdfec1-6aed-409c-806e-53dbe0b3546b service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:21.208273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdfec1-6aed-409c-806e-53dbe0b3546b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:21.216337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:21.229057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdfec1-6aed-409c-806e-53dbe0b3546b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:21.234770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdfec1-6aed-409c-806e-53dbe0b3546b service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:21.271438 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1750/3534] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:22.981092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764181d-a5e1-4a92-8f0c-08fed5eaa1ab service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:22.982820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3764181d-a5e1-4a92-8f0c-08fed5eaa1ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:23.086557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:23.182642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764181d-a5e1-4a92-8f0c-08fed5eaa1ab service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:23.192303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14cdc3-3072-487f-8481-5d24da617536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:23.199615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14cdc3-3072-487f-8481-5d24da617536 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:23.200681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14cdc3-3072-487f-8481-5d24da617536 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:23.202037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14cdc3-3072-487f-8481-5d24da617536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:23.207291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cc14cdc3-3072-487f-8481-5d24da617536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:23.383528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14cdc3-3072-487f-8481-5d24da617536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:23.386253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14cdc3-3072-487f-8481-5d24da617536 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:23.414885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1785/3535] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:23.474304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdfec1-6aed-409c-806e-53dbe0b3546b service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:23.487042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdfec1-6aed-409c-806e-53dbe0b3546b service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:23.513537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbdd10-babd-4e98-acee-50dac11ce8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:23.518978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbdd10-babd-4e98-acee-50dac11ce8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:23.529637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbdd10-babd-4e98-acee-50dac11ce8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:23.529976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbdd10-babd-4e98-acee-50dac11ce8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:23.537329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-43dbdd10-babd-4e98-acee-50dac11ce8c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:23.555107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbdd10-babd-4e98-acee-50dac11ce8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:23.557401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbdd10-babd-4e98-acee-50dac11ce8c1 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:23.570211 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1751/3536] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:25.706409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571908a-19ba-4622-ade6-a2106eda2670 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:25.706853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571908a-19ba-4622-ade6-a2106eda2670 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:25.706991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571908a-19ba-4622-ade6-a2106eda2670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:25.774564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e571908a-19ba-4622-ade6-a2106eda2670 None None] MFA Rules not processed for user `95cfeacf062f486c985ca772f2f36faf`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:25.776337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e571908a-19ba-4622-ade6-a2106eda2670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:25.972490 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1786/3537] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:25.974641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c9d69-fc7a-43f7-aa84-696631e8db5c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:25.975160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c9d69-fc7a-43f7-aa84-696631e8db5c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:25.975266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c9d69-fc7a-43f7-aa84-696631e8db5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:26.031165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6b5c9d69-fc7a-43f7-aa84-696631e8db5c None None] MFA Rules not processed for user `95cfeacf062f486c985ca772f2f36faf`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:26.035897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6b5c9d69-fc7a-43f7-aa84-696631e8db5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:26.063586 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1752/3538] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:26.281315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571908a-19ba-4622-ade6-a2106eda2670 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:26.310586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571908a-19ba-4622-ade6-a2106eda2670 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:26.318817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007c096-5e7f-412f-813f-f6d9c249d831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:26.320152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007c096-5e7f-412f-813f-f6d9c249d831 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:26.320678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007c096-5e7f-412f-813f-f6d9c249d831 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:26.321292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007c096-5e7f-412f-813f-f6d9c249d831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:26.333135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007c096-5e7f-412f-813f-f6d9c249d831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:26.336437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007c096-5e7f-412f-813f-f6d9c249d831 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:26.355867 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1787/3539] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:26 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:31.890960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0db61-7cef-4f5d-b0a5-0f1bbfaa753f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:31.892539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0db61-7cef-4f5d-b0a5-0f1bbfaa753f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:31.893161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0db61-7cef-4f5d-b0a5-0f1bbfaa753f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:31.957568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-75c0db61-7cef-4f5d-b0a5-0f1bbfaa753f None None] MFA Rules not processed for user `5e3216124a4f41b2b931a16c750649df`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:31.961470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-75c0db61-7cef-4f5d-b0a5-0f1bbfaa753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:31.981375 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1753/3540] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:36.345123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=75 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:37.478075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a54d9c-adf0-4df0-833d-a3958320b16f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:37.478684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a54d9c-adf0-4df0-833d-a3958320b16f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:37.478684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a54d9c-adf0-4df0-833d-a3958320b16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:37.512095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-93a54d9c-adf0-4df0-833d-a3958320b16f None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:37.513915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-93a54d9c-adf0-4df0-833d-a3958320b16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:37.630270 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1788/3541] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:37.650098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0db61-7cef-4f5d-b0a5-0f1bbfaa753f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:37.652145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-75c0db61-7cef-4f5d-b0a5-0f1bbfaa753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:37.766776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0db61-7cef-4f5d-b0a5-0f1bbfaa753f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:37.781126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9d8e2-25e8-45b0-9bfd-f01033ea851d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:37.782295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9d8e2-25e8-45b0-9bfd-f01033ea851d service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:37.782814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9d8e2-25e8-45b0-9bfd-f01033ea851d service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:37.783302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9d8e2-25e8-45b0-9bfd-f01033ea851d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:37.794194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9d8e2-25e8-45b0-9bfd-f01033ea851d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:37.796983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9d8e2-25e8-45b0-9bfd-f01033ea851d service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:37.808895 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1754/3542] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:02:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:02:40.323893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a54d9c-adf0-4df0-833d-a3958320b16f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:40.325377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-93a54d9c-adf0-4df0-833d-a3958320b16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:40.354082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a54d9c-adf0-4df0-833d-a3958320b16f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:40.367937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:40.368828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:40.370557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:40.371045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] PATH_INFO: `/v3/users/bc0c5c9593754f1cb98f9689b29606a2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:40.376556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0c5c9593754f1cb98f9689b29606a2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:40.382566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:40.533792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0c5c9593754f1cb98f9689b29606a2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:40.558407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0c5c9593754f1cb98f9689b29606a2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:40.560552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0c5c9593754f1cb98f9689b29606a2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:40.561850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0c5c9593754f1cb98f9689b29606a2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:40.608778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0c5c9593754f1cb98f9689b29606a2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:40.642343 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1789/3543] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:02:40 2022] DELETE /identity/v3/users/bc0c5c9593754f1cb98f9689b29606a2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:42.335455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9d8e2-25e8-45b0-9bfd-f01033ea851d service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:42.357221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9d8e2-25e8-45b0-9bfd-f01033ea851d service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:42.503245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:42.504262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:42.504689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:42.505126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] PATH_INFO: `/v3/projects/ec51fae793a147d88e5d956352f18b92` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:42.506591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec51fae793a147d88e5d956352f18b92)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:42.508521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:42.617586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec51fae793a147d88e5d956352f18b92', 'request_id': 'req-e1c01467-c01d-4c0b-8830-64a0c9c454d6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:42.637838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec51fae793a147d88e5d956352f18b92', 'request_id': 'req-e1c01467-c01d-4c0b-8830-64a0c9c454d6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:42.641036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:42.649221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec51fae793a147d88e5d956352f18b92', 'request_id': 'req-e1c01467-c01d-4c0b-8830-64a0c9c454d6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:42.675665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] The token cache is being invalidate because project ec51fae793a147d88e5d956352f18b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:02:42.675968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:42.682156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:42.688057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:42.688597 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1755/3544] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:02:42 2022] DELETE /identity/v3/projects/ec51fae793a147d88e5d956352f18b92 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:42.689752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:42.691519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:42.692833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:42.864841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece14197-31a4-4db9-ae23-a76df4b7f355 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:42.891293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:42.916123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c01467-c01d-4c0b-8830-64a0c9c454d6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:42.927403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64122eb2-a5c9-4510-9a14-00987843a59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:42.928007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64122eb2-a5c9-4510-9a14-00987843a59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:42.928960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64122eb2-a5c9-4510-9a14-00987843a59a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:42.929329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64122eb2-a5c9-4510-9a14-00987843a59a admin admin] PATH_INFO: `/v3/users/99cb54b2c0404ec5bae71cb1365a3cd5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:42.930612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64122eb2-a5c9-4510-9a14-00987843a59a admin admin] RBAC: Authorizing `identity:delete_user(user_id=99cb54b2c0404ec5bae71cb1365a3cd5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:42.932649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64122eb2-a5c9-4510-9a14-00987843a59a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:42.999224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef41b2-63b7-4d24-9da4-9c0fe914095f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:43.000023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef41b2-63b7-4d24-9da4-9c0fe914095f service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:43.000405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef41b2-63b7-4d24-9da4-9c0fe914095f service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:43.000815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef41b2-63b7-4d24-9da4-9c0fe914095f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:43.003293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b3ef41b2-63b7-4d24-9da4-9c0fe914095f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:43.018411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef41b2-63b7-4d24-9da4-9c0fe914095f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:43.020315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef41b2-63b7-4d24-9da4-9c0fe914095f service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:43.037244 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1790/3545] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:43.040015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c56313-f480-4c37-8437-57e67f36689d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:43.040361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c56313-f480-4c37-8437-57e67f36689d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:43.040831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c56313-f480-4c37-8437-57e67f36689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:43.108323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-64122eb2-a5c9-4510-9a14-00987843a59a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99cb54b2c0404ec5bae71cb1365a3cd5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:43.128058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-21c56313-f480-4c37-8437-57e67f36689d None None] MFA Rules not processed for user `bf2e13f1952a4e5bb23d57dd7fa31875`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:43.135755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-21c56313-f480-4c37-8437-57e67f36689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:43.140429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-64122eb2-a5c9-4510-9a14-00987843a59a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99cb54b2c0404ec5bae71cb1365a3cd5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:43.144294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-64122eb2-a5c9-4510-9a14-00987843a59a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99cb54b2c0404ec5bae71cb1365a3cd5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:43.144294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-64122eb2-a5c9-4510-9a14-00987843a59a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99cb54b2c0404ec5bae71cb1365a3cd5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:43.171388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-64122eb2-a5c9-4510-9a14-00987843a59a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99cb54b2c0404ec5bae71cb1365a3cd5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:43.193775 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1756/3546] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:02:42 2022] DELETE /identity/v3/users/99cb54b2c0404ec5bae71cb1365a3cd5 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:43.296493 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1791/3547] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:43.307970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb4658-e874-41c6-8c5a-8d9603b24ce5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:43.308348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb4658-e874-41c6-8c5a-8d9603b24ce5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:43.308550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb4658-e874-41c6-8c5a-8d9603b24ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:43.342743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-92bb4658-e874-41c6-8c5a-8d9603b24ce5 None None] MFA Rules not processed for user `bf2e13f1952a4e5bb23d57dd7fa31875`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:43.343959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-92bb4658-e874-41c6-8c5a-8d9603b24ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:43.500823 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1757/3548] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:43.794573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12f6c2-dc82-4fb5-a417-26ee00f3a9b3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:43.795038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12f6c2-dc82-4fb5-a417-26ee00f3a9b3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:43.795038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12f6c2-dc82-4fb5-a417-26ee00f3a9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:43.820167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb4658-e874-41c6-8c5a-8d9603b24ce5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:43.822058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-92bb4658-e874-41c6-8c5a-8d9603b24ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:43.883735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:43.934694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-df12f6c2-dc82-4fb5-a417-26ee00f3a9b3 None None] MFA Rules not processed for user `0f6088285b46499a98162b6237517174`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:43.936070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-df12f6c2-dc82-4fb5-a417-26ee00f3a9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:44.095499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb4658-e874-41c6-8c5a-8d9603b24ce5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:44.118489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424cee4-c53e-4e20-8c55-ab07219f143b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:44.119852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424cee4-c53e-4e20-8c55-ab07219f143b service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:44.120135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424cee4-c53e-4e20-8c55-ab07219f143b service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:44.121855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424cee4-c53e-4e20-8c55-ab07219f143b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:44.137768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424cee4-c53e-4e20-8c55-ab07219f143b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:44.139407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424cee4-c53e-4e20-8c55-ab07219f143b service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:44.166032 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1792/3549] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:44.168257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c9ae6-e98d-400e-a082-bbca33ed198e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:44.168353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c9ae6-e98d-400e-a082-bbca33ed198e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:44.168610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c9ae6-e98d-400e-a082-bbca33ed198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:44.190686 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1758/3550] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:44.232105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3e0c9ae6-e98d-400e-a082-bbca33ed198e None None] MFA Rules not processed for user `0f6088285b46499a98162b6237517174`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:44.233018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3e0c9ae6-e98d-400e-a082-bbca33ed198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:44.260739 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1793/3551] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:45.197733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424cee4-c53e-4e20-8c55-ab07219f143b service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:45.200827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2424cee4-c53e-4e20-8c55-ab07219f143b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:45.469540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424cee4-c53e-4e20-8c55-ab07219f143b service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:45.484384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427abcb-51ce-48f5-bb90-5df6260018c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:45.484639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427abcb-51ce-48f5-bb90-5df6260018c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:45.484913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427abcb-51ce-48f5-bb90-5df6260018c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:45.485654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427abcb-51ce-48f5-bb90-5df6260018c6 admin admin] PATH_INFO: `/v3/projects/4574b2bedd2d4882beb2232e281c9562` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:45.510530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427abcb-51ce-48f5-bb90-5df6260018c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4574b2bedd2d4882beb2232e281c9562)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:45.512420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427abcb-51ce-48f5-bb90-5df6260018c6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:45.714614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4427abcb-51ce-48f5-bb90-5df6260018c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4574b2bedd2d4882beb2232e281c9562', 'request_id': 'req-4427abcb-51ce-48f5-bb90-5df6260018c6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:45.732348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4427abcb-51ce-48f5-bb90-5df6260018c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4574b2bedd2d4882beb2232e281c9562', 'request_id': 'req-4427abcb-51ce-48f5-bb90-5df6260018c6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:45.750458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4427abcb-51ce-48f5-bb90-5df6260018c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4574b2bedd2d4882beb2232e281c9562', 'request_id': 'req-4427abcb-51ce-48f5-bb90-5df6260018c6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:45.787466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4427abcb-51ce-48f5-bb90-5df6260018c6 admin admin] The token cache is being invalidate because project 4574b2bedd2d4882beb2232e281c9562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:02:45.787824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4427abcb-51ce-48f5-bb90-5df6260018c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:45.793435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4427abcb-51ce-48f5-bb90-5df6260018c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:02:45.797529 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1759/3552] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:02:45 2022] DELETE /identity/v3/projects/4574b2bedd2d4882beb2232e281c9562 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:45.802368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e8d13-fb40-4e09-b52a-713c5340803b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:45.802885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e8d13-fb40-4e09-b52a-713c5340803b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:45.802885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e8d13-fb40-4e09-b52a-713c5340803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:45.842493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c09e8d13-fb40-4e09-b52a-713c5340803b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:45.843849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c09e8d13-fb40-4e09-b52a-713c5340803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:45.865372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:46.057927 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1794/3553] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:46.058146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df261aba-62de-4913-a662-3a9fe191574b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:46.058146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df261aba-62de-4913-a662-3a9fe191574b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:46.058146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df261aba-62de-4913-a662-3a9fe191574b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:46.174674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-df261aba-62de-4913-a662-3a9fe191574b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:46.191590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-df261aba-62de-4913-a662-3a9fe191574b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:46.215284 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1760/3554] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:46.219469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e8d13-fb40-4e09-b52a-713c5340803b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:46.243700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e8d13-fb40-4e09-b52a-713c5340803b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:46.256840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd3c85-c183-488f-9ea2-91a6c5705a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:46.258015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd3c85-c183-488f-9ea2-91a6c5705a7c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:46.258527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd3c85-c183-488f-9ea2-91a6c5705a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:46.259067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd3c85-c183-488f-9ea2-91a6c5705a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:46.259962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd3c85-c183-488f-9ea2-91a6c5705a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:02:46.260504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd3c85-c183-488f-9ea2-91a6c5705a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:46.262466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd3c85-c183-488f-9ea2-91a6c5705a7c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:46.306183 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1795/3555] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:02:46.310524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df261aba-62de-4913-a662-3a9fe191574b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:46.324857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df261aba-62de-4913-a662-3a9fe191574b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:46.339677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa8a15-7e8f-42fc-a43d-67120537289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:46.342966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa8a15-7e8f-42fc-a43d-67120537289f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:46.344591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa8a15-7e8f-42fc-a43d-67120537289f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:46.344824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa8a15-7e8f-42fc-a43d-67120537289f admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:46.346784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa8a15-7e8f-42fc-a43d-67120537289f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:46.359555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa8a15-7e8f-42fc-a43d-67120537289f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:46.403170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:46.426828 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1761/3556] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:02:46 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:02:46.431099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd3c85-c183-488f-9ea2-91a6c5705a7c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:46.459898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd3c85-c183-488f-9ea2-91a6c5705a7c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:46.620714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242ec4d-c197-4463-ba7a-5ca9d871b625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:46.621367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ec4d-c197-4463-ba7a-5ca9d871b625 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:46.621644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ec4d-c197-4463-ba7a-5ca9d871b625 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:46.621949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ec4d-c197-4463-ba7a-5ca9d871b625 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:46.623501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242ec4d-c197-4463-ba7a-5ca9d871b625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:46.627816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242ec4d-c197-4463-ba7a-5ca9d871b625 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:46.679119 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1796/3557] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:02:46 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:02:46.683076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa8a15-7e8f-42fc-a43d-67120537289f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:46.697153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa8a15-7e8f-42fc-a43d-67120537289f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:46.716997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102f12-bd20-4cb2-a6c5-acb8ba425e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:46.717996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102f12-bd20-4cb2-a6c5-acb8ba425e32 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:46.719443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102f12-bd20-4cb2-a6c5-acb8ba425e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:46.720092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102f12-bd20-4cb2-a6c5-acb8ba425e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:46.721351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb102f12-bd20-4cb2-a6c5-acb8ba425e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:46.723175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb102f12-bd20-4cb2-a6c5-acb8ba425e32 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:46.779846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242ec4d-c197-4463-ba7a-5ca9d871b625 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:46.780798 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1762/3558] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:02:46.784119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c242ec4d-c197-4463-ba7a-5ca9d871b625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:46.794797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102f12-bd20-4cb2-a6c5-acb8ba425e32 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:46.813998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102f12-bd20-4cb2-a6c5-acb8ba425e32 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:46.819318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4d4f8-906f-4672-8982-6521be8ec907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:46.819937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4d4f8-906f-4672-8982-6521be8ec907 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:46.820286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4d4f8-906f-4672-8982-6521be8ec907 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:46.820565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4d4f8-906f-4672-8982-6521be8ec907 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:46.821255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4d4f8-906f-4672-8982-6521be8ec907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:46.822865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4d4f8-906f-4672-8982-6521be8ec907 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:46.838143 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1763/3559] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:02:46.839270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4d4f8-906f-4672-8982-6521be8ec907 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:46.887441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4d4f8-906f-4672-8982-6521be8ec907 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:46.938742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1eb72e-1610-4230-868d-28df2a4075ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:46.939487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eb72e-1610-4230-868d-28df2a4075ee admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:46.939990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eb72e-1610-4230-868d-28df2a4075ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:46.940116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eb72e-1610-4230-868d-28df2a4075ee admin admin] PATH_INFO: `/v3/projects/bc9bed6d76834f6fa66d681ecd9f4e90/users/095debf3968c448fb3c3add0322d8d1b/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:46.955936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242ec4d-c197-4463-ba7a-5ca9d871b625 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:46.981889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f028a3-5e29-41e8-a55c-790d21963520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:46.982528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f028a3-5e29-41e8-a55c-790d21963520 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:46.988010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f028a3-5e29-41e8-a55c-790d21963520 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:46.988352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f028a3-5e29-41e8-a55c-790d21963520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:46.999324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-07f028a3-5e29-41e8-a55c-790d21963520 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:47.001333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1eb72e-1610-4230-868d-28df2a4075ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9bed6d76834f6fa66d681ecd9f4e90, user_id=095debf3968c448fb3c3add0322d8d1b, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:47.004989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1eb72e-1610-4230-868d-28df2a4075ee admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:47.045511 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1764/3560] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:02:46 2022] PUT /identity/v3/projects/bc9bed6d76834f6fa66d681ecd9f4e90/users/095debf3968c448fb3c3add0322d8d1b/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:02:47.050570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72108f75-3881-4c2d-b172-7ea60dc55b0d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:47.051098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72108f75-3881-4c2d-b172-7ea60dc55b0d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:47.051581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72108f75-3881-4c2d-b172-7ea60dc55b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:47.087292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-72108f75-3881-4c2d-b172-7ea60dc55b0d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:47.088645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-72108f75-3881-4c2d-b172-7ea60dc55b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:47.139633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:47.228269 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1765/3561] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:47.270932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72108f75-3881-4c2d-b172-7ea60dc55b0d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:47.273142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-72108f75-3881-4c2d-b172-7ea60dc55b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:47.293844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f028a3-5e29-41e8-a55c-790d21963520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:47.296832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f028a3-5e29-41e8-a55c-790d21963520 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:47.357898 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1797/3562] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:47.424032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72108f75-3881-4c2d-b172-7ea60dc55b0d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:47.432408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff733496-48c3-4996-a173-dc99e2a954bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:47.433875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff733496-48c3-4996-a173-dc99e2a954bd service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:47.434359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff733496-48c3-4996-a173-dc99e2a954bd service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:47.434643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff733496-48c3-4996-a173-dc99e2a954bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:47.449268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff733496-48c3-4996-a173-dc99e2a954bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:47.450918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff733496-48c3-4996-a173-dc99e2a954bd service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:47.465448 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1766/3563] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:50.485552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc6a9d-95b8-4b29-a017-295be3687389 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:50.486139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc6a9d-95b8-4b29-a017-295be3687389 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:50.486139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc6a9d-95b8-4b29-a017-295be3687389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:50.598155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e2cc6a9d-95b8-4b29-a017-295be3687389 None None] MFA Rules not processed for user `095debf3968c448fb3c3add0322d8d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:50.599692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e2cc6a9d-95b8-4b29-a017-295be3687389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:50.813879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60b6de-a40d-4c9b-a293-09cb4cbc947d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:50.814441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60b6de-a40d-4c9b-a293-09cb4cbc947d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:50.814441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60b6de-a40d-4c9b-a293-09cb4cbc947d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:50.840448 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1798/3564] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:50.842365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca6ac6-dd09-4d2e-aaf1-c5a0f5785602 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:50.842662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca6ac6-dd09-4d2e-aaf1-c5a0f5785602 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:50.842939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca6ac6-dd09-4d2e-aaf1-c5a0f5785602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:50.843651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9c60b6de-a40d-4c9b-a293-09cb4cbc947d None None] MFA Rules not processed for user `1698dee4a2bf4ea19a6ee0c3d5cb5c09`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:50.847725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9c60b6de-a40d-4c9b-a293-09cb4cbc947d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:50.884662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-08ca6ac6-dd09-4d2e-aaf1-c5a0f5785602 None None] MFA Rules not processed for user `095debf3968c448fb3c3add0322d8d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:50.885938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-08ca6ac6-dd09-4d2e-aaf1-c5a0f5785602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:50.909213 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1799/3565] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:02:50.918775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1e84a-04f3-4632-8725-dba19a9f05bc None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:50.918980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1e84a-04f3-4632-8725-dba19a9f05bc None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:50.919170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1e84a-04f3-4632-8725-dba19a9f05bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:50.971540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f9c1e84a-04f3-4632-8725-dba19a9f05bc None None] MFA Rules not processed for user `095debf3968c448fb3c3add0322d8d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:50.986851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f9c1e84a-04f3-4632-8725-dba19a9f05bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:50.990545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:51.016581 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1800/3566] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:51.025238 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1767/3567] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:02:51.500657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1e84a-04f3-4632-8725-dba19a9f05bc None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:02:51.503028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f9c1e84a-04f3-4632-8725-dba19a9f05bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:51.613556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1e84a-04f3-4632-8725-dba19a9f05bc None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:02:51.620881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42db34-844d-4e22-8919-9f80d636b7af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:02:51.621561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42db34-844d-4e22-8919-9f80d636b7af service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:51.622015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42db34-844d-4e22-8919-9f80d636b7af service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:51.622894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42db34-844d-4e22-8919-9f80d636b7af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:51.636153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42db34-844d-4e22-8919-9f80d636b7af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:02:51.638597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42db34-844d-4e22-8919-9f80d636b7af service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:02:51.650574 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1801/3568] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:02:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:02:53.415846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b75d5-ae71-47ee-be46-7ea6d693afd7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:53.416350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b75d5-ae71-47ee-be46-7ea6d693afd7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:53.416638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b75d5-ae71-47ee-be46-7ea6d693afd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:53.456600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cf2b75d5-ae71-47ee-be46-7ea6d693afd7 None None] MFA Rules not processed for user `095debf3968c448fb3c3add0322d8d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:53.458410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cf2b75d5-ae71-47ee-be46-7ea6d693afd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:53.481355 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1768/3569] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:02:56.150448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fb9f9-7da1-47a6-88d3-788480cb2486 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:02:56.151443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fb9f9-7da1-47a6-88d3-788480cb2486 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:02:56.151945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fb9f9-7da1-47a6-88d3-788480cb2486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:02:56.204523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-792fb9f9-7da1-47a6-88d3-788480cb2486 None None] MFA Rules not processed for user `095debf3968c448fb3c3add0322d8d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:02:56.206490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-792fb9f9-7da1-47a6-88d3-788480cb2486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:02:56.235112 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1802/3570] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:02:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:03.437393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:06.175126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:20.728266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb135577-ca13-450c-82de-ccedd53d3c36 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:20.728860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb135577-ca13-450c-82de-ccedd53d3c36 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:20.729042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb135577-ca13-450c-82de-ccedd53d3c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:20.756639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cb135577-ca13-450c-82de-ccedd53d3c36 None None] MFA Rules not processed for user `5266cd6be4514b3eac30a195f6b25772`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:20.774895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cb135577-ca13-450c-82de-ccedd53d3c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:20.978445 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1769/3571] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:29.359821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fb9f9-7da1-47a6-88d3-788480cb2486 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:29.361317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-792fb9f9-7da1-47a6-88d3-788480cb2486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:29.386560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fb9f9-7da1-47a6-88d3-788480cb2486 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:29.400131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:29.400818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:29.401170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:29.401550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] PATH_INFO: `/v3/users/0f6088285b46499a98162b6237517174` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:29.402795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6088285b46499a98162b6237517174)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:29.404845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:29.497283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6088285b46499a98162b6237517174'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:29.506824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6088285b46499a98162b6237517174'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:29.507805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6088285b46499a98162b6237517174'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:29.508743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6088285b46499a98162b6237517174'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:29.528346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6088285b46499a98162b6237517174'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:29.546264 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1803/3572] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:03:29 2022] DELETE /identity/v3/users/0f6088285b46499a98162b6237517174 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:03:29.905729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ced169-f350-4304-8325-f72a19133e94 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:29.906543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ced169-f350-4304-8325-f72a19133e94 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:29.906985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ced169-f350-4304-8325-f72a19133e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:29.940421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c3ced169-f350-4304-8325-f72a19133e94 None None] MFA Rules not processed for user `40f60e33f334465fac1148669de3f00c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:29.941637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c3ced169-f350-4304-8325-f72a19133e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:29.985315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:29.986959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:30.067512 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1770/3573] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:30.136128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3d303-ec5a-40bb-adb1-129a80d6a318 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:30.152697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06820db6-10f8-4325-b8b3-46ffb565d074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:30.154149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820db6-10f8-4325-b8b3-46ffb565d074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:30.155473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820db6-10f8-4325-b8b3-46ffb565d074 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:30.158816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820db6-10f8-4325-b8b3-46ffb565d074 admin admin] PATH_INFO: `/v3/projects/0b70cb43c39e4e0ba89680d7b8459c01` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:30.162006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06820db6-10f8-4325-b8b3-46ffb565d074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b70cb43c39e4e0ba89680d7b8459c01)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:30.164044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06820db6-10f8-4325-b8b3-46ffb565d074 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:30.285376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06820db6-10f8-4325-b8b3-46ffb565d074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b70cb43c39e4e0ba89680d7b8459c01', 'request_id': 'req-06820db6-10f8-4325-b8b3-46ffb565d074'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:30.298962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06820db6-10f8-4325-b8b3-46ffb565d074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b70cb43c39e4e0ba89680d7b8459c01', 'request_id': 'req-06820db6-10f8-4325-b8b3-46ffb565d074'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:30.307599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06820db6-10f8-4325-b8b3-46ffb565d074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b70cb43c39e4e0ba89680d7b8459c01', 'request_id': 'req-06820db6-10f8-4325-b8b3-46ffb565d074'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:30.325220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06820db6-10f8-4325-b8b3-46ffb565d074 admin admin] The token cache is being invalidate because project 0b70cb43c39e4e0ba89680d7b8459c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:03:30.325574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06820db6-10f8-4325-b8b3-46ffb565d074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:30.326308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06820db6-10f8-4325-b8b3-46ffb565d074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:30.334442 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1804/3574] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:03:29 2022] DELETE /identity/v3/projects/0b70cb43c39e4e0ba89680d7b8459c01 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:03:30.334714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddc385-635a-406e-ae94-9ca4d2402dce None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:30.335004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddc385-635a-406e-ae94-9ca4d2402dce None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:30.335279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddc385-635a-406e-ae94-9ca4d2402dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:30.358676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-baddc385-635a-406e-ae94-9ca4d2402dce None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:30.360181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-baddc385-635a-406e-ae94-9ca4d2402dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:30.444584 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1771/3575] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:03:30.453911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3add7-e55c-4125-9e6d-63643c770e18 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:30.455837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3add7-e55c-4125-9e6d-63643c770e18 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:30.456444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3add7-e55c-4125-9e6d-63643c770e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:30.468158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:30.490703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e0a3add7-e55c-4125-9e6d-63643c770e18 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:30.492651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e0a3add7-e55c-4125-9e6d-63643c770e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:30.504952 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1805/3576] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:03:30.508823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddc385-635a-406e-ae94-9ca4d2402dce None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:30.522406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddc385-635a-406e-ae94-9ca4d2402dce None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:30.529863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e548205-8f54-4476-b28a-5af3bf0c0f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:30.530863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e548205-8f54-4476-b28a-5af3bf0c0f16 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:30.531532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e548205-8f54-4476-b28a-5af3bf0c0f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:30.532065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e548205-8f54-4476-b28a-5af3bf0c0f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:30.532941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e548205-8f54-4476-b28a-5af3bf0c0f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:03:30.533505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e548205-8f54-4476-b28a-5af3bf0c0f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:30.536737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e548205-8f54-4476-b28a-5af3bf0c0f16 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:30.553646 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1772/3577] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:03:30.564324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3add7-e55c-4125-9e6d-63643c770e18 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:30.591194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3add7-e55c-4125-9e6d-63643c770e18 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:30.600232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754871e8-808e-4aca-8396-e7edfe245ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:30.601320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754871e8-808e-4aca-8396-e7edfe245ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:30.602687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754871e8-808e-4aca-8396-e7edfe245ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:30.627178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754871e8-808e-4aca-8396-e7edfe245ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:30.628684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754871e8-808e-4aca-8396-e7edfe245ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:30.632182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754871e8-808e-4aca-8396-e7edfe245ef2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:30.741508 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1806/3578] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:03:30 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:03:30.746058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e548205-8f54-4476-b28a-5af3bf0c0f16 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:30.771604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e548205-8f54-4476-b28a-5af3bf0c0f16 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:30.843833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:30.903020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb7482-9a75-4d60-91f9-b847cbddedd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:30.904561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb7482-9a75-4d60-91f9-b847cbddedd8 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:30.905040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb7482-9a75-4d60-91f9-b847cbddedd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:30.905503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb7482-9a75-4d60-91f9-b847cbddedd8 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:30.906639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb7482-9a75-4d60-91f9-b847cbddedd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:30.911056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb7482-9a75-4d60-91f9-b847cbddedd8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:30.945907 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1773/3579] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:03:30 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:03:30.949619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754871e8-808e-4aca-8396-e7edfe245ef2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:30.969840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754871e8-808e-4aca-8396-e7edfe245ef2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:30.977085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078546d-d10c-4b6b-b3f2-514d445b62ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:30.977970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078546d-d10c-4b6b-b3f2-514d445b62ae admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:30.978424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078546d-d10c-4b6b-b3f2-514d445b62ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:30.978698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078546d-d10c-4b6b-b3f2-514d445b62ae admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:30.979513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078546d-d10c-4b6b-b3f2-514d445b62ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:30.982845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078546d-d10c-4b6b-b3f2-514d445b62ae admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:31.010201 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1807/3580] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:03:31.014762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb7482-9a75-4d60-91f9-b847cbddedd8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:31.030075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb7482-9a75-4d60-91f9-b847cbddedd8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:31.041673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700596e3-bb24-4663-b178-3561c6920b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:31.042768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700596e3-bb24-4663-b178-3561c6920b48 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:31.043306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700596e3-bb24-4663-b178-3561c6920b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:31.044631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700596e3-bb24-4663-b178-3561c6920b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:31.046302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700596e3-bb24-4663-b178-3561c6920b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:31.048170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700596e3-bb24-4663-b178-3561c6920b48 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:31.066650 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1774/3581] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:03:31.067862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078546d-d10c-4b6b-b3f2-514d445b62ae admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:31.079645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078546d-d10c-4b6b-b3f2-514d445b62ae admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:31.095077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b14d1c-ca99-4237-af11-1f476025a00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:31.096636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b14d1c-ca99-4237-af11-1f476025a00b admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:31.097077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b14d1c-ca99-4237-af11-1f476025a00b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:31.097530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b14d1c-ca99-4237-af11-1f476025a00b admin admin] PATH_INFO: `/v3/projects/8f455695c0214bfab0f412aa34417e34/users/9f2395fe934d458faa80e28587458bd2/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:31.168650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b14d1c-ca99-4237-af11-1f476025a00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f455695c0214bfab0f412aa34417e34, user_id=9f2395fe934d458faa80e28587458bd2, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:31.171274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b14d1c-ca99-4237-af11-1f476025a00b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:31.215202 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1808/3582] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:03:31 2022] PUT /identity/v3/projects/8f455695c0214bfab0f412aa34417e34/users/9f2395fe934d458faa80e28587458bd2/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:03:31.221736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2056c-301d-4074-a67d-bd9107f6e828 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:31.222362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2056c-301d-4074-a67d-bd9107f6e828 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:31.222878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2056c-301d-4074-a67d-bd9107f6e828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:31.251653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-93f2056c-301d-4074-a67d-bd9107f6e828 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:31.253200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-93f2056c-301d-4074-a67d-bd9107f6e828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:31.361136 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1775/3583] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:31.370878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b14d1c-ca99-4237-af11-1f476025a00b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:31.373583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-38b14d1c-ca99-4237-af11-1f476025a00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:31.457974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b14d1c-ca99-4237-af11-1f476025a00b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:31.463310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bef9e6-1490-4142-b5ba-f016b65ee56b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:31.463959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bef9e6-1490-4142-b5ba-f016b65ee56b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:31.464872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bef9e6-1490-4142-b5ba-f016b65ee56b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:31.465164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bef9e6-1490-4142-b5ba-f016b65ee56b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:31.488396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bef9e6-1490-4142-b5ba-f016b65ee56b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:31.506423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bef9e6-1490-4142-b5ba-f016b65ee56b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:31.561604 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1809/3584] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:03:32.468178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2056c-301d-4074-a67d-bd9107f6e828 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:32.469893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-93f2056c-301d-4074-a67d-bd9107f6e828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:32.513091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2056c-301d-4074-a67d-bd9107f6e828 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:32.530339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d2994-c358-41b8-8917-881851da64c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:32.531238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d2994-c358-41b8-8917-881851da64c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:32.531863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d2994-c358-41b8-8917-881851da64c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:32.532724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d2994-c358-41b8-8917-881851da64c5 admin admin] PATH_INFO: `/v3/users/95cfeacf062f486c985ca772f2f36faf` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:32.534500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d2994-c358-41b8-8917-881851da64c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95cfeacf062f486c985ca772f2f36faf)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:32.538537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d2994-c358-41b8-8917-881851da64c5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:32.643581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d1d2994-c358-41b8-8917-881851da64c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95cfeacf062f486c985ca772f2f36faf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:32.685416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d1d2994-c358-41b8-8917-881851da64c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95cfeacf062f486c985ca772f2f36faf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:32.687519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d1d2994-c358-41b8-8917-881851da64c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95cfeacf062f486c985ca772f2f36faf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:32.690349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d1d2994-c358-41b8-8917-881851da64c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95cfeacf062f486c985ca772f2f36faf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:32.737598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d1d2994-c358-41b8-8917-881851da64c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95cfeacf062f486c985ca772f2f36faf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:32.781501 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1776/3585] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:03:32 2022] DELETE /identity/v3/users/95cfeacf062f486c985ca772f2f36faf => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:03:33.313727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bef9e6-1490-4142-b5ba-f016b65ee56b service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:33.327262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bef9e6-1490-4142-b5ba-f016b65ee56b service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:33.509969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb24f1-173e-44d5-9d20-9019d563a865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:33.510993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb24f1-173e-44d5-9d20-9019d563a865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:33.511465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb24f1-173e-44d5-9d20-9019d563a865 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:33.512506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb24f1-173e-44d5-9d20-9019d563a865 admin admin] PATH_INFO: `/v3/projects/2f51fe43d7c143ebb6d53f5942941c9d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:33.515388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb24f1-173e-44d5-9d20-9019d563a865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f51fe43d7c143ebb6d53f5942941c9d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:33.522127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb24f1-173e-44d5-9d20-9019d563a865 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:33.613141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:33.619812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7dcb24f1-173e-44d5-9d20-9019d563a865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f51fe43d7c143ebb6d53f5942941c9d', 'request_id': 'req-7dcb24f1-173e-44d5-9d20-9019d563a865'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:33.639601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7dcb24f1-173e-44d5-9d20-9019d563a865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f51fe43d7c143ebb6d53f5942941c9d', 'request_id': 'req-7dcb24f1-173e-44d5-9d20-9019d563a865'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:33.650327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7dcb24f1-173e-44d5-9d20-9019d563a865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f51fe43d7c143ebb6d53f5942941c9d', 'request_id': 'req-7dcb24f1-173e-44d5-9d20-9019d563a865'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:33.677618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7dcb24f1-173e-44d5-9d20-9019d563a865 admin admin] The token cache is being invalidate because project 2f51fe43d7c143ebb6d53f5942941c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:03:33.678357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7dcb24f1-173e-44d5-9d20-9019d563a865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:33.679336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7dcb24f1-173e-44d5-9d20-9019d563a865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:33.684441 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1810/3586] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:03:33 2022] DELETE /identity/v3/projects/2f51fe43d7c143ebb6d53f5942941c9d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:03:33.689120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510a3e1-4660-4aff-a911-a10a9610b578 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:33.689633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510a3e1-4660-4aff-a911-a10a9610b578 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:33.689718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510a3e1-4660-4aff-a911-a10a9610b578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:33.754128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7510a3e1-4660-4aff-a911-a10a9610b578 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:33.756191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7510a3e1-4660-4aff-a911-a10a9610b578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:33.799921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:33.900462 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1777/3587] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:03:33.908245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a888-1fd1-44f4-b241-ca01b834e51d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:33.908535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a888-1fd1-44f4-b241-ca01b834e51d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:33.908920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a888-1fd1-44f4-b241-ca01b834e51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:33.952666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8ae8a888-1fd1-44f4-b241-ca01b834e51d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:33.953970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8ae8a888-1fd1-44f4-b241-ca01b834e51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:33.973722 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1811/3588] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:33.978393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510a3e1-4660-4aff-a911-a10a9610b578 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:33.993708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510a3e1-4660-4aff-a911-a10a9610b578 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:34.002080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d060d2e-8e9b-4463-8cf5-bfeef1c67b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:34.003043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d060d2e-8e9b-4463-8cf5-bfeef1c67b92 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:34.003531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d060d2e-8e9b-4463-8cf5-bfeef1c67b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:34.003992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d060d2e-8e9b-4463-8cf5-bfeef1c67b92 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:34.005640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d060d2e-8e9b-4463-8cf5-bfeef1c67b92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:03:34.006197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d060d2e-8e9b-4463-8cf5-bfeef1c67b92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:34.008635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d060d2e-8e9b-4463-8cf5-bfeef1c67b92 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:34.040700 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1778/3589] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:03:34.045904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8a888-1fd1-44f4-b241-ca01b834e51d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:34.061154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8a888-1fd1-44f4-b241-ca01b834e51d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:34.066645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26128bb-f3e8-4edc-92fa-125fdcae89a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:34.069173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26128bb-f3e8-4edc-92fa-125fdcae89a0 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:34.069984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26128bb-f3e8-4edc-92fa-125fdcae89a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:34.071031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26128bb-f3e8-4edc-92fa-125fdcae89a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:34.074889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26128bb-f3e8-4edc-92fa-125fdcae89a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:34.078051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26128bb-f3e8-4edc-92fa-125fdcae89a0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:34.136436 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1812/3590] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:03:34 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:03:34.138857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d060d2e-8e9b-4463-8cf5-bfeef1c67b92 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:34.155601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d060d2e-8e9b-4463-8cf5-bfeef1c67b92 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:34.375885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2f7b5-4d9e-480b-abb1-f5878028d955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:34.380180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2f7b5-4d9e-480b-abb1-f5878028d955 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:34.380716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2f7b5-4d9e-480b-abb1-f5878028d955 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:34.381529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2f7b5-4d9e-480b-abb1-f5878028d955 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:34.382794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2f7b5-4d9e-480b-abb1-f5878028d955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:34.391019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2f7b5-4d9e-480b-abb1-f5878028d955 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:34.470885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26128bb-f3e8-4edc-92fa-125fdcae89a0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:34.472444 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1779/3591] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:03:34 2022] POST /identity/v3/users => generated 290 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:03:34.507958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26128bb-f3e8-4edc-92fa-125fdcae89a0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:34.528523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb8491-3b34-475b-8048-638463d12f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:34.529386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb8491-3b34-475b-8048-638463d12f98 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:34.529817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb8491-3b34-475b-8048-638463d12f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:34.530265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb8491-3b34-475b-8048-638463d12f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:34.531086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb8491-3b34-475b-8048-638463d12f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:34.536134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb8491-3b34-475b-8048-638463d12f98 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:34.570203 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1813/3592] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:03:34.571614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2f7b5-4d9e-480b-abb1-f5878028d955 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:34.588708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2f7b5-4d9e-480b-abb1-f5878028d955 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:34.599640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb63bfc-9c7e-43f2-9e3b-e3601e9f540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:34.600507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb63bfc-9c7e-43f2-9e3b-e3601e9f540f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:34.602390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb63bfc-9c7e-43f2-9e3b-e3601e9f540f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:34.602880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb63bfc-9c7e-43f2-9e3b-e3601e9f540f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:34.603778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb63bfc-9c7e-43f2-9e3b-e3601e9f540f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:34.610336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb63bfc-9c7e-43f2-9e3b-e3601e9f540f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:34.637982 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1780/3593] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:03:34.639094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb8491-3b34-475b-8048-638463d12f98 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:34.662850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb8491-3b34-475b-8048-638463d12f98 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:34.671005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c96d8-0afc-49dc-88c7-dfdd232afe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:34.672030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c96d8-0afc-49dc-88c7-dfdd232afe46 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:34.675366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c96d8-0afc-49dc-88c7-dfdd232afe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:34.675924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c96d8-0afc-49dc-88c7-dfdd232afe46 admin admin] PATH_INFO: `/v3/projects/413b42a72c864890b9373a0ff695c225/users/09d0d3c3f74a428098162e4f8df65fa4/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:34.704607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c96d8-0afc-49dc-88c7-dfdd232afe46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=413b42a72c864890b9373a0ff695c225, user_id=09d0d3c3f74a428098162e4f8df65fa4, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:34.708410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c96d8-0afc-49dc-88c7-dfdd232afe46 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:34.748991 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1814/3594] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:03:34 2022] PUT /identity/v3/projects/413b42a72c864890b9373a0ff695c225/users/09d0d3c3f74a428098162e4f8df65fa4/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:03:34.751673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2a9d7-a6df-4f1a-80fb-2e7840a7b6d9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:34.752563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2a9d7-a6df-4f1a-80fb-2e7840a7b6d9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:34.753057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2a9d7-a6df-4f1a-80fb-2e7840a7b6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:34.798821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-afc2a9d7-a6df-4f1a-80fb-2e7840a7b6d9 None None] MFA Rules not processed for user `09d0d3c3f74a428098162e4f8df65fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:34.800496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-afc2a9d7-a6df-4f1a-80fb-2e7840a7b6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:34.905532 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1781/3595] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:34.919803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c96d8-0afc-49dc-88c7-dfdd232afe46 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:34.922506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b27c96d8-0afc-49dc-88c7-dfdd232afe46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:35.072514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c96d8-0afc-49dc-88c7-dfdd232afe46 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:35.077784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19e80e-e537-4713-ab76-8b2c9d5c6098 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:35.078539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19e80e-e537-4713-ab76-8b2c9d5c6098 service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:35.078882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19e80e-e537-4713-ab76-8b2c9d5c6098 service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:35.079215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19e80e-e537-4713-ab76-8b2c9d5c6098 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:35.093329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19e80e-e537-4713-ab76-8b2c9d5c6098 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:35.094912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19e80e-e537-4713-ab76-8b2c9d5c6098 service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:35.109239 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1815/3596] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:03:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:03:35.362247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cae6f-8d45-4324-a460-4efdbcae744c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:35.362818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cae6f-8d45-4324-a460-4efdbcae744c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:35.363356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cae6f-8d45-4324-a460-4efdbcae744c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:35.401403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-565cae6f-8d45-4324-a460-4efdbcae744c None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:35.403329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-565cae6f-8d45-4324-a460-4efdbcae744c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:35.431988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:35.491525 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1782/3597] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:03:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:35.508245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19e80e-e537-4713-ab76-8b2c9d5c6098 service glance] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:35.509876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1c19e80e-e537-4713-ab76-8b2c9d5c6098 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:35.605053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:35.645987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19e80e-e537-4713-ab76-8b2c9d5c6098 service glance] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:35.659037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19269dc5-be39-4e1a-bcf7-d20444930a5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:35.660089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19269dc5-be39-4e1a-bcf7-d20444930a5c service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:35.660414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19269dc5-be39-4e1a-bcf7-d20444930a5c service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:35.661735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19269dc5-be39-4e1a-bcf7-d20444930a5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:35.672517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19269dc5-be39-4e1a-bcf7-d20444930a5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:35.674267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19269dc5-be39-4e1a-bcf7-d20444930a5c service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:35.684604 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1816/3598] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:03:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:03:40.466603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cae6f-8d45-4324-a460-4efdbcae744c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:40.468146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-565cae6f-8d45-4324-a460-4efdbcae744c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:40.596809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cae6f-8d45-4324-a460-4efdbcae744c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:40.603178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd0aea-46e8-4965-8d3f-d6399920fb7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:40.603945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd0aea-46e8-4965-8d3f-d6399920fb7e service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:40.604334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd0aea-46e8-4965-8d3f-d6399920fb7e service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:40.604714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd0aea-46e8-4965-8d3f-d6399920fb7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:40.613131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-50cd0aea-46e8-4965-8d3f-d6399920fb7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:40.641621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd0aea-46e8-4965-8d3f-d6399920fb7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:40.644690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd0aea-46e8-4965-8d3f-d6399920fb7e service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:40.658932 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1783/3599] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:03:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:03:41.848655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536296fd-7a0f-469b-8173-2b40f2f98187 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:41.849089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536296fd-7a0f-469b-8173-2b40f2f98187 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:41.849232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536296fd-7a0f-469b-8173-2b40f2f98187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:41.904310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-536296fd-7a0f-469b-8173-2b40f2f98187 None None] MFA Rules not processed for user `9f2395fe934d458faa80e28587458bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:41.905597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-536296fd-7a0f-469b-8173-2b40f2f98187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:42.074802 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1817/3600] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:42.088287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ee0ea-7b3b-494b-b1f3-f4e5c901f98b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:42.089632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ee0ea-7b3b-494b-b1f3-f4e5c901f98b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:42.089918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ee0ea-7b3b-494b-b1f3-f4e5c901f98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:42.124520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ae1ee0ea-7b3b-494b-b1f3-f4e5c901f98b None None] MFA Rules not processed for user `9f2395fe934d458faa80e28587458bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:42.126694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ae1ee0ea-7b3b-494b-b1f3-f4e5c901f98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:42.138866 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1784/3601] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:42.885665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536296fd-7a0f-469b-8173-2b40f2f98187 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:42.887864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-536296fd-7a0f-469b-8173-2b40f2f98187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:43.164782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536296fd-7a0f-469b-8173-2b40f2f98187 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:43.193624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68236cb-cf37-48ff-ba7c-eb219bf1088e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:43.194255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68236cb-cf37-48ff-ba7c-eb219bf1088e service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:43.194657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68236cb-cf37-48ff-ba7c-eb219bf1088e service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:43.194988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68236cb-cf37-48ff-ba7c-eb219bf1088e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:43.244818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68236cb-cf37-48ff-ba7c-eb219bf1088e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:43.248399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68236cb-cf37-48ff-ba7c-eb219bf1088e service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:43.302929 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1818/3602] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:03:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:03:44.618680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6e55b-b8d5-4d6e-80f9-3d7496f6ea9f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:44.619197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6e55b-b8d5-4d6e-80f9-3d7496f6ea9f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:44.619282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6e55b-b8d5-4d6e-80f9-3d7496f6ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:44.686959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-29b6e55b-b8d5-4d6e-80f9-3d7496f6ea9f None None] MFA Rules not processed for user `bf2e13f1952a4e5bb23d57dd7fa31875`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:44.690323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-29b6e55b-b8d5-4d6e-80f9-3d7496f6ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:44.858167 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1785/3603] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:45.756121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68236cb-cf37-48ff-ba7c-eb219bf1088e service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:45.760287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c68236cb-cf37-48ff-ba7c-eb219bf1088e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:45.775478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68236cb-cf37-48ff-ba7c-eb219bf1088e service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:45.779937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72326e-52f3-4763-b149-cd868918439f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:45.780873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72326e-52f3-4763-b149-cd868918439f service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:45.781405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72326e-52f3-4763-b149-cd868918439f service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:45.781886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72326e-52f3-4763-b149-cd868918439f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:45.784261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5f72326e-52f3-4763-b149-cd868918439f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:45.798397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72326e-52f3-4763-b149-cd868918439f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:45.802135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72326e-52f3-4763-b149-cd868918439f service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:45.816207 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1819/3604] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:03:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:03:47.623109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b912e81-dc7a-441d-aaa0-c09010744a24 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:47.625368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b912e81-dc7a-441d-aaa0-c09010744a24 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:47.625925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b912e81-dc7a-441d-aaa0-c09010744a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:47.688313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4b912e81-dc7a-441d-aaa0-c09010744a24 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:47.691091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4b912e81-dc7a-441d-aaa0-c09010744a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:47.708397 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1786/3605] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:03:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:47.723217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72326e-52f3-4763-b149-cd868918439f service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:47.739288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72326e-52f3-4763-b149-cd868918439f service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:47.748375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06273257-ff97-45d9-9dc2-cd2721d59c4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:47.749522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06273257-ff97-45d9-9dc2-cd2721d59c4f service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:47.750243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06273257-ff97-45d9-9dc2-cd2721d59c4f service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:47.750813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06273257-ff97-45d9-9dc2-cd2721d59c4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:47.780317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06273257-ff97-45d9-9dc2-cd2721d59c4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:47.782063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06273257-ff97-45d9-9dc2-cd2721d59c4f service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:47.794062 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1820/3606] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:03:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:03:48.031088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b912e81-dc7a-441d-aaa0-c09010744a24 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:48.301308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b912e81-dc7a-441d-aaa0-c09010744a24 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:48.310896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:48.311926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:48.312611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:48.313304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] PATH_INFO: `/v3/users/09d0d3c3f74a428098162e4f8df65fa4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:48.317469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d0d3c3f74a428098162e4f8df65fa4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:48.320360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:48.327057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:48.450006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d0d3c3f74a428098162e4f8df65fa4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:48.460278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d0d3c3f74a428098162e4f8df65fa4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:48.461097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d0d3c3f74a428098162e4f8df65fa4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:48.461923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d0d3c3f74a428098162e4f8df65fa4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:48.480271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d0d3c3f74a428098162e4f8df65fa4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:48.513521 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1787/3607] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:03:48 2022] DELETE /identity/v3/users/09d0d3c3f74a428098162e4f8df65fa4 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:03:48.517340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88aee3-9b71-48a5-b251-a7f261cea7dd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:48.517340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88aee3-9b71-48a5-b251-a7f261cea7dd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:48.517340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88aee3-9b71-48a5-b251-a7f261cea7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:48.570672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fd88aee3-9b71-48a5-b251-a7f261cea7dd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:48.576703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fd88aee3-9b71-48a5-b251-a7f261cea7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:48.643056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:48.759963 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1821/3608] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:03:48.800376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:48.800376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:48.912710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eae2e7-d8ec-4e5b-8a1e-06806b7464c3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:48.917499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee937fa-891b-4064-abf7-5accc8f8283c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:48.918518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee937fa-891b-4064-abf7-5accc8f8283c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:48.919044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee937fa-891b-4064-abf7-5accc8f8283c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:48.919560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee937fa-891b-4064-abf7-5accc8f8283c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:48.932168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee937fa-891b-4064-abf7-5accc8f8283c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:48.933664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee937fa-891b-4064-abf7-5accc8f8283c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:48.944913 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1788/3609] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:03:49.784136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88aee3-9b71-48a5-b251-a7f261cea7dd None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:49.786786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fd88aee3-9b71-48a5-b251-a7f261cea7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:49.814234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88aee3-9b71-48a5-b251-a7f261cea7dd None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:49.823474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:49.824536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:49.825232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:49.825672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a admin admin] PATH_INFO: `/v3/projects/413b42a72c864890b9373a0ff695c225` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:49.828178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a admin admin] RBAC: Authorizing `identity:delete_project(project_id=413b42a72c864890b9373a0ff695c225)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:49.831450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:49.946562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413b42a72c864890b9373a0ff695c225', 'request_id': 'req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:49.961064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413b42a72c864890b9373a0ff695c225', 'request_id': 'req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:49.970456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413b42a72c864890b9373a0ff695c225', 'request_id': 'req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:49.991056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a admin admin] The token cache is being invalidate because project 413b42a72c864890b9373a0ff695c225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:03:49.991665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:49.995209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f49f4184-3ebf-4bb7-a91f-9316dd37a57a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:03:49.997747 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1822/3610] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:03:49 2022] DELETE /identity/v3/projects/413b42a72c864890b9373a0ff695c225 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:03:50.004962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60138bcb-d009-4562-af19-ffaa848c9fae None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:50.005881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60138bcb-d009-4562-af19-ffaa848c9fae None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:50.006367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60138bcb-d009-4562-af19-ffaa848c9fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:50.040902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-60138bcb-d009-4562-af19-ffaa848c9fae None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:50.043453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-60138bcb-d009-4562-af19-ffaa848c9fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:50.217052 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1789/3611] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:50.226763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58001e47-12ed-40ea-ac80-4e1bc8fb98d1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:50.227208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58001e47-12ed-40ea-ac80-4e1bc8fb98d1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:50.227425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58001e47-12ed-40ea-ac80-4e1bc8fb98d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:50.263789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-58001e47-12ed-40ea-ac80-4e1bc8fb98d1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:50.268640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-58001e47-12ed-40ea-ac80-4e1bc8fb98d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:50.283537 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1823/3612] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:50.288284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60138bcb-d009-4562-af19-ffaa848c9fae None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:50.310583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60138bcb-d009-4562-af19-ffaa848c9fae None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:50.316970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5434f1d-d475-4edb-93b1-df8170232405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:50.317986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5434f1d-d475-4edb-93b1-df8170232405 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:50.318635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5434f1d-d475-4edb-93b1-df8170232405 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:50.319619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5434f1d-d475-4edb-93b1-df8170232405 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:50.320571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5434f1d-d475-4edb-93b1-df8170232405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:03:50.321178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5434f1d-d475-4edb-93b1-df8170232405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:50.323266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5434f1d-d475-4edb-93b1-df8170232405 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:50.341538 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1790/3613] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:03:50.346153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58001e47-12ed-40ea-ac80-4e1bc8fb98d1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:50.359927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58001e47-12ed-40ea-ac80-4e1bc8fb98d1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:50.377600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea15aed-c922-4a0d-913f-81e66e2a83d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:50.378487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea15aed-c922-4a0d-913f-81e66e2a83d9 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:50.380329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea15aed-c922-4a0d-913f-81e66e2a83d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:50.381077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea15aed-c922-4a0d-913f-81e66e2a83d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:50.382000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea15aed-c922-4a0d-913f-81e66e2a83d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:50.385659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea15aed-c922-4a0d-913f-81e66e2a83d9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:50.463367 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1824/3614] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:03:50 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:03:50.478730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5434f1d-d475-4edb-93b1-df8170232405 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:50.500329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5434f1d-d475-4edb-93b1-df8170232405 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:50.537815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:50.666674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccb3b8-c4e8-4472-8193-09b1aa9dfb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:50.668815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccb3b8-c4e8-4472-8193-09b1aa9dfb50 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:50.669323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccb3b8-c4e8-4472-8193-09b1aa9dfb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:50.669811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccb3b8-c4e8-4472-8193-09b1aa9dfb50 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:50.670828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccb3b8-c4e8-4472-8193-09b1aa9dfb50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:50.674911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccb3b8-c4e8-4472-8193-09b1aa9dfb50 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:50.707529 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1791/3615] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:03:50 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:03:50.711263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea15aed-c922-4a0d-913f-81e66e2a83d9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:50.730797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea15aed-c922-4a0d-913f-81e66e2a83d9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:50.736672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee97a41-543c-4261-a9d3-30c3e8d5701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:50.737347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee97a41-543c-4261-a9d3-30c3e8d5701a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:50.737631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee97a41-543c-4261-a9d3-30c3e8d5701a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:50.738578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee97a41-543c-4261-a9d3-30c3e8d5701a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:50.739240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee97a41-543c-4261-a9d3-30c3e8d5701a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:50.740848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee97a41-543c-4261-a9d3-30c3e8d5701a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:50.767578 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1825/3616] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:03:50.772770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccb3b8-c4e8-4472-8193-09b1aa9dfb50 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:50.787366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccb3b8-c4e8-4472-8193-09b1aa9dfb50 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:50.797953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d0730-4fb4-41cb-bb75-39b809769a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:50.798720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d0730-4fb4-41cb-bb75-39b809769a4e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:50.799013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d0730-4fb4-41cb-bb75-39b809769a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:50.799312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d0730-4fb4-41cb-bb75-39b809769a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:50.799947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d0730-4fb4-41cb-bb75-39b809769a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:50.802223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d0730-4fb4-41cb-bb75-39b809769a4e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:50.815853 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1792/3617] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:03:50.820342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee97a41-543c-4261-a9d3-30c3e8d5701a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:50.835378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee97a41-543c-4261-a9d3-30c3e8d5701a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:50.838132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8033426-b131-49c5-8e04-3f179da32534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:50.839212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8033426-b131-49c5-8e04-3f179da32534 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:50.839693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8033426-b131-49c5-8e04-3f179da32534 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:50.840162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8033426-b131-49c5-8e04-3f179da32534 admin admin] PATH_INFO: `/v3/projects/9a9dfe2733a844928b29194b54f4a0a4/users/fd917f61a1c043f599ef923f41c3a938/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:50.875680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8033426-b131-49c5-8e04-3f179da32534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9dfe2733a844928b29194b54f4a0a4, user_id=fd917f61a1c043f599ef923f41c3a938, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:50.879814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8033426-b131-49c5-8e04-3f179da32534 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:50.908954 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1826/3618] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:03:50 2022] PUT /identity/v3/projects/9a9dfe2733a844928b29194b54f4a0a4/users/fd917f61a1c043f599ef923f41c3a938/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:03:50.922177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818add2-b57b-4fd7-a8e7-aa6eb1636236 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:50.922515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818add2-b57b-4fd7-a8e7-aa6eb1636236 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:50.922748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818add2-b57b-4fd7-a8e7-aa6eb1636236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:50.994589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9818add2-b57b-4fd7-a8e7-aa6eb1636236 None None] MFA Rules not processed for user `fd917f61a1c043f599ef923f41c3a938`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:50.995856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9818add2-b57b-4fd7-a8e7-aa6eb1636236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:51.130941 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1793/3619] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:51.142989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155f6a-e9af-4200-bb39-4ce29483d6f8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:51.143866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155f6a-e9af-4200-bb39-4ce29483d6f8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:51.144505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155f6a-e9af-4200-bb39-4ce29483d6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:51.179312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-52155f6a-e9af-4200-bb39-4ce29483d6f8 None None] MFA Rules not processed for user `fd917f61a1c043f599ef923f41c3a938`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:51.184835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-52155f6a-e9af-4200-bb39-4ce29483d6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:51.202323 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1827/3620] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:03:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:51.514284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818add2-b57b-4fd7-a8e7-aa6eb1636236 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:51.519733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9818add2-b57b-4fd7-a8e7-aa6eb1636236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:51.646571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818add2-b57b-4fd7-a8e7-aa6eb1636236 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:51.653617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130a4cb-98b0-4850-b13a-e7a98ca29dad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:51.654432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130a4cb-98b0-4850-b13a-e7a98ca29dad service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:51.654787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130a4cb-98b0-4850-b13a-e7a98ca29dad service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:51.655121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130a4cb-98b0-4850-b13a-e7a98ca29dad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:51.666205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130a4cb-98b0-4850-b13a-e7a98ca29dad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:51.668026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130a4cb-98b0-4850-b13a-e7a98ca29dad service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:51.679760 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1794/3621] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:03:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:03:58.822717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9ab73-2097-424f-8937-4e5c1f5a1833 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:58.823208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9ab73-2097-424f-8937-4e5c1f5a1833 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:58.823293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9ab73-2097-424f-8937-4e5c1f5a1833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:58.848088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-38a9ab73-2097-424f-8937-4e5c1f5a1833 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:03:58.849491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-38a9ab73-2097-424f-8937-4e5c1f5a1833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:58.900222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:58.923459 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1828/3622] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:03:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:03:58.936246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130a4cb-98b0-4850-b13a-e7a98ca29dad service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:03:58.938618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5130a4cb-98b0-4850-b13a-e7a98ca29dad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:03:58.950312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:59.027208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130a4cb-98b0-4850-b13a-e7a98ca29dad service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:03:59.039472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72216e-5cab-4985-8510-f1052bae5435 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:03:59.040364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72216e-5cab-4985-8510-f1052bae5435 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:03:59.040877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72216e-5cab-4985-8510-f1052bae5435 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:03:59.041249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72216e-5cab-4985-8510-f1052bae5435 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:03:59.054045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72216e-5cab-4985-8510-f1052bae5435 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:03:59.056139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72216e-5cab-4985-8510-f1052bae5435 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:03:59.065269 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1795/3623] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:03:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:04:08.068626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9ab73-2097-424f-8937-4e5c1f5a1833 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:08.360011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9ab73-2097-424f-8937-4e5c1f5a1833 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:08.370515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:08.371428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:08.372048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:08.372482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] PATH_INFO: `/v3/users/fd917f61a1c043f599ef923f41c3a938` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:08.374545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd917f61a1c043f599ef923f41c3a938)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:08.381127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:08.483593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd917f61a1c043f599ef923f41c3a938'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:08.495599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd917f61a1c043f599ef923f41c3a938'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:08.497103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd917f61a1c043f599ef923f41c3a938'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:08.498365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd917f61a1c043f599ef923f41c3a938'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:08.527800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd917f61a1c043f599ef923f41c3a938'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:08.558544 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1829/3624] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:04:08 2022] DELETE /identity/v3/users/fd917f61a1c043f599ef923f41c3a938 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:08.563269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f91f-6e60-46bd-b5db-36bdb7cc0564 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:08.563879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f91f-6e60-46bd-b5db-36bdb7cc0564 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:08.563879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f91f-6e60-46bd-b5db-36bdb7cc0564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:08.594354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2741f91f-6e60-46bd-b5db-36bdb7cc0564 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:08.595699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2741f91f-6e60-46bd-b5db-36bdb7cc0564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:08.772113 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1796/3625] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:08.821834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:08.823523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:08.995555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ca308-7baa-4722-9a8f-cca7363bf354 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:09.000856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5e3f8-9140-4555-86ea-f1abe14936e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:09.001589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5e3f8-9140-4555-86ea-f1abe14936e8 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:09.001985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5e3f8-9140-4555-86ea-f1abe14936e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:09.002340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5e3f8-9140-4555-86ea-f1abe14936e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:09.019984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5e3f8-9140-4555-86ea-f1abe14936e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:09.021893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5e3f8-9140-4555-86ea-f1abe14936e8 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:09.032822 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1830/3626] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:10.630805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741f91f-6e60-46bd-b5db-36bdb7cc0564 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:10.632417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2741f91f-6e60-46bd-b5db-36bdb7cc0564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:10.648907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741f91f-6e60-46bd-b5db-36bdb7cc0564 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:10.658099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:10.658861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:10.659755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:10.660804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6 admin admin] PATH_INFO: `/v3/projects/9a9dfe2733a844928b29194b54f4a0a4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:10.662281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9dfe2733a844928b29194b54f4a0a4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:10.666801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:10.776518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9dfe2733a844928b29194b54f4a0a4', 'request_id': 'req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:10.799516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9dfe2733a844928b29194b54f4a0a4', 'request_id': 'req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:10.810137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9dfe2733a844928b29194b54f4a0a4', 'request_id': 'req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:10.836059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6 admin admin] The token cache is being invalidate because project 9a9dfe2733a844928b29194b54f4a0a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:04:10.836353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:10.837020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-36b5f210-6d2b-4fc5-9bff-5b7bf3d942c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:10.838828 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1797/3627] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:04:10 2022] DELETE /identity/v3/projects/9a9dfe2733a844928b29194b54f4a0a4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:10.843565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0d6cd-40bc-4137-b0db-25e7172f072f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:10.844055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0d6cd-40bc-4137-b0db-25e7172f072f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:10.844178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0d6cd-40bc-4137-b0db-25e7172f072f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:10.872050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-68f0d6cd-40bc-4137-b0db-25e7172f072f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:10.873410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-68f0d6cd-40bc-4137-b0db-25e7172f072f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:10.878378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:10.973922 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1831/3628] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:10.981586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a7f63-b8ca-448d-ad24-2762dca10f7c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:10.982292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a7f63-b8ca-448d-ad24-2762dca10f7c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:10.982778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a7f63-b8ca-448d-ad24-2762dca10f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:11.008365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fb7a7f63-b8ca-448d-ad24-2762dca10f7c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:11.010204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fb7a7f63-b8ca-448d-ad24-2762dca10f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:11.019330 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1798/3629] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:04:11.023752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0d6cd-40bc-4137-b0db-25e7172f072f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:11.036491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0d6cd-40bc-4137-b0db-25e7172f072f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:11.043340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53b4ff-7f80-4f19-912a-563c50236ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:11.044016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53b4ff-7f80-4f19-912a-563c50236ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:11.044346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53b4ff-7f80-4f19-912a-563c50236ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:11.044619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53b4ff-7f80-4f19-912a-563c50236ef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:11.045326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53b4ff-7f80-4f19-912a-563c50236ef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:04:11.046100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53b4ff-7f80-4f19-912a-563c50236ef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:11.047306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53b4ff-7f80-4f19-912a-563c50236ef5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:11.063512 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1832/3630] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:04:11.064668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a7f63-b8ca-448d-ad24-2762dca10f7c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:11.076161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a7f63-b8ca-448d-ad24-2762dca10f7c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:11.082159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320862e-6d74-43e1-9e58-257fb66bd3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:11.082854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320862e-6d74-43e1-9e58-257fb66bd3fe admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:11.083166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320862e-6d74-43e1-9e58-257fb66bd3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:11.084364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320862e-6d74-43e1-9e58-257fb66bd3fe admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:11.085315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320862e-6d74-43e1-9e58-257fb66bd3fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:11.087699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320862e-6d74-43e1-9e58-257fb66bd3fe admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:11.101570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:11.140130 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1799/3631] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:04:11 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:11.141460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53b4ff-7f80-4f19-912a-563c50236ef5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:11.154875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53b4ff-7f80-4f19-912a-563c50236ef5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:11.227951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b83922-7f96-4feb-bc13-86280527a32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:11.228577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b83922-7f96-4feb-bc13-86280527a32f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:11.228858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b83922-7f96-4feb-bc13-86280527a32f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:11.229129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b83922-7f96-4feb-bc13-86280527a32f admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:11.229800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b83922-7f96-4feb-bc13-86280527a32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:11.232251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b83922-7f96-4feb-bc13-86280527a32f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:11.266005 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1833/3632] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:04:11 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:11.269125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320862e-6d74-43e1-9e58-257fb66bd3fe admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:11.303983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320862e-6d74-43e1-9e58-257fb66bd3fe admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:11.330770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84062b5-e997-4122-93f8-79b1647d0c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:11.332309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84062b5-e997-4122-93f8-79b1647d0c3b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:11.332676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84062b5-e997-4122-93f8-79b1647d0c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:11.333018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84062b5-e997-4122-93f8-79b1647d0c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:11.333766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84062b5-e997-4122-93f8-79b1647d0c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:11.335487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84062b5-e997-4122-93f8-79b1647d0c3b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:11.349070 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1800/3633] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:11.352825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b83922-7f96-4feb-bc13-86280527a32f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:11.365641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b83922-7f96-4feb-bc13-86280527a32f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:11.371995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee77ffe-2c12-4c39-a7e4-627da566bf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:11.372626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee77ffe-2c12-4c39-a7e4-627da566bf53 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:11.373539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee77ffe-2c12-4c39-a7e4-627da566bf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:11.373832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee77ffe-2c12-4c39-a7e4-627da566bf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:11.374581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee77ffe-2c12-4c39-a7e4-627da566bf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:11.376689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee77ffe-2c12-4c39-a7e4-627da566bf53 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:11.398495 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1834/3634] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:11.400069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84062b5-e997-4122-93f8-79b1647d0c3b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:11.415070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84062b5-e997-4122-93f8-79b1647d0c3b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:11.420272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbbdda-2f38-4e5d-8764-47a12c0d18e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:11.421383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbbdda-2f38-4e5d-8764-47a12c0d18e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:11.421508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbbdda-2f38-4e5d-8764-47a12c0d18e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:11.421840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbbdda-2f38-4e5d-8764-47a12c0d18e6 admin admin] PATH_INFO: `/v3/projects/f92d768a1a654e199e14845aab7d565b/users/07280ef2c5da4903a62092a44499f455/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:11.444476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbbdda-2f38-4e5d-8764-47a12c0d18e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92d768a1a654e199e14845aab7d565b, user_id=07280ef2c5da4903a62092a44499f455, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:11.447273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbbdda-2f38-4e5d-8764-47a12c0d18e6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:11.466004 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1801/3635] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:04:11 2022] PUT /identity/v3/projects/f92d768a1a654e199e14845aab7d565b/users/07280ef2c5da4903a62092a44499f455/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:11.476582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91301821-ba53-49bb-bc7b-48dc28964695 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:11.476975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91301821-ba53-49bb-bc7b-48dc28964695 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:11.477386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91301821-ba53-49bb-bc7b-48dc28964695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:11.518134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-91301821-ba53-49bb-bc7b-48dc28964695 None None] MFA Rules not processed for user `07280ef2c5da4903a62092a44499f455`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:11.521257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-91301821-ba53-49bb-bc7b-48dc28964695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:11.618758 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1835/3636] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:04:11.630859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526918f4-6c8e-40bf-b628-e5d504c78396 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:11.631390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526918f4-6c8e-40bf-b628-e5d504c78396 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:11.631390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526918f4-6c8e-40bf-b628-e5d504c78396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:11.655087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-526918f4-6c8e-40bf-b628-e5d504c78396 None None] MFA Rules not processed for user `07280ef2c5da4903a62092a44499f455`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:11.657464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-526918f4-6c8e-40bf-b628-e5d504c78396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:11.665590 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1802/3637] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:11.680804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91301821-ba53-49bb-bc7b-48dc28964695 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:11.684835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-91301821-ba53-49bb-bc7b-48dc28964695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:11.692807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:11.796106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91301821-ba53-49bb-bc7b-48dc28964695 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:11.803868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf678766-0354-4bf5-9f1f-3aa23c81c271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:11.805164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf678766-0354-4bf5-9f1f-3aa23c81c271 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:11.805542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf678766-0354-4bf5-9f1f-3aa23c81c271 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:11.806047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf678766-0354-4bf5-9f1f-3aa23c81c271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:11.816379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf678766-0354-4bf5-9f1f-3aa23c81c271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:11.818490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf678766-0354-4bf5-9f1f-3aa23c81c271 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:11.845465 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1836/3638] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:12.396513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526918f4-6c8e-40bf-b628-e5d504c78396 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:12.398013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-526918f4-6c8e-40bf-b628-e5d504c78396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:12.625577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526918f4-6c8e-40bf-b628-e5d504c78396 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:12.631324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4915b9-7929-49e1-bf9b-42ad085cfada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:12.632822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4915b9-7929-49e1-bf9b-42ad085cfada service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:12.633335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4915b9-7929-49e1-bf9b-42ad085cfada service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:12.634069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4915b9-7929-49e1-bf9b-42ad085cfada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:12.636574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0c4915b9-7929-49e1-bf9b-42ad085cfada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:12.788429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4915b9-7929-49e1-bf9b-42ad085cfada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:12.789944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4915b9-7929-49e1-bf9b-42ad085cfada service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:12.809740 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1803/3639] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:17.270395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf678766-0354-4bf5-9f1f-3aa23c81c271 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:17.271874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cf678766-0354-4bf5-9f1f-3aa23c81c271 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:17.295804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf678766-0354-4bf5-9f1f-3aa23c81c271 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:17.307907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:17.308820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:17.309103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:17.309529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] PATH_INFO: `/v3/users/1698dee4a2bf4ea19a6ee0c3d5cb5c09` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:17.312660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1698dee4a2bf4ea19a6ee0c3d5cb5c09)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:17.314916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:17.403050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1698dee4a2bf4ea19a6ee0c3d5cb5c09'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:17.412574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1698dee4a2bf4ea19a6ee0c3d5cb5c09'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:17.414705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1698dee4a2bf4ea19a6ee0c3d5cb5c09'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:17.417598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1698dee4a2bf4ea19a6ee0c3d5cb5c09'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:17.438531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1698dee4a2bf4ea19a6ee0c3d5cb5c09'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:17.461456 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1837/3640] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:04:17 2022] DELETE /identity/v3/users/1698dee4a2bf4ea19a6ee0c3d5cb5c09 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:04:17.780221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4915b9-7929-49e1-bf9b-42ad085cfada service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:17.782345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0c4915b9-7929-49e1-bf9b-42ad085cfada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:17.798343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4915b9-7929-49e1-bf9b-42ad085cfada service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:17.875512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f0b41-b193-4da3-854f-1aa28fde80e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:17.876597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f0b41-b193-4da3-854f-1aa28fde80e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:17.876597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f0b41-b193-4da3-854f-1aa28fde80e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:17.876905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f0b41-b193-4da3-854f-1aa28fde80e6 admin admin] PATH_INFO: `/v3/users/095debf3968c448fb3c3add0322d8d1b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:17.879294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f0b41-b193-4da3-854f-1aa28fde80e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095debf3968c448fb3c3add0322d8d1b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:17.881472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f0b41-b193-4da3-854f-1aa28fde80e6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:17.885824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:17.943949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a93f0b41-b193-4da3-854f-1aa28fde80e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095debf3968c448fb3c3add0322d8d1b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:17.959488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a93f0b41-b193-4da3-854f-1aa28fde80e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095debf3968c448fb3c3add0322d8d1b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:17.960348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a93f0b41-b193-4da3-854f-1aa28fde80e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095debf3968c448fb3c3add0322d8d1b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:17.961278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a93f0b41-b193-4da3-854f-1aa28fde80e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095debf3968c448fb3c3add0322d8d1b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:17.976236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a93f0b41-b193-4da3-854f-1aa28fde80e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095debf3968c448fb3c3add0322d8d1b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:17.982343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:17.984133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:17.997584 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1804/3641] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:04:17 2022] DELETE /identity/v3/users/095debf3968c448fb3c3add0322d8d1b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:18.000253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effe2f3-bd08-478a-b171-01c3291e357b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:18.066708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:18.067361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:18.067640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:18.067909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] PATH_INFO: `/v3/projects/8b00ee5e7828469f95bd90548d35982a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:18.069127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b00ee5e7828469f95bd90548d35982a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:18.071165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:18.074359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:18.161673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b00ee5e7828469f95bd90548d35982a', 'request_id': 'req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.181058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b00ee5e7828469f95bd90548d35982a', 'request_id': 'req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.188333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b00ee5e7828469f95bd90548d35982a', 'request_id': 'req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.219671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] The token cache is being invalidate because project 8b00ee5e7828469f95bd90548d35982a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:04:18.220760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.225707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.228016 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1838/3642] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:04:17 2022] DELETE /identity/v3/projects/8b00ee5e7828469f95bd90548d35982a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:04:18.239935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01649c21-2d2b-466c-8f69-85591daf4ab7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:18.240508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01649c21-2d2b-466c-8f69-85591daf4ab7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:18.241096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01649c21-2d2b-466c-8f69-85591daf4ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:18.276897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-01649c21-2d2b-466c-8f69-85591daf4ab7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:18.278783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-01649c21-2d2b-466c-8f69-85591daf4ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:18.335106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:18.341937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:18.399444 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1805/3643] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:18.400746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01649c21-2d2b-466c-8f69-85591daf4ab7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:18.403135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-01649c21-2d2b-466c-8f69-85591daf4ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:18.416713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01649c21-2d2b-466c-8f69-85591daf4ab7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:18.422269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb307e-a012-42b9-b60e-ea2722f57dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:18.422908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb307e-a012-42b9-b60e-ea2722f57dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:18.423186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb307e-a012-42b9-b60e-ea2722f57dee admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:18.423456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb307e-a012-42b9-b60e-ea2722f57dee admin admin] PATH_INFO: `/v3/users/5e3216124a4f41b2b931a16c750649df` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:18.424632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb307e-a012-42b9-b60e-ea2722f57dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3216124a4f41b2b931a16c750649df)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:18.426807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb307e-a012-42b9-b60e-ea2722f57dee admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:18.513940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0bb307e-a012-42b9-b60e-ea2722f57dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3216124a4f41b2b931a16c750649df'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.530236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0bb307e-a012-42b9-b60e-ea2722f57dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3216124a4f41b2b931a16c750649df'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.531888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0bb307e-a012-42b9-b60e-ea2722f57dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3216124a4f41b2b931a16c750649df'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.532752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0bb307e-a012-42b9-b60e-ea2722f57dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3216124a4f41b2b931a16c750649df'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.533365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea82842-6652-4eb9-a71b-f81bbf9e1c52 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:18.541094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa390a-eabe-460b-93d3-1fe60d25d61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:18.542158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa390a-eabe-460b-93d3-1fe60d25d61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:18.542608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa390a-eabe-460b-93d3-1fe60d25d61c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:18.543052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa390a-eabe-460b-93d3-1fe60d25d61c admin admin] PATH_INFO: `/v3/projects/bc9bed6d76834f6fa66d681ecd9f4e90` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:18.544527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa390a-eabe-460b-93d3-1fe60d25d61c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9bed6d76834f6fa66d681ecd9f4e90)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:18.547006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa390a-eabe-460b-93d3-1fe60d25d61c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:18.552821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0bb307e-a012-42b9-b60e-ea2722f57dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3216124a4f41b2b931a16c750649df'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.555104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:18.581925 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1806/3644] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:04:18 2022] DELETE /identity/v3/users/5e3216124a4f41b2b931a16c750649df => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:18.584148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ce697-617b-4eee-89b7-ed617b1147a4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:18.584606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ce697-617b-4eee-89b7-ed617b1147a4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:18.584922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ce697-617b-4eee-89b7-ed617b1147a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:18.622046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3bfa390a-eabe-460b-93d3-1fe60d25d61c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'request_id': 'req-3bfa390a-eabe-460b-93d3-1fe60d25d61c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.637652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3bfa390a-eabe-460b-93d3-1fe60d25d61c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'request_id': 'req-3bfa390a-eabe-460b-93d3-1fe60d25d61c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.646301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3bfa390a-eabe-460b-93d3-1fe60d25d61c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'request_id': 'req-3bfa390a-eabe-460b-93d3-1fe60d25d61c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.655133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5a5ce697-617b-4eee-89b7-ed617b1147a4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:18.656934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5a5ce697-617b-4eee-89b7-ed617b1147a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:18.674664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3bfa390a-eabe-460b-93d3-1fe60d25d61c admin admin] The token cache is being invalidate because project bc9bed6d76834f6fa66d681ecd9f4e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:04:18.674970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3bfa390a-eabe-460b-93d3-1fe60d25d61c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.678808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3bfa390a-eabe-460b-93d3-1fe60d25d61c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:18.713526 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1839/3645] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:04:18 2022] DELETE /identity/v3/projects/bc9bed6d76834f6fa66d681ecd9f4e90 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:18.713526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef892a-6f08-4bfb-97a7-8de0610d5c60 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:18.713526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef892a-6f08-4bfb-97a7-8de0610d5c60 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:18.713526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef892a-6f08-4bfb-97a7-8de0610d5c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:18.788743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c5ef892a-6f08-4bfb-97a7-8de0610d5c60 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:18.792971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c5ef892a-6f08-4bfb-97a7-8de0610d5c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:18.797709 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1807/3646] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:18.801789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ce697-617b-4eee-89b7-ed617b1147a4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:18.816296 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1840/3647] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:18.820316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ce697-617b-4eee-89b7-ed617b1147a4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:18.823713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6a544-ad2e-4e0b-8766-2191dab3320d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:18.824057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6a544-ad2e-4e0b-8766-2191dab3320d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:18.824493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6a544-ad2e-4e0b-8766-2191dab3320d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:18.829868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525627e-b324-4735-9f2f-c16a343ad330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:18.831504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525627e-b324-4735-9f2f-c16a343ad330 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:18.832105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525627e-b324-4735-9f2f-c16a343ad330 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:18.832416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525627e-b324-4735-9f2f-c16a343ad330 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:18.833179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525627e-b324-4735-9f2f-c16a343ad330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:04:18.833575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525627e-b324-4735-9f2f-c16a343ad330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:18.835315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525627e-b324-4735-9f2f-c16a343ad330 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:18.851961 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1808/3648] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:04:18.856495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525627e-b324-4735-9f2f-c16a343ad330 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:18.867724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-61f6a544-ad2e-4e0b-8766-2191dab3320d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:18.869117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-61f6a544-ad2e-4e0b-8766-2191dab3320d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:18.871405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525627e-b324-4735-9f2f-c16a343ad330 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:18.882054 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1841/3649] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:04:18.883221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6a544-ad2e-4e0b-8766-2191dab3320d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:18.894727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6a544-ad2e-4e0b-8766-2191dab3320d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:18.895443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8f4a-119b-4632-b6dc-69539600e8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:18.900329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e02c7-376e-4400-b847-785b7375a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:18.900916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e02c7-376e-4400-b847-785b7375a5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:18.901131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e02c7-376e-4400-b847-785b7375a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:18.901694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e02c7-376e-4400-b847-785b7375a5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:18.901932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8f4a-119b-4632-b6dc-69539600e8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:18.902221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8f4a-119b-4632-b6dc-69539600e8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:18.902374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e02c7-376e-4400-b847-785b7375a5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:04:18.902494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8f4a-119b-4632-b6dc-69539600e8f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:18.902862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e02c7-376e-4400-b847-785b7375a5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:18.903856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa8f4a-119b-4632-b6dc-69539600e8f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:18.904654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e02c7-376e-4400-b847-785b7375a5d1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:18.909044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa8f4a-119b-4632-b6dc-69539600e8f7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:18.919901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:18.945883 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1842/3650] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:04:18.946904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e02c7-376e-4400-b847-785b7375a5d1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:18.948759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4c1e02c7-376e-4400-b847-785b7375a5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:18.990094 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1809/3651] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:04:18 2022] POST /identity/v3/projects => generated 403 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:04:18.990990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8f4a-119b-4632-b6dc-69539600e8f7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:18.994702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e02c7-376e-4400-b847-785b7375a5d1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:19.125087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8f4a-119b-4632-b6dc-69539600e8f7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:19.132929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66090794-fa3e-492e-90a2-b144cb784700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:19.133967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66090794-fa3e-492e-90a2-b144cb784700 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:19.134519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66090794-fa3e-492e-90a2-b144cb784700 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:19.135087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66090794-fa3e-492e-90a2-b144cb784700 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:19.136403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66090794-fa3e-492e-90a2-b144cb784700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:19.138936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66090794-fa3e-492e-90a2-b144cb784700 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:19.174322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:19.175747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:19.176026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:19.176495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] PATH_INFO: `/v3/projects/9e0310d9e59942729d685e6eb06c6460` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:19.178223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e0310d9e59942729d685e6eb06c6460)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:19.180832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:19.184944 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1810/3652] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:04:18 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:19.189503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66090794-fa3e-492e-90a2-b144cb784700 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:19.255309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e0310d9e59942729d685e6eb06c6460', 'request_id': 'req-dd30b322-8ce9-422e-899b-bf08cc4edb09'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:19.264435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e0310d9e59942729d685e6eb06c6460', 'request_id': 'req-dd30b322-8ce9-422e-899b-bf08cc4edb09'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:19.278724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e0310d9e59942729d685e6eb06c6460', 'request_id': 'req-dd30b322-8ce9-422e-899b-bf08cc4edb09'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:19.298317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:19.324236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] The token cache is being invalidate because project 9e0310d9e59942729d685e6eb06c6460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:04:19.326019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:19.327046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:19.334941 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1843/3653] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:04:18 2022] DELETE /identity/v3/projects/9e0310d9e59942729d685e6eb06c6460 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:19.337169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:19.342859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66090794-fa3e-492e-90a2-b144cb784700 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:19.343032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:19.469826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30b322-8ce9-422e-899b-bf08cc4edb09 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:19.507053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad3465-91e9-493d-b672-e4030c4aa337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:19.510992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad3465-91e9-493d-b672-e4030c4aa337 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:19.511346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad3465-91e9-493d-b672-e4030c4aa337 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:19.511569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad3465-91e9-493d-b672-e4030c4aa337 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:19.512717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad3465-91e9-493d-b672-e4030c4aa337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:19.518746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad3465-91e9-493d-b672-e4030c4aa337 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:19.532566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88862e5-6495-4ad1-aa02-3d42e998d050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:19.533293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88862e5-6495-4ad1-aa02-3d42e998d050 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:19.533890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88862e5-6495-4ad1-aa02-3d42e998d050 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:19.534657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88862e5-6495-4ad1-aa02-3d42e998d050 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:19.536047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88862e5-6495-4ad1-aa02-3d42e998d050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:19.538758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88862e5-6495-4ad1-aa02-3d42e998d050 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:19.573725 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1844/3654] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:04:19 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:19.575428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad3465-91e9-493d-b672-e4030c4aa337 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:19.579448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-60ad3465-91e9-493d-b672-e4030c4aa337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:19.591179 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1811/3655] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:04:19 2022] POST /identity/v3/users => generated 302 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:19.592110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88862e5-6495-4ad1-aa02-3d42e998d050 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:19.615329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad3465-91e9-493d-b672-e4030c4aa337 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:19.622060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88862e5-6495-4ad1-aa02-3d42e998d050 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:19.631376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426d10a-5058-4aaf-a60e-663c129c0bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:19.632350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426d10a-5058-4aaf-a60e-663c129c0bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:19.632843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426d10a-5058-4aaf-a60e-663c129c0bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:19.633302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426d10a-5058-4aaf-a60e-663c129c0bdd admin admin] PATH_INFO: `/v3/users/6e4ea2c363454c75bf52e6809b508b0f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:19.635438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426d10a-5058-4aaf-a60e-663c129c0bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4ea2c363454c75bf52e6809b508b0f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:19.638448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426d10a-5058-4aaf-a60e-663c129c0bdd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:19.639909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46bcc3-4ed0-4e33-8d20-3e46c4ad840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:19.640604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46bcc3-4ed0-4e33-8d20-3e46c4ad840c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:19.640884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46bcc3-4ed0-4e33-8d20-3e46c4ad840c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:19.641154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46bcc3-4ed0-4e33-8d20-3e46c4ad840c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:19.642191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46bcc3-4ed0-4e33-8d20-3e46c4ad840c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:19.645752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46bcc3-4ed0-4e33-8d20-3e46c4ad840c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:19.659556 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1812/3656] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:19.661142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46bcc3-4ed0-4e33-8d20-3e46c4ad840c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:19.662690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:19.663244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-da46bcc3-4ed0-4e33-8d20-3e46c4ad840c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:19.696953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46bcc3-4ed0-4e33-8d20-3e46c4ad840c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:19.711126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84413504-5538-436f-ac99-002eb2f70804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:19.711540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84413504-5538-436f-ac99-002eb2f70804 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:19.711841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84413504-5538-436f-ac99-002eb2f70804 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:19.712134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84413504-5538-436f-ac99-002eb2f70804 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:19.712826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84413504-5538-436f-ac99-002eb2f70804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:19.714788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84413504-5538-436f-ac99-002eb2f70804 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:19.732132 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1813/3657] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:19.734255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84413504-5538-436f-ac99-002eb2f70804 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:19.761450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2426d10a-5058-4aaf-a60e-663c129c0bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4ea2c363454c75bf52e6809b508b0f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:19.763916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84413504-5538-436f-ac99-002eb2f70804 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:19.770168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26980b5d-c9c6-4628-b8de-b8acc91e0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:19.770793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26980b5d-c9c6-4628-b8de-b8acc91e0732 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:19.771070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26980b5d-c9c6-4628-b8de-b8acc91e0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:19.771399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26980b5d-c9c6-4628-b8de-b8acc91e0732 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:19.772596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26980b5d-c9c6-4628-b8de-b8acc91e0732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:19.774250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26980b5d-c9c6-4628-b8de-b8acc91e0732 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:19.785932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2426d10a-5058-4aaf-a60e-663c129c0bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4ea2c363454c75bf52e6809b508b0f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:19.787105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2426d10a-5058-4aaf-a60e-663c129c0bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4ea2c363454c75bf52e6809b508b0f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:19.788165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2426d10a-5058-4aaf-a60e-663c129c0bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4ea2c363454c75bf52e6809b508b0f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:19.793286 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1814/3658] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:19.793286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26980b5d-c9c6-4628-b8de-b8acc91e0732 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:19.795969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-26980b5d-c9c6-4628-b8de-b8acc91e0732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:19.829991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2426d10a-5058-4aaf-a60e-663c129c0bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4ea2c363454c75bf52e6809b508b0f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:19.834563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26980b5d-c9c6-4628-b8de-b8acc91e0732 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:19.842226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800bbc-a4e5-4e4e-921b-dae1bf3aee01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:19.843288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800bbc-a4e5-4e4e-921b-dae1bf3aee01 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:19.843288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800bbc-a4e5-4e4e-921b-dae1bf3aee01 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:19.843500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800bbc-a4e5-4e4e-921b-dae1bf3aee01 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:19.844086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b800bbc-a4e5-4e4e-921b-dae1bf3aee01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:19.847095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b800bbc-a4e5-4e4e-921b-dae1bf3aee01 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:19.859172 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1815/3659] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:19.859904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800bbc-a4e5-4e4e-921b-dae1bf3aee01 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:19.864580 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1845/3660] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:04:19 2022] DELETE /identity/v3/users/6e4ea2c363454c75bf52e6809b508b0f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:19.865488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7b800bbc-a4e5-4e4e-921b-dae1bf3aee01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:19.865634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426d10a-5058-4aaf-a60e-663c129c0bdd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:19.883451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800bbc-a4e5-4e4e-921b-dae1bf3aee01 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:19.965553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426d10a-5058-4aaf-a60e-663c129c0bdd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:19.981453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddf06b-91fc-443e-a509-f1d93f3adbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:19.982507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddf06b-91fc-443e-a509-f1d93f3adbb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:19.982983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddf06b-91fc-443e-a509-f1d93f3adbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:19.983450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddf06b-91fc-443e-a509-f1d93f3adbb7 admin admin] PATH_INFO: `/v3/projects/c3007fed9a3947fca44796c748f4328d/users/5f961631b2644e9693e4b489ed87c5cd/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:20.001970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fddf06b-91fc-443e-a509-f1d93f3adbb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3007fed9a3947fca44796c748f4328d, user_id=5f961631b2644e9693e4b489ed87c5cd, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:20.007504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fddf06b-91fc-443e-a509-f1d93f3adbb7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:20.036503 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1846/3661] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:04:19 2022] PUT /identity/v3/projects/c3007fed9a3947fca44796c748f4328d/users/5f961631b2644e9693e4b489ed87c5cd/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:20.047016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18030bcc-82a9-4560-af5c-b15639d57b27 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:20.047625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18030bcc-82a9-4560-af5c-b15639d57b27 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:20.048109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18030bcc-82a9-4560-af5c-b15639d57b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:20.050214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4293dc-3910-4b13-ae7f-787b7e892b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:20.050901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4293dc-3910-4b13-ae7f-787b7e892b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:20.051182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4293dc-3910-4b13-ae7f-787b7e892b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:20.051459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4293dc-3910-4b13-ae7f-787b7e892b14 admin admin] PATH_INFO: `/v3/projects/917519b500674698a68dc01a4e8d68a8/users/5000948fa98a4b5d96ad27436d3d0edb/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:20.089218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4293dc-3910-4b13-ae7f-787b7e892b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917519b500674698a68dc01a4e8d68a8, user_id=5000948fa98a4b5d96ad27436d3d0edb, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:20.091985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4293dc-3910-4b13-ae7f-787b7e892b14 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:20.100465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-18030bcc-82a9-4560-af5c-b15639d57b27 None None] MFA Rules not processed for user `5f961631b2644e9693e4b489ed87c5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:20.102259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-18030bcc-82a9-4560-af5c-b15639d57b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:20.117360 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1816/3662] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:04:19 2022] PUT /identity/v3/projects/917519b500674698a68dc01a4e8d68a8/users/5000948fa98a4b5d96ad27436d3d0edb/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:20.122959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe9393-93dd-4fad-8a75-aa358cbe8835 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:20.123321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe9393-93dd-4fad-8a75-aa358cbe8835 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:20.123584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe9393-93dd-4fad-8a75-aa358cbe8835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:20.168982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e5fe9393-93dd-4fad-8a75-aa358cbe8835 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:20.170792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e5fe9393-93dd-4fad-8a75-aa358cbe8835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:20.195056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:20.276595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:20.287863 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1847/3663] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:20 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:20.293818 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1817/3664] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:04:20.316942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18030bcc-82a9-4560-af5c-b15639d57b27 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:20.319219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-18030bcc-82a9-4560-af5c-b15639d57b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:20.326579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe9393-93dd-4fad-8a75-aa358cbe8835 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:20.338708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe9393-93dd-4fad-8a75-aa358cbe8835 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:20.344556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b20c84-fa2c-41b2-bc56-8189126c4613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:20.345373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b20c84-fa2c-41b2-bc56-8189126c4613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:20.345655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b20c84-fa2c-41b2-bc56-8189126c4613 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:20.346079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b20c84-fa2c-41b2-bc56-8189126c4613 admin admin] PATH_INFO: `/v3/users/5f961631b2644e9693e4b489ed87c5cd` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:20.347893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b20c84-fa2c-41b2-bc56-8189126c4613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f961631b2644e9693e4b489ed87c5cd)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:20.351560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b20c84-fa2c-41b2-bc56-8189126c4613 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:20.392459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18030bcc-82a9-4560-af5c-b15639d57b27 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:20.466354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c4b20c84-fa2c-41b2-bc56-8189126c4613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f961631b2644e9693e4b489ed87c5cd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:20.483520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c4b20c84-fa2c-41b2-bc56-8189126c4613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f961631b2644e9693e4b489ed87c5cd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:20.486223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c4b20c84-fa2c-41b2-bc56-8189126c4613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f961631b2644e9693e4b489ed87c5cd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:20.490401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c4b20c84-fa2c-41b2-bc56-8189126c4613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f961631b2644e9693e4b489ed87c5cd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:20.516557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c4b20c84-fa2c-41b2-bc56-8189126c4613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f961631b2644e9693e4b489ed87c5cd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:20.523343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe000498-1cbd-4659-9bce-d72fb9dbd638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:20.526415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe000498-1cbd-4659-9bce-d72fb9dbd638 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:20.526911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe000498-1cbd-4659-9bce-d72fb9dbd638 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:20.528463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe000498-1cbd-4659-9bce-d72fb9dbd638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:20.533668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fe000498-1cbd-4659-9bce-d72fb9dbd638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:20.539473 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1818/3665] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:04:20 2022] DELETE /identity/v3/users/5f961631b2644e9693e4b489ed87c5cd => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:20.544684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47db28-b09a-4cdd-86de-90dff670ba0c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:20.545197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47db28-b09a-4cdd-86de-90dff670ba0c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:20.545629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47db28-b09a-4cdd-86de-90dff670ba0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:20.573406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe000498-1cbd-4659-9bce-d72fb9dbd638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:20.574946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe000498-1cbd-4659-9bce-d72fb9dbd638 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:20.587854 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1848/3666] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:20.592305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2f47db28-b09a-4cdd-86de-90dff670ba0c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:20.593776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2f47db28-b09a-4cdd-86de-90dff670ba0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:20.678500 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1819/3667] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:04:20.705789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe000498-1cbd-4659-9bce-d72fb9dbd638 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:20.709599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fe000498-1cbd-4659-9bce-d72fb9dbd638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:20.723465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe000498-1cbd-4659-9bce-d72fb9dbd638 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:20.821845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b7db4-fd96-483d-8c68-cb8557873965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:20.823432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b7db4-fd96-483d-8c68-cb8557873965 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:20.825353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b7db4-fd96-483d-8c68-cb8557873965 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:20.827008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b7db4-fd96-483d-8c68-cb8557873965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:20.870481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b7db4-fd96-483d-8c68-cb8557873965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:20.873108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b7db4-fd96-483d-8c68-cb8557873965 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:20.913012 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1849/3668] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:21.028641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47db28-b09a-4cdd-86de-90dff670ba0c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:21.030160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2f47db28-b09a-4cdd-86de-90dff670ba0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:21.044107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47db28-b09a-4cdd-86de-90dff670ba0c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:21.049467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:21.051497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:21.051497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:21.051497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795 admin admin] PATH_INFO: `/v3/projects/66f3dd8b3d034ecf9b72e603c0ef9d6e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:21.052924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f3dd8b3d034ecf9b72e603c0ef9d6e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:21.054939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:21.131298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:21.166142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f3dd8b3d034ecf9b72e603c0ef9d6e', 'request_id': 'req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:21.178663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f3dd8b3d034ecf9b72e603c0ef9d6e', 'request_id': 'req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:21.188095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f3dd8b3d034ecf9b72e603c0ef9d6e', 'request_id': 'req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:21.203839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795 admin admin] The token cache is being invalidate because project 66f3dd8b3d034ecf9b72e603c0ef9d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:04:21.204130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:21.204799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ac13c89-02ad-4681-b6d8-9fc35a2f6795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:21.208522 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1820/3669] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:04:21 2022] DELETE /identity/v3/projects/66f3dd8b3d034ecf9b72e603c0ef9d6e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:21.215321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d1721-0dd7-4755-a959-9a5c2555c7c9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:21.215604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d1721-0dd7-4755-a959-9a5c2555c7c9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:21.215879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d1721-0dd7-4755-a959-9a5c2555c7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:21.250955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-303d1721-0dd7-4755-a959-9a5c2555c7c9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:21.253490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-303d1721-0dd7-4755-a959-9a5c2555c7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:21.382076 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1850/3670] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:04:21.391283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625cc82-193f-4f35-8fe6-0361c9a0a090 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:21.394385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625cc82-193f-4f35-8fe6-0361c9a0a090 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:21.394735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625cc82-193f-4f35-8fe6-0361c9a0a090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:21.423639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a625cc82-193f-4f35-8fe6-0361c9a0a090 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:21.424900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a625cc82-193f-4f35-8fe6-0361c9a0a090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:21.443047 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1821/3671] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:21.447162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d1721-0dd7-4755-a959-9a5c2555c7c9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:21.454077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:21.458946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d1721-0dd7-4755-a959-9a5c2555c7c9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:21.465299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1690-d67e-4218-a29f-cea8b2e08314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:21.465955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1690-d67e-4218-a29f-cea8b2e08314 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:21.466510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1690-d67e-4218-a29f-cea8b2e08314 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:21.466853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1690-d67e-4218-a29f-cea8b2e08314 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:21.467581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c1690-d67e-4218-a29f-cea8b2e08314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:04:21.467958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c1690-d67e-4218-a29f-cea8b2e08314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:21.469674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c1690-d67e-4218-a29f-cea8b2e08314 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:21.503748 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1851/3672] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:04:21.508866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625cc82-193f-4f35-8fe6-0361c9a0a090 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:21.521694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625cc82-193f-4f35-8fe6-0361c9a0a090 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:21.532136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b50f9-55f9-47a6-9a5e-56f856d02028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:21.532995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b50f9-55f9-47a6-9a5e-56f856d02028 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:21.533525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b50f9-55f9-47a6-9a5e-56f856d02028 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:21.534698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b50f9-55f9-47a6-9a5e-56f856d02028 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:21.536563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b50f9-55f9-47a6-9a5e-56f856d02028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:21.538644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b50f9-55f9-47a6-9a5e-56f856d02028 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:21.583417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1690-d67e-4218-a29f-cea8b2e08314 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:21.584546 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1822/3673] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:04:21 2022] POST /identity/v3/projects => generated 395 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:21.605856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1690-d67e-4218-a29f-cea8b2e08314 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:21.687867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d21e7-6a1b-4aa4-a490-1f427bcf70ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:21.688936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d21e7-6a1b-4aa4-a490-1f427bcf70ff admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:21.689545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d21e7-6a1b-4aa4-a490-1f427bcf70ff admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:21.690602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d21e7-6a1b-4aa4-a490-1f427bcf70ff admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:21.691480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d21e7-6a1b-4aa4-a490-1f427bcf70ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:21.693841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d21e7-6a1b-4aa4-a490-1f427bcf70ff admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:21.730264 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1852/3674] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:04:21 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:21.734143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b50f9-55f9-47a6-9a5e-56f856d02028 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:21.747519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b50f9-55f9-47a6-9a5e-56f856d02028 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:21.753773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05734253-7120-4cfa-b5be-6ca3fa61a778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:21.754493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05734253-7120-4cfa-b5be-6ca3fa61a778 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:21.754848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05734253-7120-4cfa-b5be-6ca3fa61a778 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:21.755200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05734253-7120-4cfa-b5be-6ca3fa61a778 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:21.755934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05734253-7120-4cfa-b5be-6ca3fa61a778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:21.757721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05734253-7120-4cfa-b5be-6ca3fa61a778 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:21.775910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d21e7-6a1b-4aa4-a490-1f427bcf70ff admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:21.777075 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1823/3675] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:21.787678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d21e7-6a1b-4aa4-a490-1f427bcf70ff admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:21.793147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc6560-921c-4a49-8179-e9e5e6c51f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:21.793805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc6560-921c-4a49-8179-e9e5e6c51f74 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:21.794157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc6560-921c-4a49-8179-e9e5e6c51f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:21.794701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc6560-921c-4a49-8179-e9e5e6c51f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:21.795218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc6560-921c-4a49-8179-e9e5e6c51f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:21.797097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc6560-921c-4a49-8179-e9e5e6c51f74 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:21.815456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05734253-7120-4cfa-b5be-6ca3fa61a778 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:21.822371 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1853/3676] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:04:21.827131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05734253-7120-4cfa-b5be-6ca3fa61a778 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:21.832428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741e7e8-6cab-4eb6-b7eb-1e2a5bd4a9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:21.833065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741e7e8-6cab-4eb6-b7eb-1e2a5bd4a9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:21.833412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741e7e8-6cab-4eb6-b7eb-1e2a5bd4a9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:21.833773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741e7e8-6cab-4eb6-b7eb-1e2a5bd4a9d8 admin admin] PATH_INFO: `/v3/projects/c405aac48e9b403ca8d1e3ac28fab76e/users/0c6153d58d264272a375b3169e0874d3/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:21.856681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741e7e8-6cab-4eb6-b7eb-1e2a5bd4a9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c405aac48e9b403ca8d1e3ac28fab76e, user_id=0c6153d58d264272a375b3169e0874d3, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:21.860754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741e7e8-6cab-4eb6-b7eb-1e2a5bd4a9d8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:21.884844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf77e9-dca8-4f47-93d2-89ed1234228c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:21.885620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf77e9-dca8-4f47-93d2-89ed1234228c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:21.886130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf77e9-dca8-4f47-93d2-89ed1234228c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:21.889262 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1824/3677] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:04:21 2022] PUT /identity/v3/projects/c405aac48e9b403ca8d1e3ac28fab76e/users/0c6153d58d264272a375b3169e0874d3/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:04:21.913784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d1cf77e9-dca8-4f47-93d2-89ed1234228c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:21.917819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d1cf77e9-dca8-4f47-93d2-89ed1234228c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:22.008566 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1854/3678] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:22.032069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741e7e8-6cab-4eb6-b7eb-1e2a5bd4a9d8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:22.034552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3741e7e8-6cab-4eb6-b7eb-1e2a5bd4a9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:22.042294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf77e9-dca8-4f47-93d2-89ed1234228c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:22.044574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d1cf77e9-dca8-4f47-93d2-89ed1234228c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:22.057789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf77e9-dca8-4f47-93d2-89ed1234228c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:22.072896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f3149-9ac9-401f-abc0-48a96a7d3552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:22.078169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f3149-9ac9-401f-abc0-48a96a7d3552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:22.078988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f3149-9ac9-401f-abc0-48a96a7d3552 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:22.079283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f3149-9ac9-401f-abc0-48a96a7d3552 admin admin] PATH_INFO: `/v3/projects/c3007fed9a3947fca44796c748f4328d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:22.081806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f3149-9ac9-401f-abc0-48a96a7d3552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3007fed9a3947fca44796c748f4328d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:22.083869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f3149-9ac9-401f-abc0-48a96a7d3552 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:22.137977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741e7e8-6cab-4eb6-b7eb-1e2a5bd4a9d8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:22.150520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2baa3-7e52-4ebf-ba09-f669325aba9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:22.151189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2baa3-7e52-4ebf-ba09-f669325aba9d service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:22.152182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2baa3-7e52-4ebf-ba09-f669325aba9d service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:22.152624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2baa3-7e52-4ebf-ba09-f669325aba9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:22.168576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2baa3-7e52-4ebf-ba09-f669325aba9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:22.172374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2baa3-7e52-4ebf-ba09-f669325aba9d service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:22.194659 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1825/3679] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:22.196115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2baa3-7e52-4ebf-ba09-f669325aba9d service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:22.198640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a3b2baa3-7e52-4ebf-ba09-f669325aba9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:22.245703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2baa3-7e52-4ebf-ba09-f669325aba9d service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:22.248640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f85f3149-9ac9-401f-abc0-48a96a7d3552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3007fed9a3947fca44796c748f4328d', 'request_id': 'req-f85f3149-9ac9-401f-abc0-48a96a7d3552'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:22.266341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f85f3149-9ac9-401f-abc0-48a96a7d3552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3007fed9a3947fca44796c748f4328d', 'request_id': 'req-f85f3149-9ac9-401f-abc0-48a96a7d3552'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:22.278569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:22.284054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f85f3149-9ac9-401f-abc0-48a96a7d3552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3007fed9a3947fca44796c748f4328d', 'request_id': 'req-f85f3149-9ac9-401f-abc0-48a96a7d3552'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:22.306443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f85f3149-9ac9-401f-abc0-48a96a7d3552 admin admin] The token cache is being invalidate because project c3007fed9a3947fca44796c748f4328d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:04:22.306741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f85f3149-9ac9-401f-abc0-48a96a7d3552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:22.307828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f85f3149-9ac9-401f-abc0-48a96a7d3552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:22.310253 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1855/3680] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:04:22 2022] DELETE /identity/v3/projects/c3007fed9a3947fca44796c748f4328d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:22.318176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa50a-c43a-4da8-a362-8690ef859858 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:22.320971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa50a-c43a-4da8-a362-8690ef859858 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:22.321312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa50a-c43a-4da8-a362-8690ef859858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:22.346648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-757aa50a-c43a-4da8-a362-8690ef859858 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:22.348281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-757aa50a-c43a-4da8-a362-8690ef859858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:22.370879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:22.393620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b458347-be0c-49cd-80b8-923c31e619a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:22.394860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b458347-be0c-49cd-80b8-923c31e619a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:22.395167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b458347-be0c-49cd-80b8-923c31e619a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:22.397318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b458347-be0c-49cd-80b8-923c31e619a2 admin admin] PATH_INFO: `/v3/users/40f60e33f334465fac1148669de3f00c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:22.400745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b458347-be0c-49cd-80b8-923c31e619a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f60e33f334465fac1148669de3f00c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:22.404683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b458347-be0c-49cd-80b8-923c31e619a2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:22.501588 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1856/3681] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:22.506474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07702a29-4248-485b-b01f-d9069e6d8e17 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:22.508224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07702a29-4248-485b-b01f-d9069e6d8e17 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:22.509043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07702a29-4248-485b-b01f-d9069e6d8e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:22.517005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4b458347-be0c-49cd-80b8-923c31e619a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f60e33f334465fac1148669de3f00c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:22.527611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4b458347-be0c-49cd-80b8-923c31e619a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f60e33f334465fac1148669de3f00c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:22.528581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4b458347-be0c-49cd-80b8-923c31e619a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f60e33f334465fac1148669de3f00c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:22.529282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4b458347-be0c-49cd-80b8-923c31e619a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f60e33f334465fac1148669de3f00c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:22.547124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4b458347-be0c-49cd-80b8-923c31e619a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f60e33f334465fac1148669de3f00c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:22.552783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-07702a29-4248-485b-b01f-d9069e6d8e17 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:22.554578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-07702a29-4248-485b-b01f-d9069e6d8e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:22.567382 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1857/3682] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:22.567933 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1826/3683] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:04:22 2022] DELETE /identity/v3/users/40f60e33f334465fac1148669de3f00c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:22.571938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07702a29-4248-485b-b01f-d9069e6d8e17 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:22.585425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07702a29-4248-485b-b01f-d9069e6d8e17 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:22.719865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b87e2e-4c80-4a80-9f28-e33034433445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:22.720595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b87e2e-4c80-4a80-9f28-e33034433445 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:22.720881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b87e2e-4c80-4a80-9f28-e33034433445 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:22.721277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b87e2e-4c80-4a80-9f28-e33034433445 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:22.722013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b87e2e-4c80-4a80-9f28-e33034433445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:04:22.722323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b87e2e-4c80-4a80-9f28-e33034433445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:22.724450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b87e2e-4c80-4a80-9f28-e33034433445 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:22.746972 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1858/3684] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:04:22.748297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b458347-be0c-49cd-80b8-923c31e619a2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:22.762345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b458347-be0c-49cd-80b8-923c31e619a2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:22.768887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d0011-140e-4de5-a693-72d4f8c230c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:22.769689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d0011-140e-4de5-a693-72d4f8c230c9 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:22.770073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d0011-140e-4de5-a693-72d4f8c230c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:22.770450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d0011-140e-4de5-a693-72d4f8c230c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:22.771190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d0011-140e-4de5-a693-72d4f8c230c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:22.773244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d0011-140e-4de5-a693-72d4f8c230c9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:22.813690 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1827/3685] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:04:22 2022] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:22.816996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b87e2e-4c80-4a80-9f28-e33034433445 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:22.832188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b87e2e-4c80-4a80-9f28-e33034433445 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:22.932785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df0a62-9086-45ba-bb40-c1373330a4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:22.933726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df0a62-9086-45ba-bb40-c1373330a4ba admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:22.934211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df0a62-9086-45ba-bb40-c1373330a4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:22.934599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df0a62-9086-45ba-bb40-c1373330a4ba admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:22.935357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df0a62-9086-45ba-bb40-c1373330a4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:22.937504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df0a62-9086-45ba-bb40-c1373330a4ba admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:22.966516 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1859/3686] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:04:22 2022] POST /identity/v3/users => generated 282 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:22.971071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d0011-140e-4de5-a693-72d4f8c230c9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:22.983820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d0011-140e-4de5-a693-72d4f8c230c9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:22.990583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9969d-c171-4b7e-986d-d24e361a3f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:22.991453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9969d-c171-4b7e-986d-d24e361a3f0e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:22.991846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9969d-c171-4b7e-986d-d24e361a3f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:22.992259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9969d-c171-4b7e-986d-d24e361a3f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:22.993011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9969d-c171-4b7e-986d-d24e361a3f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:22.995126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9969d-c171-4b7e-986d-d24e361a3f0e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:23.013449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df0a62-9086-45ba-bb40-c1373330a4ba admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:23.021864 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1828/3687] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:23.032563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df0a62-9086-45ba-bb40-c1373330a4ba admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:23.041006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8151615-78ae-44a9-9dd4-ea9f98fff8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:23.041797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8151615-78ae-44a9-9dd4-ea9f98fff8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:23.042349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8151615-78ae-44a9-9dd4-ea9f98fff8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:23.042909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8151615-78ae-44a9-9dd4-ea9f98fff8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:23.043936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8151615-78ae-44a9-9dd4-ea9f98fff8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:23.046086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8151615-78ae-44a9-9dd4-ea9f98fff8a2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:23.049633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:23.066854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9969d-c171-4b7e-986d-d24e361a3f0e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:23.074893 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1860/3688] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:23.080234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9969d-c171-4b7e-986d-d24e361a3f0e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:23.086646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958d1ce-349b-4356-8f83-ca9c6b8d4607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:23.087814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958d1ce-349b-4356-8f83-ca9c6b8d4607 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:23.088201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958d1ce-349b-4356-8f83-ca9c6b8d4607 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:23.088635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958d1ce-349b-4356-8f83-ca9c6b8d4607 admin admin] PATH_INFO: `/v3/projects/0f79ff98437a4243817f8f931103a27e/users/68f231eaeb554115b5499d4e27a00f79/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:23.108939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958d1ce-349b-4356-8f83-ca9c6b8d4607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f79ff98437a4243817f8f931103a27e, user_id=68f231eaeb554115b5499d4e27a00f79, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:23.112255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958d1ce-349b-4356-8f83-ca9c6b8d4607 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:23.141992 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1829/3689] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:04:23 2022] PUT /identity/v3/projects/0f79ff98437a4243817f8f931103a27e/users/68f231eaeb554115b5499d4e27a00f79/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:23.147676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02a2a-09aa-468d-acac-6941f63c795a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:23.147676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02a2a-09aa-468d-acac-6941f63c795a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:23.148185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02a2a-09aa-468d-acac-6941f63c795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:23.205124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7ff02a2a-09aa-468d-acac-6941f63c795a None None] MFA Rules not processed for user `68f231eaeb554115b5499d4e27a00f79`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:23.209230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7ff02a2a-09aa-468d-acac-6941f63c795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:23.344825 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1861/3690] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:23.360406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958d1ce-349b-4356-8f83-ca9c6b8d4607 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:23.362954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f958d1ce-349b-4356-8f83-ca9c6b8d4607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:23.539235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958d1ce-349b-4356-8f83-ca9c6b8d4607 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:23.553052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db5dcc-6a5d-46b6-8e34-be696c4d852c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:23.554010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db5dcc-6a5d-46b6-8e34-be696c4d852c service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:23.555343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db5dcc-6a5d-46b6-8e34-be696c4d852c service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:23.556147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db5dcc-6a5d-46b6-8e34-be696c4d852c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:23.572563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db5dcc-6a5d-46b6-8e34-be696c4d852c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:23.574597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db5dcc-6a5d-46b6-8e34-be696c4d852c service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:23.582486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:23.593082 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1830/3691] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:23.609272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2e0a0-4f32-4235-862a-7dc6cb1a0fa1 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:23.609779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2e0a0-4f32-4235-862a-7dc6cb1a0fa1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:23.610239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2e0a0-4f32-4235-862a-7dc6cb1a0fa1 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:23.612222 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1862/3692] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 21:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 21:04:23.620654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db5dcc-6a5d-46b6-8e34-be696c4d852c service nova] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 21:04:23.636298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db5dcc-6a5d-46b6-8e34-be696c4d852c service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:23.647575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db5dcc-6a5d-46b6-8e34-be696c4d852c service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:23.651917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f337d4-59c4-4121-9a18-a3647c049331 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f231eaeb554115b5499d4e27a00f79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f79ff98437a4243817f8f931103a27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:23.652547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f337d4-59c4-4121-9a18-a3647c049331 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:23.652968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f337d4-59c4-4121-9a18-a3647c049331 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:23.653281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f337d4-59c4-4121-9a18-a3647c049331 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] PATH_INFO: `/v3/projects/0f79ff98437a4243817f8f931103a27e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:23.654593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f337d4-59c4-4121-9a18-a3647c049331 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: Authorizing `identity:get_project(project_id=0f79ff98437a4243817f8f931103a27e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:23.656391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f337d4-59c4-4121-9a18-a3647c049331 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:23.658806 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1831/3693] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 21:04:23 2022] GET /identity/v3/projects/0f79ff98437a4243817f8f931103a27e => generated 363 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:04:23.685595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2e0a0-4f32-4235-862a-7dc6cb1a0fa1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:23.687346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5da2e0a0-4f32-4235-862a-7dc6cb1a0fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:23.704305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01ece4-703b-4f97-a52d-99f8d6c00b6b None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:23.704900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01ece4-703b-4f97-a52d-99f8d6c00b6b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:23.705624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01ece4-703b-4f97-a52d-99f8d6c00b6b None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:23.708901 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1832/3694] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 21:04:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 21:04:23.734514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01ece4-703b-4f97-a52d-99f8d6c00b6b None None] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 21:04:23.736332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6f01ece4-703b-4f97-a52d-99f8d6c00b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:23.784694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01ece4-703b-4f97-a52d-99f8d6c00b6b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:23.816365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01ece4-703b-4f97-a52d-99f8d6c00b6b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:23.831874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946216e6-0724-466d-b85e-d2b4e32b2e75 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f231eaeb554115b5499d4e27a00f79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f79ff98437a4243817f8f931103a27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:23.833951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946216e6-0724-466d-b85e-d2b4e32b2e75 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:23.835525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946216e6-0724-466d-b85e-d2b4e32b2e75 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:23.836072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946216e6-0724-466d-b85e-d2b4e32b2e75 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] PATH_INFO: `/v3/projects/0f79ff98437a4243817f8f931103a27e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:23.839632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946216e6-0724-466d-b85e-d2b4e32b2e75 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: Authorizing `identity:get_project(project_id=0f79ff98437a4243817f8f931103a27e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:23.845851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946216e6-0724-466d-b85e-d2b4e32b2e75 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:23.851614 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1833/3695] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 21:04:23 2022] GET /identity/v3/projects/0f79ff98437a4243817f8f931103a27e => generated 363 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:04:23.900078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2e0a0-4f32-4235-862a-7dc6cb1a0fa1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:23.913978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c487a31-e57e-44a1-a9f1-70a923b20d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:23.914642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487a31-e57e-44a1-a9f1-70a923b20d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:23.916338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487a31-e57e-44a1-a9f1-70a923b20d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:23.916634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487a31-e57e-44a1-a9f1-70a923b20d88 admin admin] PATH_INFO: `/v3/projects/4735bf74f33a4739800d766c82d973d4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:23.919957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c487a31-e57e-44a1-a9f1-70a923b20d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4735bf74f33a4739800d766c82d973d4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:23.931195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c487a31-e57e-44a1-a9f1-70a923b20d88 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:23.970346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946216e6-0724-466d-b85e-d2b4e32b2e75 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:23.973206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-946216e6-0724-466d-b85e-d2b4e32b2e75 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:24.020897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946216e6-0724-466d-b85e-d2b4e32b2e75 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:24.032425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce47f11-a662-4842-947a-845c809412fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:24.034871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce47f11-a662-4842-947a-845c809412fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:24.035832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce47f11-a662-4842-947a-845c809412fa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:24.036222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce47f11-a662-4842-947a-845c809412fa admin admin] PATH_INFO: `/v3/users/9f2395fe934d458faa80e28587458bd2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:24.040238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce47f11-a662-4842-947a-845c809412fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2395fe934d458faa80e28587458bd2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:24.046028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce47f11-a662-4842-947a-845c809412fa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:24.078807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3c487a31-e57e-44a1-a9f1-70a923b20d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4735bf74f33a4739800d766c82d973d4', 'request_id': 'req-3c487a31-e57e-44a1-a9f1-70a923b20d88'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:24.093693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3c487a31-e57e-44a1-a9f1-70a923b20d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4735bf74f33a4739800d766c82d973d4', 'request_id': 'req-3c487a31-e57e-44a1-a9f1-70a923b20d88'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:24.104999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3c487a31-e57e-44a1-a9f1-70a923b20d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4735bf74f33a4739800d766c82d973d4', 'request_id': 'req-3c487a31-e57e-44a1-a9f1-70a923b20d88'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:24.128654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3c487a31-e57e-44a1-a9f1-70a923b20d88 admin admin] The token cache is being invalidate because project 4735bf74f33a4739800d766c82d973d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:04:24.129260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3c487a31-e57e-44a1-a9f1-70a923b20d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:24.130310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3c487a31-e57e-44a1-a9f1-70a923b20d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:24.132568 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1863/3696] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:04:23 2022] DELETE /identity/v3/projects/4735bf74f33a4739800d766c82d973d4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:24.139180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838fa93-20eb-4c8c-a914-f9a9aeae7f90 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:24.139598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838fa93-20eb-4c8c-a914-f9a9aeae7f90 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:24.139959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838fa93-20eb-4c8c-a914-f9a9aeae7f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:24.142788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7ce47f11-a662-4842-947a-845c809412fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2395fe934d458faa80e28587458bd2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:24.161905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7ce47f11-a662-4842-947a-845c809412fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2395fe934d458faa80e28587458bd2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:24.165933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7ce47f11-a662-4842-947a-845c809412fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2395fe934d458faa80e28587458bd2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:24.166632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7ce47f11-a662-4842-947a-845c809412fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2395fe934d458faa80e28587458bd2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:24.198585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7ce47f11-a662-4842-947a-845c809412fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2395fe934d458faa80e28587458bd2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:24.209866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8838fa93-20eb-4c8c-a914-f9a9aeae7f90 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:24.211724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8838fa93-20eb-4c8c-a914-f9a9aeae7f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:24.236894 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1834/3697] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:04:23 2022] DELETE /identity/v3/users/9f2395fe934d458faa80e28587458bd2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:04:24.238422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2ded3-9757-4f1c-ad7c-dd9097474df6 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:24.238718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2ded3-9757-4f1c-ad7c-dd9097474df6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:24.239004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2ded3-9757-4f1c-ad7c-dd9097474df6 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:24.240275 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1835/3698] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 21:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 21:04:24.249860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:24.258183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2ded3-9757-4f1c-ad7c-dd9097474df6 None None] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 21:04:24.268498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e1a2ded3-9757-4f1c-ad7c-dd9097474df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:24.326380 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1864/3699] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:04:24.335206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fab3c-c808-40cb-b8f2-4b43c7cd7cb1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:24.335492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fab3c-c808-40cb-b8f2-4b43c7cd7cb1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:24.335771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fab3c-c808-40cb-b8f2-4b43c7cd7cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:24.369589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2a9fab3c-c808-40cb-b8f2-4b43c7cd7cb1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:24.371344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2a9fab3c-c808-40cb-b8f2-4b43c7cd7cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:24.468135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2ded3-9757-4f1c-ad7c-dd9097474df6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:24.469750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e1a2ded3-9757-4f1c-ad7c-dd9097474df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:24.502337 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1865/3700] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:04:24.505081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fab3c-c808-40cb-b8f2-4b43c7cd7cb1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:24.523301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fab3c-c808-40cb-b8f2-4b43c7cd7cb1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:24.532914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a785c-05e2-4cc0-b076-8ec7ca0dfb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:24.537357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a785c-05e2-4cc0-b076-8ec7ca0dfb1f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:24.537643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a785c-05e2-4cc0-b076-8ec7ca0dfb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:24.538342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a785c-05e2-4cc0-b076-8ec7ca0dfb1f admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:24.540779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a785c-05e2-4cc0-b076-8ec7ca0dfb1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:04:24.541503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a785c-05e2-4cc0-b076-8ec7ca0dfb1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:24.544511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a785c-05e2-4cc0-b076-8ec7ca0dfb1f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:24.550602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:24.579698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2ded3-9757-4f1c-ad7c-dd9097474df6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:24.582808 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1866/3701] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:04:24.586275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c10410-439f-4168-9ab5-e9fe528d69bc tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f231eaeb554115b5499d4e27a00f79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f79ff98437a4243817f8f931103a27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:24.587537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10410-439f-4168-9ab5-e9fe528d69bc tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:24.587537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10410-439f-4168-9ab5-e9fe528d69bc tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:24.587537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10410-439f-4168-9ab5-e9fe528d69bc tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] PATH_INFO: `/v3/projects/0f79ff98437a4243817f8f931103a27e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:24.591122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c10410-439f-4168-9ab5-e9fe528d69bc tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: Authorizing `identity:get_project(project_id=0f79ff98437a4243817f8f931103a27e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:24.591908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a785c-05e2-4cc0-b076-8ec7ca0dfb1f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:24.592979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c10410-439f-4168-9ab5-e9fe528d69bc tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:24.594951 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1836/3702] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 21:04:24 2022] GET /identity/v3/projects/0f79ff98437a4243817f8f931103a27e => generated 363 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:04:24.600777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c10410-439f-4168-9ab5-e9fe528d69bc tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:24.605173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b8c10410-439f-4168-9ab5-e9fe528d69bc tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:24.634414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a785c-05e2-4cc0-b076-8ec7ca0dfb1f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:24.637006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c10410-439f-4168-9ab5-e9fe528d69bc tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:24.645595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518f13d-6c96-49e5-976e-71fe165b320a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:24.647338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518f13d-6c96-49e5-976e-71fe165b320a service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:24.647628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518f13d-6c96-49e5-976e-71fe165b320a service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:24.648406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518f13d-6c96-49e5-976e-71fe165b320a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:24.651249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eee8ee-9f10-4b91-b3af-c47a8a7d8263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:24.652263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eee8ee-9f10-4b91-b3af-c47a8a7d8263 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:24.652550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eee8ee-9f10-4b91-b3af-c47a8a7d8263 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:24.652824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eee8ee-9f10-4b91-b3af-c47a8a7d8263 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:24.653503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eee8ee-9f10-4b91-b3af-c47a8a7d8263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:24.654595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e518f13d-6c96-49e5-976e-71fe165b320a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:24.658605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eee8ee-9f10-4b91-b3af-c47a8a7d8263 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:24.714641 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1867/3703] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:04:24 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:24.716079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867d884-5912-436c-9d60-d998783ec215 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:24.716374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867d884-5912-436c-9d60-d998783ec215 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:24.716668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867d884-5912-436c-9d60-d998783ec215 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:24.720169 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1868/3704] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 21:04:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 21:04:24.722015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867d884-5912-436c-9d60-d998783ec215 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:24.774467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518f13d-6c96-49e5-976e-71fe165b320a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:24.777002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518f13d-6c96-49e5-976e-71fe165b320a service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:24.810701 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1837/3705] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:24.811571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518f13d-6c96-49e5-976e-71fe165b320a service nova] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 21:04:24.835702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518f13d-6c96-49e5-976e-71fe165b320a service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:24.849490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518f13d-6c96-49e5-976e-71fe165b320a service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:24.849950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867d884-5912-436c-9d60-d998783ec215 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:24.863564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2857d1e-18b1-4aa5-b4db-9acac04a4661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:24.864955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2857d1e-18b1-4aa5-b4db-9acac04a4661 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:24.866369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2857d1e-18b1-4aa5-b4db-9acac04a4661 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:24.868113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2857d1e-18b1-4aa5-b4db-9acac04a4661 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:24.868113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2857d1e-18b1-4aa5-b4db-9acac04a4661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:24.871651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2857d1e-18b1-4aa5-b4db-9acac04a4661 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:24.935455 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1869/3706] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:04:24 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:24.937493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2857d1e-18b1-4aa5-b4db-9acac04a4661 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:24.939655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f2857d1e-18b1-4aa5-b4db-9acac04a4661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:24.969517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2857d1e-18b1-4aa5-b4db-9acac04a4661 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:24.975273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e3460-3d1b-4603-9d0b-861c4e435e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:24.976880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e3460-3d1b-4603-9d0b-861c4e435e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:24.977444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e3460-3d1b-4603-9d0b-861c4e435e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:24.977967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e3460-3d1b-4603-9d0b-861c4e435e23 admin admin] PATH_INFO: `/v3/projects/8f455695c0214bfab0f412aa34417e34` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:24.979830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e3460-3d1b-4603-9d0b-861c4e435e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f455695c0214bfab0f412aa34417e34)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:24.982756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e3460-3d1b-4603-9d0b-861c4e435e23 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:25.005568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9b2e5-4081-44c3-9d59-5faf5b3c3eee tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f231eaeb554115b5499d4e27a00f79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f79ff98437a4243817f8f931103a27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:25.006322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:25.008790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b2e5-4081-44c3-9d59-5faf5b3c3eee tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:25.008790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b2e5-4081-44c3-9d59-5faf5b3c3eee tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:25.009028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b2e5-4081-44c3-9d59-5faf5b3c3eee tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] PATH_INFO: `/v3/projects/0f79ff98437a4243817f8f931103a27e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:25.012370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9b2e5-4081-44c3-9d59-5faf5b3c3eee tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: Authorizing `identity:get_project(project_id=0f79ff98437a4243817f8f931103a27e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:25.014454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9b2e5-4081-44c3-9d59-5faf5b3c3eee tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:25.035193 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1838/3707] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 21:04:24 2022] GET /identity/v3/projects/0f79ff98437a4243817f8f931103a27e => generated 363 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:04:25.038770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9b2e5-4081-44c3-9d59-5faf5b3c3eee tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:25.066726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9b2e5-4081-44c3-9d59-5faf5b3c3eee tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:25.088153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-053e3460-3d1b-4603-9d0b-861c4e435e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f455695c0214bfab0f412aa34417e34', 'request_id': 'req-053e3460-3d1b-4603-9d0b-861c4e435e23'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:25.106851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-053e3460-3d1b-4603-9d0b-861c4e435e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f455695c0214bfab0f412aa34417e34', 'request_id': 'req-053e3460-3d1b-4603-9d0b-861c4e435e23'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:25.136128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-053e3460-3d1b-4603-9d0b-861c4e435e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f455695c0214bfab0f412aa34417e34', 'request_id': 'req-053e3460-3d1b-4603-9d0b-861c4e435e23'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:25.153079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-053e3460-3d1b-4603-9d0b-861c4e435e23 admin admin] The token cache is being invalidate because project 8f455695c0214bfab0f412aa34417e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:04:25.153712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-053e3460-3d1b-4603-9d0b-861c4e435e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:25.155594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-053e3460-3d1b-4603-9d0b-861c4e435e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:25.158242 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1870/3708] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:04:24 2022] DELETE /identity/v3/projects/8f455695c0214bfab0f412aa34417e34 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:25.160520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2f141-23ee-4eb4-b8ff-f2e6391af255 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:25.161023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2f141-23ee-4eb4-b8ff-f2e6391af255 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:25.161672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2f141-23ee-4eb4-b8ff-f2e6391af255 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:25.173118 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1871/3709] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 21:04:25 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 21:04:25.175009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da636a6-c973-4935-a211-18b8dc3bc670 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:25.175553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da636a6-c973-4935-a211-18b8dc3bc670 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:25.176323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da636a6-c973-4935-a211-18b8dc3bc670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:25.202773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6becc13-d3c1-43af-90b7-28e5e57a9e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:25.203863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5da636a6-c973-4935-a211-18b8dc3bc670 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:25.204622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6becc13-d3c1-43af-90b7-28e5e57a9e01 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:25.204970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6becc13-d3c1-43af-90b7-28e5e57a9e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:25.205338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6becc13-d3c1-43af-90b7-28e5e57a9e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:25.206607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6becc13-d3c1-43af-90b7-28e5e57a9e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:25.207448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5da636a6-c973-4935-a211-18b8dc3bc670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:25.208672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6becc13-d3c1-43af-90b7-28e5e57a9e01 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:25.219931 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1872/3710] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:25.221180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da636a6-c973-4935-a211-18b8dc3bc670 None None] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 21:04:25.223320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5da636a6-c973-4935-a211-18b8dc3bc670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:25.227259 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1839/3711] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:25.228221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6becc13-d3c1-43af-90b7-28e5e57a9e01 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:25.230083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f6becc13-d3c1-43af-90b7-28e5e57a9e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:25.246566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6becc13-d3c1-43af-90b7-28e5e57a9e01 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:25.252559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013ccaf-927a-4783-a8cd-a25ab57dcced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:25.253559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013ccaf-927a-4783-a8cd-a25ab57dcced admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:25.253908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013ccaf-927a-4783-a8cd-a25ab57dcced admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:25.254190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013ccaf-927a-4783-a8cd-a25ab57dcced admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:25.254926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013ccaf-927a-4783-a8cd-a25ab57dcced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:25.256622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013ccaf-927a-4783-a8cd-a25ab57dcced admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:25.271590 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1840/3712] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:25.278740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf14d3-5d95-4bea-84c7-214f462c645f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:25.279785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf14d3-5d95-4bea-84c7-214f462c645f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:25.280260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf14d3-5d95-4bea-84c7-214f462c645f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:25.308592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cccf14d3-5d95-4bea-84c7-214f462c645f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:25.317054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cccf14d3-5d95-4bea-84c7-214f462c645f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:25.329221 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1841/3713] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:25.330336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf14d3-5d95-4bea-84c7-214f462c645f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:25.349707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf14d3-5d95-4bea-84c7-214f462c645f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:25.354458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da636a6-c973-4935-a211-18b8dc3bc670 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:25.356450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5da636a6-c973-4935-a211-18b8dc3bc670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:25.359359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46e96b-a066-4cd7-8f48-9a4bca33dd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:25.360478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46e96b-a066-4cd7-8f48-9a4bca33dd4c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:25.360965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46e96b-a066-4cd7-8f48-9a4bca33dd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:25.361476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46e96b-a066-4cd7-8f48-9a4bca33dd4c admin admin] PATH_INFO: `/v3/projects/22f2d56477794f8ab38b8e3535b3e8dc/users/fc2bdd169daf4a1db830b1fa7f94f0b2/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:25.379385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:25.383983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46e96b-a066-4cd7-8f48-9a4bca33dd4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f2d56477794f8ab38b8e3535b3e8dc, user_id=fc2bdd169daf4a1db830b1fa7f94f0b2, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:25.387881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46e96b-a066-4cd7-8f48-9a4bca33dd4c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:25.431962 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1842/3714] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:04:25 2022] PUT /identity/v3/projects/22f2d56477794f8ab38b8e3535b3e8dc/users/fc2bdd169daf4a1db830b1fa7f94f0b2/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:25.433484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46e96b-a066-4cd7-8f48-9a4bca33dd4c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:25.490867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da636a6-c973-4935-a211-18b8dc3bc670 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:25.585837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:25.604102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46e96b-a066-4cd7-8f48-9a4bca33dd4c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:25.620279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e3e23-bcb2-4df7-aa13-5cccb88ad731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:25.621068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e3e23-bcb2-4df7-aa13-5cccb88ad731 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:25.621617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e3e23-bcb2-4df7-aa13-5cccb88ad731 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:25.621731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e3e23-bcb2-4df7-aa13-5cccb88ad731 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:25.622323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e3e23-bcb2-4df7-aa13-5cccb88ad731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:04:25.622631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e3e23-bcb2-4df7-aa13-5cccb88ad731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:25.624286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e3e23-bcb2-4df7-aa13-5cccb88ad731 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:25.649223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc302cf9-f18b-4156-b449-c5e5d91e1c59 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f231eaeb554115b5499d4e27a00f79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f79ff98437a4243817f8f931103a27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:25.650024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc302cf9-f18b-4156-b449-c5e5d91e1c59 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:25.650320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc302cf9-f18b-4156-b449-c5e5d91e1c59 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:25.650595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc302cf9-f18b-4156-b449-c5e5d91e1c59 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] PATH_INFO: `/v3/projects/0f79ff98437a4243817f8f931103a27e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:25.661761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc302cf9-f18b-4156-b449-c5e5d91e1c59 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: Authorizing `identity:get_project(project_id=0f79ff98437a4243817f8f931103a27e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:25.661966 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1843/3715] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:04:25.665405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a2338-a98b-4c59-a310-ab7ff79cefb1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:25.665694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a2338-a98b-4c59-a310-ab7ff79cefb1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:25.665979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a2338-a98b-4c59-a310-ab7ff79cefb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:25.668126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc302cf9-f18b-4156-b449-c5e5d91e1c59 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:25.676287 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1873/3716] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 21:04:25 2022] GET /identity/v3/projects/0f79ff98437a4243817f8f931103a27e => generated 363 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:04:25.677214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc302cf9-f18b-4156-b449-c5e5d91e1c59 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:25.702378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc302cf9-f18b-4156-b449-c5e5d91e1c59 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:25.709114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee404b46-62f1-48fb-8868-74f24f8f390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:25.709785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee404b46-62f1-48fb-8868-74f24f8f390f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:25.710116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee404b46-62f1-48fb-8868-74f24f8f390f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:25.712995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee404b46-62f1-48fb-8868-74f24f8f390f admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:25.713884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee404b46-62f1-48fb-8868-74f24f8f390f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:25.715893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee404b46-62f1-48fb-8868-74f24f8f390f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:25.716716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9f5a2338-a98b-4c59-a310-ab7ff79cefb1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:25.718569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9f5a2338-a98b-4c59-a310-ab7ff79cefb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:25.752990 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1844/3717] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:25.752990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a2338-a98b-4c59-a310-ab7ff79cefb1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:25.752990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9f5a2338-a98b-4c59-a310-ab7ff79cefb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:25.777758 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1874/3718] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:04:25 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:25.783343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a2338-a98b-4c59-a310-ab7ff79cefb1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:25.785865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee404b46-62f1-48fb-8868-74f24f8f390f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:25.930397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:25.931213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:25.931498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:25.931774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] PATH_INFO: `/v3/users/68f231eaeb554115b5499d4e27a00f79` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:25.936607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f231eaeb554115b5499d4e27a00f79)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:25.939194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:25.950901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee404b46-62f1-48fb-8868-74f24f8f390f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:25.960859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48074a-fa78-4a82-9fa5-bb88ff09a03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:25.962246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48074a-fa78-4a82-9fa5-bb88ff09a03f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:25.962246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48074a-fa78-4a82-9fa5-bb88ff09a03f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:25.962831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48074a-fa78-4a82-9fa5-bb88ff09a03f admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:25.963887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48074a-fa78-4a82-9fa5-bb88ff09a03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:25.969048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48074a-fa78-4a82-9fa5-bb88ff09a03f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:26.021601 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1875/3719] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:04:25 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:26.023104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48074a-fa78-4a82-9fa5-bb88ff09a03f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:26.027462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1c48074a-fa78-4a82-9fa5-bb88ff09a03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:26.050977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f231eaeb554115b5499d4e27a00f79'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:26.081076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f231eaeb554115b5499d4e27a00f79'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:26.082513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f231eaeb554115b5499d4e27a00f79'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:26.083454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f231eaeb554115b5499d4e27a00f79'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:26.116998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f231eaeb554115b5499d4e27a00f79'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:26.137641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:26.148053 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1845/3720] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:04:25 2022] DELETE /identity/v3/users/68f231eaeb554115b5499d4e27a00f79 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:26.148974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:26.152582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:26.166908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48074a-fa78-4a82-9fa5-bb88ff09a03f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:26.284440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746722eb-2423-450c-ab46-045d2d10208c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:26.285100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746722eb-2423-450c-ab46-045d2d10208c service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:26.288737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af936fee-f9f0-46ea-909f-03e2f9021c5a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:26.289290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746722eb-2423-450c-ab46-045d2d10208c service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:26.289290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746722eb-2423-450c-ab46-045d2d10208c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:26.297078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99143569-3b18-4703-bddd-1b59342d4e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:26.298398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143569-3b18-4703-bddd-1b59342d4e81 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:26.298800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-746722eb-2423-450c-ab46-045d2d10208c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:26.299247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143569-3b18-4703-bddd-1b59342d4e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:26.301493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143569-3b18-4703-bddd-1b59342d4e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:26.302495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99143569-3b18-4703-bddd-1b59342d4e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:26.305750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99143569-3b18-4703-bddd-1b59342d4e81 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:26.323821 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1846/3721] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:26.325180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb00ab7-798c-491e-8228-ee0f7d690249 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:26.326178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb00ab7-798c-491e-8228-ee0f7d690249 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:26.327220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb00ab7-798c-491e-8228-ee0f7d690249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:26.342739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746722eb-2423-450c-ab46-045d2d10208c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:26.344409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746722eb-2423-450c-ab46-045d2d10208c service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:26.365507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-aeb00ab7-798c-491e-8228-ee0f7d690249 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:26.366896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-aeb00ab7-798c-491e-8228-ee0f7d690249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:26.369889 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1876/3722] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:26.370907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746722eb-2423-450c-ab46-045d2d10208c service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:26.391449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746722eb-2423-450c-ab46-045d2d10208c service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:26.396003 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1847/3723] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:26.407947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d842c-a4e2-4867-9e21-2697e3d6c2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:26.408624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d842c-a4e2-4867-9e21-2697e3d6c2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:26.409225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d842c-a4e2-4867-9e21-2697e3d6c2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:26.409225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d842c-a4e2-4867-9e21-2697e3d6c2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:26.409857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d842c-a4e2-4867-9e21-2697e3d6c2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:26.411582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d842c-a4e2-4867-9e21-2697e3d6c2c4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:26.414948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:26.434184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb00ab7-798c-491e-8228-ee0f7d690249 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:26.440896 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1877/3724] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:26.448976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d842c-a4e2-4867-9e21-2697e3d6c2c4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:26.450426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb00ab7-798c-491e-8228-ee0f7d690249 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:26.451202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-033d842c-a4e2-4867-9e21-2697e3d6c2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:26.460073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172f576-b943-474c-aae0-8d8c118c976c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:26.461008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172f576-b943-474c-aae0-8d8c118c976c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:26.461317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172f576-b943-474c-aae0-8d8c118c976c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:26.461598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172f576-b943-474c-aae0-8d8c118c976c admin admin] PATH_INFO: `/v3/projects/527bbe10db744ab4bcc8078f2d754d53/users/3245fc05926b49118c0d1028de3f09a4/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:26.483143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d842c-a4e2-4867-9e21-2697e3d6c2c4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:26.497779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5bdaf-587b-4ef7-b54c-b439ad5490f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:26.498408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5bdaf-587b-4ef7-b54c-b439ad5490f1 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:26.498687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5bdaf-587b-4ef7-b54c-b439ad5490f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:26.499014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5bdaf-587b-4ef7-b54c-b439ad5490f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:26.506055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172f576-b943-474c-aae0-8d8c118c976c admin admin] RBAC: Authorizing `identity:create_grant(project_id=527bbe10db744ab4bcc8078f2d754d53, user_id=3245fc05926b49118c0d1028de3f09a4, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:26.514527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172f576-b943-474c-aae0-8d8c118c976c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:26.518768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5bdaf-587b-4ef7-b54c-b439ad5490f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:26.520376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5bdaf-587b-4ef7-b54c-b439ad5490f1 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:26.535268 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1878/3725] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:04:26.558261 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1848/3726] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:04:26 2022] PUT /identity/v3/projects/527bbe10db744ab4bcc8078f2d754d53/users/3245fc05926b49118c0d1028de3f09a4/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:26.568873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18ea8-522b-48fe-bc16-cdf8fe462883 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:26.570252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18ea8-522b-48fe-bc16-cdf8fe462883 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:26.570762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18ea8-522b-48fe-bc16-cdf8fe462883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:26.623431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-afd18ea8-522b-48fe-bc16-cdf8fe462883 None None] MFA Rules not processed for user `3245fc05926b49118c0d1028de3f09a4`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:26.625372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-afd18ea8-522b-48fe-bc16-cdf8fe462883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:26.775624 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1879/3727] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:26.778559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e2040-9904-477c-ac8c-fc41388a07bb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:26.778851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e2040-9904-477c-ac8c-fc41388a07bb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:26.779129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e2040-9904-477c-ac8c-fc41388a07bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:26.810754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-506e2040-9904-477c-ac8c-fc41388a07bb None None] MFA Rules not processed for user `3245fc05926b49118c0d1028de3f09a4`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:26.811992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-506e2040-9904-477c-ac8c-fc41388a07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:26.834800 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1849/3728] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:26.844234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd18ea8-522b-48fe-bc16-cdf8fe462883 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:26.847205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-afd18ea8-522b-48fe-bc16-cdf8fe462883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:27.151307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd18ea8-522b-48fe-bc16-cdf8fe462883 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:27.163572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e1fbc-65a1-454d-8436-74031d758c77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:27.165655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1fbc-65a1-454d-8436-74031d758c77 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:27.165944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1fbc-65a1-454d-8436-74031d758c77 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:27.167234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1fbc-65a1-454d-8436-74031d758c77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:27.188222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e1fbc-65a1-454d-8436-74031d758c77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:27.193093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e1fbc-65a1-454d-8436-74031d758c77 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:27.256520 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1880/3729] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:28.568873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e2040-9904-477c-ac8c-fc41388a07bb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:28.570617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-506e2040-9904-477c-ac8c-fc41388a07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:28.613744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4d0a9-e1bf-49f0-b3be-9e4b2846a831 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:28.614941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4d0a9-e1bf-49f0-b3be-9e4b2846a831 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:28.615439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4d0a9-e1bf-49f0-b3be-9e4b2846a831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:28.656447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-16d4d0a9-e1bf-49f0-b3be-9e4b2846a831 None None] MFA Rules not processed for user `3245fc05926b49118c0d1028de3f09a4`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:28.659449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-16d4d0a9-e1bf-49f0-b3be-9e4b2846a831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:28.673317 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1881/3730] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:28.801996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e2040-9904-477c-ac8c-fc41388a07bb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:28.810674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33099fb8-87c5-440f-8eb9-f7a05fa37364 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:28.811752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33099fb8-87c5-440f-8eb9-f7a05fa37364 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:28.812186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33099fb8-87c5-440f-8eb9-f7a05fa37364 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:28.812701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33099fb8-87c5-440f-8eb9-f7a05fa37364 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:28.815958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-33099fb8-87c5-440f-8eb9-f7a05fa37364 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:28.829025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33099fb8-87c5-440f-8eb9-f7a05fa37364 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:28.831002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33099fb8-87c5-440f-8eb9-f7a05fa37364 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:28.846178 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1850/3731] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:28.897948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4d0a9-e1bf-49f0-b3be-9e4b2846a831 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:28.900145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-16d4d0a9-e1bf-49f0-b3be-9e4b2846a831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:28.970795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33099fb8-87c5-440f-8eb9-f7a05fa37364 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:28.973132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-33099fb8-87c5-440f-8eb9-f7a05fa37364 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:29.001162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33099fb8-87c5-440f-8eb9-f7a05fa37364 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:29.025488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fd443-3cc8-49e7-97ef-70c928a84f05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:29.026267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fd443-3cc8-49e7-97ef-70c928a84f05 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:29.027292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fd443-3cc8-49e7-97ef-70c928a84f05 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:29.050408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fd443-3cc8-49e7-97ef-70c928a84f05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:29.062863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f70fd443-3cc8-49e7-97ef-70c928a84f05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:29.125238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fd443-3cc8-49e7-97ef-70c928a84f05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:29.134068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fd443-3cc8-49e7-97ef-70c928a84f05 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:29.178309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:29.191755 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1851/3732] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:04:29.218624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4d0a9-e1bf-49f0-b3be-9e4b2846a831 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:29.238811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f0a2a-503a-4bae-baa6-1f10099365b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:29.239580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f0a2a-503a-4bae-baa6-1f10099365b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:29.239977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f0a2a-503a-4bae-baa6-1f10099365b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:29.240349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f0a2a-503a-4bae-baa6-1f10099365b2 admin admin] PATH_INFO: `/v3/projects/0f79ff98437a4243817f8f931103a27e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:29.241868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f0a2a-503a-4bae-baa6-1f10099365b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f79ff98437a4243817f8f931103a27e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:29.244421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f0a2a-503a-4bae-baa6-1f10099365b2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:29.387609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-207f0a2a-503a-4bae-baa6-1f10099365b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f79ff98437a4243817f8f931103a27e', 'request_id': 'req-207f0a2a-503a-4bae-baa6-1f10099365b2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:29.398165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-207f0a2a-503a-4bae-baa6-1f10099365b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f79ff98437a4243817f8f931103a27e', 'request_id': 'req-207f0a2a-503a-4bae-baa6-1f10099365b2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:29.412486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-207f0a2a-503a-4bae-baa6-1f10099365b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f79ff98437a4243817f8f931103a27e', 'request_id': 'req-207f0a2a-503a-4bae-baa6-1f10099365b2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:29.459384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-207f0a2a-503a-4bae-baa6-1f10099365b2 admin admin] The token cache is being invalidate because project 0f79ff98437a4243817f8f931103a27e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:04:29.459681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-207f0a2a-503a-4bae-baa6-1f10099365b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:29.460488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-207f0a2a-503a-4bae-baa6-1f10099365b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:29.467915 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1882/3733] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:04:28 2022] DELETE /identity/v3/projects/0f79ff98437a4243817f8f931103a27e => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:29.469294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c8a03-eb28-4917-a71a-b31c18e6b474 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:29.469803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c8a03-eb28-4917-a71a-b31c18e6b474 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:29.470312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c8a03-eb28-4917-a71a-b31c18e6b474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:29.525774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d06c8a03-eb28-4917-a71a-b31c18e6b474 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:29.529242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d06c8a03-eb28-4917-a71a-b31c18e6b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:29.625444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:29.723475 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1852/3734] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:04:29.733019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d0973-121f-44cf-942e-70b64e8a806e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:29.734306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d0973-121f-44cf-942e-70b64e8a806e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:29.734785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d0973-121f-44cf-942e-70b64e8a806e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:29.774560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2f2d0973-121f-44cf-942e-70b64e8a806e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:29.778362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2f2d0973-121f-44cf-942e-70b64e8a806e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:29.804229 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1883/3735] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:29.805504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c8a03-eb28-4917-a71a-b31c18e6b474 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:29.822326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c8a03-eb28-4917-a71a-b31c18e6b474 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:29.842978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea3046-8a91-4449-9f61-16fa4a1e4c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:29.843614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea3046-8a91-4449-9f61-16fa4a1e4c57 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:29.843900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea3046-8a91-4449-9f61-16fa4a1e4c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:29.844171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea3046-8a91-4449-9f61-16fa4a1e4c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:29.844835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea3046-8a91-4449-9f61-16fa4a1e4c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:04:29.845702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea3046-8a91-4449-9f61-16fa4a1e4c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:29.855356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea3046-8a91-4449-9f61-16fa4a1e4c57 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:29.909056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d0973-121f-44cf-942e-70b64e8a806e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:29.909485 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1853/3736] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:04:29.932269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d0973-121f-44cf-942e-70b64e8a806e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:29.965925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd163b-856f-487d-b21f-c6a6c0eef886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:29.970395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd163b-856f-487d-b21f-c6a6c0eef886 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:29.984517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd163b-856f-487d-b21f-c6a6c0eef886 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:29.984830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd163b-856f-487d-b21f-c6a6c0eef886 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:29.996964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd163b-856f-487d-b21f-c6a6c0eef886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:30.008582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd163b-856f-487d-b21f-c6a6c0eef886 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:30.120017 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1884/3737] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:04:29 2022] POST /identity/v3/projects => generated 389 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:04:30.124237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea3046-8a91-4449-9f61-16fa4a1e4c57 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:30.139645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea3046-8a91-4449-9f61-16fa4a1e4c57 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:30.355645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e22d8f-7825-4b30-a099-d69d4850f96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:30.356276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e22d8f-7825-4b30-a099-d69d4850f96d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:30.356561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e22d8f-7825-4b30-a099-d69d4850f96d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:30.362900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e22d8f-7825-4b30-a099-d69d4850f96d admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:30.363545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e22d8f-7825-4b30-a099-d69d4850f96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:30.365572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e22d8f-7825-4b30-a099-d69d4850f96d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:30.431213 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1854/3738] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:04:30 2022] POST /identity/v3/users => generated 295 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:30.432968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd163b-856f-487d-b21f-c6a6c0eef886 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:30.452311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd163b-856f-487d-b21f-c6a6c0eef886 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:30.467197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351642b3-216b-44f6-9d83-064ef41da6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:30.467835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351642b3-216b-44f6-9d83-064ef41da6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:30.468111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351642b3-216b-44f6-9d83-064ef41da6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:30.468383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351642b3-216b-44f6-9d83-064ef41da6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:30.469213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351642b3-216b-44f6-9d83-064ef41da6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:30.473505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351642b3-216b-44f6-9d83-064ef41da6a5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:30.531963 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1885/3739] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:30.534143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e22d8f-7825-4b30-a099-d69d4850f96d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:30.553250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e22d8f-7825-4b30-a099-d69d4850f96d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:30.572203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab629cb-a74a-4500-b54e-2944615b8067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:30.572946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab629cb-a74a-4500-b54e-2944615b8067 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:30.573388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab629cb-a74a-4500-b54e-2944615b8067 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:30.573772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab629cb-a74a-4500-b54e-2944615b8067 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:30.574542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab629cb-a74a-4500-b54e-2944615b8067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:30.578075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab629cb-a74a-4500-b54e-2944615b8067 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:30.616100 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1855/3740] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:30.621265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351642b3-216b-44f6-9d83-064ef41da6a5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:30.640813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351642b3-216b-44f6-9d83-064ef41da6a5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:30.659071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848733f-b74d-4f4b-8907-4646bb20aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:30.661226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848733f-b74d-4f4b-8907-4646bb20aba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:30.662360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848733f-b74d-4f4b-8907-4646bb20aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:30.663852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848733f-b74d-4f4b-8907-4646bb20aba7 admin admin] PATH_INFO: `/v3/projects/665f66e846c24a6db01274679100bdbf/users/21870fe169dc42359d9bdb149d0016d7/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:30.720343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848733f-b74d-4f4b-8907-4646bb20aba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=665f66e846c24a6db01274679100bdbf, user_id=21870fe169dc42359d9bdb149d0016d7, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:30.729902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848733f-b74d-4f4b-8907-4646bb20aba7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:30.777535 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1886/3741] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:04:30 2022] PUT /identity/v3/projects/665f66e846c24a6db01274679100bdbf/users/21870fe169dc42359d9bdb149d0016d7/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:30.782720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ce09d-625a-41d8-b1c0-81fe4043d9e9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:30.783510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ce09d-625a-41d8-b1c0-81fe4043d9e9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:30.783976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ce09d-625a-41d8-b1c0-81fe4043d9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:30.831455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1e8ce09d-625a-41d8-b1c0-81fe4043d9e9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:30.836052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1e8ce09d-625a-41d8-b1c0-81fe4043d9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:30.949489 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1856/3742] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:30.999099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848733f-b74d-4f4b-8907-4646bb20aba7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:31.001498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3848733f-b74d-4f4b-8907-4646bb20aba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:31.125038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848733f-b74d-4f4b-8907-4646bb20aba7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:31.139151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57155610-505d-4e00-a6b7-89b4f63c8cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:31.139151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57155610-505d-4e00-a6b7-89b4f63c8cac service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:31.141339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57155610-505d-4e00-a6b7-89b4f63c8cac service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:31.142968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57155610-505d-4e00-a6b7-89b4f63c8cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:31.169268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57155610-505d-4e00-a6b7-89b4f63c8cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:31.173869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57155610-505d-4e00-a6b7-89b4f63c8cac service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:31.205702 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1887/3743] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:34.880559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bc03-4a2d-47f9-a55f-52e6694c4628 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:34.881018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bc03-4a2d-47f9-a55f-52e6694c4628 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:34.881266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bc03-4a2d-47f9-a55f-52e6694c4628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:34.943045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b903bc03-4a2d-47f9-a55f-52e6694c4628 None None] MFA Rules not processed for user `0c6153d58d264272a375b3169e0874d3`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:34.944308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b903bc03-4a2d-47f9-a55f-52e6694c4628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:35.107976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:35.234610 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1857/3744] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:34 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:35.235218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6855-7162-4986-b7fb-510d0a465a12 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:35.235647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6855-7162-4986-b7fb-510d0a465a12 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:35.235851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6855-7162-4986-b7fb-510d0a465a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:35.272035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bdba6855-7162-4986-b7fb-510d0a465a12 None None] MFA Rules not processed for user `0c6153d58d264272a375b3169e0874d3`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:35.275691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bdba6855-7162-4986-b7fb-510d0a465a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:35.315633 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1888/3745] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:04:35.565940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bc03-4a2d-47f9-a55f-52e6694c4628 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:35.568680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b903bc03-4a2d-47f9-a55f-52e6694c4628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:35.817092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bc03-4a2d-47f9-a55f-52e6694c4628 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:35.844737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f0a80-924e-4aa1-917e-b18ff974f1b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:35.847495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f0a80-924e-4aa1-917e-b18ff974f1b9 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:35.847781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f0a80-924e-4aa1-917e-b18ff974f1b9 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:35.850552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f0a80-924e-4aa1-917e-b18ff974f1b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:35.890906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f0a80-924e-4aa1-917e-b18ff974f1b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:35.900811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f0a80-924e-4aa1-917e-b18ff974f1b9 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:35.932623 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1858/3746] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:35 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:04:39.240374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2f73b-90bd-422b-84a6-b69b941b3489 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:39.243916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2f73b-90bd-422b-84a6-b69b941b3489 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:39.245301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2f73b-90bd-422b-84a6-b69b941b3489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:39.304521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3fa2f73b-90bd-422b-84a6-b69b941b3489 None None] MFA Rules not processed for user `5000948fa98a4b5d96ad27436d3d0edb`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:39.306099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3fa2f73b-90bd-422b-84a6-b69b941b3489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:39.310821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:39.443678 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1889/3747] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:39.456123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966acc96-0b77-4716-86b9-0d0dacf71f6e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:39.457097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966acc96-0b77-4716-86b9-0d0dacf71f6e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:39.457626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966acc96-0b77-4716-86b9-0d0dacf71f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:39.523986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-966acc96-0b77-4716-86b9-0d0dacf71f6e None None] MFA Rules not processed for user `5000948fa98a4b5d96ad27436d3d0edb`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:39.530946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-966acc96-0b77-4716-86b9-0d0dacf71f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:39.540154 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1859/3748] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:40.230940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2f73b-90bd-422b-84a6-b69b941b3489 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:40.233415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3fa2f73b-90bd-422b-84a6-b69b941b3489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:40.269803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2f73b-90bd-422b-84a6-b69b941b3489 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:40.305308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f991b22-dc34-4300-96d8-019ce04d3364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:40.306515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f991b22-dc34-4300-96d8-019ce04d3364 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:40.306795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f991b22-dc34-4300-96d8-019ce04d3364 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:40.307235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f991b22-dc34-4300-96d8-019ce04d3364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:40.333948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f991b22-dc34-4300-96d8-019ce04d3364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:40.338688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f991b22-dc34-4300-96d8-019ce04d3364 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:40.360139 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1890/3749] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:44.766708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb408-6d58-404a-8437-2195134c79b6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:44.768102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb408-6d58-404a-8437-2195134c79b6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:44.768580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb408-6d58-404a-8437-2195134c79b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:44.813802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-839cb408-6d58-404a-8437-2195134c79b6 None None] MFA Rules not processed for user `fc2bdd169daf4a1db830b1fa7f94f0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:44.815823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-839cb408-6d58-404a-8437-2195134c79b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:44.973730 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1860/3750] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:44.974822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f991b22-dc34-4300-96d8-019ce04d3364 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:44.976748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6f991b22-dc34-4300-96d8-019ce04d3364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:45.000661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f991b22-dc34-4300-96d8-019ce04d3364 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:45.006768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12be80-5929-4e08-8432-2d323a3ca89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:45.007655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12be80-5929-4e08-8432-2d323a3ca89e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:45.008187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12be80-5929-4e08-8432-2d323a3ca89e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:45.008615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12be80-5929-4e08-8432-2d323a3ca89e admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:45.009454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12be80-5929-4e08-8432-2d323a3ca89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:45.011543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12be80-5929-4e08-8432-2d323a3ca89e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:45.073178 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1891/3751] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:04:44 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:45.078527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cb408-6d58-404a-8437-2195134c79b6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:45.102781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cb408-6d58-404a-8437-2195134c79b6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:45.183312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:45.220282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4db646-fe56-4969-8e96-3fec83216cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:45.222043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4db646-fe56-4969-8e96-3fec83216cfe admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:45.222328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4db646-fe56-4969-8e96-3fec83216cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:45.222602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4db646-fe56-4969-8e96-3fec83216cfe admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:45.223243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4db646-fe56-4969-8e96-3fec83216cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:45.225173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4db646-fe56-4969-8e96-3fec83216cfe admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:45.266040 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1861/3752] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:04:45 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:45.270704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12be80-5929-4e08-8432-2d323a3ca89e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:45.291660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12be80-5929-4e08-8432-2d323a3ca89e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:45.299530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d12c79-1967-4f74-ad6a-f998325365a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:45.305703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d12c79-1967-4f74-ad6a-f998325365a3 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:45.306331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d12c79-1967-4f74-ad6a-f998325365a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:45.306824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d12c79-1967-4f74-ad6a-f998325365a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:45.307719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d12c79-1967-4f74-ad6a-f998325365a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:45.310948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d12c79-1967-4f74-ad6a-f998325365a3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:45.324920 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1892/3753] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:45.329269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4db646-fe56-4969-8e96-3fec83216cfe admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:45.356982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4db646-fe56-4969-8e96-3fec83216cfe admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:45.369545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73104a27-c4e4-4a02-b5b2-154d884fc4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:45.370334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73104a27-c4e4-4a02-b5b2-154d884fc4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:45.370616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73104a27-c4e4-4a02-b5b2-154d884fc4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:45.370977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73104a27-c4e4-4a02-b5b2-154d884fc4b3 admin admin] PATH_INFO: `/v3/projects/f606041baa8b453e9f7d1fa1cf4ba72d/users/30c940859dc140bc8a8f2bc10a07eaa1/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:45.448347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73104a27-c4e4-4a02-b5b2-154d884fc4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f606041baa8b453e9f7d1fa1cf4ba72d, user_id=30c940859dc140bc8a8f2bc10a07eaa1, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:45.461147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73104a27-c4e4-4a02-b5b2-154d884fc4b3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:45.534947 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1862/3754] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:04:45 2022] PUT /identity/v3/projects/f606041baa8b453e9f7d1fa1cf4ba72d/users/30c940859dc140bc8a8f2bc10a07eaa1/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:45.538415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d12c79-1967-4f74-ad6a-f998325365a3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:45.557837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d12c79-1967-4f74-ad6a-f998325365a3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:45.851823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5d2db-1a5e-4ab1-ae2f-8440d28c3695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:45.852465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5d2db-1a5e-4ab1-ae2f-8440d28c3695 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:45.852748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5d2db-1a5e-4ab1-ae2f-8440d28c3695 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:45.853023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5d2db-1a5e-4ab1-ae2f-8440d28c3695 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:45.853797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5d2db-1a5e-4ab1-ae2f-8440d28c3695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:45.855403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5d2db-1a5e-4ab1-ae2f-8440d28c3695 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:45.900718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73104a27-c4e4-4a02-b5b2-154d884fc4b3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:45.901550 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1893/3755] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:04:45.914805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73104a27-c4e4-4a02-b5b2-154d884fc4b3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:45.923603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d57f54-b43b-4fb0-91a1-f5d06d13b4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:45.926094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d57f54-b43b-4fb0-91a1-f5d06d13b4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:45.927317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d57f54-b43b-4fb0-91a1-f5d06d13b4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:45.927763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d57f54-b43b-4fb0-91a1-f5d06d13b4ad admin admin] PATH_INFO: `/v3/projects/f606041baa8b453e9f7d1fa1cf4ba72d/users/30c940859dc140bc8a8f2bc10a07eaa1/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:45.933141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d57f54-b43b-4fb0-91a1-f5d06d13b4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f606041baa8b453e9f7d1fa1cf4ba72d, user_id=30c940859dc140bc8a8f2bc10a07eaa1, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:45.936340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d57f54-b43b-4fb0-91a1-f5d06d13b4ad admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:45.983850 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1863/3756] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:04:45 2022] PUT /identity/v3/projects/f606041baa8b453e9f7d1fa1cf4ba72d/users/30c940859dc140bc8a8f2bc10a07eaa1/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:04:52.115866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5d2db-1a5e-4ab1-ae2f-8440d28c3695 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:52.242878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:52.279640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5d2db-1a5e-4ab1-ae2f-8440d28c3695 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:52.446062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43c434-e551-4188-9142-3fbc21ac766d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:52.447118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c434-e551-4188-9142-3fbc21ac766d service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:52.447720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c434-e551-4188-9142-3fbc21ac766d service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:52.447969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c434-e551-4188-9142-3fbc21ac766d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:52.449955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0f43c434-e551-4188-9142-3fbc21ac766d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:52.576415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43c434-e551-4188-9142-3fbc21ac766d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:52.578495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43c434-e551-4188-9142-3fbc21ac766d service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:52.602224 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1894/3757] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:53.243396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3350be2-f632-476d-a328-fbc26174ff87 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:53.244268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3350be2-f632-476d-a328-fbc26174ff87 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:53.244715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3350be2-f632-476d-a328-fbc26174ff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:53.313434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f3350be2-f632-476d-a328-fbc26174ff87 None None] MFA Rules not processed for user `21870fe169dc42359d9bdb149d0016d7`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:53.315383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f3350be2-f632-476d-a328-fbc26174ff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:53.440962 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1864/3758] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:53.914204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43c434-e551-4188-9142-3fbc21ac766d service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:53.932364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43c434-e551-4188-9142-3fbc21ac766d service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:53.942124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910699ac-c7ec-45e2-9352-ef9a3b26ebb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:53.943217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910699ac-c7ec-45e2-9352-ef9a3b26ebb1 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:53.943728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910699ac-c7ec-45e2-9352-ef9a3b26ebb1 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:53.944231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910699ac-c7ec-45e2-9352-ef9a3b26ebb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:53.957491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910699ac-c7ec-45e2-9352-ef9a3b26ebb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:53.960099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910699ac-c7ec-45e2-9352-ef9a3b26ebb1 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:53.973649 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1895/3759] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:54.622230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3350be2-f632-476d-a328-fbc26174ff87 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:54.623780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f3350be2-f632-476d-a328-fbc26174ff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:54.776404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3350be2-f632-476d-a328-fbc26174ff87 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:54.794384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:54.795048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:54.795331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:54.795606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] PATH_INFO: `/v3/users/07280ef2c5da4903a62092a44499f455` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:54.802722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07280ef2c5da4903a62092a44499f455)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:54.804863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:54.853696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:54.922347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07280ef2c5da4903a62092a44499f455'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:54.940333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07280ef2c5da4903a62092a44499f455'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:54.945658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07280ef2c5da4903a62092a44499f455'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:54.947471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07280ef2c5da4903a62092a44499f455'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:54.973820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07280ef2c5da4903a62092a44499f455'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:55.011563 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1865/3760] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:04:54 2022] DELETE /identity/v3/users/07280ef2c5da4903a62092a44499f455 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:55.012890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45911c72-c9a9-403e-ab6e-486b950384af None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:55.013419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45911c72-c9a9-403e-ab6e-486b950384af None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:55.013814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45911c72-c9a9-403e-ab6e-486b950384af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:55.057108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-45911c72-c9a9-403e-ab6e-486b950384af None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:55.059709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-45911c72-c9a9-403e-ab6e-486b950384af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:55.178332 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1896/3761] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:04:55.181771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:55.183280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:55.357770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb486e-65b9-475c-b4b5-6b4eb3af4c12 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:55.362825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea943f8f-5cbf-450f-b8e0-836a1fd7b163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:55.363538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea943f8f-5cbf-450f-b8e0-836a1fd7b163 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:55.363894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea943f8f-5cbf-450f-b8e0-836a1fd7b163 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:55.364266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea943f8f-5cbf-450f-b8e0-836a1fd7b163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:55.390744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea943f8f-5cbf-450f-b8e0-836a1fd7b163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:55.396954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea943f8f-5cbf-450f-b8e0-836a1fd7b163 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:55.409477 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1866/3762] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:04:57.608474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45911c72-c9a9-403e-ab6e-486b950384af None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:57.610560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-45911c72-c9a9-403e-ab6e-486b950384af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:57.623835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45911c72-c9a9-403e-ab6e-486b950384af None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:57.631360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:57.632383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:57.633063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:57.633567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96 admin admin] PATH_INFO: `/v3/projects/f92d768a1a654e199e14845aab7d565b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:57.635500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92d768a1a654e199e14845aab7d565b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:57.637635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:57.649382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:57.745327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92d768a1a654e199e14845aab7d565b', 'request_id': 'req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:57.765099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92d768a1a654e199e14845aab7d565b', 'request_id': 'req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:57.774198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92d768a1a654e199e14845aab7d565b', 'request_id': 'req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:57.796001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96 admin admin] The token cache is being invalidate because project f92d768a1a654e199e14845aab7d565b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:04:57.796299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:57.799033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-43e34dd1-2aa6-4d9d-8d61-f0f118de1b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:04:57.800759 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1897/3763] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:04:57 2022] DELETE /identity/v3/projects/f92d768a1a654e199e14845aab7d565b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:57.806343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55672bf3-dc21-4ed5-adf1-84d6b913b62b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:57.807822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55672bf3-dc21-4ed5-adf1-84d6b913b62b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:57.808203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55672bf3-dc21-4ed5-adf1-84d6b913b62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:57.856358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-55672bf3-dc21-4ed5-adf1-84d6b913b62b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:57.860052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-55672bf3-dc21-4ed5-adf1-84d6b913b62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:58.037708 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1867/3764] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:58.045692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073e7a9-59da-48ca-9687-8929782a82d6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:58.046249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073e7a9-59da-48ca-9687-8929782a82d6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:58.046714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073e7a9-59da-48ca-9687-8929782a82d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:58.073309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b073e7a9-59da-48ca-9687-8929782a82d6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:58.074787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b073e7a9-59da-48ca-9687-8929782a82d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:58.104316 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1898/3765] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:04:58.109503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55672bf3-dc21-4ed5-adf1-84d6b913b62b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:58.130670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55672bf3-dc21-4ed5-adf1-84d6b913b62b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:58.136417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e60a1-857a-4106-b16f-a7063028a3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:58.138657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e60a1-857a-4106-b16f-a7063028a3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:58.139429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e60a1-857a-4106-b16f-a7063028a3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:58.139873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e60a1-857a-4106-b16f-a7063028a3b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:58.140752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e60a1-857a-4106-b16f-a7063028a3b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:04:58.141262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e60a1-857a-4106-b16f-a7063028a3b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:58.144666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e60a1-857a-4106-b16f-a7063028a3b5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:58.168804 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1868/3766] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:04:58.173241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073e7a9-59da-48ca-9687-8929782a82d6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:58.191630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073e7a9-59da-48ca-9687-8929782a82d6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:58.205783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5d706-0b16-4081-b6b2-717b24cb0a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:58.206405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5d706-0b16-4081-b6b2-717b24cb0a3e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:58.206752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5d706-0b16-4081-b6b2-717b24cb0a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:58.206956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5d706-0b16-4081-b6b2-717b24cb0a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:58.210095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5d706-0b16-4081-b6b2-717b24cb0a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:58.212415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5d706-0b16-4081-b6b2-717b24cb0a3e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:58.266449 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1899/3767] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:04:58 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:58.271274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e60a1-857a-4106-b16f-a7063028a3b5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:58.285622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e60a1-857a-4106-b16f-a7063028a3b5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:58.357547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:58.453358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5474e2-3ba5-4ba0-8b87-fae0c7faf539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:58.453799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5474e2-3ba5-4ba0-8b87-fae0c7faf539 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:58.456300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5474e2-3ba5-4ba0-8b87-fae0c7faf539 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:58.456596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5474e2-3ba5-4ba0-8b87-fae0c7faf539 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:58.457292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5474e2-3ba5-4ba0-8b87-fae0c7faf539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:58.461597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5474e2-3ba5-4ba0-8b87-fae0c7faf539 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:58.529038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5d706-0b16-4081-b6b2-717b24cb0a3e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:58.534509 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1869/3768] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:04:58 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:04:58.555052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5d706-0b16-4081-b6b2-717b24cb0a3e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:58.574930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7f957-71b9-4213-9cb9-7d3e034ed0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:58.575625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7f957-71b9-4213-9cb9-7d3e034ed0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:58.575846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7f957-71b9-4213-9cb9-7d3e034ed0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:58.576127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7f957-71b9-4213-9cb9-7d3e034ed0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:58.576788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7f957-71b9-4213-9cb9-7d3e034ed0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:58.581734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7f957-71b9-4213-9cb9-7d3e034ed0b5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:58.600198 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1900/3769] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:04:58.603433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5474e2-3ba5-4ba0-8b87-fae0c7faf539 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:58.619376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5474e2-3ba5-4ba0-8b87-fae0c7faf539 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:58.625644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad9057-a55a-48e4-a904-1e6e8fa0203b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:58.627217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad9057-a55a-48e4-a904-1e6e8fa0203b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:58.627736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad9057-a55a-48e4-a904-1e6e8fa0203b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:58.628246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad9057-a55a-48e4-a904-1e6e8fa0203b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:58.629755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad9057-a55a-48e4-a904-1e6e8fa0203b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:58.632269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad9057-a55a-48e4-a904-1e6e8fa0203b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:58.645538 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1870/3770] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:04:58.649698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7f957-71b9-4213-9cb9-7d3e034ed0b5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:58.662587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7f957-71b9-4213-9cb9-7d3e034ed0b5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:58.669636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e8bd9-c059-41f3-b853-748ce4ddb3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:58.671709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8bd9-c059-41f3-b853-748ce4ddb3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:58.672214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8bd9-c059-41f3-b853-748ce4ddb3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:58.673314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8bd9-c059-41f3-b853-748ce4ddb3f7 admin admin] PATH_INFO: `/v3/projects/c68b14967e8249fd886f168d366f241f/users/85abb492492343c58734564a2b26c8f6/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:58.706144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e8bd9-c059-41f3-b853-748ce4ddb3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68b14967e8249fd886f168d366f241f, user_id=85abb492492343c58734564a2b26c8f6, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:58.709012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e8bd9-c059-41f3-b853-748ce4ddb3f7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:58.736279 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1901/3771] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:04:58 2022] PUT /identity/v3/projects/c68b14967e8249fd886f168d366f241f/users/85abb492492343c58734564a2b26c8f6/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:04:58.743548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebc23e-f9a5-4483-bb2a-b1f13c9ff590 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:58.745994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebc23e-f9a5-4483-bb2a-b1f13c9ff590 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:58.746279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebc23e-f9a5-4483-bb2a-b1f13c9ff590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:58.781660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-40ebc23e-f9a5-4483-bb2a-b1f13c9ff590 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:04:58.785671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-40ebc23e-f9a5-4483-bb2a-b1f13c9ff590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:58.935505 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1871/3772] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:04:58.971126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e8bd9-c059-41f3-b853-748ce4ddb3f7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:04:58.972873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d06e8bd9-c059-41f3-b853-748ce4ddb3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:04:59.094634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e8bd9-c059-41f3-b853-748ce4ddb3f7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:04:59.105375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f0eeb-7e5a-4f4d-a65a-9339367f5229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:04:59.107672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f0eeb-7e5a-4f4d-a65a-9339367f5229 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:04:59.107980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f0eeb-7e5a-4f4d-a65a-9339367f5229 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:04:59.110079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f0eeb-7e5a-4f4d-a65a-9339367f5229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:04:59.131580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f0eeb-7e5a-4f4d-a65a-9339367f5229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:04:59.133090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f0eeb-7e5a-4f4d-a65a-9339367f5229 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:04:59.146722 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1902/3773] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:05:01.280946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e5d8c-d6a1-4a61-8aaa-bcf8aba9530d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:01.281550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e5d8c-d6a1-4a61-8aaa-bcf8aba9530d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:01.281550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e5d8c-d6a1-4a61-8aaa-bcf8aba9530d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:01.318358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-896e5d8c-d6a1-4a61-8aaa-bcf8aba9530d None None] MFA Rules not processed for user `21870fe169dc42359d9bdb149d0016d7`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:01.319603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-896e5d8c-d6a1-4a61-8aaa-bcf8aba9530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:01.454028 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1872/3774] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:07.163833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ea86a-bd02-4458-b7b4-9e52ad6286f4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:07.164817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ea86a-bd02-4458-b7b4-9e52ad6286f4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:07.165303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ea86a-bd02-4458-b7b4-9e52ad6286f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:07.208652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f09ea86a-bd02-4458-b7b4-9e52ad6286f4 None None] MFA Rules not processed for user `30c940859dc140bc8a8f2bc10a07eaa1`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:07.210276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f09ea86a-bd02-4458-b7b4-9e52ad6286f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:07.261118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:07.350096 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1903/3775] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:07.373378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e5d8c-d6a1-4a61-8aaa-bcf8aba9530d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:07.375533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-896e5d8c-d6a1-4a61-8aaa-bcf8aba9530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:07.503254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:07.539368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e5d8c-d6a1-4a61-8aaa-bcf8aba9530d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:07.545227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaded01d-c38f-4e62-9f16-a820ab9ad9ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:07.546210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaded01d-c38f-4e62-9f16-a820ab9ad9ab service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:07.546701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaded01d-c38f-4e62-9f16-a820ab9ad9ab service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:07.547200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaded01d-c38f-4e62-9f16-a820ab9ad9ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:07.549877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-aaded01d-c38f-4e62-9f16-a820ab9ad9ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:07.651369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaded01d-c38f-4e62-9f16-a820ab9ad9ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:07.652962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaded01d-c38f-4e62-9f16-a820ab9ad9ab service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:07.667001 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1873/3776] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:05:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:05:11.252892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d83f0-506b-422c-aaa1-3221cb96bc08 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:11.254301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d83f0-506b-422c-aaa1-3221cb96bc08 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:11.254938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d83f0-506b-422c-aaa1-3221cb96bc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:11.358284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-634d83f0-506b-422c-aaa1-3221cb96bc08 None None] MFA Rules not processed for user `0c6153d58d264272a375b3169e0874d3`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:11.381168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-634d83f0-506b-422c-aaa1-3221cb96bc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:11.565479 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1904/3777] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:11 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:14.018649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaded01d-c38f-4e62-9f16-a820ab9ad9ab service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:14.020815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-aaded01d-c38f-4e62-9f16-a820ab9ad9ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:14.087109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaded01d-c38f-4e62-9f16-a820ab9ad9ab service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:14.107639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d939f-c4d1-4e7b-8e25-59a00db4d20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:14.108530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d939f-c4d1-4e7b-8e25-59a00db4d20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:14.108921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d939f-c4d1-4e7b-8e25-59a00db4d20e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:14.110102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d939f-c4d1-4e7b-8e25-59a00db4d20e admin admin] PATH_INFO: `/v3/users/bf2e13f1952a4e5bb23d57dd7fa31875` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:14.115216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d939f-c4d1-4e7b-8e25-59a00db4d20e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2e13f1952a4e5bb23d57dd7fa31875)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:14.121549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d939f-c4d1-4e7b-8e25-59a00db4d20e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:14.253519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a26d939f-c4d1-4e7b-8e25-59a00db4d20e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2e13f1952a4e5bb23d57dd7fa31875'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:14.270868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a26d939f-c4d1-4e7b-8e25-59a00db4d20e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2e13f1952a4e5bb23d57dd7fa31875'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:14.271890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a26d939f-c4d1-4e7b-8e25-59a00db4d20e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2e13f1952a4e5bb23d57dd7fa31875'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:14.272929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a26d939f-c4d1-4e7b-8e25-59a00db4d20e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2e13f1952a4e5bb23d57dd7fa31875'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:14.316951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a26d939f-c4d1-4e7b-8e25-59a00db4d20e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2e13f1952a4e5bb23d57dd7fa31875'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:14.340239 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1874/3778] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:14 2022] DELETE /identity/v3/users/bf2e13f1952a4e5bb23d57dd7fa31875 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:14.629010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5abfdb-b2e5-4389-996d-340c1598d742 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:14.630352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5abfdb-b2e5-4389-996d-340c1598d742 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:14.631767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5abfdb-b2e5-4389-996d-340c1598d742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:14.739423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bc5abfdb-b2e5-4389-996d-340c1598d742 None None] MFA Rules not processed for user `85abb492492343c58734564a2b26c8f6`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:14.748017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bc5abfdb-b2e5-4389-996d-340c1598d742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:14.957217 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1905/3779] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:15.047269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a71e04-2dc7-4767-9c96-0e1baa335290 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:15.048810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a71e04-2dc7-4767-9c96-0e1baa335290 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:15.049295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a71e04-2dc7-4767-9c96-0e1baa335290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:15.058948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5abfdb-b2e5-4389-996d-340c1598d742 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:15.060418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bc5abfdb-b2e5-4389-996d-340c1598d742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:15.105880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e6a71e04-2dc7-4767-9c96-0e1baa335290 None None] MFA Rules not processed for user `5000948fa98a4b5d96ad27436d3d0edb`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:15.108180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e6a71e04-2dc7-4767-9c96-0e1baa335290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:15.211422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:15.245314 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1875/3780] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:15.246319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a71e04-2dc7-4767-9c96-0e1baa335290 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:15.247934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e6a71e04-2dc7-4767-9c96-0e1baa335290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:15.255620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:15.260627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5abfdb-b2e5-4389-996d-340c1598d742 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:15.270187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ac22f-17aa-4f5e-bc22-e1b0a21ff4a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:15.272054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ac22f-17aa-4f5e-bc22-e1b0a21ff4a2 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:15.272432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ac22f-17aa-4f5e-bc22-e1b0a21ff4a2 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:15.272801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ac22f-17aa-4f5e-bc22-e1b0a21ff4a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:15.290561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ac22f-17aa-4f5e-bc22-e1b0a21ff4a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:15.294441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ac22f-17aa-4f5e-bc22-e1b0a21ff4a2 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:15.309917 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1906/3781] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:05:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:05:15.364052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a71e04-2dc7-4767-9c96-0e1baa335290 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:15.376376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:15.378277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:15.378654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:15.381286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c admin admin] PATH_INFO: `/v3/projects/75b2a56286924e2d953bebe717ce591b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:15.383559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b2a56286924e2d953bebe717ce591b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:15.390903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:15.513225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b2a56286924e2d953bebe717ce591b', 'request_id': 'req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:15.535821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b2a56286924e2d953bebe717ce591b', 'request_id': 'req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:15.551313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b2a56286924e2d953bebe717ce591b', 'request_id': 'req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:15.576635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c admin admin] The token cache is being invalidate because project 75b2a56286924e2d953bebe717ce591b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:15.576961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:15.580909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ce3d649-ec9e-4e56-86eb-b11ac59c466c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:15.590742 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1876/3782] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:05:15 2022] DELETE /identity/v3/projects/75b2a56286924e2d953bebe717ce591b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:15.592918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d83947-b2bc-4d73-8c53-73106ecdbd8b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:15.593229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d83947-b2bc-4d73-8c53-73106ecdbd8b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:15.593514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d83947-b2bc-4d73-8c53-73106ecdbd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:15.618824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-92d83947-b2bc-4d73-8c53-73106ecdbd8b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:15.620452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-92d83947-b2bc-4d73-8c53-73106ecdbd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:15.726396 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1907/3783] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:15.727398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f929fb-50ca-4fa9-a1c0-3765efba5898 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:15.727690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f929fb-50ca-4fa9-a1c0-3765efba5898 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:15.728412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f929fb-50ca-4fa9-a1c0-3765efba5898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:15.774767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-00f929fb-50ca-4fa9-a1c0-3765efba5898 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:15.777027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-00f929fb-50ca-4fa9-a1c0-3765efba5898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:15.791515 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1877/3784] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:15.797095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d83947-b2bc-4d73-8c53-73106ecdbd8b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:15.811243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d83947-b2bc-4d73-8c53-73106ecdbd8b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:15.818944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72d938-a7e9-4a84-bcc5-5de6ec38b16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:15.819936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72d938-a7e9-4a84-bcc5-5de6ec38b16c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:15.820404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72d938-a7e9-4a84-bcc5-5de6ec38b16c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:15.820961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72d938-a7e9-4a84-bcc5-5de6ec38b16c admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:15.822550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72d938-a7e9-4a84-bcc5-5de6ec38b16c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:05:15.823120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72d938-a7e9-4a84-bcc5-5de6ec38b16c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:15.825230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72d938-a7e9-4a84-bcc5-5de6ec38b16c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:15.843018 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1908/3785] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:15.843321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f929fb-50ca-4fa9-a1c0-3765efba5898 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:15.853916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f929fb-50ca-4fa9-a1c0-3765efba5898 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:15.858705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04782b2b-5f4c-4a34-840a-1f58a7e315ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:15.859315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04782b2b-5f4c-4a34-840a-1f58a7e315ee admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:15.859870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04782b2b-5f4c-4a34-840a-1f58a7e315ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:15.861006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04782b2b-5f4c-4a34-840a-1f58a7e315ee admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:15.861684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04782b2b-5f4c-4a34-840a-1f58a7e315ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:15.863583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04782b2b-5f4c-4a34-840a-1f58a7e315ee admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:15.910205 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1878/3786] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:05:15 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:15.911937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72d938-a7e9-4a84-bcc5-5de6ec38b16c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:15.923192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72d938-a7e9-4a84-bcc5-5de6ec38b16c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:16.003908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664021b-b112-4f76-864f-3c2b58bdbdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:16.004475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664021b-b112-4f76-864f-3c2b58bdbdd5 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:16.004970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664021b-b112-4f76-864f-3c2b58bdbdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:16.005694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664021b-b112-4f76-864f-3c2b58bdbdd5 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:16.006613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664021b-b112-4f76-864f-3c2b58bdbdd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:16.009563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664021b-b112-4f76-864f-3c2b58bdbdd5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:16.061822 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1909/3787] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:15 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:16.062028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04782b2b-5f4c-4a34-840a-1f58a7e315ee admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:16.077568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04782b2b-5f4c-4a34-840a-1f58a7e315ee admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:16.084440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb8e5f-7247-4c3d-b1e6-3612e73e6280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:16.085455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb8e5f-7247-4c3d-b1e6-3612e73e6280 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:16.085971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb8e5f-7247-4c3d-b1e6-3612e73e6280 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:16.086439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb8e5f-7247-4c3d-b1e6-3612e73e6280 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:16.087362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb8e5f-7247-4c3d-b1e6-3612e73e6280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:16.089480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb8e5f-7247-4c3d-b1e6-3612e73e6280 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:16.113555 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1879/3788] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:16.117769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664021b-b112-4f76-864f-3c2b58bdbdd5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:16.129918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664021b-b112-4f76-864f-3c2b58bdbdd5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:16.138550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c68bc6-bdfa-4f53-8d47-140a9f890298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:16.138550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c68bc6-bdfa-4f53-8d47-140a9f890298 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:16.138550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c68bc6-bdfa-4f53-8d47-140a9f890298 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:16.139170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c68bc6-bdfa-4f53-8d47-140a9f890298 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:16.140336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c68bc6-bdfa-4f53-8d47-140a9f890298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:16.143162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c68bc6-bdfa-4f53-8d47-140a9f890298 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:16.165482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb8e5f-7247-4c3d-b1e6-3612e73e6280 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:16.174491 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1910/3789] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:16.177808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb8e5f-7247-4c3d-b1e6-3612e73e6280 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:16.183949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f3614-9959-45a6-aa81-1492e91c929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:16.185410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f3614-9959-45a6-aa81-1492e91c929e admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:16.186874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f3614-9959-45a6-aa81-1492e91c929e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:16.187628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f3614-9959-45a6-aa81-1492e91c929e admin admin] PATH_INFO: `/v3/projects/d2abacb798e24ea0a3a525f299497c59/users/1e28f03dfb0144048fcf991982a3ffbe/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:16.218019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f3614-9959-45a6-aa81-1492e91c929e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2abacb798e24ea0a3a525f299497c59, user_id=1e28f03dfb0144048fcf991982a3ffbe, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:16.222246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f3614-9959-45a6-aa81-1492e91c929e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:16.267139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6b13b-7552-475c-b5e1-7089f88134c9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:16.267773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6b13b-7552-475c-b5e1-7089f88134c9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:16.268060 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1880/3790] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:05:16 2022] PUT /identity/v3/projects/d2abacb798e24ea0a3a525f299497c59/users/1e28f03dfb0144048fcf991982a3ffbe/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:16.268721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6b13b-7552-475c-b5e1-7089f88134c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:16.346230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2ae6b13b-7552-475c-b5e1-7089f88134c9 None None] MFA Rules not processed for user `1e28f03dfb0144048fcf991982a3ffbe`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:16.350051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2ae6b13b-7552-475c-b5e1-7089f88134c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:16.526513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:16.628051 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1911/3791] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:16.634238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f3614-9959-45a6-aa81-1492e91c929e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:16.732223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:16.824097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f3614-9959-45a6-aa81-1492e91c929e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:16.851243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8133d5-98dc-46b9-a82f-5c29028b6462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:16.852518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8133d5-98dc-46b9-a82f-5c29028b6462 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:16.852969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8133d5-98dc-46b9-a82f-5c29028b6462 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:16.853430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8133d5-98dc-46b9-a82f-5c29028b6462 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:16.854223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8133d5-98dc-46b9-a82f-5c29028b6462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:16.873890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8133d5-98dc-46b9-a82f-5c29028b6462 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:16.950930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6b13b-7552-475c-b5e1-7089f88134c9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:16.962529 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1881/3792] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:05:16 2022] POST /identity/v3/projects => generated 369 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:16.973316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6b13b-7552-475c-b5e1-7089f88134c9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:17.149094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f8800-c6ea-49dc-adf9-460a1b1a9486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:17.150213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f8800-c6ea-49dc-adf9-460a1b1a9486 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:17.150791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f8800-c6ea-49dc-adf9-460a1b1a9486 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:17.151215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f8800-c6ea-49dc-adf9-460a1b1a9486 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:17.152019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f8800-c6ea-49dc-adf9-460a1b1a9486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:17.155473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f8800-c6ea-49dc-adf9-460a1b1a9486 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:17.212398 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1912/3793] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:16 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:17.217837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8133d5-98dc-46b9-a82f-5c29028b6462 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:17.236423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8133d5-98dc-46b9-a82f-5c29028b6462 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:17.246807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d2d9d-535b-4d7d-bb31-2dacbfeb4ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:17.250024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d2d9d-535b-4d7d-bb31-2dacbfeb4ddd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:17.250449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d2d9d-535b-4d7d-bb31-2dacbfeb4ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:17.250845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d2d9d-535b-4d7d-bb31-2dacbfeb4ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:17.251840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d2d9d-535b-4d7d-bb31-2dacbfeb4ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:17.256602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d2d9d-535b-4d7d-bb31-2dacbfeb4ddd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:17.306693 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1882/3794] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:17.310699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f8800-c6ea-49dc-adf9-460a1b1a9486 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:17.333050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f8800-c6ea-49dc-adf9-460a1b1a9486 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:17.361598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138eaa6-54b4-4c3a-9c08-439f3939d536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:17.362898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138eaa6-54b4-4c3a-9c08-439f3939d536 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:17.363402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138eaa6-54b4-4c3a-9c08-439f3939d536 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:17.363937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138eaa6-54b4-4c3a-9c08-439f3939d536 admin admin] PATH_INFO: `/v3/projects/7c1585ce9b7d47efa50bce451db82312/users/d328b7cca18c4ed7b76366881467803b/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:17.423176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138eaa6-54b4-4c3a-9c08-439f3939d536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1585ce9b7d47efa50bce451db82312, user_id=d328b7cca18c4ed7b76366881467803b, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:17.434835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138eaa6-54b4-4c3a-9c08-439f3939d536 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:17.488096 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1913/3795] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:05:17 2022] PUT /identity/v3/projects/7c1585ce9b7d47efa50bce451db82312/users/d328b7cca18c4ed7b76366881467803b/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:17.489036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d2d9d-535b-4d7d-bb31-2dacbfeb4ddd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:17.526979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d2d9d-535b-4d7d-bb31-2dacbfeb4ddd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:17.710334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b219436-085f-4025-b462-d462e0483898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:17.711052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b219436-085f-4025-b462-d462e0483898 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:17.711342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b219436-085f-4025-b462-d462e0483898 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:17.711626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b219436-085f-4025-b462-d462e0483898 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:17.714276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b219436-085f-4025-b462-d462e0483898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:17.715951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b219436-085f-4025-b462-d462e0483898 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:17.747283 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1883/3796] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:17.752369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138eaa6-54b4-4c3a-9c08-439f3939d536 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:17.770740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138eaa6-54b4-4c3a-9c08-439f3939d536 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:17.784389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdb5df-01d0-4b00-af69-225010bcd37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:17.785218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdb5df-01d0-4b00-af69-225010bcd37b admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:17.785505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdb5df-01d0-4b00-af69-225010bcd37b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:17.785779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdb5df-01d0-4b00-af69-225010bcd37b admin admin] PATH_INFO: `/v3/projects/7c1585ce9b7d47efa50bce451db82312/users/d328b7cca18c4ed7b76366881467803b/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:17.793626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdb5df-01d0-4b00-af69-225010bcd37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1585ce9b7d47efa50bce451db82312, user_id=d328b7cca18c4ed7b76366881467803b, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:17.797417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdb5df-01d0-4b00-af69-225010bcd37b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:17.830807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88065d-1ea2-4796-b08c-ea0e4eced3ac None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:17.831389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88065d-1ea2-4796-b08c-ea0e4eced3ac None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:17.831863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88065d-1ea2-4796-b08c-ea0e4eced3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:17.836066 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1914/3797] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:05:17 2022] PUT /identity/v3/projects/7c1585ce9b7d47efa50bce451db82312/users/d328b7cca18c4ed7b76366881467803b/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:17.873430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-da88065d-1ea2-4796-b08c-ea0e4eced3ac None None] MFA Rules not processed for user `d328b7cca18c4ed7b76366881467803b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:17.874956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-da88065d-1ea2-4796-b08c-ea0e4eced3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:18.023375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdb5df-01d0-4b00-af69-225010bcd37b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:18.023830 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1884/3798] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:18.045770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdb5df-01d0-4b00-af69-225010bcd37b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:18.056180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c5582-994a-440c-9521-a36e479cb3b0 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:18.057378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c5582-994a-440c-9521-a36e479cb3b0 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:18.058055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c5582-994a-440c-9521-a36e479cb3b0 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:18.058487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c5582-994a-440c-9521-a36e479cb3b0 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:18.059947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c5582-994a-440c-9521-a36e479cb3b0 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:18.061651 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-aa8c5582-994a-440c-9521-a36e479cb3b0 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:18.061651 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:18.061651 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:18.063730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c5582-994a-440c-9521-a36e479cb3b0 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:18.095861 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1915/3799] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:05:18 2022] POST /identity/v3/domains => generated 276 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:18.101384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88065d-1ea2-4796-b08c-ea0e4eced3ac None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:18.116774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88065d-1ea2-4796-b08c-ea0e4eced3ac None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:18.188937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:18.270552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e60e4d-5a52-484c-b21b-492587fe0228 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:18.271261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e60e4d-5a52-484c-b21b-492587fe0228 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:18.271450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e60e4d-5a52-484c-b21b-492587fe0228 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:18.271736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e60e4d-5a52-484c-b21b-492587fe0228 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:18.272376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e60e4d-5a52-484c-b21b-492587fe0228 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:18.273442 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-01e60e4d-5a52-484c-b21b-492587fe0228 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:18.273442 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:18.273442 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:18.274992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e60e4d-5a52-484c-b21b-492587fe0228 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:18.366182 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1885/3800] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:05:18 2022] POST /identity/v3/groups => generated 279 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:18.370452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c5582-994a-440c-9521-a36e479cb3b0 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:18.386925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c5582-994a-440c-9521-a36e479cb3b0 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:18.412895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ca568-bef9-4699-a85d-8dc5b8cf7df5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:18.414449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ca568-bef9-4699-a85d-8dc5b8cf7df5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:18.414802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ca568-bef9-4699-a85d-8dc5b8cf7df5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:18.415206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ca568-bef9-4699-a85d-8dc5b8cf7df5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/566b5c70027e4a98bcc71c492b64c9c8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:18.450618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ca568-bef9-4699-a85d-8dc5b8cf7df5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:update_group(group_id=566b5c70027e4a98bcc71c492b64c9c8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:18.451723 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-9c3ca568-bef9-4699-a85d-8dc5b8cf7df5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:18.451723 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:18.451723 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:18.455359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ca568-bef9-4699-a85d-8dc5b8cf7df5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:18.528760 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1916/3801] 10.222.0.26 () {60 vars in 1247 bytes} [Sat Oct 8 21:05:18 2022] PATCH /identity/v3/groups/566b5c70027e4a98bcc71c492b64c9c8 => generated 291 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:18.530126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e60e4d-5a52-484c-b21b-492587fe0228 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:18.550158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e60e4d-5a52-484c-b21b-492587fe0228 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:18.583414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec679a0-f8fc-45e6-9ea1-8e827d3cd388 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:18.584176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec679a0-f8fc-45e6-9ea1-8e827d3cd388 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:18.584581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec679a0-f8fc-45e6-9ea1-8e827d3cd388 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:18.584874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec679a0-f8fc-45e6-9ea1-8e827d3cd388 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/566b5c70027e4a98bcc71c492b64c9c8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:18.604837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec679a0-f8fc-45e6-9ea1-8e827d3cd388 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:get_group(group_id=566b5c70027e4a98bcc71c492b64c9c8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:18.606272 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-9ec679a0-f8fc-45e6-9ea1-8e827d3cd388 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:18.606272 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:18.606272 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:18.614655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec679a0-f8fc-45e6-9ea1-8e827d3cd388 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:18.617003 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1886/3802] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:18 2022] GET /identity/v3/groups/566b5c70027e4a98bcc71c492b64c9c8 => generated 291 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:18.622667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ca568-bef9-4699-a85d-8dc5b8cf7df5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:18.639512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ca568-bef9-4699-a85d-8dc5b8cf7df5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:18.654069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f28b17-4284-41df-9d85-a08a16781c7d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:18.654736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f28b17-4284-41df-9d85-a08a16781c7d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:18.655019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f28b17-4284-41df-9d85-a08a16781c7d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:18.655289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f28b17-4284-41df-9d85-a08a16781c7d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/566b5c70027e4a98bcc71c492b64c9c8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:18.656610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f28b17-4284-41df-9d85-a08a16781c7d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:update_group(group_id=566b5c70027e4a98bcc71c492b64c9c8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:18.658733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f28b17-4284-41df-9d85-a08a16781c7d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:18.724384 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1917/3803] 10.222.0.26 () {60 vars in 1246 bytes} [Sat Oct 8 21:05:18 2022] PATCH /identity/v3/groups/566b5c70027e4a98bcc71c492b64c9c8 => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:18.728059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec679a0-f8fc-45e6-9ea1-8e827d3cd388 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:18.744719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec679a0-f8fc-45e6-9ea1-8e827d3cd388 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:18.759845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68d3c8-9090-455e-b52d-84966daa2718 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:18.760647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68d3c8-9090-455e-b52d-84966daa2718 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:18.760958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68d3c8-9090-455e-b52d-84966daa2718 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:18.761257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68d3c8-9090-455e-b52d-84966daa2718 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/566b5c70027e4a98bcc71c492b64c9c8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:18.780173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68d3c8-9090-455e-b52d-84966daa2718 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:delete_group(group_id=566b5c70027e4a98bcc71c492b64c9c8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:18.781729 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-4d68d3c8-9090-455e-b52d-84966daa2718 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:18.781729 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:18.781729 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:18.783306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68d3c8-9090-455e-b52d-84966daa2718 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:18.923168 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1887/3804] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:05:18 2022] DELETE /identity/v3/groups/566b5c70027e4a98bcc71c492b64c9c8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:18.926061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f28b17-4284-41df-9d85-a08a16781c7d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:18.956790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f28b17-4284-41df-9d85-a08a16781c7d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:19.114858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:UPDATE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:19.177972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c4ebb-b826-4ab0-91ce-0288ff91c101 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:19.178617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c4ebb-b826-4ab0-91ce-0288ff91c101 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:19.178909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c4ebb-b826-4ab0-91ce-0288ff91c101 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:19.179186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c4ebb-b826-4ab0-91ce-0288ff91c101 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:19.179845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c4ebb-b826-4ab0-91ce-0288ff91c101 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:19.180878 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-5b8c4ebb-b826-4ab0-91ce-0288ff91c101 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:19.180878 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:19.180878 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:19.182121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c4ebb-b826-4ab0-91ce-0288ff91c101 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:19.224551 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1918/3805] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:05:18 2022] POST /identity/v3/groups => generated 326 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:19.228731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68d3c8-9090-455e-b52d-84966daa2718 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:19.247777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68d3c8-9090-455e-b52d-84966daa2718 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:19.262731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32cf32-7bf5-4225-8e5a-e5dd875d03a3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:19.263366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32cf32-7bf5-4225-8e5a-e5dd875d03a3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:19.263680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32cf32-7bf5-4225-8e5a-e5dd875d03a3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:19.263907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32cf32-7bf5-4225-8e5a-e5dd875d03a3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:19.264545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32cf32-7bf5-4225-8e5a-e5dd875d03a3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:19.266499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32cf32-7bf5-4225-8e5a-e5dd875d03a3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:19.325554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c4ebb-b826-4ab0-91ce-0288ff91c101 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:19.327655 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1888/3806] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:19 2022] POST /identity/v3/users => generated 323 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:19.360659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c4ebb-b826-4ab0-91ce-0288ff91c101 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:19.376654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35a73b-010f-41e4-b754-aff9fd9f0492 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:19.377437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35a73b-010f-41e4-b754-aff9fd9f0492 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:19.380629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35a73b-010f-41e4-b754-aff9fd9f0492 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:19.380629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35a73b-010f-41e4-b754-aff9fd9f0492 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/b4bc1274218947f1ad663bdbfae04788` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:19.443596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35a73b-010f-41e4-b754-aff9fd9f0492 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f51194ba11ba40b8b047d22d4805571e, user_id=b4bc1274218947f1ad663bdbfae04788)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:19.447825 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-8e35a73b-010f-41e4-b754-aff9fd9f0492 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:19.447825 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:19.447825 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:19.449084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35a73b-010f-41e4-b754-aff9fd9f0492 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:19.539824 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1919/3807] 10.222.0.26 () {60 vars in 1360 bytes} [Sat Oct 8 21:05:19 2022] PUT /identity/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/b4bc1274218947f1ad663bdbfae04788 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:19.544106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32cf32-7bf5-4225-8e5a-e5dd875d03a3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:19.567295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32cf32-7bf5-4225-8e5a-e5dd875d03a3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:19.740043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73a30a-f934-41ef-b023-4f65771ae6e6 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:19.741382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73a30a-f934-41ef-b023-4f65771ae6e6 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:19.742560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73a30a-f934-41ef-b023-4f65771ae6e6 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:19.743074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73a30a-f934-41ef-b023-4f65771ae6e6 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:19.744033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73a30a-f934-41ef-b023-4f65771ae6e6 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:19.749230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73a30a-f934-41ef-b023-4f65771ae6e6 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:19.832328 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1889/3808] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:19 2022] POST /identity/v3/users => generated 321 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:19.836406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35a73b-010f-41e4-b754-aff9fd9f0492 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:19.853481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35a73b-010f-41e4-b754-aff9fd9f0492 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:19.868672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b883f-f4fa-453d-8173-b532fa85a33d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:19.869405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b883f-f4fa-453d-8173-b532fa85a33d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:19.869769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b883f-f4fa-453d-8173-b532fa85a33d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:19.870154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b883f-f4fa-453d-8173-b532fa85a33d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/f6ca4d67990a4bb9bfb70d843350bf54` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:19.902720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b883f-f4fa-453d-8173-b532fa85a33d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f51194ba11ba40b8b047d22d4805571e, user_id=f6ca4d67990a4bb9bfb70d843350bf54)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:19.905416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b883f-f4fa-453d-8173-b532fa85a33d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:20.003687 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1920/3809] 10.222.0.26 () {60 vars in 1360 bytes} [Sat Oct 8 21:05:19 2022] PUT /identity/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/f6ca4d67990a4bb9bfb70d843350bf54 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:20.010022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73a30a-f934-41ef-b023-4f65771ae6e6 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:20.030150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73a30a-f934-41ef-b023-4f65771ae6e6 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:20.076156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:INSERT=7,keystone:DELETE=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:20.153659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8825e6f-33ca-4feb-8b7c-186a5b4e93c5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:20.154608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8825e6f-33ca-4feb-8b7c-186a5b4e93c5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:20.155044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8825e6f-33ca-4feb-8b7c-186a5b4e93c5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:20.155631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8825e6f-33ca-4feb-8b7c-186a5b4e93c5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:20.156582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8825e6f-33ca-4feb-8b7c-186a5b4e93c5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:20.159437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8825e6f-33ca-4feb-8b7c-186a5b4e93c5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:20.204071 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1890/3810] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:20 2022] POST /identity/v3/users => generated 323 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:20.208006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b883f-f4fa-453d-8173-b532fa85a33d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:20.226010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b883f-f4fa-453d-8173-b532fa85a33d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:20.236655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42954753-7670-426d-a7c0-91c341cfe57c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:20.237372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42954753-7670-426d-a7c0-91c341cfe57c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:20.237653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42954753-7670-426d-a7c0-91c341cfe57c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:20.238080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42954753-7670-426d-a7c0-91c341cfe57c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/194d5af845794bf28c7e479da347acdb` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:20.256368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42954753-7670-426d-a7c0-91c341cfe57c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f51194ba11ba40b8b047d22d4805571e, user_id=194d5af845794bf28c7e479da347acdb)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:20.262426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42954753-7670-426d-a7c0-91c341cfe57c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:20.312456 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1921/3811] 10.222.0.26 () {60 vars in 1360 bytes} [Sat Oct 8 21:05:20 2022] PUT /identity/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/194d5af845794bf28c7e479da347acdb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:20.317086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8825e6f-33ca-4feb-8b7c-186a5b4e93c5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:20.351305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8825e6f-33ca-4feb-8b7c-186a5b4e93c5 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:20.518266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe1118-21b8-4466-87df-cc6686e2188e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:20.519745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe1118-21b8-4466-87df-cc6686e2188e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:20.520417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe1118-21b8-4466-87df-cc6686e2188e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:20.520865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe1118-21b8-4466-87df-cc6686e2188e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/f51194ba11ba40b8b047d22d4805571e/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:20.522562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe1118-21b8-4466-87df-cc6686e2188e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=f51194ba11ba40b8b047d22d4805571e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:20.525535 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-5efe1118-21b8-4466-87df-cc6686e2188e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:20.525535 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:20.525535 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:20.527438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe1118-21b8-4466-87df-cc6686e2188e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:20.587987 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1891/3812] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 21:05:20 2022] GET /identity/v3/groups/f51194ba11ba40b8b047d22d4805571e/users => generated 1083 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:20.592089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42954753-7670-426d-a7c0-91c341cfe57c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:20.619690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42954753-7670-426d-a7c0-91c341cfe57c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:20.630288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093b8fc-5d1d-447f-8282-d2eb579b19eb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:20.631141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093b8fc-5d1d-447f-8282-d2eb579b19eb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:20.631427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093b8fc-5d1d-447f-8282-d2eb579b19eb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:20.631702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093b8fc-5d1d-447f-8282-d2eb579b19eb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/b4bc1274218947f1ad663bdbfae04788` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:20.635584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093b8fc-5d1d-447f-8282-d2eb579b19eb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=f51194ba11ba40b8b047d22d4805571e, user_id=b4bc1274218947f1ad663bdbfae04788)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:20.636966 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-4093b8fc-5d1d-447f-8282-d2eb579b19eb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:20.636966 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:20.636966 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:20.639199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093b8fc-5d1d-447f-8282-d2eb579b19eb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:20.704676 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1922/3813] 10.222.0.26 () {58 vars in 1342 bytes} [Sat Oct 8 21:05:20 2022] HEAD /identity/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/b4bc1274218947f1ad663bdbfae04788 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:20.706313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe1118-21b8-4466-87df-cc6686e2188e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:20.723191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe1118-21b8-4466-87df-cc6686e2188e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:20.751576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a17ec3-60dc-41ee-bf3d-0e577d0576b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:20.752441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17ec3-60dc-41ee-bf3d-0e577d0576b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:20.752725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17ec3-60dc-41ee-bf3d-0e577d0576b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:20.752996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17ec3-60dc-41ee-bf3d-0e577d0576b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/b4bc1274218947f1ad663bdbfae04788` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:20.759702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a17ec3-60dc-41ee-bf3d-0e577d0576b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f51194ba11ba40b8b047d22d4805571e, user_id=b4bc1274218947f1ad663bdbfae04788)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:20.762126 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-89a17ec3-60dc-41ee-bf3d-0e577d0576b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:20.762126 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:20.762126 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:20.765282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a17ec3-60dc-41ee-bf3d-0e577d0576b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:20.806330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-89a17ec3-60dc-41ee-bf3d-0e577d0576b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b4bc1274218947f1ad663bdbfae04788'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:20.838222 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1892/3814] 10.222.0.26 () {58 vars in 1344 bytes} [Sat Oct 8 21:05:20 2022] DELETE /identity/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/b4bc1274218947f1ad663bdbfae04788 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:20.839560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093b8fc-5d1d-447f-8282-d2eb579b19eb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:20.856755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093b8fc-5d1d-447f-8282-d2eb579b19eb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:20.980901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc57c37-8c12-42c1-a229-7017d03388fb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:20.982238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57c37-8c12-42c1-a229-7017d03388fb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:20.982791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57c37-8c12-42c1-a229-7017d03388fb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:20.983312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57c37-8c12-42c1-a229-7017d03388fb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/f6ca4d67990a4bb9bfb70d843350bf54` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:20.986834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc57c37-8c12-42c1-a229-7017d03388fb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=f51194ba11ba40b8b047d22d4805571e, user_id=f6ca4d67990a4bb9bfb70d843350bf54)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:20.992336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc57c37-8c12-42c1-a229-7017d03388fb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:21.035652 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1923/3815] 10.222.0.26 () {58 vars in 1342 bytes} [Sat Oct 8 21:05:20 2022] HEAD /identity/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/f6ca4d67990a4bb9bfb70d843350bf54 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:21.036664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a17ec3-60dc-41ee-bf3d-0e577d0576b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:21.071676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a17ec3-60dc-41ee-bf3d-0e577d0576b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:21.089036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3b56e-e083-48b3-aabc-e9741b5c315c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:21.089772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3b56e-e083-48b3-aabc-e9741b5c315c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:21.090029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3b56e-e083-48b3-aabc-e9741b5c315c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:21.090311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3b56e-e083-48b3-aabc-e9741b5c315c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/f6ca4d67990a4bb9bfb70d843350bf54` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:21.094549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3b56e-e083-48b3-aabc-e9741b5c315c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f51194ba11ba40b8b047d22d4805571e, user_id=f6ca4d67990a4bb9bfb70d843350bf54)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:21.099130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3b56e-e083-48b3-aabc-e9741b5c315c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:21.129030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-49d3b56e-e083-48b3-aabc-e9741b5c315c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f6ca4d67990a4bb9bfb70d843350bf54'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:21.161767 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1893/3816] 10.222.0.26 () {58 vars in 1344 bytes} [Sat Oct 8 21:05:21 2022] DELETE /identity/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/f6ca4d67990a4bb9bfb70d843350bf54 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:21.163578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc57c37-8c12-42c1-a229-7017d03388fb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:21.176327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc57c37-8c12-42c1-a229-7017d03388fb tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:21.180679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:21.295454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291fab1-55af-49f7-bf48-b017140dc2ee tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:21.296139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291fab1-55af-49f7-bf48-b017140dc2ee tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:21.296407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291fab1-55af-49f7-bf48-b017140dc2ee tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:21.297131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291fab1-55af-49f7-bf48-b017140dc2ee tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/194d5af845794bf28c7e479da347acdb` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:21.300595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291fab1-55af-49f7-bf48-b017140dc2ee tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=f51194ba11ba40b8b047d22d4805571e, user_id=194d5af845794bf28c7e479da347acdb)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:21.306385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291fab1-55af-49f7-bf48-b017140dc2ee tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:21.329460 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1924/3817] 10.222.0.26 () {58 vars in 1342 bytes} [Sat Oct 8 21:05:21 2022] HEAD /identity/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/194d5af845794bf28c7e479da347acdb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:21.333131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3b56e-e083-48b3-aabc-e9741b5c315c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:21.347954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3b56e-e083-48b3-aabc-e9741b5c315c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:21.355351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aefa51-63ad-4e97-9c04-0e9f07dea3b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:21.357139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aefa51-63ad-4e97-9c04-0e9f07dea3b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:21.357649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aefa51-63ad-4e97-9c04-0e9f07dea3b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:21.358541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aefa51-63ad-4e97-9c04-0e9f07dea3b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/194d5af845794bf28c7e479da347acdb` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:21.364162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aefa51-63ad-4e97-9c04-0e9f07dea3b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f51194ba11ba40b8b047d22d4805571e, user_id=194d5af845794bf28c7e479da347acdb)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:21.367358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aefa51-63ad-4e97-9c04-0e9f07dea3b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:21.387892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96aefa51-63ad-4e97-9c04-0e9f07dea3b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '194d5af845794bf28c7e479da347acdb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:21.417907 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1894/3818] 10.222.0.26 () {58 vars in 1344 bytes} [Sat Oct 8 21:05:21 2022] DELETE /identity/v3/groups/f51194ba11ba40b8b047d22d4805571e/users/194d5af845794bf28c7e479da347acdb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:21.422002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291fab1-55af-49f7-bf48-b017140dc2ee tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:21.443790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291fab1-55af-49f7-bf48-b017140dc2ee tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:21.546656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b089e87-29c5-4466-88ad-d7c6b0107dfa tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:21.547406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b089e87-29c5-4466-88ad-d7c6b0107dfa tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:21.547697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b089e87-29c5-4466-88ad-d7c6b0107dfa tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:21.547977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b089e87-29c5-4466-88ad-d7c6b0107dfa tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/f51194ba11ba40b8b047d22d4805571e/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:21.550417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b089e87-29c5-4466-88ad-d7c6b0107dfa tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=f51194ba11ba40b8b047d22d4805571e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:21.551026 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-0b089e87-29c5-4466-88ad-d7c6b0107dfa tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:21.551026 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:21.551026 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:21.555844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b089e87-29c5-4466-88ad-d7c6b0107dfa tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:21.594118 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1925/3819] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 21:05:21 2022] GET /identity/v3/groups/f51194ba11ba40b8b047d22d4805571e/users => generated 145 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:21.598763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aefa51-63ad-4e97-9c04-0e9f07dea3b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:21.614013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aefa51-63ad-4e97-9c04-0e9f07dea3b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:21.623279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f23ea7-1964-4c51-a558-3bfdfc7c18b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:21.624214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f23ea7-1964-4c51-a558-3bfdfc7c18b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:21.624694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f23ea7-1964-4c51-a558-3bfdfc7c18b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:21.626130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f23ea7-1964-4c51-a558-3bfdfc7c18b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/users/194d5af845794bf28c7e479da347acdb` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:21.628552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f23ea7-1964-4c51-a558-3bfdfc7c18b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:delete_user(user_id=194d5af845794bf28c7e479da347acdb)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:21.631638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f23ea7-1964-4c51-a558-3bfdfc7c18b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:21.686976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=83,keystone:INSERT=6,keystone:DELETE=11 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:21.707928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-75f23ea7-1964-4c51-a558-3bfdfc7c18b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194d5af845794bf28c7e479da347acdb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:21.718576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-75f23ea7-1964-4c51-a558-3bfdfc7c18b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194d5af845794bf28c7e479da347acdb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:21.719973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-75f23ea7-1964-4c51-a558-3bfdfc7c18b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194d5af845794bf28c7e479da347acdb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:21.721655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-75f23ea7-1964-4c51-a558-3bfdfc7c18b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194d5af845794bf28c7e479da347acdb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:21.736955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-75f23ea7-1964-4c51-a558-3bfdfc7c18b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194d5af845794bf28c7e479da347acdb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:21.758935 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1895/3820] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:21 2022] DELETE /identity/v3/users/194d5af845794bf28c7e479da347acdb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:21.764247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b089e87-29c5-4466-88ad-d7c6b0107dfa tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:21.767481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0b089e87-29c5-4466-88ad-d7c6b0107dfa tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:21.785000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b089e87-29c5-4466-88ad-d7c6b0107dfa tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:21.866628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:21.868071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:21.868356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:21.868632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/users/f6ca4d67990a4bb9bfb70d843350bf54` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:21.869951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f6ca4d67990a4bb9bfb70d843350bf54)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:21.872944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:21.969994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:21.992493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ca4d67990a4bb9bfb70d843350bf54'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:22.005896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ca4d67990a4bb9bfb70d843350bf54'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:22.006881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ca4d67990a4bb9bfb70d843350bf54'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:22.010027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ca4d67990a4bb9bfb70d843350bf54'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:22.055548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ca4d67990a4bb9bfb70d843350bf54'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:22.077139 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1926/3821] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:21 2022] DELETE /identity/v3/users/f6ca4d67990a4bb9bfb70d843350bf54 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:22.082196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f23ea7-1964-4c51-a558-3bfdfc7c18b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:22.100047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f23ea7-1964-4c51-a558-3bfdfc7c18b4 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:22.299016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:22.299679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:22.301086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:22.301403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/users/b4bc1274218947f1ad663bdbfae04788` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:22.302690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b4bc1274218947f1ad663bdbfae04788)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:22.312130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:22.403338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4bc1274218947f1ad663bdbfae04788'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:22.414038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4bc1274218947f1ad663bdbfae04788'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:22.415016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4bc1274218947f1ad663bdbfae04788'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:22.416070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4bc1274218947f1ad663bdbfae04788'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:22.441661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4bc1274218947f1ad663bdbfae04788'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:22.465396 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1896/3822] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:22 2022] DELETE /identity/v3/users/b4bc1274218947f1ad663bdbfae04788 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:22.470681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:22.472400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:22.505288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadd34b-175d-4762-8568-32f295ffb576 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:22.699247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82e07d-b7a2-4782-bc18-1a8aeb31c42d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:22.700066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82e07d-b7a2-4782-bc18-1a8aeb31c42d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:22.700628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82e07d-b7a2-4782-bc18-1a8aeb31c42d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:22.701090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82e07d-b7a2-4782-bc18-1a8aeb31c42d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/f51194ba11ba40b8b047d22d4805571e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:22.702494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82e07d-b7a2-4782-bc18-1a8aeb31c42d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f51194ba11ba40b8b047d22d4805571e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:22.704445 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-cf82e07d-b7a2-4782-bc18-1a8aeb31c42d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:22.704445 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:22.704445 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:22.706250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82e07d-b7a2-4782-bc18-1a8aeb31c42d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:22.819710 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1927/3823] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:05:22 2022] DELETE /identity/v3/groups/f51194ba11ba40b8b047d22d4805571e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:22.825791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:22.827899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:22.861158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015437ff-97ec-42b3-a074-4f8a1205792e tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:22.933382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:23.013649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bbf4d-a9d5-4032-84a0-2f5d8b3f799f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:23.014640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bbf4d-a9d5-4032-84a0-2f5d8b3f799f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:23.015142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bbf4d-a9d5-4032-84a0-2f5d8b3f799f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:23.016533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bbf4d-a9d5-4032-84a0-2f5d8b3f799f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:23.017425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bbf4d-a9d5-4032-84a0-2f5d8b3f799f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:23.021692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bbf4d-a9d5-4032-84a0-2f5d8b3f799f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:23.101040 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1897/3824] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:05:22 2022] POST /identity/v3/groups => generated 326 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:23.101284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82e07d-b7a2-4782-bc18-1a8aeb31c42d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:23.119602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82e07d-b7a2-4782-bc18-1a8aeb31c42d tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:23.151299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c723c-8a94-4bca-bea6-626660bcc1b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:23.160972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c723c-8a94-4bca-bea6-626660bcc1b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:23.161977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c723c-8a94-4bca-bea6-626660bcc1b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:23.163375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c723c-8a94-4bca-bea6-626660bcc1b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:23.167698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c723c-8a94-4bca-bea6-626660bcc1b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:23.184307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c723c-8a94-4bca-bea6-626660bcc1b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:23.237861 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1928/3825] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:05:23 2022] POST /identity/v3/groups => generated 326 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:23.239448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bbf4d-a9d5-4032-84a0-2f5d8b3f799f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:23.265157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bbf4d-a9d5-4032-84a0-2f5d8b3f799f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:23.296432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee19b3b-0843-446d-9100-70d52d5a5b38 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:23.299332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee19b3b-0843-446d-9100-70d52d5a5b38 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:23.300207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee19b3b-0843-446d-9100-70d52d5a5b38 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:23.301533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee19b3b-0843-446d-9100-70d52d5a5b38 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:23.304928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee19b3b-0843-446d-9100-70d52d5a5b38 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:23.309371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee19b3b-0843-446d-9100-70d52d5a5b38 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:23.351182 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1898/3826] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:05:23 2022] POST /identity/v3/groups => generated 326 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:23.354739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c723c-8a94-4bca-bea6-626660bcc1b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:23.377805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c723c-8a94-4bca-bea6-626660bcc1b3 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:23.395029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2154bd0-3b1a-40b1-a274-0618882cf2dc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:23.395925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2154bd0-3b1a-40b1-a274-0618882cf2dc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:23.396598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2154bd0-3b1a-40b1-a274-0618882cf2dc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:23.397008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2154bd0-3b1a-40b1-a274-0618882cf2dc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:23.397790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2154bd0-3b1a-40b1-a274-0618882cf2dc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:23.399487 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-b2154bd0-3b1a-40b1-a274-0618882cf2dc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:23.399487 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:23.399487 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:23.404757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2154bd0-3b1a-40b1-a274-0618882cf2dc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:23.448907 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1929/3827] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 21:05:23 2022] GET /identity/v3/groups => generated 1488 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:23.450009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee19b3b-0843-446d-9100-70d52d5a5b38 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:23.510571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee19b3b-0843-446d-9100-70d52d5a5b38 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:23.533528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c055fdf-54be-4045-ab53-5bf4c764d3ef tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:23.534188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c055fdf-54be-4045-ab53-5bf4c764d3ef tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:23.534601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c055fdf-54be-4045-ab53-5bf4c764d3ef tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:23.534889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c055fdf-54be-4045-ab53-5bf4c764d3ef tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/15d60463fa254e919c8a01b2e8801706` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:23.552033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c055fdf-54be-4045-ab53-5bf4c764d3ef tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:delete_group(group_id=15d60463fa254e919c8a01b2e8801706)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:23.554791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c055fdf-54be-4045-ab53-5bf4c764d3ef tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:23.700139 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1899/3828] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:05:23 2022] DELETE /identity/v3/groups/15d60463fa254e919c8a01b2e8801706 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:23.701379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2154bd0-3b1a-40b1-a274-0618882cf2dc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:23.717980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2154bd0-3b1a-40b1-a274-0618882cf2dc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:23.914476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:23.936328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6c96d-5bf8-4d37-bf35-15c73e714b02 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:23.939174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6c96d-5bf8-4d37-bf35-15c73e714b02 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:23.940060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6c96d-5bf8-4d37-bf35-15c73e714b02 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:23.940060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6c96d-5bf8-4d37-bf35-15c73e714b02 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/1d8a12a8d671471b884853be61b9fdbf` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:23.950944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6c96d-5bf8-4d37-bf35-15c73e714b02 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1d8a12a8d671471b884853be61b9fdbf)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:23.956942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6c96d-5bf8-4d37-bf35-15c73e714b02 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:24.087142 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1930/3829] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:05:23 2022] DELETE /identity/v3/groups/1d8a12a8d671471b884853be61b9fdbf => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:24.089625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c055fdf-54be-4045-ab53-5bf4c764d3ef tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:24.110443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c055fdf-54be-4045-ab53-5bf4c764d3ef tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:24.328976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65168d2b-0bde-4916-bdee-cf040311d607 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:24.329668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65168d2b-0bde-4916-bdee-cf040311d607 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:24.329951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65168d2b-0bde-4916-bdee-cf040311d607 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:24.330283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65168d2b-0bde-4916-bdee-cf040311d607 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/9383ff35660e4ee5962aaa72c89e6c2d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:24.348210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65168d2b-0bde-4916-bdee-cf040311d607 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9383ff35660e4ee5962aaa72c89e6c2d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:24.351071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65168d2b-0bde-4916-bdee-cf040311d607 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:24.471106 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1900/3830] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:05:24 2022] DELETE /identity/v3/groups/9383ff35660e4ee5962aaa72c89e6c2d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:24.483536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6c96d-5bf8-4d37-bf35-15c73e714b02 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:24.528245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6c96d-5bf8-4d37-bf35-15c73e714b02 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:24.565467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9dab4-3c66-4f13-b1c4-375a2b118e12 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:24.565760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9dab4-3c66-4f13-b1c4-375a2b118e12 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:24.566042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9dab4-3c66-4f13-b1c4-375a2b118e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:24.605206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-56a9dab4-3c66-4f13-b1c4-375a2b118e12 None None] MFA Rules not processed for user `85abb492492343c58734564a2b26c8f6`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:24.605808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-56a9dab4-3c66-4f13-b1c4-375a2b118e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:24.630991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:24.681636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da0aab-e4c6-4ed5-8792-8bbe4e4ea64c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:24.682238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da0aab-e4c6-4ed5-8792-8bbe4e4ea64c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:24.682601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da0aab-e4c6-4ed5-8792-8bbe4e4ea64c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:24.682838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da0aab-e4c6-4ed5-8792-8bbe4e4ea64c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:24.683474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da0aab-e4c6-4ed5-8792-8bbe4e4ea64c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:24.685779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da0aab-e4c6-4ed5-8792-8bbe4e4ea64c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:24.690892 ncdv-master-1 devstack@keystone.service[99085]: WARNING keystone.server.flask.common [None req-b1da0aab-e4c6-4ed5-8792-8bbe4e4ea64c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 08 21:05:24.767402 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1901/3831] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:24.782273 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1931/3832] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:24 2022] POST /identity/v3/users => generated 321 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:24.784107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9dab4-3c66-4f13-b1c4-375a2b118e12 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:24.802194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9dab4-3c66-4f13-b1c4-375a2b118e12 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:24.806568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da0aab-e4c6-4ed5-8792-8bbe4e4ea64c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:24.808770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b1da0aab-e4c6-4ed5-8792-8bbe4e4ea64c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:24.830552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260550f-7f32-4d37-8d26-596dafbdfd25 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:24.833484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260550f-7f32-4d37-8d26-596dafbdfd25 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:24.833770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260550f-7f32-4d37-8d26-596dafbdfd25 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:24.837239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260550f-7f32-4d37-8d26-596dafbdfd25 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:24.837942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260550f-7f32-4d37-8d26-596dafbdfd25 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:24.843733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260550f-7f32-4d37-8d26-596dafbdfd25 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:24.893640 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1902/3833] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:05:24 2022] POST /identity/v3/groups => generated 326 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:24.897932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260550f-7f32-4d37-8d26-596dafbdfd25 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:24.912359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260550f-7f32-4d37-8d26-596dafbdfd25 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:24.919411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85031c-5c8c-4521-b47c-4de91aed904f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:24.920443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85031c-5c8c-4521-b47c-4de91aed904f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:24.920868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85031c-5c8c-4521-b47c-4de91aed904f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:24.921273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85031c-5c8c-4521-b47c-4de91aed904f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/0d63420b587b45318db86f5351d3ef06/users/e78baaf228e34c72a39c90df09b0d73d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:24.950847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85031c-5c8c-4521-b47c-4de91aed904f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0d63420b587b45318db86f5351d3ef06, user_id=e78baaf228e34c72a39c90df09b0d73d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:24.963560 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-4f85031c-5c8c-4521-b47c-4de91aed904f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:24.963560 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:24.963560 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:24.967478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85031c-5c8c-4521-b47c-4de91aed904f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:25.031241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da0aab-e4c6-4ed5-8792-8bbe4e4ea64c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:25.032646 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1903/3834] 10.222.0.26 () {60 vars in 1360 bytes} [Sat Oct 8 21:05:24 2022] PUT /identity/v3/groups/0d63420b587b45318db86f5351d3ef06/users/e78baaf228e34c72a39c90df09b0d73d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:25.038333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85031c-5c8c-4521-b47c-4de91aed904f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:25.167998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:25.201516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85031c-5c8c-4521-b47c-4de91aed904f tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:25.206861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226408cd-a9ab-4a2e-b67a-c2042a454dfc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:25.207851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226408cd-a9ab-4a2e-b67a-c2042a454dfc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:25.209591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226408cd-a9ab-4a2e-b67a-c2042a454dfc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:25.209792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226408cd-a9ab-4a2e-b67a-c2042a454dfc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:25.210387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226408cd-a9ab-4a2e-b67a-c2042a454dfc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:25.213153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226408cd-a9ab-4a2e-b67a-c2042a454dfc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:25.221867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb5a61-7621-457c-b652-88251156219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:25.222530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb5a61-7621-457c-b652-88251156219a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:25.222813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb5a61-7621-457c-b652-88251156219a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:25.223083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb5a61-7621-457c-b652-88251156219a admin admin] PATH_INFO: `/v3/users/5266cd6be4514b3eac30a195f6b25772` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:25.226217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb5a61-7621-457c-b652-88251156219a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5266cd6be4514b3eac30a195f6b25772)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:25.229403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb5a61-7621-457c-b652-88251156219a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:25.235237 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1904/3835] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:05:25 2022] POST /identity/v3/groups => generated 327 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:25.239854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226408cd-a9ab-4a2e-b67a-c2042a454dfc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:25.260541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226408cd-a9ab-4a2e-b67a-c2042a454dfc tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:25.272055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e03747-021b-4878-a859-68dc7b2e910c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:25.272899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e03747-021b-4878-a859-68dc7b2e910c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:25.273587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e03747-021b-4878-a859-68dc7b2e910c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:25.274085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e03747-021b-4878-a859-68dc7b2e910c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/03f4fc68b89044cc9d7f3901c8ae51e9/users/e78baaf228e34c72a39c90df09b0d73d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:25.292273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e03747-021b-4878-a859-68dc7b2e910c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=03f4fc68b89044cc9d7f3901c8ae51e9, user_id=e78baaf228e34c72a39c90df09b0d73d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:25.295152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e03747-021b-4878-a859-68dc7b2e910c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:25.318238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8bb5a61-7621-457c-b652-88251156219a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5266cd6be4514b3eac30a195f6b25772'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:25.351413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8bb5a61-7621-457c-b652-88251156219a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5266cd6be4514b3eac30a195f6b25772'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:25.352256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8bb5a61-7621-457c-b652-88251156219a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5266cd6be4514b3eac30a195f6b25772'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:25.354001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8bb5a61-7621-457c-b652-88251156219a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5266cd6be4514b3eac30a195f6b25772'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:25.371692 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1905/3836] 10.222.0.26 () {60 vars in 1360 bytes} [Sat Oct 8 21:05:25 2022] PUT /identity/v3/groups/03f4fc68b89044cc9d7f3901c8ae51e9/users/e78baaf228e34c72a39c90df09b0d73d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:25.377764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e03747-021b-4878-a859-68dc7b2e910c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:25.380599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f9e03747-021b-4878-a859-68dc7b2e910c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:25.391937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8bb5a61-7621-457c-b652-88251156219a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5266cd6be4514b3eac30a195f6b25772'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:25.422603 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1932/3837] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:24 2022] DELETE /identity/v3/users/5266cd6be4514b3eac30a195f6b25772 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:25.427602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dd4df-0088-4f78-b46d-b2b233502018 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:25.428943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dd4df-0088-4f78-b46d-b2b233502018 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:25.429492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dd4df-0088-4f78-b46d-b2b233502018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:25.497955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8f1dd4df-0088-4f78-b46d-b2b233502018 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:25.503287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f1dd4df-0088-4f78-b46d-b2b233502018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:25.522051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:25.581498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e03747-021b-4878-a859-68dc7b2e910c tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:25.642104 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1933/3838] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:25.696490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c326510-9170-4fc3-be14-5421f75347f9 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:25.697257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c326510-9170-4fc3-be14-5421f75347f9 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:25.697519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c326510-9170-4fc3-be14-5421f75347f9 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:25.697794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c326510-9170-4fc3-be14-5421f75347f9 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/users/e78baaf228e34c72a39c90df09b0d73d/groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:25.700268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c326510-9170-4fc3-be14-5421f75347f9 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=e78baaf228e34c72a39c90df09b0d73d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:25.702714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c326510-9170-4fc3-be14-5421f75347f9 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:25.720523 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1906/3839] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 21:05:25 2022] GET /identity/v3/users/e78baaf228e34c72a39c90df09b0d73d/groups => generated 839 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:05:25.724464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dd4df-0088-4f78-b46d-b2b233502018 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:25.727575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f1dd4df-0088-4f78-b46d-b2b233502018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:25.733881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c326510-9170-4fc3-be14-5421f75347f9 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:25.761621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c326510-9170-4fc3-be14-5421f75347f9 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:25.775276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7b515-3bf8-4390-850e-5cea1952d1a8 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:25.777810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7b515-3bf8-4390-850e-5cea1952d1a8 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:25.778073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7b515-3bf8-4390-850e-5cea1952d1a8 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:25.778358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7b515-3bf8-4390-850e-5cea1952d1a8 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/03f4fc68b89044cc9d7f3901c8ae51e9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:25.788272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7b515-3bf8-4390-850e-5cea1952d1a8 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:delete_group(group_id=03f4fc68b89044cc9d7f3901c8ae51e9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:25.797681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7b515-3bf8-4390-850e-5cea1952d1a8 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:25.875542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dd4df-0088-4f78-b46d-b2b233502018 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:25.884010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237830b4-a10f-48b6-8c0d-6f337022bceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:25.885342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237830b4-a10f-48b6-8c0d-6f337022bceb service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:25.885745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237830b4-a10f-48b6-8c0d-6f337022bceb service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:25.887051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237830b4-a10f-48b6-8c0d-6f337022bceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:25.915992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237830b4-a10f-48b6-8c0d-6f337022bceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:25.917794 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1907/3840] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:05:25 2022] DELETE /identity/v3/groups/03f4fc68b89044cc9d7f3901c8ae51e9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:25.922546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7b515-3bf8-4390-850e-5cea1952d1a8 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:25.924089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237830b4-a10f-48b6-8c0d-6f337022bceb service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:25.982209 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1934/3841] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:05:26.014542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237830b4-a10f-48b6-8c0d-6f337022bceb service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:26.016510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-237830b4-a10f-48b6-8c0d-6f337022bceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:26.031270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:26.044979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237830b4-a10f-48b6-8c0d-6f337022bceb service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:26.057027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7b515-3bf8-4390-850e-5cea1952d1a8 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:26.069321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff28d7f-de9e-4b34-95c8-394115d3e0b2 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:26.071557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28d7f-de9e-4b34-95c8-394115d3e0b2 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:26.071853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28d7f-de9e-4b34-95c8-394115d3e0b2 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:26.072324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28d7f-de9e-4b34-95c8-394115d3e0b2 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/groups/0d63420b587b45318db86f5351d3ef06` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:26.074892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff28d7f-de9e-4b34-95c8-394115d3e0b2 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0d63420b587b45318db86f5351d3ef06)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:26.085573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff28d7f-de9e-4b34-95c8-394115d3e0b2 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:26.145377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:26.196675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6f5ea-9d40-406f-aeb6-b119847b30e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:26.198778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6f5ea-9d40-406f-aeb6-b119847b30e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:26.199066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6f5ea-9d40-406f-aeb6-b119847b30e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:26.199350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6f5ea-9d40-406f-aeb6-b119847b30e9 admin admin] PATH_INFO: `/v3/users/3245fc05926b49118c0d1028de3f09a4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:26.202912 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1908/3842] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:05:25 2022] DELETE /identity/v3/groups/0d63420b587b45318db86f5351d3ef06 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:26.208531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff28d7f-de9e-4b34-95c8-394115d3e0b2 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:26.211007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6f5ea-9d40-406f-aeb6-b119847b30e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3245fc05926b49118c0d1028de3f09a4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:26.212972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6f5ea-9d40-406f-aeb6-b119847b30e9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:26.292374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3fd6f5ea-9d40-406f-aeb6-b119847b30e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3245fc05926b49118c0d1028de3f09a4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.308040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3fd6f5ea-9d40-406f-aeb6-b119847b30e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3245fc05926b49118c0d1028de3f09a4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.308953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3fd6f5ea-9d40-406f-aeb6-b119847b30e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3245fc05926b49118c0d1028de3f09a4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.309924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3fd6f5ea-9d40-406f-aeb6-b119847b30e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3245fc05926b49118c0d1028de3f09a4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.326175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff28d7f-de9e-4b34-95c8-394115d3e0b2 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:26.333474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:26.334990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:26.335290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:26.336339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/users/e78baaf228e34c72a39c90df09b0d73d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:26.337072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3fd6f5ea-9d40-406f-aeb6-b119847b30e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3245fc05926b49118c0d1028de3f09a4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.338035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e78baaf228e34c72a39c90df09b0d73d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:26.342908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:26.371873 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1935/3843] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:26 2022] DELETE /identity/v3/users/3245fc05926b49118c0d1028de3f09a4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:26.373458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce7ec8-f3d1-47e3-a24f-6428dbc25364 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:26.373752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce7ec8-f3d1-47e3-a24f-6428dbc25364 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:26.374029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce7ec8-f3d1-47e3-a24f-6428dbc25364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:26.399318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bbce7ec8-f3d1-47e3-a24f-6428dbc25364 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:26.400565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bbce7ec8-f3d1-47e3-a24f-6428dbc25364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:26.418835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78baaf228e34c72a39c90df09b0d73d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.430510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78baaf228e34c72a39c90df09b0d73d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.431980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78baaf228e34c72a39c90df09b0d73d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.432628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78baaf228e34c72a39c90df09b0d73d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.456814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78baaf228e34c72a39c90df09b0d73d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.483052 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1909/3844] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:26 2022] DELETE /identity/v3/users/e78baaf228e34c72a39c90df09b0d73d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:26.485144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:26.486451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:26.509910 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1936/3845] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:26.546696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce7ec8-f3d1-47e3-a24f-6428dbc25364 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:26.550236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bbce7ec8-f3d1-47e3-a24f-6428dbc25364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:26.581002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181ad57-d308-4376-9755-3b01b9c11dec tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:26.594836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:26.595728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:26.598062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:26.604018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:26.606425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/domains/f240e90fb5ab41d7aa2af42b6e940ab0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:26.608120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f240e90fb5ab41d7aa2af42b6e940ab0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:26.610072 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:26.610072 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:26.610072 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:26.611886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:26.628450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:26.686121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f240e90fb5ab41d7aa2af42b6e940ab0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.689037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f240e90fb5ab41d7aa2af42b6e940ab0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.690361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce7ec8-f3d1-47e3-a24f-6428dbc25364 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:26.813241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f240e90fb5ab41d7aa2af42b6e940ab0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.814934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f240e90fb5ab41d7aa2af42b6e940ab0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:26.823739 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1910/3846] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:05:26 2022] PATCH /identity/v3/domains/f240e90fb5ab41d7aa2af42b6e940ab0 => generated 277 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:26.825008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:26.827090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:26.841996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d718375-11a0-4366-9b4c-346633c6dc38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:26.842974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d718375-11a0-4366-9b4c-346633c6dc38 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:26.843085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d718375-11a0-4366-9b4c-346633c6dc38 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:26.843341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d718375-11a0-4366-9b4c-346633c6dc38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:26.845853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0d718375-11a0-4366-9b4c-346633c6dc38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:27.002643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d718375-11a0-4366-9b4c-346633c6dc38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:27.004351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d718375-11a0-4366-9b4c-346633c6dc38 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:27.017838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a5b33-ef5f-47ff-9160-313afdbbb482 tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:27.025691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:27.026485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:27.026826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:27.027203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] PATH_INFO: `/v3/projects/0ffdae031c4f47d599acb30f1d3c87b9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:27.028571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ffdae031c4f47d599acb30f1d3c87b9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:27.031242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:27.034564 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1937/3847] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:05:27.037443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d718375-11a0-4366-9b4c-346633c6dc38 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:27.040748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0d718375-11a0-4366-9b4c-346633c6dc38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:27.141776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ffdae031c4f47d599acb30f1d3c87b9', 'request_id': 'req-22946e2c-b321-42a0-be7e-c6ff09d69e74'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.160099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ffdae031c4f47d599acb30f1d3c87b9', 'request_id': 'req-22946e2c-b321-42a0-be7e-c6ff09d69e74'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.176601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ffdae031c4f47d599acb30f1d3c87b9', 'request_id': 'req-22946e2c-b321-42a0-be7e-c6ff09d69e74'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.195403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] The token cache is being invalidate because project 0ffdae031c4f47d599acb30f1d3c87b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:27.196039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.209264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.211885 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1911/3848] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:05:26 2022] DELETE /identity/v3/projects/0ffdae031c4f47d599acb30f1d3c87b9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:27.215980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d718375-11a0-4366-9b4c-346633c6dc38 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:27.216789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:27.218615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:27.328155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:27.397486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:27.400854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd328b7cca18c4ed7b76366881467803b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1585ce9b7d47efa50bce451db82312', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:27.401742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:27.401942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:27.402165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] PATH_INFO: `/v3/domains/f240e90fb5ab41d7aa2af42b6e940ab0` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:27.432130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22946e2c-b321-42a0-be7e-c6ff09d69e74 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:27.440877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:27.442127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:27.442662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:27.443132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] PATH_INFO: `/v3/users/82eecd716629401493db6a979b7887cf` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:27.445097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] RBAC: Authorizing `identity:delete_user(user_id=82eecd716629401493db6a979b7887cf)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:27.448339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:27.454085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f240e90fb5ab41d7aa2af42b6e940ab0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:27.455171 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:27.455171 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:27.455171 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:27.462855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:27.540927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82eecd716629401493db6a979b7887cf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.542441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f240e90fb5ab41d7aa2af42b6e940ab0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.560607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82eecd716629401493db6a979b7887cf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.561561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82eecd716629401493db6a979b7887cf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.562834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82eecd716629401493db6a979b7887cf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.590154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f240e90fb5ab41d7aa2af42b6e940ab0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.597510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82eecd716629401493db6a979b7887cf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.628337 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1912/3849] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:27 2022] DELETE /identity/v3/users/82eecd716629401493db6a979b7887cf => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:27.680195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f240e90fb5ab41d7aa2af42b6e940ab0', 'request_id': 'req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.696518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f240e90fb5ab41d7aa2af42b6e940ab0', 'request_id': 'req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.709884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f240e90fb5ab41d7aa2af42b6e940ab0', 'request_id': 'req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.732031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] The token cache is being invalidate because project f240e90fb5ab41d7aa2af42b6e940ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:27.732712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.733821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.756404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f240e90fb5ab41d7aa2af42b6e940ab0', 'request_id': 'req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.765597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f240e90fb5ab41d7aa2af42b6e940ab0', 'request_id': 'req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.767187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b tempest-GroupsV3TestJSON-1193910417 tempest-GroupsV3TestJSON-1193910417-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f240e90fb5ab41d7aa2af42b6e940ab0', 'request_id': 'req-df937e29-07b1-48cd-9b4a-dbc2c61bcf4b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:27.780488 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1938/3850] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:05:27 2022] DELETE /identity/v3/domains/f240e90fb5ab41d7aa2af42b6e940ab0 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:27.786216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:27.788899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:27.912971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45253cf-cb90-40cd-8dfc-be5f3214946b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:27.985046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:27.985727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:27.986332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:27.986613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] PATH_INFO: `/v3/users/1e28f03dfb0144048fcf991982a3ffbe` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:27.987974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e28f03dfb0144048fcf991982a3ffbe)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:27.990249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:28.033913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:28.115494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e28f03dfb0144048fcf991982a3ffbe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:28.140191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e28f03dfb0144048fcf991982a3ffbe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:28.142114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e28f03dfb0144048fcf991982a3ffbe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:28.143080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e28f03dfb0144048fcf991982a3ffbe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:28.166716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e28f03dfb0144048fcf991982a3ffbe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:28.189084 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1913/3851] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:27 2022] DELETE /identity/v3/users/1e28f03dfb0144048fcf991982a3ffbe => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:28.193015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ccdb4-3070-4362-ad72-6da067d5d833 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:28.193550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ccdb4-3070-4362-ad72-6da067d5d833 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:28.193784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ccdb4-3070-4362-ad72-6da067d5d833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:28.228732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8e5ccdb4-3070-4362-ad72-6da067d5d833 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:28.231583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8e5ccdb4-3070-4362-ad72-6da067d5d833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:28.317173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:28.320499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:28.380881 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1939/3852] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:28.383694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ccdb4-3070-4362-ad72-6da067d5d833 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:28.395488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8e5ccdb4-3070-4362-ad72-6da067d5d833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:28.449841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:28.523239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14576b-3336-436a-a8b0-f91089f665b5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:28.537089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:28.541500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:28.542304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:28.542660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7 admin admin] PATH_INFO: `/v3/projects/6cbd4579af204aa6b396906ca1430d3c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:28.547274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cbd4579af204aa6b396906ca1430d3c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:28.554546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:28.559676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ccdb4-3070-4362-ad72-6da067d5d833 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:28.566142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017bcc0-2a95-4f8a-9bf4-fa7cb9ab574f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:28.566493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017bcc0-2a95-4f8a-9bf4-fa7cb9ab574f service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:28.566823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017bcc0-2a95-4f8a-9bf4-fa7cb9ab574f service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:28.567177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017bcc0-2a95-4f8a-9bf4-fa7cb9ab574f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:28.584056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017bcc0-2a95-4f8a-9bf4-fa7cb9ab574f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:28.586354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017bcc0-2a95-4f8a-9bf4-fa7cb9ab574f service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:28.602134 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1940/3853] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:05:28.661416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cbd4579af204aa6b396906ca1430d3c', 'request_id': 'req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:28.684931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cbd4579af204aa6b396906ca1430d3c', 'request_id': 'req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:28.693049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cbd4579af204aa6b396906ca1430d3c', 'request_id': 'req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:28.717391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7 admin admin] The token cache is being invalidate because project 6cbd4579af204aa6b396906ca1430d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:28.717692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:28.718274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee719e19-b0e2-4208-9b75-4c8109e4f4f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:28.723646 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1914/3854] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:05:28 2022] DELETE /identity/v3/projects/6cbd4579af204aa6b396906ca1430d3c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:28.725703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85818bd8-895d-4d69-a94d-46466c705c97 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:28.726023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85818bd8-895d-4d69-a94d-46466c705c97 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:28.726860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85818bd8-895d-4d69-a94d-46466c705c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:28.766855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-85818bd8-895d-4d69-a94d-46466c705c97 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:28.773606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-85818bd8-895d-4d69-a94d-46466c705c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:28.871143 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1941/3855] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:28.880768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d7029-caf3-4dfb-a5da-e842d5501977 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:28.881085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d7029-caf3-4dfb-a5da-e842d5501977 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:28.881380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d7029-caf3-4dfb-a5da-e842d5501977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:28.903768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b46d7029-caf3-4dfb-a5da-e842d5501977 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:28.905135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b46d7029-caf3-4dfb-a5da-e842d5501977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:28.919418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85818bd8-895d-4d69-a94d-46466c705c97 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:28.926694 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1915/3856] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:28.932119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85818bd8-895d-4d69-a94d-46466c705c97 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:28.938349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d4216-5b47-4e53-8387-93a5c7b1279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:28.939520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d4216-5b47-4e53-8387-93a5c7b1279b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:28.939956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d4216-5b47-4e53-8387-93a5c7b1279b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:28.940278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d4216-5b47-4e53-8387-93a5c7b1279b admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:28.941028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d4216-5b47-4e53-8387-93a5c7b1279b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:05:28.941501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d4216-5b47-4e53-8387-93a5c7b1279b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:28.943300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d4216-5b47-4e53-8387-93a5c7b1279b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:28.965752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d7029-caf3-4dfb-a5da-e842d5501977 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:28.973254 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1942/3857] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:28.979655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d7029-caf3-4dfb-a5da-e842d5501977 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:28.986108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8e1d8-9271-4a69-80e2-bc87837a47b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:28.987181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8e1d8-9271-4a69-80e2-bc87837a47b9 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:28.987181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8e1d8-9271-4a69-80e2-bc87837a47b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:28.987181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8e1d8-9271-4a69-80e2-bc87837a47b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:28.988282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8e1d8-9271-4a69-80e2-bc87837a47b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:28.989942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8e1d8-9271-4a69-80e2-bc87837a47b9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:29.051025 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1916/3858] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:05:28 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:05:29.055752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d4216-5b47-4e53-8387-93a5c7b1279b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:29.072811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d4216-5b47-4e53-8387-93a5c7b1279b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:29.174246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd67531-ac57-44bf-8dca-7effef3fe936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:29.174859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd67531-ac57-44bf-8dca-7effef3fe936 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:29.175146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd67531-ac57-44bf-8dca-7effef3fe936 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:29.175465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd67531-ac57-44bf-8dca-7effef3fe936 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:29.177872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd67531-ac57-44bf-8dca-7effef3fe936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:29.179857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd67531-ac57-44bf-8dca-7effef3fe936 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:29.202702 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1943/3859] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:29 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:29.207066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8e1d8-9271-4a69-80e2-bc87837a47b9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:29.214444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:29.228395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8e1d8-9271-4a69-80e2-bc87837a47b9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:29.235604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c93185-fa43-4a72-94f1-e5859dac05fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:29.236170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93185-fa43-4a72-94f1-e5859dac05fe admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:29.236506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93185-fa43-4a72-94f1-e5859dac05fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:29.236787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93185-fa43-4a72-94f1-e5859dac05fe admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:29.237628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c93185-fa43-4a72-94f1-e5859dac05fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:29.239343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c93185-fa43-4a72-94f1-e5859dac05fe admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:29.253158 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1917/3860] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:29.257308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd67531-ac57-44bf-8dca-7effef3fe936 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:29.259662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c93185-fa43-4a72-94f1-e5859dac05fe admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:29.262067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f2c93185-fa43-4a72-94f1-e5859dac05fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:29.286127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c93185-fa43-4a72-94f1-e5859dac05fe admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:29.295589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd67531-ac57-44bf-8dca-7effef3fe936 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:29.296312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:29.297732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:29.298128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:29.298793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51 admin admin] PATH_INFO: `/v3/projects/527bbe10db744ab4bcc8078f2d754d53` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:29.299904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527bbe10db744ab4bcc8078f2d754d53)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:29.302866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:29.312913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86fc0e-8edf-492c-8930-f200af92ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:29.316118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86fc0e-8edf-492c-8930-f200af92ce24 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:29.316515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86fc0e-8edf-492c-8930-f200af92ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:29.317524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86fc0e-8edf-492c-8930-f200af92ce24 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:29.320372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86fc0e-8edf-492c-8930-f200af92ce24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:29.323982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86fc0e-8edf-492c-8930-f200af92ce24 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:29.343820 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1944/3861] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:29.350903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86fc0e-8edf-492c-8930-f200af92ce24 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:29.366565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86fc0e-8edf-492c-8930-f200af92ce24 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:29.376652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527bbe10db744ab4bcc8078f2d754d53', 'request_id': 'req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:29.402275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:29.408354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527bbe10db744ab4bcc8078f2d754d53', 'request_id': 'req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:29.439655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527bbe10db744ab4bcc8078f2d754d53', 'request_id': 'req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:29.466274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51 admin admin] The token cache is being invalidate because project 527bbe10db744ab4bcc8078f2d754d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:29.466714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:29.468028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2be5d266-b7dc-4f87-a7d8-944ccb9cea51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:29.471111 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1918/3862] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:05:29 2022] DELETE /identity/v3/projects/527bbe10db744ab4bcc8078f2d754d53 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:29.476465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcfb9c-a85d-488a-820e-ef9a756ed1dd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:29.476846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcfb9c-a85d-488a-820e-ef9a756ed1dd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:29.477217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcfb9c-a85d-488a-820e-ef9a756ed1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:29.504879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47b13e-5623-4fe7-be5a-38d2bd81c309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:29.505877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47b13e-5623-4fe7-be5a-38d2bd81c309 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:29.506288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47b13e-5623-4fe7-be5a-38d2bd81c309 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:29.506575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47b13e-5623-4fe7-be5a-38d2bd81c309 admin admin] PATH_INFO: `/v3/projects/c7377184b37740f6898266ee5c621f44/users/88f002556c0f4584b29cb6dbea165876/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:29.507168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2afcfb9c-a85d-488a-820e-ef9a756ed1dd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:29.508535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2afcfb9c-a85d-488a-820e-ef9a756ed1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:29.520887 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1919/3863] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:29.529006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fbffc-c081-4268-a6f8-2515e1ea7133 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:29.529535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fbffc-c081-4268-a6f8-2515e1ea7133 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:29.529949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fbffc-c081-4268-a6f8-2515e1ea7133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:29.531064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47b13e-5623-4fe7-be5a-38d2bd81c309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7377184b37740f6898266ee5c621f44, user_id=88f002556c0f4584b29cb6dbea165876, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:29.534293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47b13e-5623-4fe7-be5a-38d2bd81c309 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:29.564620 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1945/3864] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:05:29 2022] PUT /identity/v3/projects/c7377184b37740f6898266ee5c621f44/users/88f002556c0f4584b29cb6dbea165876/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:29.567565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842409b-b611-4f58-b9ef-b2ad8dc18e67 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:29.567714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842409b-b611-4f58-b9ef-b2ad8dc18e67 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:29.568624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842409b-b611-4f58-b9ef-b2ad8dc18e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:29.578440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-921fbffc-c081-4268-a6f8-2515e1ea7133 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:29.582984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-921fbffc-c081-4268-a6f8-2515e1ea7133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:29.599961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d842409b-b611-4f58-b9ef-b2ad8dc18e67 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:29.601644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d842409b-b611-4f58-b9ef-b2ad8dc18e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:29.705250 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1920/3865] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:29.723176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fbffc-c081-4268-a6f8-2515e1ea7133 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:29.754361 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1946/3866] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:29.790412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fbffc-c081-4268-a6f8-2515e1ea7133 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:29.794632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842409b-b611-4f58-b9ef-b2ad8dc18e67 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:29.799981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca8edd-4239-4d5a-a6b0-6785a9a3aaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:29.800560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d842409b-b611-4f58-b9ef-b2ad8dc18e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:29.802452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca8edd-4239-4d5a-a6b0-6785a9a3aaec admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:29.804275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca8edd-4239-4d5a-a6b0-6785a9a3aaec admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:29.804275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca8edd-4239-4d5a-a6b0-6785a9a3aaec admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:29.807915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca8edd-4239-4d5a-a6b0-6785a9a3aaec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:05:29.809512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca8edd-4239-4d5a-a6b0-6785a9a3aaec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:29.817876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca8edd-4239-4d5a-a6b0-6785a9a3aaec admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:29.854176 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1921/3867] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:29.856731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca8edd-4239-4d5a-a6b0-6785a9a3aaec admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:29.885747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca8edd-4239-4d5a-a6b0-6785a9a3aaec admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:29.902048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052985ef-3aa2-49a0-bc27-c08626a59877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:29.902735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052985ef-3aa2-49a0-bc27-c08626a59877 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:29.903007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052985ef-3aa2-49a0-bc27-c08626a59877 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:29.903278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052985ef-3aa2-49a0-bc27-c08626a59877 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:29.903911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052985ef-3aa2-49a0-bc27-c08626a59877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:29.909244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052985ef-3aa2-49a0-bc27-c08626a59877 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:29.951129 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1922/3868] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:05:29 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:29.955960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052985ef-3aa2-49a0-bc27-c08626a59877 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:29.956813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842409b-b611-4f58-b9ef-b2ad8dc18e67 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:30.007522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:30.048847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052985ef-3aa2-49a0-bc27-c08626a59877 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:30.049238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ae329-087d-4dd2-a03d-695894c00582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:30.050661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ae329-087d-4dd2-a03d-695894c00582 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:30.051720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ae329-087d-4dd2-a03d-695894c00582 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:30.052015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ae329-087d-4dd2-a03d-695894c00582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:30.055671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e779-f8c8-4d79-b6cb-f7402e3cb4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:30.057523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e779-f8c8-4d79-b6cb-f7402e3cb4fe admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:30.058755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e779-f8c8-4d79-b6cb-f7402e3cb4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:30.059526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e779-f8c8-4d79-b6cb-f7402e3cb4fe admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:30.060429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33e779-f8c8-4d79-b6cb-f7402e3cb4fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:30.063913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33e779-f8c8-4d79-b6cb-f7402e3cb4fe admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:30.066599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ae329-087d-4dd2-a03d-695894c00582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:30.068221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ae329-087d-4dd2-a03d-695894c00582 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:30.097883 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1947/3869] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:05:30.104244 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1923/3870] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:29 2022] POST /identity/v3/users => generated 282 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:05:30.108547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ae329-087d-4dd2-a03d-695894c00582 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:30.120342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ae329-087d-4dd2-a03d-695894c00582 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:30.126047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc221e-c975-4671-93cc-5a6bd3570ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:30.126672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc221e-c975-4671-93cc-5a6bd3570ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:30.126957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc221e-c975-4671-93cc-5a6bd3570ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:30.127234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc221e-c975-4671-93cc-5a6bd3570ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:30.128041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc221e-c975-4671-93cc-5a6bd3570ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:30.129721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc221e-c975-4671-93cc-5a6bd3570ef2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:30.131371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:30.143583 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1948/3871] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:30.148478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e779-f8c8-4d79-b6cb-f7402e3cb4fe admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:30.160715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e779-f8c8-4d79-b6cb-f7402e3cb4fe admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:30.166127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18532494-70b7-4a05-92bd-fd59524529a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:30.166919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18532494-70b7-4a05-92bd-fd59524529a7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:30.167309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18532494-70b7-4a05-92bd-fd59524529a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:30.167691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18532494-70b7-4a05-92bd-fd59524529a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:30.168458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18532494-70b7-4a05-92bd-fd59524529a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:30.170521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18532494-70b7-4a05-92bd-fd59524529a7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:30.187714 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1924/3872] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:30.188715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc221e-c975-4671-93cc-5a6bd3570ef2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:30.202013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc221e-c975-4671-93cc-5a6bd3570ef2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:30.208593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e44a0a-5d10-46f2-a36a-b11796c563d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:30.210178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e44a0a-5d10-46f2-a36a-b11796c563d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:30.210178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e44a0a-5d10-46f2-a36a-b11796c563d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:30.210178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e44a0a-5d10-46f2-a36a-b11796c563d8 admin admin] PATH_INFO: `/v3/projects/e7ded993145b4eda9d6a33b994519012/users/06443b5728fb4d1e95d6245820e786bf/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:30.227948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e44a0a-5d10-46f2-a36a-b11796c563d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ded993145b4eda9d6a33b994519012, user_id=06443b5728fb4d1e95d6245820e786bf, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:30.230915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e44a0a-5d10-46f2-a36a-b11796c563d8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:30.253318 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1949/3873] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:05:30 2022] PUT /identity/v3/projects/e7ded993145b4eda9d6a33b994519012/users/06443b5728fb4d1e95d6245820e786bf/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:30.255590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def13cd5-2511-4ba7-8270-11a726c5c90c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:30.255990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def13cd5-2511-4ba7-8270-11a726c5c90c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:30.256646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def13cd5-2511-4ba7-8270-11a726c5c90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:30.282236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-def13cd5-2511-4ba7-8270-11a726c5c90c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:30.283838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-def13cd5-2511-4ba7-8270-11a726c5c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:30.384015 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1925/3874] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:30.413442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e44a0a-5d10-46f2-a36a-b11796c563d8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:30.415657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f9e44a0a-5d10-46f2-a36a-b11796c563d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:30.437225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def13cd5-2511-4ba7-8270-11a726c5c90c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:30.439676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-def13cd5-2511-4ba7-8270-11a726c5c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:30.458312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def13cd5-2511-4ba7-8270-11a726c5c90c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:30.466365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:30.467401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:30.468658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:30.469559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] PATH_INFO: `/v3/projects/d2abacb798e24ea0a3a525f299497c59` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:30.471205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2abacb798e24ea0a3a525f299497c59)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:30.478981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:30.549467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e44a0a-5d10-46f2-a36a-b11796c563d8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:30.555404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a86a00-c94f-49a8-800d-b8999b927f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:30.556395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a86a00-c94f-49a8-800d-b8999b927f03 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:30.556817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a86a00-c94f-49a8-800d-b8999b927f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:30.557273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a86a00-c94f-49a8-800d-b8999b927f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:30.579033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a86a00-c94f-49a8-800d-b8999b927f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:30.581250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a86a00-c94f-49a8-800d-b8999b927f03 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:30.597877 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1950/3875] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:05:30.738662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2abacb798e24ea0a3a525f299497c59', 'request_id': 'req-f30b7f38-d81a-4656-8c54-27975a78b6f1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:30.751350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2abacb798e24ea0a3a525f299497c59', 'request_id': 'req-f30b7f38-d81a-4656-8c54-27975a78b6f1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:30.761803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2abacb798e24ea0a3a525f299497c59', 'request_id': 'req-f30b7f38-d81a-4656-8c54-27975a78b6f1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:30.777463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] The token cache is being invalidate because project d2abacb798e24ea0a3a525f299497c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:30.777754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:30.778513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:30.782502 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1926/3876] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:05:30 2022] DELETE /identity/v3/projects/d2abacb798e24ea0a3a525f299497c59 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:30.786610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a86a00-c94f-49a8-800d-b8999b927f03 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:30.802800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a86a00-c94f-49a8-800d-b8999b927f03 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:30.934947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13130639-9374-47c7-b90f-03bf41048752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:30.935833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13130639-9374-47c7-b90f-03bf41048752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:30.936525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13130639-9374-47c7-b90f-03bf41048752 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:30.936525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13130639-9374-47c7-b90f-03bf41048752 admin admin] PATH_INFO: `/v3/users/d328b7cca18c4ed7b76366881467803b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:30.938641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13130639-9374-47c7-b90f-03bf41048752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d328b7cca18c4ed7b76366881467803b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:30.940991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13130639-9374-47c7-b90f-03bf41048752 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:31.037923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-13130639-9374-47c7-b90f-03bf41048752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd328b7cca18c4ed7b76366881467803b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:31.054073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-13130639-9374-47c7-b90f-03bf41048752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd328b7cca18c4ed7b76366881467803b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:31.055522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-13130639-9374-47c7-b90f-03bf41048752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd328b7cca18c4ed7b76366881467803b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:31.057330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-13130639-9374-47c7-b90f-03bf41048752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd328b7cca18c4ed7b76366881467803b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:31.082513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-13130639-9374-47c7-b90f-03bf41048752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd328b7cca18c4ed7b76366881467803b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:31.089685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:31.116598 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1951/3877] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:30 2022] DELETE /identity/v3/users/d328b7cca18c4ed7b76366881467803b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:33.242035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:33.245023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:33.278928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b7f38-d81a-4656-8c54-27975a78b6f1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:33.347892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:33.383329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b94baa-5032-4c20-9ccf-7882a428d185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:33.383994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b94baa-5032-4c20-9ccf-7882a428d185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:33.384282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b94baa-5032-4c20-9ccf-7882a428d185 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:33.384587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b94baa-5032-4c20-9ccf-7882a428d185 admin admin] PATH_INFO: `/v3/projects/7c1585ce9b7d47efa50bce451db82312` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:33.385773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b94baa-5032-4c20-9ccf-7882a428d185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1585ce9b7d47efa50bce451db82312)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:33.388817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b94baa-5032-4c20-9ccf-7882a428d185 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:33.467201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e6b94baa-5032-4c20-9ccf-7882a428d185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1585ce9b7d47efa50bce451db82312', 'request_id': 'req-e6b94baa-5032-4c20-9ccf-7882a428d185'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:33.496499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e6b94baa-5032-4c20-9ccf-7882a428d185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1585ce9b7d47efa50bce451db82312', 'request_id': 'req-e6b94baa-5032-4c20-9ccf-7882a428d185'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:33.508638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e6b94baa-5032-4c20-9ccf-7882a428d185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1585ce9b7d47efa50bce451db82312', 'request_id': 'req-e6b94baa-5032-4c20-9ccf-7882a428d185'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:33.524954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e6b94baa-5032-4c20-9ccf-7882a428d185 admin admin] The token cache is being invalidate because project 7c1585ce9b7d47efa50bce451db82312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:33.525344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e6b94baa-5032-4c20-9ccf-7882a428d185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:33.526186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e6b94baa-5032-4c20-9ccf-7882a428d185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:33.532500 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1927/3878] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:05:33 2022] DELETE /identity/v3/projects/7c1585ce9b7d47efa50bce451db82312 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:33.534142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7510cf-65c2-4a0f-8083-81f9fe074c04 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:33.534694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7510cf-65c2-4a0f-8083-81f9fe074c04 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:33.534694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7510cf-65c2-4a0f-8083-81f9fe074c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:33.569380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fb7510cf-65c2-4a0f-8083-81f9fe074c04 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:33.571131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fb7510cf-65c2-4a0f-8083-81f9fe074c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:33.690406 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1952/3879] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:33.699150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa649ec-fde7-414e-a7f4-a3d71b25321b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:33.699352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa649ec-fde7-414e-a7f4-a3d71b25321b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:33.699623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa649ec-fde7-414e-a7f4-a3d71b25321b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:33.744298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5aa649ec-fde7-414e-a7f4-a3d71b25321b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:33.757548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5aa649ec-fde7-414e-a7f4-a3d71b25321b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:33.786157 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1928/3880] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:33.788248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7510cf-65c2-4a0f-8083-81f9fe074c04 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:33.809250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7510cf-65c2-4a0f-8083-81f9fe074c04 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:33.822735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef958aab-67b4-400f-8010-d4f2d2b9b548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:33.828898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef958aab-67b4-400f-8010-d4f2d2b9b548 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:33.830063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef958aab-67b4-400f-8010-d4f2d2b9b548 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:33.831663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef958aab-67b4-400f-8010-d4f2d2b9b548 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:33.832394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef958aab-67b4-400f-8010-d4f2d2b9b548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:05:33.833576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef958aab-67b4-400f-8010-d4f2d2b9b548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:33.835342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef958aab-67b4-400f-8010-d4f2d2b9b548 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:33.853050 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1953/3881] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:33.857374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa649ec-fde7-414e-a7f4-a3d71b25321b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:33.873076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa649ec-fde7-414e-a7f4-a3d71b25321b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:33.879832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3fb1f-a10f-4472-a7b0-ef683c7098f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:33.881795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3fb1f-a10f-4472-a7b0-ef683c7098f5 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:33.882129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3fb1f-a10f-4472-a7b0-ef683c7098f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:33.882401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3fb1f-a10f-4472-a7b0-ef683c7098f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:33.883041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3fb1f-a10f-4472-a7b0-ef683c7098f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:33.884953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3fb1f-a10f-4472-a7b0-ef683c7098f5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:33.972502 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1929/3882] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:05:33 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:33.973869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef958aab-67b4-400f-8010-d4f2d2b9b548 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:33.992471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef958aab-67b4-400f-8010-d4f2d2b9b548 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:34.167507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3f559-84ea-4142-815b-3199cd3cc3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:34.168181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3f559-84ea-4142-815b-3199cd3cc3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:34.168408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3f559-84ea-4142-815b-3199cd3cc3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:34.168677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3f559-84ea-4142-815b-3199cd3cc3a2 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:34.173732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3f559-84ea-4142-815b-3199cd3cc3a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:34.176489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3f559-84ea-4142-815b-3199cd3cc3a2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:34.238653 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1954/3883] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:33 2022] POST /identity/v3/users => generated 286 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:05:34.242628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3fb1f-a10f-4472-a7b0-ef683c7098f5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:34.265450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3fb1f-a10f-4472-a7b0-ef683c7098f5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:34.279431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffc658-dfda-4524-8656-e5463f2d827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:34.280858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffc658-dfda-4524-8656-e5463f2d827f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:34.281142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffc658-dfda-4524-8656-e5463f2d827f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:34.282003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffc658-dfda-4524-8656-e5463f2d827f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:34.286759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffc658-dfda-4524-8656-e5463f2d827f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:34.290320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffc658-dfda-4524-8656-e5463f2d827f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:34.327649 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1930/3884] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:34.332456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3f559-84ea-4142-815b-3199cd3cc3a2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:34.358904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3f559-84ea-4142-815b-3199cd3cc3a2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:34.365450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4e83-9f0c-47e5-93e2-a6b656a47b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:34.366999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4e83-9f0c-47e5-93e2-a6b656a47b8d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:34.367503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4e83-9f0c-47e5-93e2-a6b656a47b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:34.368029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4e83-9f0c-47e5-93e2-a6b656a47b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:34.368879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c4e83-9f0c-47e5-93e2-a6b656a47b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:34.370911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c4e83-9f0c-47e5-93e2-a6b656a47b8d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:34.384976 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1955/3885] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:34.388890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffc658-dfda-4524-8656-e5463f2d827f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:34.401081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffc658-dfda-4524-8656-e5463f2d827f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:34.409905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259b130-0778-4de9-a959-c49666b6eac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:34.411759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259b130-0778-4de9-a959-c49666b6eac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:34.412403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259b130-0778-4de9-a959-c49666b6eac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:34.413351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259b130-0778-4de9-a959-c49666b6eac7 admin admin] PATH_INFO: `/v3/projects/623d434718904f2097dbbd99442a7ff4/users/64b8de4514824b0f95baeb6082881f6c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:34.439238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259b130-0778-4de9-a959-c49666b6eac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=623d434718904f2097dbbd99442a7ff4, user_id=64b8de4514824b0f95baeb6082881f6c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:34.443171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259b130-0778-4de9-a959-c49666b6eac7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:34.487921 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1931/3886] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:05:34 2022] PUT /identity/v3/projects/623d434718904f2097dbbd99442a7ff4/users/64b8de4514824b0f95baeb6082881f6c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:34.498405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7867e-951a-455b-8e65-f9561aff550c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:34.499051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7867e-951a-455b-8e65-f9561aff550c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:34.499534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7867e-951a-455b-8e65-f9561aff550c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:34.589812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8af7867e-951a-455b-8e65-f9561aff550c None None] MFA Rules not processed for user `64b8de4514824b0f95baeb6082881f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:34.591937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8af7867e-951a-455b-8e65-f9561aff550c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:34.784742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:34.837177 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1956/3887] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:34.841631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259b130-0778-4de9-a959-c49666b6eac7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:35.014932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259b130-0778-4de9-a959-c49666b6eac7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:35.031230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93296026-1208-4c56-b1fc-cc9090646d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:35.031997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93296026-1208-4c56-b1fc-cc9090646d41 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:35.032284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93296026-1208-4c56-b1fc-cc9090646d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:35.032556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93296026-1208-4c56-b1fc-cc9090646d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:35.033305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93296026-1208-4c56-b1fc-cc9090646d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:35.035250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93296026-1208-4c56-b1fc-cc9090646d41 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:35.060028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:35.105912 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1932/3888] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:05:34 2022] POST /identity/v3/projects => generated 371 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:35.110176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7867e-951a-455b-8e65-f9561aff550c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:35.126040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7867e-951a-455b-8e65-f9561aff550c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:35.315395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b60c47-f225-42c5-9403-59200ae954c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:35.316651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b60c47-f225-42c5-9403-59200ae954c7 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:35.317273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b60c47-f225-42c5-9403-59200ae954c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:35.317715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b60c47-f225-42c5-9403-59200ae954c7 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:35.318487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b60c47-f225-42c5-9403-59200ae954c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:35.322222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b60c47-f225-42c5-9403-59200ae954c7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:35.392158 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1957/3889] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:35 2022] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:35.395166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93296026-1208-4c56-b1fc-cc9090646d41 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:35.416704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93296026-1208-4c56-b1fc-cc9090646d41 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:35.431219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087748a-1784-4355-bf21-37e9bafff12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:35.433512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087748a-1784-4355-bf21-37e9bafff12c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:35.434259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087748a-1784-4355-bf21-37e9bafff12c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:35.435271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087748a-1784-4355-bf21-37e9bafff12c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:35.437826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087748a-1784-4355-bf21-37e9bafff12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:35.439649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087748a-1784-4355-bf21-37e9bafff12c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:35.472555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b60c47-f225-42c5-9403-59200ae954c7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:35.497442 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1933/3890] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:35.510892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b60c47-f225-42c5-9403-59200ae954c7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:35.517588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8cd44-4a52-4def-a146-686d7a6c0d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:35.519638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8cd44-4a52-4def-a146-686d7a6c0d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:35.520210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8cd44-4a52-4def-a146-686d7a6c0d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:35.520809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8cd44-4a52-4def-a146-686d7a6c0d6d admin admin] PATH_INFO: `/v3/projects/9f75240d7478454594425a3d130e7e8b/users/81d09e291e7646758e3595d1e0add133/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:35.544884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8cd44-4a52-4def-a146-686d7a6c0d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f75240d7478454594425a3d130e7e8b, user_id=81d09e291e7646758e3595d1e0add133, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:35.548353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8cd44-4a52-4def-a146-686d7a6c0d6d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:35.572181 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1958/3891] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:05:35 2022] PUT /identity/v3/projects/9f75240d7478454594425a3d130e7e8b/users/81d09e291e7646758e3595d1e0add133/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:35.572547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087748a-1784-4355-bf21-37e9bafff12c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:35.586078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087748a-1784-4355-bf21-37e9bafff12c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:35.691523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef750adf-98a0-41ff-b138-024fc8edb57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:35.691873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef750adf-98a0-41ff-b138-024fc8edb57c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:35.692237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef750adf-98a0-41ff-b138-024fc8edb57c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:35.693312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef750adf-98a0-41ff-b138-024fc8edb57c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:35.694335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef750adf-98a0-41ff-b138-024fc8edb57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:35.697167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef750adf-98a0-41ff-b138-024fc8edb57c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:35.717979 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1934/3892] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:35.719920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8cd44-4a52-4def-a146-686d7a6c0d6d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:35.738266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8cd44-4a52-4def-a146-686d7a6c0d6d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:35.753756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594e6d7-f65e-4a75-bf1c-0c1b96ce59ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:35.758184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594e6d7-f65e-4a75-bf1c-0c1b96ce59ac admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:35.759639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594e6d7-f65e-4a75-bf1c-0c1b96ce59ac admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:35.760757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594e6d7-f65e-4a75-bf1c-0c1b96ce59ac admin admin] PATH_INFO: `/v3/projects/9f75240d7478454594425a3d130e7e8b/users/81d09e291e7646758e3595d1e0add133/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:35.770530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594e6d7-f65e-4a75-bf1c-0c1b96ce59ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f75240d7478454594425a3d130e7e8b, user_id=81d09e291e7646758e3595d1e0add133, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:35.775881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594e6d7-f65e-4a75-bf1c-0c1b96ce59ac admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:35.805300 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1959/3893] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:05:35 2022] PUT /identity/v3/projects/9f75240d7478454594425a3d130e7e8b/users/81d09e291e7646758e3595d1e0add133/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:35.818148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db079c-cd22-4299-96eb-66bffc17e7a0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:35.818913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db079c-cd22-4299-96eb-66bffc17e7a0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:35.820014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db079c-cd22-4299-96eb-66bffc17e7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:35.944859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-59db079c-cd22-4299-96eb-66bffc17e7a0 None None] MFA Rules not processed for user `81d09e291e7646758e3595d1e0add133`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:35.947991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-59db079c-cd22-4299-96eb-66bffc17e7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:36.162975 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1935/3894] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:36.166677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594e6d7-f65e-4a75-bf1c-0c1b96ce59ac admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:36.184111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594e6d7-f65e-4a75-bf1c-0c1b96ce59ac admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:36.196771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82e0eb-cd75-4240-a16f-d244cb878873 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:36.197445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82e0eb-cd75-4240-a16f-d244cb878873 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:36.197728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82e0eb-cd75-4240-a16f-d244cb878873 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:36.198002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82e0eb-cd75-4240-a16f-d244cb878873 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:36.198741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82e0eb-cd75-4240-a16f-d244cb878873 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:36.202189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82e0eb-cd75-4240-a16f-d244cb878873 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:36.237993 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1960/3895] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:05:36 2022] POST /identity/v3/domains => generated 276 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:36.240688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db079c-cd22-4299-96eb-66bffc17e7a0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:36.274811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db079c-cd22-4299-96eb-66bffc17e7a0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:36.389906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:36.398123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c6133-9161-4983-b1ae-96fef0a5fcc7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:36.400385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c6133-9161-4983-b1ae-96fef0a5fcc7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:36.400678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c6133-9161-4983-b1ae-96fef0a5fcc7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:36.401538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c6133-9161-4983-b1ae-96fef0a5fcc7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:36.403554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c6133-9161-4983-b1ae-96fef0a5fcc7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:36.408071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c6133-9161-4983-b1ae-96fef0a5fcc7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:36.523164 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1936/3896] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:05:36 2022] POST /identity/v3/projects => generated 402 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:36.523371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82e0eb-cd75-4240-a16f-d244cb878873 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:36.539112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82e0eb-cd75-4240-a16f-d244cb878873 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:36.636449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8709e-4066-4921-b145-355aa8d7118c tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:36.649440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8709e-4066-4921-b145-355aa8d7118c tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:36.649440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8709e-4066-4921-b145-355aa8d7118c tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:36.649440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8709e-4066-4921-b145-355aa8d7118c tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/groups` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:36.649440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8709e-4066-4921-b145-355aa8d7118c tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:36.649440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8709e-4066-4921-b145-355aa8d7118c tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:36.672939 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1961/3897] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:05:36 2022] POST /identity/v3/groups => generated 302 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:36.676794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c6133-9161-4983-b1ae-96fef0a5fcc7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:36.694525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c6133-9161-4983-b1ae-96fef0a5fcc7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:36.699749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8192c46-ac5c-4ff8-a53c-13b7de0ab89f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:36.700907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8192c46-ac5c-4ff8-a53c-13b7de0ab89f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:36.700907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8192c46-ac5c-4ff8-a53c-13b7de0ab89f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:36.700907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8192c46-ac5c-4ff8-a53c-13b7de0ab89f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:36.701606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8192c46-ac5c-4ff8-a53c-13b7de0ab89f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:36.704117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8192c46-ac5c-4ff8-a53c-13b7de0ab89f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:36.723190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766647-a9c8-423c-aba0-0d1d81ae04eb None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:36.723696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766647-a9c8-423c-aba0-0d1d81ae04eb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:36.723893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766647-a9c8-423c-aba0-0d1d81ae04eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:36.759916 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1937/3898] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:36 2022] POST /identity/v3/users => generated 445 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:36.762017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8192c46-ac5c-4ff8-a53c-13b7de0ab89f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:36.777770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-26766647-a9c8-423c-aba0-0d1d81ae04eb None None] MFA Rules not processed for user `fc2bdd169daf4a1db830b1fa7f94f0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:36.783671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-26766647-a9c8-423c-aba0-0d1d81ae04eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:36.788238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8192c46-ac5c-4ff8-a53c-13b7de0ab89f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:36.805048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502e7c5-e2b9-441f-9153-3beabbb037d8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:36.805768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e7c5-e2b9-441f-9153-3beabbb037d8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:36.806054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e7c5-e2b9-441f-9153-3beabbb037d8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:36.806336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e7c5-e2b9-441f-9153-3beabbb037d8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:36.807068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502e7c5-e2b9-441f-9153-3beabbb037d8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:36.808113 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-8502e7c5-e2b9-441f-9153-3beabbb037d8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:36.808113 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:36.808113 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:36.808995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502e7c5-e2b9-441f-9153-3beabbb037d8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:36.832532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:36.844767 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1938/3899] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:05:36 2022] POST /identity/v3/roles => generated 239 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:36.851172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502e7c5-e2b9-441f-9153-3beabbb037d8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:36.878637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502e7c5-e2b9-441f-9153-3beabbb037d8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:36.898402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b985be-6580-420d-9b6a-d897d6e28cf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:36.899099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b985be-6580-420d-9b6a-d897d6e28cf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:36.899386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b985be-6580-420d-9b6a-d897d6e28cf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:36.899666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b985be-6580-420d-9b6a-d897d6e28cf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/a0990c1d9e294847bdbc7285dd138e55/inherited_to_projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:36.920039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b985be-6580-420d-9b6a-d897d6e28cf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_grant(project_id=06d2235253e24be29954ebb8e2c25b42, group_id=677c5f31d8c54d9b9c01d6aca3f75725, role_id=a0990c1d9e294847bdbc7285dd138e55)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:36.940427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b985be-6580-420d-9b6a-d897d6e28cf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:36.959909 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1939/3900] 10.222.0.26 () {60 vars in 1585 bytes} [Sat Oct 8 21:05:36 2022] PUT /identity/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/a0990c1d9e294847bdbc7285dd138e55/inherited_to_projects => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:36.974400 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1962/3901] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:05:36.974857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b985be-6580-420d-9b6a-d897d6e28cf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:36.976969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a5d61-8e4a-4e39-a8c5-fe4eeed59839 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:36.977412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a5d61-8e4a-4e39-a8c5-fe4eeed59839 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:36.979118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a5d61-8e4a-4e39-a8c5-fe4eeed59839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:37.022027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cf2a5d61-8e4a-4e39-a8c5-fe4eeed59839 None None] MFA Rules not processed for user `fc2bdd169daf4a1db830b1fa7f94f0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:37.023819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cf2a5d61-8e4a-4e39-a8c5-fe4eeed59839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:37.122241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b985be-6580-420d-9b6a-d897d6e28cf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:37.138882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6514c-6834-4476-a274-9345104ed07a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:37.139629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6514c-6834-4476-a274-9345104ed07a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:37.139930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6514c-6834-4476-a274-9345104ed07a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:37.140110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6514c-6834-4476-a274-9345104ed07a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/a0990c1d9e294847bdbc7285dd138e55/inherited_to_projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:37.143753 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1963/3902] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:37.144870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6514c-6834-4476-a274-9345104ed07a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:check_grant(project_id=06d2235253e24be29954ebb8e2c25b42, group_id=677c5f31d8c54d9b9c01d6aca3f75725, role_id=a0990c1d9e294847bdbc7285dd138e55)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:37.145958 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-56e6514c-6834-4476-a274-9345104ed07a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:37.145958 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:37.145958 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:37.147900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6514c-6834-4476-a274-9345104ed07a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:37.174923 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1940/3903] 10.222.0.26 () {58 vars in 1567 bytes} [Sat Oct 8 21:05:36 2022] HEAD /identity/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/a0990c1d9e294847bdbc7285dd138e55/inherited_to_projects => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:37.179719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a5d61-8e4a-4e39-a8c5-fe4eeed59839 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:37.204869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a5d61-8e4a-4e39-a8c5-fe4eeed59839 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:37.212589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8796b5f-dde8-466d-b00e-0ebce3167a61 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:37.213496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8796b5f-dde8-466d-b00e-0ebce3167a61 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:37.213923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8796b5f-dde8-466d-b00e-0ebce3167a61 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:37.214051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8796b5f-dde8-466d-b00e-0ebce3167a61 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/a0990c1d9e294847bdbc7285dd138e55/inherited_to_projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:37.216901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8796b5f-dde8-466d-b00e-0ebce3167a61 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=06d2235253e24be29954ebb8e2c25b42, group_id=677c5f31d8c54d9b9c01d6aca3f75725, role_id=a0990c1d9e294847bdbc7285dd138e55)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:37.218209 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-a8796b5f-dde8-466d-b00e-0ebce3167a61 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:37.218209 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:37.218209 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:37.222298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8796b5f-dde8-466d-b00e-0ebce3167a61 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:37.242131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a8796b5f-dde8-466d-b00e-0ebce3167a61 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invalidating the token cache because role a0990c1d9e294847bdbc7285dd138e55 was removed from group 677c5f31d8c54d9b9c01d6aca3f75725 on project 06d2235253e24be29954ebb8e2c25b42. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:37.242430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a8796b5f-dde8-466d-b00e-0ebce3167a61 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:37.248497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a8796b5f-dde8-466d-b00e-0ebce3167a61 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:37.294108 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1964/3904] 10.222.0.26 () {58 vars in 1569 bytes} [Sat Oct 8 21:05:37 2022] DELETE /identity/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/a0990c1d9e294847bdbc7285dd138e55/inherited_to_projects => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:37.299545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6514c-6834-4476-a274-9345104ed07a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:37.317746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-56e6514c-6834-4476-a274-9345104ed07a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:37.357627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6514c-6834-4476-a274-9345104ed07a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:37.500751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec447c-4ab1-400d-96a4-b1e41ca88fdf tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:37.501429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec447c-4ab1-400d-96a4-b1e41ca88fdf tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:37.501746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec447c-4ab1-400d-96a4-b1e41ca88fdf tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:37.501969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec447c-4ab1-400d-96a4-b1e41ca88fdf tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/roles/a0990c1d9e294847bdbc7285dd138e55` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:37.509232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec447c-4ab1-400d-96a4-b1e41ca88fdf tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a0990c1d9e294847bdbc7285dd138e55)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:37.509748 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-c4ec447c-4ab1-400d-96a4-b1e41ca88fdf tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:37.509748 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:37.509748 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:37.510653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec447c-4ab1-400d-96a4-b1e41ca88fdf tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:37.570366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:37.598065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c4ec447c-4ab1-400d-96a4-b1e41ca88fdf tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invalidating the token cache because role a0990c1d9e294847bdbc7285dd138e55 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:37.598668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c4ec447c-4ab1-400d-96a4-b1e41ca88fdf tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:37.599754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c4ec447c-4ab1-400d-96a4-b1e41ca88fdf tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:37.602645 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1941/3905] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:37 2022] DELETE /identity/v3/roles/a0990c1d9e294847bdbc7285dd138e55 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:37.609979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8796b5f-dde8-466d-b00e-0ebce3167a61 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:37.625462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8796b5f-dde8-466d-b00e-0ebce3167a61 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:37.730441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc1bd7-0656-418f-98c8-8ad7c46d2929 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:37.733722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc1bd7-0656-418f-98c8-8ad7c46d2929 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:37.733722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc1bd7-0656-418f-98c8-8ad7c46d2929 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:37.733722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc1bd7-0656-418f-98c8-8ad7c46d2929 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:37.741261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc1bd7-0656-418f-98c8-8ad7c46d2929 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:37.741261 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-e7fc1bd7-0656-418f-98c8-8ad7c46d2929 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:37.741261 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:37.741261 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:37.741261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc1bd7-0656-418f-98c8-8ad7c46d2929 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:37.786930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec447c-4ab1-400d-96a4-b1e41ca88fdf tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:37.788420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c4ec447c-4ab1-400d-96a4-b1e41ca88fdf tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:37.797649 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1965/3906] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:05:37 2022] POST /identity/v3/roles => generated 239 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:37.806421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec447c-4ab1-400d-96a4-b1e41ca88fdf tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:37.815273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fc563-9a70-4160-bb6b-43de305d0f64 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:37.816132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fc563-9a70-4160-bb6b-43de305d0f64 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:37.817276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fc563-9a70-4160-bb6b-43de305d0f64 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:37.817688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fc563-9a70-4160-bb6b-43de305d0f64 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/users/c65846d6a3fe44b0bac7dceb1d773368/roles/5caf5afa8b914ab9a1ec25299991c908/inherited_to_projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:37.845203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fc563-9a70-4160-bb6b-43de305d0f64 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_grant(project_id=06d2235253e24be29954ebb8e2c25b42, user_id=c65846d6a3fe44b0bac7dceb1d773368, role_id=5caf5afa8b914ab9a1ec25299991c908)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:37.848264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fc563-9a70-4160-bb6b-43de305d0f64 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:37.873760 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1942/3907] 10.222.0.26 () {60 vars in 1582 bytes} [Sat Oct 8 21:05:37 2022] PUT /identity/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/users/c65846d6a3fe44b0bac7dceb1d773368/roles/5caf5afa8b914ab9a1ec25299991c908/inherited_to_projects => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:37.875167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc1bd7-0656-418f-98c8-8ad7c46d2929 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:37.893540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc1bd7-0656-418f-98c8-8ad7c46d2929 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:37.980806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:38.005815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122128bc-8113-4bdb-a219-c4a228109db9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:38.006602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122128bc-8113-4bdb-a219-c4a228109db9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:38.006937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122128bc-8113-4bdb-a219-c4a228109db9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:38.007231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122128bc-8113-4bdb-a219-c4a228109db9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/users/c65846d6a3fe44b0bac7dceb1d773368/roles/5caf5afa8b914ab9a1ec25299991c908/inherited_to_projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:38.009579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122128bc-8113-4bdb-a219-c4a228109db9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:check_grant(project_id=06d2235253e24be29954ebb8e2c25b42, user_id=c65846d6a3fe44b0bac7dceb1d773368, role_id=5caf5afa8b914ab9a1ec25299991c908)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:38.010615 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-122128bc-8113-4bdb-a219-c4a228109db9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:38.010615 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:38.010615 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:38.012834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122128bc-8113-4bdb-a219-c4a228109db9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:38.025671 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1966/3908] 10.222.0.26 () {58 vars in 1564 bytes} [Sat Oct 8 21:05:37 2022] HEAD /identity/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/users/c65846d6a3fe44b0bac7dceb1d773368/roles/5caf5afa8b914ab9a1ec25299991c908/inherited_to_projects => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:38.028311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fc563-9a70-4160-bb6b-43de305d0f64 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:38.057318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fc563-9a70-4160-bb6b-43de305d0f64 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:38.083667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1305c8-475d-4497-9a24-f1b1d4346b3f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:38.085110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1305c8-475d-4497-9a24-f1b1d4346b3f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:38.085504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1305c8-475d-4497-9a24-f1b1d4346b3f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:38.085793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1305c8-475d-4497-9a24-f1b1d4346b3f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/users/c65846d6a3fe44b0bac7dceb1d773368/roles/5caf5afa8b914ab9a1ec25299991c908/inherited_to_projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:38.092067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1305c8-475d-4497-9a24-f1b1d4346b3f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=06d2235253e24be29954ebb8e2c25b42, user_id=c65846d6a3fe44b0bac7dceb1d773368, role_id=5caf5afa8b914ab9a1ec25299991c908)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:38.093143 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-fd1305c8-475d-4497-9a24-f1b1d4346b3f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:38.093143 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:38.093143 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:38.095610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1305c8-475d-4497-9a24-f1b1d4346b3f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:38.103943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fd1305c8-475d-4497-9a24-f1b1d4346b3f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invalidating the token cache because role 5caf5afa8b914ab9a1ec25299991c908 was removed from user c65846d6a3fe44b0bac7dceb1d773368 on project 06d2235253e24be29954ebb8e2c25b42. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:38.104354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fd1305c8-475d-4497-9a24-f1b1d4346b3f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:38.105824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fd1305c8-475d-4497-9a24-f1b1d4346b3f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:38.173823 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1943/3909] 10.222.0.26 () {58 vars in 1566 bytes} [Sat Oct 8 21:05:38 2022] DELETE /identity/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/users/c65846d6a3fe44b0bac7dceb1d773368/roles/5caf5afa8b914ab9a1ec25299991c908/inherited_to_projects => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:38.177583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122128bc-8113-4bdb-a219-c4a228109db9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:38.181590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-122128bc-8113-4bdb-a219-c4a228109db9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:38.208856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122128bc-8113-4bdb-a219-c4a228109db9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:38.294093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74241e7-8c89-4e02-93c9-2dee90ec479f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:38.295459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74241e7-8c89-4e02-93c9-2dee90ec479f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:38.299010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74241e7-8c89-4e02-93c9-2dee90ec479f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:38.299467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74241e7-8c89-4e02-93c9-2dee90ec479f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/roles/5caf5afa8b914ab9a1ec25299991c908` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:38.301223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74241e7-8c89-4e02-93c9-2dee90ec479f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5caf5afa8b914ab9a1ec25299991c908)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:38.317351 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-d74241e7-8c89-4e02-93c9-2dee90ec479f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:38.317351 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:38.317351 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:38.318931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74241e7-8c89-4e02-93c9-2dee90ec479f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:38.497516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d74241e7-8c89-4e02-93c9-2dee90ec479f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invalidating the token cache because role 5caf5afa8b914ab9a1ec25299991c908 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:38.497809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d74241e7-8c89-4e02-93c9-2dee90ec479f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:38.498485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d74241e7-8c89-4e02-93c9-2dee90ec479f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:38.511360 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1967/3910] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:38 2022] DELETE /identity/v3/roles/5caf5afa8b914ab9a1ec25299991c908 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:38.516106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1305c8-475d-4497-9a24-f1b1d4346b3f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:38.541493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1305c8-475d-4497-9a24-f1b1d4346b3f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:38.663361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffaa2e5-a1b4-4689-9342-f511e5963dd1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:38.664445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffaa2e5-a1b4-4689-9342-f511e5963dd1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:38.664949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffaa2e5-a1b4-4689-9342-f511e5963dd1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:38.665644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffaa2e5-a1b4-4689-9342-f511e5963dd1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:38.666623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffaa2e5-a1b4-4689-9342-f511e5963dd1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:38.668543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffaa2e5-a1b4-4689-9342-f511e5963dd1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:38.693489 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1944/3911] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:05:38 2022] POST /identity/v3/roles => generated 239 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:38.699033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74241e7-8c89-4e02-93c9-2dee90ec479f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:38.701624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d74241e7-8c89-4e02-93c9-2dee90ec479f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:38.717765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74241e7-8c89-4e02-93c9-2dee90ec479f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:38.739565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bdd53-0b23-4313-bfaa-dd3085c4a6d0 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:38.742901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bdd53-0b23-4313-bfaa-dd3085c4a6d0 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:38.743503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bdd53-0b23-4313-bfaa-dd3085c4a6d0 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:38.744026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bdd53-0b23-4313-bfaa-dd3085c4a6d0 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/eaae82db90a74ba2a78f1935d29d88b9/inherited_to_projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:38.754361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bdd53-0b23-4313-bfaa-dd3085c4a6d0 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=28c79920c3c94fe985f4a415a8dacf17, group_id=677c5f31d8c54d9b9c01d6aca3f75725, role_id=eaae82db90a74ba2a78f1935d29d88b9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:38.760175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bdd53-0b23-4313-bfaa-dd3085c4a6d0 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:38.794495 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1968/3912] 10.222.0.26 () {60 vars in 1582 bytes} [Sat Oct 8 21:05:38 2022] PUT /identity/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/eaae82db90a74ba2a78f1935d29d88b9/inherited_to_projects => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:38.799358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffaa2e5-a1b4-4689-9342-f511e5963dd1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:38.823606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffaa2e5-a1b4-4689-9342-f511e5963dd1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:38.972317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d89e6e-b927-44c0-a74e-5684ebe6a6fa tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:38.972998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d89e6e-b927-44c0-a74e-5684ebe6a6fa tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:38.973638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d89e6e-b927-44c0-a74e-5684ebe6a6fa tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:38.973984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d89e6e-b927-44c0-a74e-5684ebe6a6fa tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/inherited_to_projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:38.978824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d89e6e-b927-44c0-a74e-5684ebe6a6fa tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=28c79920c3c94fe985f4a415a8dacf17, group_id=677c5f31d8c54d9b9c01d6aca3f75725)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:38.980143 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-63d89e6e-b927-44c0-a74e-5684ebe6a6fa tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:38.980143 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:38.980143 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:38.982486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d89e6e-b927-44c0-a74e-5684ebe6a6fa tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:39.002873 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1945/3913] 10.222.0.26 () {58 vars in 1464 bytes} [Sat Oct 8 21:05:38 2022] GET /identity/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/inherited_to_projects => generated 447 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:39.006861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bdd53-0b23-4313-bfaa-dd3085c4a6d0 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:39.022447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bdd53-0b23-4313-bfaa-dd3085c4a6d0 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:39.039304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb295017-4aec-4bd6-8a56-430d942d9335 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:39.040373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb295017-4aec-4bd6-8a56-430d942d9335 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:39.040870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb295017-4aec-4bd6-8a56-430d942d9335 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:39.041430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb295017-4aec-4bd6-8a56-430d942d9335 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/eaae82db90a74ba2a78f1935d29d88b9/inherited_to_projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:39.043918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb295017-4aec-4bd6-8a56-430d942d9335 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=28c79920c3c94fe985f4a415a8dacf17, group_id=677c5f31d8c54d9b9c01d6aca3f75725, role_id=eaae82db90a74ba2a78f1935d29d88b9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:39.047806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb295017-4aec-4bd6-8a56-430d942d9335 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:39.058314 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1969/3914] 10.222.0.26 () {58 vars in 1564 bytes} [Sat Oct 8 21:05:39 2022] HEAD /identity/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/eaae82db90a74ba2a78f1935d29d88b9/inherited_to_projects => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:39.063284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d89e6e-b927-44c0-a74e-5684ebe6a6fa tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:39.075047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d89e6e-b927-44c0-a74e-5684ebe6a6fa tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:39.081345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f960849-857b-4434-8771-f0274e2ab672 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:39.082133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f960849-857b-4434-8771-f0274e2ab672 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:39.082467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f960849-857b-4434-8771-f0274e2ab672 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:39.082816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f960849-857b-4434-8771-f0274e2ab672 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/eaae82db90a74ba2a78f1935d29d88b9/inherited_to_projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:39.085745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f960849-857b-4434-8771-f0274e2ab672 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=28c79920c3c94fe985f4a415a8dacf17, group_id=677c5f31d8c54d9b9c01d6aca3f75725, role_id=eaae82db90a74ba2a78f1935d29d88b9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:39.089795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f960849-857b-4434-8771-f0274e2ab672 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:39.095505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8f960849-857b-4434-8771-f0274e2ab672 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invalidating the token cache because role eaae82db90a74ba2a78f1935d29d88b9 was removed from group 677c5f31d8c54d9b9c01d6aca3f75725 on domain 28c79920c3c94fe985f4a415a8dacf17. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:39.097363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8f960849-857b-4434-8771-f0274e2ab672 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:39.099613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8f960849-857b-4434-8771-f0274e2ab672 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:39.126090 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1946/3915] 10.222.0.26 () {58 vars in 1566 bytes} [Sat Oct 8 21:05:39 2022] DELETE /identity/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/groups/677c5f31d8c54d9b9c01d6aca3f75725/roles/eaae82db90a74ba2a78f1935d29d88b9/inherited_to_projects => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:39.130473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb295017-4aec-4bd6-8a56-430d942d9335 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:39.133534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bb295017-4aec-4bd6-8a56-430d942d9335 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:39.153765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb295017-4aec-4bd6-8a56-430d942d9335 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:39.261783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558bd54-b95b-4d96-b466-b6f65e8ee16f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:39.262515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558bd54-b95b-4d96-b466-b6f65e8ee16f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:39.262875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558bd54-b95b-4d96-b466-b6f65e8ee16f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:39.263752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558bd54-b95b-4d96-b466-b6f65e8ee16f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/roles/eaae82db90a74ba2a78f1935d29d88b9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:39.266535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558bd54-b95b-4d96-b466-b6f65e8ee16f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:delete_role(role_id=eaae82db90a74ba2a78f1935d29d88b9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:39.268243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558bd54-b95b-4d96-b466-b6f65e8ee16f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:39.315171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:39.333934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1558bd54-b95b-4d96-b466-b6f65e8ee16f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invalidating the token cache because role eaae82db90a74ba2a78f1935d29d88b9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:39.334561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1558bd54-b95b-4d96-b466-b6f65e8ee16f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:39.335402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1558bd54-b95b-4d96-b466-b6f65e8ee16f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:39.339642 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1970/3916] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:39 2022] DELETE /identity/v3/roles/eaae82db90a74ba2a78f1935d29d88b9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:39.344594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f960849-857b-4434-8771-f0274e2ab672 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:39.355816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f960849-857b-4434-8771-f0274e2ab672 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:39.380295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:39.444245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c0885-fd4a-4615-9d55-6456b967d6f3 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:39.444956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c0885-fd4a-4615-9d55-6456b967d6f3 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:39.445335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c0885-fd4a-4615-9d55-6456b967d6f3 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:39.445678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c0885-fd4a-4615-9d55-6456b967d6f3 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:39.446439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c0885-fd4a-4615-9d55-6456b967d6f3 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:39.448528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c0885-fd4a-4615-9d55-6456b967d6f3 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:39.499809 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1947/3917] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:05:39 2022] POST /identity/v3/roles => generated 240 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:39.504300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558bd54-b95b-4d96-b466-b6f65e8ee16f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:39.508037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1558bd54-b95b-4d96-b466-b6f65e8ee16f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:39.536115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558bd54-b95b-4d96-b466-b6f65e8ee16f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:39.570863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769adcc7-6ecc-4807-9fe2-9437c89cd793 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:39.571887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769adcc7-6ecc-4807-9fe2-9437c89cd793 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:39.572823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769adcc7-6ecc-4807-9fe2-9437c89cd793 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:39.573115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769adcc7-6ecc-4807-9fe2-9437c89cd793 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/users/c65846d6a3fe44b0bac7dceb1d773368/roles/ad74d3454fea4ae5bd017507183e3dc0/inherited_to_projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:39.582079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769adcc7-6ecc-4807-9fe2-9437c89cd793 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=28c79920c3c94fe985f4a415a8dacf17, user_id=c65846d6a3fe44b0bac7dceb1d773368, role_id=ad74d3454fea4ae5bd017507183e3dc0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:39.590711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769adcc7-6ecc-4807-9fe2-9437c89cd793 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:39.624499 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1971/3918] 10.222.0.26 () {60 vars in 1579 bytes} [Sat Oct 8 21:05:39 2022] PUT /identity/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/users/c65846d6a3fe44b0bac7dceb1d773368/roles/ad74d3454fea4ae5bd017507183e3dc0/inherited_to_projects => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:39.628528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c0885-fd4a-4615-9d55-6456b967d6f3 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:39.643706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c0885-fd4a-4615-9d55-6456b967d6f3 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:39.772220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dadae-f59b-4ae1-9702-9a5626933eff tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:39.772828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dadae-f59b-4ae1-9702-9a5626933eff tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:39.773108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dadae-f59b-4ae1-9702-9a5626933eff tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:39.773407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dadae-f59b-4ae1-9702-9a5626933eff tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/users/c65846d6a3fe44b0bac7dceb1d773368/roles/inherited_to_projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:39.775705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9dadae-f59b-4ae1-9702-9a5626933eff tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=28c79920c3c94fe985f4a415a8dacf17, user_id=c65846d6a3fe44b0bac7dceb1d773368)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:39.779768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9dadae-f59b-4ae1-9702-9a5626933eff tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:39.800642 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1948/3919] 10.222.0.26 () {58 vars in 1461 bytes} [Sat Oct 8 21:05:39 2022] GET /identity/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/users/c65846d6a3fe44b0bac7dceb1d773368/roles/inherited_to_projects => generated 447 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:39.804784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769adcc7-6ecc-4807-9fe2-9437c89cd793 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:39.820389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769adcc7-6ecc-4807-9fe2-9437c89cd793 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:39.835593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5979c-a059-49cc-b793-b5a18c444c85 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:39.835593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5979c-a059-49cc-b793-b5a18c444c85 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:39.835813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5979c-a059-49cc-b793-b5a18c444c85 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:39.836014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5979c-a059-49cc-b793-b5a18c444c85 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/users/c65846d6a3fe44b0bac7dceb1d773368/roles/ad74d3454fea4ae5bd017507183e3dc0/inherited_to_projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:39.838444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5979c-a059-49cc-b793-b5a18c444c85 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=28c79920c3c94fe985f4a415a8dacf17, user_id=c65846d6a3fe44b0bac7dceb1d773368, role_id=ad74d3454fea4ae5bd017507183e3dc0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:39.841077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5979c-a059-49cc-b793-b5a18c444c85 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:39.849548 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1972/3920] 10.222.0.26 () {58 vars in 1561 bytes} [Sat Oct 8 21:05:39 2022] HEAD /identity/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/users/c65846d6a3fe44b0bac7dceb1d773368/roles/ad74d3454fea4ae5bd017507183e3dc0/inherited_to_projects => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:39.853821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dadae-f59b-4ae1-9702-9a5626933eff tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:39.866215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dadae-f59b-4ae1-9702-9a5626933eff tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:39.875900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27770e8f-64df-4768-82e3-40e9db0b0867 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:39.877393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27770e8f-64df-4768-82e3-40e9db0b0867 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:39.877749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27770e8f-64df-4768-82e3-40e9db0b0867 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:39.878553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27770e8f-64df-4768-82e3-40e9db0b0867 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/users/c65846d6a3fe44b0bac7dceb1d773368/roles/ad74d3454fea4ae5bd017507183e3dc0/inherited_to_projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:39.880444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27770e8f-64df-4768-82e3-40e9db0b0867 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=28c79920c3c94fe985f4a415a8dacf17, user_id=c65846d6a3fe44b0bac7dceb1d773368, role_id=ad74d3454fea4ae5bd017507183e3dc0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:39.884399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27770e8f-64df-4768-82e3-40e9db0b0867 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:39.892055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-27770e8f-64df-4768-82e3-40e9db0b0867 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invalidating the token cache because role ad74d3454fea4ae5bd017507183e3dc0 was removed from user c65846d6a3fe44b0bac7dceb1d773368 on domain 28c79920c3c94fe985f4a415a8dacf17. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:39.892355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-27770e8f-64df-4768-82e3-40e9db0b0867 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:39.893110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-27770e8f-64df-4768-82e3-40e9db0b0867 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:39.914842 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1949/3921] 10.222.0.26 () {58 vars in 1563 bytes} [Sat Oct 8 21:05:39 2022] DELETE /identity/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/users/c65846d6a3fe44b0bac7dceb1d773368/roles/ad74d3454fea4ae5bd017507183e3dc0/inherited_to_projects => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:39.918862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5979c-a059-49cc-b793-b5a18c444c85 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:39.920717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4fe5979c-a059-49cc-b793-b5a18c444c85 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:39.938115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5979c-a059-49cc-b793-b5a18c444c85 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:40.015231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93ad3f-407b-4d25-bc91-aeaa50cdc03b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:40.016033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ad3f-407b-4d25-bc91-aeaa50cdc03b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:40.018083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ad3f-407b-4d25-bc91-aeaa50cdc03b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:40.018416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ad3f-407b-4d25-bc91-aeaa50cdc03b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/roles/ad74d3454fea4ae5bd017507183e3dc0` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:40.026413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93ad3f-407b-4d25-bc91-aeaa50cdc03b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ad74d3454fea4ae5bd017507183e3dc0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:40.031778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93ad3f-407b-4d25-bc91-aeaa50cdc03b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:40.095623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db93ad3f-407b-4d25-bc91-aeaa50cdc03b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invalidating the token cache because role ad74d3454fea4ae5bd017507183e3dc0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:40.096056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db93ad3f-407b-4d25-bc91-aeaa50cdc03b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:40.096736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db93ad3f-407b-4d25-bc91-aeaa50cdc03b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:40.099285 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1973/3922] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:39 2022] DELETE /identity/v3/roles/ad74d3454fea4ae5bd017507183e3dc0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:40.106478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27770e8f-64df-4768-82e3-40e9db0b0867 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:40.118680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27770e8f-64df-4768-82e3-40e9db0b0867 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:40.193098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b0ab9-2b54-4337-b937-ff5bb60b6e30 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:40.194378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b0ab9-2b54-4337-b937-ff5bb60b6e30 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:40.194951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b0ab9-2b54-4337-b937-ff5bb60b6e30 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:40.196159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b0ab9-2b54-4337-b937-ff5bb60b6e30 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:40.198001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b0ab9-2b54-4337-b937-ff5bb60b6e30 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:40.200638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b0ab9-2b54-4337-b937-ff5bb60b6e30 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:40.229738 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1950/3923] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:05:40 2022] POST /identity/v3/roles => generated 239 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:40.230416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93ad3f-407b-4d25-bc91-aeaa50cdc03b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:40.231861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-db93ad3f-407b-4d25-bc91-aeaa50cdc03b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:40.245016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93ad3f-407b-4d25-bc91-aeaa50cdc03b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:40.251868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34edbe3-88a9-46c2-89aa-b1200ac2c627 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:40.252542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34edbe3-88a9-46c2-89aa-b1200ac2c627 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:40.252829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34edbe3-88a9-46c2-89aa-b1200ac2c627 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:40.253760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34edbe3-88a9-46c2-89aa-b1200ac2c627 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:40.254443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34edbe3-88a9-46c2-89aa-b1200ac2c627 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:40.256589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34edbe3-88a9-46c2-89aa-b1200ac2c627 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:40.336857 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1974/3924] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:05:40 2022] POST /identity/v3/projects => generated 408 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:05:40.338595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b0ab9-2b54-4337-b937-ff5bb60b6e30 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:40.351191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b0ab9-2b54-4337-b937-ff5bb60b6e30 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:40.385469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:40.466630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f03a5-77ed-44b5-9c00-d8dd51f865a7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:40.467975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f03a5-77ed-44b5-9c00-d8dd51f865a7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:40.469606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f03a5-77ed-44b5-9c00-d8dd51f865a7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:40.469995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f03a5-77ed-44b5-9c00-d8dd51f865a7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/users/c65846d6a3fe44b0bac7dceb1d773368/roles/261c5e24b00f44228d905cf7f434a9af/inherited_to_projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:40.473654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f03a5-77ed-44b5-9c00-d8dd51f865a7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=28c79920c3c94fe985f4a415a8dacf17, user_id=c65846d6a3fe44b0bac7dceb1d773368, role_id=261c5e24b00f44228d905cf7f434a9af)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:40.485883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f03a5-77ed-44b5-9c00-d8dd51f865a7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:40.519000 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1951/3925] 10.222.0.26 () {60 vars in 1579 bytes} [Sat Oct 8 21:05:40 2022] PUT /identity/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/users/c65846d6a3fe44b0bac7dceb1d773368/roles/261c5e24b00f44228d905cf7f434a9af/inherited_to_projects => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:40.524257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34edbe3-88a9-46c2-89aa-b1200ac2c627 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:40.553791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34edbe3-88a9-46c2-89aa-b1200ac2c627 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:40.636351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194357c-0816-45f2-be75-865e24253700 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:40.637178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194357c-0816-45f2-be75-865e24253700 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:40.637602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194357c-0816-45f2-be75-865e24253700 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:40.638051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194357c-0816-45f2-be75-865e24253700 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:40.639021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194357c-0816-45f2-be75-865e24253700 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Adding query filter params (scope.project.id=06d2235253e24be29954ebb8e2c25b42, user.id=c65846d6a3fe44b0bac7dceb1d773368) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:05:40.639439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194357c-0816-45f2-be75-865e24253700 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:40.641696 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-a194357c-0816-45f2-be75-865e24253700 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:40.641696 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:40.641696 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:40.643302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194357c-0816-45f2-be75-865e24253700 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:40.657692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:40.705808 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1975/3926] 10.222.0.26 () {58 vars in 1356 bytes} [Sat Oct 8 21:05:40 2022] GET /identity/v3/role_assignments?scope.project.id=06d2235253e24be29954ebb8e2c25b42&user.id=c65846d6a3fe44b0bac7dceb1d773368&effective => generated 648 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:40.709780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f03a5-77ed-44b5-9c00-d8dd51f865a7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:40.726431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f03a5-77ed-44b5-9c00-d8dd51f865a7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:40.732135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca50a5-75e8-4a71-aeee-629a886365c7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:40.733103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca50a5-75e8-4a71-aeee-629a886365c7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:40.733662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca50a5-75e8-4a71-aeee-629a886365c7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:40.734692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca50a5-75e8-4a71-aeee-629a886365c7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:40.735992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca50a5-75e8-4a71-aeee-629a886365c7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Adding query filter params (scope.project.id=540de818118a47508ca162c5e6f79583, user.id=c65846d6a3fe44b0bac7dceb1d773368) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:05:40.736563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca50a5-75e8-4a71-aeee-629a886365c7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:40.737850 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-8eca50a5-75e8-4a71-aeee-629a886365c7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:40.737850 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:40.737850 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:40.739448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca50a5-75e8-4a71-aeee-629a886365c7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:40.868704 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1952/3927] 10.222.0.26 () {58 vars in 1356 bytes} [Sat Oct 8 21:05:40 2022] GET /identity/v3/role_assignments?scope.project.id=540de818118a47508ca162c5e6f79583&user.id=c65846d6a3fe44b0bac7dceb1d773368&effective => generated 648 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:05:40.873013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194357c-0816-45f2-be75-865e24253700 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:40.890242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194357c-0816-45f2-be75-865e24253700 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:40.914872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb5ce5-2d88-44d8-8de5-d93ed60f5dd7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:40.916369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb5ce5-2d88-44d8-8de5-d93ed60f5dd7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:40.917349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb5ce5-2d88-44d8-8de5-d93ed60f5dd7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:40.917641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb5ce5-2d88-44d8-8de5-d93ed60f5dd7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/users/c65846d6a3fe44b0bac7dceb1d773368/roles/261c5e24b00f44228d905cf7f434a9af/inherited_to_projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:40.924895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb5ce5-2d88-44d8-8de5-d93ed60f5dd7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=28c79920c3c94fe985f4a415a8dacf17, user_id=c65846d6a3fe44b0bac7dceb1d773368, role_id=261c5e24b00f44228d905cf7f434a9af)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:40.927894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb5ce5-2d88-44d8-8de5-d93ed60f5dd7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:40.959360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05bb5ce5-2d88-44d8-8de5-d93ed60f5dd7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invalidating the token cache because role 261c5e24b00f44228d905cf7f434a9af was removed from user c65846d6a3fe44b0bac7dceb1d773368 on domain 28c79920c3c94fe985f4a415a8dacf17. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:40.960550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05bb5ce5-2d88-44d8-8de5-d93ed60f5dd7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:40.962856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05bb5ce5-2d88-44d8-8de5-d93ed60f5dd7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:40.995156 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1976/3928] 10.222.0.26 () {58 vars in 1563 bytes} [Sat Oct 8 21:05:40 2022] DELETE /identity/v3/OS-INHERIT/domains/28c79920c3c94fe985f4a415a8dacf17/users/c65846d6a3fe44b0bac7dceb1d773368/roles/261c5e24b00f44228d905cf7f434a9af/inherited_to_projects => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:40.997544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca50a5-75e8-4a71-aeee-629a886365c7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:41.000895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8eca50a5-75e8-4a71-aeee-629a886365c7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:41.037698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca50a5-75e8-4a71-aeee-629a886365c7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:41.247698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f20bd-6089-43bf-80ce-d913cbb7ec93 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:41.248331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f20bd-6089-43bf-80ce-d913cbb7ec93 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:41.248617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f20bd-6089-43bf-80ce-d913cbb7ec93 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:41.249052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f20bd-6089-43bf-80ce-d913cbb7ec93 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:41.249882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f20bd-6089-43bf-80ce-d913cbb7ec93 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Adding query filter params (scope.project.id=06d2235253e24be29954ebb8e2c25b42, user.id=c65846d6a3fe44b0bac7dceb1d773368) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:05:41.250167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f20bd-6089-43bf-80ce-d913cbb7ec93 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:41.252015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f20bd-6089-43bf-80ce-d913cbb7ec93 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:41.363411 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1953/3929] 10.222.0.26 () {58 vars in 1356 bytes} [Sat Oct 8 21:05:40 2022] GET /identity/v3/role_assignments?scope.project.id=06d2235253e24be29954ebb8e2c25b42&user.id=c65846d6a3fe44b0bac7dceb1d773368&effective => generated 228 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:41.367062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb5ce5-2d88-44d8-8de5-d93ed60f5dd7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:41.385800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb5ce5-2d88-44d8-8de5-d93ed60f5dd7 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:41.414843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119cc9-1747-454c-b7da-71ef7226f598 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:41.417116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119cc9-1747-454c-b7da-71ef7226f598 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:41.417555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119cc9-1747-454c-b7da-71ef7226f598 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:41.419557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119cc9-1747-454c-b7da-71ef7226f598 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:41.421327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119cc9-1747-454c-b7da-71ef7226f598 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Adding query filter params (scope.project.id=540de818118a47508ca162c5e6f79583, user.id=c65846d6a3fe44b0bac7dceb1d773368) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:05:41.427398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119cc9-1747-454c-b7da-71ef7226f598 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:41.443490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119cc9-1747-454c-b7da-71ef7226f598 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:41.569282 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1977/3930] 10.222.0.26 () {58 vars in 1356 bytes} [Sat Oct 8 21:05:41 2022] GET /identity/v3/role_assignments?scope.project.id=540de818118a47508ca162c5e6f79583&user.id=c65846d6a3fe44b0bac7dceb1d773368&effective => generated 228 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:41.572760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f20bd-6089-43bf-80ce-d913cbb7ec93 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:41.589154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f20bd-6089-43bf-80ce-d913cbb7ec93 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:41.604858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5452d3-549f-47f7-810a-bace089c978b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:41.605368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5452d3-549f-47f7-810a-bace089c978b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:41.605653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5452d3-549f-47f7-810a-bace089c978b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:41.605929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5452d3-549f-47f7-810a-bace089c978b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/projects/540de818118a47508ca162c5e6f79583` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:41.607195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5452d3-549f-47f7-810a-bace089c978b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:delete_project(project_id=540de818118a47508ca162c5e6f79583)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:41.609135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5452d3-549f-47f7-810a-bace089c978b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:41.659640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:41.728656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ce5452d3-549f-47f7-810a-bace089c978b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '540de818118a47508ca162c5e6f79583', 'request_id': 'req-ce5452d3-549f-47f7-810a-bace089c978b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:41.754281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ce5452d3-549f-47f7-810a-bace089c978b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '540de818118a47508ca162c5e6f79583', 'request_id': 'req-ce5452d3-549f-47f7-810a-bace089c978b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:41.761454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ce5452d3-549f-47f7-810a-bace089c978b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '540de818118a47508ca162c5e6f79583', 'request_id': 'req-ce5452d3-549f-47f7-810a-bace089c978b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:41.794193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ce5452d3-549f-47f7-810a-bace089c978b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] The token cache is being invalidate because project 540de818118a47508ca162c5e6f79583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:41.794493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ce5452d3-549f-47f7-810a-bace089c978b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:41.795382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ce5452d3-549f-47f7-810a-bace089c978b tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:41.796953 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1954/3931] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:05:41 2022] DELETE /identity/v3/projects/540de818118a47508ca162c5e6f79583 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:41.801669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119cc9-1747-454c-b7da-71ef7226f598 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:41.806567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dc119cc9-1747-454c-b7da-71ef7226f598 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:41.848472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119cc9-1747-454c-b7da-71ef7226f598 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:41.864371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dc290-b268-48a3-95ca-ab1dce501bd3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:41.870412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dc290-b268-48a3-95ca-ab1dce501bd3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:41.870722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dc290-b268-48a3-95ca-ab1dce501bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:41.931674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-354dc290-b268-48a3-95ca-ab1dce501bd3 None None] MFA Rules not processed for user `88f002556c0f4584b29cb6dbea165876`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:41.934707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-354dc290-b268-48a3-95ca-ab1dce501bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:42.057044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0db330-a6f3-4368-a31a-6cb1800c1f0a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:42.061215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0db330-a6f3-4368-a31a-6cb1800c1f0a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:42.061666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0db330-a6f3-4368-a31a-6cb1800c1f0a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:42.062043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0db330-a6f3-4368-a31a-6cb1800c1f0a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/roles/261c5e24b00f44228d905cf7f434a9af` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:42.065689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0db330-a6f3-4368-a31a-6cb1800c1f0a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:delete_role(role_id=261c5e24b00f44228d905cf7f434a9af)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:42.068525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0db330-a6f3-4368-a31a-6cb1800c1f0a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:42.101097 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1955/3932] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:42.160740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3d0db330-a6f3-4368-a31a-6cb1800c1f0a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invalidating the token cache because role 261c5e24b00f44228d905cf7f434a9af has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:42.161134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3d0db330-a6f3-4368-a31a-6cb1800c1f0a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:42.162033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3d0db330-a6f3-4368-a31a-6cb1800c1f0a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:42.170504 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1978/3933] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:41 2022] DELETE /identity/v3/roles/261c5e24b00f44228d905cf7f434a9af => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:42.176270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dc290-b268-48a3-95ca-ab1dce501bd3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:42.194073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dc290-b268-48a3-95ca-ab1dce501bd3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:42.327037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e058a0b-fae3-42dd-864f-376850ccf67e tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:42.327730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e058a0b-fae3-42dd-864f-376850ccf67e tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:42.328610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e058a0b-fae3-42dd-864f-376850ccf67e tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:42.328955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e058a0b-fae3-42dd-864f-376850ccf67e tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:42.329787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e058a0b-fae3-42dd-864f-376850ccf67e tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:42.334266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e058a0b-fae3-42dd-864f-376850ccf67e tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:42.367741 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1956/3934] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:05:42 2022] POST /identity/v3/roles => generated 240 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:42.372049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0db330-a6f3-4368-a31a-6cb1800c1f0a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:42.373602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d0db330-a6f3-4368-a31a-6cb1800c1f0a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:42.396709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0db330-a6f3-4368-a31a-6cb1800c1f0a tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:42.410625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b854c-223e-4f40-9c31-1887c0b677e9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:42.411368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b854c-223e-4f40-9c31-1887c0b677e9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:42.411748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b854c-223e-4f40-9c31-1887c0b677e9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:42.412097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b854c-223e-4f40-9c31-1887c0b677e9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:42.412897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b854c-223e-4f40-9c31-1887c0b677e9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:42.415711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b854c-223e-4f40-9c31-1887c0b677e9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:42.496567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:42.516313 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1979/3935] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:05:42 2022] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:42.516554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e058a0b-fae3-42dd-864f-376850ccf67e tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:42.536884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e058a0b-fae3-42dd-864f-376850ccf67e tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:42.611467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:42.701074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fba1fa-82ae-4284-80d5-c01020c5421d tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:42.701814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fba1fa-82ae-4284-80d5-c01020c5421d tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:42.702205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fba1fa-82ae-4284-80d5-c01020c5421d tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:42.702395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fba1fa-82ae-4284-80d5-c01020c5421d tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/users/c65846d6a3fe44b0bac7dceb1d773368/roles/6c5628805acc481da02df8cb7ff1514a/inherited_to_projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:42.711028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fba1fa-82ae-4284-80d5-c01020c5421d tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:create_grant(project_id=06d2235253e24be29954ebb8e2c25b42, user_id=c65846d6a3fe44b0bac7dceb1d773368, role_id=6c5628805acc481da02df8cb7ff1514a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:42.728119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fba1fa-82ae-4284-80d5-c01020c5421d tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:42.763034 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1957/3936] 10.222.0.26 () {60 vars in 1582 bytes} [Sat Oct 8 21:05:42 2022] PUT /identity/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/users/c65846d6a3fe44b0bac7dceb1d773368/roles/6c5628805acc481da02df8cb7ff1514a/inherited_to_projects => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:42.763756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b854c-223e-4f40-9c31-1887c0b677e9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:42.778186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b854c-223e-4f40-9c31-1887c0b677e9 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:42.871605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9cabf-84f1-4868-9ee3-6838ee34c804 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:42.872238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9cabf-84f1-4868-9ee3-6838ee34c804 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:42.872615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9cabf-84f1-4868-9ee3-6838ee34c804 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:42.872836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9cabf-84f1-4868-9ee3-6838ee34c804 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:42.873622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9cabf-84f1-4868-9ee3-6838ee34c804 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Adding query filter params (scope.project.id=5caf5b2fe47e4ba8a2378d6b8f976547, user.id=c65846d6a3fe44b0bac7dceb1d773368) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:05:42.873932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9cabf-84f1-4868-9ee3-6838ee34c804 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:42.876837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9cabf-84f1-4868-9ee3-6838ee34c804 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:42.954246 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1980/3937] 10.222.0.26 () {58 vars in 1356 bytes} [Sat Oct 8 21:05:42 2022] GET /identity/v3/role_assignments?scope.project.id=5caf5b2fe47e4ba8a2378d6b8f976547&user.id=c65846d6a3fe44b0bac7dceb1d773368&effective => generated 649 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:05:42.955618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fba1fa-82ae-4284-80d5-c01020c5421d tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:42.969060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fba1fa-82ae-4284-80d5-c01020c5421d tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:42.977521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa8d78-b162-4096-8731-2ffc26ee64b1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:42.978612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa8d78-b162-4096-8731-2ffc26ee64b1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:42.978898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa8d78-b162-4096-8731-2ffc26ee64b1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:42.979333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa8d78-b162-4096-8731-2ffc26ee64b1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/users/c65846d6a3fe44b0bac7dceb1d773368/roles/6c5628805acc481da02df8cb7ff1514a/inherited_to_projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:42.983966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa8d78-b162-4096-8731-2ffc26ee64b1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=06d2235253e24be29954ebb8e2c25b42, user_id=c65846d6a3fe44b0bac7dceb1d773368, role_id=6c5628805acc481da02df8cb7ff1514a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:42.989409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa8d78-b162-4096-8731-2ffc26ee64b1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:42.997036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-04aa8d78-b162-4096-8731-2ffc26ee64b1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invalidating the token cache because role 6c5628805acc481da02df8cb7ff1514a was removed from user c65846d6a3fe44b0bac7dceb1d773368 on project 06d2235253e24be29954ebb8e2c25b42. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:42.997366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-04aa8d78-b162-4096-8731-2ffc26ee64b1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:42.999224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-04aa8d78-b162-4096-8731-2ffc26ee64b1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:43.023030 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1958/3938] 10.222.0.26 () {58 vars in 1566 bytes} [Sat Oct 8 21:05:42 2022] DELETE /identity/v3/OS-INHERIT/projects/06d2235253e24be29954ebb8e2c25b42/users/c65846d6a3fe44b0bac7dceb1d773368/roles/6c5628805acc481da02df8cb7ff1514a/inherited_to_projects => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:43.024297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9cabf-84f1-4868-9ee3-6838ee34c804 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:43.026131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bab9cabf-84f1-4868-9ee3-6838ee34c804 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:43.058809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9cabf-84f1-4868-9ee3-6838ee34c804 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:43.280126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b4b71-2b28-4634-9957-a15de55648fb tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:43.284425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4b71-2b28-4634-9957-a15de55648fb tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:43.284756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4b71-2b28-4634-9957-a15de55648fb tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:43.285037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4b71-2b28-4634-9957-a15de55648fb tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:43.286964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b4b71-2b28-4634-9957-a15de55648fb tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Adding query filter params (scope.project.id=5caf5b2fe47e4ba8a2378d6b8f976547, user.id=c65846d6a3fe44b0bac7dceb1d773368) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:05:43.287412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b4b71-2b28-4634-9957-a15de55648fb tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:43.296490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b4b71-2b28-4634-9957-a15de55648fb tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:43.411715 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1981/3939] 10.222.0.26 () {58 vars in 1356 bytes} [Sat Oct 8 21:05:43 2022] GET /identity/v3/role_assignments?scope.project.id=5caf5b2fe47e4ba8a2378d6b8f976547&user.id=c65846d6a3fe44b0bac7dceb1d773368&effective => generated 228 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:43.415911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa8d78-b162-4096-8731-2ffc26ee64b1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:43.430144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa8d78-b162-4096-8731-2ffc26ee64b1 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:43.454109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:43.454927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:43.455218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:43.455497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/projects/5caf5b2fe47e4ba8a2378d6b8f976547` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:43.462469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5caf5b2fe47e4ba8a2378d6b8f976547)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:43.475957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:43.557498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5caf5b2fe47e4ba8a2378d6b8f976547', 'request_id': 'req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:43.574981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5caf5b2fe47e4ba8a2378d6b8f976547', 'request_id': 'req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:43.588481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5caf5b2fe47e4ba8a2378d6b8f976547', 'request_id': 'req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:43.615175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] The token cache is being invalidate because project 5caf5b2fe47e4ba8a2378d6b8f976547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:43.615442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:43.617995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:43.620790 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1959/3940] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:05:43 2022] DELETE /identity/v3/projects/5caf5b2fe47e4ba8a2378d6b8f976547 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:43.625230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b4b71-2b28-4634-9957-a15de55648fb tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:43.627306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b46b4b71-2b28-4634-9957-a15de55648fb tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:43.644255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b4b71-2b28-4634-9957-a15de55648fb tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:43.648990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:43.725598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:43.727804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:43.783510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7c9d7-b2c4-4f67-8524-7480a9113da2 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:43.785949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7c9d7-b2c4-4f67-8524-7480a9113da2 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:43.786244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7c9d7-b2c4-4f67-8524-7480a9113da2 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:43.789477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7c9d7-b2c4-4f67-8524-7480a9113da2 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/roles/6c5628805acc481da02df8cb7ff1514a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:43.791172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7c9d7-b2c4-4f67-8524-7480a9113da2 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6c5628805acc481da02df8cb7ff1514a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:43.797928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7c9d7-b2c4-4f67-8524-7480a9113da2 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:43.913229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46d7c9d7-b2c4-4f67-8524-7480a9113da2 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invalidating the token cache because role 6c5628805acc481da02df8cb7ff1514a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:43.913229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46d7c9d7-b2c4-4f67-8524-7480a9113da2 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:43.913951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46d7c9d7-b2c4-4f67-8524-7480a9113da2 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:43.915999 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1982/3941] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:43 2022] DELETE /identity/v3/roles/6c5628805acc481da02df8cb7ff1514a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:43.920959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7c9d7-b2c4-4f67-8524-7480a9113da2 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:43.925643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-46d7c9d7-b2c4-4f67-8524-7480a9113da2 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:43.930703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359999a-0fc0-4b58-a2e0-ab0144dda8e8 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:43.979572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:44.071587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30257b-3bb2-4468-85f5-337f7f63a754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:44.072586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30257b-3bb2-4468-85f5-337f7f63a754 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:44.073224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30257b-3bb2-4468-85f5-337f7f63a754 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:44.073224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30257b-3bb2-4468-85f5-337f7f63a754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:44.075568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7e30257b-3bb2-4468-85f5-337f7f63a754 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:44.089004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7c9d7-b2c4-4f67-8524-7480a9113da2 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:44.103693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:44.105070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:44.106190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:44.107963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/users/c65846d6a3fe44b0bac7dceb1d773368` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:44.113162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c65846d6a3fe44b0bac7dceb1d773368)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:44.120587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:44.226895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30257b-3bb2-4468-85f5-337f7f63a754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:44.228951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30257b-3bb2-4468-85f5-337f7f63a754 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:44.243748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c65846d6a3fe44b0bac7dceb1d773368'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:44.245494 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1960/3942] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:05:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:05:44.259308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c65846d6a3fe44b0bac7dceb1d773368'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:44.260245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c65846d6a3fe44b0bac7dceb1d773368'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:44.261305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c65846d6a3fe44b0bac7dceb1d773368'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:44.276563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c65846d6a3fe44b0bac7dceb1d773368'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:44.278532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=12 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:44.306833 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1983/3943] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:43 2022] DELETE /identity/v3/users/c65846d6a3fe44b0bac7dceb1d773368 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:44.316577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30257b-3bb2-4468-85f5-337f7f63a754 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:44.336118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30257b-3bb2-4468-85f5-337f7f63a754 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:44.387510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:44.389004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:44.443701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4f19b-9cf5-4bd5-b71f-1f7a525cdf77 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:44.444346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4f19b-9cf5-4bd5-b71f-1f7a525cdf77 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:44.444630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4f19b-9cf5-4bd5-b71f-1f7a525cdf77 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:44.444911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4f19b-9cf5-4bd5-b71f-1f7a525cdf77 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/groups/677c5f31d8c54d9b9c01d6aca3f75725` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:44.446369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4f19b-9cf5-4bd5-b71f-1f7a525cdf77 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:delete_group(group_id=677c5f31d8c54d9b9c01d6aca3f75725)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:44.448337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4f19b-9cf5-4bd5-b71f-1f7a525cdf77 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:44.475187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c1798-f130-4cdb-8c95-5a04e91cedf5 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:44.483007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63a1be-cc2a-4cd1-8a9f-25ffadf8a98d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:44.483913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63a1be-cc2a-4cd1-8a9f-25ffadf8a98d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:44.484529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63a1be-cc2a-4cd1-8a9f-25ffadf8a98d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:44.485139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63a1be-cc2a-4cd1-8a9f-25ffadf8a98d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:44.490787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9c63a1be-cc2a-4cd1-8a9f-25ffadf8a98d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:44.552501 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1961/3944] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:05:44 2022] DELETE /identity/v3/groups/677c5f31d8c54d9b9c01d6aca3f75725 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:44.556073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4f19b-9cf5-4bd5-b71f-1f7a525cdf77 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:44.561676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ddf4f19b-9cf5-4bd5-b71f-1f7a525cdf77 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:44.622465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:44.627132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63a1be-cc2a-4cd1-8a9f-25ffadf8a98d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:44.629353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63a1be-cc2a-4cd1-8a9f-25ffadf8a98d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:44.649019 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1984/3945] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:05:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:05:44.703872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4f19b-9cf5-4bd5-b71f-1f7a525cdf77 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:44.711229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:44.712167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:44.712740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:44.713126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/projects/06d2235253e24be29954ebb8e2c25b42` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:44.714501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:delete_project(project_id=06d2235253e24be29954ebb8e2c25b42)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:44.717523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:44.811341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d2235253e24be29954ebb8e2c25b42', 'request_id': 'req-748a7c06-b6bc-4d80-b44d-5508625dcb4f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:44.828581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d2235253e24be29954ebb8e2c25b42', 'request_id': 'req-748a7c06-b6bc-4d80-b44d-5508625dcb4f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:44.845435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d2235253e24be29954ebb8e2c25b42', 'request_id': 'req-748a7c06-b6bc-4d80-b44d-5508625dcb4f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:44.861657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] The token cache is being invalidate because project 06d2235253e24be29954ebb8e2c25b42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:44.861956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:44.862676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:44.866447 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1962/3946] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:05:44 2022] DELETE /identity/v3/projects/06d2235253e24be29954ebb8e2c25b42 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:44.870843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63a1be-cc2a-4cd1-8a9f-25ffadf8a98d service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:44.883433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63a1be-cc2a-4cd1-8a9f-25ffadf8a98d service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:44.970223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:44.971677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:44.971967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:44.972513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/domains/28c79920c3c94fe985f4a415a8dacf17` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:44.974434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=28c79920c3c94fe985f4a415a8dacf17)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:44.976751 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:44.976751 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:44.976751 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:44.977529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:45.010483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '28c79920c3c94fe985f4a415a8dacf17'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.011386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '28c79920c3c94fe985f4a415a8dacf17'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.039526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=97,keystone:UPDATE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:45.048209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '28c79920c3c94fe985f4a415a8dacf17'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.049005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '28c79920c3c94fe985f4a415a8dacf17'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.055974 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1985/3947] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:05:44 2022] PATCH /identity/v3/domains/28c79920c3c94fe985f4a415a8dacf17 => generated 277 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:45.059907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:45.064170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:45.085069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a7c06-b6bc-4d80-b44d-5508625dcb4f tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:45.232830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d09e291e7646758e3595d1e0add133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f75240d7478454594425a3d130e7e8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:45.235578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:45.235815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:45.236050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] PATH_INFO: `/v3/domains/28c79920c3c94fe985f4a415a8dacf17` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:45.267763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=28c79920c3c94fe985f4a415a8dacf17)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:45.268816 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:45.268816 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:45.268816 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:45.273818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:45.335099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '28c79920c3c94fe985f4a415a8dacf17'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.416390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '28c79920c3c94fe985f4a415a8dacf17'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.452365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:45.509562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c79920c3c94fe985f4a415a8dacf17', 'request_id': 'req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.527154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c79920c3c94fe985f4a415a8dacf17', 'request_id': 'req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.538357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c79920c3c94fe985f4a415a8dacf17', 'request_id': 'req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.569045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] The token cache is being invalidate because project 28c79920c3c94fe985f4a415a8dacf17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:45.569404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.570432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.583525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '28c79920c3c94fe985f4a415a8dacf17', 'request_id': 'req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.584263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '28c79920c3c94fe985f4a415a8dacf17', 'request_id': 'req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.589002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '28c79920c3c94fe985f4a415a8dacf17', 'request_id': 'req-f2d28198-2b9c-4a23-9b9b-7138e8a0c978'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:45.596857 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1963/3948] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:05:45 2022] DELETE /identity/v3/domains/28c79920c3c94fe985f4a415a8dacf17 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:45.600852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:45.602559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:45.763252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786e006-cdf6-49dc-ad5f-0938a4112268 tempest-InheritsV3TestJSON-991096117 tempest-InheritsV3TestJSON-991096117-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:45.898859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:45.900425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:45.902293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:45.903301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] PATH_INFO: `/v3/users/64b8de4514824b0f95baeb6082881f6c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:45.905677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b8de4514824b0f95baeb6082881f6c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:45.909884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:46.047910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b8de4514824b0f95baeb6082881f6c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:46.070981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b8de4514824b0f95baeb6082881f6c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:46.074306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b8de4514824b0f95baeb6082881f6c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:46.077514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b8de4514824b0f95baeb6082881f6c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:46.126783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b8de4514824b0f95baeb6082881f6c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:46.163916 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1986/3949] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:45 2022] DELETE /identity/v3/users/64b8de4514824b0f95baeb6082881f6c => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:46.168223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57466ad8-237e-4cd2-a50b-d3768374dd62 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:46.168761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57466ad8-237e-4cd2-a50b-d3768374dd62 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:46.168860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57466ad8-237e-4cd2-a50b-d3768374dd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:46.196924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-57466ad8-237e-4cd2-a50b-d3768374dd62 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:46.198399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-57466ad8-237e-4cd2-a50b-d3768374dd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:46.362658 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1964/3950] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:46.385914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:46.387844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:46.484833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:46.560199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8332631-ee49-4c51-b875-9e0f8db62a1e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:46.569609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b4886-b439-495e-9d67-6f3646149cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:46.571308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b4886-b439-495e-9d67-6f3646149cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:46.572017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b4886-b439-495e-9d67-6f3646149cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:46.573124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b4886-b439-495e-9d67-6f3646149cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:46.601860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b4886-b439-495e-9d67-6f3646149cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:46.603745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b4886-b439-495e-9d67-6f3646149cc5 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:46.617836 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1987/3951] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:05:48.649368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57466ad8-237e-4cd2-a50b-d3768374dd62 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:48.651523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-57466ad8-237e-4cd2-a50b-d3768374dd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:48.772426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746d401-3ef7-4f32-a883-135abb75c1c4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:48.773414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746d401-3ef7-4f32-a883-135abb75c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:48.774080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746d401-3ef7-4f32-a883-135abb75c1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:48.819664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57466ad8-237e-4cd2-a50b-d3768374dd62 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:48.834378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:48.835199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:48.835556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:48.835904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] PATH_INFO: `/v3/projects/623d434718904f2097dbbd99442a7ff4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:48.838090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=623d434718904f2097dbbd99442a7ff4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:48.840140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:48.843791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0746d401-3ef7-4f32-a883-135abb75c1c4 None None] MFA Rules not processed for user `06443b5728fb4d1e95d6245820e786bf`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:48.844992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0746d401-3ef7-4f32-a883-135abb75c1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:48.883058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:48.961309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623d434718904f2097dbbd99442a7ff4', 'request_id': 'req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:48.975633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623d434718904f2097dbbd99442a7ff4', 'request_id': 'req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:49.003873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623d434718904f2097dbbd99442a7ff4', 'request_id': 'req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:49.024781 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1988/3952] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:49.031783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] The token cache is being invalidate because project 623d434718904f2097dbbd99442a7ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:49.033845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983baaf-bdfc-4ef4-a6fd-9c55c5f0f19b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:49.034373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983baaf-bdfc-4ef4-a6fd-9c55c5f0f19b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:49.034812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983baaf-bdfc-4ef4-a6fd-9c55c5f0f19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:49.038688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:49.041116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:49.046214 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1965/3953] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:05:48 2022] DELETE /identity/v3/projects/623d434718904f2097dbbd99442a7ff4 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:49.050993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:49.057363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:49.064754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1983baaf-bdfc-4ef4-a6fd-9c55c5f0f19b None None] MFA Rules not processed for user `06443b5728fb4d1e95d6245820e786bf`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:49.066059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1983baaf-bdfc-4ef4-a6fd-9c55c5f0f19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:49.199624 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1989/3954] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:05:49.262919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa08ffb-aed2-4f2c-803c-6f413ba289ae admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:49.270126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:49.270880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:49.271348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:49.271745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] PATH_INFO: `/v3/users/81d09e291e7646758e3595d1e0add133` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:49.273649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d09e291e7646758e3595d1e0add133)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:49.275884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:49.400963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d09e291e7646758e3595d1e0add133'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:49.418578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d09e291e7646758e3595d1e0add133'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:49.420660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d09e291e7646758e3595d1e0add133'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:49.422671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d09e291e7646758e3595d1e0add133'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:49.453293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d09e291e7646758e3595d1e0add133'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:49.485282 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1966/3955] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:49 2022] DELETE /identity/v3/users/81d09e291e7646758e3595d1e0add133 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:50.628852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983baaf-bdfc-4ef4-a6fd-9c55c5f0f19b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:50.649382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983baaf-bdfc-4ef4-a6fd-9c55c5f0f19b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:50.799228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da6f36-ab32-45fd-9cb3-4715a0349f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:50.799899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da6f36-ab32-45fd-9cb3-4715a0349f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:50.800182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da6f36-ab32-45fd-9cb3-4715a0349f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:50.800460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da6f36-ab32-45fd-9cb3-4715a0349f45 admin admin] PATH_INFO: `/v3/projects/9f75240d7478454594425a3d130e7e8b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:50.808264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da6f36-ab32-45fd-9cb3-4715a0349f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f75240d7478454594425a3d130e7e8b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:50.817463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da6f36-ab32-45fd-9cb3-4715a0349f45 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:50.828552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:50.949050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:50.950862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:50.970853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-81da6f36-ab32-45fd-9cb3-4715a0349f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f75240d7478454594425a3d130e7e8b', 'request_id': 'req-81da6f36-ab32-45fd-9cb3-4715a0349f45'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:50.985969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-81da6f36-ab32-45fd-9cb3-4715a0349f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f75240d7478454594425a3d130e7e8b', 'request_id': 'req-81da6f36-ab32-45fd-9cb3-4715a0349f45'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:50.993274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-81da6f36-ab32-45fd-9cb3-4715a0349f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f75240d7478454594425a3d130e7e8b', 'request_id': 'req-81da6f36-ab32-45fd-9cb3-4715a0349f45'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:51.019767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-81da6f36-ab32-45fd-9cb3-4715a0349f45 admin admin] The token cache is being invalidate because project 9f75240d7478454594425a3d130e7e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:51.020109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-81da6f36-ab32-45fd-9cb3-4715a0349f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:51.020735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-81da6f36-ab32-45fd-9cb3-4715a0349f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:51.026953 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1990/3956] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:05:50 2022] DELETE /identity/v3/projects/9f75240d7478454594425a3d130e7e8b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:51.028487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aadd52-ae16-438b-ac8c-5abdb65b2a08 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:51.028775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aadd52-ae16-438b-ac8c-5abdb65b2a08 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:51.029075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aadd52-ae16-438b-ac8c-5abdb65b2a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:51.057788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:51.153906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09fb4f-febd-4ae1-b445-d1a72936ca40 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:51.175377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f0aadd52-ae16-438b-ac8c-5abdb65b2a08 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:51.178796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f0aadd52-ae16-438b-ac8c-5abdb65b2a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:51.309238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9305e8-4c07-4fa9-8c32-22d5e9a26ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:51.309834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9305e8-4c07-4fa9-8c32-22d5e9a26ea2 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:51.310052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9305e8-4c07-4fa9-8c32-22d5e9a26ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:51.310346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9305e8-4c07-4fa9-8c32-22d5e9a26ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:51.319405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8a9305e8-4c07-4fa9-8c32-22d5e9a26ea2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:51.327250 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1991/3957] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:51.335724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c8c19-a587-473f-a7d2-ae3632ee97ef None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:51.336008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c8c19-a587-473f-a7d2-ae3632ee97ef None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:51.336308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c8c19-a587-473f-a7d2-ae3632ee97ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:51.400956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b97c8c19-a587-473f-a7d2-ae3632ee97ef None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:51.402999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b97c8c19-a587-473f-a7d2-ae3632ee97ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:51.423412 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1992/3958] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:05:51.441776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c8c19-a587-473f-a7d2-ae3632ee97ef None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:51.507215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c8c19-a587-473f-a7d2-ae3632ee97ef None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:51.519541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd717ee-bef8-4692-a884-d2b4de5d3584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:51.520249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd717ee-bef8-4692-a884-d2b4de5d3584 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:51.520607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd717ee-bef8-4692-a884-d2b4de5d3584 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:51.520963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd717ee-bef8-4692-a884-d2b4de5d3584 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:51.521739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd717ee-bef8-4692-a884-d2b4de5d3584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:05:51.522117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd717ee-bef8-4692-a884-d2b4de5d3584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:51.526948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd717ee-bef8-4692-a884-d2b4de5d3584 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:51.552196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9305e8-4c07-4fa9-8c32-22d5e9a26ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:51.555885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1993/3959] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:51.557016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd717ee-bef8-4692-a884-d2b4de5d3584 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:51.559106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9305e8-4c07-4fa9-8c32-22d5e9a26ea2 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:51.583972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd717ee-bef8-4692-a884-d2b4de5d3584 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:51.594773 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1967/3960] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:05:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:05:51.607021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce7069-2e0e-4a5c-a37c-8b318cb18142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:51.607844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce7069-2e0e-4a5c-a37c-8b318cb18142 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:51.608002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce7069-2e0e-4a5c-a37c-8b318cb18142 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:51.608274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce7069-2e0e-4a5c-a37c-8b318cb18142 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:51.609024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce7069-2e0e-4a5c-a37c-8b318cb18142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:51.611117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce7069-2e0e-4a5c-a37c-8b318cb18142 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:51.708444 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1994/3961] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:05:51 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:51.713528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9305e8-4c07-4fa9-8c32-22d5e9a26ea2 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:51.727303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9305e8-4c07-4fa9-8c32-22d5e9a26ea2 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:51.861490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca3beb-f4ac-4d56-97f5-d75b61214f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:51.862106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3beb-f4ac-4d56-97f5-d75b61214f50 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:51.862391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3beb-f4ac-4d56-97f5-d75b61214f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:51.862664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3beb-f4ac-4d56-97f5-d75b61214f50 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:51.863297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca3beb-f4ac-4d56-97f5-d75b61214f50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:51.865275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca3beb-f4ac-4d56-97f5-d75b61214f50 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:51.879780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:51.904103 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1968/3962] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:51 2022] POST /identity/v3/users => generated 284 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:51.904307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce7069-2e0e-4a5c-a37c-8b318cb18142 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:51.922559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce7069-2e0e-4a5c-a37c-8b318cb18142 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:51.937524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ec8d2-41ab-41c9-adf7-71377f9f62fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:51.938008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ec8d2-41ab-41c9-adf7-71377f9f62fc admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:51.938289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ec8d2-41ab-41c9-adf7-71377f9f62fc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:51.938563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ec8d2-41ab-41c9-adf7-71377f9f62fc admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:51.939220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ec8d2-41ab-41c9-adf7-71377f9f62fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:51.941226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ec8d2-41ab-41c9-adf7-71377f9f62fc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:51.957886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:51.965241 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1995/3963] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:51.970504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca3beb-f4ac-4d56-97f5-d75b61214f50 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:51.983858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca3beb-f4ac-4d56-97f5-d75b61214f50 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:51.989980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1c106-65b8-4169-8f1d-61ba492eb17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:51.990732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1c106-65b8-4169-8f1d-61ba492eb17c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:51.991032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1c106-65b8-4169-8f1d-61ba492eb17c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:51.991284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1c106-65b8-4169-8f1d-61ba492eb17c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:51.992116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1c106-65b8-4169-8f1d-61ba492eb17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:51.994311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1c106-65b8-4169-8f1d-61ba492eb17c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:52.013284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ec8d2-41ab-41c9-adf7-71377f9f62fc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:52.024096 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1969/3964] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:52.026075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ec8d2-41ab-41c9-adf7-71377f9f62fc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:52.032967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e366c-135f-4a4c-bfdf-a8e3406573aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:52.033574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e366c-135f-4a4c-bfdf-a8e3406573aa admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:52.033854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e366c-135f-4a4c-bfdf-a8e3406573aa admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:52.034125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e366c-135f-4a4c-bfdf-a8e3406573aa admin admin] PATH_INFO: `/v3/projects/c489f53774f547f5af7b38a975fab235/users/ac248da74b764a1cbd04de2dce45ee97/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:52.051824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e366c-135f-4a4c-bfdf-a8e3406573aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c489f53774f547f5af7b38a975fab235, user_id=ac248da74b764a1cbd04de2dce45ee97, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:52.055315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e366c-135f-4a4c-bfdf-a8e3406573aa admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:52.093811 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1996/3965] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:05:52 2022] PUT /identity/v3/projects/c489f53774f547f5af7b38a975fab235/users/ac248da74b764a1cbd04de2dce45ee97/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:52.097764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42eac-f3ac-49d6-b049-86832123a002 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:52.098059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42eac-f3ac-49d6-b049-86832123a002 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:52.098342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42eac-f3ac-49d6-b049-86832123a002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:52.178419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-78b42eac-f3ac-49d6-b049-86832123a002 None None] MFA Rules not processed for user `ac248da74b764a1cbd04de2dce45ee97`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:52.181648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-78b42eac-f3ac-49d6-b049-86832123a002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:52.263914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e366c-135f-4a4c-bfdf-a8e3406573aa admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:52.264831 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1970/3966] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:52.399428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e366c-135f-4a4c-bfdf-a8e3406573aa admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:52.404919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d00817-cce3-472f-8397-92915b3f9e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:52.405561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d00817-cce3-472f-8397-92915b3f9e43 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:52.406547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d00817-cce3-472f-8397-92915b3f9e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:52.407001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d00817-cce3-472f-8397-92915b3f9e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:52.407476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d00817-cce3-472f-8397-92915b3f9e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:52.409532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d00817-cce3-472f-8397-92915b3f9e43 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:52.449002 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1997/3967] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:05:52 2022] POST /identity/v3/projects => generated 365 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:52.449748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b42eac-f3ac-49d6-b049-86832123a002 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:52.467438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b42eac-f3ac-49d6-b049-86832123a002 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:52.614058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2a51e-7219-4af8-b049-af8338a125fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:52.616361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2a51e-7219-4af8-b049-af8338a125fb admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:52.617493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2a51e-7219-4af8-b049-af8338a125fb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:52.618210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2a51e-7219-4af8-b049-af8338a125fb admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:52.622232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2a51e-7219-4af8-b049-af8338a125fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:52.630848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2a51e-7219-4af8-b049-af8338a125fb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:52.681219 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1971/3968] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:52 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:05:52.685279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d00817-cce3-472f-8397-92915b3f9e43 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:52.703262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d00817-cce3-472f-8397-92915b3f9e43 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:52.718424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3befe-ff8c-49be-bb51-ffca341313cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:52.719944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3befe-ff8c-49be-bb51-ffca341313cf admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:52.721838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3befe-ff8c-49be-bb51-ffca341313cf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:52.722288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3befe-ff8c-49be-bb51-ffca341313cf admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:52.723799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3befe-ff8c-49be-bb51-ffca341313cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:52.732428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3befe-ff8c-49be-bb51-ffca341313cf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:52.764094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2a51e-7219-4af8-b049-af8338a125fb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:52.764417 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1998/3969] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:52.785804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2a51e-7219-4af8-b049-af8338a125fb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:52.790730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfc08c-6fa9-476d-a361-0a83cdc5ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:52.791421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfc08c-6fa9-476d-a361-0a83cdc5ac74 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:52.791700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfc08c-6fa9-476d-a361-0a83cdc5ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:52.791973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfc08c-6fa9-476d-a361-0a83cdc5ac74 admin admin] PATH_INFO: `/v3/projects/55a0b168cecb4c9093d94be1b5e680a9/users/1081d5c3933d4380a769d7d9d1a1f88c/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:52.830198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfc08c-6fa9-476d-a361-0a83cdc5ac74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a0b168cecb4c9093d94be1b5e680a9, user_id=1081d5c3933d4380a769d7d9d1a1f88c, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:52.832857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfc08c-6fa9-476d-a361-0a83cdc5ac74 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:52.862900 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1972/3970] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:05:52 2022] PUT /identity/v3/projects/55a0b168cecb4c9093d94be1b5e680a9/users/1081d5c3933d4380a769d7d9d1a1f88c/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:52.867192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3befe-ff8c-49be-bb51-ffca341313cf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:52.886310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3befe-ff8c-49be-bb51-ffca341313cf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:53.046973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af0dd9-964f-4c37-a195-2f3207768dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:53.047416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af0dd9-964f-4c37-a195-2f3207768dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:53.047695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af0dd9-964f-4c37-a195-2f3207768dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:53.047964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af0dd9-964f-4c37-a195-2f3207768dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:53.048612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af0dd9-964f-4c37-a195-2f3207768dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:53.050243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af0dd9-964f-4c37-a195-2f3207768dd9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:53.072610 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 1999/3971] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:53.073669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfc08c-6fa9-476d-a361-0a83cdc5ac74 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:53.091648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfc08c-6fa9-476d-a361-0a83cdc5ac74 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:53.104099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bad2ee-0855-4ede-8b88-4780a7bcf9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:53.105780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bad2ee-0855-4ede-8b88-4780a7bcf9a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:53.106061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bad2ee-0855-4ede-8b88-4780a7bcf9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:53.106336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bad2ee-0855-4ede-8b88-4780a7bcf9a2 admin admin] PATH_INFO: `/v3/projects/55a0b168cecb4c9093d94be1b5e680a9/users/1081d5c3933d4380a769d7d9d1a1f88c/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:53.114043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bad2ee-0855-4ede-8b88-4780a7bcf9a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a0b168cecb4c9093d94be1b5e680a9, user_id=1081d5c3933d4380a769d7d9d1a1f88c, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:53.116668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bad2ee-0855-4ede-8b88-4780a7bcf9a2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:53.153598 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1973/3972] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:05:53 2022] PUT /identity/v3/projects/55a0b168cecb4c9093d94be1b5e680a9/users/1081d5c3933d4380a769d7d9d1a1f88c/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:53.157535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414f44-b006-4545-91ca-f40f7aa9aa28 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:53.158093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414f44-b006-4545-91ca-f40f7aa9aa28 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:53.158630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414f44-b006-4545-91ca-f40f7aa9aa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:53.209411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c2414f44-b006-4545-91ca-f40f7aa9aa28 None None] MFA Rules not processed for user `1081d5c3933d4380a769d7d9d1a1f88c`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:53.210662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c2414f44-b006-4545-91ca-f40f7aa9aa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:53.306180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:53.453451 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2000/3973] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:53.456868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bad2ee-0855-4ede-8b88-4780a7bcf9a2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:53.495164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bad2ee-0855-4ede-8b88-4780a7bcf9a2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:53.528602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bd9c5-d6c1-46a6-bbec-45979222abb4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:53.529350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bd9c5-d6c1-46a6-bbec-45979222abb4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:53.529673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bd9c5-d6c1-46a6-bbec-45979222abb4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:53.530409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bd9c5-d6c1-46a6-bbec-45979222abb4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:53.533285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bd9c5-d6c1-46a6-bbec-45979222abb4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:53.535640 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-286bd9c5-d6c1-46a6-bbec-45979222abb4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:53.535640 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:53.535640 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:53.536960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bd9c5-d6c1-46a6-bbec-45979222abb4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:53.596076 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1974/3974] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:05:53 2022] POST /identity/v3/regions => generated 223 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:53.597725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414f44-b006-4545-91ca-f40f7aa9aa28 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:53.613802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414f44-b006-4545-91ca-f40f7aa9aa28 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:53.652592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521c412-3cfb-4a81-8a77-978c295f51ae tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:53.654022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521c412-3cfb-4a81-8a77-978c295f51ae tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:53.654725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521c412-3cfb-4a81-8a77-978c295f51ae tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:53.655079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521c412-3cfb-4a81-8a77-978c295f51ae tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:53.656373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521c412-3cfb-4a81-8a77-978c295f51ae tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:53.658281 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-1521c412-3cfb-4a81-8a77-978c295f51ae tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:53.658281 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:53.658281 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:53.659451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521c412-3cfb-4a81-8a77-978c295f51ae tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:53.744783 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2001/3975] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:05:53 2022] POST /identity/v3/regions => generated 224 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:53.750620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bd9c5-d6c1-46a6-bbec-45979222abb4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:53.776244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bd9c5-d6c1-46a6-bbec-45979222abb4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:53.797881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:53.827216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe64f5-7621-43ff-b9ca-ad3384c7645c tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:53.828527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe64f5-7621-43ff-b9ca-ad3384c7645c tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:53.828863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe64f5-7621-43ff-b9ca-ad3384c7645c tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:53.830384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe64f5-7621-43ff-b9ca-ad3384c7645c tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions/dd7d3fab-83a6-4f56-aca0-e10466a21997` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:53.831259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe64f5-7621-43ff-b9ca-ad3384c7645c tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:create_region(region_id=dd7d3fab-83a6-4f56-aca0-e10466a21997)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:53.832921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe64f5-7621-43ff-b9ca-ad3384c7645c tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:53.870683 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1975/3976] 10.222.0.26 () {60 vars in 1259 bytes} [Sat Oct 8 21:05:53 2022] PUT /identity/v3/regions/dd7d3fab-83a6-4f56-aca0-e10466a21997 => generated 232 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:53.873901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521c412-3cfb-4a81-8a77-978c295f51ae tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:53.893535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521c412-3cfb-4a81-8a77-978c295f51ae tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:53.922464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f432a9-7ae8-459a-814e-5c14d245c887 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:53.923110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f432a9-7ae8-459a-814e-5c14d245c887 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:53.923393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f432a9-7ae8-459a-814e-5c14d245c887 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:53.923666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f432a9-7ae8-459a-814e-5c14d245c887 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions/dd7d3fab-83a6-4f56-aca0-e10466a21997` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:53.924626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f432a9-7ae8-459a-814e-5c14d245c887 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:delete_region(region_id=dd7d3fab-83a6-4f56-aca0-e10466a21997)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:53.925653 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-d9f432a9-7ae8-459a-814e-5c14d245c887 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:53.925653 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:53.925653 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:53.927180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f432a9-7ae8-459a-814e-5c14d245c887 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:53.968927 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2002/3977] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 21:05:53 2022] DELETE /identity/v3/regions/dd7d3fab-83a6-4f56-aca0-e10466a21997 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:53.974028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe64f5-7621-43ff-b9ca-ad3384c7645c tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:53.986775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe64f5-7621-43ff-b9ca-ad3384c7645c tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:54.003639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab479aa2-ae27-4803-a99b-195648e3c609 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:54.004517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab479aa2-ae27-4803-a99b-195648e3c609 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:54.004826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab479aa2-ae27-4803-a99b-195648e3c609 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:54.005128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab479aa2-ae27-4803-a99b-195648e3c609 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:54.005825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab479aa2-ae27-4803-a99b-195648e3c609 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:54.007463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab479aa2-ae27-4803-a99b-195648e3c609 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:54.040533 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1976/3978] 10.222.0.26 () {60 vars in 1150 bytes} [Sat Oct 8 21:05:53 2022] POST /identity/v3/regions => generated 253 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:54.045838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f432a9-7ae8-459a-814e-5c14d245c887 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:54.069953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f432a9-7ae8-459a-814e-5c14d245c887 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:54.161869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642309a4-1e90-4d39-a845-0771e99e2ab3 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:54.169104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642309a4-1e90-4d39-a845-0771e99e2ab3 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:54.172120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642309a4-1e90-4d39-a845-0771e99e2ab3 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:54.172431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642309a4-1e90-4d39-a845-0771e99e2ab3 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions/b2232f493c7f4b268ee1f56abbc94b74` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:54.175443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642309a4-1e90-4d39-a845-0771e99e2ab3 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:update_region(region_id=b2232f493c7f4b268ee1f56abbc94b74)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:54.179755 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-642309a4-1e90-4d39-a845-0771e99e2ab3 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:54.179755 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:05:54.179755 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:05:54.185222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642309a4-1e90-4d39-a845-0771e99e2ab3 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:54.261363 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2003/3979] 10.222.0.26 () {60 vars in 1250 bytes} [Sat Oct 8 21:05:54 2022] PATCH /identity/v3/regions/b2232f493c7f4b268ee1f56abbc94b74 => generated 253 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:54.266750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab479aa2-ae27-4803-a99b-195648e3c609 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:54.287908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab479aa2-ae27-4803-a99b-195648e3c609 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:54.332610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eb4be-e6bb-4fa8-9ac4-4daadbb69f17 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:54.335793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eb4be-e6bb-4fa8-9ac4-4daadbb69f17 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:54.336146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eb4be-e6bb-4fa8-9ac4-4daadbb69f17 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:54.336429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eb4be-e6bb-4fa8-9ac4-4daadbb69f17 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions/b2232f493c7f4b268ee1f56abbc94b74` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:54.337401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4eb4be-e6bb-4fa8-9ac4-4daadbb69f17 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:get_region(region_id=b2232f493c7f4b268ee1f56abbc94b74)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:54.338507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4eb4be-e6bb-4fa8-9ac4-4daadbb69f17 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:54.358189 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1977/3980] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:05:54 2022] GET /identity/v3/regions/b2232f493c7f4b268ee1f56abbc94b74 => generated 253 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:54.358435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642309a4-1e90-4d39-a845-0771e99e2ab3 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:54.375649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642309a4-1e90-4d39-a845-0771e99e2ab3 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:54.392162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6992c-56ae-4dc8-adec-1ec761760e9a tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:54.395282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6992c-56ae-4dc8-adec-1ec761760e9a tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:54.398755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6992c-56ae-4dc8-adec-1ec761760e9a tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:54.399151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6992c-56ae-4dc8-adec-1ec761760e9a tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions/b2232f493c7f4b268ee1f56abbc94b74` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:54.399869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6992c-56ae-4dc8-adec-1ec761760e9a tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:delete_region(region_id=b2232f493c7f4b268ee1f56abbc94b74)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:54.403507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6992c-56ae-4dc8-adec-1ec761760e9a tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:54.466750 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2004/3981] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:05:54 2022] DELETE /identity/v3/regions/b2232f493c7f4b268ee1f56abbc94b74 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:54.471313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eb4be-e6bb-4fa8-9ac4-4daadbb69f17 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:54.488198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eb4be-e6bb-4fa8-9ac4-4daadbb69f17 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:54.521292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc46b1a-850d-41f5-97b9-b5d25e4d2ca1 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:54.522240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc46b1a-850d-41f5-97b9-b5d25e4d2ca1 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:54.522697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc46b1a-850d-41f5-97b9-b5d25e4d2ca1 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:54.523129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc46b1a-850d-41f5-97b9-b5d25e4d2ca1 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:54.523896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc46b1a-850d-41f5-97b9-b5d25e4d2ca1 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:54.526386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc46b1a-850d-41f5-97b9-b5d25e4d2ca1 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:54.559937 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1978/3982] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 8 21:05:54 2022] GET /identity/v3/regions => generated 669 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:54.564853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6992c-56ae-4dc8-adec-1ec761760e9a tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:54.582804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6992c-56ae-4dc8-adec-1ec761760e9a tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:54.589842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e4aa9-3c71-4714-8eb9-71457f2970d4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:54.590792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e4aa9-3c71-4714-8eb9-71457f2970d4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:54.591327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e4aa9-3c71-4714-8eb9-71457f2970d4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:54.591931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e4aa9-3c71-4714-8eb9-71457f2970d4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions/b2232f493c7f4b268ee1f56abbc94b74` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:54.592817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e4aa9-3c71-4714-8eb9-71457f2970d4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:delete_region(region_id=b2232f493c7f4b268ee1f56abbc94b74)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:54.595482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e4aa9-3c71-4714-8eb9-71457f2970d4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-ee8e4aa9-3c71-4714-8eb9-71457f2970d4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Could not find region: b2232f493c7f4b268ee1f56abbc94b74.: keystone.exception.RegionNotFound: Could not find region: b2232f493c7f4b268ee1f56abbc94b74. Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: b2232f493c7f4b268ee1f56abbc94b74. Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:05:54.643782 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: b2232f493c7f4b268ee1f56abbc94b74. Oct 08 21:05:54.645273 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:05:54.650515 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2005/3983] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:05:54 2022] DELETE /identity/v3/regions/b2232f493c7f4b268ee1f56abbc94b74 => generated 112 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:05:54.650627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc46b1a-850d-41f5-97b9-b5d25e4d2ca1 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:54.663257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc46b1a-850d-41f5-97b9-b5d25e4d2ca1 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:54.669023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806b4f4-a3be-49ac-b591-5ff8870c6463 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:54.669725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806b4f4-a3be-49ac-b591-5ff8870c6463 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:54.670006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806b4f4-a3be-49ac-b591-5ff8870c6463 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:54.670279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806b4f4-a3be-49ac-b591-5ff8870c6463 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:54.670885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806b4f4-a3be-49ac-b591-5ff8870c6463 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:54.672085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806b4f4-a3be-49ac-b591-5ff8870c6463 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:54.682088 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1979/3984] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 8 21:05:54 2022] GET /identity/v3/regions => generated 669 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:54.683255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e4aa9-3c71-4714-8eb9-71457f2970d4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:54.697011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e4aa9-3c71-4714-8eb9-71457f2970d4 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:54.702482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21a0f1-c57c-4289-9af0-a1fdf0bfdd0e tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:54.703771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a0f1-c57c-4289-9af0-a1fdf0bfdd0e tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:54.704306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a0f1-c57c-4289-9af0-a1fdf0bfdd0e tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:54.704760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a0f1-c57c-4289-9af0-a1fdf0bfdd0e tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:54.705702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21a0f1-c57c-4289-9af0-a1fdf0bfdd0e tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:54.707740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21a0f1-c57c-4289-9af0-a1fdf0bfdd0e tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:54.749804 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2006/3985] 10.222.0.26 () {60 vars in 1150 bytes} [Sat Oct 8 21:05:54 2022] POST /identity/v3/regions => generated 253 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:54.754282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806b4f4-a3be-49ac-b591-5ff8870c6463 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:54.772045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806b4f4-a3be-49ac-b591-5ff8870c6463 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:54.806000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c356c6-05e1-4c71-a9c3-16679e45790b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:54.806911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c356c6-05e1-4c71-a9c3-16679e45790b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:54.807297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c356c6-05e1-4c71-a9c3-16679e45790b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:54.807736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c356c6-05e1-4c71-a9c3-16679e45790b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:54.808716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c356c6-05e1-4c71-a9c3-16679e45790b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Adding query filter params (parent_region_id=dab0b50500e5409992694dd38ca5eddb) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:05:54.809178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c356c6-05e1-4c71-a9c3-16679e45790b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:54.820429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c356c6-05e1-4c71-a9c3-16679e45790b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:54.830778 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1980/3986] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:05:54 2022] GET /identity/v3/regions?parent_region_id=dab0b50500e5409992694dd38ca5eddb => generated 399 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:05:54.834705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21a0f1-c57c-4289-9af0-a1fdf0bfdd0e tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:54.849940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21a0f1-c57c-4289-9af0-a1fdf0bfdd0e tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:54.858017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b07bc7-78a2-4a4e-8548-e3a7b4c32856 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:54.863616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b07bc7-78a2-4a4e-8548-e3a7b4c32856 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:54.863938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b07bc7-78a2-4a4e-8548-e3a7b4c32856 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:54.864182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b07bc7-78a2-4a4e-8548-e3a7b4c32856 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions/07d9b8ad6857485386516de96a82d674` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:54.864806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b07bc7-78a2-4a4e-8548-e3a7b4c32856 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:delete_region(region_id=07d9b8ad6857485386516de96a82d674)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:54.870276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b07bc7-78a2-4a4e-8548-e3a7b4c32856 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:54.922635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c356c6-05e1-4c71-a9c3-16679e45790b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:54.922806 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2007/3987] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:05:54 2022] DELETE /identity/v3/regions/07d9b8ad6857485386516de96a82d674 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:54.938898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c356c6-05e1-4c71-a9c3-16679e45790b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:54.990508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3890990-399f-4cf2-ad0e-6742237aed9b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:54.991057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3890990-399f-4cf2-ad0e-6742237aed9b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:54.991343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3890990-399f-4cf2-ad0e-6742237aed9b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:54.991617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3890990-399f-4cf2-ad0e-6742237aed9b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions/627daf1dc2f84407b66f7a79ebc957b0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:54.992217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3890990-399f-4cf2-ad0e-6742237aed9b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:delete_region(region_id=627daf1dc2f84407b66f7a79ebc957b0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:54.993260 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-f3890990-399f-4cf2-ad0e-6742237aed9b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:05:54.993260 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:05:54.993260 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:05:54.994677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3890990-399f-4cf2-ad0e-6742237aed9b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:55.060268 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1981/3988] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:05:54 2022] DELETE /identity/v3/regions/627daf1dc2f84407b66f7a79ebc957b0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:55.061442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b07bc7-78a2-4a4e-8548-e3a7b4c32856 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:55.080624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b07bc7-78a2-4a4e-8548-e3a7b4c32856 tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:55.120250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6901106-425f-412a-9f83-feef8d902aed tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1081d5c3933d4380a769d7d9d1a1f88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a0b168cecb4c9093d94be1b5e680a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:55.121119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6901106-425f-412a-9f83-feef8d902aed tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:55.121582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6901106-425f-412a-9f83-feef8d902aed tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:55.123038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6901106-425f-412a-9f83-feef8d902aed tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] PATH_INFO: `/v3/regions/dab0b50500e5409992694dd38ca5eddb` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:55.124081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6901106-425f-412a-9f83-feef8d902aed tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorizing `identity:delete_region(region_id=dab0b50500e5409992694dd38ca5eddb)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:55.133517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6901106-425f-412a-9f83-feef8d902aed tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:55.181340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3890990-399f-4cf2-ad0e-6742237aed9b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:55.182695 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2008/3989] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:05:55 2022] DELETE /identity/v3/regions/dab0b50500e5409992694dd38ca5eddb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:05:55.392977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3890990-399f-4cf2-ad0e-6742237aed9b tempest-RegionsTestJSON-755418900 tempest-RegionsTestJSON-755418900-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:55.434649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:55.435711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:55.436205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:55.437332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] PATH_INFO: `/v3/users/ac248da74b764a1cbd04de2dce45ee97` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:55.439612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac248da74b764a1cbd04de2dce45ee97)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:55.445320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:55.455110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:55.552633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac248da74b764a1cbd04de2dce45ee97'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:55.566075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac248da74b764a1cbd04de2dce45ee97'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:55.569469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac248da74b764a1cbd04de2dce45ee97'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:55.570486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac248da74b764a1cbd04de2dce45ee97'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:55.601793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac248da74b764a1cbd04de2dce45ee97'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:55.631828 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1982/3990] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:55 2022] DELETE /identity/v3/users/ac248da74b764a1cbd04de2dce45ee97 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:55.638280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8827c9-fcd8-45a6-9b79-7b71e86f4934 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:55.638760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8827c9-fcd8-45a6-9b79-7b71e86f4934 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:55.639138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8827c9-fcd8-45a6-9b79-7b71e86f4934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:55.656653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:55.694515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fe8827c9-fcd8-45a6-9b79-7b71e86f4934 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:55.699638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fe8827c9-fcd8-45a6-9b79-7b71e86f4934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:55.825045 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2009/3991] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:55.858977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:55.860960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:56.027331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c923ba2-79b3-42f0-b365-f85efb4a290a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:56.031140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82362e60-9384-44c4-aece-bad48dabbddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:56.031804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82362e60-9384-44c4-aece-bad48dabbddb service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:56.032092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82362e60-9384-44c4-aece-bad48dabbddb service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:56.032437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82362e60-9384-44c4-aece-bad48dabbddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:56.042275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82362e60-9384-44c4-aece-bad48dabbddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:56.043741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82362e60-9384-44c4-aece-bad48dabbddb service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:56.057036 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1983/3992] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:05:57.330807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8827c9-fcd8-45a6-9b79-7b71e86f4934 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:57.332847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fe8827c9-fcd8-45a6-9b79-7b71e86f4934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:57.346651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8827c9-fcd8-45a6-9b79-7b71e86f4934 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:57.353294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:57.354154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:57.354571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:57.355085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] PATH_INFO: `/v3/projects/c489f53774f547f5af7b38a975fab235` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:57.356531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c489f53774f547f5af7b38a975fab235)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:57.358765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:57.423796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c489f53774f547f5af7b38a975fab235', 'request_id': 'req-9a3d4d85-3d0d-4780-86e9-b1348213b818'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:57.433471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c489f53774f547f5af7b38a975fab235', 'request_id': 'req-9a3d4d85-3d0d-4780-86e9-b1348213b818'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:57.442570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c489f53774f547f5af7b38a975fab235', 'request_id': 'req-9a3d4d85-3d0d-4780-86e9-b1348213b818'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:57.458551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] The token cache is being invalidate because project c489f53774f547f5af7b38a975fab235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:57.458966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:57.459651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:57.464285 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2010/3993] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:05:57 2022] DELETE /identity/v3/projects/c489f53774f547f5af7b38a975fab235 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:57.465952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82362e60-9384-44c4-aece-bad48dabbddb service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:57.483027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82362e60-9384-44c4-aece-bad48dabbddb service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:57.550173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:57.569217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c669eff-68fd-4146-b73c-edecb902e40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:57.569884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669eff-68fd-4146-b73c-edecb902e40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:57.570163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669eff-68fd-4146-b73c-edecb902e40c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:57.570872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669eff-68fd-4146-b73c-edecb902e40c admin admin] PATH_INFO: `/v3/users/1081d5c3933d4380a769d7d9d1a1f88c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:57.571623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c669eff-68fd-4146-b73c-edecb902e40c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1081d5c3933d4380a769d7d9d1a1f88c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:57.573870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c669eff-68fd-4146-b73c-edecb902e40c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:57.630276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4c669eff-68fd-4146-b73c-edecb902e40c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1081d5c3933d4380a769d7d9d1a1f88c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:57.638294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4c669eff-68fd-4146-b73c-edecb902e40c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1081d5c3933d4380a769d7d9d1a1f88c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:57.639132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4c669eff-68fd-4146-b73c-edecb902e40c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1081d5c3933d4380a769d7d9d1a1f88c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:57.639754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4c669eff-68fd-4146-b73c-edecb902e40c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1081d5c3933d4380a769d7d9d1a1f88c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:57.653801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4c669eff-68fd-4146-b73c-edecb902e40c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1081d5c3933d4380a769d7d9d1a1f88c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:57.678019 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1984/3994] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:05:57 2022] DELETE /identity/v3/users/1081d5c3933d4380a769d7d9d1a1f88c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:58.187281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:58.188991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:58.214225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d4d85-3d0d-4780-86e9-b1348213b818 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:58.365474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:58.367691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:58.367992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:58.368254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97 admin admin] PATH_INFO: `/v3/projects/55a0b168cecb4c9093d94be1b5e680a9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:58.380309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a0b168cecb4c9093d94be1b5e680a9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:58.383472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:58.451817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:58.485435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a0b168cecb4c9093d94be1b5e680a9', 'request_id': 'req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:58.503846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a0b168cecb4c9093d94be1b5e680a9', 'request_id': 'req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:58.526277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a0b168cecb4c9093d94be1b5e680a9', 'request_id': 'req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:58.559711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97 admin admin] The token cache is being invalidate because project 55a0b168cecb4c9093d94be1b5e680a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:05:58.560084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:58.560938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e238e64a-4bb6-4284-a764-8fdd1c1fbd97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:05:58.567739 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2011/3995] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:05:58 2022] DELETE /identity/v3/projects/55a0b168cecb4c9093d94be1b5e680a9 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:58.572433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7823b-b604-44d4-ba95-88f1d94a2153 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:58.573009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7823b-b604-44d4-ba95-88f1d94a2153 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:58.573161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7823b-b604-44d4-ba95-88f1d94a2153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:58.614036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-70d7823b-b604-44d4-ba95-88f1d94a2153 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:58.615588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-70d7823b-b604-44d4-ba95-88f1d94a2153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:58.711269 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1985/3996] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:58.712548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1682-4baa-4fc1-84f3-434db17a1dd3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:58.719040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1682-4baa-4fc1-84f3-434db17a1dd3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:58.719560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1682-4baa-4fc1-84f3-434db17a1dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:58.754074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bafe1682-4baa-4fc1-84f3-434db17a1dd3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:58.755578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bafe1682-4baa-4fc1-84f3-434db17a1dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:58.772407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7823b-b604-44d4-ba95-88f1d94a2153 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:58.773332 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2012/3997] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:58.784420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7823b-b604-44d4-ba95-88f1d94a2153 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:58.790382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b07639-5515-47a2-b5f9-2e54dbc13c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:58.791249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b07639-5515-47a2-b5f9-2e54dbc13c0e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:58.791692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b07639-5515-47a2-b5f9-2e54dbc13c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:58.792149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b07639-5515-47a2-b5f9-2e54dbc13c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:58.793084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b07639-5515-47a2-b5f9-2e54dbc13c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:05:58.793574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b07639-5515-47a2-b5f9-2e54dbc13c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:58.795355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b07639-5515-47a2-b5f9-2e54dbc13c0e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:58.810352 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1986/3998] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:05:58.826047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe1682-4baa-4fc1-84f3-434db17a1dd3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:58.839124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe1682-4baa-4fc1-84f3-434db17a1dd3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:58.846966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663018-e7c6-4642-998d-8f0d137fdbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:58.847595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663018-e7c6-4642-998d-8f0d137fdbdf admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:58.847878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663018-e7c6-4642-998d-8f0d137fdbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:58.848153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663018-e7c6-4642-998d-8f0d137fdbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:58.848789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663018-e7c6-4642-998d-8f0d137fdbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:58.850958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663018-e7c6-4642-998d-8f0d137fdbdf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:58.907770 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2013/3999] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:05:58 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:58.911222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b07639-5515-47a2-b5f9-2e54dbc13c0e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:58.927287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b07639-5515-47a2-b5f9-2e54dbc13c0e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:59.017287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:59.036523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17d87f-32c6-4cfe-952b-5bc1acd80296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:59.037397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17d87f-32c6-4cfe-952b-5bc1acd80296 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:59.037770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17d87f-32c6-4cfe-952b-5bc1acd80296 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:59.038125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17d87f-32c6-4cfe-952b-5bc1acd80296 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:59.039009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17d87f-32c6-4cfe-952b-5bc1acd80296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:59.041430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17d87f-32c6-4cfe-952b-5bc1acd80296 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:59.074705 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1987/4000] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:58 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:59.075594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663018-e7c6-4642-998d-8f0d137fdbdf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:59.091036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663018-e7c6-4642-998d-8f0d137fdbdf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:59.098990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41302931-3c81-474a-bad7-81195075fab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:59.099630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41302931-3c81-474a-bad7-81195075fab9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:59.104700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41302931-3c81-474a-bad7-81195075fab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:59.105114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41302931-3c81-474a-bad7-81195075fab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:59.105833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41302931-3c81-474a-bad7-81195075fab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:59.107510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41302931-3c81-474a-bad7-81195075fab9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:59.137375 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2014/4001] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:59.137959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17d87f-32c6-4cfe-952b-5bc1acd80296 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:59.157667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17d87f-32c6-4cfe-952b-5bc1acd80296 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:59.165559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5bff9-1db0-4c9a-852d-b35b019e1a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:59.166176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5bff9-1db0-4c9a-852d-b35b019e1a81 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:59.166454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5bff9-1db0-4c9a-852d-b35b019e1a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:59.166724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5bff9-1db0-4c9a-852d-b35b019e1a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:59.167370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5bff9-1db0-4c9a-852d-b35b019e1a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:59.168956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5bff9-1db0-4c9a-852d-b35b019e1a81 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:59.186138 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1988/4002] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:05:59.190303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41302931-3c81-474a-bad7-81195075fab9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:59.201006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41302931-3c81-474a-bad7-81195075fab9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:59.205983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7cf57e-70db-45ea-ba9e-075d0a4c573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:59.206591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7cf57e-70db-45ea-ba9e-075d0a4c573f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:59.206868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7cf57e-70db-45ea-ba9e-075d0a4c573f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:59.207140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7cf57e-70db-45ea-ba9e-075d0a4c573f admin admin] PATH_INFO: `/v3/projects/886bc0d3e477445991389c4a747a3883/users/f9f5653d306043f080bd3cd96bb8621c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:59.226080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7cf57e-70db-45ea-ba9e-075d0a4c573f admin admin] RBAC: Authorizing `identity:create_grant(project_id=886bc0d3e477445991389c4a747a3883, user_id=f9f5653d306043f080bd3cd96bb8621c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:59.228822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7cf57e-70db-45ea-ba9e-075d0a4c573f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:59.254664 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2015/4003] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:05:59 2022] PUT /identity/v3/projects/886bc0d3e477445991389c4a747a3883/users/f9f5653d306043f080bd3cd96bb8621c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:59.266330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec88a71-01f6-48c6-b7ad-18500cac4f11 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:59.266513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec88a71-01f6-48c6-b7ad-18500cac4f11 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:59.266785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec88a71-01f6-48c6-b7ad-18500cac4f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:59.306036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0ec88a71-01f6-48c6-b7ad-18500cac4f11 None None] MFA Rules not processed for user `f9f5653d306043f080bd3cd96bb8621c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:05:59.307860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0ec88a71-01f6-48c6-b7ad-18500cac4f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:05:59.403505 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1989/4004] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:05:59.408592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7cf57e-70db-45ea-ba9e-075d0a4c573f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:59.525461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7cf57e-70db-45ea-ba9e-075d0a4c573f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:59.533235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24782ce-1ab0-42c6-ac16-2c87f3c353bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:59.534218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24782ce-1ab0-42c6-ac16-2c87f3c353bc admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:59.534665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24782ce-1ab0-42c6-ac16-2c87f3c353bc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:59.535139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24782ce-1ab0-42c6-ac16-2c87f3c353bc admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:59.536016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24782ce-1ab0-42c6-ac16-2c87f3c353bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:59.539132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24782ce-1ab0-42c6-ac16-2c87f3c353bc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:59.583716 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2016/4005] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:05:59 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:59.588942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec88a71-01f6-48c6-b7ad-18500cac4f11 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:59.604956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec88a71-01f6-48c6-b7ad-18500cac4f11 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:59.728662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a67891-be72-4345-9f09-c574f44b5d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:59.729961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a67891-be72-4345-9f09-c574f44b5d3a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:59.730274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a67891-be72-4345-9f09-c574f44b5d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:59.730547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a67891-be72-4345-9f09-c574f44b5d3a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:59.731206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a67891-be72-4345-9f09-c574f44b5d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:59.733212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a67891-be72-4345-9f09-c574f44b5d3a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:59.791319 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1990/4006] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:05:59 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:05:59.796704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24782ce-1ab0-42c6-ac16-2c87f3c353bc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:59.820250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24782ce-1ab0-42c6-ac16-2c87f3c353bc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:59.834780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859cacd-3ad9-42c8-9b43-1836aa23f21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:59.835464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859cacd-3ad9-42c8-9b43-1836aa23f21b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:59.835756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859cacd-3ad9-42c8-9b43-1836aa23f21b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:59.836312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859cacd-3ad9-42c8-9b43-1836aa23f21b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:59.836979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859cacd-3ad9-42c8-9b43-1836aa23f21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:59.841360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859cacd-3ad9-42c8-9b43-1836aa23f21b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:59.857959 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2017/4007] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:05:59.860655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a67891-be72-4345-9f09-c574f44b5d3a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:59.878101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a67891-be72-4345-9f09-c574f44b5d3a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:05:59.894195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e800d-b257-49fe-916a-2eb4a1cb9142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:05:59.895798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e800d-b257-49fe-916a-2eb4a1cb9142 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:05:59.896578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e800d-b257-49fe-916a-2eb4a1cb9142 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:05:59.897280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e800d-b257-49fe-916a-2eb4a1cb9142 admin admin] PATH_INFO: `/v3/projects/efc1557433954550818d64959e8df818/users/54244510562d45e2915a93bb03f7c598/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:05:59.922938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e800d-b257-49fe-916a-2eb4a1cb9142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc1557433954550818d64959e8df818, user_id=54244510562d45e2915a93bb03f7c598, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:05:59.926360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e800d-b257-49fe-916a-2eb4a1cb9142 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:05:59.946965 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1991/4008] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:05:59 2022] PUT /identity/v3/projects/efc1557433954550818d64959e8df818/users/54244510562d45e2915a93bb03f7c598/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:05:59.951518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859cacd-3ad9-42c8-9b43-1836aa23f21b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:05:59.965964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859cacd-3ad9-42c8-9b43-1836aa23f21b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:00.011916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:00.064484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4c1d3-d203-452e-a1df-25bb6d3a2720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:00.064955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4c1d3-d203-452e-a1df-25bb6d3a2720 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:00.065203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4c1d3-d203-452e-a1df-25bb6d3a2720 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:00.065513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4c1d3-d203-452e-a1df-25bb6d3a2720 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:00.066352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4c1d3-d203-452e-a1df-25bb6d3a2720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:00.068494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4c1d3-d203-452e-a1df-25bb6d3a2720 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:00.086477 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2018/4009] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:00.096778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e800d-b257-49fe-916a-2eb4a1cb9142 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:00.129342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e800d-b257-49fe-916a-2eb4a1cb9142 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:00.137909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c0a7c-58b5-4ebe-8447-87b2f0c610e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:00.138586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c0a7c-58b5-4ebe-8447-87b2f0c610e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:00.138868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c0a7c-58b5-4ebe-8447-87b2f0c610e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:00.139175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c0a7c-58b5-4ebe-8447-87b2f0c610e9 admin admin] PATH_INFO: `/v3/projects/efc1557433954550818d64959e8df818/users/54244510562d45e2915a93bb03f7c598/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:00.143905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c0a7c-58b5-4ebe-8447-87b2f0c610e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc1557433954550818d64959e8df818, user_id=54244510562d45e2915a93bb03f7c598, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:00.146649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c0a7c-58b5-4ebe-8447-87b2f0c610e9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:00.181258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859645a4-4c68-41ed-b8d4-72455e592963 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:00.181258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859645a4-4c68-41ed-b8d4-72455e592963 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:00.181542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859645a4-4c68-41ed-b8d4-72455e592963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:00.183705 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1992/4010] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:00 2022] PUT /identity/v3/projects/efc1557433954550818d64959e8df818/users/54244510562d45e2915a93bb03f7c598/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:00.214387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-859645a4-4c68-41ed-b8d4-72455e592963 None None] MFA Rules not processed for user `54244510562d45e2915a93bb03f7c598`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:00.216147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-859645a4-4c68-41ed-b8d4-72455e592963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:00.336682 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2019/4011] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:06:00.341764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c0a7c-58b5-4ebe-8447-87b2f0c610e9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:00.357969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c0a7c-58b5-4ebe-8447-87b2f0c610e9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:00.364864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4bbcf-798f-404d-95b8-b962d66c3a15 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:00.365932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4bbcf-798f-404d-95b8-b962d66c3a15 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:00.366619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4bbcf-798f-404d-95b8-b962d66c3a15 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:00.367136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4bbcf-798f-404d-95b8-b962d66c3a15 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:00.368631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4bbcf-798f-404d-95b8-b962d66c3a15 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:00.371344 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-01c4bbcf-798f-404d-95b8-b962d66c3a15 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:06:00.371344 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:06:00.371344 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:06:00.373077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4bbcf-798f-404d-95b8-b962d66c3a15 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:00.400772 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1993/4012] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:06:00 2022] POST /identity/v3/services => generated 240 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:00.401647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859645a4-4c68-41ed-b8d4-72455e592963 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:00.415682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859645a4-4c68-41ed-b8d4-72455e592963 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:00.435659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465cab2-f3a8-4de6-a8de-7782a4225735 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:00.436447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465cab2-f3a8-4de6-a8de-7782a4225735 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:00.436882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465cab2-f3a8-4de6-a8de-7782a4225735 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:00.437310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465cab2-f3a8-4de6-a8de-7782a4225735 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services/fed4737391aa40d29645688ca690819d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:00.438180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465cab2-f3a8-4de6-a8de-7782a4225735 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fed4737391aa40d29645688ca690819d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:00.440003 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-4465cab2-f3a8-4de6-a8de-7782a4225735 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:06:00.440003 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:06:00.440003 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:06:00.444005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465cab2-f3a8-4de6-a8de-7782a4225735 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:00.482640 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2020/4013] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:00 2022] DELETE /identity/v3/services/fed4737391aa40d29645688ca690819d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:06:00.488954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4bbcf-798f-404d-95b8-b962d66c3a15 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:00.494297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:00.500730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4bbcf-798f-404d-95b8-b962d66c3a15 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:00.522545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479de89d-ece2-4f11-aaa5-5ed3e3abc124 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:00.523162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479de89d-ece2-4f11-aaa5-5ed3e3abc124 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:00.523428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479de89d-ece2-4f11-aaa5-5ed3e3abc124 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:00.523749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479de89d-ece2-4f11-aaa5-5ed3e3abc124 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:00.524442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479de89d-ece2-4f11-aaa5-5ed3e3abc124 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:00.526571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479de89d-ece2-4f11-aaa5-5ed3e3abc124 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:00.552760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465cab2-f3a8-4de6-a8de-7782a4225735 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:00.557282 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1994/4014] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:00 2022] POST /identity/v3/services => generated 289 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:00.563231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465cab2-f3a8-4de6-a8de-7782a4225735 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:00.581232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b4646-a057-4226-aa41-aede8a33b1d7 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:00.581892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b4646-a057-4226-aa41-aede8a33b1d7 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:00.582225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b4646-a057-4226-aa41-aede8a33b1d7 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:00.582504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b4646-a057-4226-aa41-aede8a33b1d7 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services/0700304afaaf4f759f93fc02130f57fd` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:00.583157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b4646-a057-4226-aa41-aede8a33b1d7 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:update_service(service_id=0700304afaaf4f759f93fc02130f57fd)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:00.584184 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-8f4b4646-a057-4226-aa41-aede8a33b1d7 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:06:00.584184 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:06:00.584184 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:06:00.585057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b4646-a057-4226-aa41-aede8a33b1d7 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:00.609338 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2021/4015] 10.222.0.26 () {60 vars in 1252 bytes} [Sat Oct 8 21:06:00 2022] PATCH /identity/v3/services/0700304afaaf4f759f93fc02130f57fd => generated 283 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:00.610287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479de89d-ece2-4f11-aaa5-5ed3e3abc124 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:00.625143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479de89d-ece2-4f11-aaa5-5ed3e3abc124 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:00.645230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038d1bc-e817-42ef-879b-906024083371 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:00.645488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038d1bc-e817-42ef-879b-906024083371 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:00.645751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038d1bc-e817-42ef-879b-906024083371 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:00.645952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038d1bc-e817-42ef-879b-906024083371 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services/0700304afaaf4f759f93fc02130f57fd` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:00.646737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038d1bc-e817-42ef-879b-906024083371 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:get_service(service_id=0700304afaaf4f759f93fc02130f57fd)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:00.647920 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-5038d1bc-e817-42ef-879b-906024083371 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:06:00.647920 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:06:00.647920 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:06:00.649547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038d1bc-e817-42ef-879b-906024083371 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:00.657091 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1995/4016] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:06:00 2022] GET /identity/v3/services/0700304afaaf4f759f93fc02130f57fd => generated 283 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:06:00.662568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b4646-a057-4226-aa41-aede8a33b1d7 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:00.678026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b4646-a057-4226-aa41-aede8a33b1d7 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:00.683565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2af5aa-6263-4a62-8dfa-d17cc644d3b0 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:00.684416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2af5aa-6263-4a62-8dfa-d17cc644d3b0 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:00.684729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2af5aa-6263-4a62-8dfa-d17cc644d3b0 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:00.685161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2af5aa-6263-4a62-8dfa-d17cc644d3b0 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services/0700304afaaf4f759f93fc02130f57fd` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:00.685881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2af5aa-6263-4a62-8dfa-d17cc644d3b0 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0700304afaaf4f759f93fc02130f57fd)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:00.688118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2af5aa-6263-4a62-8dfa-d17cc644d3b0 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:00.735708 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2022/4017] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:00 2022] DELETE /identity/v3/services/0700304afaaf4f759f93fc02130f57fd => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:00.736210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038d1bc-e817-42ef-879b-906024083371 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:00.771825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038d1bc-e817-42ef-879b-906024083371 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:00.809274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc2b96-7533-4265-8805-126df7fdb865 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:00.810026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc2b96-7533-4265-8805-126df7fdb865 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:00.810400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc2b96-7533-4265-8805-126df7fdb865 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:00.810781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc2b96-7533-4265-8805-126df7fdb865 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services/0700304afaaf4f759f93fc02130f57fd` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:00.813276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc2b96-7533-4265-8805-126df7fdb865 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:get_service(service_id=0700304afaaf4f759f93fc02130f57fd)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:00.814888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc2b96-7533-4265-8805-126df7fdb865 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-16fc2b96-7533-4265-8805-126df7fdb865 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Could not find service: 0700304afaaf4f759f93fc02130f57fd.: keystone.exception.ServiceNotFound: Could not find service: 0700304afaaf4f759f93fc02130f57fd. Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 0700304afaaf4f759f93fc02130f57fd. Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:06:00.853388 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:06:00.854763 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 0700304afaaf4f759f93fc02130f57fd. Oct 08 21:06:00.856052 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:06:00.863891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2af5aa-6263-4a62-8dfa-d17cc644d3b0 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:00.877350 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1996/4018] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:06:00 2022] GET /identity/v3/services/0700304afaaf4f759f93fc02130f57fd => generated 113 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:06:00.881646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2af5aa-6263-4a62-8dfa-d17cc644d3b0 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:00.888230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207179c-c2dc-42f0-b097-f0af776919a9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:00.888863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207179c-c2dc-42f0-b097-f0af776919a9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:00.889151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207179c-c2dc-42f0-b097-f0af776919a9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:00.889757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207179c-c2dc-42f0-b097-f0af776919a9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:00.891677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207179c-c2dc-42f0-b097-f0af776919a9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:00.892658 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-3207179c-c2dc-42f0-b097-f0af776919a9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:06:00.892658 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:06:00.892658 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:06:00.894066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207179c-c2dc-42f0-b097-f0af776919a9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:00.912411 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2023/4019] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:00 2022] POST /identity/v3/services => generated 274 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:00.917544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc2b96-7533-4265-8805-126df7fdb865 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:00.937420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc2b96-7533-4265-8805-126df7fdb865 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:00.955751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a3a5d-5a5f-4ba5-b2df-24e40c509ab4 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:00.956500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a3a5d-5a5f-4ba5-b2df-24e40c509ab4 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:00.956854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a3a5d-5a5f-4ba5-b2df-24e40c509ab4 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:00.957221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a3a5d-5a5f-4ba5-b2df-24e40c509ab4 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:00.958103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a3a5d-5a5f-4ba5-b2df-24e40c509ab4 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:00.960013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a3a5d-5a5f-4ba5-b2df-24e40c509ab4 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:01.015514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207179c-c2dc-42f0-b097-f0af776919a9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:01.016431 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1997/4020] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:00 2022] POST /identity/v3/services => generated 273 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:01.029406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207179c-c2dc-42f0-b097-f0af776919a9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:01.043065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:01.047348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efa551-c8a6-4bbc-833c-d26f0e78221d tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:01.049246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efa551-c8a6-4bbc-833c-d26f0e78221d tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:01.049246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efa551-c8a6-4bbc-833c-d26f0e78221d tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:01.049870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efa551-c8a6-4bbc-833c-d26f0e78221d tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:01.050962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efa551-c8a6-4bbc-833c-d26f0e78221d tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:01.054885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efa551-c8a6-4bbc-833c-d26f0e78221d tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:01.081865 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2024/4021] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:01 2022] POST /identity/v3/services => generated 273 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:06:01.085860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a3a5d-5a5f-4ba5-b2df-24e40c509ab4 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:01.099035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a3a5d-5a5f-4ba5-b2df-24e40c509ab4 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:01.118690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70452bea-c514-4831-9f7a-c80b19ba7693 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:01.119470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70452bea-c514-4831-9f7a-c80b19ba7693 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:01.119827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70452bea-c514-4831-9f7a-c80b19ba7693 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:01.120604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70452bea-c514-4831-9f7a-c80b19ba7693 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:01.120823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70452bea-c514-4831-9f7a-c80b19ba7693 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:01.122353 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-70452bea-c514-4831-9f7a-c80b19ba7693 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:06:01.122353 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:06:01.122353 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:06:01.122948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70452bea-c514-4831-9f7a-c80b19ba7693 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:01.133250 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1998/4022] 10.222.0.26 () {58 vars in 1131 bytes} [Sat Oct 8 21:06:01 2022] GET /identity/v3/services => generated 2975 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:01.135989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efa551-c8a6-4bbc-833c-d26f0e78221d tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:01.149059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efa551-c8a6-4bbc-833c-d26f0e78221d tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:01.156954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26c19d-2ff9-492a-96ce-826b39ceb6ad tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:01.157715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26c19d-2ff9-492a-96ce-826b39ceb6ad tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:01.158107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26c19d-2ff9-492a-96ce-826b39ceb6ad tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:01.158495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26c19d-2ff9-492a-96ce-826b39ceb6ad tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:01.159233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26c19d-2ff9-492a-96ce-826b39ceb6ad tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-337185109) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:06:01.159670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26c19d-2ff9-492a-96ce-826b39ceb6ad tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:01.160762 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-3c26c19d-2ff9-492a-96ce-826b39ceb6ad tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:06:01.160762 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:06:01.160762 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:06:01.161921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26c19d-2ff9-492a-96ce-826b39ceb6ad tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:01.171469 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2025/4023] 10.222.0.26 () {58 vars in 1220 bytes} [Sat Oct 8 21:06:01 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-337185109 => generated 416 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:01.175948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70452bea-c514-4831-9f7a-c80b19ba7693 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:01.189248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70452bea-c514-4831-9f7a-c80b19ba7693 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:01.194264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ad37d-9dcd-45d3-8ae7-9ad226d753e9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:01.195193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad37d-9dcd-45d3-8ae7-9ad226d753e9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:01.195193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad37d-9dcd-45d3-8ae7-9ad226d753e9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:01.195546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad37d-9dcd-45d3-8ae7-9ad226d753e9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:01.196232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ad37d-9dcd-45d3-8ae7-9ad226d753e9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-509788628) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:06:01.196492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ad37d-9dcd-45d3-8ae7-9ad226d753e9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:01.198149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ad37d-9dcd-45d3-8ae7-9ad226d753e9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:01.207142 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 1999/4024] 10.222.0.26 () {58 vars in 1220 bytes} [Sat Oct 8 21:06:01 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-509788628 => generated 415 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:06:01.208348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26c19d-2ff9-492a-96ce-826b39ceb6ad tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:01.220408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26c19d-2ff9-492a-96ce-826b39ceb6ad tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:01.225477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759bf77-eb82-451c-8162-6a441e20ee06 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:01.226121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759bf77-eb82-451c-8162-6a441e20ee06 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:01.226544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759bf77-eb82-451c-8162-6a441e20ee06 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:01.226836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759bf77-eb82-451c-8162-6a441e20ee06 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:01.227476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759bf77-eb82-451c-8162-6a441e20ee06 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-197181628) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:06:01.227785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759bf77-eb82-451c-8162-6a441e20ee06 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:01.229478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759bf77-eb82-451c-8162-6a441e20ee06 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:01.238855 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2026/4025] 10.222.0.26 () {58 vars in 1220 bytes} [Sat Oct 8 21:06:01 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-197181628 => generated 415 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:01.240706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ad37d-9dcd-45d3-8ae7-9ad226d753e9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:01.253135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ad37d-9dcd-45d3-8ae7-9ad226d753e9 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:01.260194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fc00d-6973-4f90-baaf-39944da9aeda tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:01.260998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc00d-6973-4f90-baaf-39944da9aeda tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:01.261325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc00d-6973-4f90-baaf-39944da9aeda tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:01.261605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc00d-6973-4f90-baaf-39944da9aeda tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services/939939c5c1ec4350b454c320b9c5f749` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:01.262199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fc00d-6973-4f90-baaf-39944da9aeda tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:delete_service(service_id=939939c5c1ec4350b454c320b9c5f749)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:01.263219 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-d27fc00d-6973-4f90-baaf-39944da9aeda tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:06:01.263219 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:06:01.263219 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:06:01.264113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fc00d-6973-4f90-baaf-39944da9aeda tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:01.293886 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2000/4026] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:01 2022] DELETE /identity/v3/services/939939c5c1ec4350b454c320b9c5f749 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:01.297352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759bf77-eb82-451c-8162-6a441e20ee06 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:01.308071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759bf77-eb82-451c-8162-6a441e20ee06 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:01.326671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc9b2-dc5e-4c10-a31c-bbd18615d306 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:01.327489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc9b2-dc5e-4c10-a31c-bbd18615d306 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:01.327780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc9b2-dc5e-4c10-a31c-bbd18615d306 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:01.328061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc9b2-dc5e-4c10-a31c-bbd18615d306 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services/d9851e0d6d324902bc690859cc64ebbb` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:01.328664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbc9b2-dc5e-4c10-a31c-bbd18615d306 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d9851e0d6d324902bc690859cc64ebbb)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:01.330469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbc9b2-dc5e-4c10-a31c-bbd18615d306 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:01.355349 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2027/4027] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:01 2022] DELETE /identity/v3/services/d9851e0d6d324902bc690859cc64ebbb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:06:01.361278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fc00d-6973-4f90-baaf-39944da9aeda tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:01.377660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fc00d-6973-4f90-baaf-39944da9aeda tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:01.394918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75482c23-a33e-43ce-8a4a-b69ad59eb61b tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54244510562d45e2915a93bb03f7c598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efc1557433954550818d64959e8df818', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:01.395657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75482c23-a33e-43ce-8a4a-b69ad59eb61b tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:01.396011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75482c23-a33e-43ce-8a4a-b69ad59eb61b tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:01.396360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75482c23-a33e-43ce-8a4a-b69ad59eb61b tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] PATH_INFO: `/v3/services/eda1609a320b46399ccc2f24f0c6809d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:01.397023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75482c23-a33e-43ce-8a4a-b69ad59eb61b tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorizing `identity:delete_service(service_id=eda1609a320b46399ccc2f24f0c6809d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:01.398801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75482c23-a33e-43ce-8a4a-b69ad59eb61b tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:01.433818 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2001/4028] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:01 2022] DELETE /identity/v3/services/eda1609a320b46399ccc2f24f0c6809d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:01.436212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc9b2-dc5e-4c10-a31c-bbd18615d306 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:01.553330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc9b2-dc5e-4c10-a31c-bbd18615d306 tempest-ServicesTestJSON-1452892430 tempest-ServicesTestJSON-1452892430-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:01.586425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:01.587323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:01.587703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:01.588143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] PATH_INFO: `/v3/users/f9f5653d306043f080bd3cd96bb8621c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:01.590556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f5653d306043f080bd3cd96bb8621c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:01.592128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:01.649479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f5653d306043f080bd3cd96bb8621c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:01.657137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f5653d306043f080bd3cd96bb8621c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:01.657874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f5653d306043f080bd3cd96bb8621c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:01.658503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f5653d306043f080bd3cd96bb8621c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:01.672485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f5653d306043f080bd3cd96bb8621c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:01.695383 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2028/4029] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:01 2022] DELETE /identity/v3/users/f9f5653d306043f080bd3cd96bb8621c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:01.699547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1597e0-5bde-440e-b93b-bb5c44f8d7b2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:01.700330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1597e0-5bde-440e-b93b-bb5c44f8d7b2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:01.700843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1597e0-5bde-440e-b93b-bb5c44f8d7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:01.723928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ad1597e0-5bde-440e-b93b-bb5c44f8d7b2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:01.725680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ad1597e0-5bde-440e-b93b-bb5c44f8d7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:01.787561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:01.799594 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2002/4030] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:06:02.171761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:02.174571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:02.185559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:02.284966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b6041-b8ec-4a0d-b9c0-7c5b29b542cb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:02.290575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819de2b-763e-4bda-84e9-a59cae6c215c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:02.291344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819de2b-763e-4bda-84e9-a59cae6c215c service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:02.291747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819de2b-763e-4bda-84e9-a59cae6c215c service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:02.292123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819de2b-763e-4bda-84e9-a59cae6c215c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:02.321099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819de2b-763e-4bda-84e9-a59cae6c215c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:02.323473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819de2b-763e-4bda-84e9-a59cae6c215c service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:02.342422 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2029/4031] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:04.425344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1597e0-5bde-440e-b93b-bb5c44f8d7b2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:04.427271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ad1597e0-5bde-440e-b93b-bb5c44f8d7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:04.453525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1597e0-5bde-440e-b93b-bb5c44f8d7b2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:04.517152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:04.519058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:04.520541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:04.521130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] PATH_INFO: `/v3/projects/886bc0d3e477445991389c4a747a3883` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:04.523123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=886bc0d3e477445991389c4a747a3883)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:04.528658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:04.676585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '886bc0d3e477445991389c4a747a3883', 'request_id': 'req-fb9610f2-65e3-471e-9c13-90a00b2b20f4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:04.689856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '886bc0d3e477445991389c4a747a3883', 'request_id': 'req-fb9610f2-65e3-471e-9c13-90a00b2b20f4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:04.701635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '886bc0d3e477445991389c4a747a3883', 'request_id': 'req-fb9610f2-65e3-471e-9c13-90a00b2b20f4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:04.718395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] The token cache is being invalidate because project 886bc0d3e477445991389c4a747a3883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:04.718791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:04.719716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:04.724296 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2003/4032] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:04 2022] DELETE /identity/v3/projects/886bc0d3e477445991389c4a747a3883 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:04.726095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819de2b-763e-4bda-84e9-a59cae6c215c service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:04.737432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819de2b-763e-4bda-84e9-a59cae6c215c service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:04.804163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420042b2-71f9-455b-95b1-b060fa74bded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:04.805052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420042b2-71f9-455b-95b1-b060fa74bded admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:04.805581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420042b2-71f9-455b-95b1-b060fa74bded admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:04.806060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420042b2-71f9-455b-95b1-b060fa74bded admin admin] PATH_INFO: `/v3/users/54244510562d45e2915a93bb03f7c598` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:04.807407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420042b2-71f9-455b-95b1-b060fa74bded admin admin] RBAC: Authorizing `identity:delete_user(user_id=54244510562d45e2915a93bb03f7c598)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:04.810180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420042b2-71f9-455b-95b1-b060fa74bded admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:04.882095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-420042b2-71f9-455b-95b1-b060fa74bded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54244510562d45e2915a93bb03f7c598'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:04.895562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-420042b2-71f9-455b-95b1-b060fa74bded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54244510562d45e2915a93bb03f7c598'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:04.896636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-420042b2-71f9-455b-95b1-b060fa74bded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54244510562d45e2915a93bb03f7c598'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:04.900717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-420042b2-71f9-455b-95b1-b060fa74bded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54244510562d45e2915a93bb03f7c598'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:04.917868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-420042b2-71f9-455b-95b1-b060fa74bded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54244510562d45e2915a93bb03f7c598'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:04.956187 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2030/4033] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:04 2022] DELETE /identity/v3/users/54244510562d45e2915a93bb03f7c598 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:06.458570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:06.460068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:06.522627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9610f2-65e3-471e-9c13-90a00b2b20f4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:06.676622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:06.677547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:06.678043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:06.678506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c admin admin] PATH_INFO: `/v3/projects/efc1557433954550818d64959e8df818` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:06.680341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc1557433954550818d64959e8df818)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:06.683265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:06.791757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc1557433954550818d64959e8df818', 'request_id': 'req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:06.805114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc1557433954550818d64959e8df818', 'request_id': 'req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:06.814484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc1557433954550818d64959e8df818', 'request_id': 'req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:06.831545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c admin admin] The token cache is being invalidate because project efc1557433954550818d64959e8df818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:06.832737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:06.833648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c74be72d-a867-4ab9-9d3d-a2312ba1a80c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:06.836344 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2004/4034] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:06 2022] DELETE /identity/v3/projects/efc1557433954550818d64959e8df818 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:06.841073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a8e99-a386-4c20-aff1-c49a3512defb None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:06.841745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a8e99-a386-4c20-aff1-c49a3512defb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:06.841745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a8e99-a386-4c20-aff1-c49a3512defb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:06.870617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-289a8e99-a386-4c20-aff1-c49a3512defb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:06.871864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-289a8e99-a386-4c20-aff1-c49a3512defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:06.891667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:06.964602 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2031/4035] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:06.972973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cea75-3103-4662-839e-e6ed9078fb1c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:06.976016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cea75-3103-4662-839e-e6ed9078fb1c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:06.976324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cea75-3103-4662-839e-e6ed9078fb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:07.026386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4c2cea75-3103-4662-839e-e6ed9078fb1c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:07.027616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4c2cea75-3103-4662-839e-e6ed9078fb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:07.044763 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2005/4036] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:07.045674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a8e99-a386-4c20-aff1-c49a3512defb None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:07.059716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a8e99-a386-4c20-aff1-c49a3512defb None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:07.085846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df67b3a-be24-4eac-8e2f-e00a1142db3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:07.086475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df67b3a-be24-4eac-8e2f-e00a1142db3e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:07.086754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df67b3a-be24-4eac-8e2f-e00a1142db3e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:07.087022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df67b3a-be24-4eac-8e2f-e00a1142db3e admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:07.087681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df67b3a-be24-4eac-8e2f-e00a1142db3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:06:07.087983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df67b3a-be24-4eac-8e2f-e00a1142db3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:07.089633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df67b3a-be24-4eac-8e2f-e00a1142db3e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:07.105230 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2032/4037] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:07.109783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cea75-3103-4662-839e-e6ed9078fb1c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:07.126965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cea75-3103-4662-839e-e6ed9078fb1c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:07.135195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfdbb6-7d57-4a04-8954-67f5cdde1389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:07.139190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfdbb6-7d57-4a04-8954-67f5cdde1389 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:07.139541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfdbb6-7d57-4a04-8954-67f5cdde1389 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:07.140004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfdbb6-7d57-4a04-8954-67f5cdde1389 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:07.142117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfdbb6-7d57-4a04-8954-67f5cdde1389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:07.149544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfdbb6-7d57-4a04-8954-67f5cdde1389 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:07.155498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:07.204766 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2006/4038] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:07 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:07.210834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df67b3a-be24-4eac-8e2f-e00a1142db3e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:07.235566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df67b3a-be24-4eac-8e2f-e00a1142db3e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:07.351415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49aec8-e850-4721-bdf3-6ae79eca021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:07.352165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49aec8-e850-4721-bdf3-6ae79eca021f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:07.353066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49aec8-e850-4721-bdf3-6ae79eca021f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:07.353066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49aec8-e850-4721-bdf3-6ae79eca021f admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:07.353496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49aec8-e850-4721-bdf3-6ae79eca021f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:07.356287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49aec8-e850-4721-bdf3-6ae79eca021f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:07.394131 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2033/4039] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:06:07 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:07.396460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfdbb6-7d57-4a04-8954-67f5cdde1389 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:07.413159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfdbb6-7d57-4a04-8954-67f5cdde1389 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:07.419114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8855f20-6705-46be-8a92-61928da56216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:07.420188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8855f20-6705-46be-8a92-61928da56216 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:07.420667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8855f20-6705-46be-8a92-61928da56216 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:07.421259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8855f20-6705-46be-8a92-61928da56216 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:07.422207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8855f20-6705-46be-8a92-61928da56216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:07.424039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8855f20-6705-46be-8a92-61928da56216 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:07.438576 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2007/4040] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:07.445762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49aec8-e850-4721-bdf3-6ae79eca021f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:07.468282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49aec8-e850-4721-bdf3-6ae79eca021f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:07.489996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a872cf-8d6c-4f44-beca-4219f137ad8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:07.493078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a872cf-8d6c-4f44-beca-4219f137ad8f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:07.493471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a872cf-8d6c-4f44-beca-4219f137ad8f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:07.494516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a872cf-8d6c-4f44-beca-4219f137ad8f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:07.494516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a872cf-8d6c-4f44-beca-4219f137ad8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:07.499580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a872cf-8d6c-4f44-beca-4219f137ad8f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:07.524954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8855f20-6705-46be-8a92-61928da56216 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:07.528677 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2034/4041] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:07.544910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8855f20-6705-46be-8a92-61928da56216 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:07.553918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110fcef-41e7-47fa-aba0-b6c4f5539f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:07.554745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110fcef-41e7-47fa-aba0-b6c4f5539f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:07.555640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110fcef-41e7-47fa-aba0-b6c4f5539f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:07.555982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110fcef-41e7-47fa-aba0-b6c4f5539f07 admin admin] PATH_INFO: `/v3/projects/485e0e1d054f41978f53e36f1c868dc4/users/ff8965489f774898b542ec3306ae214e/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:07.583484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110fcef-41e7-47fa-aba0-b6c4f5539f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=485e0e1d054f41978f53e36f1c868dc4, user_id=ff8965489f774898b542ec3306ae214e, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:07.586529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110fcef-41e7-47fa-aba0-b6c4f5539f07 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:07.608272 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2008/4042] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:07 2022] PUT /identity/v3/projects/485e0e1d054f41978f53e36f1c868dc4/users/ff8965489f774898b542ec3306ae214e/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:07.620587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a871b7-ce6b-4e2d-bb8a-adedab55c882 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:07.621250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a871b7-ce6b-4e2d-bb8a-adedab55c882 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:07.621907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a871b7-ce6b-4e2d-bb8a-adedab55c882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:07.660534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-41a871b7-ce6b-4e2d-bb8a-adedab55c882 None None] MFA Rules not processed for user `ff8965489f774898b542ec3306ae214e`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:07.662302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-41a871b7-ce6b-4e2d-bb8a-adedab55c882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:07.758980 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2035/4043] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:06:07.760335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110fcef-41e7-47fa-aba0-b6c4f5539f07 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:07.835165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110fcef-41e7-47fa-aba0-b6c4f5539f07 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:07.840167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c85d4-3b5f-42fc-bf75-650f2f4fb5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:07.840804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c85d4-3b5f-42fc-bf75-650f2f4fb5ef admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:07.841090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c85d4-3b5f-42fc-bf75-650f2f4fb5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:07.841386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c85d4-3b5f-42fc-bf75-650f2f4fb5ef admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:07.842063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c85d4-3b5f-42fc-bf75-650f2f4fb5ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:07.844697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c85d4-3b5f-42fc-bf75-650f2f4fb5ef admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:07.889435 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2009/4044] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:07 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:07.893216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a871b7-ce6b-4e2d-bb8a-adedab55c882 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:07.925881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a871b7-ce6b-4e2d-bb8a-adedab55c882 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:07.945786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:08.021354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61432c-7271-4d0f-a905-b4622dc8b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:08.021967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61432c-7271-4d0f-a905-b4622dc8b3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:08.022318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61432c-7271-4d0f-a905-b4622dc8b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:08.022663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61432c-7271-4d0f-a905-b4622dc8b3b1 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:08.023479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61432c-7271-4d0f-a905-b4622dc8b3b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:08.025593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61432c-7271-4d0f-a905-b4622dc8b3b1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:08.054651 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2036/4045] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:06:07 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:08.061144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c85d4-3b5f-42fc-bf75-650f2f4fb5ef admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:08.074743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c85d4-3b5f-42fc-bf75-650f2f4fb5ef admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:08.081231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3aa8ed-d62e-460a-bbf8-f89cce05d141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:08.081921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3aa8ed-d62e-460a-bbf8-f89cce05d141 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:08.082266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3aa8ed-d62e-460a-bbf8-f89cce05d141 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:08.082805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3aa8ed-d62e-460a-bbf8-f89cce05d141 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:08.083596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3aa8ed-d62e-460a-bbf8-f89cce05d141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:08.085483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3aa8ed-d62e-460a-bbf8-f89cce05d141 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:08.101064 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2010/4046] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:08.105677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61432c-7271-4d0f-a905-b4622dc8b3b1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:08.116661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61432c-7271-4d0f-a905-b4622dc8b3b1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:08.122612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdf210-845b-42bd-81ce-633472f28a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:08.123282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdf210-845b-42bd-81ce-633472f28a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:08.123551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdf210-845b-42bd-81ce-633472f28a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:08.123852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdf210-845b-42bd-81ce-633472f28a70 admin admin] PATH_INFO: `/v3/projects/60f929cc6429420093373bfa2012d3ef/users/929a82431ac24e5ea1d82888c7b39cd7/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:08.142582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdf210-845b-42bd-81ce-633472f28a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f929cc6429420093373bfa2012d3ef, user_id=929a82431ac24e5ea1d82888c7b39cd7, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:08.145415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdf210-845b-42bd-81ce-633472f28a70 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:08.165635 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2037/4047] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:08 2022] PUT /identity/v3/projects/60f929cc6429420093373bfa2012d3ef/users/929a82431ac24e5ea1d82888c7b39cd7/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:06:08.166823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3aa8ed-d62e-460a-bbf8-f89cce05d141 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:08.178155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3aa8ed-d62e-460a-bbf8-f89cce05d141 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:08.245158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b7bc7-021a-458a-8b30-b7637b34e444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:08.245571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b7bc7-021a-458a-8b30-b7637b34e444 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:08.245850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b7bc7-021a-458a-8b30-b7637b34e444 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:08.246129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b7bc7-021a-458a-8b30-b7637b34e444 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:08.246777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b7bc7-021a-458a-8b30-b7637b34e444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:08.248721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b7bc7-021a-458a-8b30-b7637b34e444 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:08.263414 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2011/4048] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:08.265125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdf210-845b-42bd-81ce-633472f28a70 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:08.276803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdf210-845b-42bd-81ce-633472f28a70 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:08.285749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990728e5-1db0-4632-8510-f598fe6e0dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:08.286605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990728e5-1db0-4632-8510-f598fe6e0dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:08.287421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990728e5-1db0-4632-8510-f598fe6e0dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:08.287421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990728e5-1db0-4632-8510-f598fe6e0dbd admin admin] PATH_INFO: `/v3/projects/60f929cc6429420093373bfa2012d3ef/users/929a82431ac24e5ea1d82888c7b39cd7/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:08.289171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990728e5-1db0-4632-8510-f598fe6e0dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f929cc6429420093373bfa2012d3ef, user_id=929a82431ac24e5ea1d82888c7b39cd7, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:08.291811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990728e5-1db0-4632-8510-f598fe6e0dbd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:08.312889 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2038/4049] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:08 2022] PUT /identity/v3/projects/60f929cc6429420093373bfa2012d3ef/users/929a82431ac24e5ea1d82888c7b39cd7/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:08.314671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3f7ef-1d93-47f0-bed1-349fa148b34d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:08.314954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3f7ef-1d93-47f0-bed1-349fa148b34d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:08.315228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3f7ef-1d93-47f0-bed1-349fa148b34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:08.347027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f8f3f7ef-1d93-47f0-bed1-349fa148b34d None None] MFA Rules not processed for user `929a82431ac24e5ea1d82888c7b39cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:08.348434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f8f3f7ef-1d93-47f0-bed1-349fa148b34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:08.359150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:08.432974 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2012/4050] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:08.438299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990728e5-1db0-4632-8510-f598fe6e0dbd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:08.524941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990728e5-1db0-4632-8510-f598fe6e0dbd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:08.531314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ec8cc-8e84-4338-b875-542431b436f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:08.531877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ec8cc-8e84-4338-b875-542431b436f1 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:08.532158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ec8cc-8e84-4338-b875-542431b436f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:08.532434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ec8cc-8e84-4338-b875-542431b436f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:08.533133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ec8cc-8e84-4338-b875-542431b436f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:08.535122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ec8cc-8e84-4338-b875-542431b436f1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:08.576091 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2039/4051] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:08 2022] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:08.580962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3f7ef-1d93-47f0-bed1-349fa148b34d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:08.596512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3f7ef-1d93-47f0-bed1-349fa148b34d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:08.674596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb028c5-a0d2-49c3-8e73-21288a60792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:08.675697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb028c5-a0d2-49c3-8e73-21288a60792b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:08.676150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb028c5-a0d2-49c3-8e73-21288a60792b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:08.676577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb028c5-a0d2-49c3-8e73-21288a60792b admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:08.677400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb028c5-a0d2-49c3-8e73-21288a60792b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:08.679847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb028c5-a0d2-49c3-8e73-21288a60792b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:08.716851 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2013/4052] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:06:08 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:08.720222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ec8cc-8e84-4338-b875-542431b436f1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:08.733387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ec8cc-8e84-4338-b875-542431b436f1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:08.740329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc6bd7-fb1c-4148-a7c1-d54877e46cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:08.742200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6bd7-fb1c-4148-a7c1-d54877e46cfd admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:08.742650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6bd7-fb1c-4148-a7c1-d54877e46cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:08.743084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6bd7-fb1c-4148-a7c1-d54877e46cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:08.744525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc6bd7-fb1c-4148-a7c1-d54877e46cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:08.747411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc6bd7-fb1c-4148-a7c1-d54877e46cfd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:08.785660 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2040/4053] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:08.787073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb028c5-a0d2-49c3-8e73-21288a60792b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:08.812911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb028c5-a0d2-49c3-8e73-21288a60792b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:08.821862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf951c5e-008e-44a3-9e04-4981f935c022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:08.822725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf951c5e-008e-44a3-9e04-4981f935c022 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:08.823187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf951c5e-008e-44a3-9e04-4981f935c022 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:08.823629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf951c5e-008e-44a3-9e04-4981f935c022 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:08.824447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf951c5e-008e-44a3-9e04-4981f935c022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:08.826412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf951c5e-008e-44a3-9e04-4981f935c022 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:08.847212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc6bd7-fb1c-4148-a7c1-d54877e46cfd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:08.847453 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2014/4054] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:08.861327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc6bd7-fb1c-4148-a7c1-d54877e46cfd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:08.871930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a190bb-c8bf-4bbf-860e-c488d363eacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:08.872716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a190bb-c8bf-4bbf-860e-c488d363eacf admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:08.873123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a190bb-c8bf-4bbf-860e-c488d363eacf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:08.873516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a190bb-c8bf-4bbf-860e-c488d363eacf admin admin] PATH_INFO: `/v3/projects/73525f00cc7149bda4dfa66f7390ff01/users/c0840ee6573f4270b006c637ffa7389d/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:08.923151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a190bb-c8bf-4bbf-860e-c488d363eacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=73525f00cc7149bda4dfa66f7390ff01, user_id=c0840ee6573f4270b006c637ffa7389d, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:08.927232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a190bb-c8bf-4bbf-860e-c488d363eacf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:08.960625 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2041/4055] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:08 2022] PUT /identity/v3/projects/73525f00cc7149bda4dfa66f7390ff01/users/c0840ee6573f4270b006c637ffa7389d/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:08.974886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ff15a-3151-442f-a2d3-5195455b9db1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:08.975465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ff15a-3151-442f-a2d3-5195455b9db1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:08.976647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ff15a-3151-442f-a2d3-5195455b9db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:09.033482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4c1ff15a-3151-442f-a2d3-5195455b9db1 None None] MFA Rules not processed for user `c0840ee6573f4270b006c637ffa7389d`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:09.034923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4c1ff15a-3151-442f-a2d3-5195455b9db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:09.148682 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2015/4056] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:09.149072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a190bb-c8bf-4bbf-860e-c488d363eacf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:09.170585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:09.301883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a190bb-c8bf-4bbf-860e-c488d363eacf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:09.313432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c3cfb-edcb-414f-8e29-ae15701f1e80 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:09.314131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c3cfb-edcb-414f-8e29-ae15701f1e80 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:09.314420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c3cfb-edcb-414f-8e29-ae15701f1e80 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:09.314687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c3cfb-edcb-414f-8e29-ae15701f1e80 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:09.315510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c3cfb-edcb-414f-8e29-ae15701f1e80 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:09.317445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c3cfb-edcb-414f-8e29-ae15701f1e80 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:09.359595 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2042/4057] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:06:09 2022] POST /identity/v3/domains => generated 276 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:09.363721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ff15a-3151-442f-a2d3-5195455b9db1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:09.377846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ff15a-3151-442f-a2d3-5195455b9db1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:09.388379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:09.457996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c84e73-481c-413a-9644-4f319df296e9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:09.458773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c84e73-481c-413a-9644-4f319df296e9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:09.459128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c84e73-481c-413a-9644-4f319df296e9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:09.459418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c84e73-481c-413a-9644-4f319df296e9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:09.462054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c84e73-481c-413a-9644-4f319df296e9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:09.463754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c84e73-481c-413a-9644-4f319df296e9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:09.495522 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2016/4058] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:06:09 2022] POST /identity/v3/roles => generated 240 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:06:09.499561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c3cfb-edcb-414f-8e29-ae15701f1e80 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:09.510602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c3cfb-edcb-414f-8e29-ae15701f1e80 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:09.516860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2052-9253-445e-995f-2140e3a7cf09 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:09.517673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2052-9253-445e-995f-2140e3a7cf09 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:09.518039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2052-9253-445e-995f-2140e3a7cf09 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:09.518375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2052-9253-445e-995f-2140e3a7cf09 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/33c0cfbb30724bc581a47eb41a6803e9/users/c0840ee6573f4270b006c637ffa7389d/roles/0e52ffb1fb974c36851a6d2d8f7b954a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:09.534306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2052-9253-445e-995f-2140e3a7cf09 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=33c0cfbb30724bc581a47eb41a6803e9, user_id=c0840ee6573f4270b006c637ffa7389d, role_id=0e52ffb1fb974c36851a6d2d8f7b954a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:09.537516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2052-9253-445e-995f-2140e3a7cf09 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:09.563454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c84e73-481c-413a-9644-4f319df296e9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:09.564157 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2043/4059] 10.222.0.26 () {60 vars in 1480 bytes} [Sat Oct 8 21:06:09 2022] PUT /identity/v3/domains/33c0cfbb30724bc581a47eb41a6803e9/users/c0840ee6573f4270b006c637ffa7389d/roles/0e52ffb1fb974c36851a6d2d8f7b954a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:09.575847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c84e73-481c-413a-9644-4f319df296e9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:09.683798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bf364-956c-47bb-8d44-9724b3c1074c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:09.684429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bf364-956c-47bb-8d44-9724b3c1074c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:09.689559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bf364-956c-47bb-8d44-9724b3c1074c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:09.689866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bf364-956c-47bb-8d44-9724b3c1074c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:09.690646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bf364-956c-47bb-8d44-9724b3c1074c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:09.691838 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-fb5bf364-956c-47bb-8d44-9724b3c1074c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:06:09.691838 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:06:09.691838 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:06:09.695188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bf364-956c-47bb-8d44-9724b3c1074c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:09.732774 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2017/4060] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:06:09 2022] POST /identity/v3/domains => generated 277 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:06:09.737242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2052-9253-445e-995f-2140e3a7cf09 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:09.755634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2052-9253-445e-995f-2140e3a7cf09 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:09.881684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2b830-333a-452f-8b3e-6c4595f9df1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:09.882353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2b830-333a-452f-8b3e-6c4595f9df1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:09.882640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2b830-333a-452f-8b3e-6c4595f9df1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:09.882918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2b830-333a-452f-8b3e-6c4595f9df1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:09.883593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2b830-333a-452f-8b3e-6c4595f9df1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:09.885229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2b830-333a-452f-8b3e-6c4595f9df1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:09.916888 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2044/4061] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:06:09 2022] POST /identity/v3/roles => generated 239 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:09.920883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bf364-956c-47bb-8d44-9724b3c1074c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:09.938562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bf364-956c-47bb-8d44-9724b3c1074c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:09.952574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456fb86-9c98-497f-8ccb-9e00d5d45470 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:09.953292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456fb86-9c98-497f-8ccb-9e00d5d45470 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:09.954324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456fb86-9c98-497f-8ccb-9e00d5d45470 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:09.954752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456fb86-9c98-497f-8ccb-9e00d5d45470 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:09.956839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456fb86-9c98-497f-8ccb-9e00d5d45470 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:09.958622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456fb86-9c98-497f-8ccb-9e00d5d45470 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:10.021585 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2018/4062] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:06:09 2022] POST /identity/v3/groups => generated 326 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:10.022853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2b830-333a-452f-8b3e-6c4595f9df1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:10.039561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2b830-333a-452f-8b3e-6c4595f9df1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:10.044906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f3984-81a2-47f7-a505-875efebfe5f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:10.045614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f3984-81a2-47f7-a505-875efebfe5f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:10.045926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f3984-81a2-47f7-a505-875efebfe5f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:10.046633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f3984-81a2-47f7-a505-875efebfe5f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/groups/ecb23f0edc304ec395a291458bf3b687/users/c0840ee6573f4270b006c637ffa7389d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:10.053180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f3984-81a2-47f7-a505-875efebfe5f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ecb23f0edc304ec395a291458bf3b687, user_id=c0840ee6573f4270b006c637ffa7389d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:10.055410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f3984-81a2-47f7-a505-875efebfe5f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:10.101544 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2045/4063] 10.222.0.26 () {60 vars in 1360 bytes} [Sat Oct 8 21:06:10 2022] PUT /identity/v3/groups/ecb23f0edc304ec395a291458bf3b687/users/c0840ee6573f4270b006c637ffa7389d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:10.106278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456fb86-9c98-497f-8ccb-9e00d5d45470 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:10.118738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456fb86-9c98-497f-8ccb-9e00d5d45470 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:10.234328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6642438-9d07-4598-bb11-89d7d83c23c9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:10.235076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642438-9d07-4598-bb11-89d7d83c23c9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:10.235366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642438-9d07-4598-bb11-89d7d83c23c9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:10.235654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642438-9d07-4598-bb11-89d7d83c23c9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/8a3b73e14d4d446c965c42364583f081/groups/ecb23f0edc304ec395a291458bf3b687/roles/cec8a30e409c4d9a8fd82067127eb37b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:10.238515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6642438-9d07-4598-bb11-89d7d83c23c9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8a3b73e14d4d446c965c42364583f081, group_id=ecb23f0edc304ec395a291458bf3b687, role_id=cec8a30e409c4d9a8fd82067127eb37b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:10.241346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6642438-9d07-4598-bb11-89d7d83c23c9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:10.281065 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2019/4064] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:10 2022] PUT /identity/v3/domains/8a3b73e14d4d446c965c42364583f081/groups/ecb23f0edc304ec395a291458bf3b687/roles/cec8a30e409c4d9a8fd82067127eb37b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:10.282705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f3984-81a2-47f7-a505-875efebfe5f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:10.297651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f3984-81a2-47f7-a505-875efebfe5f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:10.431995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:10.457021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d6b4-d49d-4155-ad72-1c8220b019cb tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:10.457758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d6b4-d49d-4155-ad72-1c8220b019cb tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:10.458039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d6b4-d49d-4155-ad72-1c8220b019cb tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:10.458316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d6b4-d49d-4155-ad72-1c8220b019cb tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:10.459121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61d6b4-d49d-4155-ad72-1c8220b019cb tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:10.461436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61d6b4-d49d-4155-ad72-1c8220b019cb tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:10.499759 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2046/4065] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:06:10 2022] POST /identity/v3/domains => generated 277 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:10.506011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6642438-9d07-4598-bb11-89d7d83c23c9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:10.521921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6642438-9d07-4598-bb11-89d7d83c23c9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:10.533317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:10.661153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db16af-ed14-42e9-b3ce-4fef3c3bad5e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:10.662268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db16af-ed14-42e9-b3ce-4fef3c3bad5e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:10.664418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db16af-ed14-42e9-b3ce-4fef3c3bad5e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:10.664971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db16af-ed14-42e9-b3ce-4fef3c3bad5e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:10.665922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db16af-ed14-42e9-b3ce-4fef3c3bad5e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:10.668523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db16af-ed14-42e9-b3ce-4fef3c3bad5e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:10.707299 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2020/4066] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:06:10 2022] POST /identity/v3/roles => generated 240 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:10.709116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d6b4-d49d-4155-ad72-1c8220b019cb tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:10.725366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d6b4-d49d-4155-ad72-1c8220b019cb tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:10.744828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519312a-4e16-4819-b9e9-d96cc8617cdf tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:10.745538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519312a-4e16-4819-b9e9-d96cc8617cdf tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:10.745853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519312a-4e16-4819-b9e9-d96cc8617cdf tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:10.746159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519312a-4e16-4819-b9e9-d96cc8617cdf tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/1e656c94438e4659bad7328e4ce1d05f/users/c0840ee6573f4270b006c637ffa7389d/roles/44149919c36a4b3992cae183200d0917` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:10.774899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519312a-4e16-4819-b9e9-d96cc8617cdf tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=1e656c94438e4659bad7328e4ce1d05f, user_id=c0840ee6573f4270b006c637ffa7389d, role_id=44149919c36a4b3992cae183200d0917)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:10.777954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519312a-4e16-4819-b9e9-d96cc8617cdf tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:10.810357 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2047/4067] 10.222.0.26 () {60 vars in 1480 bytes} [Sat Oct 8 21:06:10 2022] PUT /identity/v3/domains/1e656c94438e4659bad7328e4ce1d05f/users/c0840ee6573f4270b006c637ffa7389d/roles/44149919c36a4b3992cae183200d0917 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:10.814106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db16af-ed14-42e9-b3ce-4fef3c3bad5e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:10.830680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db16af-ed14-42e9-b3ce-4fef3c3bad5e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:10.962152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516de56-49b5-4e91-af84-514f1f5abc3c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:10.963328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516de56-49b5-4e91-af84-514f1f5abc3c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:10.963774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516de56-49b5-4e91-af84-514f1f5abc3c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:10.964207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516de56-49b5-4e91-af84-514f1f5abc3c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:10.965054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516de56-49b5-4e91-af84-514f1f5abc3c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:10.966973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516de56-49b5-4e91-af84-514f1f5abc3c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:11.014105 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2021/4068] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:06:10 2022] POST /identity/v3/domains => generated 277 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:11.018344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519312a-4e16-4819-b9e9-d96cc8617cdf tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:11.038333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519312a-4e16-4819-b9e9-d96cc8617cdf tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:11.149673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145805a9-268e-4941-b01d-be351b2845f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:11.150329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145805a9-268e-4941-b01d-be351b2845f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:11.150588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145805a9-268e-4941-b01d-be351b2845f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:11.151232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145805a9-268e-4941-b01d-be351b2845f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:11.152001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145805a9-268e-4941-b01d-be351b2845f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:11.153658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145805a9-268e-4941-b01d-be351b2845f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:11.178809 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2048/4069] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:06:11 2022] POST /identity/v3/roles => generated 239 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:11.183012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516de56-49b5-4e91-af84-514f1f5abc3c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:11.197147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516de56-49b5-4e91-af84-514f1f5abc3c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:11.202731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35148c0-66f8-432e-be1f-e6988a460a59 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:11.203360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35148c0-66f8-432e-be1f-e6988a460a59 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:11.203645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35148c0-66f8-432e-be1f-e6988a460a59 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:11.203916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35148c0-66f8-432e-be1f-e6988a460a59 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:11.204579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35148c0-66f8-432e-be1f-e6988a460a59 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:11.206657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35148c0-66f8-432e-be1f-e6988a460a59 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:11.242969 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2022/4070] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:06:11 2022] POST /identity/v3/groups => generated 327 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:11.244420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145805a9-268e-4941-b01d-be351b2845f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:11.268074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145805a9-268e-4941-b01d-be351b2845f7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:11.275134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eb89a-33df-45b1-8aee-08ab39caf033 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:11.275931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eb89a-33df-45b1-8aee-08ab39caf033 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:11.276225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eb89a-33df-45b1-8aee-08ab39caf033 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:11.276511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eb89a-33df-45b1-8aee-08ab39caf033 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/groups/dfd898b541664daca5ad2d2800103674/users/c0840ee6573f4270b006c637ffa7389d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:11.283665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1eb89a-33df-45b1-8aee-08ab39caf033 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dfd898b541664daca5ad2d2800103674, user_id=c0840ee6573f4270b006c637ffa7389d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:11.285675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1eb89a-33df-45b1-8aee-08ab39caf033 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:11.349014 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2049/4071] 10.222.0.26 () {60 vars in 1360 bytes} [Sat Oct 8 21:06:11 2022] PUT /identity/v3/groups/dfd898b541664daca5ad2d2800103674/users/c0840ee6573f4270b006c637ffa7389d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:11.353665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35148c0-66f8-432e-be1f-e6988a460a59 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:11.375515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35148c0-66f8-432e-be1f-e6988a460a59 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:11.535639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41060072-122c-40f1-a679-eb33aa29428b tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:11.536325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41060072-122c-40f1-a679-eb33aa29428b tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:11.536697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41060072-122c-40f1-a679-eb33aa29428b tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:11.536981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41060072-122c-40f1-a679-eb33aa29428b tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/0b1c90533f2c4202a75ae19e93fc0623/groups/dfd898b541664daca5ad2d2800103674/roles/16a0e52f7f33499aa390a7baf5780c51` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:11.539301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41060072-122c-40f1-a679-eb33aa29428b tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0b1c90533f2c4202a75ae19e93fc0623, group_id=dfd898b541664daca5ad2d2800103674, role_id=16a0e52f7f33499aa390a7baf5780c51)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:11.548438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41060072-122c-40f1-a679-eb33aa29428b tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:11.585441 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2023/4072] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:11 2022] PUT /identity/v3/domains/0b1c90533f2c4202a75ae19e93fc0623/groups/dfd898b541664daca5ad2d2800103674/roles/16a0e52f7f33499aa390a7baf5780c51 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:11.589734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eb89a-33df-45b1-8aee-08ab39caf033 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:11.720749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eb89a-33df-45b1-8aee-08ab39caf033 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:11.742448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:11.824050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d92a90-496a-4fdb-9341-663962f7f4cf tempest-TokensV3TestJSON-1933105721 tempest-TokensV3TestJSON-1933105721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0840ee6573f4270b006c637ffa7389d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73525f00cc7149bda4dfa66f7390ff01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:11.824822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d92a90-496a-4fdb-9341-663962f7f4cf tempest-TokensV3TestJSON-1933105721 tempest-TokensV3TestJSON-1933105721-project] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:11.825230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d92a90-496a-4fdb-9341-663962f7f4cf tempest-TokensV3TestJSON-1933105721 tempest-TokensV3TestJSON-1933105721-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:11.825616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d92a90-496a-4fdb-9341-663962f7f4cf tempest-TokensV3TestJSON-1933105721 tempest-TokensV3TestJSON-1933105721-project] PATH_INFO: `/v3/auth/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:11.826291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d92a90-496a-4fdb-9341-663962f7f4cf tempest-TokensV3TestJSON-1933105721 tempest-TokensV3TestJSON-1933105721-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:11.827563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d92a90-496a-4fdb-9341-663962f7f4cf tempest-TokensV3TestJSON-1933105721 tempest-TokensV3TestJSON-1933105721-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:11.924850 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2050/4073] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 21:06:11 2022] GET /identity/v3/auth/domains => generated 1175 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:11.929161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41060072-122c-40f1-a679-eb33aa29428b tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:11.965220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:12.040877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41060072-122c-40f1-a679-eb33aa29428b tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:12.046662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ba1bb-cbda-43f9-af0c-57252c241bb0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:12.047374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ba1bb-cbda-43f9-af0c-57252c241bb0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:12.047654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ba1bb-cbda-43f9-af0c-57252c241bb0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:12.047939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ba1bb-cbda-43f9-af0c-57252c241bb0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/0b1c90533f2c4202a75ae19e93fc0623/groups/dfd898b541664daca5ad2d2800103674/roles/16a0e52f7f33499aa390a7baf5780c51` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:12.050191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ba1bb-cbda-43f9-af0c-57252c241bb0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0b1c90533f2c4202a75ae19e93fc0623, group_id=dfd898b541664daca5ad2d2800103674, role_id=16a0e52f7f33499aa390a7baf5780c51)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:12.052840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ba1bb-cbda-43f9-af0c-57252c241bb0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:12.059974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a55ba1bb-cbda-43f9-af0c-57252c241bb0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invalidating the token cache because role 16a0e52f7f33499aa390a7baf5780c51 was removed from group dfd898b541664daca5ad2d2800103674 on domain 0b1c90533f2c4202a75ae19e93fc0623. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:12.060269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a55ba1bb-cbda-43f9-af0c-57252c241bb0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:12.060984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a55ba1bb-cbda-43f9-af0c-57252c241bb0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:12.080857 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2024/4074] 10.222.0.26 () {58 vars in 1467 bytes} [Sat Oct 8 21:06:11 2022] DELETE /identity/v3/domains/0b1c90533f2c4202a75ae19e93fc0623/groups/dfd898b541664daca5ad2d2800103674/roles/16a0e52f7f33499aa390a7baf5780c51 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:12.087756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d92a90-496a-4fdb-9341-663962f7f4cf tempest-TokensV3TestJSON-1933105721 tempest-TokensV3TestJSON-1933105721-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:12.107528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-88d92a90-496a-4fdb-9341-663962f7f4cf tempest-TokensV3TestJSON-1933105721 tempest-TokensV3TestJSON-1933105721-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:12.122329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d92a90-496a-4fdb-9341-663962f7f4cf tempest-TokensV3TestJSON-1933105721 tempest-TokensV3TestJSON-1933105721-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:12.321791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19e02b-7769-4d92-b512-a1115cbcff1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:12.322363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19e02b-7769-4d92-b512-a1115cbcff1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:12.322650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19e02b-7769-4d92-b512-a1115cbcff1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:12.323927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19e02b-7769-4d92-b512-a1115cbcff1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/groups/dfd898b541664daca5ad2d2800103674/users/c0840ee6573f4270b006c637ffa7389d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:12.328522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19e02b-7769-4d92-b512-a1115cbcff1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=dfd898b541664daca5ad2d2800103674, user_id=c0840ee6573f4270b006c637ffa7389d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:12.329615 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-3b19e02b-7769-4d92-b512-a1115cbcff1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:06:12.329615 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:06:12.329615 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:06:12.330844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19e02b-7769-4d92-b512-a1115cbcff1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:12.342584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3b19e02b-7769-4d92-b512-a1115cbcff1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c0840ee6573f4270b006c637ffa7389d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:12.362990 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2051/4075] 10.222.0.26 () {58 vars in 1344 bytes} [Sat Oct 8 21:06:12 2022] DELETE /identity/v3/groups/dfd898b541664daca5ad2d2800103674/users/c0840ee6573f4270b006c637ffa7389d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:12.367892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ba1bb-cbda-43f9-af0c-57252c241bb0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:12.386586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ba1bb-cbda-43f9-af0c-57252c241bb0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:12.484189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b20b76-83cb-4178-a787-0a71db0edf47 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:12.490782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b20b76-83cb-4178-a787-0a71db0edf47 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:12.491398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b20b76-83cb-4178-a787-0a71db0edf47 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:12.492193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b20b76-83cb-4178-a787-0a71db0edf47 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/groups/dfd898b541664daca5ad2d2800103674` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:12.493497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b20b76-83cb-4178-a787-0a71db0edf47 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_group(group_id=dfd898b541664daca5ad2d2800103674)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:12.495745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b20b76-83cb-4178-a787-0a71db0edf47 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:12.585714 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2025/4076] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:06:12 2022] DELETE /identity/v3/groups/dfd898b541664daca5ad2d2800103674 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:06:12.590492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19e02b-7769-4d92-b512-a1115cbcff1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:12.606354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19e02b-7769-4d92-b512-a1115cbcff1e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:12.664449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:12.751790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd4053-2c90-436b-b016-7ca64afc7fe9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:12.752670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd4053-2c90-436b-b016-7ca64afc7fe9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:12.753060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd4053-2c90-436b-b016-7ca64afc7fe9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:12.753483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd4053-2c90-436b-b016-7ca64afc7fe9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/roles/16a0e52f7f33499aa390a7baf5780c51` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:12.755211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd4053-2c90-436b-b016-7ca64afc7fe9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_role(role_id=16a0e52f7f33499aa390a7baf5780c51)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:12.757029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd4053-2c90-436b-b016-7ca64afc7fe9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:12.816264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29bd4053-2c90-436b-b016-7ca64afc7fe9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invalidating the token cache because role 16a0e52f7f33499aa390a7baf5780c51 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:12.816614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29bd4053-2c90-436b-b016-7ca64afc7fe9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:12.817341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29bd4053-2c90-436b-b016-7ca64afc7fe9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:12.822871 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2052/4077] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:12 2022] DELETE /identity/v3/roles/16a0e52f7f33499aa390a7baf5780c51 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:12.823872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b20b76-83cb-4178-a787-0a71db0edf47 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:12.825887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f4b20b76-83cb-4178-a787-0a71db0edf47 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:12.839663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b20b76-83cb-4178-a787-0a71db0edf47 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:12.926486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1554d21-46cb-42a2-a835-36f86b46f44e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:12.927553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1554d21-46cb-42a2-a835-36f86b46f44e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:12.928018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1554d21-46cb-42a2-a835-36f86b46f44e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:12.928466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1554d21-46cb-42a2-a835-36f86b46f44e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/0b1c90533f2c4202a75ae19e93fc0623` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:12.930025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1554d21-46cb-42a2-a835-36f86b46f44e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0b1c90533f2c4202a75ae19e93fc0623)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:12.932685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1554d21-46cb-42a2-a835-36f86b46f44e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:12.942242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:12.975737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b1554d21-46cb-42a2-a835-36f86b46f44e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0b1c90533f2c4202a75ae19e93fc0623'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:12.977087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b1554d21-46cb-42a2-a835-36f86b46f44e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0b1c90533f2c4202a75ae19e93fc0623'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.026685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b1554d21-46cb-42a2-a835-36f86b46f44e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0b1c90533f2c4202a75ae19e93fc0623'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.027890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b1554d21-46cb-42a2-a835-36f86b46f44e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0b1c90533f2c4202a75ae19e93fc0623'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.039311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd4053-2c90-436b-b016-7ca64afc7fe9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:13.049858 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2026/4078] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:06:12 2022] PATCH /identity/v3/domains/0b1c90533f2c4202a75ae19e93fc0623 => generated 278 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:13.052079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd4053-2c90-436b-b016-7ca64afc7fe9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:13.160068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:13.160862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:13.161495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:13.169850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/0b1c90533f2c4202a75ae19e93fc0623` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:13.185789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0b1c90533f2c4202a75ae19e93fc0623)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:13.188201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:13.229717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0b1c90533f2c4202a75ae19e93fc0623'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.242141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0b1c90533f2c4202a75ae19e93fc0623'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.375212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1c90533f2c4202a75ae19e93fc0623', 'request_id': 'req-22ed540c-a6ec-4505-9779-5986175939d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.379712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:13.391755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903732f-fcbb-49b2-938e-d38623f0f049 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:13.392135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903732f-fcbb-49b2-938e-d38623f0f049 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:13.392376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903732f-fcbb-49b2-938e-d38623f0f049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:13.404994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1c90533f2c4202a75ae19e93fc0623', 'request_id': 'req-22ed540c-a6ec-4505-9779-5986175939d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.412454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1c90533f2c4202a75ae19e93fc0623', 'request_id': 'req-22ed540c-a6ec-4505-9779-5986175939d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.439645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5903732f-fcbb-49b2-938e-d38623f0f049 None None] MFA Rules not processed for user `06443b5728fb4d1e95d6245820e786bf`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:13.443096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5903732f-fcbb-49b2-938e-d38623f0f049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:13.446836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] The token cache is being invalidate because project 0b1c90533f2c4202a75ae19e93fc0623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:13.447438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.448915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.460541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0b1c90533f2c4202a75ae19e93fc0623', 'request_id': 'req-22ed540c-a6ec-4505-9779-5986175939d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.472892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0b1c90533f2c4202a75ae19e93fc0623', 'request_id': 'req-22ed540c-a6ec-4505-9779-5986175939d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.475656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0b1c90533f2c4202a75ae19e93fc0623', 'request_id': 'req-22ed540c-a6ec-4505-9779-5986175939d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.491356 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2053/4079] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:06:13 2022] DELETE /identity/v3/domains/0b1c90533f2c4202a75ae19e93fc0623 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:13.496828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:13.499996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:13.616173 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2027/4080] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:13.626424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed540c-a6ec-4505-9779-5986175939d0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:13.631317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693b48c-81cc-4314-9363-442d596243d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:13.631996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693b48c-81cc-4314-9363-442d596243d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:13.632282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693b48c-81cc-4314-9363-442d596243d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:13.632561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693b48c-81cc-4314-9363-442d596243d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/1e656c94438e4659bad7328e4ce1d05f/users/c0840ee6573f4270b006c637ffa7389d/roles/44149919c36a4b3992cae183200d0917` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:13.634849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693b48c-81cc-4314-9363-442d596243d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=1e656c94438e4659bad7328e4ce1d05f, user_id=c0840ee6573f4270b006c637ffa7389d, role_id=44149919c36a4b3992cae183200d0917)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:13.637840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693b48c-81cc-4314-9363-442d596243d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:13.655370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8693b48c-81cc-4314-9363-442d596243d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invalidating the token cache because role 44149919c36a4b3992cae183200d0917 was removed from user c0840ee6573f4270b006c637ffa7389d on domain 1e656c94438e4659bad7328e4ce1d05f. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:13.655677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8693b48c-81cc-4314-9363-442d596243d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.656968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8693b48c-81cc-4314-9363-442d596243d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.684054 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2054/4081] 10.222.0.26 () {58 vars in 1464 bytes} [Sat Oct 8 21:06:13 2022] DELETE /identity/v3/domains/1e656c94438e4659bad7328e4ce1d05f/users/c0840ee6573f4270b006c637ffa7389d/roles/44149919c36a4b3992cae183200d0917 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:13.688911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903732f-fcbb-49b2-938e-d38623f0f049 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:13.720926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903732f-fcbb-49b2-938e-d38623f0f049 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:13.814139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0886219-2d23-4cfe-bef4-1b8c31a6868c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:13.815403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0886219-2d23-4cfe-bef4-1b8c31a6868c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:13.816200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0886219-2d23-4cfe-bef4-1b8c31a6868c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:13.816761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0886219-2d23-4cfe-bef4-1b8c31a6868c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/roles/44149919c36a4b3992cae183200d0917` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:13.819434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0886219-2d23-4cfe-bef4-1b8c31a6868c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_role(role_id=44149919c36a4b3992cae183200d0917)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:13.821646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0886219-2d23-4cfe-bef4-1b8c31a6868c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:13.836046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693b48c-81cc-4314-9363-442d596243d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:13.837553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8693b48c-81cc-4314-9363-442d596243d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:13.890651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0886219-2d23-4cfe-bef4-1b8c31a6868c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invalidating the token cache because role 44149919c36a4b3992cae183200d0917 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:13.891083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0886219-2d23-4cfe-bef4-1b8c31a6868c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.892217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0886219-2d23-4cfe-bef4-1b8c31a6868c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:13.898046 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2028/4082] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:13 2022] DELETE /identity/v3/roles/44149919c36a4b3992cae183200d0917 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:13.899054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0886219-2d23-4cfe-bef4-1b8c31a6868c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:13.900508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e0886219-2d23-4cfe-bef4-1b8c31a6868c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:13.939167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:13.997241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0886219-2d23-4cfe-bef4-1b8c31a6868c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:14.004555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d35a1-8a04-4831-a63d-47acd6b766da tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:14.005435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d35a1-8a04-4831-a63d-47acd6b766da tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:14.005825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d35a1-8a04-4831-a63d-47acd6b766da tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:14.006209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d35a1-8a04-4831-a63d-47acd6b766da tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/1e656c94438e4659bad7328e4ce1d05f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:14.010265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d35a1-8a04-4831-a63d-47acd6b766da tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1e656c94438e4659bad7328e4ce1d05f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:14.010910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d35a1-8a04-4831-a63d-47acd6b766da tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:14.011378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693b48c-81cc-4314-9363-442d596243d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:14.040118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec0d35a1-8a04-4831-a63d-47acd6b766da tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1e656c94438e4659bad7328e4ce1d05f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.041027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec0d35a1-8a04-4831-a63d-47acd6b766da tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1e656c94438e4659bad7328e4ce1d05f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.081428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=1,keystone:DELETE=8,keystone:SELECT=91 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:14.084215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec0d35a1-8a04-4831-a63d-47acd6b766da tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1e656c94438e4659bad7328e4ce1d05f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.085515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec0d35a1-8a04-4831-a63d-47acd6b766da tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1e656c94438e4659bad7328e4ce1d05f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.093031 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2029/4083] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:06:13 2022] PATCH /identity/v3/domains/1e656c94438e4659bad7328e4ce1d05f => generated 278 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:14.094009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d35a1-8a04-4831-a63d-47acd6b766da tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:14.096656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ec0d35a1-8a04-4831-a63d-47acd6b766da tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:14.118664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585d91f-e323-4e68-b795-1bacb267bf07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:14.119462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585d91f-e323-4e68-b795-1bacb267bf07 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:14.119820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585d91f-e323-4e68-b795-1bacb267bf07 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:14.120167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585d91f-e323-4e68-b795-1bacb267bf07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:14.122404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2585d91f-e323-4e68-b795-1bacb267bf07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:14.153398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585d91f-e323-4e68-b795-1bacb267bf07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:14.157310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585d91f-e323-4e68-b795-1bacb267bf07 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:14.180134 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2055/4084] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:06:14.181649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585d91f-e323-4e68-b795-1bacb267bf07 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:14.183162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2585d91f-e323-4e68-b795-1bacb267bf07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:14.200238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585d91f-e323-4e68-b795-1bacb267bf07 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:14.239272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d35a1-8a04-4831-a63d-47acd6b766da tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:14.251606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:14.252542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:14.252859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:14.254234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] PATH_INFO: `/v3/users/88f002556c0f4584b29cb6dbea165876` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:14.255511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f002556c0f4584b29cb6dbea165876)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:14.257857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:14.308598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:14.310027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:14.310387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:14.310711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/1e656c94438e4659bad7328e4ce1d05f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:14.326046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1e656c94438e4659bad7328e4ce1d05f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:14.328258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:14.332978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f002556c0f4584b29cb6dbea165876'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.347323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f002556c0f4584b29cb6dbea165876'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.348706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f002556c0f4584b29cb6dbea165876'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.349385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f002556c0f4584b29cb6dbea165876'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.365721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f002556c0f4584b29cb6dbea165876'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.369689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1e656c94438e4659bad7328e4ce1d05f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.387474 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2030/4085] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:14 2022] DELETE /identity/v3/users/88f002556c0f4584b29cb6dbea165876 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:14.391419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1e656c94438e4659bad7328e4ce1d05f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.447303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e656c94438e4659bad7328e4ce1d05f', 'request_id': 'req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.458184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e656c94438e4659bad7328e4ce1d05f', 'request_id': 'req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.466969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e656c94438e4659bad7328e4ce1d05f', 'request_id': 'req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.495613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] The token cache is being invalidate because project 1e656c94438e4659bad7328e4ce1d05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:14.495613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.496314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.510387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1e656c94438e4659bad7328e4ce1d05f', 'request_id': 'req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.517929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1e656c94438e4659bad7328e4ce1d05f', 'request_id': 'req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.518682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1e656c94438e4659bad7328e4ce1d05f', 'request_id': 'req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.525994 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2056/4086] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:06:14 2022] DELETE /identity/v3/domains/1e656c94438e4659bad7328e4ce1d05f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:14.530692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:14.532337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:14.553527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:14.626444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5be33-fe3e-4616-be15-219f35b930c1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:14.710170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54e1c1-5cbe-4ee1-89c2-f50f67cd4d3a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:14.710845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54e1c1-5cbe-4ee1-89c2-f50f67cd4d3a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:14.711125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54e1c1-5cbe-4ee1-89c2-f50f67cd4d3a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:14.711402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54e1c1-5cbe-4ee1-89c2-f50f67cd4d3a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/8a3b73e14d4d446c965c42364583f081/groups/ecb23f0edc304ec395a291458bf3b687/roles/cec8a30e409c4d9a8fd82067127eb37b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:14.724565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54e1c1-5cbe-4ee1-89c2-f50f67cd4d3a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8a3b73e14d4d446c965c42364583f081, group_id=ecb23f0edc304ec395a291458bf3b687, role_id=cec8a30e409c4d9a8fd82067127eb37b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:14.728257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54e1c1-5cbe-4ee1-89c2-f50f67cd4d3a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:14.737057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ad54e1c1-5cbe-4ee1-89c2-f50f67cd4d3a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invalidating the token cache because role cec8a30e409c4d9a8fd82067127eb37b was removed from group ecb23f0edc304ec395a291458bf3b687 on domain 8a3b73e14d4d446c965c42364583f081. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:14.737466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ad54e1c1-5cbe-4ee1-89c2-f50f67cd4d3a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.739357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ad54e1c1-5cbe-4ee1-89c2-f50f67cd4d3a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.757698 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2031/4087] 10.222.0.26 () {58 vars in 1467 bytes} [Sat Oct 8 21:06:14 2022] DELETE /identity/v3/domains/8a3b73e14d4d446c965c42364583f081/groups/ecb23f0edc304ec395a291458bf3b687/roles/cec8a30e409c4d9a8fd82067127eb37b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:14.766118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:14.768538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:14.784806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc8a6d-d7ff-410c-bd29-6d817fb8e09f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:14.795134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:14.888889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ea84f-0926-469f-a6d1-c9c838b7ccd8 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:14.890803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ea84f-0926-469f-a6d1-c9c838b7ccd8 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:14.891189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ea84f-0926-469f-a6d1-c9c838b7ccd8 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:14.891564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ea84f-0926-469f-a6d1-c9c838b7ccd8 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/groups/ecb23f0edc304ec395a291458bf3b687/users/c0840ee6573f4270b006c637ffa7389d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:14.894266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ea84f-0926-469f-a6d1-c9c838b7ccd8 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=ecb23f0edc304ec395a291458bf3b687, user_id=c0840ee6573f4270b006c637ffa7389d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:14.896416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ea84f-0926-469f-a6d1-c9c838b7ccd8 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:14.908230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c30ea84f-0926-469f-a6d1-c9c838b7ccd8 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c0840ee6573f4270b006c637ffa7389d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:14.935828 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2057/4088] 10.222.0.26 () {58 vars in 1344 bytes} [Sat Oct 8 21:06:14 2022] DELETE /identity/v3/groups/ecb23f0edc304ec395a291458bf3b687/users/c0840ee6573f4270b006c637ffa7389d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:14.939814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54e1c1-5cbe-4ee1-89c2-f50f67cd4d3a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:14.941340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ad54e1c1-5cbe-4ee1-89c2-f50f67cd4d3a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:14.956914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54e1c1-5cbe-4ee1-89c2-f50f67cd4d3a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:15.064508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fcd3d-bec3-4262-9755-177775b3aa6c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:15.064848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fcd3d-bec3-4262-9755-177775b3aa6c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:15.065142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fcd3d-bec3-4262-9755-177775b3aa6c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:15.065445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fcd3d-bec3-4262-9755-177775b3aa6c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/groups/ecb23f0edc304ec395a291458bf3b687` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:15.068771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fcd3d-bec3-4262-9755-177775b3aa6c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ecb23f0edc304ec395a291458bf3b687)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:15.071727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fcd3d-bec3-4262-9755-177775b3aa6c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:15.162656 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2032/4089] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:06:14 2022] DELETE /identity/v3/groups/ecb23f0edc304ec395a291458bf3b687 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:06:15.168228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ea84f-0926-469f-a6d1-c9c838b7ccd8 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:15.183858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ea84f-0926-469f-a6d1-c9c838b7ccd8 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:15.267264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6aa4e-c03a-4a61-9bfc-70ab3558ab67 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:15.268070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6aa4e-c03a-4a61-9bfc-70ab3558ab67 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:15.275099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6aa4e-c03a-4a61-9bfc-70ab3558ab67 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:15.275669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6aa4e-c03a-4a61-9bfc-70ab3558ab67 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/roles/cec8a30e409c4d9a8fd82067127eb37b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:15.278000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6aa4e-c03a-4a61-9bfc-70ab3558ab67 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cec8a30e409c4d9a8fd82067127eb37b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:15.280979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6aa4e-c03a-4a61-9bfc-70ab3558ab67 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:15.358215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-65f6aa4e-c03a-4a61-9bfc-70ab3558ab67 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invalidating the token cache because role cec8a30e409c4d9a8fd82067127eb37b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:15.358512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-65f6aa4e-c03a-4a61-9bfc-70ab3558ab67 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.359906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-65f6aa4e-c03a-4a61-9bfc-70ab3558ab67 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.362405 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2058/4090] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:15 2022] DELETE /identity/v3/roles/cec8a30e409c4d9a8fd82067127eb37b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:15.366844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fcd3d-bec3-4262-9755-177775b3aa6c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:15.369012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0d8fcd3d-bec3-4262-9755-177775b3aa6c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:15.395962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fcd3d-bec3-4262-9755-177775b3aa6c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:15.410501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:15.491736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ed16-d551-4909-a712-e4407a399c5f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:15.492440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ed16-d551-4909-a712-e4407a399c5f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:15.492725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ed16-d551-4909-a712-e4407a399c5f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:15.493002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ed16-d551-4909-a712-e4407a399c5f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/8a3b73e14d4d446c965c42364583f081` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:15.494389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ed16-d551-4909-a712-e4407a399c5f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8a3b73e14d4d446c965c42364583f081)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:15.496117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ed16-d551-4909-a712-e4407a399c5f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:15.520438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-33c7ed16-d551-4909-a712-e4407a399c5f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8a3b73e14d4d446c965c42364583f081'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.521374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-33c7ed16-d551-4909-a712-e4407a399c5f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8a3b73e14d4d446c965c42364583f081'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.526967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6aa4e-c03a-4a61-9bfc-70ab3558ab67 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:15.529062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-65f6aa4e-c03a-4a61-9bfc-70ab3558ab67 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:15.567576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-33c7ed16-d551-4909-a712-e4407a399c5f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8a3b73e14d4d446c965c42364583f081'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.568588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-33c7ed16-d551-4909-a712-e4407a399c5f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8a3b73e14d4d446c965c42364583f081'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.573132 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2033/4091] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:06:15 2022] PATCH /identity/v3/domains/8a3b73e14d4d446c965c42364583f081 => generated 278 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:15.576874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ed16-d551-4909-a712-e4407a399c5f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:15.579252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-33c7ed16-d551-4909-a712-e4407a399c5f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:15.682322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ed16-d551-4909-a712-e4407a399c5f tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:15.689239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:15.689901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:15.690184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:15.690463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/8a3b73e14d4d446c965c42364583f081` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:15.699401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6aa4e-c03a-4a61-9bfc-70ab3558ab67 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:15.703143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8a3b73e14d4d446c965c42364583f081)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:15.704787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:15.706770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:15.733962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8a3b73e14d4d446c965c42364583f081'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.747923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8a3b73e14d4d446c965c42364583f081'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.794034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:15.798028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3b73e14d4d446c965c42364583f081', 'request_id': 'req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.814560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3b73e14d4d446c965c42364583f081', 'request_id': 'req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.829027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3b73e14d4d446c965c42364583f081', 'request_id': 'req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.842828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:15.843832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:15.843832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:15.844131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9 admin admin] PATH_INFO: `/v3/projects/c7377184b37740f6898266ee5c621f44` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:15.846088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7377184b37740f6898266ee5c621f44)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:15.847922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:15.856728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] The token cache is being invalidate because project 8a3b73e14d4d446c965c42364583f081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:15.857606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.860522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.872021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8a3b73e14d4d446c965c42364583f081', 'request_id': 'req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.875652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8a3b73e14d4d446c965c42364583f081', 'request_id': 'req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.880503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8a3b73e14d4d446c965c42364583f081', 'request_id': 'req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.893545 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2034/4092] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:06:15 2022] DELETE /identity/v3/domains/8a3b73e14d4d446c965c42364583f081 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:15.894658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:15.896060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:15.939591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7377184b37740f6898266ee5c621f44', 'request_id': 'req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.958693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7377184b37740f6898266ee5c621f44', 'request_id': 'req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:15.968186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7377184b37740f6898266ee5c621f44', 'request_id': 'req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:16.009406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da689bc-7ecf-445c-8db2-c05ef3a0b67c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:16.015288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9 admin admin] The token cache is being invalidate because project c7377184b37740f6898266ee5c621f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:16.015616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:16.016371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0ca22f7e-41cc-4b2e-8ef9-2177f14111f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:16.022833 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2059/4093] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:15 2022] DELETE /identity/v3/projects/c7377184b37740f6898266ee5c621f44 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:16.026659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a37ef-f35f-44f0-8c35-bd2e3a842e61 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:16.027035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a37ef-f35f-44f0-8c35-bd2e3a842e61 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:16.027326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a37ef-f35f-44f0-8c35-bd2e3a842e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:16.079184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6d2a37ef-f35f-44f0-8c35-bd2e3a842e61 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:16.081217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6d2a37ef-f35f-44f0-8c35-bd2e3a842e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:16.133346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a75a2-909a-4149-be6b-591c45561e29 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:16.134251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a75a2-909a-4149-be6b-591c45561e29 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:16.134861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a75a2-909a-4149-be6b-591c45561e29 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:16.135218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a75a2-909a-4149-be6b-591c45561e29 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/33c0cfbb30724bc581a47eb41a6803e9/users/c0840ee6573f4270b006c637ffa7389d/roles/0e52ffb1fb974c36851a6d2d8f7b954a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:16.138340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a75a2-909a-4149-be6b-591c45561e29 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=33c0cfbb30724bc581a47eb41a6803e9, user_id=c0840ee6573f4270b006c637ffa7389d, role_id=0e52ffb1fb974c36851a6d2d8f7b954a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:16.142093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a75a2-909a-4149-be6b-591c45561e29 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:16.155520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f19a75a2-909a-4149-be6b-591c45561e29 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invalidating the token cache because role 0e52ffb1fb974c36851a6d2d8f7b954a was removed from user c0840ee6573f4270b006c637ffa7389d on domain 33c0cfbb30724bc581a47eb41a6803e9. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:16.156102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f19a75a2-909a-4149-be6b-591c45561e29 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:16.157456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f19a75a2-909a-4149-be6b-591c45561e29 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:16.211287 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2060/4094] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:16.212944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27979b8b-96c7-4533-a0e4-df36cfed8470 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:16.213261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27979b8b-96c7-4533-a0e4-df36cfed8470 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:16.213541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27979b8b-96c7-4533-a0e4-df36cfed8470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:16.222897 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2035/4095] 10.222.0.26 () {58 vars in 1464 bytes} [Sat Oct 8 21:06:15 2022] DELETE /identity/v3/domains/33c0cfbb30724bc581a47eb41a6803e9/users/c0840ee6573f4270b006c637ffa7389d/roles/0e52ffb1fb974c36851a6d2d8f7b954a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:16.227620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a75a2-909a-4149-be6b-591c45561e29 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:16.230839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f19a75a2-909a-4149-be6b-591c45561e29 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:16.268466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-27979b8b-96c7-4533-a0e4-df36cfed8470 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:16.271256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-27979b8b-96c7-4533-a0e4-df36cfed8470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:16.316597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:16.356251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:16.386531 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2061/4096] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:06:16.386531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27979b8b-96c7-4533-a0e4-df36cfed8470 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:16.388043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-27979b8b-96c7-4533-a0e4-df36cfed8470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:16.393923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a75a2-909a-4149-be6b-591c45561e29 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:16.407986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb62b5d-d652-4f14-a31a-463c6c410f16 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:16.409953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62b5d-d652-4f14-a31a-463c6c410f16 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:16.410296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62b5d-d652-4f14-a31a-463c6c410f16 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:16.410684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62b5d-d652-4f14-a31a-463c6c410f16 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/roles/0e52ffb1fb974c36851a6d2d8f7b954a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:16.416578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb62b5d-d652-4f14-a31a-463c6c410f16 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0e52ffb1fb974c36851a6d2d8f7b954a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:16.418440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb62b5d-d652-4f14-a31a-463c6c410f16 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:16.482709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ccb62b5d-d652-4f14-a31a-463c6c410f16 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invalidating the token cache because role 0e52ffb1fb974c36851a6d2d8f7b954a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:16.483186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ccb62b5d-d652-4f14-a31a-463c6c410f16 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:16.484747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ccb62b5d-d652-4f14-a31a-463c6c410f16 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:16.491957 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2036/4097] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:16 2022] DELETE /identity/v3/roles/0e52ffb1fb974c36851a6d2d8f7b954a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:06:16.492865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb62b5d-d652-4f14-a31a-463c6c410f16 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:16.496780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ccb62b5d-d652-4f14-a31a-463c6c410f16 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:16.540922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27979b8b-96c7-4533-a0e4-df36cfed8470 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:16.609756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb62b5d-d652-4f14-a31a-463c6c410f16 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:16.622368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035992dd-e29d-4dba-9d9a-9cb585b46249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:16.624538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035992dd-e29d-4dba-9d9a-9cb585b46249 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:16.624828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035992dd-e29d-4dba-9d9a-9cb585b46249 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:16.625131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035992dd-e29d-4dba-9d9a-9cb585b46249 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:16.625913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035992dd-e29d-4dba-9d9a-9cb585b46249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:06:16.628044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035992dd-e29d-4dba-9d9a-9cb585b46249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:16.631348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035992dd-e29d-4dba-9d9a-9cb585b46249 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:16.650846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61d3aa-06db-44bd-b88f-7ecee99cc911 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:16.651463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61d3aa-06db-44bd-b88f-7ecee99cc911 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:16.651748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61d3aa-06db-44bd-b88f-7ecee99cc911 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:16.652022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61d3aa-06db-44bd-b88f-7ecee99cc911 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:16.653982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4a61d3aa-06db-44bd-b88f-7ecee99cc911 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:16.659089 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2037/4098] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:16.660068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035992dd-e29d-4dba-9d9a-9cb585b46249 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:16.667604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-035992dd-e29d-4dba-9d9a-9cb585b46249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:16.694418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61d3aa-06db-44bd-b88f-7ecee99cc911 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:16.696031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61d3aa-06db-44bd-b88f-7ecee99cc911 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:16.719970 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2062/4099] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:16.720860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61d3aa-06db-44bd-b88f-7ecee99cc911 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:16.734344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61d3aa-06db-44bd-b88f-7ecee99cc911 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:16.743152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b97184-55e3-4df7-8301-bac1025fe1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:16.744126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b97184-55e3-4df7-8301-bac1025fe1bd admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:16.745095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b97184-55e3-4df7-8301-bac1025fe1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:16.745684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b97184-55e3-4df7-8301-bac1025fe1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:16.747166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b97184-55e3-4df7-8301-bac1025fe1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:16.752093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b97184-55e3-4df7-8301-bac1025fe1bd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:16.785011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035992dd-e29d-4dba-9d9a-9cb585b46249 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:16.805315 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2063/4100] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:16 2022] POST /identity/v3/projects => generated 395 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:16.806365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b97184-55e3-4df7-8301-bac1025fe1bd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:16.808443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d6b97184-55e3-4df7-8301-bac1025fe1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:16.813289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0af53e-ad13-42e7-a0bd-4ab1d735ca74 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:16.815766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0af53e-ad13-42e7-a0bd-4ab1d735ca74 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:16.817084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0af53e-ad13-42e7-a0bd-4ab1d735ca74 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:16.818341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0af53e-ad13-42e7-a0bd-4ab1d735ca74 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/33c0cfbb30724bc581a47eb41a6803e9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:16.820092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0af53e-ad13-42e7-a0bd-4ab1d735ca74 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=33c0cfbb30724bc581a47eb41a6803e9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:16.827612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0af53e-ad13-42e7-a0bd-4ab1d735ca74 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:16.881810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc0af53e-ad13-42e7-a0bd-4ab1d735ca74 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '33c0cfbb30724bc581a47eb41a6803e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:16.882941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc0af53e-ad13-42e7-a0bd-4ab1d735ca74 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '33c0cfbb30724bc581a47eb41a6803e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:16.914216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:16.928914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc0af53e-ad13-42e7-a0bd-4ab1d735ca74 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '33c0cfbb30724bc581a47eb41a6803e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:16.929565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dc0af53e-ad13-42e7-a0bd-4ab1d735ca74 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '33c0cfbb30724bc581a47eb41a6803e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:16.934460 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2038/4101] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:06:16 2022] PATCH /identity/v3/domains/33c0cfbb30724bc581a47eb41a6803e9 => generated 277 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:16.935448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0af53e-ad13-42e7-a0bd-4ab1d735ca74 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:16.938913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dc0af53e-ad13-42e7-a0bd-4ab1d735ca74 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:16.954275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b97184-55e3-4df7-8301-bac1025fe1bd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:16.966809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:17.067067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0af53e-ad13-42e7-a0bd-4ab1d735ca74 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:17.076249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fff3b-10d1-4669-ad9b-2b823757bc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:17.081659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fff3b-10d1-4669-ad9b-2b823757bc14 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:17.082019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fff3b-10d1-4669-ad9b-2b823757bc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:17.082407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fff3b-10d1-4669-ad9b-2b823757bc14 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:17.083399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fff3b-10d1-4669-ad9b-2b823757bc14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:17.084269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00819d75-86a8-46fd-8d54-aeb0fc78e418 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:17.085235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00819d75-86a8-46fd-8d54-aeb0fc78e418 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:17.085681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00819d75-86a8-46fd-8d54-aeb0fc78e418 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:17.086115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00819d75-86a8-46fd-8d54-aeb0fc78e418 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:17.086773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fff3b-10d1-4669-ad9b-2b823757bc14 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:17.089293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-00819d75-86a8-46fd-8d54-aeb0fc78e418 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:17.104481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00819d75-86a8-46fd-8d54-aeb0fc78e418 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:17.106545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00819d75-86a8-46fd-8d54-aeb0fc78e418 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:17.118562 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2039/4102] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:06:16 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:17.121739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1155-0c7f-4431-82d3-770ea35252b7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:17.122422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1155-0c7f-4431-82d3-770ea35252b7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:17.122727 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2064/4103] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:17.123193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1155-0c7f-4431-82d3-770ea35252b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:17.124409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00819d75-86a8-46fd-8d54-aeb0fc78e418 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:17.126034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-00819d75-86a8-46fd-8d54-aeb0fc78e418 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:17.152897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-becf1155-0c7f-4431-82d3-770ea35252b7 None None] MFA Rules not processed for user `06443b5728fb4d1e95d6245820e786bf`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:17.155303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-becf1155-0c7f-4431-82d3-770ea35252b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:17.265952 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2040/4104] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:17.265952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf1155-0c7f-4431-82d3-770ea35252b7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:17.298564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf1155-0c7f-4431-82d3-770ea35252b7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:17.306414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00819d75-86a8-46fd-8d54-aeb0fc78e418 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:17.323694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:17.324381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:17.324674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:17.324955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/33c0cfbb30724bc581a47eb41a6803e9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:17.343070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18dc98-c6c0-447c-8951-2f946edbe4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:17.343700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18dc98-c6c0-447c-8951-2f946edbe4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:17.343982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18dc98-c6c0-447c-8951-2f946edbe4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:17.344257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18dc98-c6c0-447c-8951-2f946edbe4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:17.344913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18dc98-c6c0-447c-8951-2f946edbe4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:17.350442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18dc98-c6c0-447c-8951-2f946edbe4e8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:17.377807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=33c0cfbb30724bc581a47eb41a6803e9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:17.382933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:17.411114 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2041/4105] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:17.412640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18dc98-c6c0-447c-8951-2f946edbe4e8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:17.426610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18dc98-c6c0-447c-8951-2f946edbe4e8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:17.438856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938ad81-c629-49e4-ba02-a8dffa953f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:17.439861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ad81-c629-49e4-ba02-a8dffa953f66 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:17.440343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ad81-c629-49e4-ba02-a8dffa953f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:17.440991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ad81-c629-49e4-ba02-a8dffa953f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:17.441866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938ad81-c629-49e4-ba02-a8dffa953f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:17.444154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938ad81-c629-49e4-ba02-a8dffa953f66 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:17.475319 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2042/4106] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:17.476247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '33c0cfbb30724bc581a47eb41a6803e9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:17.479906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938ad81-c629-49e4-ba02-a8dffa953f66 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:17.492428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938ad81-c629-49e4-ba02-a8dffa953f66 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:17.498044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327f420-a324-4e29-a8a8-12903df0b00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:17.499491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327f420-a324-4e29-a8a8-12903df0b00c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:17.499940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327f420-a324-4e29-a8a8-12903df0b00c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:17.500239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327f420-a324-4e29-a8a8-12903df0b00c admin admin] PATH_INFO: `/v3/projects/6dc1b8f80be04533b9c2f6b772350586/users/0d7f2813d2094f549a78a0b77cd99506/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:17.512617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '33c0cfbb30724bc581a47eb41a6803e9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:17.517658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327f420-a324-4e29-a8a8-12903df0b00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc1b8f80be04533b9c2f6b772350586, user_id=0d7f2813d2094f549a78a0b77cd99506, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:17.521198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327f420-a324-4e29-a8a8-12903df0b00c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:17.547807 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2043/4107] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:17 2022] PUT /identity/v3/projects/6dc1b8f80be04533b9c2f6b772350586/users/0d7f2813d2094f549a78a0b77cd99506/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:17.559364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8d47d-f44b-47ce-9ff7-0866e3d6cc17 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:17.559653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8d47d-f44b-47ce-9ff7-0866e3d6cc17 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:17.559932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8d47d-f44b-47ce-9ff7-0866e3d6cc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:17.594418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c0cfbb30724bc581a47eb41a6803e9', 'request_id': 'req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:17.597014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:17.607671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c0cfbb30724bc581a47eb41a6803e9', 'request_id': 'req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:17.617098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c0cfbb30724bc581a47eb41a6803e9', 'request_id': 'req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:17.635738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] The token cache is being invalidate because project 33c0cfbb30724bc581a47eb41a6803e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:17.637092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:17.637092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:17.641134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-43f8d47d-f44b-47ce-9ff7-0866e3d6cc17 None None] MFA Rules not processed for user `0d7f2813d2094f549a78a0b77cd99506`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:17.645519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-43f8d47d-f44b-47ce-9ff7-0866e3d6cc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:17.648495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '33c0cfbb30724bc581a47eb41a6803e9', 'request_id': 'req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:17.652784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '33c0cfbb30724bc581a47eb41a6803e9', 'request_id': 'req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:17.653717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '33c0cfbb30724bc581a47eb41a6803e9', 'request_id': 'req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:17.680768 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2065/4108] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:06:17 2022] DELETE /identity/v3/domains/33c0cfbb30724bc581a47eb41a6803e9 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:17.682258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:17.686975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:17.762733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:17.784627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2c57a-d7a2-49f8-9f0a-e79b7dd2f3a0 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:17.791210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8adb9-674f-48b3-8fcd-d263c596b7ce tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:17.792094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8adb9-674f-48b3-8fcd-d263c596b7ce tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:17.793242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8adb9-674f-48b3-8fcd-d263c596b7ce tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:17.793908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8adb9-674f-48b3-8fcd-d263c596b7ce tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:17.796293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8adb9-674f-48b3-8fcd-d263c596b7ce tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:17.797870 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2044/4109] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:06:17.799333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8adb9-674f-48b3-8fcd-d263c596b7ce tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:17.824554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8d47d-f44b-47ce-9ff7-0866e3d6cc17 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:17.825068 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2066/4110] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:17.840675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8d47d-f44b-47ce-9ff7-0866e3d6cc17 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:17.848889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7b2b2-c014-4511-a71d-6c4eed0e499a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:17.850602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b2b2-c014-4511-a71d-6c4eed0e499a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:17.851090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b2b2-c014-4511-a71d-6c4eed0e499a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:17.851526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b2b2-c014-4511-a71d-6c4eed0e499a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/projects/485e0e1d054f41978f53e36f1c868dc4/users/929a82431ac24e5ea1d82888c7b39cd7/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:17.855142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7b2b2-c014-4511-a71d-6c4eed0e499a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_grant(project_id=485e0e1d054f41978f53e36f1c868dc4, user_id=929a82431ac24e5ea1d82888c7b39cd7, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:17.859166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7b2b2-c014-4511-a71d-6c4eed0e499a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:17.888593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8adb9-674f-48b3-8fcd-d263c596b7ce tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:17.898520 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2045/4111] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:17 2022] PUT /identity/v3/projects/485e0e1d054f41978f53e36f1c868dc4/users/929a82431ac24e5ea1d82888c7b39cd7/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:17.901166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8adb9-674f-48b3-8fcd-d263c596b7ce tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:18.000438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bf69d-597a-42c1-b944-e18863f81613 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:18.001308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf69d-597a-42c1-b944-e18863f81613 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:18.001702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf69d-597a-42c1-b944-e18863f81613 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:18.002107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf69d-597a-42c1-b944-e18863f81613 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:18.002998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bf69d-597a-42c1-b944-e18863f81613 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:18.004266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bf69d-597a-42c1-b944-e18863f81613 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:18.063722 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2067/4112] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 21:06:17 2022] GET /identity/v3/auth/projects => generated 828 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:18.067989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7b2b2-c014-4511-a71d-6c4eed0e499a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:18.080583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7b2b2-c014-4511-a71d-6c4eed0e499a tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:18.086038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510390f8-5eed-4a9f-8d2a-2520e59b6b03 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:18.086711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510390f8-5eed-4a9f-8d2a-2520e59b6b03 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:18.086992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510390f8-5eed-4a9f-8d2a-2520e59b6b03 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:18.087268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510390f8-5eed-4a9f-8d2a-2520e59b6b03 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/projects/485e0e1d054f41978f53e36f1c868dc4/users/929a82431ac24e5ea1d82888c7b39cd7/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:18.089218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510390f8-5eed-4a9f-8d2a-2520e59b6b03 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=485e0e1d054f41978f53e36f1c868dc4, user_id=929a82431ac24e5ea1d82888c7b39cd7, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:18.092695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510390f8-5eed-4a9f-8d2a-2520e59b6b03 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:18.099174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-510390f8-5eed-4a9f-8d2a-2520e59b6b03 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invalidating the token cache because role a409f81bd5744563a303a825783bed61 was removed from user 929a82431ac24e5ea1d82888c7b39cd7 on project 485e0e1d054f41978f53e36f1c868dc4. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:18.099464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-510390f8-5eed-4a9f-8d2a-2520e59b6b03 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:18.100737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-510390f8-5eed-4a9f-8d2a-2520e59b6b03 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:18.128503 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2046/4113] 10.222.0.26 () {58 vars in 1467 bytes} [Sat Oct 8 21:06:18 2022] DELETE /identity/v3/projects/485e0e1d054f41978f53e36f1c868dc4/users/929a82431ac24e5ea1d82888c7b39cd7/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:18.129830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bf69d-597a-42c1-b944-e18863f81613 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:18.131727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-294bf69d-597a-42c1-b944-e18863f81613 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:18.156710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bf69d-597a-42c1-b944-e18863f81613 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:18.191820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=1,keystone:DELETE=7,keystone:SELECT=92 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:18.253392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f99a0-8b7b-4311-b641-7ea32b6f3b5d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:18.254088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f99a0-8b7b-4311-b641-7ea32b6f3b5d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:18.254375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f99a0-8b7b-4311-b641-7ea32b6f3b5d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:18.254654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f99a0-8b7b-4311-b641-7ea32b6f3b5d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:18.255467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f99a0-8b7b-4311-b641-7ea32b6f3b5d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:18.257496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f99a0-8b7b-4311-b641-7ea32b6f3b5d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:18.262014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510390f8-5eed-4a9f-8d2a-2520e59b6b03 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:18.264056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-510390f8-5eed-4a9f-8d2a-2520e59b6b03 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:18.291612 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2068/4114] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:06:18 2022] POST /identity/v3/users => generated 321 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:06:18.295733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f99a0-8b7b-4311-b641-7ea32b6f3b5d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:18.308166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f99a0-8b7b-4311-b641-7ea32b6f3b5d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:18.331546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a0778-7dc5-4042-9724-134e68bcdca7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:18.332450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a0778-7dc5-4042-9724-134e68bcdca7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:18.332924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a0778-7dc5-4042-9724-134e68bcdca7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:18.333984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a0778-7dc5-4042-9724-134e68bcdca7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:18.334534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a0778-7dc5-4042-9724-134e68bcdca7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:18.337292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a0778-7dc5-4042-9724-134e68bcdca7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:18.391494 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2069/4115] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:18 2022] POST /identity/v3/projects => generated 364 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:18.391494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a0778-7dc5-4042-9724-134e68bcdca7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:18.391494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e03a0778-7dc5-4042-9724-134e68bcdca7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:18.411537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510390f8-5eed-4a9f-8d2a-2520e59b6b03 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:18.493994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fa798-a91b-43a6-8862-9d60bb6becb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:18.494775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fa798-a91b-43a6-8862-9d60bb6becb3 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:18.495161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fa798-a91b-43a6-8862-9d60bb6becb3 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:18.495443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fa798-a91b-43a6-8862-9d60bb6becb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:18.497329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f66fa798-a91b-43a6-8862-9d60bb6becb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:18.500517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a0778-7dc5-4042-9724-134e68bcdca7 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:18.507919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec86531-4360-4f21-ab65-3148e8394879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:18.509224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec86531-4360-4f21-ab65-3148e8394879 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:18.509224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec86531-4360-4f21-ab65-3148e8394879 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:18.509224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec86531-4360-4f21-ab65-3148e8394879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:18.510897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3ec86531-4360-4f21-ab65-3148e8394879 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:18.512015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fa798-a91b-43a6-8862-9d60bb6becb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:18.513684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fa798-a91b-43a6-8862-9d60bb6becb3 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:18.524922 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2047/4116] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:06:18.525583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fa798-a91b-43a6-8862-9d60bb6becb3 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:18.527132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f66fa798-a91b-43a6-8862-9d60bb6becb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:18.588420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec86531-4360-4f21-ab65-3148e8394879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:18.590054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec86531-4360-4f21-ab65-3148e8394879 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:18.601162 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2070/4117] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:18 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:18.602173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec86531-4360-4f21-ab65-3148e8394879 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:18.607499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:18.616199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:18.634426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fa798-a91b-43a6-8862-9d60bb6becb3 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:18.642284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50f47f-624a-43e0-aff8-52f49658dbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:18.643232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50f47f-624a-43e0-aff8-52f49658dbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:18.643679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50f47f-624a-43e0-aff8-52f49658dbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:18.644165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50f47f-624a-43e0-aff8-52f49658dbe5 admin admin] PATH_INFO: `/v3/users/5000948fa98a4b5d96ad27436d3d0edb` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:18.647705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50f47f-624a-43e0-aff8-52f49658dbe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5000948fa98a4b5d96ad27436d3d0edb)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:18.650243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50f47f-624a-43e0-aff8-52f49658dbe5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:18.709092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec86531-4360-4f21-ab65-3148e8394879 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:18.726688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc1ca1-42e3-4fa8-804b-53e9a2ba47d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:18.726688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc1ca1-42e3-4fa8-804b-53e9a2ba47d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:18.726688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc1ca1-42e3-4fa8-804b-53e9a2ba47d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:18.727003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc1ca1-42e3-4fa8-804b-53e9a2ba47d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:18.727003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc1ca1-42e3-4fa8-804b-53e9a2ba47d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:18.727003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc1ca1-42e3-4fa8-804b-53e9a2ba47d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:18.740183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9b50f47f-624a-43e0-aff8-52f49658dbe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5000948fa98a4b5d96ad27436d3d0edb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:18.750763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9b50f47f-624a-43e0-aff8-52f49658dbe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5000948fa98a4b5d96ad27436d3d0edb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:18.751806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9b50f47f-624a-43e0-aff8-52f49658dbe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5000948fa98a4b5d96ad27436d3d0edb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:18.752652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9b50f47f-624a-43e0-aff8-52f49658dbe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5000948fa98a4b5d96ad27436d3d0edb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:18.772317 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2071/4118] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:18 2022] POST /identity/v3/projects => generated 363 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:18.787751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc1ca1-42e3-4fa8-804b-53e9a2ba47d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:18.787751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-71cc1ca1-42e3-4fa8-804b-53e9a2ba47d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:18.788339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9b50f47f-624a-43e0-aff8-52f49658dbe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5000948fa98a4b5d96ad27436d3d0edb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:18.800048 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2048/4119] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:18 2022] DELETE /identity/v3/users/5000948fa98a4b5d96ad27436d3d0edb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:18.875954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc1ca1-42e3-4fa8-804b-53e9a2ba47d3 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:19.002096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a37de-19b5-4e61-af86-dd4c471ce206 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:19.002962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a37de-19b5-4e61-af86-dd4c471ce206 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:19.004143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a37de-19b5-4e61-af86-dd4c471ce206 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:19.005541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a37de-19b5-4e61-af86-dd4c471ce206 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:19.006432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a37de-19b5-4e61-af86-dd4c471ce206 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:19.010738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a37de-19b5-4e61-af86-dd4c471ce206 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:19.036350 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2072/4120] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:06:18 2022] POST /identity/v3/roles => generated 239 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:19.041862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50f47f-624a-43e0-aff8-52f49658dbe5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:19.055240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50f47f-624a-43e0-aff8-52f49658dbe5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:19.060421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a2ae9-f266-4b31-af8a-fdd24c1558f9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:19.061968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2ae9-f266-4b31-af8a-fdd24c1558f9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:19.062348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2ae9-f266-4b31-af8a-fdd24c1558f9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:19.062694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2ae9-f266-4b31-af8a-fdd24c1558f9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/projects/c2fdd21fbda24bd4a8e41a36b4bed5aa/users/6f1b2d058f2e46b8ac2a83ca8bbbe505/roles/b302de36b4ef4af69b2ded4e5acb96f1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:19.084667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a2ae9-f266-4b31-af8a-fdd24c1558f9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c2fdd21fbda24bd4a8e41a36b4bed5aa, user_id=6f1b2d058f2e46b8ac2a83ca8bbbe505, role_id=b302de36b4ef4af69b2ded4e5acb96f1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:19.087514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a2ae9-f266-4b31-af8a-fdd24c1558f9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:19.116241 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2049/4121] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:19 2022] PUT /identity/v3/projects/c2fdd21fbda24bd4a8e41a36b4bed5aa/users/6f1b2d058f2e46b8ac2a83ca8bbbe505/roles/b302de36b4ef4af69b2ded4e5acb96f1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:19.118956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a37de-19b5-4e61-af86-dd4c471ce206 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:19.157272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a37de-19b5-4e61-af86-dd4c471ce206 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:19.250469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:19.287787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a2ae9-f266-4b31-af8a-fdd24c1558f9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:19.303900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-176a2ae9-f266-4b31-af8a-fdd24c1558f9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:19.359147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0b3da-511f-4a76-a05c-e0a865f4d57c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:19.361020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0b3da-511f-4a76-a05c-e0a865f4d57c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:19.363546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0b3da-511f-4a76-a05c-e0a865f4d57c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:19.363821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0b3da-511f-4a76-a05c-e0a865f4d57c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/projects/9e88711040dd42ec8cdb9c43820b341b/users/6f1b2d058f2e46b8ac2a83ca8bbbe505/roles/b302de36b4ef4af69b2ded4e5acb96f1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:19.372445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0b3da-511f-4a76-a05c-e0a865f4d57c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9e88711040dd42ec8cdb9c43820b341b, user_id=6f1b2d058f2e46b8ac2a83ca8bbbe505, role_id=b302de36b4ef4af69b2ded4e5acb96f1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:19.380451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0b3da-511f-4a76-a05c-e0a865f4d57c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:19.414069 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2073/4122] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:19 2022] PUT /identity/v3/projects/9e88711040dd42ec8cdb9c43820b341b/users/6f1b2d058f2e46b8ac2a83ca8bbbe505/roles/b302de36b4ef4af69b2ded4e5acb96f1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:19.416008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0b3da-511f-4a76-a05c-e0a865f4d57c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:19.430113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-70f0b3da-511f-4a76-a05c-e0a865f4d57c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:19.438013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a2ae9-f266-4b31-af8a-fdd24c1558f9 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:19.534787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:19.541851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0b3da-511f-4a76-a05c-e0a865f4d57c tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:19.547281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f2a89-f4ce-418a-b295-98bb7dde8a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:19.548045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f2a89-f4ce-418a-b295-98bb7dde8a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:19.548355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f2a89-f4ce-418a-b295-98bb7dde8a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:19.548592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f2a89-f4ce-418a-b295-98bb7dde8a2c admin admin] PATH_INFO: `/v3/users/0d7f2813d2094f549a78a0b77cd99506` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:19.549821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f2a89-f4ce-418a-b295-98bb7dde8a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7f2813d2094f549a78a0b77cd99506)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:19.551365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:19.551950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f2a89-f4ce-418a-b295-98bb7dde8a2c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:19.552711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:19.553689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:19.553689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382 admin admin] PATH_INFO: `/v3/projects/917519b500674698a68dc01a4e8d68a8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:19.557793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=917519b500674698a68dc01a4e8d68a8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:19.560709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:19.624342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-950f2a89-f4ce-418a-b295-98bb7dde8a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7f2813d2094f549a78a0b77cd99506'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:19.624759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917519b500674698a68dc01a4e8d68a8', 'request_id': 'req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:19.634366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-950f2a89-f4ce-418a-b295-98bb7dde8a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7f2813d2094f549a78a0b77cd99506'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:19.635510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-950f2a89-f4ce-418a-b295-98bb7dde8a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7f2813d2094f549a78a0b77cd99506'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:19.637272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917519b500674698a68dc01a4e8d68a8', 'request_id': 'req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:19.637983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-950f2a89-f4ce-418a-b295-98bb7dde8a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7f2813d2094f549a78a0b77cd99506'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:19.647256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917519b500674698a68dc01a4e8d68a8', 'request_id': 'req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:19.663565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382 admin admin] The token cache is being invalidate because project 917519b500674698a68dc01a4e8d68a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:19.664112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:19.664479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-950f2a89-f4ce-418a-b295-98bb7dde8a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7f2813d2094f549a78a0b77cd99506'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:19.665660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c1ed93a-ab91-4fa9-b55b-10dfbb168382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:19.668247 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2050/4123] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:19 2022] DELETE /identity/v3/projects/917519b500674698a68dc01a4e8d68a8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:19.673278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2346-baf8-405d-a661-1c6d077ae6c5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:19.673278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2346-baf8-405d-a661-1c6d077ae6c5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:19.673278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2346-baf8-405d-a661-1c6d077ae6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:19.697622 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2074/4124] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:19 2022] DELETE /identity/v3/users/0d7f2813d2094f549a78a0b77cd99506 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:19.706468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b15e3-28e8-4cf5-89fb-c76ed4f87f80 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:19.706886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b15e3-28e8-4cf5-89fb-c76ed4f87f80 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:19.707257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b15e3-28e8-4cf5-89fb-c76ed4f87f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:19.720434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-02dc2346-baf8-405d-a661-1c6d077ae6c5 None None] MFA Rules not processed for user `6f1b2d058f2e46b8ac2a83ca8bbbe505`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:19.722260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-02dc2346-baf8-405d-a661-1c6d077ae6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:19.728937 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2051/4125] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:19 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:19.731015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f329-4125-47e5-8f20-43b6c58ef172 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:19.731554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f329-4125-47e5-8f20-43b6c58ef172 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:19.732026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f329-4125-47e5-8f20-43b6c58ef172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:19.737927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-934b15e3-28e8-4cf5-89fb-c76ed4f87f80 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:19.739237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-934b15e3-28e8-4cf5-89fb-c76ed4f87f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:19.757313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-56a5f329-4125-47e5-8f20-43b6c58ef172 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:19.758644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-56a5f329-4125-47e5-8f20-43b6c58ef172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:19.811493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:19.852139 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2075/4126] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:19.853944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4034839-7b0c-4699-9bdd-c550cb55bc4d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:19.854241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4034839-7b0c-4699-9bdd-c550cb55bc4d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:19.854515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4034839-7b0c-4699-9bdd-c550cb55bc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:19.857512 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2052/4127] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:19.858779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3e39-1cff-40ba-b1a2-0cd79f06ee10 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:19.859861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3e39-1cff-40ba-b1a2-0cd79f06ee10 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:19.860118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3e39-1cff-40ba-b1a2-0cd79f06ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:19.874138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f4034839-7b0c-4699-9bdd-c550cb55bc4d None None] MFA Rules not processed for user `6f1b2d058f2e46b8ac2a83ca8bbbe505`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:19.875670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f4034839-7b0c-4699-9bdd-c550cb55bc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:19.888762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f8de3e39-1cff-40ba-b1a2-0cd79f06ee10 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:19.890885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f8de3e39-1cff-40ba-b1a2-0cd79f06ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:19.905434 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2053/4128] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:19.906397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de3e39-1cff-40ba-b1a2-0cd79f06ee10 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:19.907801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f8de3e39-1cff-40ba-b1a2-0cd79f06ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:20.004154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de3e39-1cff-40ba-b1a2-0cd79f06ee10 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:20.004340 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2076/4129] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 08 21:06:20.005490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4034839-7b0c-4699-9bdd-c550cb55bc4d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:20.020601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4034839-7b0c-4699-9bdd-c550cb55bc4d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:20.024931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6da55b-caca-44f4-a32f-0127aceee2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:20.025602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6da55b-caca-44f4-a32f-0127aceee2ff service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:20.025902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6da55b-caca-44f4-a32f-0127aceee2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:20.026145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6da55b-caca-44f4-a32f-0127aceee2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:20.029756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb0650-841d-4d00-b241-811a0d404701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:20.032912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb0650-841d-4d00-b241-811a0d404701 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:20.033067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb0650-841d-4d00-b241-811a0d404701 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:20.033478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb0650-841d-4d00-b241-811a0d404701 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:20.035591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb0650-841d-4d00-b241-811a0d404701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:06:20.035972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb0650-841d-4d00-b241-811a0d404701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:20.037857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb0650-841d-4d00-b241-811a0d404701 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:20.039250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6da55b-caca-44f4-a32f-0127aceee2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:20.041162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6da55b-caca-44f4-a32f-0127aceee2ff service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:20.055160 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2054/4130] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:20.062603 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2077/4131] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:20.062603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb0650-841d-4d00-b241-811a0d404701 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:20.064598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6da55b-caca-44f4-a32f-0127aceee2ff service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:20.066788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-faeb0650-841d-4d00-b241-811a0d404701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:20.091676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6da55b-caca-44f4-a32f-0127aceee2ff service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:20.102953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2f142-73de-41bf-b002-5c3846e20ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:20.103931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2f142-73de-41bf-b002-5c3846e20ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:20.104424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2f142-73de-41bf-b002-5c3846e20ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:20.104935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2f142-73de-41bf-b002-5c3846e20ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:20.105815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2f142-73de-41bf-b002-5c3846e20ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:20.107998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2f142-73de-41bf-b002-5c3846e20ba4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:20.122384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:20.148568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb0650-841d-4d00-b241-811a0d404701 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:20.156369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5a912-b5ed-4f11-bc22-147395b87fe5 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:20.156658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5a912-b5ed-4f11-bc22-147395b87fe5 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:20.156980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5a912-b5ed-4f11-bc22-147395b87fe5 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:20.157274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5a912-b5ed-4f11-bc22-147395b87fe5 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:20.167490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5a912-b5ed-4f11-bc22-147395b87fe5 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:20.171442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5a912-b5ed-4f11-bc22-147395b87fe5 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:20.190999 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2055/4132] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:20 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:20.205448 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2078/4133] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Oct 8 21:06:20 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:20.206662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2f142-73de-41bf-b002-5c3846e20ba4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:20.210032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6683f-49f8-42dd-89a1-c8089283fcda None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:20.210314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6683f-49f8-42dd-89a1-c8089283fcda None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:20.210929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6683f-49f8-42dd-89a1-c8089283fcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:20.239265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8ed6683f-49f8-42dd-89a1-c8089283fcda None None] MFA Rules not processed for user `6f1b2d058f2e46b8ac2a83ca8bbbe505`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:20.240603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8ed6683f-49f8-42dd-89a1-c8089283fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:20.368814 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2079/4134] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3223 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 08 21:06:20.374850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6683f-49f8-42dd-89a1-c8089283fcda None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:20.382736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2f142-73de-41bf-b002-5c3846e20ba4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:20.405404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5a821-4de8-4abf-8d4f-85fec7db273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:20.406290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a821-4de8-4abf-8d4f-85fec7db273a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:20.406446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:20.406547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a821-4de8-4abf-8d4f-85fec7db273a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:20.406837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a821-4de8-4abf-8d4f-85fec7db273a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:20.407465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5a821-4de8-4abf-8d4f-85fec7db273a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:20.412210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5a821-4de8-4abf-8d4f-85fec7db273a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:20.456370 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2056/4135] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:06:20 2022] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:20.461986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5a821-4de8-4abf-8d4f-85fec7db273a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:20.486312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5a821-4de8-4abf-8d4f-85fec7db273a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:20.501241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f58f4-5669-44a4-a812-664342c8c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:20.501876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f58f4-5669-44a4-a812-664342c8c73f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:20.512147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f58f4-5669-44a4-a812-664342c8c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:20.513057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f58f4-5669-44a4-a812-664342c8c73f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:20.514053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f58f4-5669-44a4-a812-664342c8c73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:20.516128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f58f4-5669-44a4-a812-664342c8c73f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:20.533297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6683f-49f8-42dd-89a1-c8089283fcda None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:20.535693 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2057/4136] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:20 2022] GET /identity/v3/roles => generated 1650 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:20.541699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f58f4-5669-44a4-a812-664342c8c73f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:20.550764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f5084-ff05-4b63-9acd-12cfab522784 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:20.551588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f5084-ff05-4b63-9acd-12cfab522784 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:20.551870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f5084-ff05-4b63-9acd-12cfab522784 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:20.552148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f5084-ff05-4b63-9acd-12cfab522784 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/roles/b302de36b4ef4af69b2ded4e5acb96f1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:20.555406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f5084-ff05-4b63-9acd-12cfab522784 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b302de36b4ef4af69b2ded4e5acb96f1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:20.557664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f5084-ff05-4b63-9acd-12cfab522784 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:20.558044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f58f4-5669-44a4-a812-664342c8c73f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:20.563900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3b12a-fb86-4f12-bfe5-5c788e31eb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:20.564691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3b12a-fb86-4f12-bfe5-5c788e31eb20 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:20.564976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3b12a-fb86-4f12-bfe5-5c788e31eb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:20.565265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3b12a-fb86-4f12-bfe5-5c788e31eb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:20.565925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3b12a-fb86-4f12-bfe5-5c788e31eb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:20.567535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3b12a-fb86-4f12-bfe5-5c788e31eb20 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:20.586067 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2058/4137] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:20 2022] GET /identity/v3/roles => generated 1650 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:20.586996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3b12a-fb86-4f12-bfe5-5c788e31eb20 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:20.611739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3b12a-fb86-4f12-bfe5-5c788e31eb20 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:20.636829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431c24b-e818-4084-acc8-26b96c2835cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:20.637799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431c24b-e818-4084-acc8-26b96c2835cb admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:20.638206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431c24b-e818-4084-acc8-26b96c2835cb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:20.638566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431c24b-e818-4084-acc8-26b96c2835cb admin admin] PATH_INFO: `/v3/projects/169293c01bf047358ff870a36c7a1247/users/dcad18d0243f492591808197ca3dcc81/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:20.675150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431c24b-e818-4084-acc8-26b96c2835cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=169293c01bf047358ff870a36c7a1247, user_id=dcad18d0243f492591808197ca3dcc81, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:20.680033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431c24b-e818-4084-acc8-26b96c2835cb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:20.691581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-686f5084-ff05-4b63-9acd-12cfab522784 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invalidating the token cache because role b302de36b4ef4af69b2ded4e5acb96f1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:20.692291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-686f5084-ff05-4b63-9acd-12cfab522784 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:20.693367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-686f5084-ff05-4b63-9acd-12cfab522784 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:20.697611 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2080/4138] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:20 2022] DELETE /identity/v3/roles/b302de36b4ef4af69b2ded4e5acb96f1 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:20.698958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f5084-ff05-4b63-9acd-12cfab522784 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:20.700715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-686f5084-ff05-4b63-9acd-12cfab522784 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:20.720583 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2059/4139] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:20 2022] PUT /identity/v3/projects/169293c01bf047358ff870a36c7a1247/users/dcad18d0243f492591808197ca3dcc81/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:20.726855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431c24b-e818-4084-acc8-26b96c2835cb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:20.730270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c431c24b-e818-4084-acc8-26b96c2835cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:20.818632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431c24b-e818-4084-acc8-26b96c2835cb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:20.820839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f5084-ff05-4b63-9acd-12cfab522784 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:20.824022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49f691-d47a-47d6-9cec-b2902093e19d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:20.824728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49f691-d47a-47d6-9cec-b2902093e19d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:20.825052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49f691-d47a-47d6-9cec-b2902093e19d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:20.825394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49f691-d47a-47d6-9cec-b2902093e19d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/projects/9e88711040dd42ec8cdb9c43820b341b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:20.828015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49f691-d47a-47d6-9cec-b2902093e19d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e88711040dd42ec8cdb9c43820b341b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:20.830187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49f691-d47a-47d6-9cec-b2902093e19d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:20.897655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:20.921349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de49f691-d47a-47d6-9cec-b2902093e19d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e88711040dd42ec8cdb9c43820b341b', 'request_id': 'req-de49f691-d47a-47d6-9cec-b2902093e19d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:20.933096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:20.935031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:20.935031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:20.935444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] PATH_INFO: `/v3/projects/6dc1b8f80be04533b9c2f6b772350586` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:20.937841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc1b8f80be04533b9c2f6b772350586)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:20.939922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:20.953467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de49f691-d47a-47d6-9cec-b2902093e19d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e88711040dd42ec8cdb9c43820b341b', 'request_id': 'req-de49f691-d47a-47d6-9cec-b2902093e19d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:20.976101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de49f691-d47a-47d6-9cec-b2902093e19d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e88711040dd42ec8cdb9c43820b341b', 'request_id': 'req-de49f691-d47a-47d6-9cec-b2902093e19d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.005388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de49f691-d47a-47d6-9cec-b2902093e19d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] The token cache is being invalidate because project 9e88711040dd42ec8cdb9c43820b341b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:21.005388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de49f691-d47a-47d6-9cec-b2902093e19d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.005816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de49f691-d47a-47d6-9cec-b2902093e19d tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.006332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:21.010179 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2060/4140] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:20 2022] DELETE /identity/v3/projects/9e88711040dd42ec8cdb9c43820b341b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:21.014104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3091f1e-1633-42d2-8798-f461769d5052 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.014104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3091f1e-1633-42d2-8798-f461769d5052 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.014104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3091f1e-1633-42d2-8798-f461769d5052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.037982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d3091f1e-1633-42d2-8798-f461769d5052 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:21.039300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d3091f1e-1633-42d2-8798-f461769d5052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:21.043622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc1b8f80be04533b9c2f6b772350586', 'request_id': 'req-82347df9-4aaf-464a-94b9-20e30712acf7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.058306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc1b8f80be04533b9c2f6b772350586', 'request_id': 'req-82347df9-4aaf-464a-94b9-20e30712acf7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.068769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc1b8f80be04533b9c2f6b772350586', 'request_id': 'req-82347df9-4aaf-464a-94b9-20e30712acf7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.114196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] The token cache is being invalidate because project 6dc1b8f80be04533b9c2f6b772350586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:21.114601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.116570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.119849 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2081/4141] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:20 2022] DELETE /identity/v3/projects/6dc1b8f80be04533b9c2f6b772350586 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:21.125962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:21.130324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:21.151357 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2061/4142] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:21.153528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44d942-5996-4ed6-961e-a680554794e1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.153883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44d942-5996-4ed6-961e-a680554794e1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.154169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44d942-5996-4ed6-961e-a680554794e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.184565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7d44d942-5996-4ed6-961e-a680554794e1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:21.190959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7d44d942-5996-4ed6-961e-a680554794e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:21.203464 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2062/4143] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:21.210652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44d942-5996-4ed6-961e-a680554794e1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:21.210652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7d44d942-5996-4ed6-961e-a680554794e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:21.237483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82347df9-4aaf-464a-94b9-20e30712acf7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:21.240968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362462b-de46-4584-acf5-f186b4a30785 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:21.241152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362462b-de46-4584-acf5-f186b4a30785 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.241518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362462b-de46-4584-acf5-f186b4a30785 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.241799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362462b-de46-4584-acf5-f186b4a30785 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/projects/9e88711040dd42ec8cdb9c43820b341b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.249970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362462b-de46-4584-acf5-f186b4a30785 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e88711040dd42ec8cdb9c43820b341b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:21.252818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362462b-de46-4584-acf5-f186b4a30785 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-5362462b-de46-4584-acf5-f186b4a30785 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Could not find project: 9e88711040dd42ec8cdb9c43820b341b.: keystone.exception.ProjectNotFound: Could not find project: 9e88711040dd42ec8cdb9c43820b341b. Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 08 21:06:21.277824 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 08 21:06:21.279033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:06:21.279033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:06:21.279033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 08 21:06:21.279033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 08 21:06:21.279033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:06:21.279033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:06:21.279033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:06:21.279033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:06:21.279033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9e88711040dd42ec8cdb9c43820b341b. Oct 08 21:06:21.279033 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:06:21.280507 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2082/4144] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:21 2022] DELETE /identity/v3/projects/9e88711040dd42ec8cdb9c43820b341b => generated 113 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:06:21.281456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde05b0-c260-4b08-89cd-61ce524b8089 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.281738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde05b0-c260-4b08-89cd-61ce524b8089 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.282005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde05b0-c260-4b08-89cd-61ce524b8089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.300409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44d942-5996-4ed6-961e-a680554794e1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:21.304485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fef21-8d00-4688-9071-f838701b0ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:21.305107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fef21-8d00-4688-9071-f838701b0ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.305416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3bde05b0-c260-4b08-89cd-61ce524b8089 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:21.305537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fef21-8d00-4688-9071-f838701b0ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.305758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fef21-8d00-4688-9071-f838701b0ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.306382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3bde05b0-c260-4b08-89cd-61ce524b8089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:21.316211 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2083/4145] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:21.316447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fef21-8d00-4688-9071-f838701b0ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:21.317770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fef21-8d00-4688-9071-f838701b0ea2 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:21.318598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde05b0-c260-4b08-89cd-61ce524b8089 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:21.331246 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2063/4146] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:21.332032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fef21-8d00-4688-9071-f838701b0ea2 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:21.333737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde05b0-c260-4b08-89cd-61ce524b8089 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:21.339787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:21.340741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.341027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.341334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/projects/c2fdd21fbda24bd4a8e41a36b4bed5aa` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.343187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c2fdd21fbda24bd4a8e41a36b4bed5aa)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:21.344617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fef21-8d00-4688-9071-f838701b0ea2 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:21.345081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:21.350582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072d1e7-6817-4e63-946d-534a5f594fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:21.351461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072d1e7-6817-4e63-946d-534a5f594fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.351959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072d1e7-6817-4e63-946d-534a5f594fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.352542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072d1e7-6817-4e63-946d-534a5f594fe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.353469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072d1e7-6817-4e63-946d-534a5f594fe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:06:21.353968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072d1e7-6817-4e63-946d-534a5f594fe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:21.356161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072d1e7-6817-4e63-946d-534a5f594fe0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:21.371552 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2064/4147] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:21.375934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072d1e7-6817-4e63-946d-534a5f594fe0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:21.391992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072d1e7-6817-4e63-946d-534a5f594fe0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:21.398998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ed4ea-2ea0-4cd4-aaaf-a40896ec65cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:21.399833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ed4ea-2ea0-4cd4-aaaf-a40896ec65cb admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.400342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ed4ea-2ea0-4cd4-aaaf-a40896ec65cb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.400694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ed4ea-2ea0-4cd4-aaaf-a40896ec65cb admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.401479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ed4ea-2ea0-4cd4-aaaf-a40896ec65cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:21.404441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ed4ea-2ea0-4cd4-aaaf-a40896ec65cb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:21.423137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2fdd21fbda24bd4a8e41a36b4bed5aa', 'request_id': 'req-e51c96d1-3ddd-4fbd-b194-883bd550b399'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.439130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2fdd21fbda24bd4a8e41a36b4bed5aa', 'request_id': 'req-e51c96d1-3ddd-4fbd-b194-883bd550b399'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.448703 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2065/4148] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:21 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:21.455122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ed4ea-2ea0-4cd4-aaaf-a40896ec65cb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:21.455912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2fdd21fbda24bd4a8e41a36b4bed5aa', 'request_id': 'req-e51c96d1-3ddd-4fbd-b194-883bd550b399'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.483403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] The token cache is being invalidate because project c2fdd21fbda24bd4a8e41a36b4bed5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:21.484205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.494856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.502321 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2084/4149] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:21 2022] DELETE /identity/v3/projects/c2fdd21fbda24bd4a8e41a36b4bed5aa => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:21.506688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:21.509101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:21.510281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:21.565445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ed4ea-2ea0-4cd4-aaaf-a40896ec65cb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:21.571695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:21.574399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73563e9f-306f-490d-9e2d-31027e80481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:21.575418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73563e9f-306f-490d-9e2d-31027e80481f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.576045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73563e9f-306f-490d-9e2d-31027e80481f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.577703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73563e9f-306f-490d-9e2d-31027e80481f admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.579192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73563e9f-306f-490d-9e2d-31027e80481f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:21.582215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73563e9f-306f-490d-9e2d-31027e80481f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:21.637961 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2066/4150] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:06:21 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:21.639930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73563e9f-306f-490d-9e2d-31027e80481f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:21.645017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-73563e9f-306f-490d-9e2d-31027e80481f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:21.660641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c96d1-3ddd-4fbd-b194-883bd550b399 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:21.676688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73563e9f-306f-490d-9e2d-31027e80481f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:21.684955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb13c3c-1928-4c5a-8671-3ad34556eba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:21.685275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb13c3c-1928-4c5a-8671-3ad34556eba0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.685851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb13c3c-1928-4c5a-8671-3ad34556eba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.686733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb13c3c-1928-4c5a-8671-3ad34556eba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.687481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb13c3c-1928-4c5a-8671-3ad34556eba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:21.689110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb13c3c-1928-4c5a-8671-3ad34556eba0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:21.705643 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2067/4151] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:21.707069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb13c3c-1928-4c5a-8671-3ad34556eba0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:21.720390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb13c3c-1928-4c5a-8671-3ad34556eba0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:21.727497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185a0ce-42f7-464a-806b-60fe18d7b43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:21.728108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185a0ce-42f7-464a-806b-60fe18d7b43e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.728394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185a0ce-42f7-464a-806b-60fe18d7b43e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.728668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185a0ce-42f7-464a-806b-60fe18d7b43e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.729538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185a0ce-42f7-464a-806b-60fe18d7b43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:21.731710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185a0ce-42f7-464a-806b-60fe18d7b43e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:21.751559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:21.751802 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2068/4152] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:21.751926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.751926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.751926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/users/6f1b2d058f2e46b8ac2a83ca8bbbe505` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.751926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6f1b2d058f2e46b8ac2a83ca8bbbe505)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:21.753612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:21.754251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185a0ce-42f7-464a-806b-60fe18d7b43e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:21.766255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185a0ce-42f7-464a-806b-60fe18d7b43e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:21.772024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0c809-4fc9-4092-b147-26fb8f8b4bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:21.772691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0c809-4fc9-4092-b147-26fb8f8b4bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.772973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0c809-4fc9-4092-b147-26fb8f8b4bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.773421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0c809-4fc9-4092-b147-26fb8f8b4bd2 admin admin] PATH_INFO: `/v3/projects/7fa4985316324e9bb80d1ff7204a38c9/users/0c80c948aa554d4cad968a62bda9fb7c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.812553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0c809-4fc9-4092-b147-26fb8f8b4bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa4985316324e9bb80d1ff7204a38c9, user_id=0c80c948aa554d4cad968a62bda9fb7c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:21.815368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0c809-4fc9-4092-b147-26fb8f8b4bd2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:21.838470 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2069/4153] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:21 2022] PUT /identity/v3/projects/7fa4985316324e9bb80d1ff7204a38c9/users/0c80c948aa554d4cad968a62bda9fb7c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:21.842083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1b2d058f2e46b8ac2a83ca8bbbe505'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.850280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b7d53-6521-4cf4-ac84-47706be162d4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:21.850582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b7d53-6521-4cf4-ac84-47706be162d4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:21.851368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b7d53-6521-4cf4-ac84-47706be162d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:21.852725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1b2d058f2e46b8ac2a83ca8bbbe505'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.854047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1b2d058f2e46b8ac2a83ca8bbbe505'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.855249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1b2d058f2e46b8ac2a83ca8bbbe505'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.875528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1b2d058f2e46b8ac2a83ca8bbbe505'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:21.894595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7b7b7d53-6521-4cf4-ac84-47706be162d4 None None] MFA Rules not processed for user `0c80c948aa554d4cad968a62bda9fb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:21.897431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7b7b7d53-6521-4cf4-ac84-47706be162d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:21.906145 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2085/4154] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:21 2022] DELETE /identity/v3/users/6f1b2d058f2e46b8ac2a83ca8bbbe505 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:06:21.914333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:21.916537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:22.010088 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2070/4155] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:06:22.019306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b7d53-6521-4cf4-ac84-47706be162d4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:22.021867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7b7b7d53-6521-4cf4-ac84-47706be162d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:22.028608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:22.054420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174f30b-109c-4b4f-8fc9-1ddd85ac6897 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:22.060089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab6333-75ee-4773-a754-ba6774d2a5fd tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:22.061526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab6333-75ee-4773-a754-ba6774d2a5fd tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:22.062100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab6333-75ee-4773-a754-ba6774d2a5fd tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:22.062489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab6333-75ee-4773-a754-ba6774d2a5fd tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/0b1c90533f2c4202a75ae19e93fc0623` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:22.073460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab6333-75ee-4773-a754-ba6774d2a5fd tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-aaab6333-75ee-4773-a754-ba6774d2a5fd tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Could not find domain: 0b1c90533f2c4202a75ae19e93fc0623.: keystone.exception.DomainNotFound: Could not find domain: 0b1c90533f2c4202a75ae19e93fc0623. Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0b1c90533f2c4202a75ae19e93fc0623. Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:06:22.087167 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:06:22.088597 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0b1c90533f2c4202a75ae19e93fc0623. Oct 08 21:06:22.089917 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:06:22.097354 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2086/4156] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:06:21 2022] PATCH /identity/v3/domains/0b1c90533f2c4202a75ae19e93fc0623 => generated 112 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:06:22.098978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab6333-75ee-4773-a754-ba6774d2a5fd tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:22.115800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab6333-75ee-4773-a754-ba6774d2a5fd tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:22.120657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:22.124598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d317f-f8bf-4a8f-9ceb-ab8f059ab888 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:22.126096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d317f-f8bf-4a8f-9ceb-ab8f059ab888 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:22.128127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d317f-f8bf-4a8f-9ceb-ab8f059ab888 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:22.128677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d317f-f8bf-4a8f-9ceb-ab8f059ab888 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/1e656c94438e4659bad7328e4ce1d05f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:22.141462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d317f-f8bf-4a8f-9ceb-ab8f059ab888 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-326d317f-f8bf-4a8f-9ceb-ab8f059ab888 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Could not find domain: 1e656c94438e4659bad7328e4ce1d05f.: keystone.exception.DomainNotFound: Could not find domain: 1e656c94438e4659bad7328e4ce1d05f. Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1e656c94438e4659bad7328e4ce1d05f. Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:06:22.149131 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:06:22.150444 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1e656c94438e4659bad7328e4ce1d05f. Oct 08 21:06:22.151505 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:06:22.158305 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2087/4157] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:06:22 2022] PATCH /identity/v3/domains/1e656c94438e4659bad7328e4ce1d05f => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:06:22.159258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d317f-f8bf-4a8f-9ceb-ab8f059ab888 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:22.160432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b7d53-6521-4cf4-ac84-47706be162d4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:22.179917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d317f-f8bf-4a8f-9ceb-ab8f059ab888 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:22.186010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47811b2e-6d84-4b46-9b41-5341e255bb6e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:22.187227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811b2e-6d84-4b46-9b41-5341e255bb6e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:22.187713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811b2e-6d84-4b46-9b41-5341e255bb6e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:22.188497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811b2e-6d84-4b46-9b41-5341e255bb6e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/8a3b73e14d4d446c965c42364583f081` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:22.198564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47811b2e-6d84-4b46-9b41-5341e255bb6e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-47811b2e-6d84-4b46-9b41-5341e255bb6e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Could not find domain: 8a3b73e14d4d446c965c42364583f081.: keystone.exception.DomainNotFound: Could not find domain: 8a3b73e14d4d446c965c42364583f081. Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8a3b73e14d4d446c965c42364583f081. Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:06:22.206493 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:06:22.207819 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8a3b73e14d4d446c965c42364583f081. Oct 08 21:06:22.208949 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:06:22.213912 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2088/4158] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:06:22 2022] PATCH /identity/v3/domains/8a3b73e14d4d446c965c42364583f081 => generated 112 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:06:22.217058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47811b2e-6d84-4b46-9b41-5341e255bb6e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:22.241030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47811b2e-6d84-4b46-9b41-5341e255bb6e tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:22.251503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14602a-0c0d-488b-a8ac-5128ed309763 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '929a82431ac24e5ea1d82888c7b39cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f929cc6429420093373bfa2012d3ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:22.254250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14602a-0c0d-488b-a8ac-5128ed309763 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:22.254831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14602a-0c0d-488b-a8ac-5128ed309763 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:22.255245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14602a-0c0d-488b-a8ac-5128ed309763 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] PATH_INFO: `/v3/domains/33c0cfbb30724bc581a47eb41a6803e9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:22.267904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14602a-0c0d-488b-a8ac-5128ed309763 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:06:22.268088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231810b-eafb-4638-ab70-eaee0a098f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:22.268855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231810b-eafb-4638-ab70-eaee0a098f05 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:22.269140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231810b-eafb-4638-ab70-eaee0a098f05 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:22.269557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231810b-eafb-4638-ab70-eaee0a098f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-8a14602a-0c0d-488b-a8ac-5128ed309763 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Could not find domain: 33c0cfbb30724bc581a47eb41a6803e9.: keystone.exception.DomainNotFound: Could not find domain: 33c0cfbb30724bc581a47eb41a6803e9. Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 33c0cfbb30724bc581a47eb41a6803e9. Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:06:22.274244 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:06:22.275406 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 33c0cfbb30724bc581a47eb41a6803e9. Oct 08 21:06:22.276452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:06:22.277758 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2089/4159] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:06:22 2022] PATCH /identity/v3/domains/33c0cfbb30724bc581a47eb41a6803e9 => generated 112 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:06:22.283277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14602a-0c0d-488b-a8ac-5128ed309763 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:22.285558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8a14602a-0c0d-488b-a8ac-5128ed309763 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:22.356021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231810b-eafb-4638-ab70-eaee0a098f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:22.357937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231810b-eafb-4638-ab70-eaee0a098f05 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:22.374329 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2071/4160] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:22.388959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14602a-0c0d-488b-a8ac-5128ed309763 tempest-TokensV3TestJSON-2129089974 tempest-TokensV3TestJSON-2129089974-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:22.401343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:22.402571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:22.402977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:22.403451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] PATH_INFO: `/v3/users/ff8965489f774898b542ec3306ae214e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:22.404935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8965489f774898b542ec3306ae214e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:22.408068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:22.528153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8965489f774898b542ec3306ae214e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:22.546191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8965489f774898b542ec3306ae214e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:22.549567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8965489f774898b542ec3306ae214e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:22.551189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8965489f774898b542ec3306ae214e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:22.586894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8965489f774898b542ec3306ae214e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:22.646378 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2090/4161] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:22 2022] DELETE /identity/v3/users/ff8965489f774898b542ec3306ae214e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:22.651691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76983be-fc2a-4a3a-a9a4-b17abae11f5a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:22.651691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76983be-fc2a-4a3a-a9a4-b17abae11f5a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:22.651691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76983be-fc2a-4a3a-a9a4-b17abae11f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:22.708058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c76983be-fc2a-4a3a-a9a4-b17abae11f5a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:22.711225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c76983be-fc2a-4a3a-a9a4-b17abae11f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:22.814147 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2072/4162] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:22.942148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:22.944008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:23.054658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:23.083721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae77e3-3593-48f0-ad54-6d1988190cfc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:23.096414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90847d4c-b7c4-487c-907a-11fbc5ce324f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:23.098412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90847d4c-b7c4-487c-907a-11fbc5ce324f service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:23.099613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90847d4c-b7c4-487c-907a-11fbc5ce324f service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:23.101588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90847d4c-b7c4-487c-907a-11fbc5ce324f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:23.120629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90847d4c-b7c4-487c-907a-11fbc5ce324f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:23.123037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90847d4c-b7c4-487c-907a-11fbc5ce324f service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:23.147818 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2091/4163] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:24.662306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76983be-fc2a-4a3a-a9a4-b17abae11f5a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:24.664543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c76983be-fc2a-4a3a-a9a4-b17abae11f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:24.729088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76983be-fc2a-4a3a-a9a4-b17abae11f5a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:24.769617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:24.772563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:24.772946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:24.790160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] PATH_INFO: `/v3/projects/485e0e1d054f41978f53e36f1c868dc4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:24.794310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=485e0e1d054f41978f53e36f1c868dc4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:24.800197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:24.872623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:24.902924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485e0e1d054f41978f53e36f1c868dc4', 'request_id': 'req-d5e29016-70d1-4589-99b4-11c48ee4b440'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:24.913795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485e0e1d054f41978f53e36f1c868dc4', 'request_id': 'req-d5e29016-70d1-4589-99b4-11c48ee4b440'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:24.924050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485e0e1d054f41978f53e36f1c868dc4', 'request_id': 'req-d5e29016-70d1-4589-99b4-11c48ee4b440'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:24.938076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] The token cache is being invalidate because project 485e0e1d054f41978f53e36f1c868dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:24.938377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:24.939049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:24.943407 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2073/4164] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:24 2022] DELETE /identity/v3/projects/485e0e1d054f41978f53e36f1c868dc4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:24.947209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90847d4c-b7c4-487c-907a-11fbc5ce324f service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:24.970631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90847d4c-b7c4-487c-907a-11fbc5ce324f service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:25.189292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51d0eb-2f00-41a7-b706-dc2d293a6e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:25.189974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d0eb-2f00-41a7-b706-dc2d293a6e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:25.190280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d0eb-2f00-41a7-b706-dc2d293a6e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:25.190557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d0eb-2f00-41a7-b706-dc2d293a6e79 admin admin] PATH_INFO: `/v3/users/929a82431ac24e5ea1d82888c7b39cd7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:25.193143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51d0eb-2f00-41a7-b706-dc2d293a6e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=929a82431ac24e5ea1d82888c7b39cd7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:25.195948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51d0eb-2f00-41a7-b706-dc2d293a6e79 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:25.296628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3d51d0eb-2f00-41a7-b706-dc2d293a6e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929a82431ac24e5ea1d82888c7b39cd7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:25.315581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3d51d0eb-2f00-41a7-b706-dc2d293a6e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929a82431ac24e5ea1d82888c7b39cd7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:25.317478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3d51d0eb-2f00-41a7-b706-dc2d293a6e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929a82431ac24e5ea1d82888c7b39cd7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:25.318309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3d51d0eb-2f00-41a7-b706-dc2d293a6e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929a82431ac24e5ea1d82888c7b39cd7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:25.370869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3d51d0eb-2f00-41a7-b706-dc2d293a6e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929a82431ac24e5ea1d82888c7b39cd7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:25.407009 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2092/4165] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:24 2022] DELETE /identity/v3/users/929a82431ac24e5ea1d82888c7b39cd7 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:25.647804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:25.649390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:25.667261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29016-70d1-4589-99b4-11c48ee4b440 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:25.782317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:25.783525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:25.783903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:25.797302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] PATH_INFO: `/v3/users/0c80c948aa554d4cad968a62bda9fb7c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:25.799840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c80c948aa554d4cad968a62bda9fb7c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:25.804169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:25.884825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c80c948aa554d4cad968a62bda9fb7c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:25.895289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c80c948aa554d4cad968a62bda9fb7c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:25.896034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c80c948aa554d4cad968a62bda9fb7c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:25.896674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c80c948aa554d4cad968a62bda9fb7c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:25.919952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c80c948aa554d4cad968a62bda9fb7c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:25.949024 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2074/4166] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:25 2022] DELETE /identity/v3/users/0c80c948aa554d4cad968a62bda9fb7c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:25.953998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d309984-2f1f-40c1-92d7-b1fd39e25e97 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:25.954527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d309984-2f1f-40c1-92d7-b1fd39e25e97 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:25.954643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d309984-2f1f-40c1-92d7-b1fd39e25e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:25.977379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2d309984-2f1f-40c1-92d7-b1fd39e25e97 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:25.979185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2d309984-2f1f-40c1-92d7-b1fd39e25e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:26.052470 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2093/4167] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:26.080310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:26.081941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:26.146253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:26.185091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd6dec-d25c-46af-a33c-b53a697f4f74 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:26.188987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62c3c3-9c59-4c96-a788-0b809237123a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:26.189657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62c3c3-9c59-4c96-a788-0b809237123a service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:26.190137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62c3c3-9c59-4c96-a788-0b809237123a service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:26.190440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62c3c3-9c59-4c96-a788-0b809237123a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:26.204540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62c3c3-9c59-4c96-a788-0b809237123a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:26.204540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62c3c3-9c59-4c96-a788-0b809237123a service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:26.218190 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2075/4168] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:26.878341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d309984-2f1f-40c1-92d7-b1fd39e25e97 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:26.883261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2d309984-2f1f-40c1-92d7-b1fd39e25e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:26.914967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:26.936211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d309984-2f1f-40c1-92d7-b1fd39e25e97 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:26.953838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:26.956794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:26.957791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:26.958100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] PATH_INFO: `/v3/projects/60f929cc6429420093373bfa2012d3ef` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:26.962374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f929cc6429420093373bfa2012d3ef)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:26.968190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:27.072954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f929cc6429420093373bfa2012d3ef', 'request_id': 'req-9a9d5f7f-8f70-4feb-a409-72089540d772'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.086924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f929cc6429420093373bfa2012d3ef', 'request_id': 'req-9a9d5f7f-8f70-4feb-a409-72089540d772'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.107811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f929cc6429420093373bfa2012d3ef', 'request_id': 'req-9a9d5f7f-8f70-4feb-a409-72089540d772'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.151051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] The token cache is being invalidate because project 60f929cc6429420093373bfa2012d3ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:27.153910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.157076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.161348 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2094/4169] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:26 2022] DELETE /identity/v3/projects/60f929cc6429420093373bfa2012d3ef => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:27.165696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62c3c3-9c59-4c96-a788-0b809237123a service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:27.185648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62c3c3-9c59-4c96-a788-0b809237123a service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:27.355192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d4d5f-f4a5-4949-92e7-867d90c4ac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:27.355853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d4d5f-f4a5-4949-92e7-867d90c4ac98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:27.356134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d4d5f-f4a5-4949-92e7-867d90c4ac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:27.356415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d4d5f-f4a5-4949-92e7-867d90c4ac98 admin admin] PATH_INFO: `/v3/users/c0840ee6573f4270b006c637ffa7389d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:27.357690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d4d5f-f4a5-4949-92e7-867d90c4ac98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0840ee6573f4270b006c637ffa7389d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:27.359622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d4d5f-f4a5-4949-92e7-867d90c4ac98 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:27.454384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3f6d4d5f-f4a5-4949-92e7-867d90c4ac98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0840ee6573f4270b006c637ffa7389d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.486152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3f6d4d5f-f4a5-4949-92e7-867d90c4ac98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0840ee6573f4270b006c637ffa7389d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.486969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3f6d4d5f-f4a5-4949-92e7-867d90c4ac98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0840ee6573f4270b006c637ffa7389d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.487604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3f6d4d5f-f4a5-4949-92e7-867d90c4ac98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0840ee6573f4270b006c637ffa7389d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.516098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3f6d4d5f-f4a5-4949-92e7-867d90c4ac98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0840ee6573f4270b006c637ffa7389d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.526106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:27.528224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:27.541281 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2076/4170] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:27 2022] DELETE /identity/v3/users/c0840ee6573f4270b006c637ffa7389d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:27.562546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d5f7f-8f70-4feb-a409-72089540d772 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:27.679400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:27.681330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:27.681877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:27.682826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6 admin admin] PATH_INFO: `/v3/projects/7fa4985316324e9bb80d1ff7204a38c9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:27.685320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa4985316324e9bb80d1ff7204a38c9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:27.691690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:27.707397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd210d5-5bc0-4804-a314-e74160c188b3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:27.707792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd210d5-5bc0-4804-a314-e74160c188b3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:27.708283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd210d5-5bc0-4804-a314-e74160c188b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:27.786056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dbd210d5-5bc0-4804-a314-e74160c188b3 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:27.790253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dbd210d5-5bc0-4804-a314-e74160c188b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:27.860013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa4985316324e9bb80d1ff7204a38c9', 'request_id': 'req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.896409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa4985316324e9bb80d1ff7204a38c9', 'request_id': 'req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.931873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa4985316324e9bb80d1ff7204a38c9', 'request_id': 'req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.950843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:27.974885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6 admin admin] The token cache is being invalidate because project 7fa4985316324e9bb80d1ff7204a38c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:27.976368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.978874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ab1b1dd9-f318-4fbd-a4f0-1accbb0af3b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:27.987545 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2095/4171] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:27 2022] DELETE /identity/v3/projects/7fa4985316324e9bb80d1ff7204a38c9 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:06:27.989699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c07daf-31c5-43a1-bdf9-863aa0401076 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:27.990856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c07daf-31c5-43a1-bdf9-863aa0401076 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:27.991256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c07daf-31c5-43a1-bdf9-863aa0401076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:28.027512 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2077/4172] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:06:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:28.046225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e0c07daf-31c5-43a1-bdf9-863aa0401076 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:28.047580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e0c07daf-31c5-43a1-bdf9-863aa0401076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:28.097071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:28.138193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd210d5-5bc0-4804-a314-e74160c188b3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:28.140293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dbd210d5-5bc0-4804-a314-e74160c188b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:28.252924 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2096/4173] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:28.256636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec2253-a6bf-4b72-852f-0ab276d15f37 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:28.256819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec2253-a6bf-4b72-852f-0ab276d15f37 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:28.257079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec2253-a6bf-4b72-852f-0ab276d15f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:28.294915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd210d5-5bc0-4804-a314-e74160c188b3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:28.318825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6aec2253-a6bf-4b72-852f-0ab276d15f37 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:28.321323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6aec2253-a6bf-4b72-852f-0ab276d15f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:28.332249 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2097/4174] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:28.336532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec2253-a6bf-4b72-852f-0ab276d15f37 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:28.361928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec2253-a6bf-4b72-852f-0ab276d15f37 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:28.370093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730c934-2b19-4958-9874-ed2b0ed8c997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:28.370756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730c934-2b19-4958-9874-ed2b0ed8c997 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:28.371229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730c934-2b19-4958-9874-ed2b0ed8c997 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:28.371575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730c934-2b19-4958-9874-ed2b0ed8c997 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:28.373157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730c934-2b19-4958-9874-ed2b0ed8c997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:06:28.374137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730c934-2b19-4958-9874-ed2b0ed8c997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:28.375832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730c934-2b19-4958-9874-ed2b0ed8c997 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:28.405411 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2098/4175] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:06:28.413710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730c934-2b19-4958-9874-ed2b0ed8c997 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:28.434736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730c934-2b19-4958-9874-ed2b0ed8c997 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:28.439341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550becb-1b8a-43eb-bab4-ef8419c43abb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:28.439977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550becb-1b8a-43eb-bab4-ef8419c43abb service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:28.440256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550becb-1b8a-43eb-bab4-ef8419c43abb service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:28.440532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550becb-1b8a-43eb-bab4-ef8419c43abb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:28.441722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c228ab2-fab1-404a-8bc1-cba62234c115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:28.442539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c228ab2-fab1-404a-8bc1-cba62234c115 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:28.442870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c228ab2-fab1-404a-8bc1-cba62234c115 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:28.443149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c228ab2-fab1-404a-8bc1-cba62234c115 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:28.443779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c228ab2-fab1-404a-8bc1-cba62234c115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:28.455989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c228ab2-fab1-404a-8bc1-cba62234c115 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:28.504470 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2099/4176] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:28 2022] POST /identity/v3/projects => generated 397 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:28.508482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c228ab2-fab1-404a-8bc1-cba62234c115 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:28.572481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550becb-1b8a-43eb-bab4-ef8419c43abb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:28.574474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550becb-1b8a-43eb-bab4-ef8419c43abb service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:28.590405 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2078/4177] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:06:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:06:28.605781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c228ab2-fab1-404a-8bc1-cba62234c115 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:28.625204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2ce7b-ebe8-4d7b-9699-1f1df7ca3e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:28.625767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2ce7b-ebe8-4d7b-9699-1f1df7ca3e5b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:28.627911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2ce7b-ebe8-4d7b-9699-1f1df7ca3e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:28.628340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2ce7b-ebe8-4d7b-9699-1f1df7ca3e5b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:28.629001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2ce7b-ebe8-4d7b-9699-1f1df7ca3e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:28.634806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2ce7b-ebe8-4d7b-9699-1f1df7ca3e5b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:28.702331 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2100/4178] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:06:28 2022] POST /identity/v3/users => generated 299 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:28.706307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550becb-1b8a-43eb-bab4-ef8419c43abb service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:28.725439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550becb-1b8a-43eb-bab4-ef8419c43abb service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:28.743282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84910e-9ba4-4f46-94fe-1c31870f18d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:28.744011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84910e-9ba4-4f46-94fe-1c31870f18d1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:28.744357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84910e-9ba4-4f46-94fe-1c31870f18d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:28.744735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84910e-9ba4-4f46-94fe-1c31870f18d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:28.745449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84910e-9ba4-4f46-94fe-1c31870f18d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:28.747133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84910e-9ba4-4f46-94fe-1c31870f18d1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:28.777000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2ce7b-ebe8-4d7b-9699-1f1df7ca3e5b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:28.777645 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2079/4179] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:28.790786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2ce7b-ebe8-4d7b-9699-1f1df7ca3e5b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:28.805471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46783efc-ac77-4771-829a-7546330065b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:28.807377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46783efc-ac77-4771-829a-7546330065b8 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:28.808566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46783efc-ac77-4771-829a-7546330065b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:28.809005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46783efc-ac77-4771-829a-7546330065b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:28.809871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46783efc-ac77-4771-829a-7546330065b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:28.812481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46783efc-ac77-4771-829a-7546330065b8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:28.839654 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2101/4180] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:28.844832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84910e-9ba4-4f46-94fe-1c31870f18d1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:28.860858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84910e-9ba4-4f46-94fe-1c31870f18d1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:28.872924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b8e63-ee2e-44d5-94a2-70b4d36a2833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:28.873669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b8e63-ee2e-44d5-94a2-70b4d36a2833 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:28.873951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b8e63-ee2e-44d5-94a2-70b4d36a2833 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:28.874224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b8e63-ee2e-44d5-94a2-70b4d36a2833 admin admin] PATH_INFO: `/v3/projects/081bbe524ba84369944f20b4d86f21dc/users/5b0d8160a9e04d84930264be71f29db7/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:28.884985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:28.941163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b8e63-ee2e-44d5-94a2-70b4d36a2833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=081bbe524ba84369944f20b4d86f21dc, user_id=5b0d8160a9e04d84930264be71f29db7, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:28.947884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b8e63-ee2e-44d5-94a2-70b4d36a2833 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:29.022713 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2080/4181] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:28 2022] PUT /identity/v3/projects/081bbe524ba84369944f20b4d86f21dc/users/5b0d8160a9e04d84930264be71f29db7/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:29.034125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578161ee-320b-4c9a-bbdc-a662cbacb7d3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:29.034615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578161ee-320b-4c9a-bbdc-a662cbacb7d3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:29.034725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578161ee-320b-4c9a-bbdc-a662cbacb7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:29.127806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-578161ee-320b-4c9a-bbdc-a662cbacb7d3 None None] MFA Rules not processed for user `5b0d8160a9e04d84930264be71f29db7`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:29.128991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-578161ee-320b-4c9a-bbdc-a662cbacb7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:29.292128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:29.355970 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2102/4182] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:29.905220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b8e63-ee2e-44d5-94a2-70b4d36a2833 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:29.907298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-953b8e63-ee2e-44d5-94a2-70b4d36a2833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:29.911678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578161ee-320b-4c9a-bbdc-a662cbacb7d3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:29.913641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-578161ee-320b-4c9a-bbdc-a662cbacb7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:30.119243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578161ee-320b-4c9a-bbdc-a662cbacb7d3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:30.130050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b50ff8-414c-4187-9620-5ba98bc027fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:30.131611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b50ff8-414c-4187-9620-5ba98bc027fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:30.131899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b50ff8-414c-4187-9620-5ba98bc027fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:30.132565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b50ff8-414c-4187-9620-5ba98bc027fd admin admin] PATH_INFO: `/v3/projects/73525f00cc7149bda4dfa66f7390ff01` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:30.137051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b50ff8-414c-4187-9620-5ba98bc027fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=73525f00cc7149bda4dfa66f7390ff01)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:30.138269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b8e63-ee2e-44d5-94a2-70b4d36a2833 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:30.141749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b50ff8-414c-4187-9620-5ba98bc027fd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:30.159965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe48c8-bed8-4072-836e-619a599fa592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:30.160554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe48c8-bed8-4072-836e-619a599fa592 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:30.160854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe48c8-bed8-4072-836e-619a599fa592 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:30.161135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe48c8-bed8-4072-836e-619a599fa592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:30.188385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe48c8-bed8-4072-836e-619a599fa592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:30.195426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe48c8-bed8-4072-836e-619a599fa592 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:30.240010 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2081/4183] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:30.297685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29b50ff8-414c-4187-9620-5ba98bc027fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73525f00cc7149bda4dfa66f7390ff01', 'request_id': 'req-29b50ff8-414c-4187-9620-5ba98bc027fd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:30.314562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29b50ff8-414c-4187-9620-5ba98bc027fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73525f00cc7149bda4dfa66f7390ff01', 'request_id': 'req-29b50ff8-414c-4187-9620-5ba98bc027fd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:30.345680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29b50ff8-414c-4187-9620-5ba98bc027fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73525f00cc7149bda4dfa66f7390ff01', 'request_id': 'req-29b50ff8-414c-4187-9620-5ba98bc027fd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:30.347790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251a52f-43fe-4bf4-a6a7-0f2ac89a08de None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:30.348336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251a52f-43fe-4bf4-a6a7-0f2ac89a08de None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:30.348662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251a52f-43fe-4bf4-a6a7-0f2ac89a08de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:30.393902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e251a52f-43fe-4bf4-a6a7-0f2ac89a08de None None] MFA Rules not processed for user `5b0d8160a9e04d84930264be71f29db7`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:30.398123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e251a52f-43fe-4bf4-a6a7-0f2ac89a08de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:30.398367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29b50ff8-414c-4187-9620-5ba98bc027fd admin admin] The token cache is being invalidate because project 73525f00cc7149bda4dfa66f7390ff01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:30.398679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29b50ff8-414c-4187-9620-5ba98bc027fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:30.399582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29b50ff8-414c-4187-9620-5ba98bc027fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:30.406437 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2103/4184] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:29 2022] DELETE /identity/v3/projects/73525f00cc7149bda4dfa66f7390ff01 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:30.408116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f52ec1-ae78-468c-9244-712d1e5f5756 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:30.409778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f52ec1-ae78-468c-9244-712d1e5f5756 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:30.410176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f52ec1-ae78-468c-9244-712d1e5f5756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:30.465124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d1f52ec1-ae78-468c-9244-712d1e5f5756 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:30.466697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d1f52ec1-ae78-468c-9244-712d1e5f5756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:30.517568 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2082/4185] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:06:30.523712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251a52f-43fe-4bf4-a6a7-0f2ac89a08de None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:30.525867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e251a52f-43fe-4bf4-a6a7-0f2ac89a08de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:30.594175 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2104/4186] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:30.602318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aedaab-c1a2-4463-bab1-82ceddff883d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:30.602871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aedaab-c1a2-4463-bab1-82ceddff883d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:30.603992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aedaab-c1a2-4463-bab1-82ceddff883d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:30.617607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251a52f-43fe-4bf4-a6a7-0f2ac89a08de None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:30.622986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:30.624473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:30.624608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:30.625743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] PATH_INFO: `/v3/users/0c6153d58d264272a375b3169e0874d3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:30.626954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6153d58d264272a375b3169e0874d3)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:30.628881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:30.634502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-76aedaab-c1a2-4463-bab1-82ceddff883d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:30.636111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-76aedaab-c1a2-4463-bab1-82ceddff883d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:30.645869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:30.654930 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2105/4187] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:30.661253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aedaab-c1a2-4463-bab1-82ceddff883d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:30.689748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aedaab-c1a2-4463-bab1-82ceddff883d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:30.699014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b37c94-080f-45cc-8253-94915787ea2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:30.699635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37c94-080f-45cc-8253-94915787ea2b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:30.700001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37c94-080f-45cc-8253-94915787ea2b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:30.700344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37c94-080f-45cc-8253-94915787ea2b admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:30.701111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b37c94-080f-45cc-8253-94915787ea2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:06:30.702054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b37c94-080f-45cc-8253-94915787ea2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:30.704255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b37c94-080f-45cc-8253-94915787ea2b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:30.707818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:30.712793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6153d58d264272a375b3169e0874d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:30.726495 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2106/4188] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:30.727410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b37c94-080f-45cc-8253-94915787ea2b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:30.731858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6153d58d264272a375b3169e0874d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:30.732846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6153d58d264272a375b3169e0874d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:30.733836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6153d58d264272a375b3169e0874d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:30.742317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b37c94-080f-45cc-8253-94915787ea2b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:30.753678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045d7e1-6e63-4d9b-aa99-ebebe8534bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:30.754563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d7e1-6e63-4d9b-aa99-ebebe8534bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:30.755093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d7e1-6e63-4d9b-aa99-ebebe8534bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:30.755898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d7e1-6e63-4d9b-aa99-ebebe8534bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:30.756661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045d7e1-6e63-4d9b-aa99-ebebe8534bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:30.759071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045d7e1-6e63-4d9b-aa99-ebebe8534bd5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:30.761053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6153d58d264272a375b3169e0874d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:30.788848 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2083/4189] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:30 2022] DELETE /identity/v3/users/0c6153d58d264272a375b3169e0874d3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:30.814561 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2107/4190] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:30 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:30.815861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:30.817794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:30.937333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcd4f7-8905-47c3-9698-aa80c902afa7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:31.050760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877aaad6-28e7-47bd-98fe-c243fe9af4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:31.051954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877aaad6-28e7-47bd-98fe-c243fe9af4ee admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:31.052395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877aaad6-28e7-47bd-98fe-c243fe9af4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:31.052676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877aaad6-28e7-47bd-98fe-c243fe9af4ee admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:31.053409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877aaad6-28e7-47bd-98fe-c243fe9af4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:31.056983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877aaad6-28e7-47bd-98fe-c243fe9af4ee admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:31.084789 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2084/4191] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:06:30 2022] POST /identity/v3/users => generated 288 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:31.088705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045d7e1-6e63-4d9b-aa99-ebebe8534bd5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:31.106024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045d7e1-6e63-4d9b-aa99-ebebe8534bd5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:31.113914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d17db8-70f1-41f5-8423-603abf853f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:31.114639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d17db8-70f1-41f5-8423-603abf853f49 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:31.115152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d17db8-70f1-41f5-8423-603abf853f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:31.115496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d17db8-70f1-41f5-8423-603abf853f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:31.116223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d17db8-70f1-41f5-8423-603abf853f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:31.117933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d17db8-70f1-41f5-8423-603abf853f49 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:31.134082 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2108/4192] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:31.137731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877aaad6-28e7-47bd-98fe-c243fe9af4ee admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:31.154265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877aaad6-28e7-47bd-98fe-c243fe9af4ee admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:31.167412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e359c38-3070-4fd2-9361-14179044ad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:31.168789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e359c38-3070-4fd2-9361-14179044ad63 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:31.169256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e359c38-3070-4fd2-9361-14179044ad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:31.169510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e359c38-3070-4fd2-9361-14179044ad63 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:31.172431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e359c38-3070-4fd2-9361-14179044ad63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:31.182509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e359c38-3070-4fd2-9361-14179044ad63 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:31.196075 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2085/4193] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:31.200075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d17db8-70f1-41f5-8423-603abf853f49 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:31.215843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d17db8-70f1-41f5-8423-603abf853f49 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:31.228734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b33e7-a409-4945-b2f5-3ab9489b0678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:31.231200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b33e7-a409-4945-b2f5-3ab9489b0678 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:31.231200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b33e7-a409-4945-b2f5-3ab9489b0678 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:31.233661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b33e7-a409-4945-b2f5-3ab9489b0678 admin admin] PATH_INFO: `/v3/projects/b475175ca4ea4a3391f5b4a31190b48e/users/c638561bc1e443b282b3e9c3b67c5582/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:31.268581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b33e7-a409-4945-b2f5-3ab9489b0678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b475175ca4ea4a3391f5b4a31190b48e, user_id=c638561bc1e443b282b3e9c3b67c5582, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:31.274959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b33e7-a409-4945-b2f5-3ab9489b0678 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:31.336885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2109/4194] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:31 2022] PUT /identity/v3/projects/b475175ca4ea4a3391f5b4a31190b48e/users/c638561bc1e443b282b3e9c3b67c5582/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:31.338654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a23c5b-5c1f-4d42-a585-f51b82b4979a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:31.338976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a23c5b-5c1f-4d42-a585-f51b82b4979a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:31.339218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a23c5b-5c1f-4d42-a585-f51b82b4979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:31.411174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e8a23c5b-5c1f-4d42-a585-f51b82b4979a None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:31.413374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e8a23c5b-5c1f-4d42-a585-f51b82b4979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:31.466551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:31.663090 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2086/4195] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:31.668329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b33e7-a409-4945-b2f5-3ab9489b0678 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:31.687923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b33e7-a409-4945-b2f5-3ab9489b0678 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:31.704664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cee51-40f7-4614-ae6a-d510ed62f784 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c638561bc1e443b282b3e9c3b67c5582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b475175ca4ea4a3391f5b4a31190b48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:31.705490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cee51-40f7-4614-ae6a-d510ed62f784 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:31.705845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cee51-40f7-4614-ae6a-d510ed62f784 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:31.708192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cee51-40f7-4614-ae6a-d510ed62f784 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] PATH_INFO: `/v3/users/c638561bc1e443b282b3e9c3b67c5582/password` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:31.879943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-849cee51-40f7-4614-ae6a-d510ed62f784 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:31.902460 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2110/4196] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:06:31 2022] POST /identity/v3/users/c638561bc1e443b282b3e9c3b67c5582/password => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:32.249167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a3ba5-65ef-41c5-969c-142241e45e7e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:32.250878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a3ba5-65ef-41c5-969c-142241e45e7e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:32.250878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a3ba5-65ef-41c5-969c-142241e45e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:32.347065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cee51-40f7-4614-ae6a-d510ed62f784 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:32.347065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-849cee51-40f7-4614-ae6a-d510ed62f784 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:32.361677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-638a3ba5-65ef-41c5-969c-142241e45e7e None None] MFA Rules not processed for user `dcad18d0243f492591808197ca3dcc81`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:32.367262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-638a3ba5-65ef-41c5-969c-142241e45e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:32.529508 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2087/4197] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:32.533119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cee51-40f7-4614-ae6a-d510ed62f784 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:32.539653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:32.540918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:32.541682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:32.542128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] PATH_INFO: `/v3/users/5b0d8160a9e04d84930264be71f29db7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:32.543657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0d8160a9e04d84930264be71f29db7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:32.546653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:32.642927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0d8160a9e04d84930264be71f29db7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:32.651215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0d8160a9e04d84930264be71f29db7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:32.651948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0d8160a9e04d84930264be71f29db7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:32.652629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0d8160a9e04d84930264be71f29db7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:32.665723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:32.679392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0d8160a9e04d84930264be71f29db7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:32.705629 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2111/4198] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:06:32 2022] DELETE /identity/v3/users/5b0d8160a9e04d84930264be71f29db7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:32.707596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75192b6f-4f8b-4fe0-ab1a-4a93fe41b235 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:32.707942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75192b6f-4f8b-4fe0-ab1a-4a93fe41b235 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:32.709100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75192b6f-4f8b-4fe0-ab1a-4a93fe41b235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:32.747399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-75192b6f-4f8b-4fe0-ab1a-4a93fe41b235 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:32.750074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-75192b6f-4f8b-4fe0-ab1a-4a93fe41b235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:32.835170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:32.837011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:32.894248 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2088/4199] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:06:32.910093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eb560-e0cb-475b-9619-ac82f6d8b751 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:32.910531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eb560-e0cb-475b-9619-ac82f6d8b751 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:32.910909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eb560-e0cb-475b-9619-ac82f6d8b751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:32.949757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a71eb560-e0cb-475b-9619-ac82f6d8b751 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:32.952327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a71eb560-e0cb-475b-9619-ac82f6d8b751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:32.962012 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2089/4200] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:32 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 21:06:32.962966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eb560-e0cb-475b-9619-ac82f6d8b751 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:32.966500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a71eb560-e0cb-475b-9619-ac82f6d8b751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:32.984279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46bba7-d928-484e-87b3-2567b219e9bb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:32.999319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be10dc-3eaf-412e-a5f9-22bda8740708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:33.000311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be10dc-3eaf-412e-a5f9-22bda8740708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:33.002567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be10dc-3eaf-412e-a5f9-22bda8740708 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:33.002910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be10dc-3eaf-412e-a5f9-22bda8740708 admin admin] PATH_INFO: `/v3/projects/c405aac48e9b403ca8d1e3ac28fab76e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:33.006659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be10dc-3eaf-412e-a5f9-22bda8740708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c405aac48e9b403ca8d1e3ac28fab76e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:33.009050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be10dc-3eaf-412e-a5f9-22bda8740708 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:33.085053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:33.101492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46be10dc-3eaf-412e-a5f9-22bda8740708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c405aac48e9b403ca8d1e3ac28fab76e', 'request_id': 'req-46be10dc-3eaf-412e-a5f9-22bda8740708'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:33.117597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46be10dc-3eaf-412e-a5f9-22bda8740708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c405aac48e9b403ca8d1e3ac28fab76e', 'request_id': 'req-46be10dc-3eaf-412e-a5f9-22bda8740708'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:33.140309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46be10dc-3eaf-412e-a5f9-22bda8740708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c405aac48e9b403ca8d1e3ac28fab76e', 'request_id': 'req-46be10dc-3eaf-412e-a5f9-22bda8740708'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:33.170255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46be10dc-3eaf-412e-a5f9-22bda8740708 admin admin] The token cache is being invalidate because project c405aac48e9b403ca8d1e3ac28fab76e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:33.171448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46be10dc-3eaf-412e-a5f9-22bda8740708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:33.173535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46be10dc-3eaf-412e-a5f9-22bda8740708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:33.175669 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2112/4201] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:32 2022] DELETE /identity/v3/projects/c405aac48e9b403ca8d1e3ac28fab76e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:06:33.177992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eea0b9-f3bf-42c5-afee-d4d8ee9dc81c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:33.178475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eea0b9-f3bf-42c5-afee-d4d8ee9dc81c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:33.178857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eea0b9-f3bf-42c5-afee-d4d8ee9dc81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:33.189831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eb560-e0cb-475b-9619-ac82f6d8b751 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:33.223330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-38eea0b9-f3bf-42c5-afee-d4d8ee9dc81c None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:33.224878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-38eea0b9-f3bf-42c5-afee-d4d8ee9dc81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:33.526242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5497301-4dce-4d49-9311-910275856077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:33.527458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5497301-4dce-4d49-9311-910275856077 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:33.527914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5497301-4dce-4d49-9311-910275856077 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:33.528354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5497301-4dce-4d49-9311-910275856077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:33.539623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b5497301-4dce-4d49-9311-910275856077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:33.581586 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2113/4202] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:33.587339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eea0b9-f3bf-42c5-afee-d4d8ee9dc81c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:33.594012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-38eea0b9-f3bf-42c5-afee-d4d8ee9dc81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:33.710048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:33.894469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5497301-4dce-4d49-9311-910275856077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:33.900780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5497301-4dce-4d49-9311-910275856077 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:33.948491 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2090/4203] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 986 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:33.955148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8ef77-c74e-4074-89d2-379e6fa710bf None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:33.955921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8ef77-c74e-4074-89d2-379e6fa710bf None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:33.955921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8ef77-c74e-4074-89d2-379e6fa710bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:33.961729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eea0b9-f3bf-42c5-afee-d4d8ee9dc81c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:34.000260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece11ea0-ed26-4949-8631-7112d4b7099a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:34.001282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece11ea0-ed26-4949-8631-7112d4b7099a service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:34.001758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece11ea0-ed26-4949-8631-7112d4b7099a service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:34.004379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece11ea0-ed26-4949-8631-7112d4b7099a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:34.011988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ece11ea0-ed26-4949-8631-7112d4b7099a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:34.056266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a8b8ef77-c74e-4074-89d2-379e6fa710bf None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:34.060340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a8b8ef77-c74e-4074-89d2-379e6fa710bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:34.089601 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2091/4204] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:34.091084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8ef77-c74e-4074-89d2-379e6fa710bf None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:34.122581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8ef77-c74e-4074-89d2-379e6fa710bf None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:34.147656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816769ea-5acf-456e-9cd1-f40a9bc8d81e tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c638561bc1e443b282b3e9c3b67c5582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b475175ca4ea4a3391f5b4a31190b48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:34.148741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816769ea-5acf-456e-9cd1-f40a9bc8d81e tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:34.149277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816769ea-5acf-456e-9cd1-f40a9bc8d81e tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:34.149737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816769ea-5acf-456e-9cd1-f40a9bc8d81e tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] PATH_INFO: `/v3/users/c638561bc1e443b282b3e9c3b67c5582/password` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:34.224254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece11ea0-ed26-4949-8631-7112d4b7099a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:34.231718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece11ea0-ed26-4949-8631-7112d4b7099a service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:34.269676 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2114/4205] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:34.275202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323ae27-4050-424a-830d-2378c78b355b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:34.275693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323ae27-4050-424a-830d-2378c78b355b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:34.276164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323ae27-4050-424a-830d-2378c78b355b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:34.302398 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-816769ea-5acf-456e-9cd1-f40a9bc8d81e tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 08 21:06:34.302398 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:34.302398 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:06:34.302398 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:06:34.302398 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:06:34.302398 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:06:34.302398 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:06:34.302398 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:06:34.302398 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:06:34.302398 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:06:34.302398 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:06:34.302398 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:06:34.302398 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 08 21:06:34.303615 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:06:34.310096 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2092/4206] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:06:34 2022] POST /identity/v3/users/c638561bc1e443b282b3e9c3b67c5582/password => generated 188 bytes in 220 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 08 21:06:34.312845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816769ea-5acf-456e-9cd1-f40a9bc8d81e tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:34.339903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816769ea-5acf-456e-9cd1-f40a9bc8d81e tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:34.350642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5323ae27-4050-424a-830d-2378c78b355b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:34.352743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5323ae27-4050-424a-830d-2378c78b355b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:34.361149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af1272-6e8b-4e26-9d66-7af2f4651ae8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c638561bc1e443b282b3e9c3b67c5582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b475175ca4ea4a3391f5b4a31190b48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:34.362174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af1272-6e8b-4e26-9d66-7af2f4651ae8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:34.362644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af1272-6e8b-4e26-9d66-7af2f4651ae8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:34.363144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af1272-6e8b-4e26-9d66-7af2f4651ae8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] PATH_INFO: `/v3/users/c638561bc1e443b282b3e9c3b67c5582/password` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:34.394156 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2115/4207] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:34.396734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323ae27-4050-424a-830d-2378c78b355b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:34.428051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323ae27-4050-424a-830d-2378c78b355b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:34.454883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89305f7-b0db-4028-bacc-49756210ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:34.455952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89305f7-b0db-4028-bacc-49756210ef78 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:34.456365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89305f7-b0db-4028-bacc-49756210ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:34.456852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89305f7-b0db-4028-bacc-49756210ef78 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:34.458026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89305f7-b0db-4028-bacc-49756210ef78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:06:34.458956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89305f7-b0db-4028-bacc-49756210ef78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:34.461581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89305f7-b0db-4028-bacc-49756210ef78 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:34.528417 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-f0af1272-6e8b-4e26-9d66-7af2f4651ae8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 08 21:06:34.528417 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:34.528417 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:06:34.528417 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:06:34.528417 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:06:34.528417 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:06:34.528417 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:06:34.528417 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:06:34.528417 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:06:34.528417 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:06:34.528417 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:06:34.528417 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:06:34.528417 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 08 21:06:34.529960 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:06:34.540560 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2116/4208] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:06:34.544535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89305f7-b0db-4028-bacc-49756210ef78 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:34.545666 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2093/4209] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:06:34 2022] POST /identity/v3/users/c638561bc1e443b282b3e9c3b67c5582/password => generated 188 bytes in 235 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 08 21:06:34.547149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af1272-6e8b-4e26-9d66-7af2f4651ae8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:34.581396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af1272-6e8b-4e26-9d66-7af2f4651ae8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:34.582810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89305f7-b0db-4028-bacc-49756210ef78 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:34.596326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d115cfa-63b6-4728-9dbb-54c4ecf87ba8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c638561bc1e443b282b3e9c3b67c5582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b475175ca4ea4a3391f5b4a31190b48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:34.597430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115cfa-63b6-4728-9dbb-54c4ecf87ba8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:34.598509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115cfa-63b6-4728-9dbb-54c4ecf87ba8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:34.599200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115cfa-63b6-4728-9dbb-54c4ecf87ba8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] PATH_INFO: `/v3/users/c638561bc1e443b282b3e9c3b67c5582/password` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:34.602304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a889d6-6018-490b-a4ce-00b1a420678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:34.603334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a889d6-6018-490b-a4ce-00b1a420678d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:34.603947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a889d6-6018-490b-a4ce-00b1a420678d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:34.604411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a889d6-6018-490b-a4ce-00b1a420678d admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:34.605381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a889d6-6018-490b-a4ce-00b1a420678d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:34.608894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a889d6-6018-490b-a4ce-00b1a420678d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:34.726131 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2117/4210] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:34 2022] POST /identity/v3/projects => generated 389 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:34.731034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a889d6-6018-490b-a4ce-00b1a420678d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:34.783269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d115cfa-63b6-4728-9dbb-54c4ecf87ba8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:34.815993 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2094/4211] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:06:34 2022] POST /identity/v3/users/c638561bc1e443b282b3e9c3b67c5582/password => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:34.962478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a889d6-6018-490b-a4ce-00b1a420678d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:35.002180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b10e6-f5b9-4de2-b362-d934802921d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:35.016689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b10e6-f5b9-4de2-b362-d934802921d2 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:35.017156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b10e6-f5b9-4de2-b362-d934802921d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:35.017662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b10e6-f5b9-4de2-b362-d934802921d2 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:35.018784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b10e6-f5b9-4de2-b362-d934802921d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:35.048455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b10e6-f5b9-4de2-b362-d934802921d2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:35.190435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d115cfa-63b6-4728-9dbb-54c4ecf87ba8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:35.206662 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2118/4212] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:06:34 2022] POST /identity/v3/users => generated 295 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:35.251541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d115cfa-63b6-4728-9dbb-54c4ecf87ba8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:35.280576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fff366-5bbb-4e5a-9b35-6066aab14ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:35.284415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fff366-5bbb-4e5a-9b35-6066aab14ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:35.291373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fff366-5bbb-4e5a-9b35-6066aab14ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:35.292772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fff366-5bbb-4e5a-9b35-6066aab14ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:35.296076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fff366-5bbb-4e5a-9b35-6066aab14ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:35.313835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fff366-5bbb-4e5a-9b35-6066aab14ab4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:35.368856 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2095/4213] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:35.374308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b10e6-f5b9-4de2-b362-d934802921d2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:35.400832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:35.409543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b10e6-f5b9-4de2-b362-d934802921d2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:35.425091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f5f1e-fe7e-4f13-b4db-5d36a921b6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:35.426390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f5f1e-fe7e-4f13-b4db-5d36a921b6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:35.427043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f5f1e-fe7e-4f13-b4db-5d36a921b6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:35.427671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f5f1e-fe7e-4f13-b4db-5d36a921b6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:35.429072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f5f1e-fe7e-4f13-b4db-5d36a921b6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:35.432606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f5f1e-fe7e-4f13-b4db-5d36a921b6c8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:35.497818 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2119/4214] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:35.499557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fff366-5bbb-4e5a-9b35-6066aab14ab4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:35.504846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:35.514881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fff366-5bbb-4e5a-9b35-6066aab14ab4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:35.534814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece56aaa-6dde-4caf-8e5a-f22563d5a09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:35.535486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece56aaa-6dde-4caf-8e5a-f22563d5a09c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:35.535771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece56aaa-6dde-4caf-8e5a-f22563d5a09c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:35.536051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece56aaa-6dde-4caf-8e5a-f22563d5a09c admin admin] PATH_INFO: `/v3/projects/6aa299e3b5df41429787365c80c28be2/users/1a561700ae4f44e59b3dd81c136447d1/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:35.586012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece56aaa-6dde-4caf-8e5a-f22563d5a09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa299e3b5df41429787365c80c28be2, user_id=1a561700ae4f44e59b3dd81c136447d1, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:35.593800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece56aaa-6dde-4caf-8e5a-f22563d5a09c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:35.627591 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2096/4215] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:35 2022] PUT /identity/v3/projects/6aa299e3b5df41429787365c80c28be2/users/1a561700ae4f44e59b3dd81c136447d1/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:35.628615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3c70b-b688-4bdc-8f1d-061e94f7e7a5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:35.629078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3c70b-b688-4bdc-8f1d-061e94f7e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:35.629216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3c70b-b688-4bdc-8f1d-061e94f7e7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:35.675747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-99b3c70b-b688-4bdc-8f1d-061e94f7e7a5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:35.676997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-99b3c70b-b688-4bdc-8f1d-061e94f7e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:35.822586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d81574-7dd3-4c32-8f55-9f2acfafe6e5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:35.822859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d81574-7dd3-4c32-8f55-9f2acfafe6e5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:35.823410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d81574-7dd3-4c32-8f55-9f2acfafe6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:35.838316 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2120/4216] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:35.880816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c1d81574-7dd3-4c32-8f55-9f2acfafe6e5 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:35.887667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c1d81574-7dd3-4c32-8f55-9f2acfafe6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:35.908856 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2097/4217] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:35 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:35.913435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dca597-5e41-4c8c-90ab-ce701d94fab4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:35.913968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dca597-5e41-4c8c-90ab-ce701d94fab4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:35.914409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dca597-5e41-4c8c-90ab-ce701d94fab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:35.957101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c8dca597-5e41-4c8c-90ab-ce701d94fab4 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:35.960673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c8dca597-5e41-4c8c-90ab-ce701d94fab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:36.064842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d81574-7dd3-4c32-8f55-9f2acfafe6e5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:36.066409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c1d81574-7dd3-4c32-8f55-9f2acfafe6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:36.115477 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2121/4218] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:36.120363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dca597-5e41-4c8c-90ab-ce701d94fab4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:36.142658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dca597-5e41-4c8c-90ab-ce701d94fab4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:36.166775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07665a-99fe-4641-b1e8-bb89dcb025c8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c638561bc1e443b282b3e9c3b67c5582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b475175ca4ea4a3391f5b4a31190b48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:36.167219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07665a-99fe-4641-b1e8-bb89dcb025c8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:36.167504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07665a-99fe-4641-b1e8-bb89dcb025c8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:36.167787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07665a-99fe-4641-b1e8-bb89dcb025c8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] PATH_INFO: `/v3/users/c638561bc1e443b282b3e9c3b67c5582/password` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:36.225235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d81574-7dd3-4c32-8f55-9f2acfafe6e5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:36.255717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0a07665a-99fe-4641-b1e8-bb89dcb025c8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:36.257287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e1db9-d503-4b7f-bdf3-20f5c3132c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:36.262625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e1db9-d503-4b7f-bdf3-20f5c3132c65 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:36.264661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e1db9-d503-4b7f-bdf3-20f5c3132c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:36.266365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e1db9-d503-4b7f-bdf3-20f5c3132c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:36.286214 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2122/4219] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:06:36 2022] POST /identity/v3/users/c638561bc1e443b282b3e9c3b67c5582/password => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:36.321509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e1db9-d503-4b7f-bdf3-20f5c3132c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:36.323031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e1db9-d503-4b7f-bdf3-20f5c3132c65 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:36.374921 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2098/4220] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:06:36.542119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07665a-99fe-4641-b1e8-bb89dcb025c8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:36.545461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0a07665a-99fe-4641-b1e8-bb89dcb025c8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:36.568894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07665a-99fe-4641-b1e8-bb89dcb025c8 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:36.573889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:36.574604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:36.574887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:36.575160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051 admin admin] PATH_INFO: `/v3/projects/081bbe524ba84369944f20b4d86f21dc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:36.576919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=081bbe524ba84369944f20b4d86f21dc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:36.579079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:36.707054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '081bbe524ba84369944f20b4d86f21dc', 'request_id': 'req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:36.733105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '081bbe524ba84369944f20b4d86f21dc', 'request_id': 'req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:36.736019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=8 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:36.746014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '081bbe524ba84369944f20b4d86f21dc', 'request_id': 'req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:36.774766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051 admin admin] The token cache is being invalidate because project 081bbe524ba84369944f20b4d86f21dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:06:36.775936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:36.777941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6a0c56f4-4c9c-470f-8348-b0f9d1feb051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:36.784864 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2123/4221] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:06:36 2022] DELETE /identity/v3/projects/081bbe524ba84369944f20b4d86f21dc => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:36.787273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddbdb8-145c-45df-8fec-4976ee04a84e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:36.787764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddbdb8-145c-45df-8fec-4976ee04a84e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:36.788033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddbdb8-145c-45df-8fec-4976ee04a84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:36.820647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e9ddbdb8-145c-45df-8fec-4976ee04a84e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:36.822314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e9ddbdb8-145c-45df-8fec-4976ee04a84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:36.958952 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2099/4222] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:36.966247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae72d2-6cf8-4af7-9a34-5ec8fe72669c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:36.966562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae72d2-6cf8-4af7-9a34-5ec8fe72669c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:36.966867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae72d2-6cf8-4af7-9a34-5ec8fe72669c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:37.017978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-84ae72d2-6cf8-4af7-9a34-5ec8fe72669c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:37.021978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-84ae72d2-6cf8-4af7-9a34-5ec8fe72669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:37.047754 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2124/4223] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:37.048940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddbdb8-145c-45df-8fec-4976ee04a84e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:37.062623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddbdb8-145c-45df-8fec-4976ee04a84e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:37.074714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff801b-f9f5-4e95-b023-ae188976a3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:37.075753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff801b-f9f5-4e95-b023-ae188976a3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:37.076296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff801b-f9f5-4e95-b023-ae188976a3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:37.077574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff801b-f9f5-4e95-b023-ae188976a3d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:37.078672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff801b-f9f5-4e95-b023-ae188976a3d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:06:37.081047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff801b-f9f5-4e95-b023-ae188976a3d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:37.090636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff801b-f9f5-4e95-b023-ae188976a3d5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:37.125598 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2100/4224] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:06:37.129889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae72d2-6cf8-4af7-9a34-5ec8fe72669c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:37.145606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae72d2-6cf8-4af7-9a34-5ec8fe72669c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:37.156856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcc25f-3720-467b-975c-e7efaab892b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:37.159199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcc25f-3720-467b-975c-e7efaab892b0 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:37.159489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcc25f-3720-467b-975c-e7efaab892b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:37.159756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcc25f-3720-467b-975c-e7efaab892b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:37.161780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcc25f-3720-467b-975c-e7efaab892b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:37.167894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcc25f-3720-467b-975c-e7efaab892b0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:37.241801 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2125/4225] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:06:37 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:06:37.250690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff801b-f9f5-4e95-b023-ae188976a3d5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:37.275704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff801b-f9f5-4e95-b023-ae188976a3d5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:37.291048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061634d3-14c1-41af-86c3-7f2eb65881db None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:37.294621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061634d3-14c1-41af-86c3-7f2eb65881db None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:37.295717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061634d3-14c1-41af-86c3-7f2eb65881db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:37.393817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-061634d3-14c1-41af-86c3-7f2eb65881db None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:37.402924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-061634d3-14c1-41af-86c3-7f2eb65881db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:37.460220 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2126/4226] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:37 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 21:06:37.461635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f8f11-c224-428f-97d6-7f1e123dd3e1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:37.461921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f8f11-c224-428f-97d6-7f1e123dd3e1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:37.470522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f8f11-c224-428f-97d6-7f1e123dd3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:37.529893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74610934-3293-4274-87ae-5cc0abd1fea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:37.530693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74610934-3293-4274-87ae-5cc0abd1fea6 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:37.532181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74610934-3293-4274-87ae-5cc0abd1fea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:37.532456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74610934-3293-4274-87ae-5cc0abd1fea6 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:37.535560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74610934-3293-4274-87ae-5cc0abd1fea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:37.544278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74610934-3293-4274-87ae-5cc0abd1fea6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:37.580547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:37.583480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-607f8f11-c224-428f-97d6-7f1e123dd3e1 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:37.584894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-607f8f11-c224-428f-97d6-7f1e123dd3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:37.625466 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2101/4227] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:06:37 2022] POST /identity/v3/users => generated 302 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:06:37.629533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74610934-3293-4274-87ae-5cc0abd1fea6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:37.663949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74610934-3293-4274-87ae-5cc0abd1fea6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:37.674604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82f036-dbd0-4c8c-9a74-88827c3cefc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:37.675869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82f036-dbd0-4c8c-9a74-88827c3cefc4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:37.676062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82f036-dbd0-4c8c-9a74-88827c3cefc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:37.678122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82f036-dbd0-4c8c-9a74-88827c3cefc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:37.678785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82f036-dbd0-4c8c-9a74-88827c3cefc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:37.683182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82f036-dbd0-4c8c-9a74-88827c3cefc4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:37.756357 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2102/4228] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:37.759171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82f036-dbd0-4c8c-9a74-88827c3cefc4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:37.820367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82f036-dbd0-4c8c-9a74-88827c3cefc4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:37.873436 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2127/4229] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:37.877821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc498-2628-490f-9614-98a184a000e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:37.879129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f8f11-c224-428f-97d6-7f1e123dd3e1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:37.879948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc498-2628-490f-9614-98a184a000e2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:37.883119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc498-2628-490f-9614-98a184a000e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:37.885920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc498-2628-490f-9614-98a184a000e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:37.886730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edc498-2628-490f-9614-98a184a000e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:37.897601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edc498-2628-490f-9614-98a184a000e2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:37.909969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f8f11-c224-428f-97d6-7f1e123dd3e1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:37.921577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be60539-65c9-49a0-ae58-648f5eaa63f6 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c638561bc1e443b282b3e9c3b67c5582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b475175ca4ea4a3391f5b4a31190b48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:37.922782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be60539-65c9-49a0-ae58-648f5eaa63f6 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:37.923423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be60539-65c9-49a0-ae58-648f5eaa63f6 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:37.923889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be60539-65c9-49a0-ae58-648f5eaa63f6 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] PATH_INFO: `/v3/users/c638561bc1e443b282b3e9c3b67c5582/password` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:37.950937 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2103/4230] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:06:37.958165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc498-2628-490f-9614-98a184a000e2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:38.026463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc498-2628-490f-9614-98a184a000e2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:38.093597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9be60539-65c9-49a0-ae58-648f5eaa63f6 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:38.098631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190bb01-5fd1-4cbe-ab31-638c7d00cd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:38.102030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190bb01-5fd1-4cbe-ab31-638c7d00cd93 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:38.103243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190bb01-5fd1-4cbe-ab31-638c7d00cd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:38.104233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190bb01-5fd1-4cbe-ab31-638c7d00cd93 admin admin] PATH_INFO: `/v3/projects/b96051fc89de47e1b636dcb23b6fdc30/users/751127bd91a24297b248f59af3e069d4/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:38.121642 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2128/4231] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:06:37 2022] POST /identity/v3/users/c638561bc1e443b282b3e9c3b67c5582/password => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:38.163184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190bb01-5fd1-4cbe-ab31-638c7d00cd93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96051fc89de47e1b636dcb23b6fdc30, user_id=751127bd91a24297b248f59af3e069d4, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:38.171359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190bb01-5fd1-4cbe-ab31-638c7d00cd93 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:38.211689 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2104/4232] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:06:37 2022] PUT /identity/v3/projects/b96051fc89de47e1b636dcb23b6fdc30/users/751127bd91a24297b248f59af3e069d4/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:38.220681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3ae53-b8b7-47c6-b22b-04b51f42f062 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:38.220960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3ae53-b8b7-47c6-b22b-04b51f42f062 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:38.221260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3ae53-b8b7-47c6-b22b-04b51f42f062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:38.342631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-76d3ae53-b8b7-47c6-b22b-04b51f42f062 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:38.343888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-76d3ae53-b8b7-47c6-b22b-04b51f42f062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:38.589138 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2129/4233] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:38.669286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190bb01-5fd1-4cbe-ab31-638c7d00cd93 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:38.671904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0190bb01-5fd1-4cbe-ab31-638c7d00cd93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:38.850807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190bb01-5fd1-4cbe-ab31-638c7d00cd93 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:38.860313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad321f4-3ea9-46b0-ad41-b776eca45445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:38.861100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad321f4-3ea9-46b0-ad41-b776eca45445 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:38.862052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad321f4-3ea9-46b0-ad41-b776eca45445 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:38.862345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad321f4-3ea9-46b0-ad41-b776eca45445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:38.890672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad321f4-3ea9-46b0-ad41-b776eca45445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:38.893367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad321f4-3ea9-46b0-ad41-b776eca45445 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:38.922894 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2105/4234] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:39.128039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39c51a-e5da-441c-a2c6-23682358ac60 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:39.128619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39c51a-e5da-441c-a2c6-23682358ac60 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:39.129384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39c51a-e5da-441c-a2c6-23682358ac60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:39.205887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fd4cd-0cb1-4e1e-8994-880840025782 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:39.206567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fd4cd-0cb1-4e1e-8994-880840025782 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:39.207201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fd4cd-0cb1-4e1e-8994-880840025782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:39.210535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ff39c51a-e5da-441c-a2c6-23682358ac60 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:39.215733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ff39c51a-e5da-441c-a2c6-23682358ac60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:39.229876 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2130/4235] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:39 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:39.240313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bc6b3-faff-4242-909d-160794406169 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:39.240794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bc6b3-faff-4242-909d-160794406169 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:39.241522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bc6b3-faff-4242-909d-160794406169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:39.244365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5a5fd4cd-0cb1-4e1e-8994-880840025782 None None] MFA Rules not processed for user `dcad18d0243f492591808197ca3dcc81`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:39.246120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5a5fd4cd-0cb1-4e1e-8994-880840025782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:39.283297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-677bc6b3-faff-4242-909d-160794406169 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:39.284875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-677bc6b3-faff-4242-909d-160794406169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:39.311405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:39.370915 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2106/4236] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:39.423936 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2131/4237] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:39.430048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fd4cd-0cb1-4e1e-8994-880840025782 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:39.448747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fd4cd-0cb1-4e1e-8994-880840025782 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:39.472551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80029f-4b28-4ddc-acd7-60e5b7d9ef08 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c638561bc1e443b282b3e9c3b67c5582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b475175ca4ea4a3391f5b4a31190b48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:39.473324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80029f-4b28-4ddc-acd7-60e5b7d9ef08 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:39.479892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80029f-4b28-4ddc-acd7-60e5b7d9ef08 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:39.479892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80029f-4b28-4ddc-acd7-60e5b7d9ef08 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] PATH_INFO: `/v3/users/c638561bc1e443b282b3e9c3b67c5582/password` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:39.659321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cf80029f-4b28-4ddc-acd7-60e5b7d9ef08 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:39.696815 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2107/4238] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:06:39 2022] POST /identity/v3/users/c638561bc1e443b282b3e9c3b67c5582/password => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:40.704316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef6891-0010-4f9b-beeb-3995e7321e19 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:40.704894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef6891-0010-4f9b-beeb-3995e7321e19 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:40.704894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef6891-0010-4f9b-beeb-3995e7321e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:40.757960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-59ef6891-0010-4f9b-beeb-3995e7321e19 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:40.761422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-59ef6891-0010-4f9b-beeb-3995e7321e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:40.782008 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2132/4239] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:40 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:41.784977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e9351-aa38-4547-8137-9b41b53313ec None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:41.785574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e9351-aa38-4547-8137-9b41b53313ec None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:41.785574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e9351-aa38-4547-8137-9b41b53313ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:41.824278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ac9e9351-aa38-4547-8137-9b41b53313ec None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:41.825533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ac9e9351-aa38-4547-8137-9b41b53313ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:41.845131 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2108/4240] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:41.851297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea258da-c1de-45db-a87a-d4ef464e69d5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:41.851837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea258da-c1de-45db-a87a-d4ef464e69d5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:41.851952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea258da-c1de-45db-a87a-d4ef464e69d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:41.901884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-aea258da-c1de-45db-a87a-d4ef464e69d5 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:41.904371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-aea258da-c1de-45db-a87a-d4ef464e69d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:41.921389 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2133/4241] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:41 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:41.922953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c2feb-9a44-497b-979f-56a2c7446361 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:41.923230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c2feb-9a44-497b-979f-56a2c7446361 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:41.923707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c2feb-9a44-497b-979f-56a2c7446361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:41.985222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=5,keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:42.083210 ncdv-master-1 devstack@keystone.service[99084]: WARNING keystone.server.flask.application [None req-a40c2feb-9a44-497b-979f-56a2c7446361 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.26: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 08 21:06:42.086018 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2109/4242] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:41 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 164 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 08 21:06:42.089641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599b666-5968-40a4-9b99-4cccccc3abf8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:42.089905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599b666-5968-40a4-9b99-4cccccc3abf8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:42.090354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599b666-5968-40a4-9b99-4cccccc3abf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:42.173709 ncdv-master-1 devstack@keystone.service[99085]: WARNING keystone.server.flask.application [None req-4599b666-5968-40a4-9b99-4cccccc3abf8 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.26: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 08 21:06:42.176671 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2134/4243] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:42 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 87 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 08 21:06:42.180281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a0870-c49b-439f-8dba-8510cc8b8e01 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:42.180571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a0870-c49b-439f-8dba-8510cc8b8e01 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:42.180852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a0870-c49b-439f-8dba-8510cc8b8e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:42.246305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599b666-5968-40a4-9b99-4cccccc3abf8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:42.249512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4599b666-5968-40a4-9b99-4cccccc3abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:42.283138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599b666-5968-40a4-9b99-4cccccc3abf8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:42.286658 ncdv-master-1 devstack@keystone.service[99084]: WARNING keystone.server.flask.application [None req-df7a0870-c49b-439f-8dba-8510cc8b8e01 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.26: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 08 21:06:42.288096 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2110/4244] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:42 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 109 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 08 21:06:42.312338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad3be3-3d8d-4e04-8c0c-e0bffc9da054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:42.314132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad3be3-3d8d-4e04-8c0c-e0bffc9da054 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:42.314435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad3be3-3d8d-4e04-8c0c-e0bffc9da054 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:42.314719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad3be3-3d8d-4e04-8c0c-e0bffc9da054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:42.323063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1dad3be3-3d8d-4e04-8c0c-e0bffc9da054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:42.503720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad3be3-3d8d-4e04-8c0c-e0bffc9da054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:42.505743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad3be3-3d8d-4e04-8c0c-e0bffc9da054 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:42.535333 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2135/4245] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:44.749575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a0870-c49b-439f-8dba-8510cc8b8e01 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:44.766144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a0870-c49b-439f-8dba-8510cc8b8e01 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:44.773634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42ae57-1094-420c-984d-f6bfc8e6eb31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:44.774543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42ae57-1094-420c-984d-f6bfc8e6eb31 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:44.775035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42ae57-1094-420c-984d-f6bfc8e6eb31 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:44.775622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42ae57-1094-420c-984d-f6bfc8e6eb31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:44.785750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1e42ae57-1094-420c-984d-f6bfc8e6eb31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:44.836404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42ae57-1094-420c-984d-f6bfc8e6eb31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:44.838377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42ae57-1094-420c-984d-f6bfc8e6eb31 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:44.876537 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2111/4246] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:06:50.207946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544738cf-3ef5-4e62-a729-f0091734e029 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:50.208840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544738cf-3ef5-4e62-a729-f0091734e029 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:50.209329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544738cf-3ef5-4e62-a729-f0091734e029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:50.230004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-544738cf-3ef5-4e62-a729-f0091734e029 None None] MFA Rules not processed for user `06443b5728fb4d1e95d6245820e786bf`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:50.231499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-544738cf-3ef5-4e62-a729-f0091734e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:50.343311 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2136/4247] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:52.725394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44741d02-9c8a-4b34-902f-9bdb88d83121 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:52.725965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44741d02-9c8a-4b34-902f-9bdb88d83121 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:52.725965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44741d02-9c8a-4b34-902f-9bdb88d83121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:52.798872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-44741d02-9c8a-4b34-902f-9bdb88d83121 None None] MFA Rules not processed for user `751127bd91a24297b248f59af3e069d4`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:52.803091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-44741d02-9c8a-4b34-902f-9bdb88d83121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:53.037131 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2112/4248] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:53.302637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d17c7-1ae0-434a-9b0d-513784ddbbc2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:53.303198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d17c7-1ae0-434a-9b0d-513784ddbbc2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:53.303198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d17c7-1ae0-434a-9b0d-513784ddbbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:53.396091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:53.453342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cc2d17c7-1ae0-434a-9b0d-513784ddbbc2 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:53.471076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cc2d17c7-1ae0-434a-9b0d-513784ddbbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:53.494975 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2137/4249] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:53 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:53.500804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44741d02-9c8a-4b34-902f-9bdb88d83121 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:53.518125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44741d02-9c8a-4b34-902f-9bdb88d83121 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:53.525377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fbfa6-951c-4ffb-aa36-21d60b73834b tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c638561bc1e443b282b3e9c3b67c5582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b475175ca4ea4a3391f5b4a31190b48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:53.526455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fbfa6-951c-4ffb-aa36-21d60b73834b tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:53.526980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fbfa6-951c-4ffb-aa36-21d60b73834b tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:53.527418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fbfa6-951c-4ffb-aa36-21d60b73834b tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] PATH_INFO: `/v3/users/c638561bc1e443b282b3e9c3b67c5582/password` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:53.676361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d17c7-1ae0-434a-9b0d-513784ddbbc2 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:53.678056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cc2d17c7-1ae0-434a-9b0d-513784ddbbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:53.707460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d17c7-1ae0-434a-9b0d-513784ddbbc2 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:53.728311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9229500-0e3b-40d2-a36b-abd122cc8a56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:53.729160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9229500-0e3b-40d2-a36b-abd122cc8a56 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:53.729388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9229500-0e3b-40d2-a36b-abd122cc8a56 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:53.729881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9229500-0e3b-40d2-a36b-abd122cc8a56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:53.740960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9229500-0e3b-40d2-a36b-abd122cc8a56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:53.742842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9229500-0e3b-40d2-a36b-abd122cc8a56 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:53.757173 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2138/4250] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:53 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:53.773044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b46fbfa6-951c-4ffb-aa36-21d60b73834b tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:53.804460 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2113/4251] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:06:53 2022] POST /identity/v3/users/c638561bc1e443b282b3e9c3b67c5582/password => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:54.808369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a9b5-6b95-40a2-bbf4-b6e53b08b43e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:54.808939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a9b5-6b95-40a2-bbf4-b6e53b08b43e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:54.810386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a9b5-6b95-40a2-bbf4-b6e53b08b43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:54.890020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3390a9b5-6b95-40a2-bbf4-b6e53b08b43e None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:54.891639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3390a9b5-6b95-40a2-bbf4-b6e53b08b43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:54.898109 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2139/4252] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:54 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:54.902572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ee68e-f399-4857-95b2-176f0b5e2406 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:54.903545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ee68e-f399-4857-95b2-176f0b5e2406 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:54.904816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ee68e-f399-4857-95b2-176f0b5e2406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-e80ee68e-f399-4857-95b2-176f0b5e2406 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 08 21:06:54.984427 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:06:54.985892 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:06:54.987496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 08 21:06:54.987496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 08 21:06:54.987496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:06:54.987496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:06:54.987496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 08 21:06:54.987496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 08 21:06:54.987496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:06:54.987496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:06:54.987496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 08 21:06:54.987496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 08 21:06:54.987496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 08 21:06:54.987496 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:06:54.991163 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2114/4253] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:54 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 21:06:54.996966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8437-4693-468b-8148-3fe899946a47 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:54.997406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8437-4693-468b-8148-3fe899946a47 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:54.997754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8437-4693-468b-8148-3fe899946a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:55.143084 ncdv-master-1 devstack@keystone.service[99085]: WARNING keystone.server.flask.application [None req-fe1c8437-4693-468b-8148-3fe899946a47 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.26: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 08 21:06:55.148070 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2140/4254] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:54 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 153 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 08 21:06:55.150078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df1d43-72b6-4e76-83cb-1bb2e8f43aa8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:55.150303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df1d43-72b6-4e76-83cb-1bb2e8f43aa8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:55.150642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df1d43-72b6-4e76-83cb-1bb2e8f43aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:55.290733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b9df1d43-72b6-4e76-83cb-1bb2e8f43aa8 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:55.298662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b9df1d43-72b6-4e76-83cb-1bb2e8f43aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:55.348668 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2115/4255] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:55.349626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c8437-4693-468b-8148-3fe899946a47 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:55.387207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c8437-4693-468b-8148-3fe899946a47 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:55.400454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9df78-7ebe-4d22-9a8d-790eb10562ff tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c638561bc1e443b282b3e9c3b67c5582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b475175ca4ea4a3391f5b4a31190b48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:55.401579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9df78-7ebe-4d22-9a8d-790eb10562ff tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:55.404872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9df78-7ebe-4d22-9a8d-790eb10562ff tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:55.405531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9df78-7ebe-4d22-9a8d-790eb10562ff tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] PATH_INFO: `/v3/users/c638561bc1e443b282b3e9c3b67c5582/password` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:55.609761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6af9df78-7ebe-4d22-9a8d-790eb10562ff tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:55.632412 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2141/4256] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:06:55 2022] POST /identity/v3/users/c638561bc1e443b282b3e9c3b67c5582/password => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:06:55.996947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5dfb3-1e8d-431c-b93b-4a223d93ee38 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:55.997487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5dfb3-1e8d-431c-b93b-4a223d93ee38 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:55.997758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5dfb3-1e8d-431c-b93b-4a223d93ee38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:56.095453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c2e5dfb3-1e8d-431c-b93b-4a223d93ee38 None None] MFA Rules not processed for user `1a561700ae4f44e59b3dd81c136447d1`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:56.096701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c2e5dfb3-1e8d-431c-b93b-4a223d93ee38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:56.267457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:UPDATE=3,keystone:INSERT=2,keystone:DELETE=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:56.316497 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2116/4257] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:56.637594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3205cf-038d-41a3-9a21-e9b253ca3fa6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:56.638732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3205cf-038d-41a3-9a21-e9b253ca3fa6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:56.638732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3205cf-038d-41a3-9a21-e9b253ca3fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:56.695248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8e3205cf-038d-41a3-9a21-e9b253ca3fa6 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:56.699412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8e3205cf-038d-41a3-9a21-e9b253ca3fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:56.703643 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2142/4258] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:56 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:56.708545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca7734-dcd7-47e6-8ccc-53e8de7d26aa None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:56.709075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca7734-dcd7-47e6-8ccc-53e8de7d26aa None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:56.709576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca7734-dcd7-47e6-8ccc-53e8de7d26aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:56.774229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-21ca7734-dcd7-47e6-8ccc-53e8de7d26aa None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:56.777074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-21ca7734-dcd7-47e6-8ccc-53e8de7d26aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:56.788957 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2117/4259] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:06:56.793847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3205cf-038d-41a3-9a21-e9b253ca3fa6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:56.814966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3205cf-038d-41a3-9a21-e9b253ca3fa6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:56.828815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da018005-290d-4e78-9609-795ca13c1ea7 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c638561bc1e443b282b3e9c3b67c5582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b475175ca4ea4a3391f5b4a31190b48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:56.830660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da018005-290d-4e78-9609-795ca13c1ea7 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:56.831364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da018005-290d-4e78-9609-795ca13c1ea7 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:56.832174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da018005-290d-4e78-9609-795ca13c1ea7 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] PATH_INFO: `/v3/users/c638561bc1e443b282b3e9c3b67c5582/password` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:56.932737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-da018005-290d-4e78-9609-795ca13c1ea7 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:56.984071 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2143/4260] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:06:56 2022] POST /identity/v3/users/c638561bc1e443b282b3e9c3b67c5582/password => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:06:57.253922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca7734-dcd7-47e6-8ccc-53e8de7d26aa None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:57.285856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca7734-dcd7-47e6-8ccc-53e8de7d26aa None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:57.304630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8eafd-f504-4ce5-a056-81d5e1aca14b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:57.306905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8eafd-f504-4ce5-a056-81d5e1aca14b service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:57.309715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8eafd-f504-4ce5-a056-81d5e1aca14b service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:57.309984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8eafd-f504-4ce5-a056-81d5e1aca14b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:57.346041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8eafd-f504-4ce5-a056-81d5e1aca14b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:57.347772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8eafd-f504-4ce5-a056-81d5e1aca14b service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:57.370853 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2118/4261] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:57.792125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da018005-290d-4e78-9609-795ca13c1ea7 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:57.813767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da018005-290d-4e78-9609-795ca13c1ea7 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:57.818734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449459a5-b0d0-4c3c-9b49-bb7787066e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:57.821718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449459a5-b0d0-4c3c-9b49-bb7787066e47 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:57.822217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449459a5-b0d0-4c3c-9b49-bb7787066e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:57.822731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449459a5-b0d0-4c3c-9b49-bb7787066e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:57.831172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-449459a5-b0d0-4c3c-9b49-bb7787066e47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:57.890380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449459a5-b0d0-4c3c-9b49-bb7787066e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:06:57.903520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449459a5-b0d0-4c3c-9b49-bb7787066e47 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:06:57.951896 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2144/4262] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:06:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:06:57.988141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d4782-aaed-4fcf-aeab-349f8844b1a5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:57.988771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d4782-aaed-4fcf-aeab-349f8844b1a5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:57.989294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d4782-aaed-4fcf-aeab-349f8844b1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:58.036237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b98d4782-aaed-4fcf-aeab-349f8844b1a5 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:58.041965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b98d4782-aaed-4fcf-aeab-349f8844b1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:58.050623 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2119/4263] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:57 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:58.068309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84515d5-01b4-4dbe-9fc9-d62f2338e537 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:58.071042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84515d5-01b4-4dbe-9fc9-d62f2338e537 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:58.071791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84515d5-01b4-4dbe-9fc9-d62f2338e537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:58.112430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e84515d5-01b4-4dbe-9fc9-d62f2338e537 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:58.114255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e84515d5-01b4-4dbe-9fc9-d62f2338e537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:58.136639 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2145/4264] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:06:58.141266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d4782-aaed-4fcf-aeab-349f8844b1a5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:06:58.163066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d4782-aaed-4fcf-aeab-349f8844b1a5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:06:58.168459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89886015-acf0-4e61-8910-6e2e8cf3cbe9 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c638561bc1e443b282b3e9c3b67c5582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b475175ca4ea4a3391f5b4a31190b48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:06:58.169987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89886015-acf0-4e61-8910-6e2e8cf3cbe9 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:58.170499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89886015-acf0-4e61-8910-6e2e8cf3cbe9 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:58.171006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89886015-acf0-4e61-8910-6e2e8cf3cbe9 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] PATH_INFO: `/v3/users/c638561bc1e443b282b3e9c3b67c5582/password` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:58.322613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-89886015-acf0-4e61-8910-6e2e8cf3cbe9 tempest-IdentityV3UsersTest-1621867317 tempest-IdentityV3UsersTest-1621867317-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:06:58.375551 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2120/4265] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:06:58 2022] POST /identity/v3/users/c638561bc1e443b282b3e9c3b67c5582/password => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:06:59.380199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9b44-c16b-4ac1-9870-a2ef7bee22aa None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:06:59.381345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9b44-c16b-4ac1-9870-a2ef7bee22aa None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:06:59.381782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9b44-c16b-4ac1-9870-a2ef7bee22aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:06:59.436670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-384e9b44-c16b-4ac1-9870-a2ef7bee22aa None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:06:59.438179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-384e9b44-c16b-4ac1-9870-a2ef7bee22aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:06:59.458974 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2146/4266] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:06:59 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:07:00.464428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382210a-1b59-43d9-87ba-e6a80d3eb2b7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:00.465480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382210a-1b59-43d9-87ba-e6a80d3eb2b7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:00.465938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382210a-1b59-43d9-87ba-e6a80d3eb2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:00.531731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7382210a-1b59-43d9-87ba-e6a80d3eb2b7 None None] MFA Rules not processed for user `c638561bc1e443b282b3e9c3b67c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:00.534383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7382210a-1b59-43d9-87ba-e6a80d3eb2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:00.552418 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2121/4267] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:00.558344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e9b44-c16b-4ac1-9870-a2ef7bee22aa None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:00.561716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-384e9b44-c16b-4ac1-9870-a2ef7bee22aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:00.584107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e9b44-c16b-4ac1-9870-a2ef7bee22aa None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:00.590689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:00.593507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:00.594003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:00.594468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] PATH_INFO: `/v3/users/c638561bc1e443b282b3e9c3b67c5582` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:00.600474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c638561bc1e443b282b3e9c3b67c5582)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:00.603898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:00.709681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:00.720577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:00.725919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:00.726614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:00.739697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=12 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:00.776199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c638561bc1e443b282b3e9c3b67c5582'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:00.818467 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2147/4268] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:07:00 2022] DELETE /identity/v3/users/c638561bc1e443b282b3e9c3b67c5582 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:00.824008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f808-0243-449f-a4e1-12cbca254562 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:00.824552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f808-0243-449f-a4e1-12cbca254562 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:00.824989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f808-0243-449f-a4e1-12cbca254562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:00.855007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a199f808-0243-449f-a4e1-12cbca254562 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:00.857035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a199f808-0243-449f-a4e1-12cbca254562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:01.034162 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2122/4269] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:01.069788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:01.071696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:01.248111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf25e-4d5b-4181-8cfe-7891c71c8d1b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:01.267549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3b5ff-a453-4e3b-99bb-e8740e03ea63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:01.268346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3b5ff-a453-4e3b-99bb-e8740e03ea63 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:01.268895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3b5ff-a453-4e3b-99bb-e8740e03ea63 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:01.269921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3b5ff-a453-4e3b-99bb-e8740e03ea63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:01.293623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3b5ff-a453-4e3b-99bb-e8740e03ea63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:01.296473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3b5ff-a453-4e3b-99bb-e8740e03ea63 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:01.315252 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2148/4270] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:01.962313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199f808-0243-449f-a4e1-12cbca254562 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:01.963853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a199f808-0243-449f-a4e1-12cbca254562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:01.999526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199f808-0243-449f-a4e1-12cbca254562 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:02.017416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47b5ad-3002-4db4-8722-54559dcf4539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:02.018301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47b5ad-3002-4db4-8722-54559dcf4539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:02.018649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47b5ad-3002-4db4-8722-54559dcf4539 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:02.019038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47b5ad-3002-4db4-8722-54559dcf4539 admin admin] PATH_INFO: `/v3/projects/b475175ca4ea4a3391f5b4a31190b48e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:02.020881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47b5ad-3002-4db4-8722-54559dcf4539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b475175ca4ea4a3391f5b4a31190b48e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:02.023072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47b5ad-3002-4db4-8722-54559dcf4539 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:02.142103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1e47b5ad-3002-4db4-8722-54559dcf4539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b475175ca4ea4a3391f5b4a31190b48e', 'request_id': 'req-1e47b5ad-3002-4db4-8722-54559dcf4539'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:02.157975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1e47b5ad-3002-4db4-8722-54559dcf4539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b475175ca4ea4a3391f5b4a31190b48e', 'request_id': 'req-1e47b5ad-3002-4db4-8722-54559dcf4539'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:02.172739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1e47b5ad-3002-4db4-8722-54559dcf4539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b475175ca4ea4a3391f5b4a31190b48e', 'request_id': 'req-1e47b5ad-3002-4db4-8722-54559dcf4539'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:02.196107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1e47b5ad-3002-4db4-8722-54559dcf4539 admin admin] The token cache is being invalidate because project b475175ca4ea4a3391f5b4a31190b48e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:07:02.196734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1e47b5ad-3002-4db4-8722-54559dcf4539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:02.197715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1e47b5ad-3002-4db4-8722-54559dcf4539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:02.200463 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2123/4271] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:01 2022] DELETE /identity/v3/projects/b475175ca4ea4a3391f5b4a31190b48e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:02.206122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54a369-8b99-4e9b-b525-bf914bfbef99 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:02.207094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54a369-8b99-4e9b-b525-bf914bfbef99 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:02.207582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54a369-8b99-4e9b-b525-bf914bfbef99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:02.244713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fa54a369-8b99-4e9b-b525-bf914bfbef99 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:02.246730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fa54a369-8b99-4e9b-b525-bf914bfbef99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:02.411999 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2149/4272] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:02.422619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b52f6c-d0a9-4661-822b-8865f6007674 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:02.423348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b52f6c-d0a9-4661-822b-8865f6007674 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:02.423348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b52f6c-d0a9-4661-822b-8865f6007674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:02.464639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=9 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:02.475848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c8b52f6c-d0a9-4661-822b-8865f6007674 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:02.479196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c8b52f6c-d0a9-4661-822b-8865f6007674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:02.514951 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2124/4273] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:02.519472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54a369-8b99-4e9b-b525-bf914bfbef99 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:02.533214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54a369-8b99-4e9b-b525-bf914bfbef99 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:02.552724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150aea8-e3b1-4a8a-82b3-8c4775101925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:02.556063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150aea8-e3b1-4a8a-82b3-8c4775101925 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:02.556376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150aea8-e3b1-4a8a-82b3-8c4775101925 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:02.556656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150aea8-e3b1-4a8a-82b3-8c4775101925 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:02.561797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150aea8-e3b1-4a8a-82b3-8c4775101925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:07:02.562536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150aea8-e3b1-4a8a-82b3-8c4775101925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:02.567363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150aea8-e3b1-4a8a-82b3-8c4775101925 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:02.594539 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2150/4274] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:07:02.599228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b52f6c-d0a9-4661-822b-8865f6007674 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:02.615446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b52f6c-d0a9-4661-822b-8865f6007674 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:02.629502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57f9e6-3012-4af6-9f5d-92fd289f0d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:02.630130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57f9e6-3012-4af6-9f5d-92fd289f0d2d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:02.630411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57f9e6-3012-4af6-9f5d-92fd289f0d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:02.630671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57f9e6-3012-4af6-9f5d-92fd289f0d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:02.631311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57f9e6-3012-4af6-9f5d-92fd289f0d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:02.636389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57f9e6-3012-4af6-9f5d-92fd289f0d2d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:02.700608 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2125/4275] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:07:02 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:02.703586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150aea8-e3b1-4a8a-82b3-8c4775101925 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:02.717763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150aea8-e3b1-4a8a-82b3-8c4775101925 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:02.897273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3f19d-bf68-4077-acf3-45524f9e9937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:02.897883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3f19d-bf68-4077-acf3-45524f9e9937 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:02.898167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3f19d-bf68-4077-acf3-45524f9e9937 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:02.898449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3f19d-bf68-4077-acf3-45524f9e9937 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:02.902387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3f19d-bf68-4077-acf3-45524f9e9937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:02.907749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3f19d-bf68-4077-acf3-45524f9e9937 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:02.961700 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2151/4276] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:07:02 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:02.965810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57f9e6-3012-4af6-9f5d-92fd289f0d2d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:02.981011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57f9e6-3012-4af6-9f5d-92fd289f0d2d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:03.000439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2b76f-2c1b-4203-a503-f11959fc36e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:03.001746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2b76f-2c1b-4203-a503-f11959fc36e1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:03.002071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2b76f-2c1b-4203-a503-f11959fc36e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:03.002460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2b76f-2c1b-4203-a503-f11959fc36e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:03.003199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2b76f-2c1b-4203-a503-f11959fc36e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:03.007384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2b76f-2c1b-4203-a503-f11959fc36e1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:03.027157 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2126/4277] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:03.032333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3f19d-bf68-4077-acf3-45524f9e9937 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:03.039566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:03.045238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3f19d-bf68-4077-acf3-45524f9e9937 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:03.055596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35421c79-148b-4b7d-b7ed-120cea86ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:03.056682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35421c79-148b-4b7d-b7ed-120cea86ac9c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:03.057166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35421c79-148b-4b7d-b7ed-120cea86ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:03.057759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35421c79-148b-4b7d-b7ed-120cea86ac9c admin admin] PATH_INFO: `/v3/projects/5394261a3c2749bda1d08cf808f11bba/users/544ea5bdf2cf40d0bd05a08fc7fdd836/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:03.079013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35421c79-148b-4b7d-b7ed-120cea86ac9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5394261a3c2749bda1d08cf808f11bba, user_id=544ea5bdf2cf40d0bd05a08fc7fdd836, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:03.083168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35421c79-148b-4b7d-b7ed-120cea86ac9c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:03.102379 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2152/4278] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:07:03 2022] PUT /identity/v3/projects/5394261a3c2749bda1d08cf808f11bba/users/544ea5bdf2cf40d0bd05a08fc7fdd836/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:07:03.105881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2b76f-2c1b-4203-a503-f11959fc36e1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:03.117805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2b76f-2c1b-4203-a503-f11959fc36e1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:03.234354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9831d50-7ea6-410b-8dba-93db8ab41e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:03.235363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9831d50-7ea6-410b-8dba-93db8ab41e65 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:03.235819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9831d50-7ea6-410b-8dba-93db8ab41e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:03.236250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9831d50-7ea6-410b-8dba-93db8ab41e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:03.237401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9831d50-7ea6-410b-8dba-93db8ab41e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:03.239931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9831d50-7ea6-410b-8dba-93db8ab41e65 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:03.264613 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2127/4279] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:03.267213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35421c79-148b-4b7d-b7ed-120cea86ac9c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:03.282912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35421c79-148b-4b7d-b7ed-120cea86ac9c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:03.291201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc23cb-1777-441d-9dd4-485468be98ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:03.292028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc23cb-1777-441d-9dd4-485468be98ce admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:03.293433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc23cb-1777-441d-9dd4-485468be98ce admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:03.294653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc23cb-1777-441d-9dd4-485468be98ce admin admin] PATH_INFO: `/v3/projects/5394261a3c2749bda1d08cf808f11bba/users/544ea5bdf2cf40d0bd05a08fc7fdd836/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:03.301384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc23cb-1777-441d-9dd4-485468be98ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5394261a3c2749bda1d08cf808f11bba, user_id=544ea5bdf2cf40d0bd05a08fc7fdd836, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:03.308351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc23cb-1777-441d-9dd4-485468be98ce admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:03.334773 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2153/4280] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:07:03 2022] PUT /identity/v3/projects/5394261a3c2749bda1d08cf808f11bba/users/544ea5bdf2cf40d0bd05a08fc7fdd836/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:03.346071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10229-9566-4a4b-96b3-e34ab579301e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:03.346468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10229-9566-4a4b-96b3-e34ab579301e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:03.346858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10229-9566-4a4b-96b3-e34ab579301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:03.408395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e4b10229-9566-4a4b-96b3-e34ab579301e None None] MFA Rules not processed for user `544ea5bdf2cf40d0bd05a08fc7fdd836`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:03.411624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e4b10229-9566-4a4b-96b3-e34ab579301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:03.544637 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2128/4281] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:03.550084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc23cb-1777-441d-9dd4-485468be98ce admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:03.634432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc23cb-1777-441d-9dd4-485468be98ce admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:03.639719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7adb3-777b-4548-ab6f-376857d59ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:03.640711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7adb3-777b-4548-ab6f-376857d59ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:03.641080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7adb3-777b-4548-ab6f-376857d59ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:03.641452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7adb3-777b-4548-ab6f-376857d59ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:03.642407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7adb3-777b-4548-ab6f-376857d59ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:03.644538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7adb3-777b-4548-ab6f-376857d59ea1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:03.685233 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2154/4282] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:07:03 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:03.688754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10229-9566-4a4b-96b3-e34ab579301e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:03.722516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10229-9566-4a4b-96b3-e34ab579301e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:03.775780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:03.795546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c52f-05fc-4559-9e13-fb10693959b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:03.802055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c52f-05fc-4559-9e13-fb10693959b2 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:03.802645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c52f-05fc-4559-9e13-fb10693959b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:03.803026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c52f-05fc-4559-9e13-fb10693959b2 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:03.803920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1c52f-05fc-4559-9e13-fb10693959b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:03.806460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1c52f-05fc-4559-9e13-fb10693959b2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:03.851710 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2129/4283] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:07:03 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:07:03.855863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7adb3-777b-4548-ab6f-376857d59ea1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:03.892849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7adb3-777b-4548-ab6f-376857d59ea1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:03.913601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc72792-4ee1-4b89-93c3-8921a725dd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:03.914286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc72792-4ee1-4b89-93c3-8921a725dd68 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:03.914571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc72792-4ee1-4b89-93c3-8921a725dd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:03.914849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc72792-4ee1-4b89-93c3-8921a725dd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:03.918928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc72792-4ee1-4b89-93c3-8921a725dd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:03.921024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc72792-4ee1-4b89-93c3-8921a725dd68 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:03.939939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c52f-05fc-4559-9e13-fb10693959b2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:03.950292 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2155/4284] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:07:03.952757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c52f-05fc-4559-9e13-fb10693959b2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:04.009407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda8893-d294-402b-9adc-b0bdcba4e072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:04.016278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda8893-d294-402b-9adc-b0bdcba4e072 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:04.017011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda8893-d294-402b-9adc-b0bdcba4e072 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:04.018350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda8893-d294-402b-9adc-b0bdcba4e072 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:04.019871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda8893-d294-402b-9adc-b0bdcba4e072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:04.027792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda8893-d294-402b-9adc-b0bdcba4e072 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:04.057804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc72792-4ee1-4b89-93c3-8921a725dd68 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:04.073562 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2130/4285] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:04.074855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda8893-d294-402b-9adc-b0bdcba4e072 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:04.078797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc72792-4ee1-4b89-93c3-8921a725dd68 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:04.080578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8dda8893-d294-402b-9adc-b0bdcba4e072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:04.090286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45416501-5f8c-4f13-9685-bcc312034685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:04.094030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45416501-5f8c-4f13-9685-bcc312034685 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:04.094779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45416501-5f8c-4f13-9685-bcc312034685 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:04.096007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45416501-5f8c-4f13-9685-bcc312034685 admin admin] PATH_INFO: `/v3/projects/a38ff50be66b4314a588005c9765efc2/users/73ef90ad862a462e8e9c775f2e2accab/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:04.143622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45416501-5f8c-4f13-9685-bcc312034685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38ff50be66b4314a588005c9765efc2, user_id=73ef90ad862a462e8e9c775f2e2accab, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:04.146354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45416501-5f8c-4f13-9685-bcc312034685 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:04.175736 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2156/4286] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:07:04 2022] PUT /identity/v3/projects/a38ff50be66b4314a588005c9765efc2/users/73ef90ad862a462e8e9c775f2e2accab/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:04.186732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d9c19-7bfb-4406-8788-48440b5ef3f6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:04.187020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d9c19-7bfb-4406-8788-48440b5ef3f6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:04.187293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d9c19-7bfb-4406-8788-48440b5ef3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:04.266702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda8893-d294-402b-9adc-b0bdcba4e072 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:04.288224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-534d9c19-7bfb-4406-8788-48440b5ef3f6 None None] MFA Rules not processed for user `73ef90ad862a462e8e9c775f2e2accab`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:04.288224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-534d9c19-7bfb-4406-8788-48440b5ef3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:04.344359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2f6b4-7657-43b6-8f58-e89dceb57e7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:04.346133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2f6b4-7657-43b6-8f58-e89dceb57e7c service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:04.346525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2f6b4-7657-43b6-8f58-e89dceb57e7c service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:04.347242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2f6b4-7657-43b6-8f58-e89dceb57e7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:04.349413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9fb2f6b4-7657-43b6-8f58-e89dceb57e7c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:04.447259 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2157/4287] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:07:04.462416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d9c19-7bfb-4406-8788-48440b5ef3f6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:04.467550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-534d9c19-7bfb-4406-8788-48440b5ef3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:04.517229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d9c19-7bfb-4406-8788-48440b5ef3f6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:04.529515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd3c6c-5bd0-4b61-824b-431cc67cab99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:04.530141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3c6c-5bd0-4b61-824b-431cc67cab99 service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:04.530484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3c6c-5bd0-4b61-824b-431cc67cab99 service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:04.530821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3c6c-5bd0-4b61-824b-431cc67cab99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:04.535901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:04.546151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2f6b4-7657-43b6-8f58-e89dceb57e7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:04.547830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2f6b4-7657-43b6-8f58-e89dceb57e7c service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:04.566892 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2131/4288] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:04.650547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd3c6c-5bd0-4b61-824b-431cc67cab99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:04.655854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd3c6c-5bd0-4b61-824b-431cc67cab99 service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:04.685642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2f6b4-7657-43b6-8f58-e89dceb57e7c service glance] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:04.690640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9fb2f6b4-7657-43b6-8f58-e89dceb57e7c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:04.697853 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2158/4289] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:04.718553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:04.813773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2f6b4-7657-43b6-8f58-e89dceb57e7c service glance] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:04.824961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab4630-2cc8-4326-b73c-fb59453a7993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:04.826091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab4630-2cc8-4326-b73c-fb59453a7993 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:04.826375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab4630-2cc8-4326-b73c-fb59453a7993 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:04.826657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab4630-2cc8-4326-b73c-fb59453a7993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:04.833872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-81ab4630-2cc8-4326-b73c-fb59453a7993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:04.864679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab4630-2cc8-4326-b73c-fb59453a7993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:04.866326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab4630-2cc8-4326-b73c-fb59453a7993 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:04.886586 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2132/4290] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:05.967151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd3c6c-5bd0-4b61-824b-431cc67cab99 service glance] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:06.110479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd3c6c-5bd0-4b61-824b-431cc67cab99 service glance] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:06.116451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:06.117455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:06.117965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:06.119387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] PATH_INFO: `/v3/users/544ea5bdf2cf40d0bd05a08fc7fdd836` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:06.122571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544ea5bdf2cf40d0bd05a08fc7fdd836)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:06.124817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:06.257156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544ea5bdf2cf40d0bd05a08fc7fdd836'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:06.274943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544ea5bdf2cf40d0bd05a08fc7fdd836'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:06.276089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544ea5bdf2cf40d0bd05a08fc7fdd836'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:06.276539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544ea5bdf2cf40d0bd05a08fc7fdd836'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:06.334753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544ea5bdf2cf40d0bd05a08fc7fdd836'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:06.368704 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2159/4291] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:07:05 2022] DELETE /identity/v3/users/544ea5bdf2cf40d0bd05a08fc7fdd836 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:06.373815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a9b2-7a59-4bc8-841f-7980f19c561e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:06.374319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a9b2-7a59-4bc8-841f-7980f19c561e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:06.374429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a9b2-7a59-4bc8-841f-7980f19c561e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:06.407987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0776a9b2-7a59-4bc8-841f-7980f19c561e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:06.409625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0776a9b2-7a59-4bc8-841f-7980f19c561e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:06.486315 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2133/4292] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:06.515257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:06.517443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:06.550065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:06.623034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ad199-074b-49eb-bd4c-ced26e672d13 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:06.627451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cab327-a6fb-4d6c-b3fd-5e0fd0368f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:06.630003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cab327-a6fb-4d6c-b3fd-5e0fd0368f65 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:06.630516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cab327-a6fb-4d6c-b3fd-5e0fd0368f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:06.631289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cab327-a6fb-4d6c-b3fd-5e0fd0368f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:06.642653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cab327-a6fb-4d6c-b3fd-5e0fd0368f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:06.645363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cab327-a6fb-4d6c-b3fd-5e0fd0368f65 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:06.670072 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2160/4293] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:07.523884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776a9b2-7a59-4bc8-841f-7980f19c561e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:07.525375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0776a9b2-7a59-4bc8-841f-7980f19c561e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:07.543076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776a9b2-7a59-4bc8-841f-7980f19c561e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:07.548684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:07.549936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:07.558237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:07.558584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] PATH_INFO: `/v3/projects/5394261a3c2749bda1d08cf808f11bba` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:07.560781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] RBAC: Authorizing `identity:delete_project(project_id=5394261a3c2749bda1d08cf808f11bba)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:07.562874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:07.660167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5394261a3c2749bda1d08cf808f11bba', 'request_id': 'req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:07.676958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5394261a3c2749bda1d08cf808f11bba', 'request_id': 'req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:07.685257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5394261a3c2749bda1d08cf808f11bba', 'request_id': 'req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:07.713727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] The token cache is being invalidate because project 5394261a3c2749bda1d08cf808f11bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:07:07.714131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:07.715518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:07.723243 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2134/4294] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:07 2022] DELETE /identity/v3/projects/5394261a3c2749bda1d08cf808f11bba => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:07.726047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cab327-a6fb-4d6c-b3fd-5e0fd0368f65 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:07.752320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cab327-a6fb-4d6c-b3fd-5e0fd0368f65 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:07.944607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:07.945855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:07.946353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:07.946814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] PATH_INFO: `/v3/users/73ef90ad862a462e8e9c775f2e2accab` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:07.948296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ef90ad862a462e8e9c775f2e2accab)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:07.953595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:08.160934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ef90ad862a462e8e9c775f2e2accab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:08.179788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ef90ad862a462e8e9c775f2e2accab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:08.181719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ef90ad862a462e8e9c775f2e2accab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:08.182571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ef90ad862a462e8e9c775f2e2accab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:08.206355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ef90ad862a462e8e9c775f2e2accab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:08.251821 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2161/4295] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:07:07 2022] DELETE /identity/v3/users/73ef90ad862a462e8e9c775f2e2accab => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:08.843928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:08.848244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:08.885359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c3be9-6cee-4e7b-b0b9-6a2037d3c3be admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:08.967607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:09.017731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fd66b-dbe6-461c-89d4-d13895b6c6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:09.019351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fd66b-dbe6-461c-89d4-d13895b6c6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:09.023002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fd66b-dbe6-461c-89d4-d13895b6c6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:09.023622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fd66b-dbe6-461c-89d4-d13895b6c6fd admin admin] PATH_INFO: `/v3/users/1a561700ae4f44e59b3dd81c136447d1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:09.025527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fd66b-dbe6-461c-89d4-d13895b6c6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a561700ae4f44e59b3dd81c136447d1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:09.028219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fd66b-dbe6-461c-89d4-d13895b6c6fd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:09.102471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:09.104700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:09.109615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-716fd66b-dbe6-461c-89d4-d13895b6c6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a561700ae4f44e59b3dd81c136447d1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:09.119740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-716fd66b-dbe6-461c-89d4-d13895b6c6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a561700ae4f44e59b3dd81c136447d1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:09.120673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-716fd66b-dbe6-461c-89d4-d13895b6c6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a561700ae4f44e59b3dd81c136447d1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:09.121411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-716fd66b-dbe6-461c-89d4-d13895b6c6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a561700ae4f44e59b3dd81c136447d1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:09.146740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bff958-784f-465a-a38a-d64a66319e0e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:09.149159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-716fd66b-dbe6-461c-89d4-d13895b6c6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a561700ae4f44e59b3dd81c136447d1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:09.159256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:09.161034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:09.164391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:09.164990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc admin admin] PATH_INFO: `/v3/projects/a38ff50be66b4314a588005c9765efc2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:09.166511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a38ff50be66b4314a588005c9765efc2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:09.170118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:09.175241 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2135/4296] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:07:08 2022] DELETE /identity/v3/users/1a561700ae4f44e59b3dd81c136447d1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:09.274779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:09.292261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a38ff50be66b4314a588005c9765efc2', 'request_id': 'req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:09.314141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a38ff50be66b4314a588005c9765efc2', 'request_id': 'req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:09.322946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a38ff50be66b4314a588005c9765efc2', 'request_id': 'req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:09.337523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc admin admin] The token cache is being invalidate because project a38ff50be66b4314a588005c9765efc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:07:09.338164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:09.339392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3ecfc9d7-8755-4049-80e3-3da60cf0d8dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:09.343260 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2162/4297] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:09 2022] DELETE /identity/v3/projects/a38ff50be66b4314a588005c9765efc2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:07:09.347679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930492b-d649-4ca7-aef2-63cb4eed581b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:09.348247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930492b-d649-4ca7-aef2-63cb4eed581b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:09.348791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930492b-d649-4ca7-aef2-63cb4eed581b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:09.388980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9930492b-d649-4ca7-aef2-63cb4eed581b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:09.391190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9930492b-d649-4ca7-aef2-63cb4eed581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:09.510345 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2136/4298] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:07:09.520329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a37a56-0a0e-4b20-a1e5-943bb36b9e1a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:09.520774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a37a56-0a0e-4b20-a1e5-943bb36b9e1a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:09.521172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a37a56-0a0e-4b20-a1e5-943bb36b9e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:09.546052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d6a37a56-0a0e-4b20-a1e5-943bb36b9e1a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:09.547883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d6a37a56-0a0e-4b20-a1e5-943bb36b9e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:09.557111 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2163/4299] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:07:09.562605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930492b-d649-4ca7-aef2-63cb4eed581b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:09.574285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930492b-d649-4ca7-aef2-63cb4eed581b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:09.580252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a80ea-94ca-4a38-99fb-4fd399bf5ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:09.580875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a80ea-94ca-4a38-99fb-4fd399bf5ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:09.582110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a80ea-94ca-4a38-99fb-4fd399bf5ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:09.582515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a80ea-94ca-4a38-99fb-4fd399bf5ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:09.583706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a80ea-94ca-4a38-99fb-4fd399bf5ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:07:09.584024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a80ea-94ca-4a38-99fb-4fd399bf5ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:09.585900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a80ea-94ca-4a38-99fb-4fd399bf5ee8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:09.630567 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2137/4300] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:07:09.634585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a37a56-0a0e-4b20-a1e5-943bb36b9e1a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:09.650226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a37a56-0a0e-4b20-a1e5-943bb36b9e1a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:09.657329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184d9b3-bcf9-42a2-b761-14e9f57fa167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:09.657959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184d9b3-bcf9-42a2-b761-14e9f57fa167 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:09.658304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184d9b3-bcf9-42a2-b761-14e9f57fa167 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:09.658924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184d9b3-bcf9-42a2-b761-14e9f57fa167 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:09.659206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184d9b3-bcf9-42a2-b761-14e9f57fa167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:09.661555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184d9b3-bcf9-42a2-b761-14e9f57fa167 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:09.706230 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2164/4301] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:07:09 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:07:09.710519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a80ea-94ca-4a38-99fb-4fd399bf5ee8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:09.726233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a80ea-94ca-4a38-99fb-4fd399bf5ee8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:09.750738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399c7f4-7b1f-4c38-a744-fc1a1f4fe8b0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:09.751032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399c7f4-7b1f-4c38-a744-fc1a1f4fe8b0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:09.751882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399c7f4-7b1f-4c38-a744-fc1a1f4fe8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:09.779182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e399c7f4-7b1f-4c38-a744-fc1a1f4fe8b0 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:09.781043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e399c7f4-7b1f-4c38-a744-fc1a1f4fe8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:09.823622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:09.844939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddff7c9-2ed4-4d2c-9b11-09ceda0677db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:09.846237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddff7c9-2ed4-4d2c-9b11-09ceda0677db admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:09.846237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddff7c9-2ed4-4d2c-9b11-09ceda0677db admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:09.846494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddff7c9-2ed4-4d2c-9b11-09ceda0677db admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:09.846894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddff7c9-2ed4-4d2c-9b11-09ceda0677db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:09.849324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddff7c9-2ed4-4d2c-9b11-09ceda0677db admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:09.877156 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2138/4302] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:07:09 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:09.893072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddff7c9-2ed4-4d2c-9b11-09ceda0677db admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:09.908957 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2165/4303] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:09.913156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddff7c9-2ed4-4d2c-9b11-09ceda0677db admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:09.919067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea7ae9-aa56-4e80-8cb7-83b627f777f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:09.919958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea7ae9-aa56-4e80-8cb7-83b627f777f4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:09.920402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea7ae9-aa56-4e80-8cb7-83b627f777f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:09.920720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea7ae9-aa56-4e80-8cb7-83b627f777f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:09.921782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea7ae9-aa56-4e80-8cb7-83b627f777f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:09.923555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399c7f4-7b1f-4c38-a744-fc1a1f4fe8b0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:09.925969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e399c7f4-7b1f-4c38-a744-fc1a1f4fe8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:09.934188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea7ae9-aa56-4e80-8cb7-83b627f777f4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:09.958972 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2139/4304] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:09.964366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea7ae9-aa56-4e80-8cb7-83b627f777f4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:09.978164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea7ae9-aa56-4e80-8cb7-83b627f777f4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:09.983819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc511998-5aa0-422b-a66a-4bf0b5ca99ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:09.984424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc511998-5aa0-422b-a66a-4bf0b5ca99ab admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:09.984698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc511998-5aa0-422b-a66a-4bf0b5ca99ab admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:09.984973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc511998-5aa0-422b-a66a-4bf0b5ca99ab admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:09.985657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc511998-5aa0-422b-a66a-4bf0b5ca99ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:09.987256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc511998-5aa0-422b-a66a-4bf0b5ca99ab admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:10.001801 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2140/4305] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:10.003006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc511998-5aa0-422b-a66a-4bf0b5ca99ab admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:10.016618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc511998-5aa0-422b-a66a-4bf0b5ca99ab admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:10.032616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b5bb9-9f8b-4e17-b813-3324ac8542a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:10.033327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b5bb9-9f8b-4e17-b813-3324ac8542a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:10.034025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b5bb9-9f8b-4e17-b813-3324ac8542a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:10.034025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b5bb9-9f8b-4e17-b813-3324ac8542a3 admin admin] PATH_INFO: `/v3/projects/d3d490ff21ec44e1b6396c87e1212d89/users/ed12d668b96a49c6a986ceef884335a8/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:10.054882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b5bb9-9f8b-4e17-b813-3324ac8542a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d490ff21ec44e1b6396c87e1212d89, user_id=ed12d668b96a49c6a986ceef884335a8, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:10.057903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b5bb9-9f8b-4e17-b813-3324ac8542a3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:10.063784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399c7f4-7b1f-4c38-a744-fc1a1f4fe8b0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:10.075404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015fd03-4166-40af-87f9-90fce44b6a42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:10.076152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015fd03-4166-40af-87f9-90fce44b6a42 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:10.076493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015fd03-4166-40af-87f9-90fce44b6a42 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:10.076832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015fd03-4166-40af-87f9-90fce44b6a42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:10.087700 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2141/4306] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:07:10 2022] PUT /identity/v3/projects/d3d490ff21ec44e1b6396c87e1212d89/users/ed12d668b96a49c6a986ceef884335a8/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:10.095252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015fd03-4166-40af-87f9-90fce44b6a42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:10.096941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015fd03-4166-40af-87f9-90fce44b6a42 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:10.097701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf98f5-a57f-41ad-8ce2-b72be216f790 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:10.098636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf98f5-a57f-41ad-8ce2-b72be216f790 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:10.099715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf98f5-a57f-41ad-8ce2-b72be216f790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:10.107559 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2166/4307] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:07:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:10.139326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-acaf98f5-a57f-41ad-8ce2-b72be216f790 None None] MFA Rules not processed for user `ed12d668b96a49c6a986ceef884335a8`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:10.141232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-acaf98f5-a57f-41ad-8ce2-b72be216f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:10.318476 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2142/4308] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:10.330345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015fd03-4166-40af-87f9-90fce44b6a42 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:10.332206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5015fd03-4166-40af-87f9-90fce44b6a42 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:10.402279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:10.455380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015fd03-4166-40af-87f9-90fce44b6a42 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:10.486120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf98f5-a57f-41ad-8ce2-b72be216f790 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:10.487736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-acaf98f5-a57f-41ad-8ce2-b72be216f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:10.642634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f777dd3-8c4b-44ea-8e9d-0a8407655dae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:10.644862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f777dd3-8c4b-44ea-8e9d-0a8407655dae service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:10.646346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f777dd3-8c4b-44ea-8e9d-0a8407655dae service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:10.648203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f777dd3-8c4b-44ea-8e9d-0a8407655dae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:10.676161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f777dd3-8c4b-44ea-8e9d-0a8407655dae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:10.682065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f777dd3-8c4b-44ea-8e9d-0a8407655dae service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:10.685083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf98f5-a57f-41ad-8ce2-b72be216f790 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:10.699466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20d117-f5a2-46f2-b479-3007287f3dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:10.701939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20d117-f5a2-46f2-b479-3007287f3dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:10.702222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20d117-f5a2-46f2-b479-3007287f3dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:10.702498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20d117-f5a2-46f2-b479-3007287f3dd3 admin admin] PATH_INFO: `/v3/projects/6aa299e3b5df41429787365c80c28be2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:10.704826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20d117-f5a2-46f2-b479-3007287f3dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa299e3b5df41429787365c80c28be2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:10.707210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20d117-f5a2-46f2-b479-3007287f3dd3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:10.712554 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2167/4309] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:07:10.742734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:10.786906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee20d117-f5a2-46f2-b479-3007287f3dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa299e3b5df41429787365c80c28be2', 'request_id': 'req-ee20d117-f5a2-46f2-b479-3007287f3dd3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:10.807168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee20d117-f5a2-46f2-b479-3007287f3dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa299e3b5df41429787365c80c28be2', 'request_id': 'req-ee20d117-f5a2-46f2-b479-3007287f3dd3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:10.815582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee20d117-f5a2-46f2-b479-3007287f3dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa299e3b5df41429787365c80c28be2', 'request_id': 'req-ee20d117-f5a2-46f2-b479-3007287f3dd3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:10.896242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee20d117-f5a2-46f2-b479-3007287f3dd3 admin admin] The token cache is being invalidate because project 6aa299e3b5df41429787365c80c28be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:07:10.897392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee20d117-f5a2-46f2-b479-3007287f3dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:10.899488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee20d117-f5a2-46f2-b479-3007287f3dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:10.905890 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2143/4310] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:10 2022] DELETE /identity/v3/projects/6aa299e3b5df41429787365c80c28be2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:10.911301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70a4cd-3e8e-4fab-b82c-b71f45f2dad6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:10.911633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70a4cd-3e8e-4fab-b82c-b71f45f2dad6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:10.911915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70a4cd-3e8e-4fab-b82c-b71f45f2dad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:10.971270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ba70a4cd-3e8e-4fab-b82c-b71f45f2dad6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:10.975719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ba70a4cd-3e8e-4fab-b82c-b71f45f2dad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:11.004780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dbecd-e04e-417c-b5b5-1771335d0469 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:11.005049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dbecd-e04e-417c-b5b5-1771335d0469 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:11.005354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dbecd-e04e-417c-b5b5-1771335d0469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:11.043963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-061dbecd-e04e-417c-b5b5-1771335d0469 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:11.045387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-061dbecd-e04e-417c-b5b5-1771335d0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:11.130157 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2168/4311] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:11.140425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e69a-b9a9-42df-9b4c-288d89d2d241 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:11.140683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e69a-b9a9-42df-9b4c-288d89d2d241 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:11.141208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e69a-b9a9-42df-9b4c-288d89d2d241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:11.142796 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2144/4312] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:07:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:07:11.168099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061dbecd-e04e-417c-b5b5-1771335d0469 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:11.169843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-061dbecd-e04e-417c-b5b5-1771335d0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:11.201488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7f87e69a-b9a9-42df-9b4c-288d89d2d241 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:11.203236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7f87e69a-b9a9-42df-9b4c-288d89d2d241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:11.225138 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2169/4313] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:07:11.229059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87e69a-b9a9-42df-9b4c-288d89d2d241 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:11.266661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87e69a-b9a9-42df-9b4c-288d89d2d241 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:11.286856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfc48c-3d92-40fc-aa9b-000e5798f651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:11.287717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfc48c-3d92-40fc-aa9b-000e5798f651 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:11.288143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfc48c-3d92-40fc-aa9b-000e5798f651 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:11.288515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfc48c-3d92-40fc-aa9b-000e5798f651 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:11.289303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfc48c-3d92-40fc-aa9b-000e5798f651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:07:11.289718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfc48c-3d92-40fc-aa9b-000e5798f651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:11.293145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfc48c-3d92-40fc-aa9b-000e5798f651 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:11.340051 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2170/4314] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:07:11.342781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfc48c-3d92-40fc-aa9b-000e5798f651 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:11.367725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061dbecd-e04e-417c-b5b5-1771335d0469 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:11.370310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfc48c-3d92-40fc-aa9b-000e5798f651 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:11.374818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d53a-953c-4b8c-be39-805fef43f8a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:11.375791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d53a-953c-4b8c-be39-805fef43f8a5 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:11.376346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d53a-953c-4b8c-be39-805fef43f8a5 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:11.376803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d53a-953c-4b8c-be39-805fef43f8a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:11.386803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5dfff-e8f4-4161-be56-2e225f7e7238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:11.387803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5dfff-e8f4-4161-be56-2e225f7e7238 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:11.388023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26d53a-953c-4b8c-be39-805fef43f8a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:11.388310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5dfff-e8f4-4161-be56-2e225f7e7238 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:11.388989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5dfff-e8f4-4161-be56-2e225f7e7238 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:11.389786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5dfff-e8f4-4161-be56-2e225f7e7238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:11.391933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5dfff-e8f4-4161-be56-2e225f7e7238 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:11.392795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26d53a-953c-4b8c-be39-805fef43f8a5 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:11.435354 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2145/4315] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:07:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:07:11.503776 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2171/4316] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:07:11 2022] POST /identity/v3/projects => generated 363 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:11.506189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d53a-953c-4b8c-be39-805fef43f8a5 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:11.548944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d53a-953c-4b8c-be39-805fef43f8a5 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:11.622626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:11.643481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c70137-294a-4933-b36a-e03e0da1eb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:11.644383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c70137-294a-4933-b36a-e03e0da1eb3b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:11.644864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c70137-294a-4933-b36a-e03e0da1eb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:11.645407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c70137-294a-4933-b36a-e03e0da1eb3b admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:11.646227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c70137-294a-4933-b36a-e03e0da1eb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:11.648743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c70137-294a-4933-b36a-e03e0da1eb3b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:11.687424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5dfff-e8f4-4161-be56-2e225f7e7238 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:11.688220 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2146/4317] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:07:11 2022] POST /identity/v3/users => generated 282 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:07:11.709207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5dfff-e8f4-4161-be56-2e225f7e7238 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:11.716524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086f53a-2f23-4da3-9ef7-ca1dcd5ce732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:11.717436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086f53a-2f23-4da3-9ef7-ca1dcd5ce732 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:11.717925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086f53a-2f23-4da3-9ef7-ca1dcd5ce732 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:11.718166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086f53a-2f23-4da3-9ef7-ca1dcd5ce732 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:11.719362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086f53a-2f23-4da3-9ef7-ca1dcd5ce732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:11.722871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086f53a-2f23-4da3-9ef7-ca1dcd5ce732 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:11.738432 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2172/4318] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:11.743559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c70137-294a-4933-b36a-e03e0da1eb3b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:11.756824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c70137-294a-4933-b36a-e03e0da1eb3b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:11.765258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cdd8e-c75f-4469-9745-80b30be19d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:11.766078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cdd8e-c75f-4469-9745-80b30be19d53 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:11.767113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cdd8e-c75f-4469-9745-80b30be19d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:11.767503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cdd8e-c75f-4469-9745-80b30be19d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:11.768255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cdd8e-c75f-4469-9745-80b30be19d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:11.770310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cdd8e-c75f-4469-9745-80b30be19d53 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:11.796544 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2147/4319] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:11.800737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086f53a-2f23-4da3-9ef7-ca1dcd5ce732 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:11.836334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086f53a-2f23-4da3-9ef7-ca1dcd5ce732 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:11.846811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8414161-e217-410f-8008-2aae21ed5801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:11.847498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8414161-e217-410f-8008-2aae21ed5801 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:11.847775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8414161-e217-410f-8008-2aae21ed5801 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:11.848048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8414161-e217-410f-8008-2aae21ed5801 admin admin] PATH_INFO: `/v3/projects/6bcd0e7c24154409824f96e9e99da357/users/30fe0e1ffa1040ec85d3c32d8b741c75/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:11.899557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8414161-e217-410f-8008-2aae21ed5801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bcd0e7c24154409824f96e9e99da357, user_id=30fe0e1ffa1040ec85d3c32d8b741c75, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:11.902395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8414161-e217-410f-8008-2aae21ed5801 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:11.954743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561f0ec-58bb-4fb9-9056-78217a033dac None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:11.954743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561f0ec-58bb-4fb9-9056-78217a033dac None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:11.954743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561f0ec-58bb-4fb9-9056-78217a033dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:11.957155 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2173/4320] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:07:11 2022] PUT /identity/v3/projects/6bcd0e7c24154409824f96e9e99da357/users/30fe0e1ffa1040ec85d3c32d8b741c75/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:07:11.992290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c561f0ec-58bb-4fb9-9056-78217a033dac None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:11.999906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c561f0ec-58bb-4fb9-9056-78217a033dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:12.198200 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2148/4321] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:12.214051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77701783-d460-42cb-8d26-3b574a376b21 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:12.215038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77701783-d460-42cb-8d26-3b574a376b21 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:12.215739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77701783-d460-42cb-8d26-3b574a376b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:12.223442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561f0ec-58bb-4fb9-9056-78217a033dac None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:12.225127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c561f0ec-58bb-4fb9-9056-78217a033dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:12.267219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-77701783-d460-42cb-8d26-3b574a376b21 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:12.269615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-77701783-d460-42cb-8d26-3b574a376b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:12.300781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:12.382562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561f0ec-58bb-4fb9-9056-78217a033dac None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:12.398029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7c1f2-f5e8-4e5c-8a9f-4eb0b3276ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:12.399103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7c1f2-f5e8-4e5c-8a9f-4eb0b3276ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:12.399597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7c1f2-f5e8-4e5c-8a9f-4eb0b3276ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:12.399980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7c1f2-f5e8-4e5c-8a9f-4eb0b3276ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:12.409602 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2174/4322] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:07:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:12.413882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7c1f2-f5e8-4e5c-8a9f-4eb0b3276ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:12.417155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7c1f2-f5e8-4e5c-8a9f-4eb0b3276ac8 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:12.438690 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2149/4323] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:12.443909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77701783-d460-42cb-8d26-3b574a376b21 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:12.596918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77701783-d460-42cb-8d26-3b574a376b21 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:12.612380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5187c25-f08f-4d94-9427-bfa5695dc7a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:12.613073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5187c25-f08f-4d94-9427-bfa5695dc7a7 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:12.613385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5187c25-f08f-4d94-9427-bfa5695dc7a7 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:12.613664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5187c25-f08f-4d94-9427-bfa5695dc7a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:12.640270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5187c25-f08f-4d94-9427-bfa5695dc7a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:12.646543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5187c25-f08f-4d94-9427-bfa5695dc7a7 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:12.662852 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2175/4324] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:07:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:13.700857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110058f6-2c25-41fa-b327-967abeb91f54 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:13.702193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110058f6-2c25-41fa-b327-967abeb91f54 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:13.702685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110058f6-2c25-41fa-b327-967abeb91f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:13.774673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-110058f6-2c25-41fa-b327-967abeb91f54 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:13.779016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-110058f6-2c25-41fa-b327-967abeb91f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:13.801808 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2150/4325] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:07:13.824500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5187c25-f08f-4d94-9427-bfa5695dc7a7 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:13.839711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5187c25-f08f-4d94-9427-bfa5695dc7a7 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:13.859944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9911ced-9f4f-41bf-bb9f-199f591a4857 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:13.864531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9911ced-9f4f-41bf-bb9f-199f591a4857 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:13.864898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9911ced-9f4f-41bf-bb9f-199f591a4857 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:13.865152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9911ced-9f4f-41bf-bb9f-199f591a4857 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:13.875845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110058f6-2c25-41fa-b327-967abeb91f54 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:13.877555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-110058f6-2c25-41fa-b327-967abeb91f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:13.907359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9911ced-9f4f-41bf-bb9f-199f591a4857 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:13.909209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9911ced-9f4f-41bf-bb9f-199f591a4857 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:13.949523 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2176/4326] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:07:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:14.023825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:14.058855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110058f6-2c25-41fa-b327-967abeb91f54 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:14.070172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c74604-3d27-4a83-86e2-e4ec95f37fcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:14.071059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c74604-3d27-4a83-86e2-e4ec95f37fcd service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:14.071810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c74604-3d27-4a83-86e2-e4ec95f37fcd service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:14.072158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c74604-3d27-4a83-86e2-e4ec95f37fcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:14.075905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e9c74604-3d27-4a83-86e2-e4ec95f37fcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:14.111662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c74604-3d27-4a83-86e2-e4ec95f37fcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:14.113850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c74604-3d27-4a83-86e2-e4ec95f37fcd service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:14.139475 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2151/4327] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:14.359486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3b727-774f-493b-8e28-94c08300f1e3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:14.359911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3b727-774f-493b-8e28-94c08300f1e3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:14.360292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3b727-774f-493b-8e28-94c08300f1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:14.398271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c8c3b727-774f-493b-8e28-94c08300f1e3 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:14.399725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c8c3b727-774f-493b-8e28-94c08300f1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:14.418365 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2177/4328] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:07:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:07:14.445914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c74604-3d27-4a83-86e2-e4ec95f37fcd service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:14.466491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c74604-3d27-4a83-86e2-e4ec95f37fcd service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:14.485920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fd253-ff2c-4335-993a-76ba5f33cb7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:14.486972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fd253-ff2c-4335-993a-76ba5f33cb7f service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:14.487472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fd253-ff2c-4335-993a-76ba5f33cb7f service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:14.487979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fd253-ff2c-4335-993a-76ba5f33cb7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:14.513767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fd253-ff2c-4335-993a-76ba5f33cb7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:14.517276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fd253-ff2c-4335-993a-76ba5f33cb7f service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:14.542179 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2152/4329] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:07:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:15.256275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b79540-b68a-4f77-8d81-0df6ce7631d7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:15.256826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b79540-b68a-4f77-8d81-0df6ce7631d7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:15.256826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b79540-b68a-4f77-8d81-0df6ce7631d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:15.294050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e0b79540-b68a-4f77-8d81-0df6ce7631d7 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:15.295290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e0b79540-b68a-4f77-8d81-0df6ce7631d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:15.314200 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2178/4330] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:15.330995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fd253-ff2c-4335-993a-76ba5f33cb7f service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:15.348345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fd253-ff2c-4335-993a-76ba5f33cb7f service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:15.361460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d349b2-8afe-43f3-9782-d9cb04b3c37b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:15.362661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d349b2-8afe-43f3-9782-d9cb04b3c37b service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:15.363775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d349b2-8afe-43f3-9782-d9cb04b3c37b service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:15.365224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d349b2-8afe-43f3-9782-d9cb04b3c37b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:15.388363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d349b2-8afe-43f3-9782-d9cb04b3c37b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:15.395369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d349b2-8afe-43f3-9782-d9cb04b3c37b service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:15.428873 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2153/4331] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:07:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:15.890473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee382-86c2-4bc8-811b-c7b77a1752db None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:15.891290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee382-86c2-4bc8-811b-c7b77a1752db None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:15.892300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee382-86c2-4bc8-811b-c7b77a1752db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:16.004090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-aacee382-86c2-4bc8-811b-c7b77a1752db None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:16.008142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-aacee382-86c2-4bc8-811b-c7b77a1752db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:16.034822 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2179/4332] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:16.085327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d349b2-8afe-43f3-9782-d9cb04b3c37b service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:16.103192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d349b2-8afe-43f3-9782-d9cb04b3c37b service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:16.117565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b4002-69e3-4bde-aa7f-647480204c78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:16.119548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b4002-69e3-4bde-aa7f-647480204c78 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:16.120914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b4002-69e3-4bde-aa7f-647480204c78 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:16.122654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b4002-69e3-4bde-aa7f-647480204c78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:16.150785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b4002-69e3-4bde-aa7f-647480204c78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:16.157413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b4002-69e3-4bde-aa7f-647480204c78 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:16.183734 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2154/4333] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:07:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:16.514098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee382-86c2-4bc8-811b-c7b77a1752db None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:16.519463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-aacee382-86c2-4bc8-811b-c7b77a1752db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:16.573354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee382-86c2-4bc8-811b-c7b77a1752db None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:16.588118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:16.589049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:16.589563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:16.590023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] PATH_INFO: `/v3/users/ed12d668b96a49c6a986ceef884335a8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:16.593240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed12d668b96a49c6a986ceef884335a8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:16.598225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:16.738941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed12d668b96a49c6a986ceef884335a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:16.755907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed12d668b96a49c6a986ceef884335a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:16.756472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed12d668b96a49c6a986ceef884335a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:16.770009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed12d668b96a49c6a986ceef884335a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:16.794337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:16.803778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed12d668b96a49c6a986ceef884335a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:16.856086 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2180/4334] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:07:16 2022] DELETE /identity/v3/users/ed12d668b96a49c6a986ceef884335a8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:16.858951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3405867-52be-4358-aeff-cb81a6fc27ce None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:16.859449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3405867-52be-4358-aeff-cb81a6fc27ce None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:16.859545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3405867-52be-4358-aeff-cb81a6fc27ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:16.896144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c3405867-52be-4358-aeff-cb81a6fc27ce None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:16.898443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c3405867-52be-4358-aeff-cb81a6fc27ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:17.168380 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2155/4335] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:17.224319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:17.229679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:17.398167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19a212-acfd-4364-baa4-35c582565c8a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:17.405959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca101e7-c163-4cc0-bee9-7569e2e7b1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:17.410009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca101e7-c163-4cc0-bee9-7569e2e7b1ee service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:17.411216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca101e7-c163-4cc0-bee9-7569e2e7b1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:17.412054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca101e7-c163-4cc0-bee9-7569e2e7b1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:17.440592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca101e7-c163-4cc0-bee9-7569e2e7b1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:17.444243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca101e7-c163-4cc0-bee9-7569e2e7b1ee service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:17.487181 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2181/4336] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:19.206130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3405867-52be-4358-aeff-cb81a6fc27ce None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:19.209548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c3405867-52be-4358-aeff-cb81a6fc27ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:19.251569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3405867-52be-4358-aeff-cb81a6fc27ce None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:19.261562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694112b2-e1ad-42ba-b24f-37534344dc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:19.262672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694112b2-e1ad-42ba-b24f-37534344dc22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:19.263200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694112b2-e1ad-42ba-b24f-37534344dc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:19.264070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694112b2-e1ad-42ba-b24f-37534344dc22 admin admin] PATH_INFO: `/v3/users/751127bd91a24297b248f59af3e069d4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:19.265632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694112b2-e1ad-42ba-b24f-37534344dc22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=751127bd91a24297b248f59af3e069d4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:19.267817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694112b2-e1ad-42ba-b24f-37534344dc22 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:19.339667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-694112b2-e1ad-42ba-b24f-37534344dc22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751127bd91a24297b248f59af3e069d4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:19.350865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-694112b2-e1ad-42ba-b24f-37534344dc22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751127bd91a24297b248f59af3e069d4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:19.352031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-694112b2-e1ad-42ba-b24f-37534344dc22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751127bd91a24297b248f59af3e069d4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:19.356782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca101e7-c163-4cc0-bee9-7569e2e7b1ee service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:19.357789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-694112b2-e1ad-42ba-b24f-37534344dc22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751127bd91a24297b248f59af3e069d4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:19.359078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0ca101e7-c163-4cc0-bee9-7569e2e7b1ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:19.377961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-694112b2-e1ad-42ba-b24f-37534344dc22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751127bd91a24297b248f59af3e069d4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:19.396295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca101e7-c163-4cc0-bee9-7569e2e7b1ee service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:19.396579 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2156/4337] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:07:19 2022] DELETE /identity/v3/users/751127bd91a24297b248f59af3e069d4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:19.505347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:19.506289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:19.506681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:19.507066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] PATH_INFO: `/v3/projects/d3d490ff21ec44e1b6396c87e1212d89` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:19.508612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d490ff21ec44e1b6396c87e1212d89)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:19.510697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:19.589378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d490ff21ec44e1b6396c87e1212d89', 'request_id': 'req-f604f66c-de4a-4db5-9048-81a67674c081'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:19.598867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d490ff21ec44e1b6396c87e1212d89', 'request_id': 'req-f604f66c-de4a-4db5-9048-81a67674c081'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:19.606835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d490ff21ec44e1b6396c87e1212d89', 'request_id': 'req-f604f66c-de4a-4db5-9048-81a67674c081'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:19.625456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] The token cache is being invalidate because project d3d490ff21ec44e1b6396c87e1212d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:07:19.625735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:19.627156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:19.629573 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2182/4338] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:19 2022] DELETE /identity/v3/projects/d3d490ff21ec44e1b6396c87e1212d89 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:07:19.633742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f63e2-08d6-40ca-bb8b-5653ace36eef None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:19.634234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f63e2-08d6-40ca-bb8b-5653ace36eef None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:19.634688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f63e2-08d6-40ca-bb8b-5653ace36eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:19.640894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:19.649031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:19.678576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-989f63e2-08d6-40ca-bb8b-5653ace36eef None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:19.680706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-989f63e2-08d6-40ca-bb8b-5653ace36eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:19.705682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:19.714090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:19.849472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604f66c-de4a-4db5-9048-81a67674c081 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:19.860805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212e330-4c16-4904-96f1-b22d8c8e5335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:19.861884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212e330-4c16-4904-96f1-b22d8c8e5335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:19.863211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212e330-4c16-4904-96f1-b22d8c8e5335 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:19.863783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212e330-4c16-4904-96f1-b22d8c8e5335 admin admin] PATH_INFO: `/v3/projects/b96051fc89de47e1b636dcb23b6fdc30` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:19.866319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212e330-4c16-4904-96f1-b22d8c8e5335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96051fc89de47e1b636dcb23b6fdc30)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:19.869998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212e330-4c16-4904-96f1-b22d8c8e5335 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:19.896401 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2157/4339] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:07:19.909749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0a0d8-aed0-4589-a2c5-988c8595926d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:19.910168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0a0d8-aed0-4589-a2c5-988c8595926d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:19.910494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0a0d8-aed0-4589-a2c5-988c8595926d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:19.991479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2fe0a0d8-aed0-4589-a2c5-988c8595926d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:19.995581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d212e330-4c16-4904-96f1-b22d8c8e5335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96051fc89de47e1b636dcb23b6fdc30', 'request_id': 'req-d212e330-4c16-4904-96f1-b22d8c8e5335'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:19.996065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2fe0a0d8-aed0-4589-a2c5-988c8595926d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:20.032459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d212e330-4c16-4904-96f1-b22d8c8e5335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96051fc89de47e1b636dcb23b6fdc30', 'request_id': 'req-d212e330-4c16-4904-96f1-b22d8c8e5335'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:20.054364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d212e330-4c16-4904-96f1-b22d8c8e5335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96051fc89de47e1b636dcb23b6fdc30', 'request_id': 'req-d212e330-4c16-4904-96f1-b22d8c8e5335'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:20.093911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d212e330-4c16-4904-96f1-b22d8c8e5335 admin admin] The token cache is being invalidate because project b96051fc89de47e1b636dcb23b6fdc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:07:20.094287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d212e330-4c16-4904-96f1-b22d8c8e5335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:20.094972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d212e330-4c16-4904-96f1-b22d8c8e5335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:20.101044 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2183/4340] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:19 2022] DELETE /identity/v3/projects/b96051fc89de47e1b636dcb23b6fdc30 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:20.103054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6db4b3-b9ed-4008-9333-bf16ee5fedda None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:20.104026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6db4b3-b9ed-4008-9333-bf16ee5fedda None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:20.104311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6db4b3-b9ed-4008-9333-bf16ee5fedda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:20.143748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-de6db4b3-b9ed-4008-9333-bf16ee5fedda None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:20.145473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-de6db4b3-b9ed-4008-9333-bf16ee5fedda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:20.278983 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2158/4341] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:20.285348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0a0d8-aed0-4589-a2c5-988c8595926d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:20.333473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0a0d8-aed0-4589-a2c5-988c8595926d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:20.366736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099dbae-5dcb-412b-8648-b5f1a6c08008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:20.367380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099dbae-5dcb-412b-8648-b5f1a6c08008 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:20.367886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099dbae-5dcb-412b-8648-b5f1a6c08008 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:20.368351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099dbae-5dcb-412b-8648-b5f1a6c08008 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:20.370974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099dbae-5dcb-412b-8648-b5f1a6c08008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:07:20.373726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099dbae-5dcb-412b-8648-b5f1a6c08008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:20.380273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099dbae-5dcb-412b-8648-b5f1a6c08008 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:20.381290 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2184/4342] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:20.392903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834b7a8-a309-4b44-befe-27d13854cfda None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:20.393140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834b7a8-a309-4b44-befe-27d13854cfda None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:20.393399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834b7a8-a309-4b44-befe-27d13854cfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:20.419606 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2159/4343] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:07:20.424064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099dbae-5dcb-412b-8648-b5f1a6c08008 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:20.472179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099dbae-5dcb-412b-8648-b5f1a6c08008 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:20.500271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5834b7a8-a309-4b44-befe-27d13854cfda None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:20.501609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5834b7a8-a309-4b44-befe-27d13854cfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:20.521737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7bbca-ce0c-4901-80b1-43063eac2bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:20.522363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7bbca-ce0c-4901-80b1-43063eac2bfa admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:20.522647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7bbca-ce0c-4901-80b1-43063eac2bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:20.530541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7bbca-ce0c-4901-80b1-43063eac2bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:20.531287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7bbca-ce0c-4901-80b1-43063eac2bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:20.535144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7bbca-ce0c-4901-80b1-43063eac2bfa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:20.546586 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2185/4344] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:20.547575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834b7a8-a309-4b44-befe-27d13854cfda None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:20.580224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834b7a8-a309-4b44-befe-27d13854cfda None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:20.597348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae641aad-0c07-40e1-af2f-bc9dfb357ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:20.597999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae641aad-0c07-40e1-af2f-bc9dfb357ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:20.598283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae641aad-0c07-40e1-af2f-bc9dfb357ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:20.598554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae641aad-0c07-40e1-af2f-bc9dfb357ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:20.599230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae641aad-0c07-40e1-af2f-bc9dfb357ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:07:20.600157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae641aad-0c07-40e1-af2f-bc9dfb357ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:20.602348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae641aad-0c07-40e1-af2f-bc9dfb357ea2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:20.672898 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2160/4345] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:07:20 2022] POST /identity/v3/projects => generated 377 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:20.674663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7bbca-ce0c-4901-80b1-43063eac2bfa admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:20.681728 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2186/4346] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:07:20.687914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae641aad-0c07-40e1-af2f-bc9dfb357ea2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:20.707460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae641aad-0c07-40e1-af2f-bc9dfb357ea2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:20.784671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:20.853453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cb8a9-05dd-4986-97b0-2d1af8b0cd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:20.854253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cb8a9-05dd-4986-97b0-2d1af8b0cd38 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:20.854655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cb8a9-05dd-4986-97b0-2d1af8b0cd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:20.855132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cb8a9-05dd-4986-97b0-2d1af8b0cd38 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:20.856020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cb8a9-05dd-4986-97b0-2d1af8b0cd38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:20.863470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cb8a9-05dd-4986-97b0-2d1af8b0cd38 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:20.902499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7bbca-ce0c-4901-80b1-43063eac2bfa admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:20.918325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0bb2d5-a179-4184-8a01-75238d465710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:20.918999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bb2d5-a179-4184-8a01-75238d465710 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:20.919313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bb2d5-a179-4184-8a01-75238d465710 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:20.919600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bb2d5-a179-4184-8a01-75238d465710 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:20.920246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0bb2d5-a179-4184-8a01-75238d465710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:20.929674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0bb2d5-a179-4184-8a01-75238d465710 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:20.969121 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2187/4347] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:07:20 2022] POST /identity/v3/projects => generated 379 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:20.970380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cb8a9-05dd-4986-97b0-2d1af8b0cd38 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:21.014256 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2161/4348] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:07:20 2022] POST /identity/v3/users => generated 289 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:21.018304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0bb2d5-a179-4184-8a01-75238d465710 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:21.040568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0bb2d5-a179-4184-8a01-75238d465710 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:21.081826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:21.186647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cb8a9-05dd-4986-97b0-2d1af8b0cd38 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:21.210995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3a68e-7422-4212-9588-c3a2113474fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:21.216474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3a68e-7422-4212-9588-c3a2113474fa admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:21.216671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3a68e-7422-4212-9588-c3a2113474fa admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:21.216928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3a68e-7422-4212-9588-c3a2113474fa admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:21.226758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3a68e-7422-4212-9588-c3a2113474fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:21.230015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3a68e-7422-4212-9588-c3a2113474fa admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:21.247068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09839ea-c5c0-4be3-bc3b-14e777e045a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:21.247767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09839ea-c5c0-4be3-bc3b-14e777e045a6 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:21.248667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09839ea-c5c0-4be3-bc3b-14e777e045a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:21.248950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09839ea-c5c0-4be3-bc3b-14e777e045a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:21.249709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09839ea-c5c0-4be3-bc3b-14e777e045a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:21.255084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09839ea-c5c0-4be3-bc3b-14e777e045a6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:21.296969 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2188/4349] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:07:20 2022] POST /identity/v3/users => generated 290 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:21.299229 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2162/4350] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:21.300245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09839ea-c5c0-4be3-bc3b-14e777e045a6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:21.300811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3a68e-7422-4212-9588-c3a2113474fa admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:21.321652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09839ea-c5c0-4be3-bc3b-14e777e045a6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:21.323255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3a68e-7422-4212-9588-c3a2113474fa admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:21.333381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2a442-4d5d-4ea9-9cb8-fd101628c46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:21.334049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2a442-4d5d-4ea9-9cb8-fd101628c46b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:21.334333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2a442-4d5d-4ea9-9cb8-fd101628c46b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:21.334611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2a442-4d5d-4ea9-9cb8-fd101628c46b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:21.335462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c949b-de62-4701-847b-79160c9cc373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:21.336080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c949b-de62-4701-847b-79160c9cc373 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:21.336400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c949b-de62-4701-847b-79160c9cc373 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:21.336747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c949b-de62-4701-847b-79160c9cc373 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:21.338141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c949b-de62-4701-847b-79160c9cc373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:21.339039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2a442-4d5d-4ea9-9cb8-fd101628c46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:21.342245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c949b-de62-4701-847b-79160c9cc373 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:21.345403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2a442-4d5d-4ea9-9cb8-fd101628c46b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:21.366808 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2163/4351] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:21.369073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2a442-4d5d-4ea9-9cb8-fd101628c46b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:21.379101 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2189/4352] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:21.384344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c949b-de62-4701-847b-79160c9cc373 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:21.388026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2a442-4d5d-4ea9-9cb8-fd101628c46b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:21.393584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dde82-0bb6-490b-84d4-93aae5f1d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:21.394360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dde82-0bb6-490b-84d4-93aae5f1d180 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:21.394646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dde82-0bb6-490b-84d4-93aae5f1d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:21.394928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dde82-0bb6-490b-84d4-93aae5f1d180 admin admin] PATH_INFO: `/v3/projects/b0988143bca84b509da9f2410a8e7e50/users/505e74c028f34cb3a48c0db2c10ec0a5/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:21.406374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c949b-de62-4701-847b-79160c9cc373 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:21.413549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b165c1-ef5c-4295-91de-bf1f8317c105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:21.414422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b165c1-ef5c-4295-91de-bf1f8317c105 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:21.414877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b165c1-ef5c-4295-91de-bf1f8317c105 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:21.415388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b165c1-ef5c-4295-91de-bf1f8317c105 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:21.415757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dde82-0bb6-490b-84d4-93aae5f1d180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0988143bca84b509da9f2410a8e7e50, user_id=505e74c028f34cb3a48c0db2c10ec0a5, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:21.416282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b165c1-ef5c-4295-91de-bf1f8317c105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:21.418165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b165c1-ef5c-4295-91de-bf1f8317c105 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:21.420180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dde82-0bb6-490b-84d4-93aae5f1d180 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:21.441618 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2190/4353] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:07:21.452600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b165c1-ef5c-4295-91de-bf1f8317c105 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:21.484650 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2164/4354] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:07:21 2022] PUT /identity/v3/projects/b0988143bca84b509da9f2410a8e7e50/users/505e74c028f34cb3a48c0db2c10ec0a5/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:21.490846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0b5d-11d9-4e4f-bbc2-f6ac18112095 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:21.490846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0b5d-11d9-4e4f-bbc2-f6ac18112095 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:21.490846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0b5d-11d9-4e4f-bbc2-f6ac18112095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:21.491278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b165c1-ef5c-4295-91de-bf1f8317c105 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:21.628920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b7ad0b5d-11d9-4e4f-bbc2-f6ac18112095 None None] MFA Rules not processed for user `505e74c028f34cb3a48c0db2c10ec0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:21.631995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b7ad0b5d-11d9-4e4f-bbc2-f6ac18112095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:21.680834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f74584-7138-448a-8066-7a106e0b73bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:21.681567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74584-7138-448a-8066-7a106e0b73bd admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:21.682372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74584-7138-448a-8066-7a106e0b73bd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:21.682660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74584-7138-448a-8066-7a106e0b73bd admin admin] PATH_INFO: `/v3/projects/765c62cac2ee4406b23a5baa85c52ff7/users/d78e9afd772c4de981cac8f5817ec356/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:21.738431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f74584-7138-448a-8066-7a106e0b73bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=765c62cac2ee4406b23a5baa85c52ff7, user_id=d78e9afd772c4de981cac8f5817ec356, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:21.746051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f74584-7138-448a-8066-7a106e0b73bd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:21.780750 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2191/4355] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:07:21 2022] PUT /identity/v3/projects/765c62cac2ee4406b23a5baa85c52ff7/users/d78e9afd772c4de981cac8f5817ec356/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:21.786046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742e5a-90d7-417c-9eaf-824d369d3730 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:21.786395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742e5a-90d7-417c-9eaf-824d369d3730 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:21.786787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742e5a-90d7-417c-9eaf-824d369d3730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:21.837163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:21.854401 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2165/4356] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:07:21.854919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ca742e5a-90d7-417c-9eaf-824d369d3730 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:21.857921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0b5d-11d9-4e4f-bbc2-f6ac18112095 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:21.858717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ca742e5a-90d7-417c-9eaf-824d369d3730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:21.884443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0b5d-11d9-4e4f-bbc2-f6ac18112095 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:22.068602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b18be-eac2-4cc4-84b7-ef0e31b51cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:22.069809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b18be-eac2-4cc4-84b7-ef0e31b51cbb admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:22.071081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b18be-eac2-4cc4-84b7-ef0e31b51cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:22.071718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b18be-eac2-4cc4-84b7-ef0e31b51cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:22.073849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b18be-eac2-4cc4-84b7-ef0e31b51cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:22.077970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b18be-eac2-4cc4-84b7-ef0e31b51cbb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:22.084621 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2192/4357] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:22.119615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:22.140115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742e5a-90d7-417c-9eaf-824d369d3730 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:22.142850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ca742e5a-90d7-417c-9eaf-824d369d3730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:22.186613 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2166/4358] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:07:21 2022] POST /identity/v3/projects => generated 377 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:22.190272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b18be-eac2-4cc4-84b7-ef0e31b51cbb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:22.293982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742e5a-90d7-417c-9eaf-824d369d3730 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:22.438044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b18be-eac2-4cc4-84b7-ef0e31b51cbb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:22.476997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab3400-9db4-4f2d-a961-ae8cac63cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:22.479628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab3400-9db4-4f2d-a961-ae8cac63cfc3 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:22.480284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab3400-9db4-4f2d-a961-ae8cac63cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:22.480903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab3400-9db4-4f2d-a961-ae8cac63cfc3 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:22.482269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab3400-9db4-4f2d-a961-ae8cac63cfc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:22.505845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab3400-9db4-4f2d-a961-ae8cac63cfc3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:22.528725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c3676-f495-4ffc-afb1-b04b56466e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:22.533464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3676-f495-4ffc-afb1-b04b56466e24 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:22.534004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3676-f495-4ffc-afb1-b04b56466e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:22.534653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3676-f495-4ffc-afb1-b04b56466e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:22.560461 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2167/4359] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:07:22 2022] POST /identity/v3/users => generated 289 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:22.561657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab3400-9db4-4f2d-a961-ae8cac63cfc3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:22.563014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c3676-f495-4ffc-afb1-b04b56466e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:22.564942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c3676-f495-4ffc-afb1-b04b56466e24 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:22.583839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab3400-9db4-4f2d-a961-ae8cac63cfc3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:22.588815 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2193/4360] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:07:22.596384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f799e-38fb-4e98-880a-f97645e97ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:22.596384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f799e-38fb-4e98-880a-f97645e97ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:22.596384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f799e-38fb-4e98-880a-f97645e97ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:22.596384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f799e-38fb-4e98-880a-f97645e97ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:22.601732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f799e-38fb-4e98-880a-f97645e97ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:22.606489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f799e-38fb-4e98-880a-f97645e97ff9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:22.635963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c3676-f495-4ffc-afb1-b04b56466e24 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:22.643739 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2168/4361] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:22.651963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c3676-f495-4ffc-afb1-b04b56466e24 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:22.663466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31e700-d1bf-4068-b526-8bf45e62378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:22.664324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31e700-d1bf-4068-b526-8bf45e62378a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:22.664691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31e700-d1bf-4068-b526-8bf45e62378a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:22.665040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31e700-d1bf-4068-b526-8bf45e62378a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:22.666297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31e700-d1bf-4068-b526-8bf45e62378a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:22.668175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31e700-d1bf-4068-b526-8bf45e62378a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:22.687904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f799e-38fb-4e98-880a-f97645e97ff9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:22.688783 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2194/4362] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:22.704579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f799e-38fb-4e98-880a-f97645e97ff9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:22.710249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e707-96be-4003-bffe-7849d1769af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:22.710922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e707-96be-4003-bffe-7849d1769af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:22.711198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e707-96be-4003-bffe-7849d1769af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:22.711470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e707-96be-4003-bffe-7849d1769af5 admin admin] PATH_INFO: `/v3/projects/a0118e9583a14a32aeabd7939df1bac7/users/530e9a1a6601464c9f8271601233d7d3/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:22.745034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4e707-96be-4003-bffe-7849d1769af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0118e9583a14a32aeabd7939df1bac7, user_id=530e9a1a6601464c9f8271601233d7d3, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:22.753676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4e707-96be-4003-bffe-7849d1769af5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:22.783738 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2169/4363] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:07:22 2022] PUT /identity/v3/projects/a0118e9583a14a32aeabd7939df1bac7/users/530e9a1a6601464c9f8271601233d7d3/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:22.790605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b03c1-7fe1-4a89-871e-95c4207d9c9c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:22.790949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b03c1-7fe1-4a89-871e-95c4207d9c9c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:22.791497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b03c1-7fe1-4a89-871e-95c4207d9c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:22.891403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-698b03c1-7fe1-4a89-871e-95c4207d9c9c None None] MFA Rules not processed for user `530e9a1a6601464c9f8271601233d7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:22.897826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-698b03c1-7fe1-4a89-871e-95c4207d9c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:23.101279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:23.197632 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2195/4364] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:23.207489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e707-96be-4003-bffe-7849d1769af5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:23.209958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f2d4e707-96be-4003-bffe-7849d1769af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:23.383838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e707-96be-4003-bffe-7849d1769af5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:23.394993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b14f8-9115-4c3a-91c4-1934140e3ae5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:23.397661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b14f8-9115-4c3a-91c4-1934140e3ae5 service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:23.397960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b14f8-9115-4c3a-91c4-1934140e3ae5 service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:23.399566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b14f8-9115-4c3a-91c4-1934140e3ae5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:23.555940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b14f8-9115-4c3a-91c4-1934140e3ae5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:23.557558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b14f8-9115-4c3a-91c4-1934140e3ae5 service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:23.586594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:23.611259 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2170/4365] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:23.850648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411fb35-8063-4938-92d7-37ca56d706c0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:23.851168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411fb35-8063-4938-92d7-37ca56d706c0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:23.851383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411fb35-8063-4938-92d7-37ca56d706c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:23.872969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4411fb35-8063-4938-92d7-37ca56d706c0 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:23.874439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4411fb35-8063-4938-92d7-37ca56d706c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:23.940456 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2196/4366] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:07:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:23.957049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b14f8-9115-4c3a-91c4-1934140e3ae5 service glance] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:23.962874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-998b14f8-9115-4c3a-91c4-1934140e3ae5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:24.196237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b14f8-9115-4c3a-91c4-1934140e3ae5 service glance] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:24.225218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47936772-9f84-409e-b978-8797314be98f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:24.225218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47936772-9f84-409e-b978-8797314be98f service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:24.225218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47936772-9f84-409e-b978-8797314be98f service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:24.225218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47936772-9f84-409e-b978-8797314be98f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:24.274895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47936772-9f84-409e-b978-8797314be98f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:24.276811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47936772-9f84-409e-b978-8797314be98f service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:24.297073 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2171/4367] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:07:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:24.630174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411fb35-8063-4938-92d7-37ca56d706c0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:24.644648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411fb35-8063-4938-92d7-37ca56d706c0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:24.660636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880d81c-42f2-4bac-968a-89c38898250d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:24.661328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880d81c-42f2-4bac-968a-89c38898250d service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:24.661615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880d81c-42f2-4bac-968a-89c38898250d service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:24.661889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880d81c-42f2-4bac-968a-89c38898250d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:24.686005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880d81c-42f2-4bac-968a-89c38898250d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:24.688094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880d81c-42f2-4bac-968a-89c38898250d service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:24.707378 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2197/4368] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:24.865139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1480b0a-d8e0-4047-b824-f7ecfd4ccc23 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:24.866914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1480b0a-d8e0-4047-b824-f7ecfd4ccc23 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:24.867434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1480b0a-d8e0-4047-b824-f7ecfd4ccc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:24.912686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e1480b0a-d8e0-4047-b824-f7ecfd4ccc23 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:24.914372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e1480b0a-d8e0-4047-b824-f7ecfd4ccc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:24.925296 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2172/4369] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:24.938228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880d81c-42f2-4bac-968a-89c38898250d service glance] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:24.957690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880d81c-42f2-4bac-968a-89c38898250d service glance] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:24.964071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58e52b-8a38-4ead-a299-c743b7b6dbdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:24.964769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58e52b-8a38-4ead-a299-c743b7b6dbdb service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:24.965124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58e52b-8a38-4ead-a299-c743b7b6dbdb service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:24.965535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58e52b-8a38-4ead-a299-c743b7b6dbdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:24.977939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58e52b-8a38-4ead-a299-c743b7b6dbdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:24.979674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58e52b-8a38-4ead-a299-c743b7b6dbdb service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:24.992071 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2198/4370] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:07:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:07:25.204825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1480b0a-d8e0-4047-b824-f7ecfd4ccc23 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:25.325102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1480b0a-d8e0-4047-b824-f7ecfd4ccc23 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:25.336045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4978ac-3db5-4d8d-b708-455ea2c5b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:25.337343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4978ac-3db5-4d8d-b708-455ea2c5b6e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:25.337938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4978ac-3db5-4d8d-b708-455ea2c5b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:25.338441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4978ac-3db5-4d8d-b708-455ea2c5b6e5 admin admin] PATH_INFO: `/v3/users/505e74c028f34cb3a48c0db2c10ec0a5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:25.340060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4978ac-3db5-4d8d-b708-455ea2c5b6e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=505e74c028f34cb3a48c0db2c10ec0a5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:25.343464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4978ac-3db5-4d8d-b708-455ea2c5b6e5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:25.437884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c4978ac-3db5-4d8d-b708-455ea2c5b6e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '505e74c028f34cb3a48c0db2c10ec0a5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:25.458812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c4978ac-3db5-4d8d-b708-455ea2c5b6e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '505e74c028f34cb3a48c0db2c10ec0a5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:25.459796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c4978ac-3db5-4d8d-b708-455ea2c5b6e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '505e74c028f34cb3a48c0db2c10ec0a5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:25.461496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c4978ac-3db5-4d8d-b708-455ea2c5b6e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '505e74c028f34cb3a48c0db2c10ec0a5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:25.498239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c4978ac-3db5-4d8d-b708-455ea2c5b6e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '505e74c028f34cb3a48c0db2c10ec0a5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:25.536740 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2173/4371] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:07:25 2022] DELETE /identity/v3/users/505e74c028f34cb3a48c0db2c10ec0a5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:25.541019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382794a-d2e9-45a9-af69-19f9936afd89 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:25.541340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382794a-d2e9-45a9-af69-19f9936afd89 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:25.541616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382794a-d2e9-45a9-af69-19f9936afd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:25.580354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1382794a-d2e9-45a9-af69-19f9936afd89 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:25.584840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1382794a-d2e9-45a9-af69-19f9936afd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:25.610359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fae602-bcbf-4362-a76e-2ded21d07d71 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:25.610652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fae602-bcbf-4362-a76e-2ded21d07d71 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:25.611397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fae602-bcbf-4362-a76e-2ded21d07d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:25.619923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:25.656668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f5fae602-bcbf-4362-a76e-2ded21d07d71 None None] MFA Rules not processed for user `06443b5728fb4d1e95d6245820e786bf`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:25.662382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f5fae602-bcbf-4362-a76e-2ded21d07d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:25.694602 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2199/4372] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:25.711686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382794a-d2e9-45a9-af69-19f9936afd89 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:25.716618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1382794a-d2e9-45a9-af69-19f9936afd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:25.785268 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2174/4373] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:25.836945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382794a-d2e9-45a9-af69-19f9936afd89 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:25.849601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5f4c8-5f8c-499f-8839-6b8ef8abac03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:25.850487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5f4c8-5f8c-499f-8839-6b8ef8abac03 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:25.850766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5f4c8-5f8c-499f-8839-6b8ef8abac03 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:25.852085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5f4c8-5f8c-499f-8839-6b8ef8abac03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:25.874206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5f4c8-5f8c-499f-8839-6b8ef8abac03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:25.879609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5f4c8-5f8c-499f-8839-6b8ef8abac03 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:25.902235 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2200/4374] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:27.195719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fae602-bcbf-4362-a76e-2ded21d07d71 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:27.200653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f5fae602-bcbf-4362-a76e-2ded21d07d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:27.230425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fae602-bcbf-4362-a76e-2ded21d07d71 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:27.246282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:27.247480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:27.248520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:27.250608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] PATH_INFO: `/v3/users/dcad18d0243f492591808197ca3dcc81` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:27.253763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcad18d0243f492591808197ca3dcc81)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:27.258769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:27.346048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcad18d0243f492591808197ca3dcc81'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:27.357011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcad18d0243f492591808197ca3dcc81'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:27.358526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcad18d0243f492591808197ca3dcc81'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:27.359571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcad18d0243f492591808197ca3dcc81'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:27.375282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcad18d0243f492591808197ca3dcc81'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:27.429101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5f4c8-5f8c-499f-8839-6b8ef8abac03 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:27.430758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ddf5f4c8-5f8c-499f-8839-6b8ef8abac03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:27.452547 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2175/4375] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:07:27 2022] DELETE /identity/v3/users/dcad18d0243f492591808197ca3dcc81 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:27.456089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:27.686665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5f4c8-5f8c-499f-8839-6b8ef8abac03 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:27.795901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1fcab-fbc2-4624-9211-bb496c58c106 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:27.796928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1fcab-fbc2-4624-9211-bb496c58c106 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:27.797237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1fcab-fbc2-4624-9211-bb496c58c106 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:27.797953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1fcab-fbc2-4624-9211-bb496c58c106 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:27.799379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f3a1fcab-fbc2-4624-9211-bb496c58c106 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:27.814652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1fcab-fbc2-4624-9211-bb496c58c106 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:27.816435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1fcab-fbc2-4624-9211-bb496c58c106 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:27.828447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:27.829769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:27.832740 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2201/4376] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:27.983680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63ec37-35d7-4c7e-a5e3-3cf0c24d2519 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:27.991266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e2326-f918-4455-87c2-8bb651674c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:27.992418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e2326-f918-4455-87c2-8bb651674c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:27.992944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e2326-f918-4455-87c2-8bb651674c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:27.994120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e2326-f918-4455-87c2-8bb651674c63 admin admin] PATH_INFO: `/v3/projects/169293c01bf047358ff870a36c7a1247` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:27.995912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e2326-f918-4455-87c2-8bb651674c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=169293c01bf047358ff870a36c7a1247)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:27.999098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e2326-f918-4455-87c2-8bb651674c63 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:28.027371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:28.070364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b67e2326-f918-4455-87c2-8bb651674c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169293c01bf047358ff870a36c7a1247', 'request_id': 'req-b67e2326-f918-4455-87c2-8bb651674c63'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.082647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b67e2326-f918-4455-87c2-8bb651674c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169293c01bf047358ff870a36c7a1247', 'request_id': 'req-b67e2326-f918-4455-87c2-8bb651674c63'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.092085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b67e2326-f918-4455-87c2-8bb651674c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169293c01bf047358ff870a36c7a1247', 'request_id': 'req-b67e2326-f918-4455-87c2-8bb651674c63'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.100913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1fcab-fbc2-4624-9211-bb496c58c106 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:28.102527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f3a1fcab-fbc2-4624-9211-bb496c58c106 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:28.118869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b67e2326-f918-4455-87c2-8bb651674c63 admin admin] The token cache is being invalidate because project 169293c01bf047358ff870a36c7a1247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:07:28.119407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b67e2326-f918-4455-87c2-8bb651674c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.120528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b67e2326-f918-4455-87c2-8bb651674c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.131139 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2176/4377] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:27 2022] DELETE /identity/v3/projects/169293c01bf047358ff870a36c7a1247 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:07:28.132618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d82642-28e4-4e3b-a06f-672074b94ca4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:28.132911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d82642-28e4-4e3b-a06f-672074b94ca4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:28.133237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d82642-28e4-4e3b-a06f-672074b94ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:28.164494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1fcab-fbc2-4624-9211-bb496c58c106 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:28.175358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-87d82642-28e4-4e3b-a06f-672074b94ca4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:28.182127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-87d82642-28e4-4e3b-a06f-672074b94ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:28.386785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:28.387942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:28.390744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:28.392212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] PATH_INFO: `/v3/projects/b0988143bca84b509da9f2410a8e7e50` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:28.398297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0988143bca84b509da9f2410a8e7e50)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:28.403827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:28.408188 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2177/4378] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:28.422649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c4cc-541c-46e9-8701-34be99e2f906 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:28.423548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c4cc-541c-46e9-8701-34be99e2f906 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:28.425578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c4cc-541c-46e9-8701-34be99e2f906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:28.495638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1466c4cc-541c-46e9-8701-34be99e2f906 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:28.500460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1466c4cc-541c-46e9-8701-34be99e2f906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:28.526731 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2178/4379] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:28.534247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466c4cc-541c-46e9-8701-34be99e2f906 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:28.537064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:28.552663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466c4cc-541c-46e9-8701-34be99e2f906 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:28.553422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0988143bca84b509da9f2410a8e7e50', 'request_id': 'req-1b6dea49-8436-4b7a-a061-be03713ee51c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.568721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0988143bca84b509da9f2410a8e7e50', 'request_id': 'req-1b6dea49-8436-4b7a-a061-be03713ee51c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.586848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0988143bca84b509da9f2410a8e7e50', 'request_id': 'req-1b6dea49-8436-4b7a-a061-be03713ee51c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.621150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] The token cache is being invalidate because project b0988143bca84b509da9f2410a8e7e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:07:28.622467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.625913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.630723 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2202/4380] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:28 2022] DELETE /identity/v3/projects/b0988143bca84b509da9f2410a8e7e50 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:07:28.634456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:28.638788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:28.756537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ff09e-c919-41df-a886-bb7dccd83f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:28.758298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ff09e-c919-41df-a886-bb7dccd83f0c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:28.761104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ff09e-c919-41df-a886-bb7dccd83f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:28.761719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ff09e-c919-41df-a886-bb7dccd83f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:28.763207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ff09e-c919-41df-a886-bb7dccd83f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:07:28.763697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ff09e-c919-41df-a886-bb7dccd83f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:28.766175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ff09e-c919-41df-a886-bb7dccd83f0c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:28.789136 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2179/4381] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:07:28.797101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ff09e-c919-41df-a886-bb7dccd83f0c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:28.811518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b36ff09e-c919-41df-a886-bb7dccd83f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:28.850003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ff09e-c919-41df-a886-bb7dccd83f0c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:28.866177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dea49-8436-4b7a-a061-be03713ee51c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:28.866400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf47f7c-bf1c-42a0-8182-46eb2a39cbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:28.866940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf47f7c-bf1c-42a0-8182-46eb2a39cbae admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:28.867223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf47f7c-bf1c-42a0-8182-46eb2a39cbae admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:28.867497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf47f7c-bf1c-42a0-8182-46eb2a39cbae admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:28.870536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf47f7c-bf1c-42a0-8182-46eb2a39cbae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:28.874887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:28.875727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:28.875972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf47f7c-bf1c-42a0-8182-46eb2a39cbae admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:28.876271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:28.876715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] PATH_INFO: `/v3/users/530e9a1a6601464c9f8271601233d7d3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:28.878294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] RBAC: Authorizing `identity:delete_user(user_id=530e9a1a6601464c9f8271601233d7d3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:28.881521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:28.964572 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2180/4382] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:07:28 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:28.970152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530e9a1a6601464c9f8271601233d7d3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.970367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf47f7c-bf1c-42a0-8182-46eb2a39cbae admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:28.982091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530e9a1a6601464c9f8271601233d7d3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.984694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530e9a1a6601464c9f8271601233d7d3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.985655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530e9a1a6601464c9f8271601233d7d3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:28.994631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:29.007419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530e9a1a6601464c9f8271601233d7d3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:29.033492 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2203/4383] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:07:28 2022] DELETE /identity/v3/users/530e9a1a6601464c9f8271601233d7d3 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:29.107530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf47f7c-bf1c-42a0-8182-46eb2a39cbae admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:29.300452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281f22f-5cce-44c2-bb68-d3e010698b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:29.301844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281f22f-5cce-44c2-bb68-d3e010698b8a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:29.302193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281f22f-5cce-44c2-bb68-d3e010698b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:29.302946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281f22f-5cce-44c2-bb68-d3e010698b8a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:29.303736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281f22f-5cce-44c2-bb68-d3e010698b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:29.306908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281f22f-5cce-44c2-bb68-d3e010698b8a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:29.367652 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2181/4384] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:07:28 2022] POST /identity/v3/users => generated 285 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:29.372156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:29.378902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:29.436224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50446d-25a0-407c-8a56-45954ca3eaea admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:29.476793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaddc9-dc3d-4902-9888-3e1489a5563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:29.479633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaddc9-dc3d-4902-9888-3e1489a5563e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:29.484869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaddc9-dc3d-4902-9888-3e1489a5563e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:29.485539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaddc9-dc3d-4902-9888-3e1489a5563e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:29.487044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacaddc9-dc3d-4902-9888-3e1489a5563e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:29.495336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacaddc9-dc3d-4902-9888-3e1489a5563e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:29.525064 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2204/4385] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:29.530401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281f22f-5cce-44c2-bb68-d3e010698b8a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:29.544772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281f22f-5cce-44c2-bb68-d3e010698b8a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:29.559753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeada103-3dc1-4a15-90cc-ddc1cd7fb4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:29.560366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeada103-3dc1-4a15-90cc-ddc1cd7fb4db admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:29.560662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeada103-3dc1-4a15-90cc-ddc1cd7fb4db admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:29.560898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeada103-3dc1-4a15-90cc-ddc1cd7fb4db admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:29.561577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeada103-3dc1-4a15-90cc-ddc1cd7fb4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:29.563182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeada103-3dc1-4a15-90cc-ddc1cd7fb4db admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:29.581571 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2182/4386] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:07:29.585883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaddc9-dc3d-4902-9888-3e1489a5563e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:29.601608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaddc9-dc3d-4902-9888-3e1489a5563e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:29.610235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf849c-f986-4ffc-857e-055687c1c1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:29.611296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf849c-f986-4ffc-857e-055687c1c1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:29.612374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf849c-f986-4ffc-857e-055687c1c1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:29.612931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf849c-f986-4ffc-857e-055687c1c1fe admin admin] PATH_INFO: `/v3/projects/4acc59093f954b61ba9f3cd05e940c28/users/b9cd61a0df164a9e9197022508adafbf/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:29.659000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf849c-f986-4ffc-857e-055687c1c1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4acc59093f954b61ba9f3cd05e940c28, user_id=b9cd61a0df164a9e9197022508adafbf, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:29.665176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf849c-f986-4ffc-857e-055687c1c1fe admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:29.681554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeada103-3dc1-4a15-90cc-ddc1cd7fb4db admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:29.685068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eeada103-3dc1-4a15-90cc-ddc1cd7fb4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:29.704742 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2205/4387] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:07:29 2022] PUT /identity/v3/projects/4acc59093f954b61ba9f3cd05e940c28/users/b9cd61a0df164a9e9197022508adafbf/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:29.717377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c84c1-de7f-45de-afe0-66637e3e1cb7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:29.717855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c84c1-de7f-45de-afe0-66637e3e1cb7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:29.718138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c84c1-de7f-45de-afe0-66637e3e1cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:29.744232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeada103-3dc1-4a15-90cc-ddc1cd7fb4db admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:29.751991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:29.758413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-482c84c1-de7f-45de-afe0-66637e3e1cb7 None None] MFA Rules not processed for user `b9cd61a0df164a9e9197022508adafbf`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:29.760423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-482c84c1-de7f-45de-afe0-66637e3e1cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:29.898397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18396e0c-c862-403a-ac05-63a01a8fabd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:29.899258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18396e0c-c862-403a-ac05-63a01a8fabd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:29.899593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18396e0c-c862-403a-ac05-63a01a8fabd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:29.899906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18396e0c-c862-403a-ac05-63a01a8fabd8 admin admin] PATH_INFO: `/v3/projects/a0118e9583a14a32aeabd7939df1bac7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:29.901378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18396e0c-c862-403a-ac05-63a01a8fabd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0118e9583a14a32aeabd7939df1bac7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:29.904240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18396e0c-c862-403a-ac05-63a01a8fabd8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:29.984240 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2206/4388] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:07:29.995202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b1664-a191-4f76-939d-3e5772d61428 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:29.995485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b1664-a191-4f76-939d-3e5772d61428 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:29.995777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b1664-a191-4f76-939d-3e5772d61428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:30.003221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:30.016593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-18396e0c-c862-403a-ac05-63a01a8fabd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0118e9583a14a32aeabd7939df1bac7', 'request_id': 'req-18396e0c-c862-403a-ac05-63a01a8fabd8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:30.034606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-18396e0c-c862-403a-ac05-63a01a8fabd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0118e9583a14a32aeabd7939df1bac7', 'request_id': 'req-18396e0c-c862-403a-ac05-63a01a8fabd8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:30.042493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-105b1664-a191-4f76-939d-3e5772d61428 None None] MFA Rules not processed for user `b9cd61a0df164a9e9197022508adafbf`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:30.044316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-105b1664-a191-4f76-939d-3e5772d61428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:30.057994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-18396e0c-c862-403a-ac05-63a01a8fabd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0118e9583a14a32aeabd7939df1bac7', 'request_id': 'req-18396e0c-c862-403a-ac05-63a01a8fabd8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:30.097754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-18396e0c-c862-403a-ac05-63a01a8fabd8 admin admin] The token cache is being invalidate because project a0118e9583a14a32aeabd7939df1bac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:07:30.111170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-18396e0c-c862-403a-ac05-63a01a8fabd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:30.113613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-18396e0c-c862-403a-ac05-63a01a8fabd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:30.123178 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2183/4389] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:29 2022] DELETE /identity/v3/projects/a0118e9583a14a32aeabd7939df1bac7 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:30.129838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdce8e-d9dd-48cc-ae55-acea5fcb5a92 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:30.133044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdce8e-d9dd-48cc-ae55-acea5fcb5a92 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:30.133683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdce8e-d9dd-48cc-ae55-acea5fcb5a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:30.230994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-43cdce8e-d9dd-48cc-ae55-acea5fcb5a92 None None] MFA Rules not processed for user `30fe0e1ffa1040ec85d3c32d8b741c75`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:30.233650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-43cdce8e-d9dd-48cc-ae55-acea5fcb5a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:30.242315 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2207/4390] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:30.244066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19733-9a38-4e42-9579-93eb881c41cf None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:30.245514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19733-9a38-4e42-9579-93eb881c41cf None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:30.246765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19733-9a38-4e42-9579-93eb881c41cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:30.308410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a4d19733-9a38-4e42-9579-93eb881c41cf None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:30.314101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a4d19733-9a38-4e42-9579-93eb881c41cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:30.428921 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2184/4391] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:30.430045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdce8e-d9dd-48cc-ae55-acea5fcb5a92 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:30.440752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-43cdce8e-d9dd-48cc-ae55-acea5fcb5a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:30.513051 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2208/4392] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:30.514754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae451c3-74ac-4594-9afe-c8466370a130 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:30.515271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae451c3-74ac-4594-9afe-c8466370a130 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:30.515956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae451c3-74ac-4594-9afe-c8466370a130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:30.564603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1ae451c3-74ac-4594-9afe-c8466370a130 None None] MFA Rules not processed for user `30fe0e1ffa1040ec85d3c32d8b741c75`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:30.570560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1ae451c3-74ac-4594-9afe-c8466370a130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:30.588081 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2209/4393] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:30.591113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb17174-a077-43ef-b26a-47308830fc13 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:30.593002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb17174-a077-43ef-b26a-47308830fc13 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:30.593523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb17174-a077-43ef-b26a-47308830fc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:30.622573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdce8e-d9dd-48cc-ae55-acea5fcb5a92 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:30.635380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2fd04-0847-406e-88d4-d7ecab10da1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:30.636009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2fd04-0847-406e-88d4-d7ecab10da1b service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:30.636624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2fd04-0847-406e-88d4-d7ecab10da1b service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:30.636624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2fd04-0847-406e-88d4-d7ecab10da1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:30.643674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-24c2fd04-0847-406e-88d4-d7ecab10da1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:30.651311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fbb17174-a077-43ef-b26a-47308830fc13 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:30.655176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fbb17174-a077-43ef-b26a-47308830fc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:30.665324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2fd04-0847-406e-88d4-d7ecab10da1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:30.669689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2fd04-0847-406e-88d4-d7ecab10da1b service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:30.677078 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2210/4394] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:30.679358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb17174-a077-43ef-b26a-47308830fc13 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:30.682586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fbb17174-a077-43ef-b26a-47308830fc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:30.696835 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2185/4395] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:30.711849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2fd04-0847-406e-88d4-d7ecab10da1b service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:30.724502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb17174-a077-43ef-b26a-47308830fc13 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:30.737050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2fd04-0847-406e-88d4-d7ecab10da1b service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:30.745434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fedf0-9ea7-4e14-9518-11a424cad841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:30.747263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fedf0-9ea7-4e14-9518-11a424cad841 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:30.747583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291cfb7-55c6-484c-aa21-fd0b8c346c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:30.747947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fedf0-9ea7-4e14-9518-11a424cad841 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:30.749745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fedf0-9ea7-4e14-9518-11a424cad841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:30.751073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291cfb7-55c6-484c-aa21-fd0b8c346c89 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:30.751369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291cfb7-55c6-484c-aa21-fd0b8c346c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:30.751691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291cfb7-55c6-484c-aa21-fd0b8c346c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:30.752375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291cfb7-55c6-484c-aa21-fd0b8c346c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:07:30.752689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291cfb7-55c6-484c-aa21-fd0b8c346c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:30.754322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291cfb7-55c6-484c-aa21-fd0b8c346c89 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:30.775064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fedf0-9ea7-4e14-9518-11a424cad841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:30.776674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fedf0-9ea7-4e14-9518-11a424cad841 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:30.783696 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2186/4396] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:07:30.792271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291cfb7-55c6-484c-aa21-fd0b8c346c89 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:30.810349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291cfb7-55c6-484c-aa21-fd0b8c346c89 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:30.822219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9da01b-2198-4fe0-a4e9-9ff335ae5057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:30.822765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da01b-2198-4fe0-a4e9-9ff335ae5057 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:30.823046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da01b-2198-4fe0-a4e9-9ff335ae5057 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:30.823320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da01b-2198-4fe0-a4e9-9ff335ae5057 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:30.823954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9da01b-2198-4fe0-a4e9-9ff335ae5057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:30.828163 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2211/4397] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:30.829936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9da01b-2198-4fe0-a4e9-9ff335ae5057 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:30.896963 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2187/4398] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:07:30 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:30.901333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fedf0-9ea7-4e14-9518-11a424cad841 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:30.920929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fedf0-9ea7-4e14-9518-11a424cad841 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:30.991938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:31.133747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad8060-87b3-4fc4-b175-b4cfa3acbe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:31.134460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad8060-87b3-4fc4-b175-b4cfa3acbe14 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:31.134699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad8060-87b3-4fc4-b175-b4cfa3acbe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:31.134905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad8060-87b3-4fc4-b175-b4cfa3acbe14 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:31.135536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad8060-87b3-4fc4-b175-b4cfa3acbe14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:31.137505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad8060-87b3-4fc4-b175-b4cfa3acbe14 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:31.173389 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2212/4399] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:07:30 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:07:31.175068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9da01b-2198-4fe0-a4e9-9ff335ae5057 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:31.193759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9da01b-2198-4fe0-a4e9-9ff335ae5057 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:31.217822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042b940-9c2f-40ad-89a1-24215ca5db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:31.218457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042b940-9c2f-40ad-89a1-24215ca5db68 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:31.218742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042b940-9c2f-40ad-89a1-24215ca5db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:31.219016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042b940-9c2f-40ad-89a1-24215ca5db68 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:31.219841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042b940-9c2f-40ad-89a1-24215ca5db68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:31.221490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042b940-9c2f-40ad-89a1-24215ca5db68 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:31.243791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:31.266197 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2188/4400] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:31.269965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad8060-87b3-4fc4-b175-b4cfa3acbe14 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:31.287310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad8060-87b3-4fc4-b175-b4cfa3acbe14 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:31.303113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4be9c-1187-4e18-94c6-b10fb1f25324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:31.304053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4be9c-1187-4e18-94c6-b10fb1f25324 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:31.304412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4be9c-1187-4e18-94c6-b10fb1f25324 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:31.304624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4be9c-1187-4e18-94c6-b10fb1f25324 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:31.305270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4be9c-1187-4e18-94c6-b10fb1f25324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:31.312394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4be9c-1187-4e18-94c6-b10fb1f25324 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:31.360902 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2213/4401] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:31.363014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042b940-9c2f-40ad-89a1-24215ca5db68 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:31.386381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042b940-9c2f-40ad-89a1-24215ca5db68 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:31.405933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ca4e0-c0e1-4f75-ba6a-29c1fa51b02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:31.406907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca4e0-c0e1-4f75-ba6a-29c1fa51b02c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:31.407201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca4e0-c0e1-4f75-ba6a-29c1fa51b02c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:31.407479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca4e0-c0e1-4f75-ba6a-29c1fa51b02c admin admin] PATH_INFO: `/v3/projects/0c522dd2db064d0bb23af9d9a557db0a/users/194e92704bcb4a6ab9a6769978a3d7b7/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:31.463943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ca4e0-c0e1-4f75-ba6a-29c1fa51b02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c522dd2db064d0bb23af9d9a557db0a, user_id=194e92704bcb4a6ab9a6769978a3d7b7, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:31.466768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ca4e0-c0e1-4f75-ba6a-29c1fa51b02c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:31.531256 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2189/4402] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:07:31 2022] PUT /identity/v3/projects/0c522dd2db064d0bb23af9d9a557db0a/users/194e92704bcb4a6ab9a6769978a3d7b7/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:31.543133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04320215-8afc-45bb-915e-2d99a8b20b26 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:31.543441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04320215-8afc-45bb-915e-2d99a8b20b26 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:31.543718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04320215-8afc-45bb-915e-2d99a8b20b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:31.652634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-04320215-8afc-45bb-915e-2d99a8b20b26 None None] MFA Rules not processed for user `194e92704bcb4a6ab9a6769978a3d7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:31.656435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-04320215-8afc-45bb-915e-2d99a8b20b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:31.866644 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2214/4403] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:31.881033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ca4e0-c0e1-4f75-ba6a-29c1fa51b02c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:31.883233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-332ca4e0-c0e1-4f75-ba6a-29c1fa51b02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:32.102710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ca4e0-c0e1-4f75-ba6a-29c1fa51b02c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:32.110662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84c470-b95d-4db7-9a0c-889f37519706 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:32.111386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c470-b95d-4db7-9a0c-889f37519706 service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:32.111686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c470-b95d-4db7-9a0c-889f37519706 service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:32.112027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c470-b95d-4db7-9a0c-889f37519706 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:32.169227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84c470-b95d-4db7-9a0c-889f37519706 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:32.179206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84c470-b95d-4db7-9a0c-889f37519706 service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:32.219369 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2190/4404] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:32.752079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04320215-8afc-45bb-915e-2d99a8b20b26 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:32.785154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84c470-b95d-4db7-9a0c-889f37519706 service glance] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:32.949542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04320215-8afc-45bb-915e-2d99a8b20b26 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:32.958879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:32.961153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:32.963428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:32.963926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] PATH_INFO: `/v3/users/194e92704bcb4a6ab9a6769978a3d7b7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:32.968434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=194e92704bcb4a6ab9a6769978a3d7b7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:32.970415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:32.979417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84c470-b95d-4db7-9a0c-889f37519706 service glance] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:32.998326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07b6b8-5517-4da3-9ec2-8e18e2e72119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:32.998945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07b6b8-5517-4da3-9ec2-8e18e2e72119 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:32.999223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07b6b8-5517-4da3-9ec2-8e18e2e72119 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:32.999492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07b6b8-5517-4da3-9ec2-8e18e2e72119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:33.002954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9e07b6b8-5517-4da3-9ec2-8e18e2e72119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:33.055702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07b6b8-5517-4da3-9ec2-8e18e2e72119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:33.058113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07b6b8-5517-4da3-9ec2-8e18e2e72119 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:33.064538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:33.092467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194e92704bcb4a6ab9a6769978a3d7b7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:33.093374 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2191/4405] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:33.110688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194e92704bcb4a6ab9a6769978a3d7b7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:33.113430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194e92704bcb4a6ab9a6769978a3d7b7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:33.116013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194e92704bcb4a6ab9a6769978a3d7b7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:33.150490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194e92704bcb4a6ab9a6769978a3d7b7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:33.189078 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2215/4406] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:07:32 2022] DELETE /identity/v3/users/194e92704bcb4a6ab9a6769978a3d7b7 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:33.195194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599c99b-89db-4f9a-9b8a-ca9d83ec5751 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:33.195681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599c99b-89db-4f9a-9b8a-ca9d83ec5751 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:33.195829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599c99b-89db-4f9a-9b8a-ca9d83ec5751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:33.228790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c599c99b-89db-4f9a-9b8a-ca9d83ec5751 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:33.230224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c599c99b-89db-4f9a-9b8a-ca9d83ec5751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:33.403673 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2192/4407] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:33.529403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:33.531022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:33.715540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed38b34-150c-4e73-91d5-83240433ee9a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:33.729124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b76d00-9850-42c1-897d-6aef9cc91f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:33.729962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b76d00-9850-42c1-897d-6aef9cc91f3b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:33.730382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b76d00-9850-42c1-897d-6aef9cc91f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:33.734490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b76d00-9850-42c1-897d-6aef9cc91f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:33.758908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b76d00-9850-42c1-897d-6aef9cc91f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:33.761651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b76d00-9850-42c1-897d-6aef9cc91f3b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:33.776242 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2216/4408] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:35.184380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599c99b-89db-4f9a-9b8a-ca9d83ec5751 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:35.185951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c599c99b-89db-4f9a-9b8a-ca9d83ec5751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:35.198659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:35.210208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599c99b-89db-4f9a-9b8a-ca9d83ec5751 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:35.222396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3a417-705d-46c9-88f7-66ce9600b7e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:35.223038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3a417-705d-46c9-88f7-66ce9600b7e4 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:35.223281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3a417-705d-46c9-88f7-66ce9600b7e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:35.223577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3a417-705d-46c9-88f7-66ce9600b7e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:35.229062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71d49-80fc-40c8-9f67-f667c1d810e1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:35.229632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71d49-80fc-40c8-9f67-f667c1d810e1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:35.229632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71d49-80fc-40c8-9f67-f667c1d810e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:35.237101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0fd3a417-705d-46c9-88f7-66ce9600b7e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:35.263161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1fd71d49-80fc-40c8-9f67-f667c1d810e1 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:35.264509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3a417-705d-46c9-88f7-66ce9600b7e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:35.266810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3a417-705d-46c9-88f7-66ce9600b7e4 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:35.270772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1fd71d49-80fc-40c8-9f67-f667c1d810e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:35.286936 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2193/4409] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:35.371029 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2217/4410] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:35.400829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3a417-705d-46c9-88f7-66ce9600b7e4 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:35.402352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0fd3a417-705d-46c9-88f7-66ce9600b7e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:35.594468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3a417-705d-46c9-88f7-66ce9600b7e4 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:35.611615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7cc0c-fca6-4cc1-afd3-b2534c527521 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:35.612492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7cc0c-fca6-4cc1-afd3-b2534c527521 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:35.612852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7cc0c-fca6-4cc1-afd3-b2534c527521 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:35.613325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7cc0c-fca6-4cc1-afd3-b2534c527521 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:35.634385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7cc0c-fca6-4cc1-afd3-b2534c527521 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:35.635998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7cc0c-fca6-4cc1-afd3-b2534c527521 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:35.657384 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2194/4411] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:07:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:35.751184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd71d49-80fc-40c8-9f67-f667c1d810e1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:35.752700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1fd71d49-80fc-40c8-9f67-f667c1d810e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:35.798110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd71d49-80fc-40c8-9f67-f667c1d810e1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:35.812319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecd346-b263-4977-b98a-db547d71a50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:35.812964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecd346-b263-4977-b98a-db547d71a50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:35.813281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecd346-b263-4977-b98a-db547d71a50d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:35.813803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecd346-b263-4977-b98a-db547d71a50d admin admin] PATH_INFO: `/v3/projects/0c522dd2db064d0bb23af9d9a557db0a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:35.822087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecd346-b263-4977-b98a-db547d71a50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c522dd2db064d0bb23af9d9a557db0a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:35.824032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecd346-b263-4977-b98a-db547d71a50d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:36.009066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-caecd346-b263-4977-b98a-db547d71a50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c522dd2db064d0bb23af9d9a557db0a', 'request_id': 'req-caecd346-b263-4977-b98a-db547d71a50d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:36.024342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:36.044189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-caecd346-b263-4977-b98a-db547d71a50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c522dd2db064d0bb23af9d9a557db0a', 'request_id': 'req-caecd346-b263-4977-b98a-db547d71a50d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:36.083508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-caecd346-b263-4977-b98a-db547d71a50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c522dd2db064d0bb23af9d9a557db0a', 'request_id': 'req-caecd346-b263-4977-b98a-db547d71a50d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:36.127577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-caecd346-b263-4977-b98a-db547d71a50d admin admin] The token cache is being invalidate because project 0c522dd2db064d0bb23af9d9a557db0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:07:36.128154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-caecd346-b263-4977-b98a-db547d71a50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:36.131264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-caecd346-b263-4977-b98a-db547d71a50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:36.139354 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2218/4412] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:35 2022] DELETE /identity/v3/projects/0c522dd2db064d0bb23af9d9a557db0a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:07:36.141383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bae4a9-3251-4bdf-855d-56d23f51d859 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:36.142595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bae4a9-3251-4bdf-855d-56d23f51d859 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:36.143214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bae4a9-3251-4bdf-855d-56d23f51d859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:36.217071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-23bae4a9-3251-4bdf-855d-56d23f51d859 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:36.221759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-23bae4a9-3251-4bdf-855d-56d23f51d859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:36.331654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3deb0d-1725-4a3f-aa55-b54c331ec16a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:36.332238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3deb0d-1725-4a3f-aa55-b54c331ec16a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:36.332238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3deb0d-1725-4a3f-aa55-b54c331ec16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:36.475865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ed3deb0d-1725-4a3f-aa55-b54c331ec16a None None] MFA Rules not processed for user `d78e9afd772c4de981cac8f5817ec356`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:36.480515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ed3deb0d-1725-4a3f-aa55-b54c331ec16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:36.484031 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2195/4413] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:36.496766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8b3bb-5702-439e-84d9-9bad76146118 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:36.499736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8b3bb-5702-439e-84d9-9bad76146118 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:36.501804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8b3bb-5702-439e-84d9-9bad76146118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:36.588459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-46a8b3bb-5702-439e-84d9-9bad76146118 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:36.590168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-46a8b3bb-5702-439e-84d9-9bad76146118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:36.610689 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2196/4414] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:36.615579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8b3bb-5702-439e-84d9-9bad76146118 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:36.631962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8b3bb-5702-439e-84d9-9bad76146118 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:36.640909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f4a98-a285-400a-8da7-d6acf3c5b4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:36.641593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4a98-a285-400a-8da7-d6acf3c5b4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:36.642114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4a98-a285-400a-8da7-d6acf3c5b4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:36.642241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4a98-a285-400a-8da7-d6acf3c5b4f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:36.643997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f4a98-a285-400a-8da7-d6acf3c5b4f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:07:36.644318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f4a98-a285-400a-8da7-d6acf3c5b4f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:36.646063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f4a98-a285-400a-8da7-d6acf3c5b4f6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:36.664475 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2219/4415] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:36.672085 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2197/4416] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:07:36.672435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3deb0d-1725-4a3f-aa55-b54c331ec16a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:36.693502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a024f4f-76b1-45b5-9305-015c8d5b6e3a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:36.696792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a024f4f-76b1-45b5-9305-015c8d5b6e3a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:36.697146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a024f4f-76b1-45b5-9305-015c8d5b6e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:36.718951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3deb0d-1725-4a3f-aa55-b54c331ec16a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:36.753683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0bda1-adfe-4ebc-8056-7747a009e6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:36.754632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0bda1-adfe-4ebc-8056-7747a009e6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:36.755117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0bda1-adfe-4ebc-8056-7747a009e6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:36.755568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0bda1-adfe-4ebc-8056-7747a009e6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:36.757010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0bda1-adfe-4ebc-8056-7747a009e6c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:36.759313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0bda1-adfe-4ebc-8056-7747a009e6c9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:36.788232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4a024f4f-76b1-45b5-9305-015c8d5b6e3a None None] MFA Rules not processed for user `d78e9afd772c4de981cac8f5817ec356`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:36.797440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4a024f4f-76b1-45b5-9305-015c8d5b6e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:36.834995 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2198/4417] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:36.878873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a024f4f-76b1-45b5-9305-015c8d5b6e3a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:36.888438 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2220/4418] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:07:36 2022] POST /identity/v3/projects => generated 389 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:07:36.896006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a024f4f-76b1-45b5-9305-015c8d5b6e3a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:37.072213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:37.090964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eb8c6-9062-4968-be6e-dd69923ab179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:37.093559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eb8c6-9062-4968-be6e-dd69923ab179 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:37.094251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eb8c6-9062-4968-be6e-dd69923ab179 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:37.095508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eb8c6-9062-4968-be6e-dd69923ab179 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:37.100426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eb8c6-9062-4968-be6e-dd69923ab179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:37.109413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eb8c6-9062-4968-be6e-dd69923ab179 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:37.186876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0bda1-adfe-4ebc-8056-7747a009e6c9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:37.207766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0bda1-adfe-4ebc-8056-7747a009e6c9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:37.217274 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2199/4419] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:07:36 2022] POST /identity/v3/users => generated 295 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:07:37.221958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb42a95-52fa-4ac3-8ebb-dd4382820467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:37.222946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb42a95-52fa-4ac3-8ebb-dd4382820467 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:37.223372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb42a95-52fa-4ac3-8ebb-dd4382820467 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:37.223748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb42a95-52fa-4ac3-8ebb-dd4382820467 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:37.224508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb42a95-52fa-4ac3-8ebb-dd4382820467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:37.227399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb42a95-52fa-4ac3-8ebb-dd4382820467 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:37.239721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eb8c6-9062-4968-be6e-dd69923ab179 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:37.241900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-df1eb8c6-9062-4968-be6e-dd69923ab179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:37.254457 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2221/4420] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:37.258960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb42a95-52fa-4ac3-8ebb-dd4382820467 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:37.280394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb42a95-52fa-4ac3-8ebb-dd4382820467 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:37.295894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526f6d5-1935-4931-81f3-03084df58632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:37.296972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526f6d5-1935-4931-81f3-03084df58632 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:37.297340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526f6d5-1935-4931-81f3-03084df58632 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:37.297832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526f6d5-1935-4931-81f3-03084df58632 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:37.317828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526f6d5-1935-4931-81f3-03084df58632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:37.319719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526f6d5-1935-4931-81f3-03084df58632 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:37.345635 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2222/4421] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:37.347778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526f6d5-1935-4931-81f3-03084df58632 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:37.365153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526f6d5-1935-4931-81f3-03084df58632 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:37.392953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f828c9e-0548-4f5c-b297-daa1d27dc0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:37.394028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f828c9e-0548-4f5c-b297-daa1d27dc0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:37.394028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f828c9e-0548-4f5c-b297-daa1d27dc0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:37.394598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f828c9e-0548-4f5c-b297-daa1d27dc0a4 admin admin] PATH_INFO: `/v3/projects/925353883d5a4829996408ca5e6839f5/users/2068ab5af67c4585ace667a896c37dc4/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:37.409719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eb8c6-9062-4968-be6e-dd69923ab179 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:37.418249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2f105-2049-4060-aa98-89d3482cc79b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:37.418886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2f105-2049-4060-aa98-89d3482cc79b service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:37.419389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f828c9e-0548-4f5c-b297-daa1d27dc0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925353883d5a4829996408ca5e6839f5, user_id=2068ab5af67c4585ace667a896c37dc4, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:37.419525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2f105-2049-4060-aa98-89d3482cc79b service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:37.419696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2f105-2049-4060-aa98-89d3482cc79b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:37.423486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f828c9e-0548-4f5c-b297-daa1d27dc0a4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:37.447238 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2223/4422] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:07:37 2022] PUT /identity/v3/projects/925353883d5a4829996408ca5e6839f5/users/2068ab5af67c4585ace667a896c37dc4/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:37.556084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2f105-2049-4060-aa98-89d3482cc79b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:37.557985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2f105-2049-4060-aa98-89d3482cc79b service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:37.563276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d929ad-1a4a-4f45-9b2f-2ff8ebba00c9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:37.563942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d929ad-1a4a-4f45-9b2f-2ff8ebba00c9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:37.564406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d929ad-1a4a-4f45-9b2f-2ff8ebba00c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:37.574000 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2200/4423] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:37.625122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-27d929ad-1a4a-4f45-9b2f-2ff8ebba00c9 None None] MFA Rules not processed for user `2068ab5af67c4585ace667a896c37dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:37.626810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-27d929ad-1a4a-4f45-9b2f-2ff8ebba00c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:37.711924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:37.757750 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2224/4424] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:37.793830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2f105-2049-4060-aa98-89d3482cc79b service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:37.796246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3ad2f105-2049-4060-aa98-89d3482cc79b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:37.954858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2f105-2049-4060-aa98-89d3482cc79b service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:38.042376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:38.080707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b16a67-b411-4230-aeb8-3a8559199f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:38.081382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b16a67-b411-4230-aeb8-3a8559199f46 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:38.081682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b16a67-b411-4230-aeb8-3a8559199f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:38.081966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b16a67-b411-4230-aeb8-3a8559199f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:38.114997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b16a67-b411-4230-aeb8-3a8559199f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:38.116990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b16a67-b411-4230-aeb8-3a8559199f46 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:38.130723 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2201/4425] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:38.221315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d929ad-1a4a-4f45-9b2f-2ff8ebba00c9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:38.347298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d929ad-1a4a-4f45-9b2f-2ff8ebba00c9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:38.364195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:38.365063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:38.365511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:38.365793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] PATH_INFO: `/v3/users/2068ab5af67c4585ace667a896c37dc4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:38.374232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2068ab5af67c4585ace667a896c37dc4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:38.376192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:38.539600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2068ab5af67c4585ace667a896c37dc4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:38.557382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2068ab5af67c4585ace667a896c37dc4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:38.559810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2068ab5af67c4585ace667a896c37dc4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:38.561555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2068ab5af67c4585ace667a896c37dc4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:38.591090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2068ab5af67c4585ace667a896c37dc4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:38.622189 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2225/4426] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:07:38 2022] DELETE /identity/v3/users/2068ab5af67c4585ace667a896c37dc4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:38.626926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943e2a4-4776-4c7d-8653-4d1e63076ccd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:38.628606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943e2a4-4776-4c7d-8653-4d1e63076ccd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:38.629139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943e2a4-4776-4c7d-8653-4d1e63076ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:38.663757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8943e2a4-4776-4c7d-8653-4d1e63076ccd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:38.666600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8943e2a4-4776-4c7d-8653-4d1e63076ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:38.896106 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2202/4427] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:38.939570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:38.941553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:39.134507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66c9b3-3c25-4538-9f27-6c5754378f23 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:39.146817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb457c-12b1-4b5b-aa5a-9e46a726bc14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:39.147457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb457c-12b1-4b5b-aa5a-9e46a726bc14 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:39.147737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb457c-12b1-4b5b-aa5a-9e46a726bc14 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:39.148012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb457c-12b1-4b5b-aa5a-9e46a726bc14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:39.160666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb457c-12b1-4b5b-aa5a-9e46a726bc14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:39.162239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb457c-12b1-4b5b-aa5a-9e46a726bc14 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:39.178114 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2226/4428] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:40.296442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943e2a4-4776-4c7d-8653-4d1e63076ccd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:40.300072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8943e2a4-4776-4c7d-8653-4d1e63076ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:40.341797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943e2a4-4776-4c7d-8653-4d1e63076ccd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:40.352366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54afe9-136a-4134-9041-84b1c519b7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:40.363047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54afe9-136a-4134-9041-84b1c519b7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:40.363696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54afe9-136a-4134-9041-84b1c519b7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:40.364149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54afe9-136a-4134-9041-84b1c519b7b4 admin admin] PATH_INFO: `/v3/projects/925353883d5a4829996408ca5e6839f5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:40.367389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54afe9-136a-4134-9041-84b1c519b7b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=925353883d5a4829996408ca5e6839f5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:40.370701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54afe9-136a-4134-9041-84b1c519b7b4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:40.463618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eb54afe9-136a-4134-9041-84b1c519b7b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925353883d5a4829996408ca5e6839f5', 'request_id': 'req-eb54afe9-136a-4134-9041-84b1c519b7b4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:40.482641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eb54afe9-136a-4134-9041-84b1c519b7b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925353883d5a4829996408ca5e6839f5', 'request_id': 'req-eb54afe9-136a-4134-9041-84b1c519b7b4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:40.498535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eb54afe9-136a-4134-9041-84b1c519b7b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925353883d5a4829996408ca5e6839f5', 'request_id': 'req-eb54afe9-136a-4134-9041-84b1c519b7b4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:40.531525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eb54afe9-136a-4134-9041-84b1c519b7b4 admin admin] The token cache is being invalidate because project 925353883d5a4829996408ca5e6839f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:07:40.533102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eb54afe9-136a-4134-9041-84b1c519b7b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:40.534274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eb54afe9-136a-4134-9041-84b1c519b7b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:40.536952 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2203/4429] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:40 2022] DELETE /identity/v3/projects/925353883d5a4829996408ca5e6839f5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:40.542010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559a0a7-860d-40bb-bb0e-215de6a3efea None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:40.543074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559a0a7-860d-40bb-bb0e-215de6a3efea None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:40.544403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559a0a7-860d-40bb-bb0e-215de6a3efea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:40.569084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0559a0a7-860d-40bb-bb0e-215de6a3efea None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:40.571375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0559a0a7-860d-40bb-bb0e-215de6a3efea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:40.583257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:40.682528 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2227/4430] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:40.691108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69304d-e5b7-4bbc-8b76-cc6b7060b038 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:40.691779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69304d-e5b7-4bbc-8b76-cc6b7060b038 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:40.692225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69304d-e5b7-4bbc-8b76-cc6b7060b038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:40.750618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9c69304d-e5b7-4bbc-8b76-cc6b7060b038 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:40.757958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9c69304d-e5b7-4bbc-8b76-cc6b7060b038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:40.783515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559a0a7-860d-40bb-bb0e-215de6a3efea None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:40.796186 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2204/4431] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:40.803258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559a0a7-860d-40bb-bb0e-215de6a3efea None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:40.815207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87083f68-2128-41c8-982b-9325a8adc561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:40.816072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87083f68-2128-41c8-982b-9325a8adc561 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:40.817008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87083f68-2128-41c8-982b-9325a8adc561 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:40.817510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87083f68-2128-41c8-982b-9325a8adc561 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:40.818485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87083f68-2128-41c8-982b-9325a8adc561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:07:40.818961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87083f68-2128-41c8-982b-9325a8adc561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:40.826834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87083f68-2128-41c8-982b-9325a8adc561 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:40.847033 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2228/4432] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:07:40.852301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69304d-e5b7-4bbc-8b76-cc6b7060b038 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:40.871056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69304d-e5b7-4bbc-8b76-cc6b7060b038 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:40.878480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31436f-186e-404b-b5f6-ecd11593f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:40.879619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31436f-186e-404b-b5f6-ecd11593f5da admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:40.880131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31436f-186e-404b-b5f6-ecd11593f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:40.880737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31436f-186e-404b-b5f6-ecd11593f5da admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:40.881855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31436f-186e-404b-b5f6-ecd11593f5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:40.884422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31436f-186e-404b-b5f6-ecd11593f5da admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:41.030576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87083f68-2128-41c8-982b-9325a8adc561 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:41.033831 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2205/4433] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:07:40 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:41.054427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87083f68-2128-41c8-982b-9325a8adc561 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:41.195325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daf794-b18a-40d2-a3fe-1c8acceb5e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:41.196188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daf794-b18a-40d2-a3fe-1c8acceb5e6b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:41.196829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daf794-b18a-40d2-a3fe-1c8acceb5e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:41.197545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daf794-b18a-40d2-a3fe-1c8acceb5e6b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:41.211680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daf794-b18a-40d2-a3fe-1c8acceb5e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:41.215267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daf794-b18a-40d2-a3fe-1c8acceb5e6b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:41.255071 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2229/4434] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:07:41 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:41.259926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31436f-186e-404b-b5f6-ecd11593f5da admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:41.275646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31436f-186e-404b-b5f6-ecd11593f5da admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:41.289742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59411a-e91b-40c7-b91d-0e76bddb5471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:41.290843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59411a-e91b-40c7-b91d-0e76bddb5471 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:41.290843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59411a-e91b-40c7-b91d-0e76bddb5471 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:41.290843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59411a-e91b-40c7-b91d-0e76bddb5471 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:41.291514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59411a-e91b-40c7-b91d-0e76bddb5471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:41.297857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59411a-e91b-40c7-b91d-0e76bddb5471 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:41.328446 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2206/4435] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:41.333291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daf794-b18a-40d2-a3fe-1c8acceb5e6b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:41.349382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daf794-b18a-40d2-a3fe-1c8acceb5e6b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:41.362693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aca220-1a20-4356-9bb7-b5085c41af50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:41.364838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aca220-1a20-4356-9bb7-b5085c41af50 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:41.365555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aca220-1a20-4356-9bb7-b5085c41af50 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:41.367328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aca220-1a20-4356-9bb7-b5085c41af50 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:41.368279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aca220-1a20-4356-9bb7-b5085c41af50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:41.373239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aca220-1a20-4356-9bb7-b5085c41af50 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:41.409289 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2230/4436] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:41.411028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59411a-e91b-40c7-b91d-0e76bddb5471 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:41.428439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59411a-e91b-40c7-b91d-0e76bddb5471 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:41.435920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f33a4-afbb-429c-ba9d-224b51fc6c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:41.458140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f33a4-afbb-429c-ba9d-224b51fc6c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:41.460177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f33a4-afbb-429c-ba9d-224b51fc6c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:41.461540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f33a4-afbb-429c-ba9d-224b51fc6c16 admin admin] PATH_INFO: `/v3/projects/c9ac5543ac3c486b8396d42f66de5d11/users/20e91ce9c7ee41889183a4a20536a374/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:41.502604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f33a4-afbb-429c-ba9d-224b51fc6c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ac5543ac3c486b8396d42f66de5d11, user_id=20e91ce9c7ee41889183a4a20536a374, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:41.507634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f33a4-afbb-429c-ba9d-224b51fc6c16 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:41.531789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:41.545440 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2207/4437] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:07:41 2022] PUT /identity/v3/projects/c9ac5543ac3c486b8396d42f66de5d11/users/20e91ce9c7ee41889183a4a20536a374/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:07:41.551760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073d36-2daa-4e90-b17a-529078b2e666 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:41.553293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073d36-2daa-4e90-b17a-529078b2e666 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:41.554218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb073d36-2daa-4e90-b17a-529078b2e666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:41.641300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cb073d36-2daa-4e90-b17a-529078b2e666 None None] MFA Rules not processed for user `20e91ce9c7ee41889183a4a20536a374`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:41.642934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cb073d36-2daa-4e90-b17a-529078b2e666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:41.814908 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2231/4438] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:41.827877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f33a4-afbb-429c-ba9d-224b51fc6c16 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:41.829666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c94f33a4-afbb-429c-ba9d-224b51fc6c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:41.931385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f33a4-afbb-429c-ba9d-224b51fc6c16 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:41.937785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed6b69-964f-45bf-86fa-5da5259b5c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:41.938435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed6b69-964f-45bf-86fa-5da5259b5c80 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:41.938793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed6b69-964f-45bf-86fa-5da5259b5c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:41.939147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed6b69-964f-45bf-86fa-5da5259b5c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:41.951638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed6b69-964f-45bf-86fa-5da5259b5c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:41.954087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed6b69-964f-45bf-86fa-5da5259b5c80 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:41.979645 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2208/4439] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:44.011242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb073d36-2daa-4e90-b17a-529078b2e666 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:44.014486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cb073d36-2daa-4e90-b17a-529078b2e666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:44.043988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:44.157340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb073d36-2daa-4e90-b17a-529078b2e666 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:44.185950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b655-56b1-4bf0-8bd9-43bec25afdec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:44.186669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b655-56b1-4bf0-8bd9-43bec25afdec service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:44.188380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b655-56b1-4bf0-8bd9-43bec25afdec service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:44.188667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b655-56b1-4bf0-8bd9-43bec25afdec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:44.194460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d50b655-56b1-4bf0-8bd9-43bec25afdec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:44.229043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50b655-56b1-4bf0-8bd9-43bec25afdec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:44.231394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50b655-56b1-4bf0-8bd9-43bec25afdec service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:44.261463 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2232/4440] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:46.342115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbc97f-3cca-46e6-a768-a8cd20af4c8d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:46.342824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbc97f-3cca-46e6-a768-a8cd20af4c8d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:46.342824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbc97f-3cca-46e6-a768-a8cd20af4c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:46.391484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d2cbc97f-3cca-46e6-a768-a8cd20af4c8d None None] MFA Rules not processed for user `06443b5728fb4d1e95d6245820e786bf`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:46.392794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d2cbc97f-3cca-46e6-a768-a8cd20af4c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:46.509732 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2209/4441] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:51.531169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b655-56b1-4bf0-8bd9-43bec25afdec service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:51.665393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b655-56b1-4bf0-8bd9-43bec25afdec service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:51.672490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:51.673666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:51.674291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:51.674748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] PATH_INFO: `/v3/users/20e91ce9c7ee41889183a4a20536a374` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:51.676097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e91ce9c7ee41889183a4a20536a374)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:51.678122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:51.774013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e91ce9c7ee41889183a4a20536a374'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:51.785639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e91ce9c7ee41889183a4a20536a374'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:51.786704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e91ce9c7ee41889183a4a20536a374'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:51.787967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e91ce9c7ee41889183a4a20536a374'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:51.805478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e91ce9c7ee41889183a4a20536a374'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:51.822098 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2233/4442] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:07:51 2022] DELETE /identity/v3/users/20e91ce9c7ee41889183a4a20536a374 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:51.827268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d6c1a-bf9f-4d09-9c17-f8db61892cdf None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:51.827809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d6c1a-bf9f-4d09-9c17-f8db61892cdf None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:51.827809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d6c1a-bf9f-4d09-9c17-f8db61892cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:51.849098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-422d6c1a-bf9f-4d09-9c17-f8db61892cdf None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:51.850924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-422d6c1a-bf9f-4d09-9c17-f8db61892cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:51.920128 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2210/4443] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:51.934940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:51.936694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:51.963796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:52.057502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b7701-e344-42bd-bc78-9b228dc29c97 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:52.063084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18355653-20d3-4dca-a155-f7d90e2c3793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:52.063842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18355653-20d3-4dca-a155-f7d90e2c3793 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:52.064228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18355653-20d3-4dca-a155-f7d90e2c3793 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:52.064609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18355653-20d3-4dca-a155-f7d90e2c3793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:52.077857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18355653-20d3-4dca-a155-f7d90e2c3793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:52.080322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18355653-20d3-4dca-a155-f7d90e2c3793 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:52.098313 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2234/4444] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:52.664218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d6c1a-bf9f-4d09-9c17-f8db61892cdf None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:52.665692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-422d6c1a-bf9f-4d09-9c17-f8db61892cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:52.684532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d6c1a-bf9f-4d09-9c17-f8db61892cdf None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:52.692694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bafc09-57bb-4227-91df-59169ca7ec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:52.695458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bafc09-57bb-4227-91df-59169ca7ec96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:52.696113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bafc09-57bb-4227-91df-59169ca7ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:52.696968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bafc09-57bb-4227-91df-59169ca7ec96 admin admin] PATH_INFO: `/v3/projects/c9ac5543ac3c486b8396d42f66de5d11` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:52.701024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bafc09-57bb-4227-91df-59169ca7ec96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ac5543ac3c486b8396d42f66de5d11)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:52.705074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bafc09-57bb-4227-91df-59169ca7ec96 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:52.802410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:52.809143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b6bafc09-57bb-4227-91df-59169ca7ec96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ac5543ac3c486b8396d42f66de5d11', 'request_id': 'req-b6bafc09-57bb-4227-91df-59169ca7ec96'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:52.826176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b6bafc09-57bb-4227-91df-59169ca7ec96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ac5543ac3c486b8396d42f66de5d11', 'request_id': 'req-b6bafc09-57bb-4227-91df-59169ca7ec96'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:52.837174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b6bafc09-57bb-4227-91df-59169ca7ec96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ac5543ac3c486b8396d42f66de5d11', 'request_id': 'req-b6bafc09-57bb-4227-91df-59169ca7ec96'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:52.867829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b6bafc09-57bb-4227-91df-59169ca7ec96 admin admin] The token cache is being invalidate because project c9ac5543ac3c486b8396d42f66de5d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:07:52.870563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b6bafc09-57bb-4227-91df-59169ca7ec96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:52.873870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b6bafc09-57bb-4227-91df-59169ca7ec96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:07:52.878985 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2211/4445] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:52 2022] DELETE /identity/v3/projects/c9ac5543ac3c486b8396d42f66de5d11 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:52.884558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca053a8-cd88-47da-bd01-859bc952d787 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:52.885061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca053a8-cd88-47da-bd01-859bc952d787 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:52.885218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca053a8-cd88-47da-bd01-859bc952d787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:52.912028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-eca053a8-cd88-47da-bd01-859bc952d787 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:52.913720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eca053a8-cd88-47da-bd01-859bc952d787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:52.994918 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2235/4446] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:53.004340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b27b6-7bed-44db-b5b7-dc2ca95d1bd8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:53.004892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b27b6-7bed-44db-b5b7-dc2ca95d1bd8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:53.005204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b27b6-7bed-44db-b5b7-dc2ca95d1bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:53.025886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7c7b27b6-7bed-44db-b5b7-dc2ca95d1bd8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:53.027946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7c7b27b6-7bed-44db-b5b7-dc2ca95d1bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:53.040825 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2212/4447] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:53.041503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca053a8-cd88-47da-bd01-859bc952d787 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:53.054466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca053a8-cd88-47da-bd01-859bc952d787 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:53.059884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecf9be-38cb-4385-b1d6-ea64925e0fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:53.060491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecf9be-38cb-4385-b1d6-ea64925e0fec admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:53.061509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecf9be-38cb-4385-b1d6-ea64925e0fec admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:53.061509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecf9be-38cb-4385-b1d6-ea64925e0fec admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:53.061985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecf9be-38cb-4385-b1d6-ea64925e0fec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:07:53.061985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecf9be-38cb-4385-b1d6-ea64925e0fec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:53.063793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecf9be-38cb-4385-b1d6-ea64925e0fec admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:53.085384 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2236/4448] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:07:53.085494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b27b6-7bed-44db-b5b7-dc2ca95d1bd8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:53.091845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b27b6-7bed-44db-b5b7-dc2ca95d1bd8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:53.096604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8c381-391a-46d0-ad3e-715ccd3a1817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:53.097252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8c381-391a-46d0-ad3e-715ccd3a1817 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:53.097546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8c381-391a-46d0-ad3e-715ccd3a1817 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:53.097823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8c381-391a-46d0-ad3e-715ccd3a1817 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:53.098465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8c381-391a-46d0-ad3e-715ccd3a1817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:53.100621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8c381-391a-46d0-ad3e-715ccd3a1817 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:53.130133 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2213/4449] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:07:53 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:53.134310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecf9be-38cb-4385-b1d6-ea64925e0fec admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:53.145411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecf9be-38cb-4385-b1d6-ea64925e0fec admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:53.217919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a92e-f22b-4141-ac7c-533ddb35b3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:53.218666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a92e-f22b-4141-ac7c-533ddb35b3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:53.218950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a92e-f22b-4141-ac7c-533ddb35b3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:53.219339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a92e-f22b-4141-ac7c-533ddb35b3c8 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:53.219966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a92e-f22b-4141-ac7c-533ddb35b3c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:53.221921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a92e-f22b-4141-ac7c-533ddb35b3c8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:53.247611 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2237/4450] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:07:53 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:07:53.248826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8c381-391a-46d0-ad3e-715ccd3a1817 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:53.259174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8c381-391a-46d0-ad3e-715ccd3a1817 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:53.264560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400bc2c-1747-4857-9582-926ac20b320d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:53.265166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400bc2c-1747-4857-9582-926ac20b320d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:53.265485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400bc2c-1747-4857-9582-926ac20b320d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:53.265762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400bc2c-1747-4857-9582-926ac20b320d admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:53.266406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400bc2c-1747-4857-9582-926ac20b320d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:53.268025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400bc2c-1747-4857-9582-926ac20b320d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:53.278247 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2214/4451] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:07:53.282283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a92e-f22b-4141-ac7c-533ddb35b3c8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:53.292402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a92e-f22b-4141-ac7c-533ddb35b3c8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:53.297103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e91a7-9125-4b5f-a71a-27b308632288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:53.297743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e91a7-9125-4b5f-a71a-27b308632288 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:53.298023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e91a7-9125-4b5f-a71a-27b308632288 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:53.298297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e91a7-9125-4b5f-a71a-27b308632288 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:53.298994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e91a7-9125-4b5f-a71a-27b308632288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:53.300582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e91a7-9125-4b5f-a71a-27b308632288 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:53.312169 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2238/4452] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:07:53.316521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400bc2c-1747-4857-9582-926ac20b320d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:53.327419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400bc2c-1747-4857-9582-926ac20b320d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:53.332298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650020da-addf-4210-a6f4-c71f85631073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:53.332965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650020da-addf-4210-a6f4-c71f85631073 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:53.333282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650020da-addf-4210-a6f4-c71f85631073 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:53.333565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650020da-addf-4210-a6f4-c71f85631073 admin admin] PATH_INFO: `/v3/projects/180055cc8f2249079a1b611b32a04c11/users/510e775193c446a3988c2bfe5fe30fdd/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:53.348693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650020da-addf-4210-a6f4-c71f85631073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180055cc8f2249079a1b611b32a04c11, user_id=510e775193c446a3988c2bfe5fe30fdd, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:53.351651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650020da-addf-4210-a6f4-c71f85631073 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:53.366233 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2215/4453] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:07:53 2022] PUT /identity/v3/projects/180055cc8f2249079a1b611b32a04c11/users/510e775193c446a3988c2bfe5fe30fdd/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:07:53.377327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5ce8-b2e0-4131-9584-fde96ca20739 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:53.377800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5ce8-b2e0-4131-9584-fde96ca20739 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:53.378138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5ce8-b2e0-4131-9584-fde96ca20739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:53.406792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-437a5ce8-b2e0-4131-9584-fde96ca20739 None None] MFA Rules not processed for user `510e775193c446a3988c2bfe5fe30fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:53.408105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-437a5ce8-b2e0-4131-9584-fde96ca20739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:53.419943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:53.496362 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2239/4454] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:53.506727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650020da-addf-4210-a6f4-c71f85631073 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:53.508500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-650020da-addf-4210-a6f4-c71f85631073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:53.573991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650020da-addf-4210-a6f4-c71f85631073 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:53.578337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce149a27-d51e-453a-8c0b-617ab9e9929d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:53.579308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce149a27-d51e-453a-8c0b-617ab9e9929d service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:53.579632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce149a27-d51e-453a-8c0b-617ab9e9929d service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:53.579894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce149a27-d51e-453a-8c0b-617ab9e9929d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:53.588444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce149a27-d51e-453a-8c0b-617ab9e9929d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:53.589965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce149a27-d51e-453a-8c0b-617ab9e9929d service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:53.599038 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2216/4455] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:07:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:56.662916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e00e7e-b4a9-4c3d-a94c-ced903bb1722 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:56.663458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e00e7e-b4a9-4c3d-a94c-ced903bb1722 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:56.663681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e00e7e-b4a9-4c3d-a94c-ced903bb1722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:56.688597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b1e00e7e-b4a9-4c3d-a94c-ced903bb1722 None None] MFA Rules not processed for user `d78e9afd772c4de981cac8f5817ec356`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:56.689902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b1e00e7e-b4a9-4c3d-a94c-ced903bb1722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:56.794119 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2240/4456] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:07:57.339385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9941be-6c07-4b5b-afc4-5548c2c7245b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:57.340917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9941be-6c07-4b5b-afc4-5548c2c7245b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:57.341775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9941be-6c07-4b5b-afc4-5548c2c7245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:57.372569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9d9941be-6c07-4b5b-afc4-5548c2c7245b None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:07:57.375313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9d9941be-6c07-4b5b-afc4-5548c2c7245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:57.538328 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2217/4457] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:07:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:07:57.559768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e00e7e-b4a9-4c3d-a94c-ced903bb1722 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:07:57.561255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b1e00e7e-b4a9-4c3d-a94c-ced903bb1722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:07:57.675502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e00e7e-b4a9-4c3d-a94c-ced903bb1722 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:07:57.681929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213e4c1-10dd-4515-86ce-19084d1f9234 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:07:57.682386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213e4c1-10dd-4515-86ce-19084d1f9234 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:07:57.682695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213e4c1-10dd-4515-86ce-19084d1f9234 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:07:57.682918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213e4c1-10dd-4515-86ce-19084d1f9234 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:07:57.694429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213e4c1-10dd-4515-86ce-19084d1f9234 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:07:57.696186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213e4c1-10dd-4515-86ce-19084d1f9234 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:07:57.707633 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2241/4458] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:07:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:08:07.528769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=4,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:07.702968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=79 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:15.292024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17145da5-b4ae-41d2-9308-1c1cdf894b6c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:15.294252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17145da5-b4ae-41d2-9308-1c1cdf894b6c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:15.294604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17145da5-b4ae-41d2-9308-1c1cdf894b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:15.335168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-17145da5-b4ae-41d2-9308-1c1cdf894b6c None None] MFA Rules not processed for user `06443b5728fb4d1e95d6245820e786bf`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:15.340381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-17145da5-b4ae-41d2-9308-1c1cdf894b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:15.539083 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2218/4459] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:08:17.377432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424377c-01d9-4604-ab30-e713e02f1a56 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:17.378395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424377c-01d9-4604-ab30-e713e02f1a56 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:17.378890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424377c-01d9-4604-ab30-e713e02f1a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:17.425058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2424377c-01d9-4604-ab30-e713e02f1a56 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:17.427579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2424377c-01d9-4604-ab30-e713e02f1a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:17.446946 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2242/4460] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:08:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:08:17.462514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17145da5-b4ae-41d2-9308-1c1cdf894b6c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:17.485369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17145da5-b4ae-41d2-9308-1c1cdf894b6c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:17.499786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a746dce-84c1-47b7-8ffb-26d320f26e71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:17.500579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a746dce-84c1-47b7-8ffb-26d320f26e71 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:17.500878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a746dce-84c1-47b7-8ffb-26d320f26e71 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:17.501156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a746dce-84c1-47b7-8ffb-26d320f26e71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:17.517022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a746dce-84c1-47b7-8ffb-26d320f26e71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:17.519029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a746dce-84c1-47b7-8ffb-26d320f26e71 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:17.547052 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2219/4461] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:08:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:08:19.094517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a080a5a-1123-4436-9ff0-54a4692aeb08 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:19.095066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a080a5a-1123-4436-9ff0-54a4692aeb08 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:19.095066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a080a5a-1123-4436-9ff0-54a4692aeb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:19.150762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2a080a5a-1123-4436-9ff0-54a4692aeb08 None None] MFA Rules not processed for user `30fe0e1ffa1040ec85d3c32d8b741c75`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:19.155010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2a080a5a-1123-4436-9ff0-54a4692aeb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:19.380485 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2243/4462] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:08:19.650109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a746dce-84c1-47b7-8ffb-26d320f26e71 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:19.652368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7a746dce-84c1-47b7-8ffb-26d320f26e71 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:19.829385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a746dce-84c1-47b7-8ffb-26d320f26e71 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:19.839801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:19.842184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:19.842740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:19.843274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] PATH_INFO: `/v3/users/b9cd61a0df164a9e9197022508adafbf` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:19.844676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9cd61a0df164a9e9197022508adafbf)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:19.848172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:19.998139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9cd61a0df164a9e9197022508adafbf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:08:20.011908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9cd61a0df164a9e9197022508adafbf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:08:20.015359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9cd61a0df164a9e9197022508adafbf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:08:20.018682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9cd61a0df164a9e9197022508adafbf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:08:20.056960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9cd61a0df164a9e9197022508adafbf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:08:20.084921 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2220/4463] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:08:19 2022] DELETE /identity/v3/users/b9cd61a0df164a9e9197022508adafbf => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:08:20.091192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056cc6a-c142-4c4b-9586-35e6fe186256 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:20.091793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056cc6a-c142-4c4b-9586-35e6fe186256 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:20.092261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056cc6a-c142-4c4b-9586-35e6fe186256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:20.150105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2056cc6a-c142-4c4b-9586-35e6fe186256 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:20.154874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2056cc6a-c142-4c4b-9586-35e6fe186256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:20.293029 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2244/4464] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:08:20.344421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:20.346470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:20.374991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:20.533327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf6920-e826-49e8-8cc3-36e26030faa3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:20.540622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafc2c4-8458-48f4-8572-78d5ce1b153a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:20.542331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafc2c4-8458-48f4-8572-78d5ce1b153a service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:20.542952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafc2c4-8458-48f4-8572-78d5ce1b153a service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:20.543477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafc2c4-8458-48f4-8572-78d5ce1b153a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:20.577633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafc2c4-8458-48f4-8572-78d5ce1b153a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:20.580205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafc2c4-8458-48f4-8572-78d5ce1b153a service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:20.605475 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2221/4465] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:08:22.683944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056cc6a-c142-4c4b-9586-35e6fe186256 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:22.687675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2056cc6a-c142-4c4b-9586-35e6fe186256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:22.722648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056cc6a-c142-4c4b-9586-35e6fe186256 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:22.737782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266e701-85dc-4586-83b2-53a21913307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:22.739080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266e701-85dc-4586-83b2-53a21913307a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:22.739513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266e701-85dc-4586-83b2-53a21913307a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:22.740242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266e701-85dc-4586-83b2-53a21913307a admin admin] PATH_INFO: `/v3/projects/4acc59093f954b61ba9f3cd05e940c28` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:22.742017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266e701-85dc-4586-83b2-53a21913307a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4acc59093f954b61ba9f3cd05e940c28)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:22.746804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266e701-85dc-4586-83b2-53a21913307a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:22.865094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d266e701-85dc-4586-83b2-53a21913307a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4acc59093f954b61ba9f3cd05e940c28', 'request_id': 'req-d266e701-85dc-4586-83b2-53a21913307a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:08:22.878448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d266e701-85dc-4586-83b2-53a21913307a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4acc59093f954b61ba9f3cd05e940c28', 'request_id': 'req-d266e701-85dc-4586-83b2-53a21913307a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:08:22.896708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d266e701-85dc-4586-83b2-53a21913307a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4acc59093f954b61ba9f3cd05e940c28', 'request_id': 'req-d266e701-85dc-4586-83b2-53a21913307a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:08:22.928070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d266e701-85dc-4586-83b2-53a21913307a admin admin] The token cache is being invalidate because project 4acc59093f954b61ba9f3cd05e940c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:08:22.928706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d266e701-85dc-4586-83b2-53a21913307a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:08:22.929569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d266e701-85dc-4586-83b2-53a21913307a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:08:22.931922 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2245/4466] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:22 2022] DELETE /identity/v3/projects/4acc59093f954b61ba9f3cd05e940c28 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:08:22.939480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71df2d5-fe67-4162-8a64-b83273aabc76 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:22.940236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71df2d5-fe67-4162-8a64-b83273aabc76 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:22.940236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71df2d5-fe67-4162-8a64-b83273aabc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:22.995081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c71df2d5-fe67-4162-8a64-b83273aabc76 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:22.996628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c71df2d5-fe67-4162-8a64-b83273aabc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:23.086617 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2222/4467] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:08:23.096224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e09cc2-d72a-424e-a65d-ea95cefa8638 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:23.096613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e09cc2-d72a-424e-a65d-ea95cefa8638 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:23.097082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e09cc2-d72a-424e-a65d-ea95cefa8638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:23.140486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-25e09cc2-d72a-424e-a65d-ea95cefa8638 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:23.142909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-25e09cc2-d72a-424e-a65d-ea95cefa8638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:23.161283 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2246/4468] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:08:23.162010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71df2d5-fe67-4162-8a64-b83273aabc76 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:23.177358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71df2d5-fe67-4162-8a64-b83273aabc76 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:23.186533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8ddcf-fcf3-4356-b40d-d4b57affc045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:23.187698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8ddcf-fcf3-4356-b40d-d4b57affc045 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:23.188389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8ddcf-fcf3-4356-b40d-d4b57affc045 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:23.188853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8ddcf-fcf3-4356-b40d-d4b57affc045 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:23.190210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8ddcf-fcf3-4356-b40d-d4b57affc045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:08:23.190928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8ddcf-fcf3-4356-b40d-d4b57affc045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:23.193122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8ddcf-fcf3-4356-b40d-d4b57affc045 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:23.209578 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2223/4469] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:08:23.214611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e09cc2-d72a-424e-a65d-ea95cefa8638 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:23.227380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e09cc2-d72a-424e-a65d-ea95cefa8638 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:23.238667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7743bc-3298-4a1a-a54a-ae130b46da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:23.239508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7743bc-3298-4a1a-a54a-ae130b46da31 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:23.241907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7743bc-3298-4a1a-a54a-ae130b46da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:23.242377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7743bc-3298-4a1a-a54a-ae130b46da31 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:23.244787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7743bc-3298-4a1a-a54a-ae130b46da31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:23.247022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7743bc-3298-4a1a-a54a-ae130b46da31 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:23.283913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:23.313016 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2247/4470] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:08:23 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:08:23.314996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8ddcf-fcf3-4356-b40d-d4b57affc045 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:23.331357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8ddcf-fcf3-4356-b40d-d4b57affc045 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:23.429973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73603ad-349d-4d1d-b95e-f596ec193ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:23.431755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73603ad-349d-4d1d-b95e-f596ec193ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:23.432978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73603ad-349d-4d1d-b95e-f596ec193ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:23.433579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73603ad-349d-4d1d-b95e-f596ec193ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:23.435178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73603ad-349d-4d1d-b95e-f596ec193ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:23.439242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73603ad-349d-4d1d-b95e-f596ec193ce8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:23.464841 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2224/4471] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:08:23 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:08:23.471149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7743bc-3298-4a1a-a54a-ae130b46da31 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:23.489818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7743bc-3298-4a1a-a54a-ae130b46da31 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:23.495847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9f986-4155-4509-9415-f1f8f62c43d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:23.496643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9f986-4155-4509-9415-f1f8f62c43d4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:23.497155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9f986-4155-4509-9415-f1f8f62c43d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:23.497638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9f986-4155-4509-9415-f1f8f62c43d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:23.498444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9f986-4155-4509-9415-f1f8f62c43d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:23.500219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9f986-4155-4509-9415-f1f8f62c43d4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:23.514705 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2248/4472] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:08:23.516543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73603ad-349d-4d1d-b95e-f596ec193ce8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:23.529296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73603ad-349d-4d1d-b95e-f596ec193ce8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:23.535559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903b210-66c3-4fa5-ab13-471023ebdb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:23.537034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903b210-66c3-4fa5-ab13-471023ebdb4d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:23.537960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903b210-66c3-4fa5-ab13-471023ebdb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:23.537960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903b210-66c3-4fa5-ab13-471023ebdb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:23.540256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903b210-66c3-4fa5-ab13-471023ebdb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:23.542473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903b210-66c3-4fa5-ab13-471023ebdb4d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:23.554769 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2225/4473] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:08:23.559507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9f986-4155-4509-9415-f1f8f62c43d4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:23.575697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9f986-4155-4509-9415-f1f8f62c43d4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:23.582717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595337f-a14f-4de3-a773-e10842109f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:23.583673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595337f-a14f-4de3-a773-e10842109f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:23.584160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595337f-a14f-4de3-a773-e10842109f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:23.585597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595337f-a14f-4de3-a773-e10842109f25 admin admin] PATH_INFO: `/v3/projects/0ae02675057e4f27bc1980348afc8ca1/users/6a78d352c143483c8e4702d789d4c516/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:23.606950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595337f-a14f-4de3-a773-e10842109f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae02675057e4f27bc1980348afc8ca1, user_id=6a78d352c143483c8e4702d789d4c516, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:23.611326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595337f-a14f-4de3-a773-e10842109f25 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:23.631681 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2249/4474] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:08:23 2022] PUT /identity/v3/projects/0ae02675057e4f27bc1980348afc8ca1/users/6a78d352c143483c8e4702d789d4c516/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:08:23.637304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b9885-5a03-4d16-b55d-336dca654e8e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:23.637700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b9885-5a03-4d16-b55d-336dca654e8e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:23.638152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b9885-5a03-4d16-b55d-336dca654e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:23.674153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-941b9885-5a03-4d16-b55d-336dca654e8e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:23.676534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-941b9885-5a03-4d16-b55d-336dca654e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:23.693639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:23.768381 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2226/4475] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:08:23.779644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595337f-a14f-4de3-a773-e10842109f25 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:23.781640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6595337f-a14f-4de3-a773-e10842109f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:23.845983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595337f-a14f-4de3-a773-e10842109f25 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:23.850581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd182aa9-e7b2-4b81-86e7-350611e74acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:23.851584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd182aa9-e7b2-4b81-86e7-350611e74acb service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:23.851584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd182aa9-e7b2-4b81-86e7-350611e74acb service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:23.851754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd182aa9-e7b2-4b81-86e7-350611e74acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:23.877246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd182aa9-e7b2-4b81-86e7-350611e74acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:23.877246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd182aa9-e7b2-4b81-86e7-350611e74acb service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:23.883761 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2250/4476] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:08:24.176787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777eb0-4fa2-4afa-9b4c-e1ba0fe0ac96 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:24.177428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777eb0-4fa2-4afa-9b4c-e1ba0fe0ac96 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:24.177428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777eb0-4fa2-4afa-9b4c-e1ba0fe0ac96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:24.199206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-eb777eb0-4fa2-4afa-9b4c-e1ba0fe0ac96 None None] MFA Rules not processed for user `21870fe169dc42359d9bdb149d0016d7`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:24.200596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eb777eb0-4fa2-4afa-9b4c-e1ba0fe0ac96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:24.309383 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2227/4477] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:08:30.209661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c99b73-d0d6-43a9-a24a-3966810a34db None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:30.210217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c99b73-d0d6-43a9-a24a-3966810a34db None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:30.210217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c99b73-d0d6-43a9-a24a-3966810a34db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:30.241038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-64c99b73-d0d6-43a9-a24a-3966810a34db None None] MFA Rules not processed for user `d78e9afd772c4de981cac8f5817ec356`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:30.243278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-64c99b73-d0d6-43a9-a24a-3966810a34db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:30.371287 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2251/4478] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:08:32.410749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381c4bb-e3c3-4721-9bb3-ef30f7bddbe1 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:32.411194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381c4bb-e3c3-4721-9bb3-ef30f7bddbe1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:32.411671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381c4bb-e3c3-4721-9bb3-ef30f7bddbe1 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:32.413239 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2228/4479] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 21:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 21:08:32.422727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cbcaa-6f19-4f41-8221-50a956d1a0af None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:32.423645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cbcaa-6f19-4f41-8221-50a956d1a0af None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:32.424112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cbcaa-6f19-4f41-8221-50a956d1a0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:32.520280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ae4cbcaa-6f19-4f41-8221-50a956d1a0af None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:32.522836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ae4cbcaa-6f19-4f41-8221-50a956d1a0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:32.539078 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2252/4480] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:08:32.632404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381c4bb-e3c3-4721-9bb3-ef30f7bddbe1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:32.634616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c381c4bb-e3c3-4721-9bb3-ef30f7bddbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:32.670326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381c4bb-e3c3-4721-9bb3-ef30f7bddbe1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:32.681632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ddff7-a614-4ffe-ae1b-1046773a1788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:32.683997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ddff7-a614-4ffe-ae1b-1046773a1788 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:32.684632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ddff7-a614-4ffe-ae1b-1046773a1788 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:32.685124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ddff7-a614-4ffe-ae1b-1046773a1788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:32.696215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ddff7-a614-4ffe-ae1b-1046773a1788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:32.701078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ddff7-a614-4ffe-ae1b-1046773a1788 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:32.718365 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2229/4481] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:08:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:08:33.715616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cbcaa-6f19-4f41-8221-50a956d1a0af None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:33.718077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ae4cbcaa-6f19-4f41-8221-50a956d1a0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:33.954816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:34.025296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cbcaa-6f19-4f41-8221-50a956d1a0af None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:34.064000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826c644-1192-45ad-8051-8d3eee84ffc3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:34.067562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c644-1192-45ad-8051-8d3eee84ffc3 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:34.069215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c644-1192-45ad-8051-8d3eee84ffc3 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:34.069679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c644-1192-45ad-8051-8d3eee84ffc3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:34.074561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3826c644-1192-45ad-8051-8d3eee84ffc3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:34.099454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826c644-1192-45ad-8051-8d3eee84ffc3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:34.103244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826c644-1192-45ad-8051-8d3eee84ffc3 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:34.133974 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2253/4482] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:08:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:08:36.039473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a88a9-8e47-40d4-8c80-04b46a9a0658 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:36.040693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a88a9-8e47-40d4-8c80-04b46a9a0658 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:36.041245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a88a9-8e47-40d4-8c80-04b46a9a0658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:36.088630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-679a88a9-8e47-40d4-8c80-04b46a9a0658 None None] MFA Rules not processed for user `d78e9afd772c4de981cac8f5817ec356`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:36.092804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-679a88a9-8e47-40d4-8c80-04b46a9a0658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:36.113257 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2230/4483] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:08:38.607148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766939f-f6cb-4004-83eb-fbbbbfb92643 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:38.607631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766939f-f6cb-4004-83eb-fbbbbfb92643 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:38.607759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766939f-f6cb-4004-83eb-fbbbbfb92643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:38.666352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a766939f-f6cb-4004-83eb-fbbbbfb92643 None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:38.668189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a766939f-f6cb-4004-83eb-fbbbbfb92643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:38.832270 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2254/4484] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:08:38.846140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d4195-3a2f-4bdf-afde-d5f88fc49599 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:38.846735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d4195-3a2f-4bdf-afde-d5f88fc49599 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:38.846735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d4195-3a2f-4bdf-afde-d5f88fc49599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:38.930798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-387d4195-3a2f-4bdf-afde-d5f88fc49599 None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:38.948956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-387d4195-3a2f-4bdf-afde-d5f88fc49599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:38.976170 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2231/4485] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:08:39.180256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766939f-f6cb-4004-83eb-fbbbbfb92643 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:39.183534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a766939f-f6cb-4004-83eb-fbbbbfb92643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:39.423870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766939f-f6cb-4004-83eb-fbbbbfb92643 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:39.432757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de519576-3dda-4847-9c5e-356106730a71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:39.434017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de519576-3dda-4847-9c5e-356106730a71 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:39.434925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de519576-3dda-4847-9c5e-356106730a71 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:39.435415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de519576-3dda-4847-9c5e-356106730a71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:39.449771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de519576-3dda-4847-9c5e-356106730a71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:39.452213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de519576-3dda-4847-9c5e-356106730a71 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:39.465802 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2255/4486] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:08:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:08:42.628383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc9151-dd23-4067-bb7a-58c99223147c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:42.628839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc9151-dd23-4067-bb7a-58c99223147c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:42.628949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc9151-dd23-4067-bb7a-58c99223147c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:42.658587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b8dc9151-dd23-4067-bb7a-58c99223147c None None] MFA Rules not processed for user `06443b5728fb4d1e95d6245820e786bf`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:42.659891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b8dc9151-dd23-4067-bb7a-58c99223147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:42.724184 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2232/4487] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:08:43.411133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de519576-3dda-4847-9c5e-356106730a71 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:43.430345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de519576-3dda-4847-9c5e-356106730a71 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:43.436308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ceb0df-2506-4c13-a03f-4c801f8e8758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:43.437836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceb0df-2506-4c13-a03f-4c801f8e8758 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:43.437836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceb0df-2506-4c13-a03f-4c801f8e8758 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:43.437836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceb0df-2506-4c13-a03f-4c801f8e8758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:43.439401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-34ceb0df-2506-4c13-a03f-4c801f8e8758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:43.466773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ceb0df-2506-4c13-a03f-4c801f8e8758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:43.468234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ceb0df-2506-4c13-a03f-4c801f8e8758 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:43.490496 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2256/4488] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:08:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:08:52.714163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:53.484170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=83 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:53.622849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e70d76-2458-40b3-b813-374b460059ae None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:53.623132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e70d76-2458-40b3-b813-374b460059ae None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:53.623404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e70d76-2458-40b3-b813-374b460059ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:53.643922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-29e70d76-2458-40b3-b813-374b460059ae None None] MFA Rules not processed for user `85abb492492343c58734564a2b26c8f6`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:53.645348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-29e70d76-2458-40b3-b813-374b460059ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:53.709173 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2233/4489] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:08:54.554343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ceb0df-2506-4c13-a03f-4c801f8e8758 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:08:54.565883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ceb0df-2506-4c13-a03f-4c801f8e8758 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:08:54.569756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331978d-db94-4897-b722-713155b79ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:08:54.570366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331978d-db94-4897-b722-713155b79ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:54.570642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331978d-db94-4897-b722-713155b79ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:54.570908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331978d-db94-4897-b722-713155b79ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:54.573247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6331978d-db94-4897-b722-713155b79ee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:54.593177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331978d-db94-4897-b722-713155b79ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:08:54.595110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331978d-db94-4897-b722-713155b79ee0 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:08:54.605637 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2257/4490] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:08:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:08:59.472122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c89e3-8993-4ad9-bb46-ad4fd8a0c45b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:08:59.472645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c89e3-8993-4ad9-bb46-ad4fd8a0c45b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:08:59.472740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c89e3-8993-4ad9-bb46-ad4fd8a0c45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:08:59.508636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-934c89e3-8993-4ad9-bb46-ad4fd8a0c45b None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:08:59.510401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-934c89e3-8993-4ad9-bb46-ad4fd8a0c45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:08:59.518952 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2234/4491] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:03.766556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82e680-fb2c-4fd9-ac32-30477d381aac None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:03.767072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82e680-fb2c-4fd9-ac32-30477d381aac None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:03.767337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82e680-fb2c-4fd9-ac32-30477d381aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:03.789491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8f82e680-fb2c-4fd9-ac32-30477d381aac None None] MFA Rules not processed for user `d78e9afd772c4de981cac8f5817ec356`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:03.792531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f82e680-fb2c-4fd9-ac32-30477d381aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:03.808049 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2258/4492] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:09.499668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=32 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:11.444516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31193cb6-4e3a-4b3f-a99b-4e4ec8a711b6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:11.445156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31193cb6-4e3a-4b3f-a99b-4e4ec8a711b6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:11.445156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31193cb6-4e3a-4b3f-a99b-4e4ec8a711b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:11.481794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-31193cb6-4e3a-4b3f-a99b-4e4ec8a711b6 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:11.485244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-31193cb6-4e3a-4b3f-a99b-4e4ec8a711b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:11.636110 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2235/4493] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:11.662396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82e680-fb2c-4fd9-ac32-30477d381aac None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:09:11.664463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f82e680-fb2c-4fd9-ac32-30477d381aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:11.830652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82e680-fb2c-4fd9-ac32-30477d381aac None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:09:11.841550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508ebf2-5315-4af0-aee7-775c01ed1a68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:09:11.842524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508ebf2-5315-4af0-aee7-775c01ed1a68 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:11.842973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508ebf2-5315-4af0-aee7-775c01ed1a68 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:11.843467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508ebf2-5315-4af0-aee7-775c01ed1a68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:11.860939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508ebf2-5315-4af0-aee7-775c01ed1a68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:09:11.863039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508ebf2-5315-4af0-aee7-775c01ed1a68 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:09:11.881391 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2259/4494] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:09:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:09:21.623657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=25 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:21.874088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=41 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:24.949517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19efb22-b86a-4f3b-8293-82ddbccec1c4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:24.950632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19efb22-b86a-4f3b-8293-82ddbccec1c4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:24.951129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19efb22-b86a-4f3b-8293-82ddbccec1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:24.991422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e19efb22-b86a-4f3b-8293-82ddbccec1c4 None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:24.993014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e19efb22-b86a-4f3b-8293-82ddbccec1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:25.005070 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2236/4495] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:09:28.244586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf80e6-b609-4f69-8b31-2a78fb4ea57b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:28.245490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf80e6-b609-4f69-8b31-2a78fb4ea57b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:28.245923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf80e6-b609-4f69-8b31-2a78fb4ea57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:28.277401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-aebf80e6-b609-4f69-8b31-2a78fb4ea57b None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:28.280972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-aebf80e6-b609-4f69-8b31-2a78fb4ea57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:28.289114 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2260/4496] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:30.963103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd815fc-06c4-4a4b-9ae8-76bf9c6b397a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:30.964603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd815fc-06c4-4a4b-9ae8-76bf9c6b397a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:30.965226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd815fc-06c4-4a4b-9ae8-76bf9c6b397a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:30.998300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-acd815fc-06c4-4a4b-9ae8-76bf9c6b397a None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:30.999999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-acd815fc-06c4-4a4b-9ae8-76bf9c6b397a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:31.025642 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2237/4497] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:31.813388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e8299-ff9f-4429-81f2-ea031eae5197 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:31.813860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e8299-ff9f-4429-81f2-ea031eae5197 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:31.813997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e8299-ff9f-4429-81f2-ea031eae5197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:31.849047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d11e8299-ff9f-4429-81f2-ea031eae5197 None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:31.850873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d11e8299-ff9f-4429-81f2-ea031eae5197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:31.860736 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2261/4498] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:32.803988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f0550-82cf-4216-8440-afd1be394671 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:32.804871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f0550-82cf-4216-8440-afd1be394671 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:32.805328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f0550-82cf-4216-8440-afd1be394671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:32.846131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-138f0550-82cf-4216-8440-afd1be394671 None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:32.847777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-138f0550-82cf-4216-8440-afd1be394671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:32.859407 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2238/4499] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:32.968290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830ad1e-1c4c-43d9-aa14-218dcb40a62d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:32.968946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830ad1e-1c4c-43d9-aa14-218dcb40a62d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:32.968946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830ad1e-1c4c-43d9-aa14-218dcb40a62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:32.997469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7830ad1e-1c4c-43d9-aa14-218dcb40a62d None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:32.999102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7830ad1e-1c4c-43d9-aa14-218dcb40a62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:33.015552 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2262/4500] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:09:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:33.024929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f0550-82cf-4216-8440-afd1be394671 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:09:33.059107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f0550-82cf-4216-8440-afd1be394671 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:09:33.081920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a1ca1-25df-43cd-98ec-edf7b381eb25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:09:33.082531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a1ca1-25df-43cd-98ec-edf7b381eb25 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:33.085521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a1ca1-25df-43cd-98ec-edf7b381eb25 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:33.086497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a1ca1-25df-43cd-98ec-edf7b381eb25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:33.100365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a1ca1-25df-43cd-98ec-edf7b381eb25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:09:33.102228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a1ca1-25df-43cd-98ec-edf7b381eb25 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:09:33.133340 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2239/4501] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:09:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:33.692699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78607096-157e-49c1-a55b-bab4169cd76c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:33.693000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78607096-157e-49c1-a55b-bab4169cd76c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:33.693296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78607096-157e-49c1-a55b-bab4169cd76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:33.720633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-78607096-157e-49c1-a55b-bab4169cd76c None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:33.722124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-78607096-157e-49c1-a55b-bab4169cd76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:33.733057 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2263/4502] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:33.898329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be20c96-cbe2-4d7c-9206-28b915cfb558 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:33.898869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be20c96-cbe2-4d7c-9206-28b915cfb558 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:33.899534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be20c96-cbe2-4d7c-9206-28b915cfb558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:33.937423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5be20c96-cbe2-4d7c-9206-28b915cfb558 None None] MFA Rules not processed for user `30fe0e1ffa1040ec85d3c32d8b741c75`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:33.938655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5be20c96-cbe2-4d7c-9206-28b915cfb558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:34.034251 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2240/4503] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:35.230237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cee1d0-10e7-48b0-a2fb-5785ac28ebab None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:35.231096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cee1d0-10e7-48b0-a2fb-5785ac28ebab None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:35.231522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cee1d0-10e7-48b0-a2fb-5785ac28ebab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:35.253988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-19cee1d0-10e7-48b0-a2fb-5785ac28ebab None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:35.255305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-19cee1d0-10e7-48b0-a2fb-5785ac28ebab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:35.283028 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2264/4504] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:35.918838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be20c96-cbe2-4d7c-9206-28b915cfb558 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:09:35.921065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5be20c96-cbe2-4d7c-9206-28b915cfb558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:36.006252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be20c96-cbe2-4d7c-9206-28b915cfb558 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:09:36.022758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f1d65-d530-4ecb-8dcf-11b9d3818068 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:09:36.023677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f1d65-d530-4ecb-8dcf-11b9d3818068 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:36.024582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f1d65-d530-4ecb-8dcf-11b9d3818068 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:36.025142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f1d65-d530-4ecb-8dcf-11b9d3818068 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:36.029718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f15f1d65-d530-4ecb-8dcf-11b9d3818068 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:36.059062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f1d65-d530-4ecb-8dcf-11b9d3818068 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:09:36.063669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f1d65-d530-4ecb-8dcf-11b9d3818068 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:09:36.094311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cee1d0-10e7-48b0-a2fb-5785ac28ebab None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:09:36.115765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cee1d0-10e7-48b0-a2fb-5785ac28ebab None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:09:36.118385 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2241/4505] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:09:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:09:36.122615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdd2ea-a972-469b-8652-a7e72e3c0d17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:09:36.125625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdd2ea-a972-469b-8652-a7e72e3c0d17 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:36.126654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdd2ea-a972-469b-8652-a7e72e3c0d17 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:36.127606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdd2ea-a972-469b-8652-a7e72e3c0d17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:36.146280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdd2ea-a972-469b-8652-a7e72e3c0d17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:09:36.150828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdd2ea-a972-469b-8652-a7e72e3c0d17 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:09:36.175891 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2265/4506] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:09:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:09:36.676316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f1d65-d530-4ecb-8dcf-11b9d3818068 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:09:36.694084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f1d65-d530-4ecb-8dcf-11b9d3818068 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:09:36.713099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42000b33-431a-42c3-ad34-c2d00ce4bcc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:09:36.713745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42000b33-431a-42c3-ad34-c2d00ce4bcc1 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:36.714021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42000b33-431a-42c3-ad34-c2d00ce4bcc1 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:36.714293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42000b33-431a-42c3-ad34-c2d00ce4bcc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:36.716781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-42000b33-431a-42c3-ad34-c2d00ce4bcc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:36.757363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42000b33-431a-42c3-ad34-c2d00ce4bcc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:09:36.760247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42000b33-431a-42c3-ad34-c2d00ce4bcc1 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:09:36.795697 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2242/4507] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:09:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:09:36.916307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeb5cf-0331-42f4-8501-432aac5459b4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:36.916824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeb5cf-0331-42f4-8501-432aac5459b4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:36.916824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeb5cf-0331-42f4-8501-432aac5459b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:36.956916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fddeb5cf-0331-42f4-8501-432aac5459b4 None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:36.964510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fddeb5cf-0331-42f4-8501-432aac5459b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:36.975362 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2266/4508] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:38.130679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e91af8-8c96-4b37-b29a-738dd5984e32 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:38.131124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e91af8-8c96-4b37-b29a-738dd5984e32 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:38.131300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e91af8-8c96-4b37-b29a-738dd5984e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:38.162203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-23e91af8-8c96-4b37-b29a-738dd5984e32 None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:38.163427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-23e91af8-8c96-4b37-b29a-738dd5984e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:38.173493 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2243/4509] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:39.087652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482e5e2-24de-49b8-ae66-b04293aec740 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:39.102535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482e5e2-24de-49b8-ae66-b04293aec740 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:39.103096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482e5e2-24de-49b8-ae66-b04293aec740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:39.130352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2482e5e2-24de-49b8-ae66-b04293aec740 None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:39.132147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2482e5e2-24de-49b8-ae66-b04293aec740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:39.151110 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2267/4510] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:43.951439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448a91f-3886-4c71-a6ee-7ae9ada7d3bb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:43.951987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448a91f-3886-4c71-a6ee-7ae9ada7d3bb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:43.951987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448a91f-3886-4c71-a6ee-7ae9ada7d3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:44.004182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c448a91f-3886-4c71-a6ee-7ae9ada7d3bb None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:44.006186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c448a91f-3886-4c71-a6ee-7ae9ada7d3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:44.025750 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2244/4511] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:44.041661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482e5e2-24de-49b8-ae66-b04293aec740 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:09:44.060693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482e5e2-24de-49b8-ae66-b04293aec740 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:09:44.079990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f224bd8-6f1a-4e1c-90a0-cf0210e46423 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:09:44.080568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f224bd8-6f1a-4e1c-90a0-cf0210e46423 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:44.080869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f224bd8-6f1a-4e1c-90a0-cf0210e46423 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:44.081159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f224bd8-6f1a-4e1c-90a0-cf0210e46423 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:44.099082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f224bd8-6f1a-4e1c-90a0-cf0210e46423 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:09:44.102133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f224bd8-6f1a-4e1c-90a0-cf0210e46423 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:09:44.119171 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2268/4512] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:09:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:46.405909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b188-db9e-45a1-9c69-727a4d5bd3ef None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:46.406414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b188-db9e-45a1-9c69-727a4d5bd3ef None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:46.406505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b188-db9e-45a1-9c69-727a4d5bd3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:46.490091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d715b188-db9e-45a1-9c69-727a4d5bd3ef None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:46.494382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d715b188-db9e-45a1-9c69-727a4d5bd3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:46.522009 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2245/4513] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:48.085451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73113f7-dfad-47e7-95f9-7fb879d64627 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:48.086817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73113f7-dfad-47e7-95f9-7fb879d64627 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:48.087456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73113f7-dfad-47e7-95f9-7fb879d64627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:48.139539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f73113f7-dfad-47e7-95f9-7fb879d64627 None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:48.141252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f73113f7-dfad-47e7-95f9-7fb879d64627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:48.158301 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2269/4514] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:09:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:09:54.076297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715b188-db9e-45a1-9c69-727a4d5bd3ef None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:09:54.083848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=67 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:54.093910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715b188-db9e-45a1-9c69-727a4d5bd3ef None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:09:54.105568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c2f26-36ea-4cf7-9de4-7d7b807626f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:09:54.106543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c2f26-36ea-4cf7-9de4-7d7b807626f5 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:54.106970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c2f26-36ea-4cf7-9de4-7d7b807626f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:54.107388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c2f26-36ea-4cf7-9de4-7d7b807626f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:54.112918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-136c2f26-36ea-4cf7-9de4-7d7b807626f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:54.138452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c2f26-36ea-4cf7-9de4-7d7b807626f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:09:54.144363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c2f26-36ea-4cf7-9de4-7d7b807626f5 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:09:54.175171 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2246/4515] 10.222.0.26 () {60 vars in 1396 bytes} [Sat Oct 8 21:09:54 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:09:56.629084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc02d9-dbe4-4464-80c1-660c4bfc589d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:56.629602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc02d9-dbe4-4464-80c1-660c4bfc589d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:56.629715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc02d9-dbe4-4464-80c1-660c4bfc589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:56.656987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=37 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:56.677395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e3fc02d9-dbe4-4464-80c1-660c4bfc589d None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:09:56.680784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e3fc02d9-dbe4-4464-80c1-660c4bfc589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:56.690810 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2270/4516] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:09:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:09:56.706151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c2f26-36ea-4cf7-9de4-7d7b807626f5 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:09:56.727757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c2f26-36ea-4cf7-9de4-7d7b807626f5 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:09:56.748324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25a9d7-4319-41d2-83b9-b6e806e6444f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:09:56.750939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25a9d7-4319-41d2-83b9-b6e806e6444f service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:56.753032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25a9d7-4319-41d2-83b9-b6e806e6444f service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:56.754357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25a9d7-4319-41d2-83b9-b6e806e6444f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:56.791171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25a9d7-4319-41d2-83b9-b6e806e6444f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:09:56.796468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25a9d7-4319-41d2-83b9-b6e806e6444f service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:09:56.830674 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2247/4517] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:09:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:59.076561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc02d9-dbe4-4464-80c1-660c4bfc589d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:09:59.080660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e3fc02d9-dbe4-4464-80c1-660c4bfc589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:09:59.123877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc02d9-dbe4-4464-80c1-660c4bfc589d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:09:59.166907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b87d8-e9f5-4b27-ab54-1029044d931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:09:59.169439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b87d8-e9f5-4b27-ab54-1029044d931d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:09:59.170179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b87d8-e9f5-4b27-ab54-1029044d931d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:09:59.170673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b87d8-e9f5-4b27-ab54-1029044d931d admin admin] PATH_INFO: `/v3/users/06443b5728fb4d1e95d6245820e786bf` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:09:59.173669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b87d8-e9f5-4b27-ab54-1029044d931d admin admin] RBAC: Authorizing `identity:delete_user(user_id=06443b5728fb4d1e95d6245820e786bf)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:09:59.181638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b87d8-e9f5-4b27-ab54-1029044d931d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:09:59.356059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5c3b87d8-e9f5-4b27-ab54-1029044d931d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06443b5728fb4d1e95d6245820e786bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:09:59.392390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5c3b87d8-e9f5-4b27-ab54-1029044d931d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06443b5728fb4d1e95d6245820e786bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:09:59.396517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5c3b87d8-e9f5-4b27-ab54-1029044d931d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06443b5728fb4d1e95d6245820e786bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:09:59.400282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5c3b87d8-e9f5-4b27-ab54-1029044d931d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06443b5728fb4d1e95d6245820e786bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:09:59.494198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5c3b87d8-e9f5-4b27-ab54-1029044d931d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06443b5728fb4d1e95d6245820e786bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:09:59.542832 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2271/4518] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:09:59 2022] DELETE /identity/v3/users/06443b5728fb4d1e95d6245820e786bf => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:01.462441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25a9d7-4319-41d2-83b9-b6e806e6444f service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:01.482716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25a9d7-4319-41d2-83b9-b6e806e6444f service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:01.725926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:01.727355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:01.727797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:01.728219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50 admin admin] PATH_INFO: `/v3/projects/e7ded993145b4eda9d6a33b994519012` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:01.729718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ded993145b4eda9d6a33b994519012)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:01.731777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:01.816109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ded993145b4eda9d6a33b994519012', 'request_id': 'req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:01.832106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ded993145b4eda9d6a33b994519012', 'request_id': 'req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:01.868327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ded993145b4eda9d6a33b994519012', 'request_id': 'req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:01.916308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50 admin admin] The token cache is being invalidate because project e7ded993145b4eda9d6a33b994519012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:01.917653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:01.921628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f7c1bdf5-e90a-490f-b9d8-36fb6a2fed50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:01.925492 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2248/4519] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:01 2022] DELETE /identity/v3/projects/e7ded993145b4eda9d6a33b994519012 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:10:01.932876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2b16-2b03-4430-8ff7-d6219ded1dff None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:01.937765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2b16-2b03-4430-8ff7-d6219ded1dff None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:01.938086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2b16-2b03-4430-8ff7-d6219ded1dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:01.974332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cb6b2b16-2b03-4430-8ff7-d6219ded1dff None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:01.977943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cb6b2b16-2b03-4430-8ff7-d6219ded1dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:02.124373 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2272/4520] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:02.132191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0741642-bfd5-4b88-8c9a-b4cc89c754d5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:02.132494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0741642-bfd5-4b88-8c9a-b4cc89c754d5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:02.132745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0741642-bfd5-4b88-8c9a-b4cc89c754d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:02.196401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a0741642-bfd5-4b88-8c9a-b4cc89c754d5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:02.197745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a0741642-bfd5-4b88-8c9a-b4cc89c754d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:02.227974 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2249/4521] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:02.232123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b2b16-2b03-4430-8ff7-d6219ded1dff None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:02.248645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b2b16-2b03-4430-8ff7-d6219ded1dff None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:02.259197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fbe06-a7cd-4524-9c59-16bf24555be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:02.261867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fbe06-a7cd-4524-9c59-16bf24555be5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:02.262525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fbe06-a7cd-4524-9c59-16bf24555be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:02.263052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fbe06-a7cd-4524-9c59-16bf24555be5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:02.264602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fbe06-a7cd-4524-9c59-16bf24555be5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:02.265604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fbe06-a7cd-4524-9c59-16bf24555be5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:02.269374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fbe06-a7cd-4524-9c59-16bf24555be5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:02.304261 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2273/4522] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:02.309614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0741642-bfd5-4b88-8c9a-b4cc89c754d5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:02.328565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0741642-bfd5-4b88-8c9a-b4cc89c754d5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:02.344735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc6913-fe0e-4488-a56e-40f302c91707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:02.345801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc6913-fe0e-4488-a56e-40f302c91707 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:02.346293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc6913-fe0e-4488-a56e-40f302c91707 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:02.346789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc6913-fe0e-4488-a56e-40f302c91707 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:02.347787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc6913-fe0e-4488-a56e-40f302c91707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:02.356584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc6913-fe0e-4488-a56e-40f302c91707 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:02.443311 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2250/4523] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:02 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:02.448312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fbe06-a7cd-4524-9c59-16bf24555be5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:02.469441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fbe06-a7cd-4524-9c59-16bf24555be5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:02.632326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:02.651469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453ce99-d312-4f6e-b213-aec69c19d66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:02.652171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453ce99-d312-4f6e-b213-aec69c19d66a admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:02.652503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453ce99-d312-4f6e-b213-aec69c19d66a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:02.652763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453ce99-d312-4f6e-b213-aec69c19d66a admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:02.654724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453ce99-d312-4f6e-b213-aec69c19d66a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:02.656643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453ce99-d312-4f6e-b213-aec69c19d66a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:02.711711 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2274/4524] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:02 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:02.716761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc6913-fe0e-4488-a56e-40f302c91707 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:02.756201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc6913-fe0e-4488-a56e-40f302c91707 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:02.771971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2146b86-b428-4374-8369-d04e5da2a543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:02.773035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2146b86-b428-4374-8369-d04e5da2a543 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:02.775541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2146b86-b428-4374-8369-d04e5da2a543 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:02.778929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2146b86-b428-4374-8369-d04e5da2a543 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:02.780124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2146b86-b428-4374-8369-d04e5da2a543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:02.788362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2146b86-b428-4374-8369-d04e5da2a543 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:02.840326 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2251/4525] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:02.844529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453ce99-d312-4f6e-b213-aec69c19d66a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:02.872391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453ce99-d312-4f6e-b213-aec69c19d66a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:02.902696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b081cf-cc52-4cbc-9ef5-ad3e8ce4febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:02.903602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b081cf-cc52-4cbc-9ef5-ad3e8ce4febf admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:02.904800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b081cf-cc52-4cbc-9ef5-ad3e8ce4febf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:02.905322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b081cf-cc52-4cbc-9ef5-ad3e8ce4febf admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:02.906091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b081cf-cc52-4cbc-9ef5-ad3e8ce4febf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:02.907915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b081cf-cc52-4cbc-9ef5-ad3e8ce4febf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:02.963276 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2275/4526] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:02.966578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2146b86-b428-4374-8369-d04e5da2a543 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:02.987563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2146b86-b428-4374-8369-d04e5da2a543 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:02.994880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49097903-ac75-4a63-b15c-1f6648fd5151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:02.996049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49097903-ac75-4a63-b15c-1f6648fd5151 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:02.996537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49097903-ac75-4a63-b15c-1f6648fd5151 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:02.997092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49097903-ac75-4a63-b15c-1f6648fd5151 admin admin] PATH_INFO: `/v3/projects/a0c1878cdbde4dc4b575c2d2810d041a/users/c7c7f292b8204fbea111a59a922fe834/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:03.022876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49097903-ac75-4a63-b15c-1f6648fd5151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c1878cdbde4dc4b575c2d2810d041a, user_id=c7c7f292b8204fbea111a59a922fe834, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:03.040028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49097903-ac75-4a63-b15c-1f6648fd5151 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:03.074138 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2252/4527] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:02 2022] PUT /identity/v3/projects/a0c1878cdbde4dc4b575c2d2810d041a/users/c7c7f292b8204fbea111a59a922fe834/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:03.074579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f195480-6dcc-4b8d-bb9e-c9f0d7cacff4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:03.074961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f195480-6dcc-4b8d-bb9e-c9f0d7cacff4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:03.075313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f195480-6dcc-4b8d-bb9e-c9f0d7cacff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:03.154425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5f195480-6dcc-4b8d-bb9e-c9f0d7cacff4 None None] MFA Rules not processed for user `c7c7f292b8204fbea111a59a922fe834`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:03.157256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5f195480-6dcc-4b8d-bb9e-c9f0d7cacff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:03.377952 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2276/4528] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:03.379877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49097903-ac75-4a63-b15c-1f6648fd5151 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:03.385641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:03.457480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49097903-ac75-4a63-b15c-1f6648fd5151 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:03.464228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb50eb-567d-4851-aef7-e65b491f0ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:03.465791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb50eb-567d-4851-aef7-e65b491f0ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:03.466298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb50eb-567d-4851-aef7-e65b491f0ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:03.466855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb50eb-567d-4851-aef7-e65b491f0ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:03.467697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb50eb-567d-4851-aef7-e65b491f0ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:03.469966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb50eb-567d-4851-aef7-e65b491f0ec1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:03.530134 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2253/4529] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:03 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:03.531671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f195480-6dcc-4b8d-bb9e-c9f0d7cacff4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:03.551494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f195480-6dcc-4b8d-bb9e-c9f0d7cacff4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:03.732353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14ba2f-c34c-402f-a903-97faaca5c6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:03.732353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14ba2f-c34c-402f-a903-97faaca5c6ee admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:03.732353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14ba2f-c34c-402f-a903-97faaca5c6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:03.732353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14ba2f-c34c-402f-a903-97faaca5c6ee admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:03.779849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14ba2f-c34c-402f-a903-97faaca5c6ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:03.779849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14ba2f-c34c-402f-a903-97faaca5c6ee admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:03.800317 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2277/4530] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:03 2022] POST /identity/v3/users => generated 291 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:03.804336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb50eb-567d-4851-aef7-e65b491f0ec1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:03.850126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb50eb-567d-4851-aef7-e65b491f0ec1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:03.861080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a276e27-6eb5-4071-817f-2ccfdd2b0dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:03.861898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a276e27-6eb5-4071-817f-2ccfdd2b0dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:03.862446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a276e27-6eb5-4071-817f-2ccfdd2b0dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:03.863279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a276e27-6eb5-4071-817f-2ccfdd2b0dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:03.864239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a276e27-6eb5-4071-817f-2ccfdd2b0dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:03.866395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a276e27-6eb5-4071-817f-2ccfdd2b0dc0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:03.899495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14ba2f-c34c-402f-a903-97faaca5c6ee admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:03.907024 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2254/4531] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:03.911475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14ba2f-c34c-402f-a903-97faaca5c6ee admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:03.926053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a3423-13bd-4b89-98be-5232df453c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:03.927821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a3423-13bd-4b89-98be-5232df453c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:03.928613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a3423-13bd-4b89-98be-5232df453c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:03.931484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a3423-13bd-4b89-98be-5232df453c9a admin admin] PATH_INFO: `/v3/projects/c739a2adabec41d5989077a885628f87/users/1db64ea1025b47cd80b4e4259b56dd36/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:03.984506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a3423-13bd-4b89-98be-5232df453c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c739a2adabec41d5989077a885628f87, user_id=1db64ea1025b47cd80b4e4259b56dd36, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:03.991477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a3423-13bd-4b89-98be-5232df453c9a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:04.029040 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2278/4532] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:03 2022] PUT /identity/v3/projects/c739a2adabec41d5989077a885628f87/users/1db64ea1025b47cd80b4e4259b56dd36/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:04.031930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a276e27-6eb5-4071-817f-2ccfdd2b0dc0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:04.046898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a276e27-6eb5-4071-817f-2ccfdd2b0dc0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:04.162336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b0e6d-ef73-450d-ad47-be27504eeade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:04.165708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0e6d-ef73-450d-ad47-be27504eeade admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:04.166073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0e6d-ef73-450d-ad47-be27504eeade admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:04.166521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0e6d-ef73-450d-ad47-be27504eeade admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:04.167766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b0e6d-ef73-450d-ad47-be27504eeade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:04.170769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b0e6d-ef73-450d-ad47-be27504eeade admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:04.192443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a3423-13bd-4b89-98be-5232df453c9a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:04.207812 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2255/4533] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:04.209870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a3423-13bd-4b89-98be-5232df453c9a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:04.215843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d490680-710c-480d-b627-be763b4eff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:04.217602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d490680-710c-480d-b627-be763b4eff95 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:04.217602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d490680-710c-480d-b627-be763b4eff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:04.217602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d490680-710c-480d-b627-be763b4eff95 admin admin] PATH_INFO: `/v3/projects/c739a2adabec41d5989077a885628f87/users/1db64ea1025b47cd80b4e4259b56dd36/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:04.219740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d490680-710c-480d-b627-be763b4eff95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c739a2adabec41d5989077a885628f87, user_id=1db64ea1025b47cd80b4e4259b56dd36, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:04.222657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d490680-710c-480d-b627-be763b4eff95 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:04.266079 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2279/4534] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:04 2022] PUT /identity/v3/projects/c739a2adabec41d5989077a885628f87/users/1db64ea1025b47cd80b4e4259b56dd36/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:04.269338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccf8b6-361a-465f-8215-d4716f298f32 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:04.269712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccf8b6-361a-465f-8215-d4716f298f32 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:04.270063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccf8b6-361a-465f-8215-d4716f298f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:04.343259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4fccf8b6-361a-465f-8215-d4716f298f32 None None] MFA Rules not processed for user `1db64ea1025b47cd80b4e4259b56dd36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:04.352083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4fccf8b6-361a-465f-8215-d4716f298f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:04.557040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:04.563699 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2256/4535] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:04.568669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d490680-710c-480d-b627-be763b4eff95 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:04.583360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d490680-710c-480d-b627-be763b4eff95 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:04.590659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a11cf-4da1-4424-9d79-d91e345e746b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:04.591282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a11cf-4da1-4424-9d79-d91e345e746b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:04.591565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a11cf-4da1-4424-9d79-d91e345e746b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:04.591837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a11cf-4da1-4424-9d79-d91e345e746b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:04.592492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a11cf-4da1-4424-9d79-d91e345e746b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:04.595552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a11cf-4da1-4424-9d79-d91e345e746b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:04.624431 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2280/4536] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:04 2022] POST /identity/v3/services => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:04.625628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccf8b6-361a-465f-8215-d4716f298f32 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:04.636853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccf8b6-361a-465f-8215-d4716f298f32 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:04.683632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709c51c-85c2-4e3d-9f46-8fdab6fa2ed0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:04.686748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709c51c-85c2-4e3d-9f46-8fdab6fa2ed0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:04.688823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709c51c-85c2-4e3d-9f46-8fdab6fa2ed0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:04.689121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709c51c-85c2-4e3d-9f46-8fdab6fa2ed0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:04.689850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709c51c-85c2-4e3d-9f46-8fdab6fa2ed0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:04.692990 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-1709c51c-85c2-4e3d-9f46-8fdab6fa2ed0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:04.692990 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:10:04.692990 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:04.693940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709c51c-85c2-4e3d-9f46-8fdab6fa2ed0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:04.778126 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-1709c51c-85c2-4e3d-9f46-8fdab6fa2ed0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-20408891. To ensure interoperability, identifiers should be a valid uuid. Oct 08 21:10:04.778126 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 08 21:10:04.778126 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:04.834545 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2257/4537] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 8 21:10:04 2022] POST /identity/v3/endpoints => generated 356 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:04.835735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a11cf-4da1-4424-9d79-d91e345e746b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:04.841336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:04.851045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a11cf-4da1-4424-9d79-d91e345e746b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:04.883928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01078f-f97e-4b63-8910-de41e75a5e92 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:04.884498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01078f-f97e-4b63-8910-de41e75a5e92 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:04.884786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01078f-f97e-4b63-8910-de41e75a5e92 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:04.885068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01078f-f97e-4b63-8910-de41e75a5e92 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/regions/tempest-region-20408891` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:04.885696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01078f-f97e-4b63-8910-de41e75a5e92 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-20408891)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:04.890983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01078f-f97e-4b63-8910-de41e75a5e92 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:04.896229 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2281/4538] 10.222.0.26 () {58 vars in 1200 bytes} [Sat Oct 8 21:10:04 2022] GET /identity/v3/regions/tempest-region-20408891 => generated 176 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:04.897395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709c51c-85c2-4e3d-9f46-8fdab6fa2ed0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:04.916497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709c51c-85c2-4e3d-9f46-8fdab6fa2ed0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:04.926903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c33e8-79b1-412a-a67e-8a590d77f7a1 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:04.927516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c33e8-79b1-412a-a67e-8a590d77f7a1 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:04.927820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c33e8-79b1-412a-a67e-8a590d77f7a1 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:04.928088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c33e8-79b1-412a-a67e-8a590d77f7a1 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:04.928717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c33e8-79b1-412a-a67e-8a590d77f7a1 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:04.930419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c33e8-79b1-412a-a67e-8a590d77f7a1 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:04.971247 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2258/4539] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:04 2022] POST /identity/v3/services => generated 287 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:04.972670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01078f-f97e-4b63-8910-de41e75a5e92 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:04.987931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01078f-f97e-4b63-8910-de41e75a5e92 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:05.018807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bf987-fed9-4c93-ac14-c2193253de7a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:05.019449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bf987-fed9-4c93-ac14-c2193253de7a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:05.019735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bf987-fed9-4c93-ac14-c2193253de7a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:05.020026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bf987-fed9-4c93-ac14-c2193253de7a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:05.020727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bf987-fed9-4c93-ac14-c2193253de7a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:05.021764 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-fd5bf987-fed9-4c93-ac14-c2193253de7a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:05.021764 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:10:05.021764 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:10:05.022656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bf987-fed9-4c93-ac14-c2193253de7a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:05.088339 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-fd5bf987-fed9-4c93-ac14-c2193253de7a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-340147443. To ensure interoperability, identifiers should be a valid uuid. Oct 08 21:10:05.088339 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 08 21:10:05.088339 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:10:05.184851 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2282/4540] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 8 21:10:04 2022] POST /identity/v3/endpoints => generated 361 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:05.190197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c33e8-79b1-412a-a67e-8a590d77f7a1 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:05.211438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c33e8-79b1-412a-a67e-8a590d77f7a1 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:05.257722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc39de-ed35-44fa-9ace-d11f9175e11d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:05.258764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc39de-ed35-44fa-9ace-d11f9175e11d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:05.259428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc39de-ed35-44fa-9ace-d11f9175e11d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:05.259880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc39de-ed35-44fa-9ace-d11f9175e11d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/regions/tempest-region-340147443` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:05.260642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc39de-ed35-44fa-9ace-d11f9175e11d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-340147443)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:05.261940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc39de-ed35-44fa-9ace-d11f9175e11d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:05.264430 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2259/4541] 10.222.0.26 () {58 vars in 1203 bytes} [Sat Oct 8 21:10:05 2022] GET /identity/v3/regions/tempest-region-340147443 => generated 178 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:10:05.269435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bf987-fed9-4c93-ac14-c2193253de7a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:05.286247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bf987-fed9-4c93-ac14-c2193253de7a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:05.292470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410191-3f3e-430e-949e-eccd358b5c4e tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:05.293303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410191-3f3e-430e-949e-eccd358b5c4e tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:05.293695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410191-3f3e-430e-949e-eccd358b5c4e tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:05.294078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410191-3f3e-430e-949e-eccd358b5c4e tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:05.294901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e410191-3f3e-430e-949e-eccd358b5c4e tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:05.297279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e410191-3f3e-430e-949e-eccd358b5c4e tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:05.323040 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-3e410191-3f3e-430e-949e-eccd358b5c4e tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2000684475. To ensure interoperability, identifiers should be a valid uuid. Oct 08 21:10:05.323040 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 08 21:10:05.323040 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:10:05.450330 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2283/4542] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 8 21:10:05 2022] POST /identity/v3/endpoints => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:10:05.454199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc39de-ed35-44fa-9ace-d11f9175e11d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:05.466567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc39de-ed35-44fa-9ace-d11f9175e11d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:05.510930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0dd6-a458-4c92-854a-1bf972f10dc5 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:05.511579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0dd6-a458-4c92-854a-1bf972f10dc5 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:05.511872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0dd6-a458-4c92-854a-1bf972f10dc5 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:05.512152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0dd6-a458-4c92-854a-1bf972f10dc5 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/regions/tempest-region-2000684475` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:05.512750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c0dd6-a458-4c92-854a-1bf972f10dc5 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2000684475)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:05.514010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c0dd6-a458-4c92-854a-1bf972f10dc5 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:05.523824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410191-3f3e-430e-949e-eccd358b5c4e tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:05.534214 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2260/4543] 10.222.0.26 () {58 vars in 1206 bytes} [Sat Oct 8 21:10:05 2022] GET /identity/v3/regions/tempest-region-2000684475 => generated 180 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:05.537412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410191-3f3e-430e-949e-eccd358b5c4e tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:05.552679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40951bb6-fedd-41f2-b75d-f88073314c1c tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:05.553591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40951bb6-fedd-41f2-b75d-f88073314c1c tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:05.553886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40951bb6-fedd-41f2-b75d-f88073314c1c tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:05.554166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40951bb6-fedd-41f2-b75d-f88073314c1c tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:05.555431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40951bb6-fedd-41f2-b75d-f88073314c1c tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:05.557131 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-40951bb6-fedd-41f2-b75d-f88073314c1c tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:05.557131 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:10:05.557131 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:10:05.558057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40951bb6-fedd-41f2-b75d-f88073314c1c tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:05.580264 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2284/4544] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Oct 8 21:10:05 2022] GET /identity/v3/endpoints => generated 4392 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:05.581571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0dd6-a458-4c92-854a-1bf972f10dc5 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:05.594201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0dd6-a458-4c92-854a-1bf972f10dc5 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:05.599408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f66897-0c58-4fab-8a88-10189b74d15a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:05.600378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f66897-0c58-4fab-8a88-10189b74d15a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:05.600737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f66897-0c58-4fab-8a88-10189b74d15a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:05.601087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f66897-0c58-4fab-8a88-10189b74d15a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints/290e323086ae4130a48b9d1221ca4124` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:05.609652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f66897-0c58-4fab-8a88-10189b74d15a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=290e323086ae4130a48b9d1221ca4124)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:05.611641 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-b0f66897-0c58-4fab-8a88-10189b74d15a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:05.611641 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:10:05.611641 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:05.617326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f66897-0c58-4fab-8a88-10189b74d15a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:05.623575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40951bb6-fedd-41f2-b75d-f88073314c1c tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:05.624125 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2261/4545] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:05 2022] GET /identity/v3/endpoints/290e323086ae4130a48b9d1221ca4124 => generated 361 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:05.634958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40951bb6-fedd-41f2-b75d-f88073314c1c tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:05.646359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ea247-f4e9-4fc8-9a9f-21f8f65929cc tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:05.647168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ea247-f4e9-4fc8-9a9f-21f8f65929cc tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:05.647571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ea247-f4e9-4fc8-9a9f-21f8f65929cc tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:05.647956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ea247-f4e9-4fc8-9a9f-21f8f65929cc tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints/290e323086ae4130a48b9d1221ca4124` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:05.650177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ea247-f4e9-4fc8-9a9f-21f8f65929cc tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=290e323086ae4130a48b9d1221ca4124)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:05.651262 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-c86ea247-f4e9-4fc8-9a9f-21f8f65929cc tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:05.651262 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:10:05.651262 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:10:05.652407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ea247-f4e9-4fc8-9a9f-21f8f65929cc tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:05.667193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c86ea247-f4e9-4fc8-9a9f-21f8f65929cc tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '290e323086ae4130a48b9d1221ca4124', 'request_id': 'req-c86ea247-f4e9-4fc8-9a9f-21f8f65929cc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:05.685737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f66897-0c58-4fab-8a88-10189b74d15a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:05.686213 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2285/4546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:05 2022] DELETE /identity/v3/endpoints/290e323086ae4130a48b9d1221ca4124 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:05.700755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f66897-0c58-4fab-8a88-10189b74d15a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:05.721832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c5049-a91f-47f6-95dc-5f896ed5f369 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:05.722611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c5049-a91f-47f6-95dc-5f896ed5f369 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:05.723010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c5049-a91f-47f6-95dc-5f896ed5f369 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:05.723393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c5049-a91f-47f6-95dc-5f896ed5f369 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:05.724147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c5049-a91f-47f6-95dc-5f896ed5f369 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:05.725852 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-246c5049-a91f-47f6-95dc-5f896ed5f369 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:05.725852 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:10:05.725852 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:05.727559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c5049-a91f-47f6-95dc-5f896ed5f369 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:05.742896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ea247-f4e9-4fc8-9a9f-21f8f65929cc tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:05.744267 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2262/4547] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Oct 8 21:10:05 2022] GET /identity/v3/endpoints => generated 4044 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:05.756008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ea247-f4e9-4fc8-9a9f-21f8f65929cc tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:05.765134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c0f7c-a9ca-43e2-997f-86bee9601f44 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:05.765134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0f7c-a9ca-43e2-997f-86bee9601f44 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:05.765134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0f7c-a9ca-43e2-997f-86bee9601f44 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:05.765567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0f7c-a9ca-43e2-997f-86bee9601f44 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints/290e323086ae4130a48b9d1221ca4124` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:05.770527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c0f7c-a9ca-43e2-997f-86bee9601f44 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-6f7c0f7c-a9ca-43e2-997f-86bee9601f44 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Could not find endpoint: 290e323086ae4130a48b9d1221ca4124.: keystone.exception.EndpointNotFound: Could not find endpoint: 290e323086ae4130a48b9d1221ca4124. Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._iter().one() Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._only_one_row( Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:10:05.804568 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 290e323086ae4130a48b9d1221ca4124. Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:10:05.806429 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:10:05.807402 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:10:05.809642 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:10:05.809642 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:10:05.809642 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:10:05.809642 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:10:05.809642 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:10:05.809642 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:10:05.809642 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:10:05.809642 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:10:05.809642 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:10:05.809642 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 08 21:10:05.809642 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 08 21:10:05.809642 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 290e323086ae4130a48b9d1221ca4124. Oct 08 21:10:05.809642 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:05.820437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c5049-a91f-47f6-95dc-5f896ed5f369 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:05.823812 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2286/4548] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:05 2022] DELETE /identity/v3/endpoints/290e323086ae4130a48b9d1221ca4124 => generated 114 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:10:05.832771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c5049-a91f-47f6-95dc-5f896ed5f369 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:05.839425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354bcf0-9a94-45f4-b7e4-8307759b93be tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:05.840999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354bcf0-9a94-45f4-b7e4-8307759b93be tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:05.841531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354bcf0-9a94-45f4-b7e4-8307759b93be tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:05.842046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354bcf0-9a94-45f4-b7e4-8307759b93be tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/regions/tempest-region-2000684475` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:05.842853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354bcf0-9a94-45f4-b7e4-8307759b93be tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2000684475)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:05.846153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354bcf0-9a94-45f4-b7e4-8307759b93be tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:05.885560 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-7354bcf0-9a94-45f4-b7e4-8307759b93be tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2000684475. To ensure interoperability, identifiers should be a valid uuid. Oct 08 21:10:05.885560 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 08 21:10:05.885560 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:05.914881 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2263/4549] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Oct 8 21:10:05 2022] DELETE /identity/v3/regions/tempest-region-2000684475 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:05.920447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c0f7c-a9ca-43e2-997f-86bee9601f44 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:05.943392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c0f7c-a9ca-43e2-997f-86bee9601f44 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:05.992336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c0455-f083-4dee-8e4b-67fd6b7a7633 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:05.993114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c0455-f083-4dee-8e4b-67fd6b7a7633 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:05.993753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c0455-f083-4dee-8e4b-67fd6b7a7633 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:05.995353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c0455-f083-4dee-8e4b-67fd6b7a7633 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:05.995353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c0455-f083-4dee-8e4b-67fd6b7a7633 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:05.996734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c0455-f083-4dee-8e4b-67fd6b7a7633 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:06.016139 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2287/4550] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Oct 8 21:10:05 2022] GET /identity/v3/endpoints => generated 4044 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:06.017750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354bcf0-9a94-45f4-b7e4-8307759b93be tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:06.036760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354bcf0-9a94-45f4-b7e4-8307759b93be tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:06.049542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1de64c-cea4-4af4-9199-96a97cd44add tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:06.050572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1de64c-cea4-4af4-9199-96a97cd44add tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:06.051019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1de64c-cea4-4af4-9199-96a97cd44add tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:06.051457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1de64c-cea4-4af4-9199-96a97cd44add tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:06.052691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1de64c-cea4-4af4-9199-96a97cd44add tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Adding query filter params (service_id=933021ffe42149aa8232e1d42f0b7522) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:06.053494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1de64c-cea4-4af4-9199-96a97cd44add tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:06.075130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1de64c-cea4-4af4-9199-96a97cd44add tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:06.097481 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2264/4551] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:10:06 2022] GET /identity/v3/endpoints?service_id=933021ffe42149aa8232e1d42f0b7522 => generated 498 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:06.102837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c0455-f083-4dee-8e4b-67fd6b7a7633 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:06.123796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c0455-f083-4dee-8e4b-67fd6b7a7633 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:06.149744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f55ee-41af-4271-97ce-b2320fef275d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:06.150454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f55ee-41af-4271-97ce-b2320fef275d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:06.150693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f55ee-41af-4271-97ce-b2320fef275d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:06.150926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f55ee-41af-4271-97ce-b2320fef275d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:06.157356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f55ee-41af-4271-97ce-b2320fef275d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Adding query filter params (service_id=76a3603b0f42406c9d4d1cbf13f4dd13) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:06.157638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f55ee-41af-4271-97ce-b2320fef275d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:06.159181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f55ee-41af-4271-97ce-b2320fef275d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:06.186710 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2288/4552] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:10:06 2022] GET /identity/v3/endpoints?service_id=76a3603b0f42406c9d4d1cbf13f4dd13 => generated 503 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:10:06.190951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1de64c-cea4-4af4-9199-96a97cd44add tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:06.209734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1de64c-cea4-4af4-9199-96a97cd44add tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:06.226773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac238d1-b667-4082-90de-45540aa50f26 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:06.227401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac238d1-b667-4082-90de-45540aa50f26 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:06.227691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac238d1-b667-4082-90de-45540aa50f26 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:06.227968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac238d1-b667-4082-90de-45540aa50f26 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:06.228642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac238d1-b667-4082-90de-45540aa50f26 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:06.228952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac238d1-b667-4082-90de-45540aa50f26 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:06.230611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac238d1-b667-4082-90de-45540aa50f26 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:06.272736 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2265/4553] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 8 21:10:06 2022] GET /identity/v3/endpoints?interface=public => generated 3401 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:06.275604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f55ee-41af-4271-97ce-b2320fef275d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:06.290385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f55ee-41af-4271-97ce-b2320fef275d tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:06.305772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b2630-0378-4a5d-9ea4-da9e2047b7a0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:06.306469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b2630-0378-4a5d-9ea4-da9e2047b7a0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:06.306790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b2630-0378-4a5d-9ea4-da9e2047b7a0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:06.307028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b2630-0378-4a5d-9ea4-da9e2047b7a0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:06.307710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b2630-0378-4a5d-9ea4-da9e2047b7a0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:06.308022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b2630-0378-4a5d-9ea4-da9e2047b7a0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:06.321961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b2630-0378-4a5d-9ea4-da9e2047b7a0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:06.334864 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2289/4554] 10.222.0.26 () {58 vars in 1171 bytes} [Sat Oct 8 21:10:06 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:06.336742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac238d1-b667-4082-90de-45540aa50f26 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:06.353793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac238d1-b667-4082-90de-45540aa50f26 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:06.368013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54003215-e9f7-46ce-af53-fa0a1399e4b2 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:06.371574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54003215-e9f7-46ce-af53-fa0a1399e4b2 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:06.372091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54003215-e9f7-46ce-af53-fa0a1399e4b2 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:06.372578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54003215-e9f7-46ce-af53-fa0a1399e4b2 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:06.373497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54003215-e9f7-46ce-af53-fa0a1399e4b2 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:06.375341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54003215-e9f7-46ce-af53-fa0a1399e4b2 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:06.420235 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2266/4555] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:06 2022] POST /identity/v3/services => generated 287 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:06.421649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b2630-0378-4a5d-9ea4-da9e2047b7a0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:06.438486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b2630-0378-4a5d-9ea4-da9e2047b7a0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:06.467977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e16252-a169-4dd5-a925-417044a3f8b3 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:06.468651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16252-a169-4dd5-a925-417044a3f8b3 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:06.469046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16252-a169-4dd5-a925-417044a3f8b3 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:06.469520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16252-a169-4dd5-a925-417044a3f8b3 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:06.481442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e16252-a169-4dd5-a925-417044a3f8b3 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:06.483272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e16252-a169-4dd5-a925-417044a3f8b3 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:06.550779 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-03e16252-a169-4dd5-a925-417044a3f8b3 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-260237299. To ensure interoperability, identifiers should be a valid uuid. Oct 08 21:10:06.550779 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 08 21:10:06.550779 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:10:06.597701 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2290/4556] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 8 21:10:06 2022] POST /identity/v3/endpoints => generated 359 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:06.602185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54003215-e9f7-46ce-af53-fa0a1399e4b2 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:06.622728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54003215-e9f7-46ce-af53-fa0a1399e4b2 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:06.666057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af13504-2085-4133-9960-4477d833fc69 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:06.667609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af13504-2085-4133-9960-4477d833fc69 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:06.671141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af13504-2085-4133-9960-4477d833fc69 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:06.671660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af13504-2085-4133-9960-4477d833fc69 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/regions/tempest-region-260237299` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:06.672555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af13504-2085-4133-9960-4477d833fc69 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-260237299)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:06.673920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af13504-2085-4133-9960-4477d833fc69 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:06.687765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e16252-a169-4dd5-a925-417044a3f8b3 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:06.694469 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2267/4557] 10.222.0.26 () {58 vars in 1203 bytes} [Sat Oct 8 21:10:06 2022] GET /identity/v3/regions/tempest-region-260237299 => generated 178 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:06.708430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e16252-a169-4dd5-a925-417044a3f8b3 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:06.714631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242bb37-f4ef-41e0-b0b0-22f487eb08a4 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:06.716294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242bb37-f4ef-41e0-b0b0-22f487eb08a4 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:06.717483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242bb37-f4ef-41e0-b0b0-22f487eb08a4 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:06.717973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242bb37-f4ef-41e0-b0b0-22f487eb08a4 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints/b84f494d0443492da7ad3e2bb718e7a6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:06.728284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:06.734498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242bb37-f4ef-41e0-b0b0-22f487eb08a4 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=b84f494d0443492da7ad3e2bb718e7a6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:06.736084 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-e242bb37-f4ef-41e0-b0b0-22f487eb08a4 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:06.736084 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:10:06.736084 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:10:06.740345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242bb37-f4ef-41e0-b0b0-22f487eb08a4 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:06.784023 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-e242bb37-f4ef-41e0-b0b0-22f487eb08a4 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1993975618. To ensure interoperability, identifiers should be a valid uuid. Oct 08 21:10:06.784023 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 08 21:10:06.784023 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:10:06.856858 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2291/4558] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 8 21:10:06 2022] PATCH /identity/v3/endpoints/b84f494d0443492da7ad3e2bb718e7a6 => generated 364 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:06.861010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af13504-2085-4133-9960-4477d833fc69 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:06.874499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af13504-2085-4133-9960-4477d833fc69 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:06.935642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ffb9d-160d-43bf-863c-0f185fe12932 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:06.936824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ffb9d-160d-43bf-863c-0f185fe12932 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:06.938455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ffb9d-160d-43bf-863c-0f185fe12932 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:06.938455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ffb9d-160d-43bf-863c-0f185fe12932 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/regions/tempest-region-1993975618` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:06.939033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ffb9d-160d-43bf-863c-0f185fe12932 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1993975618)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:06.940377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ffb9d-160d-43bf-863c-0f185fe12932 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:06.961554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242bb37-f4ef-41e0-b0b0-22f487eb08a4 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:06.975287 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2268/4559] 10.222.0.26 () {58 vars in 1206 bytes} [Sat Oct 8 21:10:06 2022] GET /identity/v3/regions/tempest-region-1993975618 => generated 180 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:07.012079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242bb37-f4ef-41e0-b0b0-22f487eb08a4 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:07.038011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a634d6-4a07-4864-b914-3fe22d50b357 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:07.039536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a634d6-4a07-4864-b914-3fe22d50b357 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:07.042084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a634d6-4a07-4864-b914-3fe22d50b357 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:07.042573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a634d6-4a07-4864-b914-3fe22d50b357 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints/b84f494d0443492da7ad3e2bb718e7a6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:07.055334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a634d6-4a07-4864-b914-3fe22d50b357 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=b84f494d0443492da7ad3e2bb718e7a6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:07.058011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a634d6-4a07-4864-b914-3fe22d50b357 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:07.079564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-64a634d6-4a07-4864-b914-3fe22d50b357 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'b84f494d0443492da7ad3e2bb718e7a6', 'request_id': 'req-64a634d6-4a07-4864-b914-3fe22d50b357'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:07.088066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ffb9d-160d-43bf-863c-0f185fe12932 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:07.090726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7c9ffb9d-160d-43bf-863c-0f185fe12932 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:07.122395 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2292/4560] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:06 2022] DELETE /identity/v3/endpoints/b84f494d0443492da7ad3e2bb718e7a6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:10:07.124328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d8ad8-b60a-4a51-92ad-c58d50182765 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:07.125813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d8ad8-b60a-4a51-92ad-c58d50182765 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:07.127622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d8ad8-b60a-4a51-92ad-c58d50182765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:07.143275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:07.176006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-028d8ad8-b60a-4a51-92ad-c58d50182765 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:07.182442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-028d8ad8-b60a-4a51-92ad-c58d50182765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:07.259998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ffb9d-160d-43bf-863c-0f185fe12932 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:07.300403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:07.301482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:07.302014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:07.302499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] PATH_INFO: `/v3/users/510e775193c446a3988c2bfe5fe30fdd` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:07.303960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] RBAC: Authorizing `identity:delete_user(user_id=510e775193c446a3988c2bfe5fe30fdd)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:07.308391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:07.402937 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2293/4561] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3953 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:07.403924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d8ad8-b60a-4a51-92ad-c58d50182765 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:07.410599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '510e775193c446a3988c2bfe5fe30fdd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:07.425231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '510e775193c446a3988c2bfe5fe30fdd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:07.426382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '510e775193c446a3988c2bfe5fe30fdd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:07.427272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '510e775193c446a3988c2bfe5fe30fdd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:07.442189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d8ad8-b60a-4a51-92ad-c58d50182765 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:07.450744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '510e775193c446a3988c2bfe5fe30fdd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:07.454870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515b5fc-011d-4053-9c01-7e89a3febafd tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:07.455547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515b5fc-011d-4053-9c01-7e89a3febafd tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:07.455803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515b5fc-011d-4053-9c01-7e89a3febafd tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:07.456100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515b5fc-011d-4053-9c01-7e89a3febafd tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/regions/tempest-region-1993975618` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:07.456956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515b5fc-011d-4053-9c01-7e89a3febafd tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1993975618)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:07.458378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515b5fc-011d-4053-9c01-7e89a3febafd tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:07.481027 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2269/4562] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:07 2022] DELETE /identity/v3/users/510e775193c446a3988c2bfe5fe30fdd => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:10:07.484250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:07.486226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:07.510256 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2294/4563] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Oct 8 21:10:07 2022] DELETE /identity/v3/regions/tempest-region-1993975618 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:07.511638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8fa5d-00ec-447b-bc74-d49fede088b0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:07.511928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8fa5d-00ec-447b-bc74-d49fede088b0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:07.513889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8fa5d-00ec-447b-bc74-d49fede088b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:07.559420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d8c8fa5d-00ec-447b-bc74-d49fede088b0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:07.560008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d8c8fa5d-00ec-447b-bc74-d49fede088b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:07.627898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb6f98-20e1-4872-88c7-d3c04c73252f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:07.650795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76530ced-8554-46e9-89c7-a869c5907a95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:07.651533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530ced-8554-46e9-89c7-a869c5907a95 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:07.651819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530ced-8554-46e9-89c7-a869c5907a95 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:07.652094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530ced-8554-46e9-89c7-a869c5907a95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:07.661434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-76530ced-8554-46e9-89c7-a869c5907a95 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:07.671736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:07.707400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:07.729257 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2295/4564] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3997 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:07.738584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8fa5d-00ec-447b-bc74-d49fede088b0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:07.739982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d8c8fa5d-00ec-447b-bc74-d49fede088b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:07.749615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76530ced-8554-46e9-89c7-a869c5907a95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:07.752022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76530ced-8554-46e9-89c7-a869c5907a95 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:07.769064 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2270/4565] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:10:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:07.770288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76530ced-8554-46e9-89c7-a869c5907a95 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:07.774064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-76530ced-8554-46e9-89c7-a869c5907a95 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:07.906072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76530ced-8554-46e9-89c7-a869c5907a95 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:07.910203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8fa5d-00ec-447b-bc74-d49fede088b0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:07.915719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c0067-7f95-4531-92bf-515d69e6cd50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:07.917918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c0067-7f95-4531-92bf-515d69e6cd50 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:07.918955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c0067-7f95-4531-92bf-515d69e6cd50 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:07.920302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c0067-7f95-4531-92bf-515d69e6cd50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:07.923099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f4a9e-ac22-43cc-b071-1db2f83dda31 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:07.925418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f4a9e-ac22-43cc-b071-1db2f83dda31 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:07.926593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f4a9e-ac22-43cc-b071-1db2f83dda31 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:07.927090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f4a9e-ac22-43cc-b071-1db2f83dda31 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/regions/tempest-region-260237299` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:07.928947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f4a9e-ac22-43cc-b071-1db2f83dda31 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-260237299)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:07.934964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f4a9e-ac22-43cc-b071-1db2f83dda31 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:07.947813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c0067-7f95-4531-92bf-515d69e6cd50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:07.949715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c0067-7f95-4531-92bf-515d69e6cd50 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:07.991220 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2271/4566] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:07 2022] GET /identity/v3/auth/tokens => generated 3997 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:10:07.991564 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2296/4567] 10.222.0.26 () {58 vars in 1206 bytes} [Sat Oct 8 21:10:07 2022] DELETE /identity/v3/regions/tempest-region-260237299 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:07.996676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c0067-7f95-4531-92bf-515d69e6cd50 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:08.023159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c0067-7f95-4531-92bf-515d69e6cd50 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:08.064458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c61355-212e-4d96-8c2f-956eeb95743a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:08.065334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c61355-212e-4d96-8c2f-956eeb95743a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:08.065878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c61355-212e-4d96-8c2f-956eeb95743a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:08.066331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c61355-212e-4d96-8c2f-956eeb95743a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/services/86a4effe635b47cc88de58f5febbc785` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:08.067175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c61355-212e-4d96-8c2f-956eeb95743a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:delete_service(service_id=86a4effe635b47cc88de58f5febbc785)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:08.072204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c61355-212e-4d96-8c2f-956eeb95743a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:08.146012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f4a9e-ac22-43cc-b071-1db2f83dda31 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:08.161349 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2272/4568] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:07 2022] DELETE /identity/v3/services/86a4effe635b47cc88de58f5febbc785 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:08.163470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f4a9e-ac22-43cc-b071-1db2f83dda31 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:08.219020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1306c-aecc-44d8-b80a-700a961590d0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:08.220769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1306c-aecc-44d8-b80a-700a961590d0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:08.221384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1306c-aecc-44d8-b80a-700a961590d0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:08.221890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1306c-aecc-44d8-b80a-700a961590d0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints/0c9e02933ad94fa0bda4a8a28ec0a8ff` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:08.229116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1306c-aecc-44d8-b80a-700a961590d0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=0c9e02933ad94fa0bda4a8a28ec0a8ff)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:08.232452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1306c-aecc-44d8-b80a-700a961590d0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:08.272965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-75e1306c-aecc-44d8-b80a-700a961590d0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '0c9e02933ad94fa0bda4a8a28ec0a8ff', 'request_id': 'req-75e1306c-aecc-44d8-b80a-700a961590d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:08.304421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c61355-212e-4d96-8c2f-956eeb95743a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:08.305699 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2297/4569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:08 2022] DELETE /identity/v3/endpoints/0c9e02933ad94fa0bda4a8a28ec0a8ff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:08.317797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c61355-212e-4d96-8c2f-956eeb95743a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:08.341930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61f048-68d7-4fff-9831-2fb9049b0c36 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:08.342721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61f048-68d7-4fff-9831-2fb9049b0c36 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:08.343115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61f048-68d7-4fff-9831-2fb9049b0c36 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:08.343492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61f048-68d7-4fff-9831-2fb9049b0c36 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/regions/tempest-region-340147443` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:08.344918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61f048-68d7-4fff-9831-2fb9049b0c36 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-340147443)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:08.350376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61f048-68d7-4fff-9831-2fb9049b0c36 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:08.394619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1306c-aecc-44d8-b80a-700a961590d0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:08.399243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-75e1306c-aecc-44d8-b80a-700a961590d0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:08.417092 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-ec61f048-68d7-4fff-9831-2fb9049b0c36 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-340147443. To ensure interoperability, identifiers should be a valid uuid. Oct 08 21:10:08.417092 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 08 21:10:08.417092 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:08.466394 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2273/4570] 10.222.0.26 () {58 vars in 1206 bytes} [Sat Oct 8 21:10:08 2022] DELETE /identity/v3/regions/tempest-region-340147443 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:08.468197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61f048-68d7-4fff-9831-2fb9049b0c36 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:08.501332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61f048-68d7-4fff-9831-2fb9049b0c36 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:08.506985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1306c-aecc-44d8-b80a-700a961590d0 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:08.515108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa03d78-53b1-4fd9-bfa3-4b0661fc541a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:08.515778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa03d78-53b1-4fd9-bfa3-4b0661fc541a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:08.516091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa03d78-53b1-4fd9-bfa3-4b0661fc541a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:08.516351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa03d78-53b1-4fd9-bfa3-4b0661fc541a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/services/76a3603b0f42406c9d4d1cbf13f4dd13` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:08.516944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa03d78-53b1-4fd9-bfa3-4b0661fc541a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:delete_service(service_id=76a3603b0f42406c9d4d1cbf13f4dd13)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:08.525317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa03d78-53b1-4fd9-bfa3-4b0661fc541a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:08.563348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a203e-da5b-4935-a649-2b9d144ad096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:08.564011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a203e-da5b-4935-a649-2b9d144ad096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:08.564291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a203e-da5b-4935-a649-2b9d144ad096 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:08.564573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a203e-da5b-4935-a649-2b9d144ad096 admin admin] PATH_INFO: `/v3/projects/180055cc8f2249079a1b611b32a04c11` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:08.575069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a203e-da5b-4935-a649-2b9d144ad096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=180055cc8f2249079a1b611b32a04c11)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:08.584140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a203e-da5b-4935-a649-2b9d144ad096 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:08.598566 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2274/4571] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:08 2022] DELETE /identity/v3/services/76a3603b0f42406c9d4d1cbf13f4dd13 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:08.607973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa03d78-53b1-4fd9-bfa3-4b0661fc541a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:08.635302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:08.665596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa03d78-53b1-4fd9-bfa3-4b0661fc541a tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:08.682107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4f755-c4d6-4ca6-8124-4c8e2c9dafb8 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:08.685292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4f755-c4d6-4ca6-8124-4c8e2c9dafb8 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:08.685874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4f755-c4d6-4ca6-8124-4c8e2c9dafb8 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:08.686530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4f755-c4d6-4ca6-8124-4c8e2c9dafb8 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/endpoints/16d65e71c2534656942911fdd1226af9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:08.691186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb6a203e-da5b-4935-a649-2b9d144ad096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180055cc8f2249079a1b611b32a04c11', 'request_id': 'req-eb6a203e-da5b-4935-a649-2b9d144ad096'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:08.700418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4f755-c4d6-4ca6-8124-4c8e2c9dafb8 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=16d65e71c2534656942911fdd1226af9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:08.704466 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-ffb4f755-c4d6-4ca6-8124-4c8e2c9dafb8 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:08.704466 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:10:08.704466 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:08.704812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb6a203e-da5b-4935-a649-2b9d144ad096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180055cc8f2249079a1b611b32a04c11', 'request_id': 'req-eb6a203e-da5b-4935-a649-2b9d144ad096'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:08.707894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4f755-c4d6-4ca6-8124-4c8e2c9dafb8 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:08.713863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb6a203e-da5b-4935-a649-2b9d144ad096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180055cc8f2249079a1b611b32a04c11', 'request_id': 'req-eb6a203e-da5b-4935-a649-2b9d144ad096'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:08.728285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ffb4f755-c4d6-4ca6-8124-4c8e2c9dafb8 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '16d65e71c2534656942911fdd1226af9', 'request_id': 'req-ffb4f755-c4d6-4ca6-8124-4c8e2c9dafb8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:08.743417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb6a203e-da5b-4935-a649-2b9d144ad096 admin admin] The token cache is being invalidate because project 180055cc8f2249079a1b611b32a04c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:08.746365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb6a203e-da5b-4935-a649-2b9d144ad096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:08.747945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb6a203e-da5b-4935-a649-2b9d144ad096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:08.755439 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2298/4572] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:08 2022] DELETE /identity/v3/projects/180055cc8f2249079a1b611b32a04c11 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:10:08.759327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab8beb-0d77-4132-8f73-ced0755bca82 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:08.759750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab8beb-0d77-4132-8f73-ced0755bca82 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:08.760051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab8beb-0d77-4132-8f73-ced0755bca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:08.760506 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2275/4573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:08 2022] DELETE /identity/v3/endpoints/16d65e71c2534656942911fdd1226af9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:08.770259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:08.775350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4f755-c4d6-4ca6-8124-4c8e2c9dafb8 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:08.778090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ffb4f755-c4d6-4ca6-8124-4c8e2c9dafb8 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:08.817155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-65ab8beb-0d77-4132-8f73-ced0755bca82 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:08.818994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-65ab8beb-0d77-4132-8f73-ced0755bca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:08.837876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4f755-c4d6-4ca6-8124-4c8e2c9dafb8 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:08.971861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b7d39-a2fa-470c-ab7c-5c0e4de0d4a9 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:08.973062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b7d39-a2fa-470c-ab7c-5c0e4de0d4a9 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:08.973357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b7d39-a2fa-470c-ab7c-5c0e4de0d4a9 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:08.973650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b7d39-a2fa-470c-ab7c-5c0e4de0d4a9 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/regions/tempest-region-20408891` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:08.974517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b7d39-a2fa-470c-ab7c-5c0e4de0d4a9 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-20408891)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:08.978755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b7d39-a2fa-470c-ab7c-5c0e4de0d4a9 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:08.999420 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2299/4574] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:09.008700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aff163-72ab-444a-a9d6-8a7c2338e670 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:09.009337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aff163-72ab-444a-a9d6-8a7c2338e670 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:09.011159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aff163-72ab-444a-a9d6-8a7c2338e670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:09.030115 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2276/4575] 10.222.0.26 () {58 vars in 1203 bytes} [Sat Oct 8 21:10:08 2022] DELETE /identity/v3/regions/tempest-region-20408891 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:09.034446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b7d39-a2fa-470c-ab7c-5c0e4de0d4a9 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:09.057351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f1aff163-72ab-444a-a9d6-8a7c2338e670 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:09.058952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f1aff163-72ab-444a-a9d6-8a7c2338e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:09.088758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b7d39-a2fa-470c-ab7c-5c0e4de0d4a9 tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:09.105912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a0fe2-cd55-48cd-ad23-d8ec535bd60b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db64ea1025b47cd80b4e4259b56dd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c739a2adabec41d5989077a885628f87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:09.108141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a0fe2-cd55-48cd-ad23-d8ec535bd60b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:09.108980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a0fe2-cd55-48cd-ad23-d8ec535bd60b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:09.109815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a0fe2-cd55-48cd-ad23-d8ec535bd60b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] PATH_INFO: `/v3/services/933021ffe42149aa8232e1d42f0b7522` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:09.111250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a0fe2-cd55-48cd-ad23-d8ec535bd60b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorizing `identity:delete_service(service_id=933021ffe42149aa8232e1d42f0b7522)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:09.114832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a0fe2-cd55-48cd-ad23-d8ec535bd60b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:09.116877 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2300/4576] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:09.121429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aff163-72ab-444a-a9d6-8a7c2338e670 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:09.144577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aff163-72ab-444a-a9d6-8a7c2338e670 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:09.179939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd6e69-443a-427e-ab41-d81958bdec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:09.185048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd6e69-443a-427e-ab41-d81958bdec30 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:09.186390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd6e69-443a-427e-ab41-d81958bdec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:09.188055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd6e69-443a-427e-ab41-d81958bdec30 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:09.194010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd6e69-443a-427e-ab41-d81958bdec30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:09.198323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd6e69-443a-427e-ab41-d81958bdec30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:09.203171 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2277/4577] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:09 2022] DELETE /identity/v3/services/933021ffe42149aa8232e1d42f0b7522 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:09.205873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd6e69-443a-427e-ab41-d81958bdec30 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:09.207060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a0fe2-cd55-48cd-ad23-d8ec535bd60b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:09.211136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4a2a0fe2-cd55-48cd-ad23-d8ec535bd60b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:09.238353 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2301/4578] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:09.239500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd6e69-443a-427e-ab41-d81958bdec30 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:09.260351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd6e69-443a-427e-ab41-d81958bdec30 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:09.291555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a0fe2-cd55-48cd-ad23-d8ec535bd60b tempest-EndPointsTestJSON-118646568 tempest-EndPointsTestJSON-118646568-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:09.299030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858fdc2-547e-49da-b3b5-2f07c41185f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:09.299646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858fdc2-547e-49da-b3b5-2f07c41185f5 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:09.299924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858fdc2-547e-49da-b3b5-2f07c41185f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:09.300054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd901f-91b9-4035-b5e3-bda03772c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:09.300210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858fdc2-547e-49da-b3b5-2f07c41185f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:09.300929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858fdc2-547e-49da-b3b5-2f07c41185f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:09.301042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd901f-91b9-4035-b5e3-bda03772c709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:09.301247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd901f-91b9-4035-b5e3-bda03772c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:09.301536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd901f-91b9-4035-b5e3-bda03772c709 admin admin] PATH_INFO: `/v3/users/c7c7f292b8204fbea111a59a922fe834` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:09.302702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd901f-91b9-4035-b5e3-bda03772c709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c7f292b8204fbea111a59a922fe834)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:09.302828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858fdc2-547e-49da-b3b5-2f07c41185f5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:09.306242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd901f-91b9-4035-b5e3-bda03772c709 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:09.375400 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2302/4579] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:09 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:10:09.380298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858fdc2-547e-49da-b3b5-2f07c41185f5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:09.478798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f3cd901f-91b9-4035-b5e3-bda03772c709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c7f292b8204fbea111a59a922fe834'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:09.491720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f3cd901f-91b9-4035-b5e3-bda03772c709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c7f292b8204fbea111a59a922fe834'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:09.493530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f3cd901f-91b9-4035-b5e3-bda03772c709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c7f292b8204fbea111a59a922fe834'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:09.508301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f3cd901f-91b9-4035-b5e3-bda03772c709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c7f292b8204fbea111a59a922fe834'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:09.525906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858fdc2-547e-49da-b3b5-2f07c41185f5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:09.529805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=13 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:09.541755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee659c-153e-4334-9c65-2c8fb4c8ee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:09.542393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee659c-153e-4334-9c65-2c8fb4c8ee9b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:09.542673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee659c-153e-4334-9c65-2c8fb4c8ee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:09.542942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee659c-153e-4334-9c65-2c8fb4c8ee9b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:09.543600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee659c-153e-4334-9c65-2c8fb4c8ee9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:09.545535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee659c-153e-4334-9c65-2c8fb4c8ee9b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:09.552590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f3cd901f-91b9-4035-b5e3-bda03772c709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c7f292b8204fbea111a59a922fe834'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:09.576801 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2278/4580] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:09 2022] DELETE /identity/v3/users/c7c7f292b8204fbea111a59a922fe834 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:09.581301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536f77a-b563-4a85-8f10-ec5f50b67951 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:09.583211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536f77a-b563-4a85-8f10-ec5f50b67951 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:09.583773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536f77a-b563-4a85-8f10-ec5f50b67951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:09.602535 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2303/4581] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:09 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:09.605214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee659c-153e-4334-9c65-2c8fb4c8ee9b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:09.607649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-91ee659c-153e-4334-9c65-2c8fb4c8ee9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:09.636640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0536f77a-b563-4a85-8f10-ec5f50b67951 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:09.637132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee659c-153e-4334-9c65-2c8fb4c8ee9b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:09.637924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0536f77a-b563-4a85-8f10-ec5f50b67951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:09.697796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:09.823251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc00e4-ceef-4c42-a2ea-08b8fe270a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:09.824470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc00e4-ceef-4c42-a2ea-08b8fe270a88 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:09.825043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc00e4-ceef-4c42-a2ea-08b8fe270a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:09.825335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc00e4-ceef-4c42-a2ea-08b8fe270a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:09.826105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc00e4-ceef-4c42-a2ea-08b8fe270a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:09.827927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc00e4-ceef-4c42-a2ea-08b8fe270a88 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:09.849233 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2279/4582] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:09.859470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536f77a-b563-4a85-8f10-ec5f50b67951 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:09.862780 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2304/4583] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:09.866546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0536f77a-b563-4a85-8f10-ec5f50b67951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:09.879226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc00e4-ceef-4c42-a2ea-08b8fe270a88 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:09.922152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc00e4-ceef-4c42-a2ea-08b8fe270a88 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:09.944451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea9ec2-7045-40ab-99d2-f85fe75ec4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:09.944451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9ec2-7045-40ab-99d2-f85fe75ec4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:09.945118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9ec2-7045-40ab-99d2-f85fe75ec4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:09.945972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9ec2-7045-40ab-99d2-f85fe75ec4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:09.946777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea9ec2-7045-40ab-99d2-f85fe75ec4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:09.962198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea9ec2-7045-40ab-99d2-f85fe75ec4e4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:10.000147 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2305/4584] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:10.001152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea9ec2-7045-40ab-99d2-f85fe75ec4e4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:10.015368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea9ec2-7045-40ab-99d2-f85fe75ec4e4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:10.040055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f729c5-b282-4866-a9ce-95cbb958e30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:10.042172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f729c5-b282-4866-a9ce-95cbb958e30b admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:10.043103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f729c5-b282-4866-a9ce-95cbb958e30b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:10.045825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f729c5-b282-4866-a9ce-95cbb958e30b admin admin] PATH_INFO: `/v3/projects/1ac07a2d4f5645d5afe02ab94b23a128/users/acb8fd2c129c475aaddca7e30e5b74f3/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:10.089779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536f77a-b563-4a85-8f10-ec5f50b67951 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:10.101783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d2a66-7de9-4cad-a538-1860a804758c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:10.103350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d2a66-7de9-4cad-a538-1860a804758c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:10.103851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d2a66-7de9-4cad-a538-1860a804758c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:10.104903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d2a66-7de9-4cad-a538-1860a804758c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:10.106022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f729c5-b282-4866-a9ce-95cbb958e30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac07a2d4f5645d5afe02ab94b23a128, user_id=acb8fd2c129c475aaddca7e30e5b74f3, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:10.115897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f729c5-b282-4866-a9ce-95cbb958e30b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:10.120750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d2a66-7de9-4cad-a538-1860a804758c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:10.123169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d2a66-7de9-4cad-a538-1860a804758c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:10.140387 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2306/4585] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:10 2022] PUT /identity/v3/projects/1ac07a2d4f5645d5afe02ab94b23a128/users/acb8fd2c129c475aaddca7e30e5b74f3/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:10.141620 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2280/4586] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:10:10.151876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a39bd-8e56-4f5f-8005-a2b6c01e8c27 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:10.152171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a39bd-8e56-4f5f-8005-a2b6c01e8c27 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:10.152490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a39bd-8e56-4f5f-8005-a2b6c01e8c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:10.211264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c39a39bd-8e56-4f5f-8005-a2b6c01e8c27 None None] MFA Rules not processed for user `acb8fd2c129c475aaddca7e30e5b74f3`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:10.212498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c39a39bd-8e56-4f5f-8005-a2b6c01e8c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:10.442788 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2307/4587] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:10.534878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d2a66-7de9-4cad-a538-1860a804758c service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:10.593646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d2a66-7de9-4cad-a538-1860a804758c service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:10.787042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ad1fb-fd21-436b-915e-77b294347086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:10.790620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad1fb-fd21-436b-915e-77b294347086 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:10.791993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad1fb-fd21-436b-915e-77b294347086 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:10.792757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad1fb-fd21-436b-915e-77b294347086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:10.821455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ad1fb-fd21-436b-915e-77b294347086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:10.830348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ad1fb-fd21-436b-915e-77b294347086 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:10.838356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a39bd-8e56-4f5f-8005-a2b6c01e8c27 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:10.840086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c39a39bd-8e56-4f5f-8005-a2b6c01e8c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:10.904573 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2281/4588] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:10:10.991791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a39bd-8e56-4f5f-8005-a2b6c01e8c27 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:11.004534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314360c-f1ea-4817-a32e-c1adb2fab25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:11.005541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314360c-f1ea-4817-a32e-c1adb2fab25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:11.006130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314360c-f1ea-4817-a32e-c1adb2fab25f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:11.006417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314360c-f1ea-4817-a32e-c1adb2fab25f admin admin] PATH_INFO: `/v3/projects/a0c1878cdbde4dc4b575c2d2810d041a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:11.010212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314360c-f1ea-4817-a32e-c1adb2fab25f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c1878cdbde4dc4b575c2d2810d041a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:11.012296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314360c-f1ea-4817-a32e-c1adb2fab25f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:11.048910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:11.110095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0314360c-f1ea-4817-a32e-c1adb2fab25f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c1878cdbde4dc4b575c2d2810d041a', 'request_id': 'req-0314360c-f1ea-4817-a32e-c1adb2fab25f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:11.125683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0314360c-f1ea-4817-a32e-c1adb2fab25f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c1878cdbde4dc4b575c2d2810d041a', 'request_id': 'req-0314360c-f1ea-4817-a32e-c1adb2fab25f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:11.140599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0314360c-f1ea-4817-a32e-c1adb2fab25f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c1878cdbde4dc4b575c2d2810d041a', 'request_id': 'req-0314360c-f1ea-4817-a32e-c1adb2fab25f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:11.175526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0314360c-f1ea-4817-a32e-c1adb2fab25f admin admin] The token cache is being invalidate because project a0c1878cdbde4dc4b575c2d2810d041a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:11.175838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0314360c-f1ea-4817-a32e-c1adb2fab25f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:11.176741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0314360c-f1ea-4817-a32e-c1adb2fab25f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:11.181954 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2308/4589] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:10 2022] DELETE /identity/v3/projects/a0c1878cdbde4dc4b575c2d2810d041a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:10:11.185362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ad1fb-fd21-436b-915e-77b294347086 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:11.206681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ad1fb-fd21-436b-915e-77b294347086 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:11.238190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:11.410042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:11.410706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:11.411093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:11.411372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] PATH_INFO: `/v3/users/1db64ea1025b47cd80b4e4259b56dd36` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:11.413523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db64ea1025b47cd80b4e4259b56dd36)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:11.415710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:11.577798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db64ea1025b47cd80b4e4259b56dd36'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:11.618016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db64ea1025b47cd80b4e4259b56dd36'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:11.625685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db64ea1025b47cd80b4e4259b56dd36'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:11.626522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db64ea1025b47cd80b4e4259b56dd36'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:11.654083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db64ea1025b47cd80b4e4259b56dd36'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:11.679534 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2282/4590] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:11 2022] DELETE /identity/v3/users/1db64ea1025b47cd80b4e4259b56dd36 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:12.365353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7b6fa-2d74-486f-af81-439424801cf1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:12.366333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7b6fa-2d74-486f-af81-439424801cf1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:12.366860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7b6fa-2d74-486f-af81-439424801cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:12.413134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-acd7b6fa-2d74-486f-af81-439424801cf1 None None] MFA Rules not processed for user `6a78d352c143483c8e4702d789d4c516`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:12.416177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-acd7b6fa-2d74-486f-af81-439424801cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:12.588241 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2309/4591] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:12.688960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:12.691241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:12.893393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb8c00-dee5-49e9-9f8f-7cea2a768125 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:12.900967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:12.902541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:12.902932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:12.903314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3 admin admin] PATH_INFO: `/v3/projects/c739a2adabec41d5989077a885628f87` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:12.904623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c739a2adabec41d5989077a885628f87)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:12.907567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:13.031392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:13.051069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c739a2adabec41d5989077a885628f87', 'request_id': 'req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:13.065471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c739a2adabec41d5989077a885628f87', 'request_id': 'req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:13.073849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c739a2adabec41d5989077a885628f87', 'request_id': 'req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:13.095008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3 admin admin] The token cache is being invalidate because project c739a2adabec41d5989077a885628f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:13.095303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:13.098215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fb456cbe-6b79-4da6-8afc-dc3a981b18f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:13.104260 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2283/4592] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:12 2022] DELETE /identity/v3/projects/c739a2adabec41d5989077a885628f87 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:13.109800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74791e2-eeff-4201-b6b4-14a28398a62e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:13.110295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74791e2-eeff-4201-b6b4-14a28398a62e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:13.110748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74791e2-eeff-4201-b6b4-14a28398a62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:13.176460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d74791e2-eeff-4201-b6b4-14a28398a62e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:13.180412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d74791e2-eeff-4201-b6b4-14a28398a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:13.338726 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2310/4593] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:13.339130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a799f-8d42-4b93-a5e5-c3589442c31a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:13.339423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a799f-8d42-4b93-a5e5-c3589442c31a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:13.340097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a799f-8d42-4b93-a5e5-c3589442c31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:13.384734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-054a799f-8d42-4b93-a5e5-c3589442c31a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:13.386742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-054a799f-8d42-4b93-a5e5-c3589442c31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:13.408280 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2284/4594] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:10:13.411079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74791e2-eeff-4201-b6b4-14a28398a62e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:13.423481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74791e2-eeff-4201-b6b4-14a28398a62e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:13.448500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384d8fc-fa13-4083-9619-41bcba3a8322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:13.449215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384d8fc-fa13-4083-9619-41bcba3a8322 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:13.449496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384d8fc-fa13-4083-9619-41bcba3a8322 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:13.449771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384d8fc-fa13-4083-9619-41bcba3a8322 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:13.450508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384d8fc-fa13-4083-9619-41bcba3a8322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:13.450815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384d8fc-fa13-4083-9619-41bcba3a8322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:13.452512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384d8fc-fa13-4083-9619-41bcba3a8322 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:13.514940 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2311/4595] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:13.516810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a799f-8d42-4b93-a5e5-c3589442c31a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:13.539326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a799f-8d42-4b93-a5e5-c3589442c31a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:13.567834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeff885-1759-4b69-a2a2-7ebc86fc180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:13.570794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeff885-1759-4b69-a2a2-7ebc86fc180a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:13.573099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeff885-1759-4b69-a2a2-7ebc86fc180a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:13.574941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeff885-1759-4b69-a2a2-7ebc86fc180a admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:13.575900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeff885-1759-4b69-a2a2-7ebc86fc180a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:13.578200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeff885-1759-4b69-a2a2-7ebc86fc180a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:13.634392 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2285/4596] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:13 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:13.635123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384d8fc-fa13-4083-9619-41bcba3a8322 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:13.661619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384d8fc-fa13-4083-9619-41bcba3a8322 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:13.765692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:13.933867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68198dbd-e8a4-4595-8b59-dc6d2e492d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:13.934494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198dbd-e8a4-4595-8b59-dc6d2e492d3d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:13.934775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198dbd-e8a4-4595-8b59-dc6d2e492d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:13.935104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198dbd-e8a4-4595-8b59-dc6d2e492d3d admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:13.935753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68198dbd-e8a4-4595-8b59-dc6d2e492d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:13.937881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68198dbd-e8a4-4595-8b59-dc6d2e492d3d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:14.034685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeff885-1759-4b69-a2a2-7ebc86fc180a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:14.064945 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2312/4597] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:13 2022] POST /identity/v3/users => generated 294 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:10:14.080920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeff885-1759-4b69-a2a2-7ebc86fc180a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:14.110062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05c5e3-70c3-4465-845b-d216fdf373f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:14.110676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05c5e3-70c3-4465-845b-d216fdf373f0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:14.115263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05c5e3-70c3-4465-845b-d216fdf373f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:14.115552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05c5e3-70c3-4465-845b-d216fdf373f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:14.134227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05c5e3-70c3-4465-845b-d216fdf373f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:14.137079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05c5e3-70c3-4465-845b-d216fdf373f0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:14.193993 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2286/4598] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:14.199223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68198dbd-e8a4-4595-8b59-dc6d2e492d3d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:14.215532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68198dbd-e8a4-4595-8b59-dc6d2e492d3d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:14.228005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f0270-a94f-4f46-8ffa-0b807214b6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:14.228904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f0270-a94f-4f46-8ffa-0b807214b6ee admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:14.229445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f0270-a94f-4f46-8ffa-0b807214b6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:14.229963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f0270-a94f-4f46-8ffa-0b807214b6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:14.230834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f0270-a94f-4f46-8ffa-0b807214b6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:14.232649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f0270-a94f-4f46-8ffa-0b807214b6ee admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:14.272541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05c5e3-70c3-4465-845b-d216fdf373f0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:14.273053 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2313/4599] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:14.303402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05c5e3-70c3-4465-845b-d216fdf373f0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:14.320220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debee4d-059d-40fd-a054-6f99abff5564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:14.320942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debee4d-059d-40fd-a054-6f99abff5564 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:14.321407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debee4d-059d-40fd-a054-6f99abff5564 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:14.321689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debee4d-059d-40fd-a054-6f99abff5564 admin admin] PATH_INFO: `/v3/projects/345269f5b6114a98ba635d3928a0d702/users/1797774277ff401985fbd97992aad4c7/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:14.381316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debee4d-059d-40fd-a054-6f99abff5564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=345269f5b6114a98ba635d3928a0d702, user_id=1797774277ff401985fbd97992aad4c7, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:14.384605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debee4d-059d-40fd-a054-6f99abff5564 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:14.418035 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2287/4600] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:14 2022] PUT /identity/v3/projects/345269f5b6114a98ba635d3928a0d702/users/1797774277ff401985fbd97992aad4c7/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:14.432209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874741f-0b29-4a67-b6b9-cbdf6a5861eb None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:14.433046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874741f-0b29-4a67-b6b9-cbdf6a5861eb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:14.433517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874741f-0b29-4a67-b6b9-cbdf6a5861eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:14.540252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a874741f-0b29-4a67-b6b9-cbdf6a5861eb None None] MFA Rules not processed for user `1797774277ff401985fbd97992aad4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:14.542077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a874741f-0b29-4a67-b6b9-cbdf6a5861eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:14.697000 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2314/4601] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:14.701272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debee4d-059d-40fd-a054-6f99abff5564 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:14.882553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debee4d-059d-40fd-a054-6f99abff5564 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:14.891087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25434ce9-a39a-4b0e-88b5-5bdd905c775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:14.892894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25434ce9-a39a-4b0e-88b5-5bdd905c775e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:14.893207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25434ce9-a39a-4b0e-88b5-5bdd905c775e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:14.894662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25434ce9-a39a-4b0e-88b5-5bdd905c775e admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:14.895318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25434ce9-a39a-4b0e-88b5-5bdd905c775e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:14.900056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25434ce9-a39a-4b0e-88b5-5bdd905c775e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:14.958832 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2288/4602] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:14 2022] POST /identity/v3/projects => generated 387 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:14.964284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874741f-0b29-4a67-b6b9-cbdf6a5861eb None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:14.988311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874741f-0b29-4a67-b6b9-cbdf6a5861eb None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:15.166876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25434ce9-a39a-4b0e-88b5-5bdd905c775e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:15.174966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-25434ce9-a39a-4b0e-88b5-5bdd905c775e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:15.203469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bad14-6f97-4291-9c4d-af90f3d2e5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:15.204109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bad14-6f97-4291-9c4d-af90f3d2e5cc admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:15.206830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bad14-6f97-4291-9c4d-af90f3d2e5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:15.208705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bad14-6f97-4291-9c4d-af90f3d2e5cc admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:15.209631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bad14-6f97-4291-9c4d-af90f3d2e5cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:15.215399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bad14-6f97-4291-9c4d-af90f3d2e5cc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:15.287496 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2315/4603] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:14 2022] POST /identity/v3/users => generated 300 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:15.291600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bad14-6f97-4291-9c4d-af90f3d2e5cc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:15.310436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:15.331203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bad14-6f97-4291-9c4d-af90f3d2e5cc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:15.348368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0fd54-84db-4452-8769-cda2ed5f88ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:15.349989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0fd54-84db-4452-8769-cda2ed5f88ff admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:15.353218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0fd54-84db-4452-8769-cda2ed5f88ff admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:15.353485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0fd54-84db-4452-8769-cda2ed5f88ff admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:15.358400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0fd54-84db-4452-8769-cda2ed5f88ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:15.403723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0fd54-84db-4452-8769-cda2ed5f88ff admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:15.473255 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2316/4604] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:10:15.475559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0fd54-84db-4452-8769-cda2ed5f88ff admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:15.500345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0fd54-84db-4452-8769-cda2ed5f88ff admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:15.513380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b99737-c03c-4a36-b8b0-bd262fcd1d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:15.514211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b99737-c03c-4a36-b8b0-bd262fcd1d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:15.514595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b99737-c03c-4a36-b8b0-bd262fcd1d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:15.514977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b99737-c03c-4a36-b8b0-bd262fcd1d59 admin admin] PATH_INFO: `/v3/projects/a191401e0ec947459e85cef49b4c0929/users/6638c08faec04884a62b9f0eada7dbe0/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:15.518413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25434ce9-a39a-4b0e-88b5-5bdd905c775e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:15.538054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66fe49-5f75-4587-90aa-0c6840edbb4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:15.539490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66fe49-5f75-4587-90aa-0c6840edbb4e service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:15.541390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66fe49-5f75-4587-90aa-0c6840edbb4e service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:15.542661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66fe49-5f75-4587-90aa-0c6840edbb4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:15.547447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8f66fe49-5f75-4587-90aa-0c6840edbb4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:15.566977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b99737-c03c-4a36-b8b0-bd262fcd1d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a191401e0ec947459e85cef49b4c0929, user_id=6638c08faec04884a62b9f0eada7dbe0, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:15.570398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b99737-c03c-4a36-b8b0-bd262fcd1d59 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:15.573000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:15.611495 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2317/4605] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:15 2022] PUT /identity/v3/projects/a191401e0ec947459e85cef49b4c0929/users/6638c08faec04884a62b9f0eada7dbe0/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:10:15.612565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b99737-c03c-4a36-b8b0-bd262fcd1d59 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:15.748373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b99737-c03c-4a36-b8b0-bd262fcd1d59 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:15.755032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4afb6c-f25c-4250-ad25-99015973ecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:15.755989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4afb6c-f25c-4250-ad25-99015973ecb9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:15.756477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4afb6c-f25c-4250-ad25-99015973ecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:15.756986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4afb6c-f25c-4250-ad25-99015973ecb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:15.758489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4afb6c-f25c-4250-ad25-99015973ecb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:15.759451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66fe49-5f75-4587-90aa-0c6840edbb4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:15.761303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4afb6c-f25c-4250-ad25-99015973ecb9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:15.767740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66fe49-5f75-4587-90aa-0c6840edbb4e service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:15.788727 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2318/4606] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:15.789985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4afb6c-f25c-4250-ad25-99015973ecb9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:15.820966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4afb6c-f25c-4250-ad25-99015973ecb9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:15.835480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a97f75-6958-4743-9796-e14cead3f333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:15.836436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a97f75-6958-4743-9796-e14cead3f333 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:15.836923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a97f75-6958-4743-9796-e14cead3f333 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:15.837433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a97f75-6958-4743-9796-e14cead3f333 admin admin] PATH_INFO: `/v3/projects/a191401e0ec947459e85cef49b4c0929/users/6638c08faec04884a62b9f0eada7dbe0/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:15.842376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a97f75-6958-4743-9796-e14cead3f333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a191401e0ec947459e85cef49b4c0929, user_id=6638c08faec04884a62b9f0eada7dbe0, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:15.849250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a97f75-6958-4743-9796-e14cead3f333 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:15.861157 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2289/4607] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:10:15.880379 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2319/4608] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:15 2022] PUT /identity/v3/projects/a191401e0ec947459e85cef49b4c0929/users/6638c08faec04884a62b9f0eada7dbe0/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:15.891956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cdc02-218e-4be6-b074-8a7018bf88c8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:15.892508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cdc02-218e-4be6-b074-8a7018bf88c8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:15.892789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cdc02-218e-4be6-b074-8a7018bf88c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:15.963670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-eb5cdc02-218e-4be6-b074-8a7018bf88c8 None None] MFA Rules not processed for user `6638c08faec04884a62b9f0eada7dbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:15.965393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eb5cdc02-218e-4be6-b074-8a7018bf88c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:16.173241 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2290/4609] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:10:16.175635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a97f75-6958-4743-9796-e14cead3f333 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:16.199139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a97f75-6958-4743-9796-e14cead3f333 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:16.213754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223660-e760-4f9f-8014-0fad2a6623cd tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:16.215701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223660-e760-4f9f-8014-0fad2a6623cd tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:16.216712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223660-e760-4f9f-8014-0fad2a6623cd tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:16.217675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223660-e760-4f9f-8014-0fad2a6623cd tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:16.221090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce223660-e760-4f9f-8014-0fad2a6623cd tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:16.229412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce223660-e760-4f9f-8014-0fad2a6623cd tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:16.285255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cdc02-218e-4be6-b074-8a7018bf88c8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:16.285951 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2320/4610] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:16 2022] POST /identity/v3/services => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:16.309297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cdc02-218e-4be6-b074-8a7018bf88c8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:16.350874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064f987-698a-458c-862b-644440bed006 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:16.353250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064f987-698a-458c-862b-644440bed006 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:16.353809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064f987-698a-458c-862b-644440bed006 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:16.355701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064f987-698a-458c-862b-644440bed006 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:16.356619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064f987-698a-458c-862b-644440bed006 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:16.362929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064f987-698a-458c-862b-644440bed006 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-1064f987-698a-458c-862b-644440bed006 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: On instance['enabled']: Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: On instance['enabled']: Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: 'False' Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise error Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application On instance['enabled']: Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application 'False' Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.401573 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 08 21:10:16.404176 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 08 21:10:16.407025 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 08 21:10:16.407025 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 08 21:10:16.407025 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.407025 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:16.407025 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:16.407025 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.407025 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application On instance['enabled']: Oct 08 21:10:16.407025 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application 'False' Oct 08 21:10:16.407025 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.411752 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2291/4611] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 8 21:10:16 2022] POST /identity/v3/endpoints => generated 283 bytes in 127 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 08 21:10:16.417487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223660-e760-4f9f-8014-0fad2a6623cd tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:16.445631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223660-e760-4f9f-8014-0fad2a6623cd tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:16.462073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f3593-6e6c-4b6d-86b7-9023ecaf4b07 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:16.462854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f3593-6e6c-4b6d-86b7-9023ecaf4b07 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:16.463134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f3593-6e6c-4b6d-86b7-9023ecaf4b07 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:16.463407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f3593-6e6c-4b6d-86b7-9023ecaf4b07 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:16.464085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f3593-6e6c-4b6d-86b7-9023ecaf4b07 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:16.465911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f3593-6e6c-4b6d-86b7-9023ecaf4b07 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-c65f3593-6e6c-4b6d-86b7-9023ecaf4b07 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: On instance['enabled']: Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: On instance['enabled']: Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: 'True' Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise error Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application On instance['enabled']: Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application 'True' Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:16.489172 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 08 21:10:16.491145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 08 21:10:16.495487 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 08 21:10:16.495487 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 08 21:10:16.495487 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:16.495487 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:16.495487 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:16.495487 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:16.495487 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application On instance['enabled']: Oct 08 21:10:16.495487 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application 'True' Oct 08 21:10:16.495487 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:16.495487 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2321/4612] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 8 21:10:16 2022] POST /identity/v3/endpoints => generated 281 bytes in 74 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 08 21:10:16.496542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064f987-698a-458c-862b-644440bed006 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:16.518015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064f987-698a-458c-862b-644440bed006 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:16.534458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a021e49-1958-4012-9b00-4d499b74a3a0 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:16.535340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a021e49-1958-4012-9b00-4d499b74a3a0 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:16.535647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a021e49-1958-4012-9b00-4d499b74a3a0 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:16.536107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a021e49-1958-4012-9b00-4d499b74a3a0 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:16.536811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a021e49-1958-4012-9b00-4d499b74a3a0 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:16.539942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a021e49-1958-4012-9b00-4d499b74a3a0 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:16.600927 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-4a021e49-1958-4012-9b00-4d499b74a3a0 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1667588335. To ensure interoperability, identifiers should be a valid uuid. Oct 08 21:10:16.600927 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 08 21:10:16.600927 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:16.684080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:16.703485 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2292/4613] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 8 21:10:16 2022] POST /identity/v3/endpoints => generated 361 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:10:16.705254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f3593-6e6c-4b6d-86b7-9023ecaf4b07 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:16.727379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f3593-6e6c-4b6d-86b7-9023ecaf4b07 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:16.816205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4127f-28c7-4ab8-bbae-10dcc880dfdb tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:16.822376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4127f-28c7-4ab8-bbae-10dcc880dfdb tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:16.825107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4127f-28c7-4ab8-bbae-10dcc880dfdb tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:16.825598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4127f-28c7-4ab8-bbae-10dcc880dfdb tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/regions/tempest-region-1667588335` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:16.826486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4127f-28c7-4ab8-bbae-10dcc880dfdb tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1667588335)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:16.828611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4127f-28c7-4ab8-bbae-10dcc880dfdb tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:16.848225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a021e49-1958-4012-9b00-4d499b74a3a0 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:16.851614 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2322/4614] 10.222.0.26 () {58 vars in 1206 bytes} [Sat Oct 8 21:10:16 2022] GET /identity/v3/regions/tempest-region-1667588335 => generated 180 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:16.862395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a021e49-1958-4012-9b00-4d499b74a3a0 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:16.868977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc055e90-28b3-4109-8c6d-d9acab129a24 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:16.870053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc055e90-28b3-4109-8c6d-d9acab129a24 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:16.870549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc055e90-28b3-4109-8c6d-d9acab129a24 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:16.871266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc055e90-28b3-4109-8c6d-d9acab129a24 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/endpoints/16baa5570024425782d67eaf4ec65c4a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:16.878179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc055e90-28b3-4109-8c6d-d9acab129a24 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=16baa5570024425782d67eaf4ec65c4a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:16.879872 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-dc055e90-28b3-4109-8c6d-d9acab129a24 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:16.879872 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:10:16.879872 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:16.880608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc055e90-28b3-4109-8c6d-d9acab129a24 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-dc055e90-28b3-4109-8c6d-d9acab129a24 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: On instance['enabled']: Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: On instance['enabled']: Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: 'False' Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise error Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application On instance['enabled']: Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application 'False' Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.889541 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 08 21:10:16.891199 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 08 21:10:16.892293 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 08 21:10:16.892293 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 08 21:10:16.892293 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.892293 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:16.892293 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:16.892293 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.892293 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application On instance['enabled']: Oct 08 21:10:16.892293 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application 'False' Oct 08 21:10:16.892293 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:10:16.899659 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2293/4615] 10.222.0.26 () {60 vars in 1255 bytes} [Sat Oct 8 21:10:16 2022] PATCH /identity/v3/endpoints/16baa5570024425782d67eaf4ec65c4a => generated 283 bytes in 50 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 08 21:10:16.903942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4127f-28c7-4ab8-bbae-10dcc880dfdb tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:16.984078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4127f-28c7-4ab8-bbae-10dcc880dfdb tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:17.039895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffc9d2-7e75-4a1a-8243-b58a78dc8460 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:17.040509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffc9d2-7e75-4a1a-8243-b58a78dc8460 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:17.041013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffc9d2-7e75-4a1a-8243-b58a78dc8460 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:17.041456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffc9d2-7e75-4a1a-8243-b58a78dc8460 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/endpoints/16baa5570024425782d67eaf4ec65c4a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:17.043393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffc9d2-7e75-4a1a-8243-b58a78dc8460 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=16baa5570024425782d67eaf4ec65c4a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:17.045873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffc9d2-7e75-4a1a-8243-b58a78dc8460 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:17.111513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23ffc9d2-7e75-4a1a-8243-b58a78dc8460 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '16baa5570024425782d67eaf4ec65c4a', 'request_id': 'req-23ffc9d2-7e75-4a1a-8243-b58a78dc8460'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:17.153157 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2323/4616] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:16 2022] DELETE /identity/v3/endpoints/16baa5570024425782d67eaf4ec65c4a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:17.155177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc055e90-28b3-4109-8c6d-d9acab129a24 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:17.170065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc055e90-28b3-4109-8c6d-d9acab129a24 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:17.214878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee182a14-7ef7-42ef-a13b-8ebb71071cd7 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:17.215854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee182a14-7ef7-42ef-a13b-8ebb71071cd7 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:17.215854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee182a14-7ef7-42ef-a13b-8ebb71071cd7 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:17.215854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee182a14-7ef7-42ef-a13b-8ebb71071cd7 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/regions/tempest-region-1667588335` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:17.217782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee182a14-7ef7-42ef-a13b-8ebb71071cd7 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1667588335)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:17.221950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee182a14-7ef7-42ef-a13b-8ebb71071cd7 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:17.276524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffc9d2-7e75-4a1a-8243-b58a78dc8460 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:17.284286 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2294/4617] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Oct 8 21:10:17 2022] DELETE /identity/v3/regions/tempest-region-1667588335 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:17.292099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffc9d2-7e75-4a1a-8243-b58a78dc8460 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:17.331326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18a8d7-bc3c-4fe2-bcc2-63c144404c30 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:17.332169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18a8d7-bc3c-4fe2-bcc2-63c144404c30 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:17.332496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18a8d7-bc3c-4fe2-bcc2-63c144404c30 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:17.332840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18a8d7-bc3c-4fe2-bcc2-63c144404c30 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:17.333613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18a8d7-bc3c-4fe2-bcc2-63c144404c30 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:17.335414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18a8d7-bc3c-4fe2-bcc2-63c144404c30 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:17.361178 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-5c18a8d7-bc3c-4fe2-bcc2-63c144404c30 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1746534614. To ensure interoperability, identifiers should be a valid uuid. Oct 08 21:10:17.361178 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 08 21:10:17.361178 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:10:17.430565 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2324/4618] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 8 21:10:17 2022] POST /identity/v3/endpoints => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:17.432625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee182a14-7ef7-42ef-a13b-8ebb71071cd7 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:17.467322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee182a14-7ef7-42ef-a13b-8ebb71071cd7 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:17.554226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53d708-1c2e-487a-a080-8a50cacee5c3 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:17.555223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53d708-1c2e-487a-a080-8a50cacee5c3 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:17.555745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53d708-1c2e-487a-a080-8a50cacee5c3 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:17.556186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53d708-1c2e-487a-a080-8a50cacee5c3 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/regions/tempest-region-1746534614` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:17.559267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53d708-1c2e-487a-a080-8a50cacee5c3 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1746534614)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:17.561026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53d708-1c2e-487a-a080-8a50cacee5c3 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:17.573894 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2295/4619] 10.222.0.26 () {58 vars in 1206 bytes} [Sat Oct 8 21:10:17 2022] GET /identity/v3/regions/tempest-region-1746534614 => generated 180 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:17.578256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18a8d7-bc3c-4fe2-bcc2-63c144404c30 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:17.598081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18a8d7-bc3c-4fe2-bcc2-63c144404c30 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:17.612657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0cab6-2e61-43dd-bb9f-964b611cd02a tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:17.613653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0cab6-2e61-43dd-bb9f-964b611cd02a tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:17.614145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0cab6-2e61-43dd-bb9f-964b611cd02a tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:17.614566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0cab6-2e61-43dd-bb9f-964b611cd02a tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/endpoints/0005ccff68424f0996609a768abb50de` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:17.626625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0cab6-2e61-43dd-bb9f-964b611cd02a tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=0005ccff68424f0996609a768abb50de)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:17.633209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0cab6-2e61-43dd-bb9f-964b611cd02a tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-50f0cab6-2e61-43dd-bb9f-964b611cd02a tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: On instance['enabled']: Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: On instance['enabled']: Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: 'True' Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise error Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application On instance['enabled']: Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application 'True' Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:17.648927 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 08 21:10:17.650296 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 08 21:10:17.651170 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 08 21:10:17.651170 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 08 21:10:17.651170 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:17.651170 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 08 21:10:17.651170 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 08 21:10:17.651170 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:17.651170 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application On instance['enabled']: Oct 08 21:10:17.651170 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application 'True' Oct 08 21:10:17.651170 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:17.654947 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2325/4620] 10.222.0.26 () {60 vars in 1255 bytes} [Sat Oct 8 21:10:17 2022] PATCH /identity/v3/endpoints/0005ccff68424f0996609a768abb50de => generated 281 bytes in 78 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 08 21:10:17.658902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53d708-1c2e-487a-a080-8a50cacee5c3 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:17.672671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53d708-1c2e-487a-a080-8a50cacee5c3 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:17.678182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787337d9-139a-4877-8212-3004bb3104fe tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:17.678823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787337d9-139a-4877-8212-3004bb3104fe tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:17.679106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787337d9-139a-4877-8212-3004bb3104fe tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:17.679443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787337d9-139a-4877-8212-3004bb3104fe tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/endpoints/0005ccff68424f0996609a768abb50de` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:17.684851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787337d9-139a-4877-8212-3004bb3104fe tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=0005ccff68424f0996609a768abb50de)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:17.687780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787337d9-139a-4877-8212-3004bb3104fe tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:17.707578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-787337d9-139a-4877-8212-3004bb3104fe tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '0005ccff68424f0996609a768abb50de', 'request_id': 'req-787337d9-139a-4877-8212-3004bb3104fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:17.727611 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2296/4621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:17 2022] DELETE /identity/v3/endpoints/0005ccff68424f0996609a768abb50de => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:17.728814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0cab6-2e61-43dd-bb9f-964b611cd02a tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:17.749690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0cab6-2e61-43dd-bb9f-964b611cd02a tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:17.788964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a330d5-a590-436b-9e6e-5f4f2629a072 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:17.790177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a330d5-a590-436b-9e6e-5f4f2629a072 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:17.790658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a330d5-a590-436b-9e6e-5f4f2629a072 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:17.791111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a330d5-a590-436b-9e6e-5f4f2629a072 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/regions/tempest-region-1746534614` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:17.791888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a330d5-a590-436b-9e6e-5f4f2629a072 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1746534614)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:17.793741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a330d5-a590-436b-9e6e-5f4f2629a072 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:17.860839 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2326/4622] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Oct 8 21:10:17 2022] DELETE /identity/v3/regions/tempest-region-1746534614 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:17.868349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787337d9-139a-4877-8212-3004bb3104fe tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:17.884855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787337d9-139a-4877-8212-3004bb3104fe tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:17.923998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c706c9-632e-4330-90b0-b8766560cec8 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6638c08faec04884a62b9f0eada7dbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a191401e0ec947459e85cef49b4c0929', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:17.924650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c706c9-632e-4330-90b0-b8766560cec8 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:17.924935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c706c9-632e-4330-90b0-b8766560cec8 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:17.925351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c706c9-632e-4330-90b0-b8766560cec8 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] PATH_INFO: `/v3/services/034d9b014b5c4862b29a61ca5d6a443e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:17.932026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c706c9-632e-4330-90b0-b8766560cec8 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorizing `identity:delete_service(service_id=034d9b014b5c4862b29a61ca5d6a443e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:17.932026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c706c9-632e-4330-90b0-b8766560cec8 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:17.964090 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2297/4623] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:17 2022] DELETE /identity/v3/services/034d9b014b5c4862b29a61ca5d6a443e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:17.968313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a330d5-a590-436b-9e6e-5f4f2629a072 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:17.976948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=5,keystone:SELECT=92,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:18.158989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a330d5-a590-436b-9e6e-5f4f2629a072 tempest-EndpointsNegativeTestJSON-1842200353 tempest-EndpointsNegativeTestJSON-1842200353-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:18.206113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:18.208107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:18.208623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:18.209106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] PATH_INFO: `/v3/users/1797774277ff401985fbd97992aad4c7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:18.214342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1797774277ff401985fbd97992aad4c7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:18.217628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:18.326834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1797774277ff401985fbd97992aad4c7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:18.346748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1797774277ff401985fbd97992aad4c7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:18.348350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1797774277ff401985fbd97992aad4c7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:18.349423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1797774277ff401985fbd97992aad4c7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:18.380451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1797774277ff401985fbd97992aad4c7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:18.416823 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2327/4624] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:17 2022] DELETE /identity/v3/users/1797774277ff401985fbd97992aad4c7 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:18.420166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4ee74-ea3f-4217-90c8-a32afa0aba64 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:18.420166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4ee74-ea3f-4217-90c8-a32afa0aba64 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:18.420758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4ee74-ea3f-4217-90c8-a32afa0aba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:18.463879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a1e4ee74-ea3f-4217-90c8-a32afa0aba64 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:18.467210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a1e4ee74-ea3f-4217-90c8-a32afa0aba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:18.555888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:18.558149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:18.636510 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2298/4625] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:18.690235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b246d5-e42d-4d05-a867-0953247e97b0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:18.695595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aece3d-a265-4326-ad27-012767bf00d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:18.696521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aece3d-a265-4326-ad27-012767bf00d6 service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:18.697023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aece3d-a265-4326-ad27-012767bf00d6 service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:18.697552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aece3d-a265-4326-ad27-012767bf00d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:18.704294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e3aece3d-a265-4326-ad27-012767bf00d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:18.719182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:18.987948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aece3d-a265-4326-ad27-012767bf00d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:18.990085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aece3d-a265-4326-ad27-012767bf00d6 service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:19.027766 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2328/4626] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:10:19.551455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4ee74-ea3f-4217-90c8-a32afa0aba64 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:19.562546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a1e4ee74-ea3f-4217-90c8-a32afa0aba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:19.582577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aece3d-a265-4326-ad27-012767bf00d6 service glance] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:19.587339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e3aece3d-a265-4326-ad27-012767bf00d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:19.770864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:19.771531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aece3d-a265-4326-ad27-012767bf00d6 service glance] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:19.780321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf42c6-09e2-4295-8a03-5e643d72ffd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:19.781891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf42c6-09e2-4295-8a03-5e643d72ffd3 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:19.782352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf42c6-09e2-4295-8a03-5e643d72ffd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:19.783498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4ee74-ea3f-4217-90c8-a32afa0aba64 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:19.787891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf42c6-09e2-4295-8a03-5e643d72ffd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:19.791128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-89bf42c6-09e2-4295-8a03-5e643d72ffd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:19.793660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88745414-3c76-417d-b95c-9d45b85e54fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:19.795295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88745414-3c76-417d-b95c-9d45b85e54fb service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:19.795675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88745414-3c76-417d-b95c-9d45b85e54fb service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:19.796540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88745414-3c76-417d-b95c-9d45b85e54fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:19.834585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf42c6-09e2-4295-8a03-5e643d72ffd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:19.843147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf42c6-09e2-4295-8a03-5e643d72ffd3 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:19.846735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88745414-3c76-417d-b95c-9d45b85e54fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:19.848612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88745414-3c76-417d-b95c-9d45b85e54fb service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:19.875681 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2329/4627] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:10:19.888925 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2299/4628] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:10:22.239991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf42c6-09e2-4295-8a03-5e643d72ffd3 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:22.242316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-89bf42c6-09e2-4295-8a03-5e643d72ffd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:22.309287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf42c6-09e2-4295-8a03-5e643d72ffd3 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:22.337331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:22.340564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:22.340858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:22.341141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] PATH_INFO: `/v3/projects/345269f5b6114a98ba635d3928a0d702` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:22.370952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=345269f5b6114a98ba635d3928a0d702)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:22.373421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:22.458584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '345269f5b6114a98ba635d3928a0d702', 'request_id': 'req-396ef029-b3af-4dde-81e1-261d93eb0e6a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:22.468457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '345269f5b6114a98ba635d3928a0d702', 'request_id': 'req-396ef029-b3af-4dde-81e1-261d93eb0e6a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:22.471861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:22.492862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '345269f5b6114a98ba635d3928a0d702', 'request_id': 'req-396ef029-b3af-4dde-81e1-261d93eb0e6a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:22.511934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] The token cache is being invalidate because project 345269f5b6114a98ba635d3928a0d702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:22.512478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:22.513615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:22.520368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88745414-3c76-417d-b95c-9d45b85e54fb service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:22.520881 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2330/4629] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:22 2022] DELETE /identity/v3/projects/345269f5b6114a98ba635d3928a0d702 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:22.531546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88745414-3c76-417d-b95c-9d45b85e54fb service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:22.662440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531e9bc-b9d2-49c3-a46f-bb45d033f272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:22.664311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531e9bc-b9d2-49c3-a46f-bb45d033f272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:22.667064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531e9bc-b9d2-49c3-a46f-bb45d033f272 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:22.667366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531e9bc-b9d2-49c3-a46f-bb45d033f272 admin admin] PATH_INFO: `/v3/users/6638c08faec04884a62b9f0eada7dbe0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:22.669710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531e9bc-b9d2-49c3-a46f-bb45d033f272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6638c08faec04884a62b9f0eada7dbe0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:22.677808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531e9bc-b9d2-49c3-a46f-bb45d033f272 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:22.800137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d531e9bc-b9d2-49c3-a46f-bb45d033f272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6638c08faec04884a62b9f0eada7dbe0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:22.812220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d531e9bc-b9d2-49c3-a46f-bb45d033f272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6638c08faec04884a62b9f0eada7dbe0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:22.812980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d531e9bc-b9d2-49c3-a46f-bb45d033f272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6638c08faec04884a62b9f0eada7dbe0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:22.813870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d531e9bc-b9d2-49c3-a46f-bb45d033f272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6638c08faec04884a62b9f0eada7dbe0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:22.834893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d531e9bc-b9d2-49c3-a46f-bb45d033f272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6638c08faec04884a62b9f0eada7dbe0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:22.856429 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2300/4630] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:22 2022] DELETE /identity/v3/users/6638c08faec04884a62b9f0eada7dbe0 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:10:23.237177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:23.240492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:23.265723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ef029-b3af-4dde-81e1-261d93eb0e6a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:23.467398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57526b-4517-4f3c-8019-08c28754fdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:23.468258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57526b-4517-4f3c-8019-08c28754fdaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:23.468593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57526b-4517-4f3c-8019-08c28754fdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:23.468898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57526b-4517-4f3c-8019-08c28754fdaf admin admin] PATH_INFO: `/v3/projects/a191401e0ec947459e85cef49b4c0929` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:23.471035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57526b-4517-4f3c-8019-08c28754fdaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a191401e0ec947459e85cef49b4c0929)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:23.496874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57526b-4517-4f3c-8019-08c28754fdaf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:23.604561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6a57526b-4517-4f3c-8019-08c28754fdaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a191401e0ec947459e85cef49b4c0929', 'request_id': 'req-6a57526b-4517-4f3c-8019-08c28754fdaf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:23.625664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6a57526b-4517-4f3c-8019-08c28754fdaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a191401e0ec947459e85cef49b4c0929', 'request_id': 'req-6a57526b-4517-4f3c-8019-08c28754fdaf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:23.633458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6a57526b-4517-4f3c-8019-08c28754fdaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a191401e0ec947459e85cef49b4c0929', 'request_id': 'req-6a57526b-4517-4f3c-8019-08c28754fdaf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:23.656284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6a57526b-4517-4f3c-8019-08c28754fdaf admin admin] The token cache is being invalidate because project a191401e0ec947459e85cef49b4c0929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:23.656580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6a57526b-4517-4f3c-8019-08c28754fdaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:23.658545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6a57526b-4517-4f3c-8019-08c28754fdaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:23.673352 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2331/4631] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:23 2022] DELETE /identity/v3/projects/a191401e0ec947459e85cef49b4c0929 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:23.678026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421514f-725e-4ef8-92f1-2f4b5aca930f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:23.678870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421514f-725e-4ef8-92f1-2f4b5aca930f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:23.679546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421514f-725e-4ef8-92f1-2f4b5aca930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:23.730787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0421514f-725e-4ef8-92f1-2f4b5aca930f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:23.738426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0421514f-725e-4ef8-92f1-2f4b5aca930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:23.920559 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2301/4632] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:23.928469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5e7b0-c0ea-4a7e-96c0-3fa944158ec2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:23.929061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5e7b0-c0ea-4a7e-96c0-3fa944158ec2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:23.931559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5e7b0-c0ea-4a7e-96c0-3fa944158ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:23.988495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-02f5e7b0-c0ea-4a7e-96c0-3fa944158ec2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:23.990473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-02f5e7b0-c0ea-4a7e-96c0-3fa944158ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:24.006130 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2332/4633] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:24.011399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421514f-725e-4ef8-92f1-2f4b5aca930f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:24.045178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421514f-725e-4ef8-92f1-2f4b5aca930f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:24.059807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e88bf-f6bb-4004-af3c-40aeee732843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:24.061697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e88bf-f6bb-4004-af3c-40aeee732843 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:24.062238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e88bf-f6bb-4004-af3c-40aeee732843 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:24.062809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e88bf-f6bb-4004-af3c-40aeee732843 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:24.064395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e88bf-f6bb-4004-af3c-40aeee732843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:24.064927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e88bf-f6bb-4004-af3c-40aeee732843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:24.069711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e88bf-f6bb-4004-af3c-40aeee732843 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:24.082726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:24.149882 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2302/4634] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:24.154927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5e7b0-c0ea-4a7e-96c0-3fa944158ec2 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:24.171100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5e7b0-c0ea-4a7e-96c0-3fa944158ec2 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:24.180671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7868-d5bc-4b81-82a0-93ab86556fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:24.181442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7868-d5bc-4b81-82a0-93ab86556fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:24.181701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7868-d5bc-4b81-82a0-93ab86556fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:24.181961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7868-d5bc-4b81-82a0-93ab86556fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:24.182602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d7868-d5bc-4b81-82a0-93ab86556fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:24.184890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d7868-d5bc-4b81-82a0-93ab86556fa0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:24.236000 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2333/4635] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:24 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:24.236954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e88bf-f6bb-4004-af3c-40aeee732843 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:24.255231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e88bf-f6bb-4004-af3c-40aeee732843 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:24.378545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d99f09-6427-4b28-85ad-9c8ab347ef9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:24.379601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d99f09-6427-4b28-85ad-9c8ab347ef9a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:24.380626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d99f09-6427-4b28-85ad-9c8ab347ef9a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:24.381572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d99f09-6427-4b28-85ad-9c8ab347ef9a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:24.383154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d99f09-6427-4b28-85ad-9c8ab347ef9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:24.386259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d99f09-6427-4b28-85ad-9c8ab347ef9a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:24.436283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7868-d5bc-4b81-82a0-93ab86556fa0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:24.483637 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2303/4636] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:24 2022] POST /identity/v3/users => generated 284 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:10:24.495362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7868-d5bc-4b81-82a0-93ab86556fa0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:24.514701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0676f-175c-4377-8273-0a90c7a84c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:24.515611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0676f-175c-4377-8273-0a90c7a84c4c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:24.517799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0676f-175c-4377-8273-0a90c7a84c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:24.518183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0676f-175c-4377-8273-0a90c7a84c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:24.518960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0676f-175c-4377-8273-0a90c7a84c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:24.522082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0676f-175c-4377-8273-0a90c7a84c4c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:24.559961 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2334/4637] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:24.561042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d99f09-6427-4b28-85ad-9c8ab347ef9a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:24.577964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d99f09-6427-4b28-85ad-9c8ab347ef9a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:24.593545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e446c0-9dc4-4329-943f-f0f408fd965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:24.597127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e446c0-9dc4-4329-943f-f0f408fd965b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:24.597467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e446c0-9dc4-4329-943f-f0f408fd965b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:24.598128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e446c0-9dc4-4329-943f-f0f408fd965b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:24.598842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e446c0-9dc4-4329-943f-f0f408fd965b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:24.603643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e446c0-9dc4-4329-943f-f0f408fd965b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:24.621919 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2304/4638] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:24.623274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0676f-175c-4377-8273-0a90c7a84c4c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:24.635511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0676f-175c-4377-8273-0a90c7a84c4c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:24.642971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d65c17-a585-4cb6-93bc-b677e5c07611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:24.644094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d65c17-a585-4cb6-93bc-b677e5c07611 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:24.644445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d65c17-a585-4cb6-93bc-b677e5c07611 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:24.644795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d65c17-a585-4cb6-93bc-b677e5c07611 admin admin] PATH_INFO: `/v3/projects/0a2ed030ca334d6ca52f03e5d99a3bb3/users/08bbd77d6cf04beba6f5c26562f9782e/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:24.669378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d65c17-a585-4cb6-93bc-b677e5c07611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2ed030ca334d6ca52f03e5d99a3bb3, user_id=08bbd77d6cf04beba6f5c26562f9782e, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:24.672247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d65c17-a585-4cb6-93bc-b677e5c07611 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:24.760895 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2335/4639] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:24 2022] PUT /identity/v3/projects/0a2ed030ca334d6ca52f03e5d99a3bb3/users/08bbd77d6cf04beba6f5c26562f9782e/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:24.772765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aa1a2-8bc7-4466-91bc-2894ecbe7040 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:24.774537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aa1a2-8bc7-4466-91bc-2894ecbe7040 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:24.775027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aa1a2-8bc7-4466-91bc-2894ecbe7040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:24.838593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b90aa1a2-8bc7-4466-91bc-2894ecbe7040 None None] MFA Rules not processed for user `08bbd77d6cf04beba6f5c26562f9782e`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:24.840485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b90aa1a2-8bc7-4466-91bc-2894ecbe7040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:25.000283 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2305/4640] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:25.000912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d65c17-a585-4cb6-93bc-b677e5c07611 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:25.040850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:25.181678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d65c17-a585-4cb6-93bc-b677e5c07611 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:25.191358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdb22e-d7a6-4d55-a58d-549ecdc77bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:25.192371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdb22e-d7a6-4d55-a58d-549ecdc77bac admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:25.192765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdb22e-d7a6-4d55-a58d-549ecdc77bac admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:25.193149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdb22e-d7a6-4d55-a58d-549ecdc77bac admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:25.195335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdb22e-d7a6-4d55-a58d-549ecdc77bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:25.199642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdb22e-d7a6-4d55-a58d-549ecdc77bac admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:25.249508 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2336/4641] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:24 2022] POST /identity/v3/projects => generated 367 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:25.253762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aa1a2-8bc7-4466-91bc-2894ecbe7040 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:25.277171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aa1a2-8bc7-4466-91bc-2894ecbe7040 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:25.409340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a27fd9-91d0-4e8f-add0-5bde138177b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:25.409888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a27fd9-91d0-4e8f-add0-5bde138177b3 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:25.410179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a27fd9-91d0-4e8f-add0-5bde138177b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:25.410442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a27fd9-91d0-4e8f-add0-5bde138177b3 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:25.411081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a27fd9-91d0-4e8f-add0-5bde138177b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:25.413888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a27fd9-91d0-4e8f-add0-5bde138177b3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:25.460604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:25.513836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdb22e-d7a6-4d55-a58d-549ecdc77bac admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:25.514364 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2306/4642] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:25 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:25.532202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdb22e-d7a6-4d55-a58d-549ecdc77bac admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:25.554829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4740363-c0db-4f7f-a3ce-52af7afd431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:25.561501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4740363-c0db-4f7f-a3ce-52af7afd431e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:25.562371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4740363-c0db-4f7f-a3ce-52af7afd431e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:25.562668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4740363-c0db-4f7f-a3ce-52af7afd431e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:25.563354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4740363-c0db-4f7f-a3ce-52af7afd431e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:25.569455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4740363-c0db-4f7f-a3ce-52af7afd431e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:25.585929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bc53b-e26a-4db1-a303-136f3308794b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:25.586452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bc53b-e26a-4db1-a303-136f3308794b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:25.586882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bc53b-e26a-4db1-a303-136f3308794b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:25.599879 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2337/4643] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:25.606530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4740363-c0db-4f7f-a3ce-52af7afd431e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:25.628915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4740363-c0db-4f7f-a3ce-52af7afd431e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:25.644452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf40f8-06df-4fd6-9cf9-97eb3f115cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:25.645140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf40f8-06df-4fd6-9cf9-97eb3f115cea admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:25.645447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf40f8-06df-4fd6-9cf9-97eb3f115cea admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:25.645725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf40f8-06df-4fd6-9cf9-97eb3f115cea admin admin] PATH_INFO: `/v3/projects/4d2386f2901248688b538ff0c0afa360/users/5c28517ae32d4c709e3c17bf54a7c078/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:25.646278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-053bc53b-e26a-4db1-a303-136f3308794b None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:25.652937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-053bc53b-e26a-4db1-a303-136f3308794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:25.696790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf40f8-06df-4fd6-9cf9-97eb3f115cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d2386f2901248688b538ff0c0afa360, user_id=5c28517ae32d4c709e3c17bf54a7c078, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:25.704529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf40f8-06df-4fd6-9cf9-97eb3f115cea admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:25.740761 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2338/4644] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:25 2022] PUT /identity/v3/projects/4d2386f2901248688b538ff0c0afa360/users/5c28517ae32d4c709e3c17bf54a7c078/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:25.743842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf40f8-06df-4fd6-9cf9-97eb3f115cea admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:25.852820 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2307/4645] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:10:25.859219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bc53b-e26a-4db1-a303-136f3308794b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:25.868460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-053bc53b-e26a-4db1-a303-136f3308794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:25.952778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf40f8-06df-4fd6-9cf9-97eb3f115cea admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:25.962051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c9aa1-18bc-46e9-9f63-102755cb650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:25.962918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c9aa1-18bc-46e9-9f63-102755cb650d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:25.963380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c9aa1-18bc-46e9-9f63-102755cb650d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:25.963805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c9aa1-18bc-46e9-9f63-102755cb650d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:25.964619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c9aa1-18bc-46e9-9f63-102755cb650d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:25.967221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c9aa1-18bc-46e9-9f63-102755cb650d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:26.004499 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2339/4646] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:26.007432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c9aa1-18bc-46e9-9f63-102755cb650d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:26.036685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c9aa1-18bc-46e9-9f63-102755cb650d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:26.055283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb053e-5640-4bba-b5be-160235e91b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:26.055970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb053e-5640-4bba-b5be-160235e91b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:26.056252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb053e-5640-4bba-b5be-160235e91b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:26.056530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb053e-5640-4bba-b5be-160235e91b46 admin admin] PATH_INFO: `/v3/projects/4d2386f2901248688b538ff0c0afa360/users/5c28517ae32d4c709e3c17bf54a7c078/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:26.058565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb053e-5640-4bba-b5be-160235e91b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d2386f2901248688b538ff0c0afa360, user_id=5c28517ae32d4c709e3c17bf54a7c078, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:26.061223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb053e-5640-4bba-b5be-160235e91b46 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:26.069341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bc53b-e26a-4db1-a303-136f3308794b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:26.093928 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2340/4647] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:26 2022] PUT /identity/v3/projects/4d2386f2901248688b538ff0c0afa360/users/5c28517ae32d4c709e3c17bf54a7c078/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:26.095690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09e0c3-33fd-4f04-9dd3-a2f1c3566764 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:26.095983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09e0c3-33fd-4f04-9dd3-a2f1c3566764 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:26.096296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09e0c3-33fd-4f04-9dd3-a2f1c3566764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:26.154144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-de09e0c3-33fd-4f04-9dd3-a2f1c3566764 None None] MFA Rules not processed for user `5c28517ae32d4c709e3c17bf54a7c078`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:26.155676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-de09e0c3-33fd-4f04-9dd3-a2f1c3566764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:26.222378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168b5f0-9f2f-49e8-9c28-d3c2d956df80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:26.222919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b5f0-9f2f-49e8-9c28-d3c2d956df80 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:26.223263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b5f0-9f2f-49e8-9c28-d3c2d956df80 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:26.223548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b5f0-9f2f-49e8-9c28-d3c2d956df80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:26.250476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:26.270484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:26.314695 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2341/4648] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:10:26.319650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09e0c3-33fd-4f04-9dd3-a2f1c3566764 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:26.332963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168b5f0-9f2f-49e8-9c28-d3c2d956df80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:26.334889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168b5f0-9f2f-49e8-9c28-d3c2d956df80 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:26.340331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09e0c3-33fd-4f04-9dd3-a2f1c3566764 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:26.353835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c67ae1-791f-48d9-a625-699c68cb3685 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c28517ae32d4c709e3c17bf54a7c078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2386f2901248688b538ff0c0afa360', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:26.354466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c67ae1-791f-48d9-a625-699c68cb3685 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:26.354820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c67ae1-791f-48d9-a625-699c68cb3685 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:26.355213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c67ae1-791f-48d9-a625-699c68cb3685 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] PATH_INFO: `/v3/policies` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:26.356246 ncdv-master-1 devstack@keystone.service[99085]: WARNING oslo_log.versionutils [None req-06c67ae1-791f-48d9-a625-699c68cb3685 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 08 21:10:26.356666 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2308/4649] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:10:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:26.357268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c67ae1-791f-48d9-a625-699c68cb3685 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:26.358814 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-06c67ae1-791f-48d9-a625-699c68cb3685 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:26.358814 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:10:26.358814 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:10:26.359670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c67ae1-791f-48d9-a625-699c68cb3685 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:26.389910 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2342/4650] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:10:26 2022] POST /identity/v3/policies => generated 230 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:26.394022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168b5f0-9f2f-49e8-9c28-d3c2d956df80 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:26.535161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168b5f0-9f2f-49e8-9c28-d3c2d956df80 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:26.542026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bf94e-ebca-4f2c-b967-8e5d18132717 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c28517ae32d4c709e3c17bf54a7c078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2386f2901248688b538ff0c0afa360', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:26.542515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bf94e-ebca-4f2c-b967-8e5d18132717 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:26.542800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bf94e-ebca-4f2c-b967-8e5d18132717 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:26.543501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bf94e-ebca-4f2c-b967-8e5d18132717 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] PATH_INFO: `/v3/policies/3ab43c83375a483192c8bff69f5bf123` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:26.544043 ncdv-master-1 devstack@keystone.service[99084]: WARNING oslo_log.versionutils [None req-486bf94e-ebca-4f2c-b967-8e5d18132717 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 08 21:10:26.544562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bf94e-ebca-4f2c-b967-8e5d18132717 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=3ab43c83375a483192c8bff69f5bf123)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:26.545826 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-486bf94e-ebca-4f2c-b967-8e5d18132717 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:26.545826 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:10:26.545826 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:26.546957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bf94e-ebca-4f2c-b967-8e5d18132717 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:26.584764 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2309/4651] 10.222.0.26 () {60 vars in 1252 bytes} [Sat Oct 8 21:10:26 2022] PATCH /identity/v3/policies/3ab43c83375a483192c8bff69f5bf123 => generated 236 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:26.586260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c67ae1-791f-48d9-a625-699c68cb3685 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:26.599248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c67ae1-791f-48d9-a625-699c68cb3685 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:26.637435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bebaa-f51b-4a7e-b3ae-fb8937635ba1 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c28517ae32d4c709e3c17bf54a7c078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2386f2901248688b538ff0c0afa360', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:26.638164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bebaa-f51b-4a7e-b3ae-fb8937635ba1 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:26.638450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bebaa-f51b-4a7e-b3ae-fb8937635ba1 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:26.638750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bebaa-f51b-4a7e-b3ae-fb8937635ba1 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] PATH_INFO: `/v3/policies/3ab43c83375a483192c8bff69f5bf123` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:26.639618 ncdv-master-1 devstack@keystone.service[99085]: WARNING oslo_log.versionutils [None req-dd7bebaa-f51b-4a7e-b3ae-fb8937635ba1 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 08 21:10:26.640208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bebaa-f51b-4a7e-b3ae-fb8937635ba1 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=3ab43c83375a483192c8bff69f5bf123)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:26.641537 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-dd7bebaa-f51b-4a7e-b3ae-fb8937635ba1 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:26.641537 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:10:26.641537 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:10:26.642435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bebaa-f51b-4a7e-b3ae-fb8937635ba1 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:26.694696 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2343/4652] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:10:26 2022] GET /identity/v3/policies/3ab43c83375a483192c8bff69f5bf123 => generated 236 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:26.709071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bf94e-ebca-4f2c-b967-8e5d18132717 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:26.734981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bf94e-ebca-4f2c-b967-8e5d18132717 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:26.756108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0091c-d12b-4414-a400-841f00c2d31e tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c28517ae32d4c709e3c17bf54a7c078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2386f2901248688b538ff0c0afa360', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:26.756712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0091c-d12b-4414-a400-841f00c2d31e tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:26.756995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0091c-d12b-4414-a400-841f00c2d31e tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:26.757834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0091c-d12b-4414-a400-841f00c2d31e tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] PATH_INFO: `/v3/policies/3ab43c83375a483192c8bff69f5bf123` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:26.758603 ncdv-master-1 devstack@keystone.service[99084]: WARNING oslo_log.versionutils [None req-d1b0091c-d12b-4414-a400-841f00c2d31e tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 08 21:10:26.759163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0091c-d12b-4414-a400-841f00c2d31e tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=3ab43c83375a483192c8bff69f5bf123)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:26.760383 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-d1b0091c-d12b-4414-a400-841f00c2d31e tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:26.760383 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:10:26.760383 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:26.761303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0091c-d12b-4414-a400-841f00c2d31e tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:26.802816 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2310/4653] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:26 2022] DELETE /identity/v3/policies/3ab43c83375a483192c8bff69f5bf123 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:26.805820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bebaa-f51b-4a7e-b3ae-fb8937635ba1 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:26.816847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bebaa-f51b-4a7e-b3ae-fb8937635ba1 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:26.831742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4cbf3-e02c-4b18-96af-0551ef6b9976 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c28517ae32d4c709e3c17bf54a7c078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2386f2901248688b538ff0c0afa360', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:26.833252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4cbf3-e02c-4b18-96af-0551ef6b9976 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:26.833552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4cbf3-e02c-4b18-96af-0551ef6b9976 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:26.833836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4cbf3-e02c-4b18-96af-0551ef6b9976 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] PATH_INFO: `/v3/policies` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:26.835700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4cbf3-e02c-4b18-96af-0551ef6b9976 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:26.838789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4cbf3-e02c-4b18-96af-0551ef6b9976 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:26.880953 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2344/4654] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:10:26 2022] POST /identity/v3/policies => generated 229 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:26.881398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0091c-d12b-4414-a400-841f00c2d31e tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:26.896378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0091c-d12b-4414-a400-841f00c2d31e tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:26.913123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df17e-2ecd-45ce-8d72-60d184d9eafc tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c28517ae32d4c709e3c17bf54a7c078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2386f2901248688b538ff0c0afa360', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:26.913853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df17e-2ecd-45ce-8d72-60d184d9eafc tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:26.914143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df17e-2ecd-45ce-8d72-60d184d9eafc tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:26.914476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df17e-2ecd-45ce-8d72-60d184d9eafc tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] PATH_INFO: `/v3/policies` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:26.915373 ncdv-master-1 devstack@keystone.service[99084]: WARNING oslo_log.versionutils [None req-454df17e-2ecd-45ce-8d72-60d184d9eafc tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 08 21:10:26.915906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454df17e-2ecd-45ce-8d72-60d184d9eafc tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:26.918053 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-454df17e-2ecd-45ce-8d72-60d184d9eafc tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:26.918053 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:10:26.918053 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:26.919075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454df17e-2ecd-45ce-8d72-60d184d9eafc tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:26.958413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4cbf3-e02c-4b18-96af-0551ef6b9976 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:26.967213 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2311/4655] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:10:26 2022] POST /identity/v3/policies => generated 229 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:26.972890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4cbf3-e02c-4b18-96af-0551ef6b9976 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:26.979204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2411970-fa51-4df4-a105-946d663bf816 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c28517ae32d4c709e3c17bf54a7c078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2386f2901248688b538ff0c0afa360', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:26.979941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2411970-fa51-4df4-a105-946d663bf816 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:26.980263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2411970-fa51-4df4-a105-946d663bf816 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:26.980660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2411970-fa51-4df4-a105-946d663bf816 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] PATH_INFO: `/v3/policies` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:26.981951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2411970-fa51-4df4-a105-946d663bf816 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:26.984292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2411970-fa51-4df4-a105-946d663bf816 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:27.014141 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2345/4656] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:10:26 2022] POST /identity/v3/policies => generated 230 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:10:27.018491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df17e-2ecd-45ce-8d72-60d184d9eafc tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:27.038079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df17e-2ecd-45ce-8d72-60d184d9eafc tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:27.051709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee8c4c-d1c0-451f-8254-3ed2f8975033 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c28517ae32d4c709e3c17bf54a7c078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2386f2901248688b538ff0c0afa360', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:27.052509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee8c4c-d1c0-451f-8254-3ed2f8975033 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:27.052898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee8c4c-d1c0-451f-8254-3ed2f8975033 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:27.053304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee8c4c-d1c0-451f-8254-3ed2f8975033 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] PATH_INFO: `/v3/policies` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:27.056509 ncdv-master-1 devstack@keystone.service[99084]: WARNING oslo_log.versionutils [None req-bdee8c4c-d1c0-451f-8254-3ed2f8975033 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 08 21:10:27.059347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee8c4c-d1c0-451f-8254-3ed2f8975033 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:27.063340 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-bdee8c4c-d1c0-451f-8254-3ed2f8975033 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:27.063340 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:10:27.063340 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:27.066493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee8c4c-d1c0-451f-8254-3ed2f8975033 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:27.084599 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2312/4657] 10.222.0.26 () {58 vars in 1131 bytes} [Sat Oct 8 21:10:27 2022] GET /identity/v3/policies => generated 764 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:27.090371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2411970-fa51-4df4-a105-946d663bf816 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:27.111847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2411970-fa51-4df4-a105-946d663bf816 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:27.125413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928e9a2-9d63-4385-907d-d151cb9acec4 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c28517ae32d4c709e3c17bf54a7c078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2386f2901248688b538ff0c0afa360', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:27.126197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e9a2-9d63-4385-907d-d151cb9acec4 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:27.126481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e9a2-9d63-4385-907d-d151cb9acec4 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:27.126841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e9a2-9d63-4385-907d-d151cb9acec4 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] PATH_INFO: `/v3/policies/86315808075243a39f8abf99dca4ae35` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:27.127901 ncdv-master-1 devstack@keystone.service[99085]: WARNING oslo_log.versionutils [None req-3928e9a2-9d63-4385-907d-d151cb9acec4 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 08 21:10:27.128474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928e9a2-9d63-4385-907d-d151cb9acec4 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=86315808075243a39f8abf99dca4ae35)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:27.129711 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-3928e9a2-9d63-4385-907d-d151cb9acec4 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:27.129711 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:10:27.129711 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:10:27.130609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928e9a2-9d63-4385-907d-d151cb9acec4 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:27.173493 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2346/4658] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:27 2022] DELETE /identity/v3/policies/86315808075243a39f8abf99dca4ae35 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:27.175405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee8c4c-d1c0-451f-8254-3ed2f8975033 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:27.191171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee8c4c-d1c0-451f-8254-3ed2f8975033 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:27.214958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a2053-0645-457f-8b8a-feeaf4afb633 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c28517ae32d4c709e3c17bf54a7c078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2386f2901248688b538ff0c0afa360', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:27.214958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a2053-0645-457f-8b8a-feeaf4afb633 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:27.214958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a2053-0645-457f-8b8a-feeaf4afb633 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:27.215354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a2053-0645-457f-8b8a-feeaf4afb633 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] PATH_INFO: `/v3/policies/09a757aa82914906a18c1d05f3250ef9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:27.230556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a2053-0645-457f-8b8a-feeaf4afb633 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=09a757aa82914906a18c1d05f3250ef9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:27.238805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a2053-0645-457f-8b8a-feeaf4afb633 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:27.276168 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2313/4659] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:27 2022] DELETE /identity/v3/policies/09a757aa82914906a18c1d05f3250ef9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:27.280810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928e9a2-9d63-4385-907d-d151cb9acec4 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:27.293651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928e9a2-9d63-4385-907d-d151cb9acec4 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:27.324695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef3ded-f988-4302-8032-827f1be7acb0 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c28517ae32d4c709e3c17bf54a7c078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2386f2901248688b538ff0c0afa360', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:27.325952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef3ded-f988-4302-8032-827f1be7acb0 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:27.339211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef3ded-f988-4302-8032-827f1be7acb0 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:27.339912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef3ded-f988-4302-8032-827f1be7acb0 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] PATH_INFO: `/v3/policies/27fbdd6bfe1545c188c48523b930ab47` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:27.341286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef3ded-f988-4302-8032-827f1be7acb0 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=27fbdd6bfe1545c188c48523b930ab47)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:27.347811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef3ded-f988-4302-8032-827f1be7acb0 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:27.379576 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2347/4660] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:27 2022] DELETE /identity/v3/policies/27fbdd6bfe1545c188c48523b930ab47 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:27.385542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a2053-0645-457f-8b8a-feeaf4afb633 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:27.571983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a2053-0645-457f-8b8a-feeaf4afb633 tempest-PoliciesTestJSON-673558358 tempest-PoliciesTestJSON-673558358-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:27.594399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:27.597767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:27.598056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:27.599932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] PATH_INFO: `/v3/users/08bbd77d6cf04beba6f5c26562f9782e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:27.604391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] RBAC: Authorizing `identity:delete_user(user_id=08bbd77d6cf04beba6f5c26562f9782e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:27.611403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:27.635255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:27.668665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8eeb8-4407-40dd-9640-7dacc3ccc694 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:27.669098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8eeb8-4407-40dd-9640-7dacc3ccc694 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:27.669477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8eeb8-4407-40dd-9640-7dacc3ccc694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:27.702856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-70a8eeb8-4407-40dd-9640-7dacc3ccc694 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:27.704539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-70a8eeb8-4407-40dd-9640-7dacc3ccc694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:27.737575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08bbd77d6cf04beba6f5c26562f9782e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:27.756663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08bbd77d6cf04beba6f5c26562f9782e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:27.760177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08bbd77d6cf04beba6f5c26562f9782e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:27.761740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08bbd77d6cf04beba6f5c26562f9782e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:27.780639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08bbd77d6cf04beba6f5c26562f9782e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:27.797672 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2348/4661] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:10:27.812620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc868a3-d868-4814-b7b9-1aff142b8e8d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:27.812965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc868a3-d868-4814-b7b9-1aff142b8e8d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:27.813319 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2314/4662] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:27 2022] DELETE /identity/v3/users/08bbd77d6cf04beba6f5c26562f9782e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:27.813431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc868a3-d868-4814-b7b9-1aff142b8e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:27.823756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:27.825542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:27.849787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3dc868a3-d868-4814-b7b9-1aff142b8e8d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:27.851442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3dc868a3-d868-4814-b7b9-1aff142b8e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:27.925443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:27.950782 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2349/4663] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:27.958712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc868a3-d868-4814-b7b9-1aff142b8e8d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:27.965476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3dc868a3-d868-4814-b7b9-1aff142b8e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:27.981947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7df13-85d4-40fe-86b8-98a5ffd4dfac admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:27.999897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f6864-4c50-4e7e-aa5a-30ccd15f51f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:28.001536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f6864-4c50-4e7e-aa5a-30ccd15f51f7 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:28.002250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f6864-4c50-4e7e-aa5a-30ccd15f51f7 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:28.003348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f6864-4c50-4e7e-aa5a-30ccd15f51f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:28.174150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc868a3-d868-4814-b7b9-1aff142b8e8d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:28.189916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d80d5-e701-4952-b717-e8806f2cb08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:28.192173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d80d5-e701-4952-b717-e8806f2cb08a service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:28.194272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d80d5-e701-4952-b717-e8806f2cb08a service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:28.194648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d80d5-e701-4952-b717-e8806f2cb08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:28.197815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f6864-4c50-4e7e-aa5a-30ccd15f51f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:28.203716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f6864-4c50-4e7e-aa5a-30ccd15f51f7 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:28.228060 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2315/4664] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:10:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:10:28.232057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d80d5-e701-4952-b717-e8806f2cb08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:28.234639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d80d5-e701-4952-b717-e8806f2cb08a service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:28.258623 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2350/4665] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:10:28.967588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f6864-4c50-4e7e-aa5a-30ccd15f51f7 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:28.969114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dc7f6864-4c50-4e7e-aa5a-30ccd15f51f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:28.998062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f6864-4c50-4e7e-aa5a-30ccd15f51f7 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:29.006016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:29.006768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:29.007119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:29.007983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21 admin admin] PATH_INFO: `/v3/projects/0a2ed030ca334d6ca52f03e5d99a3bb3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:29.009778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2ed030ca334d6ca52f03e5d99a3bb3)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:29.015454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:29.041225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:29.086045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2ed030ca334d6ca52f03e5d99a3bb3', 'request_id': 'req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:29.100576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2ed030ca334d6ca52f03e5d99a3bb3', 'request_id': 'req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:29.113128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2ed030ca334d6ca52f03e5d99a3bb3', 'request_id': 'req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:29.133851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21 admin admin] The token cache is being invalidate because project 0a2ed030ca334d6ca52f03e5d99a3bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:29.135122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:29.136863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-18acbb40-6a2e-4db0-8ff0-6ec3fef7fa21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:29.141483 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2316/4666] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:28 2022] DELETE /identity/v3/projects/0a2ed030ca334d6ca52f03e5d99a3bb3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:29.145769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d80d5-e701-4952-b717-e8806f2cb08a service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:29.159916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d80d5-e701-4952-b717-e8806f2cb08a service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:29.340378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:29.341037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:29.341584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:29.341917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] PATH_INFO: `/v3/users/5c28517ae32d4c709e3c17bf54a7c078` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:29.345700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c28517ae32d4c709e3c17bf54a7c078)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:29.348032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:29.462665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c28517ae32d4c709e3c17bf54a7c078'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:29.501985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c28517ae32d4c709e3c17bf54a7c078'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:29.505651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c28517ae32d4c709e3c17bf54a7c078'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:29.506653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c28517ae32d4c709e3c17bf54a7c078'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:29.531228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c28517ae32d4c709e3c17bf54a7c078'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:29.572817 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2351/4667] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:29 2022] DELETE /identity/v3/users/5c28517ae32d4c709e3c17bf54a7c078 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:30.266370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ce34-83bc-4e69-8ab9-3e1688f61472 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:30.267012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ce34-83bc-4e69-8ab9-3e1688f61472 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:30.267012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ce34-83bc-4e69-8ab9-3e1688f61472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:30.341178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3471ce34-83bc-4e69-8ab9-3e1688f61472 None None] MFA Rules not processed for user `d78e9afd772c4de981cac8f5817ec356`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:30.342329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3471ce34-83bc-4e69-8ab9-3e1688f61472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:30.448188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:30.451945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:30.501680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:30.581926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34b220-c9e8-4ce9-a0d6-ee27b342e7c7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:30.593572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd5a0a-ff83-4214-b514-d523e9560f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:30.595465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd5a0a-ff83-4214-b514-d523e9560f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:30.596712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd5a0a-ff83-4214-b514-d523e9560f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:30.597475 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2317/4668] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:30.597958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd5a0a-ff83-4214-b514-d523e9560f76 admin admin] PATH_INFO: `/v3/projects/4d2386f2901248688b538ff0c0afa360` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:30.614617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd5a0a-ff83-4214-b514-d523e9560f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d2386f2901248688b538ff0c0afa360)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:30.622051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd5a0a-ff83-4214-b514-d523e9560f76 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:30.740619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c4dd5a0a-ff83-4214-b514-d523e9560f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d2386f2901248688b538ff0c0afa360', 'request_id': 'req-c4dd5a0a-ff83-4214-b514-d523e9560f76'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:30.764836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c4dd5a0a-ff83-4214-b514-d523e9560f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d2386f2901248688b538ff0c0afa360', 'request_id': 'req-c4dd5a0a-ff83-4214-b514-d523e9560f76'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:30.779350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c4dd5a0a-ff83-4214-b514-d523e9560f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d2386f2901248688b538ff0c0afa360', 'request_id': 'req-c4dd5a0a-ff83-4214-b514-d523e9560f76'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:30.850146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c4dd5a0a-ff83-4214-b514-d523e9560f76 admin admin] The token cache is being invalidate because project 4d2386f2901248688b538ff0c0afa360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:30.850651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c4dd5a0a-ff83-4214-b514-d523e9560f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:30.856740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c4dd5a0a-ff83-4214-b514-d523e9560f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:30.863988 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2352/4669] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:30 2022] DELETE /identity/v3/projects/4d2386f2901248688b538ff0c0afa360 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:30.865906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80d848-51b5-4259-a2d4-268931fa5e1c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:30.867096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80d848-51b5-4259-a2d4-268931fa5e1c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:30.867554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80d848-51b5-4259-a2d4-268931fa5e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:30.906157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1b80d848-51b5-4259-a2d4-268931fa5e1c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:30.909548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1b80d848-51b5-4259-a2d4-268931fa5e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:31.023826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acc5be-a18a-47fc-8724-26e22196cb92 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:31.024491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acc5be-a18a-47fc-8724-26e22196cb92 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:31.024914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acc5be-a18a-47fc-8724-26e22196cb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:31.066434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f3acc5be-a18a-47fc-8724-26e22196cb92 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:31.068771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f3acc5be-a18a-47fc-8724-26e22196cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:31.092373 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2318/4670] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:31.094246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c36463-7460-4522-b940-7063132aa615 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:31.094852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c36463-7460-4522-b940-7063132aa615 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:31.097353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c36463-7460-4522-b940-7063132aa615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:31.151669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d1c36463-7460-4522-b940-7063132aa615 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:31.155763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d1c36463-7460-4522-b940-7063132aa615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:31.174229 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2319/4671] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:31.175391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c36463-7460-4522-b940-7063132aa615 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:31.191114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c36463-7460-4522-b940-7063132aa615 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:31.215760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e6324-bfcb-4922-9703-0c110b8da6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:31.218967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e6324-bfcb-4922-9703-0c110b8da6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:31.219740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e6324-bfcb-4922-9703-0c110b8da6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:31.220693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e6324-bfcb-4922-9703-0c110b8da6a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:31.225587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e6324-bfcb-4922-9703-0c110b8da6a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:31.228322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e6324-bfcb-4922-9703-0c110b8da6a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:31.233969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e6324-bfcb-4922-9703-0c110b8da6a6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:31.236723 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2353/4672] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 08 21:10:31.262453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acc5be-a18a-47fc-8724-26e22196cb92 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:31.265235 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2320/4673] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:31.265398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f3acc5be-a18a-47fc-8724-26e22196cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:31.269485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e6324-bfcb-4922-9703-0c110b8da6a6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:31.285412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e6324-bfcb-4922-9703-0c110b8da6a6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:31.306996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb5347-d865-415f-90f0-13b53d268e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:31.307870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb5347-d865-415f-90f0-13b53d268e7c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:31.308576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb5347-d865-415f-90f0-13b53d268e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:31.308998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb5347-d865-415f-90f0-13b53d268e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:31.310155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb5347-d865-415f-90f0-13b53d268e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:31.313988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb5347-d865-415f-90f0-13b53d268e7c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:31.364528 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2321/4674] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:31 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:10:31.370318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb5347-d865-415f-90f0-13b53d268e7c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:31.380049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:31.436917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:31.477174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb5347-d865-415f-90f0-13b53d268e7c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:31.483844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acc5be-a18a-47fc-8724-26e22196cb92 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:31.485125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2209b1c-784b-425b-8c77-6f611da1a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:31.486021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2209b1c-784b-425b-8c77-6f611da1a94a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:31.486453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2209b1c-784b-425b-8c77-6f611da1a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:31.486915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2209b1c-784b-425b-8c77-6f611da1a94a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:31.487833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2209b1c-784b-425b-8c77-6f611da1a94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:31.490153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2209b1c-784b-425b-8c77-6f611da1a94a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:31.528548 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2322/4675] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:31 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:31.532395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2209b1c-784b-425b-8c77-6f611da1a94a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:31.560060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2209b1c-784b-425b-8c77-6f611da1a94a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:31.575221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2bae4-4fff-458c-82db-bd25128ee312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:31.576427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2bae4-4fff-458c-82db-bd25128ee312 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:31.577348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2bae4-4fff-458c-82db-bd25128ee312 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:31.577348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2bae4-4fff-458c-82db-bd25128ee312 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:31.577646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2bae4-4fff-458c-82db-bd25128ee312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:31.580619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2bae4-4fff-458c-82db-bd25128ee312 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:31.615286 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2323/4676] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:10:31.618103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2bae4-4fff-458c-82db-bd25128ee312 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:31.622248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3aa5aa-dd05-4397-98a8-bf1e6e26d936 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:31.623580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aa5aa-dd05-4397-98a8-bf1e6e26d936 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:31.624964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aa5aa-dd05-4397-98a8-bf1e6e26d936 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:31.625461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aa5aa-dd05-4397-98a8-bf1e6e26d936 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:31.645345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2bae4-4fff-458c-82db-bd25128ee312 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:31.656971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383eb3d5-fa32-4f47-b0f0-cb8538e7de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:31.658033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383eb3d5-fa32-4f47-b0f0-cb8538e7de57 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:31.658321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383eb3d5-fa32-4f47-b0f0-cb8538e7de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:31.658774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383eb3d5-fa32-4f47-b0f0-cb8538e7de57 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:31.659783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383eb3d5-fa32-4f47-b0f0-cb8538e7de57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:31.661826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383eb3d5-fa32-4f47-b0f0-cb8538e7de57 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:31.674786 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2324/4677] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:31.681079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383eb3d5-fa32-4f47-b0f0-cb8538e7de57 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:31.694242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383eb3d5-fa32-4f47-b0f0-cb8538e7de57 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:31.701867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fd880-880a-46f1-909f-fc6c597206ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:31.702795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fd880-880a-46f1-909f-fc6c597206ac admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:31.703149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fd880-880a-46f1-909f-fc6c597206ac admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:31.703479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fd880-880a-46f1-909f-fc6c597206ac admin admin] PATH_INFO: `/v3/projects/55b09ba09f96457ab646245bdbde02b1/users/0a7b3b90a8cd4f32b411f8d7761ad3a1/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:31.746790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fd880-880a-46f1-909f-fc6c597206ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b09ba09f96457ab646245bdbde02b1, user_id=0a7b3b90a8cd4f32b411f8d7761ad3a1, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:31.750111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3aa5aa-dd05-4397-98a8-bf1e6e26d936 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:31.750685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fd880-880a-46f1-909f-fc6c597206ac admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:31.752518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3aa5aa-dd05-4397-98a8-bf1e6e26d936 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:31.769972 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2354/4679] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:10:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:31.770663 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2325/4679] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:31 2022] PUT /identity/v3/projects/55b09ba09f96457ab646245bdbde02b1/users/0a7b3b90a8cd4f32b411f8d7761ad3a1/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:31.780915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697abe4-a04a-4083-92d7-3cb493808bc4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:31.781330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697abe4-a04a-4083-92d7-3cb493808bc4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:31.782295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697abe4-a04a-4083-92d7-3cb493808bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:31.838785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6697abe4-a04a-4083-92d7-3cb493808bc4 None None] MFA Rules not processed for user `0a7b3b90a8cd4f32b411f8d7761ad3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:31.840004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6697abe4-a04a-4083-92d7-3cb493808bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:32.015563 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2355/4680] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:32.020531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fd880-880a-46f1-909f-fc6c597206ac admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:32.182293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fd880-880a-46f1-909f-fc6c597206ac admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:32.198090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d3a0e-e61a-4f60-a111-71621ecf42aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:32.198669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d3a0e-e61a-4f60-a111-71621ecf42aa admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:32.198951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d3a0e-e61a-4f60-a111-71621ecf42aa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:32.199222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d3a0e-e61a-4f60-a111-71621ecf42aa admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:32.200086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d3a0e-e61a-4f60-a111-71621ecf42aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:32.201834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d3a0e-e61a-4f60-a111-71621ecf42aa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:32.260551 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2326/4681] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:32 2022] POST /identity/v3/projects => generated 369 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:32.264186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697abe4-a04a-4083-92d7-3cb493808bc4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:32.280142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697abe4-a04a-4083-92d7-3cb493808bc4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:32.403091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:32.547265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a91115-ea08-46fa-b375-76efdda89aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:32.547265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a91115-ea08-46fa-b375-76efdda89aed admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:32.547265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a91115-ea08-46fa-b375-76efdda89aed admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:32.547265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a91115-ea08-46fa-b375-76efdda89aed admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:32.549173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a91115-ea08-46fa-b375-76efdda89aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:32.549173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a91115-ea08-46fa-b375-76efdda89aed admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:32.631083 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2356/4682] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:32 2022] POST /identity/v3/users => generated 291 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:32.633081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d3a0e-e61a-4f60-a111-71621ecf42aa admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:32.653948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d3a0e-e61a-4f60-a111-71621ecf42aa admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:32.672970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255774cc-1e8d-4401-950d-24ba2b38ae15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:32.673655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255774cc-1e8d-4401-950d-24ba2b38ae15 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:32.673934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255774cc-1e8d-4401-950d-24ba2b38ae15 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:32.674202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255774cc-1e8d-4401-950d-24ba2b38ae15 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:32.674852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255774cc-1e8d-4401-950d-24ba2b38ae15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:32.676471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255774cc-1e8d-4401-950d-24ba2b38ae15 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:32.698463 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2327/4683] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:32.700694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a91115-ea08-46fa-b375-76efdda89aed admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:32.729893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a91115-ea08-46fa-b375-76efdda89aed admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:32.749047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3a7a2-7255-4aaa-8fa8-e29668a38f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:32.749769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3a7a2-7255-4aaa-8fa8-e29668a38f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:32.750077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3a7a2-7255-4aaa-8fa8-e29668a38f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:32.750412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3a7a2-7255-4aaa-8fa8-e29668a38f98 admin admin] PATH_INFO: `/v3/projects/50418590ef39441dbcba1d52863b2f90/users/24ab041ccc92430da64d6d7878f9d3d9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:32.788229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3a7a2-7255-4aaa-8fa8-e29668a38f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50418590ef39441dbcba1d52863b2f90, user_id=24ab041ccc92430da64d6d7878f9d3d9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:32.792335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3a7a2-7255-4aaa-8fa8-e29668a38f98 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:32.837126 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2357/4684] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:32 2022] PUT /identity/v3/projects/50418590ef39441dbcba1d52863b2f90/users/24ab041ccc92430da64d6d7878f9d3d9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:32.841070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255774cc-1e8d-4401-950d-24ba2b38ae15 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:32.856805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255774cc-1e8d-4401-950d-24ba2b38ae15 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:32.888317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:33.036494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf99d51-e38d-465a-ad0c-5a5dc098fa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:33.040853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99d51-e38d-465a-ad0c-5a5dc098fa34 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:33.043654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99d51-e38d-465a-ad0c-5a5dc098fa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:33.045383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99d51-e38d-465a-ad0c-5a5dc098fa34 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:33.046614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf99d51-e38d-465a-ad0c-5a5dc098fa34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:33.055990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf99d51-e38d-465a-ad0c-5a5dc098fa34 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:33.117780 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2328/4685] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:33.121469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3a7a2-7255-4aaa-8fa8-e29668a38f98 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:33.141409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3a7a2-7255-4aaa-8fa8-e29668a38f98 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:33.160010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad82997-e014-4638-b072-be60bb209b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:33.160723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad82997-e014-4638-b072-be60bb209b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:33.161009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad82997-e014-4638-b072-be60bb209b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:33.161302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad82997-e014-4638-b072-be60bb209b3e admin admin] PATH_INFO: `/v3/projects/50418590ef39441dbcba1d52863b2f90/users/24ab041ccc92430da64d6d7878f9d3d9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:33.170440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad82997-e014-4638-b072-be60bb209b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50418590ef39441dbcba1d52863b2f90, user_id=24ab041ccc92430da64d6d7878f9d3d9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:33.173156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad82997-e014-4638-b072-be60bb209b3e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:33.227339 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2358/4686] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:33 2022] PUT /identity/v3/projects/50418590ef39441dbcba1d52863b2f90/users/24ab041ccc92430da64d6d7878f9d3d9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:33.237733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e4c28-6632-4069-9d77-0d974a50ec6a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:33.238276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e4c28-6632-4069-9d77-0d974a50ec6a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:33.238729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e4c28-6632-4069-9d77-0d974a50ec6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:33.300332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1f7e4c28-6632-4069-9d77-0d974a50ec6a None None] MFA Rules not processed for user `24ab041ccc92430da64d6d7878f9d3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:33.302097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1f7e4c28-6632-4069-9d77-0d974a50ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:33.390558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7284a-419c-427a-b55e-0c42b64f25db None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:33.391006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7284a-419c-427a-b55e-0c42b64f25db None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:33.391257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7284a-419c-427a-b55e-0c42b64f25db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:33.428244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-34e7284a-419c-427a-b55e-0c42b64f25db None None] MFA Rules not processed for user `30fe0e1ffa1040ec85d3c32d8b741c75`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:33.432830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-34e7284a-419c-427a-b55e-0c42b64f25db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:33.496960 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2329/4687] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:33.503913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e4c28-6632-4069-9d77-0d974a50ec6a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:33.525071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e4c28-6632-4069-9d77-0d974a50ec6a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:33.565669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8703e-3fc9-488e-9e4e-af954fb707ed tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ab041ccc92430da64d6d7878f9d3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50418590ef39441dbcba1d52863b2f90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:33.566292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8703e-3fc9-488e-9e4e-af954fb707ed tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:33.566598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8703e-3fc9-488e-9e4e-af954fb707ed tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:33.566858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8703e-3fc9-488e-9e4e-af954fb707ed tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:33.567504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8703e-3fc9-488e-9e4e-af954fb707ed tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:33.570041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8703e-3fc9-488e-9e4e-af954fb707ed tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:33.651594 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2330/4688] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:33 2022] POST /identity/v3/projects => generated 359 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:33.658649 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2359/4689] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:33.658649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7284a-419c-427a-b55e-0c42b64f25db None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:33.693563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7284a-419c-427a-b55e-0c42b64f25db None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:33.949594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a6276-61db-45d5-87db-c8d98a984ed1 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ab041ccc92430da64d6d7878f9d3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50418590ef39441dbcba1d52863b2f90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:33.953080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a6276-61db-45d5-87db-c8d98a984ed1 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:33.953404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a6276-61db-45d5-87db-c8d98a984ed1 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:33.953680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a6276-61db-45d5-87db-c8d98a984ed1 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:33.956678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a6276-61db-45d5-87db-c8d98a984ed1 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:33.966391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a6276-61db-45d5-87db-c8d98a984ed1 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:34.053039 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2360/4690] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:33 2022] POST /identity/v3/users => generated 373 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:10:34.060304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8703e-3fc9-488e-9e4e-af954fb707ed tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:34.079441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8703e-3fc9-488e-9e4e-af954fb707ed tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:34.091128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbc349-bdc3-4579-b592-46f0460563a9 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ab041ccc92430da64d6d7878f9d3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50418590ef39441dbcba1d52863b2f90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:34.092246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc349-bdc3-4579-b592-46f0460563a9 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:34.095632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc349-bdc3-4579-b592-46f0460563a9 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:34.096247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbc349-bdc3-4579-b592-46f0460563a9 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:34.098565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbc349-bdc3-4579-b592-46f0460563a9 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:34.099542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbc349-bdc3-4579-b592-46f0460563a9 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:34.103841 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-3fbbc349-bdc3-4579-b592-46f0460563a9 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:34.103841 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:10:34.103841 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:10:34.107519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbc349-bdc3-4579-b592-46f0460563a9 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:34.213893 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2331/4691] 10.222.0.26 () {58 vars in 1157 bytes} [Sat Oct 8 21:10:34 2022] GET /identity/v3/users?domain_id=default => generated 8007 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:34.219117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a6276-61db-45d5-87db-c8d98a984ed1 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:34.238803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a6276-61db-45d5-87db-c8d98a984ed1 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:34.248796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ab041ccc92430da64d6d7878f9d3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50418590ef39441dbcba1d52863b2f90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:34.249960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:34.250408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:34.250832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] PATH_INFO: `/v3/users/cac5b67d81974ccca6e28e9f4aa44014` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:34.265867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:34.302637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorizing `identity:update_user(user_id=cac5b67d81974ccca6e28e9f4aa44014)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:34.302637 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:10:34.302637 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:10:34.302637 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:10:34.302637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:34.407997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cac5b67d81974ccca6e28e9f4aa44014'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:34.429850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invalidating the token cache because user cac5b67d81974ccca6e28e9f4aa44014 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:34.430298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:34.431061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:34.436351 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2361/4692] 10.222.0.26 () {60 vars in 1244 bytes} [Sat Oct 8 21:10:34 2022] PATCH /identity/v3/users/cac5b67d81974ccca6e28e9f4aa44014 => generated 488 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:10:34.441119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d90b35-c280-4045-bf90-07fee9653bd3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:34.441697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d90b35-c280-4045-bf90-07fee9653bd3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:34.441927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d90b35-c280-4045-bf90-07fee9653bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:34.471727 ncdv-master-1 devstack@keystone.service[99084]: WARNING keystone.auth.plugins.core [None req-48d90b35-c280-4045-bf90-07fee9653bd3 None None] User is disabled: cac5b67d81974ccca6e28e9f4aa44014: AssertionError: User is disabled: cac5b67d81974ccca6e28e9f4aa44014 Oct 08 21:10:34.508788 ncdv-master-1 devstack@keystone.service[99084]: WARNING keystone.server.flask.application [None req-48d90b35-c280-4045-bf90-07fee9653bd3 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.26: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 08 21:10:34.513633 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2332/4693] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:34 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 71 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 08 21:10:34.515507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:34.521202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:34.559763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251600b-e867-4b05-8d88-10c5b7e1e3d0 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:34.578589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e212f9-5e54-406b-9d58-afc8d9fd4c50 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ab041ccc92430da64d6d7878f9d3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50418590ef39441dbcba1d52863b2f90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:34.590634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e212f9-5e54-406b-9d58-afc8d9fd4c50 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:34.591229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e212f9-5e54-406b-9d58-afc8d9fd4c50 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:34.591824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e212f9-5e54-406b-9d58-afc8d9fd4c50 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] PATH_INFO: `/v3/users/cac5b67d81974ccca6e28e9f4aa44014` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:34.647524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e212f9-5e54-406b-9d58-afc8d9fd4c50 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cac5b67d81974ccca6e28e9f4aa44014)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:34.649998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e212f9-5e54-406b-9d58-afc8d9fd4c50 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:34.757074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8e212f9-5e54-406b-9d58-afc8d9fd4c50 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac5b67d81974ccca6e28e9f4aa44014'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:34.784092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8e212f9-5e54-406b-9d58-afc8d9fd4c50 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac5b67d81974ccca6e28e9f4aa44014'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:34.785590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8e212f9-5e54-406b-9d58-afc8d9fd4c50 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac5b67d81974ccca6e28e9f4aa44014'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:34.799373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8e212f9-5e54-406b-9d58-afc8d9fd4c50 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac5b67d81974ccca6e28e9f4aa44014'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:34.848787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f8e212f9-5e54-406b-9d58-afc8d9fd4c50 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac5b67d81974ccca6e28e9f4aa44014'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:34.894991 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2362/4694] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:34 2022] DELETE /identity/v3/users/cac5b67d81974ccca6e28e9f4aa44014 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:34.899838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d90b35-c280-4045-bf90-07fee9653bd3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:34.901845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-48d90b35-c280-4045-bf90-07fee9653bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:35.079727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d90b35-c280-4045-bf90-07fee9653bd3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:35.088894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ab041ccc92430da64d6d7878f9d3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50418590ef39441dbcba1d52863b2f90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:35.091313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:35.091956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:35.093546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] PATH_INFO: `/v3/projects/cb30cfd7c6184f4e91b90f8349b04e1e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:35.096024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cb30cfd7c6184f4e91b90f8349b04e1e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:35.099967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:35.130942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:35.286840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb30cfd7c6184f4e91b90f8349b04e1e', 'request_id': 'req-5916f969-9321-43d4-b8f5-43239a73b58a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:35.307534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb30cfd7c6184f4e91b90f8349b04e1e', 'request_id': 'req-5916f969-9321-43d4-b8f5-43239a73b58a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:35.314206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb30cfd7c6184f4e91b90f8349b04e1e', 'request_id': 'req-5916f969-9321-43d4-b8f5-43239a73b58a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:35.358075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] The token cache is being invalidate because project cb30cfd7c6184f4e91b90f8349b04e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:35.358520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:35.365675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:35.373905 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2333/4695] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:34 2022] DELETE /identity/v3/projects/cb30cfd7c6184f4e91b90f8349b04e1e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:35.375065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e212f9-5e54-406b-9d58-afc8d9fd4c50 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:35.395253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e212f9-5e54-406b-9d58-afc8d9fd4c50 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:35.602365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e99e0-9487-4470-803e-995cc756e694 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24ab041ccc92430da64d6d7878f9d3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50418590ef39441dbcba1d52863b2f90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:35.603005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e99e0-9487-4470-803e-995cc756e694 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:35.603288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e99e0-9487-4470-803e-995cc756e694 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:35.603564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e99e0-9487-4470-803e-995cc756e694 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:35.604227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e99e0-9487-4470-803e-995cc756e694 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:35.616197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e99e0-9487-4470-803e-995cc756e694 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:35.655856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:35.658677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-5e1e99e0-9487-4470-803e-995cc756e694 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Could not find domain: bba60422780b4663bcb7b00bc8375eec.: keystone.exception.DomainNotFound: Could not find domain: bba60422780b4663bcb7b00bc8375eec. Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bba60422780b4663bcb7b00bc8375eec. Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:10:35.668529 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 08 21:10:35.669734 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:10:35.670756 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:10:35.671730 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:10:35.671730 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bba60422780b4663bcb7b00bc8375eec. Oct 08 21:10:35.671730 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:10:35.677228 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2363/4696] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:35 2022] POST /identity/v3/users => generated 112 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:10:35.678602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e99e0-9487-4470-803e-995cc756e694 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:35.684159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5e1e99e0-9487-4470-803e-995cc756e694 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:35.773440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=11 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:35.789266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916f969-9321-43d4-b8f5-43239a73b58a tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:35.800166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b859226-dd67-4288-acdc-8a927f97af4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:35.802006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b859226-dd67-4288-acdc-8a927f97af4a service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:35.802728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b859226-dd67-4288-acdc-8a927f97af4a service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:35.802728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b859226-dd67-4288-acdc-8a927f97af4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:35.806079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0b859226-dd67-4288-acdc-8a927f97af4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:35.892482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e99e0-9487-4470-803e-995cc756e694 tempest-UsersNegativeTest-499413555 tempest-UsersNegativeTest-499413555-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:35.901100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:35.903534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:35.904010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:35.904443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] PATH_INFO: `/v3/users/0a7b3b90a8cd4f32b411f8d7761ad3a1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:35.906344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7b3b90a8cd4f32b411f8d7761ad3a1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:35.910199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:35.943209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b859226-dd67-4288-acdc-8a927f97af4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:35.947509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b859226-dd67-4288-acdc-8a927f97af4a service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:35.993350 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2334/4697] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:10:36.016261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7b3b90a8cd4f32b411f8d7761ad3a1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:36.038829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7b3b90a8cd4f32b411f8d7761ad3a1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:36.041325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7b3b90a8cd4f32b411f8d7761ad3a1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:36.042663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7b3b90a8cd4f32b411f8d7761ad3a1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:36.094139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7b3b90a8cd4f32b411f8d7761ad3a1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:36.121808 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2364/4698] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:35 2022] DELETE /identity/v3/users/0a7b3b90a8cd4f32b411f8d7761ad3a1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:36.124110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd521a-9212-45c2-ac11-aae9fa5fa630 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:36.124897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd521a-9212-45c2-ac11-aae9fa5fa630 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:36.125181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd521a-9212-45c2-ac11-aae9fa5fa630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:36.174799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3fbd521a-9212-45c2-ac11-aae9fa5fa630 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:36.192513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3fbd521a-9212-45c2-ac11-aae9fa5fa630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:36.305219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:36.577574 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2335/4699] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:36.608707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:36.610184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:36.777353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884ec70-61e6-4807-b16f-dc36dab8684e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:36.784937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279aa9a-3720-4724-9026-e0c0c09927dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:36.785637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279aa9a-3720-4724-9026-e0c0c09927dc service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:36.799633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279aa9a-3720-4724-9026-e0c0c09927dc service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:36.800239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279aa9a-3720-4724-9026-e0c0c09927dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:36.839361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279aa9a-3720-4724-9026-e0c0c09927dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:36.842045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279aa9a-3720-4724-9026-e0c0c09927dc service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:36.869127 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2365/4700] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:10:39.623571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd521a-9212-45c2-ac11-aae9fa5fa630 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:39.625016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3fbd521a-9212-45c2-ac11-aae9fa5fa630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:39.656477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd521a-9212-45c2-ac11-aae9fa5fa630 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:39.667588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:39.669724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:39.670184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:39.673482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] PATH_INFO: `/v3/projects/55b09ba09f96457ab646245bdbde02b1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:39.681406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b09ba09f96457ab646245bdbde02b1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:39.683398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:39.875346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b09ba09f96457ab646245bdbde02b1', 'request_id': 'req-594bbc71-aedd-4adb-a0fb-7c9b8defac78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:39.901214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b09ba09f96457ab646245bdbde02b1', 'request_id': 'req-594bbc71-aedd-4adb-a0fb-7c9b8defac78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:39.932012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b09ba09f96457ab646245bdbde02b1', 'request_id': 'req-594bbc71-aedd-4adb-a0fb-7c9b8defac78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:39.951053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] The token cache is being invalidate because project 55b09ba09f96457ab646245bdbde02b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:39.951345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:39.952013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:39.954080 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2336/4701] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:39 2022] DELETE /identity/v3/projects/55b09ba09f96457ab646245bdbde02b1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:39.957801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279aa9a-3720-4724-9026-e0c0c09927dc service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:39.976686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279aa9a-3720-4724-9026-e0c0c09927dc service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:40.106844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:40.125954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:40.126674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:40.126891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:40.127167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] PATH_INFO: `/v3/users/24ab041ccc92430da64d6d7878f9d3d9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:40.128731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ab041ccc92430da64d6d7878f9d3d9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:40.130737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:40.248948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ab041ccc92430da64d6d7878f9d3d9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:40.260890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ab041ccc92430da64d6d7878f9d3d9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:40.261980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ab041ccc92430da64d6d7878f9d3d9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:40.262591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ab041ccc92430da64d6d7878f9d3d9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:40.286388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ab041ccc92430da64d6d7878f9d3d9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:40.359215 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2366/4702] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:39 2022] DELETE /identity/v3/users/24ab041ccc92430da64d6d7878f9d3d9 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:41.346323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:41.348084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:41.491060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bbc71-aedd-4adb-a0fb-7c9b8defac78 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:41.597635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52830324-4fdc-4d8d-90fb-ebc1e1184ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:41.599311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52830324-4fdc-4d8d-90fb-ebc1e1184ccd service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:41.599311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52830324-4fdc-4d8d-90fb-ebc1e1184ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:41.601445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52830324-4fdc-4d8d-90fb-ebc1e1184ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:41.605119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-52830324-4fdc-4d8d-90fb-ebc1e1184ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:41.623502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:41.690009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52830324-4fdc-4d8d-90fb-ebc1e1184ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:41.691461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52830324-4fdc-4d8d-90fb-ebc1e1184ccd service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:41.703584 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2337/4703] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:10:42.739871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:42.751085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:42.784287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f50b7d-9734-47fc-a959-08afa0368bf6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:42.790984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172f773-c3a9-4862-80fc-3a5e669202a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:42.791836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172f773-c3a9-4862-80fc-3a5e669202a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:42.792272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172f773-c3a9-4862-80fc-3a5e669202a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:42.792716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172f773-c3a9-4862-80fc-3a5e669202a9 admin admin] PATH_INFO: `/v3/projects/50418590ef39441dbcba1d52863b2f90` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:42.794479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172f773-c3a9-4862-80fc-3a5e669202a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50418590ef39441dbcba1d52863b2f90)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:42.796936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172f773-c3a9-4862-80fc-3a5e669202a9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:42.952672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b172f773-c3a9-4862-80fc-3a5e669202a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50418590ef39441dbcba1d52863b2f90', 'request_id': 'req-b172f773-c3a9-4862-80fc-3a5e669202a9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:42.963470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b172f773-c3a9-4862-80fc-3a5e669202a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50418590ef39441dbcba1d52863b2f90', 'request_id': 'req-b172f773-c3a9-4862-80fc-3a5e669202a9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:42.975110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b172f773-c3a9-4862-80fc-3a5e669202a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50418590ef39441dbcba1d52863b2f90', 'request_id': 'req-b172f773-c3a9-4862-80fc-3a5e669202a9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:42.992966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b172f773-c3a9-4862-80fc-3a5e669202a9 admin admin] The token cache is being invalidate because project 50418590ef39441dbcba1d52863b2f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:42.993859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b172f773-c3a9-4862-80fc-3a5e669202a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:42.994772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b172f773-c3a9-4862-80fc-3a5e669202a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:42.997037 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2367/4704] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:42 2022] DELETE /identity/v3/projects/50418590ef39441dbcba1d52863b2f90 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:43.001939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210a32-9ef3-4d69-9976-8a809cdba992 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:43.002497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210a32-9ef3-4d69-9976-8a809cdba992 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:43.002668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210a32-9ef3-4d69-9976-8a809cdba992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:43.047576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-83210a32-9ef3-4d69-9976-8a809cdba992 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:43.050227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-83210a32-9ef3-4d69-9976-8a809cdba992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:43.148852 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2338/4705] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:43.150943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44a622-9dd4-43ec-8fdb-aa2921f207f5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:43.151538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44a622-9dd4-43ec-8fdb-aa2921f207f5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:43.151850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44a622-9dd4-43ec-8fdb-aa2921f207f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:43.192917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cd44a622-9dd4-43ec-8fdb-aa2921f207f5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:43.194209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cd44a622-9dd4-43ec-8fdb-aa2921f207f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:43.215764 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2368/4706] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:10:43.222332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83210a32-9ef3-4d69-9976-8a809cdba992 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:43.248594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83210a32-9ef3-4d69-9976-8a809cdba992 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:43.256333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fba619-ed0a-4dec-ad5f-0f25f2b43b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:43.257010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fba619-ed0a-4dec-ad5f-0f25f2b43b91 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:43.257350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fba619-ed0a-4dec-ad5f-0f25f2b43b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:43.257626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fba619-ed0a-4dec-ad5f-0f25f2b43b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:43.258282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fba619-ed0a-4dec-ad5f-0f25f2b43b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:43.258586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fba619-ed0a-4dec-ad5f-0f25f2b43b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:43.260200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fba619-ed0a-4dec-ad5f-0f25f2b43b91 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:43.273730 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2339/4707] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:43.277374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44a622-9dd4-43ec-8fdb-aa2921f207f5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:43.287128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44a622-9dd4-43ec-8fdb-aa2921f207f5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:43.292274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f70692-b0b1-4b87-a11b-4aad10fec5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:43.292972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70692-b0b1-4b87-a11b-4aad10fec5bc admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:43.293351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70692-b0b1-4b87-a11b-4aad10fec5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:43.293694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70692-b0b1-4b87-a11b-4aad10fec5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:43.294385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f70692-b0b1-4b87-a11b-4aad10fec5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:43.296359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f70692-b0b1-4b87-a11b-4aad10fec5bc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:43.338460 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2369/4708] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:43 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:43.338986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fba619-ed0a-4dec-ad5f-0f25f2b43b91 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:43.351505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fba619-ed0a-4dec-ad5f-0f25f2b43b91 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:43.434823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49192985-2acc-4713-abad-2454ebd7a2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:43.435573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49192985-2acc-4713-abad-2454ebd7a2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:43.435938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49192985-2acc-4713-abad-2454ebd7a2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:43.436220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49192985-2acc-4713-abad-2454ebd7a2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:43.437078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49192985-2acc-4713-abad-2454ebd7a2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:43.439257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49192985-2acc-4713-abad-2454ebd7a2e2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:43.472900 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2340/4709] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:43 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:43.482736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f70692-b0b1-4b87-a11b-4aad10fec5bc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:43.501232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f70692-b0b1-4b87-a11b-4aad10fec5bc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:43.508858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae2c28-2e5d-4123-b560-806b9e57ea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:43.509691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae2c28-2e5d-4123-b560-806b9e57ea79 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:43.510629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae2c28-2e5d-4123-b560-806b9e57ea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:43.510629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae2c28-2e5d-4123-b560-806b9e57ea79 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:43.511082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae2c28-2e5d-4123-b560-806b9e57ea79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:43.516761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae2c28-2e5d-4123-b560-806b9e57ea79 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:43.536911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49192985-2acc-4713-abad-2454ebd7a2e2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:43.538569 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2370/4710] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:43.552424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49192985-2acc-4713-abad-2454ebd7a2e2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:43.576556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13b3a2-9dda-4540-b290-b39cec782b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:43.577479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13b3a2-9dda-4540-b290-b39cec782b32 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:43.578545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13b3a2-9dda-4540-b290-b39cec782b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:43.579008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13b3a2-9dda-4540-b290-b39cec782b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:43.579675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13b3a2-9dda-4540-b290-b39cec782b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:43.583361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13b3a2-9dda-4540-b290-b39cec782b32 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:43.600035 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2341/4711] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:43.602235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae2c28-2e5d-4123-b560-806b9e57ea79 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:43.619268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae2c28-2e5d-4123-b560-806b9e57ea79 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:43.628025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a236a9-4e1b-40e5-9823-51e478084091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:43.628981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a236a9-4e1b-40e5-9823-51e478084091 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:43.629465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a236a9-4e1b-40e5-9823-51e478084091 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:43.629908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a236a9-4e1b-40e5-9823-51e478084091 admin admin] PATH_INFO: `/v3/projects/852a56ce3d9b401abca3c077d532a5a4/users/255de8abdb354cb6ac4510189f98d069/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:43.646209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:43.658128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a236a9-4e1b-40e5-9823-51e478084091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852a56ce3d9b401abca3c077d532a5a4, user_id=255de8abdb354cb6ac4510189f98d069, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:43.661465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a236a9-4e1b-40e5-9823-51e478084091 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:43.682303 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2371/4712] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:43 2022] PUT /identity/v3/projects/852a56ce3d9b401abca3c077d532a5a4/users/255de8abdb354cb6ac4510189f98d069/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:43.690646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02961645-6981-4580-879c-c84cb63478ae None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:43.691053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02961645-6981-4580-879c-c84cb63478ae None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:43.691411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02961645-6981-4580-879c-c84cb63478ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:43.726726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-02961645-6981-4580-879c-c84cb63478ae None None] MFA Rules not processed for user `255de8abdb354cb6ac4510189f98d069`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:43.728974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-02961645-6981-4580-879c-c84cb63478ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:43.733528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:43.816993 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2342/4713] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:10:43.822508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a236a9-4e1b-40e5-9823-51e478084091 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:43.835718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a236a9-4e1b-40e5-9823-51e478084091 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:43.841754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a4289-f868-4421-aa4c-98ed21e0bc1f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:43.842974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a4289-f868-4421-aa4c-98ed21e0bc1f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:43.843267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a4289-f868-4421-aa4c-98ed21e0bc1f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:43.843644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a4289-f868-4421-aa4c-98ed21e0bc1f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:43.844659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a4289-f868-4421-aa4c-98ed21e0bc1f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:create_application_credential(user_id=255de8abdb354cb6ac4510189f98d069)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:43.846074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a4289-f868-4421-aa4c-98ed21e0bc1f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:43.938041 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2372/4714] 10.222.0.26 () {60 vars in 1314 bytes} [Sat Oct 8 21:10:43 2022] POST /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials => generated 788 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:43.942225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02961645-6981-4580-879c-c84cb63478ae None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:43.960096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02961645-6981-4580-879c-c84cb63478ae None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:43.966387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f050aa0-e7b6-4c17-8c7a-e72676d36a72 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:43.971806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f050aa0-e7b6-4c17-8c7a-e72676d36a72 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:43.971806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f050aa0-e7b6-4c17-8c7a-e72676d36a72 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:43.971806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f050aa0-e7b6-4c17-8c7a-e72676d36a72 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/d673f706f0434d939e2fecfc1c53e062` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:43.995578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f050aa0-e7b6-4c17-8c7a-e72676d36a72 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:get_application_credential(user_id=255de8abdb354cb6ac4510189f98d069, application_credential_id=d673f706f0434d939e2fecfc1c53e062)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:43.998287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f050aa0-e7b6-4c17-8c7a-e72676d36a72 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:44.005324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8462e22-197b-4f8f-9c99-8f445b3ea2e7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:44.005698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8462e22-197b-4f8f-9c99-8f445b3ea2e7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:44.006067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8462e22-197b-4f8f-9c99-8f445b3ea2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:44.015644 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2343/4715] 10.222.0.26 () {58 vars in 1392 bytes} [Sat Oct 8 21:10:43 2022] GET /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/d673f706f0434d939e2fecfc1c53e062 => generated 688 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:44.033429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b8462e22-197b-4f8f-9c99-8f445b3ea2e7 None None] MFA Rules not processed for user `255de8abdb354cb6ac4510189f98d069`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:44.035102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b8462e22-197b-4f8f-9c99-8f445b3ea2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:44.158843 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2373/4716] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3424 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 08 21:10:44.164081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f050aa0-e7b6-4c17-8c7a-e72676d36a72 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:44.173871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f050aa0-e7b6-4c17-8c7a-e72676d36a72 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:44.178406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078fa44-598c-48f0-aaaa-e85b07548595 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:44.179871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078fa44-598c-48f0-aaaa-e85b07548595 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:44.180406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078fa44-598c-48f0-aaaa-e85b07548595 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:44.180799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078fa44-598c-48f0-aaaa-e85b07548595 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/d673f706f0434d939e2fecfc1c53e062` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:44.182077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078fa44-598c-48f0-aaaa-e85b07548595 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:delete_application_credential(user_id=255de8abdb354cb6ac4510189f98d069, application_credential_id=d673f706f0434d939e2fecfc1c53e062)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:44.185015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078fa44-598c-48f0-aaaa-e85b07548595 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:44.233078 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2344/4717] 10.222.0.26 () {58 vars in 1395 bytes} [Sat Oct 8 21:10:44 2022] DELETE /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/d673f706f0434d939e2fecfc1c53e062 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:44.240238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8462e22-197b-4f8f-9c99-8f445b3ea2e7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:44.268424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8462e22-197b-4f8f-9c99-8f445b3ea2e7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:44.274864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a36121-3f9a-4e40-be69-4b9e643baae4 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:44.279024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a36121-3f9a-4e40-be69-4b9e643baae4 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:44.279024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a36121-3f9a-4e40-be69-4b9e643baae4 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:44.279295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a36121-3f9a-4e40-be69-4b9e643baae4 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:44.280160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a36121-3f9a-4e40-be69-4b9e643baae4 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:create_application_credential(user_id=255de8abdb354cb6ac4510189f98d069)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:44.282285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a36121-3f9a-4e40-be69-4b9e643baae4 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:44.352512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:44.509241 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2374/4718] 10.222.0.26 () {60 vars in 1315 bytes} [Sat Oct 8 21:10:44 2022] POST /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials => generated 921 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:44.510658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078fa44-598c-48f0-aaaa-e85b07548595 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:44.540881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078fa44-598c-48f0-aaaa-e85b07548595 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:44.555547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66696398-090a-4a4f-b23a-ca33d115088c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:44.556656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66696398-090a-4a4f-b23a-ca33d115088c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:44.557047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66696398-090a-4a4f-b23a-ca33d115088c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:44.557471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66696398-090a-4a4f-b23a-ca33d115088c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/cb4eaf80fbf8469482b6d4c3a2a95c27` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:44.583126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66696398-090a-4a4f-b23a-ca33d115088c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:delete_application_credential(user_id=255de8abdb354cb6ac4510189f98d069, application_credential_id=cb4eaf80fbf8469482b6d4c3a2a95c27)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:44.584882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66696398-090a-4a4f-b23a-ca33d115088c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:44.622135 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2345/4719] 10.222.0.26 () {58 vars in 1395 bytes} [Sat Oct 8 21:10:44 2022] DELETE /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/cb4eaf80fbf8469482b6d4c3a2a95c27 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:44.623281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a36121-3f9a-4e40-be69-4b9e643baae4 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:44.635112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a36121-3f9a-4e40-be69-4b9e643baae4 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:44.646227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb52420-82fa-49d0-812f-368c629f3d70 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:44.647351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb52420-82fa-49d0-812f-368c629f3d70 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:44.648638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb52420-82fa-49d0-812f-368c629f3d70 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:44.649213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb52420-82fa-49d0-812f-368c629f3d70 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:44.650329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb52420-82fa-49d0-812f-368c629f3d70 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:create_application_credential(user_id=255de8abdb354cb6ac4510189f98d069)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:44.652513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb52420-82fa-49d0-812f-368c629f3d70 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:44.754046 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2375/4720] 10.222.0.26 () {60 vars in 1315 bytes} [Sat Oct 8 21:10:44 2022] POST /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials => generated 812 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:44.758628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66696398-090a-4a4f-b23a-ca33d115088c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:44.774321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66696398-090a-4a4f-b23a-ca33d115088c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:44.779895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe44cfc-a1ec-4d44-b60d-86f3c50598b9 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:44.780897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe44cfc-a1ec-4d44-b60d-86f3c50598b9 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:44.781711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe44cfc-a1ec-4d44-b60d-86f3c50598b9 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:44.782865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe44cfc-a1ec-4d44-b60d-86f3c50598b9 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/04f50c36c55741aa8703116b1f2b7c77` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:44.795748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe44cfc-a1ec-4d44-b60d-86f3c50598b9 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:delete_application_credential(user_id=255de8abdb354cb6ac4510189f98d069, application_credential_id=04f50c36c55741aa8703116b1f2b7c77)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:44.797837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe44cfc-a1ec-4d44-b60d-86f3c50598b9 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:44.829944 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2346/4721] 10.222.0.26 () {58 vars in 1395 bytes} [Sat Oct 8 21:10:44 2022] DELETE /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/04f50c36c55741aa8703116b1f2b7c77 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:44.836060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb52420-82fa-49d0-812f-368c629f3d70 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:44.850305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb52420-82fa-49d0-812f-368c629f3d70 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:44.863350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168882e1-ecc1-40c4-a704-53e8d9373c26 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:44.864067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168882e1-ecc1-40c4-a704-53e8d9373c26 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:44.865135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168882e1-ecc1-40c4-a704-53e8d9373c26 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:44.865135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168882e1-ecc1-40c4-a704-53e8d9373c26 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:44.865500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168882e1-ecc1-40c4-a704-53e8d9373c26 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:create_application_credential(user_id=255de8abdb354cb6ac4510189f98d069)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:44.867512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168882e1-ecc1-40c4-a704-53e8d9373c26 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:44.987737 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2376/4722] 10.222.0.26 () {60 vars in 1314 bytes} [Sat Oct 8 21:10:44 2022] POST /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials => generated 788 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:44.991697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe44cfc-a1ec-4d44-b60d-86f3c50598b9 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:45.002062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe44cfc-a1ec-4d44-b60d-86f3c50598b9 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:45.018101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13442211-138c-430f-9e34-ce8d4de618b0 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:45.018818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13442211-138c-430f-9e34-ce8d4de618b0 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:45.019102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13442211-138c-430f-9e34-ce8d4de618b0 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:45.019561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13442211-138c-430f-9e34-ce8d4de618b0 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:45.020405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13442211-138c-430f-9e34-ce8d4de618b0 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:create_application_credential(user_id=255de8abdb354cb6ac4510189f98d069)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:45.024268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13442211-138c-430f-9e34-ce8d4de618b0 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:45.168675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:45.178582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168882e1-ecc1-40c4-a704-53e8d9373c26 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:45.183492 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2347/4723] 10.222.0.26 () {60 vars in 1314 bytes} [Sat Oct 8 21:10:44 2022] POST /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials => generated 789 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:45.190232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168882e1-ecc1-40c4-a704-53e8d9373c26 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:45.201893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef73afb-66d3-4e97-a965-5c86faae2f88 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:45.202836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef73afb-66d3-4e97-a965-5c86faae2f88 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:45.203279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef73afb-66d3-4e97-a965-5c86faae2f88 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:45.203719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef73afb-66d3-4e97-a965-5c86faae2f88 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:45.204536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef73afb-66d3-4e97-a965-5c86faae2f88 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:list_application_credentials(user_id=255de8abdb354cb6ac4510189f98d069)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:45.206188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef73afb-66d3-4e97-a965-5c86faae2f88 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:45.226244 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2377/4724] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 8 21:10:45 2022] GET /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials => generated 1501 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:10:45.229645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13442211-138c-430f-9e34-ce8d4de618b0 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:45.244407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13442211-138c-430f-9e34-ce8d4de618b0 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:45.250578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e915f7d-7d2f-464d-9d4d-cc2089fcde2f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:45.251472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e915f7d-7d2f-464d-9d4d-cc2089fcde2f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:45.251960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e915f7d-7d2f-464d-9d4d-cc2089fcde2f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:45.252390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e915f7d-7d2f-464d-9d4d-cc2089fcde2f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/12462ce311794e45825e9fb152bc617d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:45.266428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e915f7d-7d2f-464d-9d4d-cc2089fcde2f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:delete_application_credential(user_id=255de8abdb354cb6ac4510189f98d069, application_credential_id=12462ce311794e45825e9fb152bc617d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:45.268467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e915f7d-7d2f-464d-9d4d-cc2089fcde2f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:45.303609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef73afb-66d3-4e97-a965-5c86faae2f88 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:45.304499 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2348/4725] 10.222.0.26 () {58 vars in 1395 bytes} [Sat Oct 8 21:10:45 2022] DELETE /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/12462ce311794e45825e9fb152bc617d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:10:45.319030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef73afb-66d3-4e97-a965-5c86faae2f88 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:45.336800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd740e-83e7-4cf1-8401-7494a5fa4a9a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:45.338188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd740e-83e7-4cf1-8401-7494a5fa4a9a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:45.338489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd740e-83e7-4cf1-8401-7494a5fa4a9a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:45.338770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd740e-83e7-4cf1-8401-7494a5fa4a9a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/4449851559df462cb37c2760fae5d51d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:45.366607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd740e-83e7-4cf1-8401-7494a5fa4a9a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:delete_application_credential(user_id=255de8abdb354cb6ac4510189f98d069, application_credential_id=4449851559df462cb37c2760fae5d51d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:45.368991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd740e-83e7-4cf1-8401-7494a5fa4a9a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:45.419402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e915f7d-7d2f-464d-9d4d-cc2089fcde2f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:45.420828 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2378/4726] 10.222.0.26 () {58 vars in 1395 bytes} [Sat Oct 8 21:10:45 2022] DELETE /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/4449851559df462cb37c2760fae5d51d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:45.430180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e915f7d-7d2f-464d-9d4d-cc2089fcde2f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:45.435213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ddb70-11e3-456c-b0eb-fb6ed434acc5 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:45.435583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ddb70-11e3-456c-b0eb-fb6ed434acc5 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:45.435872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ddb70-11e3-456c-b0eb-fb6ed434acc5 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:45.436152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ddb70-11e3-456c-b0eb-fb6ed434acc5 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:45.436814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ddb70-11e3-456c-b0eb-fb6ed434acc5 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:create_application_credential(user_id=255de8abdb354cb6ac4510189f98d069)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:45.437999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ddb70-11e3-456c-b0eb-fb6ed434acc5 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:45.574430 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2349/4727] 10.222.0.26 () {60 vars in 1314 bytes} [Sat Oct 8 21:10:45 2022] POST /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials => generated 789 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:45.578218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd740e-83e7-4cf1-8401-7494a5fa4a9a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:45.595616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd740e-83e7-4cf1-8401-7494a5fa4a9a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:45.609166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3fa4f-a359-4940-a953-e835c985e20a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:45.609841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3fa4f-a359-4940-a953-e835c985e20a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:45.610199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3fa4f-a359-4940-a953-e835c985e20a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:45.610485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3fa4f-a359-4940-a953-e835c985e20a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:45.611754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3fa4f-a359-4940-a953-e835c985e20a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:create_application_credential(user_id=255de8abdb354cb6ac4510189f98d069)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:45.612370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3fa4f-a359-4940-a953-e835c985e20a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:45.623604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:INSERT=8,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:45.737778 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2379/4728] 10.222.0.26 () {60 vars in 1314 bytes} [Sat Oct 8 21:10:45 2022] POST /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials => generated 788 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:45.742379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ddb70-11e3-456c-b0eb-fb6ed434acc5 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:45.752400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ddb70-11e3-456c-b0eb-fb6ed434acc5 tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:45.758204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a2cd0-ea60-453f-8b40-9251120edb5f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:45.758612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a2cd0-ea60-453f-8b40-9251120edb5f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:45.758612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a2cd0-ea60-453f-8b40-9251120edb5f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:45.758861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a2cd0-ea60-453f-8b40-9251120edb5f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:45.759649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a2cd0-ea60-453f-8b40-9251120edb5f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Adding query filter params (name=tempest-application_credential-908025462) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:45.760117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a2cd0-ea60-453f-8b40-9251120edb5f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:list_application_credentials(user_id=255de8abdb354cb6ac4510189f98d069)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:45.761788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a2cd0-ea60-453f-8b40-9251120edb5f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:45.780987 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2350/4729] 10.222.0.26 () {58 vars in 1384 bytes} [Sat Oct 8 21:10:45 2022] GET /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials?name=tempest-application_credential-908025462 => generated 885 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:10:45.784825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3fa4f-a359-4940-a953-e835c985e20a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:45.802452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3fa4f-a359-4940-a953-e835c985e20a tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:45.808168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bd53e-2c62-4c1f-bbfa-67f9a6292f8c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:45.808831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bd53e-2c62-4c1f-bbfa-67f9a6292f8c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:45.809112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bd53e-2c62-4c1f-bbfa-67f9a6292f8c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:45.809590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bd53e-2c62-4c1f-bbfa-67f9a6292f8c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/c212643bffa947c2b5f152d670324364` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:45.828351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bd53e-2c62-4c1f-bbfa-67f9a6292f8c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:delete_application_credential(user_id=255de8abdb354cb6ac4510189f98d069, application_credential_id=c212643bffa947c2b5f152d670324364)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:45.829796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bd53e-2c62-4c1f-bbfa-67f9a6292f8c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:45.867544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a2cd0-ea60-453f-8b40-9251120edb5f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:45.867713 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2380/4730] 10.222.0.26 () {58 vars in 1395 bytes} [Sat Oct 8 21:10:45 2022] DELETE /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/c212643bffa947c2b5f152d670324364 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:45.879933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a2cd0-ea60-453f-8b40-9251120edb5f tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:45.895338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493fa6d-d24f-4768-b339-35170da7c4db tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '255de8abdb354cb6ac4510189f98d069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852a56ce3d9b401abca3c077d532a5a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:45.896965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493fa6d-d24f-4768-b339-35170da7c4db tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:45.897561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493fa6d-d24f-4768-b339-35170da7c4db tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:45.898031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493fa6d-d24f-4768-b339-35170da7c4db tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/a6616eef2fcb4fec82df65c2795f95f9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:45.909908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493fa6d-d24f-4768-b339-35170da7c4db tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorizing `identity:delete_application_credential(user_id=255de8abdb354cb6ac4510189f98d069, application_credential_id=a6616eef2fcb4fec82df65c2795f95f9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:45.911553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493fa6d-d24f-4768-b339-35170da7c4db tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:45.945253 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2351/4731] 10.222.0.26 () {58 vars in 1395 bytes} [Sat Oct 8 21:10:45 2022] DELETE /identity/v3/users/255de8abdb354cb6ac4510189f98d069/application_credentials/a6616eef2fcb4fec82df65c2795f95f9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:45.951713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bd53e-2c62-4c1f-bbfa-67f9a6292f8c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:46.052900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bd53e-2c62-4c1f-bbfa-67f9a6292f8c tempest-ApplicationCredentialsV3Test-649011608 tempest-ApplicationCredentialsV3Test-649011608-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:46.060618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:46.061071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:46.061482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:46.061853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] PATH_INFO: `/v3/users/255de8abdb354cb6ac4510189f98d069` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:46.063572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=255de8abdb354cb6ac4510189f98d069)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:46.065871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:46.162591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255de8abdb354cb6ac4510189f98d069'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:46.174926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255de8abdb354cb6ac4510189f98d069'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:46.176051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255de8abdb354cb6ac4510189f98d069'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:46.176944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255de8abdb354cb6ac4510189f98d069'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:46.218078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:46.223800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255de8abdb354cb6ac4510189f98d069'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:46.274417 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2381/4732] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:45 2022] DELETE /identity/v3/users/255de8abdb354cb6ac4510189f98d069 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:46.279325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e0fa6-fd7f-4696-82ab-b3c16be7ab62 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:46.279864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e0fa6-fd7f-4696-82ab-b3c16be7ab62 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:46.280093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e0fa6-fd7f-4696-82ab-b3c16be7ab62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:46.321103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fc9e0fa6-fd7f-4696-82ab-b3c16be7ab62 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:46.323021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fc9e0fa6-fd7f-4696-82ab-b3c16be7ab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:46.453007 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2352/4733] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:46.577225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:46.577996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:46.744193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7f7c5-fd6b-4195-b4ac-8776ae92e8e6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:46.755454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7ed9a-4460-4671-b3c5-63049cecd5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:46.756291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ed9a-4460-4671-b3c5-63049cecd5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:46.756855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ed9a-4460-4671-b3c5-63049cecd5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:46.757842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ed9a-4460-4671-b3c5-63049cecd5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:46.782196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7ed9a-4460-4671-b3c5-63049cecd5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:46.783709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7ed9a-4460-4671-b3c5-63049cecd5b4 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:46.810996 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2382/4734] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:10:47.953845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e0fa6-fd7f-4696-82ab-b3c16be7ab62 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:47.955646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fc9e0fa6-fd7f-4696-82ab-b3c16be7ab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:47.977218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e0fa6-fd7f-4696-82ab-b3c16be7ab62 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:47.985482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:47.999666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:47.999989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:48.000274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9 admin admin] PATH_INFO: `/v3/projects/852a56ce3d9b401abca3c077d532a5a4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:48.006753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852a56ce3d9b401abca3c077d532a5a4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:48.009157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:48.040399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:48.080400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852a56ce3d9b401abca3c077d532a5a4', 'request_id': 'req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:48.091346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852a56ce3d9b401abca3c077d532a5a4', 'request_id': 'req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:48.100349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852a56ce3d9b401abca3c077d532a5a4', 'request_id': 'req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:48.116771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9 admin admin] The token cache is being invalidate because project 852a56ce3d9b401abca3c077d532a5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:48.117585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:48.119858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56a897c0-edfa-45da-9f1b-2e2a64cf89e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:48.121982 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2353/4735] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:47 2022] DELETE /identity/v3/projects/852a56ce3d9b401abca3c077d532a5a4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:48.128307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb8817-f05d-4f5e-a1d7-9a6a835f0b04 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:48.128851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb8817-f05d-4f5e-a1d7-9a6a835f0b04 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:48.128946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb8817-f05d-4f5e-a1d7-9a6a835f0b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:48.152442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9dbb8817-f05d-4f5e-a1d7-9a6a835f0b04 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:48.154350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9dbb8817-f05d-4f5e-a1d7-9a6a835f0b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:48.262728 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2383/4736] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:48.274208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f8b4b-ff09-4341-8b7b-c991209c59df None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:48.274751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f8b4b-ff09-4341-8b7b-c991209c59df None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:48.275336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f8b4b-ff09-4341-8b7b-c991209c59df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:48.315376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7d8f8b4b-ff09-4341-8b7b-c991209c59df None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:48.316609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7d8f8b4b-ff09-4341-8b7b-c991209c59df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:48.343449 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2354/4737] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:48.343975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb8817-f05d-4f5e-a1d7-9a6a835f0b04 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:48.359636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb8817-f05d-4f5e-a1d7-9a6a835f0b04 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:48.376907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903e6d8-14a6-4184-8896-64fa5c65b16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:48.377575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903e6d8-14a6-4184-8896-64fa5c65b16b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:48.377861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903e6d8-14a6-4184-8896-64fa5c65b16b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:48.378139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903e6d8-14a6-4184-8896-64fa5c65b16b admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:48.378805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903e6d8-14a6-4184-8896-64fa5c65b16b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:48.383855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903e6d8-14a6-4184-8896-64fa5c65b16b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:48.386582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903e6d8-14a6-4184-8896-64fa5c65b16b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:48.421363 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2384/4738] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:48.425560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f8b4b-ff09-4341-8b7b-c991209c59df None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:48.439359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f8b4b-ff09-4341-8b7b-c991209c59df None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:48.447083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee118424-21b5-4848-b5eb-243494269afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:48.448136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee118424-21b5-4848-b5eb-243494269afd admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:48.448409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee118424-21b5-4848-b5eb-243494269afd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:48.448682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee118424-21b5-4848-b5eb-243494269afd admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:48.449446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee118424-21b5-4848-b5eb-243494269afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:48.451503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee118424-21b5-4848-b5eb-243494269afd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:48.528772 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2355/4739] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:48 2022] POST /identity/v3/projects => generated 397 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:10:48.529920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903e6d8-14a6-4184-8896-64fa5c65b16b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:48.550029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903e6d8-14a6-4184-8896-64fa5c65b16b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:48.739445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356c2d3-68ee-4d78-8b3d-21ee58ac19ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:48.740474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356c2d3-68ee-4d78-8b3d-21ee58ac19ee admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:48.740978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356c2d3-68ee-4d78-8b3d-21ee58ac19ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:48.742383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356c2d3-68ee-4d78-8b3d-21ee58ac19ee admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:48.743513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356c2d3-68ee-4d78-8b3d-21ee58ac19ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:48.747675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356c2d3-68ee-4d78-8b3d-21ee58ac19ee admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:48.800090 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2385/4740] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:48 2022] POST /identity/v3/users => generated 305 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:10:48.804740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee118424-21b5-4848-b5eb-243494269afd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:48.820436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee118424-21b5-4848-b5eb-243494269afd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:48.833483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6f00d-0144-4ff3-96ba-45bc30df0565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:48.834108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f00d-0144-4ff3-96ba-45bc30df0565 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:48.834412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f00d-0144-4ff3-96ba-45bc30df0565 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:48.834686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f00d-0144-4ff3-96ba-45bc30df0565 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:48.835865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6f00d-0144-4ff3-96ba-45bc30df0565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:48.839587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6f00d-0144-4ff3-96ba-45bc30df0565 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:48.867957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356c2d3-68ee-4d78-8b3d-21ee58ac19ee admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:48.868201 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2356/4741] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:48.882592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356c2d3-68ee-4d78-8b3d-21ee58ac19ee admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:48.896952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438284da-c9a1-4d0e-9b9f-e4b99668365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:48.898862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438284da-c9a1-4d0e-9b9f-e4b99668365b admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:48.898862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438284da-c9a1-4d0e-9b9f-e4b99668365b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:48.898862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438284da-c9a1-4d0e-9b9f-e4b99668365b admin admin] PATH_INFO: `/v3/projects/f6ec1090294e4b34bf847e34858b51ab/users/925d02afd5e4400faec1367aac80410c/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:48.904440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:48.941584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438284da-c9a1-4d0e-9b9f-e4b99668365b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ec1090294e4b34bf847e34858b51ab, user_id=925d02afd5e4400faec1367aac80410c, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:48.947968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438284da-c9a1-4d0e-9b9f-e4b99668365b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:48.982407 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2386/4742] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:48 2022] PUT /identity/v3/projects/f6ec1090294e4b34bf847e34858b51ab/users/925d02afd5e4400faec1367aac80410c/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:48.986219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6f00d-0144-4ff3-96ba-45bc30df0565 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:49.003485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6f00d-0144-4ff3-96ba-45bc30df0565 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:49.180387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33974620-9409-4adb-bbf3-18d24c592779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:49.181754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33974620-9409-4adb-bbf3-18d24c592779 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:49.182046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33974620-9409-4adb-bbf3-18d24c592779 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:49.182324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33974620-9409-4adb-bbf3-18d24c592779 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:49.182985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33974620-9409-4adb-bbf3-18d24c592779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:49.184601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33974620-9409-4adb-bbf3-18d24c592779 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:49.205979 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2357/4743] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:49.206868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438284da-c9a1-4d0e-9b9f-e4b99668365b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:49.219455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438284da-c9a1-4d0e-9b9f-e4b99668365b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:49.226944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07471f9-7616-43e2-ac96-01b32eaf8eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:49.227829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07471f9-7616-43e2-ac96-01b32eaf8eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:49.228308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07471f9-7616-43e2-ac96-01b32eaf8eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:49.228763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07471f9-7616-43e2-ac96-01b32eaf8eb5 admin admin] PATH_INFO: `/v3/projects/f6ec1090294e4b34bf847e34858b51ab/users/925d02afd5e4400faec1367aac80410c/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:49.231012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07471f9-7616-43e2-ac96-01b32eaf8eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ec1090294e4b34bf847e34858b51ab, user_id=925d02afd5e4400faec1367aac80410c, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:49.236475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07471f9-7616-43e2-ac96-01b32eaf8eb5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:49.282179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b8b7-25b9-4f31-9560-5da4f9b57c60 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:49.282436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b8b7-25b9-4f31-9560-5da4f9b57c60 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:49.282706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b8b7-25b9-4f31-9560-5da4f9b57c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:49.285855 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2387/4744] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:49 2022] PUT /identity/v3/projects/f6ec1090294e4b34bf847e34858b51ab/users/925d02afd5e4400faec1367aac80410c/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:49.322455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e1a7b8b7-25b9-4f31-9560-5da4f9b57c60 None None] MFA Rules not processed for user `925d02afd5e4400faec1367aac80410c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:49.324497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e1a7b8b7-25b9-4f31-9560-5da4f9b57c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:49.389821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:49.437442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07471f9-7616-43e2-ac96-01b32eaf8eb5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:49.439545 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2358/4745] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:49 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:49.598533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07471f9-7616-43e2-ac96-01b32eaf8eb5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:49.612572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50eb04-054f-432b-9de2-bfab223e1856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:49.615332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50eb04-054f-432b-9de2-bfab223e1856 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:49.615695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50eb04-054f-432b-9de2-bfab223e1856 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:49.616567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50eb04-054f-432b-9de2-bfab223e1856 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:49.618567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50eb04-054f-432b-9de2-bfab223e1856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:49.623482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50eb04-054f-432b-9de2-bfab223e1856 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:49.672339 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2388/4746] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:49 2022] POST /identity/v3/projects => generated 399 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:49.676030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7b8b7-25b9-4f31-9560-5da4f9b57c60 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:49.698366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7b8b7-25b9-4f31-9560-5da4f9b57c60 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:49.702899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102789d2-c0ca-45b7-9a99-eaee71ee5a29 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:49.705218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102789d2-c0ca-45b7-9a99-eaee71ee5a29 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:49.705218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102789d2-c0ca-45b7-9a99-eaee71ee5a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:49.730529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-102789d2-c0ca-45b7-9a99-eaee71ee5a29 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:49.732015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-102789d2-c0ca-45b7-9a99-eaee71ee5a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:49.817832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100ae4d-a983-4a3c-88f8-181ab558179e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:49.818779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ae4d-a983-4a3c-88f8-181ab558179e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:49.818779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ae4d-a983-4a3c-88f8-181ab558179e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:49.819009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ae4d-a983-4a3c-88f8-181ab558179e admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:49.820343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100ae4d-a983-4a3c-88f8-181ab558179e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:49.822811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100ae4d-a983-4a3c-88f8-181ab558179e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:49.827180 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2389/4747] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:10:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:49.842891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102789d2-c0ca-45b7-9a99-eaee71ee5a29 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:49.845265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-102789d2-c0ca-45b7-9a99-eaee71ee5a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:49.859268 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2359/4748] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:49 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:49.859268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100ae4d-a983-4a3c-88f8-181ab558179e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:49.886635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100ae4d-a983-4a3c-88f8-181ab558179e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:49.902120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e8ce1-b5f9-4708-ac4f-7a95b21509ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:49.902741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e8ce1-b5f9-4708-ac4f-7a95b21509ae admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:49.903020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e8ce1-b5f9-4708-ac4f-7a95b21509ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:49.903293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e8ce1-b5f9-4708-ac4f-7a95b21509ae admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:49.903942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e8ce1-b5f9-4708-ac4f-7a95b21509ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:49.905738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e8ce1-b5f9-4708-ac4f-7a95b21509ae admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:49.931319 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2360/4749] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:49.935463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e8ce1-b5f9-4708-ac4f-7a95b21509ae admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:49.956347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e8ce1-b5f9-4708-ac4f-7a95b21509ae admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:49.968559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139b947-fcf6-4076-88b8-a36a0a27b0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:49.969242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139b947-fcf6-4076-88b8-a36a0a27b0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:49.970957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139b947-fcf6-4076-88b8-a36a0a27b0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:49.971327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139b947-fcf6-4076-88b8-a36a0a27b0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:49.971955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139b947-fcf6-4076-88b8-a36a0a27b0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:49.974049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139b947-fcf6-4076-88b8-a36a0a27b0c3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:50.007166 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2361/4750] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:50.008989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139b947-fcf6-4076-88b8-a36a0a27b0c3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:50.031299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139b947-fcf6-4076-88b8-a36a0a27b0c3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:50.047101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de395283-cec9-42b6-b246-adf2929a1574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:50.048047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395283-cec9-42b6-b246-adf2929a1574 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:50.048485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395283-cec9-42b6-b246-adf2929a1574 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:50.048919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395283-cec9-42b6-b246-adf2929a1574 admin admin] PATH_INFO: `/v3/projects/57bab48068f44f0dbea69380ed811039/users/3b44293c90ee4ab585b8957792ac157a/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:50.104616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:50.105719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de395283-cec9-42b6-b246-adf2929a1574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57bab48068f44f0dbea69380ed811039, user_id=3b44293c90ee4ab585b8957792ac157a, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:50.109547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de395283-cec9-42b6-b246-adf2929a1574 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:50.119527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102789d2-c0ca-45b7-9a99-eaee71ee5a29 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:50.136841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a681ab1-436b-4161-b40a-dbd44501eccc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:50.137622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a681ab1-436b-4161-b40a-dbd44501eccc service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:50.137903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a681ab1-436b-4161-b40a-dbd44501eccc service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:50.138179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a681ab1-436b-4161-b40a-dbd44501eccc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:50.146709 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2362/4751] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:50 2022] PUT /identity/v3/projects/57bab48068f44f0dbea69380ed811039/users/3b44293c90ee4ab585b8957792ac157a/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:50.156526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a681ab1-436b-4161-b40a-dbd44501eccc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:50.160186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41468783-76d4-4eb4-933d-86c773c6dcbf None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:50.160717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41468783-76d4-4eb4-933d-86c773c6dcbf None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:50.161141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41468783-76d4-4eb4-933d-86c773c6dcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:50.165268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a681ab1-436b-4161-b40a-dbd44501eccc service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:50.188230 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2390/4752] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:10:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:50.214983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-41468783-76d4-4eb4-933d-86c773c6dcbf None None] MFA Rules not processed for user `3b44293c90ee4ab585b8957792ac157a`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:50.223366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-41468783-76d4-4eb4-933d-86c773c6dcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:50.353504 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2363/4753] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:10:50.367358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a681ab1-436b-4161-b40a-dbd44501eccc service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:50.368800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0a681ab1-436b-4161-b40a-dbd44501eccc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:50.505262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a681ab1-436b-4161-b40a-dbd44501eccc service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:50.597152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d2d0e-f719-47d0-857c-fe90fc7ad4f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:50.598284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d2d0e-f719-47d0-857c-fe90fc7ad4f4 service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:50.598674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d2d0e-f719-47d0-857c-fe90fc7ad4f4 service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:50.599016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d2d0e-f719-47d0-857c-fe90fc7ad4f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:50.699896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d2d0e-f719-47d0-857c-fe90fc7ad4f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:50.701812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d2d0e-f719-47d0-857c-fe90fc7ad4f4 service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:50.729116 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2391/4754] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:50 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:10:51.656489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41468783-76d4-4eb4-933d-86c773c6dcbf None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:51.696549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:51.825515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41468783-76d4-4eb4-933d-86c773c6dcbf None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:51.831646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b4099-4f87-460b-8a7f-427d5061557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:51.832291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b4099-4f87-460b-8a7f-427d5061557c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:51.832569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b4099-4f87-460b-8a7f-427d5061557c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:51.832834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b4099-4f87-460b-8a7f-427d5061557c admin admin] PATH_INFO: `/v3/users/925d02afd5e4400faec1367aac80410c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:51.835427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b4099-4f87-460b-8a7f-427d5061557c admin admin] RBAC: Authorizing `identity:delete_user(user_id=925d02afd5e4400faec1367aac80410c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:51.838506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b4099-4f87-460b-8a7f-427d5061557c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:51.935806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131303de-c918-4014-9a22-da5db7ef20c6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:51.936351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131303de-c918-4014-9a22-da5db7ef20c6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:51.936888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131303de-c918-4014-9a22-da5db7ef20c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:51.971653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bd9b4099-4f87-460b-8a7f-427d5061557c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925d02afd5e4400faec1367aac80410c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:51.993838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-131303de-c918-4014-9a22-da5db7ef20c6 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:51.996619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-131303de-c918-4014-9a22-da5db7ef20c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:52.002863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bd9b4099-4f87-460b-8a7f-427d5061557c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925d02afd5e4400faec1367aac80410c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:52.003875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bd9b4099-4f87-460b-8a7f-427d5061557c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925d02afd5e4400faec1367aac80410c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:52.005771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bd9b4099-4f87-460b-8a7f-427d5061557c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925d02afd5e4400faec1367aac80410c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:52.033407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bd9b4099-4f87-460b-8a7f-427d5061557c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925d02afd5e4400faec1367aac80410c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:52.060852 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2364/4755] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:51 2022] DELETE /identity/v3/users/925d02afd5e4400faec1367aac80410c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:52.062351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef637ec6-ba6f-48d9-9119-e676e0df32c9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:52.062735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef637ec6-ba6f-48d9-9119-e676e0df32c9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:52.063099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef637ec6-ba6f-48d9-9119-e676e0df32c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:52.086660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ef637ec6-ba6f-48d9-9119-e676e0df32c9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:52.091043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ef637ec6-ba6f-48d9-9119-e676e0df32c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:52.105654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:52.132236 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2392/4756] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:10:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:10:52.140337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131303de-c918-4014-9a22-da5db7ef20c6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:52.142023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-131303de-c918-4014-9a22-da5db7ef20c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:52.267652 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2365/4757] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:52.303787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131303de-c918-4014-9a22-da5db7ef20c6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:52.368610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef637ec6-ba6f-48d9-9119-e676e0df32c9 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:52.372762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ef637ec6-ba6f-48d9-9119-e676e0df32c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:52.512013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89ae80-cfda-48af-bf67-cf62f4b08231 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:52.513131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89ae80-cfda-48af-bf67-cf62f4b08231 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:52.513131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89ae80-cfda-48af-bf67-cf62f4b08231 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:52.513559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89ae80-cfda-48af-bf67-cf62f4b08231 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:52.533332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:52.568338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef637ec6-ba6f-48d9-9119-e676e0df32c9 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:52.578262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb545a-d94e-4a39-9e1d-7ec50f673419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:52.578964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb545a-d94e-4a39-9e1d-7ec50f673419 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:52.579248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb545a-d94e-4a39-9e1d-7ec50f673419 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:52.579527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb545a-d94e-4a39-9e1d-7ec50f673419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:52.602725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb545a-d94e-4a39-9e1d-7ec50f673419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:52.604845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb545a-d94e-4a39-9e1d-7ec50f673419 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:52.633679 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2366/4758] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:10:52.674958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89ae80-cfda-48af-bf67-cf62f4b08231 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:52.682023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89ae80-cfda-48af-bf67-cf62f4b08231 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:52.713966 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2393/4759] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:10:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:10:54.088364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb545a-d94e-4a39-9e1d-7ec50f673419 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:54.091268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cedb545a-d94e-4a39-9e1d-7ec50f673419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:54.119059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb545a-d94e-4a39-9e1d-7ec50f673419 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:54.131623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:54.143717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:54.144113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:54.144491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] PATH_INFO: `/v3/users/85abb492492343c58734564a2b26c8f6` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:54.146623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=85abb492492343c58734564a2b26c8f6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:54.151419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:54.279511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85abb492492343c58734564a2b26c8f6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:54.318504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85abb492492343c58734564a2b26c8f6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:54.322508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85abb492492343c58734564a2b26c8f6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:54.325565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85abb492492343c58734564a2b26c8f6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:54.360391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85abb492492343c58734564a2b26c8f6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:54.389441 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2367/4760] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:54 2022] DELETE /identity/v3/users/85abb492492343c58734564a2b26c8f6 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:54.864282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89ae80-cfda-48af-bf67-cf62f4b08231 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:54.865925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ea89ae80-cfda-48af-bf67-cf62f4b08231 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:54.900630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89ae80-cfda-48af-bf67-cf62f4b08231 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:55.010459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:55.045595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:55.046234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:55.046518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:55.046796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] PATH_INFO: `/v3/projects/f6ec1090294e4b34bf847e34858b51ab` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:55.050283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ec1090294e4b34bf847e34858b51ab)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:55.056410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:55.186269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ec1090294e4b34bf847e34858b51ab', 'request_id': 'req-cc0b9863-b0b1-4baa-afc2-2224abbfec13'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:55.204725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ec1090294e4b34bf847e34858b51ab', 'request_id': 'req-cc0b9863-b0b1-4baa-afc2-2224abbfec13'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:55.230990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ec1090294e4b34bf847e34858b51ab', 'request_id': 'req-cc0b9863-b0b1-4baa-afc2-2224abbfec13'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:55.255159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] The token cache is being invalidate because project f6ec1090294e4b34bf847e34858b51ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:55.256018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:55.258211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:55.266758 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2394/4761] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:54 2022] DELETE /identity/v3/projects/f6ec1090294e4b34bf847e34858b51ab => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:55.274064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:55.277122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:55.296546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ebcf-2107-425f-8d2e-95ad14bbaf9b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:55.391687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaee393-366f-4ec3-88eb-21475ff50aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:55.392603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee393-366f-4ec3-88eb-21475ff50aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:55.392947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee393-366f-4ec3-88eb-21475ff50aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:55.393380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee393-366f-4ec3-88eb-21475ff50aa6 admin admin] PATH_INFO: `/v3/users/3b44293c90ee4ab585b8957792ac157a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:55.394855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaee393-366f-4ec3-88eb-21475ff50aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b44293c90ee4ab585b8957792ac157a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:55.397791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaee393-366f-4ec3-88eb-21475ff50aa6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:55.476839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-baaee393-366f-4ec3-88eb-21475ff50aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b44293c90ee4ab585b8957792ac157a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:55.491920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-baaee393-366f-4ec3-88eb-21475ff50aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b44293c90ee4ab585b8957792ac157a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:55.491920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-baaee393-366f-4ec3-88eb-21475ff50aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b44293c90ee4ab585b8957792ac157a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:55.491920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-baaee393-366f-4ec3-88eb-21475ff50aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b44293c90ee4ab585b8957792ac157a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:55.491920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:55.513419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-baaee393-366f-4ec3-88eb-21475ff50aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b44293c90ee4ab585b8957792ac157a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:55.556177 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2368/4762] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:10:55 2022] DELETE /identity/v3/users/3b44293c90ee4ab585b8957792ac157a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:55.618397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:55.619868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:55.640875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b9863-b0b1-4baa-afc2-2224abbfec13 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:55.851298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0a163-a592-4bd0-aab8-0591e6eda155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:55.852408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a163-a592-4bd0-aab8-0591e6eda155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:55.854618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a163-a592-4bd0-aab8-0591e6eda155 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:55.855002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a163-a592-4bd0-aab8-0591e6eda155 admin admin] PATH_INFO: `/v3/projects/c68b14967e8249fd886f168d366f241f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:55.860553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0a163-a592-4bd0-aab8-0591e6eda155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68b14967e8249fd886f168d366f241f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:55.862607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0a163-a592-4bd0-aab8-0591e6eda155 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:55.982314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a1c0a163-a592-4bd0-aab8-0591e6eda155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68b14967e8249fd886f168d366f241f', 'request_id': 'req-a1c0a163-a592-4bd0-aab8-0591e6eda155'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:55.997973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a1c0a163-a592-4bd0-aab8-0591e6eda155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68b14967e8249fd886f168d366f241f', 'request_id': 'req-a1c0a163-a592-4bd0-aab8-0591e6eda155'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:56.016615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a1c0a163-a592-4bd0-aab8-0591e6eda155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68b14967e8249fd886f168d366f241f', 'request_id': 'req-a1c0a163-a592-4bd0-aab8-0591e6eda155'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:56.085373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a1c0a163-a592-4bd0-aab8-0591e6eda155 admin admin] The token cache is being invalidate because project c68b14967e8249fd886f168d366f241f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:56.085606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a1c0a163-a592-4bd0-aab8-0591e6eda155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:56.089696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a1c0a163-a592-4bd0-aab8-0591e6eda155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:56.097898 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2395/4763] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:55 2022] DELETE /identity/v3/projects/c68b14967e8249fd886f168d366f241f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:56.104451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86c7cf-f2da-4314-8df4-9fa416e60ce6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:56.105142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86c7cf-f2da-4314-8df4-9fa416e60ce6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:56.105543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86c7cf-f2da-4314-8df4-9fa416e60ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:56.151390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7b86c7cf-f2da-4314-8df4-9fa416e60ce6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:56.154072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7b86c7cf-f2da-4314-8df4-9fa416e60ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:56.318085 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2369/4764] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:56.327326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec5dab-e93c-43d0-be28-03fd055b7f64 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:56.327664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec5dab-e93c-43d0-be28-03fd055b7f64 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:56.327887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec5dab-e93c-43d0-be28-03fd055b7f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:56.351209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:56.391674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-98ec5dab-e93c-43d0-be28-03fd055b7f64 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:56.391856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86c7cf-f2da-4314-8df4-9fa416e60ce6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:56.393082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-98ec5dab-e93c-43d0-be28-03fd055b7f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:56.393870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7b86c7cf-f2da-4314-8df4-9fa416e60ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:56.412421 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2396/4765] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:56.416418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec5dab-e93c-43d0-be28-03fd055b7f64 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:56.424042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86c7cf-f2da-4314-8df4-9fa416e60ce6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:56.436369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:56.437031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:56.439499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:56.439808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9 admin admin] PATH_INFO: `/v3/projects/57bab48068f44f0dbea69380ed811039` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:56.440734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec5dab-e93c-43d0-be28-03fd055b7f64 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:56.443337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57bab48068f44f0dbea69380ed811039)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:56.451503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937b5e5-e36c-43ba-a5be-2d0d4df58ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:56.452279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937b5e5-e36c-43ba-a5be-2d0d4df58ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:56.452763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937b5e5-e36c-43ba-a5be-2d0d4df58ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:56.452963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:56.453443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937b5e5-e36c-43ba-a5be-2d0d4df58ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:56.455588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937b5e5-e36c-43ba-a5be-2d0d4df58ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:56.456232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937b5e5-e36c-43ba-a5be-2d0d4df58ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:56.459236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937b5e5-e36c-43ba-a5be-2d0d4df58ca4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:56.486524 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2397/4766] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:56.487638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937b5e5-e36c-43ba-a5be-2d0d4df58ca4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:56.505010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937b5e5-e36c-43ba-a5be-2d0d4df58ca4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:56.511452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f6837-5313-4b86-8e27-df99cfb9860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:56.512178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f6837-5313-4b86-8e27-df99cfb9860a admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:56.512555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f6837-5313-4b86-8e27-df99cfb9860a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:56.513438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f6837-5313-4b86-8e27-df99cfb9860a admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:56.513789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f6837-5313-4b86-8e27-df99cfb9860a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:56.515933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f6837-5313-4b86-8e27-df99cfb9860a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:56.597679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57bab48068f44f0dbea69380ed811039', 'request_id': 'req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:56.606854 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2398/4767] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:56 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:56.608167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f6837-5313-4b86-8e27-df99cfb9860a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:56.619466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57bab48068f44f0dbea69380ed811039', 'request_id': 'req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:56.630246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57bab48068f44f0dbea69380ed811039', 'request_id': 'req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:56.667373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9 admin admin] The token cache is being invalidate because project 57bab48068f44f0dbea69380ed811039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:10:56.667700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:56.668961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e16e8c64-10e0-42d7-8a86-ea88f1c042b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:10:56.673859 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2370/4768] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:56 2022] DELETE /identity/v3/projects/57bab48068f44f0dbea69380ed811039 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:56.676235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3316-3986-4ab4-8c4c-116c5e5a0402 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:56.676529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3316-3986-4ab4-8c4c-116c5e5a0402 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:56.676804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3316-3986-4ab4-8c4c-116c5e5a0402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:56.717291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ba6e3316-3986-4ab4-8c4c-116c5e5a0402 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:56.723482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ba6e3316-3986-4ab4-8c4c-116c5e5a0402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:56.739177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f6837-5313-4b86-8e27-df99cfb9860a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:56.746654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfbb6c-e0b9-4085-8a45-19094f3deec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:56.747550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfbb6c-e0b9-4085-8a45-19094f3deec5 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:56.747680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfbb6c-e0b9-4085-8a45-19094f3deec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:56.747946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfbb6c-e0b9-4085-8a45-19094f3deec5 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:56.748587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfbb6c-e0b9-4085-8a45-19094f3deec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:56.750873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfbb6c-e0b9-4085-8a45-19094f3deec5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:56.761798 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2371/4769] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:56.767359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a55ec-9356-45d8-a6fa-adfb2104d915 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:56.767744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a55ec-9356-45d8-a6fa-adfb2104d915 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:56.768116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a55ec-9356-45d8-a6fa-adfb2104d915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:56.800801 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2399/4770] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:56 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:10:56.805355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfbb6c-e0b9-4085-8a45-19094f3deec5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:56.807105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-32bfbb6c-e0b9-4085-8a45-19094f3deec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:56.837068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfbb6c-e0b9-4085-8a45-19094f3deec5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:56.842360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fa8a55ec-9356-45d8-a6fa-adfb2104d915 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:56.843798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fa8a55ec-9356-45d8-a6fa-adfb2104d915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:56.850970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843530a-82c5-415f-bb59-fdf10e38f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:56.852374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843530a-82c5-415f-bb59-fdf10e38f951 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:56.852675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843530a-82c5-415f-bb59-fdf10e38f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:56.852959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843530a-82c5-415f-bb59-fdf10e38f951 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:56.858503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843530a-82c5-415f-bb59-fdf10e38f951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:56.862461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843530a-82c5-415f-bb59-fdf10e38f951 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:56.865387 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2372/4771] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:56.870641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a55ec-9356-45d8-a6fa-adfb2104d915 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:56.892046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a55ec-9356-45d8-a6fa-adfb2104d915 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:56.901675 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2400/4772] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:10:56.902608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843530a-82c5-415f-bb59-fdf10e38f951 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:56.903611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813967c-e717-4955-9208-03502228cbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:56.904321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813967c-e717-4955-9208-03502228cbcc admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:56.904686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813967c-e717-4955-9208-03502228cbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:56.905045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813967c-e717-4955-9208-03502228cbcc admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:56.905803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813967c-e717-4955-9208-03502228cbcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:10:56.913202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813967c-e717-4955-9208-03502228cbcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:56.915159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813967c-e717-4955-9208-03502228cbcc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:56.934279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843530a-82c5-415f-bb59-fdf10e38f951 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:56.936980 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2373/4773] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:10:56.941706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813967c-e717-4955-9208-03502228cbcc admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:56.953533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081baa5-37ad-4013-9bd3-010d0ef4a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:56.956183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081baa5-37ad-4013-9bd3-010d0ef4a24b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:56.956538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081baa5-37ad-4013-9bd3-010d0ef4a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:56.958539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081baa5-37ad-4013-9bd3-010d0ef4a24b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:56.963693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081baa5-37ad-4013-9bd3-010d0ef4a24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:56.965328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813967c-e717-4955-9208-03502228cbcc admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:56.966366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081baa5-37ad-4013-9bd3-010d0ef4a24b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:56.981552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88a092-a90a-4a80-a21a-a86c3d316bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:56.982350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88a092-a90a-4a80-a21a-a86c3d316bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:56.982703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88a092-a90a-4a80-a21a-a86c3d316bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:56.983053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88a092-a90a-4a80-a21a-a86c3d316bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:56.983759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88a092-a90a-4a80-a21a-a86c3d316bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:56.985942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88a092-a90a-4a80-a21a-a86c3d316bc5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:57.002723 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2401/4774] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:57.003836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081baa5-37ad-4013-9bd3-010d0ef4a24b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:57.037560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081baa5-37ad-4013-9bd3-010d0ef4a24b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:57.053150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573e3ba-dd98-48da-8c95-0ce54b8c8dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:57.055588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573e3ba-dd98-48da-8c95-0ce54b8c8dab admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:57.056855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573e3ba-dd98-48da-8c95-0ce54b8c8dab admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:57.057339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573e3ba-dd98-48da-8c95-0ce54b8c8dab admin admin] PATH_INFO: `/v3/projects/c56b9280162d4a6b9bac0cc641147a24/users/7b0248890c8c4da9a1c3d08bcd5742ad/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:57.067917 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2374/4775] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:56 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:10:57.072075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88a092-a90a-4a80-a21a-a86c3d316bc5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:57.089434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:57.116884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573e3ba-dd98-48da-8c95-0ce54b8c8dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56b9280162d4a6b9bac0cc641147a24, user_id=7b0248890c8c4da9a1c3d08bcd5742ad, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:57.123586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573e3ba-dd98-48da-8c95-0ce54b8c8dab admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:57.177448 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2402/4776] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:57 2022] PUT /identity/v3/projects/c56b9280162d4a6b9bac0cc641147a24/users/7b0248890c8c4da9a1c3d08bcd5742ad/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:57.187025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579fd15-7952-4a9a-a755-d0765fa73cb3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:57.187938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579fd15-7952-4a9a-a755-d0765fa73cb3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:57.188704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579fd15-7952-4a9a-a755-d0765fa73cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:57.210718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88a092-a90a-4a80-a21a-a86c3d316bc5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:57.271221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a579fd15-7952-4a9a-a755-d0765fa73cb3 None None] MFA Rules not processed for user `7b0248890c8c4da9a1c3d08bcd5742ad`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:57.273444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a579fd15-7952-4a9a-a755-d0765fa73cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:57.343026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe981-f7a6-4864-8cad-b41ebe35bd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:57.343705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe981-f7a6-4864-8cad-b41ebe35bd1e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:57.344184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe981-f7a6-4864-8cad-b41ebe35bd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:57.344395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe981-f7a6-4864-8cad-b41ebe35bd1e admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:57.345178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffe981-f7a6-4864-8cad-b41ebe35bd1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:57.351450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffe981-f7a6-4864-8cad-b41ebe35bd1e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:57.423724 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2375/4777] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:57 2022] POST /identity/v3/users => generated 300 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:57.430083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe981-f7a6-4864-8cad-b41ebe35bd1e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:57.436542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:57.456850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe981-f7a6-4864-8cad-b41ebe35bd1e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:57.462273 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2403/4778] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:57.473682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579fd15-7952-4a9a-a755-d0765fa73cb3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:57.475690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a579fd15-7952-4a9a-a755-d0765fa73cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:57.477358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d3e5b-a5d1-472f-9457-80d0fd7377da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:57.477987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d3e5b-a5d1-472f-9457-80d0fd7377da admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:57.478321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d3e5b-a5d1-472f-9457-80d0fd7377da admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:57.478555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d3e5b-a5d1-472f-9457-80d0fd7377da admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:57.479195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d3e5b-a5d1-472f-9457-80d0fd7377da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:57.481015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d3e5b-a5d1-472f-9457-80d0fd7377da admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:57.520282 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2376/4779] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:10:57.526435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d3e5b-a5d1-472f-9457-80d0fd7377da admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:57.545638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d3e5b-a5d1-472f-9457-80d0fd7377da admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:57.557154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42fab8-aa9b-48c3-aa9d-3aed3a8586e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:57.558060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42fab8-aa9b-48c3-aa9d-3aed3a8586e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:57.558568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42fab8-aa9b-48c3-aa9d-3aed3a8586e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:57.558794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42fab8-aa9b-48c3-aa9d-3aed3a8586e8 admin admin] PATH_INFO: `/v3/projects/7e60384569db4c928175b67f41488b88/users/565a35f71f79409eb7b577d6d594a8d3/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:57.607950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42fab8-aa9b-48c3-aa9d-3aed3a8586e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e60384569db4c928175b67f41488b88, user_id=565a35f71f79409eb7b577d6d594a8d3, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:57.610827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42fab8-aa9b-48c3-aa9d-3aed3a8586e8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:57.641322 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2377/4780] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:57 2022] PUT /identity/v3/projects/7e60384569db4c928175b67f41488b88/users/565a35f71f79409eb7b577d6d594a8d3/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:57.658576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42fab8-aa9b-48c3-aa9d-3aed3a8586e8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:57.737819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579fd15-7952-4a9a-a755-d0765fa73cb3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:57.787552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42fab8-aa9b-48c3-aa9d-3aed3a8586e8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:57.796150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536c717-3337-4d14-b354-87ff333a3652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:57.797133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536c717-3337-4d14-b354-87ff333a3652 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:57.797611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536c717-3337-4d14-b354-87ff333a3652 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:57.798428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536c717-3337-4d14-b354-87ff333a3652 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:57.800081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536c717-3337-4d14-b354-87ff333a3652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:57.802808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536c717-3337-4d14-b354-87ff333a3652 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:57.848192 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2378/4781] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:10:57.852187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536c717-3337-4d14-b354-87ff333a3652 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:57.882324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536c717-3337-4d14-b354-87ff333a3652 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:57.895458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53595b-b6e4-4895-9319-8f87510bc683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:57.898708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53595b-b6e4-4895-9319-8f87510bc683 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:57.899938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53595b-b6e4-4895-9319-8f87510bc683 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:57.900234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53595b-b6e4-4895-9319-8f87510bc683 admin admin] PATH_INFO: `/v3/projects/7e60384569db4c928175b67f41488b88/users/565a35f71f79409eb7b577d6d594a8d3/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:57.907205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53595b-b6e4-4895-9319-8f87510bc683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e60384569db4c928175b67f41488b88, user_id=565a35f71f79409eb7b577d6d594a8d3, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:57.919036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53595b-b6e4-4895-9319-8f87510bc683 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:57.922151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:57.937382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e92654-6f11-49c5-8b86-6967e7ad2eaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:57.938000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e92654-6f11-49c5-8b86-6967e7ad2eaa service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:57.938277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e92654-6f11-49c5-8b86-6967e7ad2eaa service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:57.938545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e92654-6f11-49c5-8b86-6967e7ad2eaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:57.971656 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2379/4782] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:57 2022] PUT /identity/v3/projects/7e60384569db4c928175b67f41488b88/users/565a35f71f79409eb7b577d6d594a8d3/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:57.975797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2428e-9c8d-40ef-b687-f2345b101d10 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:57.976249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2428e-9c8d-40ef-b687-f2345b101d10 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:57.976668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2428e-9c8d-40ef-b687-f2345b101d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:58.027992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-75c2428e-9c8d-40ef-b687-f2345b101d10 None None] MFA Rules not processed for user `565a35f71f79409eb7b577d6d594a8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:58.030191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-75c2428e-9c8d-40ef-b687-f2345b101d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:58.158743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e92654-6f11-49c5-8b86-6967e7ad2eaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:58.160360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e92654-6f11-49c5-8b86-6967e7ad2eaa service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:58.183908 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2380/4783] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:58.185605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2428e-9c8d-40ef-b687-f2345b101d10 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:58.252843 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2404/4784] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 774 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:10:58.258028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2428e-9c8d-40ef-b687-f2345b101d10 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:58.264563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072af334-47b5-4104-8956-d2757d70e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:58.265558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072af334-47b5-4104-8956-d2757d70e970 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:58.265911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072af334-47b5-4104-8956-d2757d70e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:58.266259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072af334-47b5-4104-8956-d2757d70e970 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:58.266964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072af334-47b5-4104-8956-d2757d70e970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:58.269071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072af334-47b5-4104-8956-d2757d70e970 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:58.322601 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2381/4785] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:10:58 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:58.327077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e92654-6f11-49c5-8b86-6967e7ad2eaa service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:58.343272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e92654-6f11-49c5-8b86-6967e7ad2eaa service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:58.487428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:58.632433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650e077-bd51-44ae-afa4-0f7453b0f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:58.633071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650e077-bd51-44ae-afa4-0f7453b0f6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:58.638308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650e077-bd51-44ae-afa4-0f7453b0f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:58.638652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650e077-bd51-44ae-afa4-0f7453b0f6c4 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:58.639352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650e077-bd51-44ae-afa4-0f7453b0f6c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:58.641546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650e077-bd51-44ae-afa4-0f7453b0f6c4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:58.715319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072af334-47b5-4104-8956-d2757d70e970 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:58.727293 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2405/4786] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:10:58 2022] POST /identity/v3/users => generated 294 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:10:58.742821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072af334-47b5-4104-8956-d2757d70e970 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:58.761778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067d867-ddf0-419a-8926-af1176340f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:58.763093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067d867-ddf0-419a-8926-af1176340f07 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:58.763383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067d867-ddf0-419a-8926-af1176340f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:58.770137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067d867-ddf0-419a-8926-af1176340f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:58.774192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067d867-ddf0-419a-8926-af1176340f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:58.775984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067d867-ddf0-419a-8926-af1176340f07 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:58.830800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650e077-bd51-44ae-afa4-0f7453b0f6c4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:58.833011 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2382/4787] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:10:58.842152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650e077-bd51-44ae-afa4-0f7453b0f6c4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:58.896663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27888bb2-9c3f-4bba-9e0d-6cd890a45a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:58.897886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27888bb2-9c3f-4bba-9e0d-6cd890a45a52 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:58.898165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27888bb2-9c3f-4bba-9e0d-6cd890a45a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:58.898441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27888bb2-9c3f-4bba-9e0d-6cd890a45a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:58.906392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27888bb2-9c3f-4bba-9e0d-6cd890a45a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:58.918360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27888bb2-9c3f-4bba-9e0d-6cd890a45a52 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:58.960055 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2406/4788] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:10:58.964630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067d867-ddf0-419a-8926-af1176340f07 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:58.997020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067d867-ddf0-419a-8926-af1176340f07 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:59.024769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0e7bb-d145-454c-a4c2-9f8cdac5afce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:59.025479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0e7bb-d145-454c-a4c2-9f8cdac5afce admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:59.025760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0e7bb-d145-454c-a4c2-9f8cdac5afce admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:59.026033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0e7bb-d145-454c-a4c2-9f8cdac5afce admin admin] PATH_INFO: `/v3/projects/be77f5af691f4cc3b0766978307d7463/users/cdc3922b768a49c6886915e1d0d816d2/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:59.091447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0e7bb-d145-454c-a4c2-9f8cdac5afce admin admin] RBAC: Authorizing `identity:create_grant(project_id=be77f5af691f4cc3b0766978307d7463, user_id=cdc3922b768a49c6886915e1d0d816d2, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:59.103046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0e7bb-d145-454c-a4c2-9f8cdac5afce admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:59.146928 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2383/4789] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:10:58 2022] PUT /identity/v3/projects/be77f5af691f4cc3b0766978307d7463/users/cdc3922b768a49c6886915e1d0d816d2/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:10:59.149367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970ad24-b8fb-49b5-a9c8-3e3e1ba1d543 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:59.149657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970ad24-b8fb-49b5-a9c8-3e3e1ba1d543 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:59.149934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970ad24-b8fb-49b5-a9c8-3e3e1ba1d543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:59.252467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2970ad24-b8fb-49b5-a9c8-3e3e1ba1d543 None None] MFA Rules not processed for user `cdc3922b768a49c6886915e1d0d816d2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:10:59.259605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2970ad24-b8fb-49b5-a9c8-3e3e1ba1d543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:59.448979 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2407/4790] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:10:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:10:59.464466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0e7bb-d145-454c-a4c2-9f8cdac5afce admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:10:59.466570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-20a0e7bb-d145-454c-a4c2-9f8cdac5afce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:10:59.613966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:59.671099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0e7bb-d145-454c-a4c2-9f8cdac5afce admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:10:59.679791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62add5-959e-49c4-93c8-fe6bed783ab7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:10:59.681594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62add5-959e-49c4-93c8-fe6bed783ab7 service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:10:59.681880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62add5-959e-49c4-93c8-fe6bed783ab7 service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:10:59.688521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62add5-959e-49c4-93c8-fe6bed783ab7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:10:59.851383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62add5-959e-49c4-93c8-fe6bed783ab7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:10:59.854178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62add5-959e-49c4-93c8-fe6bed783ab7 service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:10:59.887672 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2384/4791] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:10:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:00.167622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970ad24-b8fb-49b5-a9c8-3e3e1ba1d543 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:00.169082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2970ad24-b8fb-49b5-a9c8-3e3e1ba1d543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:00.278932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970ad24-b8fb-49b5-a9c8-3e3e1ba1d543 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:00.288690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:00.289498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:00.289959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:00.290448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] PATH_INFO: `/v3/users/acb8fd2c129c475aaddca7e30e5b74f3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:00.291810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb8fd2c129c475aaddca7e30e5b74f3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:00.294024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:00.368097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:00.389238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb8fd2c129c475aaddca7e30e5b74f3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:00.412259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb8fd2c129c475aaddca7e30e5b74f3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:00.413178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb8fd2c129c475aaddca7e30e5b74f3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:00.415222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb8fd2c129c475aaddca7e30e5b74f3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:00.458293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb8fd2c129c475aaddca7e30e5b74f3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:00.496283 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2408/4792] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:00 2022] DELETE /identity/v3/users/acb8fd2c129c475aaddca7e30e5b74f3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:00.500835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3671-dd1e-42ab-a1e7-93cc1c06b413 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:00.501257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3671-dd1e-42ab-a1e7-93cc1c06b413 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:00.501640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3671-dd1e-42ab-a1e7-93cc1c06b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:00.548917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ccde3671-dd1e-42ab-a1e7-93cc1c06b413 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:00.550486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ccde3671-dd1e-42ab-a1e7-93cc1c06b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:00.706195 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2385/4793] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:00.717150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:00.722071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:00.886273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b492aa-0738-4001-97d4-1352e4b7c4f5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:00.893372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2dd45-a860-4bd7-84f8-c39d91ebcdd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:00.893997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2dd45-a860-4bd7-84f8-c39d91ebcdd7 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:00.894394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2dd45-a860-4bd7-84f8-c39d91ebcdd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:00.894808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2dd45-a860-4bd7-84f8-c39d91ebcdd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:00.910341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2dd45-a860-4bd7-84f8-c39d91ebcdd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:00.912181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2dd45-a860-4bd7-84f8-c39d91ebcdd7 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:00.941856 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2409/4794] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:01.096132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde3671-dd1e-42ab-a1e7-93cc1c06b413 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:01.097872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ccde3671-dd1e-42ab-a1e7-93cc1c06b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:01.122545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde3671-dd1e-42ab-a1e7-93cc1c06b413 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:01.137825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6fc95-b0b5-4a9d-8172-7e5b86be7878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:01.138480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6fc95-b0b5-4a9d-8172-7e5b86be7878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:01.138756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6fc95-b0b5-4a9d-8172-7e5b86be7878 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:01.139130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6fc95-b0b5-4a9d-8172-7e5b86be7878 admin admin] PATH_INFO: `/v3/users/565a35f71f79409eb7b577d6d594a8d3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:01.140505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6fc95-b0b5-4a9d-8172-7e5b86be7878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=565a35f71f79409eb7b577d6d594a8d3)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:01.142711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6fc95-b0b5-4a9d-8172-7e5b86be7878 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:01.213942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-40d6fc95-b0b5-4a9d-8172-7e5b86be7878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565a35f71f79409eb7b577d6d594a8d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:01.215227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2dd45-a860-4bd7-84f8-c39d91ebcdd7 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:01.216683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-caf2dd45-a860-4bd7-84f8-c39d91ebcdd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:01.223890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-40d6fc95-b0b5-4a9d-8172-7e5b86be7878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565a35f71f79409eb7b577d6d594a8d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:01.225326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-40d6fc95-b0b5-4a9d-8172-7e5b86be7878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565a35f71f79409eb7b577d6d594a8d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:01.226466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-40d6fc95-b0b5-4a9d-8172-7e5b86be7878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565a35f71f79409eb7b577d6d594a8d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:01.250085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-40d6fc95-b0b5-4a9d-8172-7e5b86be7878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565a35f71f79409eb7b577d6d594a8d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:01.251364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2dd45-a860-4bd7-84f8-c39d91ebcdd7 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:01.254775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:01.271400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:01.275589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:01.276050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:01.280184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24 admin admin] PATH_INFO: `/v3/projects/1ac07a2d4f5645d5afe02ab94b23a128` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:01.286341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac07a2d4f5645d5afe02ab94b23a128)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:01.288337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:01.315188 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2386/4795] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:01 2022] DELETE /identity/v3/users/565a35f71f79409eb7b577d6d594a8d3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:01.316796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfacdd2-6a02-4091-929e-5beb578ced18 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:01.320038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfacdd2-6a02-4091-929e-5beb578ced18 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:01.320420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfacdd2-6a02-4091-929e-5beb578ced18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:01.388967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bbfacdd2-6a02-4091-929e-5beb578ced18 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:01.390858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bbfacdd2-6a02-4091-929e-5beb578ced18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:01.455673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac07a2d4f5645d5afe02ab94b23a128', 'request_id': 'req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:01.477649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac07a2d4f5645d5afe02ab94b23a128', 'request_id': 'req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:01.486205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac07a2d4f5645d5afe02ab94b23a128', 'request_id': 'req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:01.505987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24 admin admin] The token cache is being invalidate because project 1ac07a2d4f5645d5afe02ab94b23a128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:01.507226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:01.508303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f769cb1f-d2f6-4f7a-b932-b9c22afa3c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:01.515200 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2410/4796] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:01 2022] DELETE /identity/v3/projects/1ac07a2d4f5645d5afe02ab94b23a128 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:01.516964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92f9d-e8c4-4f8e-811a-ad881fb6d0a3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:01.517439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92f9d-e8c4-4f8e-811a-ad881fb6d0a3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:01.517901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92f9d-e8c4-4f8e-811a-ad881fb6d0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:01.552525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-41a92f9d-e8c4-4f8e-811a-ad881fb6d0a3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:01.560139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-41a92f9d-e8c4-4f8e-811a-ad881fb6d0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:01.562891 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2387/4797] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:01.597660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfacdd2-6a02-4091-929e-5beb578ced18 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:01.599486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bbfacdd2-6a02-4091-929e-5beb578ced18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:01.663532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:01.700907 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2411/4798] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:01.703113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfacdd2-6a02-4091-929e-5beb578ced18 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:01.709140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb49c8-0880-49e4-ab6c-2a5a05d892b3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:01.709378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb49c8-0880-49e4-ab6c-2a5a05d892b3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:01.709628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb49c8-0880-49e4-ab6c-2a5a05d892b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:01.763335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e6eb49c8-0880-49e4-ab6c-2a5a05d892b3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:01.767757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e6eb49c8-0880-49e4-ab6c-2a5a05d892b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:01.804338 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2412/4799] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:01.806134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb49c8-0880-49e4-ab6c-2a5a05d892b3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:01.829738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525313f3-9916-458f-a6b9-acf2f2aef6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:01.830425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb49c8-0880-49e4-ab6c-2a5a05d892b3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:01.830845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525313f3-9916-458f-a6b9-acf2f2aef6ef service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:01.831282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525313f3-9916-458f-a6b9-acf2f2aef6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:01.831890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525313f3-9916-458f-a6b9-acf2f2aef6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:01.841139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241535fa-5d09-4ce0-8709-8ddfb9511ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:01.841914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241535fa-5d09-4ce0-8709-8ddfb9511ffc admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:01.842614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241535fa-5d09-4ce0-8709-8ddfb9511ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:01.842614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241535fa-5d09-4ce0-8709-8ddfb9511ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:01.843275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241535fa-5d09-4ce0-8709-8ddfb9511ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:01.843643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241535fa-5d09-4ce0-8709-8ddfb9511ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:01.845446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241535fa-5d09-4ce0-8709-8ddfb9511ffc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:01.858226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525313f3-9916-458f-a6b9-acf2f2aef6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:01.859682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525313f3-9916-458f-a6b9-acf2f2aef6ef service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:01.878263 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2413/4800] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:01.892839 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2388/4801] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:01.900339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241535fa-5d09-4ce0-8709-8ddfb9511ffc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:01.914523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241535fa-5d09-4ce0-8709-8ddfb9511ffc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:01.926362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea7815-3947-4638-a311-3be608422e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:01.926995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea7815-3947-4638-a311-3be608422e72 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:01.928666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea7815-3947-4638-a311-3be608422e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:01.928958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea7815-3947-4638-a311-3be608422e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:01.930204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea7815-3947-4638-a311-3be608422e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:01.932797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea7815-3947-4638-a311-3be608422e72 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:01.996630 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2414/4802] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:01 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:02.001061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525313f3-9916-458f-a6b9-acf2f2aef6ef service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:02.022962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525313f3-9916-458f-a6b9-acf2f2aef6ef service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:02.110655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:02.127366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3f398-d9ad-4fd7-ba55-313a16dbc995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:02.128067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3f398-d9ad-4fd7-ba55-313a16dbc995 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:02.128462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3f398-d9ad-4fd7-ba55-313a16dbc995 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:02.128799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3f398-d9ad-4fd7-ba55-313a16dbc995 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:02.129558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3f398-d9ad-4fd7-ba55-313a16dbc995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:02.132227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3f398-d9ad-4fd7-ba55-313a16dbc995 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:02.171769 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2389/4803] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:01 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:02.175682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea7815-3947-4638-a311-3be608422e72 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:02.187689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea7815-3947-4638-a311-3be608422e72 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:02.193130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d11903-9bc7-4b42-9bcb-48af6a25c503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:02.194104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d11903-9bc7-4b42-9bcb-48af6a25c503 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:02.195347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d11903-9bc7-4b42-9bcb-48af6a25c503 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:02.195853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d11903-9bc7-4b42-9bcb-48af6a25c503 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:02.197629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d11903-9bc7-4b42-9bcb-48af6a25c503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:02.199668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d11903-9bc7-4b42-9bcb-48af6a25c503 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:02.216419 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2415/4804] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:02.220108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3f398-d9ad-4fd7-ba55-313a16dbc995 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:02.236738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3f398-d9ad-4fd7-ba55-313a16dbc995 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:02.243833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a720de-025e-476b-b18b-9ca6c925c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:02.244750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a720de-025e-476b-b18b-9ca6c925c3dd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:02.245396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a720de-025e-476b-b18b-9ca6c925c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:02.245777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a720de-025e-476b-b18b-9ca6c925c3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:02.247023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a720de-025e-476b-b18b-9ca6c925c3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:02.248998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a720de-025e-476b-b18b-9ca6c925c3dd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:02.267471 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2390/4805] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:02.271754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d11903-9bc7-4b42-9bcb-48af6a25c503 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:02.290390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d11903-9bc7-4b42-9bcb-48af6a25c503 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:02.299494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ed33e-afa7-4468-8a1c-44ee176a6159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:02.300393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ed33e-afa7-4468-8a1c-44ee176a6159 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:02.301284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ed33e-afa7-4468-8a1c-44ee176a6159 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:02.305378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ed33e-afa7-4468-8a1c-44ee176a6159 admin admin] PATH_INFO: `/v3/projects/0fdd27e001dc45d3b92a2db3577e2e0a/users/63753501c8674e169cfde7c2457abf73/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:02.326473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ed33e-afa7-4468-8a1c-44ee176a6159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fdd27e001dc45d3b92a2db3577e2e0a, user_id=63753501c8674e169cfde7c2457abf73, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:02.331138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ed33e-afa7-4468-8a1c-44ee176a6159 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:02.355640 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2416/4806] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:02 2022] PUT /identity/v3/projects/0fdd27e001dc45d3b92a2db3577e2e0a/users/63753501c8674e169cfde7c2457abf73/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:02.367631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d30e30-0293-4a14-98f2-36a6173f662f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:02.368085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d30e30-0293-4a14-98f2-36a6173f662f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:02.368557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d30e30-0293-4a14-98f2-36a6173f662f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:02.414183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-97d30e30-0293-4a14-98f2-36a6173f662f None None] MFA Rules not processed for user `63753501c8674e169cfde7c2457abf73`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:02.415752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-97d30e30-0293-4a14-98f2-36a6173f662f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:02.488987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ed33e-afa7-4468-8a1c-44ee176a6159 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:02.491615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5d3ed33e-afa7-4468-8a1c-44ee176a6159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:02.537401 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2391/4807] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:02.542654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d30e30-0293-4a14-98f2-36a6173f662f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:02.595755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ed33e-afa7-4468-8a1c-44ee176a6159 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:02.603728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:02.604800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:02.605415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:02.605774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] PATH_INFO: `/v3/projects/7e60384569db4c928175b67f41488b88` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:02.607502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e60384569db4c928175b67f41488b88)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:02.610083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:02.618911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d30e30-0293-4a14-98f2-36a6173f662f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:02.626181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029c0df-69cf-4700-8749-0a2948b72187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:02.626881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029c0df-69cf-4700-8749-0a2948b72187 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:02.627236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029c0df-69cf-4700-8749-0a2948b72187 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:02.627576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029c0df-69cf-4700-8749-0a2948b72187 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:02.628442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029c0df-69cf-4700-8749-0a2948b72187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:02.630446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029c0df-69cf-4700-8749-0a2948b72187 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:02.673677 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2392/4808] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:02 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:02.674779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029c0df-69cf-4700-8749-0a2948b72187 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:02.723710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e60384569db4c928175b67f41488b88', 'request_id': 'req-8fdbfe4a-e5fa-4256-b946-97c9b675369e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:02.733671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:02.737609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e60384569db4c928175b67f41488b88', 'request_id': 'req-8fdbfe4a-e5fa-4256-b946-97c9b675369e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:02.751219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e60384569db4c928175b67f41488b88', 'request_id': 'req-8fdbfe4a-e5fa-4256-b946-97c9b675369e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:02.758244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029c0df-69cf-4700-8749-0a2948b72187 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:02.760268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:02.768273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] The token cache is being invalidate because project 7e60384569db4c928175b67f41488b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:02.768761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:02.769566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:02.779787 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2417/4809] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:02 2022] DELETE /identity/v3/projects/7e60384569db4c928175b67f41488b88 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:02.781272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:02.783723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:02.870898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab1350-c20b-403e-93b9-a56a42b73634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:02.871523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab1350-c20b-403e-93b9-a56a42b73634 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:02.871800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab1350-c20b-403e-93b9-a56a42b73634 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:02.872071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab1350-c20b-403e-93b9-a56a42b73634 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:02.874659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab1350-c20b-403e-93b9-a56a42b73634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:02.878797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab1350-c20b-403e-93b9-a56a42b73634 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:02.942782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbfe4a-e5fa-4256-b946-97c9b675369e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:02.943033 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2393/4810] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:02 2022] POST /identity/v3/users => generated 296 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:02.944808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab1350-c20b-403e-93b9-a56a42b73634 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:02.947422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-13ab1350-c20b-403e-93b9-a56a42b73634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:02.959042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:02.961408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:02.962297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:02.962927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] PATH_INFO: `/v3/users/cdc3922b768a49c6886915e1d0d816d2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:02.964413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab1350-c20b-403e-93b9-a56a42b73634 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:02.964759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc3922b768a49c6886915e1d0d816d2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:02.966962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:02.969662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071abb9f-5460-4304-8447-238cf72d3fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:02.970263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071abb9f-5460-4304-8447-238cf72d3fce admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:02.970716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071abb9f-5460-4304-8447-238cf72d3fce admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:02.970998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071abb9f-5460-4304-8447-238cf72d3fce admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:02.971641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071abb9f-5460-4304-8447-238cf72d3fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:02.973331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071abb9f-5460-4304-8447-238cf72d3fce admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:03.005369 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2394/4811] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:03.006492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071abb9f-5460-4304-8447-238cf72d3fce admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:03.017982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071abb9f-5460-4304-8447-238cf72d3fce admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:03.037518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30344f-662b-460c-931b-878021e1b79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:03.037518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30344f-662b-460c-931b-878021e1b79f admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:03.037518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30344f-662b-460c-931b-878021e1b79f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:03.037518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30344f-662b-460c-931b-878021e1b79f admin admin] PATH_INFO: `/v3/projects/98a5b367f66344fda800788354943e7b/users/f0d9fa079b0142c0ab04d149c73aa5ed/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:03.062648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30344f-662b-460c-931b-878021e1b79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a5b367f66344fda800788354943e7b, user_id=f0d9fa079b0142c0ab04d149c73aa5ed, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:03.066107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30344f-662b-460c-931b-878021e1b79f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:03.090791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc3922b768a49c6886915e1d0d816d2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:03.094580 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2395/4812] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:03 2022] PUT /identity/v3/projects/98a5b367f66344fda800788354943e7b/users/f0d9fa079b0142c0ab04d149c73aa5ed/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:03.095566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30344f-662b-460c-931b-878021e1b79f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:03.108351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc3922b768a49c6886915e1d0d816d2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:03.111894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc3922b768a49c6886915e1d0d816d2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:03.111894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc3922b768a49c6886915e1d0d816d2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:03.141431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc3922b768a49c6886915e1d0d816d2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:03.168521 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2418/4813] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:02 2022] DELETE /identity/v3/users/cdc3922b768a49c6886915e1d0d816d2 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:03.304502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30344f-662b-460c-931b-878021e1b79f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:03.380960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:03.398492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba70fd2-d9b6-4ddd-834a-13fc01aba101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:03.399228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba70fd2-d9b6-4ddd-834a-13fc01aba101 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:03.400466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba70fd2-d9b6-4ddd-834a-13fc01aba101 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:03.400813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba70fd2-d9b6-4ddd-834a-13fc01aba101 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:03.401688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba70fd2-d9b6-4ddd-834a-13fc01aba101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:03.406631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba70fd2-d9b6-4ddd-834a-13fc01aba101 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:03.433619 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2396/4814] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:03.438554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:03.440095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:03.467293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2c804-70df-491a-bca5-770b1971b107 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:03.474402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bdc1f-ff70-47e9-87f3-819330243f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:03.475534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bdc1f-ff70-47e9-87f3-819330243f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:03.475817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bdc1f-ff70-47e9-87f3-819330243f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:03.476094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bdc1f-ff70-47e9-87f3-819330243f03 admin admin] PATH_INFO: `/v3/projects/98a5b367f66344fda800788354943e7b/users/f0d9fa079b0142c0ab04d149c73aa5ed/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:03.478359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bdc1f-ff70-47e9-87f3-819330243f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a5b367f66344fda800788354943e7b, user_id=f0d9fa079b0142c0ab04d149c73aa5ed, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:03.483196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bdc1f-ff70-47e9-87f3-819330243f03 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:03.527925 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2419/4815] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:03 2022] PUT /identity/v3/projects/98a5b367f66344fda800788354943e7b/users/f0d9fa079b0142c0ab04d149c73aa5ed/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:03.528242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d7aad-e6c0-4c48-81cd-466a95407762 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:03.528705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d7aad-e6c0-4c48-81cd-466a95407762 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:03.529000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d7aad-e6c0-4c48-81cd-466a95407762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:03.610527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-873d7aad-e6c0-4c48-81cd-466a95407762 None None] MFA Rules not processed for user `f0d9fa079b0142c0ab04d149c73aa5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:03.612749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-873d7aad-e6c0-4c48-81cd-466a95407762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:03.799337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bdc1f-ff70-47e9-87f3-819330243f03 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:03.801114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-362bdc1f-ff70-47e9-87f3-819330243f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:03.826175 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2397/4816] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:03.848703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d7aad-e6c0-4c48-81cd-466a95407762 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:03.853911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-873d7aad-e6c0-4c48-81cd-466a95407762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:03.935114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bdc1f-ff70-47e9-87f3-819330243f03 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:03.947137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501f723-a85a-4717-8a0e-43c0c7f472e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:03.949727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501f723-a85a-4717-8a0e-43c0c7f472e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:03.950414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501f723-a85a-4717-8a0e-43c0c7f472e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:03.950827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501f723-a85a-4717-8a0e-43c0c7f472e6 admin admin] PATH_INFO: `/v3/projects/be77f5af691f4cc3b0766978307d7463` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:03.952878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501f723-a85a-4717-8a0e-43c0c7f472e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be77f5af691f4cc3b0766978307d7463)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:03.977077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501f723-a85a-4717-8a0e-43c0c7f472e6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:03.994949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:04.100836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d7aad-e6c0-4c48-81cd-466a95407762 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:04.117282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7501f723-a85a-4717-8a0e-43c0c7f472e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be77f5af691f4cc3b0766978307d7463', 'request_id': 'req-7501f723-a85a-4717-8a0e-43c0c7f472e6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:04.138843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7501f723-a85a-4717-8a0e-43c0c7f472e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be77f5af691f4cc3b0766978307d7463', 'request_id': 'req-7501f723-a85a-4717-8a0e-43c0c7f472e6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:04.157744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7501f723-a85a-4717-8a0e-43c0c7f472e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be77f5af691f4cc3b0766978307d7463', 'request_id': 'req-7501f723-a85a-4717-8a0e-43c0c7f472e6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:04.182637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7501f723-a85a-4717-8a0e-43c0c7f472e6 admin admin] The token cache is being invalidate because project be77f5af691f4cc3b0766978307d7463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:04.183406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7501f723-a85a-4717-8a0e-43c0c7f472e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:04.184901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7501f723-a85a-4717-8a0e-43c0c7f472e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:04.187335 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2420/4817] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:03 2022] DELETE /identity/v3/projects/be77f5af691f4cc3b0766978307d7463 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:04.196498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f28d-f9c4-48bd-a12f-931c8ee80635 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:04.198028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f28d-f9c4-48bd-a12f-931c8ee80635 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:04.200527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f28d-f9c4-48bd-a12f-931c8ee80635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:04.209504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a90b67-0823-4ea6-a79d-282464937b77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:04.211793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90b67-0823-4ea6-a79d-282464937b77 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:04.212860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90b67-0823-4ea6-a79d-282464937b77 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:04.213869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90b67-0823-4ea6-a79d-282464937b77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:04.219455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-34a90b67-0823-4ea6-a79d-282464937b77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:04.264747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4b67f28d-f9c4-48bd-a12f-931c8ee80635 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:04.269888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4b67f28d-f9c4-48bd-a12f-931c8ee80635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:04.328466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:04.389431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a90b67-0823-4ea6-a79d-282464937b77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:04.391719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a90b67-0823-4ea6-a79d-282464937b77 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:04.408481 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2421/4818] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:04.408787 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2398/4819] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:11:04.416718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec2230-57ca-43c5-a103-c80395bd8112 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:04.417102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec2230-57ca-43c5-a103-c80395bd8112 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:04.418183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec2230-57ca-43c5-a103-c80395bd8112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:04.471549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1bec2230-57ca-43c5-a103-c80395bd8112 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:04.472214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1bec2230-57ca-43c5-a103-c80395bd8112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:04.496213 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2422/4820] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:04.498452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a90b67-0823-4ea6-a79d-282464937b77 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:04.530723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a90b67-0823-4ea6-a79d-282464937b77 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:04.535711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a464f-a733-4dfe-a312-1308ee3f817c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:04.536321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a464f-a733-4dfe-a312-1308ee3f817c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:04.536603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a464f-a733-4dfe-a312-1308ee3f817c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:04.536891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a464f-a733-4dfe-a312-1308ee3f817c admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:04.537677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a464f-a733-4dfe-a312-1308ee3f817c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:04.537985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a464f-a733-4dfe-a312-1308ee3f817c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:04.539581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a464f-a733-4dfe-a312-1308ee3f817c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:04.582520 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2399/4821] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:04.586888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec2230-57ca-43c5-a103-c80395bd8112 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:04.601032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec2230-57ca-43c5-a103-c80395bd8112 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:04.615169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfddaf-0e06-4ad6-9b89-652df30faf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:04.618686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfddaf-0e06-4ad6-9b89-652df30faf5e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:04.619301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfddaf-0e06-4ad6-9b89-652df30faf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:04.619752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfddaf-0e06-4ad6-9b89-652df30faf5e admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:04.620845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfddaf-0e06-4ad6-9b89-652df30faf5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:04.626493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfddaf-0e06-4ad6-9b89-652df30faf5e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:04.649862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a464f-a733-4dfe-a312-1308ee3f817c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:04.652294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-670a464f-a733-4dfe-a312-1308ee3f817c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:04.680428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a464f-a733-4dfe-a312-1308ee3f817c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:04.685788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431b85a-c503-4ccd-9ec1-801bd71e9a1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:04.686454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431b85a-c503-4ccd-9ec1-801bd71e9a1e service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:04.686856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431b85a-c503-4ccd-9ec1-801bd71e9a1e service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:04.687307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431b85a-c503-4ccd-9ec1-801bd71e9a1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:04.690962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6431b85a-c503-4ccd-9ec1-801bd71e9a1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:04.699122 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2423/4822] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:04 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:04.704089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfddaf-0e06-4ad6-9b89-652df30faf5e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:04.865067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431b85a-c503-4ccd-9ec1-801bd71e9a1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:04.866601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431b85a-c503-4ccd-9ec1-801bd71e9a1e service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:04.876639 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2400/4823] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:11:04.888685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfddaf-0e06-4ad6-9b89-652df30faf5e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:04.904776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c01da-2e7d-4f3c-9fcf-545af929b877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:04.905429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c01da-2e7d-4f3c-9fcf-545af929b877 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:04.905705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c01da-2e7d-4f3c-9fcf-545af929b877 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:04.906262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c01da-2e7d-4f3c-9fcf-545af929b877 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:04.906899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c01da-2e7d-4f3c-9fcf-545af929b877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:04.908835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c01da-2e7d-4f3c-9fcf-545af929b877 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:04.935612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:04.968102 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2424/4824] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:04 2022] POST /identity/v3/users => generated 296 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:04.969051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431b85a-c503-4ccd-9ec1-801bd71e9a1e service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:04.995600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431b85a-c503-4ccd-9ec1-801bd71e9a1e service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:05.013973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3731f3f-24ad-4c27-b589-a7cd85a48c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:05.014724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3731f3f-24ad-4c27-b589-a7cd85a48c79 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:05.015227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3731f3f-24ad-4c27-b589-a7cd85a48c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:05.015858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3731f3f-24ad-4c27-b589-a7cd85a48c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:05.016731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3731f3f-24ad-4c27-b589-a7cd85a48c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:05.020951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3731f3f-24ad-4c27-b589-a7cd85a48c79 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:05.054045 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2401/4825] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:11:05.055190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c01da-2e7d-4f3c-9fcf-545af929b877 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:05.076111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c01da-2e7d-4f3c-9fcf-545af929b877 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:05.101984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93e2ba-5eb9-49ce-909d-0464e14a0467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:05.102611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93e2ba-5eb9-49ce-909d-0464e14a0467 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:05.102890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93e2ba-5eb9-49ce-909d-0464e14a0467 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:05.103155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93e2ba-5eb9-49ce-909d-0464e14a0467 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:05.103811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93e2ba-5eb9-49ce-909d-0464e14a0467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:05.111981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93e2ba-5eb9-49ce-909d-0464e14a0467 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:05.161260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3731f3f-24ad-4c27-b589-a7cd85a48c79 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:05.168443 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2425/4826] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:05.178284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3731f3f-24ad-4c27-b589-a7cd85a48c79 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:05.201412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4015cbb-3127-4bef-8cf3-e7df6ace7a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:05.201412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4015cbb-3127-4bef-8cf3-e7df6ace7a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:05.201412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4015cbb-3127-4bef-8cf3-e7df6ace7a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:05.201412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4015cbb-3127-4bef-8cf3-e7df6ace7a9d admin admin] PATH_INFO: `/v3/projects/5126710cffcb488f92e3915c9b332822/users/723fd065499a4b7696ab87ecb7643b5f/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:05.241804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4015cbb-3127-4bef-8cf3-e7df6ace7a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5126710cffcb488f92e3915c9b332822, user_id=723fd065499a4b7696ab87ecb7643b5f, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:05.249795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4015cbb-3127-4bef-8cf3-e7df6ace7a9d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:05.280680 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2402/4827] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:05 2022] PUT /identity/v3/projects/5126710cffcb488f92e3915c9b332822/users/723fd065499a4b7696ab87ecb7643b5f/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:05.385268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734d608-b461-4046-9d12-afc8930c8649 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:05.385584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734d608-b461-4046-9d12-afc8930c8649 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:05.385929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734d608-b461-4046-9d12-afc8930c8649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:05.426041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9734d608-b461-4046-9d12-afc8930c8649 None None] MFA Rules not processed for user `723fd065499a4b7696ab87ecb7643b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:05.428318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9734d608-b461-4046-9d12-afc8930c8649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:05.536341 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2426/4828] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:05.543231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4015cbb-3127-4bef-8cf3-e7df6ace7a9d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:05.659262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4015cbb-3127-4bef-8cf3-e7df6ace7a9d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:05.670496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ee3af-fb86-4099-bea8-25167c989e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:05.671123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ee3af-fb86-4099-bea8-25167c989e26 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:05.671461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ee3af-fb86-4099-bea8-25167c989e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:05.671741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ee3af-fb86-4099-bea8-25167c989e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:05.672392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ee3af-fb86-4099-bea8-25167c989e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:05.674448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ee3af-fb86-4099-bea8-25167c989e26 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:05.723525 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2403/4829] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:05 2022] POST /identity/v3/projects => generated 391 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:05.729122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734d608-b461-4046-9d12-afc8930c8649 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:05.741446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734d608-b461-4046-9d12-afc8930c8649 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:05.854654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91aaf07-0558-4a69-90e7-f2f74f8f8116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:05.855951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91aaf07-0558-4a69-90e7-f2f74f8f8116 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:05.856973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91aaf07-0558-4a69-90e7-f2f74f8f8116 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:05.857406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91aaf07-0558-4a69-90e7-f2f74f8f8116 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:05.858316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91aaf07-0558-4a69-90e7-f2f74f8f8116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:05.861810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91aaf07-0558-4a69-90e7-f2f74f8f8116 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:05.902064 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2427/4830] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:05 2022] POST /identity/v3/users => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:05.905760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ee3af-fb86-4099-bea8-25167c989e26 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:05.928942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ee3af-fb86-4099-bea8-25167c989e26 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:05.948190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb071a-bde5-4cad-bae7-25d6a4d1042d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:05.949471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb071a-bde5-4cad-bae7-25d6a4d1042d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:05.951087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb071a-bde5-4cad-bae7-25d6a4d1042d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:05.951475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb071a-bde5-4cad-bae7-25d6a4d1042d admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:05.952654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb071a-bde5-4cad-bae7-25d6a4d1042d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:05.956725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb071a-bde5-4cad-bae7-25d6a4d1042d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:05.963605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:05.983774 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2404/4831] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:05.987938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91aaf07-0558-4a69-90e7-f2f74f8f8116 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:06.005456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91aaf07-0558-4a69-90e7-f2f74f8f8116 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:06.019909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765acea-edf2-4d9f-bed0-88d7570873c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:06.022377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765acea-edf2-4d9f-bed0-88d7570873c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:06.022836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765acea-edf2-4d9f-bed0-88d7570873c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:06.023273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765acea-edf2-4d9f-bed0-88d7570873c8 admin admin] PATH_INFO: `/v3/projects/c16d7821fb5e45968803bbc5bd604037/users/c66f4dcf9d44426d916b5c7f5bd21899/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:06.078344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765acea-edf2-4d9f-bed0-88d7570873c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16d7821fb5e45968803bbc5bd604037, user_id=c66f4dcf9d44426d916b5c7f5bd21899, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:06.088079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765acea-edf2-4d9f-bed0-88d7570873c8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:06.124772 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2428/4832] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:05 2022] PUT /identity/v3/projects/c16d7821fb5e45968803bbc5bd604037/users/c66f4dcf9d44426d916b5c7f5bd21899/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:06.128810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb071a-bde5-4cad-bae7-25d6a4d1042d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:06.144493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb071a-bde5-4cad-bae7-25d6a4d1042d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:06.269932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324eab32-43e5-4338-9838-2b5c6a68582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:06.272775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324eab32-43e5-4338-9838-2b5c6a68582a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:06.272775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324eab32-43e5-4338-9838-2b5c6a68582a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:06.273062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324eab32-43e5-4338-9838-2b5c6a68582a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:06.275274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324eab32-43e5-4338-9838-2b5c6a68582a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:06.276924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324eab32-43e5-4338-9838-2b5c6a68582a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:06.306247 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2405/4833] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:06.312749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765acea-edf2-4d9f-bed0-88d7570873c8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:06.340716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765acea-edf2-4d9f-bed0-88d7570873c8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:06.350693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff0374-e375-4bcf-ac56-d4f822ee9707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:06.352094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0374-e375-4bcf-ac56-d4f822ee9707 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:06.352094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0374-e375-4bcf-ac56-d4f822ee9707 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:06.352094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0374-e375-4bcf-ac56-d4f822ee9707 admin admin] PATH_INFO: `/v3/projects/c16d7821fb5e45968803bbc5bd604037/users/c66f4dcf9d44426d916b5c7f5bd21899/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:06.356595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff0374-e375-4bcf-ac56-d4f822ee9707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16d7821fb5e45968803bbc5bd604037, user_id=c66f4dcf9d44426d916b5c7f5bd21899, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:06.361741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff0374-e375-4bcf-ac56-d4f822ee9707 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:06.409646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77617327-6602-40e3-9a3a-3fadaa5e9290 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:06.409646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77617327-6602-40e3-9a3a-3fadaa5e9290 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:06.409646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77617327-6602-40e3-9a3a-3fadaa5e9290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:06.437143 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2429/4834] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:06 2022] PUT /identity/v3/projects/c16d7821fb5e45968803bbc5bd604037/users/c66f4dcf9d44426d916b5c7f5bd21899/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:06.473107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-77617327-6602-40e3-9a3a-3fadaa5e9290 None None] MFA Rules not processed for user `c66f4dcf9d44426d916b5c7f5bd21899`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:06.474451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-77617327-6602-40e3-9a3a-3fadaa5e9290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:06.694810 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2406/4835] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:06.695414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff0374-e375-4bcf-ac56-d4f822ee9707 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:06.697477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-38ff0374-e375-4bcf-ac56-d4f822ee9707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:06.769417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:06.828777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff0374-e375-4bcf-ac56-d4f822ee9707 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:06.860295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4de58-81b3-475a-99d5-8679ea0480fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:06.861606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4de58-81b3-475a-99d5-8679ea0480fa service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:06.862700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4de58-81b3-475a-99d5-8679ea0480fa service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:06.862986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4de58-81b3-475a-99d5-8679ea0480fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:07.050801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4de58-81b3-475a-99d5-8679ea0480fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:07.053271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4de58-81b3-475a-99d5-8679ea0480fa service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:07.081812 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2430/4836] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:08.540726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77617327-6602-40e3-9a3a-3fadaa5e9290 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:08.543253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-77617327-6602-40e3-9a3a-3fadaa5e9290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:08.731569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77617327-6602-40e3-9a3a-3fadaa5e9290 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:08.753947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:08.755248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:08.758860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:08.760017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] PATH_INFO: `/v3/users/7b0248890c8c4da9a1c3d08bcd5742ad` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:08.767345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0248890c8c4da9a1c3d08bcd5742ad)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:08.776292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:08.820920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:08.890222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0248890c8c4da9a1c3d08bcd5742ad'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:08.908613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0248890c8c4da9a1c3d08bcd5742ad'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:08.911020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0248890c8c4da9a1c3d08bcd5742ad'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:08.913155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0248890c8c4da9a1c3d08bcd5742ad'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:08.958948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0248890c8c4da9a1c3d08bcd5742ad'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:09.005644 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2407/4837] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:08 2022] DELETE /identity/v3/users/7b0248890c8c4da9a1c3d08bcd5742ad => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:09.008188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcc16d-b928-4085-a647-f54a23010c41 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:09.008718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcc16d-b928-4085-a647-f54a23010c41 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:09.008802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcc16d-b928-4085-a647-f54a23010c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:09.063515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6bdcc16d-b928-4085-a647-f54a23010c41 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:09.066064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6bdcc16d-b928-4085-a647-f54a23010c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:09.250133 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2431/4838] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:09.263941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:09.265540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:09.388411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aab59c-8a7a-4e88-acaa-50c648b0be09 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:09.392618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62bbed-beef-48cd-9c08-555723a08913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:09.393552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62bbed-beef-48cd-9c08-555723a08913 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:09.394150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62bbed-beef-48cd-9c08-555723a08913 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:09.394277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62bbed-beef-48cd-9c08-555723a08913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:09.408679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62bbed-beef-48cd-9c08-555723a08913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:09.411192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62bbed-beef-48cd-9c08-555723a08913 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:09.425910 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2408/4839] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:10.016217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcc16d-b928-4085-a647-f54a23010c41 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:10.019242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6bdcc16d-b928-4085-a647-f54a23010c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:10.051647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcc16d-b928-4085-a647-f54a23010c41 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:10.066571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:10.067665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:10.068287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:10.070273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d admin admin] PATH_INFO: `/v3/projects/c56b9280162d4a6b9bac0cc641147a24` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:10.072514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56b9280162d4a6b9bac0cc641147a24)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:10.074974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:10.244664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56b9280162d4a6b9bac0cc641147a24', 'request_id': 'req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:10.258478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56b9280162d4a6b9bac0cc641147a24', 'request_id': 'req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:10.268597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56b9280162d4a6b9bac0cc641147a24', 'request_id': 'req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:10.289766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d admin admin] The token cache is being invalidate because project c56b9280162d4a6b9bac0cc641147a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:10.290451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:10.291769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff6cfc79-bab9-4cff-ba03-367f5f598f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:10.294267 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2432/4840] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:10 2022] DELETE /identity/v3/projects/c56b9280162d4a6b9bac0cc641147a24 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:10.300352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44e80-eedc-44fa-8d6f-1234afd08430 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:10.300895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44e80-eedc-44fa-8d6f-1234afd08430 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:10.301005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44e80-eedc-44fa-8d6f-1234afd08430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:10.327827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-00b44e80-eedc-44fa-8d6f-1234afd08430 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:10.329137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-00b44e80-eedc-44fa-8d6f-1234afd08430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:10.449799 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2409/4841] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:10.458546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9d3bb-3251-46ba-bf30-83ee85d01bee None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:10.459327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9d3bb-3251-46ba-bf30-83ee85d01bee None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:10.460366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9d3bb-3251-46ba-bf30-83ee85d01bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:10.501507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:10.546402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-83f9d3bb-3251-46ba-bf30-83ee85d01bee None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:10.548045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-83f9d3bb-3251-46ba-bf30-83ee85d01bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:10.575657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b44e80-eedc-44fa-8d6f-1234afd08430 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:10.593474 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2433/4842] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:10.596129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b44e80-eedc-44fa-8d6f-1234afd08430 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:10.630602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54242318-7dc1-4d33-b58e-824284c588c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:10.631860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54242318-7dc1-4d33-b58e-824284c588c1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:10.637403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54242318-7dc1-4d33-b58e-824284c588c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:10.638471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54242318-7dc1-4d33-b58e-824284c588c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:10.641984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54242318-7dc1-4d33-b58e-824284c588c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:10.645118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54242318-7dc1-4d33-b58e-824284c588c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:10.650154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54242318-7dc1-4d33-b58e-824284c588c1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:10.711991 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2410/4843] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:10.714041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9d3bb-3251-46ba-bf30-83ee85d01bee None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:10.729090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9d3bb-3251-46ba-bf30-83ee85d01bee None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:10.751092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8839c-ce02-4a74-b755-719e215ce8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:10.753933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8839c-ce02-4a74-b755-719e215ce8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:10.754509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8839c-ce02-4a74-b755-719e215ce8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:10.755448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8839c-ce02-4a74-b755-719e215ce8c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:10.758534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8839c-ce02-4a74-b755-719e215ce8c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:10.763425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8839c-ce02-4a74-b755-719e215ce8c0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:10.818217 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2434/4844] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:10 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:10.820120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54242318-7dc1-4d33-b58e-824284c588c1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:10.833706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54242318-7dc1-4d33-b58e-824284c588c1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:10.919922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:11.020857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e664d-6713-42d3-acaf-3f7bd0b1d873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:11.021964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e664d-6713-42d3-acaf-3f7bd0b1d873 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:11.021964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e664d-6713-42d3-acaf-3f7bd0b1d873 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:11.022270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e664d-6713-42d3-acaf-3f7bd0b1d873 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:11.022725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e664d-6713-42d3-acaf-3f7bd0b1d873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:11.024750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e664d-6713-42d3-acaf-3f7bd0b1d873 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:11.105316 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2411/4845] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:10 2022] POST /identity/v3/users => generated 294 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:11.109614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8839c-ce02-4a74-b755-719e215ce8c0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:11.126192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8839c-ce02-4a74-b755-719e215ce8c0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:11.140881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fa4f7-9986-41b3-99a8-a230d86dd29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:11.141922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fa4f7-9986-41b3-99a8-a230d86dd29a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:11.142411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fa4f7-9986-41b3-99a8-a230d86dd29a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:11.143041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fa4f7-9986-41b3-99a8-a230d86dd29a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:11.143857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fa4f7-9986-41b3-99a8-a230d86dd29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:11.153825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fa4f7-9986-41b3-99a8-a230d86dd29a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:11.168827 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2435/4846] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:11.172913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e664d-6713-42d3-acaf-3f7bd0b1d873 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:11.190140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e664d-6713-42d3-acaf-3f7bd0b1d873 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:11.197693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab5ac9-6f82-4182-88ea-9a037642809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:11.198318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab5ac9-6f82-4182-88ea-9a037642809b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:11.198603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab5ac9-6f82-4182-88ea-9a037642809b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:11.198877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab5ac9-6f82-4182-88ea-9a037642809b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:11.199594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab5ac9-6f82-4182-88ea-9a037642809b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:11.201220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab5ac9-6f82-4182-88ea-9a037642809b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:11.220094 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2412/4847] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:11.221111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fa4f7-9986-41b3-99a8-a230d86dd29a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:11.238150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fa4f7-9986-41b3-99a8-a230d86dd29a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:11.261229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95515f78-18a0-401e-ab34-aeda89212800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:11.261978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95515f78-18a0-401e-ab34-aeda89212800 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:11.262336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95515f78-18a0-401e-ab34-aeda89212800 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:11.262684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95515f78-18a0-401e-ab34-aeda89212800 admin admin] PATH_INFO: `/v3/projects/ac685667f2cd4d2a861c4f924a42e231/users/a4e5c13785ec4951a72c8cf1384515fe/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:11.311047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95515f78-18a0-401e-ab34-aeda89212800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac685667f2cd4d2a861c4f924a42e231, user_id=a4e5c13785ec4951a72c8cf1384515fe, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:11.317915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95515f78-18a0-401e-ab34-aeda89212800 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:11.355121 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2436/4848] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:11 2022] PUT /identity/v3/projects/ac685667f2cd4d2a861c4f924a42e231/users/a4e5c13785ec4951a72c8cf1384515fe/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:11.370522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175c384-14f4-4a09-94b2-5e8f101aa9f6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:11.371807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175c384-14f4-4a09-94b2-5e8f101aa9f6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:11.372561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175c384-14f4-4a09-94b2-5e8f101aa9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:11.470607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9175c384-14f4-4a09-94b2-5e8f101aa9f6 None None] MFA Rules not processed for user `a4e5c13785ec4951a72c8cf1384515fe`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:11.482303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9175c384-14f4-4a09-94b2-5e8f101aa9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:11.733643 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2413/4849] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:11.740355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95515f78-18a0-401e-ab34-aeda89212800 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:11.926320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95515f78-18a0-401e-ab34-aeda89212800 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:11.955520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c75a9-0e6a-4707-8e79-5edcb1fc372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:11.959244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c75a9-0e6a-4707-8e79-5edcb1fc372a admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:11.964057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c75a9-0e6a-4707-8e79-5edcb1fc372a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:11.964349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c75a9-0e6a-4707-8e79-5edcb1fc372a admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:11.970368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c75a9-0e6a-4707-8e79-5edcb1fc372a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:11.979169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c75a9-0e6a-4707-8e79-5edcb1fc372a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:12.069156 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2437/4850] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:11 2022] POST /identity/v3/projects => generated 387 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:12.070507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175c384-14f4-4a09-94b2-5e8f101aa9f6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:12.090518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175c384-14f4-4a09-94b2-5e8f101aa9f6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:12.281697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd46b58-b8f5-4f49-b540-c045bb2020b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:12.282343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd46b58-b8f5-4f49-b540-c045bb2020b9 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:12.282643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd46b58-b8f5-4f49-b540-c045bb2020b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:12.282882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd46b58-b8f5-4f49-b540-c045bb2020b9 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:12.283594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd46b58-b8f5-4f49-b540-c045bb2020b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:12.285640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd46b58-b8f5-4f49-b540-c045bb2020b9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:12.339400 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2414/4851] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:12 2022] POST /identity/v3/users => generated 300 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:12.344585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c75a9-0e6a-4707-8e79-5edcb1fc372a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:12.364285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c75a9-0e6a-4707-8e79-5edcb1fc372a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:12.395072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3a4f5-80a8-4703-94ed-a3ef7a098e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:12.395072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3a4f5-80a8-4703-94ed-a3ef7a098e0e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:12.399706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3a4f5-80a8-4703-94ed-a3ef7a098e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:12.403636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3a4f5-80a8-4703-94ed-a3ef7a098e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:12.404450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3a4f5-80a8-4703-94ed-a3ef7a098e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:12.406144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3a4f5-80a8-4703-94ed-a3ef7a098e0e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:12.481669 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2438/4852] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:12.484211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd46b58-b8f5-4f49-b540-c045bb2020b9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:12.511662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd46b58-b8f5-4f49-b540-c045bb2020b9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:12.525394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852e59e-5d63-46c5-8b1e-a84d0066d2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:12.526099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852e59e-5d63-46c5-8b1e-a84d0066d2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:12.526411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852e59e-5d63-46c5-8b1e-a84d0066d2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:12.526690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852e59e-5d63-46c5-8b1e-a84d0066d2a9 admin admin] PATH_INFO: `/v3/projects/cc98e8f1830c4edbb8f30591729fe668/users/773a2f540026405c84b4ca4ca0de3a98/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:12.569771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852e59e-5d63-46c5-8b1e-a84d0066d2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc98e8f1830c4edbb8f30591729fe668, user_id=773a2f540026405c84b4ca4ca0de3a98, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:12.573024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852e59e-5d63-46c5-8b1e-a84d0066d2a9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:12.605423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:12.621006 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2415/4853] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:12 2022] PUT /identity/v3/projects/cc98e8f1830c4edbb8f30591729fe668/users/773a2f540026405c84b4ca4ca0de3a98/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:12.625533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3a4f5-80a8-4703-94ed-a3ef7a098e0e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:12.659296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3a4f5-80a8-4703-94ed-a3ef7a098e0e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:12.795706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c6433-ebf0-4c34-ba81-a0e90c32a067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:12.796664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6433-ebf0-4c34-ba81-a0e90c32a067 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:12.797206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6433-ebf0-4c34-ba81-a0e90c32a067 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:12.797735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6433-ebf0-4c34-ba81-a0e90c32a067 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:12.798646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c6433-ebf0-4c34-ba81-a0e90c32a067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:12.800703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c6433-ebf0-4c34-ba81-a0e90c32a067 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:12.819410 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2439/4854] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:12.820744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852e59e-5d63-46c5-8b1e-a84d0066d2a9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:12.836262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852e59e-5d63-46c5-8b1e-a84d0066d2a9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:12.855018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44876ff5-7dd3-48ea-a024-b95ab6c38ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:12.855707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44876ff5-7dd3-48ea-a024-b95ab6c38ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:12.855992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44876ff5-7dd3-48ea-a024-b95ab6c38ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:12.857149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44876ff5-7dd3-48ea-a024-b95ab6c38ba4 admin admin] PATH_INFO: `/v3/projects/cc98e8f1830c4edbb8f30591729fe668/users/773a2f540026405c84b4ca4ca0de3a98/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:12.864361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44876ff5-7dd3-48ea-a024-b95ab6c38ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc98e8f1830c4edbb8f30591729fe668, user_id=773a2f540026405c84b4ca4ca0de3a98, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:12.868879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44876ff5-7dd3-48ea-a024-b95ab6c38ba4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:12.893919 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2416/4855] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:12 2022] PUT /identity/v3/projects/cc98e8f1830c4edbb8f30591729fe668/users/773a2f540026405c84b4ca4ca0de3a98/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:12.904572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82476f-b5f5-40cc-beeb-36e364cab0da None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:12.904898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82476f-b5f5-40cc-beeb-36e364cab0da None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:12.905213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82476f-b5f5-40cc-beeb-36e364cab0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:12.946028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:12.965951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2f82476f-b5f5-40cc-beeb-36e364cab0da None None] MFA Rules not processed for user `773a2f540026405c84b4ca4ca0de3a98`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:12.967592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2f82476f-b5f5-40cc-beeb-36e364cab0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:12.981133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44876ff5-7dd3-48ea-a024-b95ab6c38ba4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:12.982960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-44876ff5-7dd3-48ea-a024-b95ab6c38ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:13.133064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44876ff5-7dd3-48ea-a024-b95ab6c38ba4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:13.137747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395a711-0c90-429a-8126-4f198f4d2e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:13.138448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395a711-0c90-429a-8126-4f198f4d2e6f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:13.138808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395a711-0c90-429a-8126-4f198f4d2e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:13.139157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395a711-0c90-429a-8126-4f198f4d2e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:13.141413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9395a711-0c90-429a-8126-4f198f4d2e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:13.172429 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2440/4856] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:13.173745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82476f-b5f5-40cc-beeb-36e364cab0da None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:13.202975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82476f-b5f5-40cc-beeb-36e364cab0da None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:13.215315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34c1e9-3863-4806-8f22-5d2a5a2d92ec tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a2f540026405c84b4ca4ca0de3a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc98e8f1830c4edbb8f30591729fe668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:13.216784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34c1e9-3863-4806-8f22-5d2a5a2d92ec tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:13.218138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34c1e9-3863-4806-8f22-5d2a5a2d92ec tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:13.218138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34c1e9-3863-4806-8f22-5d2a5a2d92ec tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] PATH_INFO: `/v3/projects/ac685667f2cd4d2a861c4f924a42e231` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:13.221216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34c1e9-3863-4806-8f22-5d2a5a2d92ec tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorizing `identity:get_project(project_id=ac685667f2cd4d2a861c4f924a42e231)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:13.228419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34c1e9-3863-4806-8f22-5d2a5a2d92ec tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:13.232539 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2441/4857] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:11:13 2022] GET /identity/v3/projects/ac685667f2cd4d2a861c4f924a42e231 => generated 387 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:13.237838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34c1e9-3863-4806-8f22-5d2a5a2d92ec tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:13.260505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34c1e9-3863-4806-8f22-5d2a5a2d92ec tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:13.275023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b007c-0edf-474a-9eb1-f97961ef54e4 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a2f540026405c84b4ca4ca0de3a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc98e8f1830c4edbb8f30591729fe668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:13.276048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b007c-0edf-474a-9eb1-f97961ef54e4 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:13.276389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b007c-0edf-474a-9eb1-f97961ef54e4 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:13.276673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b007c-0edf-474a-9eb1-f97961ef54e4 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:13.279041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b007c-0edf-474a-9eb1-f97961ef54e4 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:13.282763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b007c-0edf-474a-9eb1-f97961ef54e4 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:13.324376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395a711-0c90-429a-8126-4f198f4d2e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:13.326366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395a711-0c90-429a-8126-4f198f4d2e6f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:13.347034 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2417/4858] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:11:13.348244 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2442/4859] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:11:13 2022] POST /identity/v3/projects => generated 339 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:13.357537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b007c-0edf-474a-9eb1-f97961ef54e4 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:13.562571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b007c-0edf-474a-9eb1-f97961ef54e4 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:13.608464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659e164-7a96-436a-96bb-fe143217e785 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a2f540026405c84b4ca4ca0de3a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc98e8f1830c4edbb8f30591729fe668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:13.612518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659e164-7a96-436a-96bb-fe143217e785 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:13.612879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659e164-7a96-436a-96bb-fe143217e785 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:13.613125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659e164-7a96-436a-96bb-fe143217e785 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:13.617176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659e164-7a96-436a-96bb-fe143217e785 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:13.625233 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-6659e164-7a96-436a-96bb-fe143217e785 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:11:13.625233 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:11:13.625233 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:11:13.632117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659e164-7a96-436a-96bb-fe143217e785 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:13.715086 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2443/4860] 10.222.0.26 () {58 vars in 1131 bytes} [Sat Oct 8 21:11:13 2022] GET /identity/v3/projects => generated 7322 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:13.717365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395a711-0c90-429a-8126-4f198f4d2e6f service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:13.735773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395a711-0c90-429a-8126-4f198f4d2e6f service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:13.749696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4c267-adff-45e7-a6c8-0a33238deeb3 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a2f540026405c84b4ca4ca0de3a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc98e8f1830c4edbb8f30591729fe668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:13.750364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4c267-adff-45e7-a6c8-0a33238deeb3 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:13.750649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4c267-adff-45e7-a6c8-0a33238deeb3 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:13.750924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4c267-adff-45e7-a6c8-0a33238deeb3 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] PATH_INFO: `/v3/projects/ac685667f2cd4d2a861c4f924a42e231` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:13.755426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4c267-adff-45e7-a6c8-0a33238deeb3 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorizing `identity:get_project(project_id=ac685667f2cd4d2a861c4f924a42e231)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:13.758036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4c267-adff-45e7-a6c8-0a33238deeb3 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:13.765274 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2418/4861] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:11:13 2022] GET /identity/v3/projects/ac685667f2cd4d2a861c4f924a42e231 => generated 387 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:13.767710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659e164-7a96-436a-96bb-fe143217e785 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:13.784930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659e164-7a96-436a-96bb-fe143217e785 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:13.794005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ef03a-523d-434d-a5be-c3cad1a50c7d tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a2f540026405c84b4ca4ca0de3a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc98e8f1830c4edbb8f30591729fe668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:13.794764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ef03a-523d-434d-a5be-c3cad1a50c7d tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:13.795050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ef03a-523d-434d-a5be-c3cad1a50c7d tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:13.795411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ef03a-523d-434d-a5be-c3cad1a50c7d tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] PATH_INFO: `/v3/projects/22d47789c71a4af7b8c60954736638bc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:13.797597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ef03a-523d-434d-a5be-c3cad1a50c7d tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorizing `identity:get_project(project_id=22d47789c71a4af7b8c60954736638bc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:13.800202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ef03a-523d-434d-a5be-c3cad1a50c7d tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:13.808597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4c267-adff-45e7-a6c8-0a33238deeb3 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:13.826805 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2444/4862] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:11:13 2022] GET /identity/v3/projects/22d47789c71a4af7b8c60954736638bc => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:13.828010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4c267-adff-45e7-a6c8-0a33238deeb3 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:13.840967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a5ca2-a5ee-422a-be2e-513a2b11f069 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a2f540026405c84b4ca4ca0de3a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc98e8f1830c4edbb8f30591729fe668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:13.844710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a5ca2-a5ee-422a-be2e-513a2b11f069 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:13.845009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a5ca2-a5ee-422a-be2e-513a2b11f069 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:13.848964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a5ca2-a5ee-422a-be2e-513a2b11f069 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:13.851787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a5ca2-a5ee-422a-be2e-513a2b11f069 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:13.857232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a5ca2-a5ee-422a-be2e-513a2b11f069 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:13.938536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ef03a-523d-434d-a5be-c3cad1a50c7d tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:13.963662 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2419/4863] 10.222.0.26 () {58 vars in 1131 bytes} [Sat Oct 8 21:11:13 2022] GET /identity/v3/projects => generated 7322 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:13.981147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ef03a-523d-434d-a5be-c3cad1a50c7d tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:14.011974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162a7d8-1f0f-47d0-b3b2-2abd88dda854 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a2f540026405c84b4ca4ca0de3a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc98e8f1830c4edbb8f30591729fe668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:14.015398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162a7d8-1f0f-47d0-b3b2-2abd88dda854 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:14.016885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162a7d8-1f0f-47d0-b3b2-2abd88dda854 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:14.017434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162a7d8-1f0f-47d0-b3b2-2abd88dda854 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:14.021416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162a7d8-1f0f-47d0-b3b2-2abd88dda854 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:14.025648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162a7d8-1f0f-47d0-b3b2-2abd88dda854 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:14.036063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162a7d8-1f0f-47d0-b3b2-2abd88dda854 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:14.126666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a5ca2-a5ee-422a-be2e-513a2b11f069 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:14.137330 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2445/4864] 10.222.0.26 () {58 vars in 1166 bytes} [Sat Oct 8 21:11:13 2022] GET /identity/v3/projects?domain_id=default => generated 6991 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:14.140094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a5ca2-a5ee-422a-be2e-513a2b11f069 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:14.151737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c973b-901d-4bb4-8122-18d9d6b86107 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a2f540026405c84b4ca4ca0de3a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc98e8f1830c4edbb8f30591729fe668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:14.152387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c973b-901d-4bb4-8122-18d9d6b86107 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:14.152678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c973b-901d-4bb4-8122-18d9d6b86107 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:14.152963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c973b-901d-4bb4-8122-18d9d6b86107 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:14.154451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c973b-901d-4bb4-8122-18d9d6b86107 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:14.157062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c973b-901d-4bb4-8122-18d9d6b86107 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:14.194100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162a7d8-1f0f-47d0-b3b2-2abd88dda854 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:14.215687 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2420/4865] 10.222.0.26 () {58 vars in 1131 bytes} [Sat Oct 8 21:11:14 2022] GET /identity/v3/projects => generated 7322 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:14.216819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162a7d8-1f0f-47d0-b3b2-2abd88dda854 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:14.223308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a530-be2e-4863-a361-91bc75d96820 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a2f540026405c84b4ca4ca0de3a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc98e8f1830c4edbb8f30591729fe668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:14.224085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a530-be2e-4863-a361-91bc75d96820 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:14.224383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a530-be2e-4863-a361-91bc75d96820 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:14.226003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a530-be2e-4863-a361-91bc75d96820 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:14.226823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6a530-be2e-4863-a361-91bc75d96820 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:14.227394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6a530-be2e-4863-a361-91bc75d96820 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:14.230641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6a530-be2e-4863-a361-91bc75d96820 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:14.241297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c973b-901d-4bb4-8122-18d9d6b86107 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:14.242200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c74c973b-901d-4bb4-8122-18d9d6b86107 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:14.275083 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2446/4866] 10.222.0.26 () {58 vars in 1166 bytes} [Sat Oct 8 21:11:14 2022] GET /identity/v3/projects?domain_id=default => generated 6991 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:14.279567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a530-be2e-4863-a361-91bc75d96820 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:14.324221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a530-be2e-4863-a361-91bc75d96820 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:14.339700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ead8d5-aec1-4bf1-9eda-c21bf8f30320 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a2f540026405c84b4ca4ca0de3a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc98e8f1830c4edbb8f30591729fe668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:14.340437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ead8d5-aec1-4bf1-9eda-c21bf8f30320 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:14.340872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ead8d5-aec1-4bf1-9eda-c21bf8f30320 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:14.341153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ead8d5-aec1-4bf1-9eda-c21bf8f30320 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:14.343903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ead8d5-aec1-4bf1-9eda-c21bf8f30320 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:14.346482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ead8d5-aec1-4bf1-9eda-c21bf8f30320 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:14.419448 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2447/4867] 10.222.0.26 () {58 vars in 1131 bytes} [Sat Oct 8 21:11:14 2022] GET /identity/v3/projects => generated 7322 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:14.420065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c973b-901d-4bb4-8122-18d9d6b86107 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:14.420930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ead8d5-aec1-4bf1-9eda-c21bf8f30320 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:14.428978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452cebe-b6f7-4746-ad04-f4c779b6e6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:14.429805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452cebe-b6f7-4746-ad04-f4c779b6e6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:14.430099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452cebe-b6f7-4746-ad04-f4c779b6e6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:14.430369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452cebe-b6f7-4746-ad04-f4c779b6e6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:14.437665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1452cebe-b6f7-4746-ad04-f4c779b6e6f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:14.464575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ead8d5-aec1-4bf1-9eda-c21bf8f30320 tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:14.488690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c659f-8c73-4077-968f-8fa9bc6578ed tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a2f540026405c84b4ca4ca0de3a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc98e8f1830c4edbb8f30591729fe668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:14.489620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c659f-8c73-4077-968f-8fa9bc6578ed tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:14.490064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c659f-8c73-4077-968f-8fa9bc6578ed tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:14.491135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c659f-8c73-4077-968f-8fa9bc6578ed tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:14.492348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c659f-8c73-4077-968f-8fa9bc6578ed tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-652800824) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:14.492922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c659f-8c73-4077-968f-8fa9bc6578ed tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:14.495189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c659f-8c73-4077-968f-8fa9bc6578ed tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:14.524500 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2448/4868] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:11:14 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-652800824 => generated 534 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:14.529984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c659f-8c73-4077-968f-8fa9bc6578ed tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:14.542382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c659f-8c73-4077-968f-8fa9bc6578ed tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:14.548090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a2f540026405c84b4ca4ca0de3a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc98e8f1830c4edbb8f30591729fe668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:14.549011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:14.549556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:14.550029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] PATH_INFO: `/v3/projects/22d47789c71a4af7b8c60954736638bc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:14.551485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorizing `identity:delete_project(project_id=22d47789c71a4af7b8c60954736638bc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:14.554457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:14.555814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:14.556867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:14.667584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d47789c71a4af7b8c60954736638bc', 'request_id': 'req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:14.688969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452cebe-b6f7-4746-ad04-f4c779b6e6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:14.688969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452cebe-b6f7-4746-ad04-f4c779b6e6f6 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:14.711282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d47789c71a4af7b8c60954736638bc', 'request_id': 'req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:14.719009 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2421/4869] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:14 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:11:14.723934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d47789c71a4af7b8c60954736638bc', 'request_id': 'req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:14.755409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] The token cache is being invalidate because project 22d47789c71a4af7b8c60954736638bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:14.758553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:14.761160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-57a9a9fa-a21b-4fab-8347-7d7ddf281b9a tempest-ListProjectsStaticTestJSON-901120843 tempest-ListProjectsStaticTestJSON-901120843-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:14.764745 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2449/4870] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:14 2022] DELETE /identity/v3/projects/22d47789c71a4af7b8c60954736638bc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:14.768876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452cebe-b6f7-4746-ad04-f4c779b6e6f6 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:15.065575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452cebe-b6f7-4746-ad04-f4c779b6e6f6 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:15.187030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:15.188140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:15.188435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:15.188714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] PATH_INFO: `/v3/users/a4e5c13785ec4951a72c8cf1384515fe` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:15.190787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e5c13785ec4951a72c8cf1384515fe)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:15.194522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:15.380147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e5c13785ec4951a72c8cf1384515fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:15.398744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e5c13785ec4951a72c8cf1384515fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:15.401117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e5c13785ec4951a72c8cf1384515fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:15.403370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e5c13785ec4951a72c8cf1384515fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:15.422038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:15.443130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e5c13785ec4951a72c8cf1384515fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:15.487031 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2422/4871] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:14 2022] DELETE /identity/v3/users/a4e5c13785ec4951a72c8cf1384515fe => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:15.495049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7daa47-fc39-4ece-8b59-c0c494a90e11 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:15.496030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7daa47-fc39-4ece-8b59-c0c494a90e11 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:15.496511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7daa47-fc39-4ece-8b59-c0c494a90e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:15.586080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3d7daa47-fc39-4ece-8b59-c0c494a90e11 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:15.587317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d7daa47-fc39-4ece-8b59-c0c494a90e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:15.754574 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2450/4872] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:15.762995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:15.764049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:15.918288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b00e2-2d8b-4670-8037-f9cfc2b26fcd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:15.922242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac3b7a-3d0f-47a9-95fa-cecd774e613c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:15.923122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3b7a-3d0f-47a9-95fa-cecd774e613c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:15.923122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3b7a-3d0f-47a9-95fa-cecd774e613c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:15.923387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3b7a-3d0f-47a9-95fa-cecd774e613c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:15.935082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac3b7a-3d0f-47a9-95fa-cecd774e613c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:15.936545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac3b7a-3d0f-47a9-95fa-cecd774e613c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:15.949565 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2423/4873] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:16.772742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7daa47-fc39-4ece-8b59-c0c494a90e11 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:16.774450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d7daa47-fc39-4ece-8b59-c0c494a90e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:16.800930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7daa47-fc39-4ece-8b59-c0c494a90e11 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:16.800930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45851f40-d518-4b3c-9d14-3856437462a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:16.800930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45851f40-d518-4b3c-9d14-3856437462a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:16.800930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45851f40-d518-4b3c-9d14-3856437462a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:16.801587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45851f40-d518-4b3c-9d14-3856437462a1 admin admin] PATH_INFO: `/v3/users/63753501c8674e169cfde7c2457abf73` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:16.806986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45851f40-d518-4b3c-9d14-3856437462a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63753501c8674e169cfde7c2457abf73)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:16.806986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45851f40-d518-4b3c-9d14-3856437462a1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:16.879718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac3b7a-3d0f-47a9-95fa-cecd774e613c service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:16.883784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-95ac3b7a-3d0f-47a9-95fa-cecd774e613c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:16.906050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-45851f40-d518-4b3c-9d14-3856437462a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63753501c8674e169cfde7c2457abf73'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:16.909690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac3b7a-3d0f-47a9-95fa-cecd774e613c service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:16.918185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-45851f40-d518-4b3c-9d14-3856437462a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63753501c8674e169cfde7c2457abf73'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:16.920218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-45851f40-d518-4b3c-9d14-3856437462a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63753501c8674e169cfde7c2457abf73'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:16.921567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-45851f40-d518-4b3c-9d14-3856437462a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63753501c8674e169cfde7c2457abf73'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:16.934460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:16.935464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:16.935866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:16.936249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] PATH_INFO: `/v3/projects/ac685667f2cd4d2a861c4f924a42e231` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:16.938012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac685667f2cd4d2a861c4f924a42e231)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:16.938770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-45851f40-d518-4b3c-9d14-3856437462a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63753501c8674e169cfde7c2457abf73'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:16.941441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:16.972498 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2451/4874] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:16 2022] DELETE /identity/v3/users/63753501c8674e169cfde7c2457abf73 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:16.975337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543544d-13b9-4846-beee-a4e0727f230f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:16.975705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543544d-13b9-4846-beee-a4e0727f230f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:16.976155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543544d-13b9-4846-beee-a4e0727f230f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:16.985014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:17.013004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7543544d-13b9-4846-beee-a4e0727f230f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:17.015460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7543544d-13b9-4846-beee-a4e0727f230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:17.039685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac685667f2cd4d2a861c4f924a42e231', 'request_id': 'req-1305aecb-8a20-42a7-a2c3-605aace728b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:17.049625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac685667f2cd4d2a861c4f924a42e231', 'request_id': 'req-1305aecb-8a20-42a7-a2c3-605aace728b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:17.058013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac685667f2cd4d2a861c4f924a42e231', 'request_id': 'req-1305aecb-8a20-42a7-a2c3-605aace728b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:17.076959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] The token cache is being invalidate because project ac685667f2cd4d2a861c4f924a42e231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:17.077649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:17.078377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:17.087254 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2424/4875] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:16 2022] DELETE /identity/v3/projects/ac685667f2cd4d2a861c4f924a42e231 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:17.090963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:17.092708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:17.117320 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2452/4876] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:17.130842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543544d-13b9-4846-beee-a4e0727f230f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:17.134133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7543544d-13b9-4846-beee-a4e0727f230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:17.176955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305aecb-8a20-42a7-a2c3-605aace728b9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:17.183966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:17.185015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:17.185598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:17.186065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] PATH_INFO: `/v3/users/773a2f540026405c84b4ca4ca0de3a98` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:17.187456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] RBAC: Authorizing `identity:delete_user(user_id=773a2f540026405c84b4ca4ca0de3a98)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:17.190310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:17.204069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:17.217337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543544d-13b9-4846-beee-a4e0727f230f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:17.226934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cab68e-1974-45e8-bfc4-ce8e394f3f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:17.228296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab68e-1974-45e8-bfc4-ce8e394f3f89 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:17.229090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab68e-1974-45e8-bfc4-ce8e394f3f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:17.229693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab68e-1974-45e8-bfc4-ce8e394f3f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:17.255332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cab68e-1974-45e8-bfc4-ce8e394f3f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:17.258055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cab68e-1974-45e8-bfc4-ce8e394f3f89 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:17.270224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773a2f540026405c84b4ca4ca0de3a98'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:17.274343 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2453/4877] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:17.279653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773a2f540026405c84b4ca4ca0de3a98'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:17.280380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773a2f540026405c84b4ca4ca0de3a98'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:17.280997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773a2f540026405c84b4ca4ca0de3a98'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:17.296704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773a2f540026405c84b4ca4ca0de3a98'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:17.321453 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2425/4878] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:17 2022] DELETE /identity/v3/users/773a2f540026405c84b4ca4ca0de3a98 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:18.102266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cab68e-1974-45e8-bfc4-ce8e394f3f89 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:18.118358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cab68e-1974-45e8-bfc4-ce8e394f3f89 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:18.231393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:18.232309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:18.232869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:18.233360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d admin admin] PATH_INFO: `/v3/projects/cc98e8f1830c4edbb8f30591729fe668` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:18.234854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc98e8f1830c4edbb8f30591729fe668)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:18.237130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:18.307610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc98e8f1830c4edbb8f30591729fe668', 'request_id': 'req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:18.309610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:18.330443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc98e8f1830c4edbb8f30591729fe668', 'request_id': 'req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:18.345826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc98e8f1830c4edbb8f30591729fe668', 'request_id': 'req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:18.369156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d admin admin] The token cache is being invalidate because project cc98e8f1830c4edbb8f30591729fe668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:18.369833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:18.370072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:18.370861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d866a9d8-9c9c-4014-b5b1-c680d5179c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:18.371626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:18.373634 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2454/4879] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:18 2022] DELETE /identity/v3/projects/cc98e8f1830c4edbb8f30591729fe668 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:18.378498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9406-d8a7-4a71-ba4b-78924bc98d43 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:18.378938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9406-d8a7-4a71-ba4b-78924bc98d43 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:18.379219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9406-d8a7-4a71-ba4b-78924bc98d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:18.394092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d56237-529e-4144-a4d8-73c2fd21391c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:18.407348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-33cd9406-d8a7-4a71-ba4b-78924bc98d43 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:18.408721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-33cd9406-d8a7-4a71-ba4b-78924bc98d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:18.507531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:18.508317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:18.508700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:18.509077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] PATH_INFO: `/v3/projects/0fdd27e001dc45d3b92a2db3577e2e0a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:18.510652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fdd27e001dc45d3b92a2db3577e2e0a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:18.513039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:18.539692 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2455/4880] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:18.542714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b5382-946d-4f5e-b5da-a052853acc29 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:18.546450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b5382-946d-4f5e-b5da-a052853acc29 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:18.546878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b5382-946d-4f5e-b5da-a052853acc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:18.584645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ff2b5382-946d-4f5e-b5da-a052853acc29 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:18.593003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ff2b5382-946d-4f5e-b5da-a052853acc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:18.618683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fdd27e001dc45d3b92a2db3577e2e0a', 'request_id': 'req-2d217ce2-a613-4caf-9948-d6a14387e827'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:18.636805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fdd27e001dc45d3b92a2db3577e2e0a', 'request_id': 'req-2d217ce2-a613-4caf-9948-d6a14387e827'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:18.645476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fdd27e001dc45d3b92a2db3577e2e0a', 'request_id': 'req-2d217ce2-a613-4caf-9948-d6a14387e827'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:18.669788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] The token cache is being invalidate because project 0fdd27e001dc45d3b92a2db3577e2e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:18.671767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:18.673524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:18.676745 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2426/4881] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:18 2022] DELETE /identity/v3/projects/0fdd27e001dc45d3b92a2db3577e2e0a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:18.682568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:18.686255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:18.739645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:18.752634 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2456/4882] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:18.752634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b5382-946d-4f5e-b5da-a052853acc29 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:18.757073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ff2b5382-946d-4f5e-b5da-a052853acc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:18.837738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d217ce2-a613-4caf-9948-d6a14387e827 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:18.852554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:18.853476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:18.853938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:18.854352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] PATH_INFO: `/v3/users/f0d9fa079b0142c0ab04d149c73aa5ed` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:18.857096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d9fa079b0142c0ab04d149c73aa5ed)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:18.859482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:18.948530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b5382-946d-4f5e-b5da-a052853acc29 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:18.966251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5f0c1-ad5a-4cd4-a53f-310cb5cdef11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:18.967143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5f0c1-ad5a-4cd4-a53f-310cb5cdef11 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:18.967568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5f0c1-ad5a-4cd4-a53f-310cb5cdef11 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:18.968649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5f0c1-ad5a-4cd4-a53f-310cb5cdef11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:18.971458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2ba5f0c1-ad5a-4cd4-a53f-310cb5cdef11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:18.976841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d9fa079b0142c0ab04d149c73aa5ed'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:18.995085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d9fa079b0142c0ab04d149c73aa5ed'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:18.995969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d9fa079b0142c0ab04d149c73aa5ed'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:18.996810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d9fa079b0142c0ab04d149c73aa5ed'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:19.018182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5f0c1-ad5a-4cd4-a53f-310cb5cdef11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:19.020147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5f0c1-ad5a-4cd4-a53f-310cb5cdef11 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:19.020573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d9fa079b0142c0ab04d149c73aa5ed'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:19.031304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:19.047496 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2457/4883] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:19.048960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5f0c1-ad5a-4cd4-a53f-310cb5cdef11 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:19.060074 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2427/4884] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:18 2022] DELETE /identity/v3/users/f0d9fa079b0142c0ab04d149c73aa5ed => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:19.085496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5f0c1-ad5a-4cd4-a53f-310cb5cdef11 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:19.173380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e342154-bca1-4c48-afac-ec14a708e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:19.174202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e342154-bca1-4c48-afac-ec14a708e722 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:19.174524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e342154-bca1-4c48-afac-ec14a708e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:19.174844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e342154-bca1-4c48-afac-ec14a708e722 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:19.175506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e342154-bca1-4c48-afac-ec14a708e722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:19.175889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e342154-bca1-4c48-afac-ec14a708e722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:19.177699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e342154-bca1-4c48-afac-ec14a708e722 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:19.194884 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2458/4885] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:19.199514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:19.201789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:19.217774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c081088-6308-4ddf-b63e-2584f896f61a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:19.225522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f1dbe-7eea-43bb-9347-84e8f2009904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:19.226650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f1dbe-7eea-43bb-9347-84e8f2009904 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:19.227992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f1dbe-7eea-43bb-9347-84e8f2009904 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:19.227992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f1dbe-7eea-43bb-9347-84e8f2009904 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:19.228216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f1dbe-7eea-43bb-9347-84e8f2009904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:19.230973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f1dbe-7eea-43bb-9347-84e8f2009904 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:19.274192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e342154-bca1-4c48-afac-ec14a708e722 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:19.275212 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2428/4886] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:19 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:19.288151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e342154-bca1-4c48-afac-ec14a708e722 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:19.417291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dad56d-4ac9-4948-ac6e-aa46a2538f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:19.418553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dad56d-4ac9-4948-ac6e-aa46a2538f06 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:19.418838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dad56d-4ac9-4948-ac6e-aa46a2538f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:19.421451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dad56d-4ac9-4948-ac6e-aa46a2538f06 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:19.422209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dad56d-4ac9-4948-ac6e-aa46a2538f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:19.426876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dad56d-4ac9-4948-ac6e-aa46a2538f06 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:19.498802 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2459/4887] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:19 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:19.508165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f1dbe-7eea-43bb-9347-84e8f2009904 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:19.539608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f1dbe-7eea-43bb-9347-84e8f2009904 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:19.548099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a3b63-92da-40dc-8868-8ab8cde7a87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:19.548965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a3b63-92da-40dc-8868-8ab8cde7a87a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:19.549479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a3b63-92da-40dc-8868-8ab8cde7a87a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:19.549984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a3b63-92da-40dc-8868-8ab8cde7a87a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:19.550987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a3b63-92da-40dc-8868-8ab8cde7a87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:19.552777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a3b63-92da-40dc-8868-8ab8cde7a87a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:19.567777 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2429/4888] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:19.573644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dad56d-4ac9-4948-ac6e-aa46a2538f06 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:19.588678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dad56d-4ac9-4948-ac6e-aa46a2538f06 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:19.601029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef6293-16a6-49ac-8be1-5317dc991eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:19.601789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef6293-16a6-49ac-8be1-5317dc991eaa admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:19.602127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef6293-16a6-49ac-8be1-5317dc991eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:19.603823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef6293-16a6-49ac-8be1-5317dc991eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:19.605683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef6293-16a6-49ac-8be1-5317dc991eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:19.610048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef6293-16a6-49ac-8be1-5317dc991eaa admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:19.638253 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2460/4889] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:19.642621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a3b63-92da-40dc-8868-8ab8cde7a87a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:19.671478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a3b63-92da-40dc-8868-8ab8cde7a87a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:19.682191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d5ab0-4082-44b7-91cb-01b061a1c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:19.682869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d5ab0-4082-44b7-91cb-01b061a1c2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:19.683213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d5ab0-4082-44b7-91cb-01b061a1c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:19.683496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d5ab0-4082-44b7-91cb-01b061a1c2f2 admin admin] PATH_INFO: `/v3/projects/48a9692a1b71443091497c8a7615e19d/users/3ad563de225e44e9a7e81788095cd86b/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:19.712686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d5ab0-4082-44b7-91cb-01b061a1c2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a9692a1b71443091497c8a7615e19d, user_id=3ad563de225e44e9a7e81788095cd86b, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:19.716783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d5ab0-4082-44b7-91cb-01b061a1c2f2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:19.752870 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2430/4890] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:19 2022] PUT /identity/v3/projects/48a9692a1b71443091497c8a7615e19d/users/3ad563de225e44e9a7e81788095cd86b/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:19.764236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57681efd-76cc-4d75-a645-052016451725 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:19.764801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57681efd-76cc-4d75-a645-052016451725 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:19.765329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57681efd-76cc-4d75-a645-052016451725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:19.816715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-57681efd-76cc-4d75-a645-052016451725 None None] MFA Rules not processed for user `3ad563de225e44e9a7e81788095cd86b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:19.819317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-57681efd-76cc-4d75-a645-052016451725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:19.958155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:19.964984 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2461/4891] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:19.969792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d5ab0-4082-44b7-91cb-01b061a1c2f2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:20.061213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:20.094171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d5ab0-4082-44b7-91cb-01b061a1c2f2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:20.103139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4a7cb-83d4-47b8-8ca7-848496842d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:20.104127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4a7cb-83d4-47b8-8ca7-848496842d40 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:20.105102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4a7cb-83d4-47b8-8ca7-848496842d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:20.105456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4a7cb-83d4-47b8-8ca7-848496842d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:20.106396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4a7cb-83d4-47b8-8ca7-848496842d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:20.110762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4a7cb-83d4-47b8-8ca7-848496842d40 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:20.163055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57681efd-76cc-4d75-a645-052016451725 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:20.167377 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2431/4892] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:19 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:20.168192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-57681efd-76cc-4d75-a645-052016451725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:20.168737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4a7cb-83d4-47b8-8ca7-848496842d40 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:20.204038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57681efd-76cc-4d75-a645-052016451725 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:20.306260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4a7cb-83d4-47b8-8ca7-848496842d40 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:20.313494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29931b8d-0df0-42d1-a2f4-8b546a0b1a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:20.314274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931b8d-0df0-42d1-a2f4-8b546a0b1a4e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:20.314710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931b8d-0df0-42d1-a2f4-8b546a0b1a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:20.315086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931b8d-0df0-42d1-a2f4-8b546a0b1a4e admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:20.315988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29931b8d-0df0-42d1-a2f4-8b546a0b1a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:20.318211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29931b8d-0df0-42d1-a2f4-8b546a0b1a4e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:20.372252 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2432/4893] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:20 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:20.373148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29931b8d-0df0-42d1-a2f4-8b546a0b1a4e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:20.378643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:20.380325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:20.384959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:20.386477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56 admin admin] PATH_INFO: `/v3/projects/98a5b367f66344fda800788354943e7b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:20.389097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a5b367f66344fda800788354943e7b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:20.393087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:20.400366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29931b8d-0df0-42d1-a2f4-8b546a0b1a4e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:20.413931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980fa21-637d-4860-ae1b-f4d06d0457c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:20.418468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980fa21-637d-4860-ae1b-f4d06d0457c2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:20.418805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980fa21-637d-4860-ae1b-f4d06d0457c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:20.419129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980fa21-637d-4860-ae1b-f4d06d0457c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:20.420145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980fa21-637d-4860-ae1b-f4d06d0457c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:20.422255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980fa21-637d-4860-ae1b-f4d06d0457c2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:20.439619 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2433/4894] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:20.446638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980fa21-637d-4860-ae1b-f4d06d0457c2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:20.463056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980fa21-637d-4860-ae1b-f4d06d0457c2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:20.470451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140083d-5971-4a63-a2ca-388e15e59708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:20.471274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140083d-5971-4a63-a2ca-388e15e59708 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:20.471555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140083d-5971-4a63-a2ca-388e15e59708 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:20.471962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140083d-5971-4a63-a2ca-388e15e59708 admin admin] PATH_INFO: `/v3/projects/bf409e98d9164a73a84b018a363141dd/users/fe481c965dfb4c2d85ce91ac909de250/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:20.501155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140083d-5971-4a63-a2ca-388e15e59708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf409e98d9164a73a84b018a363141dd, user_id=fe481c965dfb4c2d85ce91ac909de250, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:20.507117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140083d-5971-4a63-a2ca-388e15e59708 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:20.518092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a5b367f66344fda800788354943e7b', 'request_id': 'req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:20.534104 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2434/4895] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:20 2022] PUT /identity/v3/projects/bf409e98d9164a73a84b018a363141dd/users/fe481c965dfb4c2d85ce91ac909de250/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:20.535586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140083d-5971-4a63-a2ca-388e15e59708 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:20.538514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a5b367f66344fda800788354943e7b', 'request_id': 'req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:20.553606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a5b367f66344fda800788354943e7b', 'request_id': 'req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:20.575434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56 admin admin] The token cache is being invalidate because project 98a5b367f66344fda800788354943e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:20.579211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:20.580148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-29120ef0-7bcb-4c67-9ab7-d1f1c38ded56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:20.585516 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2462/4896] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:20 2022] DELETE /identity/v3/projects/98a5b367f66344fda800788354943e7b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:20.590199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a20ae-3ed2-47bf-a25e-a6f247b414c0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:20.590199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a20ae-3ed2-47bf-a25e-a6f247b414c0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:20.590564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a20ae-3ed2-47bf-a25e-a6f247b414c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:20.669625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ae1a20ae-3ed2-47bf-a25e-a6f247b414c0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:20.670772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140083d-5971-4a63-a2ca-388e15e59708 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:20.670903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ae1a20ae-3ed2-47bf-a25e-a6f247b414c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:20.687987 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2463/4897] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:20.689582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e813a-e790-4f7c-928c-9a6540249a99 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:20.689874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e813a-e790-4f7c-928c-9a6540249a99 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:20.690255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e813a-e790-4f7c-928c-9a6540249a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:20.693035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562319b-d929-45b1-a046-fb14a40cd963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:20.693901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562319b-d929-45b1-a046-fb14a40cd963 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:20.694352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562319b-d929-45b1-a046-fb14a40cd963 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:20.694771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562319b-d929-45b1-a046-fb14a40cd963 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:20.695564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562319b-d929-45b1-a046-fb14a40cd963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:20.697511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562319b-d929-45b1-a046-fb14a40cd963 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:20.727806 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2435/4898] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:20.728883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562319b-d929-45b1-a046-fb14a40cd963 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:20.733992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4562319b-d929-45b1-a046-fb14a40cd963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:20.734631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f73e813a-e790-4f7c-928c-9a6540249a99 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:20.736318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f73e813a-e790-4f7c-928c-9a6540249a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:20.755341 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2464/4899] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:20.760185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e813a-e790-4f7c-928c-9a6540249a99 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:20.771204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562319b-d929-45b1-a046-fb14a40cd963 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:20.789032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e813a-e790-4f7c-928c-9a6540249a99 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:20.798071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02394d-358a-451e-ae1c-1c1f7c47ef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:20.801246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02394d-358a-451e-ae1c-1c1f7c47ef62 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:20.801670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02394d-358a-451e-ae1c-1c1f7c47ef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:20.802284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02394d-358a-451e-ae1c-1c1f7c47ef62 admin admin] PATH_INFO: `/v3/projects/bf409e98d9164a73a84b018a363141dd/users/fe481c965dfb4c2d85ce91ac909de250/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:20.807824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02394d-358a-451e-ae1c-1c1f7c47ef62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf409e98d9164a73a84b018a363141dd, user_id=fe481c965dfb4c2d85ce91ac909de250, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:20.816894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6ff8b-08da-45f1-b4c3-635b3aeba151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:20.818167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6ff8b-08da-45f1-b4c3-635b3aeba151 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:20.818703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6ff8b-08da-45f1-b4c3-635b3aeba151 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:20.819064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6ff8b-08da-45f1-b4c3-635b3aeba151 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:20.820619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6ff8b-08da-45f1-b4c3-635b3aeba151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:20.822532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02394d-358a-451e-ae1c-1c1f7c47ef62 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:20.826243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6ff8b-08da-45f1-b4c3-635b3aeba151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:20.830260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6ff8b-08da-45f1-b4c3-635b3aeba151 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:20.839267 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2436/4900] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:20 2022] PUT /identity/v3/projects/bf409e98d9164a73a84b018a363141dd/users/fe481c965dfb4c2d85ce91ac909de250/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:20.854261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc696504-37a6-409b-a4c6-a0a392b12cdf None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:20.854920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc696504-37a6-409b-a4c6-a0a392b12cdf None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:20.855412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc696504-37a6-409b-a4c6-a0a392b12cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:20.860050 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2465/4901] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:11:20.864170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6ff8b-08da-45f1-b4c3-635b3aeba151 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:20.878016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:20.888243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6ff8b-08da-45f1-b4c3-635b3aeba151 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:20.959834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dc696504-37a6-409b-a4c6-a0a392b12cdf None None] MFA Rules not processed for user `fe481c965dfb4c2d85ce91ac909de250`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:20.960833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dc696504-37a6-409b-a4c6-a0a392b12cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:21.048530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756b653-1a00-40b7-b130-fc5dbfd14c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:21.050003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756b653-1a00-40b7-b130-fc5dbfd14c77 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:21.050475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756b653-1a00-40b7-b130-fc5dbfd14c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:21.050919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756b653-1a00-40b7-b130-fc5dbfd14c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:21.051708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756b653-1a00-40b7-b130-fc5dbfd14c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:21.056886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756b653-1a00-40b7-b130-fc5dbfd14c77 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:21.080347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:21.124795 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2466/4902] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:20 2022] POST /identity/v3/projects => generated 357 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:21.127708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756b653-1a00-40b7-b130-fc5dbfd14c77 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:21.130342 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2437/4903] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:21.144307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc696504-37a6-409b-a4c6-a0a392b12cdf None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:21.175430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc696504-37a6-409b-a4c6-a0a392b12cdf None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:21.255266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756b653-1a00-40b7-b130-fc5dbfd14c77 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:21.263627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e8df3-f87d-425b-a727-79b499d8caa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:21.264398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e8df3-f87d-425b-a727-79b499d8caa8 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:21.264877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e8df3-f87d-425b-a727-79b499d8caa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:21.265264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e8df3-f87d-425b-a727-79b499d8caa8 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:21.266594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e8df3-f87d-425b-a727-79b499d8caa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:21.269095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e8df3-f87d-425b-a727-79b499d8caa8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:21.307836 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2467/4904] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:21 2022] POST /identity/v3/users => generated 279 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:21.311660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e8df3-f87d-425b-a727-79b499d8caa8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:21.330917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e8df3-f87d-425b-a727-79b499d8caa8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:21.338627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d2c16-397d-408c-87c2-d183659e76c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:21.339860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d2c16-397d-408c-87c2-d183659e76c6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:21.340229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d2c16-397d-408c-87c2-d183659e76c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:21.341393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d2c16-397d-408c-87c2-d183659e76c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:21.342087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d2c16-397d-408c-87c2-d183659e76c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:21.344560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d2c16-397d-408c-87c2-d183659e76c6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:21.354357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a28b48-358e-45a7-8292-fd71fa3d318e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe481c965dfb4c2d85ce91ac909de250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf409e98d9164a73a84b018a363141dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:21.355275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a28b48-358e-45a7-8292-fd71fa3d318e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:21.356511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a28b48-358e-45a7-8292-fd71fa3d318e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:21.358607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a28b48-358e-45a7-8292-fd71fa3d318e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:21.359097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a28b48-358e-45a7-8292-fd71fa3d318e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:21.362504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a28b48-358e-45a7-8292-fd71fa3d318e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:21.373102 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2468/4905] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:11:21.379009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d2c16-397d-408c-87c2-d183659e76c6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:21.424623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d2c16-397d-408c-87c2-d183659e76c6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:21.431502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097b703-09f6-49bb-8749-275331f07fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:21.435910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097b703-09f6-49bb-8749-275331f07fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:21.436226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097b703-09f6-49bb-8749-275331f07fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:21.436498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097b703-09f6-49bb-8749-275331f07fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:21.439836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097b703-09f6-49bb-8749-275331f07fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:21.445962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097b703-09f6-49bb-8749-275331f07fd6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:21.454662 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2438/4906] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:21 2022] POST /identity/v3/projects => generated 333 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:21.455952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a28b48-358e-45a7-8292-fd71fa3d318e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:21.479301 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2469/4907] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:21.480306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097b703-09f6-49bb-8749-275331f07fd6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:21.503537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097b703-09f6-49bb-8749-275331f07fd6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:21.593077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a28b48-358e-45a7-8292-fd71fa3d318e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:21.600711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc0c93-7a45-447f-94a2-46c3316d56a5 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe481c965dfb4c2d85ce91ac909de250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf409e98d9164a73a84b018a363141dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:21.601433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc0c93-7a45-447f-94a2-46c3316d56a5 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:21.601739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc0c93-7a45-447f-94a2-46c3316d56a5 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:21.602005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc0c93-7a45-447f-94a2-46c3316d56a5 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:21.602628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc0c93-7a45-447f-94a2-46c3316d56a5 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:21.603691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb9a36-77eb-4c4d-a7a7-6d8be83f99fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:21.604989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc0c93-7a45-447f-94a2-46c3316d56a5 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:21.611272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb9a36-77eb-4c4d-a7a7-6d8be83f99fc admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:21.611740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb9a36-77eb-4c4d-a7a7-6d8be83f99fc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:21.612142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb9a36-77eb-4c4d-a7a7-6d8be83f99fc admin admin] PATH_INFO: `/v3/projects/a26c456dde0d4002aeceb99e210970fa/users/edb2b7e770c540d092b0e06096ddbd1e/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:21.633227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb9a36-77eb-4c4d-a7a7-6d8be83f99fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26c456dde0d4002aeceb99e210970fa, user_id=edb2b7e770c540d092b0e06096ddbd1e, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:21.636765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb9a36-77eb-4c4d-a7a7-6d8be83f99fc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:21.638643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:21.654970 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2439/4908] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:11:21 2022] POST /identity/v3/projects => generated 333 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:21.658376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc0c93-7a45-447f-94a2-46c3316d56a5 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:21.668472 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2470/4909] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:21 2022] PUT /identity/v3/projects/a26c456dde0d4002aeceb99e210970fa/users/edb2b7e770c540d092b0e06096ddbd1e/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:21.689066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7472a7-2622-487c-8e53-be056f411034 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:21.689324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7472a7-2622-487c-8e53-be056f411034 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:21.689526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7472a7-2622-487c-8e53-be056f411034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:21.782568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5b7472a7-2622-487c-8e53-be056f411034 None None] MFA Rules not processed for user `edb2b7e770c540d092b0e06096ddbd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:21.794760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5b7472a7-2622-487c-8e53-be056f411034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:21.807130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc0c93-7a45-447f-94a2-46c3316d56a5 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:21.880493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:21.978354 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2471/4910] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:21.979232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7472a7-2622-487c-8e53-be056f411034 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:21.980552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5b7472a7-2622-487c-8e53-be056f411034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:21.982665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff00cb-7387-4ed7-8d47-50bd91cb2073 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe481c965dfb4c2d85ce91ac909de250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf409e98d9164a73a84b018a363141dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:21.983399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff00cb-7387-4ed7-8d47-50bd91cb2073 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:21.984102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff00cb-7387-4ed7-8d47-50bd91cb2073 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:21.984216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff00cb-7387-4ed7-8d47-50bd91cb2073 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:21.990172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff00cb-7387-4ed7-8d47-50bd91cb2073 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:21.998375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff00cb-7387-4ed7-8d47-50bd91cb2073 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:22.093233 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2440/4911] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:21 2022] POST /identity/v3/projects => generated 358 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:22.098887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff00cb-7387-4ed7-8d47-50bd91cb2073 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:22.161028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7472a7-2622-487c-8e53-be056f411034 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:22.266611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:22.280038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:22.281754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:22.282700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] PATH_INFO: `/v3/users/723fd065499a4b7696ab87ecb7643b5f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:22.285247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=723fd065499a4b7696ab87ecb7643b5f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:22.288749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:22.291277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff00cb-7387-4ed7-8d47-50bd91cb2073 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:22.301967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c5ee1-f4e9-418c-9e4d-1b8ee6448962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:22.302587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c5ee1-f4e9-418c-9e4d-1b8ee6448962 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:22.303413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c5ee1-f4e9-418c-9e4d-1b8ee6448962 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:22.303697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c5ee1-f4e9-418c-9e4d-1b8ee6448962 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:22.304334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c5ee1-f4e9-418c-9e4d-1b8ee6448962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:22.317117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c5ee1-f4e9-418c-9e4d-1b8ee6448962 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:22.363106 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2441/4912] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:22 2022] POST /identity/v3/projects => generated 355 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:22.363747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c5ee1-f4e9-418c-9e4d-1b8ee6448962 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:22.377200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:22.383217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723fd065499a4b7696ab87ecb7643b5f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:22.401974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723fd065499a4b7696ab87ecb7643b5f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:22.403793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723fd065499a4b7696ab87ecb7643b5f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:22.405864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723fd065499a4b7696ab87ecb7643b5f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:22.444932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723fd065499a4b7696ab87ecb7643b5f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:22.453160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:22.458379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c5ee1-f4e9-418c-9e4d-1b8ee6448962 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:22.467919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092877b-2876-4283-826f-dfdc0a5a5fb9 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe481c965dfb4c2d85ce91ac909de250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf409e98d9164a73a84b018a363141dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:22.468818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092877b-2876-4283-826f-dfdc0a5a5fb9 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:22.469482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092877b-2876-4283-826f-dfdc0a5a5fb9 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:22.470244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092877b-2876-4283-826f-dfdc0a5a5fb9 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:22.470965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092877b-2876-4283-826f-dfdc0a5a5fb9 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:22.474326 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2472/4913] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:21 2022] DELETE /identity/v3/users/723fd065499a4b7696ab87ecb7643b5f => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:22.474326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:22.474561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:22.497856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092877b-2876-4283-826f-dfdc0a5a5fb9 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:22.555440 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2442/4914] 10.222.0.26 () {58 vars in 1131 bytes} [Sat Oct 8 21:11:22 2022] GET /identity/v3/projects => generated 7913 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:22.559492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db7e3-893f-40c4-9f50-2720b6806dbf None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:22.559492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db7e3-893f-40c4-9f50-2720b6806dbf None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:22.559492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db7e3-893f-40c4-9f50-2720b6806dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:22.597613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-714db7e3-893f-40c4-9f50-2720b6806dbf None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:22.599163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-714db7e3-893f-40c4-9f50-2720b6806dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:22.604781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329a77b-7942-4cb0-b852-cb8bb2a43661 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:22.611359 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2443/4915] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:22.611359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714db7e3-893f-40c4-9f50-2720b6806dbf None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:22.611359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-714db7e3-893f-40c4-9f50-2720b6806dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:22.623946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b248475-aa96-4baa-b2b7-4ffcb3177bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:22.626692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b248475-aa96-4baa-b2b7-4ffcb3177bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:22.627270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b248475-aa96-4baa-b2b7-4ffcb3177bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:22.627658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b248475-aa96-4baa-b2b7-4ffcb3177bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:22.628411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b248475-aa96-4baa-b2b7-4ffcb3177bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:22.634682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b248475-aa96-4baa-b2b7-4ffcb3177bc6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:22.698383 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2473/4916] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:22 2022] POST /identity/v3/users => generated 284 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:22.698383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b248475-aa96-4baa-b2b7-4ffcb3177bc6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:22.700860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2b248475-aa96-4baa-b2b7-4ffcb3177bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:22.750246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714db7e3-893f-40c4-9f50-2720b6806dbf None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:22.756700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17607245-e816-440f-a4d8-cc25a7f1999e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe481c965dfb4c2d85ce91ac909de250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf409e98d9164a73a84b018a363141dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:22.757435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17607245-e816-440f-a4d8-cc25a7f1999e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:22.757784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17607245-e816-440f-a4d8-cc25a7f1999e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:22.758150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17607245-e816-440f-a4d8-cc25a7f1999e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:22.759085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17607245-e816-440f-a4d8-cc25a7f1999e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:22.759456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17607245-e816-440f-a4d8-cc25a7f1999e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:22.761817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17607245-e816-440f-a4d8-cc25a7f1999e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:22.790932 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2444/4917] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 21:11:22 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:22.792089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17607245-e816-440f-a4d8-cc25a7f1999e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:22.807723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17607245-e816-440f-a4d8-cc25a7f1999e tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:22.813152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e328006-1b1b-460f-b29b-9672e7981156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:22.813870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e328006-1b1b-460f-b29b-9672e7981156 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:22.814215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e328006-1b1b-460f-b29b-9672e7981156 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:22.814553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e328006-1b1b-460f-b29b-9672e7981156 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:22.815377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e328006-1b1b-460f-b29b-9672e7981156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:22.817073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e328006-1b1b-460f-b29b-9672e7981156 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:22.832880 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2445/4918] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:22.832880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e328006-1b1b-460f-b29b-9672e7981156 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:22.838258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b248475-aa96-4baa-b2b7-4ffcb3177bc6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:22.842639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e52a2-3589-41a3-b68a-9e6555c3a06d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:22.844068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e52a2-3589-41a3-b68a-9e6555c3a06d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:22.844550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e52a2-3589-41a3-b68a-9e6555c3a06d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:22.845018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e52a2-3589-41a3-b68a-9e6555c3a06d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:22.845335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e328006-1b1b-460f-b29b-9672e7981156 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:22.850893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68881ea6-3140-4cd7-80f0-b4e99b79bc65 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe481c965dfb4c2d85ce91ac909de250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf409e98d9164a73a84b018a363141dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:22.851965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68881ea6-3140-4cd7-80f0-b4e99b79bc65 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:22.852299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68881ea6-3140-4cd7-80f0-b4e99b79bc65 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:22.852841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68881ea6-3140-4cd7-80f0-b4e99b79bc65 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:22.853662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68881ea6-3140-4cd7-80f0-b4e99b79bc65 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Adding query filter params (parent_id=51af2d7feb1d472d8add9805a01a51b3) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:22.854031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68881ea6-3140-4cd7-80f0-b4e99b79bc65 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:22.856152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68881ea6-3140-4cd7-80f0-b4e99b79bc65 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:22.865343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e52a2-3589-41a3-b68a-9e6555c3a06d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:22.867050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e52a2-3589-41a3-b68a-9e6555c3a06d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:22.889144 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2474/4919] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:22.893249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e52a2-3589-41a3-b68a-9e6555c3a06d service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:22.894872 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2446/4920] 10.222.0.26 () {58 vars in 1216 bytes} [Sat Oct 8 21:11:22 2022] GET /identity/v3/projects?parent_id=51af2d7feb1d472d8add9805a01a51b3 => generated 498 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:22.895824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68881ea6-3140-4cd7-80f0-b4e99b79bc65 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:22.901874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-68881ea6-3140-4cd7-80f0-b4e99b79bc65 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:22.910929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e52a2-3589-41a3-b68a-9e6555c3a06d service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:22.930827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07257de7-0f5a-4a5e-9b2a-ab6061008f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:22.933490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07257de7-0f5a-4a5e-9b2a-ab6061008f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:22.933490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07257de7-0f5a-4a5e-9b2a-ab6061008f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:22.933709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07257de7-0f5a-4a5e-9b2a-ab6061008f65 admin admin] PATH_INFO: `/v3/projects/2a8de04d6fa24986aef56a1b8ce71744/users/6882b9119020477cb87c8494d972bffa/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:22.968525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07257de7-0f5a-4a5e-9b2a-ab6061008f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8de04d6fa24986aef56a1b8ce71744, user_id=6882b9119020477cb87c8494d972bffa, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:22.975923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07257de7-0f5a-4a5e-9b2a-ab6061008f65 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:23.019014 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2475/4921] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:22 2022] PUT /identity/v3/projects/2a8de04d6fa24986aef56a1b8ce71744/users/6882b9119020477cb87c8494d972bffa/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:23.020080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07257de7-0f5a-4a5e-9b2a-ab6061008f65 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:23.039071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68881ea6-3140-4cd7-80f0-b4e99b79bc65 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:23.044865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:23.184342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fde16d-83fe-471c-ac77-13933afba77f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:23.186254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fde16d-83fe-471c-ac77-13933afba77f service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:23.186534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fde16d-83fe-471c-ac77-13933afba77f service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:23.186802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fde16d-83fe-471c-ac77-13933afba77f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:23.191086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d3fde16d-83fe-471c-ac77-13933afba77f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:23.195150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07257de7-0f5a-4a5e-9b2a-ab6061008f65 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:23.214187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe481c965dfb4c2d85ce91ac909de250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf409e98d9164a73a84b018a363141dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:23.215061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:23.215206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:23.215577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] PATH_INFO: `/v3/projects/c5e12074eadf4a9f95b4a7393034a170` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:23.216842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c5e12074eadf4a9f95b4a7393034a170)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:23.219953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fde16d-83fe-471c-ac77-13933afba77f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:23.221319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:23.222201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fde16d-83fe-471c-ac77-13933afba77f service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:23.236551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:23.252409 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2447/4922] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:23.253921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fde16d-83fe-471c-ac77-13933afba77f service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:23.378176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e12074eadf4a9f95b4a7393034a170', 'request_id': 'req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:23.393079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e12074eadf4a9f95b4a7393034a170', 'request_id': 'req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:23.398430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fde16d-83fe-471c-ac77-13933afba77f service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:23.405133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e12074eadf4a9f95b4a7393034a170', 'request_id': 'req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:23.429293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] The token cache is being invalidate because project c5e12074eadf4a9f95b4a7393034a170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:23.429629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:23.430466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:23.432336 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2476/4923] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:23 2022] DELETE /identity/v3/projects/c5e12074eadf4a9f95b4a7393034a170 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:23.437996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:23.447429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:23.519685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9f6f4-4a37-4a6e-ab36-b3c6dc0bd5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:23.520300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9f6f4-4a37-4a6e-ab36-b3c6dc0bd5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:23.520576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9f6f4-4a37-4a6e-ab36-b3c6dc0bd5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:23.520844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9f6f4-4a37-4a6e-ab36-b3c6dc0bd5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:23.521549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9f6f4-4a37-4a6e-ab36-b3c6dc0bd5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:23.523138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9f6f4-4a37-4a6e-ab36-b3c6dc0bd5b1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:23.538592 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2448/4924] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:23.541617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9f6f4-4a37-4a6e-ab36-b3c6dc0bd5b1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:23.544988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d1d9f6f4-4a37-4a6e-ab36-b3c6dc0bd5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:23.570128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a068c5f-b73a-4bbe-adee-fbd7ab63c5a3 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:23.571689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9f6f4-4a37-4a6e-ab36-b3c6dc0bd5b1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:23.584533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf83073-5778-4c4c-9481-1ee0e1789889 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe481c965dfb4c2d85ce91ac909de250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf409e98d9164a73a84b018a363141dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:23.585338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf83073-5778-4c4c-9481-1ee0e1789889 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:23.585456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62be7d-3e67-4dcb-8685-d90c8e048c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:23.585578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf83073-5778-4c4c-9481-1ee0e1789889 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:23.585867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf83073-5778-4c4c-9481-1ee0e1789889 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] PATH_INFO: `/v3/projects/51af2d7feb1d472d8add9805a01a51b3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:23.586319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62be7d-3e67-4dcb-8685-d90c8e048c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:23.587419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf83073-5778-4c4c-9481-1ee0e1789889 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorizing `identity:delete_project(project_id=51af2d7feb1d472d8add9805a01a51b3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:23.589455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62be7d-3e67-4dcb-8685-d90c8e048c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:23.589877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62be7d-3e67-4dcb-8685-d90c8e048c4c admin admin] PATH_INFO: `/v3/projects/2a8de04d6fa24986aef56a1b8ce71744/users/6882b9119020477cb87c8494d972bffa/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:23.595818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf83073-5778-4c4c-9481-1ee0e1789889 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:23.596275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62be7d-3e67-4dcb-8685-d90c8e048c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8de04d6fa24986aef56a1b8ce71744, user_id=6882b9119020477cb87c8494d972bffa, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:23.598999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62be7d-3e67-4dcb-8685-d90c8e048c4c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:23.641425 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2449/4925] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:23 2022] PUT /identity/v3/projects/2a8de04d6fa24986aef56a1b8ce71744/users/6882b9119020477cb87c8494d972bffa/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:23.641425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62be7d-3e67-4dcb-8685-d90c8e048c4c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:23.641425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2f62be7d-3e67-4dcb-8685-d90c8e048c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:23.676331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5bf83073-5778-4c4c-9481-1ee0e1789889 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51af2d7feb1d472d8add9805a01a51b3', 'request_id': 'req-5bf83073-5778-4c4c-9481-1ee0e1789889'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:23.691070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5bf83073-5778-4c4c-9481-1ee0e1789889 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51af2d7feb1d472d8add9805a01a51b3', 'request_id': 'req-5bf83073-5778-4c4c-9481-1ee0e1789889'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:23.697366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5bf83073-5778-4c4c-9481-1ee0e1789889 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51af2d7feb1d472d8add9805a01a51b3', 'request_id': 'req-5bf83073-5778-4c4c-9481-1ee0e1789889'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:23.703616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:23.718994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5bf83073-5778-4c4c-9481-1ee0e1789889 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] The token cache is being invalidate because project 51af2d7feb1d472d8add9805a01a51b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:23.719367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5bf83073-5778-4c4c-9481-1ee0e1789889 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:23.722400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5bf83073-5778-4c4c-9481-1ee0e1789889 tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:23.727136 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2477/4926] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:23 2022] DELETE /identity/v3/projects/51af2d7feb1d472d8add9805a01a51b3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:23.729998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9592807-8b78-421a-8568-cb61bf6f0c7b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:23.730282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9592807-8b78-421a-8568-cb61bf6f0c7b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:23.730561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9592807-8b78-421a-8568-cb61bf6f0c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:23.756772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62be7d-3e67-4dcb-8685-d90c8e048c4c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:23.793941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a9592807-8b78-421a-8568-cb61bf6f0c7b None None] MFA Rules not processed for user `6882b9119020477cb87c8494d972bffa`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:23.795393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a9592807-8b78-421a-8568-cb61bf6f0c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:23.812551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:23.914562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:23.915542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:23.915823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:23.916102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] PATH_INFO: `/v3/users/30fe0e1ffa1040ec85d3c32d8b741c75` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:23.919812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] RBAC: Authorizing `identity:delete_user(user_id=30fe0e1ffa1040ec85d3c32d8b741c75)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:23.923207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:23.970731 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2478/4927] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:23.972717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9592807-8b78-421a-8568-cb61bf6f0c7b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:23.986696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a9592807-8b78-421a-8568-cb61bf6f0c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:24.018760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30fe0e1ffa1040ec85d3c32d8b741c75'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.028674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30fe0e1ffa1040ec85d3c32d8b741c75'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.029451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30fe0e1ffa1040ec85d3c32d8b741c75'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.030508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30fe0e1ffa1040ec85d3c32d8b741c75'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.045070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30fe0e1ffa1040ec85d3c32d8b741c75'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.066055 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2450/4928] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:23 2022] DELETE /identity/v3/users/30fe0e1ffa1040ec85d3c32d8b741c75 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:24.066921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:24.075052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:24.095143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9592807-8b78-421a-8568-cb61bf6f0c7b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:24.165171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:24.171165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124935fd-2235-4002-b37e-760568d2668c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:24.178567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:24.179779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:24.180153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:24.180570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] PATH_INFO: `/v3/projects/5126710cffcb488f92e3915c9b332822` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:24.182399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5126710cffcb488f92e3915c9b332822)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:24.184360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:24.191037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe481c965dfb4c2d85ce91ac909de250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf409e98d9164a73a84b018a363141dd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:24.192041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:24.192391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:24.192740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] PATH_INFO: `/v3/projects/1b6a82d6e1e04213b6f0b045ba0b40ff` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:24.195142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1b6a82d6e1e04213b6f0b045ba0b40ff)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:24.197101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:24.253443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5126710cffcb488f92e3915c9b332822', 'request_id': 'req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.268943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5126710cffcb488f92e3915c9b332822', 'request_id': 'req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.274983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6a82d6e1e04213b6f0b045ba0b40ff', 'request_id': 'req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.283286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5126710cffcb488f92e3915c9b332822', 'request_id': 'req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.288968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6a82d6e1e04213b6f0b045ba0b40ff', 'request_id': 'req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.294015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:24.301260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6a82d6e1e04213b6f0b045ba0b40ff', 'request_id': 'req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.302351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] The token cache is being invalidate because project 5126710cffcb488f92e3915c9b332822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:24.303380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.304569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.313231 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2451/4929] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:24 2022] DELETE /identity/v3/projects/5126710cffcb488f92e3915c9b332822 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:24.313231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:24.319089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:24.326217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] The token cache is being invalidate because project 1b6a82d6e1e04213b6f0b045ba0b40ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:24.327529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.328323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.331401 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2479/4930] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:23 2022] DELETE /identity/v3/projects/1b6a82d6e1e04213b6f0b045ba0b40ff => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:24.335042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:24.335042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:24.404289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c9a67-5eb7-48e6-89d3-c10b2a0dc867 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:24.404726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e1e56-bfb3-42b4-ac0e-24c4a4aeef2b tempest-ListProjectsTestJSON-1390669143 tempest-ListProjectsTestJSON-1390669143-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:24.409440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff7e2b-d70f-4d66-b793-b9140b4240ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:24.410269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff7e2b-d70f-4d66-b793-b9140b4240ff service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:24.410547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff7e2b-d70f-4d66-b793-b9140b4240ff service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:24.410818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff7e2b-d70f-4d66-b793-b9140b4240ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:24.413296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a0ff7e2b-d70f-4d66-b793-b9140b4240ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:24.496182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5ccc8-85d2-4fd1-bff9-b74e44f3d653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:24.496810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5ccc8-85d2-4fd1-bff9-b74e44f3d653 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:24.497089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5ccc8-85d2-4fd1-bff9-b74e44f3d653 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:24.497523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5ccc8-85d2-4fd1-bff9-b74e44f3d653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:24.499487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6cc5ccc8-85d2-4fd1-bff9-b74e44f3d653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:24.565758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff7e2b-d70f-4d66-b793-b9140b4240ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:24.567417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff7e2b-d70f-4d66-b793-b9140b4240ff service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:24.582514 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2480/4931] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:24.583619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff7e2b-d70f-4d66-b793-b9140b4240ff service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:24.585569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a0ff7e2b-d70f-4d66-b793-b9140b4240ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:24.588757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:24.625602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5ccc8-85d2-4fd1-bff9-b74e44f3d653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:24.628461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5ccc8-85d2-4fd1-bff9-b74e44f3d653 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:24.656489 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2452/4932] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:24.659032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5ccc8-85d2-4fd1-bff9-b74e44f3d653 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:24.666701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6cc5ccc8-85d2-4fd1-bff9-b74e44f3d653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:24.743621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff7e2b-d70f-4d66-b793-b9140b4240ff service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:24.748762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:24.749577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:24.749944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:24.750342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] PATH_INFO: `/v3/projects/6bcd0e7c24154409824f96e9e99da357` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:24.751937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bcd0e7c24154409824f96e9e99da357)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:24.753821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:24.795867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5ccc8-85d2-4fd1-bff9-b74e44f3d653 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:24.803914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:24.804705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:24.805130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:24.805458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] PATH_INFO: `/v3/users/c66f4dcf9d44426d916b5c7f5bd21899` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:24.806620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66f4dcf9d44426d916b5c7f5bd21899)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:24.809973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:24.831991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:24.857011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bcd0e7c24154409824f96e9e99da357', 'request_id': 'req-c705f5a8-2363-488b-b9c8-9d7ceee2169f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.877495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bcd0e7c24154409824f96e9e99da357', 'request_id': 'req-c705f5a8-2363-488b-b9c8-9d7ceee2169f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.894598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bcd0e7c24154409824f96e9e99da357', 'request_id': 'req-c705f5a8-2363-488b-b9c8-9d7ceee2169f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.905288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66f4dcf9d44426d916b5c7f5bd21899'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.916033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] The token cache is being invalidate because project 6bcd0e7c24154409824f96e9e99da357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:24.916686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.918774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.919706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66f4dcf9d44426d916b5c7f5bd21899'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.923315 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2481/4933] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:24 2022] DELETE /identity/v3/projects/6bcd0e7c24154409824f96e9e99da357 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:24.924295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66f4dcf9d44426d916b5c7f5bd21899'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.925304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:24.927268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66f4dcf9d44426d916b5c7f5bd21899'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.928799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:24.959247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66f4dcf9d44426d916b5c7f5bd21899'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:24.998987 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2453/4934] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:24 2022] DELETE /identity/v3/users/c66f4dcf9d44426d916b5c7f5bd21899 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:25.000607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:25.007753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:25.052593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f5a8-2363-488b-b9c8-9d7ceee2169f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:25.128351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3bafd-13ab-410c-b072-47aa2de97d42 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:25.132574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179e5b7-595b-429b-a2e7-b7d3bfe4e029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:25.133209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179e5b7-595b-429b-a2e7-b7d3bfe4e029 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:25.133673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179e5b7-595b-429b-a2e7-b7d3bfe4e029 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:25.133960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179e5b7-595b-429b-a2e7-b7d3bfe4e029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:25.135767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1179e5b7-595b-429b-a2e7-b7d3bfe4e029 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:25.144550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742b59f-f00a-4ee7-a214-e51b4b5196a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:25.147369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742b59f-f00a-4ee7-a214-e51b4b5196a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:25.147694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742b59f-f00a-4ee7-a214-e51b4b5196a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:25.148771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742b59f-f00a-4ee7-a214-e51b4b5196a7 admin admin] PATH_INFO: `/v3/users/3ad563de225e44e9a7e81788095cd86b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:25.152660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742b59f-f00a-4ee7-a214-e51b4b5196a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad563de225e44e9a7e81788095cd86b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:25.156662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742b59f-f00a-4ee7-a214-e51b4b5196a7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:25.159460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:25.252978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5742b59f-f00a-4ee7-a214-e51b4b5196a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad563de225e44e9a7e81788095cd86b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:25.263890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5742b59f-f00a-4ee7-a214-e51b4b5196a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad563de225e44e9a7e81788095cd86b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:25.264879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5742b59f-f00a-4ee7-a214-e51b4b5196a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad563de225e44e9a7e81788095cd86b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:25.270223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5742b59f-f00a-4ee7-a214-e51b4b5196a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad563de225e44e9a7e81788095cd86b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:25.281500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179e5b7-595b-429b-a2e7-b7d3bfe4e029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:25.285653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179e5b7-595b-429b-a2e7-b7d3bfe4e029 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:25.300074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5742b59f-f00a-4ee7-a214-e51b4b5196a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad563de225e44e9a7e81788095cd86b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:25.306392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:25.322986 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2454/4935] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:25.325206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84c939-8363-4054-af5a-704bd1947c5c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:25.341723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84c939-8363-4054-af5a-704bd1947c5c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:25.341723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84c939-8363-4054-af5a-704bd1947c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:25.351686 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2482/4936] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:24 2022] DELETE /identity/v3/users/3ad563de225e44e9a7e81788095cd86b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:25.356627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8e4ff-d732-4285-afb5-838a08118d89 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:25.357146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8e4ff-d732-4285-afb5-838a08118d89 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:25.357622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8e4ff-d732-4285-afb5-838a08118d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:25.360826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ec84c939-8363-4054-af5a-704bd1947c5c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:25.363543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ec84c939-8363-4054-af5a-704bd1947c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:25.404105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-95e8e4ff-d732-4285-afb5-838a08118d89 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:25.406821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-95e8e4ff-d732-4285-afb5-838a08118d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:25.505380 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2455/4937] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:25.591917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2a242-4a36-4525-874c-55f18331ab56 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:25.592205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2a242-4a36-4525-874c-55f18331ab56 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:25.592472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2a242-4a36-4525-874c-55f18331ab56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:25.609751 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2483/4938] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:25.632254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-82f2a242-4a36-4525-874c-55f18331ab56 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:25.633528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-82f2a242-4a36-4525-874c-55f18331ab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:25.635700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8e4ff-d732-4285-afb5-838a08118d89 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:25.637369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-95e8e4ff-d732-4285-afb5-838a08118d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:25.660059 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2456/4939] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:25.664227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2a242-4a36-4525-874c-55f18331ab56 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:25.665731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-82f2a242-4a36-4525-874c-55f18331ab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:25.697733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2a242-4a36-4525-874c-55f18331ab56 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:25.711252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:25.713817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:25.714277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:25.716530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232 admin admin] PATH_INFO: `/v3/projects/c16d7821fb5e45968803bbc5bd604037` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:25.718278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16d7821fb5e45968803bbc5bd604037)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:25.720505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:25.761629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8e4ff-d732-4285-afb5-838a08118d89 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:25.766074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87712c25-0812-40e2-b332-62554f614bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:25.766896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87712c25-0812-40e2-b332-62554f614bcc service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:25.767137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87712c25-0812-40e2-b332-62554f614bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:25.767585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87712c25-0812-40e2-b332-62554f614bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:25.779135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87712c25-0812-40e2-b332-62554f614bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:25.780641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87712c25-0812-40e2-b332-62554f614bcc service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:25.795444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16d7821fb5e45968803bbc5bd604037', 'request_id': 'req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:25.797256 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2484/4940] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:25.799181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87712c25-0812-40e2-b332-62554f614bcc service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:25.810675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16d7821fb5e45968803bbc5bd604037', 'request_id': 'req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:25.821455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87712c25-0812-40e2-b332-62554f614bcc service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:25.823899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16d7821fb5e45968803bbc5bd604037', 'request_id': 'req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:25.840397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232 admin admin] The token cache is being invalidate because project c16d7821fb5e45968803bbc5bd604037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:25.840763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:25.841586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b39c9cb1-8fe2-4bdb-860d-01e4ad197232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:25.843581 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2457/4941] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:25 2022] DELETE /identity/v3/projects/c16d7821fb5e45968803bbc5bd604037 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:25.853277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fa566-19eb-4dfc-bc97-6916ac937503 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:25.853595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fa566-19eb-4dfc-bc97-6916ac937503 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:25.853853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fa566-19eb-4dfc-bc97-6916ac937503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:25.916231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-999fa566-19eb-4dfc-bc97-6916ac937503 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:25.917999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-999fa566-19eb-4dfc-bc97-6916ac937503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:25.921328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de54bdc-2c36-4a58-838e-a08037c19928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:25.922301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de54bdc-2c36-4a58-838e-a08037c19928 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:25.922748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de54bdc-2c36-4a58-838e-a08037c19928 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:25.926194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de54bdc-2c36-4a58-838e-a08037c19928 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:25.927331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de54bdc-2c36-4a58-838e-a08037c19928 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:25.928331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de54bdc-2c36-4a58-838e-a08037c19928 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:25.930583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de54bdc-2c36-4a58-838e-a08037c19928 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:25.937747 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2458/4942] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:25.947492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a4280-c7ee-46d0-9d2b-3c5d4501d70c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:25.947770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a4280-c7ee-46d0-9d2b-3c5d4501d70c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:25.948054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a4280-c7ee-46d0-9d2b-3c5d4501d70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:25.956898 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2485/4943] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:25.962272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de54bdc-2c36-4a58-838e-a08037c19928 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:25.965501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0de54bdc-2c36-4a58-838e-a08037c19928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:25.997377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-317a4280-c7ee-46d0-9d2b-3c5d4501d70c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:25.999384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-317a4280-c7ee-46d0-9d2b-3c5d4501d70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:26.004194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de54bdc-2c36-4a58-838e-a08037c19928 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:26.014837 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2459/4944] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:26.015918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb89b97-0140-4c2b-bfd0-4706cefaa91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:26.017181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb89b97-0140-4c2b-bfd0-4706cefaa91b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:26.018316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb89b97-0140-4c2b-bfd0-4706cefaa91b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:26.018601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb89b97-0140-4c2b-bfd0-4706cefaa91b admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:26.019251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb89b97-0140-4c2b-bfd0-4706cefaa91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:26.019665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a4280-c7ee-46d0-9d2b-3c5d4501d70c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:26.021246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb89b97-0140-4c2b-bfd0-4706cefaa91b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:26.036525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a4280-c7ee-46d0-9d2b-3c5d4501d70c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:26.042810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a328b6-07c6-47ca-8270-b2c62b3e3b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:26.043991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a328b6-07c6-47ca-8270-b2c62b3e3b3f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:26.044158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a328b6-07c6-47ca-8270-b2c62b3e3b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:26.044610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a328b6-07c6-47ca-8270-b2c62b3e3b3f admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:26.045279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a328b6-07c6-47ca-8270-b2c62b3e3b3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:26.045606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a328b6-07c6-47ca-8270-b2c62b3e3b3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:26.048618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a328b6-07c6-47ca-8270-b2c62b3e3b3f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:26.068121 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2460/4945] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:11:26.070827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a328b6-07c6-47ca-8270-b2c62b3e3b3f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:26.087470 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2486/4946] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:25 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:26.088467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a328b6-07c6-47ca-8270-b2c62b3e3b3f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:26.091435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb89b97-0140-4c2b-bfd0-4706cefaa91b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:26.093604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:26.114055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:26.180484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f4330-c4bd-4a8a-969f-f6227f64294b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:26.182501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f4330-c4bd-4a8a-969f-f6227f64294b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:26.183527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f4330-c4bd-4a8a-969f-f6227f64294b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:26.184232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f4330-c4bd-4a8a-969f-f6227f64294b admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:26.185313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f4330-c4bd-4a8a-969f-f6227f64294b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:26.187340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f4330-c4bd-4a8a-969f-f6227f64294b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:26.205178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb89b97-0140-4c2b-bfd0-4706cefaa91b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:26.214749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a437c-becc-4208-b3e8-4952438ef9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:26.215775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a437c-becc-4208-b3e8-4952438ef9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:26.216335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a437c-becc-4208-b3e8-4952438ef9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:26.216949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a437c-becc-4208-b3e8-4952438ef9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:26.218514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a437c-becc-4208-b3e8-4952438ef9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:26.221767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a437c-becc-4208-b3e8-4952438ef9e5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:26.262687 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2461/4947] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:26 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:26.264703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f4330-c4bd-4a8a-969f-f6227f64294b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:26.267181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-343f4330-c4bd-4a8a-969f-f6227f64294b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:26.285983 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2487/4948] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:26 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:26.287802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a437c-becc-4208-b3e8-4952438ef9e5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:26.299616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a437c-becc-4208-b3e8-4952438ef9e5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:26.373877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f4330-c4bd-4a8a-969f-f6227f64294b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:26.379013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:26.380449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:26.380836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:26.381763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] PATH_INFO: `/v3/projects/48a9692a1b71443091497c8a7615e19d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:26.383556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a9692a1b71443091497c8a7615e19d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:26.384954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5f87e-f3aa-434b-9fca-b3871dc5a5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:26.385604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5f87e-f3aa-434b-9fca-b3871dc5a5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:26.385888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5f87e-f3aa-434b-9fca-b3871dc5a5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:26.386013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:26.386162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5f87e-f3aa-434b-9fca-b3871dc5a5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:26.386782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5f87e-f3aa-434b-9fca-b3871dc5a5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:26.389591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5f87e-f3aa-434b-9fca-b3871dc5a5a9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:26.432881 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2488/4949] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:26 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:26.436261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5f87e-f3aa-434b-9fca-b3871dc5a5a9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:26.456631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a9692a1b71443091497c8a7615e19d', 'request_id': 'req-00b644a7-9f2e-438d-afe0-b373558fafcc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:26.464131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5f87e-f3aa-434b-9fca-b3871dc5a5a9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:26.472653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a9692a1b71443091497c8a7615e19d', 'request_id': 'req-00b644a7-9f2e-438d-afe0-b373558fafcc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:26.489366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a9692a1b71443091497c8a7615e19d', 'request_id': 'req-00b644a7-9f2e-438d-afe0-b373558fafcc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:26.507426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] The token cache is being invalidate because project 48a9692a1b71443091497c8a7615e19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:26.507854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:26.508656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:26.510625 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2462/4950] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:26 2022] DELETE /identity/v3/projects/48a9692a1b71443091497c8a7615e19d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:26.511676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:26.513581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:26.555674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:26.559202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032bdd8-4cf6-43f2-be0e-bce7ee8aa959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:26.560280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032bdd8-4cf6-43f2-be0e-bce7ee8aa959 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:26.560728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032bdd8-4cf6-43f2-be0e-bce7ee8aa959 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:26.561158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032bdd8-4cf6-43f2-be0e-bce7ee8aa959 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:26.562763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032bdd8-4cf6-43f2-be0e-bce7ee8aa959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:26.566730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032bdd8-4cf6-43f2-be0e-bce7ee8aa959 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:26.582621 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2489/4951] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:26.584475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032bdd8-4cf6-43f2-be0e-bce7ee8aa959 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:26.595297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b032bdd8-4cf6-43f2-be0e-bce7ee8aa959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:26.612729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b644a7-9f2e-438d-afe0-b373558fafcc admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:26.619015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996c4bd-0c92-4fb6-8ce9-b9e6240959a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:26.619872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996c4bd-0c92-4fb6-8ce9-b9e6240959a0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:26.620310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996c4bd-0c92-4fb6-8ce9-b9e6240959a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:26.620756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996c4bd-0c92-4fb6-8ce9-b9e6240959a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:26.621621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996c4bd-0c92-4fb6-8ce9-b9e6240959a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:26.623496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996c4bd-0c92-4fb6-8ce9-b9e6240959a0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:26.627044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032bdd8-4cf6-43f2-be0e-bce7ee8aa959 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:26.636211 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2463/4952] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:26.638006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996c4bd-0c92-4fb6-8ce9-b9e6240959a0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:26.640106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4996c4bd-0c92-4fb6-8ce9-b9e6240959a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:26.643245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:26.644841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:26.644841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:26.644841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] PATH_INFO: `/v3/users/fe481c965dfb4c2d85ce91ac909de250` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:26.648189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe481c965dfb4c2d85ce91ac909de250)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:26.651787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:26.668899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996c4bd-0c92-4fb6-8ce9-b9e6240959a0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:26.674205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0987d5-1c81-4cc0-8f2c-0233631a11ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:26.675492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0987d5-1c81-4cc0-8f2c-0233631a11ca admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:26.675876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0987d5-1c81-4cc0-8f2c-0233631a11ca admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:26.676259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0987d5-1c81-4cc0-8f2c-0233631a11ca admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:26.677002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0987d5-1c81-4cc0-8f2c-0233631a11ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:26.680241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0987d5-1c81-4cc0-8f2c-0233631a11ca admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:26.696959 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2464/4953] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:26.697769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:26.708500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0987d5-1c81-4cc0-8f2c-0233631a11ca admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:26.732668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0987d5-1c81-4cc0-8f2c-0233631a11ca admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:26.742574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72868285-d047-45b2-951b-521cea9710f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:26.743286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72868285-d047-45b2-951b-521cea9710f4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:26.743637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72868285-d047-45b2-951b-521cea9710f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:26.743979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72868285-d047-45b2-951b-521cea9710f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:26.744730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72868285-d047-45b2-951b-521cea9710f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:26.746733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72868285-d047-45b2-951b-521cea9710f4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:26.759607 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2465/4954] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:26.760872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72868285-d047-45b2-951b-521cea9710f4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:26.775252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72868285-d047-45b2-951b-521cea9710f4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:26.775994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe481c965dfb4c2d85ce91ac909de250'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:26.781198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f828a05-6ce8-4d35-89ed-deedf519c6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:26.782307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f828a05-6ce8-4d35-89ed-deedf519c6df admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:26.782668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f828a05-6ce8-4d35-89ed-deedf519c6df admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:26.783016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f828a05-6ce8-4d35-89ed-deedf519c6df admin admin] PATH_INFO: `/v3/projects/b6b70dcba67c45f59af8f156c0b68bd6/users/7fb36c37e54e47a4b1464c0b2123de4f/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:26.799437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe481c965dfb4c2d85ce91ac909de250'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:26.800424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe481c965dfb4c2d85ce91ac909de250'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:26.802330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe481c965dfb4c2d85ce91ac909de250'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:26.823514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f828a05-6ce8-4d35-89ed-deedf519c6df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b70dcba67c45f59af8f156c0b68bd6, user_id=7fb36c37e54e47a4b1464c0b2123de4f, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:26.826330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f828a05-6ce8-4d35-89ed-deedf519c6df admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:26.831018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe481c965dfb4c2d85ce91ac909de250'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:26.856618 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2490/4955] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:26 2022] DELETE /identity/v3/users/fe481c965dfb4c2d85ce91ac909de250 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:26.858053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:26.860997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:26.878128 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2466/4956] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:26 2022] PUT /identity/v3/projects/b6b70dcba67c45f59af8f156c0b68bd6/users/7fb36c37e54e47a4b1464c0b2123de4f/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:26.889573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecab3d-7ada-4e6d-8270-7c50527e101b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:26.890047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecab3d-7ada-4e6d-8270-7c50527e101b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:26.890420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecab3d-7ada-4e6d-8270-7c50527e101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:26.957311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3fecab3d-7ada-4e6d-8270-7c50527e101b None None] MFA Rules not processed for user `7fb36c37e54e47a4b1464c0b2123de4f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:26.959128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3fecab3d-7ada-4e6d-8270-7c50527e101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:27.019106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87188e9c-ac5b-4bb1-ad01-325ffb40c10b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:27.130564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ef01a-9f8e-411c-a164-739b29e508a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:27.132921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ef01a-9f8e-411c-a164-739b29e508a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:27.133337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ef01a-9f8e-411c-a164-739b29e508a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:27.133769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ef01a-9f8e-411c-a164-739b29e508a3 admin admin] PATH_INFO: `/v3/projects/61b5c27e0ffe4f2aad613093fe8a166c/users/fc1f7055ac564592875266de7553ce30/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:27.158356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ef01a-9f8e-411c-a164-739b29e508a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b5c27e0ffe4f2aad613093fe8a166c, user_id=fc1f7055ac564592875266de7553ce30, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:27.162681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ef01a-9f8e-411c-a164-739b29e508a3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:27.164601 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2467/4957] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:27.166500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecab3d-7ada-4e6d-8270-7c50527e101b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:27.170079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3fecab3d-7ada-4e6d-8270-7c50527e101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:27.182291 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2491/4958] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:26 2022] PUT /identity/v3/projects/61b5c27e0ffe4f2aad613093fe8a166c/users/fc1f7055ac564592875266de7553ce30/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:27.194533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a9eb2-33b1-4daf-a8d3-66da3bff9ad4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:27.195846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a9eb2-33b1-4daf-a8d3-66da3bff9ad4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:27.196126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a9eb2-33b1-4daf-a8d3-66da3bff9ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:27.230137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e01a9eb2-33b1-4daf-a8d3-66da3bff9ad4 None None] MFA Rules not processed for user `fc1f7055ac564592875266de7553ce30`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:27.231373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e01a9eb2-33b1-4daf-a8d3-66da3bff9ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:27.252311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:27.296192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:27.319225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecab3d-7ada-4e6d-8270-7c50527e101b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:27.329253 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2492/4959] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:27.332319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a9eb2-33b1-4daf-a8d3-66da3bff9ad4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:27.448460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a9eb2-33b1-4daf-a8d3-66da3bff9ad4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:27.455894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45631cba-a4e9-4ee5-b5fa-9a6c77d7200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:27.456514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45631cba-a4e9-4ee5-b5fa-9a6c77d7200b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:27.456798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45631cba-a4e9-4ee5-b5fa-9a6c77d7200b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:27.457171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45631cba-a4e9-4ee5-b5fa-9a6c77d7200b admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:27.458922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45631cba-a4e9-4ee5-b5fa-9a6c77d7200b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:27.460890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45631cba-a4e9-4ee5-b5fa-9a6c77d7200b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:27.471267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0a197-39d1-404d-88cc-32d168887d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:27.473461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a197-39d1-404d-88cc-32d168887d00 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:27.473757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a197-39d1-404d-88cc-32d168887d00 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:27.474244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a197-39d1-404d-88cc-32d168887d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:27.505550 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2493/4960] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:27 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:27.506850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45631cba-a4e9-4ee5-b5fa-9a6c77d7200b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:27.508689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-45631cba-a4e9-4ee5-b5fa-9a6c77d7200b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:27.565761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0a197-39d1-404d-88cc-32d168887d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:27.568617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0a197-39d1-404d-88cc-32d168887d00 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:27.580348 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2468/4961] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:27.582011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0a197-39d1-404d-88cc-32d168887d00 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:27.589734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45631cba-a4e9-4ee5-b5fa-9a6c77d7200b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:27.595037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4ab30-6072-4d5b-a13e-478d4d9e131c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:27.595377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0a197-39d1-404d-88cc-32d168887d00 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:27.595673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4ab30-6072-4d5b-a13e-478d4d9e131c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:27.596077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4ab30-6072-4d5b-a13e-478d4d9e131c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:27.596359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4ab30-6072-4d5b-a13e-478d4d9e131c admin admin] PATH_INFO: `/v3/projects/bf409e98d9164a73a84b018a363141dd` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:27.597847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4ab30-6072-4d5b-a13e-478d4d9e131c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf409e98d9164a73a84b018a363141dd)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:27.601489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4ab30-6072-4d5b-a13e-478d4d9e131c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:27.603161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bcb9f-cbca-4934-9f6c-08bee4eb8917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:27.604160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bcb9f-cbca-4934-9f6c-08bee4eb8917 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:27.604302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bcb9f-cbca-4934-9f6c-08bee4eb8917 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:27.604639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bcb9f-cbca-4934-9f6c-08bee4eb8917 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:27.605379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bcb9f-cbca-4934-9f6c-08bee4eb8917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:27.607279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bcb9f-cbca-4934-9f6c-08bee4eb8917 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:27.641936 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2469/4962] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:27 2022] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:27.645538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bcb9f-cbca-4934-9f6c-08bee4eb8917 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:27.671177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bcb9f-cbca-4934-9f6c-08bee4eb8917 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:27.682532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:27.691577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-48f4ab30-6072-4d5b-a13e-478d4d9e131c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf409e98d9164a73a84b018a363141dd', 'request_id': 'req-48f4ab30-6072-4d5b-a13e-478d4d9e131c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:27.705951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-48f4ab30-6072-4d5b-a13e-478d4d9e131c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf409e98d9164a73a84b018a363141dd', 'request_id': 'req-48f4ab30-6072-4d5b-a13e-478d4d9e131c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:27.716312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-48f4ab30-6072-4d5b-a13e-478d4d9e131c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf409e98d9164a73a84b018a363141dd', 'request_id': 'req-48f4ab30-6072-4d5b-a13e-478d4d9e131c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:27.741656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-48f4ab30-6072-4d5b-a13e-478d4d9e131c admin admin] The token cache is being invalidate because project bf409e98d9164a73a84b018a363141dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:27.742262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-48f4ab30-6072-4d5b-a13e-478d4d9e131c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:27.744113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-48f4ab30-6072-4d5b-a13e-478d4d9e131c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:27.746989 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2494/4963] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:27 2022] DELETE /identity/v3/projects/bf409e98d9164a73a84b018a363141dd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:27.751912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8f5e0-44b8-4dad-a1b6-3b071181ad72 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:27.752230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8f5e0-44b8-4dad-a1b6-3b071181ad72 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:27.752482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8f5e0-44b8-4dad-a1b6-3b071181ad72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:27.753799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b009f-e4e8-4767-9ccd-6e528f447e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:27.755107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b009f-e4e8-4767-9ccd-6e528f447e8f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:27.755569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b009f-e4e8-4767-9ccd-6e528f447e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:27.756615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b009f-e4e8-4767-9ccd-6e528f447e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:27.757454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b009f-e4e8-4767-9ccd-6e528f447e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:27.759285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b009f-e4e8-4767-9ccd-6e528f447e8f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:27.782036 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2470/4964] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:11:27.786080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b009f-e4e8-4767-9ccd-6e528f447e8f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:27.787989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-887b009f-e4e8-4767-9ccd-6e528f447e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:27.793581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-59f8f5e0-44b8-4dad-a1b6-3b071181ad72 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:27.795066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-59f8f5e0-44b8-4dad-a1b6-3b071181ad72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:27.804093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b009f-e4e8-4767-9ccd-6e528f447e8f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:27.810490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8189fcd-7b60-4c39-a13f-5981d93aa7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:27.811484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8189fcd-7b60-4c39-a13f-5981d93aa7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:27.814098 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2495/4965] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:27.814411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8189fcd-7b60-4c39-a13f-5981d93aa7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:27.814875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8189fcd-7b60-4c39-a13f-5981d93aa7c9 admin admin] PATH_INFO: `/v3/projects/62b0c61848084eda960cc808fe8c48e5/users/0386384d3125462ea24a129f0ea98136/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:27.822310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d32e2e-90c4-4ceb-a8ca-cedd28382ae0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:27.822808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d32e2e-90c4-4ceb-a8ca-cedd28382ae0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:27.823435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d32e2e-90c4-4ceb-a8ca-cedd28382ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:27.832217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:27.837826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8189fcd-7b60-4c39-a13f-5981d93aa7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b0c61848084eda960cc808fe8c48e5, user_id=0386384d3125462ea24a129f0ea98136, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:27.849291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8189fcd-7b60-4c39-a13f-5981d93aa7c9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:27.852543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-18d32e2e-90c4-4ceb-a8ca-cedd28382ae0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:27.853808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-18d32e2e-90c4-4ceb-a8ca-cedd28382ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:27.862423 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2496/4966] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:27.869566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d32e2e-90c4-4ceb-a8ca-cedd28382ae0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:27.879687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d32e2e-90c4-4ceb-a8ca-cedd28382ae0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:27.893286 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2471/4967] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:27 2022] PUT /identity/v3/projects/62b0c61848084eda960cc808fe8c48e5/users/0386384d3125462ea24a129f0ea98136/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:27.894404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8189fcd-7b60-4c39-a13f-5981d93aa7c9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:27.963976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cace2-9e0f-4756-b7ad-b14c24a1cc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:27.964646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cace2-9e0f-4756-b7ad-b14c24a1cc51 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:27.964931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cace2-9e0f-4756-b7ad-b14c24a1cc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:27.965223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cace2-9e0f-4756-b7ad-b14c24a1cc51 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:27.965881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cace2-9e0f-4756-b7ad-b14c24a1cc51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:27.966191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cace2-9e0f-4756-b7ad-b14c24a1cc51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:27.968056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cace2-9e0f-4756-b7ad-b14c24a1cc51 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:27.991380 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2497/4968] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:11:27.991380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cace2-9e0f-4756-b7ad-b14c24a1cc51 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:27.994118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f23cace2-9e0f-4756-b7ad-b14c24a1cc51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:28.020881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8189fcd-7b60-4c39-a13f-5981d93aa7c9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:28.022692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cace2-9e0f-4756-b7ad-b14c24a1cc51 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:28.027077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75076a3d-36d6-4bd2-9ce0-902d28988759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:28.027691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076a3d-36d6-4bd2-9ce0-902d28988759 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:28.028313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076a3d-36d6-4bd2-9ce0-902d28988759 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:28.028596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076a3d-36d6-4bd2-9ce0-902d28988759 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:28.029290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75076a3d-36d6-4bd2-9ce0-902d28988759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:28.029644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:28.030824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:28.030954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75076a3d-36d6-4bd2-9ce0-902d28988759 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:28.031422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:28.032093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] PATH_INFO: `/v3/users/7fb36c37e54e47a4b1464c0b2123de4f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:28.035244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb36c37e54e47a4b1464c0b2123de4f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:28.038175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:28.043071 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2472/4969] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:28.043982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75076a3d-36d6-4bd2-9ce0-902d28988759 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:28.063093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75076a3d-36d6-4bd2-9ce0-902d28988759 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:28.074739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23494b2c-bda5-400f-b685-0195cd51e759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:28.076349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23494b2c-bda5-400f-b685-0195cd51e759 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:28.076636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23494b2c-bda5-400f-b685-0195cd51e759 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:28.076916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23494b2c-bda5-400f-b685-0195cd51e759 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:28.077585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23494b2c-bda5-400f-b685-0195cd51e759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:28.080814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23494b2c-bda5-400f-b685-0195cd51e759 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:28.129519 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2473/4970] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:28 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:28.130525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23494b2c-bda5-400f-b685-0195cd51e759 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:28.135340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb36c37e54e47a4b1464c0b2123de4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:28.158638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb36c37e54e47a4b1464c0b2123de4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:28.159535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb36c37e54e47a4b1464c0b2123de4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:28.160249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb36c37e54e47a4b1464c0b2123de4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:28.175432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb36c37e54e47a4b1464c0b2123de4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:28.198705 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2498/4971] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:27 2022] DELETE /identity/v3/users/7fb36c37e54e47a4b1464c0b2123de4f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:28.199993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:28.201661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:28.237256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:28.249408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23494b2c-bda5-400f-b685-0195cd51e759 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:28.325221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e1479-7c5c-4cd1-91e0-34bdce541066 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:28.338074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eaa82-3ce4-41d5-bdd6-00770dddad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:28.338762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eaa82-3ce4-41d5-bdd6-00770dddad02 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:28.339010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eaa82-3ce4-41d5-bdd6-00770dddad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:28.339286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eaa82-3ce4-41d5-bdd6-00770dddad02 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:28.339923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eaa82-3ce4-41d5-bdd6-00770dddad02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:28.344144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eaa82-3ce4-41d5-bdd6-00770dddad02 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:28.425408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b395cb-9a43-45ea-9c5c-52ab6abd89b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:28.426442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b395cb-9a43-45ea-9c5c-52ab6abd89b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:28.429743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b395cb-9a43-45ea-9c5c-52ab6abd89b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:28.430064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b395cb-9a43-45ea-9c5c-52ab6abd89b0 admin admin] PATH_INFO: `/v3/projects/62b0c61848084eda960cc808fe8c48e5/users/0386384d3125462ea24a129f0ea98136/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:28.435465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b395cb-9a43-45ea-9c5c-52ab6abd89b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b0c61848084eda960cc808fe8c48e5, user_id=0386384d3125462ea24a129f0ea98136, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:28.436628 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2499/4972] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:28 2022] POST /identity/v3/users => generated 284 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:28.440288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58052517-7825-4a29-a118-e67cbc82be8b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:28.440288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58052517-7825-4a29-a118-e67cbc82be8b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:28.440288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58052517-7825-4a29-a118-e67cbc82be8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:28.446557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b395cb-9a43-45ea-9c5c-52ab6abd89b0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:28.493565 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2474/4973] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:28 2022] PUT /identity/v3/projects/62b0c61848084eda960cc808fe8c48e5/users/0386384d3125462ea24a129f0ea98136/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:28.494439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b395cb-9a43-45ea-9c5c-52ab6abd89b0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:28.511597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-58052517-7825-4a29-a118-e67cbc82be8b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:28.524833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-58052517-7825-4a29-a118-e67cbc82be8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:28.529318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:28.642540 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2500/4974] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:28.647939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba30cc-84a8-4455-8adf-a5729b2b0f85 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:28.648971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba30cc-84a8-4455-8adf-a5729b2b0f85 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:28.650952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba30cc-84a8-4455-8adf-a5729b2b0f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:28.658721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b395cb-9a43-45ea-9c5c-52ab6abd89b0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:28.692011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026c057-283a-4170-926c-3da9c217bc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:28.694219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026c057-283a-4170-926c-3da9c217bc7a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:28.694509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026c057-283a-4170-926c-3da9c217bc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:28.694783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026c057-283a-4170-926c-3da9c217bc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:28.697768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026c057-283a-4170-926c-3da9c217bc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:28.702219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026c057-283a-4170-926c-3da9c217bc7a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:28.732241 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2475/4975] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:28.734243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026c057-283a-4170-926c-3da9c217bc7a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:28.743917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0026c057-283a-4170-926c-3da9c217bc7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:28.746383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-faba30cc-84a8-4455-8adf-a5729b2b0f85 None None] MFA Rules not processed for user `0386384d3125462ea24a129f0ea98136`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:28.751405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-faba30cc-84a8-4455-8adf-a5729b2b0f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:28.904530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026c057-283a-4170-926c-3da9c217bc7a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:28.911335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dec17-33d9-451f-b9ee-017794b1d8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:28.911335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dec17-33d9-451f-b9ee-017794b1d8ad service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:28.911335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dec17-33d9-451f-b9ee-017794b1d8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:28.914378 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2501/4976] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:28.914378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba30cc-84a8-4455-8adf-a5729b2b0f85 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:28.914692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dec17-33d9-451f-b9ee-017794b1d8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:28.934005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba30cc-84a8-4455-8adf-a5729b2b0f85 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:28.949358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc935e-d8eb-4adf-8264-a13f7349205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:28.951447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc935e-d8eb-4adf-8264-a13f7349205f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:28.951746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc935e-d8eb-4adf-8264-a13f7349205f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:28.952046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc935e-d8eb-4adf-8264-a13f7349205f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:28.952688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc935e-d8eb-4adf-8264-a13f7349205f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:28.955193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc935e-d8eb-4adf-8264-a13f7349205f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:28.955852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397dec17-33d9-451f-b9ee-017794b1d8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:28.957936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397dec17-33d9-451f-b9ee-017794b1d8ad service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:28.971464 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2476/4977] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:28.972669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dec17-33d9-451f-b9ee-017794b1d8ad service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:28.976264 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2502/4978] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:28.980912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc935e-d8eb-4adf-8264-a13f7349205f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:28.999482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dec17-33d9-451f-b9ee-017794b1d8ad service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:29.008278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc935e-d8eb-4adf-8264-a13f7349205f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:29.013841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37727a46-28dc-4ec3-ac22-df1228333700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:29.014573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727a46-28dc-4ec3-ac22-df1228333700 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:29.014857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727a46-28dc-4ec3-ac22-df1228333700 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:29.015135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727a46-28dc-4ec3-ac22-df1228333700 admin admin] PATH_INFO: `/v3/projects/5686177796a5488ab703e60d1144849e/users/43a1dc8f626f4e6b913243e3076cd7ca/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:29.015874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d9c2d-2f36-475f-83e2-2e27b3793de8 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0386384d3125462ea24a129f0ea98136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62b0c61848084eda960cc808fe8c48e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:29.016864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d9c2d-2f36-475f-83e2-2e27b3793de8 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:29.017973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d9c2d-2f36-475f-83e2-2e27b3793de8 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:29.018683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d9c2d-2f36-475f-83e2-2e27b3793de8 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:29.020616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d9c2d-2f36-475f-83e2-2e27b3793de8 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:29.021172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d9c2d-2f36-475f-83e2-2e27b3793de8 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:29.027173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d9c2d-2f36-475f-83e2-2e27b3793de8 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:29.036095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37727a46-28dc-4ec3-ac22-df1228333700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5686177796a5488ab703e60d1144849e, user_id=43a1dc8f626f4e6b913243e3076cd7ca, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:29.039367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37727a46-28dc-4ec3-ac22-df1228333700 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:29.049753 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2477/4979] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:29.059309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d9c2d-2f36-475f-83e2-2e27b3793de8 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:29.065465 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2503/4980] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:28 2022] PUT /identity/v3/projects/5686177796a5488ab703e60d1144849e/users/43a1dc8f626f4e6b913243e3076cd7ca/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:29.087840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd43bd2-0309-433b-b39f-344fd6ce829d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:29.088036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd43bd2-0309-433b-b39f-344fd6ce829d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:29.091568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd43bd2-0309-433b-b39f-344fd6ce829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:29.105668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d9c2d-2f36-475f-83e2-2e27b3793de8 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:29.135216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:29.177245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9bd43bd2-0309-433b-b39f-344fd6ce829d None None] MFA Rules not processed for user `43a1dc8f626f4e6b913243e3076cd7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:29.179036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9bd43bd2-0309-433b-b39f-344fd6ce829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:29.245975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5d0b4-df74-466f-8dd4-e725b7d5c4ab tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0386384d3125462ea24a129f0ea98136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62b0c61848084eda960cc808fe8c48e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:29.247238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5d0b4-df74-466f-8dd4-e725b7d5c4ab tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:29.247753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5d0b4-df74-466f-8dd4-e725b7d5c4ab tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:29.248237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5d0b4-df74-466f-8dd4-e725b7d5c4ab tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:29.249097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5d0b4-df74-466f-8dd4-e725b7d5c4ab tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:29.251641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5d0b4-df74-466f-8dd4-e725b7d5c4ab tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:29.305210 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2504/4981] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:29.306305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd43bd2-0309-433b-b39f-344fd6ce829d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:29.310180 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2478/4982] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:29 2022] POST /identity/v3/projects => generated 350 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:29.325007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5d0b4-df74-466f-8dd4-e725b7d5c4ab tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:29.372754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:29.468026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd43bd2-0309-433b-b39f-344fd6ce829d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:29.488470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5d0b4-df74-466f-8dd4-e725b7d5c4ab tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:29.496004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1f54a-437f-4bd4-9f9d-466a7d7859c9 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0386384d3125462ea24a129f0ea98136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62b0c61848084eda960cc808fe8c48e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:29.496703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1f54a-437f-4bd4-9f9d-466a7d7859c9 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:29.496969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1f54a-437f-4bd4-9f9d-466a7d7859c9 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:29.497324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1f54a-437f-4bd4-9f9d-466a7d7859c9 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:29.498396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1f54a-437f-4bd4-9f9d-466a7d7859c9 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:29.498753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1f54a-437f-4bd4-9f9d-466a7d7859c9 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:29.508375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1f54a-437f-4bd4-9f9d-466a7d7859c9 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:29.539451 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2479/4983] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:29.580400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d644e-2a09-434e-bf19-7762535f473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:29.581204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d644e-2a09-434e-bf19-7762535f473e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:29.581591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d644e-2a09-434e-bf19-7762535f473e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:29.581971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d644e-2a09-434e-bf19-7762535f473e admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:29.582722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d644e-2a09-434e-bf19-7762535f473e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:29.585578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d644e-2a09-434e-bf19-7762535f473e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:29.589346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1f54a-437f-4bd4-9f9d-466a7d7859c9 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:29.665617 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2505/4984] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:29 2022] POST /identity/v3/projects => generated 367 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:29.679163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d644e-2a09-434e-bf19-7762535f473e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:29.713097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1f54a-437f-4bd4-9f9d-466a7d7859c9 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:29.721409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:29.786094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d644e-2a09-434e-bf19-7762535f473e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:29.808488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78036d4-cdd5-44ee-b0b2-f373e391e1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:29.808944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78036d4-cdd5-44ee-b0b2-f373e391e1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:29.809258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78036d4-cdd5-44ee-b0b2-f373e391e1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:29.809541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78036d4-cdd5-44ee-b0b2-f373e391e1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:29.810185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78036d4-cdd5-44ee-b0b2-f373e391e1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:29.812439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78036d4-cdd5-44ee-b0b2-f373e391e1b3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:29.822337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a974210-398a-476c-a346-31c5d78dabbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:29.822779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a974210-398a-476c-a346-31c5d78dabbd service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:29.823058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a974210-398a-476c-a346-31c5d78dabbd service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:29.823330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a974210-398a-476c-a346-31c5d78dabbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:29.854639 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2506/4985] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:29 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:29.858473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78036d4-cdd5-44ee-b0b2-f373e391e1b3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:29.876848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78036d4-cdd5-44ee-b0b2-f373e391e1b3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:29.890674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabde33-c9cb-4171-8f36-017556785d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:29.891306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabde33-c9cb-4171-8f36-017556785d81 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:29.891682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabde33-c9cb-4171-8f36-017556785d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:29.891871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabde33-c9cb-4171-8f36-017556785d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:29.892496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabde33-c9cb-4171-8f36-017556785d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:29.894128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabde33-c9cb-4171-8f36-017556785d81 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:29.937338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a974210-398a-476c-a346-31c5d78dabbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:29.940921 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2507/4986] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:11:29.941064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a974210-398a-476c-a346-31c5d78dabbd service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:29.941941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabde33-c9cb-4171-8f36-017556785d81 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:29.950368 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2480/4987] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:11:29.964606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabde33-c9cb-4171-8f36-017556785d81 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:29.969923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c0e80-ed61-4e9e-b798-d380352c53b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:29.970686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c0e80-ed61-4e9e-b798-d380352c53b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:29.971049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c0e80-ed61-4e9e-b798-d380352c53b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:29.971375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c0e80-ed61-4e9e-b798-d380352c53b3 admin admin] PATH_INFO: `/v3/projects/7ef23efee2b049359231ee4d6ac212d2/users/a9ddd3ddc0b34204bc06d2a2ff91670a/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:29.992004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c0e80-ed61-4e9e-b798-d380352c53b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef23efee2b049359231ee4d6ac212d2, user_id=a9ddd3ddc0b34204bc06d2a2ff91670a, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:29.996609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c0e80-ed61-4e9e-b798-d380352c53b3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:30.014706 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2508/4988] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:29 2022] PUT /identity/v3/projects/7ef23efee2b049359231ee4d6ac212d2/users/a9ddd3ddc0b34204bc06d2a2ff91670a/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:30.018871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a974210-398a-476c-a346-31c5d78dabbd service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:30.032812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a974210-398a-476c-a346-31c5d78dabbd service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:30.092327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:30.120378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c0e80-ed61-4e9e-b798-d380352c53b3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:30.122336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-397c0e80-ed61-4e9e-b798-d380352c53b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:30.189861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859ff85-948c-4977-b79e-40f00befb11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:30.193245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859ff85-948c-4977-b79e-40f00befb11d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:30.194174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859ff85-948c-4977-b79e-40f00befb11d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:30.195298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859ff85-948c-4977-b79e-40f00befb11d admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:30.197777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859ff85-948c-4977-b79e-40f00befb11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:30.199681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859ff85-948c-4977-b79e-40f00befb11d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:30.265493 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2481/4989] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:30.270043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859ff85-948c-4977-b79e-40f00befb11d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:30.292128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859ff85-948c-4977-b79e-40f00befb11d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:30.308063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197722d-463e-43cd-8de0-edc33ff99818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:30.308816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197722d-463e-43cd-8de0-edc33ff99818 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:30.309383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197722d-463e-43cd-8de0-edc33ff99818 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:30.309745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197722d-463e-43cd-8de0-edc33ff99818 admin admin] PATH_INFO: `/v3/projects/7ef23efee2b049359231ee4d6ac212d2/users/a9ddd3ddc0b34204bc06d2a2ff91670a/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:30.312013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197722d-463e-43cd-8de0-edc33ff99818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef23efee2b049359231ee4d6ac212d2, user_id=a9ddd3ddc0b34204bc06d2a2ff91670a, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:30.314960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197722d-463e-43cd-8de0-edc33ff99818 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:30.327419 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2482/4990] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:30 2022] PUT /identity/v3/projects/7ef23efee2b049359231ee4d6ac212d2/users/a9ddd3ddc0b34204bc06d2a2ff91670a/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:30.328628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46d968-b41e-44fa-afe8-b28b3fe8bbfd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:30.328982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46d968-b41e-44fa-afe8-b28b3fe8bbfd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:30.329351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46d968-b41e-44fa-afe8-b28b3fe8bbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:30.350536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c0e80-ed61-4e9e-b798-d380352c53b3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:30.378642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-be46d968-b41e-44fa-afe8-b28b3fe8bbfd None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:30.379931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-be46d968-b41e-44fa-afe8-b28b3fe8bbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:30.475685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:30.481381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:30.481895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:30.482770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] PATH_INFO: `/v3/projects/b6b70dcba67c45f59af8f156c0b68bd6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:30.486501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b70dcba67c45f59af8f156c0b68bd6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:30.489214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:30.531824 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2483/4991] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:11:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:30.547348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dec27-6127-428c-bc99-02ecccaa1ccc None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:30.547768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dec27-6127-428c-bc99-02ecccaa1ccc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:30.549671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dec27-6127-428c-bc99-02ecccaa1ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:30.607206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:30.639439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-055dec27-6127-428c-bc99-02ecccaa1ccc None None] MFA Rules not processed for user `a9ddd3ddc0b34204bc06d2a2ff91670a`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:30.641107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-055dec27-6127-428c-bc99-02ecccaa1ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:30.647390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b70dcba67c45f59af8f156c0b68bd6', 'request_id': 'req-982eef31-bb0c-477c-81a4-93b4ee7418fc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:30.671639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b70dcba67c45f59af8f156c0b68bd6', 'request_id': 'req-982eef31-bb0c-477c-81a4-93b4ee7418fc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:30.681488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b70dcba67c45f59af8f156c0b68bd6', 'request_id': 'req-982eef31-bb0c-477c-81a4-93b4ee7418fc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:30.726892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] The token cache is being invalidate because project b6b70dcba67c45f59af8f156c0b68bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:30.727193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:30.730338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:30.736511 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2509/4992] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:30 2022] DELETE /identity/v3/projects/b6b70dcba67c45f59af8f156c0b68bd6 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:30.737983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:30.742136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:30.815226 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2484/4993] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:30.816866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dec27-6127-428c-bc99-02ecccaa1ccc None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:30.825837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-055dec27-6127-428c-bc99-02ecccaa1ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:30.948037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:30.968500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982eef31-bb0c-477c-81a4-93b4ee7418fc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:30.981073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76319738-1ede-44cc-a6f3-f0d5511a7173 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:30.983813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76319738-1ede-44cc-a6f3-f0d5511a7173 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:30.983813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76319738-1ede-44cc-a6f3-f0d5511a7173 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:30.985470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76319738-1ede-44cc-a6f3-f0d5511a7173 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:30.989800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-76319738-1ede-44cc-a6f3-f0d5511a7173 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:31.000677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dec27-6127-428c-bc99-02ecccaa1ccc None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:31.007272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437e01e-4302-46fc-b446-f27019984d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:31.008259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e01e-4302-46fc-b446-f27019984d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:31.008944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e01e-4302-46fc-b446-f27019984d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:31.009409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e01e-4302-46fc-b446-f27019984d56 admin admin] PATH_INFO: `/v3/users/fc2bdd169daf4a1db830b1fa7f94f0b2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:31.010873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437e01e-4302-46fc-b446-f27019984d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2bdd169daf4a1db830b1fa7f94f0b2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:31.013237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437e01e-4302-46fc-b446-f27019984d56 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:31.087695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76319738-1ede-44cc-a6f3-f0d5511a7173 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:31.089319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76319738-1ede-44cc-a6f3-f0d5511a7173 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:31.100145 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2510/4994] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:11:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:31.101331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05c051-1e31-478e-9bad-f53ffb656d1a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:31.101602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05c051-1e31-478e-9bad-f53ffb656d1a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:31.101879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05c051-1e31-478e-9bad-f53ffb656d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:31.130281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8d05c051-1e31-478e-9bad-f53ffb656d1a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:31.132021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8d05c051-1e31-478e-9bad-f53ffb656d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:31.136626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7437e01e-4302-46fc-b446-f27019984d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2bdd169daf4a1db830b1fa7f94f0b2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:31.142480 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2511/4995] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:31.150746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05c051-1e31-478e-9bad-f53ffb656d1a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:31.173219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7437e01e-4302-46fc-b446-f27019984d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2bdd169daf4a1db830b1fa7f94f0b2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:31.174237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7437e01e-4302-46fc-b446-f27019984d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2bdd169daf4a1db830b1fa7f94f0b2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:31.176263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7437e01e-4302-46fc-b446-f27019984d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2bdd169daf4a1db830b1fa7f94f0b2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:31.186173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05c051-1e31-478e-9bad-f53ffb656d1a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:31.198392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07ba87-60b3-46eb-a8d6-bfa0fef1c144 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ddd3ddc0b34204bc06d2a2ff91670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef23efee2b049359231ee4d6ac212d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:31.199946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07ba87-60b3-46eb-a8d6-bfa0fef1c144 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:31.200160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07ba87-60b3-46eb-a8d6-bfa0fef1c144 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:31.200799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07ba87-60b3-46eb-a8d6-bfa0fef1c144 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:31.202508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7437e01e-4302-46fc-b446-f27019984d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2bdd169daf4a1db830b1fa7f94f0b2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:31.204848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07ba87-60b3-46eb-a8d6-bfa0fef1c144 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:31.206504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07ba87-60b3-46eb-a8d6-bfa0fef1c144 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:31.239657 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2485/4996] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:30 2022] DELETE /identity/v3/users/fc2bdd169daf4a1db830b1fa7f94f0b2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:31.243311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cc239-79e1-4c48-a1e8-121f304c003a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:31.248223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cc239-79e1-4c48-a1e8-121f304c003a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:31.248534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cc239-79e1-4c48-a1e8-121f304c003a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:31.260441 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2512/4997] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:11:31 2022] POST /identity/v3/domains => generated 277 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:31.262875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07ba87-60b3-46eb-a8d6-bfa0fef1c144 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:31.268660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7a07ba87-60b3-46eb-a8d6-bfa0fef1c144 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:31.319376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e21cc239-79e1-4c48-a1e8-121f304c003a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:31.323575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e21cc239-79e1-4c48-a1e8-121f304c003a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:31.423900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:31.499258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07ba87-60b3-46eb-a8d6-bfa0fef1c144 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:31.512688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d475e89-780a-4325-baf1-d336c8853f10 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ddd3ddc0b34204bc06d2a2ff91670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef23efee2b049359231ee4d6ac212d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:31.514187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d475e89-780a-4325-baf1-d336c8853f10 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:31.515460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d475e89-780a-4325-baf1-d336c8853f10 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:31.515764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d475e89-780a-4325-baf1-d336c8853f10 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:31.518001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d475e89-780a-4325-baf1-d336c8853f10 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:31.523894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d475e89-780a-4325-baf1-d336c8853f10 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:31.606507 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2513/4998] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:31 2022] POST /identity/v3/users => generated 347 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:31.609178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d475e89-780a-4325-baf1-d336c8853f10 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:31.634945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d475e89-780a-4325-baf1-d336c8853f10 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:31.641206 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2486/4999] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:31.645639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cc239-79e1-4c48-a1e8-121f304c003a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:31.653963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a94d3-5d37-42b1-b1ad-64fb3f253f65 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ddd3ddc0b34204bc06d2a2ff91670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef23efee2b049359231ee4d6ac212d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:31.654684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a94d3-5d37-42b1-b1ad-64fb3f253f65 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:31.655476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a94d3-5d37-42b1-b1ad-64fb3f253f65 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:31.655761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a94d3-5d37-42b1-b1ad-64fb3f253f65 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:31.656495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a94d3-5d37-42b1-b1ad-64fb3f253f65 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:31.658782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a94d3-5d37-42b1-b1ad-64fb3f253f65 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:31.680810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cc239-79e1-4c48-a1e8-121f304c003a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:31.701253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31401787-1335-4a8c-a399-4f6a3f0a6f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:31.706876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401787-1335-4a8c-a399-4f6a3f0a6f81 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:31.710296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401787-1335-4a8c-a399-4f6a3f0a6f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:31.710768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401787-1335-4a8c-a399-4f6a3f0a6f81 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:31.712625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31401787-1335-4a8c-a399-4f6a3f0a6f81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:31.712935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31401787-1335-4a8c-a399-4f6a3f0a6f81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:31.717806 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2514/5000] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:31 2022] POST /identity/v3/users => generated 324 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:31.723546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a94d3-5d37-42b1-b1ad-64fb3f253f65 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:31.723752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31401787-1335-4a8c-a399-4f6a3f0a6f81 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:31.744113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a94d3-5d37-42b1-b1ad-64fb3f253f65 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:31.772984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c2e55-518b-48ec-a7c8-922a2c014851 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ddd3ddc0b34204bc06d2a2ff91670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef23efee2b049359231ee4d6ac212d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:31.775675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c2e55-518b-48ec-a7c8-922a2c014851 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:31.777220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c2e55-518b-48ec-a7c8-922a2c014851 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:31.781026 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2487/5001] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:31.781391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c2e55-518b-48ec-a7c8-922a2c014851 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] PATH_INFO: `/v3/users/327649b816344172912128c6f58a9fba` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:31.797243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31401787-1335-4a8c-a399-4f6a3f0a6f81 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:31.817782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c2e55-518b-48ec-a7c8-922a2c014851 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorizing `identity:get_user(user_id=327649b816344172912128c6f58a9fba)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:31.826461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c2e55-518b-48ec-a7c8-922a2c014851 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:31.832929 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2515/5002] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:11:31 2022] GET /identity/v3/users/327649b816344172912128c6f58a9fba => generated 347 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:11:31.835477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c2e55-518b-48ec-a7c8-922a2c014851 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:31.836043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31401787-1335-4a8c-a399-4f6a3f0a6f81 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:31.851121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c2e55-518b-48ec-a7c8-922a2c014851 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:31.857686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecbcf1-68f2-474b-a228-69817ab3b90e tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ddd3ddc0b34204bc06d2a2ff91670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef23efee2b049359231ee4d6ac212d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:31.858938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbcf1-68f2-474b-a228-69817ab3b90e tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:31.859307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbcf1-68f2-474b-a228-69817ab3b90e tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:31.859660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbcf1-68f2-474b-a228-69817ab3b90e tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:31.860612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecbcf1-68f2-474b-a228-69817ab3b90e tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Adding query filter params (domain_id=10b0a27424cc449aadc4bd60dfb362b2) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:31.861951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecbcf1-68f2-474b-a228-69817ab3b90e tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:31.862847 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-25ecbcf1-68f2-474b-a228-69817ab3b90e tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:11:31.862847 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:11:31.862847 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:11:31.864230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecbcf1-68f2-474b-a228-69817ab3b90e tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:31.870772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59d149-a3eb-4c6c-bb5f-0952f9ee1c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:31.880210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59d149-a3eb-4c6c-bb5f-0952f9ee1c92 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:31.882802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59d149-a3eb-4c6c-bb5f-0952f9ee1c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:31.884658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59d149-a3eb-4c6c-bb5f-0952f9ee1c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:31.885589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59d149-a3eb-4c6c-bb5f-0952f9ee1c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:31.889148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59d149-a3eb-4c6c-bb5f-0952f9ee1c92 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:31.891312 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2516/5003] 10.222.0.26 () {58 vars in 1207 bytes} [Sat Oct 8 21:11:31 2022] GET /identity/v3/users?domain_id=10b0a27424cc449aadc4bd60dfb362b2 => generated 484 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:11:31.895791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecbcf1-68f2-474b-a228-69817ab3b90e tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:31.923771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecbcf1-68f2-474b-a228-69817ab3b90e tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:31.934482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7352b4d-64c2-4717-9a75-889e6618a5a2 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ddd3ddc0b34204bc06d2a2ff91670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef23efee2b049359231ee4d6ac212d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:31.935531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7352b4d-64c2-4717-9a75-889e6618a5a2 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:31.936339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7352b4d-64c2-4717-9a75-889e6618a5a2 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:31.943130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7352b4d-64c2-4717-9a75-889e6618a5a2 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:31.944782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7352b4d-64c2-4717-9a75-889e6618a5a2 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:31.952204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7352b4d-64c2-4717-9a75-889e6618a5a2 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:31.982563 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2488/5004] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:31 2022] POST /identity/v3/projects => generated 389 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:31.988822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59d149-a3eb-4c6c-bb5f-0952f9ee1c92 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:32.045465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:32.061784 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2517/5005] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:31 2022] GET /identity/v3/users => generated 8568 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:11:32.066928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7352b4d-64c2-4717-9a75-889e6618a5a2 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:32.092207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7352b4d-64c2-4717-9a75-889e6618a5a2 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:32.161722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59d149-a3eb-4c6c-bb5f-0952f9ee1c92 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:32.187104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7884e-6d02-4d73-a701-2da5aedfe08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:32.188563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7884e-6d02-4d73-a701-2da5aedfe08a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:32.188912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7884e-6d02-4d73-a701-2da5aedfe08a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:32.189623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7884e-6d02-4d73-a701-2da5aedfe08a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:32.190418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7884e-6d02-4d73-a701-2da5aedfe08a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:32.202163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7884e-6d02-4d73-a701-2da5aedfe08a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:32.256828 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2489/5006] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:31 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:32.261158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7884e-6d02-4d73-a701-2da5aedfe08a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:32.278296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32ecb8-a3b1-4c17-a2ba-3e9f647f227f tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ddd3ddc0b34204bc06d2a2ff91670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef23efee2b049359231ee4d6ac212d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:32.279645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32ecb8-a3b1-4c17-a2ba-3e9f647f227f tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:32.282266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32ecb8-a3b1-4c17-a2ba-3e9f647f227f tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:32.282698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32ecb8-a3b1-4c17-a2ba-3e9f647f227f tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:32.284914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32ecb8-a3b1-4c17-a2ba-3e9f647f227f tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Adding query filter params (name=tempest-test_user-228570734) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:32.286282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32ecb8-a3b1-4c17-a2ba-3e9f647f227f tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:32.291164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32ecb8-a3b1-4c17-a2ba-3e9f647f227f tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:32.295216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7884e-6d02-4d73-a701-2da5aedfe08a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:32.313768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff7dd9-7203-4ea3-9ae5-5ccf2f2eba14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:32.314512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7dd9-7203-4ea3-9ae5-5ccf2f2eba14 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:32.314887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7dd9-7203-4ea3-9ae5-5ccf2f2eba14 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:32.315826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7dd9-7203-4ea3-9ae5-5ccf2f2eba14 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:32.316491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff7dd9-7203-4ea3-9ae5-5ccf2f2eba14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:32.318333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff7dd9-7203-4ea3-9ae5-5ccf2f2eba14 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:32.349460 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2490/5007] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:32.354233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff7dd9-7203-4ea3-9ae5-5ccf2f2eba14 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:32.398133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff7dd9-7203-4ea3-9ae5-5ccf2f2eba14 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:32.404234 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2518/5008] 10.222.0.26 () {58 vars in 1187 bytes} [Sat Oct 8 21:11:32 2022] GET /identity/v3/users?name=tempest-test_user-228570734 => generated 474 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:32.406294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32ecb8-a3b1-4c17-a2ba-3e9f647f227f tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:32.426985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32ecb8-a3b1-4c17-a2ba-3e9f647f227f tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:32.427389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65affe0f-c3e1-423e-b91d-afeaf71d6019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:32.428656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65affe0f-c3e1-423e-b91d-afeaf71d6019 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:32.429071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65affe0f-c3e1-423e-b91d-afeaf71d6019 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:32.429389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65affe0f-c3e1-423e-b91d-afeaf71d6019 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:32.430116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65affe0f-c3e1-423e-b91d-afeaf71d6019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:32.441692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65affe0f-c3e1-423e-b91d-afeaf71d6019 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:32.441894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a75aa-be2e-45d7-b03e-cf4d0cedab68 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ddd3ddc0b34204bc06d2a2ff91670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef23efee2b049359231ee4d6ac212d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:32.442696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a75aa-be2e-45d7-b03e-cf4d0cedab68 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:32.443081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a75aa-be2e-45d7-b03e-cf4d0cedab68 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:32.444151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a75aa-be2e-45d7-b03e-cf4d0cedab68 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:32.444794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a75aa-be2e-45d7-b03e-cf4d0cedab68 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:32.449417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a75aa-be2e-45d7-b03e-cf4d0cedab68 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:32.451576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a75aa-be2e-45d7-b03e-cf4d0cedab68 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:32.501607 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2491/5009] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:32.506796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65affe0f-c3e1-423e-b91d-afeaf71d6019 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:32.525755 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2519/5010] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 8 21:11:32 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:32.529053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a75aa-be2e-45d7-b03e-cf4d0cedab68 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:32.541656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65affe0f-c3e1-423e-b91d-afeaf71d6019 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:32.560953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a75aa-be2e-45d7-b03e-cf4d0cedab68 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:32.567908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0258a2-985e-4632-bab9-edbeb1444cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:32.569034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0258a2-985e-4632-bab9-edbeb1444cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:32.569812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0258a2-985e-4632-bab9-edbeb1444cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:32.570055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0258a2-985e-4632-bab9-edbeb1444cdf admin admin] PATH_INFO: `/v3/projects/85daf8b3ee684e01a414941e7b7c768b/users/84b9968c1dd3411ca4e8232709346400/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:32.574835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9e833-ab81-4282-b657-7f89ee7cbaa0 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ddd3ddc0b34204bc06d2a2ff91670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef23efee2b049359231ee4d6ac212d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:32.575622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9e833-ab81-4282-b657-7f89ee7cbaa0 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:32.575980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9e833-ab81-4282-b657-7f89ee7cbaa0 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:32.576476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9e833-ab81-4282-b657-7f89ee7cbaa0 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] PATH_INFO: `/v3/users/322a279b318b4472b043d5dd3988c626` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:32.611845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9e833-ab81-4282-b657-7f89ee7cbaa0 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorizing `identity:delete_user(user_id=322a279b318b4472b043d5dd3988c626)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:32.615263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9e833-ab81-4282-b657-7f89ee7cbaa0 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:32.643682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0258a2-985e-4632-bab9-edbeb1444cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=85daf8b3ee684e01a414941e7b7c768b, user_id=84b9968c1dd3411ca4e8232709346400, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:32.649422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0258a2-985e-4632-bab9-edbeb1444cdf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:32.692765 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2492/5011] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:32 2022] PUT /identity/v3/projects/85daf8b3ee684e01a414941e7b7c768b/users/84b9968c1dd3411ca4e8232709346400/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:32.696379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0258a2-985e-4632-bab9-edbeb1444cdf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:32.702823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2d0258a2-985e-4632-bab9-edbeb1444cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:32.732622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:32.801554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-efc9e833-ab81-4282-b657-7f89ee7cbaa0 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '322a279b318b4472b043d5dd3988c626'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:32.830264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-efc9e833-ab81-4282-b657-7f89ee7cbaa0 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '322a279b318b4472b043d5dd3988c626'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:32.842797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-efc9e833-ab81-4282-b657-7f89ee7cbaa0 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '322a279b318b4472b043d5dd3988c626'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:32.844253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-efc9e833-ab81-4282-b657-7f89ee7cbaa0 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '322a279b318b4472b043d5dd3988c626'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:32.883641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-efc9e833-ab81-4282-b657-7f89ee7cbaa0 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '322a279b318b4472b043d5dd3988c626'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:32.896710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0258a2-985e-4632-bab9-edbeb1444cdf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:32.908668 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2520/5012] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:32 2022] DELETE /identity/v3/users/322a279b318b4472b043d5dd3988c626 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:32.910203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f7ccc-191a-4873-a977-12c0db508a1d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:32.910489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f7ccc-191a-4873-a977-12c0db508a1d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:32.910765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f7ccc-191a-4873-a977-12c0db508a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:32.914276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:32.916249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:32.916697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:32.918007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] PATH_INFO: `/v3/projects/22f2d56477794f8ab38b8e3535b3e8dc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:32.922107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f2d56477794f8ab38b8e3535b3e8dc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:32.926987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:32.961661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fc2f7ccc-191a-4873-a977-12c0db508a1d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:32.963368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fc2f7ccc-191a-4873-a977-12c0db508a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:33.049662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f2d56477794f8ab38b8e3535b3e8dc', 'request_id': 'req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.077516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f2d56477794f8ab38b8e3535b3e8dc', 'request_id': 'req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.091074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:33.102939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f2d56477794f8ab38b8e3535b3e8dc', 'request_id': 'req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.165883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] The token cache is being invalidate because project 22f2d56477794f8ab38b8e3535b3e8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:33.168419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.171055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.176202 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2493/5013] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:32 2022] DELETE /identity/v3/projects/22f2d56477794f8ab38b8e3535b3e8dc => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:33.182137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:33.184993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:33.206490 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2521/5014] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:33.209375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f7ccc-191a-4873-a977-12c0db508a1d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:33.211648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fc2f7ccc-191a-4873-a977-12c0db508a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:33.238738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f7ccc-191a-4873-a977-12c0db508a1d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:33.378709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfad59-eeed-4d76-b8b4-1db1ba7d76bc admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:33.392319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ddd3ddc0b34204bc06d2a2ff91670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef23efee2b049359231ee4d6ac212d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:33.393801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:33.398792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:33.399674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] PATH_INFO: `/v3/users/327649b816344172912128c6f58a9fba` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:33.402659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorizing `identity:delete_user(user_id=327649b816344172912128c6f58a9fba)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:33.416366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:33.435538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:33.436328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:33.437267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:33.438282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] PATH_INFO: `/v3/users/30c940859dc140bc8a8f2bc10a07eaa1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:33.440591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c940859dc140bc8a8f2bc10a07eaa1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:33.447644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:33.524782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327649b816344172912128c6f58a9fba'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.544411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327649b816344172912128c6f58a9fba'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.545306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327649b816344172912128c6f58a9fba'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.547860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327649b816344172912128c6f58a9fba'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.559898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c940859dc140bc8a8f2bc10a07eaa1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.565770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:33.588833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c940859dc140bc8a8f2bc10a07eaa1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.590245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327649b816344172912128c6f58a9fba'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.591502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c940859dc140bc8a8f2bc10a07eaa1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.595361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c940859dc140bc8a8f2bc10a07eaa1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.621109 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2494/5015] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:33 2022] DELETE /identity/v3/users/327649b816344172912128c6f58a9fba => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:33.621810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:33.628153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:33.632857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c940859dc140bc8a8f2bc10a07eaa1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:33.689929 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2522/5016] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:33 2022] DELETE /identity/v3/users/30c940859dc140bc8a8f2bc10a07eaa1 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:33.701431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:33.706228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:33.961405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0ad8f-9d5e-4d1f-b4c4-1c3d33cadd47 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:34.045272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:34.089697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9442876-3efe-4065-9686-544eaea8120c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:34.115477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e970d-9a28-44d0-812f-e81b4c0fe1e4 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ddd3ddc0b34204bc06d2a2ff91670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef23efee2b049359231ee4d6ac212d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:34.116165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e970d-9a28-44d0-812f-e81b4c0fe1e4 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:34.117695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e970d-9a28-44d0-812f-e81b4c0fe1e4 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:34.117695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e970d-9a28-44d0-812f-e81b4c0fe1e4 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] PATH_INFO: `/v3/domains/10b0a27424cc449aadc4bd60dfb362b2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:34.121854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e970d-9a28-44d0-812f-e81b4c0fe1e4 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=10b0a27424cc449aadc4bd60dfb362b2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:34.123503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e970d-9a28-44d0-812f-e81b4c0fe1e4 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:34.200829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707846c-06ec-4756-b482-e5f2f3468a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:34.201927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707846c-06ec-4756-b482-e5f2f3468a25 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:34.203157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707846c-06ec-4756-b482-e5f2f3468a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:34.203713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707846c-06ec-4756-b482-e5f2f3468a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:34.203909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f46e970d-9a28-44d0-812f-e81b4c0fe1e4 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '10b0a27424cc449aadc4bd60dfb362b2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:34.208661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f46e970d-9a28-44d0-812f-e81b4c0fe1e4 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '10b0a27424cc449aadc4bd60dfb362b2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:34.212206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6707846c-06ec-4756-b482-e5f2f3468a25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:34.307861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f46e970d-9a28-44d0-812f-e81b4c0fe1e4 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '10b0a27424cc449aadc4bd60dfb362b2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:34.314194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f46e970d-9a28-44d0-812f-e81b4c0fe1e4 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '10b0a27424cc449aadc4bd60dfb362b2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:34.327193 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2523/5017] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:11:33 2022] PATCH /identity/v3/domains/10b0a27424cc449aadc4bd60dfb362b2 => generated 278 bytes in 637 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:34.328378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e970d-9a28-44d0-812f-e81b4c0fe1e4 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:34.332839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f46e970d-9a28-44d0-812f-e81b4c0fe1e4 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:34.488213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707846c-06ec-4756-b482-e5f2f3468a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:34.491634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707846c-06ec-4756-b482-e5f2f3468a25 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:34.524478 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2495/5018] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 903 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:34.658587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e970d-9a28-44d0-812f-e81b4c0fe1e4 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:34.673256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ddd3ddc0b34204bc06d2a2ff91670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef23efee2b049359231ee4d6ac212d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:34.676925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:34.685821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:34.690743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] PATH_INFO: `/v3/domains/10b0a27424cc449aadc4bd60dfb362b2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:34.761299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707846c-06ec-4756-b482-e5f2f3468a25 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:34.763554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6707846c-06ec-4756-b482-e5f2f3468a25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:34.792652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=10b0a27424cc449aadc4bd60dfb362b2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:34.796280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707846c-06ec-4756-b482-e5f2f3468a25 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:34.799514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:34.902458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '10b0a27424cc449aadc4bd60dfb362b2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:34.919726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:34.949116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '10b0a27424cc449aadc4bd60dfb362b2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.091036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772d075-d1d8-4895-b58d-c395dabbb6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:35.091777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772d075-d1d8-4895-b58d-c395dabbb6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:35.092063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772d075-d1d8-4895-b58d-c395dabbb6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:35.095317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772d075-d1d8-4895-b58d-c395dabbb6ed admin admin] PATH_INFO: `/v3/projects/f606041baa8b453e9f7d1fa1cf4ba72d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:35.101349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772d075-d1d8-4895-b58d-c395dabbb6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f606041baa8b453e9f7d1fa1cf4ba72d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:35.107619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772d075-d1d8-4895-b58d-c395dabbb6ed admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:35.179426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b0a27424cc449aadc4bd60dfb362b2', 'request_id': 'req-75355855-0c0a-45fa-9683-dbffa1169980'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.193145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b0a27424cc449aadc4bd60dfb362b2', 'request_id': 'req-75355855-0c0a-45fa-9683-dbffa1169980'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.204147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b0a27424cc449aadc4bd60dfb362b2', 'request_id': 'req-75355855-0c0a-45fa-9683-dbffa1169980'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.253457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] The token cache is being invalidate because project 10b0a27424cc449aadc4bd60dfb362b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:35.255362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.259044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.290450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '10b0a27424cc449aadc4bd60dfb362b2', 'request_id': 'req-75355855-0c0a-45fa-9683-dbffa1169980'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.302572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8772d075-d1d8-4895-b58d-c395dabbb6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f606041baa8b453e9f7d1fa1cf4ba72d', 'request_id': 'req-8772d075-d1d8-4895-b58d-c395dabbb6ed'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.306256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '10b0a27424cc449aadc4bd60dfb362b2', 'request_id': 'req-75355855-0c0a-45fa-9683-dbffa1169980'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.309517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '10b0a27424cc449aadc4bd60dfb362b2', 'request_id': 'req-75355855-0c0a-45fa-9683-dbffa1169980'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.326235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8772d075-d1d8-4895-b58d-c395dabbb6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f606041baa8b453e9f7d1fa1cf4ba72d', 'request_id': 'req-8772d075-d1d8-4895-b58d-c395dabbb6ed'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.335087 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2524/5019] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:11:34 2022] DELETE /identity/v3/domains/10b0a27424cc449aadc4bd60dfb362b2 => generated 0 bytes in 1007 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:35.339915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:35.342189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:35.346431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8772d075-d1d8-4895-b58d-c395dabbb6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f606041baa8b453e9f7d1fa1cf4ba72d', 'request_id': 'req-8772d075-d1d8-4895-b58d-c395dabbb6ed'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.371469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8772d075-d1d8-4895-b58d-c395dabbb6ed admin admin] The token cache is being invalidate because project f606041baa8b453e9f7d1fa1cf4ba72d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:35.371953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8772d075-d1d8-4895-b58d-c395dabbb6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.374628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8772d075-d1d8-4895-b58d-c395dabbb6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.384523 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2496/5020] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:34 2022] DELETE /identity/v3/projects/f606041baa8b453e9f7d1fa1cf4ba72d => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:35.389326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a79eb-59d1-495b-9437-93aa47dba807 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:35.389681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a79eb-59d1-495b-9437-93aa47dba807 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:35.390031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a79eb-59d1-495b-9437-93aa47dba807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:35.403693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:35.432985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7e2a79eb-59d1-495b-9437-93aa47dba807 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:35.434440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7e2a79eb-59d1-495b-9437-93aa47dba807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:35.514439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75355855-0c0a-45fa-9683-dbffa1169980 tempest-UsersV3TestJSON-1038798918 tempest-UsersV3TestJSON-1038798918-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:35.588854 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2497/5021] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:35.590353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a2faf-7d59-4ffe-82d9-f235644e53b8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:35.590640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a2faf-7d59-4ffe-82d9-f235644e53b8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:35.590918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a2faf-7d59-4ffe-82d9-f235644e53b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:35.659786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a61a2faf-7d59-4ffe-82d9-f235644e53b8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:35.661384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a61a2faf-7d59-4ffe-82d9-f235644e53b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:35.676139 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2498/5022] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:35.678139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a2faf-7d59-4ffe-82d9-f235644e53b8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:35.680598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a61a2faf-7d59-4ffe-82d9-f235644e53b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:35.681093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:35.681956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:35.683955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:35.684314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] PATH_INFO: `/v3/users/43a1dc8f626f4e6b913243e3076cd7ca` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:35.686151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a1dc8f626f4e6b913243e3076cd7ca)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:35.688420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:35.718161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:35.766757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a1dc8f626f4e6b913243e3076cd7ca'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.778644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a1dc8f626f4e6b913243e3076cd7ca'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.779533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a1dc8f626f4e6b913243e3076cd7ca'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.780518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a1dc8f626f4e6b913243e3076cd7ca'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.811491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a1dc8f626f4e6b913243e3076cd7ca'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:35.845511 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2525/5023] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:35 2022] DELETE /identity/v3/users/43a1dc8f626f4e6b913243e3076cd7ca => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:35.845511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:35.846399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:35.878633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a2faf-7d59-4ffe-82d9-f235644e53b8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:36.011090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93467ba0-cf64-4fc3-9c95-a44648c1ee84 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0386384d3125462ea24a129f0ea98136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62b0c61848084eda960cc808fe8c48e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:36.011976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93467ba0-cf64-4fc3-9c95-a44648c1ee84 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:36.012960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93467ba0-cf64-4fc3-9c95-a44648c1ee84 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:36.013376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93467ba0-cf64-4fc3-9c95-a44648c1ee84 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] PATH_INFO: `/v3/projects/0aaef20e865148f2ae4e1bec82862ad5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:36.016917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93467ba0-cf64-4fc3-9c95-a44648c1ee84 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0aaef20e865148f2ae4e1bec82862ad5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:36.024582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93467ba0-cf64-4fc3-9c95-a44648c1ee84 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:36.093858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511c50b-7dc3-4379-8834-7cec64975e3f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:36.122915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82add5f-8f65-4c46-9e39-5b0daafea573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:36.137283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82add5f-8f65-4c46-9e39-5b0daafea573 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:36.137283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82add5f-8f65-4c46-9e39-5b0daafea573 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:36.137283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82add5f-8f65-4c46-9e39-5b0daafea573 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:36.137283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82add5f-8f65-4c46-9e39-5b0daafea573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:36.137283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82add5f-8f65-4c46-9e39-5b0daafea573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:36.137283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82add5f-8f65-4c46-9e39-5b0daafea573 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:36.156541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:36.160508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-93467ba0-cf64-4fc3-9c95-a44648c1ee84 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aaef20e865148f2ae4e1bec82862ad5', 'request_id': 'req-93467ba0-cf64-4fc3-9c95-a44648c1ee84'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:36.183246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-93467ba0-cf64-4fc3-9c95-a44648c1ee84 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aaef20e865148f2ae4e1bec82862ad5', 'request_id': 'req-93467ba0-cf64-4fc3-9c95-a44648c1ee84'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:36.196214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-93467ba0-cf64-4fc3-9c95-a44648c1ee84 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aaef20e865148f2ae4e1bec82862ad5', 'request_id': 'req-93467ba0-cf64-4fc3-9c95-a44648c1ee84'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:36.219664 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2526/5024] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:36.221331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322f21d-2f3e-4968-90a6-d44f53d6765d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:36.221768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322f21d-2f3e-4968-90a6-d44f53d6765d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:36.222043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322f21d-2f3e-4968-90a6-d44f53d6765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:36.230549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-93467ba0-cf64-4fc3-9c95-a44648c1ee84 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] The token cache is being invalidate because project 0aaef20e865148f2ae4e1bec82862ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:36.230848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-93467ba0-cf64-4fc3-9c95-a44648c1ee84 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:36.231823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-93467ba0-cf64-4fc3-9c95-a44648c1ee84 tempest-QuotasNegativeTest-570040240 tempest-QuotasNegativeTest-570040240-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:36.239363 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2499/5025] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:35 2022] DELETE /identity/v3/projects/0aaef20e865148f2ae4e1bec82862ad5 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:36.240892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bddc31-e68c-4fab-a26e-2b67cc27341f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:36.241199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bddc31-e68c-4fab-a26e-2b67cc27341f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:36.241523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bddc31-e68c-4fab-a26e-2b67cc27341f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:36.314800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3322f21d-2f3e-4968-90a6-d44f53d6765d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:36.316742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e8bddc31-e68c-4fab-a26e-2b67cc27341f None None] MFA Rules not processed for user `d78e9afd772c4de981cac8f5817ec356`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:36.318001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e8bddc31-e68c-4fab-a26e-2b67cc27341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:36.320175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3322f21d-2f3e-4968-90a6-d44f53d6765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:36.531143 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2500/5026] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:36.532289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bddc31-e68c-4fab-a26e-2b67cc27341f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:36.533773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e8bddc31-e68c-4fab-a26e-2b67cc27341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:36.587014 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2527/5027] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:36.589693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322f21d-2f3e-4968-90a6-d44f53d6765d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:36.597593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3322f21d-2f3e-4968-90a6-d44f53d6765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:36.659385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322f21d-2f3e-4968-90a6-d44f53d6765d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:36.675541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:36.676062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:36.677993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:36.678583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] PATH_INFO: `/v3/users/fc1f7055ac564592875266de7553ce30` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:36.680215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1f7055ac564592875266de7553ce30)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:36.683064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:36.728324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bddc31-e68c-4fab-a26e-2b67cc27341f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:36.735450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45df96-9e61-44cb-a863-62d872840270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:36.736074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45df96-9e61-44cb-a863-62d872840270 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:36.736355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45df96-9e61-44cb-a863-62d872840270 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:36.736628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45df96-9e61-44cb-a863-62d872840270 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:36.738232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45df96-9e61-44cb-a863-62d872840270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:36.741199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45df96-9e61-44cb-a863-62d872840270 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:36.773642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:36.830935 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2501/5028] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:36 2022] POST /identity/v3/projects => generated 381 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:36.830935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45df96-9e61-44cb-a863-62d872840270 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:36.838278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ff45df96-9e61-44cb-a863-62d872840270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:36.841129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1f7055ac564592875266de7553ce30'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:36.869752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1f7055ac564592875266de7553ce30'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:36.871015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1f7055ac564592875266de7553ce30'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:36.872080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1f7055ac564592875266de7553ce30'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:36.894680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1f7055ac564592875266de7553ce30'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:36.937373 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2528/5029] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:36 2022] DELETE /identity/v3/users/fc1f7055ac564592875266de7553ce30 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:36.940326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:36.945653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:37.054251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45df96-9e61-44cb-a863-62d872840270 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:37.098574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:37.141341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c69bfb-41c4-4e70-b640-446f7add6ba0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:37.157530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24471f4a-cf9a-4667-9c90-fbf81292d961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:37.159945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24471f4a-cf9a-4667-9c90-fbf81292d961 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:37.160260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24471f4a-cf9a-4667-9c90-fbf81292d961 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:37.160717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24471f4a-cf9a-4667-9c90-fbf81292d961 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:37.161397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24471f4a-cf9a-4667-9c90-fbf81292d961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:37.164374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24471f4a-cf9a-4667-9c90-fbf81292d961 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:37.199416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1737ea-c15e-4e11-9e19-407171c6e7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:37.202197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1737ea-c15e-4e11-9e19-407171c6e7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:37.202466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1737ea-c15e-4e11-9e19-407171c6e7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:37.205791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1737ea-c15e-4e11-9e19-407171c6e7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:37.212549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6a1737ea-c15e-4e11-9e19-407171c6e7b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:37.215506 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2529/5030] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:36 2022] POST /identity/v3/users => generated 291 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:37.218804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e6978-3b13-4abd-9c38-d52bbdfc2c28 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:37.219147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e6978-3b13-4abd-9c38-d52bbdfc2c28 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:37.219508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e6978-3b13-4abd-9c38-d52bbdfc2c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:37.259706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1737ea-c15e-4e11-9e19-407171c6e7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:37.261919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1737ea-c15e-4e11-9e19-407171c6e7b8 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:37.289286 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2502/5031] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:37.293584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1737ea-c15e-4e11-9e19-407171c6e7b8 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:37.312555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-aa2e6978-3b13-4abd-9c38-d52bbdfc2c28 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:37.314616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-aa2e6978-3b13-4abd-9c38-d52bbdfc2c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:37.318301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1737ea-c15e-4e11-9e19-407171c6e7b8 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:37.326591 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2530/5032] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:37.331942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921eaf8c-b583-4aa9-be27-0bfe9472fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:37.332651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eaf8c-b583-4aa9-be27-0bfe9472fdfb admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:37.333128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eaf8c-b583-4aa9-be27-0bfe9472fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:37.333486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eaf8c-b583-4aa9-be27-0bfe9472fdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:37.334695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921eaf8c-b583-4aa9-be27-0bfe9472fdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:37.336418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921eaf8c-b583-4aa9-be27-0bfe9472fdfb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:37.338683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e6978-3b13-4abd-9c38-d52bbdfc2c28 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:37.340550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-aa2e6978-3b13-4abd-9c38-d52bbdfc2c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:37.352407 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2503/5033] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:37.353592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921eaf8c-b583-4aa9-be27-0bfe9472fdfb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:37.366556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921eaf8c-b583-4aa9-be27-0bfe9472fdfb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:37.375437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e6978-3b13-4abd-9c38-d52bbdfc2c28 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:37.377032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d866ce-ddc2-45b5-951c-7f56e09245eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:37.377674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d866ce-ddc2-45b5-951c-7f56e09245eb admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:37.378892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d866ce-ddc2-45b5-951c-7f56e09245eb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:37.379168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d866ce-ddc2-45b5-951c-7f56e09245eb admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:37.383194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d866ce-ddc2-45b5-951c-7f56e09245eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:37.384580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81166208-0614-4f86-84d6-234d446937dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:37.385145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81166208-0614-4f86-84d6-234d446937dd service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:37.385434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81166208-0614-4f86-84d6-234d446937dd service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:37.385700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81166208-0614-4f86-84d6-234d446937dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:37.387483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d866ce-ddc2-45b5-951c-7f56e09245eb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:37.411787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81166208-0614-4f86-84d6-234d446937dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:37.418373 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2504/5034] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:37.420717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d866ce-ddc2-45b5-951c-7f56e09245eb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:37.421139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81166208-0614-4f86-84d6-234d446937dd service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:37.444511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d866ce-ddc2-45b5-951c-7f56e09245eb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:37.447860 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2531/5035] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:37.452408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af52b0-9ac1-427b-9c93-c58115e7b875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:37.453166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af52b0-9ac1-427b-9c93-c58115e7b875 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:37.453834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af52b0-9ac1-427b-9c93-c58115e7b875 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:37.453834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af52b0-9ac1-427b-9c93-c58115e7b875 admin admin] PATH_INFO: `/v3/projects/b0a53484c6ab4ea4be7acb5ac53acaa0/users/f77129c9ce5149748c6bd39c69307f76/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:37.481500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af52b0-9ac1-427b-9c93-c58115e7b875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a53484c6ab4ea4be7acb5ac53acaa0, user_id=f77129c9ce5149748c6bd39c69307f76, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:37.486936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af52b0-9ac1-427b-9c93-c58115e7b875 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:37.523682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403750-01be-4763-8fcd-538368d4cea6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:37.524057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403750-01be-4763-8fcd-538368d4cea6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:37.524418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403750-01be-4763-8fcd-538368d4cea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:37.532391 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2505/5036] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:37 2022] PUT /identity/v3/projects/b0a53484c6ab4ea4be7acb5ac53acaa0/users/f77129c9ce5149748c6bd39c69307f76/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:37.571847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c0403750-01be-4763-8fcd-538368d4cea6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:37.576243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c0403750-01be-4763-8fcd-538368d4cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:37.748670 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2532/5037] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:37.787601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af52b0-9ac1-427b-9c93-c58115e7b875 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:37.899755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af52b0-9ac1-427b-9c93-c58115e7b875 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:37.909087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ec6f5-122f-4d96-bdbc-d8b1a0c85861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:37.909740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ec6f5-122f-4d96-bdbc-d8b1a0c85861 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:37.910173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ec6f5-122f-4d96-bdbc-d8b1a0c85861 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:37.910453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ec6f5-122f-4d96-bdbc-d8b1a0c85861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:37.946359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ec6f5-122f-4d96-bdbc-d8b1a0c85861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:37.947833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ec6f5-122f-4d96-bdbc-d8b1a0c85861 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:37.975798 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2506/5038] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:38.178888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403750-01be-4763-8fcd-538368d4cea6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:38.180388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c0403750-01be-4763-8fcd-538368d4cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:38.201730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403750-01be-4763-8fcd-538368d4cea6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:38.223212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:38.223874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:38.224163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:38.229708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] PATH_INFO: `/v3/projects/61b5c27e0ffe4f2aad613093fe8a166c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:38.231006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b5c27e0ffe4f2aad613093fe8a166c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:38.233010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:38.244337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:38.391393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b5c27e0ffe4f2aad613093fe8a166c', 'request_id': 'req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:38.405888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b5c27e0ffe4f2aad613093fe8a166c', 'request_id': 'req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:38.440553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b5c27e0ffe4f2aad613093fe8a166c', 'request_id': 'req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:38.462094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] The token cache is being invalidate because project 61b5c27e0ffe4f2aad613093fe8a166c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:38.462577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:38.463800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:38.466235 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2533/5039] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:38 2022] DELETE /identity/v3/projects/61b5c27e0ffe4f2aad613093fe8a166c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:38.470474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ec6f5-122f-4d96-bdbc-d8b1a0c85861 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:38.482976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ec6f5-122f-4d96-bdbc-d8b1a0c85861 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:38.638452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:38.640543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:38.640927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:38.641108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] PATH_INFO: `/v3/users/0386384d3125462ea24a129f0ea98136` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:38.643666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0386384d3125462ea24a129f0ea98136)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:38.649066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:38.699695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:38.763396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0386384d3125462ea24a129f0ea98136'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:38.787734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0386384d3125462ea24a129f0ea98136'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:38.788765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0386384d3125462ea24a129f0ea98136'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:38.790212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0386384d3125462ea24a129f0ea98136'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:38.832889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0386384d3125462ea24a129f0ea98136'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:38.872531 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2507/5040] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:38 2022] DELETE /identity/v3/users/0386384d3125462ea24a129f0ea98136 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:39.624689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:39.631332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:39.657956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baff01-ecb1-48d9-ad5a-7645d8c1f1bb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:39.783073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:39.784260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:39.784712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:39.785173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] PATH_INFO: `/v3/projects/5686177796a5488ab703e60d1144849e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:39.786574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5686177796a5488ab703e60d1144849e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:39.788883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:39.897235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5686177796a5488ab703e60d1144849e', 'request_id': 'req-6642e273-879e-409c-9da5-eca06c36de56'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:39.911412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5686177796a5488ab703e60d1144849e', 'request_id': 'req-6642e273-879e-409c-9da5-eca06c36de56'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:39.930065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5686177796a5488ab703e60d1144849e', 'request_id': 'req-6642e273-879e-409c-9da5-eca06c36de56'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:39.962921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] The token cache is being invalidate because project 5686177796a5488ab703e60d1144849e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:39.963305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:39.965853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:39.967695 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2534/5041] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:39 2022] DELETE /identity/v3/projects/5686177796a5488ab703e60d1144849e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:39.972761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:39.986289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:40.055908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d41a81-3e7a-43ba-8254-f9bc210a4c88 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:40.224653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b88b3-4da3-4d93-8a28-712347305cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:40.225878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b88b3-4da3-4d93-8a28-712347305cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:40.226217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b88b3-4da3-4d93-8a28-712347305cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:40.226425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b88b3-4da3-4d93-8a28-712347305cc9 admin admin] PATH_INFO: `/v3/users/a9ddd3ddc0b34204bc06d2a2ff91670a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:40.230024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b88b3-4da3-4d93-8a28-712347305cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ddd3ddc0b34204bc06d2a2ff91670a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:40.234726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b88b3-4da3-4d93-8a28-712347305cc9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:40.405465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bc6b88b3-4da3-4d93-8a28-712347305cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ddd3ddc0b34204bc06d2a2ff91670a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:40.423992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bc6b88b3-4da3-4d93-8a28-712347305cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ddd3ddc0b34204bc06d2a2ff91670a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:40.425965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bc6b88b3-4da3-4d93-8a28-712347305cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ddd3ddc0b34204bc06d2a2ff91670a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:40.431399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bc6b88b3-4da3-4d93-8a28-712347305cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ddd3ddc0b34204bc06d2a2ff91670a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:40.497142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bc6b88b3-4da3-4d93-8a28-712347305cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ddd3ddc0b34204bc06d2a2ff91670a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:40.534635 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2508/5042] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:39 2022] DELETE /identity/v3/users/a9ddd3ddc0b34204bc06d2a2ff91670a => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:40.800599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:40.803137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:40.935009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642e273-879e-409c-9da5-eca06c36de56 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:41.051744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:41.207021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:41.209582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:41.212753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:41.212753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd admin admin] PATH_INFO: `/v3/projects/62b0c61848084eda960cc808fe8c48e5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:41.212753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b0c61848084eda960cc808fe8c48e5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:41.215183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:41.348976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b0c61848084eda960cc808fe8c48e5', 'request_id': 'req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:41.371438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b0c61848084eda960cc808fe8c48e5', 'request_id': 'req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:41.390986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b0c61848084eda960cc808fe8c48e5', 'request_id': 'req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:41.429611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd admin admin] The token cache is being invalidate because project 62b0c61848084eda960cc808fe8c48e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:41.430289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:41.431288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-814f4841-0891-47f0-9d6e-4e7cfb13d2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:41.437566 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2535/5043] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:40 2022] DELETE /identity/v3/projects/62b0c61848084eda960cc808fe8c48e5 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:41.438512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69753222-f5f5-4858-a7ba-ee8b51530d2e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:41.438996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69753222-f5f5-4858-a7ba-ee8b51530d2e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:41.439091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69753222-f5f5-4858-a7ba-ee8b51530d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:41.505162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-69753222-f5f5-4858-a7ba-ee8b51530d2e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:41.507416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-69753222-f5f5-4858-a7ba-ee8b51530d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:41.525781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:41.628515 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2509/5044] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:41.640756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736c457-a035-4d39-b94f-d9cfa615df0f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:41.641114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736c457-a035-4d39-b94f-d9cfa615df0f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:41.641475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736c457-a035-4d39-b94f-d9cfa615df0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:41.730975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5736c457-a035-4d39-b94f-d9cfa615df0f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:41.735564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5736c457-a035-4d39-b94f-d9cfa615df0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:41.778272 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2536/5045] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:41.779573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69753222-f5f5-4858-a7ba-ee8b51530d2e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:41.793180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69753222-f5f5-4858-a7ba-ee8b51530d2e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:41.808293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c8df9-3bc5-4446-bb83-c46b4e8ebd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:41.809064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c8df9-3bc5-4446-bb83-c46b4e8ebd3b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:41.809382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c8df9-3bc5-4446-bb83-c46b4e8ebd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:41.809665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c8df9-3bc5-4446-bb83-c46b4e8ebd3b admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:41.810330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c8df9-3bc5-4446-bb83-c46b4e8ebd3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:41.810641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c8df9-3bc5-4446-bb83-c46b4e8ebd3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:41.817572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c8df9-3bc5-4446-bb83-c46b4e8ebd3b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:41.850197 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2510/5046] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:41.851763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736c457-a035-4d39-b94f-d9cfa615df0f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:41.864687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736c457-a035-4d39-b94f-d9cfa615df0f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:41.880221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd3705-00e7-46bf-9ab5-40b376c6c554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:41.888610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd3705-00e7-46bf-9ab5-40b376c6c554 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:41.889149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd3705-00e7-46bf-9ab5-40b376c6c554 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:41.889732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd3705-00e7-46bf-9ab5-40b376c6c554 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:41.890595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd3705-00e7-46bf-9ab5-40b376c6c554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:41.892696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd3705-00e7-46bf-9ab5-40b376c6c554 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:41.984098 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2537/5047] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:41 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:41.984564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c8df9-3bc5-4446-bb83-c46b4e8ebd3b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:42.001734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c8df9-3bc5-4446-bb83-c46b4e8ebd3b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:42.241702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f7713-ac4d-4077-ae2f-45bc315c5774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:42.242478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f7713-ac4d-4077-ae2f-45bc315c5774 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:42.242928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f7713-ac4d-4077-ae2f-45bc315c5774 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:42.243210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f7713-ac4d-4077-ae2f-45bc315c5774 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:42.243854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f7713-ac4d-4077-ae2f-45bc315c5774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:42.246538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f7713-ac4d-4077-ae2f-45bc315c5774 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:42.296887 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2511/5048] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:41 2022] POST /identity/v3/users => generated 289 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:42.301343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd3705-00e7-46bf-9ab5-40b376c6c554 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:42.317338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd3705-00e7-46bf-9ab5-40b376c6c554 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:42.329959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e33c73-71b0-430f-ae3d-bedcf8a302bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:42.330717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e33c73-71b0-430f-ae3d-bedcf8a302bd admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:42.331635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e33c73-71b0-430f-ae3d-bedcf8a302bd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:42.331921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e33c73-71b0-430f-ae3d-bedcf8a302bd admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:42.332582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e33c73-71b0-430f-ae3d-bedcf8a302bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:42.339535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e33c73-71b0-430f-ae3d-bedcf8a302bd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:42.376240 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2538/5049] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:11:42.378262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f7713-ac4d-4077-ae2f-45bc315c5774 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:42.389739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f7713-ac4d-4077-ae2f-45bc315c5774 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:42.409858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9346911-0387-4b4f-b30c-a34696644c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:42.410491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9346911-0387-4b4f-b30c-a34696644c7e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:42.410770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9346911-0387-4b4f-b30c-a34696644c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:42.411414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9346911-0387-4b4f-b30c-a34696644c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:42.412479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9346911-0387-4b4f-b30c-a34696644c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:42.414075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9346911-0387-4b4f-b30c-a34696644c7e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:42.440316 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2512/5050] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:42.445077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e33c73-71b0-430f-ae3d-bedcf8a302bd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:42.461255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e33c73-71b0-430f-ae3d-bedcf8a302bd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:42.494508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f875e-b9f0-41fb-a5d2-a738f0cf03c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:42.497441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f875e-b9f0-41fb-a5d2-a738f0cf03c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:42.497933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f875e-b9f0-41fb-a5d2-a738f0cf03c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:42.498377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f875e-b9f0-41fb-a5d2-a738f0cf03c0 admin admin] PATH_INFO: `/v3/projects/c7038fee40aa4178b648cc857ac40dd4/users/e0e5c31d4f4442a78d8148b0b9bfd9e2/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:42.569268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f875e-b9f0-41fb-a5d2-a738f0cf03c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7038fee40aa4178b648cc857ac40dd4, user_id=e0e5c31d4f4442a78d8148b0b9bfd9e2, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:42.575120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f875e-b9f0-41fb-a5d2-a738f0cf03c0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:42.625074 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2539/5051] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:42 2022] PUT /identity/v3/projects/c7038fee40aa4178b648cc857ac40dd4/users/e0e5c31d4f4442a78d8148b0b9bfd9e2/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:42.625718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b20af9-e874-4bec-a4a5-117447a96d86 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:42.626009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b20af9-e874-4bec-a4a5-117447a96d86 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:42.626286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b20af9-e874-4bec-a4a5-117447a96d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:42.712710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e1b20af9-e874-4bec-a4a5-117447a96d86 None None] MFA Rules not processed for user `e0e5c31d4f4442a78d8148b0b9bfd9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:42.716170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e1b20af9-e874-4bec-a4a5-117447a96d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:42.902765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f875e-b9f0-41fb-a5d2-a738f0cf03c0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:42.905908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d19f875e-b9f0-41fb-a5d2-a738f0cf03c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:42.963706 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2513/5052] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:42.964851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b20af9-e874-4bec-a4a5-117447a96d86 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:42.967643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e1b20af9-e874-4bec-a4a5-117447a96d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:43.013815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:43.107399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b20af9-e874-4bec-a4a5-117447a96d86 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:43.111479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:43.117715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49852-73d5-407f-867d-01f97ffd5973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:43.118699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49852-73d5-407f-867d-01f97ffd5973 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:43.119134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49852-73d5-407f-867d-01f97ffd5973 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:43.119573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49852-73d5-407f-867d-01f97ffd5973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:43.123599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a9d49852-73d5-407f-867d-01f97ffd5973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:43.153851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d49852-73d5-407f-867d-01f97ffd5973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:43.155500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d49852-73d5-407f-867d-01f97ffd5973 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:43.159279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f875e-b9f0-41fb-a5d2-a738f0cf03c0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:43.169876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e1ba4-eb43-43bc-8280-59e4da618196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:43.172481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1ba4-eb43-43bc-8280-59e4da618196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:43.173467 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2514/5053] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:43.173608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1ba4-eb43-43bc-8280-59e4da618196 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:43.173848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1ba4-eb43-43bc-8280-59e4da618196 admin admin] PATH_INFO: `/v3/projects/7ef23efee2b049359231ee4d6ac212d2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:43.174308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49852-73d5-407f-867d-01f97ffd5973 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:43.177096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e1ba4-eb43-43bc-8280-59e4da618196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef23efee2b049359231ee4d6ac212d2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:43.195651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e1ba4-eb43-43bc-8280-59e4da618196 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:43.201275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49852-73d5-407f-867d-01f97ffd5973 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:43.208148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354971e3-d1ee-4fdb-b4ab-d52c6a829c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:43.214776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354971e3-d1ee-4fdb-b4ab-d52c6a829c61 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:43.215721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354971e3-d1ee-4fdb-b4ab-d52c6a829c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:43.215721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354971e3-d1ee-4fdb-b4ab-d52c6a829c61 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:43.216165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354971e3-d1ee-4fdb-b4ab-d52c6a829c61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:43.218213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354971e3-d1ee-4fdb-b4ab-d52c6a829c61 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:43.268246 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2515/5054] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:43 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:43.273339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354971e3-d1ee-4fdb-b4ab-d52c6a829c61 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:43.320418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-de5e1ba4-eb43-43bc-8280-59e4da618196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef23efee2b049359231ee4d6ac212d2', 'request_id': 'req-de5e1ba4-eb43-43bc-8280-59e4da618196'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:43.338930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-de5e1ba4-eb43-43bc-8280-59e4da618196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef23efee2b049359231ee4d6ac212d2', 'request_id': 'req-de5e1ba4-eb43-43bc-8280-59e4da618196'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:43.346363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-de5e1ba4-eb43-43bc-8280-59e4da618196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef23efee2b049359231ee4d6ac212d2', 'request_id': 'req-de5e1ba4-eb43-43bc-8280-59e4da618196'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:43.371577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-de5e1ba4-eb43-43bc-8280-59e4da618196 admin admin] The token cache is being invalidate because project 7ef23efee2b049359231ee4d6ac212d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:43.372043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-de5e1ba4-eb43-43bc-8280-59e4da618196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:43.372839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-de5e1ba4-eb43-43bc-8280-59e4da618196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:43.382391 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2540/5055] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:42 2022] DELETE /identity/v3/projects/7ef23efee2b049359231ee4d6ac212d2 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:43.384279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005729d-46c3-4ccf-b970-a501201b5b71 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:43.384682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005729d-46c3-4ccf-b970-a501201b5b71 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:43.385069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005729d-46c3-4ccf-b970-a501201b5b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:43.398754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354971e3-d1ee-4fdb-b4ab-d52c6a829c61 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:43.434931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b005729d-46c3-4ccf-b970-a501201b5b71 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:43.436498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b005729d-46c3-4ccf-b970-a501201b5b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:43.636579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d27813-4aec-499b-afff-8f9cb9cfd465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:43.637315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d27813-4aec-499b-afff-8f9cb9cfd465 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:43.637513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d27813-4aec-499b-afff-8f9cb9cfd465 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:43.637793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d27813-4aec-499b-afff-8f9cb9cfd465 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:43.651200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d27813-4aec-499b-afff-8f9cb9cfd465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:43.655547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d27813-4aec-499b-afff-8f9cb9cfd465 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:43.664948 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2541/5056] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:43.759116 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2516/5057] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:43 2022] POST /identity/v3/users => generated 294 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:43.764866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005729d-46c3-4ccf-b970-a501201b5b71 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:43.767985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b005729d-46c3-4ccf-b970-a501201b5b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:43.781377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daa0b0-d095-4d61-b34c-29582b78162a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:43.781735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daa0b0-d095-4d61-b34c-29582b78162a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:43.782020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daa0b0-d095-4d61-b34c-29582b78162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:43.822747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-26daa0b0-d095-4d61-b34c-29582b78162a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:43.826002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-26daa0b0-d095-4d61-b34c-29582b78162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:43.861891 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2517/5058] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:11:43.862415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005729d-46c3-4ccf-b970-a501201b5b71 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:43.866796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26daa0b0-d095-4d61-b34c-29582b78162a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:43.897368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26daa0b0-d095-4d61-b34c-29582b78162a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:43.898567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda96657-8880-4d8a-98b5-6a18cf984069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:43.899374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96657-8880-4d8a-98b5-6a18cf984069 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:43.901244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96657-8880-4d8a-98b5-6a18cf984069 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:43.901641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96657-8880-4d8a-98b5-6a18cf984069 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:43.905042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda96657-8880-4d8a-98b5-6a18cf984069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:43.914760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda96657-8880-4d8a-98b5-6a18cf984069 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:43.923917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cad435-d928-4241-b61f-1b2c51188dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:43.924590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cad435-d928-4241-b61f-1b2c51188dec admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:43.924875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cad435-d928-4241-b61f-1b2c51188dec admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:43.925152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cad435-d928-4241-b61f-1b2c51188dec admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:43.926206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cad435-d928-4241-b61f-1b2c51188dec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:43.926525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cad435-d928-4241-b61f-1b2c51188dec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:43.928144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cad435-d928-4241-b61f-1b2c51188dec admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:43.978458 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2542/5059] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:43.996867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda96657-8880-4d8a-98b5-6a18cf984069 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:44.002419 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2518/5060] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:44.009133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cad435-d928-4241-b61f-1b2c51188dec admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:44.064667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cad435-d928-4241-b61f-1b2c51188dec admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:44.068457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda96657-8880-4d8a-98b5-6a18cf984069 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:44.109004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a6e22-7523-469a-b947-9a59b8666f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:44.114170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad572e-a00d-4ab8-b27a-281bbcfa316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:44.114889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad572e-a00d-4ab8-b27a-281bbcfa316c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:44.115168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad572e-a00d-4ab8-b27a-281bbcfa316c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:44.115437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad572e-a00d-4ab8-b27a-281bbcfa316c admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:44.116079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad572e-a00d-4ab8-b27a-281bbcfa316c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:44.118057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad572e-a00d-4ab8-b27a-281bbcfa316c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:44.121400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a6e22-7523-469a-b947-9a59b8666f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:44.121836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a6e22-7523-469a-b947-9a59b8666f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:44.122236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a6e22-7523-469a-b947-9a59b8666f1a admin admin] PATH_INFO: `/v3/projects/144ea108f2a54d1280d88894184b6c98/users/872e262b64ff40948d59e8c36168b895/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:44.163678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:44.223047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a6e22-7523-469a-b947-9a59b8666f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=144ea108f2a54d1280d88894184b6c98, user_id=872e262b64ff40948d59e8c36168b895, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:44.229910 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2519/5061] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:44 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:44.235371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad572e-a00d-4ab8-b27a-281bbcfa316c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:44.260301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a6e22-7523-469a-b947-9a59b8666f1a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:44.329215 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2543/5062] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:43 2022] PUT /identity/v3/projects/144ea108f2a54d1280d88894184b6c98/users/872e262b64ff40948d59e8c36168b895/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:44.332514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a6e22-7523-469a-b947-9a59b8666f1a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:44.431292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad572e-a00d-4ab8-b27a-281bbcfa316c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:44.540618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:44.569962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a6e22-7523-469a-b947-9a59b8666f1a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:44.578736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce43a95-bd1e-4660-8a67-265d3c35cc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:44.579810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce43a95-bd1e-4660-8a67-265d3c35cc60 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:44.580320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce43a95-bd1e-4660-8a67-265d3c35cc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:44.580761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce43a95-bd1e-4660-8a67-265d3c35cc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:44.581885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce43a95-bd1e-4660-8a67-265d3c35cc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:44.584338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce43a95-bd1e-4660-8a67-265d3c35cc60 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:44.608853 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2544/5063] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:44.612418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce43a95-bd1e-4660-8a67-265d3c35cc60 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:44.619550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12c426-5bb1-4a24-8ab3-f0848f62e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:44.621104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12c426-5bb1-4a24-8ab3-f0848f62e2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:44.621472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12c426-5bb1-4a24-8ab3-f0848f62e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:44.621907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12c426-5bb1-4a24-8ab3-f0848f62e2c9 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:44.622897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12c426-5bb1-4a24-8ab3-f0848f62e2c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:44.631998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12c426-5bb1-4a24-8ab3-f0848f62e2c9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:44.648410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce43a95-bd1e-4660-8a67-265d3c35cc60 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:44.659589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb86f4-52d3-4751-a499-2268df95c762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:44.661806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb86f4-52d3-4751-a499-2268df95c762 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:44.662657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb86f4-52d3-4751-a499-2268df95c762 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:44.663296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb86f4-52d3-4751-a499-2268df95c762 admin admin] PATH_INFO: `/v3/projects/144ea108f2a54d1280d88894184b6c98/users/872e262b64ff40948d59e8c36168b895/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:44.670860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb86f4-52d3-4751-a499-2268df95c762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=144ea108f2a54d1280d88894184b6c98, user_id=872e262b64ff40948d59e8c36168b895, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:44.679136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb86f4-52d3-4751-a499-2268df95c762 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:44.695245 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2520/5064] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:44 2022] POST /identity/v3/users => generated 289 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:44.697342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12c426-5bb1-4a24-8ab3-f0848f62e2c9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:44.720993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12c426-5bb1-4a24-8ab3-f0848f62e2c9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:44.733127 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2545/5065] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:44 2022] PUT /identity/v3/projects/144ea108f2a54d1280d88894184b6c98/users/872e262b64ff40948d59e8c36168b895/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:44.738507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12715100-8da9-4cb4-9dbf-85e22ef578d4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:44.740730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12715100-8da9-4cb4-9dbf-85e22ef578d4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:44.741012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12715100-8da9-4cb4-9dbf-85e22ef578d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:44.874324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-12715100-8da9-4cb4-9dbf-85e22ef578d4 None None] MFA Rules not processed for user `872e262b64ff40948d59e8c36168b895`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:44.883825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-12715100-8da9-4cb4-9dbf-85e22ef578d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:44.978159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6f7c0-0276-4153-bf86-10e0e5012fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:44.979769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6f7c0-0276-4153-bf86-10e0e5012fde admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:44.981173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6f7c0-0276-4153-bf86-10e0e5012fde admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:44.983640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6f7c0-0276-4153-bf86-10e0e5012fde admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:44.985153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6f7c0-0276-4153-bf86-10e0e5012fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:44.995160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6f7c0-0276-4153-bf86-10e0e5012fde admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:45.040650 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2521/5066] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:45.043143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6f7c0-0276-4153-bf86-10e0e5012fde admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:45.057718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ceb6f7c0-0276-4153-bf86-10e0e5012fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:45.113812 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2546/5067] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:45.120807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12715100-8da9-4cb4-9dbf-85e22ef578d4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:45.140121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12715100-8da9-4cb4-9dbf-85e22ef578d4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:45.162927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:45.163739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa8fc-725e-4ec3-bb91-5b4140e0fea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:45.164381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa8fc-725e-4ec3-bb91-5b4140e0fea9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:45.164642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa8fc-725e-4ec3-bb91-5b4140e0fea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:45.164967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa8fc-725e-4ec3-bb91-5b4140e0fea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:45.165610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baa8fc-725e-4ec3-bb91-5b4140e0fea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:45.171610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baa8fc-725e-4ec3-bb91-5b4140e0fea9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:45.192125 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2547/5068] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:45.192125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa8fc-725e-4ec3-bb91-5b4140e0fea9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:45.192125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c4baa8fc-725e-4ec3-bb91-5b4140e0fea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:45.252311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6f7c0-0276-4153-bf86-10e0e5012fde admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:45.266982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f0cc9-d904-4714-a54c-2f963bb7469b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:45.268580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f0cc9-d904-4714-a54c-2f963bb7469b service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:45.269126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f0cc9-d904-4714-a54c-2f963bb7469b service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:45.270582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f0cc9-d904-4714-a54c-2f963bb7469b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:45.280036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dc5f0cc9-d904-4714-a54c-2f963bb7469b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:45.349667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa8fc-725e-4ec3-bb91-5b4140e0fea9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:45.357795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0d302-f5af-411d-8466-fc53926cd084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:45.358423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0d302-f5af-411d-8466-fc53926cd084 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:45.358707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0d302-f5af-411d-8466-fc53926cd084 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:45.358981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0d302-f5af-411d-8466-fc53926cd084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:45.363678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ffa0d302-f5af-411d-8466-fc53926cd084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:45.551075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:45.624258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f0cc9-d904-4714-a54c-2f963bb7469b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:45.625399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f0cc9-d904-4714-a54c-2f963bb7469b service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:45.629474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0d302-f5af-411d-8466-fc53926cd084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:45.634027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0d302-f5af-411d-8466-fc53926cd084 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:45.645418 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2522/5069] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:45.647350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f0cc9-d904-4714-a54c-2f963bb7469b service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:45.671992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f0cc9-d904-4714-a54c-2f963bb7469b service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:45.675422 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2548/5070] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:45.680285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0d302-f5af-411d-8466-fc53926cd084 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:45.685215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f8443-f5a6-4a17-a62b-da368643a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:45.688353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f8443-f5a6-4a17-a62b-da368643a104 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:45.688777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f8443-f5a6-4a17-a62b-da368643a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:45.689071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f8443-f5a6-4a17-a62b-da368643a104 admin admin] PATH_INFO: `/v3/projects/5aa138a6d6754834ad7c45a8c40c8e2b/users/61074afbcd8340fb9dac914348cb996f/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:45.705875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0d302-f5af-411d-8466-fc53926cd084 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:45.718331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac9b4e-151f-4046-8cf9-85b32609a727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:45.719098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac9b4e-151f-4046-8cf9-85b32609a727 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:45.719491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac9b4e-151f-4046-8cf9-85b32609a727 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:45.719969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac9b4e-151f-4046-8cf9-85b32609a727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:45.734032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f8443-f5a6-4a17-a62b-da368643a104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa138a6d6754834ad7c45a8c40c8e2b, user_id=61074afbcd8340fb9dac914348cb996f, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:45.745568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f8443-f5a6-4a17-a62b-da368643a104 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:45.752676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac9b4e-151f-4046-8cf9-85b32609a727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:45.759209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac9b4e-151f-4046-8cf9-85b32609a727 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:45.791171 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2523/5071] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:45 2022] PUT /identity/v3/projects/5aa138a6d6754834ad7c45a8c40c8e2b/users/61074afbcd8340fb9dac914348cb996f/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:45.792333 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2549/5072] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:45.804704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0773b3-4615-4cd3-ad70-dced890d5de7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:45.804989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0773b3-4615-4cd3-ad70-dced890d5de7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:45.805283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0773b3-4615-4cd3-ad70-dced890d5de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:45.889053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8a0773b3-4615-4cd3-ad70-dced890d5de7 None None] MFA Rules not processed for user `61074afbcd8340fb9dac914348cb996f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:45.890531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8a0773b3-4615-4cd3-ad70-dced890d5de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:46.190629 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2524/5073] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:46.195891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac9b4e-151f-4046-8cf9-85b32609a727 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:46.218780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac9b4e-151f-4046-8cf9-85b32609a727 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:46.407388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9607e-6f06-4f22-9f6d-7a830e3bf437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:46.409855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9607e-6f06-4f22-9f6d-7a830e3bf437 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:46.411485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9607e-6f06-4f22-9f6d-7a830e3bf437 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:46.412070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9607e-6f06-4f22-9f6d-7a830e3bf437 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:46.412894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9607e-6f06-4f22-9f6d-7a830e3bf437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:46.415324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9607e-6f06-4f22-9f6d-7a830e3bf437 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:46.465035 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2550/5074] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:46 2022] POST /identity/v3/projects => generated 377 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:46.468924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0773b3-4615-4cd3-ad70-dced890d5de7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:46.485081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0773b3-4615-4cd3-ad70-dced890d5de7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:46.551224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:46.634631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd63533-0c06-4a33-94bb-76a772cdcf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:46.637377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd63533-0c06-4a33-94bb-76a772cdcf4b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:46.637877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd63533-0c06-4a33-94bb-76a772cdcf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:46.638394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd63533-0c06-4a33-94bb-76a772cdcf4b admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:46.639281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd63533-0c06-4a33-94bb-76a772cdcf4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:46.641762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd63533-0c06-4a33-94bb-76a772cdcf4b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:46.681572 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2525/5075] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:46 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:46.688526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9607e-6f06-4f22-9f6d-7a830e3bf437 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:46.733800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9607e-6f06-4f22-9f6d-7a830e3bf437 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:46.742399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7471d-d297-438f-a20f-e0d12abfaea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:46.743164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7471d-d297-438f-a20f-e0d12abfaea1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:46.743456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7471d-d297-438f-a20f-e0d12abfaea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:46.743769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7471d-d297-438f-a20f-e0d12abfaea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:46.744521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7471d-d297-438f-a20f-e0d12abfaea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:46.747366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7471d-d297-438f-a20f-e0d12abfaea1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:46.793553 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2551/5076] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:46.798396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd63533-0c06-4a33-94bb-76a772cdcf4b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:46.822652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd63533-0c06-4a33-94bb-76a772cdcf4b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:46.870929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ab34b-fd09-40a4-acbf-fcfd7a187989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:46.876664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ab34b-fd09-40a4-acbf-fcfd7a187989 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:46.877445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ab34b-fd09-40a4-acbf-fcfd7a187989 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:46.877957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ab34b-fd09-40a4-acbf-fcfd7a187989 admin admin] PATH_INFO: `/v3/projects/16e2ed14e7e241e281b1aef68208f6fe/users/14869e7f15984501a32b0989e73ed614/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:46.923760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ab34b-fd09-40a4-acbf-fcfd7a187989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e2ed14e7e241e281b1aef68208f6fe, user_id=14869e7f15984501a32b0989e73ed614, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:46.929251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ab34b-fd09-40a4-acbf-fcfd7a187989 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:46.956680 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2526/5077] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:46 2022] PUT /identity/v3/projects/16e2ed14e7e241e281b1aef68208f6fe/users/14869e7f15984501a32b0989e73ed614/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:46.961040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7471d-d297-438f-a20f-e0d12abfaea1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:46.988655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7471d-d297-438f-a20f-e0d12abfaea1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:47.108948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384030c-eab7-45d9-a19b-d60a0611b01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:47.109638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384030c-eab7-45d9-a19b-d60a0611b01b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:47.109920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384030c-eab7-45d9-a19b-d60a0611b01b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:47.110196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384030c-eab7-45d9-a19b-d60a0611b01b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:47.110865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384030c-eab7-45d9-a19b-d60a0611b01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:47.112502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384030c-eab7-45d9-a19b-d60a0611b01b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:47.138763 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2552/5078] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:47.143234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ab34b-fd09-40a4-acbf-fcfd7a187989 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:47.159505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ab34b-fd09-40a4-acbf-fcfd7a187989 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:47.170048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5f40d-e0d3-4e8a-beb6-71f064bf4374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:47.170752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5f40d-e0d3-4e8a-beb6-71f064bf4374 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:47.171025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5f40d-e0d3-4e8a-beb6-71f064bf4374 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:47.171280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5f40d-e0d3-4e8a-beb6-71f064bf4374 admin admin] PATH_INFO: `/v3/projects/16e2ed14e7e241e281b1aef68208f6fe/users/14869e7f15984501a32b0989e73ed614/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:47.191338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5f40d-e0d3-4e8a-beb6-71f064bf4374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e2ed14e7e241e281b1aef68208f6fe, user_id=14869e7f15984501a32b0989e73ed614, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:47.194278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5f40d-e0d3-4e8a-beb6-71f064bf4374 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:47.223071 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2527/5079] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:47 2022] PUT /identity/v3/projects/16e2ed14e7e241e281b1aef68208f6fe/users/14869e7f15984501a32b0989e73ed614/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:47.235549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5576fd6-e7ca-4d2c-9c79-47e4593747b1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:47.236040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5576fd6-e7ca-4d2c-9c79-47e4593747b1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:47.236252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5576fd6-e7ca-4d2c-9c79-47e4593747b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:47.316969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d5576fd6-e7ca-4d2c-9c79-47e4593747b1 None None] MFA Rules not processed for user `14869e7f15984501a32b0989e73ed614`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:47.323656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d5576fd6-e7ca-4d2c-9c79-47e4593747b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:47.372677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:47.472130 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2553/5080] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:47.477306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5f40d-e0d3-4e8a-beb6-71f064bf4374 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:47.493657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5f40d-e0d3-4e8a-beb6-71f064bf4374 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:47.511779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766e871-416d-40e7-9def-28a9bd5e96e6 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:47.512513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766e871-416d-40e7-9def-28a9bd5e96e6 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:47.512801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766e871-416d-40e7-9def-28a9bd5e96e6 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:47.513297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766e871-416d-40e7-9def-28a9bd5e96e6 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:47.514011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766e871-416d-40e7-9def-28a9bd5e96e6 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:47.515703 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-3766e871-416d-40e7-9def-28a9bd5e96e6 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:11:47.515703 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:11:47.515703 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:11:47.516693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766e871-416d-40e7-9def-28a9bd5e96e6 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:47.543467 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2528/5081] 10.222.0.26 () {60 vars in 1185 bytes} [Sat Oct 8 21:11:47 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:47.547274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5576fd6-e7ca-4d2c-9c79-47e4593747b1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:47.562767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5576fd6-e7ca-4d2c-9c79-47e4593747b1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:47.576556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab702574-dda3-489a-aa2e-b9f58ebc7cc5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:47.577369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab702574-dda3-489a-aa2e-b9f58ebc7cc5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:47.577783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab702574-dda3-489a-aa2e-b9f58ebc7cc5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:47.578177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab702574-dda3-489a-aa2e-b9f58ebc7cc5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/15262b96a10e40198addd8a715a105f9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:47.578872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab702574-dda3-489a-aa2e-b9f58ebc7cc5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=15262b96a10e40198addd8a715a105f9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:47.579955 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-ab702574-dda3-489a-aa2e-b9f58ebc7cc5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:11:47.579955 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:11:47.579955 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:11:47.582913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab702574-dda3-489a-aa2e-b9f58ebc7cc5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:47.604771 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2554/5082] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:11:47 2022] GET /identity/v3/OS-OAUTH1/consumers/15262b96a10e40198addd8a715a105f9 => generated 220 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:47.606292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766e871-416d-40e7-9def-28a9bd5e96e6 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:47.623622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766e871-416d-40e7-9def-28a9bd5e96e6 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:47.635025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:47.635692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:47.635979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:47.636260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/15262b96a10e40198addd8a715a105f9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:47.636859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=15262b96a10e40198addd8a715a105f9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:47.637916 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:11:47.637916 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:11:47.637916 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:11:47.638874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:47.639091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invalidating token cache because consumer 15262b96a10e40198addd8a715a105f9 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:47.639380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:47.641602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:47.675990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '15262b96a10e40198addd8a715a105f9', 'request_id': 'req-53bfa268-9ab5-413a-b644-eecd03403d57'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:47.704364 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2529/5083] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:11:47 2022] DELETE /identity/v3/OS-OAUTH1/consumers/15262b96a10e40198addd8a715a105f9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:47.709782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab702574-dda3-489a-aa2e-b9f58ebc7cc5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:47.713092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ab702574-dda3-489a-aa2e-b9f58ebc7cc5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:47.727459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:47.731212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:47.737530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab702574-dda3-489a-aa2e-b9f58ebc7cc5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:47.745464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c403389-f72a-4be0-9384-f846f378a327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:47.746449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c403389-f72a-4be0-9384-f846f378a327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:47.746947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c403389-f72a-4be0-9384-f846f378a327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:47.747707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c403389-f72a-4be0-9384-f846f378a327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:47.748620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c403389-f72a-4be0-9384-f846f378a327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:47.749873 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-0c403389-f72a-4be0-9384-f846f378a327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:11:47.749873 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:11:47.749873 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:11:47.751742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c403389-f72a-4be0-9384-f846f378a327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:47.780270 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2555/5084] 10.222.0.26 () {60 vars in 1185 bytes} [Sat Oct 8 21:11:47 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:47.781556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c403389-f72a-4be0-9384-f846f378a327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:47.808077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c403389-f72a-4be0-9384-f846f378a327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:47.842494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c7374-3b16-402b-a2e3-4073249f788d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:47.843324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c7374-3b16-402b-a2e3-4073249f788d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:47.843717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c7374-3b16-402b-a2e3-4073249f788d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:47.844630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c7374-3b16-402b-a2e3-4073249f788d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/77385fe9cfe64c5bb5eabd8176feff92` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:47.846340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c7374-3b16-402b-a2e3-4073249f788d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=77385fe9cfe64c5bb5eabd8176feff92)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:47.848073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c7374-3b16-402b-a2e3-4073249f788d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:47.853578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfa268-9ab5-413a-b644-eecd03403d57 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:47.861920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4f752-4725-4b41-b805-0315ae265ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:47.862738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4f752-4725-4b41-b805-0315ae265ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:47.863157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4f752-4725-4b41-b805-0315ae265ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:47.863426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4f752-4725-4b41-b805-0315ae265ecc admin admin] PATH_INFO: `/v3/users/edb2b7e770c540d092b0e06096ddbd1e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:47.865596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4f752-4725-4b41-b805-0315ae265ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb2b7e770c540d092b0e06096ddbd1e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:47.870417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4f752-4725-4b41-b805-0315ae265ecc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:47.874167 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2556/5085] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:11:47 2022] GET /identity/v3/OS-OAUTH1/consumers/77385fe9cfe64c5bb5eabd8176feff92 => generated 221 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:47.875338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c7374-3b16-402b-a2e3-4073249f788d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:47.898708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c7374-3b16-402b-a2e3-4073249f788d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:47.911920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:47.912842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:47.913062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:47.913456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/77385fe9cfe64c5bb5eabd8176feff92` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:47.914155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=77385fe9cfe64c5bb5eabd8176feff92)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:47.915324 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:11:47.915324 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:11:47.915324 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:11:47.919492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:47.921911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invalidating token cache because consumer 77385fe9cfe64c5bb5eabd8176feff92 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:47.922306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:47.923750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:47.972640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '77385fe9cfe64c5bb5eabd8176feff92', 'request_id': 'req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:47.997952 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2557/5086] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:11:47 2022] DELETE /identity/v3/OS-OAUTH1/consumers/77385fe9cfe64c5bb5eabd8176feff92 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:47.999384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:48.002930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:48.035655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:INSERT=7,keystone:DELETE=9 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:48.040341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aaa4f752-4725-4b41-b805-0315ae265ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb2b7e770c540d092b0e06096ddbd1e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:48.045579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f547b-bd61-49bc-8ed9-cb5408e1c342 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:48.058963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aaa4f752-4725-4b41-b805-0315ae265ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb2b7e770c540d092b0e06096ddbd1e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:48.060210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aaa4f752-4725-4b41-b805-0315ae265ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb2b7e770c540d092b0e06096ddbd1e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:48.061030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aaa4f752-4725-4b41-b805-0315ae265ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb2b7e770c540d092b0e06096ddbd1e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:48.064121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bac2a-f808-4c5b-8423-105b6f24dd21 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:48.064924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bac2a-f808-4c5b-8423-105b6f24dd21 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:48.066046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bac2a-f808-4c5b-8423-105b6f24dd21 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:48.066439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bac2a-f808-4c5b-8423-105b6f24dd21 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/77385fe9cfe64c5bb5eabd8176feff92` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:48.068705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bac2a-f808-4c5b-8423-105b6f24dd21 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=77385fe9cfe64c5bb5eabd8176feff92)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:48.072615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bac2a-f808-4c5b-8423-105b6f24dd21 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-7b4bac2a-f808-4c5b-8423-105b6f24dd21 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 08 21:11:48.109450 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 08 21:11:48.110650 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 08 21:11:48.110650 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 08 21:11:48.110650 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 08 21:11:48.110650 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 08 21:11:48.110650 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 08 21:11:48.110650 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 08 21:11:48.110650 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 08 21:11:48.110650 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 08 21:11:48.110650 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:11:48.116356 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2558/5087] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:11:47 2022] GET /identity/v3/OS-OAUTH1/consumers/77385fe9cfe64c5bb5eabd8176feff92 => generated 74 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 21:11:48.117785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bac2a-f808-4c5b-8423-105b6f24dd21 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:48.119799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7b4bac2a-f808-4c5b-8423-105b6f24dd21 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:48.122606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aaa4f752-4725-4b41-b805-0315ae265ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb2b7e770c540d092b0e06096ddbd1e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:48.148289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bac2a-f808-4c5b-8423-105b6f24dd21 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:48.159129 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2530/5088] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:47 2022] DELETE /identity/v3/users/edb2b7e770c540d092b0e06096ddbd1e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:48.160188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e3e8e-8f38-4dec-8a8f-620ada2552f0 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:48.161110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e3e8e-8f38-4dec-8a8f-620ada2552f0 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:48.161699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e3e8e-8f38-4dec-8a8f-620ada2552f0 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:48.163337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e3e8e-8f38-4dec-8a8f-620ada2552f0 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/77385fe9cfe64c5bb5eabd8176feff92` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:48.164068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e3e8e-8f38-4dec-8a8f-620ada2552f0 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=77385fe9cfe64c5bb5eabd8176feff92)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:48.167070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24f8a-a8c1-4182-a42f-169549a2637e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:48.167373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24f8a-a8c1-4182-a42f-169549a2637e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:48.167653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24f8a-a8c1-4182-a42f-169549a2637e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:48.168781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e3e8e-8f38-4dec-8a8f-620ada2552f0 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:48.169180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6d0e3e8e-8f38-4dec-8a8f-620ada2552f0 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invalidating token cache because consumer 77385fe9cfe64c5bb5eabd8176feff92 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:48.170861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6d0e3e8e-8f38-4dec-8a8f-620ada2552f0 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:48.171738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6d0e3e8e-8f38-4dec-8a8f-620ada2552f0 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:48.218402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e6c24f8a-a8c1-4182-a42f-169549a2637e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:48.223030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e6c24f8a-a8c1-4182-a42f-169549a2637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-6d0e3e8e-8f38-4dec-8a8f-620ada2552f0 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 08 21:11:48.223673 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:11:48.225470 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:11:48.225470 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 08 21:11:48.225470 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 08 21:11:48.225470 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 08 21:11:48.225470 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 08 21:11:48.225470 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 08 21:11:48.225470 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 08 21:11:48.225470 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 08 21:11:48.225470 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 08 21:11:48.225470 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 08 21:11:48.225470 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:11:48.229924 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2559/5089] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:11:48 2022] DELETE /identity/v3/OS-OAUTH1/consumers/77385fe9cfe64c5bb5eabd8176feff92 => generated 74 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 21:11:48.233266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e3e8e-8f38-4dec-8a8f-620ada2552f0 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:48.234718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6d0e3e8e-8f38-4dec-8a8f-620ada2552f0 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:48.273322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e3e8e-8f38-4dec-8a8f-620ada2552f0 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:48.411936 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2531/5090] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:48.431744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844ba3-296b-4166-8500-681315e4bf58 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:48.432623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844ba3-296b-4166-8500-681315e4bf58 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:48.432978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844ba3-296b-4166-8500-681315e4bf58 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:48.433374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844ba3-296b-4166-8500-681315e4bf58 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:48.434604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48844ba3-296b-4166-8500-681315e4bf58 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:48.436811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48844ba3-296b-4166-8500-681315e4bf58 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:48.466419 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2560/5091] 10.222.0.26 () {60 vars in 1185 bytes} [Sat Oct 8 21:11:48 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:48.466815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24f8a-a8c1-4182-a42f-169549a2637e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:48.481318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24f8a-a8c1-4182-a42f-169549a2637e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:48.488922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5bf8b-3715-474f-9fc1-70a2d0ab5631 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:48.490047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5bf8b-3715-474f-9fc1-70a2d0ab5631 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:48.491392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5bf8b-3715-474f-9fc1-70a2d0ab5631 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:48.491947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5bf8b-3715-474f-9fc1-70a2d0ab5631 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:48.493038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5bf8b-3715-474f-9fc1-70a2d0ab5631 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:48.495833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844ba3-296b-4166-8500-681315e4bf58 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:48.498468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-48844ba3-296b-4166-8500-681315e4bf58 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:48.510641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5bf8b-3715-474f-9fc1-70a2d0ab5631 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:48.546606 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2532/5092] 10.222.0.26 () {60 vars in 1185 bytes} [Sat Oct 8 21:11:48 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:48.547902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5bf8b-3715-474f-9fc1-70a2d0ab5631 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:48.565041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5bf8b-3715-474f-9fc1-70a2d0ab5631 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:48.572814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d2b54-509d-4418-aeaa-34a08b8b136f tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:48.576360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2b54-509d-4418-aeaa-34a08b8b136f tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:48.577150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2b54-509d-4418-aeaa-34a08b8b136f tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:48.577633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2b54-509d-4418-aeaa-34a08b8b136f tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:48.578525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d2b54-509d-4418-aeaa-34a08b8b136f tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:48.580021 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-0f0d2b54-509d-4418-aeaa-34a08b8b136f tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:11:48.580021 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:11:48.580021 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:11:48.581554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d2b54-509d-4418-aeaa-34a08b8b136f tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:48.588617 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2533/5093] 10.222.0.26 () {58 vars in 1164 bytes} [Sat Oct 8 21:11:48 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:48.594566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d2b54-509d-4418-aeaa-34a08b8b136f tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:48.615794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:48.617773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d2b54-509d-4418-aeaa-34a08b8b136f tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:48.626460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:48.627269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:48.627687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:48.628114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1cff72b16b614d648c6dce803d81ed85` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:48.628872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=1cff72b16b614d648c6dce803d81ed85)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:48.631480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:48.631867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invalidating token cache because consumer 1cff72b16b614d648c6dce803d81ed85 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:48.632358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:48.633569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:48.643569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844ba3-296b-4166-8500-681315e4bf58 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:48.651281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e768aa3-7601-440c-9acc-0bd20227341b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:48.652271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768aa3-7601-440c-9acc-0bd20227341b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:48.652617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768aa3-7601-440c-9acc-0bd20227341b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:48.652834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768aa3-7601-440c-9acc-0bd20227341b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:48.653049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '1cff72b16b614d648c6dce803d81ed85', 'request_id': 'req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:48.657784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2e768aa3-7601-440c-9acc-0bd20227341b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:48.688380 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2534/5094] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:11:48 2022] DELETE /identity/v3/OS-OAUTH1/consumers/1cff72b16b614d648c6dce803d81ed85 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:48.690311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:48.691424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e768aa3-7601-440c-9acc-0bd20227341b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:48.692068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:48.693980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e768aa3-7601-440c-9acc-0bd20227341b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:48.709631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede27d2-f161-4cb0-b65e-7d08f4f0ded5 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:48.715377 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2561/5095] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:11:48.717708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902dcea-c4de-4484-b885-6a47f430a60a tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:48.719650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902dcea-c4de-4484-b885-6a47f430a60a tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:48.720102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902dcea-c4de-4484-b885-6a47f430a60a tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:48.720695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902dcea-c4de-4484-b885-6a47f430a60a tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ec3f1e74dde2424bba6576576bb388b0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:48.722166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902dcea-c4de-4484-b885-6a47f430a60a tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=ec3f1e74dde2424bba6576576bb388b0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:48.724495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902dcea-c4de-4484-b885-6a47f430a60a tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:48.725147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4902dcea-c4de-4484-b885-6a47f430a60a tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invalidating token cache because consumer ec3f1e74dde2424bba6576576bb388b0 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:48.727540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4902dcea-c4de-4484-b885-6a47f430a60a tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:48.729211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4902dcea-c4de-4484-b885-6a47f430a60a tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:48.747643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4902dcea-c4de-4484-b885-6a47f430a60a tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'ec3f1e74dde2424bba6576576bb388b0', 'request_id': 'req-4902dcea-c4de-4484-b885-6a47f430a60a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:48.774987 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2535/5096] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:11:48 2022] DELETE /identity/v3/OS-OAUTH1/consumers/ec3f1e74dde2424bba6576576bb388b0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:48.781217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e768aa3-7601-440c-9acc-0bd20227341b service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:48.804734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e768aa3-7601-440c-9acc-0bd20227341b service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:48.812957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39902c-8fc7-4357-b6cd-20bb4d7855d3 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:48.816520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39902c-8fc7-4357-b6cd-20bb4d7855d3 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:48.816964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39902c-8fc7-4357-b6cd-20bb4d7855d3 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:48.818806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39902c-8fc7-4357-b6cd-20bb4d7855d3 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:48.819916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39902c-8fc7-4357-b6cd-20bb4d7855d3 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:48.822823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39902c-8fc7-4357-b6cd-20bb4d7855d3 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:48.852829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902dcea-c4de-4484-b885-6a47f430a60a tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:48.855420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4902dcea-c4de-4484-b885-6a47f430a60a tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:48.866049 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2562/5097] 10.222.0.26 () {60 vars in 1185 bytes} [Sat Oct 8 21:11:48 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:48.901264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902dcea-c4de-4484-b885-6a47f430a60a tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:48.909278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265cc33-f178-4b69-bb51-518202a4a07e tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:48.910464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265cc33-f178-4b69-bb51-518202a4a07e tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:48.910984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265cc33-f178-4b69-bb51-518202a4a07e tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:48.911562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265cc33-f178-4b69-bb51-518202a4a07e tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/cf9b6e9bc3194407859b217e888782d0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:48.912905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265cc33-f178-4b69-bb51-518202a4a07e tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=cf9b6e9bc3194407859b217e888782d0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:48.914193 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-8265cc33-f178-4b69-bb51-518202a4a07e tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:11:48.914193 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:11:48.914193 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:11:48.915679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265cc33-f178-4b69-bb51-518202a4a07e tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:48.958730 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2536/5098] 10.222.0.26 () {60 vars in 1285 bytes} [Sat Oct 8 21:11:48 2022] PATCH /identity/v3/OS-OAUTH1/consumers/cf9b6e9bc3194407859b217e888782d0 => generated 219 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:48.960492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39902c-8fc7-4357-b6cd-20bb4d7855d3 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:48.976425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39902c-8fc7-4357-b6cd-20bb4d7855d3 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:48.984562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9f90a-18af-4f76-afef-8d8092aec327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:48.985707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9f90a-18af-4f76-afef-8d8092aec327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:48.986269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9f90a-18af-4f76-afef-8d8092aec327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:48.986758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9f90a-18af-4f76-afef-8d8092aec327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/cf9b6e9bc3194407859b217e888782d0` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:48.988024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9f90a-18af-4f76-afef-8d8092aec327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=cf9b6e9bc3194407859b217e888782d0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:48.991299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9f90a-18af-4f76-afef-8d8092aec327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:49.003692 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2563/5099] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:11:48 2022] GET /identity/v3/OS-OAUTH1/consumers/cf9b6e9bc3194407859b217e888782d0 => generated 219 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:49.003915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265cc33-f178-4b69-bb51-518202a4a07e tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:49.020395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265cc33-f178-4b69-bb51-518202a4a07e tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:49.026142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fa8e1-8376-4100-99d8-730c28aaf27d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14869e7f15984501a32b0989e73ed614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16e2ed14e7e241e281b1aef68208f6fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:49.026792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fa8e1-8376-4100-99d8-730c28aaf27d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:49.027065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fa8e1-8376-4100-99d8-730c28aaf27d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:49.027391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fa8e1-8376-4100-99d8-730c28aaf27d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/cf9b6e9bc3194407859b217e888782d0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:49.027987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fa8e1-8376-4100-99d8-730c28aaf27d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=cf9b6e9bc3194407859b217e888782d0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:49.029863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fa8e1-8376-4100-99d8-730c28aaf27d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:49.030139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-081fa8e1-8376-4100-99d8-730c28aaf27d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invalidating token cache because consumer cf9b6e9bc3194407859b217e888782d0 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:49.030416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-081fa8e1-8376-4100-99d8-730c28aaf27d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:49.031099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-081fa8e1-8376-4100-99d8-730c28aaf27d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:49.048498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-081fa8e1-8376-4100-99d8-730c28aaf27d tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'cf9b6e9bc3194407859b217e888782d0', 'request_id': 'req-081fa8e1-8376-4100-99d8-730c28aaf27d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:49.093306 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2537/5100] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:11:49 2022] DELETE /identity/v3/OS-OAUTH1/consumers/cf9b6e9bc3194407859b217e888782d0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:49.094833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9f90a-18af-4f76-afef-8d8092aec327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:49.103770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c0b9f90a-18af-4f76-afef-8d8092aec327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:49.125408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9f90a-18af-4f76-afef-8d8092aec327 tempest-OAUTHConsumersV3Test-1016334773 tempest-OAUTHConsumersV3Test-1016334773-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:49.130971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:49.131698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:49.132043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:49.132381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] PATH_INFO: `/v3/users/61074afbcd8340fb9dac914348cb996f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:49.133659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=61074afbcd8340fb9dac914348cb996f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:49.135703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:49.194300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61074afbcd8340fb9dac914348cb996f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:49.203031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61074afbcd8340fb9dac914348cb996f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:49.203835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61074afbcd8340fb9dac914348cb996f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:49.204527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61074afbcd8340fb9dac914348cb996f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:49.220926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61074afbcd8340fb9dac914348cb996f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:49.238752 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2564/5101] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:49 2022] DELETE /identity/v3/users/61074afbcd8340fb9dac914348cb996f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:49.245293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1dc7d-4e7c-4adf-a2c3-f6617e1c8add None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:49.247053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1dc7d-4e7c-4adf-a2c3-f6617e1c8add None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:49.249009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1dc7d-4e7c-4adf-a2c3-f6617e1c8add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:49.278225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=85,keystone:DELETE=9,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:49.289451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3bd1dc7d-4e7c-4adf-a2c3-f6617e1c8add None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:49.290431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3bd1dc7d-4e7c-4adf-a2c3-f6617e1c8add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:49.448510 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2538/5102] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:49.472335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:49.473911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:49.590440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1073da-a743-401d-a1b6-588f23f9dd7f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:49.597158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817d986-74f6-456d-9c5d-2d028b76f8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:49.598087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817d986-74f6-456d-9c5d-2d028b76f8ea service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:49.598557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817d986-74f6-456d-9c5d-2d028b76f8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:49.599045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817d986-74f6-456d-9c5d-2d028b76f8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:49.612565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817d986-74f6-456d-9c5d-2d028b76f8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:49.614351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817d986-74f6-456d-9c5d-2d028b76f8ea service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:49.636080 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2565/5103] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:50.702905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1dc7d-4e7c-4adf-a2c3-f6617e1c8add None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:50.704536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3bd1dc7d-4e7c-4adf-a2c3-f6617e1c8add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:50.763696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1dc7d-4e7c-4adf-a2c3-f6617e1c8add None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:50.796472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:50.797304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:50.797702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:50.798074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] PATH_INFO: `/v3/projects/a26c456dde0d4002aeceb99e210970fa` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:50.803959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26c456dde0d4002aeceb99e210970fa)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:50.807618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:50.927919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26c456dde0d4002aeceb99e210970fa', 'request_id': 'req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:50.944089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26c456dde0d4002aeceb99e210970fa', 'request_id': 'req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:50.951983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26c456dde0d4002aeceb99e210970fa', 'request_id': 'req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:50.969544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] The token cache is being invalidate because project a26c456dde0d4002aeceb99e210970fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:50.969762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:50.970473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:50.976671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817d986-74f6-456d-9c5d-2d028b76f8ea service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:50.978166 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2539/5104] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:50 2022] DELETE /identity/v3/projects/a26c456dde0d4002aeceb99e210970fa => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:50.990766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817d986-74f6-456d-9c5d-2d028b76f8ea service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:51.045368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:51.073444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:51.074623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:51.075147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:51.075642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] PATH_INFO: `/v3/users/6882b9119020477cb87c8494d972bffa` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:51.077742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6882b9119020477cb87c8494d972bffa)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:51.080236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:51.128586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:51.130167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:51.150357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6882b9119020477cb87c8494d972bffa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.160386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6882b9119020477cb87c8494d972bffa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.160613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c68f0-d2dc-4f7d-a7be-2684e98b115a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:51.162224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6882b9119020477cb87c8494d972bffa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.163502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6882b9119020477cb87c8494d972bffa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.175128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:51.175907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:51.176251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:51.176640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] PATH_INFO: `/v3/projects/5aa138a6d6754834ad7c45a8c40c8e2b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:51.178351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa138a6d6754834ad7c45a8c40c8e2b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:51.180798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6882b9119020477cb87c8494d972bffa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.182226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:51.202638 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2566/5105] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:50 2022] DELETE /identity/v3/users/6882b9119020477cb87c8494d972bffa => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:51.296658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa138a6d6754834ad7c45a8c40c8e2b', 'request_id': 'req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.309097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa138a6d6754834ad7c45a8c40c8e2b', 'request_id': 'req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.332258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa138a6d6754834ad7c45a8c40c8e2b', 'request_id': 'req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.355577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] The token cache is being invalidate because project 5aa138a6d6754834ad7c45a8c40c8e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:51.355918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.356602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.359610 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2540/5106] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:51 2022] DELETE /identity/v3/projects/5aa138a6d6754834ad7c45a8c40c8e2b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:51.364430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:51.367658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:51.530508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec15aae-5ba2-4fb2-b26b-63de282d2519 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:51.617693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:51.618646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:51.619001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:51.619517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] PATH_INFO: `/v3/users/14869e7f15984501a32b0989e73ed614` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:51.620812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14869e7f15984501a32b0989e73ed614)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:51.623121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:51.634130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:51.708988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14869e7f15984501a32b0989e73ed614'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.737265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14869e7f15984501a32b0989e73ed614'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.738047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14869e7f15984501a32b0989e73ed614'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.738654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14869e7f15984501a32b0989e73ed614'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.756148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14869e7f15984501a32b0989e73ed614'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:51.784141 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2567/5107] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:51 2022] DELETE /identity/v3/users/14869e7f15984501a32b0989e73ed614 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:52.208268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:52.209488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:52.233390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7c63a-2b28-4a49-8de4-ce038b36bfcb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:52.263138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:52.341394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ba4f9-9c8b-49ec-a282-81a023a003b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:52.342106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ba4f9-9c8b-49ec-a282-81a023a003b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:52.342392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ba4f9-9c8b-49ec-a282-81a023a003b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:52.342671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ba4f9-9c8b-49ec-a282-81a023a003b0 admin admin] PATH_INFO: `/v3/users/21870fe169dc42359d9bdb149d0016d7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:52.344324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ba4f9-9c8b-49ec-a282-81a023a003b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21870fe169dc42359d9bdb149d0016d7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:52.346337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ba4f9-9c8b-49ec-a282-81a023a003b0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:52.407384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c35ba4f9-9c8b-49ec-a282-81a023a003b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21870fe169dc42359d9bdb149d0016d7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:52.415928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c35ba4f9-9c8b-49ec-a282-81a023a003b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21870fe169dc42359d9bdb149d0016d7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:52.417216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c35ba4f9-9c8b-49ec-a282-81a023a003b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21870fe169dc42359d9bdb149d0016d7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:52.418047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c35ba4f9-9c8b-49ec-a282-81a023a003b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21870fe169dc42359d9bdb149d0016d7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:52.434321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c35ba4f9-9c8b-49ec-a282-81a023a003b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21870fe169dc42359d9bdb149d0016d7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:52.462981 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2541/5108] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:52 2022] DELETE /identity/v3/users/21870fe169dc42359d9bdb149d0016d7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:52.488793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:52.491478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:52.508373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6179ff-3741-42f3-84e1-253b53bb7744 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:52.601316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b31fd1-6135-47f1-82f7-b292ffe48e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:52.603124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b31fd1-6135-47f1-82f7-b292ffe48e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:52.603606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b31fd1-6135-47f1-82f7-b292ffe48e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:52.604265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b31fd1-6135-47f1-82f7-b292ffe48e12 admin admin] PATH_INFO: `/v3/projects/2a8de04d6fa24986aef56a1b8ce71744` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:52.606332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b31fd1-6135-47f1-82f7-b292ffe48e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8de04d6fa24986aef56a1b8ce71744)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:52.608734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b31fd1-6135-47f1-82f7-b292ffe48e12 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:52.678293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35b31fd1-6135-47f1-82f7-b292ffe48e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8de04d6fa24986aef56a1b8ce71744', 'request_id': 'req-35b31fd1-6135-47f1-82f7-b292ffe48e12'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:52.694129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35b31fd1-6135-47f1-82f7-b292ffe48e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8de04d6fa24986aef56a1b8ce71744', 'request_id': 'req-35b31fd1-6135-47f1-82f7-b292ffe48e12'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:52.704259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35b31fd1-6135-47f1-82f7-b292ffe48e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8de04d6fa24986aef56a1b8ce71744', 'request_id': 'req-35b31fd1-6135-47f1-82f7-b292ffe48e12'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:52.720456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35b31fd1-6135-47f1-82f7-b292ffe48e12 admin admin] The token cache is being invalidate because project 2a8de04d6fa24986aef56a1b8ce71744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:52.720821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35b31fd1-6135-47f1-82f7-b292ffe48e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:52.722814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35b31fd1-6135-47f1-82f7-b292ffe48e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:52.727582 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2568/5109] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:52 2022] DELETE /identity/v3/projects/2a8de04d6fa24986aef56a1b8ce71744 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:52.732581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659f838-e314-4e4c-b60b-8952bc56dba0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:52.732922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659f838-e314-4e4c-b60b-8952bc56dba0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:52.733228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659f838-e314-4e4c-b60b-8952bc56dba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:52.758235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6659f838-e314-4e4c-b60b-8952bc56dba0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:52.759698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6659f838-e314-4e4c-b60b-8952bc56dba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:52.855131 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2542/5110] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:52.860776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf48e2a-f73c-4039-9a2b-397a55c5ba1a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:52.861439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf48e2a-f73c-4039-9a2b-397a55c5ba1a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:52.862766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf48e2a-f73c-4039-9a2b-397a55c5ba1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:52.903475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3bf48e2a-f73c-4039-9a2b-397a55c5ba1a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:52.906162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3bf48e2a-f73c-4039-9a2b-397a55c5ba1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:52.917451 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2569/5111] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:52.922348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659f838-e314-4e4c-b60b-8952bc56dba0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:52.944289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659f838-e314-4e4c-b60b-8952bc56dba0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:52.952419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e7eb4-d3de-45a5-9b86-57551e3ef137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:52.953855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e7eb4-d3de-45a5-9b86-57551e3ef137 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:52.955400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e7eb4-d3de-45a5-9b86-57551e3ef137 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:52.955982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e7eb4-d3de-45a5-9b86-57551e3ef137 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:52.958383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e7eb4-d3de-45a5-9b86-57551e3ef137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:52.959249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e7eb4-d3de-45a5-9b86-57551e3ef137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:52.962596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e7eb4-d3de-45a5-9b86-57551e3ef137 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:52.981339 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2543/5112] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:52.986504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf48e2a-f73c-4039-9a2b-397a55c5ba1a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:53.002023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf48e2a-f73c-4039-9a2b-397a55c5ba1a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:53.011023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912615bc-38d3-4e0d-b2d3-c4cbbd7b483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:53.012300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912615bc-38d3-4e0d-b2d3-c4cbbd7b483d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:53.012662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912615bc-38d3-4e0d-b2d3-c4cbbd7b483d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:53.012941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912615bc-38d3-4e0d-b2d3-c4cbbd7b483d admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:53.013625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912615bc-38d3-4e0d-b2d3-c4cbbd7b483d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:53.015790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912615bc-38d3-4e0d-b2d3-c4cbbd7b483d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:53.022099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:53.064703 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2570/5113] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:52 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:53.066344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e7eb4-d3de-45a5-9b86-57551e3ef137 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:53.078057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e7eb4-d3de-45a5-9b86-57551e3ef137 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:53.103364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:53.172341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c268-7b26-47c1-8fc2-065aa013de26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:53.173064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c268-7b26-47c1-8fc2-065aa013de26 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:53.173982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c268-7b26-47c1-8fc2-065aa013de26 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:53.174457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c268-7b26-47c1-8fc2-065aa013de26 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:53.175861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525c268-7b26-47c1-8fc2-065aa013de26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:53.200312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525c268-7b26-47c1-8fc2-065aa013de26 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:53.238246 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2544/5114] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:53 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:53.241420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912615bc-38d3-4e0d-b2d3-c4cbbd7b483d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:53.258772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912615bc-38d3-4e0d-b2d3-c4cbbd7b483d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:53.265466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af049d5-f0ca-4827-b4e6-33524ad85f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:53.266258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af049d5-f0ca-4827-b4e6-33524ad85f3f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:53.266646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af049d5-f0ca-4827-b4e6-33524ad85f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:53.268962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af049d5-f0ca-4827-b4e6-33524ad85f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:53.268962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af049d5-f0ca-4827-b4e6-33524ad85f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:53.269802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af049d5-f0ca-4827-b4e6-33524ad85f3f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:53.291900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c268-7b26-47c1-8fc2-065aa013de26 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:53.304713 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2571/5115] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:53.312512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c268-7b26-47c1-8fc2-065aa013de26 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:53.332941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af049d5-f0ca-4827-b4e6-33524ad85f3f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:53.335802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2af049d5-f0ca-4827-b4e6-33524ad85f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:53.336655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1adb99-2dbd-449b-ab53-4351d58d9cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:53.338318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1adb99-2dbd-449b-ab53-4351d58d9cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:53.338813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1adb99-2dbd-449b-ab53-4351d58d9cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:53.339310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1adb99-2dbd-449b-ab53-4351d58d9cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:53.340719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1adb99-2dbd-449b-ab53-4351d58d9cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:53.342760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1adb99-2dbd-449b-ab53-4351d58d9cd3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:53.358348 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2545/5116] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:53.362975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1adb99-2dbd-449b-ab53-4351d58d9cd3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:53.367156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af049d5-f0ca-4827-b4e6-33524ad85f3f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:53.378976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1adb99-2dbd-449b-ab53-4351d58d9cd3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:53.383140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:53.384804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:53.384954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627613a-f16b-46ed-b537-17da942ea787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:53.385292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:53.385467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] PATH_INFO: `/v3/projects/16e2ed14e7e241e281b1aef68208f6fe` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:53.386479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627613a-f16b-46ed-b537-17da942ea787 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:53.386479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627613a-f16b-46ed-b537-17da942ea787 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:53.386788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627613a-f16b-46ed-b537-17da942ea787 admin admin] PATH_INFO: `/v3/projects/c17b6bdd6f114da181f2e37fd2a98db5/users/1f376598278741bcbd500462c3b5224b/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:53.387094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e2ed14e7e241e281b1aef68208f6fe)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:53.389142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:53.412281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627613a-f16b-46ed-b537-17da942ea787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c17b6bdd6f114da181f2e37fd2a98db5, user_id=1f376598278741bcbd500462c3b5224b, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:53.416340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627613a-f16b-46ed-b537-17da942ea787 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:53.450804 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2546/5117] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:53 2022] PUT /identity/v3/projects/c17b6bdd6f114da181f2e37fd2a98db5/users/1f376598278741bcbd500462c3b5224b/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:53.463300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d10058-4d2f-4189-acdd-4b1d8798ca1c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:53.463701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d10058-4d2f-4189-acdd-4b1d8798ca1c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:53.464409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d10058-4d2f-4189-acdd-4b1d8798ca1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:53.553778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e2ed14e7e241e281b1aef68208f6fe', 'request_id': 'req-94be5e46-af8d-4b57-aac0-53bccce311fd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:53.554328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-23d10058-4d2f-4189-acdd-4b1d8798ca1c None None] MFA Rules not processed for user `1f376598278741bcbd500462c3b5224b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:53.555327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-23d10058-4d2f-4189-acdd-4b1d8798ca1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:53.576124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e2ed14e7e241e281b1aef68208f6fe', 'request_id': 'req-94be5e46-af8d-4b57-aac0-53bccce311fd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:53.602339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e2ed14e7e241e281b1aef68208f6fe', 'request_id': 'req-94be5e46-af8d-4b57-aac0-53bccce311fd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:53.652057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] The token cache is being invalidate because project 16e2ed14e7e241e281b1aef68208f6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:53.652398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:53.657319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:53.659732 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2572/5118] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:53 2022] DELETE /identity/v3/projects/16e2ed14e7e241e281b1aef68208f6fe => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:53.660561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:53.667791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:53.711718 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2547/5119] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:53.713102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2363189-7fee-4c87-89f9-bedc8910c558 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:53.713415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2363189-7fee-4c87-89f9-bedc8910c558 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:53.713686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2363189-7fee-4c87-89f9-bedc8910c558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:53.752830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e2363189-7fee-4c87-89f9-bedc8910c558 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:53.755164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e2363189-7fee-4c87-89f9-bedc8910c558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:53.826190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be5e46-af8d-4b57-aac0-53bccce311fd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:53.840057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186629a-6870-4092-ba2a-cb675fd4d717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:53.840818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186629a-6870-4092-ba2a-cb675fd4d717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:53.841160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186629a-6870-4092-ba2a-cb675fd4d717 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:53.841465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186629a-6870-4092-ba2a-cb675fd4d717 admin admin] PATH_INFO: `/v3/projects/665f66e846c24a6db01274679100bdbf` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:53.845881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186629a-6870-4092-ba2a-cb675fd4d717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=665f66e846c24a6db01274679100bdbf)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:53.851514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186629a-6870-4092-ba2a-cb675fd4d717 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:53.962848 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2548/5120] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:53.966461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2363189-7fee-4c87-89f9-bedc8910c558 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:53.977727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e2363189-7fee-4c87-89f9-bedc8910c558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:53.999332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:54.011550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2363189-7fee-4c87-89f9-bedc8910c558 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:54.033233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0186629a-6870-4092-ba2a-cb675fd4d717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665f66e846c24a6db01274679100bdbf', 'request_id': 'req-0186629a-6870-4092-ba2a-cb675fd4d717'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:54.061043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0186629a-6870-4092-ba2a-cb675fd4d717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665f66e846c24a6db01274679100bdbf', 'request_id': 'req-0186629a-6870-4092-ba2a-cb675fd4d717'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:54.067001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:54.071790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0186629a-6870-4092-ba2a-cb675fd4d717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665f66e846c24a6db01274679100bdbf', 'request_id': 'req-0186629a-6870-4092-ba2a-cb675fd4d717'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:54.103886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0186629a-6870-4092-ba2a-cb675fd4d717 admin admin] The token cache is being invalidate because project 665f66e846c24a6db01274679100bdbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:54.105021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0186629a-6870-4092-ba2a-cb675fd4d717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:54.106168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0186629a-6870-4092-ba2a-cb675fd4d717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:54.108159 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2573/5121] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:53 2022] DELETE /identity/v3/projects/665f66e846c24a6db01274679100bdbf => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:54.112946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dabda-2fe8-45f1-92d8-a70737f531f8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:54.113551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dabda-2fe8-45f1-92d8-a70737f531f8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:54.114065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dabda-2fe8-45f1-92d8-a70737f531f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:54.140784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8f7dabda-2fe8-45f1-92d8-a70737f531f8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:54.144429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f7dabda-2fe8-45f1-92d8-a70737f531f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:54.181940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57347048-11aa-4566-8759-a6cce772860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:54.182698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57347048-11aa-4566-8759-a6cce772860c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:54.183084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57347048-11aa-4566-8759-a6cce772860c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:54.183466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57347048-11aa-4566-8759-a6cce772860c admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:54.185343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57347048-11aa-4566-8759-a6cce772860c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:54.189686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57347048-11aa-4566-8759-a6cce772860c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:54.249732 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2549/5122] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:53 2022] POST /identity/v3/projects => generated 379 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:54.252187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b6195-23d1-4884-884e-ff9354f9a882 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:54.252922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b6195-23d1-4884-884e-ff9354f9a882 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:54.253509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b6195-23d1-4884-884e-ff9354f9a882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:54.289807 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2574/5123] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:54.291435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dabda-2fe8-45f1-92d8-a70737f531f8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:54.294964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f7dabda-2fe8-45f1-92d8-a70737f531f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:54.307314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bd2b6195-23d1-4884-884e-ff9354f9a882 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:54.308671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bd2b6195-23d1-4884-884e-ff9354f9a882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:54.318789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dabda-2fe8-45f1-92d8-a70737f531f8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:54.455038 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2550/5124] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:54.456328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b6195-23d1-4884-884e-ff9354f9a882 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:54.481181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724d8d5-ac58-4ef4-8473-5c2d8af5423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:54.482295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724d8d5-ac58-4ef4-8473-5c2d8af5423e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:54.484582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724d8d5-ac58-4ef4-8473-5c2d8af5423e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:54.485491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724d8d5-ac58-4ef4-8473-5c2d8af5423e admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:54.488738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724d8d5-ac58-4ef4-8473-5c2d8af5423e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:54.495662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724d8d5-ac58-4ef4-8473-5c2d8af5423e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:54.497131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b6195-23d1-4884-884e-ff9354f9a882 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:54.515984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55d9e1-7b63-4114-9ae0-d17237e5fe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:54.516623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d9e1-7b63-4114-9ae0-d17237e5fe2f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:54.516906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d9e1-7b63-4114-9ae0-d17237e5fe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:54.517196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d9e1-7b63-4114-9ae0-d17237e5fe2f admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:54.517876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55d9e1-7b63-4114-9ae0-d17237e5fe2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:54.518161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55d9e1-7b63-4114-9ae0-d17237e5fe2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:54.530470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55d9e1-7b63-4114-9ae0-d17237e5fe2f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:54.573095 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2575/5125] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:54 2022] POST /identity/v3/users => generated 296 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:54.573095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb6817-4f92-4d23-a61a-9a0410e507c5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:54.573095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb6817-4f92-4d23-a61a-9a0410e507c5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:54.573095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb6817-4f92-4d23-a61a-9a0410e507c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:54.585259 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2551/5126] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:54.587667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55d9e1-7b63-4114-9ae0-d17237e5fe2f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:54.605487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55d9e1-7b63-4114-9ae0-d17237e5fe2f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:54.628976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cafb6817-4f92-4d23-a61a-9a0410e507c5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:54.629612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927f44e-f7ca-4731-87b2-69f9b30e8cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:54.632586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927f44e-f7ca-4731-87b2-69f9b30e8cab admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:54.632835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cafb6817-4f92-4d23-a61a-9a0410e507c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:54.635134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927f44e-f7ca-4731-87b2-69f9b30e8cab admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:54.635667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927f44e-f7ca-4731-87b2-69f9b30e8cab admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:54.636547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927f44e-f7ca-4731-87b2-69f9b30e8cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:54.639273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927f44e-f7ca-4731-87b2-69f9b30e8cab admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:54.665767 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2576/5127] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:54.665767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb6817-4f92-4d23-a61a-9a0410e507c5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:54.678550 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2552/5128] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:54.682312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927f44e-f7ca-4731-87b2-69f9b30e8cab admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:54.685051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb6817-4f92-4d23-a61a-9a0410e507c5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:54.703045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44b643-cdfc-48bc-9819-a365b70f2c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:54.703713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44b643-cdfc-48bc-9819-a365b70f2c66 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:54.703992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44b643-cdfc-48bc-9819-a365b70f2c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:54.704772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44b643-cdfc-48bc-9819-a365b70f2c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:54.704922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44b643-cdfc-48bc-9819-a365b70f2c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:54.708102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44b643-cdfc-48bc-9819-a365b70f2c66 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:54.715744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927f44e-f7ca-4731-87b2-69f9b30e8cab admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:54.731202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fc946-3385-4157-a0f9-c7c239999d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:54.735743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fc946-3385-4157-a0f9-c7c239999d07 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:54.736292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fc946-3385-4157-a0f9-c7c239999d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:54.736775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fc946-3385-4157-a0f9-c7c239999d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:54.738562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fc946-3385-4157-a0f9-c7c239999d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:54.741500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fc946-3385-4157-a0f9-c7c239999d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:54.747097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fc946-3385-4157-a0f9-c7c239999d07 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:54.780907 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2553/5129] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:54.782290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fc946-3385-4157-a0f9-c7c239999d07 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:54.784984 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2577/5130] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:54 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:54.785910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44b643-cdfc-48bc-9819-a365b70f2c66 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:54.819085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fc946-3385-4157-a0f9-c7c239999d07 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:54.929179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:54.955662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44b643-cdfc-48bc-9819-a365b70f2c66 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:54.960788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:54.982490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228c801-c7cb-4760-b26c-eeac9da86c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:54.985322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8efaf7-30f9-4e42-9149-a1b4a1fa955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:54.988681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228c801-c7cb-4760-b26c-eeac9da86c09 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:54.989043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228c801-c7cb-4760-b26c-eeac9da86c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:54.990453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228c801-c7cb-4760-b26c-eeac9da86c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:54.990879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8efaf7-30f9-4e42-9149-a1b4a1fa955e admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:54.991597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8efaf7-30f9-4e42-9149-a1b4a1fa955e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:54.991935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8efaf7-30f9-4e42-9149-a1b4a1fa955e admin admin] PATH_INFO: `/v3/projects/c8761ca56c944d5da36df2954034cc8b/users/7f774a81bec24c9a8ccd7720429026c4/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:54.994024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228c801-c7cb-4760-b26c-eeac9da86c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:54.998283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228c801-c7cb-4760-b26c-eeac9da86c09 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:55.036220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8efaf7-30f9-4e42-9149-a1b4a1fa955e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8761ca56c944d5da36df2954034cc8b, user_id=7f774a81bec24c9a8ccd7720429026c4, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:55.046936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8efaf7-30f9-4e42-9149-a1b4a1fa955e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:55.067651 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2578/5131] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:54 2022] POST /identity/v3/projects => generated 387 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:55.067651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228c801-c7cb-4760-b26c-eeac9da86c09 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:55.082146 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2554/5132] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:54 2022] PUT /identity/v3/projects/c8761ca56c944d5da36df2954034cc8b/users/7f774a81bec24c9a8ccd7720429026c4/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:55.083058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8efaf7-30f9-4e42-9149-a1b4a1fa955e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:55.241041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8efaf7-30f9-4e42-9149-a1b4a1fa955e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:55.254345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1b4e7-80f4-467a-bf72-e9b884f1b2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:55.256709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b4e7-80f4-467a-bf72-e9b884f1b2db admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:55.257440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b4e7-80f4-467a-bf72-e9b884f1b2db admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:55.257770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b4e7-80f4-467a-bf72-e9b884f1b2db admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:55.261238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1b4e7-80f4-467a-bf72-e9b884f1b2db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:55.264557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1b4e7-80f4-467a-bf72-e9b884f1b2db admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:55.305062 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2555/5133] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:55 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:55.305062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1b4e7-80f4-467a-bf72-e9b884f1b2db admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:55.317312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1b4e7-80f4-467a-bf72-e9b884f1b2db admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:55.322920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49bb56-0ea9-4274-9d36-95acae138183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:55.323541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49bb56-0ea9-4274-9d36-95acae138183 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:55.324069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49bb56-0ea9-4274-9d36-95acae138183 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:55.324345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49bb56-0ea9-4274-9d36-95acae138183 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:55.325476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228c801-c7cb-4760-b26c-eeac9da86c09 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:55.325609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49bb56-0ea9-4274-9d36-95acae138183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:55.341841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49bb56-0ea9-4274-9d36-95acae138183 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:55.343847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e05178-0f74-4ba7-aed7-09e0a47f21c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:55.344870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e05178-0f74-4ba7-aed7-09e0a47f21c4 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:55.345156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e05178-0f74-4ba7-aed7-09e0a47f21c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:55.345460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e05178-0f74-4ba7-aed7-09e0a47f21c4 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:55.346108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e05178-0f74-4ba7-aed7-09e0a47f21c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:55.348138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e05178-0f74-4ba7-aed7-09e0a47f21c4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:55.360445 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2556/5134] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:55.361446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49bb56-0ea9-4274-9d36-95acae138183 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:55.378078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49bb56-0ea9-4274-9d36-95acae138183 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:55.391587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c389890-1307-45f6-a90c-fe45cc367fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:55.392260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c389890-1307-45f6-a90c-fe45cc367fac admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:55.392562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c389890-1307-45f6-a90c-fe45cc367fac admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:55.393133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c389890-1307-45f6-a90c-fe45cc367fac admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:55.403379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c389890-1307-45f6-a90c-fe45cc367fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:55.407782 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2579/5135] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:55 2022] POST /identity/v3/users => generated 284 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:55.407951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c389890-1307-45f6-a90c-fe45cc367fac admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:55.408063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e05178-0f74-4ba7-aed7-09e0a47f21c4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:55.424723 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2557/5136] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:55.424723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c389890-1307-45f6-a90c-fe45cc367fac admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:55.427849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e05178-0f74-4ba7-aed7-09e0a47f21c4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:55.441901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37947ed7-ffea-4d0a-8efc-056e657e34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:55.442597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37947ed7-ffea-4d0a-8efc-056e657e34e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:55.443488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37947ed7-ffea-4d0a-8efc-056e657e34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:55.443682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c389890-1307-45f6-a90c-fe45cc367fac admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:55.443806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37947ed7-ffea-4d0a-8efc-056e657e34e4 admin admin] PATH_INFO: `/v3/projects/c8761ca56c944d5da36df2954034cc8b/users/7f774a81bec24c9a8ccd7720429026c4/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:55.447554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37947ed7-ffea-4d0a-8efc-056e657e34e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8761ca56c944d5da36df2954034cc8b, user_id=7f774a81bec24c9a8ccd7720429026c4, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:55.449290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86298c-2dca-4c5f-b395-fe8d7dc7a1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:55.450317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86298c-2dca-4c5f-b395-fe8d7dc7a1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:55.450608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86298c-2dca-4c5f-b395-fe8d7dc7a1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:55.450882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86298c-2dca-4c5f-b395-fe8d7dc7a1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:55.451545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86298c-2dca-4c5f-b395-fe8d7dc7a1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:55.453920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86298c-2dca-4c5f-b395-fe8d7dc7a1a4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:55.456986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37947ed7-ffea-4d0a-8efc-056e657e34e4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:55.473388 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2558/5137] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:55.473388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86298c-2dca-4c5f-b395-fe8d7dc7a1a4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:55.488371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86298c-2dca-4c5f-b395-fe8d7dc7a1a4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:55.500769 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2580/5138] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:55 2022] PUT /identity/v3/projects/c8761ca56c944d5da36df2954034cc8b/users/7f774a81bec24c9a8ccd7720429026c4/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:55.501726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37947ed7-ffea-4d0a-8efc-056e657e34e4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:55.616759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029493c-524d-46f3-8faa-c01fce51c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:55.617462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029493c-524d-46f3-8faa-c01fce51c2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:55.617748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029493c-524d-46f3-8faa-c01fce51c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:55.618023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029493c-524d-46f3-8faa-c01fce51c2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:55.618681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029493c-524d-46f3-8faa-c01fce51c2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:55.621468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029493c-524d-46f3-8faa-c01fce51c2e5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:55.635353 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2559/5139] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:55.636778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca320f8-1882-455d-a536-40de5944806f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:55.636961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca320f8-1882-455d-a536-40de5944806f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:55.637271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca320f8-1882-455d-a536-40de5944806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:55.646950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37947ed7-ffea-4d0a-8efc-056e657e34e4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:55.662093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f007dd-10fe-4e20-b596-6466802c03d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:55.662743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f007dd-10fe-4e20-b596-6466802c03d0 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:55.663037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f007dd-10fe-4e20-b596-6466802c03d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:55.663306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f007dd-10fe-4e20-b596-6466802c03d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:55.663974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f007dd-10fe-4e20-b596-6466802c03d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:55.665637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f007dd-10fe-4e20-b596-6466802c03d0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:55.673088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-eca320f8-1882-455d-a536-40de5944806f None None] MFA Rules not processed for user `7f774a81bec24c9a8ccd7720429026c4`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:55.675486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eca320f8-1882-455d-a536-40de5944806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:55.687952 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2581/5140] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:55.696901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f007dd-10fe-4e20-b596-6466802c03d0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:55.704798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:55.723401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f007dd-10fe-4e20-b596-6466802c03d0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:55.737889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729135c-bbb4-423c-8ad2-596079d57f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:55.742381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729135c-bbb4-423c-8ad2-596079d57f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:55.743305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729135c-bbb4-423c-8ad2-596079d57f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:55.745069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729135c-bbb4-423c-8ad2-596079d57f53 admin admin] PATH_INFO: `/v3/projects/f8aa88ec28bc4f8b9fe34ea3e5080126/users/80dd3d24ba324a338912df952c94fc03/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:55.783873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729135c-bbb4-423c-8ad2-596079d57f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8aa88ec28bc4f8b9fe34ea3e5080126, user_id=80dd3d24ba324a338912df952c94fc03, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:55.786987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729135c-bbb4-423c-8ad2-596079d57f53 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:55.810393 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2582/5141] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:55 2022] PUT /identity/v3/projects/f8aa88ec28bc4f8b9fe34ea3e5080126/users/80dd3d24ba324a338912df952c94fc03/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:55.811243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729135c-bbb4-423c-8ad2-596079d57f53 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:55.840731 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2560/5142] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:55.842522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1905c6-0073-4832-b57a-0d4902bee2d4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:55.843461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1905c6-0073-4832-b57a-0d4902bee2d4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:55.843897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1905c6-0073-4832-b57a-0d4902bee2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:55.892738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:55.897016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fd1905c6-0073-4832-b57a-0d4902bee2d4 None None] MFA Rules not processed for user `80dd3d24ba324a338912df952c94fc03`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:55.900044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fd1905c6-0073-4832-b57a-0d4902bee2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:55.966301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729135c-bbb4-423c-8ad2-596079d57f53 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:55.980561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b7981-5c00-485a-963d-fccb564b4271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:55.981472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b7981-5c00-485a-963d-fccb564b4271 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:55.981760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b7981-5c00-485a-963d-fccb564b4271 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:55.982049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b7981-5c00-485a-963d-fccb564b4271 admin admin] PATH_INFO: `/v3/projects/a13b1a0f52f544bb814639340648d661/users/62c423d0e55249e3bd3015aa9a6aaa29/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:56.011484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b7981-5c00-485a-963d-fccb564b4271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13b1a0f52f544bb814639340648d661, user_id=62c423d0e55249e3bd3015aa9a6aaa29, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:56.015128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b7981-5c00-485a-963d-fccb564b4271 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:56.037994 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2583/5143] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:55 2022] PUT /identity/v3/projects/a13b1a0f52f544bb814639340648d661/users/62c423d0e55249e3bd3015aa9a6aaa29/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:56.038806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b7981-5c00-485a-963d-fccb564b4271 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:56.040676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e53b7981-5c00-485a-963d-fccb564b4271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:56.127600 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2561/5144] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:56.128650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503d6af-42eb-4dc6-bee8-65b1af631f8a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:56.129249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503d6af-42eb-4dc6-bee8-65b1af631f8a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:56.131382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503d6af-42eb-4dc6-bee8-65b1af631f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:56.180275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6503d6af-42eb-4dc6-bee8-65b1af631f8a None None] MFA Rules not processed for user `62c423d0e55249e3bd3015aa9a6aaa29`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:56.183621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6503d6af-42eb-4dc6-bee8-65b1af631f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:56.198970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b7981-5c00-485a-963d-fccb564b4271 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:56.214315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e191d-6c9d-49b7-8532-389607ed0ca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:56.214959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e191d-6c9d-49b7-8532-389607ed0ca8 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:56.215248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e191d-6c9d-49b7-8532-389607ed0ca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:56.215524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e191d-6c9d-49b7-8532-389607ed0ca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:56.325662 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2562/5145] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:56.330295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503d6af-42eb-4dc6-bee8-65b1af631f8a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:56.354831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e191d-6c9d-49b7-8532-389607ed0ca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:56.360258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e191d-6c9d-49b7-8532-389607ed0ca8 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:56.399462 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2584/5146] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:56.406729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e191d-6c9d-49b7-8532-389607ed0ca8 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:56.430888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e191d-6c9d-49b7-8532-389607ed0ca8 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:56.437131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe0a18-355c-44de-a6b0-37310792308d tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c423d0e55249e3bd3015aa9a6aaa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a13b1a0f52f544bb814639340648d661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:56.437846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe0a18-355c-44de-a6b0-37310792308d tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:56.438310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe0a18-355c-44de-a6b0-37310792308d tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:56.439559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe0a18-355c-44de-a6b0-37310792308d tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] PATH_INFO: `/v3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:56.441385 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2585/5147] 10.222.0.26 () {58 vars in 1104 bytes} [Sat Oct 8 21:11:56 2022] GET /identity/v3 => generated 255 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:56.446822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe0a18-355c-44de-a6b0-37310792308d tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:56.472280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe0a18-355c-44de-a6b0-37310792308d tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:56.484492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aeaac-d65a-4358-b95d-c3b3ff8445fc tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c423d0e55249e3bd3015aa9a6aaa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a13b1a0f52f544bb814639340648d661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:56.485051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aeaac-d65a-4358-b95d-c3b3ff8445fc tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:56.485381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aeaac-d65a-4358-b95d-c3b3ff8445fc tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:56.485775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aeaac-d65a-4358-b95d-c3b3ff8445fc tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] PATH_INFO: `/v3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:56.487490 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2586/5148] 10.222.0.26 () {58 vars in 1104 bytes} [Sat Oct 8 21:11:56 2022] GET /identity/v3 => generated 255 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:56.495005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aeaac-d65a-4358-b95d-c3b3ff8445fc tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:56.508519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:56.532383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aeaac-d65a-4358-b95d-c3b3ff8445fc tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:56.550143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02a058-9e11-4b64-b26c-b6194890109b tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c423d0e55249e3bd3015aa9a6aaa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a13b1a0f52f544bb814639340648d661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:56.551328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a058-9e11-4b64-b26c-b6194890109b tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:56.551676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a058-9e11-4b64-b26c-b6194890109b tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:56.552851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a058-9e11-4b64-b26c-b6194890109b tempest-TestApiDiscovery-358136933 tempest-TestApiDiscovery-358136933-project] PATH_INFO: `/v3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:56.560210 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2587/5149] 10.222.0.26 () {58 vars in 1104 bytes} [Sat Oct 8 21:11:56 2022] GET /identity/v3 => generated 255 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:56.567452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5d57a-6afa-4374-80fa-090df9c2a2e0 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:56.567812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5d57a-6afa-4374-80fa-090df9c2a2e0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:56.568099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5d57a-6afa-4374-80fa-090df9c2a2e0 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:56.569519 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2588/5150] 10.222.0.26 () {56 vars in 895 bytes} [Sat Oct 8 21:11:56 2022] GET /identity/ => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 21:11:56.575132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f964ea1-b11f-4840-8fde-3e85bcabf4a8 None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:56.575456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f964ea1-b11f-4840-8fde-3e85bcabf4a8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:56.575898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f964ea1-b11f-4840-8fde-3e85bcabf4a8 None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:56.580699 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2589/5151] 10.222.0.26 () {56 vars in 895 bytes} [Sat Oct 8 21:11:56 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 21:11:56.582270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f964ea1-b11f-4840-8fde-3e85bcabf4a8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:56.584335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503d6af-42eb-4dc6-bee8-65b1af631f8a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:56.604282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1200fb7-69ed-4847-987d-418adea23285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:56.605731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1200fb7-69ed-4847-987d-418adea23285 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:56.606370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1200fb7-69ed-4847-987d-418adea23285 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:56.607144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1200fb7-69ed-4847-987d-418adea23285 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:56.609147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1200fb7-69ed-4847-987d-418adea23285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:56.616357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1200fb7-69ed-4847-987d-418adea23285 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:56.623432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f964ea1-b11f-4840-8fde-3e85bcabf4a8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:56.644710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04833e4-064f-43ee-a2d3-dce1905e28f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:56.645433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04833e4-064f-43ee-a2d3-dce1905e28f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:56.645794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04833e4-064f-43ee-a2d3-dce1905e28f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:56.646684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04833e4-064f-43ee-a2d3-dce1905e28f9 admin admin] PATH_INFO: `/v3/users/62c423d0e55249e3bd3015aa9a6aaa29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:56.650063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04833e4-064f-43ee-a2d3-dce1905e28f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62c423d0e55249e3bd3015aa9a6aaa29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:56.652621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04833e4-064f-43ee-a2d3-dce1905e28f9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:56.697535 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2563/5152] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:56 2022] POST /identity/v3/projects => generated 385 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:56.699450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1200fb7-69ed-4847-987d-418adea23285 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:56.776406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:56.797399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a04833e4-064f-43ee-a2d3-dce1905e28f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62c423d0e55249e3bd3015aa9a6aaa29'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:56.827101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a04833e4-064f-43ee-a2d3-dce1905e28f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62c423d0e55249e3bd3015aa9a6aaa29'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:56.827885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a04833e4-064f-43ee-a2d3-dce1905e28f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62c423d0e55249e3bd3015aa9a6aaa29'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:56.833776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a04833e4-064f-43ee-a2d3-dce1905e28f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62c423d0e55249e3bd3015aa9a6aaa29'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:56.886112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a04833e4-064f-43ee-a2d3-dce1905e28f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62c423d0e55249e3bd3015aa9a6aaa29'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:56.888199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1200fb7-69ed-4847-987d-418adea23285 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:56.909428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb22da-7adb-434e-a62c-dc08e89ddf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:56.913706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb22da-7adb-434e-a62c-dc08e89ddf51 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:56.914007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb22da-7adb-434e-a62c-dc08e89ddf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:56.914595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb22da-7adb-434e-a62c-dc08e89ddf51 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:56.916362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb22da-7adb-434e-a62c-dc08e89ddf51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:56.920592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb22da-7adb-434e-a62c-dc08e89ddf51 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:56.957966 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2590/5153] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:56 2022] DELETE /identity/v3/users/62c423d0e55249e3bd3015aa9a6aaa29 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:56.962589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48389da-7e47-466b-86db-c042c60e7f50 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:56.963224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48389da-7e47-466b-86db-c042c60e7f50 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:56.965091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48389da-7e47-466b-86db-c042c60e7f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:56.994711 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2564/5154] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:11:56 2022] POST /identity/v3/users => generated 299 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:56.997461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fb324-39d2-4129-be85-d8d346018886 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:57.000965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fb324-39d2-4129-be85-d8d346018886 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:57.001423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fb324-39d2-4129-be85-d8d346018886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:57.071128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7a3fb324-39d2-4129-be85-d8d346018886 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:57.078069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7a3fb324-39d2-4129-be85-d8d346018886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:57.093463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f48389da-7e47-466b-86db-c042c60e7f50 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:57.094839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f48389da-7e47-466b-86db-c042c60e7f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:57.265130 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2565/5155] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:57.265130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fb324-39d2-4129-be85-d8d346018886 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:57.266157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7a3fb324-39d2-4129-be85-d8d346018886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:57.269521 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2591/5156] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:57.270424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48389da-7e47-466b-86db-c042c60e7f50 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:57.274899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f48389da-7e47-466b-86db-c042c60e7f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:57.306714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fb324-39d2-4129-be85-d8d346018886 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:57.319439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebca242-63b4-40ab-9d11-14ad995da91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:57.320164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebca242-63b4-40ab-9d11-14ad995da91b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:57.320527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebca242-63b4-40ab-9d11-14ad995da91b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:57.321049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebca242-63b4-40ab-9d11-14ad995da91b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:57.322023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebca242-63b4-40ab-9d11-14ad995da91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:57.323919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebca242-63b4-40ab-9d11-14ad995da91b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:57.346400 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2566/5157] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:57.350221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebca242-63b4-40ab-9d11-14ad995da91b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:57.355415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-aebca242-63b4-40ab-9d11-14ad995da91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:57.408070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48389da-7e47-466b-86db-c042c60e7f50 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:57.424576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ad90-b035-401c-94c1-7c121bad3c6d tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f774a81bec24c9a8ccd7720429026c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8761ca56c944d5da36df2954034cc8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:57.427391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ad90-b035-401c-94c1-7c121bad3c6d tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:57.427698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ad90-b035-401c-94c1-7c121bad3c6d tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:57.427979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ad90-b035-401c-94c1-7c121bad3c6d tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:57.430269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ad90-b035-401c-94c1-7c121bad3c6d tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:57.432388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ad90-b035-401c-94c1-7c121bad3c6d tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:57.437103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ad90-b035-401c-94c1-7c121bad3c6d tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:57.455356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:57.473064 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2592/5158] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:57.475294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ad90-b035-401c-94c1-7c121bad3c6d tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:57.477242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c9c5ad90-b035-401c-94c1-7c121bad3c6d tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:57.586721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:57.589683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebca242-63b4-40ab-9d11-14ad995da91b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:57.602895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef8a80-7fb8-427f-8927-01096efbfaec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:57.604062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef8a80-7fb8-427f-8927-01096efbfaec service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:57.605101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef8a80-7fb8-427f-8927-01096efbfaec service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:57.606271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef8a80-7fb8-427f-8927-01096efbfaec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:57.624290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef8a80-7fb8-427f-8927-01096efbfaec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:57.626789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef8a80-7fb8-427f-8927-01096efbfaec service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:57.640218 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2567/5159] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:11:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:57.641170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef8a80-7fb8-427f-8927-01096efbfaec service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:57.643253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ad90-b035-401c-94c1-7c121bad3c6d tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:57.648220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe506d5c-56bf-44f8-b6f8-7c2115d4d2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:57.648924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe506d5c-56bf-44f8-b6f8-7c2115d4d2ef service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:57.649319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe506d5c-56bf-44f8-b6f8-7c2115d4d2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:57.649696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe506d5c-56bf-44f8-b6f8-7c2115d4d2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:57.657973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef8a80-7fb8-427f-8927-01096efbfaec service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:57.666036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7aa47-b35f-46af-ab20-9dd464218575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:57.667113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7aa47-b35f-46af-ab20-9dd464218575 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:57.667515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7aa47-b35f-46af-ab20-9dd464218575 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:57.667800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7aa47-b35f-46af-ab20-9dd464218575 admin admin] PATH_INFO: `/v3/projects/b11206f0b82241c7bfba41998ffd170a/users/07104fa4b20a48e7bd0e6bc8d20d37bc/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:57.684441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe506d5c-56bf-44f8-b6f8-7c2115d4d2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:57.685937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe506d5c-56bf-44f8-b6f8-7c2115d4d2ef service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:57.693556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7aa47-b35f-46af-ab20-9dd464218575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11206f0b82241c7bfba41998ffd170a, user_id=07104fa4b20a48e7bd0e6bc8d20d37bc, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:57.709978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7aa47-b35f-46af-ab20-9dd464218575 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:57.734396 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2593/5160] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:11:57.734396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe506d5c-56bf-44f8-b6f8-7c2115d4d2ef service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:57.747590 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2568/5161] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:57 2022] PUT /identity/v3/projects/b11206f0b82241c7bfba41998ffd170a/users/07104fa4b20a48e7bd0e6bc8d20d37bc/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:57.751909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7aa47-b35f-46af-ab20-9dd464218575 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:57.758199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe506d5c-56bf-44f8-b6f8-7c2115d4d2ef service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:57.917272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7aa47-b35f-46af-ab20-9dd464218575 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:57.931268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9312c22-e45d-4d82-bebc-f9374d37b4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:57.932177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9312c22-e45d-4d82-bebc-f9374d37b4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:57.932567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9312c22-e45d-4d82-bebc-f9374d37b4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:57.932946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9312c22-e45d-4d82-bebc-f9374d37b4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:57.934031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9312c22-e45d-4d82-bebc-f9374d37b4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:57.936941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9312c22-e45d-4d82-bebc-f9374d37b4f8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:57.961866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa97e82-0f2f-4596-a3ab-f8b94e6d4fdb tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f774a81bec24c9a8ccd7720429026c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8761ca56c944d5da36df2954034cc8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:57.962536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa97e82-0f2f-4596-a3ab-f8b94e6d4fdb tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:57.962818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa97e82-0f2f-4596-a3ab-f8b94e6d4fdb tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:57.963095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa97e82-0f2f-4596-a3ab-f8b94e6d4fdb tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:57.963743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa97e82-0f2f-4596-a3ab-f8b94e6d4fdb tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:57.977084 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2569/5162] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:11:57.977550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa97e82-0f2f-4596-a3ab-f8b94e6d4fdb tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:57.985546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9312c22-e45d-4d82-bebc-f9374d37b4f8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:58.001140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9312c22-e45d-4d82-bebc-f9374d37b4f8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:58.008300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e4a03-eade-4f8b-8651-b4f240f1da51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:58.009175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4a03-eade-4f8b-8651-b4f240f1da51 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:58.009670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4a03-eade-4f8b-8651-b4f240f1da51 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:58.010092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4a03-eade-4f8b-8651-b4f240f1da51 admin admin] PATH_INFO: `/v3/projects/b11206f0b82241c7bfba41998ffd170a/users/07104fa4b20a48e7bd0e6bc8d20d37bc/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:58.012439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e4a03-eade-4f8b-8651-b4f240f1da51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11206f0b82241c7bfba41998ffd170a, user_id=07104fa4b20a48e7bd0e6bc8d20d37bc, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:58.016667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e4a03-eade-4f8b-8651-b4f240f1da51 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:58.046615 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2594/5164] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:57 2022] POST /identity/v3/projects => generated 354 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:11:58.048548 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2570/5164] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:11:57 2022] PUT /identity/v3/projects/b11206f0b82241c7bfba41998ffd170a/users/07104fa4b20a48e7bd0e6bc8d20d37bc/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:58.050021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3324fc-cfb1-4f67-9f9f-43cf3a8da845 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:58.050666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3324fc-cfb1-4f67-9f9f-43cf3a8da845 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:58.051097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3324fc-cfb1-4f67-9f9f-43cf3a8da845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:58.051376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e4a03-eade-4f8b-8651-b4f240f1da51 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:58.109426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8d3324fc-cfb1-4f67-9f9f-43cf3a8da845 None None] MFA Rules not processed for user `07104fa4b20a48e7bd0e6bc8d20d37bc`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:58.111101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8d3324fc-cfb1-4f67-9f9f-43cf3a8da845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:58.236144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e4a03-eade-4f8b-8651-b4f240f1da51 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:58.281023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:58.320600 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2595/5165] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:11:58.322455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3324fc-cfb1-4f67-9f9f-43cf3a8da845 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:58.342225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3324fc-cfb1-4f67-9f9f-43cf3a8da845 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:58.356233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5748f2-c6e9-4841-a67c-b38c77b84d98 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07104fa4b20a48e7bd0e6bc8d20d37bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11206f0b82241c7bfba41998ffd170a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:58.357509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5748f2-c6e9-4841-a67c-b38c77b84d98 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:58.357816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5748f2-c6e9-4841-a67c-b38c77b84d98 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:58.358090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5748f2-c6e9-4841-a67c-b38c77b84d98 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:58.360061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5748f2-c6e9-4841-a67c-b38c77b84d98 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:58.368023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5748f2-c6e9-4841-a67c-b38c77b84d98 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:58.379993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297e8c2-7fc9-47fb-a617-e31b1690e192 tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f774a81bec24c9a8ccd7720429026c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8761ca56c944d5da36df2954034cc8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:58.381308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297e8c2-7fc9-47fb-a617-e31b1690e192 tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:58.381600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297e8c2-7fc9-47fb-a617-e31b1690e192 tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:58.381887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297e8c2-7fc9-47fb-a617-e31b1690e192 tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:58.382549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297e8c2-7fc9-47fb-a617-e31b1690e192 tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:11:58.382991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297e8c2-7fc9-47fb-a617-e31b1690e192 tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:58.385087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297e8c2-7fc9-47fb-a617-e31b1690e192 tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:58.417323 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2571/5166] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:58.445301 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2596/5167] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:11:58 2022] POST /identity/v3/projects => generated 360 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:11:58.446472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297e8c2-7fc9-47fb-a617-e31b1690e192 tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:58.467630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297e8c2-7fc9-47fb-a617-e31b1690e192 tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:58.497685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5748f2-c6e9-4841-a67c-b38c77b84d98 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:58.554810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:58.656935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5748f2-c6e9-4841-a67c-b38c77b84d98 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:58.662824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060526f8-4555-49ae-a6b3-5af5eceb9d54 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07104fa4b20a48e7bd0e6bc8d20d37bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11206f0b82241c7bfba41998ffd170a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:58.663502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060526f8-4555-49ae-a6b3-5af5eceb9d54 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:58.664203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060526f8-4555-49ae-a6b3-5af5eceb9d54 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:58.664508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060526f8-4555-49ae-a6b3-5af5eceb9d54 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] PATH_INFO: `/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags/tempest-tag-399893733` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:58.665864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060526f8-4555-49ae-a6b3-5af5eceb9d54 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=ab7899a0062f45c6b0a86db3648151c6, value=tempest-tag-399893733)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:58.668790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060526f8-4555-49ae-a6b3-5af5eceb9d54 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:58.678367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f774a81bec24c9a8ccd7720429026c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8761ca56c944d5da36df2954034cc8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:58.679518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:58.679518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:58.679777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] PATH_INFO: `/v3/projects/3c46f2f9fecb4c86a540caaf789bd9c1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:58.684980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c46f2f9fecb4c86a540caaf789bd9c1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:58.702171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:58.768329 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-060526f8-4555-49ae-a6b3-5af5eceb9d54 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-399893733. To ensure interoperability, identifiers should be a valid uuid. Oct 08 21:11:58.768329 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 08 21:11:58.768329 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:11:58.791154 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2572/5168] 10.222.0.26 () {60 vars in 1330 bytes} [Sat Oct 8 21:11:58 2022] PUT /identity/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags/tempest-tag-399893733 => generated 0 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 290 bytes (2 switches on core 0) Oct 08 21:11:58.795538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060526f8-4555-49ae-a6b3-5af5eceb9d54 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:58.821825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060526f8-4555-49ae-a6b3-5af5eceb9d54 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:58.852393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c46f2f9fecb4c86a540caaf789bd9c1', 'request_id': 'req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:58.875671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c46f2f9fecb4c86a540caaf789bd9c1', 'request_id': 'req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:58.907175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c46f2f9fecb4c86a540caaf789bd9c1', 'request_id': 'req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:58.925912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] The token cache is being invalidate because project 3c46f2f9fecb4c86a540caaf789bd9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:11:58.926347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:58.927324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:58.932534 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2597/5169] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:58 2022] DELETE /identity/v3/projects/3c46f2f9fecb4c86a540caaf789bd9c1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:58.935943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8110059-e999-49b6-b8ef-603c7c43247e tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07104fa4b20a48e7bd0e6bc8d20d37bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11206f0b82241c7bfba41998ffd170a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:58.937824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8110059-e999-49b6-b8ef-603c7c43247e tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:58.939854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8110059-e999-49b6-b8ef-603c7c43247e tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:58.941663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8110059-e999-49b6-b8ef-603c7c43247e tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] PATH_INFO: `/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags/tempest-tag-399893733` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:58.965836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8110059-e999-49b6-b8ef-603c7c43247e tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=ab7899a0062f45c6b0a86db3648151c6, value=tempest-tag-399893733)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:58.968999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8110059-e999-49b6-b8ef-603c7c43247e tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:58.978684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:58.990796 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2573/5170] 10.222.0.26 () {58 vars in 1311 bytes} [Sat Oct 8 21:11:58 2022] GET /identity/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags/tempest-tag-399893733 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:58.992801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:58.995003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:59.016080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfcc0c-a6c5-4bf1-9f8e-78a52de105bd tempest-VolumeQuotaClassesTest-893362963 tempest-VolumeQuotaClassesTest-893362963-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:59.025906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4b4b5-fad7-4d63-9d03-c11cc2e25e2b tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07104fa4b20a48e7bd0e6bc8d20d37bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11206f0b82241c7bfba41998ffd170a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:59.026715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4b4b5-fad7-4d63-9d03-c11cc2e25e2b tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:59.027110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4b4b5-fad7-4d63-9d03-c11cc2e25e2b tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:59.027510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4b4b5-fad7-4d63-9d03-c11cc2e25e2b tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] PATH_INFO: `/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:59.029432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4b4b5-fad7-4d63-9d03-c11cc2e25e2b tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=ab7899a0062f45c6b0a86db3648151c6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:59.032682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4b4b5-fad7-4d63-9d03-c11cc2e25e2b tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:59.148302 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2598/5171] 10.222.0.26 () {60 vars in 1265 bytes} [Sat Oct 8 21:11:58 2022] PUT /identity/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags => generated 142 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:59.152520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8110059-e999-49b6-b8ef-603c7c43247e tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:59.167757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8110059-e999-49b6-b8ef-603c7c43247e tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:59.175072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f899ec-60da-4989-a829-e4845cdea52d tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07104fa4b20a48e7bd0e6bc8d20d37bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11206f0b82241c7bfba41998ffd170a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:59.176578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f899ec-60da-4989-a829-e4845cdea52d tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:59.176578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f899ec-60da-4989-a829-e4845cdea52d tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:59.176881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f899ec-60da-4989-a829-e4845cdea52d tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] PATH_INFO: `/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:59.197515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f899ec-60da-4989-a829-e4845cdea52d tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=ab7899a0062f45c6b0a86db3648151c6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:59.200247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f899ec-60da-4989-a829-e4845cdea52d tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:59.219140 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2574/5172] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:11:59 2022] GET /identity/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags => generated 142 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:11:59.225315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4b4b5-fad7-4d63-9d03-c11cc2e25e2b tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:59.259788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4b4b5-fad7-4d63-9d03-c11cc2e25e2b tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:59.273476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498dccc-dc36-42de-b831-50cd4044679f tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07104fa4b20a48e7bd0e6bc8d20d37bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11206f0b82241c7bfba41998ffd170a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:59.277805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498dccc-dc36-42de-b831-50cd4044679f tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:59.278141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498dccc-dc36-42de-b831-50cd4044679f tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:59.278414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498dccc-dc36-42de-b831-50cd4044679f tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] PATH_INFO: `/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags/tempest-tag-1480738604` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:59.281962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498dccc-dc36-42de-b831-50cd4044679f tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=ab7899a0062f45c6b0a86db3648151c6, value=tempest-tag-1480738604)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:59.286040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498dccc-dc36-42de-b831-50cd4044679f tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:59.381516 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-2498dccc-dc36-42de-b831-50cd4044679f tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1480738604. To ensure interoperability, identifiers should be a valid uuid. Oct 08 21:11:59.381516 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 08 21:11:59.381516 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:11:59.383867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f899ec-60da-4989-a829-e4845cdea52d tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:59.386338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-30f899ec-60da-4989-a829-e4845cdea52d tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:59.401961 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2599/5173] 10.222.0.26 () {58 vars in 1317 bytes} [Sat Oct 8 21:11:59 2022] DELETE /identity/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags/tempest-tag-1480738604 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:59.406884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498dccc-dc36-42de-b831-50cd4044679f tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:59.421814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498dccc-dc36-42de-b831-50cd4044679f tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:59.433025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9951e42-9c6f-49f0-8284-c5a9c9df97a0 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07104fa4b20a48e7bd0e6bc8d20d37bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11206f0b82241c7bfba41998ffd170a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:59.434125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9951e42-9c6f-49f0-8284-c5a9c9df97a0 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:59.434249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9951e42-9c6f-49f0-8284-c5a9c9df97a0 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:59.434428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9951e42-9c6f-49f0-8284-c5a9c9df97a0 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] PATH_INFO: `/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags/tempest-tag-1480738604` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:59.470847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9951e42-9c6f-49f0-8284-c5a9c9df97a0 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=ab7899a0062f45c6b0a86db3648151c6, value=tempest-tag-1480738604)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:59.476026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9951e42-9c6f-49f0-8284-c5a9c9df97a0 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-b9951e42-9c6f-49f0-8284-c5a9c9df97a0 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Could not find project tag: tempest-tag-1480738604.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1480738604. Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 08 21:11:59.506848 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 08 21:11:59.507921 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:11:59.507921 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:11:59.507921 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 08 21:11:59.507921 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 08 21:11:59.507921 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1480738604. Oct 08 21:11:59.507921 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:11:59.509036 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2600/5174] 10.222.0.26 () {58 vars in 1314 bytes} [Sat Oct 8 21:11:59 2022] GET /identity/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags/tempest-tag-1480738604 => generated 107 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:11:59.562683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9951e42-9c6f-49f0-8284-c5a9c9df97a0 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:59.591182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9951e42-9c6f-49f0-8284-c5a9c9df97a0 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:59.602974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbac76c-4fe1-44aa-8c8e-84cfa7785b13 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07104fa4b20a48e7bd0e6bc8d20d37bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11206f0b82241c7bfba41998ffd170a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:59.604132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac76c-4fe1-44aa-8c8e-84cfa7785b13 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:59.604904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac76c-4fe1-44aa-8c8e-84cfa7785b13 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:59.605339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac76c-4fe1-44aa-8c8e-84cfa7785b13 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] PATH_INFO: `/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:59.613904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbac76c-4fe1-44aa-8c8e-84cfa7785b13 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=ab7899a0062f45c6b0a86db3648151c6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:59.613904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbac76c-4fe1-44aa-8c8e-84cfa7785b13 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:59.635437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:59.772051 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2601/5175] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:11:59 2022] DELETE /identity/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:11:59.775412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f899ec-60da-4989-a829-e4845cdea52d tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:11:59.776249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70286a0c-3698-47bf-96b4-cde053cedbbf None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:59.777452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70286a0c-3698-47bf-96b4-cde053cedbbf None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:59.777739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70286a0c-3698-47bf-96b4-cde053cedbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:59.780472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:11:59.781267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:11:59.782111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:11:59.782111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] PATH_INFO: `/v3/users/1f376598278741bcbd500462c3b5224b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:11:59.783730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f376598278741bcbd500462c3b5224b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:11:59.785859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:11:59.847986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-70286a0c-3698-47bf-96b4-cde053cedbbf None None] MFA Rules not processed for user `84b9968c1dd3411ca4e8232709346400`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:11:59.854034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-70286a0c-3698-47bf-96b4-cde053cedbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:11:59.888778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f376598278741bcbd500462c3b5224b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:59.904150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f376598278741bcbd500462c3b5224b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:59.905612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f376598278741bcbd500462c3b5224b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:59.913812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f376598278741bcbd500462c3b5224b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:59.936771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f376598278741bcbd500462c3b5224b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:11:59.976672 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2575/5176] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:11:59 2022] DELETE /identity/v3/users/1f376598278741bcbd500462c3b5224b => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:11:59.978189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:11:59.982662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:00.017690 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2602/5177] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:00.017690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70286a0c-3698-47bf-96b4-cde053cedbbf None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:00.026535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-70286a0c-3698-47bf-96b4-cde053cedbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:00.056554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70286a0c-3698-47bf-96b4-cde053cedbbf None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:00.089111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:00.105218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee918fbe-2653-4998-83d9-f9d408e4248f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:00.122544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58491b67-8386-4eb3-b014-16783371fd32 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07104fa4b20a48e7bd0e6bc8d20d37bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11206f0b82241c7bfba41998ffd170a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:00.123538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491b67-8386-4eb3-b014-16783371fd32 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:00.123927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491b67-8386-4eb3-b014-16783371fd32 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:00.124306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491b67-8386-4eb3-b014-16783371fd32 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] PATH_INFO: `/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:00.144543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58491b67-8386-4eb3-b014-16783371fd32 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=ab7899a0062f45c6b0a86db3648151c6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:00.144543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58491b67-8386-4eb3-b014-16783371fd32 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:00.157056 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2576/5178] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:11:59 2022] GET /identity/v3/projects/ab7899a0062f45c6b0a86db3648151c6/tags => generated 66 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:12:00.158596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b5684-1984-4874-a655-5f1fcabd389d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:00.158986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b5684-1984-4874-a655-5f1fcabd389d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:00.160499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b5684-1984-4874-a655-5f1fcabd389d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:00.191709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a77b5684-1984-4874-a655-5f1fcabd389d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:00.193941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a77b5684-1984-4874-a655-5f1fcabd389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:00.252927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:00.254012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:00.254501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:00.255529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] PATH_INFO: `/v3/projects/a13b1a0f52f544bb814639340648d661` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:00.257561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a13b1a0f52f544bb814639340648d661)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:00.259709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:00.322517 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2577/5179] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:00.322517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b5684-1984-4874-a655-5f1fcabd389d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:00.324595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a77b5684-1984-4874-a655-5f1fcabd389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:00.343938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a13b1a0f52f544bb814639340648d661', 'request_id': 'req-d7d6856d-b428-4c37-84ba-113904273cdf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:00.357369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a13b1a0f52f544bb814639340648d661', 'request_id': 'req-d7d6856d-b428-4c37-84ba-113904273cdf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:00.365439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:00.368435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a13b1a0f52f544bb814639340648d661', 'request_id': 'req-d7d6856d-b428-4c37-84ba-113904273cdf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:00.388555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] The token cache is being invalidate because project a13b1a0f52f544bb814639340648d661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:00.388893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:00.389661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:00.391719 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2603/5180] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:00 2022] DELETE /identity/v3/projects/a13b1a0f52f544bb814639340648d661 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:00.392271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:00.394282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:00.493459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b5684-1984-4874-a655-5f1fcabd389d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:00.497569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6856d-b428-4c37-84ba-113904273cdf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:00.505819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07104fa4b20a48e7bd0e6bc8d20d37bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11206f0b82241c7bfba41998ffd170a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:00.507193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:00.507482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:00.507759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] PATH_INFO: `/v3/projects/ab7899a0062f45c6b0a86db3648151c6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:00.509532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ab7899a0062f45c6b0a86db3648151c6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:00.512248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:00.606027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7899a0062f45c6b0a86db3648151c6', 'request_id': 'req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:00.626612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7899a0062f45c6b0a86db3648151c6', 'request_id': 'req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:00.640498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7899a0062f45c6b0a86db3648151c6', 'request_id': 'req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:00.646623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d51a0-2909-4d52-a18a-343b83ebd18f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:00.647307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d51a0-2909-4d52-a18a-343b83ebd18f service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:00.647596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d51a0-2909-4d52-a18a-343b83ebd18f service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:00.647883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d51a0-2909-4d52-a18a-343b83ebd18f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:00.649847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fc6d51a0-2909-4d52-a18a-343b83ebd18f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:00.669162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:00.671606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] The token cache is being invalidate because project ab7899a0062f45c6b0a86db3648151c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:00.672058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:00.678110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:00.680164 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2604/5181] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:00 2022] DELETE /identity/v3/projects/ab7899a0062f45c6b0a86db3648151c6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:00.681351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:00.683415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:00.742270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d51a0-2909-4d52-a18a-343b83ebd18f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:00.743931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d51a0-2909-4d52-a18a-343b83ebd18f service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:00.765777 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2578/5182] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:00.766968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a238f1-9800-4ebd-8348-fe7c08aaf2c4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:00.767257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a238f1-9800-4ebd-8348-fe7c08aaf2c4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:00.771035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a238f1-9800-4ebd-8348-fe7c08aaf2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:00.822295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-01a238f1-9800-4ebd-8348-fe7c08aaf2c4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:00.830619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-01a238f1-9800-4ebd-8348-fe7c08aaf2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:00.871464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac6d3f-e10c-4863-b6d2-9618d9f6e504 tempest-IdentityV3ProjectTagsTest-594453186 tempest-IdentityV3ProjectTagsTest-594453186-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:00.881006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5686e5-4b26-4a8b-a6a2-1e628fe9186a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:00.881677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5686e5-4b26-4a8b-a6a2-1e628fe9186a service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:00.881957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5686e5-4b26-4a8b-a6a2-1e628fe9186a service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:00.882228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5686e5-4b26-4a8b-a6a2-1e628fe9186a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:00.891337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7a5686e5-4b26-4a8b-a6a2-1e628fe9186a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:01.024661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:01.043653 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2579/5183] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:01.044652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a238f1-9800-4ebd-8348-fe7c08aaf2c4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:01.049897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-01a238f1-9800-4ebd-8348-fe7c08aaf2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:01.083354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a238f1-9800-4ebd-8348-fe7c08aaf2c4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:01.103697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3923d-717e-4154-b895-536d5994927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:01.104439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3923d-717e-4154-b895-536d5994927a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:01.104794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3923d-717e-4154-b895-536d5994927a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:01.105140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3923d-717e-4154-b895-536d5994927a admin admin] PATH_INFO: `/v3/users/80dd3d24ba324a338912df952c94fc03` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:01.107682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3923d-717e-4154-b895-536d5994927a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80dd3d24ba324a338912df952c94fc03)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:01.109837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3923d-717e-4154-b895-536d5994927a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:01.121741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5686e5-4b26-4a8b-a6a2-1e628fe9186a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:01.123357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5686e5-4b26-4a8b-a6a2-1e628fe9186a service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:01.151168 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2605/5184] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:01.152328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5686e5-4b26-4a8b-a6a2-1e628fe9186a service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:01.160810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7a5686e5-4b26-4a8b-a6a2-1e628fe9186a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:01.225734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9c3923d-717e-4154-b895-536d5994927a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80dd3d24ba324a338912df952c94fc03'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:01.242595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9c3923d-717e-4154-b895-536d5994927a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80dd3d24ba324a338912df952c94fc03'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:01.244322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9c3923d-717e-4154-b895-536d5994927a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80dd3d24ba324a338912df952c94fc03'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:01.245293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9c3923d-717e-4154-b895-536d5994927a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80dd3d24ba324a338912df952c94fc03'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:01.275192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9c3923d-717e-4154-b895-536d5994927a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80dd3d24ba324a338912df952c94fc03'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:01.310321 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2580/5185] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:01 2022] DELETE /identity/v3/users/80dd3d24ba324a338912df952c94fc03 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:01.313400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571870c-26d1-4daa-9936-ea3c4233d24f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:01.313692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571870c-26d1-4daa-9936-ea3c4233d24f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:01.315230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571870c-26d1-4daa-9936-ea3c4233d24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:01.345095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5686e5-4b26-4a8b-a6a2-1e628fe9186a service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:01.371020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9571870c-26d1-4daa-9936-ea3c4233d24f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:01.372354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9571870c-26d1-4daa-9936-ea3c4233d24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:01.450405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:01.513818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf626e0-e3df-41f2-8198-fbcba85323da tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872e262b64ff40948d59e8c36168b895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '144ea108f2a54d1280d88894184b6c98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:01.515326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf626e0-e3df-41f2-8198-fbcba85323da tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:01.515638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf626e0-e3df-41f2-8198-fbcba85323da tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:01.515918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf626e0-e3df-41f2-8198-fbcba85323da tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:01.516592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf626e0-e3df-41f2-8198-fbcba85323da tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:01.516901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf626e0-e3df-41f2-8198-fbcba85323da tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:01.519617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf626e0-e3df-41f2-8198-fbcba85323da tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:01.536328 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2581/5186] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:01.539566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b393-1138-4ac9-9268-abe45e77bde0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:01.540821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b393-1138-4ac9-9268-abe45e77bde0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:01.541106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b393-1138-4ac9-9268-abe45e77bde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:01.571005 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2606/5187] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:01.572042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf626e0-e3df-41f2-8198-fbcba85323da tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:01.584885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf626e0-e3df-41f2-8198-fbcba85323da tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:01.606169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab5311-c3cd-4508-8ec4-71f69e4d8e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:01.607108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab5311-c3cd-4508-8ec4-71f69e4d8e72 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:01.607500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab5311-c3cd-4508-8ec4-71f69e4d8e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:01.607913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab5311-c3cd-4508-8ec4-71f69e4d8e72 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:01.608771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab5311-c3cd-4508-8ec4-71f69e4d8e72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:01.609251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab5311-c3cd-4508-8ec4-71f69e4d8e72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:01.611333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab5311-c3cd-4508-8ec4-71f69e4d8e72 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:01.626476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5970b393-1138-4ac9-9268-abe45e77bde0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:01.627738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5970b393-1138-4ac9-9268-abe45e77bde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:01.647172 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2607/5188] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:01.648172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab5311-c3cd-4508-8ec4-71f69e4d8e72 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:01.650609 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2582/5189] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:01.651553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b393-1138-4ac9-9268-abe45e77bde0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:01.654225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-41ab5311-c3cd-4508-8ec4-71f69e4d8e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:01.685419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b393-1138-4ac9-9268-abe45e77bde0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:01.690600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab5311-c3cd-4508-8ec4-71f69e4d8e72 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:01.699025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe730b5c-678a-4822-9297-c488f8d2791f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:01.701480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe730b5c-678a-4822-9297-c488f8d2791f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:01.702621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe730b5c-678a-4822-9297-c488f8d2791f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:01.702871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66d44e-4aec-4402-8065-8d46fefc7466 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872e262b64ff40948d59e8c36168b895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '144ea108f2a54d1280d88894184b6c98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:01.703702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66d44e-4aec-4402-8065-8d46fefc7466 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:01.704073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe730b5c-678a-4822-9297-c488f8d2791f admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:01.704262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66d44e-4aec-4402-8065-8d46fefc7466 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:01.704573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66d44e-4aec-4402-8065-8d46fefc7466 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:01.705235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66d44e-4aec-4402-8065-8d46fefc7466 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:01.705917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe730b5c-678a-4822-9297-c488f8d2791f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:01.708495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66d44e-4aec-4402-8065-8d46fefc7466 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:01.711758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe730b5c-678a-4822-9297-c488f8d2791f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:01.780214 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2608/5190] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:01 2022] POST /identity/v3/projects => generated 348 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:01.782191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66d44e-4aec-4402-8065-8d46fefc7466 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:01.787301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ad66d44e-4aec-4402-8065-8d46fefc7466 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:01.788044 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2583/5191] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:01 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:01.789656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe730b5c-678a-4822-9297-c488f8d2791f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:01.889748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:01.933220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66d44e-4aec-4402-8065-8d46fefc7466 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:01.978596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe730b5c-678a-4822-9297-c488f8d2791f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:01.996020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391663ee-e80a-408c-b8a7-85c49d35158b tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872e262b64ff40948d59e8c36168b895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '144ea108f2a54d1280d88894184b6c98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:01.999251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391663ee-e80a-408c-b8a7-85c49d35158b tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:01.999509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391663ee-e80a-408c-b8a7-85c49d35158b tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:01.999782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391663ee-e80a-408c-b8a7-85c49d35158b tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:02.004609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391663ee-e80a-408c-b8a7-85c49d35158b tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:02.004945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391663ee-e80a-408c-b8a7-85c49d35158b tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:02.007270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391663ee-e80a-408c-b8a7-85c49d35158b tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:02.035225 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2584/5192] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:02.040859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391663ee-e80a-408c-b8a7-85c49d35158b tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:02.059982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb46df-9047-42e9-be71-7f5f0ab58a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:02.060763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb46df-9047-42e9-be71-7f5f0ab58a78 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:02.061312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb46df-9047-42e9-be71-7f5f0ab58a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:02.061595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb46df-9047-42e9-be71-7f5f0ab58a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:02.150863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391663ee-e80a-408c-b8a7-85c49d35158b tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:02.156415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d1477-e2a8-4fba-9f29-de7e7e37ee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:02.157331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d1477-e2a8-4fba-9f29-de7e7e37ee68 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:02.157663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d1477-e2a8-4fba-9f29-de7e7e37ee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:02.157937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d1477-e2a8-4fba-9f29-de7e7e37ee68 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:02.158818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d1477-e2a8-4fba-9f29-de7e7e37ee68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:02.160988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d1477-e2a8-4fba-9f29-de7e7e37ee68 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:02.192051 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2585/5193] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:02 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:02.197559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d1477-e2a8-4fba-9f29-de7e7e37ee68 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:02.218846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d1477-e2a8-4fba-9f29-de7e7e37ee68 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:02.225863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be832491-d7d0-4263-962b-c6d0e61c99a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:02.226727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832491-d7d0-4263-962b-c6d0e61c99a6 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:02.227156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832491-d7d0-4263-962b-c6d0e61c99a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:02.227579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832491-d7d0-4263-962b-c6d0e61c99a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:02.228373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be832491-d7d0-4263-962b-c6d0e61c99a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:02.230472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be832491-d7d0-4263-962b-c6d0e61c99a6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:02.238980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb46df-9047-42e9-be71-7f5f0ab58a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:02.241152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb46df-9047-42e9-be71-7f5f0ab58a78 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:02.252173 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2586/5194] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:02.258922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be832491-d7d0-4263-962b-c6d0e61c99a6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:02.271884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-be832491-d7d0-4263-962b-c6d0e61c99a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:02.288060 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2609/5195] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:02.289662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb46df-9047-42e9-be71-7f5f0ab58a78 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:02.305602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb46df-9047-42e9-be71-7f5f0ab58a78 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:02.311716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be832491-d7d0-4263-962b-c6d0e61c99a6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:02.313632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9551c6c-3201-436d-abff-22f6aceb3bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:02.314811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551c6c-3201-436d-abff-22f6aceb3bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:02.315493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551c6c-3201-436d-abff-22f6aceb3bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:02.315956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551c6c-3201-436d-abff-22f6aceb3bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:02.316823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9551c6c-3201-436d-abff-22f6aceb3bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:02.319327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9551c6c-3201-436d-abff-22f6aceb3bd4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:02.321740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88005d1-cee5-4d4a-b6dd-b81535334add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:02.323780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88005d1-cee5-4d4a-b6dd-b81535334add admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:02.325841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88005d1-cee5-4d4a-b6dd-b81535334add admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:02.327313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88005d1-cee5-4d4a-b6dd-b81535334add admin admin] PATH_INFO: `/v3/projects/c17b6bdd6f114da181f2e37fd2a98db5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:02.329993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88005d1-cee5-4d4a-b6dd-b81535334add admin admin] RBAC: Authorizing `identity:delete_project(project_id=c17b6bdd6f114da181f2e37fd2a98db5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:02.331913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88005d1-cee5-4d4a-b6dd-b81535334add admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:02.338921 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2610/5196] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:02.342310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9551c6c-3201-436d-abff-22f6aceb3bd4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:02.362169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9551c6c-3201-436d-abff-22f6aceb3bd4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:02.365941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:02.372276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd782bc4-70f4-4b57-ba34-8bb95f27d9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:02.373623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd782bc4-70f4-4b57-ba34-8bb95f27d9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:02.373902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd782bc4-70f4-4b57-ba34-8bb95f27d9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:02.374245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd782bc4-70f4-4b57-ba34-8bb95f27d9a0 admin admin] PATH_INFO: `/v3/projects/da2b3b21992b454d978c75b9a3cedcab/users/74b06561e95d4157ad1fd2503f3a9abf/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:02.402414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd782bc4-70f4-4b57-ba34-8bb95f27d9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2b3b21992b454d978c75b9a3cedcab, user_id=74b06561e95d4157ad1fd2503f3a9abf, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:02.409641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd782bc4-70f4-4b57-ba34-8bb95f27d9a0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:02.445270 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2611/5197] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:02 2022] PUT /identity/v3/projects/da2b3b21992b454d978c75b9a3cedcab/users/74b06561e95d4157ad1fd2503f3a9abf/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:02.448376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcc5b1-226c-47b1-9313-3546bf8463c3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:02.448778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcc5b1-226c-47b1-9313-3546bf8463c3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:02.449165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcc5b1-226c-47b1-9313-3546bf8463c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:02.450912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a88005d1-cee5-4d4a-b6dd-b81535334add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c17b6bdd6f114da181f2e37fd2a98db5', 'request_id': 'req-a88005d1-cee5-4d4a-b6dd-b81535334add'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:02.466768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a88005d1-cee5-4d4a-b6dd-b81535334add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c17b6bdd6f114da181f2e37fd2a98db5', 'request_id': 'req-a88005d1-cee5-4d4a-b6dd-b81535334add'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:02.485429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a88005d1-cee5-4d4a-b6dd-b81535334add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c17b6bdd6f114da181f2e37fd2a98db5', 'request_id': 'req-a88005d1-cee5-4d4a-b6dd-b81535334add'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:02.517201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a88005d1-cee5-4d4a-b6dd-b81535334add admin admin] The token cache is being invalidate because project c17b6bdd6f114da181f2e37fd2a98db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:02.517747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a88005d1-cee5-4d4a-b6dd-b81535334add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:02.518714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a88005d1-cee5-4d4a-b6dd-b81535334add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:02.526263 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2587/5198] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:02 2022] DELETE /identity/v3/projects/c17b6bdd6f114da181f2e37fd2a98db5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:02.526486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a3dcc5b1-226c-47b1-9313-3546bf8463c3 None None] MFA Rules not processed for user `74b06561e95d4157ad1fd2503f3a9abf`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:02.527750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a3dcc5b1-226c-47b1-9313-3546bf8463c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:02.530835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae7e6-1329-4bb5-bad2-45d730c8516d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:02.531433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae7e6-1329-4bb5-bad2-45d730c8516d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:02.531939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae7e6-1329-4bb5-bad2-45d730c8516d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:02.705488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-631ae7e6-1329-4bb5-bad2-45d730c8516d None None] MFA Rules not processed for user `f77129c9ce5149748c6bd39c69307f76`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:02.707741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-631ae7e6-1329-4bb5-bad2-45d730c8516d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:02.713558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:02.735693 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2612/5199] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:02.740635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcc5b1-226c-47b1-9313-3546bf8463c3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:02.746626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a3dcc5b1-226c-47b1-9313-3546bf8463c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:02.834075 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2588/5200] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:02.835203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ae7e6-1329-4bb5-bad2-45d730c8516d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:02.854426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ae7e6-1329-4bb5-bad2-45d730c8516d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:02.868117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd28a7-a463-46b6-9d16-94096aec8af5 tempest-IdentityCatalogTest-555772273 tempest-IdentityCatalogTest-555772273-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b06561e95d4157ad1fd2503f3a9abf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da2b3b21992b454d978c75b9a3cedcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:02.868748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd28a7-a463-46b6-9d16-94096aec8af5 tempest-IdentityCatalogTest-555772273 tempest-IdentityCatalogTest-555772273-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:02.869032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd28a7-a463-46b6-9d16-94096aec8af5 tempest-IdentityCatalogTest-555772273 tempest-IdentityCatalogTest-555772273-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:02.869336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd28a7-a463-46b6-9d16-94096aec8af5 tempest-IdentityCatalogTest-555772273 tempest-IdentityCatalogTest-555772273-project] PATH_INFO: `/v3/auth/catalog` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:02.869920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd28a7-a463-46b6-9d16-94096aec8af5 tempest-IdentityCatalogTest-555772273 tempest-IdentityCatalogTest-555772273-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:02.871005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd28a7-a463-46b6-9d16-94096aec8af5 tempest-IdentityCatalogTest-555772273 tempest-IdentityCatalogTest-555772273-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:02.885038 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2589/5201] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 21:12:02 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:02.885038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bafb2-d59f-4e7b-9465-a0e8ff3f958a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:02.885038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bafb2-d59f-4e7b-9465-a0e8ff3f958a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:02.885038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bafb2-d59f-4e7b-9465-a0e8ff3f958a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:02.920923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcc5b1-226c-47b1-9313-3546bf8463c3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:02.926646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fe2bafb2-d59f-4e7b-9465-a0e8ff3f958a None None] MFA Rules not processed for user `f77129c9ce5149748c6bd39c69307f76`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:02.929931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fe2bafb2-d59f-4e7b-9465-a0e8ff3f958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:02.934397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b8b89-e4f7-49d8-9207-9a3d79cf4e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:02.935239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b8b89-e4f7-49d8-9207-9a3d79cf4e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:02.935358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b8b89-e4f7-49d8-9207-9a3d79cf4e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:02.935626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b8b89-e4f7-49d8-9207-9a3d79cf4e53 admin admin] PATH_INFO: `/v3/users/7f774a81bec24c9a8ccd7720429026c4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:02.936888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b8b89-e4f7-49d8-9207-9a3d79cf4e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f774a81bec24c9a8ccd7720429026c4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:02.938886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b8b89-e4f7-49d8-9207-9a3d79cf4e53 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:02.949471 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2590/5202] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:02.950315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bafb2-d59f-4e7b-9465-a0e8ff3f958a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:02.958145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fe2bafb2-d59f-4e7b-9465-a0e8ff3f958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:02.985522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bafb2-d59f-4e7b-9465-a0e8ff3f958a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:02.992675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:02.993417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:02.993761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:02.994075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] PATH_INFO: `/v3/users/74b06561e95d4157ad1fd2503f3a9abf` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:02.995341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b06561e95d4157ad1fd2503f3a9abf)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:03.003225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:03.035090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-344b8b89-e4f7-49d8-9207-9a3d79cf4e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f774a81bec24c9a8ccd7720429026c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.052939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-344b8b89-e4f7-49d8-9207-9a3d79cf4e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f774a81bec24c9a8ccd7720429026c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.054792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-344b8b89-e4f7-49d8-9207-9a3d79cf4e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f774a81bec24c9a8ccd7720429026c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.056725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-344b8b89-e4f7-49d8-9207-9a3d79cf4e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f774a81bec24c9a8ccd7720429026c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.090785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-344b8b89-e4f7-49d8-9207-9a3d79cf4e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f774a81bec24c9a8ccd7720429026c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.106966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b06561e95d4157ad1fd2503f3a9abf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.120378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b06561e95d4157ad1fd2503f3a9abf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.121106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b06561e95d4157ad1fd2503f3a9abf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.121779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b06561e95d4157ad1fd2503f3a9abf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.125887 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2613/5203] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:02 2022] DELETE /identity/v3/users/7f774a81bec24c9a8ccd7720429026c4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:03.136560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:03.140469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b06561e95d4157ad1fd2503f3a9abf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.171667 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2591/5204] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:02 2022] DELETE /identity/v3/users/74b06561e95d4157ad1fd2503f3a9abf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:03.173283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd6597-2461-462c-a0c4-5592555028dd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:03.173532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd6597-2461-462c-a0c4-5592555028dd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:03.173916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd6597-2461-462c-a0c4-5592555028dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:03.234113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5ecd6597-2461-462c-a0c4-5592555028dd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:03.236925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5ecd6597-2461-462c-a0c4-5592555028dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:03.367282 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2614/5205] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:12:03.385850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:03.395448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:03.454514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd6597-2461-462c-a0c4-5592555028dd None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:03.458736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5ecd6597-2461-462c-a0c4-5592555028dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:03.520606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:03.569972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418219c-6d18-47a6-b96f-e37394ad6e1c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:03.576369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d82d98-d688-4132-b47e-b0d7e0cb9d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:03.577000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d82d98-d688-4132-b47e-b0d7e0cb9d48 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:03.577311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d82d98-d688-4132-b47e-b0d7e0cb9d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:03.577586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d82d98-d688-4132-b47e-b0d7e0cb9d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:03.613292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d82d98-d688-4132-b47e-b0d7e0cb9d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:03.614902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d82d98-d688-4132-b47e-b0d7e0cb9d48 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:03.628716 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2592/5206] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:03.629757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d82d98-d688-4132-b47e-b0d7e0cb9d48 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:03.631161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a9d82d98-d688-4132-b47e-b0d7e0cb9d48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:03.650149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d82d98-d688-4132-b47e-b0d7e0cb9d48 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:03.656713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:03.657778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:03.658253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:03.658723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] PATH_INFO: `/v3/projects/f8aa88ec28bc4f8b9fe34ea3e5080126` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:03.660253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8aa88ec28bc4f8b9fe34ea3e5080126)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:03.664278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:03.679948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd6597-2461-462c-a0c4-5592555028dd None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:03.695200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e8497-37b4-4003-8544-b843fa9649aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:03.696145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e8497-37b4-4003-8544-b843fa9649aa service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:03.697656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e8497-37b4-4003-8544-b843fa9649aa service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:03.697936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e8497-37b4-4003-8544-b843fa9649aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:03.703177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-359e8497-37b4-4003-8544-b843fa9649aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:03.770450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8aa88ec28bc4f8b9fe34ea3e5080126', 'request_id': 'req-3d6b5a9b-79f7-417b-b64f-d34739980b14'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.796452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8aa88ec28bc4f8b9fe34ea3e5080126', 'request_id': 'req-3d6b5a9b-79f7-417b-b64f-d34739980b14'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.805272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8aa88ec28bc4f8b9fe34ea3e5080126', 'request_id': 'req-3d6b5a9b-79f7-417b-b64f-d34739980b14'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.844699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] The token cache is being invalidate because project f8aa88ec28bc4f8b9fe34ea3e5080126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:03.845259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.847640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:03.853400 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2593/5207] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:03 2022] DELETE /identity/v3/projects/f8aa88ec28bc4f8b9fe34ea3e5080126 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:03.853400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:03.854108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:03.892904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e8497-37b4-4003-8544-b843fa9649aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:03.894348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e8497-37b4-4003-8544-b843fa9649aa service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:03.923745 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2615/5208] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:03.925808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e8497-37b4-4003-8544-b843fa9649aa service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:03.961597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e8497-37b4-4003-8544-b843fa9649aa service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:04.046785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b5a9b-79f7-417b-b64f-d34739980b14 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:04.054339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872e262b64ff40948d59e8c36168b895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '144ea108f2a54d1280d88894184b6c98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:04.055085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:04.055433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:04.055827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] PATH_INFO: `/v3/projects/e71e02ed237140a2b05c8cdb2ced6238` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:04.057090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e71e02ed237140a2b05c8cdb2ced6238)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:04.059759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:04.111224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:04.175494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71e02ed237140a2b05c8cdb2ced6238', 'request_id': 'req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:04.191504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71e02ed237140a2b05c8cdb2ced6238', 'request_id': 'req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:04.198627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:04.199327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:04.201944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:04.202290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] PATH_INFO: `/v3/users/07104fa4b20a48e7bd0e6bc8d20d37bc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:04.203134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71e02ed237140a2b05c8cdb2ced6238', 'request_id': 'req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:04.205784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07104fa4b20a48e7bd0e6bc8d20d37bc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:04.212010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:04.229516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] The token cache is being invalidate because project e71e02ed237140a2b05c8cdb2ced6238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:04.229825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:04.231040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:04.235246 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2594/5209] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:03 2022] DELETE /identity/v3/projects/e71e02ed237140a2b05c8cdb2ced6238 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:04.278064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:04.279721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:04.341785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07104fa4b20a48e7bd0e6bc8d20d37bc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:04.374238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07104fa4b20a48e7bd0e6bc8d20d37bc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:04.375411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07104fa4b20a48e7bd0e6bc8d20d37bc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:04.377668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07104fa4b20a48e7bd0e6bc8d20d37bc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:04.381085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:04.410241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07104fa4b20a48e7bd0e6bc8d20d37bc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:04.445369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24626e-67ab-4ff8-b842-ea7ccfabf2c0 tempest-RoutersIpV6AdminTest-333765425 tempest-RoutersIpV6AdminTest-333765425-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:04.450380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae6359-f889-44b9-bb23-d6bb77c2fb1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:04.451068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae6359-f889-44b9-bb23-d6bb77c2fb1f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:04.451359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae6359-f889-44b9-bb23-d6bb77c2fb1f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:04.453673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae6359-f889-44b9-bb23-d6bb77c2fb1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:04.455561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bcae6359-f889-44b9-bb23-d6bb77c2fb1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:04.456289 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2616/5210] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:03 2022] DELETE /identity/v3/users/07104fa4b20a48e7bd0e6bc8d20d37bc => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:04.678996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae6359-f889-44b9-bb23-d6bb77c2fb1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:04.680841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae6359-f889-44b9-bb23-d6bb77c2fb1f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:04.698528 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2595/5211] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:12:04.721211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:04.722720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:04.902129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5c1ac-a769-4f31-8d0d-aabca251b393 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:04.917675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:04.922179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:04.930706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:04.931604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4 admin admin] PATH_INFO: `/v3/projects/c8761ca56c944d5da36df2954034cc8b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:04.933081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8761ca56c944d5da36df2954034cc8b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:04.935551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:05.006153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae6359-f889-44b9-bb23-d6bb77c2fb1f service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:05.014175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bcae6359-f889-44b9-bb23-d6bb77c2fb1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:05.059336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8761ca56c944d5da36df2954034cc8b', 'request_id': 'req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:05.079330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8761ca56c944d5da36df2954034cc8b', 'request_id': 'req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:05.090755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8761ca56c944d5da36df2954034cc8b', 'request_id': 'req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:05.120520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4 admin admin] The token cache is being invalidate because project c8761ca56c944d5da36df2954034cc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:05.121136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:05.122884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-caf1bbe7-0729-4ce6-bf47-79d0dae419a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:05.129982 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2617/5212] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:04 2022] DELETE /identity/v3/projects/c8761ca56c944d5da36df2954034cc8b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:05.138173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c2fa7-7310-4eea-b44a-c59d818e7e0d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:05.139182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c2fa7-7310-4eea-b44a-c59d818e7e0d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:05.139182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c2fa7-7310-4eea-b44a-c59d818e7e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:05.177286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:05.188946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae6359-f889-44b9-bb23-d6bb77c2fb1f service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:05.198691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9f9c2fa7-7310-4eea-b44a-c59d818e7e0d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:05.201587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9f9c2fa7-7310-4eea-b44a-c59d818e7e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:05.365391 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2618/5213] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:05.367170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db994f2-36f5-413f-9c9a-29fb69748a2c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:05.367463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db994f2-36f5-413f-9c9a-29fb69748a2c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:05.367746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db994f2-36f5-413f-9c9a-29fb69748a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:05.382333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:05.387618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c7857-e7d7-412a-a20b-09d45191fb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:05.389366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c7857-e7d7-412a-a20b-09d45191fb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:05.389768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c7857-e7d7-412a-a20b-09d45191fb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:05.390035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c7857-e7d7-412a-a20b-09d45191fb84 admin admin] PATH_INFO: `/v3/projects/da2b3b21992b454d978c75b9a3cedcab` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:05.391343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c7857-e7d7-412a-a20b-09d45191fb84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2b3b21992b454d978c75b9a3cedcab)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:05.398065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c7857-e7d7-412a-a20b-09d45191fb84 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:05.416700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0db994f2-36f5-413f-9c9a-29fb69748a2c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:05.420980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0db994f2-36f5-413f-9c9a-29fb69748a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:05.444862 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2619/5214] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:05.449098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db994f2-36f5-413f-9c9a-29fb69748a2c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:05.477165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db994f2-36f5-413f-9c9a-29fb69748a2c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:05.500972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8963f71-b46e-44fd-866c-2b575ed1daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:05.503343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8963f71-b46e-44fd-866c-2b575ed1daf0 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:05.506071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8963f71-b46e-44fd-866c-2b575ed1daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:05.507719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8963f71-b46e-44fd-866c-2b575ed1daf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:05.512262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8963f71-b46e-44fd-866c-2b575ed1daf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:05.512895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8963f71-b46e-44fd-866c-2b575ed1daf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:05.518354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8963f71-b46e-44fd-866c-2b575ed1daf0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:05.537165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-005c7857-e7d7-412a-a20b-09d45191fb84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2b3b21992b454d978c75b9a3cedcab', 'request_id': 'req-005c7857-e7d7-412a-a20b-09d45191fb84'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:05.554599 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2620/5215] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:05.555280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8963f71-b46e-44fd-866c-2b575ed1daf0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:05.561435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-005c7857-e7d7-412a-a20b-09d45191fb84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2b3b21992b454d978c75b9a3cedcab', 'request_id': 'req-005c7857-e7d7-412a-a20b-09d45191fb84'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:05.581249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8963f71-b46e-44fd-866c-2b575ed1daf0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:05.581679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-005c7857-e7d7-412a-a20b-09d45191fb84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2b3b21992b454d978c75b9a3cedcab', 'request_id': 'req-005c7857-e7d7-412a-a20b-09d45191fb84'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:05.621326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-005c7857-e7d7-412a-a20b-09d45191fb84 admin admin] The token cache is being invalidate because project da2b3b21992b454d978c75b9a3cedcab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:05.621634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-005c7857-e7d7-412a-a20b-09d45191fb84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:05.623584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-005c7857-e7d7-412a-a20b-09d45191fb84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:05.628405 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2596/5216] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:05 2022] DELETE /identity/v3/projects/da2b3b21992b454d978c75b9a3cedcab => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:05.638369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a462cb-0a19-4096-be3c-4b06c31af91b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:05.638369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a462cb-0a19-4096-be3c-4b06c31af91b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:05.638369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a462cb-0a19-4096-be3c-4b06c31af91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:05.695536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f9a462cb-0a19-4096-be3c-4b06c31af91b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:05.701460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f9a462cb-0a19-4096-be3c-4b06c31af91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:05.721669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1640a-f032-4e9a-a6be-4b51e2942d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:05.722304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1640a-f032-4e9a-a6be-4b51e2942d91 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:05.722590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1640a-f032-4e9a-a6be-4b51e2942d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:05.725517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1640a-f032-4e9a-a6be-4b51e2942d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:05.726356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1640a-f032-4e9a-a6be-4b51e2942d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:05.731093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1640a-f032-4e9a-a6be-4b51e2942d91 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:05.809084 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2621/5217] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:05 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:05.831670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1640a-f032-4e9a-a6be-4b51e2942d91 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:05.843630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-43f1640a-f032-4e9a-a6be-4b51e2942d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:05.904821 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2597/5218] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:12:05.908044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0296c0-feb4-4904-ab53-bda574f71844 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:05.908395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0296c0-feb4-4904-ab53-bda574f71844 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:05.908722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0296c0-feb4-4904-ab53-bda574f71844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:06.003849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5e0296c0-feb4-4904-ab53-bda574f71844 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:06.009851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5e0296c0-feb4-4904-ab53-bda574f71844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:06.077604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1640a-f032-4e9a-a6be-4b51e2942d91 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:06.094082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ca40-20ca-480f-ad2b-ac8bf5de58d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:06.096246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ca40-20ca-480f-ad2b-ac8bf5de58d5 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:06.096555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ca40-20ca-480f-ad2b-ac8bf5de58d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:06.101595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ca40-20ca-480f-ad2b-ac8bf5de58d5 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:06.102533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29ca40-20ca-480f-ad2b-ac8bf5de58d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:06.108795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29ca40-20ca-480f-ad2b-ac8bf5de58d5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:06.158246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:06.168880 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2622/5219] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:05 2022] POST /identity/v3/users => generated 289 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:06.170655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ca40-20ca-480f-ad2b-ac8bf5de58d5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:06.174810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8e29ca40-20ca-480f-ad2b-ac8bf5de58d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:06.194213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ca40-20ca-480f-ad2b-ac8bf5de58d5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:06.224698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:06.232098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:06.232618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:06.233131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] PATH_INFO: `/v3/projects/b11206f0b82241c7bfba41998ffd170a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:06.235355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11206f0b82241c7bfba41998ffd170a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:06.238200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:06.288652 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2598/5220] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:06.293909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0296c0-feb4-4904-ab53-bda574f71844 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:06.332830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0296c0-feb4-4904-ab53-bda574f71844 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:06.370538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11206f0b82241c7bfba41998ffd170a', 'request_id': 'req-5189705d-6a63-4818-a7d1-32b7a7867547'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:06.377511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:06.389555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11206f0b82241c7bfba41998ffd170a', 'request_id': 'req-5189705d-6a63-4818-a7d1-32b7a7867547'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:06.405102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11206f0b82241c7bfba41998ffd170a', 'request_id': 'req-5189705d-6a63-4818-a7d1-32b7a7867547'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:06.444155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] The token cache is being invalidate because project b11206f0b82241c7bfba41998ffd170a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:06.446599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:06.447845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:06.457038 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2623/5221] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:06 2022] DELETE /identity/v3/projects/b11206f0b82241c7bfba41998ffd170a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:06.457038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:06.459575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:06.562606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23fab0-7a2c-4486-84d5-12133858b08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:06.565267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23fab0-7a2c-4486-84d5-12133858b08a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:06.565637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23fab0-7a2c-4486-84d5-12133858b08a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:06.566304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23fab0-7a2c-4486-84d5-12133858b08a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:06.570315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23fab0-7a2c-4486-84d5-12133858b08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:06.572573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23fab0-7a2c-4486-84d5-12133858b08a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:06.605309 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2599/5222] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:06.605309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736edaa-cb70-4577-a520-c448ddd7bf25 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:06.605309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736edaa-cb70-4577-a520-c448ddd7bf25 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:06.608032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736edaa-cb70-4577-a520-c448ddd7bf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:06.653250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189705d-6a63-4818-a7d1-32b7a7867547 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:06.656117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5736edaa-cb70-4577-a520-c448ddd7bf25 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:06.658506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5736edaa-cb70-4577-a520-c448ddd7bf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:06.665956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbd046-83b8-4b87-8d2a-e2424491de2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:06.666593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbd046-83b8-4b87-8d2a-e2424491de2e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:06.666867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbd046-83b8-4b87-8d2a-e2424491de2e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:06.667149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbd046-83b8-4b87-8d2a-e2424491de2e admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:06.667798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbd046-83b8-4b87-8d2a-e2424491de2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:06.668099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbd046-83b8-4b87-8d2a-e2424491de2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:06.669711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbd046-83b8-4b87-8d2a-e2424491de2e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:06.689243 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2600/5223] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:06.690475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736edaa-cb70-4577-a520-c448ddd7bf25 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:06.697743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5736edaa-cb70-4577-a520-c448ddd7bf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:06.741975 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2624/5224] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:06.743539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc529426-8ba1-478b-aeb0-280a07021786 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:06.743830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc529426-8ba1-478b-aeb0-280a07021786 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:06.744133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc529426-8ba1-478b-aeb0-280a07021786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:06.752859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736edaa-cb70-4577-a520-c448ddd7bf25 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:06.770605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b488-efe2-424b-bfa9-5a89d69671b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:06.771571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b488-efe2-424b-bfa9-5a89d69671b1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:06.771873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b488-efe2-424b-bfa9-5a89d69671b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:06.772109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b488-efe2-424b-bfa9-5a89d69671b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:06.772754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064b488-efe2-424b-bfa9-5a89d69671b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:06.774363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064b488-efe2-424b-bfa9-5a89d69671b1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:06.794945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-dc529426-8ba1-478b-aeb0-280a07021786 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:06.796193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dc529426-8ba1-478b-aeb0-280a07021786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:06.801020 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2601/5225] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:06.801659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b488-efe2-424b-bfa9-5a89d69671b1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:06.824085 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2625/5226] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:06.825033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc529426-8ba1-478b-aeb0-280a07021786 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:06.829584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b488-efe2-424b-bfa9-5a89d69671b1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:06.843170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfba2b-db11-439e-adb6-109001bd2b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:06.844137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfba2b-db11-439e-adb6-109001bd2b79 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:06.844270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfba2b-db11-439e-adb6-109001bd2b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:06.844774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfba2b-db11-439e-adb6-109001bd2b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:06.847154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc529426-8ba1-478b-aeb0-280a07021786 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:06.847940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfba2b-db11-439e-adb6-109001bd2b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:06.850313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfba2b-db11-439e-adb6-109001bd2b79 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:06.878984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fe65d-c365-4b53-8742-6013fec43625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:06.878984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fe65d-c365-4b53-8742-6013fec43625 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:06.878984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fe65d-c365-4b53-8742-6013fec43625 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:06.878984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fe65d-c365-4b53-8742-6013fec43625 admin admin] PATH_INFO: `/v3/projects/f7e7663e704b4ca4b7a47b6f9b3113e3/users/84860f5a6aa2438dade943bb1190c678/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:06.903654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fe65d-c365-4b53-8742-6013fec43625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e7663e704b4ca4b7a47b6f9b3113e3, user_id=84860f5a6aa2438dade943bb1190c678, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:06.911973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fe65d-c365-4b53-8742-6013fec43625 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:06.920821 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2602/5227] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:06 2022] POST /identity/v3/projects => generated 395 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:06.923279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfba2b-db11-439e-adb6-109001bd2b79 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:06.946879 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2626/5228] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:06 2022] PUT /identity/v3/projects/f7e7663e704b4ca4b7a47b6f9b3113e3/users/84860f5a6aa2438dade943bb1190c678/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:06.948524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fe65d-c365-4b53-8742-6013fec43625 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:07.156850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfba2b-db11-439e-adb6-109001bd2b79 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:07.168566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fe65d-c365-4b53-8742-6013fec43625 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:07.171556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd3bce-687d-475a-ae70-ae8bba37e6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:07.172193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd3bce-687d-475a-ae70-ae8bba37e6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:07.172471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd3bce-687d-475a-ae70-ae8bba37e6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:07.172741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd3bce-687d-475a-ae70-ae8bba37e6b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:07.173477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd3bce-687d-475a-ae70-ae8bba37e6b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:07.173779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd3bce-687d-475a-ae70-ae8bba37e6b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:07.177948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd3bce-687d-475a-ae70-ae8bba37e6b8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:07.182047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9336f-fe45-47f7-95a3-16b7f8361032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:07.182684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9336f-fe45-47f7-95a3-16b7f8361032 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:07.182958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9336f-fe45-47f7-95a3-16b7f8361032 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:07.183227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9336f-fe45-47f7-95a3-16b7f8361032 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:07.183854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9336f-fe45-47f7-95a3-16b7f8361032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:07.192040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9336f-fe45-47f7-95a3-16b7f8361032 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:07.199398 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2603/5229] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:07.201054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1f674-8f29-46b1-8e12-6c8c06cbdda8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:07.201429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1f674-8f29-46b1-8e12-6c8c06cbdda8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:07.202009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1f674-8f29-46b1-8e12-6c8c06cbdda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:07.237307 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2627/5230] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:06 2022] POST /identity/v3/users => generated 304 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:07.238168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9336f-fe45-47f7-95a3-16b7f8361032 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:07.243494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-64d1f674-8f29-46b1-8e12-6c8c06cbdda8 None None] MFA Rules not processed for user `84860f5a6aa2438dade943bb1190c678`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:07.245419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-64d1f674-8f29-46b1-8e12-6c8c06cbdda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:07.262836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:07.263024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9336f-fe45-47f7-95a3-16b7f8361032 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:07.277926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2480f-cd45-4d68-a695-4a6ff0622c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:07.278567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2480f-cd45-4d68-a695-4a6ff0622c7c admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:07.278854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2480f-cd45-4d68-a695-4a6ff0622c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:07.279131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2480f-cd45-4d68-a695-4a6ff0622c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:07.279772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2480f-cd45-4d68-a695-4a6ff0622c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:07.282282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2480f-cd45-4d68-a695-4a6ff0622c7c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:07.339428 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2628/5231] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:07 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:07.340366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2480f-cd45-4d68-a695-4a6ff0622c7c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:07.365119 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2604/5232] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:07.366007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1f674-8f29-46b1-8e12-6c8c06cbdda8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:07.386552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1f674-8f29-46b1-8e12-6c8c06cbdda8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:07.408401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:07.546795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da3f02-77cf-46be-9865-acce23d46354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:07.547412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da3f02-77cf-46be-9865-acce23d46354 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:07.548609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da3f02-77cf-46be-9865-acce23d46354 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:07.549592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da3f02-77cf-46be-9865-acce23d46354 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:07.555770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da3f02-77cf-46be-9865-acce23d46354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:07.562357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da3f02-77cf-46be-9865-acce23d46354 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:07.591650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2480f-cd45-4d68-a695-4a6ff0622c7c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:07.600680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fda9aa-382b-45a1-97f7-4bbbf88cad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:07.601433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fda9aa-382b-45a1-97f7-4bbbf88cad4a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:07.607407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fda9aa-382b-45a1-97f7-4bbbf88cad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:07.617069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fda9aa-382b-45a1-97f7-4bbbf88cad4a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:07.617638 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2605/5233] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:07 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:07.619477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fda9aa-382b-45a1-97f7-4bbbf88cad4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:07.620145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da3f02-77cf-46be-9865-acce23d46354 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:07.623467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fda9aa-382b-45a1-97f7-4bbbf88cad4a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:07.647895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da3f02-77cf-46be-9865-acce23d46354 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:07.656683 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2629/5234] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:07.658024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fda9aa-382b-45a1-97f7-4bbbf88cad4a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:07.664355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b96c-b9ee-40c5-8975-f8bf61c9c4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:07.665612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b96c-b9ee-40c5-8975-f8bf61c9c4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:07.665842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b96c-b9ee-40c5-8975-f8bf61c9c4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:07.666159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b96c-b9ee-40c5-8975-f8bf61c9c4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:07.667966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9b96c-b9ee-40c5-8975-f8bf61c9c4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:07.672485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9b96c-b9ee-40c5-8975-f8bf61c9c4f1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:07.683333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fda9aa-382b-45a1-97f7-4bbbf88cad4a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:07.697589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2711f79-b240-45e1-a386-c9cc6d139776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:07.698632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2711f79-b240-45e1-a386-c9cc6d139776 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:07.698916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2711f79-b240-45e1-a386-c9cc6d139776 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:07.699190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2711f79-b240-45e1-a386-c9cc6d139776 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:07.701457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2711f79-b240-45e1-a386-c9cc6d139776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:07.705877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2711f79-b240-45e1-a386-c9cc6d139776 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:07.741032 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2630/5235] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:07.744091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2711f79-b240-45e1-a386-c9cc6d139776 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:07.750338 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2606/5236] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:07 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:07.752401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b96c-b9ee-40c5-8975-f8bf61c9c4f1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:07.773599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2711f79-b240-45e1-a386-c9cc6d139776 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:07.877085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b96c-b9ee-40c5-8975-f8bf61c9c4f1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:07.884733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe296a-1e21-443e-bfb2-1021f3c86748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:07.885791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe296a-1e21-443e-bfb2-1021f3c86748 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:07.885791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe296a-1e21-443e-bfb2-1021f3c86748 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:07.885979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe296a-1e21-443e-bfb2-1021f3c86748 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:07.886659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe296a-1e21-443e-bfb2-1021f3c86748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:07.889215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe296a-1e21-443e-bfb2-1021f3c86748 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:07.905029 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2607/5237] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:07.911815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe296a-1e21-443e-bfb2-1021f3c86748 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:07.926723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe296a-1e21-443e-bfb2-1021f3c86748 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:07.936454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3994bee-f514-43a8-a822-30477874e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:07.937144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3994bee-f514-43a8-a822-30477874e513 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:07.937519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3994bee-f514-43a8-a822-30477874e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:07.938669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3994bee-f514-43a8-a822-30477874e513 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:07.939495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3994bee-f514-43a8-a822-30477874e513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:07.941498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3994bee-f514-43a8-a822-30477874e513 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:07.950389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e84a3-b2ae-41c4-b20a-e4cfe8d6f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:07.952763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e84a3-b2ae-41c4-b20a-e4cfe8d6f41d admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:07.952917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e84a3-b2ae-41c4-b20a-e4cfe8d6f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:07.953224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e84a3-b2ae-41c4-b20a-e4cfe8d6f41d admin admin] PATH_INFO: `/v3/projects/1bc079d24d7b454abbaeb374a9413a5e/users/12209f70334e4b0dacc59d6fe7f0ab98/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:07.997236 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2608/5238] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:07 2022] POST /identity/v3/users => generated 290 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:07.997236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3994bee-f514-43a8-a822-30477874e513 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:08.010730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:08.012823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e84a3-b2ae-41c4-b20a-e4cfe8d6f41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc079d24d7b454abbaeb374a9413a5e, user_id=12209f70334e4b0dacc59d6fe7f0ab98, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:08.015673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e84a3-b2ae-41c4-b20a-e4cfe8d6f41d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:08.024688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3994bee-f514-43a8-a822-30477874e513 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:08.045160 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2631/5239] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:07 2022] PUT /identity/v3/projects/1bc079d24d7b454abbaeb374a9413a5e/users/12209f70334e4b0dacc59d6fe7f0ab98/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:08.045564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc30c27-3caa-42c6-9a89-3a4775d95ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:08.046238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e84a3-b2ae-41c4-b20a-e4cfe8d6f41d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:08.046377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc30c27-3caa-42c6-9a89-3a4775d95ace admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:08.046664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc30c27-3caa-42c6-9a89-3a4775d95ace admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:08.047185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc30c27-3caa-42c6-9a89-3a4775d95ace admin admin] PATH_INFO: `/v3/projects/649e051cb3a94531aef5cc4867fe1cfe/users/1a5c6056c64a4cb097b9a08302c49021/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:08.070246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc30c27-3caa-42c6-9a89-3a4775d95ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=649e051cb3a94531aef5cc4867fe1cfe, user_id=1a5c6056c64a4cb097b9a08302c49021, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:08.073209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc30c27-3caa-42c6-9a89-3a4775d95ace admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:08.095142 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2609/5240] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:07 2022] PUT /identity/v3/projects/649e051cb3a94531aef5cc4867fe1cfe/users/1a5c6056c64a4cb097b9a08302c49021/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:08.096171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc30c27-3caa-42c6-9a89-3a4775d95ace admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:08.202491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc30c27-3caa-42c6-9a89-3a4775d95ace admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:08.211436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40619bd2-ea7d-474b-ab83-0e2fe60f3484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:08.212917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40619bd2-ea7d-474b-ab83-0e2fe60f3484 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:08.213378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40619bd2-ea7d-474b-ab83-0e2fe60f3484 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:08.213793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40619bd2-ea7d-474b-ab83-0e2fe60f3484 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:08.214620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40619bd2-ea7d-474b-ab83-0e2fe60f3484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:08.216562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40619bd2-ea7d-474b-ab83-0e2fe60f3484 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:08.231859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e84a3-b2ae-41c4-b20a-e4cfe8d6f41d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:08.239021 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2610/5241] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:08.240404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80890f5a-7218-4992-8779-be9814617f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:08.241000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19146bf-54bc-41e9-affe-7e88f5f8d979 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:08.241180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80890f5a-7218-4992-8779-be9814617f31 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:08.241531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80890f5a-7218-4992-8779-be9814617f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:08.241805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19146bf-54bc-41e9-affe-7e88f5f8d979 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:08.241948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80890f5a-7218-4992-8779-be9814617f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:08.242348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19146bf-54bc-41e9-affe-7e88f5f8d979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:08.243641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80890f5a-7218-4992-8779-be9814617f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:08.245543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80890f5a-7218-4992-8779-be9814617f31 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:08.258887 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2632/5242] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:08.262275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80890f5a-7218-4992-8779-be9814617f31 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:08.282654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80890f5a-7218-4992-8779-be9814617f31 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:08.287109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e19146bf-54bc-41e9-affe-7e88f5f8d979 None None] MFA Rules not processed for user `1a5c6056c64a4cb097b9a08302c49021`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:08.288713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e19146bf-54bc-41e9-affe-7e88f5f8d979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:08.293091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807caae-646c-4f91-82d6-51bc33214be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:08.296681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807caae-646c-4f91-82d6-51bc33214be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:08.297217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807caae-646c-4f91-82d6-51bc33214be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:08.297730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807caae-646c-4f91-82d6-51bc33214be0 admin admin] PATH_INFO: `/v3/projects/1bc079d24d7b454abbaeb374a9413a5e/users/12209f70334e4b0dacc59d6fe7f0ab98/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:08.300865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807caae-646c-4f91-82d6-51bc33214be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc079d24d7b454abbaeb374a9413a5e, user_id=12209f70334e4b0dacc59d6fe7f0ab98, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:08.306910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807caae-646c-4f91-82d6-51bc33214be0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:08.323382 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2633/5243] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:08 2022] PUT /identity/v3/projects/1bc079d24d7b454abbaeb374a9413a5e/users/12209f70334e4b0dacc59d6fe7f0ab98/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:08.324905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807caae-646c-4f91-82d6-51bc33214be0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:08.334445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:08.418707 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2611/5244] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:08.421246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b74dcd-be4f-4ac2-90e2-731e96191f94 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:08.421632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b74dcd-be4f-4ac2-90e2-731e96191f94 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:08.421832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b74dcd-be4f-4ac2-90e2-731e96191f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:08.464961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807caae-646c-4f91-82d6-51bc33214be0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:08.476297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f4f4f-e5ca-4354-a203-e3242a7d2f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:08.477361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f4f4f-e5ca-4354-a203-e3242a7d2f39 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:08.477932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f4f4f-e5ca-4354-a203-e3242a7d2f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:08.478213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f4f4f-e5ca-4354-a203-e3242a7d2f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:08.479499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f4f4f-e5ca-4354-a203-e3242a7d2f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:08.482298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f4f4f-e5ca-4354-a203-e3242a7d2f39 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:08.484931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a0b74dcd-be4f-4ac2-90e2-731e96191f94 None None] MFA Rules not processed for user `12209f70334e4b0dacc59d6fe7f0ab98`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:08.486687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a0b74dcd-be4f-4ac2-90e2-731e96191f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:08.501143 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2634/5245] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:08.502077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f4f4f-e5ca-4354-a203-e3242a7d2f39 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:08.604774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:08.616386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f4f4f-e5ca-4354-a203-e3242a7d2f39 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:08.630258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a9484-9ccd-4478-af99-85b02a77bdeb tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c6056c64a4cb097b9a08302c49021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '649e051cb3a94531aef5cc4867fe1cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:08.632534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9484-9ccd-4478-af99-85b02a77bdeb tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:08.632849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9484-9ccd-4478-af99-85b02a77bdeb tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:08.633679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9484-9ccd-4478-af99-85b02a77bdeb tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] PATH_INFO: `/v3/users/1a5c6056c64a4cb097b9a08302c49021/application_credentials` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:08.635653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a9484-9ccd-4478-af99-85b02a77bdeb tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorizing `identity:create_application_credential(user_id=1a5c6056c64a4cb097b9a08302c49021)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:08.638591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a9484-9ccd-4478-af99-85b02a77bdeb tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:08.659538 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2612/5246] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:08.659538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b74dcd-be4f-4ac2-90e2-731e96191f94 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:08.681250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b74dcd-be4f-4ac2-90e2-731e96191f94 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:08.690376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ebdba-bd37-4c26-bdc3-4567652b76fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:08.693398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ebdba-bd37-4c26-bdc3-4567652b76fb admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:08.693679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ebdba-bd37-4c26-bdc3-4567652b76fb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:08.693945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ebdba-bd37-4c26-bdc3-4567652b76fb admin admin] PATH_INFO: `/v3/projects/15460c4dec1441648845f3b0496ee430/users/e8981e478a2f44f3abad9bf6f005bd7a/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:08.728895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ebdba-bd37-4c26-bdc3-4567652b76fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=15460c4dec1441648845f3b0496ee430, user_id=e8981e478a2f44f3abad9bf6f005bd7a, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:08.732234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ebdba-bd37-4c26-bdc3-4567652b76fb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:08.770654 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2613/5247] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:08 2022] PUT /identity/v3/projects/15460c4dec1441648845f3b0496ee430/users/e8981e478a2f44f3abad9bf6f005bd7a/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:08.770654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ebdba-bd37-4c26-bdc3-4567652b76fb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:08.780968 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2635/5248] 10.222.0.26 () {60 vars in 1315 bytes} [Sat Oct 8 21:12:08 2022] POST /identity/v3/users/1a5c6056c64a4cb097b9a08302c49021/application_credentials => generated 921 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:08.780968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca3a70-33c5-4c1a-8c3c-263bf5575f10 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:08.780968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca3a70-33c5-4c1a-8c3c-263bf5575f10 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:08.780968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca3a70-33c5-4c1a-8c3c-263bf5575f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:08.827031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-57ca3a70-33c5-4c1a-8c3c-263bf5575f10 None None] MFA Rules not processed for user `e8981e478a2f44f3abad9bf6f005bd7a`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:08.831249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-57ca3a70-33c5-4c1a-8c3c-263bf5575f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:08.873517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:08.893917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ebdba-bd37-4c26-bdc3-4567652b76fb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:08.900462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0efbd-1137-490f-b77e-84f3e6a2725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:08.902271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0efbd-1137-490f-b77e-84f3e6a2725a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:08.902834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0efbd-1137-490f-b77e-84f3e6a2725a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:08.903305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0efbd-1137-490f-b77e-84f3e6a2725a admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:08.904202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0efbd-1137-490f-b77e-84f3e6a2725a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:08.906742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0efbd-1137-490f-b77e-84f3e6a2725a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:08.932847 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2636/5249] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:08.932847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca3a70-33c5-4c1a-8c3c-263bf5575f10 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:08.967762 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2614/5250] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:08 2022] POST /identity/v3/projects => generated 395 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:08.972297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0efbd-1137-490f-b77e-84f3e6a2725a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:09.074423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca3a70-33c5-4c1a-8c3c-263bf5575f10 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:09.087738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0efbd-1137-490f-b77e-84f3e6a2725a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:09.093412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9200fd-a6cc-4da3-8095-a0e41ad010b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:09.094259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9200fd-a6cc-4da3-8095-a0e41ad010b6 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:09.094690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9200fd-a6cc-4da3-8095-a0e41ad010b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:09.095449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9200fd-a6cc-4da3-8095-a0e41ad010b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:09.096328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9200fd-a6cc-4da3-8095-a0e41ad010b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:09.099258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9200fd-a6cc-4da3-8095-a0e41ad010b6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:09.138189 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2615/5251] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:08 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:09.139394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9200fd-a6cc-4da3-8095-a0e41ad010b6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:09.168281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0734cb4-fca3-4931-9d3d-7a7d11aabfd5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c6056c64a4cb097b9a08302c49021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '649e051cb3a94531aef5cc4867fe1cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:09.169226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0734cb4-fca3-4931-9d3d-7a7d11aabfd5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:09.170522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0734cb4-fca3-4931-9d3d-7a7d11aabfd5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:09.171445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0734cb4-fca3-4931-9d3d-7a7d11aabfd5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] PATH_INFO: `/v3/users/1a5c6056c64a4cb097b9a08302c49021/access_rules/a394806735be49739de9c7a7057bef0e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:09.174712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0734cb4-fca3-4931-9d3d-7a7d11aabfd5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorizing `identity:delete_access_rule(user_id=1a5c6056c64a4cb097b9a08302c49021, access_rule_id=a394806735be49739de9c7a7057bef0e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:09.177547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0734cb4-fca3-4931-9d3d-7a7d11aabfd5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:09.222425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:09.272994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9200fd-a6cc-4da3-8095-a0e41ad010b6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:09.279928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380145ee-b419-4388-809b-439dafbe4b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:09.281263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380145ee-b419-4388-809b-439dafbe4b70 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:09.281927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380145ee-b419-4388-809b-439dafbe4b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:09.282349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380145ee-b419-4388-809b-439dafbe4b70 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:09.283129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380145ee-b419-4388-809b-439dafbe4b70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:09.286747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380145ee-b419-4388-809b-439dafbe4b70 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:09.322473 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2616/5252] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:09 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:09.323662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380145ee-b419-4388-809b-439dafbe4b70 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-b0734cb4-fca3-4931-9d3d-7a7d11aabfd5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application session.delete(ref) Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application next(self.gen) Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application yield resource Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application next(self.gen) Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.session.rollback() Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.force_reraise() Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 21:12:09.329886 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise self.value Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application session.commit() Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._prepare_impl() Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.session.flush() Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._flush(objects) Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 08 21:12:09.331539 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application compat.raise_( Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application flush_context.execute() Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rec.execute(self) Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._synchronize( Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise AssertionError( Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 08 21:12:09.332760 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:12:09.335546 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:12:09.336761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 08 21:12:09.336761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 08 21:12:09.336761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 08 21:12:09.336761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 08 21:12:09.336761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 08 21:12:09.336761 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:12:09.336761 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2637/5253] 10.222.0.26 () {58 vars in 1362 bytes} [Sat Oct 8 21:12:08 2022] DELETE /identity/v3/users/1a5c6056c64a4cb097b9a08302c49021/access_rules/a394806735be49739de9c7a7057bef0e => generated 89 bytes in 401 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 08 21:12:09.336761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0734cb4-fca3-4931-9d3d-7a7d11aabfd5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:09.344187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380145ee-b419-4388-809b-439dafbe4b70 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:09.347511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0734cb4-fca3-4931-9d3d-7a7d11aabfd5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:09.351449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e45d-039d-4635-8297-e324e1a891bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:09.352327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e45d-039d-4635-8297-e324e1a891bb admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:09.353569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef62cc-5b8e-4b8f-a182-2714f3d95af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:09.354121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef62cc-5b8e-4b8f-a182-2714f3d95af6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:09.354684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef62cc-5b8e-4b8f-a182-2714f3d95af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:09.354806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef62cc-5b8e-4b8f-a182-2714f3d95af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:09.355425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e45d-039d-4635-8297-e324e1a891bb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:09.355648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef62cc-5b8e-4b8f-a182-2714f3d95af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:09.356021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e45d-039d-4635-8297-e324e1a891bb admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:09.356935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605e45d-039d-4635-8297-e324e1a891bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:09.358035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef62cc-5b8e-4b8f-a182-2714f3d95af6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:09.363033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605e45d-039d-4635-8297-e324e1a891bb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:09.383824 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2638/5254] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:09.384813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef62cc-5b8e-4b8f-a182-2714f3d95af6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:09.405960 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2617/5255] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:09 2022] POST /identity/v3/users => generated 296 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:09.406833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e45d-039d-4635-8297-e324e1a891bb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:09.431877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e45d-039d-4635-8297-e324e1a891bb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:09.440941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dfba1-ff26-4cc3-865c-a6a6ff85f76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:09.444159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dfba1-ff26-4cc3-865c-a6a6ff85f76d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:09.444447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dfba1-ff26-4cc3-865c-a6a6ff85f76d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:09.444745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dfba1-ff26-4cc3-865c-a6a6ff85f76d admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:09.445517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7dfba1-ff26-4cc3-865c-a6a6ff85f76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:09.448700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7dfba1-ff26-4cc3-865c-a6a6ff85f76d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:09.476116 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2618/5256] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:09.477075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dfba1-ff26-4cc3-865c-a6a6ff85f76d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:09.488898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dfba1-ff26-4cc3-865c-a6a6ff85f76d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:09.497791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac11e6-5927-40af-bf19-1e6a2712f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:09.498284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac11e6-5927-40af-bf19-1e6a2712f1aa admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:09.498625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac11e6-5927-40af-bf19-1e6a2712f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:09.498865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac11e6-5927-40af-bf19-1e6a2712f1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:09.499483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac11e6-5927-40af-bf19-1e6a2712f1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:09.501099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac11e6-5927-40af-bf19-1e6a2712f1aa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:09.506262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef62cc-5b8e-4b8f-a182-2714f3d95af6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:09.511268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ff419-dd34-49c8-8963-492fb7f278b7 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c6056c64a4cb097b9a08302c49021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '649e051cb3a94531aef5cc4867fe1cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:09.512041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ff419-dd34-49c8-8963-492fb7f278b7 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:09.512451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ff419-dd34-49c8-8963-492fb7f278b7 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:09.512883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ff419-dd34-49c8-8963-492fb7f278b7 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] PATH_INFO: `/v3/users/1a5c6056c64a4cb097b9a08302c49021/application_credentials/e087bad51f25490aab0645b1cd35b163` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:09.519380 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2619/5257] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:09.521223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac11e6-5927-40af-bf19-1e6a2712f1aa admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:09.531878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac11e6-5927-40af-bf19-1e6a2712f1aa admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:09.537024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb1160-9833-4ed8-83a9-36481ab1520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:09.537728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1160-9833-4ed8-83a9-36481ab1520a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:09.538011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1160-9833-4ed8-83a9-36481ab1520a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:09.538291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1160-9833-4ed8-83a9-36481ab1520a admin admin] PATH_INFO: `/v3/projects/628680071e374e29b05c92ac9dfe98f6/users/137302d4c39d4b5b906ed61b22aab298/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:09.577536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ff419-dd34-49c8-8963-492fb7f278b7 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorizing `identity:delete_application_credential(user_id=1a5c6056c64a4cb097b9a08302c49021, application_credential_id=e087bad51f25490aab0645b1cd35b163)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:09.580910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ff419-dd34-49c8-8963-492fb7f278b7 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:09.586489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb1160-9833-4ed8-83a9-36481ab1520a admin admin] RBAC: Authorizing `identity:create_grant(project_id=628680071e374e29b05c92ac9dfe98f6, user_id=137302d4c39d4b5b906ed61b22aab298, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:09.588739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:09.590671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb1160-9833-4ed8-83a9-36481ab1520a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:09.616985 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2620/5258] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:09 2022] PUT /identity/v3/projects/628680071e374e29b05c92ac9dfe98f6/users/137302d4c39d4b5b906ed61b22aab298/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:09.617856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb1160-9833-4ed8-83a9-36481ab1520a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:09.638845 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2639/5259] 10.222.0.26 () {58 vars in 1395 bytes} [Sat Oct 8 21:12:09 2022] DELETE /identity/v3/users/1a5c6056c64a4cb097b9a08302c49021/application_credentials/e087bad51f25490aab0645b1cd35b163 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:09.640292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfbf78-ef53-44bc-b7eb-f5a0537961fa None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:09.640512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfbf78-ef53-44bc-b7eb-f5a0537961fa None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:09.640794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfbf78-ef53-44bc-b7eb-f5a0537961fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:09.684479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-18dfbf78-ef53-44bc-b7eb-f5a0537961fa None None] MFA Rules not processed for user `137302d4c39d4b5b906ed61b22aab298`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:09.685771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-18dfbf78-ef53-44bc-b7eb-f5a0537961fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:09.733819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb1160-9833-4ed8-83a9-36481ab1520a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:09.741556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93447b5f-7b8b-4a0d-ae3b-d3ae48fd298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:09.742373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93447b5f-7b8b-4a0d-ae3b-d3ae48fd298c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:09.742660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93447b5f-7b8b-4a0d-ae3b-d3ae48fd298c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:09.742933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93447b5f-7b8b-4a0d-ae3b-d3ae48fd298c admin admin] PATH_INFO: `/v3/projects/661a9f4c42764204be9cd5a7fb10092b/users/2a2cbb81401a41b9963c999f3b0417f9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:09.764326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93447b5f-7b8b-4a0d-ae3b-d3ae48fd298c admin admin] RBAC: Authorizing `identity:create_grant(project_id=661a9f4c42764204be9cd5a7fb10092b, user_id=2a2cbb81401a41b9963c999f3b0417f9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:09.769931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93447b5f-7b8b-4a0d-ae3b-d3ae48fd298c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:09.789760 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2640/5260] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:09.794106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfbf78-ef53-44bc-b7eb-f5a0537961fa None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:09.804752 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2621/5261] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:09 2022] PUT /identity/v3/projects/661a9f4c42764204be9cd5a7fb10092b/users/2a2cbb81401a41b9963c999f3b0417f9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:09.805647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93447b5f-7b8b-4a0d-ae3b-d3ae48fd298c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:09.810106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-93447b5f-7b8b-4a0d-ae3b-d3ae48fd298c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:09.871068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:09.889107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93447b5f-7b8b-4a0d-ae3b-d3ae48fd298c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:09.895678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b31c68-ae5c-436c-8ed5-4b51f514ef80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:09.896528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b31c68-ae5c-436c-8ed5-4b51f514ef80 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:09.896962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b31c68-ae5c-436c-8ed5-4b51f514ef80 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:09.897511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b31c68-ae5c-436c-8ed5-4b51f514ef80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:09.899988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-66b31c68-ae5c-436c-8ed5-4b51f514ef80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:09.902609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfbf78-ef53-44bc-b7eb-f5a0537961fa None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:09.916498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b31c68-ae5c-436c-8ed5-4b51f514ef80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:09.918762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b31c68-ae5c-436c-8ed5-4b51f514ef80 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:09.939991 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2622/5262] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:09.941089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b31c68-ae5c-436c-8ed5-4b51f514ef80 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:09.943274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-66b31c68-ae5c-436c-8ed5-4b51f514ef80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:09.988972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d918f-dfa4-4c74-a077-80b1b989b3e1 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c6056c64a4cb097b9a08302c49021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '649e051cb3a94531aef5cc4867fe1cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:09.990501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d918f-dfa4-4c74-a077-80b1b989b3e1 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:09.990624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d918f-dfa4-4c74-a077-80b1b989b3e1 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:09.990938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d918f-dfa4-4c74-a077-80b1b989b3e1 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] PATH_INFO: `/v3/users/1a5c6056c64a4cb097b9a08302c49021/access_rules` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:09.992621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d918f-dfa4-4c74-a077-80b1b989b3e1 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorizing `identity:list_access_rules(user_id=1a5c6056c64a4cb097b9a08302c49021)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:09.994458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d918f-dfa4-4c74-a077-80b1b989b3e1 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:10.008784 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2641/5263] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:12:09 2022] GET /identity/v3/users/1a5c6056c64a4cb097b9a08302c49021/access_rules => generated 369 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:10.009509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d918f-dfa4-4c74-a077-80b1b989b3e1 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:10.044436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b31c68-ae5c-436c-8ed5-4b51f514ef80 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:10.055431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813d754-f7ab-464b-b8d1-cb63e1f28dcc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:10.055872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:10.056055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813d754-f7ab-464b-b8d1-cb63e1f28dcc service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:10.056342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813d754-f7ab-464b-b8d1-cb63e1f28dcc service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:10.056618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813d754-f7ab-464b-b8d1-cb63e1f28dcc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:10.093703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d918f-dfa4-4c74-a077-80b1b989b3e1 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:10.099677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48892ba6-69a3-4155-8b89-2241a316d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:10.100638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892ba6-69a3-4155-8b89-2241a316d34c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:10.100999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892ba6-69a3-4155-8b89-2241a316d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:10.101408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892ba6-69a3-4155-8b89-2241a316d34c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:10.102125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48892ba6-69a3-4155-8b89-2241a316d34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:10.103790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48892ba6-69a3-4155-8b89-2241a316d34c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:10.128006 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2642/5264] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:10.128006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48892ba6-69a3-4155-8b89-2241a316d34c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:10.149352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48892ba6-69a3-4155-8b89-2241a316d34c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:10.154890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813d754-f7ab-464b-b8d1-cb63e1f28dcc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:10.155377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813d754-f7ab-464b-b8d1-cb63e1f28dcc service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:10.157642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308ee2b-2783-49d5-894b-6edab228b3cd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c6056c64a4cb097b9a08302c49021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '649e051cb3a94531aef5cc4867fe1cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:10.158612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308ee2b-2783-49d5-894b-6edab228b3cd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:10.159052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308ee2b-2783-49d5-894b-6edab228b3cd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:10.159500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308ee2b-2783-49d5-894b-6edab228b3cd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] PATH_INFO: `/v3/users/1a5c6056c64a4cb097b9a08302c49021/access_rules/a394806735be49739de9c7a7057bef0e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:10.162047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308ee2b-2783-49d5-894b-6edab228b3cd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorizing `identity:delete_access_rule(user_id=1a5c6056c64a4cb097b9a08302c49021, access_rule_id=a394806735be49739de9c7a7057bef0e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:10.164282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308ee2b-2783-49d5-894b-6edab228b3cd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:10.169328 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2623/5265] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:09 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:10.170299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813d754-f7ab-464b-b8d1-cb63e1f28dcc service glance] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:10.186564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813d754-f7ab-464b-b8d1-cb63e1f28dcc service glance] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:10.192782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af08bd-c5c0-4307-9a72-1c693b219c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:10.193783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af08bd-c5c0-4307-9a72-1c693b219c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:10.194176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af08bd-c5c0-4307-9a72-1c693b219c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:10.195507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af08bd-c5c0-4307-9a72-1c693b219c39 admin admin] PATH_INFO: `/v3/projects/661a9f4c42764204be9cd5a7fb10092b/users/2a2cbb81401a41b9963c999f3b0417f9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:10.197062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af08bd-c5c0-4307-9a72-1c693b219c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661a9f4c42764204be9cd5a7fb10092b, user_id=2a2cbb81401a41b9963c999f3b0417f9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:10.199102 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2643/5266] 10.222.0.26 () {58 vars in 1362 bytes} [Sat Oct 8 21:12:10 2022] DELETE /identity/v3/users/1a5c6056c64a4cb097b9a08302c49021/access_rules/a394806735be49739de9c7a7057bef0e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:10.203088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308ee2b-2783-49d5-894b-6edab228b3cd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:10.203477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af08bd-c5c0-4307-9a72-1c693b219c39 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:10.220339 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2624/5267] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:10 2022] PUT /identity/v3/projects/661a9f4c42764204be9cd5a7fb10092b/users/2a2cbb81401a41b9963c999f3b0417f9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:10.221894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308ee2b-2783-49d5-894b-6edab228b3cd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:10.245773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89d18e-fd5e-4949-8df4-068d69c95310 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:10.246768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89d18e-fd5e-4949-8df4-068d69c95310 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:10.247791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89d18e-fd5e-4949-8df4-068d69c95310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:10.316479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2a89d18e-fd5e-4949-8df4-068d69c95310 None None] MFA Rules not processed for user `2a2cbb81401a41b9963c999f3b0417f9`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:10.320054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2a89d18e-fd5e-4949-8df4-068d69c95310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:10.350998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e596ad-4a3c-4385-80af-870fa16198b5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c6056c64a4cb097b9a08302c49021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '649e051cb3a94531aef5cc4867fe1cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:10.351951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e596ad-4a3c-4385-80af-870fa16198b5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:10.352342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e596ad-4a3c-4385-80af-870fa16198b5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:10.352784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e596ad-4a3c-4385-80af-870fa16198b5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] PATH_INFO: `/v3/users/1a5c6056c64a4cb097b9a08302c49021/access_rules` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:10.354378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e596ad-4a3c-4385-80af-870fa16198b5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorizing `identity:list_access_rules(user_id=1a5c6056c64a4cb097b9a08302c49021)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:10.356761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e596ad-4a3c-4385-80af-870fa16198b5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:10.371890 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2644/5268] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:12:10 2022] GET /identity/v3/users/1a5c6056c64a4cb097b9a08302c49021/access_rules => generated 158 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:10.373405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e596ad-4a3c-4385-80af-870fa16198b5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:10.395710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e596ad-4a3c-4385-80af-870fa16198b5 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:10.404969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be22c9e-a2dc-4bf0-adf4-b8861aa74bdd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c6056c64a4cb097b9a08302c49021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '649e051cb3a94531aef5cc4867fe1cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:10.406047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be22c9e-a2dc-4bf0-adf4-b8861aa74bdd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:10.406915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be22c9e-a2dc-4bf0-adf4-b8861aa74bdd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:10.408332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be22c9e-a2dc-4bf0-adf4-b8861aa74bdd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] PATH_INFO: `/v3/users/1a5c6056c64a4cb097b9a08302c49021/application_credentials` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:10.409740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be22c9e-a2dc-4bf0-adf4-b8861aa74bdd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorizing `identity:create_application_credential(user_id=1a5c6056c64a4cb097b9a08302c49021)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:10.412462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be22c9e-a2dc-4bf0-adf4-b8861aa74bdd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:10.481344 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2625/5269] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:12:10.502912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89d18e-fd5e-4949-8df4-068d69c95310 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:10.504541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2a89d18e-fd5e-4949-8df4-068d69c95310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:10.523331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:10.547078 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2645/5270] 10.222.0.26 () {60 vars in 1315 bytes} [Sat Oct 8 21:12:10 2022] POST /identity/v3/users/1a5c6056c64a4cb097b9a08302c49021/application_credentials => generated 919 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:10.548475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be22c9e-a2dc-4bf0-adf4-b8861aa74bdd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:10.575790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be22c9e-a2dc-4bf0-adf4-b8861aa74bdd tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:10.586504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f7d63-af0f-4ba9-bb42-3d5644fbfdc6 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c6056c64a4cb097b9a08302c49021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '649e051cb3a94531aef5cc4867fe1cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:10.587544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7d63-af0f-4ba9-bb42-3d5644fbfdc6 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:10.587828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7d63-af0f-4ba9-bb42-3d5644fbfdc6 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:10.588133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7d63-af0f-4ba9-bb42-3d5644fbfdc6 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] PATH_INFO: `/v3/users/1a5c6056c64a4cb097b9a08302c49021/access_rules` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:10.589552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f7d63-af0f-4ba9-bb42-3d5644fbfdc6 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorizing `identity:list_access_rules(user_id=1a5c6056c64a4cb097b9a08302c49021)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:10.591026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f7d63-af0f-4ba9-bb42-3d5644fbfdc6 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:10.597980 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2646/5271] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:12:10 2022] GET /identity/v3/users/1a5c6056c64a4cb097b9a08302c49021/access_rules => generated 369 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:10.603689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f7d63-af0f-4ba9-bb42-3d5644fbfdc6 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:10.614116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f7d63-af0f-4ba9-bb42-3d5644fbfdc6 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:10.626804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baa23c-45b5-4491-af28-78a885df4919 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c6056c64a4cb097b9a08302c49021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '649e051cb3a94531aef5cc4867fe1cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:10.637356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baa23c-45b5-4491-af28-78a885df4919 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:10.637658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baa23c-45b5-4491-af28-78a885df4919 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:10.637946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baa23c-45b5-4491-af28-78a885df4919 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] PATH_INFO: `/v3/users/1a5c6056c64a4cb097b9a08302c49021/application_credentials` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:10.640526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52baa23c-45b5-4491-af28-78a885df4919 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorizing `identity:create_application_credential(user_id=1a5c6056c64a4cb097b9a08302c49021)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:10.641715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52baa23c-45b5-4491-af28-78a885df4919 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:10.659176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89d18e-fd5e-4949-8df4-068d69c95310 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:10.668681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86105c25-7c37-4319-b09a-03829af1df96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:10.669088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86105c25-7c37-4319-b09a-03829af1df96 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:10.669395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86105c25-7c37-4319-b09a-03829af1df96 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:10.669673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86105c25-7c37-4319-b09a-03829af1df96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:10.684428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86105c25-7c37-4319-b09a-03829af1df96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:10.687173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86105c25-7c37-4319-b09a-03829af1df96 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:10.688557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:10.704814 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2626/5272] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:12:10.773100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86105c25-7c37-4319-b09a-03829af1df96 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:10.774785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-86105c25-7c37-4319-b09a-03829af1df96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:10.789820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86105c25-7c37-4319-b09a-03829af1df96 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:10.801992 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2647/5273] 10.222.0.26 () {60 vars in 1315 bytes} [Sat Oct 8 21:12:10 2022] POST /identity/v3/users/1a5c6056c64a4cb097b9a08302c49021/application_credentials => generated 920 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:12:10.807724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144392c-378f-4211-8741-69caa7cab2f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:10.808578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144392c-378f-4211-8741-69caa7cab2f0 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:10.809506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144392c-378f-4211-8741-69caa7cab2f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:10.809763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144392c-378f-4211-8741-69caa7cab2f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:10.814658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baa23c-45b5-4491-af28-78a885df4919 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:10.835361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baa23c-45b5-4491-af28-78a885df4919 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:10.846526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed6ea0-4887-4c1f-959c-32cd71ce5775 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c6056c64a4cb097b9a08302c49021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '649e051cb3a94531aef5cc4867fe1cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:10.847465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed6ea0-4887-4c1f-959c-32cd71ce5775 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:10.848605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed6ea0-4887-4c1f-959c-32cd71ce5775 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:10.849046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed6ea0-4887-4c1f-959c-32cd71ce5775 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] PATH_INFO: `/v3/users/1a5c6056c64a4cb097b9a08302c49021/access_rules/d5b39c9273704cc4af7ac3a0bcf12ad4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:10.851012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed6ea0-4887-4c1f-959c-32cd71ce5775 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorizing `identity:get_access_rule(user_id=1a5c6056c64a4cb097b9a08302c49021, access_rule_id=d5b39c9273704cc4af7ac3a0bcf12ad4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:10.852940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed6ea0-4887-4c1f-959c-32cd71ce5775 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:10.861147 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2648/5274] 10.222.0.26 () {58 vars in 1359 bytes} [Sat Oct 8 21:12:10 2022] GET /identity/v3/users/1a5c6056c64a4cb097b9a08302c49021/access_rules/d5b39c9273704cc4af7ac3a0bcf12ad4 => generated 229 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:12:10.861839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed6ea0-4887-4c1f-959c-32cd71ce5775 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:10.916141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144392c-378f-4211-8741-69caa7cab2f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:10.918026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144392c-378f-4211-8741-69caa7cab2f0 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:10.934427 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2627/5275] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:12:10.936165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144392c-378f-4211-8741-69caa7cab2f0 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:11.048967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed6ea0-4887-4c1f-959c-32cd71ce5775 tempest-AccessRulesV3Test-169449964 tempest-AccessRulesV3Test-169449964-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:11.065697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b4018-53fe-4cc9-bf26-94f95e37fec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:11.066368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b4018-53fe-4cc9-bf26-94f95e37fec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:11.066710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b4018-53fe-4cc9-bf26-94f95e37fec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:11.067062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b4018-53fe-4cc9-bf26-94f95e37fec8 admin admin] PATH_INFO: `/v3/users/12209f70334e4b0dacc59d6fe7f0ab98` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:11.072516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b4018-53fe-4cc9-bf26-94f95e37fec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12209f70334e4b0dacc59d6fe7f0ab98)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:11.073959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b4018-53fe-4cc9-bf26-94f95e37fec8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:11.081493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144392c-378f-4211-8741-69caa7cab2f0 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:11.089180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81303db-732e-482f-b44e-8052a2857364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:11.090131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81303db-732e-482f-b44e-8052a2857364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:11.090565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81303db-732e-482f-b44e-8052a2857364 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:11.090993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81303db-732e-482f-b44e-8052a2857364 admin admin] PATH_INFO: `/v3/users/1a5c6056c64a4cb097b9a08302c49021` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:11.092872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81303db-732e-482f-b44e-8052a2857364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5c6056c64a4cb097b9a08302c49021)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:11.095919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81303db-732e-482f-b44e-8052a2857364 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:11.159274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-152b4018-53fe-4cc9-bf26-94f95e37fec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12209f70334e4b0dacc59d6fe7f0ab98'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:11.169368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-152b4018-53fe-4cc9-bf26-94f95e37fec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12209f70334e4b0dacc59d6fe7f0ab98'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:11.170282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-152b4018-53fe-4cc9-bf26-94f95e37fec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12209f70334e4b0dacc59d6fe7f0ab98'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:11.171201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-152b4018-53fe-4cc9-bf26-94f95e37fec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12209f70334e4b0dacc59d6fe7f0ab98'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:11.187283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b81303db-732e-482f-b44e-8052a2857364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5c6056c64a4cb097b9a08302c49021'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:11.196245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-152b4018-53fe-4cc9-bf26-94f95e37fec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12209f70334e4b0dacc59d6fe7f0ab98'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:11.198872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:11.203069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b81303db-732e-482f-b44e-8052a2857364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5c6056c64a4cb097b9a08302c49021'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:11.203930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b81303db-732e-482f-b44e-8052a2857364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5c6056c64a4cb097b9a08302c49021'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:11.205764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b81303db-732e-482f-b44e-8052a2857364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5c6056c64a4cb097b9a08302c49021'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:11.226557 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2649/5276] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:10 2022] DELETE /identity/v3/users/12209f70334e4b0dacc59d6fe7f0ab98 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:11.231801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472f3d4-bc78-45ac-9629-f3903b103ad1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:11.232779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472f3d4-bc78-45ac-9629-f3903b103ad1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:11.233523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472f3d4-bc78-45ac-9629-f3903b103ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:11.279525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f472f3d4-bc78-45ac-9629-f3903b103ad1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:11.281427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f472f3d4-bc78-45ac-9629-f3903b103ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:11.290022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b81303db-732e-482f-b44e-8052a2857364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5c6056c64a4cb097b9a08302c49021'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:11.322923 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2628/5277] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:10 2022] DELETE /identity/v3/users/1a5c6056c64a4cb097b9a08302c49021 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:11.324251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48ed51-b460-404f-ba14-89be36aca114 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:11.324541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48ed51-b460-404f-ba14-89be36aca114 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:11.324902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48ed51-b460-404f-ba14-89be36aca114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:11.325894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:11.389899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fa48ed51-b460-404f-ba14-89be36aca114 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:11.391675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fa48ed51-b460-404f-ba14-89be36aca114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:11.420528 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2650/5278] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:11.434260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472f3d4-bc78-45ac-9629-f3903b103ad1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:11.436970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f472f3d4-bc78-45ac-9629-f3903b103ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:11.535735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472f3d4-bc78-45ac-9629-f3903b103ad1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:11.612355 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2629/5279] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:11.644323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48ed51-b460-404f-ba14-89be36aca114 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:11.654377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc3eec-6478-4bec-b609-3c43fda7558d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:11.655543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3eec-6478-4bec-b609-3c43fda7558d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:11.656163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3eec-6478-4bec-b609-3c43fda7558d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:11.656646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3eec-6478-4bec-b609-3c43fda7558d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:11.673259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc3eec-6478-4bec-b609-3c43fda7558d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:11.675872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc3eec-6478-4bec-b609-3c43fda7558d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:11.705314 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2651/5280] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:11.772683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48ed51-b460-404f-ba14-89be36aca114 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:11.783578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50f404-7d25-4c3f-a14b-0fdc1113750c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:11.784564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f404-7d25-4c3f-a14b-0fdc1113750c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:11.784950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f404-7d25-4c3f-a14b-0fdc1113750c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:11.788930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f404-7d25-4c3f-a14b-0fdc1113750c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:11.812436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50f404-7d25-4c3f-a14b-0fdc1113750c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:11.814117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50f404-7d25-4c3f-a14b-0fdc1113750c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:11.826401 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2630/5281] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:12.381795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc3eec-6478-4bec-b609-3c43fda7558d service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:12.384308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e3fc3eec-6478-4bec-b609-3c43fda7558d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:12.410007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc3eec-6478-4bec-b609-3c43fda7558d service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:12.416753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:12.417949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:12.418362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:12.419460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] PATH_INFO: `/v3/projects/1bc079d24d7b454abbaeb374a9413a5e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:12.421575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc079d24d7b454abbaeb374a9413a5e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:12.438432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:12.541885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50f404-7d25-4c3f-a14b-0fdc1113750c service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:12.544177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ee50f404-7d25-4c3f-a14b-0fdc1113750c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:12.560766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50f404-7d25-4c3f-a14b-0fdc1113750c service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:12.565014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc079d24d7b454abbaeb374a9413a5e', 'request_id': 'req-4d70f08a-c1d0-4887-90db-965db8587345'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:12.577447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc079d24d7b454abbaeb374a9413a5e', 'request_id': 'req-4d70f08a-c1d0-4887-90db-965db8587345'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:12.590173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc079d24d7b454abbaeb374a9413a5e', 'request_id': 'req-4d70f08a-c1d0-4887-90db-965db8587345'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:12.608281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] The token cache is being invalidate because project 1bc079d24d7b454abbaeb374a9413a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:12.608573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:12.610951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:12.612487 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2652/5282] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:12 2022] DELETE /identity/v3/projects/1bc079d24d7b454abbaeb374a9413a5e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:12.618501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:12.620117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:12.636212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:12.639357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:12.657027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4067f2a-8e92-476a-8971-bfbb3667baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:12.657816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4067f2a-8e92-476a-8971-bfbb3667baa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:12.658612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4067f2a-8e92-476a-8971-bfbb3667baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:12.659102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4067f2a-8e92-476a-8971-bfbb3667baa5 admin admin] PATH_INFO: `/v3/projects/649e051cb3a94531aef5cc4867fe1cfe` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:12.660622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4067f2a-8e92-476a-8971-bfbb3667baa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=649e051cb3a94531aef5cc4867fe1cfe)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:12.663072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4067f2a-8e92-476a-8971-bfbb3667baa5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:12.745687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4067f2a-8e92-476a-8971-bfbb3667baa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649e051cb3a94531aef5cc4867fe1cfe', 'request_id': 'req-d4067f2a-8e92-476a-8971-bfbb3667baa5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:12.766495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4067f2a-8e92-476a-8971-bfbb3667baa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649e051cb3a94531aef5cc4867fe1cfe', 'request_id': 'req-d4067f2a-8e92-476a-8971-bfbb3667baa5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:12.771168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70f08a-c1d0-4887-90db-965db8587345 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:12.787966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4067f2a-8e92-476a-8971-bfbb3667baa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649e051cb3a94531aef5cc4867fe1cfe', 'request_id': 'req-d4067f2a-8e92-476a-8971-bfbb3667baa5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:12.821583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4067f2a-8e92-476a-8971-bfbb3667baa5 admin admin] The token cache is being invalidate because project 649e051cb3a94531aef5cc4867fe1cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:12.821901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4067f2a-8e92-476a-8971-bfbb3667baa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:12.826710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4067f2a-8e92-476a-8971-bfbb3667baa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:12.829525 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2631/5283] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:12 2022] DELETE /identity/v3/projects/649e051cb3a94531aef5cc4867fe1cfe => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:12:12.836199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee334e7-18a2-4f3b-8172-4af0df0b55f9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:12.836544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee334e7-18a2-4f3b-8172-4af0df0b55f9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:12.836831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee334e7-18a2-4f3b-8172-4af0df0b55f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:12.878636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9ee334e7-18a2-4f3b-8172-4af0df0b55f9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:12.881669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9ee334e7-18a2-4f3b-8172-4af0df0b55f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:12.918287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113c4d2-a386-4e3a-92d3-d5ba9258eb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:12.919395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c4d2-a386-4e3a-92d3-d5ba9258eb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:12.920025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c4d2-a386-4e3a-92d3-d5ba9258eb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:12.920451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c4d2-a386-4e3a-92d3-d5ba9258eb80 admin admin] PATH_INFO: `/v3/users/137302d4c39d4b5b906ed61b22aab298` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:12.921889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113c4d2-a386-4e3a-92d3-d5ba9258eb80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=137302d4c39d4b5b906ed61b22aab298)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:12.924126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113c4d2-a386-4e3a-92d3-d5ba9258eb80 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:13.049259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7113c4d2-a386-4e3a-92d3-d5ba9258eb80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '137302d4c39d4b5b906ed61b22aab298'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:13.068195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7113c4d2-a386-4e3a-92d3-d5ba9258eb80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '137302d4c39d4b5b906ed61b22aab298'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:13.073331 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2632/5284] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:13.079044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7113c4d2-a386-4e3a-92d3-d5ba9258eb80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '137302d4c39d4b5b906ed61b22aab298'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:13.081066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7113c4d2-a386-4e3a-92d3-d5ba9258eb80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '137302d4c39d4b5b906ed61b22aab298'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:13.083153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342140e-16ab-43d5-b2e8-1db55eeb9258 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:13.083446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342140e-16ab-43d5-b2e8-1db55eeb9258 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:13.083989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342140e-16ab-43d5-b2e8-1db55eeb9258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:13.120910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b342140e-16ab-43d5-b2e8-1db55eeb9258 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:13.122665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b342140e-16ab-43d5-b2e8-1db55eeb9258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:13.135599 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2633/5285] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:12:13.140005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342140e-16ab-43d5-b2e8-1db55eeb9258 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:13.140231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7113c4d2-a386-4e3a-92d3-d5ba9258eb80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '137302d4c39d4b5b906ed61b22aab298'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:13.158249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342140e-16ab-43d5-b2e8-1db55eeb9258 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:13.164878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db5028-cd90-4801-8739-06e981fa2c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:13.165825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db5028-cd90-4801-8739-06e981fa2c11 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:13.166363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db5028-cd90-4801-8739-06e981fa2c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:13.166707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db5028-cd90-4801-8739-06e981fa2c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:13.167696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db5028-cd90-4801-8739-06e981fa2c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:13.168104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db5028-cd90-4801-8739-06e981fa2c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:13.169891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db5028-cd90-4801-8739-06e981fa2c11 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:13.177536 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2653/5286] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:12 2022] DELETE /identity/v3/users/137302d4c39d4b5b906ed61b22aab298 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:13.225027 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2634/5287] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:12:13.225206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113c4d2-a386-4e3a-92d3-d5ba9258eb80 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:13.271667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:13.325738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113c4d2-a386-4e3a-92d3-d5ba9258eb80 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:13.337199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7b867-fc15-4a5b-ac8f-d94ccc798785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:13.338419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7b867-fc15-4a5b-ac8f-d94ccc798785 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:13.339870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7b867-fc15-4a5b-ac8f-d94ccc798785 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:13.339870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7b867-fc15-4a5b-ac8f-d94ccc798785 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:13.339870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7b867-fc15-4a5b-ac8f-d94ccc798785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:13.341678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7b867-fc15-4a5b-ac8f-d94ccc798785 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:13.417757 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2654/5288] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:13 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:13.419340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db5028-cd90-4801-8739-06e981fa2c11 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:13.440360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db5028-cd90-4801-8739-06e981fa2c11 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:13.565054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc85147-4049-4fc8-89ad-684ab1f6b0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:13.565713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc85147-4049-4fc8-89ad-684ab1f6b0ad admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:13.566215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc85147-4049-4fc8-89ad-684ab1f6b0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:13.566642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc85147-4049-4fc8-89ad-684ab1f6b0ad admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:13.568320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc85147-4049-4fc8-89ad-684ab1f6b0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:13.570853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc85147-4049-4fc8-89ad-684ab1f6b0ad admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:13.581584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:13.617046 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2635/5289] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:13 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:13.621710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7b867-fc15-4a5b-ac8f-d94ccc798785 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:13.641504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7b867-fc15-4a5b-ac8f-d94ccc798785 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:13.648550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53684c1-af51-4481-b091-a28ad9c8dfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:13.649425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53684c1-af51-4481-b091-a28ad9c8dfbd admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:13.649893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53684c1-af51-4481-b091-a28ad9c8dfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:13.650961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53684c1-af51-4481-b091-a28ad9c8dfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:13.652184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53684c1-af51-4481-b091-a28ad9c8dfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:13.654863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53684c1-af51-4481-b091-a28ad9c8dfbd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:13.671739 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2655/5290] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:13.676084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc85147-4049-4fc8-89ad-684ab1f6b0ad admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:13.692991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc85147-4049-4fc8-89ad-684ab1f6b0ad admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:13.704253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b9039-64b3-4f31-a158-619782c711f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:13.705325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b9039-64b3-4f31-a158-619782c711f3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:13.705827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b9039-64b3-4f31-a158-619782c711f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:13.706323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b9039-64b3-4f31-a158-619782c711f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:13.707879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b9039-64b3-4f31-a158-619782c711f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:13.709993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b9039-64b3-4f31-a158-619782c711f3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:13.727419 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2636/5291] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:13.731495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53684c1-af51-4481-b091-a28ad9c8dfbd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:13.745664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53684c1-af51-4481-b091-a28ad9c8dfbd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:13.754376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b8e8c-19e0-4625-a631-d62a64a7d6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:13.755246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b8e8c-19e0-4625-a631-d62a64a7d6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:13.755606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b8e8c-19e0-4625-a631-d62a64a7d6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:13.755971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b8e8c-19e0-4625-a631-d62a64a7d6ab admin admin] PATH_INFO: `/v3/projects/11985c01eb784910a1179336cbf3c522/users/0ea944b257df4235b27cd61a3e8c22d4/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:13.775782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b8e8c-19e0-4625-a631-d62a64a7d6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=11985c01eb784910a1179336cbf3c522, user_id=0ea944b257df4235b27cd61a3e8c22d4, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:13.778679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b8e8c-19e0-4625-a631-d62a64a7d6ab admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:13.813160 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2656/5292] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:13 2022] PUT /identity/v3/projects/11985c01eb784910a1179336cbf3c522/users/0ea944b257df4235b27cd61a3e8c22d4/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:13.814895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b3614-f427-427c-997c-187f70422e2b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:13.815185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b3614-f427-427c-997c-187f70422e2b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:13.815592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b3614-f427-427c-997c-187f70422e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:13.859692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c81b3614-f427-427c-997c-187f70422e2b None None] MFA Rules not processed for user `0ea944b257df4235b27cd61a3e8c22d4`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:13.861898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c81b3614-f427-427c-997c-187f70422e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:13.999874 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2637/5293] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:14.013806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b8e8c-19e0-4625-a631-d62a64a7d6ab admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:14.015758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4b4b8e8c-19e0-4625-a631-d62a64a7d6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:14.127610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b8e8c-19e0-4625-a631-d62a64a7d6ab admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:14.134515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21868b1e-e222-4854-92ca-b4303aa844f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:14.135243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21868b1e-e222-4854-92ca-b4303aa844f7 service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:14.135662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21868b1e-e222-4854-92ca-b4303aa844f7 service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:14.136029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21868b1e-e222-4854-92ca-b4303aa844f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:14.159575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21868b1e-e222-4854-92ca-b4303aa844f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:14.162917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21868b1e-e222-4854-92ca-b4303aa844f7 service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:14.191137 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2657/5294] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:14.326080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b3614-f427-427c-997c-187f70422e2b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:14.425889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b3614-f427-427c-997c-187f70422e2b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:14.434302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cf43c-d522-40c0-bb11-00ab9c34a9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:14.434967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cf43c-d522-40c0-bb11-00ab9c34a9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:14.435320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cf43c-d522-40c0-bb11-00ab9c34a9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:14.435620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cf43c-d522-40c0-bb11-00ab9c34a9a0 admin admin] PATH_INFO: `/v3/users/0ea944b257df4235b27cd61a3e8c22d4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:14.437980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cf43c-d522-40c0-bb11-00ab9c34a9a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea944b257df4235b27cd61a3e8c22d4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:14.440422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cf43c-d522-40c0-bb11-00ab9c34a9a0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:14.568917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-148cf43c-d522-40c0-bb11-00ab9c34a9a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea944b257df4235b27cd61a3e8c22d4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:14.571529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21868b1e-e222-4854-92ca-b4303aa844f7 service glance] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:14.572933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-21868b1e-e222-4854-92ca-b4303aa844f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:14.630613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21868b1e-e222-4854-92ca-b4303aa844f7 service glance] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:14.632594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-148cf43c-d522-40c0-bb11-00ab9c34a9a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea944b257df4235b27cd61a3e8c22d4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:14.633369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-148cf43c-d522-40c0-bb11-00ab9c34a9a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea944b257df4235b27cd61a3e8c22d4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:14.633992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-148cf43c-d522-40c0-bb11-00ab9c34a9a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea944b257df4235b27cd61a3e8c22d4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:14.645045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc91a51-4333-4c55-97ef-c741e3cc4b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:14.646318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc91a51-4333-4c55-97ef-c741e3cc4b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:14.646606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc91a51-4333-4c55-97ef-c741e3cc4b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:14.646873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc91a51-4333-4c55-97ef-c741e3cc4b39 admin admin] PATH_INFO: `/v3/projects/628680071e374e29b05c92ac9dfe98f6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:14.648957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc91a51-4333-4c55-97ef-c741e3cc4b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=628680071e374e29b05c92ac9dfe98f6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:14.650919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc91a51-4333-4c55-97ef-c741e3cc4b39 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:14.659972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:14.667270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-148cf43c-d522-40c0-bb11-00ab9c34a9a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea944b257df4235b27cd61a3e8c22d4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:14.703856 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2638/5295] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:14 2022] DELETE /identity/v3/users/0ea944b257df4235b27cd61a3e8c22d4 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:14.705791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b3b89-6708-4937-8027-f1c0a58e0e17 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:14.705933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b3b89-6708-4937-8027-f1c0a58e0e17 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:14.706187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b3b89-6708-4937-8027-f1c0a58e0e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:14.732849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a59b3b89-6708-4937-8027-f1c0a58e0e17 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:14.734238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a59b3b89-6708-4937-8027-f1c0a58e0e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:14.776688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc91a51-4333-4c55-97ef-c741e3cc4b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '628680071e374e29b05c92ac9dfe98f6', 'request_id': 'req-bcc91a51-4333-4c55-97ef-c741e3cc4b39'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:14.799754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc91a51-4333-4c55-97ef-c741e3cc4b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '628680071e374e29b05c92ac9dfe98f6', 'request_id': 'req-bcc91a51-4333-4c55-97ef-c741e3cc4b39'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:14.810042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc91a51-4333-4c55-97ef-c741e3cc4b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '628680071e374e29b05c92ac9dfe98f6', 'request_id': 'req-bcc91a51-4333-4c55-97ef-c741e3cc4b39'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:14.827922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc91a51-4333-4c55-97ef-c741e3cc4b39 admin admin] The token cache is being invalidate because project 628680071e374e29b05c92ac9dfe98f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:14.828605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc91a51-4333-4c55-97ef-c741e3cc4b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:14.829682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc91a51-4333-4c55-97ef-c741e3cc4b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:14.831340 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2639/5296] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:14.831867 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2658/5297] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:14 2022] DELETE /identity/v3/projects/628680071e374e29b05c92ac9dfe98f6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:12:14.833866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b3b89-6708-4937-8027-f1c0a58e0e17 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:14.838355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a59b3b89-6708-4937-8027-f1c0a58e0e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:14.839011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b940eef-07e0-4a3d-8b59-91664d5fc7e0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:14.839517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b940eef-07e0-4a3d-8b59-91664d5fc7e0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:14.840203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b940eef-07e0-4a3d-8b59-91664d5fc7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:14.856804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b3b89-6708-4937-8027-f1c0a58e0e17 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:14.882560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6b940eef-07e0-4a3d-8b59-91664d5fc7e0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:14.884123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6b940eef-07e0-4a3d-8b59-91664d5fc7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:14.890689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:15.003609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33de6c-3e9a-4781-b1e8-2ed6e7da9079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:15.004265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33de6c-3e9a-4781-b1e8-2ed6e7da9079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:15.004554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33de6c-3e9a-4781-b1e8-2ed6e7da9079 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:15.004887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33de6c-3e9a-4781-b1e8-2ed6e7da9079 admin admin] PATH_INFO: `/v3/users/84860f5a6aa2438dade943bb1190c678` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:15.006077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33de6c-3e9a-4781-b1e8-2ed6e7da9079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84860f5a6aa2438dade943bb1190c678)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:15.008084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33de6c-3e9a-4781-b1e8-2ed6e7da9079 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:15.029237 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2659/5298] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:15.029237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b940eef-07e0-4a3d-8b59-91664d5fc7e0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:15.031849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6b940eef-07e0-4a3d-8b59-91664d5fc7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:15.085655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1e33de6c-3e9a-4781-b1e8-2ed6e7da9079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84860f5a6aa2438dade943bb1190c678'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:15.101099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1e33de6c-3e9a-4781-b1e8-2ed6e7da9079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84860f5a6aa2438dade943bb1190c678'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:15.103608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1e33de6c-3e9a-4781-b1e8-2ed6e7da9079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84860f5a6aa2438dade943bb1190c678'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:15.104709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1e33de6c-3e9a-4781-b1e8-2ed6e7da9079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84860f5a6aa2438dade943bb1190c678'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:15.131678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1e33de6c-3e9a-4781-b1e8-2ed6e7da9079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84860f5a6aa2438dade943bb1190c678'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:15.155952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b940eef-07e0-4a3d-8b59-91664d5fc7e0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:15.157152 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2640/5299] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:14 2022] DELETE /identity/v3/users/84860f5a6aa2438dade943bb1190c678 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:15.162867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9892e7-2129-4b28-a552-ba319bb257fd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:15.162867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9892e7-2129-4b28-a552-ba319bb257fd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:15.162867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9892e7-2129-4b28-a552-ba319bb257fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:15.194674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:15.203782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fd9892e7-2129-4b28-a552-ba319bb257fd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:15.205028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fd9892e7-2129-4b28-a552-ba319bb257fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:15.248422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3c96b-eb0d-4d9a-a492-b56d4d8daa0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:15.249955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3c96b-eb0d-4d9a-a492-b56d4d8daa0b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:15.250397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3c96b-eb0d-4d9a-a492-b56d4d8daa0b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:15.250833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3c96b-eb0d-4d9a-a492-b56d4d8daa0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:15.254125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-15a3c96b-eb0d-4d9a-a492-b56d4d8daa0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:15.314921 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2641/5300] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:15.316325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784172d-2346-4ab2-89b0-9c5338327f9f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:15.317968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784172d-2346-4ab2-89b0-9c5338327f9f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:15.318252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784172d-2346-4ab2-89b0-9c5338327f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:15.354208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2784172d-2346-4ab2-89b0-9c5338327f9f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:15.355563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2784172d-2346-4ab2-89b0-9c5338327f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:15.359296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3c96b-eb0d-4d9a-a492-b56d4d8daa0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:15.360742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3c96b-eb0d-4d9a-a492-b56d4d8daa0b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:15.373257 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2642/5301] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:15.373257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784172d-2346-4ab2-89b0-9c5338327f9f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:15.373514 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2660/5302] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:15.396153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3c96b-eb0d-4d9a-a492-b56d4d8daa0b service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:15.400806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-15a3c96b-eb0d-4d9a-a492-b56d4d8daa0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:15.411018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784172d-2346-4ab2-89b0-9c5338327f9f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:15.423691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a9890-92c6-4f8d-8a8b-ab692e53936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:15.423691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a9890-92c6-4f8d-8a8b-ab692e53936f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:15.424002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a9890-92c6-4f8d-8a8b-ab692e53936f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:15.424233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a9890-92c6-4f8d-8a8b-ab692e53936f admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:15.425009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a9890-92c6-4f8d-8a8b-ab692e53936f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:15.425349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a9890-92c6-4f8d-8a8b-ab692e53936f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:15.427396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a9890-92c6-4f8d-8a8b-ab692e53936f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:15.454072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3c96b-eb0d-4d9a-a492-b56d4d8daa0b service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:15.461130 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2643/5303] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:15.461130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a9890-92c6-4f8d-8a8b-ab692e53936f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:15.464415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140a3ad-54be-4c0b-bc7b-51fd8659e579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:15.464947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-359a9890-92c6-4f8d-8a8b-ab692e53936f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:15.465068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a3ad-54be-4c0b-bc7b-51fd8659e579 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:15.466457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a3ad-54be-4c0b-bc7b-51fd8659e579 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:15.466859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a3ad-54be-4c0b-bc7b-51fd8659e579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:15.489538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140a3ad-54be-4c0b-bc7b-51fd8659e579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:15.492438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140a3ad-54be-4c0b-bc7b-51fd8659e579 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:15.510628 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2661/5304] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:15.511743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140a3ad-54be-4c0b-bc7b-51fd8659e579 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:15.520221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:15.527758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140a3ad-54be-4c0b-bc7b-51fd8659e579 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:15.535433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a78b79-1e6f-45af-930d-565fd2c2fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:15.536083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a78b79-1e6f-45af-930d-565fd2c2fc1e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:15.536362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a78b79-1e6f-45af-930d-565fd2c2fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:15.536746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a78b79-1e6f-45af-930d-565fd2c2fc1e admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:15.537630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a78b79-1e6f-45af-930d-565fd2c2fc1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:15.541175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a78b79-1e6f-45af-930d-565fd2c2fc1e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:15.570059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a9890-92c6-4f8d-8a8b-ab692e53936f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:15.576955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e7ae3-2780-452e-a3d1-ae9a840b9b52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:15.577703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e7ae3-2780-452e-a3d1-ae9a840b9b52 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:15.578104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e7ae3-2780-452e-a3d1-ae9a840b9b52 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:15.578376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e7ae3-2780-452e-a3d1-ae9a840b9b52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:15.580444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-309e7ae3-2780-452e-a3d1-ae9a840b9b52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:15.587859 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2662/5305] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:15 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:15.595661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a78b79-1e6f-45af-930d-565fd2c2fc1e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:15.604414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e7ae3-2780-452e-a3d1-ae9a840b9b52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:15.607010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e7ae3-2780-452e-a3d1-ae9a840b9b52 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:15.624941 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2644/5306] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:15.758092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a78b79-1e6f-45af-930d-565fd2c2fc1e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:15.766398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6fa11-300d-4162-b8b4-cc3a511e6fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:15.767174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6fa11-300d-4162-b8b4-cc3a511e6fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:15.767549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6fa11-300d-4162-b8b4-cc3a511e6fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:15.767968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6fa11-300d-4162-b8b4-cc3a511e6fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:15.768694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6fa11-300d-4162-b8b4-cc3a511e6fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:15.771861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6fa11-300d-4162-b8b4-cc3a511e6fc1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:15.809221 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2663/5307] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:15 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:12:15.813248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e7ae3-2780-452e-a3d1-ae9a840b9b52 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:15.833625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e7ae3-2780-452e-a3d1-ae9a840b9b52 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:15.838703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5af6d7-782b-4583-9f32-7c2ca6a02d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:15.839318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af6d7-782b-4583-9f32-7c2ca6a02d78 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:15.839839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af6d7-782b-4583-9f32-7c2ca6a02d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:15.839982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af6d7-782b-4583-9f32-7c2ca6a02d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:15.840549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5af6d7-782b-4583-9f32-7c2ca6a02d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:15.842428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5af6d7-782b-4583-9f32-7c2ca6a02d78 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:15.856196 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2645/5308] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:15.860340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6fa11-300d-4162-b8b4-cc3a511e6fc1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:15.876159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6fa11-300d-4162-b8b4-cc3a511e6fc1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:15.884178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7c144-cf8a-4a07-b565-387956190987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:15.884872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7c144-cf8a-4a07-b565-387956190987 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:15.885320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7c144-cf8a-4a07-b565-387956190987 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:15.885603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7c144-cf8a-4a07-b565-387956190987 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:15.886547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7c144-cf8a-4a07-b565-387956190987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:15.888454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7c144-cf8a-4a07-b565-387956190987 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:15.901440 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2664/5309] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:15.906339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5af6d7-782b-4583-9f32-7c2ca6a02d78 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:15.920597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5af6d7-782b-4583-9f32-7c2ca6a02d78 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:15.927492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5aa1e-0aef-4439-b433-e3306b0fe6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:15.928162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5aa1e-0aef-4439-b433-e3306b0fe6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:15.928448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5aa1e-0aef-4439-b433-e3306b0fe6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:15.928727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5aa1e-0aef-4439-b433-e3306b0fe6f6 admin admin] PATH_INFO: `/v3/projects/bc753bdffa3e4df28e8d36234a4ae4c1/users/67ab7e80e3ea40d4813bea1dbfcb05cd/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:15.949699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5aa1e-0aef-4439-b433-e3306b0fe6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc753bdffa3e4df28e8d36234a4ae4c1, user_id=67ab7e80e3ea40d4813bea1dbfcb05cd, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:15.953219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5aa1e-0aef-4439-b433-e3306b0fe6f6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:15.991288 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2646/5310] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:15 2022] PUT /identity/v3/projects/bc753bdffa3e4df28e8d36234a4ae4c1/users/67ab7e80e3ea40d4813bea1dbfcb05cd/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:15.996712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768da1b-5b6b-436c-b550-c9a6ef00065d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:15.997017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768da1b-5b6b-436c-b550-c9a6ef00065d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:15.997364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768da1b-5b6b-436c-b550-c9a6ef00065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:16.039806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c768da1b-5b6b-436c-b550-c9a6ef00065d None None] MFA Rules not processed for user `67ab7e80e3ea40d4813bea1dbfcb05cd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:16.042320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c768da1b-5b6b-436c-b550-c9a6ef00065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:16.134686 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2665/5311] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:16.139577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5aa1e-0aef-4439-b433-e3306b0fe6f6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:16.189568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:16.216067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5aa1e-0aef-4439-b433-e3306b0fe6f6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:16.221280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e09b3-06af-4ef7-b059-d85f66b3ec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:16.222042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e09b3-06af-4ef7-b059-d85f66b3ec90 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:16.222544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e09b3-06af-4ef7-b059-d85f66b3ec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:16.222900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e09b3-06af-4ef7-b059-d85f66b3ec90 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:16.224151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e09b3-06af-4ef7-b059-d85f66b3ec90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:16.226569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e09b3-06af-4ef7-b059-d85f66b3ec90 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:16.274933 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2647/5312] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:16 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:16.276024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768da1b-5b6b-436c-b550-c9a6ef00065d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:16.288193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768da1b-5b6b-436c-b550-c9a6ef00065d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:16.357793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:16.375422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742732ca-680d-461d-844c-d14ccbae7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:16.376060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742732ca-680d-461d-844c-d14ccbae7403 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:16.376344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742732ca-680d-461d-844c-d14ccbae7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:16.376696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742732ca-680d-461d-844c-d14ccbae7403 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:16.377387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742732ca-680d-461d-844c-d14ccbae7403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:16.379399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742732ca-680d-461d-844c-d14ccbae7403 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:16.410231 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2666/5313] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:16 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:12:16.419932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e09b3-06af-4ef7-b059-d85f66b3ec90 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:16.443344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e09b3-06af-4ef7-b059-d85f66b3ec90 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:16.452781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9fb5b-02ed-4bc3-b2e9-7a824e34a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:16.453746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9fb5b-02ed-4bc3-b2e9-7a824e34a639 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:16.453746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9fb5b-02ed-4bc3-b2e9-7a824e34a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:16.459650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9fb5b-02ed-4bc3-b2e9-7a824e34a639 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:16.461170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9fb5b-02ed-4bc3-b2e9-7a824e34a639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:16.462808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9fb5b-02ed-4bc3-b2e9-7a824e34a639 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:16.491430 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2648/5314] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:16.496154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742732ca-680d-461d-844c-d14ccbae7403 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:16.523351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742732ca-680d-461d-844c-d14ccbae7403 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:16.528694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9fb5b-02ed-4bc3-b2e9-7a824e34a639 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:16.530553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2af9fb5b-02ed-4bc3-b2e9-7a824e34a639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:16.538429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66413db-19cf-49c3-b32a-1481c964cdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:16.539131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66413db-19cf-49c3-b32a-1481c964cdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:16.539420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66413db-19cf-49c3-b32a-1481c964cdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:16.539699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66413db-19cf-49c3-b32a-1481c964cdb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:16.543279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66413db-19cf-49c3-b32a-1481c964cdb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:16.544902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66413db-19cf-49c3-b32a-1481c964cdb4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:16.553966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9fb5b-02ed-4bc3-b2e9-7a824e34a639 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:16.568746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:16.569434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:16.569711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:16.573548 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2667/5315] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:16.576977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] PATH_INFO: `/v3/projects/11985c01eb784910a1179336cbf3c522` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:16.578351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11985c01eb784910a1179336cbf3c522)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:16.580295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:16.580985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66413db-19cf-49c3-b32a-1481c964cdb4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:16.593808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66413db-19cf-49c3-b32a-1481c964cdb4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:16.600422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a8b4a-916d-4e81-850e-f0fa92ec2fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:16.601252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a8b4a-916d-4e81-850e-f0fa92ec2fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:16.601709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a8b4a-916d-4e81-850e-f0fa92ec2fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:16.601997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a8b4a-916d-4e81-850e-f0fa92ec2fe5 admin admin] PATH_INFO: `/v3/projects/2cadc09cfa4e42bba721c7c9a9949ad5/users/27a07a608aee4fc2b084ee8f96c67b32/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:16.637828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a8b4a-916d-4e81-850e-f0fa92ec2fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cadc09cfa4e42bba721c7c9a9949ad5, user_id=27a07a608aee4fc2b084ee8f96c67b32, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:16.645839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a8b4a-916d-4e81-850e-f0fa92ec2fe5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:16.675778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11985c01eb784910a1179336cbf3c522', 'request_id': 'req-4d91f50d-ebe0-42aa-811c-535d572cf255'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:16.691573 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2668/5316] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:16 2022] PUT /identity/v3/projects/2cadc09cfa4e42bba721c7c9a9949ad5/users/27a07a608aee4fc2b084ee8f96c67b32/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:16.694227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94322473-1f8a-4187-afdc-4460ed77d99e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:16.694636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94322473-1f8a-4187-afdc-4460ed77d99e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:16.694913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94322473-1f8a-4187-afdc-4460ed77d99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:16.700425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11985c01eb784910a1179336cbf3c522', 'request_id': 'req-4d91f50d-ebe0-42aa-811c-535d572cf255'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:16.711589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11985c01eb784910a1179336cbf3c522', 'request_id': 'req-4d91f50d-ebe0-42aa-811c-535d572cf255'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:16.727009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] The token cache is being invalidate because project 11985c01eb784910a1179336cbf3c522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:16.727456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:16.728236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:16.730354 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2649/5317] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:16 2022] DELETE /identity/v3/projects/11985c01eb784910a1179336cbf3c522 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:16.731018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:16.732547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:16.796141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-94322473-1f8a-4187-afdc-4460ed77d99e None None] MFA Rules not processed for user `27a07a608aee4fc2b084ee8f96c67b32`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:16.801739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-94322473-1f8a-4187-afdc-4460ed77d99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:16.832470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91f50d-ebe0-42aa-811c-535d572cf255 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:16.888287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:16.915597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:16.916416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:16.917016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:16.917671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] PATH_INFO: `/v3/projects/f7e7663e704b4ca4b7a47b6f9b3113e3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:16.918992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e7663e704b4ca4b7a47b6f9b3113e3)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:16.921606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:16.971375 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2669/5318] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:16.972762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b58699-06fd-4201-b866-7c666ca9cb42 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:16.973052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b58699-06fd-4201-b866-7c666ca9cb42 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:16.974223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b58699-06fd-4201-b866-7c666ca9cb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:17.000110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e7663e704b4ca4b7a47b6f9b3113e3', 'request_id': 'req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:17.008613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a5b58699-06fd-4201-b866-7c666ca9cb42 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:17.010031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a5b58699-06fd-4201-b866-7c666ca9cb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:17.011680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e7663e704b4ca4b7a47b6f9b3113e3', 'request_id': 'req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:17.022051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e7663e704b4ca4b7a47b6f9b3113e3', 'request_id': 'req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:17.040969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] The token cache is being invalidate because project f7e7663e704b4ca4b7a47b6f9b3113e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:17.041272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:17.041953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:17.044890 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2650/5319] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:16 2022] DELETE /identity/v3/projects/f7e7663e704b4ca4b7a47b6f9b3113e3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:17.045733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:17.047281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:17.132044 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2670/5320] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:17.134383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b58699-06fd-4201-b866-7c666ca9cb42 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:17.147236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a5b58699-06fd-4201-b866-7c666ca9cb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:17.171198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b58699-06fd-4201-b866-7c666ca9cb42 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:17.176968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d33a0-b176-4b10-83dd-377aeda8b73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:17.178314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d33a0-b176-4b10-83dd-377aeda8b73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:17.178960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d33a0-b176-4b10-83dd-377aeda8b73e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:17.179505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d33a0-b176-4b10-83dd-377aeda8b73e admin admin] PATH_INFO: `/v3/users/e8981e478a2f44f3abad9bf6f005bd7a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:17.181323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d33a0-b176-4b10-83dd-377aeda8b73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8981e478a2f44f3abad9bf6f005bd7a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:17.183384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d33a0-b176-4b10-83dd-377aeda8b73e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:17.195934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a26b6-bac9-48be-bcd9-54dd33b31a7e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:17.210683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b3830-4f67-4edc-a512-4fb5d9a3fee4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:17.212558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b3830-4f67-4edc-a512-4fb5d9a3fee4 service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:17.213033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b3830-4f67-4edc-a512-4fb5d9a3fee4 service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:17.213442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b3830-4f67-4edc-a512-4fb5d9a3fee4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:17.223063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-763b3830-4f67-4edc-a512-4fb5d9a3fee4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:17.287843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:17.328076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac9d33a0-b176-4b10-83dd-377aeda8b73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8981e478a2f44f3abad9bf6f005bd7a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:17.348102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac9d33a0-b176-4b10-83dd-377aeda8b73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8981e478a2f44f3abad9bf6f005bd7a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:17.349570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac9d33a0-b176-4b10-83dd-377aeda8b73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8981e478a2f44f3abad9bf6f005bd7a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:17.350474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac9d33a0-b176-4b10-83dd-377aeda8b73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8981e478a2f44f3abad9bf6f005bd7a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:17.393109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b3830-4f67-4edc-a512-4fb5d9a3fee4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:17.394729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b3830-4f67-4edc-a512-4fb5d9a3fee4 service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:17.404337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac9d33a0-b176-4b10-83dd-377aeda8b73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8981e478a2f44f3abad9bf6f005bd7a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:17.423865 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2651/5321] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:17.425724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de60efd-c160-4ae5-aa4d-5a29b7c6cd61 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:17.426102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de60efd-c160-4ae5-aa4d-5a29b7c6cd61 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:17.426385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de60efd-c160-4ae5-aa4d-5a29b7c6cd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:17.430634 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2671/5322] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:17 2022] DELETE /identity/v3/users/e8981e478a2f44f3abad9bf6f005bd7a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:17.511290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5de60efd-c160-4ae5-aa4d-5a29b7c6cd61 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:17.513816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5de60efd-c160-4ae5-aa4d-5a29b7c6cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:17.570020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:17.636230 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2652/5323] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:17.640620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d33a0-b176-4b10-83dd-377aeda8b73e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:17.654564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d33a0-b176-4b10-83dd-377aeda8b73e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:17.664694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d766f-0567-4ac9-b536-34019d92787c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:17.665717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d766f-0567-4ac9-b536-34019d92787c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:17.666427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d766f-0567-4ac9-b536-34019d92787c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:17.667450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d766f-0567-4ac9-b536-34019d92787c admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:17.669741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d766f-0567-4ac9-b536-34019d92787c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:17.670305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d766f-0567-4ac9-b536-34019d92787c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:17.673528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d766f-0567-4ac9-b536-34019d92787c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:17.700754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de60efd-c160-4ae5-aa4d-5a29b7c6cd61 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:17.717049 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2672/5324] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:17.718990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d766f-0567-4ac9-b536-34019d92787c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:17.720028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de60efd-c160-4ae5-aa4d-5a29b7c6cd61 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:17.723117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ec3d766f-0567-4ac9-b536-34019d92787c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:17.737124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fef8d-163d-4fb9-aacf-57e0cb516ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:17.739746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fef8d-163d-4fb9-aacf-57e0cb516ffa admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:17.741863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fef8d-163d-4fb9-aacf-57e0cb516ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:17.743050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fef8d-163d-4fb9-aacf-57e0cb516ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:17.744858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fef8d-163d-4fb9-aacf-57e0cb516ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:17.749296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fef8d-163d-4fb9-aacf-57e0cb516ffa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:17.844252 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2653/5325] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:17 2022] POST /identity/v3/projects => generated 405 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:17.851256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fef8d-163d-4fb9-aacf-57e0cb516ffa admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:17.887040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d766f-0567-4ac9-b536-34019d92787c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:18.022268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38219441-e57b-4751-b584-c486f42276ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:18.024283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38219441-e57b-4751-b584-c486f42276ed service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:18.024580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38219441-e57b-4751-b584-c486f42276ed service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:18.024853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38219441-e57b-4751-b584-c486f42276ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:18.030860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-38219441-e57b-4751-b584-c486f42276ed service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:18.039627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fef8d-163d-4fb9-aacf-57e0cb516ffa admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:18.048848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e6512-d1a7-41bc-a694-b2593d2ed79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:18.049725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e6512-d1a7-41bc-a694-b2593d2ed79f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:18.050010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e6512-d1a7-41bc-a694-b2593d2ed79f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:18.050281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e6512-d1a7-41bc-a694-b2593d2ed79f admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:18.050913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e6512-d1a7-41bc-a694-b2593d2ed79f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:18.053037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e6512-d1a7-41bc-a694-b2593d2ed79f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:18.113393 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2654/5326] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:17 2022] POST /identity/v3/users => generated 303 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:18.115254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e6512-d1a7-41bc-a694-b2593d2ed79f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:18.118873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d27e6512-d1a7-41bc-a694-b2593d2ed79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:18.135668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e6512-d1a7-41bc-a694-b2593d2ed79f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:18.142584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:18.143634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:18.143981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:18.144220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] PATH_INFO: `/v3/projects/15460c4dec1441648845f3b0496ee430` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:18.148893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15460c4dec1441648845f3b0496ee430)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:18.154486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:18.193095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38219441-e57b-4751-b584-c486f42276ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:18.194758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38219441-e57b-4751-b584-c486f42276ed service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:18.214612 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2673/5327] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:18.215538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38219441-e57b-4751-b584-c486f42276ed service glance] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:18.226230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15460c4dec1441648845f3b0496ee430', 'request_id': 'req-287f1bfc-d334-40af-b328-5fe392503e67'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:18.227375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:18.238069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15460c4dec1441648845f3b0496ee430', 'request_id': 'req-287f1bfc-d334-40af-b328-5fe392503e67'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:18.238884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38219441-e57b-4751-b584-c486f42276ed service glance] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:18.248695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15460c4dec1441648845f3b0496ee430', 'request_id': 'req-287f1bfc-d334-40af-b328-5fe392503e67'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:18.266347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] The token cache is being invalidate because project 15460c4dec1441648845f3b0496ee430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:18.266794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:18.267725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:18.269447 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2655/5328] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:18 2022] DELETE /identity/v3/projects/15460c4dec1441648845f3b0496ee430 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:18.274165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:18.278603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:18.348510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:18.371330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f032a84-f4ac-4354-98ff-fd7329e0d13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:18.371983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f032a84-f4ac-4354-98ff-fd7329e0d13b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:18.372264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f032a84-f4ac-4354-98ff-fd7329e0d13b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:18.372535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f032a84-f4ac-4354-98ff-fd7329e0d13b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:18.373178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f032a84-f4ac-4354-98ff-fd7329e0d13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:18.374807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f032a84-f4ac-4354-98ff-fd7329e0d13b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:18.404208 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2674/5329] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:18.407530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f032a84-f4ac-4354-98ff-fd7329e0d13b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:18.412066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2f032a84-f4ac-4354-98ff-fd7329e0d13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:18.440059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f032a84-f4ac-4354-98ff-fd7329e0d13b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:18.461383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea722a3b-c220-4faa-b68d-2a82689fda03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:18.462130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea722a3b-c220-4faa-b68d-2a82689fda03 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:18.463075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea722a3b-c220-4faa-b68d-2a82689fda03 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:18.463075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea722a3b-c220-4faa-b68d-2a82689fda03 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:18.463368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea722a3b-c220-4faa-b68d-2a82689fda03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:18.469943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea722a3b-c220-4faa-b68d-2a82689fda03 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:18.507817 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2675/5330] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:18.508776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea722a3b-c220-4faa-b68d-2a82689fda03 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:18.550722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea722a3b-c220-4faa-b68d-2a82689fda03 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:18.553205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f1bfc-d334-40af-b328-5fe392503e67 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:18.564250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:18.564917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:18.565213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:18.565506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] PATH_INFO: `/v3/users/2a2cbb81401a41b9963c999f3b0417f9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:18.568049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b925a3f-e919-4d90-a28d-acd5fc103f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:18.568580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b925a3f-e919-4d90-a28d-acd5fc103f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:18.568867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b925a3f-e919-4d90-a28d-acd5fc103f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:18.569015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2cbb81401a41b9963c999f3b0417f9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:18.569213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b925a3f-e919-4d90-a28d-acd5fc103f3b admin admin] PATH_INFO: `/v3/projects/d09dfabc853d4e338285012361ff69c7/users/46ff7768e6c6482ea9f5c893efcd9676/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:18.570991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:18.605393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b925a3f-e919-4d90-a28d-acd5fc103f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09dfabc853d4e338285012361ff69c7, user_id=46ff7768e6c6482ea9f5c893efcd9676, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:18.609051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b925a3f-e919-4d90-a28d-acd5fc103f3b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:18.638694 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2676/5331] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:18 2022] PUT /identity/v3/projects/d09dfabc853d4e338285012361ff69c7/users/46ff7768e6c6482ea9f5c893efcd9676/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:18.650125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c63a-0f5d-4c12-ba5e-e8d677d4960d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:18.650445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c63a-0f5d-4c12-ba5e-e8d677d4960d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:18.650685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c63a-0f5d-4c12-ba5e-e8d677d4960d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:18.661330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2cbb81401a41b9963c999f3b0417f9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:18.688751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2cbb81401a41b9963c999f3b0417f9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:18.690503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2cbb81401a41b9963c999f3b0417f9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:18.691917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2cbb81401a41b9963c999f3b0417f9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:18.710370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a2c7c63a-0f5d-4c12-ba5e-e8d677d4960d None None] MFA Rules not processed for user `46ff7768e6c6482ea9f5c893efcd9676`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:18.712025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2cbb81401a41b9963c999f3b0417f9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:18.712348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a2c7c63a-0f5d-4c12-ba5e-e8d677d4960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:18.776254 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2656/5332] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:18 2022] DELETE /identity/v3/users/2a2cbb81401a41b9963c999f3b0417f9 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:18.890341 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2677/5333] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:18 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:18.891516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:18.893437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:19.102928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f63f7-1c2d-4a8b-81f9-e32963a61a30 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:19.135153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a6650-3423-4bef-afb7-998442a94009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:19.135795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6650-3423-4bef-afb7-998442a94009 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:19.136075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6650-3423-4bef-afb7-998442a94009 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:19.136349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6650-3423-4bef-afb7-998442a94009 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:19.136988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a6650-3423-4bef-afb7-998442a94009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:19.154178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a6650-3423-4bef-afb7-998442a94009 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:19.237610 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2657/5334] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:18 2022] POST /identity/v3/projects => generated 407 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:19.242120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c63a-0f5d-4c12-ba5e-e8d677d4960d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:19.412762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:19.453632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c63a-0f5d-4c12-ba5e-e8d677d4960d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:19.659252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be1841-6aed-40b8-9418-ca0d89480f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:19.660187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be1841-6aed-40b8-9418-ca0d89480f7b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:19.661398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be1841-6aed-40b8-9418-ca0d89480f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:19.661704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be1841-6aed-40b8-9418-ca0d89480f7b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:19.662422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be1841-6aed-40b8-9418-ca0d89480f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:19.664351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be1841-6aed-40b8-9418-ca0d89480f7b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:19.720531 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2678/5335] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:19 2022] POST /identity/v3/users => generated 310 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:19.722009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a6650-3423-4bef-afb7-998442a94009 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:19.740347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a6650-3423-4bef-afb7-998442a94009 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:19.780293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cb222-7b4a-4a3a-b5e1-aabbd016aba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:19.781880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cb222-7b4a-4a3a-b5e1-aabbd016aba4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:19.786803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cb222-7b4a-4a3a-b5e1-aabbd016aba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:19.787699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cb222-7b4a-4a3a-b5e1-aabbd016aba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:19.787699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cb222-7b4a-4a3a-b5e1-aabbd016aba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:19.789382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cb222-7b4a-4a3a-b5e1-aabbd016aba4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:19.862279 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2658/5336] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:19.866644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be1841-6aed-40b8-9418-ca0d89480f7b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:19.875439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cb222-7b4a-4a3a-b5e1-aabbd016aba4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:19.880843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d56cb222-7b4a-4a3a-b5e1-aabbd016aba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:19.887054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be1841-6aed-40b8-9418-ca0d89480f7b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:19.913697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e934b3-c28e-480d-92a6-447b99bd2a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:19.914396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e934b3-c28e-480d-92a6-447b99bd2a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:19.914666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e934b3-c28e-480d-92a6-447b99bd2a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:19.915104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e934b3-c28e-480d-92a6-447b99bd2a72 admin admin] PATH_INFO: `/v3/projects/323a2d09e70946dfb93b1701bbbe2a08/users/9196ff89092a4154950657497d057e15/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:19.919780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cb222-7b4a-4a3a-b5e1-aabbd016aba4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:19.931075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:19.932342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:19.932730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:19.933073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7 admin admin] PATH_INFO: `/v3/projects/661a9f4c42764204be9cd5a7fb10092b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:19.936445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=661a9f4c42764204be9cd5a7fb10092b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:19.939025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:19.950170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:19.978113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e934b3-c28e-480d-92a6-447b99bd2a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=323a2d09e70946dfb93b1701bbbe2a08, user_id=9196ff89092a4154950657497d057e15, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:19.980809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e934b3-c28e-480d-92a6-447b99bd2a72 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:20.039985 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2679/5337] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:19 2022] PUT /identity/v3/projects/323a2d09e70946dfb93b1701bbbe2a08/users/9196ff89092a4154950657497d057e15/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:20.045254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e934b3-c28e-480d-92a6-447b99bd2a72 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:20.076782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661a9f4c42764204be9cd5a7fb10092b', 'request_id': 'req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:20.101035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661a9f4c42764204be9cd5a7fb10092b', 'request_id': 'req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:20.139817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661a9f4c42764204be9cd5a7fb10092b', 'request_id': 'req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:20.157228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7 admin admin] The token cache is being invalidate because project 661a9f4c42764204be9cd5a7fb10092b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:20.157605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:20.158469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-35fbb8e2-6bc4-4d82-a1ed-b5e29d49edc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:20.167151 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2659/5338] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:19 2022] DELETE /identity/v3/projects/661a9f4c42764204be9cd5a7fb10092b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:20.168964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2113-4dcb-4037-97b3-75aab8c6a3f0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:20.169287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2113-4dcb-4037-97b3-75aab8c6a3f0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:20.169563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2113-4dcb-4037-97b3-75aab8c6a3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:20.207196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d7df2113-4dcb-4037-97b3-75aab8c6a3f0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:20.212808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d7df2113-4dcb-4037-97b3-75aab8c6a3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:20.213907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e934b3-c28e-480d-92a6-447b99bd2a72 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:20.404093 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2660/5339] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:20.406077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d335d-81a3-45ff-a187-c422021d8938 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:20.406469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d335d-81a3-45ff-a187-c422021d8938 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:20.407273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d335d-81a3-45ff-a187-c422021d8938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:20.439104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3048f-2193-4a68-b2f9-121a5004ca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:20.439948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3048f-2193-4a68-b2f9-121a5004ca59 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:20.440465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3048f-2193-4a68-b2f9-121a5004ca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:20.440907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3048f-2193-4a68-b2f9-121a5004ca59 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:20.441691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3048f-2193-4a68-b2f9-121a5004ca59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:20.444273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3048f-2193-4a68-b2f9-121a5004ca59 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:20.462070 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2680/5340] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:20.466833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3048f-2193-4a68-b2f9-121a5004ca59 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:20.485675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-abc3048f-2193-4a68-b2f9-121a5004ca59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:20.528837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3048f-2193-4a68-b2f9-121a5004ca59 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:20.528928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8a5d335d-81a3-45ff-a187-c422021d8938 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:20.535706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8a5d335d-81a3-45ff-a187-c422021d8938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:20.555105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3aaef-41ae-4a94-b9a5-698d2aadbafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:20.558617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3aaef-41ae-4a94-b9a5-698d2aadbafb admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:20.560218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3aaef-41ae-4a94-b9a5-698d2aadbafb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:20.561127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3aaef-41ae-4a94-b9a5-698d2aadbafb admin admin] PATH_INFO: `/v3/projects/323a2d09e70946dfb93b1701bbbe2a08/users/9196ff89092a4154950657497d057e15/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:20.567897 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2661/5341] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:20.570103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3aaef-41ae-4a94-b9a5-698d2aadbafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=323a2d09e70946dfb93b1701bbbe2a08, user_id=9196ff89092a4154950657497d057e15, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:20.574949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d335d-81a3-45ff-a187-c422021d8938 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:20.588953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3aaef-41ae-4a94-b9a5-698d2aadbafb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:20.600696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:20.609495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d335d-81a3-45ff-a187-c422021d8938 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:20.639192 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2681/5342] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:20 2022] PUT /identity/v3/projects/323a2d09e70946dfb93b1701bbbe2a08/users/9196ff89092a4154950657497d057e15/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:20.651636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529d494-1012-458e-8af4-3be034051be0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:20.652132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529d494-1012-458e-8af4-3be034051be0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:20.652571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529d494-1012-458e-8af4-3be034051be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:20.711394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b406d45-6f21-4d6f-b4b3-0c7185d2b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:20.712445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b406d45-6f21-4d6f-b4b3-0c7185d2b316 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:20.713039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b406d45-6f21-4d6f-b4b3-0c7185d2b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:20.713447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b406d45-6f21-4d6f-b4b3-0c7185d2b316 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:20.714279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b406d45-6f21-4d6f-b4b3-0c7185d2b316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:20.714700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b406d45-6f21-4d6f-b4b3-0c7185d2b316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:20.720081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b406d45-6f21-4d6f-b4b3-0c7185d2b316 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:20.738664 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2662/5343] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:20.743893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b406d45-6f21-4d6f-b4b3-0c7185d2b316 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:20.773089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b406d45-6f21-4d6f-b4b3-0c7185d2b316 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:20.779406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702972b3-98d5-4994-9855-a9860b6e1d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:20.780582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702972b3-98d5-4994-9855-a9860b6e1d84 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:20.781063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702972b3-98d5-4994-9855-a9860b6e1d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:20.781596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702972b3-98d5-4994-9855-a9860b6e1d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:20.782486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702972b3-98d5-4994-9855-a9860b6e1d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:20.784944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702972b3-98d5-4994-9855-a9860b6e1d84 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:20.789397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b529d494-1012-458e-8af4-3be034051be0 None None] MFA Rules not processed for user `9196ff89092a4154950657497d057e15`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:20.795704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b529d494-1012-458e-8af4-3be034051be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:20.821728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:20.834515 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2663/5344] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:20 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:20.839056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702972b3-98d5-4994-9855-a9860b6e1d84 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:20.950036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702972b3-98d5-4994-9855-a9860b6e1d84 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:20.958674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c07b45-7efe-48e8-b8cf-3182e4ae76ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:20.960455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c07b45-7efe-48e8-b8cf-3182e4ae76ae admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:20.964875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c07b45-7efe-48e8-b8cf-3182e4ae76ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:20.965604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c07b45-7efe-48e8-b8cf-3182e4ae76ae admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:20.966858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c07b45-7efe-48e8-b8cf-3182e4ae76ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:20.971029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c07b45-7efe-48e8-b8cf-3182e4ae76ae admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:21.029145 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2664/5345] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:20 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:21.034442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c07b45-7efe-48e8-b8cf-3182e4ae76ae admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:21.070663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c07b45-7efe-48e8-b8cf-3182e4ae76ae admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:21.089018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0b566-e9eb-4f15-83c4-d5da82fce64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:21.090070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0b566-e9eb-4f15-83c4-d5da82fce64f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:21.092563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0b566-e9eb-4f15-83c4-d5da82fce64f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:21.092873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0b566-e9eb-4f15-83c4-d5da82fce64f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:21.093468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0b566-e9eb-4f15-83c4-d5da82fce64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:21.100376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0b566-e9eb-4f15-83c4-d5da82fce64f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:21.105026 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2682/5346] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:21.138549 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2665/5347] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:21.142718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529d494-1012-458e-8af4-3be034051be0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:21.148371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0b566-e9eb-4f15-83c4-d5da82fce64f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:21.151691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bae0b566-e9eb-4f15-83c4-d5da82fce64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:21.173904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529d494-1012-458e-8af4-3be034051be0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:21.198064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099101b-b65b-4e9a-96a3-e06f7d8214ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:21.198929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099101b-b65b-4e9a-96a3-e06f7d8214ee admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:21.201331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099101b-b65b-4e9a-96a3-e06f7d8214ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:21.202117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099101b-b65b-4e9a-96a3-e06f7d8214ee admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:21.203010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099101b-b65b-4e9a-96a3-e06f7d8214ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:21.204503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0b566-e9eb-4f15-83c4-d5da82fce64f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:21.206897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099101b-b65b-4e9a-96a3-e06f7d8214ee admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:21.218605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:21.220042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:21.221708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:21.222225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] PATH_INFO: `/v3/users/67ab7e80e3ea40d4813bea1dbfcb05cd` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:21.225918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ab7e80e3ea40d4813bea1dbfcb05cd)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:21.233554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:21.239716 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2683/5348] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:21.240895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099101b-b65b-4e9a-96a3-e06f7d8214ee admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:21.247067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7099101b-b65b-4e9a-96a3-e06f7d8214ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:21.358312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ab7e80e3ea40d4813bea1dbfcb05cd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:21.380139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ab7e80e3ea40d4813bea1dbfcb05cd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:21.382809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ab7e80e3ea40d4813bea1dbfcb05cd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:21.383802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ab7e80e3ea40d4813bea1dbfcb05cd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:21.402708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099101b-b65b-4e9a-96a3-e06f7d8214ee admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:21.414000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb157c-44ce-4669-8dc9-2ed79a44a1d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:21.414539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb157c-44ce-4669-8dc9-2ed79a44a1d2 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:21.416021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb157c-44ce-4669-8dc9-2ed79a44a1d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:21.416666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb157c-44ce-4669-8dc9-2ed79a44a1d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:21.416782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ab7e80e3ea40d4813bea1dbfcb05cd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:21.422670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e6eb157c-44ce-4669-8dc9-2ed79a44a1d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:21.443374 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2666/5349] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:21 2022] DELETE /identity/v3/users/67ab7e80e3ea40d4813bea1dbfcb05cd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:21.451280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:21.456815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:21.600983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:21.615450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb157c-44ce-4669-8dc9-2ed79a44a1d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:21.619991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb157c-44ce-4669-8dc9-2ed79a44a1d2 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:21.635472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161c953-5c60-40bd-8b62-c017b6ac8288 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:21.642711 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2684/5350] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:21.644768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0d990-f52a-46ba-be4c-59f161027110 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:21.645334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0d990-f52a-46ba-be4c-59f161027110 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:21.646028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0d990-f52a-46ba-be4c-59f161027110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:21.661688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731ea5b-def9-41f7-b946-b4b08ed61721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:21.671986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-15d0d990-f52a-46ba-be4c-59f161027110 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:21.673883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-15d0d990-f52a-46ba-be4c-59f161027110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:21.688272 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2685/5351] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:21.691443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731ea5b-def9-41f7-b946-b4b08ed61721 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:21.694915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731ea5b-def9-41f7-b946-b4b08ed61721 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:21.698036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731ea5b-def9-41f7-b946-b4b08ed61721 admin admin] PATH_INFO: `/v3/projects/d75970c62311417eada44e0270dade81/users/71e546b55bd1475782e5863ed50b6f01/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:21.704686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0d990-f52a-46ba-be4c-59f161027110 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:21.710973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-15d0d990-f52a-46ba-be4c-59f161027110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:21.737121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731ea5b-def9-41f7-b946-b4b08ed61721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75970c62311417eada44e0270dade81, user_id=71e546b55bd1475782e5863ed50b6f01, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:21.742758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731ea5b-def9-41f7-b946-b4b08ed61721 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:21.761400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:21.774493 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2667/5352] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:21 2022] PUT /identity/v3/projects/d75970c62311417eada44e0270dade81/users/71e546b55bd1475782e5863ed50b6f01/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:21.779809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972b768-7ffa-4770-afd5-27f0aec45d50 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:21.780222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972b768-7ffa-4770-afd5-27f0aec45d50 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:21.780579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972b768-7ffa-4770-afd5-27f0aec45d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:21.806609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9972b768-7ffa-4770-afd5-27f0aec45d50 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:21.808379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9972b768-7ffa-4770-afd5-27f0aec45d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:21.828347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0d990-f52a-46ba-be4c-59f161027110 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:21.896803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1405b-cae7-436d-8219-72cd46c8880f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:21.897593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1405b-cae7-436d-8219-72cd46c8880f service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:21.897884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1405b-cae7-436d-8219-72cd46c8880f service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:21.898420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1405b-cae7-436d-8219-72cd46c8880f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:21.931799 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2668/5353] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:21.949097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972b768-7ffa-4770-afd5-27f0aec45d50 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:21.972955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972b768-7ffa-4770-afd5-27f0aec45d50 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:21.996403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84d034-df5c-44e8-a6e3-b5abf905a227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:21.997245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84d034-df5c-44e8-a6e3-b5abf905a227 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:21.999131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84d034-df5c-44e8-a6e3-b5abf905a227 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:21.999521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84d034-df5c-44e8-a6e3-b5abf905a227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:22.024512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84d034-df5c-44e8-a6e3-b5abf905a227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:22.029268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84d034-df5c-44e8-a6e3-b5abf905a227 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:22.042280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1405b-cae7-436d-8219-72cd46c8880f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:22.043756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1405b-cae7-436d-8219-72cd46c8880f service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:22.060767 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2669/5354] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:22.070862 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2686/5355] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:23.429282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84d034-df5c-44e8-a6e3-b5abf905a227 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:23.434730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ab84d034-df5c-44e8-a6e3-b5abf905a227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:23.447699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1405b-cae7-436d-8219-72cd46c8880f service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:23.450273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c8d1405b-cae7-436d-8219-72cd46c8880f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:23.503704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84d034-df5c-44e8-a6e3-b5abf905a227 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:23.535338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:23.537398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:23.537908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:23.538399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] PATH_INFO: `/v3/projects/bc753bdffa3e4df28e8d36234a4ae4c1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:23.541866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc753bdffa3e4df28e8d36234a4ae4c1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:23.544306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:23.642461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1405b-cae7-436d-8219-72cd46c8880f service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:23.652385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc753bdffa3e4df28e8d36234a4ae4c1', 'request_id': 'req-c577f5e3-7259-4fcd-bf71-fb69446b384d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:23.675087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc753bdffa3e4df28e8d36234a4ae4c1', 'request_id': 'req-c577f5e3-7259-4fcd-bf71-fb69446b384d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:23.683029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:23.702096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc753bdffa3e4df28e8d36234a4ae4c1', 'request_id': 'req-c577f5e3-7259-4fcd-bf71-fb69446b384d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:23.716259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] The token cache is being invalidate because project bc753bdffa3e4df28e8d36234a4ae4c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:23.716604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:23.717227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:23.719309 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2670/5356] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:23 2022] DELETE /identity/v3/projects/bc753bdffa3e4df28e8d36234a4ae4c1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:23.722871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:23.726750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:23.767456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b36b-8c05-4ca1-a1ef-2a3e914e10bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:23.768097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b36b-8c05-4ca1-a1ef-2a3e914e10bb service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:23.768374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b36b-8c05-4ca1-a1ef-2a3e914e10bb service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:23.768781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b36b-8c05-4ca1-a1ef-2a3e914e10bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:23.771459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8a20b36b-8c05-4ca1-a1ef-2a3e914e10bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:23.820665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:23.854460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577f5e3-7259-4fcd-bf71-fb69446b384d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:23.870784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde663a-c507-4bce-baf1-72d57c1d66aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:23.872808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde663a-c507-4bce-baf1-72d57c1d66aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:23.873098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde663a-c507-4bce-baf1-72d57c1d66aa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:23.873402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde663a-c507-4bce-baf1-72d57c1d66aa admin admin] PATH_INFO: `/v3/users/27a07a608aee4fc2b084ee8f96c67b32` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:23.875195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde663a-c507-4bce-baf1-72d57c1d66aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a07a608aee4fc2b084ee8f96c67b32)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:23.878822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde663a-c507-4bce-baf1-72d57c1d66aa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:23.892132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20b36b-8c05-4ca1-a1ef-2a3e914e10bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:23.893843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20b36b-8c05-4ca1-a1ef-2a3e914e10bb service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:23.908820 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2687/5357] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:23 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:12:24.026075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-adde663a-c507-4bce-baf1-72d57c1d66aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a07a608aee4fc2b084ee8f96c67b32'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:24.043162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-adde663a-c507-4bce-baf1-72d57c1d66aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a07a608aee4fc2b084ee8f96c67b32'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:24.049091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-adde663a-c507-4bce-baf1-72d57c1d66aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a07a608aee4fc2b084ee8f96c67b32'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:24.052856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-adde663a-c507-4bce-baf1-72d57c1d66aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a07a608aee4fc2b084ee8f96c67b32'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:24.107336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-adde663a-c507-4bce-baf1-72d57c1d66aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a07a608aee4fc2b084ee8f96c67b32'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:24.132583 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2671/5358] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:23 2022] DELETE /identity/v3/users/27a07a608aee4fc2b084ee8f96c67b32 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:25.272599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b36b-8c05-4ca1-a1ef-2a3e914e10bb service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:25.323117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b36b-8c05-4ca1-a1ef-2a3e914e10bb service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:25.423733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca8f30-56a7-4119-a669-f91a45805a44 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:25.424302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca8f30-56a7-4119-a669-f91a45805a44 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:25.424515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca8f30-56a7-4119-a669-f91a45805a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:25.519289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69146f57-1129-4690-82d9-746b5fdfb9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:25.520954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cfca8f30-56a7-4119-a669-f91a45805a44 None None] MFA Rules not processed for user `71e546b55bd1475782e5863ed50b6f01`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:25.522206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69146f57-1129-4690-82d9-746b5fdfb9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:25.522488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69146f57-1129-4690-82d9-746b5fdfb9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:25.522763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69146f57-1129-4690-82d9-746b5fdfb9a7 admin admin] PATH_INFO: `/v3/projects/2cadc09cfa4e42bba721c7c9a9949ad5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:25.528268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cfca8f30-56a7-4119-a669-f91a45805a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:25.530050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69146f57-1129-4690-82d9-746b5fdfb9a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cadc09cfa4e42bba721c7c9a9949ad5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:25.532031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69146f57-1129-4690-82d9-746b5fdfb9a7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:25.665583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69146f57-1129-4690-82d9-746b5fdfb9a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cadc09cfa4e42bba721c7c9a9949ad5', 'request_id': 'req-69146f57-1129-4690-82d9-746b5fdfb9a7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:25.686718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69146f57-1129-4690-82d9-746b5fdfb9a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cadc09cfa4e42bba721c7c9a9949ad5', 'request_id': 'req-69146f57-1129-4690-82d9-746b5fdfb9a7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:25.689769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:25.701220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69146f57-1129-4690-82d9-746b5fdfb9a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cadc09cfa4e42bba721c7c9a9949ad5', 'request_id': 'req-69146f57-1129-4690-82d9-746b5fdfb9a7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:25.708761 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2672/5359] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:25.712962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca8f30-56a7-4119-a669-f91a45805a44 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:25.717463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cfca8f30-56a7-4119-a669-f91a45805a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:25.720617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69146f57-1129-4690-82d9-746b5fdfb9a7 admin admin] The token cache is being invalidate because project 2cadc09cfa4e42bba721c7c9a9949ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:25.721104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69146f57-1129-4690-82d9-746b5fdfb9a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:25.722166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69146f57-1129-4690-82d9-746b5fdfb9a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:25.725269 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2688/5360] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:25 2022] DELETE /identity/v3/projects/2cadc09cfa4e42bba721c7c9a9949ad5 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:25.732365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42fafb-3939-460b-a71c-56155e480238 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:25.732816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42fafb-3939-460b-a71c-56155e480238 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:25.733219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42fafb-3939-460b-a71c-56155e480238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:25.748038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca8f30-56a7-4119-a669-f91a45805a44 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:25.800195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9b42fafb-3939-460b-a71c-56155e480238 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:25.804636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9b42fafb-3939-460b-a71c-56155e480238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:25.848751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:25.861431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5d130-3685-40e6-aa64-1c3655ce2255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:25.862941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5d130-3685-40e6-aa64-1c3655ce2255 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:25.862941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5d130-3685-40e6-aa64-1c3655ce2255 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:25.862941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5d130-3685-40e6-aa64-1c3655ce2255 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:25.863680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5d130-3685-40e6-aa64-1c3655ce2255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:25.866476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5d130-3685-40e6-aa64-1c3655ce2255 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:25.914298 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2673/5361] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:25 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:25.916966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5d130-3685-40e6-aa64-1c3655ce2255 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:25.920146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1eb5d130-3685-40e6-aa64-1c3655ce2255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:26.040409 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2689/5362] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:26.049225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8d73d-8bb7-486b-9116-83c645de378e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:26.049528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8d73d-8bb7-486b-9116-83c645de378e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:26.049914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8d73d-8bb7-486b-9116-83c645de378e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:26.071892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5d130-3685-40e6-aa64-1c3655ce2255 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:26.092979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722b1be-5322-4687-8673-232c98032876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:26.093703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722b1be-5322-4687-8673-232c98032876 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:26.094083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722b1be-5322-4687-8673-232c98032876 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:26.094596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722b1be-5322-4687-8673-232c98032876 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:26.096015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722b1be-5322-4687-8673-232c98032876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:26.098235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722b1be-5322-4687-8673-232c98032876 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:26.144519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-46f8d73d-8bb7-486b-9116-83c645de378e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:26.145961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-46f8d73d-8bb7-486b-9116-83c645de378e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:26.155742 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2690/5363] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:26.160364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8d73d-8bb7-486b-9116-83c645de378e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:26.175951 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2674/5364] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:25 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:26.177467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722b1be-5322-4687-8673-232c98032876 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:26.181067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8d73d-8bb7-486b-9116-83c645de378e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:26.187534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a4e20-d036-4bac-8a19-2ff6e882e032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:26.188574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a4e20-d036-4bac-8a19-2ff6e882e032 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:26.189018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a4e20-d036-4bac-8a19-2ff6e882e032 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:26.189975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a4e20-d036-4bac-8a19-2ff6e882e032 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:26.190868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a4e20-d036-4bac-8a19-2ff6e882e032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:26.190868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a4e20-d036-4bac-8a19-2ff6e882e032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:26.195732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a4e20-d036-4bac-8a19-2ff6e882e032 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:26.203588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722b1be-5322-4687-8673-232c98032876 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:26.217966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a2b0a-9f7e-4787-9a2a-bfd62df081fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:26.218589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a2b0a-9f7e-4787-9a2a-bfd62df081fd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:26.218867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a2b0a-9f7e-4787-9a2a-bfd62df081fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:26.219283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a2b0a-9f7e-4787-9a2a-bfd62df081fd admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:26.219936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a2b0a-9f7e-4787-9a2a-bfd62df081fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:26.221805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a2b0a-9f7e-4787-9a2a-bfd62df081fd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:26.241327 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2691/5365] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:26.245798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a4e20-d036-4bac-8a19-2ff6e882e032 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:26.252403 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2675/5366] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:26.257071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a2b0a-9f7e-4787-9a2a-bfd62df081fd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:26.260618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a4e20-d036-4bac-8a19-2ff6e882e032 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:26.268020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8c6c9-7027-4567-8568-ee83dbab19b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:26.268782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8c6c9-7027-4567-8568-ee83dbab19b4 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:26.269295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8c6c9-7027-4567-8568-ee83dbab19b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:26.269551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8c6c9-7027-4567-8568-ee83dbab19b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:26.270385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8c6c9-7027-4567-8568-ee83dbab19b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:26.272656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8c6c9-7027-4567-8568-ee83dbab19b4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:26.280849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a2b0a-9f7e-4787-9a2a-bfd62df081fd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:26.297863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc19132-6fe4-4d55-9794-d1d8921d705d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:26.299024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc19132-6fe4-4d55-9794-d1d8921d705d admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:26.299468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc19132-6fe4-4d55-9794-d1d8921d705d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:26.299720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc19132-6fe4-4d55-9794-d1d8921d705d admin admin] PATH_INFO: `/v3/projects/17e6fc4e68334b7d8280006be65c3356/users/ab4180a8531148cba63962794a9750bf/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:26.318973 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2692/5367] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:26 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:26.324011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8c6c9-7027-4567-8568-ee83dbab19b4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:26.326717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc19132-6fe4-4d55-9794-d1d8921d705d admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e6fc4e68334b7d8280006be65c3356, user_id=ab4180a8531148cba63962794a9750bf, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:26.329684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc19132-6fe4-4d55-9794-d1d8921d705d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:26.374329 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2676/5368] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:26 2022] PUT /identity/v3/projects/17e6fc4e68334b7d8280006be65c3356/users/ab4180a8531148cba63962794a9750bf/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:26.379076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc19132-6fe4-4d55-9794-d1d8921d705d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:26.475231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8c6c9-7027-4567-8568-ee83dbab19b4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:26.602625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:26.633793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc19132-6fe4-4d55-9794-d1d8921d705d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:26.635401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65aeb3-13eb-4f5f-aea5-e3dcc664f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:26.639568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65aeb3-13eb-4f5f-aea5-e3dcc664f37c admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:26.639721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65aeb3-13eb-4f5f-aea5-e3dcc664f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:26.639960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65aeb3-13eb-4f5f-aea5-e3dcc664f37c admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:26.641357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65aeb3-13eb-4f5f-aea5-e3dcc664f37c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:26.644193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e63b7-2a35-4159-a77c-0d26e20a0b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:26.644408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65aeb3-13eb-4f5f-aea5-e3dcc664f37c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:26.644962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e63b7-2a35-4159-a77c-0d26e20a0b3b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:26.646907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e63b7-2a35-4159-a77c-0d26e20a0b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:26.647199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e63b7-2a35-4159-a77c-0d26e20a0b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:26.650058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e63b7-2a35-4159-a77c-0d26e20a0b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:26.652561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e63b7-2a35-4159-a77c-0d26e20a0b3b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:26.688842 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2677/5369] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:26.690906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e63b7-2a35-4159-a77c-0d26e20a0b3b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:26.697737 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2693/5370] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:26 2022] POST /identity/v3/users => generated 287 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:26.709177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e63b7-2a35-4159-a77c-0d26e20a0b3b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:26.711214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65aeb3-13eb-4f5f-aea5-e3dcc664f37c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:26.714742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7afacd-610a-4992-9a9c-8c4259412519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:26.715469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7afacd-610a-4992-9a9c-8c4259412519 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:26.715757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7afacd-610a-4992-9a9c-8c4259412519 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:26.716034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7afacd-610a-4992-9a9c-8c4259412519 admin admin] PATH_INFO: `/v3/projects/17e6fc4e68334b7d8280006be65c3356/users/ab4180a8531148cba63962794a9750bf/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:26.718682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7afacd-610a-4992-9a9c-8c4259412519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e6fc4e68334b7d8280006be65c3356, user_id=ab4180a8531148cba63962794a9750bf, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:26.733421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7afacd-610a-4992-9a9c-8c4259412519 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:26.733667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65aeb3-13eb-4f5f-aea5-e3dcc664f37c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:26.745459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995686f-aac4-41a0-b407-c5729016f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:26.746209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995686f-aac4-41a0-b407-c5729016f01d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:26.747032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995686f-aac4-41a0-b407-c5729016f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:26.747317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995686f-aac4-41a0-b407-c5729016f01d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:26.750239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995686f-aac4-41a0-b407-c5729016f01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:26.755703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995686f-aac4-41a0-b407-c5729016f01d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:26.766738 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2678/5371] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:26 2022] PUT /identity/v3/projects/17e6fc4e68334b7d8280006be65c3356/users/ab4180a8531148cba63962794a9750bf/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:12:26.780346 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2694/5372] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:26.780612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7afacd-610a-4992-9a9c-8c4259412519 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:26.808378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:26.889361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7afacd-610a-4992-9a9c-8c4259412519 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:26.894994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e162a4-66ed-4258-a81e-692de69be928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:26.895663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e162a4-66ed-4258-a81e-692de69be928 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:26.895940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e162a4-66ed-4258-a81e-692de69be928 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:26.896214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e162a4-66ed-4258-a81e-692de69be928 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:26.896872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e162a4-66ed-4258-a81e-692de69be928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:26.899392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e162a4-66ed-4258-a81e-692de69be928 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:26.910538 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2679/5373] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:26.914513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995686f-aac4-41a0-b407-c5729016f01d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:26.927224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995686f-aac4-41a0-b407-c5729016f01d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:26.932051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9239f1-6170-4f8c-8240-4ccc7d770baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:26.932809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9239f1-6170-4f8c-8240-4ccc7d770baa admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:26.933233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9239f1-6170-4f8c-8240-4ccc7d770baa admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:26.933578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9239f1-6170-4f8c-8240-4ccc7d770baa admin admin] PATH_INFO: `/v3/projects/509e5746019e46bcb756a2f84e4056c8/users/0feeac65345841dfacad6610c6bcbe39/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:26.954721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9239f1-6170-4f8c-8240-4ccc7d770baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=509e5746019e46bcb756a2f84e4056c8, user_id=0feeac65345841dfacad6610c6bcbe39, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:26.958290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9239f1-6170-4f8c-8240-4ccc7d770baa admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:26.977296 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2695/5374] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:26 2022] PUT /identity/v3/projects/509e5746019e46bcb756a2f84e4056c8/users/0feeac65345841dfacad6610c6bcbe39/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:26.989668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662ea33-44ef-4e33-a6ad-8c38efed126f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:26.989986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662ea33-44ef-4e33-a6ad-8c38efed126f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:26.990267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662ea33-44ef-4e33-a6ad-8c38efed126f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:27.028781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f662ea33-44ef-4e33-a6ad-8c38efed126f None None] MFA Rules not processed for user `0feeac65345841dfacad6610c6bcbe39`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:27.030234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f662ea33-44ef-4e33-a6ad-8c38efed126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:27.128873 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2680/5375] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:27.149095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9239f1-6170-4f8c-8240-4ccc7d770baa admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:27.152983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8e9239f1-6170-4f8c-8240-4ccc7d770baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:27.252446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9239f1-6170-4f8c-8240-4ccc7d770baa admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:27.257364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69644078-cc93-4054-9970-9751086ac4c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:27.258596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644078-cc93-4054-9970-9751086ac4c9 service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:27.259485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644078-cc93-4054-9970-9751086ac4c9 service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:27.260048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644078-cc93-4054-9970-9751086ac4c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:27.277334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69644078-cc93-4054-9970-9751086ac4c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:27.279009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69644078-cc93-4054-9970-9751086ac4c9 service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:27.291175 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2696/5376] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:28.304664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662ea33-44ef-4e33-a6ad-8c38efed126f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:28.388083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662ea33-44ef-4e33-a6ad-8c38efed126f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:28.395268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:28.396155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:28.396443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:28.396724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] PATH_INFO: `/v3/users/0feeac65345841dfacad6610c6bcbe39` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:28.397969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0feeac65345841dfacad6610c6bcbe39)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:28.399973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:28.458986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:28.460550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0feeac65345841dfacad6610c6bcbe39'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:28.494695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0feeac65345841dfacad6610c6bcbe39'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:28.496354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0feeac65345841dfacad6610c6bcbe39'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:28.497481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0feeac65345841dfacad6610c6bcbe39'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:28.513015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0feeac65345841dfacad6610c6bcbe39'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:28.536392 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2681/5377] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:28 2022] DELETE /identity/v3/users/0feeac65345841dfacad6610c6bcbe39 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:12:28.540750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f84fc0-4ebd-4749-8f4e-fc30a565b3ab None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:28.541275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f84fc0-4ebd-4749-8f4e-fc30a565b3ab None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:28.541361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f84fc0-4ebd-4749-8f4e-fc30a565b3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:28.564786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-01f84fc0-4ebd-4749-8f4e-fc30a565b3ab None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:28.566129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-01f84fc0-4ebd-4749-8f4e-fc30a565b3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:28.657394 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2697/5378] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:28.672525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:28.674996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:28.750678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd75296-7f82-4af6-a7d5-686b74f7b6f7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:28.757940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80599ac6-8336-49d6-96f1-55d05a7e63b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:28.758842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80599ac6-8336-49d6-96f1-55d05a7e63b5 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:28.759228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80599ac6-8336-49d6-96f1-55d05a7e63b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:28.760602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80599ac6-8336-49d6-96f1-55d05a7e63b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:28.780197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80599ac6-8336-49d6-96f1-55d05a7e63b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:28.782480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80599ac6-8336-49d6-96f1-55d05a7e63b5 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:28.803961 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2682/5379] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:29.023406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f84fc0-4ebd-4749-8f4e-fc30a565b3ab None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:29.025218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-01f84fc0-4ebd-4749-8f4e-fc30a565b3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:29.055692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f84fc0-4ebd-4749-8f4e-fc30a565b3ab None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:29.068934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3e0c3-0007-465e-991d-36b771f1264b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:29.069575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3e0c3-0007-465e-991d-36b771f1264b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:29.069869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3e0c3-0007-465e-991d-36b771f1264b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:29.070149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3e0c3-0007-465e-991d-36b771f1264b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:29.075086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-18c3e0c3-0007-465e-991d-36b771f1264b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:29.114636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3e0c3-0007-465e-991d-36b771f1264b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:29.116857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3e0c3-0007-465e-991d-36b771f1264b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:29.149827 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2698/5380] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:29.771171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660b2b-e85d-4e9f-b5e8-b419fcea0db6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:29.771699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660b2b-e85d-4e9f-b5e8-b419fcea0db6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:29.771699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660b2b-e85d-4e9f-b5e8-b419fcea0db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:29.837259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9e660b2b-e85d-4e9f-b5e8-b419fcea0db6 None None] MFA Rules not processed for user `ab4180a8531148cba63962794a9750bf`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:29.838512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9e660b2b-e85d-4e9f-b5e8-b419fcea0db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:30.015107 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2683/5381] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:30.017014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0437bc6-66b9-4f09-8016-c10b1000bc62 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:30.017559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0437bc6-66b9-4f09-8016-c10b1000bc62 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:30.018013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0437bc6-66b9-4f09-8016-c10b1000bc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:30.063625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c0437bc6-66b9-4f09-8016-c10b1000bc62 None None] MFA Rules not processed for user `71e546b55bd1475782e5863ed50b6f01`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:30.066224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c0437bc6-66b9-4f09-8016-c10b1000bc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:30.123622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:30.190994 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2699/5382] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:30.203894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660b2b-e85d-4e9f-b5e8-b419fcea0db6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:30.205397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9e660b2b-e85d-4e9f-b5e8-b419fcea0db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:30.276495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:30.313420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660b2b-e85d-4e9f-b5e8-b419fcea0db6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:30.323700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ae23b-8d85-4a87-bbe7-59251a9ce4e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:30.324480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ae23b-8d85-4a87-bbe7-59251a9ce4e4 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:30.324884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ae23b-8d85-4a87-bbe7-59251a9ce4e4 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:30.325306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ae23b-8d85-4a87-bbe7-59251a9ce4e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:30.328266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-153ae23b-8d85-4a87-bbe7-59251a9ce4e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:30.342468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ae23b-8d85-4a87-bbe7-59251a9ce4e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:30.344814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ae23b-8d85-4a87-bbe7-59251a9ce4e4 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:30.356033 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2684/5383] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:31.305644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0437bc6-66b9-4f09-8016-c10b1000bc62 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:31.307681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c0437bc6-66b9-4f09-8016-c10b1000bc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:31.323285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0437bc6-66b9-4f09-8016-c10b1000bc62 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:31.328012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0550afb-c925-4a83-89c2-4419f6daf196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:31.328643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0550afb-c925-4a83-89c2-4419f6daf196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:31.328915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0550afb-c925-4a83-89c2-4419f6daf196 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:31.329418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0550afb-c925-4a83-89c2-4419f6daf196 admin admin] PATH_INFO: `/v3/projects/509e5746019e46bcb756a2f84e4056c8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:31.330532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0550afb-c925-4a83-89c2-4419f6daf196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509e5746019e46bcb756a2f84e4056c8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:31.332458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0550afb-c925-4a83-89c2-4419f6daf196 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:31.393291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a0550afb-c925-4a83-89c2-4419f6daf196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509e5746019e46bcb756a2f84e4056c8', 'request_id': 'req-a0550afb-c925-4a83-89c2-4419f6daf196'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:31.403278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a0550afb-c925-4a83-89c2-4419f6daf196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509e5746019e46bcb756a2f84e4056c8', 'request_id': 'req-a0550afb-c925-4a83-89c2-4419f6daf196'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:31.409676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a0550afb-c925-4a83-89c2-4419f6daf196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509e5746019e46bcb756a2f84e4056c8', 'request_id': 'req-a0550afb-c925-4a83-89c2-4419f6daf196'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:31.424805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a0550afb-c925-4a83-89c2-4419f6daf196 admin admin] The token cache is being invalidate because project 509e5746019e46bcb756a2f84e4056c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:31.425375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a0550afb-c925-4a83-89c2-4419f6daf196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:31.427322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a0550afb-c925-4a83-89c2-4419f6daf196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:31.429534 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2700/5384] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:31 2022] DELETE /identity/v3/projects/509e5746019e46bcb756a2f84e4056c8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:31.434109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5b690-222f-4dc1-bdb1-a170a72717d2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:31.434652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5b690-222f-4dc1-bdb1-a170a72717d2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:31.434652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5b690-222f-4dc1-bdb1-a170a72717d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:31.465408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f8f5b690-222f-4dc1-bdb1-a170a72717d2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:31.469242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f8f5b690-222f-4dc1-bdb1-a170a72717d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:31.559006 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2685/5385] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:31.566517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d77560-f302-4e8f-ac11-b9be11b3b181 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:31.566843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d77560-f302-4e8f-ac11-b9be11b3b181 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:31.567757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d77560-f302-4e8f-ac11-b9be11b3b181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:31.596527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-17d77560-f302-4e8f-ac11-b9be11b3b181 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:31.598131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-17d77560-f302-4e8f-ac11-b9be11b3b181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:31.607878 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2701/5386] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:12:31.617781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5b690-222f-4dc1-bdb1-a170a72717d2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:31.631753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5b690-222f-4dc1-bdb1-a170a72717d2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:31.636647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50932fd2-b5d4-4345-9f01-ba45b57d5fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:31.637778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50932fd2-b5d4-4345-9f01-ba45b57d5fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:31.638065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50932fd2-b5d4-4345-9f01-ba45b57d5fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:31.638374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50932fd2-b5d4-4345-9f01-ba45b57d5fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:31.639179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50932fd2-b5d4-4345-9f01-ba45b57d5fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:31.639890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50932fd2-b5d4-4345-9f01-ba45b57d5fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:31.642254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50932fd2-b5d4-4345-9f01-ba45b57d5fa5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:31.655135 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2686/5387] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:31.659496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d77560-f302-4e8f-ac11-b9be11b3b181 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:31.672175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d77560-f302-4e8f-ac11-b9be11b3b181 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:31.678070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3513e-b70a-4ae6-9b58-d74b48eef489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:31.678777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3513e-b70a-4ae6-9b58-d74b48eef489 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:31.679269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3513e-b70a-4ae6-9b58-d74b48eef489 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:31.679465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3513e-b70a-4ae6-9b58-d74b48eef489 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:31.680572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3513e-b70a-4ae6-9b58-d74b48eef489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:31.682904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3513e-b70a-4ae6-9b58-d74b48eef489 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:31.719572 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2702/5388] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:31 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:31.724508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50932fd2-b5d4-4345-9f01-ba45b57d5fa5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:31.738707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50932fd2-b5d4-4345-9f01-ba45b57d5fa5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:31.819454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999be7a-e580-460d-adf2-3f5467ded43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:31.819937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999be7a-e580-460d-adf2-3f5467ded43c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:31.820295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999be7a-e580-460d-adf2-3f5467ded43c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:31.820636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999be7a-e580-460d-adf2-3f5467ded43c admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:31.821557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999be7a-e580-460d-adf2-3f5467ded43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:31.824319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999be7a-e580-460d-adf2-3f5467ded43c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:31.853705 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2687/5389] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:31 2022] POST /identity/v3/users => generated 282 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:31.858331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3513e-b70a-4ae6-9b58-d74b48eef489 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:31.870615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3513e-b70a-4ae6-9b58-d74b48eef489 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:31.881720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9407369-9971-4749-8ac4-74a366bca35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:31.882377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9407369-9971-4749-8ac4-74a366bca35a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:31.882662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9407369-9971-4749-8ac4-74a366bca35a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:31.882937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9407369-9971-4749-8ac4-74a366bca35a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:31.883600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9407369-9971-4749-8ac4-74a366bca35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:31.885226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9407369-9971-4749-8ac4-74a366bca35a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:31.901306 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2703/5390] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:31.905167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999be7a-e580-460d-adf2-3f5467ded43c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:31.915983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999be7a-e580-460d-adf2-3f5467ded43c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:31.921614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ede2fe-a0e0-4603-86e1-46ea770a832b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:31.921887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede2fe-a0e0-4603-86e1-46ea770a832b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:31.922151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede2fe-a0e0-4603-86e1-46ea770a832b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:31.922439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede2fe-a0e0-4603-86e1-46ea770a832b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:31.923230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ede2fe-a0e0-4603-86e1-46ea770a832b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:31.924759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ede2fe-a0e0-4603-86e1-46ea770a832b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:31.936744 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2688/5391] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:12:31.940757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9407369-9971-4749-8ac4-74a366bca35a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:31.975338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9407369-9971-4749-8ac4-74a366bca35a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:32.001952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4883c87-b9e9-4de7-91df-834266398fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:32.002992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4883c87-b9e9-4de7-91df-834266398fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:32.003406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4883c87-b9e9-4de7-91df-834266398fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:32.003610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4883c87-b9e9-4de7-91df-834266398fa1 admin admin] PATH_INFO: `/v3/projects/836a0d2cbf9a4cd99f778127ab7d6f87/users/23cacb20f4d54fe89dbe5d334d4f395f/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:32.050845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4883c87-b9e9-4de7-91df-834266398fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=836a0d2cbf9a4cd99f778127ab7d6f87, user_id=23cacb20f4d54fe89dbe5d334d4f395f, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:32.060323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4883c87-b9e9-4de7-91df-834266398fa1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:32.126122 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2704/5392] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:31 2022] PUT /identity/v3/projects/836a0d2cbf9a4cd99f778127ab7d6f87/users/23cacb20f4d54fe89dbe5d334d4f395f/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:12:32.131438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa020dc-4bee-405d-8c1c-4d231da5a693 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:32.132027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa020dc-4bee-405d-8c1c-4d231da5a693 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:32.132513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa020dc-4bee-405d-8c1c-4d231da5a693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:32.200397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-faa020dc-4bee-405d-8c1c-4d231da5a693 None None] MFA Rules not processed for user `23cacb20f4d54fe89dbe5d334d4f395f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:32.201740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-faa020dc-4bee-405d-8c1c-4d231da5a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:32.253564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:32.302855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4883c87-b9e9-4de7-91df-834266398fa1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:32.305029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a4883c87-b9e9-4de7-91df-834266398fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:32.350752 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2689/5393] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:32.357586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa020dc-4bee-405d-8c1c-4d231da5a693 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:32.359376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-faa020dc-4bee-405d-8c1c-4d231da5a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:32.443693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:32.458033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4883c87-b9e9-4de7-91df-834266398fa1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:32.500549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e7b0a-6a9a-4b55-8dda-b28605e3a9ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:32.502567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e7b0a-6a9a-4b55-8dda-b28605e3a9ac service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:32.503415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e7b0a-6a9a-4b55-8dda-b28605e3a9ac service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:32.503871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e7b0a-6a9a-4b55-8dda-b28605e3a9ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:32.516379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa020dc-4bee-405d-8c1c-4d231da5a693 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:32.526108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4a8e7b0a-6a9a-4b55-8dda-b28605e3a9ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:32.543934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fe1e9-ee91-4f0b-8282-4224a922985f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:32.544717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fe1e9-ee91-4f0b-8282-4224a922985f service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:32.545006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fe1e9-ee91-4f0b-8282-4224a922985f service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:32.545389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fe1e9-ee91-4f0b-8282-4224a922985f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:32.547099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e7b0a-6a9a-4b55-8dda-b28605e3a9ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:32.548925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e7b0a-6a9a-4b55-8dda-b28605e3a9ac service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:32.568901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732fe1e9-ee91-4f0b-8282-4224a922985f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:32.574286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732fe1e9-ee91-4f0b-8282-4224a922985f service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:32.577589 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2705/5394] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:12:32.589599 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2690/5395] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:33.148349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e7b0a-6a9a-4b55-8dda-b28605e3a9ac service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:33.231020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e7b0a-6a9a-4b55-8dda-b28605e3a9ac service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:33.243859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:33.244724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:33.245014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:33.245321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] PATH_INFO: `/v3/users/23cacb20f4d54fe89dbe5d334d4f395f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:33.246603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23cacb20f4d54fe89dbe5d334d4f395f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:33.248850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:33.328863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23cacb20f4d54fe89dbe5d334d4f395f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:33.346165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23cacb20f4d54fe89dbe5d334d4f395f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:33.346955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23cacb20f4d54fe89dbe5d334d4f395f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:33.347671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23cacb20f4d54fe89dbe5d334d4f395f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:33.369262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23cacb20f4d54fe89dbe5d334d4f395f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:33.391554 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2706/5396] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:33 2022] DELETE /identity/v3/users/23cacb20f4d54fe89dbe5d334d4f395f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:33.396489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a4cd-f145-485f-88a8-e998d0c5ebf4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:33.396768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a4cd-f145-485f-88a8-e998d0c5ebf4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:33.397036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a4cd-f145-485f-88a8-e998d0c5ebf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:33.433450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e560a4cd-f145-485f-88a8-e998d0c5ebf4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:33.434682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e560a4cd-f145-485f-88a8-e998d0c5ebf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:33.515250 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2691/5397] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:33.564423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:33.565460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:33.682069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a3e09-0f62-4a93-97b5-a4ab71681326 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:33.686867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a54eae-dad8-439f-a807-c650a4592f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:33.687498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a54eae-dad8-439f-a807-c650a4592f25 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:33.687775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a54eae-dad8-439f-a807-c650a4592f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:33.688045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a54eae-dad8-439f-a807-c650a4592f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:33.704422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a54eae-dad8-439f-a807-c650a4592f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:33.705936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a54eae-dad8-439f-a807-c650a4592f25 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:33.717689 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2707/5398] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:35.596508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560a4cd-f145-485f-88a8-e998d0c5ebf4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:35.602712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e560a4cd-f145-485f-88a8-e998d0c5ebf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:35.627403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560a4cd-f145-485f-88a8-e998d0c5ebf4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:35.637082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae680c2f-db62-4b46-aad2-44b914e9aaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:35.639744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae680c2f-db62-4b46-aad2-44b914e9aaeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:35.640315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae680c2f-db62-4b46-aad2-44b914e9aaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:35.641751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae680c2f-db62-4b46-aad2-44b914e9aaeb admin admin] PATH_INFO: `/v3/projects/836a0d2cbf9a4cd99f778127ab7d6f87` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:35.644332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae680c2f-db62-4b46-aad2-44b914e9aaeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=836a0d2cbf9a4cd99f778127ab7d6f87)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:35.650601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae680c2f-db62-4b46-aad2-44b914e9aaeb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:35.786455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ae680c2f-db62-4b46-aad2-44b914e9aaeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836a0d2cbf9a4cd99f778127ab7d6f87', 'request_id': 'req-ae680c2f-db62-4b46-aad2-44b914e9aaeb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:35.805475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ae680c2f-db62-4b46-aad2-44b914e9aaeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836a0d2cbf9a4cd99f778127ab7d6f87', 'request_id': 'req-ae680c2f-db62-4b46-aad2-44b914e9aaeb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:35.815736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ae680c2f-db62-4b46-aad2-44b914e9aaeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836a0d2cbf9a4cd99f778127ab7d6f87', 'request_id': 'req-ae680c2f-db62-4b46-aad2-44b914e9aaeb'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:35.821730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:35.845108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ae680c2f-db62-4b46-aad2-44b914e9aaeb admin admin] The token cache is being invalidate because project 836a0d2cbf9a4cd99f778127ab7d6f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:35.845637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ae680c2f-db62-4b46-aad2-44b914e9aaeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:35.848701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ae680c2f-db62-4b46-aad2-44b914e9aaeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:35.856588 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2692/5399] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:35 2022] DELETE /identity/v3/projects/836a0d2cbf9a4cd99f778127ab7d6f87 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:35.858656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4c239-a0c2-48f4-b600-82d867bf12e2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:35.859239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4c239-a0c2-48f4-b600-82d867bf12e2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:35.859239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4c239-a0c2-48f4-b600-82d867bf12e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:35.897113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-67f4c239-a0c2-48f4-b600-82d867bf12e2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:35.898466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-67f4c239-a0c2-48f4-b600-82d867bf12e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:35.909334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:36.052707 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2708/5400] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:36.060378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f46d6f-4cf3-4c00-a658-c0492708064d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:36.060571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f46d6f-4cf3-4c00-a658-c0492708064d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:36.060769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f46d6f-4cf3-4c00-a658-c0492708064d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:36.085367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-16f46d6f-4cf3-4c00-a658-c0492708064d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:36.087028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-16f46d6f-4cf3-4c00-a658-c0492708064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:36.096218 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2693/5401] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:12:36.101370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4c239-a0c2-48f4-b600-82d867bf12e2 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:36.119138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4c239-a0c2-48f4-b600-82d867bf12e2 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:36.124711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136886c-c188-45c1-936f-ddf2759be5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:36.125370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136886c-c188-45c1-936f-ddf2759be5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:36.125650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136886c-c188-45c1-936f-ddf2759be5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:36.125924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136886c-c188-45c1-936f-ddf2759be5c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:36.126634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136886c-c188-45c1-936f-ddf2759be5c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:36.126939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136886c-c188-45c1-936f-ddf2759be5c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:36.128603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136886c-c188-45c1-936f-ddf2759be5c5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:36.151215 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2709/5402] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:36.152171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f46d6f-4cf3-4c00-a658-c0492708064d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:36.162952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f46d6f-4cf3-4c00-a658-c0492708064d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:36.168317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980a615-b53b-47fd-91f7-ebc9ce43bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:36.169236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980a615-b53b-47fd-91f7-ebc9ce43bd9e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:36.169548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980a615-b53b-47fd-91f7-ebc9ce43bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:36.169823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980a615-b53b-47fd-91f7-ebc9ce43bd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:36.170457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980a615-b53b-47fd-91f7-ebc9ce43bd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:36.172357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980a615-b53b-47fd-91f7-ebc9ce43bd9e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:36.225572 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2694/5403] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:36 2022] POST /identity/v3/projects => generated 391 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:36.229494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136886c-c188-45c1-936f-ddf2759be5c5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:36.243279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136886c-c188-45c1-936f-ddf2759be5c5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:36.338162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64421cab-3669-4441-b612-4c15ca584f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:36.341571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64421cab-3669-4441-b612-4c15ca584f29 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:36.341942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64421cab-3669-4441-b612-4c15ca584f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:36.342418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64421cab-3669-4441-b612-4c15ca584f29 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:36.343128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64421cab-3669-4441-b612-4c15ca584f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:36.350130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64421cab-3669-4441-b612-4c15ca584f29 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:36.411408 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2710/5404] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:36 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:12:36.415350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980a615-b53b-47fd-91f7-ebc9ce43bd9e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:36.426705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980a615-b53b-47fd-91f7-ebc9ce43bd9e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:36.431709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b6b61-d1df-40a1-8f5f-1008e7009599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:36.432327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6b61-d1df-40a1-8f5f-1008e7009599 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:36.432605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6b61-d1df-40a1-8f5f-1008e7009599 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:36.432874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6b61-d1df-40a1-8f5f-1008e7009599 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:36.433561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b6b61-d1df-40a1-8f5f-1008e7009599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:36.435160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b6b61-d1df-40a1-8f5f-1008e7009599 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:36.446910 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2695/5405] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:12:36.451470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64421cab-3669-4441-b612-4c15ca584f29 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:36.467087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64421cab-3669-4441-b612-4c15ca584f29 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:36.477530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74b777-ebb3-4419-99db-7444e6bc2934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:36.478635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74b777-ebb3-4419-99db-7444e6bc2934 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:36.479196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74b777-ebb3-4419-99db-7444e6bc2934 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:36.479629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74b777-ebb3-4419-99db-7444e6bc2934 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:36.480943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74b777-ebb3-4419-99db-7444e6bc2934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:36.484166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74b777-ebb3-4419-99db-7444e6bc2934 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:36.500098 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2711/5406] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:36.509570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b6b61-d1df-40a1-8f5f-1008e7009599 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:36.523145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b6b61-d1df-40a1-8f5f-1008e7009599 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:36.529150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9bc5-0f8a-4106-99e3-9c1c224c5bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:36.530074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9bc5-0f8a-4106-99e3-9c1c224c5bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:36.530518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9bc5-0f8a-4106-99e3-9c1c224c5bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:36.530790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9bc5-0f8a-4106-99e3-9c1c224c5bcf admin admin] PATH_INFO: `/v3/projects/7035a333da7e4ca4abfd41beab0a29a8/users/41dda970baaf419ebff776169c460192/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:36.567976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f9bc5-0f8a-4106-99e3-9c1c224c5bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7035a333da7e4ca4abfd41beab0a29a8, user_id=41dda970baaf419ebff776169c460192, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:36.572516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f9bc5-0f8a-4106-99e3-9c1c224c5bcf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:36.603912 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2696/5407] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:36 2022] PUT /identity/v3/projects/7035a333da7e4ca4abfd41beab0a29a8/users/41dda970baaf419ebff776169c460192/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:36.616731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ebaea-7c4a-44be-87a9-cb1829995e89 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:36.617492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ebaea-7c4a-44be-87a9-cb1829995e89 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:36.617857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ebaea-7c4a-44be-87a9-cb1829995e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:36.666770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e21ebaea-7c4a-44be-87a9-cb1829995e89 None None] MFA Rules not processed for user `41dda970baaf419ebff776169c460192`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:36.668141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e21ebaea-7c4a-44be-87a9-cb1829995e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:36.789770 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2712/5408] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:36.812469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9bc5-0f8a-4106-99e3-9c1c224c5bcf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:36.814762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-793f9bc5-0f8a-4106-99e3-9c1c224c5bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:36.824324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ebaea-7c4a-44be-87a9-cb1829995e89 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:36.826625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e21ebaea-7c4a-44be-87a9-cb1829995e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:36.846291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:36.924945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ebaea-7c4a-44be-87a9-cb1829995e89 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:36.929585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584c397-9088-45b3-854f-e5991acc8a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:36.930782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584c397-9088-45b3-854f-e5991acc8a99 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:36.931084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584c397-9088-45b3-854f-e5991acc8a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:36.931412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584c397-9088-45b3-854f-e5991acc8a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:36.943322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584c397-9088-45b3-854f-e5991acc8a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:36.945235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584c397-9088-45b3-854f-e5991acc8a99 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:36.959891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9bc5-0f8a-4106-99e3-9c1c224c5bcf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:36.962700 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2713/5409] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:12:36.963632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584c397-9088-45b3-854f-e5991acc8a99 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:36.964957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f584c397-9088-45b3-854f-e5991acc8a99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:36.969605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:36.970407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:36.970859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:36.971234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] PATH_INFO: `/v3/users/84b9968c1dd3411ca4e8232709346400` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:36.976960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b9968c1dd3411ca4e8232709346400)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:36.979197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584c397-9088-45b3-854f-e5991acc8a99 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:36.980501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:36.983494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206a266-ec24-42c7-a043-c0d742ab3028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:36.984272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206a266-ec24-42c7-a043-c0d742ab3028 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:36.984863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206a266-ec24-42c7-a043-c0d742ab3028 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:36.984863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206a266-ec24-42c7-a043-c0d742ab3028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:36.986766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b206a266-ec24-42c7-a043-c0d742ab3028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:37.007905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206a266-ec24-42c7-a043-c0d742ab3028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:37.009658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206a266-ec24-42c7-a043-c0d742ab3028 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:37.020933 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2714/5410] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:37.054124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206a266-ec24-42c7-a043-c0d742ab3028 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:37.058290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b206a266-ec24-42c7-a043-c0d742ab3028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:37.076048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b9968c1dd3411ca4e8232709346400'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:37.083328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206a266-ec24-42c7-a043-c0d742ab3028 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:37.099648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b9968c1dd3411ca4e8232709346400'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:37.101977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b9968c1dd3411ca4e8232709346400'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:37.103696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1893a4-7749-414c-8b5c-4d1b735e5f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:37.104361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1893a4-7749-414c-8b5c-4d1b735e5f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:37.104880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1893a4-7749-414c-8b5c-4d1b735e5f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:37.104997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1893a4-7749-414c-8b5c-4d1b735e5f55 admin admin] PATH_INFO: `/v3/users/d78e9afd772c4de981cac8f5817ec356` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:37.106488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1893a4-7749-414c-8b5c-4d1b735e5f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78e9afd772c4de981cac8f5817ec356)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:37.107813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b9968c1dd3411ca4e8232709346400'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:37.108071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1893a4-7749-414c-8b5c-4d1b735e5f55 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:37.133396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b9968c1dd3411ca4e8232709346400'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:37.157096 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2697/5411] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:36 2022] DELETE /identity/v3/users/84b9968c1dd3411ca4e8232709346400 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:37.204179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a1893a4-7749-414c-8b5c-4d1b735e5f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78e9afd772c4de981cac8f5817ec356'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:37.214328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a1893a4-7749-414c-8b5c-4d1b735e5f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78e9afd772c4de981cac8f5817ec356'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:37.215492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a1893a4-7749-414c-8b5c-4d1b735e5f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78e9afd772c4de981cac8f5817ec356'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:37.215950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a1893a4-7749-414c-8b5c-4d1b735e5f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78e9afd772c4de981cac8f5817ec356'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:37.231461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a1893a4-7749-414c-8b5c-4d1b735e5f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78e9afd772c4de981cac8f5817ec356'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:37.252351 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2715/5412] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:37 2022] DELETE /identity/v3/users/d78e9afd772c4de981cac8f5817ec356 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:37.827651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:37.830480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:37.897744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:38.006091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac881443-80fb-421e-9fc3-5230fa39531a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:38.129315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:38.130069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:38.130353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:38.130625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77 admin admin] PATH_INFO: `/v3/projects/85daf8b3ee684e01a414941e7b7c768b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:38.132608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85daf8b3ee684e01a414941e7b7c768b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:38.134737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:38.228936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85daf8b3ee684e01a414941e7b7c768b', 'request_id': 'req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:38.239505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85daf8b3ee684e01a414941e7b7c768b', 'request_id': 'req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:38.248342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85daf8b3ee684e01a414941e7b7c768b', 'request_id': 'req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:38.264213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77 admin admin] The token cache is being invalidate because project 85daf8b3ee684e01a414941e7b7c768b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:38.264439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:38.265127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0709169f-4ce1-4c7a-ab5f-efeca0cfca77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:38.273022 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2698/5413] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:37 2022] DELETE /identity/v3/projects/85daf8b3ee684e01a414941e7b7c768b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:38.274977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ac6d2-77c3-4090-83e2-e386e7d380ce None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:38.275509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ac6d2-77c3-4090-83e2-e386e7d380ce None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:38.275614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ac6d2-77c3-4090-83e2-e386e7d380ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:38.315266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b09ac6d2-77c3-4090-83e2-e386e7d380ce None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:38.317317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b09ac6d2-77c3-4090-83e2-e386e7d380ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:38.397354 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2716/5414] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:38.403157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61876d6e-9cb4-4478-b7d5-fbf4cec6471a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:38.404077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61876d6e-9cb4-4478-b7d5-fbf4cec6471a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:38.404611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61876d6e-9cb4-4478-b7d5-fbf4cec6471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:38.442765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-61876d6e-9cb4-4478-b7d5-fbf4cec6471a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:38.444151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-61876d6e-9cb4-4478-b7d5-fbf4cec6471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:38.457452 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2699/5415] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:12:38.461718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ac6d2-77c3-4090-83e2-e386e7d380ce None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:38.480828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ac6d2-77c3-4090-83e2-e386e7d380ce None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:38.494935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61876d6e-9cb4-4478-b7d5-fbf4cec6471a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:38.496545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-61876d6e-9cb4-4478-b7d5-fbf4cec6471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:38.497934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595234d-99d0-4e41-aad8-ef2e69668f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:38.500951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595234d-99d0-4e41-aad8-ef2e69668f41 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:38.502781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595234d-99d0-4e41-aad8-ef2e69668f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:38.503297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595234d-99d0-4e41-aad8-ef2e69668f41 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:38.505174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595234d-99d0-4e41-aad8-ef2e69668f41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:38.506829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595234d-99d0-4e41-aad8-ef2e69668f41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:38.510927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595234d-99d0-4e41-aad8-ef2e69668f41 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:38.513063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61876d6e-9cb4-4478-b7d5-fbf4cec6471a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:38.515492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:38.532498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728760e-4389-4ac8-b58f-45dc06fa57a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:38.533346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728760e-4389-4ac8-b58f-45dc06fa57a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:38.533729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728760e-4389-4ac8-b58f-45dc06fa57a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:38.534102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728760e-4389-4ac8-b58f-45dc06fa57a6 admin admin] PATH_INFO: `/v3/projects/765c62cac2ee4406b23a5baa85c52ff7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:38.535911 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2717/5416] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:38.537139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728760e-4389-4ac8-b58f-45dc06fa57a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765c62cac2ee4406b23a5baa85c52ff7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:38.539592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728760e-4389-4ac8-b58f-45dc06fa57a6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:38.541855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595234d-99d0-4e41-aad8-ef2e69668f41 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:38.561253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595234d-99d0-4e41-aad8-ef2e69668f41 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:38.586247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2e204-a429-4a57-968e-858775eda2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:38.587642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2e204-a429-4a57-968e-858775eda2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:38.588454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2e204-a429-4a57-968e-858775eda2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:38.588843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2e204-a429-4a57-968e-858775eda2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:38.590561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2e204-a429-4a57-968e-858775eda2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:38.593597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2e204-a429-4a57-968e-858775eda2e6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:38.600570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:38.622273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2728760e-4389-4ac8-b58f-45dc06fa57a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765c62cac2ee4406b23a5baa85c52ff7', 'request_id': 'req-2728760e-4389-4ac8-b58f-45dc06fa57a6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:38.633579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2728760e-4389-4ac8-b58f-45dc06fa57a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765c62cac2ee4406b23a5baa85c52ff7', 'request_id': 'req-2728760e-4389-4ac8-b58f-45dc06fa57a6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:38.641311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2728760e-4389-4ac8-b58f-45dc06fa57a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765c62cac2ee4406b23a5baa85c52ff7', 'request_id': 'req-2728760e-4389-4ac8-b58f-45dc06fa57a6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:38.656906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2728760e-4389-4ac8-b58f-45dc06fa57a6 admin admin] The token cache is being invalidate because project 765c62cac2ee4406b23a5baa85c52ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:38.656906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2728760e-4389-4ac8-b58f-45dc06fa57a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:38.657829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2728760e-4389-4ac8-b58f-45dc06fa57a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:38.664171 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2700/5417] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:38 2022] DELETE /identity/v3/projects/765c62cac2ee4406b23a5baa85c52ff7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:38.669740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9a65f-c07e-4ce8-ab0b-d6d59cc9af7f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:38.670756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9a65f-c07e-4ce8-ab0b-d6d59cc9af7f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:38.670756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9a65f-c07e-4ce8-ab0b-d6d59cc9af7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:38.673007 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2718/5418] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:38 2022] POST /identity/v3/projects => generated 397 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:38.678148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2e204-a429-4a57-968e-858775eda2e6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:38.680055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b5b2e204-a429-4a57-968e-858775eda2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:38.699661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-25b9a65f-c07e-4ce8-ab0b-d6d59cc9af7f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:38.701405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-25b9a65f-c07e-4ce8-ab0b-d6d59cc9af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:38.805148 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2701/5419] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:12:38.806059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2e204-a429-4a57-968e-858775eda2e6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:38.811667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03297c-6518-4305-ab29-24ec6c247114 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:38.811972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37007b-6980-4a8a-8529-fce5861d9e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:38.812504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03297c-6518-4305-ab29-24ec6c247114 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:38.812636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37007b-6980-4a8a-8529-fce5861d9e6e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:38.812872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37007b-6980-4a8a-8529-fce5861d9e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:38.813148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37007b-6980-4a8a-8529-fce5861d9e6e admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:38.813854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37007b-6980-4a8a-8529-fce5861d9e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:38.814095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03297c-6518-4305-ab29-24ec6c247114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:38.816387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37007b-6980-4a8a-8529-fce5861d9e6e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:38.866260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9a03297c-6518-4305-ab29-24ec6c247114 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:38.870618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9a03297c-6518-4305-ab29-24ec6c247114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:38.888715 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2719/5420] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:38 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:38.891222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37007b-6980-4a8a-8529-fce5861d9e6e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:38.897135 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2702/5421] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:12:38.899116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03297c-6518-4305-ab29-24ec6c247114 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:38.912961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03297c-6518-4305-ab29-24ec6c247114 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:38.918622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37007b-6980-4a8a-8529-fce5861d9e6e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:38.922506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cac28-cf2e-43e4-950a-bd21e3a5c268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:38.923802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cac28-cf2e-43e4-950a-bd21e3a5c268 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:38.924783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cac28-cf2e-43e4-950a-bd21e3a5c268 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:38.925070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cac28-cf2e-43e4-950a-bd21e3a5c268 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:38.925762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cac28-cf2e-43e4-950a-bd21e3a5c268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:38.926588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cac28-cf2e-43e4-950a-bd21e3a5c268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:38.928875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cac28-cf2e-43e4-950a-bd21e3a5c268 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:38.932226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf8039-0a6a-40c5-91f0-13ce31fd8f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:38.935036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf8039-0a6a-40c5-91f0-13ce31fd8f68 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:38.935318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf8039-0a6a-40c5-91f0-13ce31fd8f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:38.935593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf8039-0a6a-40c5-91f0-13ce31fd8f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:38.936301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf8039-0a6a-40c5-91f0-13ce31fd8f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:38.937979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf8039-0a6a-40c5-91f0-13ce31fd8f68 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:38.971669 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2703/5422] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:38.975276 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2720/5423] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:38.977467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cac28-cf2e-43e4-950a-bd21e3a5c268 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:38.978892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf8039-0a6a-40c5-91f0-13ce31fd8f68 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:38.999630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cac28-cf2e-43e4-950a-bd21e3a5c268 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:39.003954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf8039-0a6a-40c5-91f0-13ce31fd8f68 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:39.018490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87b769-826a-4e28-b144-cc9ac0ca0873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:39.029933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87b769-826a-4e28-b144-cc9ac0ca0873 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:39.031401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87b769-826a-4e28-b144-cc9ac0ca0873 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:39.033582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87b769-826a-4e28-b144-cc9ac0ca0873 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:39.034934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87b769-826a-4e28-b144-cc9ac0ca0873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:39.037474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f45c31-5b14-45fb-ae9d-89f658f9b5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:39.038517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f45c31-5b14-45fb-ae9d-89f658f9b5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:39.038811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f45c31-5b14-45fb-ae9d-89f658f9b5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:39.039094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f45c31-5b14-45fb-ae9d-89f658f9b5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:39.039759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f45c31-5b14-45fb-ae9d-89f658f9b5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:39.042623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f45c31-5b14-45fb-ae9d-89f658f9b5b5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:39.043002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87b769-826a-4e28-b144-cc9ac0ca0873 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:39.121165 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2721/5424] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:39.125806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f45c31-5b14-45fb-ae9d-89f658f9b5b5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:39.168994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f45c31-5b14-45fb-ae9d-89f658f9b5b5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:39.177851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10e1b5-81e6-4a60-8d15-08ce41ff8d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:39.178698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10e1b5-81e6-4a60-8d15-08ce41ff8d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:39.179139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10e1b5-81e6-4a60-8d15-08ce41ff8d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:39.179490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10e1b5-81e6-4a60-8d15-08ce41ff8d6f admin admin] PATH_INFO: `/v3/projects/3207efb3c2484385b24e40119d1bb71a/users/345fc5b62ae34cdc8323d5afb75a8a34/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:39.195249 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2704/5425] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:38 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:39.196172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87b769-826a-4e28-b144-cc9ac0ca0873 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:39.207343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10e1b5-81e6-4a60-8d15-08ce41ff8d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3207efb3c2484385b24e40119d1bb71a, user_id=345fc5b62ae34cdc8323d5afb75a8a34, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:39.212673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10e1b5-81e6-4a60-8d15-08ce41ff8d6f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:39.241745 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2722/5426] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:39 2022] PUT /identity/v3/projects/3207efb3c2484385b24e40119d1bb71a/users/345fc5b62ae34cdc8323d5afb75a8a34/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:39.246877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44393d93-abb3-4e81-ad76-74ddf190fd7f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:39.248038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44393d93-abb3-4e81-ad76-74ddf190fd7f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:39.255128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44393d93-abb3-4e81-ad76-74ddf190fd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:39.284029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-44393d93-abb3-4e81-ad76-74ddf190fd7f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:39.287480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-44393d93-abb3-4e81-ad76-74ddf190fd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:39.336350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87b769-826a-4e28-b144-cc9ac0ca0873 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:39.399697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:39.462165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7212611-3590-499b-abe6-61428e3bef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:39.462800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7212611-3590-499b-abe6-61428e3bef8e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:39.463096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7212611-3590-499b-abe6-61428e3bef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:39.463396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7212611-3590-499b-abe6-61428e3bef8e admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:39.464045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7212611-3590-499b-abe6-61428e3bef8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:39.466054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7212611-3590-499b-abe6-61428e3bef8e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:39.511164 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2705/5427] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:39 2022] POST /identity/v3/users => generated 292 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:39.514633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7212611-3590-499b-abe6-61428e3bef8e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:39.539973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7212611-3590-499b-abe6-61428e3bef8e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:39.557398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54112cf8-9dc3-4ac3-aab5-b6e3ddb52e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:39.558027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54112cf8-9dc3-4ac3-aab5-b6e3ddb52e68 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:39.558309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54112cf8-9dc3-4ac3-aab5-b6e3ddb52e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:39.558589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54112cf8-9dc3-4ac3-aab5-b6e3ddb52e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:39.559241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54112cf8-9dc3-4ac3-aab5-b6e3ddb52e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:39.563399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54112cf8-9dc3-4ac3-aab5-b6e3ddb52e68 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:39.604671 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2706/5428] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:12:39.606794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54112cf8-9dc3-4ac3-aab5-b6e3ddb52e68 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:39.639418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54112cf8-9dc3-4ac3-aab5-b6e3ddb52e68 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:39.649981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2878a-1905-40ca-902e-2fcdcebe0ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:39.651839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2878a-1905-40ca-902e-2fcdcebe0ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:39.665414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2878a-1905-40ca-902e-2fcdcebe0ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:39.668524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2878a-1905-40ca-902e-2fcdcebe0ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:39.669467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2878a-1905-40ca-902e-2fcdcebe0ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:39.672688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2878a-1905-40ca-902e-2fcdcebe0ef4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:39.700481 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2723/5429] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:12:39.711480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44393d93-abb3-4e81-ad76-74ddf190fd7f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:39.711671 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2707/5430] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:12:39.715826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2878a-1905-40ca-902e-2fcdcebe0ef4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:39.720959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b8d2878a-1905-40ca-902e-2fcdcebe0ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:39.722119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44393d93-abb3-4e81-ad76-74ddf190fd7f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:39.727629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbfaed-32bd-438c-b50e-b397ffc7a3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:39.728291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbfaed-32bd-438c-b50e-b397ffc7a3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:39.728563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbfaed-32bd-438c-b50e-b397ffc7a3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:39.729135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbfaed-32bd-438c-b50e-b397ffc7a3b2 admin admin] PATH_INFO: `/v3/projects/7994439815e0416180c95158033ae3f2/users/de71b64a2e1c4b6aaa15b5ee75003add/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:39.746323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbfaed-32bd-438c-b50e-b397ffc7a3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7994439815e0416180c95158033ae3f2, user_id=de71b64a2e1c4b6aaa15b5ee75003add, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:39.749328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbfaed-32bd-438c-b50e-b397ffc7a3b2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:39.751868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:39.786558 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2724/5431] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:39 2022] PUT /identity/v3/projects/7994439815e0416180c95158033ae3f2/users/de71b64a2e1c4b6aaa15b5ee75003add/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:39.794543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d6d35-bca3-4c2b-9878-c129e52d142f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:39.795688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d6d35-bca3-4c2b-9878-c129e52d142f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:39.796373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d6d35-bca3-4c2b-9878-c129e52d142f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:39.847450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2878a-1905-40ca-902e-2fcdcebe0ef4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:39.851720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4c0d6d35-bca3-4c2b-9878-c129e52d142f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:39.854763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4c0d6d35-bca3-4c2b-9878-c129e52d142f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:39.967014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6fe46-ade6-4506-b505-555417af7925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:39.968415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6fe46-ade6-4506-b505-555417af7925 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:39.968776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6fe46-ade6-4506-b505-555417af7925 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:39.969973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6fe46-ade6-4506-b505-555417af7925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:39.993118 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2725/5432] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:39.996010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6fe46-ade6-4506-b505-555417af7925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:39.997989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6fe46-ade6-4506-b505-555417af7925 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:40.012587 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2708/5433] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:12:40.037520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d6d35-bca3-4c2b-9878-c129e52d142f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:40.039579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4c0d6d35-bca3-4c2b-9878-c129e52d142f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:40.061405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d6d35-bca3-4c2b-9878-c129e52d142f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:40.070154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590f32c-8e4e-4dbf-b160-a5a316a0094d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:40.071603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590f32c-8e4e-4dbf-b160-a5a316a0094d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:40.072098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590f32c-8e4e-4dbf-b160-a5a316a0094d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:40.074337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590f32c-8e4e-4dbf-b160-a5a316a0094d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:40.099039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590f32c-8e4e-4dbf-b160-a5a316a0094d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:40.100827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590f32c-8e4e-4dbf-b160-a5a316a0094d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:40.153954 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2726/5434] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:12:40.525361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6fe46-ade6-4506-b505-555417af7925 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:40.526807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-aff6fe46-ade6-4506-b505-555417af7925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:40.552764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6fe46-ade6-4506-b505-555417af7925 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:40.565284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79456b1-f3c5-4681-b483-71f122ed9949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:40.565863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79456b1-f3c5-4681-b483-71f122ed9949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:40.566141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79456b1-f3c5-4681-b483-71f122ed9949 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:40.566412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79456b1-f3c5-4681-b483-71f122ed9949 admin admin] PATH_INFO: `/v3/users/6a78d352c143483c8e4702d789d4c516` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:40.568306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79456b1-f3c5-4681-b483-71f122ed9949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a78d352c143483c8e4702d789d4c516)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:40.570391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79456b1-f3c5-4681-b483-71f122ed9949 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:40.673754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c79456b1-f3c5-4681-b483-71f122ed9949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a78d352c143483c8e4702d789d4c516'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:40.683791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:40.687745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c79456b1-f3c5-4681-b483-71f122ed9949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a78d352c143483c8e4702d789d4c516'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:40.690244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c79456b1-f3c5-4681-b483-71f122ed9949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a78d352c143483c8e4702d789d4c516'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:40.692497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c79456b1-f3c5-4681-b483-71f122ed9949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a78d352c143483c8e4702d789d4c516'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:40.708961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c79456b1-f3c5-4681-b483-71f122ed9949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a78d352c143483c8e4702d789d4c516'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:40.728473 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2709/5435] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:40 2022] DELETE /identity/v3/users/6a78d352c143483c8e4702d789d4c516 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:12:41.863095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590f32c-8e4e-4dbf-b160-a5a316a0094d service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:41.883296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590f32c-8e4e-4dbf-b160-a5a316a0094d service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:42.018237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:42.018910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:42.019369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:42.019657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9 admin admin] PATH_INFO: `/v3/projects/0ae02675057e4f27bc1980348afc8ca1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:42.020859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae02675057e4f27bc1980348afc8ca1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:42.022986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:42.106234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae02675057e4f27bc1980348afc8ca1', 'request_id': 'req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:42.124137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae02675057e4f27bc1980348afc8ca1', 'request_id': 'req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:42.133828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae02675057e4f27bc1980348afc8ca1', 'request_id': 'req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:42.166637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9 admin admin] The token cache is being invalidate because project 0ae02675057e4f27bc1980348afc8ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:42.167245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:42.168924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8bd8c35a-e7e3-4772-8dc6-2d1908b0caa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:42.174218 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2727/5436] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:41 2022] DELETE /identity/v3/projects/0ae02675057e4f27bc1980348afc8ca1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:42.179818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26343aa2-967d-4ffc-b73a-7f9e6e099e60 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:42.180308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26343aa2-967d-4ffc-b73a-7f9e6e099e60 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:42.180481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26343aa2-967d-4ffc-b73a-7f9e6e099e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:42.247959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-26343aa2-967d-4ffc-b73a-7f9e6e099e60 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:42.250982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-26343aa2-967d-4ffc-b73a-7f9e6e099e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:42.375285 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2710/5437] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:42.383403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e2978-201c-4ae9-bb0b-79c138bee8b1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:42.383730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e2978-201c-4ae9-bb0b-79c138bee8b1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:42.384014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e2978-201c-4ae9-bb0b-79c138bee8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:42.440815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e93e2978-201c-4ae9-bb0b-79c138bee8b1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:42.447842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e93e2978-201c-4ae9-bb0b-79c138bee8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:42.472302 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2728/5438] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:42.478443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26343aa2-967d-4ffc-b73a-7f9e6e099e60 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:42.502656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26343aa2-967d-4ffc-b73a-7f9e6e099e60 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:42.522070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79272-31bc-4372-a49d-9f9418b6fb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:42.522711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79272-31bc-4372-a49d-9f9418b6fb5a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:42.522999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79272-31bc-4372-a49d-9f9418b6fb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:42.523275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79272-31bc-4372-a49d-9f9418b6fb5a admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:42.523969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d79272-31bc-4372-a49d-9f9418b6fb5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:42.524275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d79272-31bc-4372-a49d-9f9418b6fb5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:42.525933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d79272-31bc-4372-a49d-9f9418b6fb5a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:42.550017 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2711/5439] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:42.555081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e2978-201c-4ae9-bb0b-79c138bee8b1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:42.570505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:42.586100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e2978-201c-4ae9-bb0b-79c138bee8b1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:42.595720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c98e12-50b7-470e-b43c-9f4b87a2702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:42.596391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c98e12-50b7-470e-b43c-9f4b87a2702c admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:42.596672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c98e12-50b7-470e-b43c-9f4b87a2702c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:42.596985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c98e12-50b7-470e-b43c-9f4b87a2702c admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:42.597806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c98e12-50b7-470e-b43c-9f4b87a2702c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:42.611848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c98e12-50b7-470e-b43c-9f4b87a2702c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:42.679360 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2729/5440] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:42 2022] POST /identity/v3/projects => generated 403 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:12:42.683908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79272-31bc-4372-a49d-9f9418b6fb5a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:42.698289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79272-31bc-4372-a49d-9f9418b6fb5a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:42.846731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8576-0906-4f3d-969f-79a5b798edd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:42.847586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8576-0906-4f3d-969f-79a5b798edd9 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:42.847819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8576-0906-4f3d-969f-79a5b798edd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:42.848165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8576-0906-4f3d-969f-79a5b798edd9 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:42.850322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e8576-0906-4f3d-969f-79a5b798edd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:42.854621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e8576-0906-4f3d-969f-79a5b798edd9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:42.905917 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2712/5441] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:42 2022] POST /identity/v3/users => generated 302 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:42.909943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c98e12-50b7-470e-b43c-9f4b87a2702c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:42.924883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c98e12-50b7-470e-b43c-9f4b87a2702c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:42.937976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f6160-cf59-48e0-a1fc-b76da772dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:42.938609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f6160-cf59-48e0-a1fc-b76da772dd2c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:42.938889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f6160-cf59-48e0-a1fc-b76da772dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:42.939162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f6160-cf59-48e0-a1fc-b76da772dd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:42.939811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f6160-cf59-48e0-a1fc-b76da772dd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:42.941594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f6160-cf59-48e0-a1fc-b76da772dd2c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:42.954773 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2730/5442] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:42.959278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8576-0906-4f3d-969f-79a5b798edd9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:42.975631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8576-0906-4f3d-969f-79a5b798edd9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:42.985634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d5dee-392b-4b4c-a42d-cd76c28ffb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:42.987193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d5dee-392b-4b4c-a42d-cd76c28ffb6b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:42.987486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d5dee-392b-4b4c-a42d-cd76c28ffb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:42.987767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d5dee-392b-4b4c-a42d-cd76c28ffb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:42.989671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d5dee-392b-4b4c-a42d-cd76c28ffb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:42.991286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d5dee-392b-4b4c-a42d-cd76c28ffb6b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:43.023537 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2713/5443] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:43.027677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f6160-cf59-48e0-a1fc-b76da772dd2c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:43.041425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f6160-cf59-48e0-a1fc-b76da772dd2c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:43.046902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd26a4-112a-4351-a7ed-967e0a7d56cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:43.047660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd26a4-112a-4351-a7ed-967e0a7d56cf admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:43.048004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd26a4-112a-4351-a7ed-967e0a7d56cf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:43.048350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd26a4-112a-4351-a7ed-967e0a7d56cf admin admin] PATH_INFO: `/v3/projects/195ea87b43684ed59b1b1c048b0584b3/users/0a6b3f4cefa94e269186f9d9e5aff559/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:43.079597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd26a4-112a-4351-a7ed-967e0a7d56cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=195ea87b43684ed59b1b1c048b0584b3, user_id=0a6b3f4cefa94e269186f9d9e5aff559, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:43.085015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd26a4-112a-4351-a7ed-967e0a7d56cf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:43.126187 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2731/5444] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:43 2022] PUT /identity/v3/projects/195ea87b43684ed59b1b1c048b0584b3/users/0a6b3f4cefa94e269186f9d9e5aff559/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:12:43.131198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627855ba-e2f7-4c9f-acf2-dab38fac9ae3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:43.131420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627855ba-e2f7-4c9f-acf2-dab38fac9ae3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:43.131704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627855ba-e2f7-4c9f-acf2-dab38fac9ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:43.181905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-627855ba-e2f7-4c9f-acf2-dab38fac9ae3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:43.183257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-627855ba-e2f7-4c9f-acf2-dab38fac9ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:43.278925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:43.352535 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2714/5445] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:43.405437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd26a4-112a-4351-a7ed-967e0a7d56cf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:43.408110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-53bd26a4-112a-4351-a7ed-967e0a7d56cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:43.534237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd26a4-112a-4351-a7ed-967e0a7d56cf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:43.540067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcae5c-b2e4-426e-a6fc-6f5458b54ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:43.540067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcae5c-b2e4-426e-a6fc-6f5458b54ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:43.540390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcae5c-b2e4-426e-a6fc-6f5458b54ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:43.540605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcae5c-b2e4-426e-a6fc-6f5458b54ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:43.551763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcae5c-b2e4-426e-a6fc-6f5458b54ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:43.553552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcae5c-b2e4-426e-a6fc-6f5458b54ed5 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:43.565639 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2732/5446] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:45.556151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627855ba-e2f7-4c9f-acf2-dab38fac9ae3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:45.557576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-627855ba-e2f7-4c9f-acf2-dab38fac9ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:45.575773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627855ba-e2f7-4c9f-acf2-dab38fac9ae3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:45.582886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:45.583545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:45.583877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:45.584203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] PATH_INFO: `/v3/users/46ff7768e6c6482ea9f5c893efcd9676` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:45.585603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ff7768e6c6482ea9f5c893efcd9676)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:45.587619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:45.681377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ff7768e6c6482ea9f5c893efcd9676'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:45.691026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ff7768e6c6482ea9f5c893efcd9676'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:45.692337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ff7768e6c6482ea9f5c893efcd9676'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:45.693178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ff7768e6c6482ea9f5c893efcd9676'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:45.711391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ff7768e6c6482ea9f5c893efcd9676'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:45.736123 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2715/5447] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:45 2022] DELETE /identity/v3/users/46ff7768e6c6482ea9f5c893efcd9676 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:45.738180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39f3b6-48c6-43a3-ab1b-da2822a8a49f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:45.739050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39f3b6-48c6-43a3-ab1b-da2822a8a49f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:45.739507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39f3b6-48c6-43a3-ab1b-da2822a8a49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:45.765364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-db39f3b6-48c6-43a3-ab1b-da2822a8a49f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:45.768114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-db39f3b6-48c6-43a3-ab1b-da2822a8a49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:45.868736 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2733/5448] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:46.092836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:46.094434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:46.161324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38feea-331d-4313-9e12-3f1a2b3ee77c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:46.165105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ace79-75e0-46d5-8a22-b82827a16eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:46.166006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ace79-75e0-46d5-8a22-b82827a16eae service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:46.166161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ace79-75e0-46d5-8a22-b82827a16eae service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:46.166332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ace79-75e0-46d5-8a22-b82827a16eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:46.180709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ace79-75e0-46d5-8a22-b82827a16eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:46.182412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ace79-75e0-46d5-8a22-b82827a16eae service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:46.195698 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2716/5449] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:47.191204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39f3b6-48c6-43a3-ab1b-da2822a8a49f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:47.193402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-db39f3b6-48c6-43a3-ab1b-da2822a8a49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:47.209654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39f3b6-48c6-43a3-ab1b-da2822a8a49f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:47.217542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:47.218656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:47.219176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:47.219678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] PATH_INFO: `/v3/projects/d09dfabc853d4e338285012361ff69c7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:47.221312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09dfabc853d4e338285012361ff69c7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:47.224295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:47.295276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:47.302601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09dfabc853d4e338285012361ff69c7', 'request_id': 'req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:47.322589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09dfabc853d4e338285012361ff69c7', 'request_id': 'req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:47.344033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09dfabc853d4e338285012361ff69c7', 'request_id': 'req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:47.365578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] The token cache is being invalidate because project d09dfabc853d4e338285012361ff69c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:47.365871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:47.366745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:47.368847 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2734/5450] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:47 2022] DELETE /identity/v3/projects/d09dfabc853d4e338285012361ff69c7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:47.372958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ace79-75e0-46d5-8a22-b82827a16eae service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:47.391902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ace79-75e0-46d5-8a22-b82827a16eae service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:47.523585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:47.545741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825d26c-f973-47ba-855f-4db5d2039a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:47.549596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825d26c-f973-47ba-855f-4db5d2039a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:47.552059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825d26c-f973-47ba-855f-4db5d2039a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:47.552937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825d26c-f973-47ba-855f-4db5d2039a01 admin admin] PATH_INFO: `/v3/users/9196ff89092a4154950657497d057e15` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:47.555282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825d26c-f973-47ba-855f-4db5d2039a01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9196ff89092a4154950657497d057e15)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:47.558045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825d26c-f973-47ba-855f-4db5d2039a01 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:47.683538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6825d26c-f973-47ba-855f-4db5d2039a01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9196ff89092a4154950657497d057e15'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:47.700707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6825d26c-f973-47ba-855f-4db5d2039a01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9196ff89092a4154950657497d057e15'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:47.704655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6825d26c-f973-47ba-855f-4db5d2039a01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9196ff89092a4154950657497d057e15'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:47.705679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6825d26c-f973-47ba-855f-4db5d2039a01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9196ff89092a4154950657497d057e15'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:47.737582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6825d26c-f973-47ba-855f-4db5d2039a01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9196ff89092a4154950657497d057e15'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:47.769350 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2717/5451] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:47 2022] DELETE /identity/v3/users/9196ff89092a4154950657497d057e15 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:48.546285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:48.548616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:48.574575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dfb27-a6f8-4e36-83c1-d0a6cd831f96 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:48.664011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32736c-926c-4b21-a83a-3ce56a041845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:48.664720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32736c-926c-4b21-a83a-3ce56a041845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:48.664996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32736c-926c-4b21-a83a-3ce56a041845 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:48.665463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32736c-926c-4b21-a83a-3ce56a041845 admin admin] PATH_INFO: `/v3/projects/323a2d09e70946dfb93b1701bbbe2a08` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:48.666728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32736c-926c-4b21-a83a-3ce56a041845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=323a2d09e70946dfb93b1701bbbe2a08)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:48.668641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32736c-926c-4b21-a83a-3ce56a041845 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:48.738270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a32736c-926c-4b21-a83a-3ce56a041845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323a2d09e70946dfb93b1701bbbe2a08', 'request_id': 'req-7a32736c-926c-4b21-a83a-3ce56a041845'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:48.755132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a32736c-926c-4b21-a83a-3ce56a041845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323a2d09e70946dfb93b1701bbbe2a08', 'request_id': 'req-7a32736c-926c-4b21-a83a-3ce56a041845'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:48.766452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a32736c-926c-4b21-a83a-3ce56a041845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323a2d09e70946dfb93b1701bbbe2a08', 'request_id': 'req-7a32736c-926c-4b21-a83a-3ce56a041845'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:48.781098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a32736c-926c-4b21-a83a-3ce56a041845 admin admin] The token cache is being invalidate because project 323a2d09e70946dfb93b1701bbbe2a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:48.781098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a32736c-926c-4b21-a83a-3ce56a041845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:48.782151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a32736c-926c-4b21-a83a-3ce56a041845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:48.788247 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2735/5452] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:48 2022] DELETE /identity/v3/projects/323a2d09e70946dfb93b1701bbbe2a08 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:48.790371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61a525-79f8-43ff-acaf-5b9ab8f415d7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:48.790881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61a525-79f8-43ff-acaf-5b9ab8f415d7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:48.791077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61a525-79f8-43ff-acaf-5b9ab8f415d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:48.820206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9d61a525-79f8-43ff-acaf-5b9ab8f415d7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:48.821932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9d61a525-79f8-43ff-acaf-5b9ab8f415d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:48.910415 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2718/5453] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:48.913608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b93300-8128-43c9-bb3a-a69ffe33a561 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:48.913893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b93300-8128-43c9-bb3a-a69ffe33a561 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:48.914170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b93300-8128-43c9-bb3a-a69ffe33a561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:48.948116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-69b93300-8128-43c9-bb3a-a69ffe33a561 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:48.949613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-69b93300-8128-43c9-bb3a-a69ffe33a561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:48.963614 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2736/5454] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:48.965000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61a525-79f8-43ff-acaf-5b9ab8f415d7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:48.997987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61a525-79f8-43ff-acaf-5b9ab8f415d7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:49.011943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa2cff-d315-41a5-8966-45a39a44c64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:49.024686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa2cff-d315-41a5-8966-45a39a44c64a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:49.025394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa2cff-d315-41a5-8966-45a39a44c64a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:49.025914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa2cff-d315-41a5-8966-45a39a44c64a admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:49.027029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa2cff-d315-41a5-8966-45a39a44c64a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:49.027781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa2cff-d315-41a5-8966-45a39a44c64a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:49.031019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa2cff-d315-41a5-8966-45a39a44c64a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:49.047908 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2719/5455] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:49.053575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b93300-8128-43c9-bb3a-a69ffe33a561 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:49.067695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b93300-8128-43c9-bb3a-a69ffe33a561 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:49.073491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702947b-33c6-4bfc-a535-f35327005350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:49.074312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702947b-33c6-4bfc-a535-f35327005350 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:49.074596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702947b-33c6-4bfc-a535-f35327005350 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:49.074870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702947b-33c6-4bfc-a535-f35327005350 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:49.075981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702947b-33c6-4bfc-a535-f35327005350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:49.077933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702947b-33c6-4bfc-a535-f35327005350 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:49.127353 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2737/5456] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:49 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:49.130368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa2cff-d315-41a5-8966-45a39a44c64a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:49.157358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa2cff-d315-41a5-8966-45a39a44c64a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:49.256937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:49.269049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781f9fa-4405-4df2-9013-1802c4932c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:49.270911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781f9fa-4405-4df2-9013-1802c4932c9d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:49.270911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781f9fa-4405-4df2-9013-1802c4932c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:49.271139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781f9fa-4405-4df2-9013-1802c4932c9d admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:49.272143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781f9fa-4405-4df2-9013-1802c4932c9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:49.274040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781f9fa-4405-4df2-9013-1802c4932c9d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:49.306209 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2720/5457] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:49 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:49.312239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702947b-33c6-4bfc-a535-f35327005350 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:49.330348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702947b-33c6-4bfc-a535-f35327005350 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:49.346614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2146db-532a-4bfc-ad13-337c40f569ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:49.350202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2146db-532a-4bfc-ad13-337c40f569ce admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:49.350978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2146db-532a-4bfc-ad13-337c40f569ce admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:49.352794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2146db-532a-4bfc-ad13-337c40f569ce admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:49.353792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2146db-532a-4bfc-ad13-337c40f569ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:49.358244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2146db-532a-4bfc-ad13-337c40f569ce admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:49.396927 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2738/5458] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:49.400936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781f9fa-4405-4df2-9013-1802c4932c9d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:49.443004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781f9fa-4405-4df2-9013-1802c4932c9d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:49.456553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f3041-b65f-43a7-b1b0-9227d3b37315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:49.457850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f3041-b65f-43a7-b1b0-9227d3b37315 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:49.458304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f3041-b65f-43a7-b1b0-9227d3b37315 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:49.458802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f3041-b65f-43a7-b1b0-9227d3b37315 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:49.459600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f3041-b65f-43a7-b1b0-9227d3b37315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:49.461696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f3041-b65f-43a7-b1b0-9227d3b37315 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:49.478341 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2721/5459] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:12:49.482626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2146db-532a-4bfc-ad13-337c40f569ce admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:49.503328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2146db-532a-4bfc-ad13-337c40f569ce admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:49.514355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f3041-b65f-43a7-b1b0-9227d3b37315 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:49.517328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-547f3041-b65f-43a7-b1b0-9227d3b37315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:49.536030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1577-21c3-4451-ac9e-6918a48da9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:49.538068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1577-21c3-4451-ac9e-6918a48da9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:49.538993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1577-21c3-4451-ac9e-6918a48da9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:49.539979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1577-21c3-4451-ac9e-6918a48da9e9 admin admin] PATH_INFO: `/v3/projects/e20d16d934c94f94b1edda85360c5d6e/users/fe5ee5ec04e44011bf77cbade8ef6cf3/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:49.570899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f3041-b65f-43a7-b1b0-9227d3b37315 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:49.582497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:49.583228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:49.583587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:49.584739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] PATH_INFO: `/v3/users/f77129c9ce5149748c6bd39c69307f76` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:49.588933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77129c9ce5149748c6bd39c69307f76)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:49.595244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:49.595874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1577-21c3-4451-ac9e-6918a48da9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20d16d934c94f94b1edda85360c5d6e, user_id=fe5ee5ec04e44011bf77cbade8ef6cf3, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:49.605652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1577-21c3-4451-ac9e-6918a48da9e9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:49.638810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:49.650093 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2739/5460] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:49 2022] PUT /identity/v3/projects/e20d16d934c94f94b1edda85360c5d6e/users/fe5ee5ec04e44011bf77cbade8ef6cf3/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:49.665417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253274c2-4f27-44b5-bbb0-fa7e3c74324a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:49.665916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253274c2-4f27-44b5-bbb0-fa7e3c74324a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:49.666355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253274c2-4f27-44b5-bbb0-fa7e3c74324a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:49.765407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77129c9ce5149748c6bd39c69307f76'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:49.768213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-253274c2-4f27-44b5-bbb0-fa7e3c74324a None None] MFA Rules not processed for user `fe5ee5ec04e44011bf77cbade8ef6cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:49.774557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-253274c2-4f27-44b5-bbb0-fa7e3c74324a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:49.786880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77129c9ce5149748c6bd39c69307f76'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:49.789474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77129c9ce5149748c6bd39c69307f76'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:49.791613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77129c9ce5149748c6bd39c69307f76'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:49.835395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77129c9ce5149748c6bd39c69307f76'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:49.864583 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2722/5461] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:49 2022] DELETE /identity/v3/users/f77129c9ce5149748c6bd39c69307f76 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:49.953386 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2740/5462] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:49.999921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:50.001587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:50.116239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8873934-2e60-4fe9-9ae9-f6565811fd01 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:50.120569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf9c35-6719-47d8-af5e-b63e02769f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:50.127043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf9c35-6719-47d8-af5e-b63e02769f8f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:50.128565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf9c35-6719-47d8-af5e-b63e02769f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:50.129123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf9c35-6719-47d8-af5e-b63e02769f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:50.231006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf9c35-6719-47d8-af5e-b63e02769f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:50.234294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf9c35-6719-47d8-af5e-b63e02769f8f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:50.258717 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2723/5463] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:50.377620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253274c2-4f27-44b5-bbb0-fa7e3c74324a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:50.380009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-253274c2-4f27-44b5-bbb0-fa7e3c74324a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:50.505075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253274c2-4f27-44b5-bbb0-fa7e3c74324a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:50.511755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf9c35-6719-47d8-af5e-b63e02769f8f service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:50.514249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f1cf9c35-6719-47d8-af5e-b63e02769f8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:50.520322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:50.628617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eda6be-3da5-4363-bb0c-cc52553d86fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:50.631129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eda6be-3da5-4363-bb0c-cc52553d86fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:50.631416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eda6be-3da5-4363-bb0c-cc52553d86fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:50.631747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eda6be-3da5-4363-bb0c-cc52553d86fe admin admin] PATH_INFO: `/v3/projects/b0a53484c6ab4ea4be7acb5ac53acaa0` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:50.635422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eda6be-3da5-4363-bb0c-cc52553d86fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a53484c6ab4ea4be7acb5ac53acaa0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:50.640536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eda6be-3da5-4363-bb0c-cc52553d86fe admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:50.742397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf9c35-6719-47d8-af5e-b63e02769f8f service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:50.751428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:50.765576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d4eda6be-3da5-4363-bb0c-cc52553d86fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'request_id': 'req-d4eda6be-3da5-4363-bb0c-cc52553d86fe'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:50.790545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d4eda6be-3da5-4363-bb0c-cc52553d86fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'request_id': 'req-d4eda6be-3da5-4363-bb0c-cc52553d86fe'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:50.807566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d4eda6be-3da5-4363-bb0c-cc52553d86fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'request_id': 'req-d4eda6be-3da5-4363-bb0c-cc52553d86fe'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:50.849269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d4eda6be-3da5-4363-bb0c-cc52553d86fe admin admin] The token cache is being invalidate because project b0a53484c6ab4ea4be7acb5ac53acaa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:50.849622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d4eda6be-3da5-4363-bb0c-cc52553d86fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:50.852087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d4eda6be-3da5-4363-bb0c-cc52553d86fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:50.855582 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2741/5464] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:50 2022] DELETE /identity/v3/projects/b0a53484c6ab4ea4be7acb5ac53acaa0 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:50.865318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0932-3532-4ff9-876d-a450ab69eae6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:50.865619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0932-3532-4ff9-876d-a450ab69eae6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:50.866383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0932-3532-4ff9-876d-a450ab69eae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:50.933774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fc3c0932-3532-4ff9-876d-a450ab69eae6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:50.935186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fc3c0932-3532-4ff9-876d-a450ab69eae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:50.943713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29360f-0d44-4fab-9627-7cf7db963f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:50.945728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29360f-0d44-4fab-9627-7cf7db963f85 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:50.946006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29360f-0d44-4fab-9627-7cf7db963f85 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:50.946274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29360f-0d44-4fab-9627-7cf7db963f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:50.951263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9f29360f-0d44-4fab-9627-7cf7db963f85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:50.984804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29360f-0d44-4fab-9627-7cf7db963f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:50.986613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29360f-0d44-4fab-9627-7cf7db963f85 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:51.017006 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2724/5465] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:51.047981 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2742/5466] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:51.056815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7ca61-f5e9-467c-b9cd-56363915d1df None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:51.057105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7ca61-f5e9-467c-b9cd-56363915d1df None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:51.057405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7ca61-f5e9-467c-b9cd-56363915d1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:51.142631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-60e7ca61-f5e9-467c-b9cd-56363915d1df None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:51.144521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-60e7ca61-f5e9-467c-b9cd-56363915d1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:51.170425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0932-3532-4ff9-876d-a450ab69eae6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:51.178856 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2725/5467] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:51.197939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0932-3532-4ff9-876d-a450ab69eae6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:51.212129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b192b0-880e-4b48-9118-f5f50b5cd99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:51.212779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b192b0-880e-4b48-9118-f5f50b5cd99a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:51.213062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b192b0-880e-4b48-9118-f5f50b5cd99a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:51.216109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b192b0-880e-4b48-9118-f5f50b5cd99a admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:51.216830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b192b0-880e-4b48-9118-f5f50b5cd99a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:51.217433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b192b0-880e-4b48-9118-f5f50b5cd99a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:51.220541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b192b0-880e-4b48-9118-f5f50b5cd99a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:51.246773 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2743/5468] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:51.248207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7ca61-f5e9-467c-b9cd-56363915d1df None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:51.263730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7ca61-f5e9-467c-b9cd-56363915d1df None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:51.271836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff152d-c85b-49fe-ba5a-db69ca0a1f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:51.277561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff152d-c85b-49fe-ba5a-db69ca0a1f16 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:51.278063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff152d-c85b-49fe-ba5a-db69ca0a1f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:51.278510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff152d-c85b-49fe-ba5a-db69ca0a1f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:51.279278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff152d-c85b-49fe-ba5a-db69ca0a1f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:51.287322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff152d-c85b-49fe-ba5a-db69ca0a1f16 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:51.363417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b192b0-880e-4b48-9118-f5f50b5cd99a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:51.377310 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2726/5469] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:51 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:51.379855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b192b0-880e-4b48-9118-f5f50b5cd99a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:51.503103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73460938-9a5e-4ab2-a3bc-41eac08f82d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:51.503740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73460938-9a5e-4ab2-a3bc-41eac08f82d9 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:51.504574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73460938-9a5e-4ab2-a3bc-41eac08f82d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:51.504832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73460938-9a5e-4ab2-a3bc-41eac08f82d9 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:51.505704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73460938-9a5e-4ab2-a3bc-41eac08f82d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:51.508264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73460938-9a5e-4ab2-a3bc-41eac08f82d9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:51.540112 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2744/5470] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:51 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:51.541549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff152d-c85b-49fe-ba5a-db69ca0a1f16 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:51.565036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff152d-c85b-49fe-ba5a-db69ca0a1f16 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:51.577330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ba6a8-0ce7-460d-bf7c-ff480a8f95ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:51.578162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ba6a8-0ce7-460d-bf7c-ff480a8f95ed admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:51.581496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ba6a8-0ce7-460d-bf7c-ff480a8f95ed admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:51.581901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ba6a8-0ce7-460d-bf7c-ff480a8f95ed admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:51.582830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ba6a8-0ce7-460d-bf7c-ff480a8f95ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:51.584754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ba6a8-0ce7-460d-bf7c-ff480a8f95ed admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:51.613081 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2727/5471] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:51.617591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73460938-9a5e-4ab2-a3bc-41eac08f82d9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:51.638886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73460938-9a5e-4ab2-a3bc-41eac08f82d9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:51.648993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011713b7-697d-4d37-9779-d414a66ea169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:51.649927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011713b7-697d-4d37-9779-d414a66ea169 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:51.650386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011713b7-697d-4d37-9779-d414a66ea169 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:51.650821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011713b7-697d-4d37-9779-d414a66ea169 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:51.652298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011713b7-697d-4d37-9779-d414a66ea169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:51.654402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011713b7-697d-4d37-9779-d414a66ea169 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:51.694329 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2745/5472] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:51.700021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ba6a8-0ce7-460d-bf7c-ff480a8f95ed admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:51.724626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ba6a8-0ce7-460d-bf7c-ff480a8f95ed admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:51.730491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0604ca-2314-4dc1-a407-109849fb9df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:51.731168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0604ca-2314-4dc1-a407-109849fb9df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:51.731452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0604ca-2314-4dc1-a407-109849fb9df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:51.731730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0604ca-2314-4dc1-a407-109849fb9df6 admin admin] PATH_INFO: `/v3/projects/3b59e98c081f4f04a1589910813079f9/users/f8a400a004b849798b5b87853f6f5327/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:51.768222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0604ca-2314-4dc1-a407-109849fb9df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b59e98c081f4f04a1589910813079f9, user_id=f8a400a004b849798b5b87853f6f5327, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:51.771788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0604ca-2314-4dc1-a407-109849fb9df6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:51.805783 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2728/5473] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:51 2022] PUT /identity/v3/projects/3b59e98c081f4f04a1589910813079f9/users/f8a400a004b849798b5b87853f6f5327/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:51.817100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4340ae-7c06-4e24-ae76-11b39098bed3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:51.817429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4340ae-7c06-4e24-ae76-11b39098bed3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:51.817691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4340ae-7c06-4e24-ae76-11b39098bed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:51.865389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3e4340ae-7c06-4e24-ae76-11b39098bed3 None None] MFA Rules not processed for user `f8a400a004b849798b5b87853f6f5327`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:51.866765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3e4340ae-7c06-4e24-ae76-11b39098bed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:51.914254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:52.031668 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2746/5474] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:52.045128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0604ca-2314-4dc1-a407-109849fb9df6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:52.048386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6d0604ca-2314-4dc1-a407-109849fb9df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:52.135066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:52.245727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0604ca-2314-4dc1-a407-109849fb9df6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:52.260262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c07430-c9e4-4797-acf0-9de146efab6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:52.260903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c07430-c9e4-4797-acf0-9de146efab6f service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:52.261208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c07430-c9e4-4797-acf0-9de146efab6f service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:52.261522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c07430-c9e4-4797-acf0-9de146efab6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:52.290573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c07430-c9e4-4797-acf0-9de146efab6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:52.293468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c07430-c9e4-4797-acf0-9de146efab6f service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:52.308228 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2729/5475] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:52.646112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4340ae-7c06-4e24-ae76-11b39098bed3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:52.758868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4340ae-7c06-4e24-ae76-11b39098bed3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:52.764447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:52.765108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:52.765425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:52.765856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] PATH_INFO: `/v3/users/f8a400a004b849798b5b87853f6f5327` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:52.768421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a400a004b849798b5b87853f6f5327)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:52.771935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:52.844648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a400a004b849798b5b87853f6f5327'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:52.862576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a400a004b849798b5b87853f6f5327'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:52.864506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a400a004b849798b5b87853f6f5327'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:52.866059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a400a004b849798b5b87853f6f5327'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:52.896981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a400a004b849798b5b87853f6f5327'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:52.922685 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2747/5476] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:52 2022] DELETE /identity/v3/users/f8a400a004b849798b5b87853f6f5327 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:52.927494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029f3ca-511a-4261-81e5-214257c1c3eb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:52.927769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029f3ca-511a-4261-81e5-214257c1c3eb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:52.928048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029f3ca-511a-4261-81e5-214257c1c3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:52.967339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9029f3ca-511a-4261-81e5-214257c1c3eb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:52.968642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9029f3ca-511a-4261-81e5-214257c1c3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:53.121594 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2730/5477] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:53.164152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:53.166061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:53.295521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:53.327516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa99ba-452a-4db3-96a5-0c5160eaae95 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:53.340728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa65e35-1969-42b4-87c5-0978206bc712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:53.342416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa65e35-1969-42b4-87c5-0978206bc712 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:53.343738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa65e35-1969-42b4-87c5-0978206bc712 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:53.344057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa65e35-1969-42b4-87c5-0978206bc712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:53.365549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa65e35-1969-42b4-87c5-0978206bc712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:53.368892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa65e35-1969-42b4-87c5-0978206bc712 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:53.394715 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2748/5478] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:54.198792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029f3ca-511a-4261-81e5-214257c1c3eb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:54.200718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9029f3ca-511a-4261-81e5-214257c1c3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:54.223369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029f3ca-511a-4261-81e5-214257c1c3eb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:54.236313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:54.237300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:54.237781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:54.238825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] PATH_INFO: `/v3/users/41dda970baaf419ebff776169c460192` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:54.240862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41dda970baaf419ebff776169c460192)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:54.244362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:54.394955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41dda970baaf419ebff776169c460192'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:54.406006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41dda970baaf419ebff776169c460192'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:54.409615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41dda970baaf419ebff776169c460192'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:54.410805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41dda970baaf419ebff776169c460192'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:54.440612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41dda970baaf419ebff776169c460192'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:54.463415 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2731/5479] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:12:54 2022] DELETE /identity/v3/users/41dda970baaf419ebff776169c460192 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:54.467788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85753e08-0eef-40d8-92e9-15ccb2775f0f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:54.468338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85753e08-0eef-40d8-92e9-15ccb2775f0f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:54.468715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85753e08-0eef-40d8-92e9-15ccb2775f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:54.512696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-85753e08-0eef-40d8-92e9-15ccb2775f0f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:54.514160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-85753e08-0eef-40d8-92e9-15ccb2775f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:54.662234 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2749/5480] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:54.700496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:54.702311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:54.754671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:54.827974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fb051-9eee-45c6-8ead-66d359e53985 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:54.840368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c897e2-3aef-48ae-bef7-d7158007b604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:54.841066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c897e2-3aef-48ae-bef7-d7158007b604 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:54.841460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c897e2-3aef-48ae-bef7-d7158007b604 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:54.841739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c897e2-3aef-48ae-bef7-d7158007b604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:54.869433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c897e2-3aef-48ae-bef7-d7158007b604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:54.870904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c897e2-3aef-48ae-bef7-d7158007b604 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:54.892137 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2732/5481] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:55.089141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85753e08-0eef-40d8-92e9-15ccb2775f0f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:55.090782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-85753e08-0eef-40d8-92e9-15ccb2775f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:55.104917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85753e08-0eef-40d8-92e9-15ccb2775f0f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:55.121909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60d370-a8ce-4738-800e-0a8788db5246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:55.122790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60d370-a8ce-4738-800e-0a8788db5246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:55.123201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60d370-a8ce-4738-800e-0a8788db5246 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:55.123586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60d370-a8ce-4738-800e-0a8788db5246 admin admin] PATH_INFO: `/v3/projects/3b59e98c081f4f04a1589910813079f9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:55.124977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60d370-a8ce-4738-800e-0a8788db5246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b59e98c081f4f04a1589910813079f9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:55.127167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60d370-a8ce-4738-800e-0a8788db5246 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:55.202412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a60d370-a8ce-4738-800e-0a8788db5246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b59e98c081f4f04a1589910813079f9', 'request_id': 'req-8a60d370-a8ce-4738-800e-0a8788db5246'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:55.224328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a60d370-a8ce-4738-800e-0a8788db5246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b59e98c081f4f04a1589910813079f9', 'request_id': 'req-8a60d370-a8ce-4738-800e-0a8788db5246'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:55.235371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a60d370-a8ce-4738-800e-0a8788db5246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b59e98c081f4f04a1589910813079f9', 'request_id': 'req-8a60d370-a8ce-4738-800e-0a8788db5246'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:55.252513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a60d370-a8ce-4738-800e-0a8788db5246 admin admin] The token cache is being invalidate because project 3b59e98c081f4f04a1589910813079f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:55.252902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a60d370-a8ce-4738-800e-0a8788db5246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:55.254256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a60d370-a8ce-4738-800e-0a8788db5246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:55.256495 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2750/5482] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:55 2022] DELETE /identity/v3/projects/3b59e98c081f4f04a1589910813079f9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:55.264158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af74c3-4f9e-4536-b9e7-b160840881c9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:55.264695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af74c3-4f9e-4536-b9e7-b160840881c9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:55.264695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af74c3-4f9e-4536-b9e7-b160840881c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:55.287058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-23af74c3-4f9e-4536-b9e7-b160840881c9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:55.288434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-23af74c3-4f9e-4536-b9e7-b160840881c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:55.406849 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2733/5483] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:55.415281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175df4-1a1f-47c4-bdc3-dbafafb968bd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:55.415753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175df4-1a1f-47c4-bdc3-dbafafb968bd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:55.416162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175df4-1a1f-47c4-bdc3-dbafafb968bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:55.459010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-22175df4-1a1f-47c4-bdc3-dbafafb968bd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:55.461357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-22175df4-1a1f-47c4-bdc3-dbafafb968bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:55.484442 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2751/5484] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:55.487938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af74c3-4f9e-4536-b9e7-b160840881c9 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:55.506688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af74c3-4f9e-4536-b9e7-b160840881c9 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:55.520779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf373389-f8f9-4ea5-9764-dcd2e466ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:55.521624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf373389-f8f9-4ea5-9764-dcd2e466ad50 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:55.522033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf373389-f8f9-4ea5-9764-dcd2e466ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:55.522413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf373389-f8f9-4ea5-9764-dcd2e466ad50 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:55.523294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf373389-f8f9-4ea5-9764-dcd2e466ad50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:55.523705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf373389-f8f9-4ea5-9764-dcd2e466ad50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:55.535796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf373389-f8f9-4ea5-9764-dcd2e466ad50 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:55.564659 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2734/5485] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:55.566024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22175df4-1a1f-47c4-bdc3-dbafafb968bd None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:55.587164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22175df4-1a1f-47c4-bdc3-dbafafb968bd None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:55.593329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e18df-6778-4ef6-bd58-961056faa402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:55.594223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e18df-6778-4ef6-bd58-961056faa402 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:55.594665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e18df-6778-4ef6-bd58-961056faa402 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:55.595097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e18df-6778-4ef6-bd58-961056faa402 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:55.596526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e18df-6778-4ef6-bd58-961056faa402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:55.598721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e18df-6778-4ef6-bd58-961056faa402 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:55.665584 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2752/5486] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:55 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:55.666549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf373389-f8f9-4ea5-9764-dcd2e466ad50 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:55.686501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf373389-f8f9-4ea5-9764-dcd2e466ad50 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:55.815978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287bfbb-96fc-412f-ad68-6efc8e225fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:55.817485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287bfbb-96fc-412f-ad68-6efc8e225fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:55.817876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287bfbb-96fc-412f-ad68-6efc8e225fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:55.818261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287bfbb-96fc-412f-ad68-6efc8e225fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:55.818990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287bfbb-96fc-412f-ad68-6efc8e225fb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:55.821344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287bfbb-96fc-412f-ad68-6efc8e225fb7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:55.878262 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2735/5487] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:55 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:12:55.880331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e18df-6778-4ef6-bd58-961056faa402 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:55.897415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e18df-6778-4ef6-bd58-961056faa402 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:55.912922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e707a-3eb2-4f25-bf3d-5a84dc8b804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:55.913710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e707a-3eb2-4f25-bf3d-5a84dc8b804b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:55.913710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e707a-3eb2-4f25-bf3d-5a84dc8b804b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:55.913710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e707a-3eb2-4f25-bf3d-5a84dc8b804b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:55.914229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e707a-3eb2-4f25-bf3d-5a84dc8b804b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:55.915865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e707a-3eb2-4f25-bf3d-5a84dc8b804b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:55.952634 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2753/5488] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:55.954356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287bfbb-96fc-412f-ad68-6efc8e225fb7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:55.972936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287bfbb-96fc-412f-ad68-6efc8e225fb7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:55.984683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8a84f-2dc3-4088-85e4-4303676bcb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:55.985919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8a84f-2dc3-4088-85e4-4303676bcb71 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:55.986879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8a84f-2dc3-4088-85e4-4303676bcb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:55.986879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8a84f-2dc3-4088-85e4-4303676bcb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:55.987422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8a84f-2dc3-4088-85e4-4303676bcb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:55.991199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8a84f-2dc3-4088-85e4-4303676bcb71 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:56.029414 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2736/5489] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:56.038012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e707a-3eb2-4f25-bf3d-5a84dc8b804b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:56.062992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e707a-3eb2-4f25-bf3d-5a84dc8b804b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:56.075525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db38c0-b61a-4e05-97d7-dadabd13f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:56.076213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db38c0-b61a-4e05-97d7-dadabd13f66f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:56.076491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db38c0-b61a-4e05-97d7-dadabd13f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:56.076767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db38c0-b61a-4e05-97d7-dadabd13f66f admin admin] PATH_INFO: `/v3/projects/86df4228e86c466f998e44a4ad915e6d/users/ae43e2677fe54132ae4e5fad42524fb8/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:56.108626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db38c0-b61a-4e05-97d7-dadabd13f66f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86df4228e86c466f998e44a4ad915e6d, user_id=ae43e2677fe54132ae4e5fad42524fb8, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:56.111312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db38c0-b61a-4e05-97d7-dadabd13f66f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:56.140015 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2754/5490] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:56 2022] PUT /identity/v3/projects/86df4228e86c466f998e44a4ad915e6d/users/ae43e2677fe54132ae4e5fad42524fb8/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:56.151233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8460877-3338-4da7-bb01-148d8e8eefff None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:56.151638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8460877-3338-4da7-bb01-148d8e8eefff None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:56.151813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8460877-3338-4da7-bb01-148d8e8eefff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:56.209790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c8460877-3338-4da7-bb01-148d8e8eefff None None] MFA Rules not processed for user `ae43e2677fe54132ae4e5fad42524fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:56.210936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c8460877-3338-4da7-bb01-148d8e8eefff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:56.246810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:56.371483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db38c0-b61a-4e05-97d7-dadabd13f66f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:56.373626 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2737/5491] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:56.377969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:56.552646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db38c0-b61a-4e05-97d7-dadabd13f66f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:56.559984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6e95a-befb-42fc-9c92-ec0aedcfe0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:56.561078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6e95a-befb-42fc-9c92-ec0aedcfe0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:56.562008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6e95a-befb-42fc-9c92-ec0aedcfe0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:56.562581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6e95a-befb-42fc-9c92-ec0aedcfe0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:56.563536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6e95a-befb-42fc-9c92-ec0aedcfe0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:56.568184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6e95a-befb-42fc-9c92-ec0aedcfe0f5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:56.635718 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2755/5492] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:56 2022] POST /identity/v3/projects => generated 375 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:56.638149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8460877-3338-4da7-bb01-148d8e8eefff None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:56.652519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8460877-3338-4da7-bb01-148d8e8eefff None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:56.747100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56fab4-4184-43ea-b48e-07e0fa70aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:56.748556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56fab4-4184-43ea-b48e-07e0fa70aacd admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:56.749848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56fab4-4184-43ea-b48e-07e0fa70aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:56.750363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56fab4-4184-43ea-b48e-07e0fa70aacd admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:56.751483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56fab4-4184-43ea-b48e-07e0fa70aacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:56.763007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56fab4-4184-43ea-b48e-07e0fa70aacd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:56.810574 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2738/5493] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:56 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:56.814451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6e95a-befb-42fc-9c92-ec0aedcfe0f5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:56.835962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6e95a-befb-42fc-9c92-ec0aedcfe0f5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:56.840768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee0ad1-c48d-462e-af22-c4da612303fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:56.841593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee0ad1-c48d-462e-af22-c4da612303fb admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:56.841823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee0ad1-c48d-462e-af22-c4da612303fb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:56.842098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee0ad1-c48d-462e-af22-c4da612303fb admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:56.842957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee0ad1-c48d-462e-af22-c4da612303fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:56.846517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee0ad1-c48d-462e-af22-c4da612303fb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:56.881342 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2756/5494] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:56.882357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56fab4-4184-43ea-b48e-07e0fa70aacd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:56.897509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56fab4-4184-43ea-b48e-07e0fa70aacd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:56.903254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c190646-8e01-4872-aa34-96bf0dff1789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:56.904004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c190646-8e01-4872-aa34-96bf0dff1789 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:56.905551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c190646-8e01-4872-aa34-96bf0dff1789 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:56.906106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c190646-8e01-4872-aa34-96bf0dff1789 admin admin] PATH_INFO: `/v3/projects/47cbafb4c0c14b97b862592e9360a5af/users/ce12e1c677bb48929bc4d16fe79c3be4/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:56.928849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c190646-8e01-4872-aa34-96bf0dff1789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cbafb4c0c14b97b862592e9360a5af, user_id=ce12e1c677bb48929bc4d16fe79c3be4, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:56.933643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c190646-8e01-4872-aa34-96bf0dff1789 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:56.957290 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2739/5495] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:56 2022] PUT /identity/v3/projects/47cbafb4c0c14b97b862592e9360a5af/users/ce12e1c677bb48929bc4d16fe79c3be4/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:12:56.961446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee0ad1-c48d-462e-af22-c4da612303fb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:56.976978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee0ad1-c48d-462e-af22-c4da612303fb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:57.127816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9a120-6fcd-4b04-b0a9-e892422ad777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:57.130844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9a120-6fcd-4b04-b0a9-e892422ad777 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:57.130844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9a120-6fcd-4b04-b0a9-e892422ad777 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:57.134318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9a120-6fcd-4b04-b0a9-e892422ad777 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:57.135088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9a120-6fcd-4b04-b0a9-e892422ad777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:57.136768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9a120-6fcd-4b04-b0a9-e892422ad777 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:57.169219 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2757/5496] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:12:57.173396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c190646-8e01-4872-aa34-96bf0dff1789 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:57.189445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c190646-8e01-4872-aa34-96bf0dff1789 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:57.204274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c5b9e-9faa-4de4-9117-35779fa8418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:57.205214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c5b9e-9faa-4de4-9117-35779fa8418c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:57.205659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c5b9e-9faa-4de4-9117-35779fa8418c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:57.206107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c5b9e-9faa-4de4-9117-35779fa8418c admin admin] PATH_INFO: `/v3/projects/47cbafb4c0c14b97b862592e9360a5af/users/ce12e1c677bb48929bc4d16fe79c3be4/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:57.211861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c5b9e-9faa-4de4-9117-35779fa8418c admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cbafb4c0c14b97b862592e9360a5af, user_id=ce12e1c677bb48929bc4d16fe79c3be4, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:57.220625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c5b9e-9faa-4de4-9117-35779fa8418c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:57.259890 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2740/5497] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:12:57 2022] PUT /identity/v3/projects/47cbafb4c0c14b97b862592e9360a5af/users/ce12e1c677bb48929bc4d16fe79c3be4/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:57.274986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077246e-618f-4512-b387-031fa682fd2f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:57.275555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077246e-618f-4512-b387-031fa682fd2f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:57.275982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077246e-618f-4512-b387-031fa682fd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:57.356602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f077246e-618f-4512-b387-031fa682fd2f None None] MFA Rules not processed for user `ce12e1c677bb48929bc4d16fe79c3be4`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:57.358068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f077246e-618f-4512-b387-031fa682fd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:57.577984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:57.590020 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2758/5498] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:57.593913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c5b9e-9faa-4de4-9117-35779fa8418c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:57.609530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c5b9e-9faa-4de4-9117-35779fa8418c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:57.624684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485eb9f-20a4-4569-ac06-6f47ce89e2f2 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:57.625427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485eb9f-20a4-4569-ac06-6f47ce89e2f2 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:57.625717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485eb9f-20a4-4569-ac06-6f47ce89e2f2 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:57.625996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485eb9f-20a4-4569-ac06-6f47ce89e2f2 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:57.626640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485eb9f-20a4-4569-ac06-6f47ce89e2f2 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:57.628525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485eb9f-20a4-4569-ac06-6f47ce89e2f2 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:57.697572 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2741/5499] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:57 2022] POST /identity/v3/projects => generated 351 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:57.701623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077246e-618f-4512-b387-031fa682fd2f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:57.720297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077246e-618f-4512-b387-031fa682fd2f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:57.867099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd3444-613b-45e1-9fb0-49c952fb85f5 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:57.867863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3444-613b-45e1-9fb0-49c952fb85f5 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:57.868149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3444-613b-45e1-9fb0-49c952fb85f5 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:57.868428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3444-613b-45e1-9fb0-49c952fb85f5 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:57.869170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd3444-613b-45e1-9fb0-49c952fb85f5 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:57.871216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd3444-613b-45e1-9fb0-49c952fb85f5 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:57.974768 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2759/5500] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:12:57 2022] POST /identity/v3/projects => generated 349 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:12:57.976498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485eb9f-20a4-4569-ac06-6f47ce89e2f2 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:58.011476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485eb9f-20a4-4569-ac06-6f47ce89e2f2 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:58.090816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:58.125112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e96bb-dc99-4dd9-866a-93e6f320d367 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:58.127611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e96bb-dc99-4dd9-866a-93e6f320d367 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:58.128682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e96bb-dc99-4dd9-866a-93e6f320d367 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:58.130529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e96bb-dc99-4dd9-866a-93e6f320d367 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/users/ae43e2677fe54132ae4e5fad42524fb8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:58.135073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e96bb-dc99-4dd9-866a-93e6f320d367 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:get_user(user_id=ae43e2677fe54132ae4e5fad42524fb8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:58.142989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e96bb-dc99-4dd9-866a-93e6f320d367 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:58.152342 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2742/5501] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:12:57 2022] GET /identity/v3/users/ae43e2677fe54132ae4e5fad42524fb8 => generated 288 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:58.157709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd3444-613b-45e1-9fb0-49c952fb85f5 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:58.179066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd3444-613b-45e1-9fb0-49c952fb85f5 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:58.198751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6205b-3adb-49f2-af2c-6c565a460909 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:58.200933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6205b-3adb-49f2-af2c-6c565a460909 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:58.202693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6205b-3adb-49f2-af2c-6c565a460909 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:58.203199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6205b-3adb-49f2-af2c-6c565a460909 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/credentials` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:58.205231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6205b-3adb-49f2-af2c-6c565a460909 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:58.212297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6205b-3adb-49f2-af2c-6c565a460909 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:58.271283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e96bb-dc99-4dd9-866a-93e6f320d367 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:58.274048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-858e96bb-dc99-4dd9-866a-93e6f320d367 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:58.280289 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2760/5502] 10.222.0.26 () {60 vars in 1162 bytes} [Sat Oct 8 21:12:58 2022] POST /identity/v3/credentials => generated 430 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:12:58.284361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6205b-3adb-49f2-af2c-6c565a460909 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:58.319846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6205b-3adb-49f2-af2c-6c565a460909 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:58.333091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2621d45-18b8-439a-b5f8-c8f8fe9834d6 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:58.333776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2621d45-18b8-439a-b5f8-c8f8fe9834d6 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:58.343364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2621d45-18b8-439a-b5f8-c8f8fe9834d6 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:58.343682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2621d45-18b8-439a-b5f8-c8f8fe9834d6 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/credentials/747ba94bed59984703fd286548269c95272e79422f862c05ac90be96915a0317` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:58.349379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2621d45-18b8-439a-b5f8-c8f8fe9834d6 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=747ba94bed59984703fd286548269c95272e79422f862c05ac90be96915a0317)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:58.351403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2621d45-18b8-439a-b5f8-c8f8fe9834d6 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:58.356107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2621d45-18b8-439a-b5f8-c8f8fe9834d6 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=747ba94bed59984703fd286548269c95272e79422f862c05ac90be96915a0317)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:58.362724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2621d45-18b8-439a-b5f8-c8f8fe9834d6 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:58.396402 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2761/5503] 10.222.0.26 () {60 vars in 1358 bytes} [Sat Oct 8 21:12:58 2022] PATCH /identity/v3/credentials/747ba94bed59984703fd286548269c95272e79422f862c05ac90be96915a0317 => generated 436 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:58.400371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2621d45-18b8-439a-b5f8-c8f8fe9834d6 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:58.421014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e96bb-dc99-4dd9-866a-93e6f320d367 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:58.422345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2621d45-18b8-439a-b5f8-c8f8fe9834d6 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:58.427588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:58.428774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:58.429281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:58.429743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] PATH_INFO: `/v3/projects/7035a333da7e4ca4abfd41beab0a29a8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:58.431152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7035a333da7e4ca4abfd41beab0a29a8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:58.431978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9267bb-02a4-4d15-8322-f4fe2fe241b9 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:58.432642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9267bb-02a4-4d15-8322-f4fe2fe241b9 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:58.432928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9267bb-02a4-4d15-8322-f4fe2fe241b9 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:58.433225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9267bb-02a4-4d15-8322-f4fe2fe241b9 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/credentials/747ba94bed59984703fd286548269c95272e79422f862c05ac90be96915a0317` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:58.434321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:58.438112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9267bb-02a4-4d15-8322-f4fe2fe241b9 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=747ba94bed59984703fd286548269c95272e79422f862c05ac90be96915a0317)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:58.439890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9267bb-02a4-4d15-8322-f4fe2fe241b9 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:58.448409 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2762/5504] 10.222.0.26 () {58 vars in 1335 bytes} [Sat Oct 8 21:12:58 2022] GET /identity/v3/credentials/747ba94bed59984703fd286548269c95272e79422f862c05ac90be96915a0317 => generated 436 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:12:58.449404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9267bb-02a4-4d15-8322-f4fe2fe241b9 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:58.471777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9267bb-02a4-4d15-8322-f4fe2fe241b9 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:58.489273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f2ad7-bb1b-4f3f-a9a6-6e16c6da1a80 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:58.489273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f2ad7-bb1b-4f3f-a9a6-6e16c6da1a80 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:58.489669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f2ad7-bb1b-4f3f-a9a6-6e16c6da1a80 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:58.489669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f2ad7-bb1b-4f3f-a9a6-6e16c6da1a80 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/credentials/747ba94bed59984703fd286548269c95272e79422f862c05ac90be96915a0317` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:58.509006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f2ad7-bb1b-4f3f-a9a6-6e16c6da1a80 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=747ba94bed59984703fd286548269c95272e79422f862c05ac90be96915a0317)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:58.509006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f2ad7-bb1b-4f3f-a9a6-6e16c6da1a80 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:58.544684 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2763/5505] 10.222.0.26 () {58 vars in 1338 bytes} [Sat Oct 8 21:12:58 2022] DELETE /identity/v3/credentials/747ba94bed59984703fd286548269c95272e79422f862c05ac90be96915a0317 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:58.545621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f2ad7-bb1b-4f3f-a9a6-6e16c6da1a80 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:58.553701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-db2f2ad7-bb1b-4f3f-a9a6-6e16c6da1a80 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:58.583171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7035a333da7e4ca4abfd41beab0a29a8', 'request_id': 'req-a56647ec-170a-4422-829d-b79e6d981c96'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:58.609801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7035a333da7e4ca4abfd41beab0a29a8', 'request_id': 'req-a56647ec-170a-4422-829d-b79e6d981c96'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:58.630695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7035a333da7e4ca4abfd41beab0a29a8', 'request_id': 'req-a56647ec-170a-4422-829d-b79e6d981c96'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:58.658193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f2ad7-bb1b-4f3f-a9a6-6e16c6da1a80 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:58.658751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] The token cache is being invalidate because project 7035a333da7e4ca4abfd41beab0a29a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:58.659010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:58.660636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:58.666507 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2743/5506] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:58 2022] DELETE /identity/v3/projects/7035a333da7e4ca4abfd41beab0a29a8 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:58.667644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:58.673177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:58.749506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291b1a2-c56e-4076-a3f9-e1e3e775d044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:58.750145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291b1a2-c56e-4076-a3f9-e1e3e775d044 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:58.750431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291b1a2-c56e-4076-a3f9-e1e3e775d044 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:58.753556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291b1a2-c56e-4076-a3f9-e1e3e775d044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:58.758780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4291b1a2-c56e-4076-a3f9-e1e3e775d044 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:58.788576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:58.858539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56647ec-170a-4422-829d-b79e6d981c96 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:58.869280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae18079-c537-4a55-9281-6a2e6401dde4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:58.869830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae18079-c537-4a55-9281-6a2e6401dde4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:58.870108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae18079-c537-4a55-9281-6a2e6401dde4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:58.870387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae18079-c537-4a55-9281-6a2e6401dde4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/credentials` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:58.871037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae18079-c537-4a55-9281-6a2e6401dde4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:58.874385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae18079-c537-4a55-9281-6a2e6401dde4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:58.943645 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2744/5507] 10.222.0.26 () {60 vars in 1162 bytes} [Sat Oct 8 21:12:58 2022] POST /identity/v3/credentials => generated 431 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:58.945328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291b1a2-c56e-4076-a3f9-e1e3e775d044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:58.946349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b5f03-afa1-4754-bca7-6ddc84ca2502 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:58.946635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b5f03-afa1-4754-bca7-6ddc84ca2502 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:58.946839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291b1a2-c56e-4076-a3f9-e1e3e775d044 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:58.946943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b5f03-afa1-4754-bca7-6ddc84ca2502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:58.971642 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2764/5508] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:12:58.972632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291b1a2-c56e-4076-a3f9-e1e3e775d044 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:59.005112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291b1a2-c56e-4076-a3f9-e1e3e775d044 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:59.018367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-242b5f03-afa1-4754-bca7-6ddc84ca2502 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:59.020316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-242b5f03-afa1-4754-bca7-6ddc84ca2502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:59.033801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a43d7-93db-4369-85a0-3bbb165fea9f tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:59.034499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a43d7-93db-4369-85a0-3bbb165fea9f tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:59.036428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a43d7-93db-4369-85a0-3bbb165fea9f tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:59.036725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a43d7-93db-4369-85a0-3bbb165fea9f tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/credentials` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:59.037512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a43d7-93db-4369-85a0-3bbb165fea9f tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:59.044030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a43d7-93db-4369-85a0-3bbb165fea9f tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:59.046910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:59.078544 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2765/5509] 10.222.0.26 () {60 vars in 1162 bytes} [Sat Oct 8 21:12:58 2022] POST /identity/v3/credentials => generated 429 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:59.081311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a43d7-93db-4369-85a0-3bbb165fea9f tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:59.114325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a43d7-93db-4369-85a0-3bbb165fea9f tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:59.135183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86615cbd-46ef-409e-82ed-71090924609d tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:59.136307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86615cbd-46ef-409e-82ed-71090924609d tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:59.136885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86615cbd-46ef-409e-82ed-71090924609d tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:59.138451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86615cbd-46ef-409e-82ed-71090924609d tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/credentials` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:59.140072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86615cbd-46ef-409e-82ed-71090924609d tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:59.145811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86615cbd-46ef-409e-82ed-71090924609d tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:59.172893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86615cbd-46ef-409e-82ed-71090924609d tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:59.178760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86615cbd-46ef-409e-82ed-71090924609d tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:59.185016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86615cbd-46ef-409e-82ed-71090924609d tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:59.194002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86615cbd-46ef-409e-82ed-71090924609d tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:59.200019 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2766/5510] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Oct 8 21:12:59 2022] GET /identity/v3/credentials => generated 945 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:59.203476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86615cbd-46ef-409e-82ed-71090924609d tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:59.240670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86615cbd-46ef-409e-82ed-71090924609d tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:59.246308 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2745/5511] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:59.249964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942a028-9805-4c3e-a5a8-5505d0ceec98 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:59.250801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942a028-9805-4c3e-a5a8-5505d0ceec98 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:59.251059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942a028-9805-4c3e-a5a8-5505d0ceec98 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:59.251397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942a028-9805-4c3e-a5a8-5505d0ceec98 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/credentials/265a62b46b3630e71135f227066591a87522fea3d4f073d18860b0790156975d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:59.253481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942a028-9805-4c3e-a5a8-5505d0ceec98 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=265a62b46b3630e71135f227066591a87522fea3d4f073d18860b0790156975d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:59.255230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a9a29-910f-48a4-ad39-6e37272f7773 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:59.255516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a9a29-910f-48a4-ad39-6e37272f7773 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:59.255694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942a028-9805-4c3e-a5a8-5505d0ceec98 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:59.255818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a9a29-910f-48a4-ad39-6e37272f7773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:59.288664 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2767/5512] 10.222.0.26 () {58 vars in 1338 bytes} [Sat Oct 8 21:12:59 2022] DELETE /identity/v3/credentials/265a62b46b3630e71135f227066591a87522fea3d4f073d18860b0790156975d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:59.291257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942a028-9805-4c3e-a5a8-5505d0ceec98 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:59.304830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-001a9a29-910f-48a4-ad39-6e37272f7773 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:12:59.307555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-001a9a29-910f-48a4-ad39-6e37272f7773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:59.312437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942a028-9805-4c3e-a5a8-5505d0ceec98 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:59.330381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085e8b4-b88c-44d3-87eb-8a3be9d66df1 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:59.330381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e8b4-b88c-44d3-87eb-8a3be9d66df1 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:59.330927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e8b4-b88c-44d3-87eb-8a3be9d66df1 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:59.333160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e8b4-b88c-44d3-87eb-8a3be9d66df1 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/credentials/ddf6b3bd6ae9eeefa5f32f3c9b6a6e6deb9b24aa4aa19530eacb1f36330e6363` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:59.333673 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2746/5513] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:12:59.338694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a9a29-910f-48a4-ad39-6e37272f7773 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:59.340658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085e8b4-b88c-44d3-87eb-8a3be9d66df1 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=ddf6b3bd6ae9eeefa5f32f3c9b6a6e6deb9b24aa4aa19530eacb1f36330e6363)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:59.343625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085e8b4-b88c-44d3-87eb-8a3be9d66df1 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:59.360398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a9a29-910f-48a4-ad39-6e37272f7773 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:59.381262 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2768/5514] 10.222.0.26 () {58 vars in 1338 bytes} [Sat Oct 8 21:12:59 2022] DELETE /identity/v3/credentials/ddf6b3bd6ae9eeefa5f32f3c9b6a6e6deb9b24aa4aa19530eacb1f36330e6363 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:12:59.383883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f184e6-c052-45c5-a90c-ef6a80265a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:59.385643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f184e6-c052-45c5-a90c-ef6a80265a15 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:59.385643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f184e6-c052-45c5-a90c-ef6a80265a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:59.385886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f184e6-c052-45c5-a90c-ef6a80265a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:59.386032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085e8b4-b88c-44d3-87eb-8a3be9d66df1 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:59.386351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f184e6-c052-45c5-a90c-ef6a80265a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:12:59.386655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f184e6-c052-45c5-a90c-ef6a80265a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:59.388278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f184e6-c052-45c5-a90c-ef6a80265a15 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:59.402684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085e8b4-b88c-44d3-87eb-8a3be9d66df1 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:59.409637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:59.410870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:59.411344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:59.411769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/projects/cdcd408434e84019b1e533549ac2cfc9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:59.413456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cdcd408434e84019b1e533549ac2cfc9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:59.415857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:59.431165 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2747/5515] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:12:59.444224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f184e6-c052-45c5-a90c-ef6a80265a15 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:59.470735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f184e6-c052-45c5-a90c-ef6a80265a15 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:59.507656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e53a00-8442-40b6-84d2-9e69a1a0b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:59.508208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e53a00-8442-40b6-84d2-9e69a1a0b3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:59.508518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e53a00-8442-40b6-84d2-9e69a1a0b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:59.508788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e53a00-8442-40b6-84d2-9e69a1a0b3d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:59.509485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e53a00-8442-40b6-84d2-9e69a1a0b3d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:59.511489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e53a00-8442-40b6-84d2-9e69a1a0b3d8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:59.521981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdcd408434e84019b1e533549ac2cfc9', 'request_id': 'req-d498b0a3-bb0d-4c32-be59-69649d8017b4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:59.538379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdcd408434e84019b1e533549ac2cfc9', 'request_id': 'req-d498b0a3-bb0d-4c32-be59-69649d8017b4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:59.548883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdcd408434e84019b1e533549ac2cfc9', 'request_id': 'req-d498b0a3-bb0d-4c32-be59-69649d8017b4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:59.587497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] The token cache is being invalidate because project cdcd408434e84019b1e533549ac2cfc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:12:59.587939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:59.590642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:12:59.596822 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2769/5516] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:59 2022] DELETE /identity/v3/projects/cdcd408434e84019b1e533549ac2cfc9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:12:59.602920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:59.604562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:59.626356 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2748/5517] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:12:59 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:59.627913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e53a00-8442-40b6-84d2-9e69a1a0b3d8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:59.637265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-04e53a00-8442-40b6-84d2-9e69a1a0b3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:12:59.665052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:59.712114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498b0a3-bb0d-4c32-be59-69649d8017b4 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:59.822387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e53a00-8442-40b6-84d2-9e69a1a0b3d8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:59.837267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aad34-9924-4182-bed9-615f4832f186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:59.837898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aad34-9924-4182-bed9-615f4832f186 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:59.838238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aad34-9924-4182-bed9-615f4832f186 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:59.838435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aad34-9924-4182-bed9-615f4832f186 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:59.839067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25aad34-9924-4182-bed9-615f4832f186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:59.840999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25aad34-9924-4182-bed9-615f4832f186 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:59.884040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce12e1c677bb48929bc4d16fe79c3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47cbafb4c0c14b97b862592e9360a5af', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:12:59.885854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:12:59.886214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:12:59.886620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] PATH_INFO: `/v3/projects/ac19ac930d694d5d9029bbbaaf467c4d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:12:59.888942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ac19ac930d694d5d9029bbbaaf467c4d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:12:59.891469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:12:59.928755 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2749/5518] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:12:59 2022] POST /identity/v3/users => generated 291 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:12:59.930674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aad34-9924-4182-bed9-615f4832f186 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:12:59.964632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aad34-9924-4182-bed9-615f4832f186 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:12:59.998514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac19ac930d694d5d9029bbbaaf467c4d', 'request_id': 'req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:00.011658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac19ac930d694d5d9029bbbaaf467c4d', 'request_id': 'req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:00.022794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac19ac930d694d5d9029bbbaaf467c4d', 'request_id': 'req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:00.080684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] The token cache is being invalidate because project ac19ac930d694d5d9029bbbaaf467c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:00.080990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:00.083621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:00.086281 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2770/5519] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:12:59 2022] DELETE /identity/v3/projects/ac19ac930d694d5d9029bbbaaf467c4d => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:00.092309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:00.095671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:00.126821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23023a-c299-49ab-ac9d-9af121d7e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:00.127450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23023a-c299-49ab-ac9d-9af121d7e3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:00.127728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23023a-c299-49ab-ac9d-9af121d7e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:00.127997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23023a-c299-49ab-ac9d-9af121d7e3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:00.128682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23023a-c299-49ab-ac9d-9af121d7e3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:00.137957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23023a-c299-49ab-ac9d-9af121d7e3e6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:00.151502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:00.168637 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2750/5520] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:00.169628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23023a-c299-49ab-ac9d-9af121d7e3e6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:00.177826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7d23023a-c299-49ab-ac9d-9af121d7e3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:00.215437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23023a-c299-49ab-ac9d-9af121d7e3e6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:00.242219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505f20b-a548-4635-ba52-d3f879e5832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:00.243031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505f20b-a548-4635-ba52-d3f879e5832a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:00.243465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505f20b-a548-4635-ba52-d3f879e5832a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:00.243926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505f20b-a548-4635-ba52-d3f879e5832a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:00.244730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505f20b-a548-4635-ba52-d3f879e5832a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:00.246563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505f20b-a548-4635-ba52-d3f879e5832a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:00.262610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47fa1a-ae4c-4630-bd14-c4fa8cff8955 tempest-CredentialsTestJSON-1863057194 tempest-CredentialsTestJSON-1863057194-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:00.272574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6c090-342f-4662-abaf-b4007739cf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:00.273796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6c090-342f-4662-abaf-b4007739cf21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:00.274091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6c090-342f-4662-abaf-b4007739cf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:00.274379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6c090-342f-4662-abaf-b4007739cf21 admin admin] PATH_INFO: `/v3/users/ae43e2677fe54132ae4e5fad42524fb8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:00.275898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6c090-342f-4662-abaf-b4007739cf21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae43e2677fe54132ae4e5fad42524fb8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:00.277895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6c090-342f-4662-abaf-b4007739cf21 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:00.288559 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2751/5521] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:00.294751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505f20b-a548-4635-ba52-d3f879e5832a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:00.321566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:00.335164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505f20b-a548-4635-ba52-d3f879e5832a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:00.343568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31642820-8014-4ed4-855e-b8542f52e925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:00.344321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31642820-8014-4ed4-855e-b8542f52e925 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:00.344696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31642820-8014-4ed4-855e-b8542f52e925 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:00.344976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31642820-8014-4ed4-855e-b8542f52e925 admin admin] PATH_INFO: `/v3/projects/eff1fd49d8e84409b42969874d575d0a/users/95b38c37ad5943ca994292f7dd80af21/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:00.368855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31642820-8014-4ed4-855e-b8542f52e925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff1fd49d8e84409b42969874d575d0a, user_id=95b38c37ad5943ca994292f7dd80af21, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:00.372314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31642820-8014-4ed4-855e-b8542f52e925 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:00.384298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cdb6c090-342f-4662-abaf-b4007739cf21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae43e2677fe54132ae4e5fad42524fb8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:00.391617 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2752/5522] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:00 2022] PUT /identity/v3/projects/eff1fd49d8e84409b42969874d575d0a/users/95b38c37ad5943ca994292f7dd80af21/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:00.402928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cd814-c466-46c7-b415-9316612dcd5c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:00.403208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cd814-c466-46c7-b415-9316612dcd5c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:00.403481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cd814-c466-46c7-b415-9316612dcd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:00.408675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cdb6c090-342f-4662-abaf-b4007739cf21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae43e2677fe54132ae4e5fad42524fb8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:00.409823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cdb6c090-342f-4662-abaf-b4007739cf21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae43e2677fe54132ae4e5fad42524fb8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:00.411378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cdb6c090-342f-4662-abaf-b4007739cf21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae43e2677fe54132ae4e5fad42524fb8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:00.441940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b98cd814-c466-46c7-b415-9316612dcd5c None None] MFA Rules not processed for user `95b38c37ad5943ca994292f7dd80af21`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:00.442816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b98cd814-c466-46c7-b415-9316612dcd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:00.452621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cdb6c090-342f-4662-abaf-b4007739cf21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae43e2677fe54132ae4e5fad42524fb8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:00.501061 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2771/5523] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:00 2022] DELETE /identity/v3/users/ae43e2677fe54132ae4e5fad42524fb8 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:00.502960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117989bd-f5da-47a9-a9e6-96811549708e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:00.503703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117989bd-f5da-47a9-a9e6-96811549708e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:00.503703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117989bd-f5da-47a9-a9e6-96811549708e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:00.562504 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2753/5524] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:13:00.563664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cd814-c466-46c7-b415-9316612dcd5c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:00.565341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b98cd814-c466-46c7-b415-9316612dcd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:00.566783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-117989bd-f5da-47a9-a9e6-96811549708e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:00.568252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-117989bd-f5da-47a9-a9e6-96811549708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:00.690730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cd814-c466-46c7-b415-9316612dcd5c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:00.710244 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2772/5525] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:00.720256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117989bd-f5da-47a9-a9e6-96811549708e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:00.838708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d45d53-3958-47c7-8efd-197851379d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:00.841588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d45d53-3958-47c7-8efd-197851379d76 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:00.845179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d45d53-3958-47c7-8efd-197851379d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:00.845605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d45d53-3958-47c7-8efd-197851379d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:00.927444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117989bd-f5da-47a9-a9e6-96811549708e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:00.929238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:00.937991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cc86c-2975-4c2f-b9a7-a7b0cd86d1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:00.938625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cc86c-2975-4c2f-b9a7-a7b0cd86d1cb service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:00.938904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cc86c-2975-4c2f-b9a7-a7b0cd86d1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:00.939181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cc86c-2975-4c2f-b9a7-a7b0cd86d1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:00.971222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cc86c-2975-4c2f-b9a7-a7b0cd86d1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:00.973235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cc86c-2975-4c2f-b9a7-a7b0cd86d1cb service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:01.022793 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2773/5526] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:01.026101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d45d53-3958-47c7-8efd-197851379d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:01.029970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d45d53-3958-47c7-8efd-197851379d76 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:01.060658 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2754/5527] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:03.297205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799156f-0dd0-4c00-b39c-23f4ec5fe460 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:03.297782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799156f-0dd0-4c00-b39c-23f4ec5fe460 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:03.298100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799156f-0dd0-4c00-b39c-23f4ec5fe460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:03.342994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0799156f-0dd0-4c00-b39c-23f4ec5fe460 None None] MFA Rules not processed for user `345fc5b62ae34cdc8323d5afb75a8a34`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:03.344506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0799156f-0dd0-4c00-b39c-23f4ec5fe460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:03.383006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:03.444351 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2774/5528] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:03.451373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d45d53-3958-47c7-8efd-197851379d76 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:03.453563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-02d45d53-3958-47c7-8efd-197851379d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:03.558080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d45d53-3958-47c7-8efd-197851379d76 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:03.565499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0ff67-512e-49e8-aced-84dd53b89ec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:03.566922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0ff67-512e-49e8-aced-84dd53b89ec8 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:03.567274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0ff67-512e-49e8-aced-84dd53b89ec8 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:03.567792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0ff67-512e-49e8-aced-84dd53b89ec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:03.582052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0ff67-512e-49e8-aced-84dd53b89ec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:03.583789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0ff67-512e-49e8-aced-84dd53b89ec8 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:03.595151 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2755/5529] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:03 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:03.957608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799156f-0dd0-4c00-b39c-23f4ec5fe460 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:03.960208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0799156f-0dd0-4c00-b39c-23f4ec5fe460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:03.990149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799156f-0dd0-4c00-b39c-23f4ec5fe460 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:04.008283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:04.009402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:04.010979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:04.011414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2 admin admin] PATH_INFO: `/v3/projects/86df4228e86c466f998e44a4ad915e6d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:04.017678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86df4228e86c466f998e44a4ad915e6d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:04.020031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:04.183448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86df4228e86c466f998e44a4ad915e6d', 'request_id': 'req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:04.213911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86df4228e86c466f998e44a4ad915e6d', 'request_id': 'req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:04.229347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86df4228e86c466f998e44a4ad915e6d', 'request_id': 'req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:04.266845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2 admin admin] The token cache is being invalidate because project 86df4228e86c466f998e44a4ad915e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:04.266845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:04.268347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bd7f6dee-24d4-43f5-8789-f92e0758bdf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:04.276644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0ff67-512e-49e8-aced-84dd53b89ec8 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:04.276915 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2775/5530] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:03 2022] DELETE /identity/v3/projects/86df4228e86c466f998e44a4ad915e6d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:04.295243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0ff67-512e-49e8-aced-84dd53b89ec8 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:04.431055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f2633-6c71-4fcb-a0b7-3555e1e22317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:04.431802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f2633-6c71-4fcb-a0b7-3555e1e22317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:04.432160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f2633-6c71-4fcb-a0b7-3555e1e22317 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:04.432509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f2633-6c71-4fcb-a0b7-3555e1e22317 admin admin] PATH_INFO: `/v3/users/ce12e1c677bb48929bc4d16fe79c3be4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:04.433997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f2633-6c71-4fcb-a0b7-3555e1e22317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce12e1c677bb48929bc4d16fe79c3be4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:04.436010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f2633-6c71-4fcb-a0b7-3555e1e22317 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:04.516894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e47f2633-6c71-4fcb-a0b7-3555e1e22317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce12e1c677bb48929bc4d16fe79c3be4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:04.522967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:04.526407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e47f2633-6c71-4fcb-a0b7-3555e1e22317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce12e1c677bb48929bc4d16fe79c3be4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:04.527228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e47f2633-6c71-4fcb-a0b7-3555e1e22317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce12e1c677bb48929bc4d16fe79c3be4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:04.528167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e47f2633-6c71-4fcb-a0b7-3555e1e22317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce12e1c677bb48929bc4d16fe79c3be4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:04.551309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e47f2633-6c71-4fcb-a0b7-3555e1e22317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce12e1c677bb48929bc4d16fe79c3be4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:04.589750 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2756/5531] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:04 2022] DELETE /identity/v3/users/ce12e1c677bb48929bc4d16fe79c3be4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:13:05.088652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cc89a-9c3d-4668-8e55-474aec413a28 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:05.089158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cc89a-9c3d-4668-8e55-474aec413a28 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:05.089353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cc89a-9c3d-4668-8e55-474aec413a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:05.199756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-472cc89a-9c3d-4668-8e55-474aec413a28 None None] MFA Rules not processed for user `de71b64a2e1c4b6aaa15b5ee75003add`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:05.201011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-472cc89a-9c3d-4668-8e55-474aec413a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:05.441703 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2776/5532] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:05.453256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13058c45-c2e1-4d15-a14b-afff237f5057 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:05.453552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13058c45-c2e1-4d15-a14b-afff237f5057 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:05.453835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13058c45-c2e1-4d15-a14b-afff237f5057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:05.497929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-13058c45-c2e1-4d15-a14b-afff237f5057 None None] MFA Rules not processed for user `de71b64a2e1c4b6aaa15b5ee75003add`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:05.499171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-13058c45-c2e1-4d15-a14b-afff237f5057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:05.514399 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2757/5533] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:13:05.541782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cc89a-9c3d-4668-8e55-474aec413a28 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:05.543591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-472cc89a-9c3d-4668-8e55-474aec413a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:05.638323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:05.655100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820a4c-914d-4cab-9b2f-53b821d5fcec None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:05.656036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820a4c-914d-4cab-9b2f-53b821d5fcec None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:05.656818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820a4c-914d-4cab-9b2f-53b821d5fcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:05.733549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3f820a4c-914d-4cab-9b2f-53b821d5fcec None None] MFA Rules not processed for user `0a6b3f4cefa94e269186f9d9e5aff559`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:05.735203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3f820a4c-914d-4cab-9b2f-53b821d5fcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:05.753126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cc89a-9c3d-4668-8e55-474aec413a28 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:05.784470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a705a29-a601-4112-81bf-b3d72fa59463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:05.786441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a705a29-a601-4112-81bf-b3d72fa59463 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:05.786743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a705a29-a601-4112-81bf-b3d72fa59463 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:05.786999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a705a29-a601-4112-81bf-b3d72fa59463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:05.812295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a705a29-a601-4112-81bf-b3d72fa59463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:05.814979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a705a29-a601-4112-81bf-b3d72fa59463 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:05.848865 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2777/5534] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:13:05.957020 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2758/5535] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:05.958572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a705a29-a601-4112-81bf-b3d72fa59463 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:05.964765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2a705a29-a601-4112-81bf-b3d72fa59463 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:06.174312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a705a29-a601-4112-81bf-b3d72fa59463 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:06.200768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f82226-e28a-4ec9-85eb-89a42fc16a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:06.201841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f82226-e28a-4ec9-85eb-89a42fc16a59 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:06.201841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f82226-e28a-4ec9-85eb-89a42fc16a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:06.201841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f82226-e28a-4ec9-85eb-89a42fc16a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:06.202500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f82226-e28a-4ec9-85eb-89a42fc16a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:06.205510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f82226-e28a-4ec9-85eb-89a42fc16a59 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:06.270960 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2778/5536] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:05 2022] POST /identity/v3/projects => generated 405 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:06.274427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f820a4c-914d-4cab-9b2f-53b821d5fcec None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:06.300277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f820a4c-914d-4cab-9b2f-53b821d5fcec None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:06.463127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23656141-97e5-4952-abe0-a758975aa16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:06.464277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23656141-97e5-4952-abe0-a758975aa16d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:06.464556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23656141-97e5-4952-abe0-a758975aa16d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:06.464830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23656141-97e5-4952-abe0-a758975aa16d admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:06.465622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23656141-97e5-4952-abe0-a758975aa16d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:06.474414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23656141-97e5-4952-abe0-a758975aa16d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:06.537526 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2759/5537] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:06 2022] POST /identity/v3/users => generated 303 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:06.541728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f82226-e28a-4ec9-85eb-89a42fc16a59 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:06.556569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f82226-e28a-4ec9-85eb-89a42fc16a59 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:06.573641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f354a5-65ee-458d-9163-d1ec5cb42a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:06.575651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f354a5-65ee-458d-9163-d1ec5cb42a36 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:06.575939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f354a5-65ee-458d-9163-d1ec5cb42a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:06.577447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f354a5-65ee-458d-9163-d1ec5cb42a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:06.578100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f354a5-65ee-458d-9163-d1ec5cb42a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:06.585692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f354a5-65ee-458d-9163-d1ec5cb42a36 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:06.639251 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2779/5538] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:06.642862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23656141-97e5-4952-abe0-a758975aa16d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:06.665159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23656141-97e5-4952-abe0-a758975aa16d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:06.677508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089e6cd-e0e5-42eb-96fb-ed4a37a587d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:06.680033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089e6cd-e0e5-42eb-96fb-ed4a37a587d3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:06.680550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089e6cd-e0e5-42eb-96fb-ed4a37a587d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:06.682840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089e6cd-e0e5-42eb-96fb-ed4a37a587d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:06.684428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089e6cd-e0e5-42eb-96fb-ed4a37a587d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:06.686477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089e6cd-e0e5-42eb-96fb-ed4a37a587d3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:06.706933 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2760/5539] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:06.717425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f354a5-65ee-458d-9163-d1ec5cb42a36 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:06.776765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f354a5-65ee-458d-9163-d1ec5cb42a36 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:06.791503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f27f-d7a2-4a5f-8156-58b14a03d3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:06.793650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f27f-d7a2-4a5f-8156-58b14a03d3a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:06.793928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f27f-d7a2-4a5f-8156-58b14a03d3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:06.795977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f27f-d7a2-4a5f-8156-58b14a03d3a4 admin admin] PATH_INFO: `/v3/projects/0a006f4c3b3647d6989274bbdfad0049/users/6aef5df0d6004b968d4280a94e1847da/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:06.839081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68f27f-d7a2-4a5f-8156-58b14a03d3a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a006f4c3b3647d6989274bbdfad0049, user_id=6aef5df0d6004b968d4280a94e1847da, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:06.847966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68f27f-d7a2-4a5f-8156-58b14a03d3a4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:06.878545 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2780/5540] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:06 2022] PUT /identity/v3/projects/0a006f4c3b3647d6989274bbdfad0049/users/6aef5df0d6004b968d4280a94e1847da/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:07.167061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089e6cd-e0e5-42eb-96fb-ed4a37a587d3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:07.168859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b089e6cd-e0e5-42eb-96fb-ed4a37a587d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:07.207720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089e6cd-e0e5-42eb-96fb-ed4a37a587d3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:07.315602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:07.414330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:07.415128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:07.415591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:07.415884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2 admin admin] PATH_INFO: `/v3/projects/47cbafb4c0c14b97b862592e9360a5af` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:07.417749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47cbafb4c0c14b97b862592e9360a5af)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:07.421878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:07.524301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47cbafb4c0c14b97b862592e9360a5af', 'request_id': 'req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:07.535894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47cbafb4c0c14b97b862592e9360a5af', 'request_id': 'req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:07.545830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47cbafb4c0c14b97b862592e9360a5af', 'request_id': 'req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:07.561015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2 admin admin] The token cache is being invalidate because project 47cbafb4c0c14b97b862592e9360a5af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:07.561455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:07.562758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56b26ab9-55a8-4509-a4cc-2deafadd1cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:07.568674 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2761/5541] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:07 2022] DELETE /identity/v3/projects/47cbafb4c0c14b97b862592e9360a5af => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:07.570639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6150e-2886-4f39-bf16-e1032c1dc0f4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:07.572110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6150e-2886-4f39-bf16-e1032c1dc0f4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:07.572110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6150e-2886-4f39-bf16-e1032c1dc0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:07.619459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bba6150e-2886-4f39-bf16-e1032c1dc0f4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:07.620730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bba6150e-2886-4f39-bf16-e1032c1dc0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:07.781326 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2781/5542] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:07.786831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08468e-439a-4b64-84de-f1e8b421452d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:07.787341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08468e-439a-4b64-84de-f1e8b421452d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:07.787889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08468e-439a-4b64-84de-f1e8b421452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:07.838900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ff08468e-439a-4b64-84de-f1e8b421452d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:07.841174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ff08468e-439a-4b64-84de-f1e8b421452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:07.862590 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2762/5543] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:07.867182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6150e-2886-4f39-bf16-e1032c1dc0f4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:07.877455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6150e-2886-4f39-bf16-e1032c1dc0f4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:07.892001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d11bcb-1b14-4a30-8ed5-ffef30df0f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:07.892888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11bcb-1b14-4a30-8ed5-ffef30df0f5d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:07.893370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11bcb-1b14-4a30-8ed5-ffef30df0f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:07.893818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11bcb-1b14-4a30-8ed5-ffef30df0f5d admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:07.897128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d11bcb-1b14-4a30-8ed5-ffef30df0f5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:13:07.897698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d11bcb-1b14-4a30-8ed5-ffef30df0f5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:07.899511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d11bcb-1b14-4a30-8ed5-ffef30df0f5d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:07.961118 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2782/5544] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:07.966075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08468e-439a-4b64-84de-f1e8b421452d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:07.978095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08468e-439a-4b64-84de-f1e8b421452d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:07.995424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943a81e-8c44-4e27-bd35-b770fd32e54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:08.001463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943a81e-8c44-4e27-bd35-b770fd32e54d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:08.001804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943a81e-8c44-4e27-bd35-b770fd32e54d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:08.002089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943a81e-8c44-4e27-bd35-b770fd32e54d admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:08.005243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943a81e-8c44-4e27-bd35-b770fd32e54d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:08.008388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943a81e-8c44-4e27-bd35-b770fd32e54d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:08.086152 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2763/5545] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:07 2022] POST /identity/v3/projects => generated 389 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:13:08.087630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d11bcb-1b14-4a30-8ed5-ffef30df0f5d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:08.094511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:08.107984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d11bcb-1b14-4a30-8ed5-ffef30df0f5d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:08.289515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696937c-ef0c-40c1-90d7-aedd5a88920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:08.290170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696937c-ef0c-40c1-90d7-aedd5a88920b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:08.290474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696937c-ef0c-40c1-90d7-aedd5a88920b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:08.290771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696937c-ef0c-40c1-90d7-aedd5a88920b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:08.291426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696937c-ef0c-40c1-90d7-aedd5a88920b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:08.293462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696937c-ef0c-40c1-90d7-aedd5a88920b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:08.325993 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2783/5546] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:08 2022] POST /identity/v3/users => generated 295 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:08.327496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943a81e-8c44-4e27-bd35-b770fd32e54d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:08.342688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943a81e-8c44-4e27-bd35-b770fd32e54d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:08.355133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f3806-a6b8-4de6-8fa5-36e527a6bd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:08.355731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f3806-a6b8-4de6-8fa5-36e527a6bd7b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:08.356285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f3806-a6b8-4de6-8fa5-36e527a6bd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:08.356580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f3806-a6b8-4de6-8fa5-36e527a6bd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:08.357418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f3806-a6b8-4de6-8fa5-36e527a6bd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:08.360766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f3806-a6b8-4de6-8fa5-36e527a6bd7b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:08.386785 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2764/5547] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:08.388750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696937c-ef0c-40c1-90d7-aedd5a88920b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:08.404836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696937c-ef0c-40c1-90d7-aedd5a88920b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:08.447580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03019f7-3b00-4792-b06d-2fb175c73352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:08.448611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03019f7-3b00-4792-b06d-2fb175c73352 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:08.449383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03019f7-3b00-4792-b06d-2fb175c73352 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:08.449913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03019f7-3b00-4792-b06d-2fb175c73352 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:08.450790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03019f7-3b00-4792-b06d-2fb175c73352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:08.452754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03019f7-3b00-4792-b06d-2fb175c73352 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:08.486428 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2784/5548] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:08.491572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f3806-a6b8-4de6-8fa5-36e527a6bd7b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:08.506993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f3806-a6b8-4de6-8fa5-36e527a6bd7b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:08.532903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2769d4b-3017-477d-9d2f-6de0ed1399b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:08.533901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2769d4b-3017-477d-9d2f-6de0ed1399b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:08.534331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2769d4b-3017-477d-9d2f-6de0ed1399b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:08.535338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2769d4b-3017-477d-9d2f-6de0ed1399b8 admin admin] PATH_INFO: `/v3/projects/25519c1d1a2645ef9ea714c7d98d17a1/users/d35d052fd93e4b24a23a0c7c774c3c5f/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:08.573863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2769d4b-3017-477d-9d2f-6de0ed1399b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25519c1d1a2645ef9ea714c7d98d17a1, user_id=d35d052fd93e4b24a23a0c7c774c3c5f, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:08.583906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2769d4b-3017-477d-9d2f-6de0ed1399b8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:08.616590 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2765/5549] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:08 2022] PUT /identity/v3/projects/25519c1d1a2645ef9ea714c7d98d17a1/users/d35d052fd93e4b24a23a0c7c774c3c5f/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:08.618852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38e24-d3c2-4252-ac24-80bfb32ac8a8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:08.619221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38e24-d3c2-4252-ac24-80bfb32ac8a8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:08.619304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38e24-d3c2-4252-ac24-80bfb32ac8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:08.705681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f8e38e24-d3c2-4252-ac24-80bfb32ac8a8 None None] MFA Rules not processed for user `d35d052fd93e4b24a23a0c7c774c3c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:08.710460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f8e38e24-d3c2-4252-ac24-80bfb32ac8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:08.986942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2769d4b-3017-477d-9d2f-6de0ed1399b8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:09.002793 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2785/5550] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:09.238068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:09.255188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2769d4b-3017-477d-9d2f-6de0ed1399b8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:09.262842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e379ff3-06d3-4b49-a354-d5252c7697a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:09.263935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e379ff3-06d3-4b49-a354-d5252c7697a9 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:09.266174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e379ff3-06d3-4b49-a354-d5252c7697a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:09.267310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e379ff3-06d3-4b49-a354-d5252c7697a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:09.268269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e379ff3-06d3-4b49-a354-d5252c7697a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:09.271265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e379ff3-06d3-4b49-a354-d5252c7697a9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:09.344148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e38e24-d3c2-4252-ac24-80bfb32ac8a8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:09.354634 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2766/5551] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:08 2022] POST /identity/v3/projects => generated 389 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:13:09.357965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e38e24-d3c2-4252-ac24-80bfb32ac8a8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:09.554531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d730a-8dff-4342-abb2-eac33b3c9b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:09.555182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d730a-8dff-4342-abb2-eac33b3c9b21 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:09.561985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d730a-8dff-4342-abb2-eac33b3c9b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:09.562337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d730a-8dff-4342-abb2-eac33b3c9b21 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:09.563025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d730a-8dff-4342-abb2-eac33b3c9b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:09.565175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d730a-8dff-4342-abb2-eac33b3c9b21 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:09.603707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:09.619153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e379ff3-06d3-4b49-a354-d5252c7697a9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:09.629983 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2786/5552] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:09 2022] POST /identity/v3/users => generated 301 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:09.632945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e379ff3-06d3-4b49-a354-d5252c7697a9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:09.641508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90b0dc-2c60-474a-bb25-8836d3a21d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:09.643132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90b0dc-2c60-474a-bb25-8836d3a21d77 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:09.643431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90b0dc-2c60-474a-bb25-8836d3a21d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:09.644375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90b0dc-2c60-474a-bb25-8836d3a21d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:09.646605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90b0dc-2c60-474a-bb25-8836d3a21d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:09.651639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90b0dc-2c60-474a-bb25-8836d3a21d77 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:09.684442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d730a-8dff-4342-abb2-eac33b3c9b21 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:09.696361 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2767/5553] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:09.703106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d730a-8dff-4342-abb2-eac33b3c9b21 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:09.731522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8e5f5-3794-4583-b0c7-0cafbb0ca0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:09.733764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8e5f5-3794-4583-b0c7-0cafbb0ca0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:09.735615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8e5f5-3794-4583-b0c7-0cafbb0ca0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:09.737765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8e5f5-3794-4583-b0c7-0cafbb0ca0cc admin admin] PATH_INFO: `/v3/projects/b637a7c116ab474997655e434b356905/users/bd07dda69328432d80de4bbbe5faa23c/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:09.777900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8e5f5-3794-4583-b0c7-0cafbb0ca0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b637a7c116ab474997655e434b356905, user_id=bd07dda69328432d80de4bbbe5faa23c, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:09.782024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8e5f5-3794-4583-b0c7-0cafbb0ca0cc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:09.815493 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2787/5554] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:09 2022] PUT /identity/v3/projects/b637a7c116ab474997655e434b356905/users/bd07dda69328432d80de4bbbe5faa23c/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:09.820240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90b0dc-2c60-474a-bb25-8836d3a21d77 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:09.831515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90b0dc-2c60-474a-bb25-8836d3a21d77 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:10.010265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd609738-742c-4f92-82a5-6baf8ca7a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:10.012396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd609738-742c-4f92-82a5-6baf8ca7a7bd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:10.012772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd609738-742c-4f92-82a5-6baf8ca7a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:10.013056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd609738-742c-4f92-82a5-6baf8ca7a7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:10.014789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd609738-742c-4f92-82a5-6baf8ca7a7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:10.016858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd609738-742c-4f92-82a5-6baf8ca7a7bd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:10.058101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8e5f5-3794-4583-b0c7-0cafbb0ca0cc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:10.060141 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2768/5555] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:10.090201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8e5f5-3794-4583-b0c7-0cafbb0ca0cc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:10.115853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3e828-7b93-4feb-b989-eb08947ba3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:10.117870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3e828-7b93-4feb-b989-eb08947ba3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:10.134213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3e828-7b93-4feb-b989-eb08947ba3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:10.135275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3e828-7b93-4feb-b989-eb08947ba3bd admin admin] PATH_INFO: `/v3/projects/b637a7c116ab474997655e434b356905/users/bd07dda69328432d80de4bbbe5faa23c/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:10.141678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3e828-7b93-4feb-b989-eb08947ba3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b637a7c116ab474997655e434b356905, user_id=bd07dda69328432d80de4bbbe5faa23c, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:10.151902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3e828-7b93-4feb-b989-eb08947ba3bd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:10.205530 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2788/5556] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:10 2022] PUT /identity/v3/projects/b637a7c116ab474997655e434b356905/users/bd07dda69328432d80de4bbbe5faa23c/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:13:10.219196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e1d27-c0c1-4316-9772-77cbd6c38e9e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:10.219498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e1d27-c0c1-4316-9772-77cbd6c38e9e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:10.220033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e1d27-c0c1-4316-9772-77cbd6c38e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:10.312245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5c8e1d27-c0c1-4316-9772-77cbd6c38e9e None None] MFA Rules not processed for user `bd07dda69328432d80de4bbbe5faa23c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:10.315004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5c8e1d27-c0c1-4316-9772-77cbd6c38e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:10.507298 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2769/5557] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:10.507644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3e828-7b93-4feb-b989-eb08947ba3bd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:10.533515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3e828-7b93-4feb-b989-eb08947ba3bd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:10.548068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3a77a-3351-494a-b29a-3e6c6fdd7dd4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:10.548748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3a77a-3351-494a-b29a-3e6c6fdd7dd4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:10.552016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3a77a-3351-494a-b29a-3e6c6fdd7dd4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:10.552816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3a77a-3351-494a-b29a-3e6c6fdd7dd4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:10.553163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3a77a-3351-494a-b29a-3e6c6fdd7dd4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:10.561461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3a77a-3351-494a-b29a-3e6c6fdd7dd4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:10.620885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2789/5558] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:13:10 2022] POST /identity/v3/domains => generated 276 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:10.625626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e1d27-c0c1-4316-9772-77cbd6c38e9e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:10.642591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e1d27-c0c1-4316-9772-77cbd6c38e9e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:10.734023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:10.749746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3086c-d79a-4b99-8dd6-68f603593036 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:10.750727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3086c-d79a-4b99-8dd6-68f603593036 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:10.751294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3086c-d79a-4b99-8dd6-68f603593036 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:10.752389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3086c-d79a-4b99-8dd6-68f603593036 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:10.754462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3086c-d79a-4b99-8dd6-68f603593036 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=f6d5ad11d92243e28af32aefb1ef0218)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:10.778810 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-77c3086c-d79a-4b99-8dd6-68f603593036 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:13:10.778810 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:13:10.778810 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:13:10.783108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3086c-d79a-4b99-8dd6-68f603593036 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:10.913842 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2770/5559] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:13:10 2022] PUT /identity/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config => generated 138 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:10.915098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3a77a-3351-494a-b29a-3e6c6fdd7dd4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:10.938481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3a77a-3351-494a-b29a-3e6c6fdd7dd4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:10.951814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346739bb-603c-4747-bfcd-aa3dd553bd21 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:10.952816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346739bb-603c-4747-bfcd-aa3dd553bd21 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:10.964817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346739bb-603c-4747-bfcd-aa3dd553bd21 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:10.965392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346739bb-603c-4747-bfcd-aa3dd553bd21 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:10.967537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346739bb-603c-4747-bfcd-aa3dd553bd21 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f6d5ad11d92243e28af32aefb1ef0218, group=identity)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:10.968899 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-346739bb-603c-4747-bfcd-aa3dd553bd21 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:13:10.968899 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:13:10.968899 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:13:10.970150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346739bb-603c-4747-bfcd-aa3dd553bd21 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:10.985598 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2790/5560] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:13:10 2022] GET /identity/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config/identity => generated 45 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:10.990061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3086c-d79a-4b99-8dd6-68f603593036 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:11.010693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3086c-d79a-4b99-8dd6-68f603593036 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:11.024424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7c566-07e7-4131-9ec6-cd453a82dd17 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:11.025120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7c566-07e7-4131-9ec6-cd453a82dd17 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:11.025520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7c566-07e7-4131-9ec6-cd453a82dd17 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:11.025712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7c566-07e7-4131-9ec6-cd453a82dd17 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config/identity/driver` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:11.028924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7c566-07e7-4131-9ec6-cd453a82dd17 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f6d5ad11d92243e28af32aefb1ef0218, group=identity, option=driver)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:11.030253 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-fbd7c566-07e7-4131-9ec6-cd453a82dd17 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:13:11.030253 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:13:11.030253 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:13:11.032528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7c566-07e7-4131-9ec6-cd453a82dd17 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:11.079258 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2771/5561] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Oct 8 21:13:10 2022] GET /identity/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config/identity/driver => generated 31 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:11.086082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346739bb-603c-4747-bfcd-aa3dd553bd21 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:11.102455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346739bb-603c-4747-bfcd-aa3dd553bd21 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:11.113832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f8c8f-cb03-458c-987b-27eab20c439f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:11.120724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f8c8f-cb03-458c-987b-27eab20c439f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:11.121318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f8c8f-cb03-458c-987b-27eab20c439f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:11.121767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f8c8f-cb03-458c-987b-27eab20c439f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config/ldap` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:11.123447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f8c8f-cb03-458c-987b-27eab20c439f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f6d5ad11d92243e28af32aefb1ef0218, group=ldap)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:11.126685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f8c8f-cb03-458c-987b-27eab20c439f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:11.136724 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2791/5562] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:13:11 2022] GET /identity/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config/ldap => generated 106 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:11.140921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7c566-07e7-4131-9ec6-cd453a82dd17 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:11.154471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7c566-07e7-4131-9ec6-cd453a82dd17 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:11.162618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95171081-3b6b-4993-8d67-7294efa52209 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:11.163791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95171081-3b6b-4993-8d67-7294efa52209 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:11.164657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95171081-3b6b-4993-8d67-7294efa52209 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:11.165444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95171081-3b6b-4993-8d67-7294efa52209 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config/ldap/url` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:11.167564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95171081-3b6b-4993-8d67-7294efa52209 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f6d5ad11d92243e28af32aefb1ef0218, group=ldap, option=url)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:11.170676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95171081-3b6b-4993-8d67-7294efa52209 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:11.181809 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2772/5563] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:13:11 2022] GET /identity/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config/ldap/url => generated 46 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:11.185670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f8c8f-cb03-458c-987b-27eab20c439f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:11.198465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f8c8f-cb03-458c-987b-27eab20c439f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:11.204856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0d3bd-fb4a-4a80-b341-950d00942004 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:11.206152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0d3bd-fb4a-4a80-b341-950d00942004 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:11.207223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0d3bd-fb4a-4a80-b341-950d00942004 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:11.207667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0d3bd-fb4a-4a80-b341-950d00942004 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config/ldap/user_tree_dn` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:11.209115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0d3bd-fb4a-4a80-b341-950d00942004 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f6d5ad11d92243e28af32aefb1ef0218, group=ldap, option=user_tree_dn)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:11.211305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0d3bd-fb4a-4a80-b341-950d00942004 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:11.219017 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2792/5564] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:13:11 2022] GET /identity/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config/ldap/user_tree_dn => generated 63 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:11.223839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95171081-3b6b-4993-8d67-7294efa52209 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:11.238150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95171081-3b6b-4993-8d67-7294efa52209 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:11.245931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462afb4-4d1b-4acb-8153-aa16d33bd347 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:11.246933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462afb4-4d1b-4acb-8153-aa16d33bd347 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:11.248031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462afb4-4d1b-4acb-8153-aa16d33bd347 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:11.248486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462afb4-4d1b-4acb-8153-aa16d33bd347 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:11.249382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462afb4-4d1b-4acb-8153-aa16d33bd347 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f6d5ad11d92243e28af32aefb1ef0218)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:11.250575 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-f462afb4-4d1b-4acb-8153-aa16d33bd347 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:13:11.250575 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:13:11.250575 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:13:11.252950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462afb4-4d1b-4acb-8153-aa16d33bd347 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:11.265260 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2773/5565] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:13:11 2022] DELETE /identity/v3/domains/f6d5ad11d92243e28af32aefb1ef0218/config => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:11.270580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0d3bd-fb4a-4a80-b341-950d00942004 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:11.294958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0d3bd-fb4a-4a80-b341-950d00942004 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:11.302985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d01b4-ed66-4dca-8600-3630afcbaef8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:11.304074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d01b4-ed66-4dca-8600-3630afcbaef8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:11.304525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d01b4-ed66-4dca-8600-3630afcbaef8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:11.304990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d01b4-ed66-4dca-8600-3630afcbaef8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/f6d5ad11d92243e28af32aefb1ef0218` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:11.307011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d01b4-ed66-4dca-8600-3630afcbaef8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f6d5ad11d92243e28af32aefb1ef0218)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:11.310247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d01b4-ed66-4dca-8600-3630afcbaef8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:11.364599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e0d01b4-ed66-4dca-8600-3630afcbaef8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f6d5ad11d92243e28af32aefb1ef0218'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.365441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e0d01b4-ed66-4dca-8600-3630afcbaef8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f6d5ad11d92243e28af32aefb1ef0218'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.421614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e0d01b4-ed66-4dca-8600-3630afcbaef8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f6d5ad11d92243e28af32aefb1ef0218'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.423092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e0d01b4-ed66-4dca-8600-3630afcbaef8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f6d5ad11d92243e28af32aefb1ef0218'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.425723 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2793/5566] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:11 2022] PATCH /identity/v3/domains/f6d5ad11d92243e28af32aefb1ef0218 => generated 277 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:11.430108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462afb4-4d1b-4acb-8153-aa16d33bd347 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:11.432045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f462afb4-4d1b-4acb-8153-aa16d33bd347 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:11.452711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462afb4-4d1b-4acb-8153-aa16d33bd347 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:11.558109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:11.559127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:11.559577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:11.560061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/f6d5ad11d92243e28af32aefb1ef0218` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:11.589468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f6d5ad11d92243e28af32aefb1ef0218)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:11.597334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:11.665836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f6d5ad11d92243e28af32aefb1ef0218'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.711291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f6d5ad11d92243e28af32aefb1ef0218'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.823475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d5ad11d92243e28af32aefb1ef0218', 'request_id': 'req-4575b131-f546-405f-87ba-3d8cc783825b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.843947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d5ad11d92243e28af32aefb1ef0218', 'request_id': 'req-4575b131-f546-405f-87ba-3d8cc783825b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.855099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d5ad11d92243e28af32aefb1ef0218', 'request_id': 'req-4575b131-f546-405f-87ba-3d8cc783825b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.856947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:11.887989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] The token cache is being invalidate because project f6d5ad11d92243e28af32aefb1ef0218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:11.888468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.891339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.913803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f6d5ad11d92243e28af32aefb1ef0218', 'request_id': 'req-4575b131-f546-405f-87ba-3d8cc783825b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.914867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f6d5ad11d92243e28af32aefb1ef0218', 'request_id': 'req-4575b131-f546-405f-87ba-3d8cc783825b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.924250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f6d5ad11d92243e28af32aefb1ef0218', 'request_id': 'req-4575b131-f546-405f-87ba-3d8cc783825b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:11.943454 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2774/5567] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:13:11 2022] DELETE /identity/v3/domains/f6d5ad11d92243e28af32aefb1ef0218 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:11.949304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d01b4-ed66-4dca-8600-3630afcbaef8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:11.969653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d01b4-ed66-4dca-8600-3630afcbaef8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:12.122024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42642ede-5c2a-4522-88f1-3ade5ad43090 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:12.122996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42642ede-5c2a-4522-88f1-3ade5ad43090 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:12.123505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42642ede-5c2a-4522-88f1-3ade5ad43090 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:12.127172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42642ede-5c2a-4522-88f1-3ade5ad43090 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:12.128361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42642ede-5c2a-4522-88f1-3ade5ad43090 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:12.134296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42642ede-5c2a-4522-88f1-3ade5ad43090 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:12.181074 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2794/5568] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:13:11 2022] POST /identity/v3/domains => generated 277 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:12.182906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:12.185001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:12.217983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b131-f546-405f-87ba-3d8cc783825b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:12.426558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfb105-c61c-48bd-a45f-04e34aa14029 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:12.429406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfb105-c61c-48bd-a45f-04e34aa14029 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:12.430023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfb105-c61c-48bd-a45f-04e34aa14029 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:12.430545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfb105-c61c-48bd-a45f-04e34aa14029 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/7dfbfccd264345d9867d5ddc673d6b05/config` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:12.433078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfb105-c61c-48bd-a45f-04e34aa14029 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=7dfbfccd264345d9867d5ddc673d6b05)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:12.439212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfb105-c61c-48bd-a45f-04e34aa14029 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:12.532110 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2775/5569] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:13:12 2022] PUT /identity/v3/domains/7dfbfccd264345d9867d5ddc673d6b05/config => generated 138 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:12.549568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42642ede-5c2a-4522-88f1-3ade5ad43090 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:12.568192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42642ede-5c2a-4522-88f1-3ade5ad43090 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:12.576024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d489ba-9e4c-438d-92ba-61af0e5769dc tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:12.577041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d489ba-9e4c-438d-92ba-61af0e5769dc tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:12.577648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d489ba-9e4c-438d-92ba-61af0e5769dc tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:12.578160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d489ba-9e4c-438d-92ba-61af0e5769dc tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/7dfbfccd264345d9867d5ddc673d6b05/config` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:12.580508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d489ba-9e4c-438d-92ba-61af0e5769dc tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=7dfbfccd264345d9867d5ddc673d6b05)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:12.582349 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-05d489ba-9e4c-438d-92ba-61af0e5769dc tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:13:12.582349 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:13:12.582349 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:13:12.583776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d489ba-9e4c-438d-92ba-61af0e5769dc tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:12.631417 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2795/5570] 10.222.0.26 () {60 vars in 1271 bytes} [Sat Oct 8 21:13:12 2022] PATCH /identity/v3/domains/7dfbfccd264345d9867d5ddc673d6b05/config => generated 141 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:12.635985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfb105-c61c-48bd-a45f-04e34aa14029 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:12.661361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfb105-c61c-48bd-a45f-04e34aa14029 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:12.674629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d30364-3285-4085-a6cf-0b50a8dd019c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:12.676441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d30364-3285-4085-a6cf-0b50a8dd019c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:12.677587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d30364-3285-4085-a6cf-0b50a8dd019c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:12.678356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d30364-3285-4085-a6cf-0b50a8dd019c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/7dfbfccd264345d9867d5ddc673d6b05/config` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:12.681224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d30364-3285-4085-a6cf-0b50a8dd019c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=7dfbfccd264345d9867d5ddc673d6b05)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:12.684798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d30364-3285-4085-a6cf-0b50a8dd019c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:12.698610 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2776/5571] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:13:12 2022] GET /identity/v3/domains/7dfbfccd264345d9867d5ddc673d6b05/config => generated 141 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:13:12.702474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d489ba-9e4c-438d-92ba-61af0e5769dc tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:12.710938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:12.716262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d489ba-9e4c-438d-92ba-61af0e5769dc tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:12.726271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0a6da-5cb7-468d-90f1-09192d2a52bb tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:12.728324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a6da-5cb7-468d-90f1-09192d2a52bb tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:12.728992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a6da-5cb7-468d-90f1-09192d2a52bb tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:12.729513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a6da-5cb7-468d-90f1-09192d2a52bb tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/7dfbfccd264345d9867d5ddc673d6b05/config` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:12.730574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0a6da-5cb7-468d-90f1-09192d2a52bb tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=7dfbfccd264345d9867d5ddc673d6b05)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:12.732207 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-06b0a6da-5cb7-468d-90f1-09192d2a52bb tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:13:12.732207 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:13:12.732207 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:13:12.734324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0a6da-5cb7-468d-90f1-09192d2a52bb tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:12.751949 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2796/5572] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:13:12 2022] DELETE /identity/v3/domains/7dfbfccd264345d9867d5ddc673d6b05/config => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:12.752635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d30364-3285-4085-a6cf-0b50a8dd019c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:12.769981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d30364-3285-4085-a6cf-0b50a8dd019c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:12.786121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c279c-395b-41d2-b59d-97a4e10cf2a7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:12.786770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c279c-395b-41d2-b59d-97a4e10cf2a7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:12.787050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c279c-395b-41d2-b59d-97a4e10cf2a7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:12.787326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c279c-395b-41d2-b59d-97a4e10cf2a7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/7dfbfccd264345d9867d5ddc673d6b05/config` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:12.790945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c279c-395b-41d2-b59d-97a4e10cf2a7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=7dfbfccd264345d9867d5ddc673d6b05)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:12.792741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c279c-395b-41d2-b59d-97a4e10cf2a7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-300c279c-395b-41d2-b59d-97a4e10cf2a7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Could not find any options in domain configuration for domain 7dfbfccd264345d9867d5ddc673d6b05.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 7dfbfccd264345d9867d5ddc673d6b05. Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 08 21:13:12.814412 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 08 21:13:12.815586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 08 21:13:12.815586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 08 21:13:12.815586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:12.815586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:12.815586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 08 21:13:12.815586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 08 21:13:12.815586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 7dfbfccd264345d9867d5ddc673d6b05. Oct 08 21:13:12.815586 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:12.818649 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2777/5573] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:13:12 2022] GET /identity/v3/domains/7dfbfccd264345d9867d5ddc673d6b05/config => generated 151 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:13:12.821409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0a6da-5cb7-468d-90f1-09192d2a52bb tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:12.836872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0a6da-5cb7-468d-90f1-09192d2a52bb tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:12.857444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8dff3-cb5d-4054-84ab-5f5b49ebbeec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:12.858123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8dff3-cb5d-4054-84ab-5f5b49ebbeec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:12.858377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8dff3-cb5d-4054-84ab-5f5b49ebbeec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:12.858652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8dff3-cb5d-4054-84ab-5f5b49ebbeec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/7dfbfccd264345d9867d5ddc673d6b05/config` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:12.859438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8dff3-cb5d-4054-84ab-5f5b49ebbeec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=7dfbfccd264345d9867d5ddc673d6b05)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:12.861285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8dff3-cb5d-4054-84ab-5f5b49ebbeec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:12.891317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c279c-395b-41d2-b59d-97a4e10cf2a7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:12.901921 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2797/5574] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:13:12 2022] DELETE /identity/v3/domains/7dfbfccd264345d9867d5ddc673d6b05/config => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:12.909395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c279c-395b-41d2-b59d-97a4e10cf2a7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:12.931086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5f20e-e994-43b1-9854-d03a4adfb8e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:12.931907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5f20e-e994-43b1-9854-d03a4adfb8e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:12.932360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5f20e-e994-43b1-9854-d03a4adfb8e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:12.932807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5f20e-e994-43b1-9854-d03a4adfb8e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/7dfbfccd264345d9867d5ddc673d6b05` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:12.934671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5f20e-e994-43b1-9854-d03a4adfb8e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7dfbfccd264345d9867d5ddc673d6b05)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:12.936436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5f20e-e994-43b1-9854-d03a4adfb8e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:12.978522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3bf5f20e-e994-43b1-9854-d03a4adfb8e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7dfbfccd264345d9867d5ddc673d6b05'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:12.981346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3bf5f20e-e994-43b1-9854-d03a4adfb8e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7dfbfccd264345d9867d5ddc673d6b05'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:13.031172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3bf5f20e-e994-43b1-9854-d03a4adfb8e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7dfbfccd264345d9867d5ddc673d6b05'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:13.033571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3bf5f20e-e994-43b1-9854-d03a4adfb8e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7dfbfccd264345d9867d5ddc673d6b05'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:13.042529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8dff3-cb5d-4054-84ab-5f5b49ebbeec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:13.043751 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2778/5575] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:12 2022] PATCH /identity/v3/domains/7dfbfccd264345d9867d5ddc673d6b05 => generated 278 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:13.044557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-09c8dff3-cb5d-4054-84ab-5f5b49ebbeec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:13.064338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8dff3-cb5d-4054-84ab-5f5b49ebbeec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:13.272594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:13.273308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:13.273641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:13.274537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/7dfbfccd264345d9867d5ddc673d6b05` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:13.327382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7dfbfccd264345d9867d5ddc673d6b05)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:13.329254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:13.389880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7dfbfccd264345d9867d5ddc673d6b05'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:13.418477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7dfbfccd264345d9867d5ddc673d6b05'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:13.573011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dfbfccd264345d9867d5ddc673d6b05', 'request_id': 'req-bcc88f04-d1ce-4db2-878a-68d99e037732'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:13.607569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dfbfccd264345d9867d5ddc673d6b05', 'request_id': 'req-bcc88f04-d1ce-4db2-878a-68d99e037732'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:13.671545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dfbfccd264345d9867d5ddc673d6b05', 'request_id': 'req-bcc88f04-d1ce-4db2-878a-68d99e037732'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:13.712524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] The token cache is being invalidate because project 7dfbfccd264345d9867d5ddc673d6b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:13.714451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:13.718684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:13.788140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7dfbfccd264345d9867d5ddc673d6b05', 'request_id': 'req-bcc88f04-d1ce-4db2-878a-68d99e037732'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:13.798703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7dfbfccd264345d9867d5ddc673d6b05', 'request_id': 'req-bcc88f04-d1ce-4db2-878a-68d99e037732'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:13.799617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7dfbfccd264345d9867d5ddc673d6b05', 'request_id': 'req-bcc88f04-d1ce-4db2-878a-68d99e037732'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:13.810221 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2798/5576] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:13:13 2022] DELETE /identity/v3/domains/7dfbfccd264345d9867d5ddc673d6b05 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:13:13.816537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5f20e-e994-43b1-9854-d03a4adfb8e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:13.831380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5f20e-e994-43b1-9854-d03a4adfb8e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:13.963499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:13.988511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fcd27-b151-482d-854c-43a878e3bfc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:13.989256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fcd27-b151-482d-854c-43a878e3bfc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:13.989519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fcd27-b151-482d-854c-43a878e3bfc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:13.993712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fcd27-b151-482d-854c-43a878e3bfc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:13.994727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fcd27-b151-482d-854c-43a878e3bfc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:13.997242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fcd27-b151-482d-854c-43a878e3bfc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:14.038777 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2779/5577] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:13:13 2022] POST /identity/v3/domains => generated 276 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:14.043854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:14.046965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:14.072939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc88f04-d1ce-4db2-878a-68d99e037732 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:14.101815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:14.191802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67e9d5-1c54-48de-8032-857d2a819ed5 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:14.192572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67e9d5-1c54-48de-8032-857d2a819ed5 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:14.192921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67e9d5-1c54-48de-8032-857d2a819ed5 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:14.193833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67e9d5-1c54-48de-8032-857d2a819ed5 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:14.194593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67e9d5-1c54-48de-8032-857d2a819ed5 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=5a2eed0c33e84588a4b9d972363b0d4e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:14.201631 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-dc67e9d5-1c54-48de-8032-857d2a819ed5 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:13:14.201631 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:13:14.201631 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:13:14.202943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67e9d5-1c54-48de-8032-857d2a819ed5 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:14.287629 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2799/5578] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:13:14 2022] PUT /identity/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config => generated 138 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:14.292719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fcd27-b151-482d-854c-43a878e3bfc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:14.314721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fcd27-b151-482d-854c-43a878e3bfc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:14.321836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff022de6-c50f-45b4-a35e-04077fa2895e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:14.322735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff022de6-c50f-45b4-a35e-04077fa2895e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:14.323200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff022de6-c50f-45b4-a35e-04077fa2895e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:14.323664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff022de6-c50f-45b4-a35e-04077fa2895e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:14.325120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff022de6-c50f-45b4-a35e-04077fa2895e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=5a2eed0c33e84588a4b9d972363b0d4e, group=identity)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:14.326429 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-ff022de6-c50f-45b4-a35e-04077fa2895e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:13:14.326429 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:13:14.326429 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:13:14.327980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff022de6-c50f-45b4-a35e-04077fa2895e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:14.409465 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2780/5579] 10.222.0.26 () {60 vars in 1297 bytes} [Sat Oct 8 21:13:14 2022] PATCH /identity/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config/identity => generated 176 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:13:14.410550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67e9d5-1c54-48de-8032-857d2a819ed5 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:14.427858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67e9d5-1c54-48de-8032-857d2a819ed5 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:14.444205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712379e-ca12-4d5a-ba0a-8f45358bd1c8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:14.444900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712379e-ca12-4d5a-ba0a-8f45358bd1c8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:14.445201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712379e-ca12-4d5a-ba0a-8f45358bd1c8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:14.445546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712379e-ca12-4d5a-ba0a-8f45358bd1c8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config/identity/driver` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:14.446239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712379e-ca12-4d5a-ba0a-8f45358bd1c8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=5a2eed0c33e84588a4b9d972363b0d4e, group=identity, option=driver)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:14.448809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712379e-ca12-4d5a-ba0a-8f45358bd1c8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:14.490630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff022de6-c50f-45b4-a35e-04077fa2895e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:14.497600 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2800/5580] 10.222.0.26 () {60 vars in 1318 bytes} [Sat Oct 8 21:13:14 2022] PATCH /identity/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config/identity/driver => generated 176 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:13:14.506182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff022de6-c50f-45b4-a35e-04077fa2895e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:14.513508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f28e2b-da98-4101-a59f-55a3ce0f1c3f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:14.514264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f28e2b-da98-4101-a59f-55a3ce0f1c3f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:14.514739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f28e2b-da98-4101-a59f-55a3ce0f1c3f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:14.515202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f28e2b-da98-4101-a59f-55a3ce0f1c3f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config/identity/driver` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:14.515913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f28e2b-da98-4101-a59f-55a3ce0f1c3f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5a2eed0c33e84588a4b9d972363b0d4e, group=identity, option=driver)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:14.518198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f28e2b-da98-4101-a59f-55a3ce0f1c3f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:14.549109 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2781/5581] 10.222.0.26 () {58 vars in 1299 bytes} [Sat Oct 8 21:13:14 2022] DELETE /identity/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config/identity/driver => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:13:14.554411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712379e-ca12-4d5a-ba0a-8f45358bd1c8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:14.578594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712379e-ca12-4d5a-ba0a-8f45358bd1c8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:14.590997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565a796-91f7-48cc-a34c-1ec6a9c45ae0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:14.591694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565a796-91f7-48cc-a34c-1ec6a9c45ae0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:14.592439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565a796-91f7-48cc-a34c-1ec6a9c45ae0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:14.592735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565a796-91f7-48cc-a34c-1ec6a9c45ae0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config/identity/driver` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:14.595225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565a796-91f7-48cc-a34c-1ec6a9c45ae0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5a2eed0c33e84588a4b9d972363b0d4e, group=identity, option=driver)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:14.597959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565a796-91f7-48cc-a34c-1ec6a9c45ae0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:14.618968 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-5565a796-91f7-48cc-a34c-1ec6a9c45ae0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Could not find option driver in group identity in domain configuration for domain 5a2eed0c33e84588a4b9d972363b0d4e.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 5a2eed0c33e84588a4b9d972363b0d4e. Oct 08 21:13:14.618968 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:14.618968 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:14.618968 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:14.618968 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:14.618968 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:14.618968 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:14.618968 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:14.618968 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:14.618968 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:14.618968 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:14.618968 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:14.618968 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 08 21:13:14.619977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 08 21:13:14.619977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 08 21:13:14.619977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 08 21:13:14.619977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:14.619977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:14.619977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 08 21:13:14.619977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 08 21:13:14.619977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 5a2eed0c33e84588a4b9d972363b0d4e. Oct 08 21:13:14.619977 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:14.619977 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2801/5582] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Oct 8 21:13:14 2022] GET /identity/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config/identity/driver => generated 171 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:13:14.625503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f28e2b-da98-4101-a59f-55a3ce0f1c3f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:14.636678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f28e2b-da98-4101-a59f-55a3ce0f1c3f tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:14.643049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e62df1-e540-4719-b5f4-bb0e0b3c4324 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:14.643274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e62df1-e540-4719-b5f4-bb0e0b3c4324 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:14.643532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e62df1-e540-4719-b5f4-bb0e0b3c4324 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:14.643667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e62df1-e540-4719-b5f4-bb0e0b3c4324 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:14.644310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e62df1-e540-4719-b5f4-bb0e0b3c4324 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5a2eed0c33e84588a4b9d972363b0d4e, group=identity)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:14.645986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e62df1-e540-4719-b5f4-bb0e0b3c4324 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:14.667203 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2782/5583] 10.222.0.26 () {58 vars in 1278 bytes} [Sat Oct 8 21:13:14 2022] DELETE /identity/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config/identity => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:14.671338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565a796-91f7-48cc-a34c-1ec6a9c45ae0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:14.687864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565a796-91f7-48cc-a34c-1ec6a9c45ae0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:14.693066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc1eec-041d-4bdf-99c9-f70075db1ae8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:14.693766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc1eec-041d-4bdf-99c9-f70075db1ae8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:14.694048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc1eec-041d-4bdf-99c9-f70075db1ae8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:14.694322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc1eec-041d-4bdf-99c9-f70075db1ae8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:14.695483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc1eec-041d-4bdf-99c9-f70075db1ae8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5a2eed0c33e84588a4b9d972363b0d4e, group=identity)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:14.698998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc1eec-041d-4bdf-99c9-f70075db1ae8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:14.709496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-0dcc1eec-041d-4bdf-99c9-f70075db1ae8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Could not find group identity in domain configuration for domain 5a2eed0c33e84588a4b9d972363b0d4e.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 5a2eed0c33e84588a4b9d972363b0d4e. Oct 08 21:13:14.709496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:14.709496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:14.709496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:14.709496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:14.709496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:14.709496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:14.709496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:14.709496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:14.709496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:14.709496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:14.709496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:14.709496 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 08 21:13:14.710559 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 08 21:13:14.710559 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 08 21:13:14.710559 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 08 21:13:14.710559 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:14.710559 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:14.710559 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 08 21:13:14.710559 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 08 21:13:14.710559 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 5a2eed0c33e84588a4b9d972363b0d4e. Oct 08 21:13:14.710559 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:14.711413 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2802/5584] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:13:14 2022] GET /identity/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config/identity => generated 154 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:13:14.715318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e62df1-e540-4719-b5f4-bb0e0b3c4324 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:14.728286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e62df1-e540-4719-b5f4-bb0e0b3c4324 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:14.733388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c6693-0ee5-4e46-b30a-e37eca55d7a4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:14.734301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6693-0ee5-4e46-b30a-e37eca55d7a4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:14.734641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6693-0ee5-4e46-b30a-e37eca55d7a4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:14.735001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6693-0ee5-4e46-b30a-e37eca55d7a4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:14.735659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c6693-0ee5-4e46-b30a-e37eca55d7a4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5a2eed0c33e84588a4b9d972363b0d4e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:14.737391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c6693-0ee5-4e46-b30a-e37eca55d7a4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:14.755591 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2783/5585] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:13:14 2022] DELETE /identity/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e/config => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:13:14.756620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc1eec-041d-4bdf-99c9-f70075db1ae8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:14.770018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc1eec-041d-4bdf-99c9-f70075db1ae8 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:14.779648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca93f9d-d2d0-4d19-b400-1666f6769435 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:14.780205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca93f9d-d2d0-4d19-b400-1666f6769435 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:14.780490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca93f9d-d2d0-4d19-b400-1666f6769435 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:14.780764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca93f9d-d2d0-4d19-b400-1666f6769435 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:14.811226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca93f9d-d2d0-4d19-b400-1666f6769435 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5a2eed0c33e84588a4b9d972363b0d4e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:14.812863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca93f9d-d2d0-4d19-b400-1666f6769435 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:14.868968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ca93f9d-d2d0-4d19-b400-1666f6769435 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5a2eed0c33e84588a4b9d972363b0d4e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:14.873159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ca93f9d-d2d0-4d19-b400-1666f6769435 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5a2eed0c33e84588a4b9d972363b0d4e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:14.949996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ca93f9d-d2d0-4d19-b400-1666f6769435 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5a2eed0c33e84588a4b9d972363b0d4e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:14.951080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ca93f9d-d2d0-4d19-b400-1666f6769435 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5a2eed0c33e84588a4b9d972363b0d4e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:14.965309 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2803/5586] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:14 2022] PATCH /identity/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e => generated 277 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:14.969922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c6693-0ee5-4e46-b30a-e37eca55d7a4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:14.973362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-db6c6693-0ee5-4e46-b30a-e37eca55d7a4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:14.997541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c6693-0ee5-4e46-b30a-e37eca55d7a4 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:15.146838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:15.147487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:15.147922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:15.148207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:15.165910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5a2eed0c33e84588a4b9d972363b0d4e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:15.167530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:15.197717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5a2eed0c33e84588a4b9d972363b0d4e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:15.238345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5a2eed0c33e84588a4b9d972363b0d4e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:15.282647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:15.313313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a2eed0c33e84588a4b9d972363b0d4e', 'request_id': 'req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:15.326001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a2eed0c33e84588a4b9d972363b0d4e', 'request_id': 'req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:15.338394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a2eed0c33e84588a4b9d972363b0d4e', 'request_id': 'req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:15.366453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] The token cache is being invalidate because project 5a2eed0c33e84588a4b9d972363b0d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:15.366809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:15.367600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:15.381999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5a2eed0c33e84588a4b9d972363b0d4e', 'request_id': 'req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:15.383427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5a2eed0c33e84588a4b9d972363b0d4e', 'request_id': 'req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:15.390606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5a2eed0c33e84588a4b9d972363b0d4e', 'request_id': 'req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:15.400326 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2784/5587] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:13:14 2022] DELETE /identity/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:13:15.410315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca93f9d-d2d0-4d19-b400-1666f6769435 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:15.442228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca93f9d-d2d0-4d19-b400-1666f6769435 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:15.573248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b03c46-e531-461e-a8f1-2369d7f1729d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:15.575265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03c46-e531-461e-a8f1-2369d7f1729d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:15.576050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03c46-e531-461e-a8f1-2369d7f1729d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:15.576626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03c46-e531-461e-a8f1-2369d7f1729d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:15.577476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b03c46-e531-461e-a8f1-2369d7f1729d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:15.580379 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-32b03c46-e531-461e-a8f1-2369d7f1729d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:13:15.580379 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:13:15.580379 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:13:15.582344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b03c46-e531-461e-a8f1-2369d7f1729d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:15.588520 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2804/5588] 10.222.0.26 () {58 vars in 1173 bytes} [Sat Oct 8 21:13:15 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:15.592981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:15.594661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:15.618114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f1e16-87c2-44e6-b8bf-f242adb0e1e6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:15.624988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf01cf-beba-48d8-b46c-37844e1282c6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:15.625988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf01cf-beba-48d8-b46c-37844e1282c6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:15.626321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf01cf-beba-48d8-b46c-37844e1282c6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:15.626606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf01cf-beba-48d8-b46c-37844e1282c6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:15.627828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf01cf-beba-48d8-b46c-37844e1282c6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:15.631896 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-58bf01cf-beba-48d8-b46c-37844e1282c6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:13:15.631896 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:13:15.631896 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:13:15.643055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf01cf-beba-48d8-b46c-37844e1282c6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:15.646699 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2785/5589] 10.222.0.26 () {58 vars in 1200 bytes} [Sat Oct 8 21:13:15 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:15.651018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b03c46-e531-461e-a8f1-2369d7f1729d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:15.667657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b03c46-e531-461e-a8f1-2369d7f1729d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:15.684619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba4312-890f-4b39-b20d-87c704f52e83 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:15.685336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4312-890f-4b39-b20d-87c704f52e83 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:15.685623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4312-890f-4b39-b20d-87c704f52e83 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:15.685884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4312-890f-4b39-b20d-87c704f52e83 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:15.686490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba4312-890f-4b39-b20d-87c704f52e83 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:15.688118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba4312-890f-4b39-b20d-87c704f52e83 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:15.693036 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2805/5590] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:13:15 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:15.699388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf01cf-beba-48d8-b46c-37844e1282c6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:15.714206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf01cf-beba-48d8-b46c-37844e1282c6 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:15.725859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a33e51-4e7d-4b16-b485-9992b5481b01 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:15.726662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33e51-4e7d-4b16-b485-9992b5481b01 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:15.726990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33e51-4e7d-4b16-b485-9992b5481b01 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:15.727341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33e51-4e7d-4b16-b485-9992b5481b01 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:15.736674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a33e51-4e7d-4b16-b485-9992b5481b01 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:15.741989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a33e51-4e7d-4b16-b485-9992b5481b01 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:15.743822 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2786/5591] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:15 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:15.748124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba4312-890f-4b39-b20d-87c704f52e83 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:15.758462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:15.766796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba4312-890f-4b39-b20d-87c704f52e83 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:15.786017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574424b-484f-4b5c-9b1b-e08dd54219da tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:15.786700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574424b-484f-4b5c-9b1b-e08dd54219da tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:15.791047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574424b-484f-4b5c-9b1b-e08dd54219da tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:15.791522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574424b-484f-4b5c-9b1b-e08dd54219da tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:15.793882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574424b-484f-4b5c-9b1b-e08dd54219da tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:15.796053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574424b-484f-4b5c-9b1b-e08dd54219da tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:15.798046 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2806/5592] 10.222.0.26 () {58 vars in 1188 bytes} [Sat Oct 8 21:13:15 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:15.802465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a33e51-4e7d-4b16-b485-9992b5481b01 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:15.820276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a33e51-4e7d-4b16-b485-9992b5481b01 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:15.833675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0510cd3-9463-4538-b0b8-45c72d8d4dc2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:15.836713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0510cd3-9463-4538-b0b8-45c72d8d4dc2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:15.837012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0510cd3-9463-4538-b0b8-45c72d8d4dc2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:15.839482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0510cd3-9463-4538-b0b8-45c72d8d4dc2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:15.841344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0510cd3-9463-4538-b0b8-45c72d8d4dc2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:15.851406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0510cd3-9463-4538-b0b8-45c72d8d4dc2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:15.861223 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2787/5593] 10.222.0.26 () {58 vars in 1200 bytes} [Sat Oct 8 21:13:15 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:15.861924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574424b-484f-4b5c-9b1b-e08dd54219da tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:15.883742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574424b-484f-4b5c-9b1b-e08dd54219da tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:15.898020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e820a70-1461-4ac0-a9fb-c1c6e40d91a0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:15.898861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e820a70-1461-4ac0-a9fb-c1c6e40d91a0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:15.900924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e820a70-1461-4ac0-a9fb-c1c6e40d91a0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:15.901318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e820a70-1461-4ac0-a9fb-c1c6e40d91a0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:15.902199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e820a70-1461-4ac0-a9fb-c1c6e40d91a0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:15.907930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e820a70-1461-4ac0-a9fb-c1c6e40d91a0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:15.916627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0510cd3-9463-4538-b0b8-45c72d8d4dc2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:15.924958 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2807/5594] 10.222.0.26 () {58 vars in 1203 bytes} [Sat Oct 8 21:13:15 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:15.929270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0510cd3-9463-4538-b0b8-45c72d8d4dc2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:15.958865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcc288-7e63-465e-993b-3e75353ce1e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:15.960574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcc288-7e63-465e-993b-3e75353ce1e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:15.962716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcc288-7e63-465e-993b-3e75353ce1e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:15.963240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcc288-7e63-465e-993b-3e75353ce1e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:15.966112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcc288-7e63-465e-993b-3e75353ce1e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:15.968753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcc288-7e63-465e-993b-3e75353ce1e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:15.976176 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2788/5595] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Oct 8 21:13:15 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:15.980009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e820a70-1461-4ac0-a9fb-c1c6e40d91a0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:15.996410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e820a70-1461-4ac0-a9fb-c1c6e40d91a0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.006888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473beba5-55ac-46a0-845f-3f357625dde1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.007766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473beba5-55ac-46a0-845f-3f357625dde1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.008162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473beba5-55ac-46a0-845f-3f357625dde1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.008550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473beba5-55ac-46a0-845f-3f357625dde1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.009289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473beba5-55ac-46a0-845f-3f357625dde1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.013054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473beba5-55ac-46a0-845f-3f357625dde1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.022027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcc288-7e63-465e-993b-3e75353ce1e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.031152 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2808/5596] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:15 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:16.038499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcc288-7e63-465e-993b-3e75353ce1e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.062291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b2401-5b2b-4fcd-895e-8887bc20cd3d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.065347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b2401-5b2b-4fcd-895e-8887bc20cd3d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.069327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b2401-5b2b-4fcd-895e-8887bc20cd3d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.069990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b2401-5b2b-4fcd-895e-8887bc20cd3d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.072994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b2401-5b2b-4fcd-895e-8887bc20cd3d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.078996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b2401-5b2b-4fcd-895e-8887bc20cd3d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.089614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473beba5-55ac-46a0-845f-3f357625dde1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.101852 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2789/5597] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 08 21:13:16.107229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473beba5-55ac-46a0-845f-3f357625dde1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.120027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f17894-a3b8-42f4-a3df-1889c5bb87b7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.121593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f17894-a3b8-42f4-a3df-1889c5bb87b7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.122112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f17894-a3b8-42f4-a3df-1889c5bb87b7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.122480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f17894-a3b8-42f4-a3df-1889c5bb87b7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.123326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f17894-a3b8-42f4-a3df-1889c5bb87b7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.126317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f17894-a3b8-42f4-a3df-1889c5bb87b7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.132386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b2401-5b2b-4fcd-895e-8887bc20cd3d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.141165 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2809/5598] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:16.146662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b2401-5b2b-4fcd-895e-8887bc20cd3d tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.157343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419c69-be99-49fc-9fb8-3699a950aa38 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.157999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419c69-be99-49fc-9fb8-3699a950aa38 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.158285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419c69-be99-49fc-9fb8-3699a950aa38 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.158565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419c69-be99-49fc-9fb8-3699a950aa38 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.159167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b419c69-be99-49fc-9fb8-3699a950aa38 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.160998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b419c69-be99-49fc-9fb8-3699a950aa38 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.167451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f17894-a3b8-42f4-a3df-1889c5bb87b7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.168544 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2790/5599] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:16.188550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f17894-a3b8-42f4-a3df-1889c5bb87b7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.195658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24385d6-9f98-42b9-b543-8d0de0600db7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.196267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24385d6-9f98-42b9-b543-8d0de0600db7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.196561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24385d6-9f98-42b9-b543-8d0de0600db7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.196842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24385d6-9f98-42b9-b543-8d0de0600db7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.197462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24385d6-9f98-42b9-b543-8d0de0600db7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.202023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24385d6-9f98-42b9-b543-8d0de0600db7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.213060 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2810/5600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:16.214457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419c69-be99-49fc-9fb8-3699a950aa38 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.227488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419c69-be99-49fc-9fb8-3699a950aa38 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.234417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed4836-a189-4fb6-b6fb-69365c006676 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.234895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed4836-a189-4fb6-b6fb-69365c006676 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.235256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed4836-a189-4fb6-b6fb-69365c006676 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.236203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed4836-a189-4fb6-b6fb-69365c006676 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.236815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed4836-a189-4fb6-b6fb-69365c006676 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.238891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed4836-a189-4fb6-b6fb-69365c006676 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.257239 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2791/5601] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 08 21:13:16.260488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24385d6-9f98-42b9-b543-8d0de0600db7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.287917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24385d6-9f98-42b9-b543-8d0de0600db7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.304775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3e856-70f0-43db-96a5-64662dad3518 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.306311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3e856-70f0-43db-96a5-64662dad3518 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.307171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3e856-70f0-43db-96a5-64662dad3518 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.307171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3e856-70f0-43db-96a5-64662dad3518 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.307517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3e856-70f0-43db-96a5-64662dad3518 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.332667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3e856-70f0-43db-96a5-64662dad3518 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.335232 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2811/5602] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:16.339755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed4836-a189-4fb6-b6fb-69365c006676 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.352838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed4836-a189-4fb6-b6fb-69365c006676 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.368967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa13ac-7d1e-40f4-b610-73b3535a15db tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.370505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa13ac-7d1e-40f4-b610-73b3535a15db tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.370505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa13ac-7d1e-40f4-b610-73b3535a15db tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.370505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa13ac-7d1e-40f4-b610-73b3535a15db tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.375292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa13ac-7d1e-40f4-b610-73b3535a15db tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.380352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa13ac-7d1e-40f4-b610-73b3535a15db tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.385242 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2792/5603] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:16.387743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3e856-70f0-43db-96a5-64662dad3518 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.401286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3e856-70f0-43db-96a5-64662dad3518 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.424213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a92e5a-ee9e-43b8-ae79-df9c61571621 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.426172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a92e5a-ee9e-43b8-ae79-df9c61571621 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.426981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a92e5a-ee9e-43b8-ae79-df9c61571621 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.428155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a92e5a-ee9e-43b8-ae79-df9c61571621 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.429099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a92e5a-ee9e-43b8-ae79-df9c61571621 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.437932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a92e5a-ee9e-43b8-ae79-df9c61571621 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.455307 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2812/5604] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:16.463300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa13ac-7d1e-40f4-b610-73b3535a15db tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.538205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa13ac-7d1e-40f4-b610-73b3535a15db tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.551778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582afc7-6d59-4cfd-9dd2-473f0bcbea72 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.553459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582afc7-6d59-4cfd-9dd2-473f0bcbea72 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.553848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582afc7-6d59-4cfd-9dd2-473f0bcbea72 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.554388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582afc7-6d59-4cfd-9dd2-473f0bcbea72 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.555098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582afc7-6d59-4cfd-9dd2-473f0bcbea72 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.556888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582afc7-6d59-4cfd-9dd2-473f0bcbea72 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.558340 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2793/5605] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:16.562703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a92e5a-ee9e-43b8-ae79-df9c61571621 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.580865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a92e5a-ee9e-43b8-ae79-df9c61571621 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.603903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c0d54-57b9-4d30-ac31-8f83caebfdc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.604679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c0d54-57b9-4d30-ac31-8f83caebfdc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.604951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c0d54-57b9-4d30-ac31-8f83caebfdc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.605258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c0d54-57b9-4d30-ac31-8f83caebfdc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.605860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c0d54-57b9-4d30-ac31-8f83caebfdc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.607501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c0d54-57b9-4d30-ac31-8f83caebfdc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.619085 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2813/5606] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 08 21:13:16.620377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582afc7-6d59-4cfd-9dd2-473f0bcbea72 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.635630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582afc7-6d59-4cfd-9dd2-473f0bcbea72 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.654199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61697fb-5c8a-4ffe-852d-3160cf2e0046 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.654913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61697fb-5c8a-4ffe-852d-3160cf2e0046 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.655224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61697fb-5c8a-4ffe-852d-3160cf2e0046 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.655529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61697fb-5c8a-4ffe-852d-3160cf2e0046 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.656110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61697fb-5c8a-4ffe-852d-3160cf2e0046 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.657889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61697fb-5c8a-4ffe-852d-3160cf2e0046 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.663837 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2794/5607] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:16.665210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c0d54-57b9-4d30-ac31-8f83caebfdc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.689631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c0d54-57b9-4d30-ac31-8f83caebfdc7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.716431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b046ddc-beb7-4fce-9bc2-76f33a53e71e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.719786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b046ddc-beb7-4fce-9bc2-76f33a53e71e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.720347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b046ddc-beb7-4fce-9bc2-76f33a53e71e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.723638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b046ddc-beb7-4fce-9bc2-76f33a53e71e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.726675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b046ddc-beb7-4fce-9bc2-76f33a53e71e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.733064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b046ddc-beb7-4fce-9bc2-76f33a53e71e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.737148 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2814/5608] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 08 21:13:16.742269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61697fb-5c8a-4ffe-852d-3160cf2e0046 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.755970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61697fb-5c8a-4ffe-852d-3160cf2e0046 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.771110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361612b-cec3-412d-9f79-17b530bbdf76 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.772502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361612b-cec3-412d-9f79-17b530bbdf76 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.772643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361612b-cec3-412d-9f79-17b530bbdf76 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.772904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361612b-cec3-412d-9f79-17b530bbdf76 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.774604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361612b-cec3-412d-9f79-17b530bbdf76 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.775161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361612b-cec3-412d-9f79-17b530bbdf76 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.780145 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2795/5609] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:16.783089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b046ddc-beb7-4fce-9bc2-76f33a53e71e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.820025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b046ddc-beb7-4fce-9bc2-76f33a53e71e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.840411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce78cd-df30-4d02-bacf-24d766a4d389 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.841114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce78cd-df30-4d02-bacf-24d766a4d389 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.841436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce78cd-df30-4d02-bacf-24d766a4d389 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.842075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce78cd-df30-4d02-bacf-24d766a4d389 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.842872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce78cd-df30-4d02-bacf-24d766a4d389 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.847985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce78cd-df30-4d02-bacf-24d766a4d389 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.852363 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2815/5610] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:16.855132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361612b-cec3-412d-9f79-17b530bbdf76 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.870329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361612b-cec3-412d-9f79-17b530bbdf76 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.887271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1470f8-8666-483d-ba57-64f049071000 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.887787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1470f8-8666-483d-ba57-64f049071000 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.888388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1470f8-8666-483d-ba57-64f049071000 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.888695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1470f8-8666-483d-ba57-64f049071000 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.889371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1470f8-8666-483d-ba57-64f049071000 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.891079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1470f8-8666-483d-ba57-64f049071000 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.893168 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2796/5611] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:16.898092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce78cd-df30-4d02-bacf-24d766a4d389 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.924279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce78cd-df30-4d02-bacf-24d766a4d389 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.945811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b392379-cbb8-434d-81a6-9715324ce854 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.946497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b392379-cbb8-434d-81a6-9715324ce854 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.946783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b392379-cbb8-434d-81a6-9715324ce854 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.947080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b392379-cbb8-434d-81a6-9715324ce854 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.947690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b392379-cbb8-434d-81a6-9715324ce854 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.949295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b392379-cbb8-434d-81a6-9715324ce854 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.954449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1470f8-8666-483d-ba57-64f049071000 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:16.955520 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2816/5612] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:16.969116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1470f8-8666-483d-ba57-64f049071000 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:16.979125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d834-7ef1-4623-a0d2-e65231188cdd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:16.980443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d834-7ef1-4623-a0d2-e65231188cdd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:16.980911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d834-7ef1-4623-a0d2-e65231188cdd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:16.981385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d834-7ef1-4623-a0d2-e65231188cdd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:16.982131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34d834-7ef1-4623-a0d2-e65231188cdd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:16.983895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34d834-7ef1-4623-a0d2-e65231188cdd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:16.985960 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2797/5613] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 08 21:13:16.989905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b392379-cbb8-434d-81a6-9715324ce854 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.006236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b392379-cbb8-434d-81a6-9715324ce854 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.013503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a8acb-04de-4beb-a93c-951a6b3ce0df tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.014610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a8acb-04de-4beb-a93c-951a6b3ce0df tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.015143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a8acb-04de-4beb-a93c-951a6b3ce0df tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.015569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a8acb-04de-4beb-a93c-951a6b3ce0df tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.016330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a8acb-04de-4beb-a93c-951a6b3ce0df tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.018856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a8acb-04de-4beb-a93c-951a6b3ce0df tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.021012 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2817/5614] 10.222.0.26 () {58 vars in 1290 bytes} [Sat Oct 8 21:13:16 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.024919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d834-7ef1-4623-a0d2-e65231188cdd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.040806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d834-7ef1-4623-a0d2-e65231188cdd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.058353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06678154-51fc-4d79-bd07-b861772719ec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.059036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678154-51fc-4d79-bd07-b861772719ec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.059865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678154-51fc-4d79-bd07-b861772719ec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.059865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678154-51fc-4d79-bd07-b861772719ec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.060152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06678154-51fc-4d79-bd07-b861772719ec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.061797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06678154-51fc-4d79-bd07-b861772719ec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.062947 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2798/5615] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.067908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a8acb-04de-4beb-a93c-951a6b3ce0df tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.081306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a8acb-04de-4beb-a93c-951a6b3ce0df tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.091838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810336a-7713-41d8-b96c-bb217fdeed1e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.092555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810336a-7713-41d8-b96c-bb217fdeed1e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.092854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810336a-7713-41d8-b96c-bb217fdeed1e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.093144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810336a-7713-41d8-b96c-bb217fdeed1e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.096119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810336a-7713-41d8-b96c-bb217fdeed1e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.097952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810336a-7713-41d8-b96c-bb217fdeed1e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.099288 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2818/5616] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.105971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06678154-51fc-4d79-bd07-b861772719ec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.122766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06678154-51fc-4d79-bd07-b861772719ec tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.134393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c8510-18e3-424a-b85d-924629f18501 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.135071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c8510-18e3-424a-b85d-924629f18501 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.135349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c8510-18e3-424a-b85d-924629f18501 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.135727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c8510-18e3-424a-b85d-924629f18501 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.136262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c8510-18e3-424a-b85d-924629f18501 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.137897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c8510-18e3-424a-b85d-924629f18501 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.141908 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2799/5617] 10.222.0.26 () {58 vars in 1308 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.143391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810336a-7713-41d8-b96c-bb217fdeed1e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.157900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810336a-7713-41d8-b96c-bb217fdeed1e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.178825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb04eb6-4ab2-4377-aced-a43b45251ea7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.179728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb04eb6-4ab2-4377-aced-a43b45251ea7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.179888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb04eb6-4ab2-4377-aced-a43b45251ea7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.180629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb04eb6-4ab2-4377-aced-a43b45251ea7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.180629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb04eb6-4ab2-4377-aced-a43b45251ea7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.182258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb04eb6-4ab2-4377-aced-a43b45251ea7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.186167 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2819/5618] 10.222.0.26 () {58 vars in 1290 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.187393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c8510-18e3-424a-b85d-924629f18501 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.204106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c8510-18e3-424a-b85d-924629f18501 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.213783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415e7c0-eb92-46e2-a298-11c8c594e3c0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.214460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e7c0-eb92-46e2-a298-11c8c594e3c0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.214743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e7c0-eb92-46e2-a298-11c8c594e3c0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.215020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e7c0-eb92-46e2-a298-11c8c594e3c0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.215798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415e7c0-eb92-46e2-a298-11c8c594e3c0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.217250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415e7c0-eb92-46e2-a298-11c8c594e3c0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.218417 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2800/5619] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 08 21:13:17.223150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb04eb6-4ab2-4377-aced-a43b45251ea7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.238511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb04eb6-4ab2-4377-aced-a43b45251ea7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.251281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35121a14-7f9e-499f-b6e5-b52dd7200745 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.251281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35121a14-7f9e-499f-b6e5-b52dd7200745 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.251281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35121a14-7f9e-499f-b6e5-b52dd7200745 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.251672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35121a14-7f9e-499f-b6e5-b52dd7200745 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.252128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35121a14-7f9e-499f-b6e5-b52dd7200745 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.254105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35121a14-7f9e-499f-b6e5-b52dd7200745 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.258927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415e7c0-eb92-46e2-a298-11c8c594e3c0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.266189 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2820/5620] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.271626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415e7c0-eb92-46e2-a298-11c8c594e3c0 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.282106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4dec4-2aba-4a44-9dd2-96a38b236142 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.286132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4dec4-2aba-4a44-9dd2-96a38b236142 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.286328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4dec4-2aba-4a44-9dd2-96a38b236142 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.286591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4dec4-2aba-4a44-9dd2-96a38b236142 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.287198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4dec4-2aba-4a44-9dd2-96a38b236142 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.288813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4dec4-2aba-4a44-9dd2-96a38b236142 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.294131 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2801/5621] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.294435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35121a14-7f9e-499f-b6e5-b52dd7200745 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.308983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35121a14-7f9e-499f-b6e5-b52dd7200745 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.318977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03083616-20ce-4e82-ab1a-cdd9c3f40241 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.319744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03083616-20ce-4e82-ab1a-cdd9c3f40241 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.320025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03083616-20ce-4e82-ab1a-cdd9c3f40241 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.320300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03083616-20ce-4e82-ab1a-cdd9c3f40241 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.320894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03083616-20ce-4e82-ab1a-cdd9c3f40241 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.324509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03083616-20ce-4e82-ab1a-cdd9c3f40241 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.333975 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2821/5622] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.337798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4dec4-2aba-4a44-9dd2-96a38b236142 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.353481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4dec4-2aba-4a44-9dd2-96a38b236142 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.365841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d57bec-649e-405d-9082-22332e0620e7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.366886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d57bec-649e-405d-9082-22332e0620e7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.366886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d57bec-649e-405d-9082-22332e0620e7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.367113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d57bec-649e-405d-9082-22332e0620e7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.367594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d57bec-649e-405d-9082-22332e0620e7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.369323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d57bec-649e-405d-9082-22332e0620e7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.373426 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2802/5623] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.375590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03083616-20ce-4e82-ab1a-cdd9c3f40241 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.390524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03083616-20ce-4e82-ab1a-cdd9c3f40241 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.397540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a74ed7-43fd-4573-84c7-0b024a445167 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.398343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a74ed7-43fd-4573-84c7-0b024a445167 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.398695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a74ed7-43fd-4573-84c7-0b024a445167 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.399040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a74ed7-43fd-4573-84c7-0b024a445167 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.399771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a74ed7-43fd-4573-84c7-0b024a445167 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.401552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a74ed7-43fd-4573-84c7-0b024a445167 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.405400 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2822/5624] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.407945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d57bec-649e-405d-9082-22332e0620e7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.422813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d57bec-649e-405d-9082-22332e0620e7 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.434664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3bb8e-0e62-43ed-b6ee-5b8a025af809 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.435522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3bb8e-0e62-43ed-b6ee-5b8a025af809 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.435808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3bb8e-0e62-43ed-b6ee-5b8a025af809 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.436088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3bb8e-0e62-43ed-b6ee-5b8a025af809 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.436678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3bb8e-0e62-43ed-b6ee-5b8a025af809 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.438444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3bb8e-0e62-43ed-b6ee-5b8a025af809 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.446049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a74ed7-43fd-4573-84c7-0b024a445167 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.448494 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2803/5625] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.457421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a74ed7-43fd-4573-84c7-0b024a445167 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.466914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c0625-2740-43cb-9c48-d765391c544b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.467591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c0625-2740-43cb-9c48-d765391c544b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.468177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c0625-2740-43cb-9c48-d765391c544b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.468177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c0625-2740-43cb-9c48-d765391c544b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.468713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c0625-2740-43cb-9c48-d765391c544b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.470334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c0625-2740-43cb-9c48-d765391c544b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.471456 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2823/5626] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.478219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3bb8e-0e62-43ed-b6ee-5b8a025af809 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.495327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3bb8e-0e62-43ed-b6ee-5b8a025af809 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.502264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1f9d6-b9b6-4034-8308-97a86cc0f761 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.502934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1f9d6-b9b6-4034-8308-97a86cc0f761 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.503941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1f9d6-b9b6-4034-8308-97a86cc0f761 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.504233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1f9d6-b9b6-4034-8308-97a86cc0f761 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.505349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1f9d6-b9b6-4034-8308-97a86cc0f761 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.508159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1f9d6-b9b6-4034-8308-97a86cc0f761 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.516746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c0625-2740-43cb-9c48-d765391c544b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.533628 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2804/5627] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.539132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c0625-2740-43cb-9c48-d765391c544b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.548094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027fd8d-90cf-4c42-89aa-d662a72fa63c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.549100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027fd8d-90cf-4c42-89aa-d662a72fa63c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.549709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027fd8d-90cf-4c42-89aa-d662a72fa63c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.549937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027fd8d-90cf-4c42-89aa-d662a72fa63c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.551625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027fd8d-90cf-4c42-89aa-d662a72fa63c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.554720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027fd8d-90cf-4c42-89aa-d662a72fa63c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.563763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1f9d6-b9b6-4034-8308-97a86cc0f761 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.578169 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2824/5628] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.585661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1f9d6-b9b6-4034-8308-97a86cc0f761 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.595118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bda5d-e857-4b88-ae89-a5ef03835ed2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.598673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bda5d-e857-4b88-ae89-a5ef03835ed2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.598992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bda5d-e857-4b88-ae89-a5ef03835ed2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.599281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bda5d-e857-4b88-ae89-a5ef03835ed2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.599902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bda5d-e857-4b88-ae89-a5ef03835ed2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.605178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bda5d-e857-4b88-ae89-a5ef03835ed2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.610215 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2805/5629] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.614705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027fd8d-90cf-4c42-89aa-d662a72fa63c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.634820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027fd8d-90cf-4c42-89aa-d662a72fa63c tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.649976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87477b12-df57-4477-93e5-93f1c30629e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.653327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87477b12-df57-4477-93e5-93f1c30629e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.654914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87477b12-df57-4477-93e5-93f1c30629e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.656203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87477b12-df57-4477-93e5-93f1c30629e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.659017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87477b12-df57-4477-93e5-93f1c30629e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.660818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87477b12-df57-4477-93e5-93f1c30629e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.669293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bda5d-e857-4b88-ae89-a5ef03835ed2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.683934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bda5d-e857-4b88-ae89-a5ef03835ed2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.685347 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2825/5630] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.690460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fb0b1-008d-4917-9aea-1c0006ffd442 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.692364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fb0b1-008d-4917-9aea-1c0006ffd442 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.693085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fb0b1-008d-4917-9aea-1c0006ffd442 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.693642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fb0b1-008d-4917-9aea-1c0006ffd442 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.694459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fb0b1-008d-4917-9aea-1c0006ffd442 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.696310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fb0b1-008d-4917-9aea-1c0006ffd442 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.703836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87477b12-df57-4477-93e5-93f1c30629e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.716008 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2806/5631] 10.222.0.26 () {58 vars in 1212 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.719584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87477b12-df57-4477-93e5-93f1c30629e2 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.725994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ce0eb-f0ba-4743-99d3-5b0e512f124e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.727016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ce0eb-f0ba-4743-99d3-5b0e512f124e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.727896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ce0eb-f0ba-4743-99d3-5b0e512f124e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.728356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ce0eb-f0ba-4743-99d3-5b0e512f124e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.729114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ce0eb-f0ba-4743-99d3-5b0e512f124e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.731542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ce0eb-f0ba-4743-99d3-5b0e512f124e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.739380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fb0b1-008d-4917-9aea-1c0006ffd442 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.740050 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2826/5632] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.763215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fb0b1-008d-4917-9aea-1c0006ffd442 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.782340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192df82-403c-4eae-8faa-a9a6e66b3673 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.783378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192df82-403c-4eae-8faa-a9a6e66b3673 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.783842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192df82-403c-4eae-8faa-a9a6e66b3673 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.784294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192df82-403c-4eae-8faa-a9a6e66b3673 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.785809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192df82-403c-4eae-8faa-a9a6e66b3673 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.788221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192df82-403c-4eae-8faa-a9a6e66b3673 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.789729 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2807/5633] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.793947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ce0eb-f0ba-4743-99d3-5b0e512f124e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.808575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ce0eb-f0ba-4743-99d3-5b0e512f124e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.823168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d7032-01d7-4fc0-891c-6dce2e56f096 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.824012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d7032-01d7-4fc0-891c-6dce2e56f096 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.824300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d7032-01d7-4fc0-891c-6dce2e56f096 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.824578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d7032-01d7-4fc0-891c-6dce2e56f096 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.825201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d7032-01d7-4fc0-891c-6dce2e56f096 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.826828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d7032-01d7-4fc0-891c-6dce2e56f096 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.833110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192df82-403c-4eae-8faa-a9a6e66b3673 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.833557 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2827/5634] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.849714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192df82-403c-4eae-8faa-a9a6e66b3673 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.861442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb137fc-4239-4aad-a4ab-dbc77ad77f49 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.862166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb137fc-4239-4aad-a4ab-dbc77ad77f49 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.862663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb137fc-4239-4aad-a4ab-dbc77ad77f49 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.862951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb137fc-4239-4aad-a4ab-dbc77ad77f49 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.863559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb137fc-4239-4aad-a4ab-dbc77ad77f49 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.866254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb137fc-4239-4aad-a4ab-dbc77ad77f49 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.867518 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2808/5635] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 08 21:13:17.871589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d7032-01d7-4fc0-891c-6dce2e56f096 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.882047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d7032-01d7-4fc0-891c-6dce2e56f096 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.888357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dcb75-7e94-4e68-a252-812411456fcd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.889530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dcb75-7e94-4e68-a252-812411456fcd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.889993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dcb75-7e94-4e68-a252-812411456fcd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.890614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dcb75-7e94-4e68-a252-812411456fcd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.892077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dcb75-7e94-4e68-a252-812411456fcd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.894701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dcb75-7e94-4e68-a252-812411456fcd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.896529 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2828/5636] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.900306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb137fc-4239-4aad-a4ab-dbc77ad77f49 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.912149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb137fc-4239-4aad-a4ab-dbc77ad77f49 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.921944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98402a4b-9cfd-4989-9e5a-2308b2b0525b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.922819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98402a4b-9cfd-4989-9e5a-2308b2b0525b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.923279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98402a4b-9cfd-4989-9e5a-2308b2b0525b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.923963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98402a4b-9cfd-4989-9e5a-2308b2b0525b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.924849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98402a4b-9cfd-4989-9e5a-2308b2b0525b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.929132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98402a4b-9cfd-4989-9e5a-2308b2b0525b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.930849 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2809/5637] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:17.934995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dcb75-7e94-4e68-a252-812411456fcd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.947149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dcb75-7e94-4e68-a252-812411456fcd tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.953261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc3de9-fc41-4552-a38b-71ca033d9cb1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.954600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc3de9-fc41-4552-a38b-71ca033d9cb1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.955067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc3de9-fc41-4552-a38b-71ca033d9cb1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.955514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc3de9-fc41-4552-a38b-71ca033d9cb1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.956954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc3de9-fc41-4552-a38b-71ca033d9cb1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.959239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc3de9-fc41-4552-a38b-71ca033d9cb1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.961073 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2829/5638] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 08 21:13:17.965036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98402a4b-9cfd-4989-9e5a-2308b2b0525b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:17.978528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98402a4b-9cfd-4989-9e5a-2308b2b0525b tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:17.984673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199bbe9-fea3-44e4-8968-d4476e0fc910 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:17.986106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199bbe9-fea3-44e4-8968-d4476e0fc910 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:17.986522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199bbe9-fea3-44e4-8968-d4476e0fc910 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:17.987036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199bbe9-fea3-44e4-8968-d4476e0fc910 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:17.987818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199bbe9-fea3-44e4-8968-d4476e0fc910 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:17.989586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199bbe9-fea3-44e4-8968-d4476e0fc910 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:17.990883 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2810/5639] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 08 21:13:17.995061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc3de9-fc41-4552-a38b-71ca033d9cb1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:18.006273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc3de9-fc41-4552-a38b-71ca033d9cb1 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:18.011222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd64ebb-9b78-443b-a569-e73abb630fb9 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:18.012015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64ebb-9b78-443b-a569-e73abb630fb9 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:18.012470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64ebb-9b78-443b-a569-e73abb630fb9 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:18.013054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64ebb-9b78-443b-a569-e73abb630fb9 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:18.013853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd64ebb-9b78-443b-a569-e73abb630fb9 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:18.015810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd64ebb-9b78-443b-a569-e73abb630fb9 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:18.017800 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2830/5640] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:17 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 08 21:13:18.024514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199bbe9-fea3-44e4-8968-d4476e0fc910 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:18.056705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199bbe9-fea3-44e4-8968-d4476e0fc910 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:18.066180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407b837-9cbe-42ae-88de-db42ad860757 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:18.066938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b837-9cbe-42ae-88de-db42ad860757 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:18.067288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b837-9cbe-42ae-88de-db42ad860757 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:18.067633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b837-9cbe-42ae-88de-db42ad860757 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:18.068915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407b837-9cbe-42ae-88de-db42ad860757 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:18.071630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407b837-9cbe-42ae-88de-db42ad860757 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:18.078512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd64ebb-9b78-443b-a569-e73abb630fb9 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:18.079096 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2811/5641] 10.222.0.26 () {58 vars in 1278 bytes} [Sat Oct 8 21:13:18 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 08 21:13:18.096819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd64ebb-9b78-443b-a569-e73abb630fb9 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:18.139851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29843c60-07fd-49aa-80ef-948b100d322e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:18.140512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843c60-07fd-49aa-80ef-948b100d322e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:18.140797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843c60-07fd-49aa-80ef-948b100d322e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:18.141266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843c60-07fd-49aa-80ef-948b100d322e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:18.160899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29843c60-07fd-49aa-80ef-948b100d322e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-29843c60-07fd-49aa-80ef-948b100d322e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Could not find domain: 5a2eed0c33e84588a4b9d972363b0d4e.: keystone.exception.DomainNotFound: Could not find domain: 5a2eed0c33e84588a4b9d972363b0d4e. Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5a2eed0c33e84588a4b9d972363b0d4e. Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:18.168097 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:18.169221 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:13:18.170333 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5a2eed0c33e84588a4b9d972363b0d4e. Oct 08 21:13:18.171982 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:18.173971 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2831/5642] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:18 2022] PATCH /identity/v3/domains/5a2eed0c33e84588a4b9d972363b0d4e => generated 112 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:13:18.176378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407b837-9cbe-42ae-88de-db42ad860757 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:18.192228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407b837-9cbe-42ae-88de-db42ad860757 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:18.197954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2e671-fbc8-40fb-a7f0-4c79e93fb204 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:18.198597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e671-fbc8-40fb-a7f0-4c79e93fb204 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:18.198883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e671-fbc8-40fb-a7f0-4c79e93fb204 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:18.199198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e671-fbc8-40fb-a7f0-4c79e93fb204 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/7dfbfccd264345d9867d5ddc673d6b05` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:18.208730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2e671-fbc8-40fb-a7f0-4c79e93fb204 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-a9c2e671-fbc8-40fb-a7f0-4c79e93fb204 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Could not find domain: 7dfbfccd264345d9867d5ddc673d6b05.: keystone.exception.DomainNotFound: Could not find domain: 7dfbfccd264345d9867d5ddc673d6b05. Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7dfbfccd264345d9867d5ddc673d6b05. Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:18.215804 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:18.216845 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:13:18.217841 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7dfbfccd264345d9867d5ddc673d6b05. Oct 08 21:13:18.219028 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:18.221326 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2812/5643] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:18 2022] PATCH /identity/v3/domains/7dfbfccd264345d9867d5ddc673d6b05 => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:13:18.226614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29843c60-07fd-49aa-80ef-948b100d322e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:18.241025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29843c60-07fd-49aa-80ef-948b100d322e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:18.252701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369f10f-1d20-4346-a057-175c09e98f5e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd07dda69328432d80de4bbbe5faa23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b637a7c116ab474997655e434b356905', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:18.254611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369f10f-1d20-4346-a057-175c09e98f5e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:18.254970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369f10f-1d20-4346-a057-175c09e98f5e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:18.256527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369f10f-1d20-4346-a057-175c09e98f5e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] PATH_INFO: `/v3/domains/f6d5ad11d92243e28af32aefb1ef0218` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:18.267778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369f10f-1d20-4346-a057-175c09e98f5e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-8369f10f-1d20-4346-a057-175c09e98f5e tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Could not find domain: f6d5ad11d92243e28af32aefb1ef0218.: keystone.exception.DomainNotFound: Could not find domain: f6d5ad11d92243e28af32aefb1ef0218. Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f6d5ad11d92243e28af32aefb1ef0218. Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:18.280239 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:18.281292 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:13:18.282267 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f6d5ad11d92243e28af32aefb1ef0218. Oct 08 21:13:18.283299 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:18.283299 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2832/5644] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:18 2022] PATCH /identity/v3/domains/f6d5ad11d92243e28af32aefb1ef0218 => generated 112 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 08 21:13:18.289103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2e671-fbc8-40fb-a7f0-4c79e93fb204 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:18.291679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a9c2e671-fbc8-40fb-a7f0-4c79e93fb204 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:18.341769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:18.409659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2e671-fbc8-40fb-a7f0-4c79e93fb204 tempest-DomainConfigurationTestJSON-743441566 tempest-DomainConfigurationTestJSON-743441566-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:18.416733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:18.417146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:18.417538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:18.418130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] PATH_INFO: `/v3/users/d35d052fd93e4b24a23a0c7c774c3c5f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:18.419472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35d052fd93e4b24a23a0c7c774c3c5f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:18.421762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:18.517344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35d052fd93e4b24a23a0c7c774c3c5f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:18.535051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35d052fd93e4b24a23a0c7c774c3c5f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:18.536064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35d052fd93e4b24a23a0c7c774c3c5f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:18.536743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35d052fd93e4b24a23a0c7c774c3c5f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:18.555012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35d052fd93e4b24a23a0c7c774c3c5f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:18.578552 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2813/5645] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:18 2022] DELETE /identity/v3/users/d35d052fd93e4b24a23a0c7c774c3c5f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:18.580063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a75b8-4f12-4d78-8136-dda46919dbc3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:18.580528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a75b8-4f12-4d78-8136-dda46919dbc3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:18.580729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a75b8-4f12-4d78-8136-dda46919dbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:18.624386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5a7a75b8-4f12-4d78-8136-dda46919dbc3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:18.625942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5a7a75b8-4f12-4d78-8136-dda46919dbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:18.768079 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2833/5646] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:18.808906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:18.810452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:18.906793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e77fe-ed95-4581-87f6-ab3550df02d2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:18.911110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365118b-5a91-441d-a473-01a914805fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:18.911953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365118b-5a91-441d-a473-01a914805fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:18.912471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365118b-5a91-441d-a473-01a914805fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:18.912996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365118b-5a91-441d-a473-01a914805fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:18.927279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365118b-5a91-441d-a473-01a914805fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:18.931291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365118b-5a91-441d-a473-01a914805fd5 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:18.959494 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2814/5647] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:20.608922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a75b8-4f12-4d78-8136-dda46919dbc3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:20.611242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5a7a75b8-4f12-4d78-8136-dda46919dbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:20.625699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a75b8-4f12-4d78-8136-dda46919dbc3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:20.631707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:20.632658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:20.633155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:20.633671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] PATH_INFO: `/v3/projects/25519c1d1a2645ef9ea714c7d98d17a1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:20.635482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25519c1d1a2645ef9ea714c7d98d17a1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:20.637786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:20.719987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:20.762314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25519c1d1a2645ef9ea714c7d98d17a1', 'request_id': 'req-2e9ba658-a791-4ec8-978d-1343536cddf5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:20.794083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25519c1d1a2645ef9ea714c7d98d17a1', 'request_id': 'req-2e9ba658-a791-4ec8-978d-1343536cddf5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:20.817396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25519c1d1a2645ef9ea714c7d98d17a1', 'request_id': 'req-2e9ba658-a791-4ec8-978d-1343536cddf5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:20.851570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] The token cache is being invalidate because project 25519c1d1a2645ef9ea714c7d98d17a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:20.851877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:20.852579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:20.856833 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2834/5648] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:20 2022] DELETE /identity/v3/projects/25519c1d1a2645ef9ea714c7d98d17a1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:20.861624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365118b-5a91-441d-a473-01a914805fd5 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:20.886136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365118b-5a91-441d-a473-01a914805fd5 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:20.972512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:21.007132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76cd0d-fb55-403a-b609-6f9226e7efd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:21.008138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76cd0d-fb55-403a-b609-6f9226e7efd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:21.008776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76cd0d-fb55-403a-b609-6f9226e7efd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:21.009326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76cd0d-fb55-403a-b609-6f9226e7efd0 admin admin] PATH_INFO: `/v3/users/bd07dda69328432d80de4bbbe5faa23c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:21.010864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76cd0d-fb55-403a-b609-6f9226e7efd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd07dda69328432d80de4bbbe5faa23c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:21.013269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76cd0d-fb55-403a-b609-6f9226e7efd0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:21.137745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fc76cd0d-fb55-403a-b609-6f9226e7efd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd07dda69328432d80de4bbbe5faa23c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:21.174929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fc76cd0d-fb55-403a-b609-6f9226e7efd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd07dda69328432d80de4bbbe5faa23c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:21.175939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fc76cd0d-fb55-403a-b609-6f9226e7efd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd07dda69328432d80de4bbbe5faa23c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:21.176807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fc76cd0d-fb55-403a-b609-6f9226e7efd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd07dda69328432d80de4bbbe5faa23c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:21.203783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fc76cd0d-fb55-403a-b609-6f9226e7efd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd07dda69328432d80de4bbbe5faa23c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:21.250533 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2815/5649] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:20 2022] DELETE /identity/v3/users/bd07dda69328432d80de4bbbe5faa23c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:24.366684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:24.369731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:24.417157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ba658-a791-4ec8-978d-1343536cddf5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:24.594734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304fdb5-46ea-4755-80bd-5bd3564e6295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:24.595410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304fdb5-46ea-4755-80bd-5bd3564e6295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:24.595695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304fdb5-46ea-4755-80bd-5bd3564e6295 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:24.595974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304fdb5-46ea-4755-80bd-5bd3564e6295 admin admin] PATH_INFO: `/v3/projects/b637a7c116ab474997655e434b356905` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:24.606275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304fdb5-46ea-4755-80bd-5bd3564e6295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b637a7c116ab474997655e434b356905)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:24.608243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304fdb5-46ea-4755-80bd-5bd3564e6295 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:24.722313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e304fdb5-46ea-4755-80bd-5bd3564e6295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b637a7c116ab474997655e434b356905', 'request_id': 'req-e304fdb5-46ea-4755-80bd-5bd3564e6295'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:24.737066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e304fdb5-46ea-4755-80bd-5bd3564e6295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b637a7c116ab474997655e434b356905', 'request_id': 'req-e304fdb5-46ea-4755-80bd-5bd3564e6295'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:24.747762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e304fdb5-46ea-4755-80bd-5bd3564e6295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b637a7c116ab474997655e434b356905', 'request_id': 'req-e304fdb5-46ea-4755-80bd-5bd3564e6295'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:24.775279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e304fdb5-46ea-4755-80bd-5bd3564e6295 admin admin] The token cache is being invalidate because project b637a7c116ab474997655e434b356905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:24.775579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e304fdb5-46ea-4755-80bd-5bd3564e6295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:24.776270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e304fdb5-46ea-4755-80bd-5bd3564e6295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:24.781142 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2835/5650] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:24 2022] DELETE /identity/v3/projects/b637a7c116ab474997655e434b356905 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:24.782932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba3dc5-bcc8-4a2c-8a7a-a74250175600 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:24.783399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba3dc5-bcc8-4a2c-8a7a-a74250175600 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:24.783595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba3dc5-bcc8-4a2c-8a7a-a74250175600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:24.821402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b8ba3dc5-bcc8-4a2c-8a7a-a74250175600 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:24.822654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b8ba3dc5-bcc8-4a2c-8a7a-a74250175600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:24.952514 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2816/5651] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:24.961234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183e73-9dbc-4c46-97c2-2aed9f0edf25 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:24.961855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183e73-9dbc-4c46-97c2-2aed9f0edf25 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:24.962202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183e73-9dbc-4c46-97c2-2aed9f0edf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:24.990209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b1183e73-9dbc-4c46-97c2-2aed9f0edf25 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:24.991728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b1183e73-9dbc-4c46-97c2-2aed9f0edf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:25.008310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba3dc5-bcc8-4a2c-8a7a-a74250175600 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:25.021567 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2836/5652] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:25.021924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba3dc5-bcc8-4a2c-8a7a-a74250175600 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:25.028463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df00558-84af-42dc-a746-882c9bfba20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:25.029176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df00558-84af-42dc-a746-882c9bfba20c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:25.029562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df00558-84af-42dc-a746-882c9bfba20c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:25.029959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df00558-84af-42dc-a746-882c9bfba20c admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:25.031042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df00558-84af-42dc-a746-882c9bfba20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:13:25.031453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df00558-84af-42dc-a746-882c9bfba20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:25.033386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df00558-84af-42dc-a746-882c9bfba20c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:25.056404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183e73-9dbc-4c46-97c2-2aed9f0edf25 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:25.062727 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2817/5653] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:25.067234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183e73-9dbc-4c46-97c2-2aed9f0edf25 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:25.073035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420e74-007e-4794-b0ac-123f8a690b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:25.073866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420e74-007e-4794-b0ac-123f8a690b29 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:25.074152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420e74-007e-4794-b0ac-123f8a690b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:25.074423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420e74-007e-4794-b0ac-123f8a690b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:25.075246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b420e74-007e-4794-b0ac-123f8a690b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:25.077497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b420e74-007e-4794-b0ac-123f8a690b29 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:25.111567 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2837/5654] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:25 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:25.113771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df00558-84af-42dc-a746-882c9bfba20c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:25.125624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df00558-84af-42dc-a746-882c9bfba20c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:25.212352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:25.223388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f06ff-4987-4eda-b297-bfd5347529ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:25.224396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f06ff-4987-4eda-b297-bfd5347529ce admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:25.225001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f06ff-4987-4eda-b297-bfd5347529ce admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:25.225878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f06ff-4987-4eda-b297-bfd5347529ce admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:25.226765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f06ff-4987-4eda-b297-bfd5347529ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:25.229800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f06ff-4987-4eda-b297-bfd5347529ce admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:25.280372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420e74-007e-4794-b0ac-123f8a690b29 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:25.283554 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2818/5655] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:25 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:25.288769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3b420e74-007e-4794-b0ac-123f8a690b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:25.292038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f06ff-4987-4eda-b297-bfd5347529ce admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:25.320578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420e74-007e-4794-b0ac-123f8a690b29 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:25.325505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f06ff-4987-4eda-b297-bfd5347529ce admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:25.334150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6c3c9-5601-4e44-bc35-1facd347ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:25.335198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6c3c9-5601-4e44-bc35-1facd347ec11 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:25.335700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6c3c9-5601-4e44-bc35-1facd347ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:25.336068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d0bee-5d70-47ac-a808-e4360b2fa5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:25.336562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6c3c9-5601-4e44-bc35-1facd347ec11 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:25.337639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6c3c9-5601-4e44-bc35-1facd347ec11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:25.337973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d0bee-5d70-47ac-a808-e4360b2fa5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:25.338239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d0bee-5d70-47ac-a808-e4360b2fa5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:25.338919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d0bee-5d70-47ac-a808-e4360b2fa5d4 admin admin] PATH_INFO: `/v3/users/345fc5b62ae34cdc8323d5afb75a8a34` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:25.340986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6c3c9-5601-4e44-bc35-1facd347ec11 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:25.342188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d0bee-5d70-47ac-a808-e4360b2fa5d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=345fc5b62ae34cdc8323d5afb75a8a34)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:25.344276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d0bee-5d70-47ac-a808-e4360b2fa5d4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:25.362372 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2819/5656] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:25.366655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6c3c9-5601-4e44-bc35-1facd347ec11 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:25.387475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6c3c9-5601-4e44-bc35-1facd347ec11 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:25.389072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:25.399699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15051f1d-d64b-49c2-b2d0-d6e1366e3a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:25.401507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15051f1d-d64b-49c2-b2d0-d6e1366e3a74 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:25.402083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15051f1d-d64b-49c2-b2d0-d6e1366e3a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:25.402587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15051f1d-d64b-49c2-b2d0-d6e1366e3a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:25.403593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15051f1d-d64b-49c2-b2d0-d6e1366e3a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:25.406425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15051f1d-d64b-49c2-b2d0-d6e1366e3a74 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:25.434368 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2820/5657] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:13:25.435688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15051f1d-d64b-49c2-b2d0-d6e1366e3a74 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:25.451604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-279d0bee-5d70-47ac-a808-e4360b2fa5d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345fc5b62ae34cdc8323d5afb75a8a34'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:25.452319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15051f1d-d64b-49c2-b2d0-d6e1366e3a74 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:25.459486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f255c5-f3d9-4c12-926a-b8d7f7818acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:25.460450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f255c5-f3d9-4c12-926a-b8d7f7818acf admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:25.461461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f255c5-f3d9-4c12-926a-b8d7f7818acf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:25.461789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f255c5-f3d9-4c12-926a-b8d7f7818acf admin admin] PATH_INFO: `/v3/projects/f557bac39ab348e5bc8a3e390270d50b/users/d807485d721443b7971497f7915b7037/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:25.470155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-279d0bee-5d70-47ac-a808-e4360b2fa5d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345fc5b62ae34cdc8323d5afb75a8a34'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:25.471805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-279d0bee-5d70-47ac-a808-e4360b2fa5d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345fc5b62ae34cdc8323d5afb75a8a34'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:25.472650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-279d0bee-5d70-47ac-a808-e4360b2fa5d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345fc5b62ae34cdc8323d5afb75a8a34'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:25.500113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f255c5-f3d9-4c12-926a-b8d7f7818acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f557bac39ab348e5bc8a3e390270d50b, user_id=d807485d721443b7971497f7915b7037, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:25.500367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-279d0bee-5d70-47ac-a808-e4360b2fa5d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345fc5b62ae34cdc8323d5afb75a8a34'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:25.504242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f255c5-f3d9-4c12-926a-b8d7f7818acf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:25.520466 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2838/5658] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:25 2022] DELETE /identity/v3/users/345fc5b62ae34cdc8323d5afb75a8a34 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:25.546959 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2821/5659] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:25 2022] PUT /identity/v3/projects/f557bac39ab348e5bc8a3e390270d50b/users/d807485d721443b7971497f7915b7037/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:25.559130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2aa6f-67bb-4b4a-b947-b8bbf22076a5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:25.559415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2aa6f-67bb-4b4a-b947-b8bbf22076a5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:25.559958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2aa6f-67bb-4b4a-b947-b8bbf22076a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:25.599864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-aea2aa6f-67bb-4b4a-b947-b8bbf22076a5 None None] MFA Rules not processed for user `d807485d721443b7971497f7915b7037`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:25.601667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-aea2aa6f-67bb-4b4a-b947-b8bbf22076a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:25.734695 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2839/5660] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:25.735399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f255c5-f3d9-4c12-926a-b8d7f7818acf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:25.737241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-16f255c5-f3d9-4c12-926a-b8d7f7818acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:25.865211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f255c5-f3d9-4c12-926a-b8d7f7818acf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:25.987724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e78a4e-cf43-4399-a5d3-58f0ad4e25d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:25.988658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e78a4e-cf43-4399-a5d3-58f0ad4e25d3 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:25.988947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e78a4e-cf43-4399-a5d3-58f0ad4e25d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:25.989239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e78a4e-cf43-4399-a5d3-58f0ad4e25d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:25.989893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e78a4e-cf43-4399-a5d3-58f0ad4e25d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:25.993907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e78a4e-cf43-4399-a5d3-58f0ad4e25d3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:26.028087 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2822/5661] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:25 2022] POST /identity/v3/projects => generated 367 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:26.033083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2aa6f-67bb-4b4a-b947-b8bbf22076a5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:26.045300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2aa6f-67bb-4b4a-b947-b8bbf22076a5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:26.126607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eefd4e-33e2-4f57-aed5-be0f5293adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:26.127147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eefd4e-33e2-4f57-aed5-be0f5293adf3 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:26.127591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eefd4e-33e2-4f57-aed5-be0f5293adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:26.127862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eefd4e-33e2-4f57-aed5-be0f5293adf3 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:26.129139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eefd4e-33e2-4f57-aed5-be0f5293adf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:26.131135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eefd4e-33e2-4f57-aed5-be0f5293adf3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:26.162750 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2840/5662] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:26 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:13:26.166790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e78a4e-cf43-4399-a5d3-58f0ad4e25d3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:26.180154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e78a4e-cf43-4399-a5d3-58f0ad4e25d3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:26.199132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bef56f-a37b-4cc1-8bb5-9362e7bfbc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:26.199762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bef56f-a37b-4cc1-8bb5-9362e7bfbc2c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:26.200044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bef56f-a37b-4cc1-8bb5-9362e7bfbc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:26.201282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bef56f-a37b-4cc1-8bb5-9362e7bfbc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:26.201427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bef56f-a37b-4cc1-8bb5-9362e7bfbc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:26.203521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bef56f-a37b-4cc1-8bb5-9362e7bfbc2c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:26.223328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eefd4e-33e2-4f57-aed5-be0f5293adf3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:26.229509 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2823/5663] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:13:26.235702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eefd4e-33e2-4f57-aed5-be0f5293adf3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:26.246705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c448e1-4fa3-4852-88db-6a01a5f33037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:26.247672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c448e1-4fa3-4852-88db-6a01a5f33037 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:26.247959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c448e1-4fa3-4852-88db-6a01a5f33037 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:26.248447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c448e1-4fa3-4852-88db-6a01a5f33037 admin admin] PATH_INFO: `/v3/projects/3acc195957ea4d1ca97cc8ea71cb6c29/users/18019f70668242178bb1a634a278206a/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:26.267119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:26.293277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c448e1-4fa3-4852-88db-6a01a5f33037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acc195957ea4d1ca97cc8ea71cb6c29, user_id=18019f70668242178bb1a634a278206a, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:26.296501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c448e1-4fa3-4852-88db-6a01a5f33037 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:26.323825 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2841/5664] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:26 2022] PUT /identity/v3/projects/3acc195957ea4d1ca97cc8ea71cb6c29/users/18019f70668242178bb1a634a278206a/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:13:26.327691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bef56f-a37b-4cc1-8bb5-9362e7bfbc2c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:26.342813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bef56f-a37b-4cc1-8bb5-9362e7bfbc2c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:26.379437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:26.434670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d50f1-6860-4921-ab99-44b0f8a0c8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:26.435174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d50f1-6860-4921-ab99-44b0f8a0c8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:26.435554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d50f1-6860-4921-ab99-44b0f8a0c8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:26.436316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d50f1-6860-4921-ab99-44b0f8a0c8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:26.437733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d50f1-6860-4921-ab99-44b0f8a0c8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:26.439754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d50f1-6860-4921-ab99-44b0f8a0c8e4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:26.459489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c448e1-4fa3-4852-88db-6a01a5f33037 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:26.465352 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2824/5665] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:26.474840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c448e1-4fa3-4852-88db-6a01a5f33037 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:26.490929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2de63-e772-43ec-b031-11d03390af7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:26.492010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2de63-e772-43ec-b031-11d03390af7b admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:26.492517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2de63-e772-43ec-b031-11d03390af7b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:26.493061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2de63-e772-43ec-b031-11d03390af7b admin admin] PATH_INFO: `/v3/projects/3acc195957ea4d1ca97cc8ea71cb6c29/users/18019f70668242178bb1a634a278206a/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:26.495995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2de63-e772-43ec-b031-11d03390af7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acc195957ea4d1ca97cc8ea71cb6c29, user_id=18019f70668242178bb1a634a278206a, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:26.500715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2de63-e772-43ec-b031-11d03390af7b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:26.521571 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2842/5666] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:26 2022] PUT /identity/v3/projects/3acc195957ea4d1ca97cc8ea71cb6c29/users/18019f70668242178bb1a634a278206a/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:26.532626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2b721-791d-40d7-931f-8105c84b5fd4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:26.532916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2b721-791d-40d7-931f-8105c84b5fd4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:26.533213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2b721-791d-40d7-931f-8105c84b5fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:26.568223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3bb2b721-791d-40d7-931f-8105c84b5fd4 None None] MFA Rules not processed for user `18019f70668242178bb1a634a278206a`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:26.570141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3bb2b721-791d-40d7-931f-8105c84b5fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:26.594111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2de63-e772-43ec-b031-11d03390af7b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:26.596469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-83a2de63-e772-43ec-b031-11d03390af7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:26.674133 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2825/5667] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:26.677226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2b721-791d-40d7-931f-8105c84b5fd4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:26.688038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2b721-791d-40d7-931f-8105c84b5fd4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:26.694890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb78a7-dd86-495b-9d1d-02679aa61aec tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:26.695881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb78a7-dd86-495b-9d1d-02679aa61aec tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:26.696415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb78a7-dd86-495b-9d1d-02679aa61aec tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:26.697321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb78a7-dd86-495b-9d1d-02679aa61aec tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:26.698243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb78a7-dd86-495b-9d1d-02679aa61aec tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:26.700465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb78a7-dd86-495b-9d1d-02679aa61aec tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:26.726907 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2826/5668] 10.222.0.26 () {60 vars in 1150 bytes} [Sat Oct 8 21:13:26 2022] POST /identity/v3/domains => generated 276 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:26.737205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb78a7-dd86-495b-9d1d-02679aa61aec tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:26.759843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2de63-e772-43ec-b031-11d03390af7b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:26.859608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7f9a8-ccb1-466b-9991-6746548c6184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:26.860890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7f9a8-ccb1-466b-9991-6746548c6184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:26.861371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7f9a8-ccb1-466b-9991-6746548c6184 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:26.862257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7f9a8-ccb1-466b-9991-6746548c6184 admin admin] PATH_INFO: `/v3/projects/3207efb3c2484385b24e40119d1bb71a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:26.864891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7f9a8-ccb1-466b-9991-6746548c6184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3207efb3c2484385b24e40119d1bb71a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:26.869128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7f9a8-ccb1-466b-9991-6746548c6184 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:26.880108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb78a7-dd86-495b-9d1d-02679aa61aec tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:26.886830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a06fd-cdd0-4d21-abdc-15e5c2494958 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:26.887685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a06fd-cdd0-4d21-abdc-15e5c2494958 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:26.888039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a06fd-cdd0-4d21-abdc-15e5c2494958 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:26.888388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a06fd-cdd0-4d21-abdc-15e5c2494958 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:26.889121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a06fd-cdd0-4d21-abdc-15e5c2494958 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:26.890996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a06fd-cdd0-4d21-abdc-15e5c2494958 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:26.915670 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2827/5669] 10.222.0.26 () {60 vars in 1150 bytes} [Sat Oct 8 21:13:26 2022] POST /identity/v3/domains => generated 277 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:26.919539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a06fd-cdd0-4d21-abdc-15e5c2494958 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:26.965219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:26.987337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23e7f9a8-ccb1-466b-9991-6746548c6184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3207efb3c2484385b24e40119d1bb71a', 'request_id': 'req-23e7f9a8-ccb1-466b-9991-6746548c6184'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.020387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23e7f9a8-ccb1-466b-9991-6746548c6184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3207efb3c2484385b24e40119d1bb71a', 'request_id': 'req-23e7f9a8-ccb1-466b-9991-6746548c6184'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.031187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23e7f9a8-ccb1-466b-9991-6746548c6184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3207efb3c2484385b24e40119d1bb71a', 'request_id': 'req-23e7f9a8-ccb1-466b-9991-6746548c6184'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.055299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23e7f9a8-ccb1-466b-9991-6746548c6184 admin admin] The token cache is being invalidate because project 3207efb3c2484385b24e40119d1bb71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:27.055816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23e7f9a8-ccb1-466b-9991-6746548c6184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.056936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23e7f9a8-ccb1-466b-9991-6746548c6184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.064834 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2843/5670] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:26 2022] DELETE /identity/v3/projects/3207efb3c2484385b24e40119d1bb71a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:27.067388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715cf8e-47e1-42b5-9867-075317ec626f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:27.067937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715cf8e-47e1-42b5-9867-075317ec626f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:27.068492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715cf8e-47e1-42b5-9867-075317ec626f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:27.080663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a06fd-cdd0-4d21-abdc-15e5c2494958 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:27.119322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2715cf8e-47e1-42b5-9867-075317ec626f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:27.120772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2715cf8e-47e1-42b5-9867-075317ec626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:27.138998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:27.181495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac802b9-5c63-4c7e-8b53-4f1a9db208fe tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:27.182705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac802b9-5c63-4c7e-8b53-4f1a9db208fe tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:27.183133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac802b9-5c63-4c7e-8b53-4f1a9db208fe tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:27.183434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac802b9-5c63-4c7e-8b53-4f1a9db208fe tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:27.185120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac802b9-5c63-4c7e-8b53-4f1a9db208fe tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:27.187046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac802b9-5c63-4c7e-8b53-4f1a9db208fe tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:27.213241 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2828/5671] 10.222.0.26 () {60 vars in 1150 bytes} [Sat Oct 8 21:13:26 2022] POST /identity/v3/domains => generated 277 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:27.215696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac802b9-5c63-4c7e-8b53-4f1a9db208fe tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:27.219512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4ac802b9-5c63-4c7e-8b53-4f1a9db208fe tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:27.247769 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2844/5672] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:27.256430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735de03d-3b77-47bf-908d-215a4f8c0d53 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:27.256721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735de03d-3b77-47bf-908d-215a4f8c0d53 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:27.256997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735de03d-3b77-47bf-908d-215a4f8c0d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:27.281592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-735de03d-3b77-47bf-908d-215a4f8c0d53 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:27.284259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-735de03d-3b77-47bf-908d-215a4f8c0d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:27.386173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac802b9-5c63-4c7e-8b53-4f1a9db208fe tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:27.386604 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2845/5673] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:27.392954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735de03d-3b77-47bf-908d-215a4f8c0d53 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:27.395609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec756b-a99f-4a64-b8f5-9e085ca4842d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:27.396673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec756b-a99f-4a64-b8f5-9e085ca4842d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:27.397150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec756b-a99f-4a64-b8f5-9e085ca4842d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:27.397521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec756b-a99f-4a64-b8f5-9e085ca4842d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:27.398545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec756b-a99f-4a64-b8f5-9e085ca4842d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:27.403191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec756b-a99f-4a64-b8f5-9e085ca4842d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:27.407866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735de03d-3b77-47bf-908d-215a4f8c0d53 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:27.415617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e4726-c86f-4d5b-a34f-0ba62060e196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:27.416411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4726-c86f-4d5b-a34f-0ba62060e196 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:27.417031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4726-c86f-4d5b-a34f-0ba62060e196 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:27.417444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4726-c86f-4d5b-a34f-0ba62060e196 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:27.418314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e4726-c86f-4d5b-a34f-0ba62060e196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:13:27.418949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e4726-c86f-4d5b-a34f-0ba62060e196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:27.421418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e4726-c86f-4d5b-a34f-0ba62060e196 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:27.430217 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2829/5674] 10.222.0.26 () {60 vars in 1150 bytes} [Sat Oct 8 21:13:27 2022] POST /identity/v3/domains => generated 280 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:27.434055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec756b-a99f-4a64-b8f5-9e085ca4842d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:27.442962 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2846/5675] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:27.443967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e4726-c86f-4d5b-a34f-0ba62060e196 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:27.462365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e4726-c86f-4d5b-a34f-0ba62060e196 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:27.577793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee1a4a-cf4c-487c-b891-7444cdc10552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:27.579046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1a4a-cf4c-487c-b891-7444cdc10552 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:27.579371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1a4a-cf4c-487c-b891-7444cdc10552 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:27.579602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1a4a-cf4c-487c-b891-7444cdc10552 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:27.580231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee1a4a-cf4c-487c-b891-7444cdc10552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:27.582597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee1a4a-cf4c-487c-b891-7444cdc10552 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:27.587632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:27.593065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec756b-a99f-4a64-b8f5-9e085ca4842d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:27.620348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:27.621774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:27.622435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:27.623112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/871df34c5e8a4ba5a83633dcdd62e9e5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:27.637275 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2847/5676] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:27 2022] POST /identity/v3/projects => generated 395 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:27.639951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee1a4a-cf4c-487c-b891-7444cdc10552 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:27.672965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=871df34c5e8a4ba5a83633dcdd62e9e5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:27.682103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:27.726860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '871df34c5e8a4ba5a83633dcdd62e9e5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.742437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '871df34c5e8a4ba5a83633dcdd62e9e5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.767750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:27.845837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee1a4a-cf4c-487c-b891-7444cdc10552 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:27.861971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871df34c5e8a4ba5a83633dcdd62e9e5', 'request_id': 'req-f5c5390d-66aa-44d6-b2ab-25bf70259779'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.884035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871df34c5e8a4ba5a83633dcdd62e9e5', 'request_id': 'req-f5c5390d-66aa-44d6-b2ab-25bf70259779'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.894890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871df34c5e8a4ba5a83633dcdd62e9e5', 'request_id': 'req-f5c5390d-66aa-44d6-b2ab-25bf70259779'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.916646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] The token cache is being invalidate because project 871df34c5e8a4ba5a83633dcdd62e9e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:27.916868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.917564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.927602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '871df34c5e8a4ba5a83633dcdd62e9e5', 'request_id': 'req-f5c5390d-66aa-44d6-b2ab-25bf70259779'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.928483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '871df34c5e8a4ba5a83633dcdd62e9e5', 'request_id': 'req-f5c5390d-66aa-44d6-b2ab-25bf70259779'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.934715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '871df34c5e8a4ba5a83633dcdd62e9e5', 'request_id': 'req-f5c5390d-66aa-44d6-b2ab-25bf70259779'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:27.945225 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2830/5677] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:13:27 2022] DELETE /identity/v3/domains/871df34c5e8a4ba5a83633dcdd62e9e5 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:13:27.948754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:27.953049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f228f-e8b4-4341-9bbe-35cabde37de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:27.953883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f228f-e8b4-4341-9bbe-35cabde37de4 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:27.954265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f228f-e8b4-4341-9bbe-35cabde37de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:27.954625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:27.954860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f228f-e8b4-4341-9bbe-35cabde37de4 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:27.955649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f228f-e8b4-4341-9bbe-35cabde37de4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:27.958090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f228f-e8b4-4341-9bbe-35cabde37de4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:27.993475 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2848/5678] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:27 2022] POST /identity/v3/users => generated 298 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:27.994489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f228f-e8b4-4341-9bbe-35cabde37de4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:27.996967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bf0f228f-e8b4-4341-9bbe-35cabde37de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:28.024903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f228f-e8b4-4341-9bbe-35cabde37de4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:28.042156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0579dee-f570-4296-aec1-8f2f35edd0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:28.045465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0579dee-f570-4296-aec1-8f2f35edd0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:28.045935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0579dee-f570-4296-aec1-8f2f35edd0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:28.046376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0579dee-f570-4296-aec1-8f2f35edd0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:28.048370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0579dee-f570-4296-aec1-8f2f35edd0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:28.050720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0579dee-f570-4296-aec1-8f2f35edd0e5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:28.077167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5390d-66aa-44d6-b2ab-25bf70259779 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:28.082408 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2849/5679] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:13:28.083644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77df92a-352c-4143-acc2-1c97a23c85eb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:28.083921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c617cab-dad7-4361-8b09-afb110e70d33 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:28.084266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c617cab-dad7-4361-8b09-afb110e70d33 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:28.084541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c617cab-dad7-4361-8b09-afb110e70d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:28.085363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77df92a-352c-4143-acc2-1c97a23c85eb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:28.085925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77df92a-352c-4143-acc2-1c97a23c85eb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:28.086432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77df92a-352c-4143-acc2-1c97a23c85eb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:28.087451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77df92a-352c-4143-acc2-1c97a23c85eb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:28.090207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77df92a-352c-4143-acc2-1c97a23c85eb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:28.131156 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2831/5680] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:13:27 2022] POST /identity/v3/domains => generated 249 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:13:28.131156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77df92a-352c-4143-acc2-1c97a23c85eb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:28.144716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5c617cab-dad7-4361-8b09-afb110e70d33 None None] MFA Rules not processed for user `6aef5df0d6004b968d4280a94e1847da`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:28.148359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5c617cab-dad7-4361-8b09-afb110e70d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:28.185457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:28.278736 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2850/5681] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:28.279795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c617cab-dad7-4361-8b09-afb110e70d33 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:28.312410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77df92a-352c-4143-acc2-1c97a23c85eb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:28.328239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a50ee-eb95-46ef-bb18-8b5deb761005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:28.329677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a50ee-eb95-46ef-bb18-8b5deb761005 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:28.332021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a50ee-eb95-46ef-bb18-8b5deb761005 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:28.332402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a50ee-eb95-46ef-bb18-8b5deb761005 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:28.333215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a50ee-eb95-46ef-bb18-8b5deb761005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:28.340163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a50ee-eb95-46ef-bb18-8b5deb761005 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:28.370243 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2832/5682] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:28.376667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32842868-da7f-4f1f-96c2-8618b2842903 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:28.377202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32842868-da7f-4f1f-96c2-8618b2842903 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:28.377716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32842868-da7f-4f1f-96c2-8618b2842903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:28.433030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-32842868-da7f-4f1f-96c2-8618b2842903 None None] MFA Rules not processed for user `0a6b3f4cefa94e269186f9d9e5aff559`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:28.433437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:28.435776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-32842868-da7f-4f1f-96c2-8618b2842903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:28.480397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c617cab-dad7-4361-8b09-afb110e70d33 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:28.501234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23a07-c3d3-4ecf-9098-cdda3f2e6fc9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:28.502464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23a07-c3d3-4ecf-9098-cdda3f2e6fc9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:28.505584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23a07-c3d3-4ecf-9098-cdda3f2e6fc9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:28.506238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23a07-c3d3-4ecf-9098-cdda3f2e6fc9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/f357b9abf21b4298a08e89f0c438ac5e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:28.542388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa23a07-c3d3-4ecf-9098-cdda3f2e6fc9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f357b9abf21b4298a08e89f0c438ac5e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:28.544113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa23a07-c3d3-4ecf-9098-cdda3f2e6fc9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:28.594999 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2833/5683] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:28.596119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32842868-da7f-4f1f-96c2-8618b2842903 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:28.608213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dfa23a07-c3d3-4ecf-9098-cdda3f2e6fc9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f357b9abf21b4298a08e89f0c438ac5e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:28.610893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32842868-da7f-4f1f-96c2-8618b2842903 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:28.611393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dfa23a07-c3d3-4ecf-9098-cdda3f2e6fc9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f357b9abf21b4298a08e89f0c438ac5e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:28.616832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801deada-eeb0-404f-9a7a-9751543d8440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:28.617545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801deada-eeb0-404f-9a7a-9751543d8440 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:28.617951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801deada-eeb0-404f-9a7a-9751543d8440 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:28.618357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801deada-eeb0-404f-9a7a-9751543d8440 admin admin] PATH_INFO: `/v3/projects/38ddedd2c2754cdb8c60acf585f86f2a/users/b6300eee278b4fad9561ebea03c2eeaa/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:28.643565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801deada-eeb0-404f-9a7a-9751543d8440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ddedd2c2754cdb8c60acf585f86f2a, user_id=b6300eee278b4fad9561ebea03c2eeaa, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:28.657503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801deada-eeb0-404f-9a7a-9751543d8440 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:28.673989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dfa23a07-c3d3-4ecf-9098-cdda3f2e6fc9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f357b9abf21b4298a08e89f0c438ac5e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:28.674796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dfa23a07-c3d3-4ecf-9098-cdda3f2e6fc9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f357b9abf21b4298a08e89f0c438ac5e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:28.688173 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2851/5684] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:28 2022] PATCH /identity/v3/domains/f357b9abf21b4298a08e89f0c438ac5e => generated 250 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:28.692001 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2834/5685] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:28 2022] PUT /identity/v3/projects/38ddedd2c2754cdb8c60acf585f86f2a/users/b6300eee278b4fad9561ebea03c2eeaa/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:28.692270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23a07-c3d3-4ecf-9098-cdda3f2e6fc9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:28.694471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801deada-eeb0-404f-9a7a-9751543d8440 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:28.695769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dfa23a07-c3d3-4ecf-9098-cdda3f2e6fc9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:28.698448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-801deada-eeb0-404f-9a7a-9751543d8440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:28.872333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801deada-eeb0-404f-9a7a-9751543d8440 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:28.878495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:28.879437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:28.880704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:28.880704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/f357b9abf21b4298a08e89f0c438ac5e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:28.896361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f357b9abf21b4298a08e89f0c438ac5e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:28.898290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:28.928068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23a07-c3d3-4ecf-9098-cdda3f2e6fc9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:28.935169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f357b9abf21b4298a08e89f0c438ac5e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:28.947834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f357b9abf21b4298a08e89f0c438ac5e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:28.959352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:29.009750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f357b9abf21b4298a08e89f0c438ac5e', 'request_id': 'req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.023412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f357b9abf21b4298a08e89f0c438ac5e', 'request_id': 'req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.030748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37867-4a5b-4750-bda5-37afbba3cdf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:29.031426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37867-4a5b-4750-bda5-37afbba3cdf8 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:29.031712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37867-4a5b-4750-bda5-37afbba3cdf8 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:29.031855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f357b9abf21b4298a08e89f0c438ac5e', 'request_id': 'req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.031973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37867-4a5b-4750-bda5-37afbba3cdf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:29.033856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-38a37867-4a5b-4750-bda5-37afbba3cdf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:29.047530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] The token cache is being invalidate because project f357b9abf21b4298a08e89f0c438ac5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:29.047761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.048669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.074309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f357b9abf21b4298a08e89f0c438ac5e', 'request_id': 'req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.075555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f357b9abf21b4298a08e89f0c438ac5e', 'request_id': 'req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.080279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f357b9abf21b4298a08e89f0c438ac5e', 'request_id': 'req-8780d070-03b9-4e8e-ae4f-913b25e7ca1f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.088902 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2835/5686] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:13:28 2022] DELETE /identity/v3/domains/f357b9abf21b4298a08e89f0c438ac5e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:29.090629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ef2f0-1979-4bdc-9921-30fc5fed7141 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:29.091120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ef2f0-1979-4bdc-9921-30fc5fed7141 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:29.091502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ef2f0-1979-4bdc-9921-30fc5fed7141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:29.117870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8e7ef2f0-1979-4bdc-9921-30fc5fed7141 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:29.119448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8e7ef2f0-1979-4bdc-9921-30fc5fed7141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:29.135343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:29.196170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a37867-4a5b-4750-bda5-37afbba3cdf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:29.197825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a37867-4a5b-4750-bda5-37afbba3cdf8 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:29.226481 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2852/5687] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:28 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:29.227430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37867-4a5b-4750-bda5-37afbba3cdf8 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:29.232414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-38a37867-4a5b-4750-bda5-37afbba3cdf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:29.252190 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2836/5688] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:29.253159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ef2f0-1979-4bdc-9921-30fc5fed7141 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:29.254501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8e7ef2f0-1979-4bdc-9921-30fc5fed7141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:29.345726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37867-4a5b-4750-bda5-37afbba3cdf8 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:29.354586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:29.355357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:29.355634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:29.355907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] PATH_INFO: `/v3/users/71e546b55bd1475782e5863ed50b6f01` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:29.358260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e546b55bd1475782e5863ed50b6f01)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:29.361111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:29.382237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ef2f0-1979-4bdc-9921-30fc5fed7141 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:29.388290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e6d5c-4ef6-4eac-9b91-ae465e9d73d0 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:29.388912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6d5c-4ef6-4eac-9b91-ae465e9d73d0 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:29.389217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6d5c-4ef6-4eac-9b91-ae465e9d73d0 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:29.390088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6d5c-4ef6-4eac-9b91-ae465e9d73d0 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:29.391536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e6d5c-4ef6-4eac-9b91-ae465e9d73d0 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:29.393384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e6d5c-4ef6-4eac-9b91-ae465e9d73d0 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:29.420450 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2837/5689] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:13:29 2022] POST /identity/v3/domains => generated 279 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:29.422499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e6d5c-4ef6-4eac-9b91-ae465e9d73d0 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:29.426067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fb9e6d5c-4ef6-4eac-9b91-ae465e9d73d0 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:29.450220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e546b55bd1475782e5863ed50b6f01'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.460525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e546b55bd1475782e5863ed50b6f01'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.461329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e546b55bd1475782e5863ed50b6f01'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.462969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e546b55bd1475782e5863ed50b6f01'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.483004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:29.506820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e546b55bd1475782e5863ed50b6f01'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.535719 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2853/5690] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:29 2022] DELETE /identity/v3/users/71e546b55bd1475782e5863ed50b6f01 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:29.536782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:29.538420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:29.594523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e6d5c-4ef6-4eac-9b91-ae465e9d73d0 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:29.639357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:29.659620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fd6ff-0f41-4ce0-905a-b6c0c60116f5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:29.668608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebc3b0-23f9-4975-bb37-a7141bb177a6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:29.669599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebc3b0-23f9-4975-bb37-a7141bb177a6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:29.670458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebc3b0-23f9-4975-bb37-a7141bb177a6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:29.671238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebc3b0-23f9-4975-bb37-a7141bb177a6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/1a43ef081688409ca45ecadc67923005` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:29.687431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebc3b0-23f9-4975-bb37-a7141bb177a6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1a43ef081688409ca45ecadc67923005)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:29.689673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebc3b0-23f9-4975-bb37-a7141bb177a6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:29.723492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-14ebc3b0-23f9-4975-bb37-a7141bb177a6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1a43ef081688409ca45ecadc67923005'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.725385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-14ebc3b0-23f9-4975-bb37-a7141bb177a6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1a43ef081688409ca45ecadc67923005'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.736594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205d544-2601-4752-bc4d-7b755bdb8052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:29.737222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205d544-2601-4752-bc4d-7b755bdb8052 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:29.738048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205d544-2601-4752-bc4d-7b755bdb8052 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:29.738334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205d544-2601-4752-bc4d-7b755bdb8052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:29.745163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d205d544-2601-4752-bc4d-7b755bdb8052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:29.772984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-14ebc3b0-23f9-4975-bb37-a7141bb177a6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1a43ef081688409ca45ecadc67923005'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.774591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-14ebc3b0-23f9-4975-bb37-a7141bb177a6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1a43ef081688409ca45ecadc67923005'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:29.780263 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2854/5691] 10.222.0.26 () {60 vars in 1250 bytes} [Sat Oct 8 21:13:29 2022] PATCH /identity/v3/domains/1a43ef081688409ca45ecadc67923005 => generated 279 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:29.786559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebc3b0-23f9-4975-bb37-a7141bb177a6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:29.788775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-14ebc3b0-23f9-4975-bb37-a7141bb177a6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:29.921463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205d544-2601-4752-bc4d-7b755bdb8052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:29.922925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205d544-2601-4752-bc4d-7b755bdb8052 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:29.951825 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2838/5692] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:29.993572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebc3b0-23f9-4975-bb37-a7141bb177a6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:29.999312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe9653-acb9-4a95-9f2c-576d4a61cf95 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:30.000413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9653-acb9-4a95-9f2c-576d4a61cf95 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:30.000917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9653-acb9-4a95-9f2c-576d4a61cf95 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:30.001603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9653-acb9-4a95-9f2c-576d4a61cf95 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/1a43ef081688409ca45ecadc67923005` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:30.019426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe9653-acb9-4a95-9f2c-576d4a61cf95 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=1a43ef081688409ca45ecadc67923005)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:30.022121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe9653-acb9-4a95-9f2c-576d4a61cf95 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:30.024815 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2855/5693] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:13:29 2022] GET /identity/v3/domains/1a43ef081688409ca45ecadc67923005 => generated 279 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:30.028443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205d544-2601-4752-bc4d-7b755bdb8052 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:30.032922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d205d544-2601-4752-bc4d-7b755bdb8052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:30.059661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205d544-2601-4752-bc4d-7b755bdb8052 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:30.071595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:30.072569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:30.073232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:30.075009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/1a43ef081688409ca45ecadc67923005` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:30.078047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1a43ef081688409ca45ecadc67923005)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:30.083160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:30.148084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1a43ef081688409ca45ecadc67923005'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:30.170039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1a43ef081688409ca45ecadc67923005'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:30.313461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a43ef081688409ca45ecadc67923005', 'request_id': 'req-99113b0c-5a8d-4590-898d-e1b8033a06d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:30.326569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:30.338465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a43ef081688409ca45ecadc67923005', 'request_id': 'req-99113b0c-5a8d-4590-898d-e1b8033a06d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:30.373431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a43ef081688409ca45ecadc67923005', 'request_id': 'req-99113b0c-5a8d-4590-898d-e1b8033a06d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:30.397217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] The token cache is being invalidate because project 1a43ef081688409ca45ecadc67923005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:30.397777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:30.398664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:30.415921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1a43ef081688409ca45ecadc67923005', 'request_id': 'req-99113b0c-5a8d-4590-898d-e1b8033a06d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:30.421438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1a43ef081688409ca45ecadc67923005', 'request_id': 'req-99113b0c-5a8d-4590-898d-e1b8033a06d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:30.426820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1a43ef081688409ca45ecadc67923005', 'request_id': 'req-99113b0c-5a8d-4590-898d-e1b8033a06d3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:30.440421 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2839/5694] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:13:30 2022] DELETE /identity/v3/domains/1a43ef081688409ca45ecadc67923005 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:13:30.442331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe9653-acb9-4a95-9f2c-576d4a61cf95 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:30.444514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-11fe9653-acb9-4a95-9f2c-576d4a61cf95 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:30.493335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe9653-acb9-4a95-9f2c-576d4a61cf95 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:30.664024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0bb65-2434-4b17-a2a8-c592f3329154 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:30.664939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0bb65-2434-4b17-a2a8-c592f3329154 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:30.665318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0bb65-2434-4b17-a2a8-c592f3329154 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:30.665680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0bb65-2434-4b17-a2a8-c592f3329154 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:30.666636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0bb65-2434-4b17-a2a8-c592f3329154 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:30.672187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0bb65-2434-4b17-a2a8-c592f3329154 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:30.701140 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2856/5695] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 8 21:13:30 2022] GET /identity/v3/domains => generated 1348 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:30.706896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:30.721052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99113b0c-5a8d-4590-898d-e1b8033a06d3 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:30.731806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473ebb6-2146-454e-9df8-697ef00d7623 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:30.732455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473ebb6-2146-454e-9df8-697ef00d7623 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:30.733606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473ebb6-2146-454e-9df8-697ef00d7623 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:30.733895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473ebb6-2146-454e-9df8-697ef00d7623 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/1a43ef081688409ca45ecadc67923005` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:30.754933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473ebb6-2146-454e-9df8-697ef00d7623 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-3473ebb6-2146-454e-9df8-697ef00d7623 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Could not find domain: 1a43ef081688409ca45ecadc67923005.: keystone.exception.DomainNotFound: Could not find domain: 1a43ef081688409ca45ecadc67923005. Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1a43ef081688409ca45ecadc67923005. Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:30.771344 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:30.772520 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1a43ef081688409ca45ecadc67923005. Oct 08 21:13:30.773605 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:30.778783 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2840/5696] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:30 2022] PATCH /identity/v3/domains/1a43ef081688409ca45ecadc67923005 => generated 112 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 08 21:13:30.785562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0bb65-2434-4b17-a2a8-c592f3329154 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:30.803939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0bb65-2434-4b17-a2a8-c592f3329154 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:30.819770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffa20d-2cae-47d1-804a-4dbc84eb4ff9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:30.820412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffa20d-2cae-47d1-804a-4dbc84eb4ff9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:30.821389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffa20d-2cae-47d1-804a-4dbc84eb4ff9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:30.822650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffa20d-2cae-47d1-804a-4dbc84eb4ff9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:30.822650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffa20d-2cae-47d1-804a-4dbc84eb4ff9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:30.828065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffa20d-2cae-47d1-804a-4dbc84eb4ff9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:30.876512 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2857/5697] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:13:30 2022] POST /identity/v3/domains => generated 277 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:30.881203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473ebb6-2146-454e-9df8-697ef00d7623 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:30.897921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473ebb6-2146-454e-9df8-697ef00d7623 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:31.025888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffa20d-2cae-47d1-804a-4dbc84eb4ff9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:31.028334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-59ffa20d-2cae-47d1-804a-4dbc84eb4ff9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:31.143240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e73407-5331-434c-96e4-f8c72f67f306 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:31.149905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e73407-5331-434c-96e4-f8c72f67f306 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:31.150227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e73407-5331-434c-96e4-f8c72f67f306 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:31.151418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e73407-5331-434c-96e4-f8c72f67f306 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:31.152141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e73407-5331-434c-96e4-f8c72f67f306 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:31.154233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e73407-5331-434c-96e4-f8c72f67f306 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:31.191875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:31.266121 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2841/5698] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:30 2022] POST /identity/v3/users => generated 348 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:31.270947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e73407-5331-434c-96e4-f8c72f67f306 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:31.296170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e73407-5331-434c-96e4-f8c72f67f306 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:31.316437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331cbf4-8f09-4538-9b80-fed733637595 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:31.317252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331cbf4-8f09-4538-9b80-fed733637595 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:31.319759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331cbf4-8f09-4538-9b80-fed733637595 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:31.320186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331cbf4-8f09-4538-9b80-fed733637595 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:31.322266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331cbf4-8f09-4538-9b80-fed733637595 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:31.330292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331cbf4-8f09-4538-9b80-fed733637595 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:31.334323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffa20d-2cae-47d1-804a-4dbc84eb4ff9 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:31.354262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:31.356117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:31.357058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:31.358249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] PATH_INFO: `/v3/projects/d75970c62311417eada44e0270dade81` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:31.360751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d75970c62311417eada44e0270dade81)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:31.367457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:31.372544 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2842/5699] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:13:31 2022] POST /identity/v3/groups => generated 323 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:31.373688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331cbf4-8f09-4538-9b80-fed733637595 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:31.394501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331cbf4-8f09-4538-9b80-fed733637595 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:31.408077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2f614-f057-4407-8af6-036a3e82dd81 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:31.408791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f614-f057-4407-8af6-036a3e82dd81 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:31.408791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f614-f057-4407-8af6-036a3e82dd81 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:31.409001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f614-f057-4407-8af6-036a3e82dd81 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/314636f478ac456aabbeec8fcfa4f317` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:31.411808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2f614-f057-4407-8af6-036a3e82dd81 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=314636f478ac456aabbeec8fcfa4f317)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:31.418340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2f614-f057-4407-8af6-036a3e82dd81 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:31.483238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c9c2f614-f057-4407-8af6-036a3e82dd81 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '314636f478ac456aabbeec8fcfa4f317'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:31.484241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c9c2f614-f057-4407-8af6-036a3e82dd81 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '314636f478ac456aabbeec8fcfa4f317'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:31.531009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75970c62311417eada44e0270dade81', 'request_id': 'req-61503ae7-2a07-427c-9ded-80c86b46d524'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:31.551567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c9c2f614-f057-4407-8af6-036a3e82dd81 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '314636f478ac456aabbeec8fcfa4f317'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:31.553389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c9c2f614-f057-4407-8af6-036a3e82dd81 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '314636f478ac456aabbeec8fcfa4f317'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:31.554395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75970c62311417eada44e0270dade81', 'request_id': 'req-61503ae7-2a07-427c-9ded-80c86b46d524'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:31.560140 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2843/5700] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:31 2022] PATCH /identity/v3/domains/314636f478ac456aabbeec8fcfa4f317 => generated 278 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:13:31.563223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2f614-f057-4407-8af6-036a3e82dd81 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:31.566103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c9c2f614-f057-4407-8af6-036a3e82dd81 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:31.570105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75970c62311417eada44e0270dade81', 'request_id': 'req-61503ae7-2a07-427c-9ded-80c86b46d524'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:31.601878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] The token cache is being invalidate because project d75970c62311417eada44e0270dade81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:31.602332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:31.604590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:31.610939 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2858/5701] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:31 2022] DELETE /identity/v3/projects/d75970c62311417eada44e0270dade81 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:31.612292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:31.614497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:31.743636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:31.799742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2f614-f057-4407-8af6-036a3e82dd81 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:31.811038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61503ae7-2a07-427c-9ded-80c86b46d524 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:31.820218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:31.820891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:31.821310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:31.821602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] PATH_INFO: `/v3/users/ab4180a8531148cba63962794a9750bf` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:31.826021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4180a8531148cba63962794a9750bf)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:31.828074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:31.934524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4180a8531148cba63962794a9750bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:31.960207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4180a8531148cba63962794a9750bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:31.961494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4180a8531148cba63962794a9750bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:31.962813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4180a8531148cba63962794a9750bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:31.965792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:31.978854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:31.979587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:31.979870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:31.980153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/314636f478ac456aabbeec8fcfa4f317` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:31.983601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4180a8531148cba63962794a9750bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.008134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=314636f478ac456aabbeec8fcfa4f317)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:32.012055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:32.027915 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2859/5702] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:31 2022] DELETE /identity/v3/users/ab4180a8531148cba63962794a9750bf => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:32.035510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:32.037633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:32.066479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '314636f478ac456aabbeec8fcfa4f317'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.214753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb627960-2ce4-4155-bd8c-f1fa3c04024a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:32.373557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f7a10309bb4996977d201fde779afc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.393111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:32.400745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f7a10309bb4996977d201fde779afc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.401292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f7a10309bb4996977d201fde779afc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.427335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f7a10309bb4996977d201fde779afc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.441723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8c5d4-3a4a-4152-8940-8a4c7bc76a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:32.443547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8c5d4-3a4a-4152-8940-8a4c7bc76a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:32.443859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8c5d4-3a4a-4152-8940-8a4c7bc76a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:32.444137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8c5d4-3a4a-4152-8940-8a4c7bc76a67 admin admin] PATH_INFO: `/v3/users/e0e5c31d4f4442a78d8148b0b9bfd9e2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:32.449394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8c5d4-3a4a-4152-8940-8a4c7bc76a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e5c31d4f4442a78d8148b0b9bfd9e2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:32.453056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8c5d4-3a4a-4152-8940-8a4c7bc76a67 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:32.477977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f7a10309bb4996977d201fde779afc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.521721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '314636f478ac456aabbeec8fcfa4f317'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.581414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5fe8c5d4-3a4a-4152-8940-8a4c7bc76a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e5c31d4f4442a78d8148b0b9bfd9e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.595288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5fe8c5d4-3a4a-4152-8940-8a4c7bc76a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e5c31d4f4442a78d8148b0b9bfd9e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.596160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5fe8c5d4-3a4a-4152-8940-8a4c7bc76a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e5c31d4f4442a78d8148b0b9bfd9e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.597411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5fe8c5d4-3a4a-4152-8940-8a4c7bc76a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e5c31d4f4442a78d8148b0b9bfd9e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.637897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5fe8c5d4-3a4a-4152-8940-8a4c7bc76a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e5c31d4f4442a78d8148b0b9bfd9e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.642193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314636f478ac456aabbeec8fcfa4f317', 'request_id': 'req-c98bc662-7eb4-45b1-914b-3d91e1d3834b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.657858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:32.661687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314636f478ac456aabbeec8fcfa4f317', 'request_id': 'req-c98bc662-7eb4-45b1-914b-3d91e1d3834b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.666254 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2860/5703] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:32 2022] DELETE /identity/v3/users/e0e5c31d4f4442a78d8148b0b9bfd9e2 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:32.671535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c9713-ebe6-40e1-9c02-442046261638 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:32.672437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c9713-ebe6-40e1-9c02-442046261638 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:32.673097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c9713-ebe6-40e1-9c02-442046261638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:32.683466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314636f478ac456aabbeec8fcfa4f317', 'request_id': 'req-c98bc662-7eb4-45b1-914b-3d91e1d3834b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.705228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] The token cache is being invalidate because project 314636f478ac456aabbeec8fcfa4f317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:32.705901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.707007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.716085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-663c9713-ebe6-40e1-9c02-442046261638 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:32.717353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-663c9713-ebe6-40e1-9c02-442046261638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:32.718740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '314636f478ac456aabbeec8fcfa4f317', 'request_id': 'req-c98bc662-7eb4-45b1-914b-3d91e1d3834b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.719712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '314636f478ac456aabbeec8fcfa4f317', 'request_id': 'req-c98bc662-7eb4-45b1-914b-3d91e1d3834b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.725842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '314636f478ac456aabbeec8fcfa4f317', 'request_id': 'req-c98bc662-7eb4-45b1-914b-3d91e1d3834b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:32.736714 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2844/5704] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:13:31 2022] DELETE /identity/v3/domains/314636f478ac456aabbeec8fcfa4f317 => generated 0 bytes in 1171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:32.739308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:32.742467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:32.862105 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2861/5705] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:32.873046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c9713-ebe6-40e1-9c02-442046261638 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:32.874612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-663c9713-ebe6-40e1-9c02-442046261638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:32.901425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bc662-7eb4-45b1-914b-3d91e1d3834b tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.000948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c9713-ebe6-40e1-9c02-442046261638 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.006900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0496f3-dd8a-49b8-9049-a5ce67fc98de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.007530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0496f3-dd8a-49b8-9049-a5ce67fc98de service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.007806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0496f3-dd8a-49b8-9049-a5ce67fc98de service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.008077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0496f3-dd8a-49b8-9049-a5ce67fc98de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.009014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:33.023299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca6b16-c122-4f3f-9a31-d1cb30983e99 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.024463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca6b16-c122-4f3f-9a31-d1cb30983e99 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.025078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca6b16-c122-4f3f-9a31-d1cb30983e99 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.026404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca6b16-c122-4f3f-9a31-d1cb30983e99 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/314636f478ac456aabbeec8fcfa4f317` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.033037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0496f3-dd8a-49b8-9049-a5ce67fc98de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:33.034625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0496f3-dd8a-49b8-9049-a5ce67fc98de service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:33.038939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca6b16-c122-4f3f-9a31-d1cb30983e99 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=314636f478ac456aabbeec8fcfa4f317)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:33.042456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca6b16-c122-4f3f-9a31-d1cb30983e99 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-61ca6b16-c122-4f3f-9a31-d1cb30983e99 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Could not find domain: 314636f478ac456aabbeec8fcfa4f317.: keystone.exception.DomainNotFound: Could not find domain: 314636f478ac456aabbeec8fcfa4f317. Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 314636f478ac456aabbeec8fcfa4f317. Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:33.059666 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:13:33.060984 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 314636f478ac456aabbeec8fcfa4f317. Oct 08 21:13:33.062575 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:33.063991 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2862/5706] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:13:33.077283 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2845/5707] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:13:32 2022] GET /identity/v3/domains/314636f478ac456aabbeec8fcfa4f317 => generated 112 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:13:33.081669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0496f3-dd8a-49b8-9049-a5ce67fc98de service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.095654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0496f3-dd8a-49b8-9049-a5ce67fc98de service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.107692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f442881-052e-42e0-a2b5-3b645094926c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.108705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f442881-052e-42e0-a2b5-3b645094926c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.108705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f442881-052e-42e0-a2b5-3b645094926c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.108913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f442881-052e-42e0-a2b5-3b645094926c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/users/19f7a10309bb4996977d201fde779afc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.142703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f442881-052e-42e0-a2b5-3b645094926c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:get_user(user_id=19f7a10309bb4996977d201fde779afc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:33.149715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f442881-052e-42e0-a2b5-3b645094926c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:33.159757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca6b16-c122-4f3f-9a31-d1cb30983e99 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.161540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-61ca6b16-c122-4f3f-9a31-d1cb30983e99 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:33.202888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca6b16-c122-4f3f-9a31-d1cb30983e99 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-9f442881-052e-42e0-a2b5-3b645094926c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Could not find user: 19f7a10309bb4996977d201fde779afc.: keystone.exception.UserNotFound: Could not find user: 19f7a10309bb4996977d201fde779afc. Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 21:13:33.215145 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:13:33.216357 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:13:33.217456 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:13:33.217456 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:13:33.217456 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:13:33.217456 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:13:33.217456 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 21:13:33.217456 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 21:13:33.217456 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 21:13:33.217456 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 21:13:33.217456 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 21:13:33.217456 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 21:13:33.217456 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 19f7a10309bb4996977d201fde779afc. Oct 08 21:13:33.217456 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:33.224149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.224993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.225473 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2863/5708] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:13:33 2022] GET /identity/v3/users/19f7a10309bb4996977d201fde779afc => generated 110 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:13:33.225700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.225919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c admin admin] PATH_INFO: `/v3/projects/17e6fc4e68334b7d8280006be65c3356` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.227966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f442881-052e-42e0-a2b5-3b645094926c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.232323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e6fc4e68334b7d8280006be65c3356)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:33.235171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:33.261616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f442881-052e-42e0-a2b5-3b645094926c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.276017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7cdee-33ee-4acd-a46b-2b0b3021fe68 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.276692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7cdee-33ee-4acd-a46b-2b0b3021fe68 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.277579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7cdee-33ee-4acd-a46b-2b0b3021fe68 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.277579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7cdee-33ee-4acd-a46b-2b0b3021fe68 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/groups/0a1c7adc76d6479eb3978932ebd04bd6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.288919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7cdee-33ee-4acd-a46b-2b0b3021fe68 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:get_group(group_id=0a1c7adc76d6479eb3978932ebd04bd6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:33.290143 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-e0b7cdee-33ee-4acd-a46b-2b0b3021fe68 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:13:33.290143 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:13:33.290143 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:13:33.292242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7cdee-33ee-4acd-a46b-2b0b3021fe68 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-e0b7cdee-33ee-4acd-a46b-2b0b3021fe68 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Could not find group: 0a1c7adc76d6479eb3978932ebd04bd6.: keystone.exception.GroupNotFound: Could not find group: 0a1c7adc76d6479eb3978932ebd04bd6. Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 08 21:13:33.312952 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:13:33.314569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:13:33.316799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:13:33.316799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:13:33.316799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:13:33.316799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:13:33.316799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 08 21:13:33.316799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 08 21:13:33.316799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 08 21:13:33.316799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 08 21:13:33.316799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 08 21:13:33.316799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 08 21:13:33.316799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 0a1c7adc76d6479eb3978932ebd04bd6. Oct 08 21:13:33.316799 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:33.318736 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2864/5709] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:33 2022] GET /identity/v3/groups/0a1c7adc76d6479eb3978932ebd04bd6 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:13:33.319797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7cdee-33ee-4acd-a46b-2b0b3021fe68 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.341291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7cdee-33ee-4acd-a46b-2b0b3021fe68 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.363230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e6fc4e68334b7d8280006be65c3356', 'request_id': 'req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:33.402188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e6fc4e68334b7d8280006be65c3356', 'request_id': 'req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:33.424747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e6fc4e68334b7d8280006be65c3356', 'request_id': 'req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:33.432733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b9e29-6ef4-4179-a23a-bd7312029dfb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.434686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9e29-6ef4-4179-a23a-bd7312029dfb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.434843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9e29-6ef4-4179-a23a-bd7312029dfb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.435084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9e29-6ef4-4179-a23a-bd7312029dfb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/groups/0a1c7adc76d6479eb3978932ebd04bd6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.442597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b9e29-6ef4-4179-a23a-bd7312029dfb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-ff0b9e29-6ef4-4179-a23a-bd7312029dfb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Could not find group: 0a1c7adc76d6479eb3978932ebd04bd6.: keystone.exception.GroupNotFound: Could not find group: 0a1c7adc76d6479eb3978932ebd04bd6. Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 08 21:13:33.449934 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:13:33.451153 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 0a1c7adc76d6479eb3978932ebd04bd6. Oct 08 21:13:33.452329 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:33.454829 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2865/5710] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:13:33 2022] DELETE /identity/v3/groups/0a1c7adc76d6479eb3978932ebd04bd6 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:13:33.455798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b9e29-6ef4-4179-a23a-bd7312029dfb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.457477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c admin admin] The token cache is being invalidate because project 17e6fc4e68334b7d8280006be65c3356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:33.458015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:33.459398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5cf6d2d-b8fa-4279-b1fa-000a6c0c3e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:33.461412 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2846/5711] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:33 2022] DELETE /identity/v3/projects/17e6fc4e68334b7d8280006be65c3356 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:13:33.466484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7121b-8031-47ee-99c4-6ac61630ec82 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.466988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7121b-8031-47ee-99c4-6ac61630ec82 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.468428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7121b-8031-47ee-99c4-6ac61630ec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.472333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b9e29-6ef4-4179-a23a-bd7312029dfb tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.479202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6364a-6a11-44ff-82ad-c5f06f86f95c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.479961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6364a-6a11-44ff-82ad-c5f06f86f95c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.480493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6364a-6a11-44ff-82ad-c5f06f86f95c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.480868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6364a-6a11-44ff-82ad-c5f06f86f95c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/users/19f7a10309bb4996977d201fde779afc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.491868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6364a-6a11-44ff-82ad-c5f06f86f95c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:delete_user(user_id=19f7a10309bb4996977d201fde779afc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:33.494818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6364a-6a11-44ff-82ad-c5f06f86f95c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-5cd6364a-6a11-44ff-82ad-c5f06f86f95c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Could not find user: 19f7a10309bb4996977d201fde779afc.: keystone.exception.UserNotFound: Could not find user: 19f7a10309bb4996977d201fde779afc. Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 08 21:13:33.515426 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:13:33.516433 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 19f7a10309bb4996977d201fde779afc. Oct 08 21:13:33.517569 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:33.520601 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2866/5712] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:33 2022] DELETE /identity/v3/users/19f7a10309bb4996977d201fde779afc => generated 110 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:13:33.526115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6364a-6a11-44ff-82ad-c5f06f86f95c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.528166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5cd6364a-6a11-44ff-82ad-c5f06f86f95c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:33.530241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-66d7121b-8031-47ee-99c4-6ac61630ec82 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:33.532330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-66d7121b-8031-47ee-99c4-6ac61630ec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:33.538590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:33.551034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6364a-6a11-44ff-82ad-c5f06f86f95c tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.563591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef940dd-7199-4c6f-9cdc-949969724443 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.564704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef940dd-7199-4c6f-9cdc-949969724443 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.567973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef940dd-7199-4c6f-9cdc-949969724443 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.568508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef940dd-7199-4c6f-9cdc-949969724443 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/314636f478ac456aabbeec8fcfa4f317` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.602938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef940dd-7199-4c6f-9cdc-949969724443 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-2ef940dd-7199-4c6f-9cdc-949969724443 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Could not find domain: 314636f478ac456aabbeec8fcfa4f317.: keystone.exception.DomainNotFound: Could not find domain: 314636f478ac456aabbeec8fcfa4f317. Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 314636f478ac456aabbeec8fcfa4f317. Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:33.611491 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:33.617459 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 314636f478ac456aabbeec8fcfa4f317. Oct 08 21:13:33.618552 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:13:33.619610 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2867/5713] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:33 2022] PATCH /identity/v3/domains/314636f478ac456aabbeec8fcfa4f317 => generated 112 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:13:33.626641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef940dd-7199-4c6f-9cdc-949969724443 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.650957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef940dd-7199-4c6f-9cdc-949969724443 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.667989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee91b8-668c-4b07-a76a-73111d8ed994 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.668458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee91b8-668c-4b07-a76a-73111d8ed994 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.668748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee91b8-668c-4b07-a76a-73111d8ed994 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.669021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee91b8-668c-4b07-a76a-73111d8ed994 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.669707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee91b8-668c-4b07-a76a-73111d8ed994 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:33.672429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee91b8-668c-4b07-a76a-73111d8ed994 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:33.711593 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2868/5715] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 8 21:13:33 2022] GET /identity/v3/domains => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:33.711593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd2e7-d61a-4ce4-92e9-a7557688094e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.711593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd2e7-d61a-4ce4-92e9-a7557688094e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.711593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd2e7-d61a-4ce4-92e9-a7557688094e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.712400 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2847/5714] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:33.713670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7121b-8031-47ee-99c4-6ac61630ec82 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.733098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7121b-8031-47ee-99c4-6ac61630ec82 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.740040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738ad57-9fc5-48bc-bd90-fd35a80cf4db tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.740265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-12ccd2e7-d61a-4ce4-92e9-a7557688094e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:33.741103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738ad57-9fc5-48bc-bd90-fd35a80cf4db tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.741622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738ad57-9fc5-48bc-bd90-fd35a80cf4db tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.741755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-12ccd2e7-d61a-4ce4-92e9-a7557688094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:33.742226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738ad57-9fc5-48bc-bd90-fd35a80cf4db tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.743138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738ad57-9fc5-48bc-bd90-fd35a80cf4db tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:13:33.743840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738ad57-9fc5-48bc-bd90-fd35a80cf4db tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:33.745662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738ad57-9fc5-48bc-bd90-fd35a80cf4db tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:33.754442 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2869/5716] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:33.758254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccd2e7-d61a-4ce4-92e9-a7557688094e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.772911 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2848/5717] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:13:33 2022] GET /identity/v3/domains?enabled=True => generated 1095 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:33.775120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccd2e7-d61a-4ce4-92e9-a7557688094e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.780900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738ad57-9fc5-48bc-bd90-fd35a80cf4db tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.789748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49490c92-58a8-4baa-ae08-ad7575ef6ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.791147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49490c92-58a8-4baa-ae08-ad7575ef6ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.791790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49490c92-58a8-4baa-ae08-ad7575ef6ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.792945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49490c92-58a8-4baa-ae08-ad7575ef6ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.794829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49490c92-58a8-4baa-ae08-ad7575ef6ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:13:33.795396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49490c92-58a8-4baa-ae08-ad7575ef6ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:33.796576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738ad57-9fc5-48bc-bd90-fd35a80cf4db tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.797672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49490c92-58a8-4baa-ae08-ad7575ef6ed2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:33.803682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddedcfc-37ef-4d04-901e-4513cd4b02ce tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.804359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddedcfc-37ef-4d04-901e-4513cd4b02ce tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.804694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddedcfc-37ef-4d04-901e-4513cd4b02ce tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.804973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddedcfc-37ef-4d04-901e-4513cd4b02ce tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.805864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddedcfc-37ef-4d04-901e-4513cd4b02ce tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-295367304) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:13:33.806225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddedcfc-37ef-4d04-901e-4513cd4b02ce tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:33.808027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddedcfc-37ef-4d04-901e-4513cd4b02ce tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:33.819565 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2870/5718] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:13:33.823683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49490c92-58a8-4baa-ae08-ad7575ef6ed2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.836155 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2849/5719] 10.222.0.26 () {58 vars in 1197 bytes} [Sat Oct 8 21:13:33 2022] GET /identity/v3/domains?name=tempest-test_domain-295367304 => generated 407 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:33.837068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddedcfc-37ef-4d04-901e-4513cd4b02ce tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.845679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49490c92-58a8-4baa-ae08-ad7575ef6ed2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.852461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddedcfc-37ef-4d04-901e-4513cd4b02ce tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.857102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cca41c-2ab4-42b9-8bdb-a4e3917f7b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.859539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cca41c-2ab4-42b9-8bdb-a4e3917f7b0b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.860305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cca41c-2ab4-42b9-8bdb-a4e3917f7b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.860623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c005a-c3b1-4b04-a2ba-f25d188806f5 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.861225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cca41c-2ab4-42b9-8bdb-a4e3917f7b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.861454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c005a-c3b1-4b04-a2ba-f25d188806f5 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.861655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c005a-c3b1-4b04-a2ba-f25d188806f5 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.863285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c005a-c3b1-4b04-a2ba-f25d188806f5 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/314636f478ac456aabbeec8fcfa4f317` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.863628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cca41c-2ab4-42b9-8bdb-a4e3917f7b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:33.867505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cca41c-2ab4-42b9-8bdb-a4e3917f7b0b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:33.873165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c005a-c3b1-4b04-a2ba-f25d188806f5 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-e71c005a-c3b1-4b04-a2ba-f25d188806f5 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Could not find domain: 314636f478ac456aabbeec8fcfa4f317.: keystone.exception.DomainNotFound: Could not find domain: 314636f478ac456aabbeec8fcfa4f317. Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 314636f478ac456aabbeec8fcfa4f317. Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:33.881653 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:33.882849 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 314636f478ac456aabbeec8fcfa4f317. Oct 08 21:13:33.883940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:33.885002 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2850/5720] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:33 2022] PATCH /identity/v3/domains/314636f478ac456aabbeec8fcfa4f317 => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:13:33.887581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c005a-c3b1-4b04-a2ba-f25d188806f5 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.901429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c005a-c3b1-4b04-a2ba-f25d188806f5 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:33.908808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae50ea-8473-479d-a282-f96e7b3a3541 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:33.910141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae50ea-8473-479d-a282-f96e7b3a3541 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:33.910659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae50ea-8473-479d-a282-f96e7b3a3541 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:33.911161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae50ea-8473-479d-a282-f96e7b3a3541 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/01c1628a925946b4b0de0a5f9dcd7153` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:33.938527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae50ea-8473-479d-a282-f96e7b3a3541 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=01c1628a925946b4b0de0a5f9dcd7153)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:33.941610 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2871/5721] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:33 2022] POST /identity/v3/projects => generated 399 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:13:33.946272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cca41c-2ab4-42b9-8bdb-a4e3917f7b0b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:33.947617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae50ea-8473-479d-a282-f96e7b3a3541 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:33.995774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:34.044644 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2851/5722] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:33 2022] PATCH /identity/v3/domains/01c1628a925946b4b0de0a5f9dcd7153 => generated 277 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:34.046179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae50ea-8473-479d-a282-f96e7b3a3541 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:34.058520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae50ea-8473-479d-a282-f96e7b3a3541 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:34.077641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cca41c-2ab4-42b9-8bdb-a4e3917f7b0b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:34.091246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6ff52-d61f-4605-86dc-4fca020d416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:34.093437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6ff52-d61f-4605-86dc-4fca020d416a admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:34.094694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6ff52-d61f-4605-86dc-4fca020d416a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:34.094977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6ff52-d61f-4605-86dc-4fca020d416a admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:34.098104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6ff52-d61f-4605-86dc-4fca020d416a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:34.103462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6ff52-d61f-4605-86dc-4fca020d416a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:34.141785 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2872/5723] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:33 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:34.144355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:34.145134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:34.145481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:34.145760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/01c1628a925946b4b0de0a5f9dcd7153` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:34.145965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6ff52-d61f-4605-86dc-4fca020d416a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:34.164966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=01c1628a925946b4b0de0a5f9dcd7153)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:34.166818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:34.171508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6ff52-d61f-4605-86dc-4fca020d416a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:34.187695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157beaf-9bb5-4b9c-be2d-2c4939daa871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:34.188895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157beaf-9bb5-4b9c-be2d-2c4939daa871 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:34.189199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157beaf-9bb5-4b9c-be2d-2c4939daa871 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:34.189494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157beaf-9bb5-4b9c-be2d-2c4939daa871 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:34.192830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157beaf-9bb5-4b9c-be2d-2c4939daa871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:34.197872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157beaf-9bb5-4b9c-be2d-2c4939daa871 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:34.198262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '01c1628a925946b4b0de0a5f9dcd7153'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.220929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '01c1628a925946b4b0de0a5f9dcd7153'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.234276 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2873/5724] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:34.235982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157beaf-9bb5-4b9c-be2d-2c4939daa871 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:34.257320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157beaf-9bb5-4b9c-be2d-2c4939daa871 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:34.264466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7cec2-3ef4-4969-91a2-5fc2b6da7d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:34.265281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7cec2-3ef4-4969-91a2-5fc2b6da7d99 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:34.265567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7cec2-3ef4-4969-91a2-5fc2b6da7d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:34.265840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7cec2-3ef4-4969-91a2-5fc2b6da7d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:34.266491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7cec2-3ef4-4969-91a2-5fc2b6da7d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:34.268218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7cec2-3ef4-4969-91a2-5fc2b6da7d99 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:34.282528 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2874/5725] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:34.288036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7cec2-3ef4-4969-91a2-5fc2b6da7d99 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:34.301216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c1628a925946b4b0de0a5f9dcd7153', 'request_id': 'req-e2757753-ed38-4c02-98d4-419d5309e247'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.311594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7cec2-3ef4-4969-91a2-5fc2b6da7d99 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:34.315321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c1628a925946b4b0de0a5f9dcd7153', 'request_id': 'req-e2757753-ed38-4c02-98d4-419d5309e247'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.327799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c1628a925946b4b0de0a5f9dcd7153', 'request_id': 'req-e2757753-ed38-4c02-98d4-419d5309e247'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.358321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] The token cache is being invalidate because project 01c1628a925946b4b0de0a5f9dcd7153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:34.358763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.360241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.381855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '01c1628a925946b4b0de0a5f9dcd7153', 'request_id': 'req-e2757753-ed38-4c02-98d4-419d5309e247'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.382613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '01c1628a925946b4b0de0a5f9dcd7153', 'request_id': 'req-e2757753-ed38-4c02-98d4-419d5309e247'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.404476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '01c1628a925946b4b0de0a5f9dcd7153', 'request_id': 'req-e2757753-ed38-4c02-98d4-419d5309e247'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.419750 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2852/5726] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:13:34 2022] DELETE /identity/v3/domains/01c1628a925946b4b0de0a5f9dcd7153 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:34.421257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:34.424702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:34.469176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d5979-7087-455e-9899-c57ab7c31a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:34.469880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d5979-7087-455e-9899-c57ab7c31a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:34.470988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d5979-7087-455e-9899-c57ab7c31a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:34.471272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d5979-7087-455e-9899-c57ab7c31a01 admin admin] PATH_INFO: `/v3/projects/9319c189186b4639adc4392a14209fab/users/34519d5169994688ba28db116e249b5f/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:34.509426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:34.517818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d5979-7087-455e-9899-c57ab7c31a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9319c189186b4639adc4392a14209fab, user_id=34519d5169994688ba28db116e249b5f, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:34.522112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d5979-7087-455e-9899-c57ab7c31a01 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:34.524799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:34.552302 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2875/5727] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:34 2022] PUT /identity/v3/projects/9319c189186b4639adc4392a14209fab/users/34519d5169994688ba28db116e249b5f/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:34.567408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83178507-a017-41ce-83bd-1fa9a1e3da7f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:34.567760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83178507-a017-41ce-83bd-1fa9a1e3da7f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:34.569146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83178507-a017-41ce-83bd-1fa9a1e3da7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:34.636212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2757753-ed38-4c02-98d4-419d5309e247 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:34.643101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-83178507-a017-41ce-83bd-1fa9a1e3da7f None None] MFA Rules not processed for user `34519d5169994688ba28db116e249b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:34.644410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-83178507-a017-41ce-83bd-1fa9a1e3da7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:34.778238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5efe9-154d-4f64-8c89-5c98c762d7b1 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:34.779227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5efe9-154d-4f64-8c89-5c98c762d7b1 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:34.779703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5efe9-154d-4f64-8c89-5c98c762d7b1 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:34.780168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5efe9-154d-4f64-8c89-5c98c762d7b1 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/a398f477be314e719f866a64cb16da78` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:34.813123 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2876/5728] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:34.826066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83178507-a017-41ce-83bd-1fa9a1e3da7f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:34.830041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-83178507-a017-41ce-83bd-1fa9a1e3da7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:34.845856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5efe9-154d-4f64-8c89-5c98c762d7b1 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a398f477be314e719f866a64cb16da78)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:34.855090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5efe9-154d-4f64-8c89-5c98c762d7b1 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:34.911452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96f5efe9-154d-4f64-8c89-5c98c762d7b1 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a398f477be314e719f866a64cb16da78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.912645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96f5efe9-154d-4f64-8c89-5c98c762d7b1 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a398f477be314e719f866a64cb16da78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.977357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83178507-a017-41ce-83bd-1fa9a1e3da7f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:34.985813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96f5efe9-154d-4f64-8c89-5c98c762d7b1 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a398f477be314e719f866a64cb16da78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.985813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96f5efe9-154d-4f64-8c89-5c98c762d7b1 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a398f477be314e719f866a64cb16da78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:34.993757 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2853/5729] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:34 2022] PATCH /identity/v3/domains/a398f477be314e719f866a64cb16da78 => generated 278 bytes in 573 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:34.995030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5efe9-154d-4f64-8c89-5c98c762d7b1 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:34.997091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-96f5efe9-154d-4f64-8c89-5c98c762d7b1 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:35.096458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5efe9-154d-4f64-8c89-5c98c762d7b1 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:35.111517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:35.112181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:35.112543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:35.112822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/a398f477be314e719f866a64cb16da78` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:35.115984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38e83f-1e8a-46c0-a88f-60f1a76350fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:35.116754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38e83f-1e8a-46c0-a88f-60f1a76350fc service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:35.117114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38e83f-1e8a-46c0-a88f-60f1a76350fc service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:35.117633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38e83f-1e8a-46c0-a88f-60f1a76350fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:35.119900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ba38e83f-1e8a-46c0-a88f-60f1a76350fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:35.153172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a398f477be314e719f866a64cb16da78)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:35.156339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:35.214734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:35.229607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a398f477be314e719f866a64cb16da78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.232734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:35.256735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38e83f-1e8a-46c0-a88f-60f1a76350fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:35.257082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a398f477be314e719f866a64cb16da78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.261749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38e83f-1e8a-46c0-a88f-60f1a76350fc service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:35.291646 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2877/5730] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:35.347671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38e83f-1e8a-46c0-a88f-60f1a76350fc service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:35.349464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ba38e83f-1e8a-46c0-a88f-60f1a76350fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:35.425471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a398f477be314e719f866a64cb16da78', 'request_id': 'req-56426030-3be1-49df-9361-127d61f4c7af'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.446531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a398f477be314e719f866a64cb16da78', 'request_id': 'req-56426030-3be1-49df-9361-127d61f4c7af'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.464719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a398f477be314e719f866a64cb16da78', 'request_id': 'req-56426030-3be1-49df-9361-127d61f4c7af'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.511463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] The token cache is being invalidate because project a398f477be314e719f866a64cb16da78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:35.512432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.513289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.528491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a398f477be314e719f866a64cb16da78', 'request_id': 'req-56426030-3be1-49df-9361-127d61f4c7af'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.530046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a398f477be314e719f866a64cb16da78', 'request_id': 'req-56426030-3be1-49df-9361-127d61f4c7af'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.535467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a398f477be314e719f866a64cb16da78', 'request_id': 'req-56426030-3be1-49df-9361-127d61f4c7af'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.557753 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2854/5731] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:13:34 2022] DELETE /identity/v3/domains/a398f477be314e719f866a64cb16da78 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:35.558928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:35.563085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:35.567288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38e83f-1e8a-46c0-a88f-60f1a76350fc service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:35.730164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:35.730862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:35.731247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:35.731584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] PATH_INFO: `/v3/projects/c7038fee40aa4178b648cc857ac40dd4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:35.733569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7038fee40aa4178b648cc857ac40dd4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:35.736130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:35.746161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56426030-3be1-49df-9361-127d61f4c7af tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:35.754348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806efb98-8637-4bac-ad3a-0482943a9a7d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:35.755087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806efb98-8637-4bac-ad3a-0482943a9a7d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:35.755477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806efb98-8637-4bac-ad3a-0482943a9a7d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:35.755825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806efb98-8637-4bac-ad3a-0482943a9a7d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/e018d38c581346da8156bc8a772dfa86` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:35.772982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806efb98-8637-4bac-ad3a-0482943a9a7d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e018d38c581346da8156bc8a772dfa86)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:35.775380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806efb98-8637-4bac-ad3a-0482943a9a7d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:35.804961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-806efb98-8637-4bac-ad3a-0482943a9a7d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e018d38c581346da8156bc8a772dfa86'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.805968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-806efb98-8637-4bac-ad3a-0482943a9a7d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e018d38c581346da8156bc8a772dfa86'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.847074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-806efb98-8637-4bac-ad3a-0482943a9a7d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e018d38c581346da8156bc8a772dfa86'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.847919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-806efb98-8637-4bac-ad3a-0482943a9a7d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e018d38c581346da8156bc8a772dfa86'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.858739 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2855/5732] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:13:35 2022] PATCH /identity/v3/domains/e018d38c581346da8156bc8a772dfa86 => generated 277 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:35.860417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806efb98-8637-4bac-ad3a-0482943a9a7d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:35.861312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7038fee40aa4178b648cc857ac40dd4', 'request_id': 'req-54f6aa34-56ab-475c-bf35-26215d7b0539'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.864587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-806efb98-8637-4bac-ad3a-0482943a9a7d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:35.881330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7038fee40aa4178b648cc857ac40dd4', 'request_id': 'req-54f6aa34-56ab-475c-bf35-26215d7b0539'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.889044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7038fee40aa4178b648cc857ac40dd4', 'request_id': 'req-54f6aa34-56ab-475c-bf35-26215d7b0539'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.913448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:35.921608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] The token cache is being invalidate because project c7038fee40aa4178b648cc857ac40dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:35.921984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.923585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:35.933018 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2878/5733] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:35 2022] DELETE /identity/v3/projects/c7038fee40aa4178b648cc857ac40dd4 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:35.934079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:35.939519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:35.980978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806efb98-8637-4bac-ad3a-0482943a9a7d tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:36.022457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:36.081080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18019f70668242178bb1a634a278206a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acc195957ea4d1ca97cc8ea71cb6c29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:36.081886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:36.082304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:36.082612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] PATH_INFO: `/v3/domains/e018d38c581346da8156bc8a772dfa86` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:36.101337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6aa34-56ab-475c-bf35-26215d7b0539 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:36.126334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e018d38c581346da8156bc8a772dfa86)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:36.130243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:36.140320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:36.141000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:36.142867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:36.143170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] PATH_INFO: `/v3/users/872e262b64ff40948d59e8c36168b895` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:36.162013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] RBAC: Authorizing `identity:delete_user(user_id=872e262b64ff40948d59e8c36168b895)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:36.166859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:36.200053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e018d38c581346da8156bc8a772dfa86'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.238167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e018d38c581346da8156bc8a772dfa86'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.266817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872e262b64ff40948d59e8c36168b895'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.291568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872e262b64ff40948d59e8c36168b895'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.292663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872e262b64ff40948d59e8c36168b895'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.294857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872e262b64ff40948d59e8c36168b895'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.333048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872e262b64ff40948d59e8c36168b895'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.380140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e018d38c581346da8156bc8a772dfa86', 'request_id': 'req-c6152bb0-be45-4917-b8fc-86676436f4e6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.384428 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2879/5734] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:35 2022] DELETE /identity/v3/users/872e262b64ff40948d59e8c36168b895 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:36.402830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e018d38c581346da8156bc8a772dfa86', 'request_id': 'req-c6152bb0-be45-4917-b8fc-86676436f4e6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.408314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e018d38c581346da8156bc8a772dfa86', 'request_id': 'req-c6152bb0-be45-4917-b8fc-86676436f4e6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.440203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] The token cache is being invalidate because project e018d38c581346da8156bc8a772dfa86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:36.445300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.446967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.473018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e018d38c581346da8156bc8a772dfa86', 'request_id': 'req-c6152bb0-be45-4917-b8fc-86676436f4e6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.474398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e018d38c581346da8156bc8a772dfa86', 'request_id': 'req-c6152bb0-be45-4917-b8fc-86676436f4e6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.483942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c6152bb0-be45-4917-b8fc-86676436f4e6 tempest-DomainsTestJSON-1339730377 tempest-DomainsTestJSON-1339730377-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e018d38c581346da8156bc8a772dfa86', 'request_id': 'req-c6152bb0-be45-4917-b8fc-86676436f4e6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.518428 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2856/5735] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:13:35 2022] DELETE /identity/v3/domains/e018d38c581346da8156bc8a772dfa86 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:36.521344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:36.522903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:36.657472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77284a8-21b4-4d3e-8cce-c947df0e74af admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:36.663988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:36.664839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:36.665134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:36.665418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] PATH_INFO: `/v3/users/d807485d721443b7971497f7915b7037` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:36.666733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d807485d721443b7971497f7915b7037)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:36.668759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:36.776275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd807485d721443b7971497f7915b7037'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.778492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:36.792968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd807485d721443b7971497f7915b7037'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.794443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd807485d721443b7971497f7915b7037'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.795151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd807485d721443b7971497f7915b7037'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.817941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd807485d721443b7971497f7915b7037'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:36.872032 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2880/5736] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:36 2022] DELETE /identity/v3/users/d807485d721443b7971497f7915b7037 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:13:36.876595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac400d0-dda2-4b94-9491-9b8dffc212de None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:36.876889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac400d0-dda2-4b94-9491-9b8dffc212de None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:36.877173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac400d0-dda2-4b94-9491-9b8dffc212de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:36.899173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:36.934599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-aac400d0-dda2-4b94-9491-9b8dffc212de None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:36.935859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-aac400d0-dda2-4b94-9491-9b8dffc212de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:37.043176 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2857/5737] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:37.072745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:37.074371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:37.243594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45fbaf-e346-45c2-babe-5c432d18b1ae admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:37.254422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819243bb-ff79-42e7-aa23-26a29f2a3613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:37.255330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819243bb-ff79-42e7-aa23-26a29f2a3613 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:37.255763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819243bb-ff79-42e7-aa23-26a29f2a3613 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:37.256310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819243bb-ff79-42e7-aa23-26a29f2a3613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:37.275150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819243bb-ff79-42e7-aa23-26a29f2a3613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:37.277812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819243bb-ff79-42e7-aa23-26a29f2a3613 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:37.292183 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2881/5738] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:37.600078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac400d0-dda2-4b94-9491-9b8dffc212de None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:37.601919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-aac400d0-dda2-4b94-9491-9b8dffc212de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:37.628067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac400d0-dda2-4b94-9491-9b8dffc212de None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:37.636489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fb285-c653-453b-b716-b5743a384fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:37.636489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fb285-c653-453b-b716-b5743a384fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:37.636489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fb285-c653-453b-b716-b5743a384fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:37.636864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fb285-c653-453b-b716-b5743a384fe5 admin admin] PATH_INFO: `/v3/projects/144ea108f2a54d1280d88894184b6c98` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:37.638474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fb285-c653-453b-b716-b5743a384fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=144ea108f2a54d1280d88894184b6c98)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:37.641963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fb285-c653-453b-b716-b5743a384fe5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:37.777704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ca7fb285-c653-453b-b716-b5743a384fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '144ea108f2a54d1280d88894184b6c98', 'request_id': 'req-ca7fb285-c653-453b-b716-b5743a384fe5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:37.795813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ca7fb285-c653-453b-b716-b5743a384fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '144ea108f2a54d1280d88894184b6c98', 'request_id': 'req-ca7fb285-c653-453b-b716-b5743a384fe5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:37.806660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ca7fb285-c653-453b-b716-b5743a384fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '144ea108f2a54d1280d88894184b6c98', 'request_id': 'req-ca7fb285-c653-453b-b716-b5743a384fe5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:37.833445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ca7fb285-c653-453b-b716-b5743a384fe5 admin admin] The token cache is being invalidate because project 144ea108f2a54d1280d88894184b6c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:37.833941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ca7fb285-c653-453b-b716-b5743a384fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:37.835406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ca7fb285-c653-453b-b716-b5743a384fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:37.838247 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2858/5739] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:37 2022] DELETE /identity/v3/projects/144ea108f2a54d1280d88894184b6c98 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:37.850992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bcfeb-8074-4aaa-a6e7-15b3261aac25 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:37.851279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bcfeb-8074-4aaa-a6e7-15b3261aac25 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:37.851558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bcfeb-8074-4aaa-a6e7-15b3261aac25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:37.874346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b91bcfeb-8074-4aaa-a6e7-15b3261aac25 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:37.876574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b91bcfeb-8074-4aaa-a6e7-15b3261aac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:37.997561 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2882/5740] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:38.005588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c6335-b973-4171-9d99-ada4fff256b7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:38.006295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c6335-b973-4171-9d99-ada4fff256b7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:38.006766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c6335-b973-4171-9d99-ada4fff256b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:38.038587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1d4c6335-b973-4171-9d99-ada4fff256b7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:38.040337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1d4c6335-b973-4171-9d99-ada4fff256b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:38.053547 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2859/5741] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:38.057938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bcfeb-8074-4aaa-a6e7-15b3261aac25 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:38.069411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bcfeb-8074-4aaa-a6e7-15b3261aac25 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:38.076134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68db997-57b2-4b84-bd30-0964f3dfc052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:38.077400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68db997-57b2-4b84-bd30-0964f3dfc052 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:38.077696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68db997-57b2-4b84-bd30-0964f3dfc052 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:38.078715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68db997-57b2-4b84-bd30-0964f3dfc052 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:38.079414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68db997-57b2-4b84-bd30-0964f3dfc052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:13:38.079732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68db997-57b2-4b84-bd30-0964f3dfc052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:38.082247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68db997-57b2-4b84-bd30-0964f3dfc052 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:38.109918 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2883/5742] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:38.115212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c6335-b973-4171-9d99-ada4fff256b7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:38.127113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c6335-b973-4171-9d99-ada4fff256b7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:38.132782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bced1-c81b-46ce-8382-41289509461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:38.133449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bced1-c81b-46ce-8382-41289509461c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:38.133913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bced1-c81b-46ce-8382-41289509461c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:38.134198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bced1-c81b-46ce-8382-41289509461c admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:38.134842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bced1-c81b-46ce-8382-41289509461c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:38.136776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bced1-c81b-46ce-8382-41289509461c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:38.173838 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2860/5743] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:38 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:38.178168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68db997-57b2-4b84-bd30-0964f3dfc052 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:38.195850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68db997-57b2-4b84-bd30-0964f3dfc052 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:38.314253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:38.322764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01e33c-2547-4113-a616-0a13a3d78ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:38.324301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01e33c-2547-4113-a616-0a13a3d78ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:38.325412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01e33c-2547-4113-a616-0a13a3d78ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:38.325916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01e33c-2547-4113-a616-0a13a3d78ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:38.326676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01e33c-2547-4113-a616-0a13a3d78ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:38.329511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01e33c-2547-4113-a616-0a13a3d78ea3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:38.361756 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2884/5744] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:38 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:13:38.368662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bced1-c81b-46ce-8382-41289509461c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:38.382814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bced1-c81b-46ce-8382-41289509461c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:38.388016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49800b-7072-4b0c-8eef-2e8dfebf9a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:38.389167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49800b-7072-4b0c-8eef-2e8dfebf9a87 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:38.389506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49800b-7072-4b0c-8eef-2e8dfebf9a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:38.389777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49800b-7072-4b0c-8eef-2e8dfebf9a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:38.390423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49800b-7072-4b0c-8eef-2e8dfebf9a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:38.392026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49800b-7072-4b0c-8eef-2e8dfebf9a87 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:38.417770 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2861/5745] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:13:38.422771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01e33c-2547-4113-a616-0a13a3d78ea3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:38.442473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01e33c-2547-4113-a616-0a13a3d78ea3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:38.459880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570807c9-de66-4d6e-ae53-d636df7fe5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:38.460574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570807c9-de66-4d6e-ae53-d636df7fe5be admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:38.460858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570807c9-de66-4d6e-ae53-d636df7fe5be admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:38.461128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570807c9-de66-4d6e-ae53-d636df7fe5be admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:38.461813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570807c9-de66-4d6e-ae53-d636df7fe5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:38.464017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570807c9-de66-4d6e-ae53-d636df7fe5be admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:38.510822 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2885/5746] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:38.515257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49800b-7072-4b0c-8eef-2e8dfebf9a87 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:38.537499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49800b-7072-4b0c-8eef-2e8dfebf9a87 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:38.556768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036931e-15dc-4c02-b08d-0d11424965db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:38.556768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036931e-15dc-4c02-b08d-0d11424965db admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:38.557127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036931e-15dc-4c02-b08d-0d11424965db admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:38.557411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036931e-15dc-4c02-b08d-0d11424965db admin admin] PATH_INFO: `/v3/projects/01ee10233d0e41d398a9f52f558934e8/users/51b44ebd62ab40e781f7922667a15482/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:38.587924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036931e-15dc-4c02-b08d-0d11424965db admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ee10233d0e41d398a9f52f558934e8, user_id=51b44ebd62ab40e781f7922667a15482, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:38.619476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036931e-15dc-4c02-b08d-0d11424965db admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:38.651473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570807c9-de66-4d6e-ae53-d636df7fe5be admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:38.655892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-570807c9-de66-4d6e-ae53-d636df7fe5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:38.680964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570807c9-de66-4d6e-ae53-d636df7fe5be admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:38.685339 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2862/5747] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:38 2022] PUT /identity/v3/projects/01ee10233d0e41d398a9f52f558934e8/users/51b44ebd62ab40e781f7922667a15482/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:38.690833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036931e-15dc-4c02-b08d-0d11424965db admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:38.693138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f036931e-15dc-4c02-b08d-0d11424965db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:38.758842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:38.942108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba72fcc-f7d9-4401-be8b-fc108f7175fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:38.947395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba72fcc-f7d9-4401-be8b-fc108f7175fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:38.947769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba72fcc-f7d9-4401-be8b-fc108f7175fc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:38.948039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba72fcc-f7d9-4401-be8b-fc108f7175fc admin admin] PATH_INFO: `/v3/users/95b38c37ad5943ca994292f7dd80af21` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:38.957764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba72fcc-f7d9-4401-be8b-fc108f7175fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b38c37ad5943ca994292f7dd80af21)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:38.963198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba72fcc-f7d9-4401-be8b-fc108f7175fc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:38.967963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036931e-15dc-4c02-b08d-0d11424965db admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:38.985362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c647547-84c4-47da-96f8-4995f6a9a29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:38.988360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c647547-84c4-47da-96f8-4995f6a9a29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:38.990451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c647547-84c4-47da-96f8-4995f6a9a29d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:38.990728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c647547-84c4-47da-96f8-4995f6a9a29d admin admin] PATH_INFO: `/v3/projects/f557bac39ab348e5bc8a3e390270d50b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:39.004440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c647547-84c4-47da-96f8-4995f6a9a29d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f557bac39ab348e5bc8a3e390270d50b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:39.014860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c647547-84c4-47da-96f8-4995f6a9a29d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:39.173060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aba72fcc-f7d9-4401-be8b-fc108f7175fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b38c37ad5943ca994292f7dd80af21'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.188467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aba72fcc-f7d9-4401-be8b-fc108f7175fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b38c37ad5943ca994292f7dd80af21'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.191284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aba72fcc-f7d9-4401-be8b-fc108f7175fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b38c37ad5943ca994292f7dd80af21'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.192130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aba72fcc-f7d9-4401-be8b-fc108f7175fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b38c37ad5943ca994292f7dd80af21'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.203384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6c647547-84c4-47da-96f8-4995f6a9a29d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f557bac39ab348e5bc8a3e390270d50b', 'request_id': 'req-6c647547-84c4-47da-96f8-4995f6a9a29d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.218849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aba72fcc-f7d9-4401-be8b-fc108f7175fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b38c37ad5943ca994292f7dd80af21'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.223880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6c647547-84c4-47da-96f8-4995f6a9a29d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f557bac39ab348e5bc8a3e390270d50b', 'request_id': 'req-6c647547-84c4-47da-96f8-4995f6a9a29d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.255633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6c647547-84c4-47da-96f8-4995f6a9a29d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f557bac39ab348e5bc8a3e390270d50b', 'request_id': 'req-6c647547-84c4-47da-96f8-4995f6a9a29d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.310130 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2886/5748] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:38 2022] DELETE /identity/v3/users/95b38c37ad5943ca994292f7dd80af21 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:39.311715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90060c40-d966-4ca4-9d5b-de1f3d9e37e7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:39.312007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90060c40-d966-4ca4-9d5b-de1f3d9e37e7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:39.317273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90060c40-d966-4ca4-9d5b-de1f3d9e37e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:39.321165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6c647547-84c4-47da-96f8-4995f6a9a29d admin admin] The token cache is being invalidate because project f557bac39ab348e5bc8a3e390270d50b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:39.323534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6c647547-84c4-47da-96f8-4995f6a9a29d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.324597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6c647547-84c4-47da-96f8-4995f6a9a29d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.327594 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2863/5749] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:38 2022] DELETE /identity/v3/projects/f557bac39ab348e5bc8a3e390270d50b => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:39.345035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524f94-1ee6-40af-b532-7184148f07fe None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:39.347732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524f94-1ee6-40af-b532-7184148f07fe None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:39.349024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524f94-1ee6-40af-b532-7184148f07fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:39.370297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-90060c40-d966-4ca4-9d5b-de1f3d9e37e7 None None] MFA Rules not processed for user `51b44ebd62ab40e781f7922667a15482`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:39.372511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-90060c40-d966-4ca4-9d5b-de1f3d9e37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:39.404649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c0524f94-1ee6-40af-b532-7184148f07fe None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:39.407710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c0524f94-1ee6-40af-b532-7184148f07fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:39.458414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:39.558286 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2864/5750] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:39.562213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0524f94-1ee6-40af-b532-7184148f07fe None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:39.566296 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2887/5751] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:39.571134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c0524f94-1ee6-40af-b532-7184148f07fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:39.572794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90060c40-d966-4ca4-9d5b-de1f3d9e37e7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:39.599876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0524f94-1ee6-40af-b532-7184148f07fe None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:39.600529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-90060c40-d966-4ca4-9d5b-de1f3d9e37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:39.604955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:39.605630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:39.606073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:39.606361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] PATH_INFO: `/v3/users/18019f70668242178bb1a634a278206a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:39.616487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18019f70668242178bb1a634a278206a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:39.618497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:39.619721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90060c40-d966-4ca4-9d5b-de1f3d9e37e7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:39.627542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2d7e4-5ed0-4e68-876f-6254ef51757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:39.629310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d7e4-5ed0-4e68-876f-6254ef51757f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:39.629873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d7e4-5ed0-4e68-876f-6254ef51757f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:39.630156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d7e4-5ed0-4e68-876f-6254ef51757f admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:39.630911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2d7e4-5ed0-4e68-876f-6254ef51757f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:39.633789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2d7e4-5ed0-4e68-876f-6254ef51757f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:39.700461 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2888/5752] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:39 2022] POST /identity/v3/projects => generated 393 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:39.704623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2d7e4-5ed0-4e68-876f-6254ef51757f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:39.710630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-08c2d7e4-5ed0-4e68-876f-6254ef51757f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:39.721881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18019f70668242178bb1a634a278206a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.724273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:39.734459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18019f70668242178bb1a634a278206a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.735433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18019f70668242178bb1a634a278206a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.736122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18019f70668242178bb1a634a278206a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.762985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18019f70668242178bb1a634a278206a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:39.793467 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2865/5753] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:39 2022] DELETE /identity/v3/users/18019f70668242178bb1a634a278206a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:39.793719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:39.796063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:39.890712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2d7e4-5ed0-4e68-876f-6254ef51757f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:39.982946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5abe40-c725-4751-94c5-093ac3f98e60 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:39.992068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d24d0-86d0-40ea-912f-30eddbc41816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:39.992806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d24d0-86d0-40ea-912f-30eddbc41816 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:39.993290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d24d0-86d0-40ea-912f-30eddbc41816 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:39.993646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d24d0-86d0-40ea-912f-30eddbc41816 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:39.994991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d24d0-86d0-40ea-912f-30eddbc41816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:39.998095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d24d0-86d0-40ea-912f-30eddbc41816 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:40.025888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491f197-c443-4829-8e13-7da32acf7039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:40.026520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491f197-c443-4829-8e13-7da32acf7039 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:40.026854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491f197-c443-4829-8e13-7da32acf7039 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:40.027131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491f197-c443-4829-8e13-7da32acf7039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:40.028763 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2866/5754] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:39 2022] POST /identity/v3/users => generated 303 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:40.033151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d24d0-86d0-40ea-912f-30eddbc41816 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:40.035508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9491f197-c443-4829-8e13-7da32acf7039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:40.047176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d24d0-86d0-40ea-912f-30eddbc41816 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:40.053287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c262f-08c4-4152-a184-6ec5b9f4ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:40.053916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c262f-08c4-4152-a184-6ec5b9f4ce22 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:40.054204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c262f-08c4-4152-a184-6ec5b9f4ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:40.054483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c262f-08c4-4152-a184-6ec5b9f4ce22 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:40.055198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c262f-08c4-4152-a184-6ec5b9f4ce22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:40.056886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c262f-08c4-4152-a184-6ec5b9f4ce22 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:40.063663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491f197-c443-4829-8e13-7da32acf7039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:40.065138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491f197-c443-4829-8e13-7da32acf7039 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:40.080119 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2867/5755] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:13:40.084915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c262f-08c4-4152-a184-6ec5b9f4ce22 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:40.095360 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2889/5756] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:40.105487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c262f-08c4-4152-a184-6ec5b9f4ce22 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:40.113723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968c061-e306-4c45-a107-00a6040dbacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:40.115106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968c061-e306-4c45-a107-00a6040dbacf admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:40.116201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968c061-e306-4c45-a107-00a6040dbacf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:40.116745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968c061-e306-4c45-a107-00a6040dbacf admin admin] PATH_INFO: `/v3/projects/b54376e8f42e403596d65bcb4bf82032/users/f99403a3be4f4942a2421c3c9bf63662/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:40.150883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968c061-e306-4c45-a107-00a6040dbacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54376e8f42e403596d65bcb4bf82032, user_id=f99403a3be4f4942a2421c3c9bf63662, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:40.154060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968c061-e306-4c45-a107-00a6040dbacf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:40.177087 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2868/5757] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:40 2022] PUT /identity/v3/projects/b54376e8f42e403596d65bcb4bf82032/users/f99403a3be4f4942a2421c3c9bf63662/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:40.181021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491f197-c443-4829-8e13-7da32acf7039 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:40.196033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491f197-c443-4829-8e13-7da32acf7039 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:40.297242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66879f8a-a7bf-4e7d-a7c1-4aea5e4042a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:40.298967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66879f8a-a7bf-4e7d-a7c1-4aea5e4042a0 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:40.299403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66879f8a-a7bf-4e7d-a7c1-4aea5e4042a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:40.300681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66879f8a-a7bf-4e7d-a7c1-4aea5e4042a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:40.301576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66879f8a-a7bf-4e7d-a7c1-4aea5e4042a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:40.304350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66879f8a-a7bf-4e7d-a7c1-4aea5e4042a0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:40.329225 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2890/5758] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:13:40.333770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968c061-e306-4c45-a107-00a6040dbacf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:40.366221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968c061-e306-4c45-a107-00a6040dbacf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:40.380425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886118e-01a1-45c0-9ea2-98b7b639ea1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:40.381127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886118e-01a1-45c0-9ea2-98b7b639ea1f admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:40.383159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886118e-01a1-45c0-9ea2-98b7b639ea1f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:40.383453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886118e-01a1-45c0-9ea2-98b7b639ea1f admin admin] PATH_INFO: `/v3/projects/b54376e8f42e403596d65bcb4bf82032/users/f99403a3be4f4942a2421c3c9bf63662/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:40.394453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886118e-01a1-45c0-9ea2-98b7b639ea1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54376e8f42e403596d65bcb4bf82032, user_id=f99403a3be4f4942a2421c3c9bf63662, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:40.405417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886118e-01a1-45c0-9ea2-98b7b639ea1f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:40.441526 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2869/5759] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:40 2022] PUT /identity/v3/projects/b54376e8f42e403596d65bcb4bf82032/users/f99403a3be4f4942a2421c3c9bf63662/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:40.447210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60d872-bafd-42fb-9b14-51255ba12294 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:40.447424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60d872-bafd-42fb-9b14-51255ba12294 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:40.447695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60d872-bafd-42fb-9b14-51255ba12294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:40.521245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7a60d872-bafd-42fb-9b14-51255ba12294 None None] MFA Rules not processed for user `f99403a3be4f4942a2421c3c9bf63662`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:40.522847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7a60d872-bafd-42fb-9b14-51255ba12294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:40.528302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:40.633829 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2891/5760] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:40.677524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886118e-01a1-45c0-9ea2-98b7b639ea1f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:40.680477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6886118e-01a1-45c0-9ea2-98b7b639ea1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:40.743646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60d872-bafd-42fb-9b14-51255ba12294 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:40.746011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7a60d872-bafd-42fb-9b14-51255ba12294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:40.925832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886118e-01a1-45c0-9ea2-98b7b639ea1f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:40.926940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60d872-bafd-42fb-9b14-51255ba12294 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:40.935089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694a36f-0332-4054-9b5d-803415391f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:40.936837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694a36f-0332-4054-9b5d-803415391f20 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:40.937358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694a36f-0332-4054-9b5d-803415391f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:40.937889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694a36f-0332-4054-9b5d-803415391f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:40.947626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:40.949626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:40.950003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:40.950301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] PATH_INFO: `/v3/users/fe5ee5ec04e44011bf77cbade8ef6cf3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:40.954079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694a36f-0332-4054-9b5d-803415391f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:40.956618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5ee5ec04e44011bf77cbade8ef6cf3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:40.957239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694a36f-0332-4054-9b5d-803415391f20 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:40.959393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:40.982781 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2870/5761] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:41.102463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5ee5ec04e44011bf77cbade8ef6cf3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:41.119131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5ee5ec04e44011bf77cbade8ef6cf3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:41.120668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5ee5ec04e44011bf77cbade8ef6cf3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:41.121473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5ee5ec04e44011bf77cbade8ef6cf3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:41.173250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5ee5ec04e44011bf77cbade8ef6cf3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:41.204819 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2892/5762] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:40 2022] DELETE /identity/v3/users/fe5ee5ec04e44011bf77cbade8ef6cf3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:41.207665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbce2d7-c5f5-4703-b637-6dde67558e16 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:41.210923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbce2d7-c5f5-4703-b637-6dde67558e16 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:41.211283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbce2d7-c5f5-4703-b637-6dde67558e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:41.243032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6fbce2d7-c5f5-4703-b637-6dde67558e16 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:41.245116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6fbce2d7-c5f5-4703-b637-6dde67558e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:41.253846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:41.379958 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2871/5763] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:13:41.395231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:41.396762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:41.426102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbce2d7-c5f5-4703-b637-6dde67558e16 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:41.427579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6fbce2d7-c5f5-4703-b637-6dde67558e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:41.451242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbce2d7-c5f5-4703-b637-6dde67558e16 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:41.454046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:41.469241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d492b-fba3-41d7-be04-64222ef27549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:41.469908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d492b-fba3-41d7-be04-64222ef27549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:41.470709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d492b-fba3-41d7-be04-64222ef27549 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:41.470709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d492b-fba3-41d7-be04-64222ef27549 admin admin] PATH_INFO: `/v3/projects/eff1fd49d8e84409b42969874d575d0a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:41.477370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d492b-fba3-41d7-be04-64222ef27549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff1fd49d8e84409b42969874d575d0a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:41.478228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d492b-fba3-41d7-be04-64222ef27549 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:41.601907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeea500-180d-4d81-8766-207f896d58e7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:41.609998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90148ce-06c1-4b54-80a7-c9ed05f0fd97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:41.610635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90148ce-06c1-4b54-80a7-c9ed05f0fd97 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:41.610918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90148ce-06c1-4b54-80a7-c9ed05f0fd97 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:41.611189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90148ce-06c1-4b54-80a7-c9ed05f0fd97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:41.646240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90148ce-06c1-4b54-80a7-c9ed05f0fd97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:41.647449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90148ce-06c1-4b54-80a7-c9ed05f0fd97 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:41.657860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e25d492b-fba3-41d7-be04-64222ef27549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff1fd49d8e84409b42969874d575d0a', 'request_id': 'req-e25d492b-fba3-41d7-be04-64222ef27549'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:41.670490 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2893/5764] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:41.671414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90148ce-06c1-4b54-80a7-c9ed05f0fd97 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:41.673829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e25d492b-fba3-41d7-be04-64222ef27549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff1fd49d8e84409b42969874d575d0a', 'request_id': 'req-e25d492b-fba3-41d7-be04-64222ef27549'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:41.683019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d90148ce-06c1-4b54-80a7-c9ed05f0fd97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:41.684798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e25d492b-fba3-41d7-be04-64222ef27549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff1fd49d8e84409b42969874d575d0a', 'request_id': 'req-e25d492b-fba3-41d7-be04-64222ef27549'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:41.719134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90148ce-06c1-4b54-80a7-c9ed05f0fd97 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:41.729627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e25d492b-fba3-41d7-be04-64222ef27549 admin admin] The token cache is being invalidate because project eff1fd49d8e84409b42969874d575d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:41.729940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e25d492b-fba3-41d7-be04-64222ef27549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:41.731067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e25d492b-fba3-41d7-be04-64222ef27549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:41.741977 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2872/5765] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:41 2022] DELETE /identity/v3/projects/eff1fd49d8e84409b42969874d575d0a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:41.747135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8a994-9cbe-4663-8bbd-526da4a2f5db None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:41.747135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8a994-9cbe-4663-8bbd-526da4a2f5db None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:41.747135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8a994-9cbe-4663-8bbd-526da4a2f5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:41.825921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0bc8a994-9cbe-4663-8bbd-526da4a2f5db None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:41.831901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0bc8a994-9cbe-4663-8bbd-526da4a2f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:41.938352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef22102-79a0-4c1c-af8d-798d87593184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:41.939923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef22102-79a0-4c1c-af8d-798d87593184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:41.941521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef22102-79a0-4c1c-af8d-798d87593184 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:41.942366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef22102-79a0-4c1c-af8d-798d87593184 admin admin] PATH_INFO: `/v3/projects/3acc195957ea4d1ca97cc8ea71cb6c29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:41.944446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef22102-79a0-4c1c-af8d-798d87593184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3acc195957ea4d1ca97cc8ea71cb6c29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:41.949078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef22102-79a0-4c1c-af8d-798d87593184 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:42.114347 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2873/5766] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:42.123788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dba8a-fe8c-4e83-b837-6325ad187851 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:42.124787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dba8a-fe8c-4e83-b837-6325ad187851 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:42.127032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dba8a-fe8c-4e83-b837-6325ad187851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:42.131960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bef22102-79a0-4c1c-af8d-798d87593184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3acc195957ea4d1ca97cc8ea71cb6c29', 'request_id': 'req-bef22102-79a0-4c1c-af8d-798d87593184'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:42.153118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bef22102-79a0-4c1c-af8d-798d87593184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3acc195957ea4d1ca97cc8ea71cb6c29', 'request_id': 'req-bef22102-79a0-4c1c-af8d-798d87593184'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:42.172685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bef22102-79a0-4c1c-af8d-798d87593184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3acc195957ea4d1ca97cc8ea71cb6c29', 'request_id': 'req-bef22102-79a0-4c1c-af8d-798d87593184'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:42.202283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bef22102-79a0-4c1c-af8d-798d87593184 admin admin] The token cache is being invalidate because project 3acc195957ea4d1ca97cc8ea71cb6c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:42.203863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bef22102-79a0-4c1c-af8d-798d87593184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:42.206688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bef22102-79a0-4c1c-af8d-798d87593184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:42.210504 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2894/5767] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:41 2022] DELETE /identity/v3/projects/3acc195957ea4d1ca97cc8ea71cb6c29 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:42.216267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115e73f-f995-45a4-8fe2-ba425e90d157 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:42.217124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115e73f-f995-45a4-8fe2-ba425e90d157 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:42.217906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115e73f-f995-45a4-8fe2-ba425e90d157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:42.235940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-111dba8a-fe8c-4e83-b837-6325ad187851 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:42.242222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-111dba8a-fe8c-4e83-b837-6325ad187851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:42.284949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e115e73f-f995-45a4-8fe2-ba425e90d157 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:42.286653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e115e73f-f995-45a4-8fe2-ba425e90d157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:42.332993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:42.417601 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2874/5768] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:42.422279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dba8a-fe8c-4e83-b837-6325ad187851 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:42.440340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dba8a-fe8c-4e83-b837-6325ad187851 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:42.448087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df52453-b19f-4fce-a662-18011f86e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:42.449063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52453-b19f-4fce-a662-18011f86e33b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:42.450080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52453-b19f-4fce-a662-18011f86e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:42.450650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52453-b19f-4fce-a662-18011f86e33b admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:42.453132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df52453-b19f-4fce-a662-18011f86e33b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:13:42.454330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df52453-b19f-4fce-a662-18011f86e33b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:42.458538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df52453-b19f-4fce-a662-18011f86e33b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:42.488674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:42.500332 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2875/5769] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:42.502172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df52453-b19f-4fce-a662-18011f86e33b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:42.528341 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2895/5770] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:13:42.529457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df52453-b19f-4fce-a662-18011f86e33b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:42.530703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f8e91-1208-4e1a-88ab-db712d568606 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:42.531245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f8e91-1208-4e1a-88ab-db712d568606 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:42.531582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f8e91-1208-4e1a-88ab-db712d568606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:42.536176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618000-bb9a-42e2-a7af-3cac69ec4a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:42.536981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618000-bb9a-42e2-a7af-3cac69ec4a08 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:42.537344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618000-bb9a-42e2-a7af-3cac69ec4a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:42.537624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618000-bb9a-42e2-a7af-3cac69ec4a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:42.538267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f618000-bb9a-42e2-a7af-3cac69ec4a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:42.553871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f618000-bb9a-42e2-a7af-3cac69ec4a08 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:42.582540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bf1f8e91-1208-4e1a-88ab-db712d568606 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:42.583840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bf1f8e91-1208-4e1a-88ab-db712d568606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:42.618143 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2896/5771] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:42.622424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f8e91-1208-4e1a-88ab-db712d568606 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:42.655449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f8e91-1208-4e1a-88ab-db712d568606 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:42.664284 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2876/5772] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:42 2022] POST /identity/v3/projects => generated 369 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:42.670337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618000-bb9a-42e2-a7af-3cac69ec4a08 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:42.796133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83f348-147a-47d5-b617-bd6edf83f1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:42.796676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83f348-147a-47d5-b617-bd6edf83f1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:42.796951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83f348-147a-47d5-b617-bd6edf83f1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:42.799175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83f348-147a-47d5-b617-bd6edf83f1f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:42.800152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83f348-147a-47d5-b617-bd6edf83f1f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:13:42.800581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83f348-147a-47d5-b617-bd6edf83f1f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:42.802239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83f348-147a-47d5-b617-bd6edf83f1f0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:42.825168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618000-bb9a-42e2-a7af-3cac69ec4a08 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:42.841054 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2897/5773] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:13:42.842616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83f348-147a-47d5-b617-bd6edf83f1f0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:42.844332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0b83f348-147a-47d5-b617-bd6edf83f1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:42.848295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5b318-ee0b-4807-958c-b4ac6ac5ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:42.849229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5b318-ee0b-4807-958c-b4ac6ac5ba21 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:42.849731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5b318-ee0b-4807-958c-b4ac6ac5ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:42.850511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5b318-ee0b-4807-958c-b4ac6ac5ba21 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:42.851368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5b318-ee0b-4807-958c-b4ac6ac5ba21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:42.854168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5b318-ee0b-4807-958c-b4ac6ac5ba21 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:42.866001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83f348-147a-47d5-b617-bd6edf83f1f0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:42.871715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:42.872504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:42.872782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:42.873052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] PATH_INFO: `/v3/users/34519d5169994688ba28db116e249b5f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:42.875163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=34519d5169994688ba28db116e249b5f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:42.877480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:42.894227 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2877/5774] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:42 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:42.895528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5b318-ee0b-4807-958c-b4ac6ac5ba21 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:42.909998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5b318-ee0b-4807-958c-b4ac6ac5ba21 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:42.917939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d583f-c24b-4a95-ab19-5a1ed8af2daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:42.918756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d583f-c24b-4a95-ab19-5a1ed8af2daa admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:42.919096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d583f-c24b-4a95-ab19-5a1ed8af2daa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:42.919533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d583f-c24b-4a95-ab19-5a1ed8af2daa admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:42.921533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d583f-c24b-4a95-ab19-5a1ed8af2daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:42.929284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d583f-c24b-4a95-ab19-5a1ed8af2daa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:42.957967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34519d5169994688ba28db116e249b5f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:42.977703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34519d5169994688ba28db116e249b5f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:42.980434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34519d5169994688ba28db116e249b5f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:42.982417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34519d5169994688ba28db116e249b5f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:42.997147 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2878/5775] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:42 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:42.999480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d583f-c24b-4a95-ab19-5a1ed8af2daa admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:43.002010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bc9d583f-c24b-4a95-ab19-5a1ed8af2daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:43.022733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34519d5169994688ba28db116e249b5f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:43.046080 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2898/5776] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:42 2022] DELETE /identity/v3/users/34519d5169994688ba28db116e249b5f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:43.047092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:43.048424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:43.130992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:43.141575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d583f-c24b-4a95-ab19-5a1ed8af2daa admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:43.157509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668d428-d28b-463b-b1ff-0efa349f8237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:43.157509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668d428-d28b-463b-b1ff-0efa349f8237 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.158516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668d428-d28b-463b-b1ff-0efa349f8237 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.158798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668d428-d28b-463b-b1ff-0efa349f8237 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.164054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668d428-d28b-463b-b1ff-0efa349f8237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:43.167056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a433aa9-1923-4424-a79d-6684f17a20cc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:43.168316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668d428-d28b-463b-b1ff-0efa349f8237 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:43.180867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:43.181722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.181819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.182219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] PATH_INFO: `/v3/projects/e20d16d934c94f94b1edda85360c5d6e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.184809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20d16d934c94f94b1edda85360c5d6e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:43.188613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:43.193031 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2879/5777] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:43.205488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668d428-d28b-463b-b1ff-0efa349f8237 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:43.205488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b668d428-d28b-463b-b1ff-0efa349f8237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:43.233430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:43.241265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668d428-d28b-463b-b1ff-0efa349f8237 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:43.252622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd99f0d-5c67-4fd1-b51c-9198fab03aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:43.253539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd99f0d-5c67-4fd1-b51c-9198fab03aee admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.254487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd99f0d-5c67-4fd1-b51c-9198fab03aee admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.254873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd99f0d-5c67-4fd1-b51c-9198fab03aee admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.255698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd99f0d-5c67-4fd1-b51c-9198fab03aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:43.257865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd99f0d-5c67-4fd1-b51c-9198fab03aee admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:43.304555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20d16d934c94f94b1edda85360c5d6e', 'request_id': 'req-271b78f0-3f22-4c9b-9cb5-26275c758da9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:43.319355 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2880/5778] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:43 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:43.322568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5de694-0aa1-4028-9ea7-9755e5ea017a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.322851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5de694-0aa1-4028-9ea7-9755e5ea017a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.323536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5de694-0aa1-4028-9ea7-9755e5ea017a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.333883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20d16d934c94f94b1edda85360c5d6e', 'request_id': 'req-271b78f0-3f22-4c9b-9cb5-26275c758da9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:43.350824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20d16d934c94f94b1edda85360c5d6e', 'request_id': 'req-271b78f0-3f22-4c9b-9cb5-26275c758da9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:43.361622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-de5de694-0aa1-4028-9ea7-9755e5ea017a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:43.368092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-de5de694-0aa1-4028-9ea7-9755e5ea017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:43.375652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] The token cache is being invalidate because project e20d16d934c94f94b1edda85360c5d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:43.375955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:43.380747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:43.386547 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2899/5779] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:43 2022] DELETE /identity/v3/projects/e20d16d934c94f94b1edda85360c5d6e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:43.386547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:43.386547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:43.463200 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2881/5780] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:43.467348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5de694-0aa1-4028-9ea7-9755e5ea017a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:43.467348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-de5de694-0aa1-4028-9ea7-9755e5ea017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:43.480364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5de694-0aa1-4028-9ea7-9755e5ea017a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:43.489552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b36fb-abbb-49b7-8934-b51c04f0bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:43.490574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b36fb-abbb-49b7-8934-b51c04f0bf34 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.490935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b36fb-abbb-49b7-8934-b51c04f0bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.491266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b36fb-abbb-49b7-8934-b51c04f0bf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.492009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b36fb-abbb-49b7-8934-b51c04f0bf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:43.493849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b36fb-abbb-49b7-8934-b51c04f0bf34 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:43.508608 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2882/5781] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:43.518142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1269d15-1639-483d-8536-625224872852 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.519372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1269d15-1639-483d-8536-625224872852 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.520202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1269d15-1639-483d-8536-625224872852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.526108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b78f0-3f22-4c9b-9cb5-26275c758da9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:43.533712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d573f-953b-4685-b7d8-0857a3828fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:43.534583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d573f-953b-4685-b7d8-0857a3828fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.535756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d573f-953b-4685-b7d8-0857a3828fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.536213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d573f-953b-4685-b7d8-0857a3828fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.537029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d573f-953b-4685-b7d8-0857a3828fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:43.539796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d573f-953b-4685-b7d8-0857a3828fe8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:43.553464 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2900/5782] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:43.554985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ef3cd-3210-4df0-b90b-fe1a8c4a5dcf None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.555441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ef3cd-3210-4df0-b90b-fe1a8c4a5dcf None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.556336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ef3cd-3210-4df0-b90b-fe1a8c4a5dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.563232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b1269d15-1639-483d-8536-625224872852 None None] MFA Rules not processed for user `b6300eee278b4fad9561ebea03c2eeaa`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:43.566227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b1269d15-1639-483d-8536-625224872852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:43.579574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-795ef3cd-3210-4df0-b90b-fe1a8c4a5dcf None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:43.580877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-795ef3cd-3210-4df0-b90b-fe1a8c4a5dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:43.589256 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2901/5783] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:43.596847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ef3cd-3210-4df0-b90b-fe1a8c4a5dcf None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:43.613151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-795ef3cd-3210-4df0-b90b-fe1a8c4a5dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:43.672651 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2883/5784] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:43.673568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1269d15-1639-483d-8536-625224872852 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:43.692496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1269d15-1639-483d-8536-625224872852 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:43.698208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0bf67-dfd8-406a-9642-c9f408e77571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:43.699293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0bf67-dfd8-406a-9642-c9f408e77571 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.699916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0bf67-dfd8-406a-9642-c9f408e77571 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.699916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0bf67-dfd8-406a-9642-c9f408e77571 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.700491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0bf67-dfd8-406a-9642-c9f408e77571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:43.702453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0bf67-dfd8-406a-9642-c9f408e77571 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:43.724686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ef3cd-3210-4df0-b90b-fe1a8c4a5dcf None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:43.728959 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2884/5785] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:43.728959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0bf67-dfd8-406a-9642-c9f408e77571 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:43.729600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844d032-13a6-4537-ad1d-f92c4c50f9d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:43.730403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844d032-13a6-4537-ad1d-f92c4c50f9d1 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.730694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844d032-13a6-4537-ad1d-f92c4c50f9d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.731085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844d032-13a6-4537-ad1d-f92c4c50f9d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.741494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0bf67-dfd8-406a-9642-c9f408e77571 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:43.742347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844d032-13a6-4537-ad1d-f92c4c50f9d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:43.745844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844d032-13a6-4537-ad1d-f92c4c50f9d1 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:43.746631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a8367-a123-4c30-8e02-ce77bca3d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:43.747304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a8367-a123-4c30-8e02-ce77bca3d75d admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.747585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a8367-a123-4c30-8e02-ce77bca3d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.748014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a8367-a123-4c30-8e02-ce77bca3d75d admin admin] PATH_INFO: `/v3/projects/68a9da7d148747d891eb7796da1fca6f/users/2bb05353c8414bdb9ce12685cdbffeab/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.762383 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2902/5786] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:43.763971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14923169-b02b-461c-922d-be8deb5b7c12 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.764339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14923169-b02b-461c-922d-be8deb5b7c12 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.764691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14923169-b02b-461c-922d-be8deb5b7c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.766869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a8367-a123-4c30-8e02-ce77bca3d75d admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a9da7d148747d891eb7796da1fca6f, user_id=2bb05353c8414bdb9ce12685cdbffeab, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:43.770695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a8367-a123-4c30-8e02-ce77bca3d75d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:43.790157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-14923169-b02b-461c-922d-be8deb5b7c12 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:43.791746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-14923169-b02b-461c-922d-be8deb5b7c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:43.802556 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2885/5787] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:43 2022] PUT /identity/v3/projects/68a9da7d148747d891eb7796da1fca6f/users/2bb05353c8414bdb9ce12685cdbffeab/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:43.802556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6d0b5-37a0-41c0-b944-45fdbdbe0b78 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.802556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6d0b5-37a0-41c0-b944-45fdbdbe0b78 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.802556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6d0b5-37a0-41c0-b944-45fdbdbe0b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.810627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:43.822736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-97d6d0b5-37a0-41c0-b944-45fdbdbe0b78 None None] MFA Rules not processed for user `b6300eee278b4fad9561ebea03c2eeaa`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:43.823989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-97d6d0b5-37a0-41c0-b944-45fdbdbe0b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:43.856069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:43.899940 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2886/5788] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:43.899940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6d0b5-37a0-41c0-b944-45fdbdbe0b78 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:43.900240 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2903/5789] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:43.900240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e575c-224c-4443-adf6-407ec2b187e0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.900240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e575c-224c-4443-adf6-407ec2b187e0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.900240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e575c-224c-4443-adf6-407ec2b187e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.913616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6d0b5-37a0-41c0-b944-45fdbdbe0b78 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:43.919354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac9e2c-898f-4ad9-b17f-aed9a8dadf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:43.920015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac9e2c-898f-4ad9-b17f-aed9a8dadf16 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:43.920531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac9e2c-898f-4ad9-b17f-aed9a8dadf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:43.921200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac9e2c-898f-4ad9-b17f-aed9a8dadf16 admin admin] PATH_INFO: `/v3/projects/ea959089492a40dab44b2dff72bfc7d7/users/eeeb7211724d46b0841f47c4ebe22920/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:43.939067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac9e2c-898f-4ad9-b17f-aed9a8dadf16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea959089492a40dab44b2dff72bfc7d7, user_id=eeeb7211724d46b0841f47c4ebe22920, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:43.942826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac9e2c-898f-4ad9-b17f-aed9a8dadf16 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:43.947009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a99e575c-224c-4443-adf6-407ec2b187e0 None None] MFA Rules not processed for user `2bb05353c8414bdb9ce12685cdbffeab`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:43.948735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a99e575c-224c-4443-adf6-407ec2b187e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:43.989063 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2887/5790] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:43 2022] PUT /identity/v3/projects/ea959089492a40dab44b2dff72bfc7d7/users/eeeb7211724d46b0841f47c4ebe22920/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:43.989063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac9e2c-898f-4ad9-b17f-aed9a8dadf16 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:44.081092 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2904/5791] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:44.082494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e575c-224c-4443-adf6-407ec2b187e0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:44.083815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a99e575c-224c-4443-adf6-407ec2b187e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:44.121659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac9e2c-898f-4ad9-b17f-aed9a8dadf16 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:44.129017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2325a-80b7-4a23-8589-320f124cd2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:44.129941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2325a-80b7-4a23-8589-320f124cd2dd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:44.130700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2325a-80b7-4a23-8589-320f124cd2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:44.131402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2325a-80b7-4a23-8589-320f124cd2dd admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:44.132799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2325a-80b7-4a23-8589-320f124cd2dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:13:44.133290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2325a-80b7-4a23-8589-320f124cd2dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:44.136183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2325a-80b7-4a23-8589-320f124cd2dd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:44.154730 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2888/5792] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:44.160082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41529c53-8272-44fa-a305-b2be8428842f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:44.160649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41529c53-8272-44fa-a305-b2be8428842f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:44.163978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41529c53-8272-44fa-a305-b2be8428842f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:44.204806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-41529c53-8272-44fa-a305-b2be8428842f None None] MFA Rules not processed for user `eeeb7211724d46b0841f47c4ebe22920`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:44.208239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-41529c53-8272-44fa-a305-b2be8428842f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:44.211934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e575c-224c-4443-adf6-407ec2b187e0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:44.295886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:44.332076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e510f-fa99-4aee-a28f-08d2972793e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:44.332749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e510f-fa99-4aee-a28f-08d2972793e2 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:44.333060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e510f-fa99-4aee-a28f-08d2972793e2 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:44.334298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e510f-fa99-4aee-a28f-08d2972793e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:44.397819 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2889/5793] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:44.399973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41529c53-8272-44fa-a305-b2be8428842f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:44.427063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41529c53-8272-44fa-a305-b2be8428842f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:44.438721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5d14a-e6ca-493a-8ac7-78575edafd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:44.439352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5d14a-e6ca-493a-8ac7-78575edafd69 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:44.439633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5d14a-e6ca-493a-8ac7-78575edafd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:44.439906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5d14a-e6ca-493a-8ac7-78575edafd69 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:44.441125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5d14a-e6ca-493a-8ac7-78575edafd69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:44.447460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5d14a-e6ca-493a-8ac7-78575edafd69 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:44.454111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e510f-fa99-4aee-a28f-08d2972793e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:44.456776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e510f-fa99-4aee-a28f-08d2972793e2 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:44.505613 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2905/5794] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:44 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:44.522263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e510f-fa99-4aee-a28f-08d2972793e2 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:44.562674 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2890/5795] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:44 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:44.563754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5d14a-e6ca-493a-8ac7-78575edafd69 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:44.615313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:44.677774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5d14a-e6ca-493a-8ac7-78575edafd69 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:44.683081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fa039-3664-4d13-813a-a3082f23b8cc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb7211724d46b0841f47c4ebe22920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea959089492a40dab44b2dff72bfc7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:44.683820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fa039-3664-4d13-813a-a3082f23b8cc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:44.684171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fa039-3664-4d13-813a-a3082f23b8cc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:44.684514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fa039-3664-4d13-813a-a3082f23b8cc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:44.685396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fa039-3664-4d13-813a-a3082f23b8cc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=eeeb7211724d46b0841f47c4ebe22920)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:44.687080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fa039-3664-4d13-813a-a3082f23b8cc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:44.709645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e510f-fa99-4aee-a28f-08d2972793e2 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:44.715624 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2891/5796] 10.222.0.26 () {60 vars in 1299 bytes} [Sat Oct 8 21:13:44 2022] POST /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2 => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:44.716891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fa039-3664-4d13-813a-a3082f23b8cc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:44.841345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fa039-3664-4d13-813a-a3082f23b8cc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:44.841884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccfa2d-22f0-429b-bf36-247a585d9916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:44.842738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccfa2d-22f0-429b-bf36-247a585d9916 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:44.843349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccfa2d-22f0-429b-bf36-247a585d9916 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:44.844002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccfa2d-22f0-429b-bf36-247a585d9916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:44.870227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765752b2-e5e4-40a1-a1d8-84cd53326005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:44.870938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765752b2-e5e4-40a1-a1d8-84cd53326005 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:44.871223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765752b2-e5e4-40a1-a1d8-84cd53326005 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:44.871503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765752b2-e5e4-40a1-a1d8-84cd53326005 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:44.872459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765752b2-e5e4-40a1-a1d8-84cd53326005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:44.884741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765752b2-e5e4-40a1-a1d8-84cd53326005 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:44.937519 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2892/5797] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:44 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:44.937519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765752b2-e5e4-40a1-a1d8-84cd53326005 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:44.958318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765752b2-e5e4-40a1-a1d8-84cd53326005 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:44.966966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2315b3-7e38-4525-9b11-2e4801c3fbfc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb7211724d46b0841f47c4ebe22920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea959089492a40dab44b2dff72bfc7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:44.967638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2315b3-7e38-4525-9b11-2e4801c3fbfc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:44.967923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2315b3-7e38-4525-9b11-2e4801c3fbfc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:44.968203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2315b3-7e38-4525-9b11-2e4801c3fbfc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/97dba8cafc4845d1887259a31cb98d03` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:44.970668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:44.971178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2315b3-7e38-4525-9b11-2e4801c3fbfc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=eeeb7211724d46b0841f47c4ebe22920, credential_id=97dba8cafc4845d1887259a31cb98d03)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:44.973164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2315b3-7e38-4525-9b11-2e4801c3fbfc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:44.992469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccfa2d-22f0-429b-bf36-247a585d9916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:44.995203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccfa2d-22f0-429b-bf36-247a585d9916 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.015006 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2906/5798] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:45.017309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccfa2d-22f0-429b-bf36-247a585d9916 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.021830 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2893/5799] 10.222.0.26 () {58 vars in 1380 bytes} [Sat Oct 8 21:13:44 2022] DELETE /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/97dba8cafc4845d1887259a31cb98d03 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:45.025922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2315b3-7e38-4525-9b11-2e4801c3fbfc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.046299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2315b3-7e38-4525-9b11-2e4801c3fbfc tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.047972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccfa2d-22f0-429b-bf36-247a585d9916 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.052649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090e0cf-2598-4926-b526-c90c699e31da tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb7211724d46b0841f47c4ebe22920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea959089492a40dab44b2dff72bfc7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.053609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090e0cf-2598-4926-b526-c90c699e31da tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.053755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0b8e8-7ee8-42ea-97cc-57b3cb04caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.053927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090e0cf-2598-4926-b526-c90c699e31da tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.054266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0b8e8-7ee8-42ea-97cc-57b3cb04caa9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.054401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090e0cf-2598-4926-b526-c90c699e31da tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.054544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0b8e8-7ee8-42ea-97cc-57b3cb04caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.054832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0b8e8-7ee8-42ea-97cc-57b3cb04caa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.055155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090e0cf-2598-4926-b526-c90c699e31da tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=eeeb7211724d46b0841f47c4ebe22920)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:45.057500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090e0cf-2598-4926-b526-c90c699e31da tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.067248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0b8e8-7ee8-42ea-97cc-57b3cb04caa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:45.072274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0b8e8-7ee8-42ea-97cc-57b3cb04caa9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.083045 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2894/5800] 10.222.0.26 () {60 vars in 1299 bytes} [Sat Oct 8 21:13:45 2022] POST /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2 => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:45.087032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090e0cf-2598-4926-b526-c90c699e31da tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.105683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090e0cf-2598-4926-b526-c90c699e31da tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.113281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a139b7-1eb6-486d-8ce2-f47f562cdc29 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb7211724d46b0841f47c4ebe22920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea959089492a40dab44b2dff72bfc7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.114149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a139b7-1eb6-486d-8ce2-f47f562cdc29 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.114577 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2907/5801] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:45.114873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a139b7-1eb6-486d-8ce2-f47f562cdc29 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.115490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a139b7-1eb6-486d-8ce2-f47f562cdc29 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/e5312bac3ae74a8b8111e7a19aaa55b1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.118988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a139b7-1eb6-486d-8ce2-f47f562cdc29 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=eeeb7211724d46b0841f47c4ebe22920, credential_id=e5312bac3ae74a8b8111e7a19aaa55b1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:45.120728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0b8e8-7ee8-42ea-97cc-57b3cb04caa9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.121025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a139b7-1eb6-486d-8ce2-f47f562cdc29 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.146054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0b8e8-7ee8-42ea-97cc-57b3cb04caa9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.156068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd9e9f-66fd-4830-afb8-404c1456b116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.159972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9e9f-66fd-4830-afb8-404c1456b116 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.160465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9e9f-66fd-4830-afb8-404c1456b116 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.160952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9e9f-66fd-4830-afb8-404c1456b116 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.163087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd9e9f-66fd-4830-afb8-404c1456b116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:45.164839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd9e9f-66fd-4830-afb8-404c1456b116 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.165293 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2895/5802] 10.222.0.26 () {58 vars in 1380 bytes} [Sat Oct 8 21:13:45 2022] DELETE /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/e5312bac3ae74a8b8111e7a19aaa55b1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:45.170147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a139b7-1eb6-486d-8ce2-f47f562cdc29 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.185223 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2908/5803] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:45.185223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd9e9f-66fd-4830-afb8-404c1456b116 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.200717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a139b7-1eb6-486d-8ce2-f47f562cdc29 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.203076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd9e9f-66fd-4830-afb8-404c1456b116 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.207341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7546a-1598-41d4-8454-1dcc93dfd866 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb7211724d46b0841f47c4ebe22920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea959089492a40dab44b2dff72bfc7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.208500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7546a-1598-41d4-8454-1dcc93dfd866 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.208794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7546a-1598-41d4-8454-1dcc93dfd866 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.209079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7546a-1598-41d4-8454-1dcc93dfd866 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/e5312bac3ae74a8b8111e7a19aaa55b1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.210030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b67064-ab0e-429c-a757-41b66eef4d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.210807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67064-ab0e-429c-a757-41b66eef4d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.211195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67064-ab0e-429c-a757-41b66eef4d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.211575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67064-ab0e-429c-a757-41b66eef4d3b admin admin] PATH_INFO: `/v3/projects/9dd51263022340de856a8aa8e2272499/users/7007fb264988426f927e5f98dba676a6/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.239117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b67064-ab0e-429c-a757-41b66eef4d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd51263022340de856a8aa8e2272499, user_id=7007fb264988426f927e5f98dba676a6, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:45.245272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b67064-ab0e-429c-a757-41b66eef4d3b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-97e7546a-1598-41d4-8454-1dcc93dfd866 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Could not find credential: 390cb9ec6e49129489ddcc5cbd7fb7d7bda82d17d3678e22bf7adc9ad7ee106d.: keystone.exception.CredentialNotFound: Could not find credential: 390cb9ec6e49129489ddcc5cbd7fb7d7bda82d17d3678e22bf7adc9ad7ee106d. Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 08 21:13:45.247452 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:13:45.248622 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 390cb9ec6e49129489ddcc5cbd7fb7d7bda82d17d3678e22bf7adc9ad7ee106d. Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:45.254583 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2896/5804] 10.222.0.26 () {58 vars in 1377 bytes} [Sat Oct 8 21:13:45 2022] GET /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/e5312bac3ae74a8b8111e7a19aaa55b1 => generated 148 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 08 21:13:45.256635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7546a-1598-41d4-8454-1dcc93dfd866 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.266085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7546a-1598-41d4-8454-1dcc93dfd866 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.271426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c74ff-75fe-40fe-b92a-06dd0a175143 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb7211724d46b0841f47c4ebe22920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea959089492a40dab44b2dff72bfc7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.272082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c74ff-75fe-40fe-b92a-06dd0a175143 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.272366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c74ff-75fe-40fe-b92a-06dd0a175143 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.272645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c74ff-75fe-40fe-b92a-06dd0a175143 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.273323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c74ff-75fe-40fe-b92a-06dd0a175143 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=eeeb7211724d46b0841f47c4ebe22920)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:45.279930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c74ff-75fe-40fe-b92a-06dd0a175143 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.281655 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2909/5805] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:45 2022] PUT /identity/v3/projects/9dd51263022340de856a8aa8e2272499/users/7007fb264988426f927e5f98dba676a6/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:45.294407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d923-0595-4738-92ad-16fb2b658534 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.295033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d923-0595-4738-92ad-16fb2b658534 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.295691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d923-0595-4738-92ad-16fb2b658534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.323649 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2897/5806] 10.222.0.26 () {60 vars in 1299 bytes} [Sat Oct 8 21:13:45 2022] POST /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2 => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:45.327513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c74ff-75fe-40fe-b92a-06dd0a175143 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.345792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f407d923-0595-4738-92ad-16fb2b658534 None None] MFA Rules not processed for user `7007fb264988426f927e5f98dba676a6`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:45.348312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f407d923-0595-4738-92ad-16fb2b658534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:45.360341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c74ff-75fe-40fe-b92a-06dd0a175143 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.409951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:45.458280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b9838-5041-40f7-b51a-ee7acb7d7068 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb7211724d46b0841f47c4ebe22920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea959089492a40dab44b2dff72bfc7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.459725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b9838-5041-40f7-b51a-ee7acb7d7068 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.460346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b9838-5041-40f7-b51a-ee7acb7d7068 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.461217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b9838-5041-40f7-b51a-ee7acb7d7068 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.462097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b9838-5041-40f7-b51a-ee7acb7d7068 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=eeeb7211724d46b0841f47c4ebe22920)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:45.466681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b9838-5041-40f7-b51a-ee7acb7d7068 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.473371 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2910/5807] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:45.509251 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2898/5808] 10.222.0.26 () {60 vars in 1299 bytes} [Sat Oct 8 21:13:45 2022] POST /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2 => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:13:45.513701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407d923-0595-4738-92ad-16fb2b658534 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.538574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407d923-0595-4738-92ad-16fb2b658534 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.546244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6854dc-90b1-40a1-b2a8-7f7cc811060f tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb7211724d46b0841f47c4ebe22920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea959089492a40dab44b2dff72bfc7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.546935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6854dc-90b1-40a1-b2a8-7f7cc811060f tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.547222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6854dc-90b1-40a1-b2a8-7f7cc811060f tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.547501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6854dc-90b1-40a1-b2a8-7f7cc811060f tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.548168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6854dc-90b1-40a1-b2a8-7f7cc811060f tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=eeeb7211724d46b0841f47c4ebe22920)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:45.551250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6854dc-90b1-40a1-b2a8-7f7cc811060f tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.569612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b9838-5041-40f7-b51a-ee7acb7d7068 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.578899 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2911/5809] 10.222.0.26 () {58 vars in 1278 bytes} [Sat Oct 8 21:13:45 2022] GET /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2 => generated 865 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:45.591321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6854dc-90b1-40a1-b2a8-7f7cc811060f tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.626706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6854dc-90b1-40a1-b2a8-7f7cc811060f tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.639482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ea15f-ced4-4fb1-9778-07b3cea237f4 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb7211724d46b0841f47c4ebe22920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea959089492a40dab44b2dff72bfc7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.641473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ea15f-ced4-4fb1-9778-07b3cea237f4 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.642369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ea15f-ced4-4fb1-9778-07b3cea237f4 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.643897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ea15f-ced4-4fb1-9778-07b3cea237f4 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/81c7ffc1032a4db793d78585e3d84743` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.656016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ea15f-ced4-4fb1-9778-07b3cea237f4 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=eeeb7211724d46b0841f47c4ebe22920, credential_id=81c7ffc1032a4db793d78585e3d84743)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:45.660657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ea15f-ced4-4fb1-9778-07b3cea237f4 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.704866 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2912/5810] 10.222.0.26 () {58 vars in 1380 bytes} [Sat Oct 8 21:13:45 2022] DELETE /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/81c7ffc1032a4db793d78585e3d84743 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:45.710008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ea15f-ced4-4fb1-9778-07b3cea237f4 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.716134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-843ea15f-ced4-4fb1-9778-07b3cea237f4 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:45.758903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b9838-5041-40f7-b51a-ee7acb7d7068 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.768448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cc752-f693-4c4b-a262-c695d30dc995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.770782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cc752-f693-4c4b-a262-c695d30dc995 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.771575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cc752-f693-4c4b-a262-c695d30dc995 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.771575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cc752-f693-4c4b-a262-c695d30dc995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.809772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cc752-f693-4c4b-a262-c695d30dc995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:45.812102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cc752-f693-4c4b-a262-c695d30dc995 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.844183 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2899/5811] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:45.845442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cc752-f693-4c4b-a262-c695d30dc995 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.865075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cc752-f693-4c4b-a262-c695d30dc995 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.874568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4e177-c7db-44bc-a7d3-f86d8c6d6d55 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb7211724d46b0841f47c4ebe22920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea959089492a40dab44b2dff72bfc7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.876619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4e177-c7db-44bc-a7d3-f86d8c6d6d55 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.877140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4e177-c7db-44bc-a7d3-f86d8c6d6d55 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.877619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4e177-c7db-44bc-a7d3-f86d8c6d6d55 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/3412385ef4c34aebaa96f1d33ca65723` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.882149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4e177-c7db-44bc-a7d3-f86d8c6d6d55 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=eeeb7211724d46b0841f47c4ebe22920, credential_id=3412385ef4c34aebaa96f1d33ca65723)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:45.884644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4e177-c7db-44bc-a7d3-f86d8c6d6d55 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.908124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ea15f-ced4-4fb1-9778-07b3cea237f4 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.924229 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2900/5812] 10.222.0.26 () {58 vars in 1380 bytes} [Sat Oct 8 21:13:45 2022] DELETE /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/3412385ef4c34aebaa96f1d33ca65723 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:45.930155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4e177-c7db-44bc-a7d3-f86d8c6d6d55 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:45.932161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.934959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.936574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.936958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] PATH_INFO: `/v3/projects/9319c189186b4639adc4392a14209fab` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.943461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9319c189186b4639adc4392a14209fab)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:45.958192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.961990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4e177-c7db-44bc-a7d3-f86d8c6d6d55 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:45.977694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bec09-8d7f-4f1c-a06f-53d91ed10e10 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb7211724d46b0841f47c4ebe22920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea959089492a40dab44b2dff72bfc7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:45.978497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bec09-8d7f-4f1c-a06f-53d91ed10e10 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:45.978885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bec09-8d7f-4f1c-a06f-53d91ed10e10 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:45.979262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bec09-8d7f-4f1c-a06f-53d91ed10e10 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:45.980236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bec09-8d7f-4f1c-a06f-53d91ed10e10 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=eeeb7211724d46b0841f47c4ebe22920)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:45.983197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bec09-8d7f-4f1c-a06f-53d91ed10e10 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:45.991311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:46.025165 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2901/5813] 10.222.0.26 () {60 vars in 1299 bytes} [Sat Oct 8 21:13:45 2022] POST /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2 => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:46.029489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bec09-8d7f-4f1c-a06f-53d91ed10e10 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:46.055999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bec09-8d7f-4f1c-a06f-53d91ed10e10 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:46.065705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5eea7f-dd0e-42b8-8fa9-1b501c725776 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb7211724d46b0841f47c4ebe22920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea959089492a40dab44b2dff72bfc7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:46.067429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5eea7f-dd0e-42b8-8fa9-1b501c725776 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:46.068919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5eea7f-dd0e-42b8-8fa9-1b501c725776 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:46.069428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5eea7f-dd0e-42b8-8fa9-1b501c725776 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/97597d588c824642bbbf5877c8007872` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:46.077140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5eea7f-dd0e-42b8-8fa9-1b501c725776 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=eeeb7211724d46b0841f47c4ebe22920, credential_id=97597d588c824642bbbf5877c8007872)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:46.082634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5eea7f-dd0e-42b8-8fa9-1b501c725776 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:46.110520 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2902/5814] 10.222.0.26 () {58 vars in 1377 bytes} [Sat Oct 8 21:13:46 2022] GET /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/97597d588c824642bbbf5877c8007872 => generated 367 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:46.111425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9319c189186b4639adc4392a14209fab', 'request_id': 'req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:46.113275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5eea7f-dd0e-42b8-8fa9-1b501c725776 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:46.133702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9319c189186b4639adc4392a14209fab', 'request_id': 'req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:46.135927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5eea7f-dd0e-42b8-8fa9-1b501c725776 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:46.147460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9319c189186b4639adc4392a14209fab', 'request_id': 'req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:46.170670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] The token cache is being invalidate because project 9319c189186b4639adc4392a14209fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:46.171013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:46.172275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:46.189221 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2913/5815] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:45 2022] DELETE /identity/v3/projects/9319c189186b4639adc4392a14209fab => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:46.256657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf035d-c555-4ec9-970d-8ed28d57a257 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb7211724d46b0841f47c4ebe22920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea959089492a40dab44b2dff72bfc7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:46.258288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf035d-c555-4ec9-970d-8ed28d57a257 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:46.260535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf035d-c555-4ec9-970d-8ed28d57a257 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:46.261447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf035d-c555-4ec9-970d-8ed28d57a257 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/97597d588c824642bbbf5877c8007872` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:46.266565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf035d-c555-4ec9-970d-8ed28d57a257 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=eeeb7211724d46b0841f47c4ebe22920, credential_id=97597d588c824642bbbf5877c8007872)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:46.269074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf035d-c555-4ec9-970d-8ed28d57a257 tempest-EC2CredentialsTest-1650336096 tempest-EC2CredentialsTest-1650336096-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:46.307026 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2903/5816] 10.222.0.26 () {58 vars in 1380 bytes} [Sat Oct 8 21:13:46 2022] DELETE /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920/credentials/OS-EC2/97597d588c824642bbbf5877c8007872 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:46.314355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:46.316541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:46.423852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54d781-2cfc-4fce-bf93-ab4fd7e7b7fa admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:46.439302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:46.440006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:46.440325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:46.440601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] PATH_INFO: `/v3/users/eeeb7211724d46b0841f47c4ebe22920` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:46.449695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeeb7211724d46b0841f47c4ebe22920)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:46.451974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:46.545756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeeb7211724d46b0841f47c4ebe22920'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:46.556569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeeb7211724d46b0841f47c4ebe22920'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:46.556569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeeb7211724d46b0841f47c4ebe22920'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:46.557113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeeb7211724d46b0841f47c4ebe22920'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:46.574934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeeb7211724d46b0841f47c4ebe22920'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:46.597233 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2914/5817] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:46 2022] DELETE /identity/v3/users/eeeb7211724d46b0841f47c4ebe22920 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:46.599958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae057c-192a-425e-8e9b-5c6ab6dab921 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:46.600777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae057c-192a-425e-8e9b-5c6ab6dab921 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:46.601607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae057c-192a-425e-8e9b-5c6ab6dab921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:46.629634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4bae057c-192a-425e-8e9b-5c6ab6dab921 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:46.631248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4bae057c-192a-425e-8e9b-5c6ab6dab921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:46.698695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:46.810828 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2904/5818] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:13:46.865217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:46.867141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:46.948672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:47.076968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b16981-4392-4398-bb7c-df69eeba138b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:47.089429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90426f-8256-47c3-8050-47e1410eb2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:47.091294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90426f-8256-47c3-8050-47e1410eb2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:47.091482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90426f-8256-47c3-8050-47e1410eb2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:47.091680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90426f-8256-47c3-8050-47e1410eb2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:47.126747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90426f-8256-47c3-8050-47e1410eb2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:47.131076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90426f-8256-47c3-8050-47e1410eb2f7 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:47.164298 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2915/5819] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:47.755587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae057c-192a-425e-8e9b-5c6ab6dab921 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:47.757028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4bae057c-192a-425e-8e9b-5c6ab6dab921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:47.779800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae057c-192a-425e-8e9b-5c6ab6dab921 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:47.794573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:47.795218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:47.795497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:47.795771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] PATH_INFO: `/v3/users/51b44ebd62ab40e781f7922667a15482` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:47.801384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b44ebd62ab40e781f7922667a15482)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:47.803785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:47.908951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b44ebd62ab40e781f7922667a15482'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:47.921747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b44ebd62ab40e781f7922667a15482'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:47.922597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b44ebd62ab40e781f7922667a15482'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:47.924033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b44ebd62ab40e781f7922667a15482'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:47.953893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b44ebd62ab40e781f7922667a15482'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:47.991397 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2905/5820] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:47 2022] DELETE /identity/v3/users/51b44ebd62ab40e781f7922667a15482 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:47.995839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bfc61-2554-4213-aa8d-874ede827f3c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:48.009872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bfc61-2554-4213-aa8d-874ede827f3c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:48.009872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bfc61-2554-4213-aa8d-874ede827f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:48.038869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-332bfc61-2554-4213-aa8d-874ede827f3c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:48.040571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-332bfc61-2554-4213-aa8d-874ede827f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:48.133587 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2916/5821] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:48.151937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:48.153490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:48.297522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90a4f3-542e-4bef-a17e-79910f37bbca admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:48.302801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46fcbe-f02c-4edd-b688-15a34f1885f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:48.303509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46fcbe-f02c-4edd-b688-15a34f1885f2 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:48.303862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46fcbe-f02c-4edd-b688-15a34f1885f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:48.304204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46fcbe-f02c-4edd-b688-15a34f1885f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:48.339595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46fcbe-f02c-4edd-b688-15a34f1885f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:48.344657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46fcbe-f02c-4edd-b688-15a34f1885f2 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:48.373713 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2906/5822] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:49.562642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bfc61-2554-4213-aa8d-874ede827f3c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:49.564128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-332bfc61-2554-4213-aa8d-874ede827f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:49.626975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bfc61-2554-4213-aa8d-874ede827f3c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:49.634951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d3879-1a93-40ee-a8a8-10d4df128596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:49.635890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d3879-1a93-40ee-a8a8-10d4df128596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:49.636315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d3879-1a93-40ee-a8a8-10d4df128596 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:49.636771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d3879-1a93-40ee-a8a8-10d4df128596 admin admin] PATH_INFO: `/v3/projects/ea959089492a40dab44b2dff72bfc7d7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:49.639522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d3879-1a93-40ee-a8a8-10d4df128596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea959089492a40dab44b2dff72bfc7d7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:49.643467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d3879-1a93-40ee-a8a8-10d4df128596 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:49.748126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ea8d3879-1a93-40ee-a8a8-10d4df128596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea959089492a40dab44b2dff72bfc7d7', 'request_id': 'req-ea8d3879-1a93-40ee-a8a8-10d4df128596'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:49.762452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ea8d3879-1a93-40ee-a8a8-10d4df128596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea959089492a40dab44b2dff72bfc7d7', 'request_id': 'req-ea8d3879-1a93-40ee-a8a8-10d4df128596'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:49.776888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ea8d3879-1a93-40ee-a8a8-10d4df128596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea959089492a40dab44b2dff72bfc7d7', 'request_id': 'req-ea8d3879-1a93-40ee-a8a8-10d4df128596'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:49.795106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ea8d3879-1a93-40ee-a8a8-10d4df128596 admin admin] The token cache is being invalidate because project ea959089492a40dab44b2dff72bfc7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:49.796675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ea8d3879-1a93-40ee-a8a8-10d4df128596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:49.798275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ea8d3879-1a93-40ee-a8a8-10d4df128596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:49.800974 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2917/5823] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:49 2022] DELETE /identity/v3/projects/ea959089492a40dab44b2dff72bfc7d7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:49.808258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a59d8-a34b-46a3-a2a8-0553a36f966f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:49.809490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a59d8-a34b-46a3-a2a8-0553a36f966f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:49.810224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a59d8-a34b-46a3-a2a8-0553a36f966f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:49.848484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-795a59d8-a34b-46a3-a2a8-0553a36f966f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:49.852650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-795a59d8-a34b-46a3-a2a8-0553a36f966f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:49.951227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:49.985673 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2907/5824] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:49.993986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd4eff-6e42-4b2f-bc2a-7843924b6f06 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:49.994412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd4eff-6e42-4b2f-bc2a-7843924b6f06 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:49.995126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd4eff-6e42-4b2f-bc2a-7843924b6f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:50.011382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a59d8-a34b-46a3-a2a8-0553a36f966f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:50.013539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-795a59d8-a34b-46a3-a2a8-0553a36f966f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:50.051019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-07fd4eff-6e42-4b2f-bc2a-7843924b6f06 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:50.053569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a59d8-a34b-46a3-a2a8-0553a36f966f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:50.056275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-07fd4eff-6e42-4b2f-bc2a-7843924b6f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:50.065984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:50.066927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:50.067832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:50.068809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] PATH_INFO: `/v3/projects/01ee10233d0e41d398a9f52f558934e8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:50.072413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ee10233d0e41d398a9f52f558934e8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:50.074661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:50.078878 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2918/5825] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:50.083950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd4eff-6e42-4b2f-bc2a-7843924b6f06 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:50.102754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd4eff-6e42-4b2f-bc2a-7843924b6f06 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:50.127509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d72e4c-07fe-4cf4-a8df-5203c4413310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:50.129975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d72e4c-07fe-4cf4-a8df-5203c4413310 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:50.133149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d72e4c-07fe-4cf4-a8df-5203c4413310 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:50.134676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d72e4c-07fe-4cf4-a8df-5203c4413310 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:50.136509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d72e4c-07fe-4cf4-a8df-5203c4413310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:13:50.150101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d72e4c-07fe-4cf4-a8df-5203c4413310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:50.161329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d72e4c-07fe-4cf4-a8df-5203c4413310 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:50.205254 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2919/5826] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:50.210960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d72e4c-07fe-4cf4-a8df-5203c4413310 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:50.238644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d72e4c-07fe-4cf4-a8df-5203c4413310 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:50.240730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ee10233d0e41d398a9f52f558934e8', 'request_id': 'req-addbb790-d0f5-4395-814a-850c4de5dca3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:50.278282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ee10233d0e41d398a9f52f558934e8', 'request_id': 'req-addbb790-d0f5-4395-814a-850c4de5dca3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:50.288297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ee10233d0e41d398a9f52f558934e8', 'request_id': 'req-addbb790-d0f5-4395-814a-850c4de5dca3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:50.316350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] The token cache is being invalidate because project 01ee10233d0e41d398a9f52f558934e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:50.317865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:50.319735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:50.324522 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2908/5827] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:50 2022] DELETE /identity/v3/projects/01ee10233d0e41d398a9f52f558934e8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:50.326528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:50.328810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:50.330984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:50.402733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9d7e-3623-4bee-b5c7-3f46da2fc4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:50.403795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9d7e-3623-4bee-b5c7-3f46da2fc4ae admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:50.404076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9d7e-3623-4bee-b5c7-3f46da2fc4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:50.404350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9d7e-3623-4bee-b5c7-3f46da2fc4ae admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:50.405336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe9d7e-3623-4bee-b5c7-3f46da2fc4ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:50.408580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe9d7e-3623-4bee-b5c7-3f46da2fc4ae admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:50.464245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbb790-d0f5-4395-814a-850c4de5dca3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:50.470110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:50.471006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:50.471918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:50.472591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] PATH_INFO: `/v3/users/f99403a3be4f4942a2421c3c9bf63662` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:50.501110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99403a3be4f4942a2421c3c9bf63662)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:50.503770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:50.508720 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2920/5828] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:50 2022] POST /identity/v3/projects => generated 381 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:50.511957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9d7e-3623-4bee-b5c7-3f46da2fc4ae admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:50.515800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6ffe9d7e-3623-4bee-b5c7-3f46da2fc4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:50.604011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99403a3be4f4942a2421c3c9bf63662'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:50.621827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99403a3be4f4942a2421c3c9bf63662'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:50.622610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99403a3be4f4942a2421c3c9bf63662'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:50.624321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99403a3be4f4942a2421c3c9bf63662'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:50.645152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99403a3be4f4942a2421c3c9bf63662'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:50.661176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:50.661380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9d7e-3623-4bee-b5c7-3f46da2fc4ae admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:50.676339 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2909/5829] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:50 2022] DELETE /identity/v3/users/f99403a3be4f4942a2421c3c9bf63662 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:50.679173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5806f-b32e-41e4-80ad-a5973092092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:50.680152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5806f-b32e-41e4-80ad-a5973092092a admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:50.680833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5806f-b32e-41e4-80ad-a5973092092a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:50.681518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5806f-b32e-41e4-80ad-a5973092092a admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:50.682416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5806f-b32e-41e4-80ad-a5973092092a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:50.689416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5806f-b32e-41e4-80ad-a5973092092a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:50.748834 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2921/5830] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:50 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:50.753951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:50.755700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:50.853290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d57d7-2a78-4c52-8320-bb311deb9a2f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:50.864682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424380f1-d8fb-44f2-9328-bb1dd2d1ebef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:50.865368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424380f1-d8fb-44f2-9328-bb1dd2d1ebef admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:50.865651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424380f1-d8fb-44f2-9328-bb1dd2d1ebef admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:50.865924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424380f1-d8fb-44f2-9328-bb1dd2d1ebef admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:50.866593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424380f1-d8fb-44f2-9328-bb1dd2d1ebef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:50.868229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424380f1-d8fb-44f2-9328-bb1dd2d1ebef admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:50.883535 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2910/5831] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:50.884485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5806f-b32e-41e4-80ad-a5973092092a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:50.895918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5806f-b32e-41e4-80ad-a5973092092a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:50.900870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c650abd-e594-4f15-a295-f00733988899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:50.901723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c650abd-e594-4f15-a295-f00733988899 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:50.902129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c650abd-e594-4f15-a295-f00733988899 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:50.902483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c650abd-e594-4f15-a295-f00733988899 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:50.903181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c650abd-e594-4f15-a295-f00733988899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:50.905133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c650abd-e594-4f15-a295-f00733988899 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:50.925747 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2922/5832] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:13:50.926931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424380f1-d8fb-44f2-9328-bb1dd2d1ebef admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:50.938527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424380f1-d8fb-44f2-9328-bb1dd2d1ebef admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:50.944392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e16874-9baf-4650-b176-fa78d3253a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:50.945213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e16874-9baf-4650-b176-fa78d3253a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:50.945567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e16874-9baf-4650-b176-fa78d3253a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:50.945913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e16874-9baf-4650-b176-fa78d3253a76 admin admin] PATH_INFO: `/v3/projects/c254e51cecab4c58a76a589409118802/users/cf86376fc36a4ac49937ef4dd54d9c2b/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:50.963015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e16874-9baf-4650-b176-fa78d3253a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c254e51cecab4c58a76a589409118802, user_id=cf86376fc36a4ac49937ef4dd54d9c2b, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:50.968468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e16874-9baf-4650-b176-fa78d3253a76 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:50.989314 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2911/5833] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:50 2022] PUT /identity/v3/projects/c254e51cecab4c58a76a589409118802/users/cf86376fc36a4ac49937ef4dd54d9c2b/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:50.996071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70e90c-4432-4bbb-9443-6a746e0f1fe2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:50.996290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70e90c-4432-4bbb-9443-6a746e0f1fe2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:50.996631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70e90c-4432-4bbb-9443-6a746e0f1fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:51.028884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0a70e90c-4432-4bbb-9443-6a746e0f1fe2 None None] MFA Rules not processed for user `cf86376fc36a4ac49937ef4dd54d9c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:51.030634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0a70e90c-4432-4bbb-9443-6a746e0f1fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:51.113956 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2923/5834] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:51.118380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e16874-9baf-4650-b176-fa78d3253a76 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:51.266465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e16874-9baf-4650-b176-fa78d3253a76 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:51.276926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835c03e-44e4-421a-b2ec-44471a711807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:51.278460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835c03e-44e4-421a-b2ec-44471a711807 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:51.279793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835c03e-44e4-421a-b2ec-44471a711807 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:51.282140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70e90c-4432-4bbb-9443-6a746e0f1fe2 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:51.285982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0a70e90c-4432-4bbb-9443-6a746e0f1fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:51.297676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835c03e-44e4-421a-b2ec-44471a711807 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:51.300599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835c03e-44e4-421a-b2ec-44471a711807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:51.309068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835c03e-44e4-421a-b2ec-44471a711807 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:51.334023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70e90c-4432-4bbb-9443-6a746e0f1fe2 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:51.352825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a48042-88d1-4c79-87e6-d12a4a747a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:51.355459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a48042-88d1-4c79-87e6-d12a4a747a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:51.356633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a48042-88d1-4c79-87e6-d12a4a747a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:51.357937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a48042-88d1-4c79-87e6-d12a4a747a8b admin admin] PATH_INFO: `/v3/projects/b54376e8f42e403596d65bcb4bf82032` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:51.362556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a48042-88d1-4c79-87e6-d12a4a747a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b54376e8f42e403596d65bcb4bf82032)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:51.367520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a48042-88d1-4c79-87e6-d12a4a747a8b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:51.392659 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2912/5835] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:51 2022] POST /identity/v3/projects => generated 381 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:51.397036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835c03e-44e4-421a-b2ec-44471a711807 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:51.426149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:51.591185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50a48042-88d1-4c79-87e6-d12a4a747a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b54376e8f42e403596d65bcb4bf82032', 'request_id': 'req-50a48042-88d1-4c79-87e6-d12a4a747a8b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:51.618345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50a48042-88d1-4c79-87e6-d12a4a747a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b54376e8f42e403596d65bcb4bf82032', 'request_id': 'req-50a48042-88d1-4c79-87e6-d12a4a747a8b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:51.648851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50a48042-88d1-4c79-87e6-d12a4a747a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b54376e8f42e403596d65bcb4bf82032', 'request_id': 'req-50a48042-88d1-4c79-87e6-d12a4a747a8b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:51.687703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50a48042-88d1-4c79-87e6-d12a4a747a8b admin admin] The token cache is being invalidate because project b54376e8f42e403596d65bcb4bf82032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:51.688371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50a48042-88d1-4c79-87e6-d12a4a747a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:51.694334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50a48042-88d1-4c79-87e6-d12a4a747a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:51.702497 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2924/5836] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:51 2022] DELETE /identity/v3/projects/b54376e8f42e403596d65bcb4bf82032 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:51.707078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:51.707272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a978b4-a4ba-43c1-9c01-87658945d306 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:51.707549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a978b4-a4ba-43c1-9c01-87658945d306 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:51.718066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a978b4-a4ba-43c1-9c01-87658945d306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:51.720425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835c03e-44e4-421a-b2ec-44471a711807 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:51.772998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-27a978b4-a4ba-43c1-9c01-87658945d306 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:51.774582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-27a978b4-a4ba-43c1-9c01-87658945d306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:51.913272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec4f79-94b2-4106-ad58-71ab3297f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:51.914779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4f79-94b2-4106-ad58-71ab3297f8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:51.915243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4f79-94b2-4106-ad58-71ab3297f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:51.915692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4f79-94b2-4106-ad58-71ab3297f8e8 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:51.917126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec4f79-94b2-4106-ad58-71ab3297f8e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:51.923220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec4f79-94b2-4106-ad58-71ab3297f8e8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:51.942706 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2925/5837] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:51.944458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c192317-f271-4695-ab58-3199bd090ef5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:51.944748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c192317-f271-4695-ab58-3199bd090ef5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:51.945026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c192317-f271-4695-ab58-3199bd090ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:51.976544 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2913/5838] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:51 2022] POST /identity/v3/users => generated 291 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:13:51.980171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec4f79-94b2-4106-ad58-71ab3297f8e8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:51.994718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2c192317-f271-4695-ab58-3199bd090ef5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:51.997101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2c192317-f271-4695-ab58-3199bd090ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:52.002634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-54ec4f79-94b2-4106-ad58-71ab3297f8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:52.019932 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2926/5839] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:52.026265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c192317-f271-4695-ab58-3199bd090ef5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:52.035858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec4f79-94b2-4106-ad58-71ab3297f8e8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:52.052694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c192317-f271-4695-ab58-3199bd090ef5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:52.069923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc7e81-41cb-4af6-a4f1-6ce4ec7efce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:52.071546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf05ab7-e928-4883-ad9d-24dc0a7fc607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:52.072252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf05ab7-e928-4883-ad9d-24dc0a7fc607 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.072600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf05ab7-e928-4883-ad9d-24dc0a7fc607 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.072748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7e81-41cb-4af6-a4f1-6ce4ec7efce4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.072861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf05ab7-e928-4883-ad9d-24dc0a7fc607 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.073585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7e81-41cb-4af6-a4f1-6ce4ec7efce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.073714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf05ab7-e928-4883-ad9d-24dc0a7fc607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:13:52.074286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7e81-41cb-4af6-a4f1-6ce4ec7efce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.075195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc7e81-41cb-4af6-a4f1-6ce4ec7efce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:52.077021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc7e81-41cb-4af6-a4f1-6ce4ec7efce4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:52.078845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf05ab7-e928-4883-ad9d-24dc0a7fc607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:52.090126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf05ab7-e928-4883-ad9d-24dc0a7fc607 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:52.094521 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2914/5840] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:52.098506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc7e81-41cb-4af6-a4f1-6ce4ec7efce4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:52.111599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc7e81-41cb-4af6-a4f1-6ce4ec7efce4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:52.120087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075ebc2-3315-426b-96fa-8e307fff53e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:52.121779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075ebc2-3315-426b-96fa-8e307fff53e4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.122174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075ebc2-3315-426b-96fa-8e307fff53e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.122556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075ebc2-3315-426b-96fa-8e307fff53e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.123745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075ebc2-3315-426b-96fa-8e307fff53e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:52.127732 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2927/5841] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:52.127917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075ebc2-3315-426b-96fa-8e307fff53e4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:52.129899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf05ab7-e928-4883-ad9d-24dc0a7fc607 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:52.139488 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2915/5842] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:52.144707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075ebc2-3315-426b-96fa-8e307fff53e4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:52.156545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf05ab7-e928-4883-ad9d-24dc0a7fc607 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:52.169659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d262a-8d78-4831-894a-78919941d009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:52.170295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d262a-8d78-4831-894a-78919941d009 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.170576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d262a-8d78-4831-894a-78919941d009 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.170850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d262a-8d78-4831-894a-78919941d009 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.171492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d262a-8d78-4831-894a-78919941d009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:52.172967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075ebc2-3315-426b-96fa-8e307fff53e4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:52.179182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d262a-8d78-4831-894a-78919941d009 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:52.183079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca1c73-03df-47e8-ac92-65c657dcabd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:52.184045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1c73-03df-47e8-ac92-65c657dcabd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.184610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1c73-03df-47e8-ac92-65c657dcabd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.185139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1c73-03df-47e8-ac92-65c657dcabd9 admin admin] PATH_INFO: `/v3/projects/039c3c040601450f90a6c2989d549f83/users/6cf42d1582824bf3a29212dc26a153c0/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.219259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca1c73-03df-47e8-ac92-65c657dcabd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039c3c040601450f90a6c2989d549f83, user_id=6cf42d1582824bf3a29212dc26a153c0, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:52.230039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca1c73-03df-47e8-ac92-65c657dcabd9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:52.245252 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2928/5843] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:52 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:52.250391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d262a-8d78-4831-894a-78919941d009 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:52.263110 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2916/5844] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:52 2022] PUT /identity/v3/projects/039c3c040601450f90a6c2989d549f83/users/6cf42d1582824bf3a29212dc26a153c0/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:52.275166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708462c-235b-45af-8585-f52ab55ad6c8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.275514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708462c-235b-45af-8585-f52ab55ad6c8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.276026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708462c-235b-45af-8585-f52ab55ad6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.359209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d262a-8d78-4831-894a-78919941d009 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:52.364256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1708462c-235b-45af-8585-f52ab55ad6c8 None None] MFA Rules not processed for user `6cf42d1582824bf3a29212dc26a153c0`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:52.366094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:52.369246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1708462c-235b-45af-8585-f52ab55ad6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:52.491998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5daef-8ffa-448f-81f9-2e9c452541e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:52.492647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5daef-8ffa-448f-81f9-2e9c452541e3 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.493150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5daef-8ffa-448f-81f9-2e9c452541e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.493589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5daef-8ffa-448f-81f9-2e9c452541e3 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.494321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5daef-8ffa-448f-81f9-2e9c452541e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:52.497963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5daef-8ffa-448f-81f9-2e9c452541e3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:52.552530 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2929/5845] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:52 2022] POST /identity/v3/users => generated 290 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:52.557852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5daef-8ffa-448f-81f9-2e9c452541e3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:52.564064 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2917/5846] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:52.569152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708462c-235b-45af-8585-f52ab55ad6c8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:52.571126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1708462c-235b-45af-8585-f52ab55ad6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:52.576920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5daef-8ffa-448f-81f9-2e9c452541e3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:52.584663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fb6c8-484f-4147-a03b-f8b0ac4b1bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:52.585310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fb6c8-484f-4147-a03b-f8b0ac4b1bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.585590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fb6c8-484f-4147-a03b-f8b0ac4b1bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.585864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fb6c8-484f-4147-a03b-f8b0ac4b1bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.586505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fb6c8-484f-4147-a03b-f8b0ac4b1bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:52.588102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fb6c8-484f-4147-a03b-f8b0ac4b1bc9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:52.603531 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2930/5847] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:13:52.607523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fb6c8-484f-4147-a03b-f8b0ac4b1bc9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:52.620192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:52.624027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fb6c8-484f-4147-a03b-f8b0ac4b1bc9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:52.652158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708462c-235b-45af-8585-f52ab55ad6c8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:52.658015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1c441-5ed2-4d51-b28e-487d0bb748b2 tempest-IdentityV3ProjectsTest-1265021747 tempest-IdentityV3ProjectsTest-1265021747-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf86376fc36a4ac49937ef4dd54d9c2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c254e51cecab4c58a76a589409118802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:52.659360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1c441-5ed2-4d51-b28e-487d0bb748b2 tempest-IdentityV3ProjectsTest-1265021747 tempest-IdentityV3ProjectsTest-1265021747-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.660155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1c441-5ed2-4d51-b28e-487d0bb748b2 tempest-IdentityV3ProjectsTest-1265021747 tempest-IdentityV3ProjectsTest-1265021747-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.660855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1c441-5ed2-4d51-b28e-487d0bb748b2 tempest-IdentityV3ProjectsTest-1265021747 tempest-IdentityV3ProjectsTest-1265021747-project] PATH_INFO: `/v3/users/cf86376fc36a4ac49937ef4dd54d9c2b/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.662280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2886d-198f-4c7b-86fb-22327aa72cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:52.662732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1c441-5ed2-4d51-b28e-487d0bb748b2 tempest-IdentityV3ProjectsTest-1265021747 tempest-IdentityV3ProjectsTest-1265021747-project] RBAC: Authorizing `identity:list_user_projects(user_id=cf86376fc36a4ac49937ef4dd54d9c2b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:52.662941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2886d-198f-4c7b-86fb-22327aa72cce admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.663182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2886d-198f-4c7b-86fb-22327aa72cce admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.663454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2886d-198f-4c7b-86fb-22327aa72cce admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.664927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2886d-198f-4c7b-86fb-22327aa72cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:52.667107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1c441-5ed2-4d51-b28e-487d0bb748b2 tempest-IdentityV3ProjectsTest-1265021747 tempest-IdentityV3ProjectsTest-1265021747-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:52.668676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2886d-198f-4c7b-86fb-22327aa72cce admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:52.688325 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2931/5848] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:13:52.693262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2886d-198f-4c7b-86fb-22327aa72cce admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:52.717370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2886d-198f-4c7b-86fb-22327aa72cce admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:52.743570 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2918/5849] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:13:52 2022] GET /identity/v3/users/cf86376fc36a4ac49937ef4dd54d9c2b/projects => generated 517 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:13:52.747222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4cb58-ff73-4c49-bee9-b77face26859 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.747528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4cb58-ff73-4c49-bee9-b77face26859 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.748184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4cb58-ff73-4c49-bee9-b77face26859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.751231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a0d64-d0a3-43fe-a870-b4d55477963e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:52.751949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a0d64-d0a3-43fe-a870-b4d55477963e admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.752228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a0d64-d0a3-43fe-a870-b4d55477963e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.752532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a0d64-d0a3-43fe-a870-b4d55477963e admin admin] PATH_INFO: `/v3/projects/8607d75f5fa04fb886aaeb401d706bce/users/7af21976e8bf4aae97aaa8971e38ede5/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.797479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-98d4cb58-ff73-4c49-bee9-b77face26859 None None] MFA Rules not processed for user `cf86376fc36a4ac49937ef4dd54d9c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:52.798696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a0d64-d0a3-43fe-a870-b4d55477963e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8607d75f5fa04fb886aaeb401d706bce, user_id=7af21976e8bf4aae97aaa8971e38ede5, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:52.799889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-98d4cb58-ff73-4c49-bee9-b77face26859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:52.801586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a0d64-d0a3-43fe-a870-b4d55477963e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:52.811283 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2919/5850] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:52.824734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b77b81-643c-4535-86d9-1e7e05ed0830 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.831800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b77b81-643c-4535-86d9-1e7e05ed0830 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.832759 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2932/5851] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:52 2022] PUT /identity/v3/projects/8607d75f5fa04fb886aaeb401d706bce/users/7af21976e8bf4aae97aaa8971e38ede5/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:52.832886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b77b81-643c-4535-86d9-1e7e05ed0830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.849688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71ba8b-5ee1-4d4b-bee9-124b4468e440 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:52.849688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71ba8b-5ee1-4d4b-bee9-124b4468e440 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:52.849688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71ba8b-5ee1-4d4b-bee9-124b4468e440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:52.890603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-49b77b81-643c-4535-86d9-1e7e05ed0830 None None] MFA Rules not processed for user `cf86376fc36a4ac49937ef4dd54d9c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:52.894784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-49b77b81-643c-4535-86d9-1e7e05ed0830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:52.916723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ad71ba8b-5ee1-4d4b-bee9-124b4468e440 None None] MFA Rules not processed for user `7af21976e8bf4aae97aaa8971e38ede5`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:52.920422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ad71ba8b-5ee1-4d4b-bee9-124b4468e440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:53.012141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.models.token_model [None req-49b77b81-643c-4535-86d9-1e7e05ed0830 None None] User cf86376fc36a4ac49937ef4dd54d9c2b has no access to project 039c3c040601450f90a6c2989d549f83 {{(pid=99084) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 08 21:13:53.017721 ncdv-master-1 devstack@keystone.service[99084]: WARNING keystone.server.flask.application [None req-49b77b81-643c-4535-86d9-1e7e05ed0830 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.26: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 08 21:13:53.020439 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2920/5852] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:52 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 202 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 08 21:13:53.025777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b77b81-643c-4535-86d9-1e7e05ed0830 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:53.067664 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2933/5853] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:53.095371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71ba8b-5ee1-4d4b-bee9-124b4468e440 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:53.097266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ad71ba8b-5ee1-4d4b-bee9-124b4468e440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:53.156174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b77b81-643c-4535-86d9-1e7e05ed0830 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:53.164050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120d731-2c20-43cd-9603-8bbf35f17d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:53.165030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120d731-2c20-43cd-9603-8bbf35f17d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:53.165567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120d731-2c20-43cd-9603-8bbf35f17d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:53.166190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120d731-2c20-43cd-9603-8bbf35f17d24 admin admin] PATH_INFO: `/v3/users/cf86376fc36a4ac49937ef4dd54d9c2b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:53.167741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120d731-2c20-43cd-9603-8bbf35f17d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf86376fc36a4ac49937ef4dd54d9c2b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:53.169938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120d731-2c20-43cd-9603-8bbf35f17d24 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:53.189242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:53.266883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71ba8b-5ee1-4d4b-bee9-124b4468e440 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:53.280657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3accb0-2f56-45a0-9dde-b6a3c729344e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:53.281473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3accb0-2f56-45a0-9dde-b6a3c729344e service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:53.281742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3accb0-2f56-45a0-9dde-b6a3c729344e service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:53.282012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3accb0-2f56-45a0-9dde-b6a3c729344e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:53.288520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1120d731-2c20-43cd-9603-8bbf35f17d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf86376fc36a4ac49937ef4dd54d9c2b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:53.291617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:53.297839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1120d731-2c20-43cd-9603-8bbf35f17d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf86376fc36a4ac49937ef4dd54d9c2b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:53.300603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1120d731-2c20-43cd-9603-8bbf35f17d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf86376fc36a4ac49937ef4dd54d9c2b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:53.301331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1120d731-2c20-43cd-9603-8bbf35f17d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf86376fc36a4ac49937ef4dd54d9c2b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:53.312510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3accb0-2f56-45a0-9dde-b6a3c729344e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:53.314004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3accb0-2f56-45a0-9dde-b6a3c729344e service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:53.324749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1120d731-2c20-43cd-9603-8bbf35f17d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf86376fc36a4ac49937ef4dd54d9c2b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:53.350794 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2921/5854] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:53 2022] DELETE /identity/v3/users/cf86376fc36a4ac49937ef4dd54d9c2b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:53.353162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a0cac-bea7-43a3-a18a-80580afcc8be None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:53.353545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a0cac-bea7-43a3-a18a-80580afcc8be None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:53.354904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a0cac-bea7-43a3-a18a-80580afcc8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:53.363464 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2934/5855] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:13:53.389223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7f7a0cac-bea7-43a3-a18a-80580afcc8be None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:53.390659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7f7a0cac-bea7-43a3-a18a-80580afcc8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:53.531729 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2922/5856] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:53.610748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3accb0-2f56-45a0-9dde-b6a3c729344e service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:53.612981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ce3accb0-2f56-45a0-9dde-b6a3c729344e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:53.630549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3accb0-2f56-45a0-9dde-b6a3c729344e service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:53.708770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c416af-a94b-431e-ba49-de0bcca654f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:53.709455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c416af-a94b-431e-ba49-de0bcca654f2 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:53.709731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c416af-a94b-431e-ba49-de0bcca654f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:53.710184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c416af-a94b-431e-ba49-de0bcca654f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:53.725779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c416af-a94b-431e-ba49-de0bcca654f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:53.727235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c416af-a94b-431e-ba49-de0bcca654f2 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:53.744522 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2935/5857] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:54.568711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a0cac-bea7-43a3-a18a-80580afcc8be None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:54.570280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7f7a0cac-bea7-43a3-a18a-80580afcc8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:54.697357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a0cac-bea7-43a3-a18a-80580afcc8be None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:54.704230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b2ebf-cdfd-4e5c-87f7-6182fd3dd1e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:54.704911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b2ebf-cdfd-4e5c-87f7-6182fd3dd1e2 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:54.705213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b2ebf-cdfd-4e5c-87f7-6182fd3dd1e2 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:54.705493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b2ebf-cdfd-4e5c-87f7-6182fd3dd1e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:54.707359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7b7b2ebf-cdfd-4e5c-87f7-6182fd3dd1e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:54.819442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b2ebf-cdfd-4e5c-87f7-6182fd3dd1e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:54.821111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b2ebf-cdfd-4e5c-87f7-6182fd3dd1e2 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:54.855615 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2923/5858] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:54 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:13:55.061146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c416af-a94b-431e-ba49-de0bcca654f2 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:55.062802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-59c416af-a94b-431e-ba49-de0bcca654f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:55.088527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c416af-a94b-431e-ba49-de0bcca654f2 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:55.093866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:55.094631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:55.094912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:55.095184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] PATH_INFO: `/v3/projects/c254e51cecab4c58a76a589409118802` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:55.104302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c254e51cecab4c58a76a589409118802)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:55.106855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:55.295036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c254e51cecab4c58a76a589409118802', 'request_id': 'req-a85c8480-6fc5-40e9-9701-0af2df9eb95f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:55.317366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c254e51cecab4c58a76a589409118802', 'request_id': 'req-a85c8480-6fc5-40e9-9701-0af2df9eb95f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:55.339565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c254e51cecab4c58a76a589409118802', 'request_id': 'req-a85c8480-6fc5-40e9-9701-0af2df9eb95f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:55.366239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] The token cache is being invalidate because project c254e51cecab4c58a76a589409118802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:55.366795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:55.367618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:55.373532 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2936/5859] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:55 2022] DELETE /identity/v3/projects/c254e51cecab4c58a76a589409118802 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:55.375130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b2ebf-cdfd-4e5c-87f7-6182fd3dd1e2 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:55.384761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:55.399621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b2ebf-cdfd-4e5c-87f7-6182fd3dd1e2 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:55.613253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dc781-60b5-427f-8dbe-8a7f37ab309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:55.614896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dc781-60b5-427f-8dbe-8a7f37ab309b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:55.615391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dc781-60b5-427f-8dbe-8a7f37ab309b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:55.615961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dc781-60b5-427f-8dbe-8a7f37ab309b admin admin] PATH_INFO: `/v3/users/6cf42d1582824bf3a29212dc26a153c0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:55.617484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dc781-60b5-427f-8dbe-8a7f37ab309b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf42d1582824bf3a29212dc26a153c0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:55.619691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dc781-60b5-427f-8dbe-8a7f37ab309b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:55.732707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b7dc781-60b5-427f-8dbe-8a7f37ab309b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf42d1582824bf3a29212dc26a153c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:55.755857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b7dc781-60b5-427f-8dbe-8a7f37ab309b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf42d1582824bf3a29212dc26a153c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:55.757446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b7dc781-60b5-427f-8dbe-8a7f37ab309b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf42d1582824bf3a29212dc26a153c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:55.759872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b7dc781-60b5-427f-8dbe-8a7f37ab309b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf42d1582824bf3a29212dc26a153c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:55.798179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b7dc781-60b5-427f-8dbe-8a7f37ab309b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf42d1582824bf3a29212dc26a153c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:55.827739 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2924/5860] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:55 2022] DELETE /identity/v3/users/6cf42d1582824bf3a29212dc26a153c0 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:56.467925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:56.469554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:56.491268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c8480-6fc5-40e9-9701-0af2df9eb95f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:56.703082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3198ed-3d3c-4daa-b366-880a342cb7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:56.704846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3198ed-3d3c-4daa-b366-880a342cb7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:56.705823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3198ed-3d3c-4daa-b366-880a342cb7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:56.706519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3198ed-3d3c-4daa-b366-880a342cb7e2 admin admin] PATH_INFO: `/v3/projects/039c3c040601450f90a6c2989d549f83` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:56.708012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3198ed-3d3c-4daa-b366-880a342cb7e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=039c3c040601450f90a6c2989d549f83)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:56.710330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3198ed-3d3c-4daa-b366-880a342cb7e2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:56.727943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:56.779633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a3198ed-3d3c-4daa-b366-880a342cb7e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039c3c040601450f90a6c2989d549f83', 'request_id': 'req-7a3198ed-3d3c-4daa-b366-880a342cb7e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:56.791153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a3198ed-3d3c-4daa-b366-880a342cb7e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039c3c040601450f90a6c2989d549f83', 'request_id': 'req-7a3198ed-3d3c-4daa-b366-880a342cb7e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:56.800915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a3198ed-3d3c-4daa-b366-880a342cb7e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039c3c040601450f90a6c2989d549f83', 'request_id': 'req-7a3198ed-3d3c-4daa-b366-880a342cb7e2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:56.820384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a3198ed-3d3c-4daa-b366-880a342cb7e2 admin admin] The token cache is being invalidate because project 039c3c040601450f90a6c2989d549f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:13:56.820730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a3198ed-3d3c-4daa-b366-880a342cb7e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:56.822436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a3198ed-3d3c-4daa-b366-880a342cb7e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:56.827952 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2937/5861] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:13:56 2022] DELETE /identity/v3/projects/039c3c040601450f90a6c2989d549f83 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:56.829474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315637a8-5465-4c15-8ea1-5c766acf228a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:56.830466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315637a8-5465-4c15-8ea1-5c766acf228a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:56.831486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315637a8-5465-4c15-8ea1-5c766acf228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:56.859145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-315637a8-5465-4c15-8ea1-5c766acf228a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:56.860541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-315637a8-5465-4c15-8ea1-5c766acf228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:56.928595 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2925/5862] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:56.936205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95c280-9301-4665-b30a-048b0fcadbdf None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:56.936499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95c280-9301-4665-b30a-048b0fcadbdf None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:56.936799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95c280-9301-4665-b30a-048b0fcadbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:56.960762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1b95c280-9301-4665-b30a-048b0fcadbdf None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:56.962004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1b95c280-9301-4665-b30a-048b0fcadbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:56.971119 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2938/5863] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:56.976367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315637a8-5465-4c15-8ea1-5c766acf228a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:57.030014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315637a8-5465-4c15-8ea1-5c766acf228a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:57.054555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43df4d-d7d7-4a74-bcee-91249a9dbc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:57.055588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43df4d-d7d7-4a74-bcee-91249a9dbc74 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:57.055880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43df4d-d7d7-4a74-bcee-91249a9dbc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:57.056164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43df4d-d7d7-4a74-bcee-91249a9dbc74 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:57.058510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43df4d-d7d7-4a74-bcee-91249a9dbc74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:13:57.060186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43df4d-d7d7-4a74-bcee-91249a9dbc74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:57.066384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43df4d-d7d7-4a74-bcee-91249a9dbc74 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:57.116957 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2926/5864] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:13:57.120945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95c280-9301-4665-b30a-048b0fcadbdf None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:57.145660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95c280-9301-4665-b30a-048b0fcadbdf None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:57.157824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d5ff9-4037-46f2-8b47-e77ded7878ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:57.158605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5ff9-4037-46f2-8b47-e77ded7878ff admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:57.159534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5ff9-4037-46f2-8b47-e77ded7878ff admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:57.159808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5ff9-4037-46f2-8b47-e77ded7878ff admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:57.161120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d5ff9-4037-46f2-8b47-e77ded7878ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:57.162523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d5ff9-4037-46f2-8b47-e77ded7878ff admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:57.247014 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2939/5865] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:13:57 2022] POST /identity/v3/projects => generated 359 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:57.247822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43df4d-d7d7-4a74-bcee-91249a9dbc74 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:57.262771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43df4d-d7d7-4a74-bcee-91249a9dbc74 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:57.276755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:57.426590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768851d2-d69d-412a-8f6e-caa520704a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:57.428415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768851d2-d69d-412a-8f6e-caa520704a84 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:57.428415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768851d2-d69d-412a-8f6e-caa520704a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:57.428415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768851d2-d69d-412a-8f6e-caa520704a84 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:57.429592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768851d2-d69d-412a-8f6e-caa520704a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:57.431523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768851d2-d69d-412a-8f6e-caa520704a84 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:57.484083 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2927/5866] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:13:57 2022] POST /identity/v3/users => generated 280 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:13:57.486159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d5ff9-4037-46f2-8b47-e77ded7878ff admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:57.501084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d5ff9-4037-46f2-8b47-e77ded7878ff admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:57.515877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f0f80-a978-4629-b14a-2ffe8e78f9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:57.516821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f0f80-a978-4629-b14a-2ffe8e78f9ca admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:57.517293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f0f80-a978-4629-b14a-2ffe8e78f9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:57.517754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f0f80-a978-4629-b14a-2ffe8e78f9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:57.519558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f0f80-a978-4629-b14a-2ffe8e78f9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:57.521406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f0f80-a978-4629-b14a-2ffe8e78f9ca admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:57.546377 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2940/5867] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:57.547681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768851d2-d69d-412a-8f6e-caa520704a84 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:57.571787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768851d2-d69d-412a-8f6e-caa520704a84 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:57.585478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f091e1b-0548-4c51-a168-1833efcef2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:57.585872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f091e1b-0548-4c51-a168-1833efcef2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:57.586111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f091e1b-0548-4c51-a168-1833efcef2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:57.586396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f091e1b-0548-4c51-a168-1833efcef2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:57.587047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f091e1b-0548-4c51-a168-1833efcef2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:57.588671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f091e1b-0548-4c51-a168-1833efcef2b4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:57.625540 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2928/5868] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:13:57.626774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f0f80-a978-4629-b14a-2ffe8e78f9ca admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:57.644030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f0f80-a978-4629-b14a-2ffe8e78f9ca admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:57.668949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d7927-d819-4ab2-823e-29e506a55304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:57.669441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7927-d819-4ab2-823e-29e506a55304 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:57.669731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7927-d819-4ab2-823e-29e506a55304 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:57.670018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7927-d819-4ab2-823e-29e506a55304 admin admin] PATH_INFO: `/v3/projects/3187965484c1464db1dd4ff8f6cd06c3/users/4e66a70aaf354ce7a874ac4fafecab5c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:57.768081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d7927-d819-4ab2-823e-29e506a55304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3187965484c1464db1dd4ff8f6cd06c3, user_id=4e66a70aaf354ce7a874ac4fafecab5c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:57.777027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d7927-d819-4ab2-823e-29e506a55304 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:57.824324 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2941/5869] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:13:57 2022] PUT /identity/v3/projects/3187965484c1464db1dd4ff8f6cd06c3/users/4e66a70aaf354ce7a874ac4fafecab5c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:57.840502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234ce6-d321-45be-aaf7-383fe2f76a6b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:57.841055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234ce6-d321-45be-aaf7-383fe2f76a6b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:57.841348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234ce6-d321-45be-aaf7-383fe2f76a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:57.898650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e7234ce6-d321-45be-aaf7-383fe2f76a6b None None] MFA Rules not processed for user `4e66a70aaf354ce7a874ac4fafecab5c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:57.899944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e7234ce6-d321-45be-aaf7-383fe2f76a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:58.057743 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2929/5870] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:58.063269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee002-61f0-43cd-97f3-fe1e75f2e0db None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:58.063566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee002-61f0-43cd-97f3-fe1e75f2e0db None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:58.063887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee002-61f0-43cd-97f3-fe1e75f2e0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:58.122712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a46ee002-61f0-43cd-97f3-fe1e75f2e0db None None] MFA Rules not processed for user `4e66a70aaf354ce7a874ac4fafecab5c`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:58.125087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a46ee002-61f0-43cd-97f3-fe1e75f2e0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:58.137807 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2942/5871] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:58 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:13:58.145634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574309c-9cec-4b94-b332-ef817572e4db None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:58.146182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574309c-9cec-4b94-b332-ef817572e4db None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:58.146672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574309c-9cec-4b94-b332-ef817572e4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:58.170548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9574309c-9cec-4b94-b332-ef817572e4db None None] MFA Rules not processed for user `4e66a70aaf354ce7a874ac4fafecab5c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:58.172078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9574309c-9cec-4b94-b332-ef817572e4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:58.178127 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2930/5872] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:58 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:13:58.182059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee002-61f0-43cd-97f3-fe1e75f2e0db None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:58.209151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee002-61f0-43cd-97f3-fe1e75f2e0db None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:58.225005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e3769-57d3-4453-9834-6b778221b7d1 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e66a70aaf354ce7a874ac4fafecab5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3187965484c1464db1dd4ff8f6cd06c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:58.226279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3769-57d3-4453-9834-6b778221b7d1 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:58.228681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3769-57d3-4453-9834-6b778221b7d1 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:58.244499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3769-57d3-4453-9834-6b778221b7d1 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:58.254831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e3769-57d3-4453-9834-6b778221b7d1 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: Authorizing `identity:check_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:58.257347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e3769-57d3-4453-9834-6b778221b7d1 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:58.267621 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2943/5873] 10.222.0.26 () {56 vars in 1264 bytes} [Sat Oct 8 21:13:58 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:58.272115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574309c-9cec-4b94-b332-ef817572e4db None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:58.289644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574309c-9cec-4b94-b332-ef817572e4db None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:58.296393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06507291-a481-4a7f-97e0-b74ce7fc43da tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e66a70aaf354ce7a874ac4fafecab5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3187965484c1464db1dd4ff8f6cd06c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:58.297166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06507291-a481-4a7f-97e0-b74ce7fc43da tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:58.297585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06507291-a481-4a7f-97e0-b74ce7fc43da tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:58.297966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06507291-a481-4a7f-97e0-b74ce7fc43da tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:58.306332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06507291-a481-4a7f-97e0-b74ce7fc43da tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:58.308573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06507291-a481-4a7f-97e0-b74ce7fc43da tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:58.322061 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2931/5874] 10.222.0.26 () {56 vars in 1263 bytes} [Sat Oct 8 21:13:58 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:58.323384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e3769-57d3-4453-9834-6b778221b7d1 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:58.337039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e3769-57d3-4453-9834-6b778221b7d1 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:58.357050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc9f2b-8bfc-4dc1-92e9-c1980c4fa4af tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e66a70aaf354ce7a874ac4fafecab5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3187965484c1464db1dd4ff8f6cd06c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:58.358557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc9f2b-8bfc-4dc1-92e9-c1980c4fa4af tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:58.358925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc9f2b-8bfc-4dc1-92e9-c1980c4fa4af tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:58.366580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc9f2b-8bfc-4dc1-92e9-c1980c4fa4af tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:58.374444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc9f2b-8bfc-4dc1-92e9-c1980c4fa4af tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:58.377625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc9f2b-8bfc-4dc1-92e9-c1980c4fa4af tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:58.402211 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2944/5875] 10.222.0.26 () {56 vars in 1266 bytes} [Sat Oct 8 21:13:58 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:58.406602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06507291-a481-4a7f-97e0-b74ce7fc43da tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:58.419058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06507291-a481-4a7f-97e0-b74ce7fc43da tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:58.430842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783cefc-5879-4987-aba1-753eb14d8a18 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e66a70aaf354ce7a874ac4fafecab5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3187965484c1464db1dd4ff8f6cd06c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:58.431755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783cefc-5879-4987-aba1-753eb14d8a18 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] REQUEST_METHOD: `HEAD` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:58.432141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783cefc-5879-4987-aba1-753eb14d8a18 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:58.432526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783cefc-5879-4987-aba1-753eb14d8a18 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:58.437358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9783cefc-5879-4987-aba1-753eb14d8a18 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-9783cefc-5879-4987-aba1-753eb14d8a18 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 08 21:13:58.477722 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 08 21:13:58.483896 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 08 21:13:58.485333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:58.485333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:58.485333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 08 21:13:58.485333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 08 21:13:58.485333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 08 21:13:58.485333 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:58.485333 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2932/5876] 10.222.0.26 () {56 vars in 1264 bytes} [Sat Oct 8 21:13:58 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Oct 08 21:13:58.499165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f683d9-5b02-4590-b663-cc7911629227 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:58.499682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f683d9-5b02-4590-b663-cc7911629227 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:58.503222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f683d9-5b02-4590-b663-cc7911629227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:58.528006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-36f683d9-5b02-4590-b663-cc7911629227 None None] MFA Rules not processed for user `4e66a70aaf354ce7a874ac4fafecab5c`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:58.533056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-36f683d9-5b02-4590-b663-cc7911629227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:58.545029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783cefc-5879-4987-aba1-753eb14d8a18 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:58.545905 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2945/5877] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:58 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:13:58.563624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783cefc-5879-4987-aba1-753eb14d8a18 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:58.572677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1fc0b-0615-4027-9ba1-3928ba3ff281 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e66a70aaf354ce7a874ac4fafecab5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3187965484c1464db1dd4ff8f6cd06c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:58.573574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1fc0b-0615-4027-9ba1-3928ba3ff281 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:58.574017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1fc0b-0615-4027-9ba1-3928ba3ff281 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:58.583484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1fc0b-0615-4027-9ba1-3928ba3ff281 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:58.597959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1fc0b-0615-4027-9ba1-3928ba3ff281 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:58.602392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1fc0b-0615-4027-9ba1-3928ba3ff281 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:58.617842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f683d9-5b02-4590-b663-cc7911629227 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:58.633554 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2933/5878] 10.222.0.26 () {56 vars in 1263 bytes} [Sat Oct 8 21:13:58 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:58.640410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f683d9-5b02-4590-b663-cc7911629227 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:58.652490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27ce84-4b1a-4dcc-aad1-f82fb49d5427 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e66a70aaf354ce7a874ac4fafecab5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3187965484c1464db1dd4ff8f6cd06c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:58.656979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27ce84-4b1a-4dcc-aad1-f82fb49d5427 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:58.657434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27ce84-4b1a-4dcc-aad1-f82fb49d5427 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:58.658052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27ce84-4b1a-4dcc-aad1-f82fb49d5427 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:58.670247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27ce84-4b1a-4dcc-aad1-f82fb49d5427 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:58.672176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27ce84-4b1a-4dcc-aad1-f82fb49d5427 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:58.702971 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2946/5879] 10.222.0.26 () {56 vars in 1266 bytes} [Sat Oct 8 21:13:58 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:58.706959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1fc0b-0615-4027-9ba1-3928ba3ff281 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:58.722742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1fc0b-0615-4027-9ba1-3928ba3ff281 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:58.733900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a4ca3-ca95-4dc4-8951-c09a6328c920 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e66a70aaf354ce7a874ac4fafecab5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3187965484c1464db1dd4ff8f6cd06c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:58.737621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a4ca3-ca95-4dc4-8951-c09a6328c920 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:58.738579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a4ca3-ca95-4dc4-8951-c09a6328c920 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:58.741474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a4ca3-ca95-4dc4-8951-c09a6328c920 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:58.743691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0f6a4ca3-ca95-4dc4-8951-c09a6328c920 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-0f6a4ca3-ca95-4dc4-8951-c09a6328c920 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 08 21:13:58.756155 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 08 21:13:58.761426 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 08 21:13:58.762679 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:13:58.762679 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:13:58.762679 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 08 21:13:58.762679 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 08 21:13:58.762679 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 08 21:13:58.762679 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:13:58.762679 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2934/5880] 10.222.0.26 () {56 vars in 1263 bytes} [Sat Oct 8 21:13:58 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 21:13:58.766584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27ce84-4b1a-4dcc-aad1-f82fb49d5427 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:58.838144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:58.888234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27ce84-4b1a-4dcc-aad1-f82fb49d5427 tempest-TokensV3Test-593064595 tempest-TokensV3Test-593064595-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:58.895123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:58.917708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:58.918026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:58.918308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] PATH_INFO: `/v3/users/4e66a70aaf354ce7a874ac4fafecab5c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:58.924209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e66a70aaf354ce7a874ac4fafecab5c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:58.926803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:59.045491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e66a70aaf354ce7a874ac4fafecab5c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:59.066059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e66a70aaf354ce7a874ac4fafecab5c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:59.066835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e66a70aaf354ce7a874ac4fafecab5c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:59.067550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e66a70aaf354ce7a874ac4fafecab5c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:59.106507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e66a70aaf354ce7a874ac4fafecab5c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:13:59.129862 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2947/5881] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:13:58 2022] DELETE /identity/v3/users/4e66a70aaf354ce7a874ac4fafecab5c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:13:59.134489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ded9-9534-4445-8c0a-a4d15f5d6b19 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:59.136456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ded9-9534-4445-8c0a-a4d15f5d6b19 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:59.137072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ded9-9534-4445-8c0a-a4d15f5d6b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:59.171806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e246ded9-9534-4445-8c0a-a4d15f5d6b19 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:13:59.173223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e246ded9-9534-4445-8c0a-a4d15f5d6b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:59.198278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:59.293726 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2935/5882] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:13:59.355255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:13:59.357343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:13:59.478267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d7e68-2f9e-4856-8bbe-37bc29449635 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:13:59.489109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33bba-372c-484a-9fee-8e6d6b6b3c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:13:59.490245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33bba-372c-484a-9fee-8e6d6b6b3c99 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:13:59.490600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33bba-372c-484a-9fee-8e6d6b6b3c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:13:59.491074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33bba-372c-484a-9fee-8e6d6b6b3c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:13:59.504242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b33bba-372c-484a-9fee-8e6d6b6b3c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:13:59.506857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b33bba-372c-484a-9fee-8e6d6b6b3c99 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:13:59.530185 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2948/5883] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:00.967645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246ded9-9534-4445-8c0a-a4d15f5d6b19 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:00.970040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e246ded9-9534-4445-8c0a-a4d15f5d6b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:00.992905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246ded9-9534-4445-8c0a-a4d15f5d6b19 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:01.005986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ecf65-1de4-4a31-bd94-c7042d8e1502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:01.007082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ecf65-1de4-4a31-bd94-c7042d8e1502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:01.007641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ecf65-1de4-4a31-bd94-c7042d8e1502 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:01.008246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ecf65-1de4-4a31-bd94-c7042d8e1502 admin admin] PATH_INFO: `/v3/projects/3187965484c1464db1dd4ff8f6cd06c3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:01.015229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ecf65-1de4-4a31-bd94-c7042d8e1502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3187965484c1464db1dd4ff8f6cd06c3)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:01.019029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ecf65-1de4-4a31-bd94-c7042d8e1502 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:01.121966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-800ecf65-1de4-4a31-bd94-c7042d8e1502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3187965484c1464db1dd4ff8f6cd06c3', 'request_id': 'req-800ecf65-1de4-4a31-bd94-c7042d8e1502'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:01.144087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-800ecf65-1de4-4a31-bd94-c7042d8e1502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3187965484c1464db1dd4ff8f6cd06c3', 'request_id': 'req-800ecf65-1de4-4a31-bd94-c7042d8e1502'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:01.160456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-800ecf65-1de4-4a31-bd94-c7042d8e1502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3187965484c1464db1dd4ff8f6cd06c3', 'request_id': 'req-800ecf65-1de4-4a31-bd94-c7042d8e1502'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:01.185554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-800ecf65-1de4-4a31-bd94-c7042d8e1502 admin admin] The token cache is being invalidate because project 3187965484c1464db1dd4ff8f6cd06c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:01.186698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-800ecf65-1de4-4a31-bd94-c7042d8e1502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:01.189742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-800ecf65-1de4-4a31-bd94-c7042d8e1502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:01.193607 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2936/5884] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:00 2022] DELETE /identity/v3/projects/3187965484c1464db1dd4ff8f6cd06c3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:01.198594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74ee6c-401f-48d4-aa83-70d2c33961f7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:01.199414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74ee6c-401f-48d4-aa83-70d2c33961f7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:01.199851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74ee6c-401f-48d4-aa83-70d2c33961f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:01.228897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8a74ee6c-401f-48d4-aa83-70d2c33961f7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:01.232122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8a74ee6c-401f-48d4-aa83-70d2c33961f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:01.298986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:01.316927 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2949/5885] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:01.327734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542751e-9f58-49fa-8f54-2855cd20fb6c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:01.328018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542751e-9f58-49fa-8f54-2855cd20fb6c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:01.328511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542751e-9f58-49fa-8f54-2855cd20fb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:01.376191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7542751e-9f58-49fa-8f54-2855cd20fb6c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:01.378981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7542751e-9f58-49fa-8f54-2855cd20fb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:01.394071 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2937/5886] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:01.398168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74ee6c-401f-48d4-aa83-70d2c33961f7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:01.414021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74ee6c-401f-48d4-aa83-70d2c33961f7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:01.428841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29480c1-826c-4801-9cfa-a080af5b2727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:01.430837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29480c1-826c-4801-9cfa-a080af5b2727 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:01.431319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29480c1-826c-4801-9cfa-a080af5b2727 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:01.431776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29480c1-826c-4801-9cfa-a080af5b2727 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:01.432651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29480c1-826c-4801-9cfa-a080af5b2727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:14:01.434262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29480c1-826c-4801-9cfa-a080af5b2727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:01.438837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29480c1-826c-4801-9cfa-a080af5b2727 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:01.470802 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2950/5887] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:14:01.477099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542751e-9f58-49fa-8f54-2855cd20fb6c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:01.491577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542751e-9f58-49fa-8f54-2855cd20fb6c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:01.501712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcea3d8-9cb5-4009-98e9-0530fec8ca7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:01.503807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcea3d8-9cb5-4009-98e9-0530fec8ca7e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:01.504434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcea3d8-9cb5-4009-98e9-0530fec8ca7e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:01.505805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcea3d8-9cb5-4009-98e9-0530fec8ca7e admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:01.507111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcea3d8-9cb5-4009-98e9-0530fec8ca7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:01.509692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcea3d8-9cb5-4009-98e9-0530fec8ca7e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:01.572328 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2938/5888] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:01 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:01.576247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29480c1-826c-4801-9cfa-a080af5b2727 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:01.590277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29480c1-826c-4801-9cfa-a080af5b2727 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:01.726167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80217834-16b3-476c-bee5-64b6d3f476bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:01.726796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80217834-16b3-476c-bee5-64b6d3f476bc admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:01.727178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80217834-16b3-476c-bee5-64b6d3f476bc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:01.727472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80217834-16b3-476c-bee5-64b6d3f476bc admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:01.728097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80217834-16b3-476c-bee5-64b6d3f476bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:01.730087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80217834-16b3-476c-bee5-64b6d3f476bc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:01.771479 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2951/5889] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:01 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:01.772411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcea3d8-9cb5-4009-98e9-0530fec8ca7e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:01.790954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcea3d8-9cb5-4009-98e9-0530fec8ca7e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:01.803405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb4e57-adf3-4a60-9f92-a577c74a9235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:01.804042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb4e57-adf3-4a60-9f92-a577c74a9235 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:01.804382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb4e57-adf3-4a60-9f92-a577c74a9235 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:01.804643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb4e57-adf3-4a60-9f92-a577c74a9235 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:01.805284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb4e57-adf3-4a60-9f92-a577c74a9235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:01.806983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb4e57-adf3-4a60-9f92-a577c74a9235 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:01.828736 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2939/5890] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:14:01.831930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80217834-16b3-476c-bee5-64b6d3f476bc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:01.850097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80217834-16b3-476c-bee5-64b6d3f476bc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:01.863937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502d150-822d-4984-b7bd-396743b8cd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:01.864574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502d150-822d-4984-b7bd-396743b8cd2b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:01.864862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502d150-822d-4984-b7bd-396743b8cd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:01.867125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502d150-822d-4984-b7bd-396743b8cd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:01.867818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502d150-822d-4984-b7bd-396743b8cd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:01.870989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502d150-822d-4984-b7bd-396743b8cd2b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:01.929362 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2952/5891] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:01.931623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb4e57-adf3-4a60-9f92-a577c74a9235 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:01.949503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb4e57-adf3-4a60-9f92-a577c74a9235 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:01.965432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e2cba-33f7-4a78-8f97-a91ac2993959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:01.966115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e2cba-33f7-4a78-8f97-a91ac2993959 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:01.966397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e2cba-33f7-4a78-8f97-a91ac2993959 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:01.966673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e2cba-33f7-4a78-8f97-a91ac2993959 admin admin] PATH_INFO: `/v3/projects/7ad56d9ee50b4ac0a9ceed19988ae70e/users/1bacf8ec54204d10a78d019866747ede/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:02.023342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e2cba-33f7-4a78-8f97-a91ac2993959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad56d9ee50b4ac0a9ceed19988ae70e, user_id=1bacf8ec54204d10a78d019866747ede, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:02.027473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e2cba-33f7-4a78-8f97-a91ac2993959 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:02.051784 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2940/5892] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:01 2022] PUT /identity/v3/projects/7ad56d9ee50b4ac0a9ceed19988ae70e/users/1bacf8ec54204d10a78d019866747ede/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:02.062250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3bd93-ff12-46d1-a6ac-d0c7ad49e1f7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:02.062615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3bd93-ff12-46d1-a6ac-d0c7ad49e1f7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:02.062866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3bd93-ff12-46d1-a6ac-d0c7ad49e1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:02.109640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-98a3bd93-ff12-46d1-a6ac-d0c7ad49e1f7 None None] MFA Rules not processed for user `1bacf8ec54204d10a78d019866747ede`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:02.111067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-98a3bd93-ff12-46d1-a6ac-d0c7ad49e1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:02.211842 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2953/5893] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:02.216822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e2cba-33f7-4a78-8f97-a91ac2993959 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:02.293817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:02.319387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e2cba-33f7-4a78-8f97-a91ac2993959 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:02.331161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d37ad-5687-449e-b817-da64d2302c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:02.333641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d37ad-5687-449e-b817-da64d2302c32 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:02.351185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d37ad-5687-449e-b817-da64d2302c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:02.352829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d37ad-5687-449e-b817-da64d2302c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:02.355500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d37ad-5687-449e-b817-da64d2302c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:02.390000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d37ad-5687-449e-b817-da64d2302c32 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:02.425427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13572b5f-98c8-47c5-8da1-2717cc157c0b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:02.425893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13572b5f-98c8-47c5-8da1-2717cc157c0b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:02.426913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13572b5f-98c8-47c5-8da1-2717cc157c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:02.454833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-13572b5f-98c8-47c5-8da1-2717cc157c0b None None] MFA Rules not processed for user `b6300eee278b4fad9561ebea03c2eeaa`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:02.458326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-13572b5f-98c8-47c5-8da1-2717cc157c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:02.485350 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2941/5894] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:02 2022] POST /identity/v3/projects => generated 375 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:14:02.489383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d37ad-5687-449e-b817-da64d2302c32 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:02.551879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:02.587302 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2954/5895] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:02.631846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d37ad-5687-449e-b817-da64d2302c32 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:02.638352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2a4da-beda-43f4-a2dc-2dd87b9af1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:02.639182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2a4da-beda-43f4-a2dc-2dd87b9af1ba admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:02.639606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2a4da-beda-43f4-a2dc-2dd87b9af1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:02.639887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2a4da-beda-43f4-a2dc-2dd87b9af1ba admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:02.640732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2a4da-beda-43f4-a2dc-2dd87b9af1ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:02.642770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2a4da-beda-43f4-a2dc-2dd87b9af1ba admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:02.678021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba58c51-eb58-4bcb-9ad4-a09c15df41f7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:02.678419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba58c51-eb58-4bcb-9ad4-a09c15df41f7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:02.678712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba58c51-eb58-4bcb-9ad4-a09c15df41f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:02.707281 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2942/5896] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:02 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:02.710766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2a4da-beda-43f4-a2dc-2dd87b9af1ba admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:02.728814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-dba58c51-eb58-4bcb-9ad4-a09c15df41f7 None None] MFA Rules not processed for user `b6300eee278b4fad9561ebea03c2eeaa`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:02.730485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dba58c51-eb58-4bcb-9ad4-a09c15df41f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:02.740854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2a4da-beda-43f4-a2dc-2dd87b9af1ba admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:02.756635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af8ad-f7c8-4f11-9845-533abc9f815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:02.757304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af8ad-f7c8-4f11-9845-533abc9f815a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:02.757591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af8ad-f7c8-4f11-9845-533abc9f815a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:02.759086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af8ad-f7c8-4f11-9845-533abc9f815a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:02.759770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60af8ad-f7c8-4f11-9845-533abc9f815a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:02.764318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60af8ad-f7c8-4f11-9845-533abc9f815a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:02.804506 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2943/5897] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:02.810639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af8ad-f7c8-4f11-9845-533abc9f815a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:02.831854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af8ad-f7c8-4f11-9845-533abc9f815a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:02.845689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed2f3-1a36-4bd1-b860-c43acb097e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:02.848056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed2f3-1a36-4bd1-b860-c43acb097e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:02.848410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed2f3-1a36-4bd1-b860-c43acb097e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:02.849405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed2f3-1a36-4bd1-b860-c43acb097e2b admin admin] PATH_INFO: `/v3/projects/e76720b3723f45e7a2cdf3323164cebe/users/b30030cae30e4461a5efb4992d96ec50/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:02.897427 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2955/5898] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:02.900859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bed2f3-1a36-4bd1-b860-c43acb097e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76720b3723f45e7a2cdf3323164cebe, user_id=b30030cae30e4461a5efb4992d96ec50, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:02.903840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bed2f3-1a36-4bd1-b860-c43acb097e2b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:02.934152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e82213-1c12-4854-92d0-4f31660bf203 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:02.934479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e82213-1c12-4854-92d0-4f31660bf203 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:02.934936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e82213-1c12-4854-92d0-4f31660bf203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:02.941839 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2944/5899] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:02 2022] PUT /identity/v3/projects/e76720b3723f45e7a2cdf3323164cebe/users/b30030cae30e4461a5efb4992d96ec50/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:02.947902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed2f3-1a36-4bd1-b860-c43acb097e2b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:02.970822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-80e82213-1c12-4854-92d0-4f31660bf203 None None] MFA Rules not processed for user `b6300eee278b4fad9561ebea03c2eeaa`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:02.973802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-80e82213-1c12-4854-92d0-4f31660bf203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:03.081250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed2f3-1a36-4bd1-b860-c43acb097e2b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:03.110467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d1aad-1b62-4637-8ebe-c35f97b89b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:03.115851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d1aad-1b62-4637-8ebe-c35f97b89b74 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:03.116139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d1aad-1b62-4637-8ebe-c35f97b89b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:03.116418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d1aad-1b62-4637-8ebe-c35f97b89b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:03.118902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d1aad-1b62-4637-8ebe-c35f97b89b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:03.124800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d1aad-1b62-4637-8ebe-c35f97b89b74 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:03.139656 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2956/5900] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:03.151021 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2945/5901] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:03.152350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e82213-1c12-4854-92d0-4f31660bf203 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:03.169393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e82213-1c12-4854-92d0-4f31660bf203 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:03.175421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d22ed2-a38b-425d-88c9-cc47f991e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:03.176164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22ed2-a38b-425d-88c9-cc47f991e48d admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:03.176445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22ed2-a38b-425d-88c9-cc47f991e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:03.176722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22ed2-a38b-425d-88c9-cc47f991e48d admin admin] PATH_INFO: `/v3/projects/e76720b3723f45e7a2cdf3323164cebe/users/b30030cae30e4461a5efb4992d96ec50/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:03.179168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d22ed2-a38b-425d-88c9-cc47f991e48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76720b3723f45e7a2cdf3323164cebe, user_id=b30030cae30e4461a5efb4992d96ec50, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:03.182059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d22ed2-a38b-425d-88c9-cc47f991e48d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:03.199365 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2957/5902] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:03 2022] PUT /identity/v3/projects/e76720b3723f45e7a2cdf3323164cebe/users/b30030cae30e4461a5efb4992d96ec50/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:03.207941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee084e35-fe43-49a9-8f6e-96729c97836c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:03.207941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee084e35-fe43-49a9-8f6e-96729c97836c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:03.207941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee084e35-fe43-49a9-8f6e-96729c97836c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:03.227122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa74533-0f0a-4bf1-9286-dc7337709b7c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:03.228399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa74533-0f0a-4bf1-9286-dc7337709b7c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:03.234422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa74533-0f0a-4bf1-9286-dc7337709b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:03.271062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ee084e35-fe43-49a9-8f6e-96729c97836c None None] MFA Rules not processed for user `b6300eee278b4fad9561ebea03c2eeaa`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:03.272688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ee084e35-fe43-49a9-8f6e-96729c97836c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:03.311440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-baa74533-0f0a-4bf1-9286-dc7337709b7c None None] MFA Rules not processed for user `b30030cae30e4461a5efb4992d96ec50`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:03.313120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-baa74533-0f0a-4bf1-9286-dc7337709b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:03.318137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:03.437896 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2946/5903] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:03.478549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2c850-19f1-4407-a47c-42d715c544d6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:03.482541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2c850-19f1-4407-a47c-42d715c544d6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:03.483025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2c850-19f1-4407-a47c-42d715c544d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:03.536287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8fa2c850-19f1-4407-a47c-42d715c544d6 None None] MFA Rules not processed for user `b6300eee278b4fad9561ebea03c2eeaa`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:03.540371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8fa2c850-19f1-4407-a47c-42d715c544d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:03.555144 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2958/5904] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:03.558221 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2947/5905] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:14:03.571196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa74533-0f0a-4bf1-9286-dc7337709b7c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:03.572701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-baa74533-0f0a-4bf1-9286-dc7337709b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:03.601087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:03.690616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa74533-0f0a-4bf1-9286-dc7337709b7c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:03.698112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20d8ce-c74f-45d9-9274-b8cbe989ec52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:03.699927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d8ce-c74f-45d9-9274-b8cbe989ec52 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:03.700330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d8ce-c74f-45d9-9274-b8cbe989ec52 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:03.703045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d8ce-c74f-45d9-9274-b8cbe989ec52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:03.719186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20d8ce-c74f-45d9-9274-b8cbe989ec52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:03.721913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20d8ce-c74f-45d9-9274-b8cbe989ec52 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:03.735497 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2959/5906] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:08.318717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2c850-19f1-4407-a47c-42d715c544d6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:08.395463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2c850-19f1-4407-a47c-42d715c544d6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:08.400978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:08.402023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:08.402564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:08.403057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] PATH_INFO: `/v3/users/1bacf8ec54204d10a78d019866747ede` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:08.405255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bacf8ec54204d10a78d019866747ede)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:08.407407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:08.485038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bacf8ec54204d10a78d019866747ede'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:08.496637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bacf8ec54204d10a78d019866747ede'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:08.497779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bacf8ec54204d10a78d019866747ede'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:08.498561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bacf8ec54204d10a78d019866747ede'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:08.521466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bacf8ec54204d10a78d019866747ede'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:08.542325 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2948/5907] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:08 2022] DELETE /identity/v3/users/1bacf8ec54204d10a78d019866747ede => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:08.546763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af8c5c-9feb-4a17-8562-c8ec03eaeaf6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:08.547627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af8c5c-9feb-4a17-8562-c8ec03eaeaf6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:08.547898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af8c5c-9feb-4a17-8562-c8ec03eaeaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:08.580471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-77af8c5c-9feb-4a17-8562-c8ec03eaeaf6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:08.582360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-77af8c5c-9feb-4a17-8562-c8ec03eaeaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:08.654358 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2960/5908] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:08.689606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:08.692122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:08.857104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:08.961093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae9b1a-1785-4cda-8733-41d1ffea9433 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:08.998361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5b234-d712-4b26-9e8f-097be2af51b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:09.016290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5b234-d712-4b26-9e8f-097be2af51b1 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:09.020502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5b234-d712-4b26-9e8f-097be2af51b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:09.023268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5b234-d712-4b26-9e8f-097be2af51b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:09.060829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5b234-d712-4b26-9e8f-097be2af51b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:09.063921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5b234-d712-4b26-9e8f-097be2af51b1 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:09.085538 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2949/5909] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:10.161359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af8c5c-9feb-4a17-8562-c8ec03eaeaf6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:10.162812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-77af8c5c-9feb-4a17-8562-c8ec03eaeaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:10.182052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af8c5c-9feb-4a17-8562-c8ec03eaeaf6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:10.207092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:10.207984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:10.208453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:10.208906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] PATH_INFO: `/v3/users/2bb05353c8414bdb9ce12685cdbffeab` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:10.210813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb05353c8414bdb9ce12685cdbffeab)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:10.214114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:10.347013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb05353c8414bdb9ce12685cdbffeab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:10.372004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb05353c8414bdb9ce12685cdbffeab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:10.376051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb05353c8414bdb9ce12685cdbffeab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:10.378302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb05353c8414bdb9ce12685cdbffeab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:10.397272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb05353c8414bdb9ce12685cdbffeab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:10.420118 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2961/5910] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:10 2022] DELETE /identity/v3/users/2bb05353c8414bdb9ce12685cdbffeab => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:10.424353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756991c-4a48-4c9c-8513-8d4c3b98b528 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:10.425327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756991c-4a48-4c9c-8513-8d4c3b98b528 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:10.425798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756991c-4a48-4c9c-8513-8d4c3b98b528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:10.461901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4756991c-4a48-4c9c-8513-8d4c3b98b528 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:10.476501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4756991c-4a48-4c9c-8513-8d4c3b98b528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:10.608274 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2950/5911] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:14:10.634217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:10.635702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:10.708167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:10.760674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875e2e0-034f-464c-abfc-af9825992fac admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:10.768839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d6109-163a-4c3e-9cbc-6baf92cac81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:10.772798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d6109-163a-4c3e-9cbc-6baf92cac81c service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:10.773017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d6109-163a-4c3e-9cbc-6baf92cac81c service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:10.773518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d6109-163a-4c3e-9cbc-6baf92cac81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:10.790327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d6109-163a-4c3e-9cbc-6baf92cac81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:10.792203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d6109-163a-4c3e-9cbc-6baf92cac81c service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:10.841105 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2962/5912] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:10.903994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756991c-4a48-4c9c-8513-8d4c3b98b528 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:10.905753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4756991c-4a48-4c9c-8513-8d4c3b98b528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:10.927658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756991c-4a48-4c9c-8513-8d4c3b98b528 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:10.937521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:10.938182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:10.938462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:10.938742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29 admin admin] PATH_INFO: `/v3/projects/7ad56d9ee50b4ac0a9ceed19988ae70e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:10.946168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad56d9ee50b4ac0a9ceed19988ae70e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:10.948196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:11.078560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad56d9ee50b4ac0a9ceed19988ae70e', 'request_id': 'req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.097607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad56d9ee50b4ac0a9ceed19988ae70e', 'request_id': 'req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.108130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad56d9ee50b4ac0a9ceed19988ae70e', 'request_id': 'req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.131306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29 admin admin] The token cache is being invalidate because project 7ad56d9ee50b4ac0a9ceed19988ae70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:11.131612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.134584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5c967c83-7eaa-4b85-a117-d3f5eb6aac29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.142127 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2951/5913] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:10 2022] DELETE /identity/v3/projects/7ad56d9ee50b4ac0a9ceed19988ae70e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:11.143259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d6109-163a-4c3e-9cbc-6baf92cac81c service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:11.159794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d6109-163a-4c3e-9cbc-6baf92cac81c service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:11.284545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70cd92-db4b-45e4-adff-a9bb8c36ed24 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:11.284840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70cd92-db4b-45e4-adff-a9bb8c36ed24 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:11.285126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70cd92-db4b-45e4-adff-a9bb8c36ed24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:11.331912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1f70cd92-db4b-45e4-adff-a9bb8c36ed24 None None] MFA Rules not processed for user `de71b64a2e1c4b6aaa15b5ee75003add`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:11.334012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1f70cd92-db4b-45e4-adff-a9bb8c36ed24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:11.371741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace61e8-204c-4c82-8530-7a64f5f5d562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:11.372414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace61e8-204c-4c82-8530-7a64f5f5d562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:11.372796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace61e8-204c-4c82-8530-7a64f5f5d562 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:11.372953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace61e8-204c-4c82-8530-7a64f5f5d562 admin admin] PATH_INFO: `/v3/users/b30030cae30e4461a5efb4992d96ec50` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:11.383207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace61e8-204c-4c82-8530-7a64f5f5d562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b30030cae30e4461a5efb4992d96ec50)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:11.383962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace61e8-204c-4c82-8530-7a64f5f5d562 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:11.526585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0ace61e8-204c-4c82-8530-7a64f5f5d562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b30030cae30e4461a5efb4992d96ec50'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.535498 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2952/5914] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:11.565894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0ace61e8-204c-4c82-8530-7a64f5f5d562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b30030cae30e4461a5efb4992d96ec50'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.568330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0ace61e8-204c-4c82-8530-7a64f5f5d562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b30030cae30e4461a5efb4992d96ec50'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.571682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0ace61e8-204c-4c82-8530-7a64f5f5d562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b30030cae30e4461a5efb4992d96ec50'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.621777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0ace61e8-204c-4c82-8530-7a64f5f5d562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b30030cae30e4461a5efb4992d96ec50'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.662631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70cd92-db4b-45e4-adff-a9bb8c36ed24 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:11.663864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1f70cd92-db4b-45e4-adff-a9bb8c36ed24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:11.687342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70cd92-db4b-45e4-adff-a9bb8c36ed24 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:11.692340 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2963/5915] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:11 2022] DELETE /identity/v3/users/b30030cae30e4461a5efb4992d96ec50 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:11.709611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:11.803882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:11.805369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:11.805792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:11.806080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd admin admin] PATH_INFO: `/v3/projects/68a9da7d148747d891eb7796da1fca6f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:11.807504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a9da7d148747d891eb7796da1fca6f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:11.809742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:11.937592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a9da7d148747d891eb7796da1fca6f', 'request_id': 'req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.954256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a9da7d148747d891eb7796da1fca6f', 'request_id': 'req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.965339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a9da7d148747d891eb7796da1fca6f', 'request_id': 'req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.997824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd admin admin] The token cache is being invalidate because project 68a9da7d148747d891eb7796da1fca6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:11.998031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:11.999695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b24b83b9-4a09-44ea-8e0f-1dc4c667edcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:12.002018 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2953/5916] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:11 2022] DELETE /identity/v3/projects/68a9da7d148747d891eb7796da1fca6f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:14:12.007453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587db08-6160-4416-93ef-3c9bcf20dc4f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:12.009933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587db08-6160-4416-93ef-3c9bcf20dc4f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:12.010456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587db08-6160-4416-93ef-3c9bcf20dc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:12.056884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9587db08-6160-4416-93ef-3c9bcf20dc4f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:12.058543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9587db08-6160-4416-93ef-3c9bcf20dc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:12.246986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:12.277105 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2964/5917] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:12.284384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aadaf-e989-4d47-8828-8be1346d107c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:12.285709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aadaf-e989-4d47-8828-8be1346d107c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:12.286093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aadaf-e989-4d47-8828-8be1346d107c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:12.315484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-617aadaf-e989-4d47-8828-8be1346d107c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:12.318062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-617aadaf-e989-4d47-8828-8be1346d107c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:12.328939 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2954/5918] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:12.333956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587db08-6160-4416-93ef-3c9bcf20dc4f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:12.352948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587db08-6160-4416-93ef-3c9bcf20dc4f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:12.372630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbd51c-d820-4208-92e3-d79d07501979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:12.373794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd51c-d820-4208-92e3-d79d07501979 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:12.374181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd51c-d820-4208-92e3-d79d07501979 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:12.374602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd51c-d820-4208-92e3-d79d07501979 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:12.375668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbd51c-d820-4208-92e3-d79d07501979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:14:12.376127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbd51c-d820-4208-92e3-d79d07501979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:12.383314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbd51c-d820-4208-92e3-d79d07501979 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:12.415076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aadaf-e989-4d47-8828-8be1346d107c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:12.415281 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2965/5919] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:14:12.425953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aadaf-e989-4d47-8828-8be1346d107c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:12.452076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbd51c-d820-4208-92e3-d79d07501979 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:12.453967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2dbbd51c-d820-4208-92e3-d79d07501979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:12.455802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0f094-6b91-4852-b205-fb16d522b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:12.456608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0f094-6b91-4852-b205-fb16d522b859 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:12.457046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0f094-6b91-4852-b205-fb16d522b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:12.457592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0f094-6b91-4852-b205-fb16d522b859 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:12.458594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0f094-6b91-4852-b205-fb16d522b859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:12.460669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0f094-6b91-4852-b205-fb16d522b859 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:12.537692 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2955/5920] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:12 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:12.541515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0f094-6b91-4852-b205-fb16d522b859 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:12.639974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0f094-6b91-4852-b205-fb16d522b859 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:12.647963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06741ae-1117-4cef-b217-ac660b53dd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:12.649065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06741ae-1117-4cef-b217-ac660b53dd4e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:12.649611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06741ae-1117-4cef-b217-ac660b53dd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:12.650179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06741ae-1117-4cef-b217-ac660b53dd4e admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:12.651176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06741ae-1117-4cef-b217-ac660b53dd4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:12.651590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbd51c-d820-4208-92e3-d79d07501979 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:12.653950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06741ae-1117-4cef-b217-ac660b53dd4e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:12.695193 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2956/5921] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:12 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:12.700148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06741ae-1117-4cef-b217-ac660b53dd4e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:12.711096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:12.724401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06741ae-1117-4cef-b217-ac660b53dd4e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:12.742760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a81b8-c3e8-4ec7-ac11-615c99311648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:12.743390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a81b8-c3e8-4ec7-ac11-615c99311648 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:12.744153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a81b8-c3e8-4ec7-ac11-615c99311648 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:12.745153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a81b8-c3e8-4ec7-ac11-615c99311648 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:12.745885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a81b8-c3e8-4ec7-ac11-615c99311648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:12.757841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a81b8-c3e8-4ec7-ac11-615c99311648 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:12.768119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd590902-43e0-4b25-9a9a-723c5418e660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:12.769684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd590902-43e0-4b25-9a9a-723c5418e660 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:12.770175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd590902-43e0-4b25-9a9a-723c5418e660 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:12.770792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd590902-43e0-4b25-9a9a-723c5418e660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:12.773620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fd590902-43e0-4b25-9a9a-723c5418e660 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:12.776141 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2957/5922] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:12.776990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a81b8-c3e8-4ec7-ac11-615c99311648 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:12.780532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a82a81b8-c3e8-4ec7-ac11-615c99311648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:12.796333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a81b8-c3e8-4ec7-ac11-615c99311648 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:12.804212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285968d0-98ba-4f96-b587-3d48957c49a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:12.804994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285968d0-98ba-4f96-b587-3d48957c49a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:12.805395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285968d0-98ba-4f96-b587-3d48957c49a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:12.805734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285968d0-98ba-4f96-b587-3d48957c49a4 admin admin] PATH_INFO: `/v3/projects/e76720b3723f45e7a2cdf3323164cebe` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:12.807302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285968d0-98ba-4f96-b587-3d48957c49a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76720b3723f45e7a2cdf3323164cebe)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:12.809411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285968d0-98ba-4f96-b587-3d48957c49a4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:12.809620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd590902-43e0-4b25-9a9a-723c5418e660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:12.816056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd590902-43e0-4b25-9a9a-723c5418e660 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:12.838532 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2966/5923] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:14:12.841635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd590902-43e0-4b25-9a9a-723c5418e660 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:12.861327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd590902-43e0-4b25-9a9a-723c5418e660 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:12.913430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-285968d0-98ba-4f96-b587-3d48957c49a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76720b3723f45e7a2cdf3323164cebe', 'request_id': 'req-285968d0-98ba-4f96-b587-3d48957c49a4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:12.933748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-285968d0-98ba-4f96-b587-3d48957c49a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76720b3723f45e7a2cdf3323164cebe', 'request_id': 'req-285968d0-98ba-4f96-b587-3d48957c49a4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:12.947679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-285968d0-98ba-4f96-b587-3d48957c49a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76720b3723f45e7a2cdf3323164cebe', 'request_id': 'req-285968d0-98ba-4f96-b587-3d48957c49a4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:12.968733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55ffb7-c744-4a62-9c12-83f16dbef400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:12.969521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55ffb7-c744-4a62-9c12-83f16dbef400 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:12.969890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55ffb7-c744-4a62-9c12-83f16dbef400 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:12.970280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55ffb7-c744-4a62-9c12-83f16dbef400 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:12.972612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55ffb7-c744-4a62-9c12-83f16dbef400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:12.974913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55ffb7-c744-4a62-9c12-83f16dbef400 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:12.977932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-285968d0-98ba-4f96-b587-3d48957c49a4 admin admin] The token cache is being invalidate because project e76720b3723f45e7a2cdf3323164cebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:12.978225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-285968d0-98ba-4f96-b587-3d48957c49a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:12.979824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-285968d0-98ba-4f96-b587-3d48957c49a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:12.984028 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2958/5924] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:12 2022] DELETE /identity/v3/projects/e76720b3723f45e7a2cdf3323164cebe => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:12.988690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a0bc3-419f-4e21-9956-ba670a73c478 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:12.988974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a0bc3-419f-4e21-9956-ba670a73c478 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:12.989273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a0bc3-419f-4e21-9956-ba670a73c478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:12.992091 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2967/5925] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:12.997151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55ffb7-c744-4a62-9c12-83f16dbef400 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:13.000643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6b55ffb7-c744-4a62-9c12-83f16dbef400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:13.023971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55ffb7-c744-4a62-9c12-83f16dbef400 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:13.031832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1a8d5-b66f-4aa6-81af-104eb1e03558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:13.034717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1a8d5-b66f-4aa6-81af-104eb1e03558 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:13.035047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1a8d5-b66f-4aa6-81af-104eb1e03558 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:13.035276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1a8d5-b66f-4aa6-81af-104eb1e03558 admin admin] PATH_INFO: `/v3/projects/257d8893699c47eea348f25eaf2479d5/users/7528c528ac6b42c189eb04ac37eeff6d/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:13.035984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7e9a0bc3-419f-4e21-9956-ba670a73c478 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:13.037272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7e9a0bc3-419f-4e21-9956-ba670a73c478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:13.058323 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2959/5926] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:14:13.066039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3906e-9046-4df6-b670-1d8edc392c56 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:13.066345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3906e-9046-4df6-b670-1d8edc392c56 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:13.066597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3906e-9046-4df6-b670-1d8edc392c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:13.081304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1a8d5-b66f-4aa6-81af-104eb1e03558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=257d8893699c47eea348f25eaf2479d5, user_id=7528c528ac6b42c189eb04ac37eeff6d, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:13.084378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1a8d5-b66f-4aa6-81af-104eb1e03558 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:13.110460 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2968/5927] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:12 2022] PUT /identity/v3/projects/257d8893699c47eea348f25eaf2479d5/users/7528c528ac6b42c189eb04ac37eeff6d/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:13.115403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c1a3906e-9046-4df6-b670-1d8edc392c56 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:13.121168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c1a3906e-9046-4df6-b670-1d8edc392c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:13.122945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32a1b8-8b7c-44d5-9273-24dad1104023 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:13.123241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32a1b8-8b7c-44d5-9273-24dad1104023 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:13.123551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32a1b8-8b7c-44d5-9273-24dad1104023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:13.166245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:13.183800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3d32a1b8-8b7c-44d5-9273-24dad1104023 None None] MFA Rules not processed for user `7528c528ac6b42c189eb04ac37eeff6d`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:13.185269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d32a1b8-8b7c-44d5-9273-24dad1104023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:13.271408 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2960/5928] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:14:13.272775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3906e-9046-4df6-b670-1d8edc392c56 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:13.288971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3906e-9046-4df6-b670-1d8edc392c56 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:13.294419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0db44-587d-4353-a702-e484f5acbf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:13.295844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0db44-587d-4353-a702-e484f5acbf56 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:13.296307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0db44-587d-4353-a702-e484f5acbf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:13.297322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0db44-587d-4353-a702-e484f5acbf56 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:13.298324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0db44-587d-4353-a702-e484f5acbf56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:14:13.298824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0db44-587d-4353-a702-e484f5acbf56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:13.300783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0db44-587d-4353-a702-e484f5acbf56 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:13.342298 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2961/5929] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:14:13.345078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0db44-587d-4353-a702-e484f5acbf56 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:13.372363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0db44-587d-4353-a702-e484f5acbf56 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:13.379193 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2969/5930] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:13.385220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4fe44-5985-4d7d-be09-82324c968624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:13.389677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4fe44-5985-4d7d-be09-82324c968624 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:13.389967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4fe44-5985-4d7d-be09-82324c968624 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:13.390248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4fe44-5985-4d7d-be09-82324c968624 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:13.390896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4fe44-5985-4d7d-be09-82324c968624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:13.400083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4fe44-5985-4d7d-be09-82324c968624 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:13.430220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32a1b8-8b7c-44d5-9273-24dad1104023 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:13.432011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d32a1b8-8b7c-44d5-9273-24dad1104023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:13.461285 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2962/5931] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:13 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:13.462481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4fe44-5985-4d7d-be09-82324c968624 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:13.562516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:13.596683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32a1b8-8b7c-44d5-9273-24dad1104023 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:13.640396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4fe44-5985-4d7d-be09-82324c968624 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:13.653020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bc1a7-c8a3-4b6d-a638-ad13d82a4b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:13.655090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bc1a7-c8a3-4b6d-a638-ad13d82a4b29 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:13.655619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bc1a7-c8a3-4b6d-a638-ad13d82a4b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:13.656564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bc1a7-c8a3-4b6d-a638-ad13d82a4b29 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:13.657941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bc1a7-c8a3-4b6d-a638-ad13d82a4b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:13.664634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bc1a7-c8a3-4b6d-a638-ad13d82a4b29 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:13.695124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2d3ee-0b7f-4579-a274-0c0c63169d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:13.696525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2d3ee-0b7f-4579-a274-0c0c63169d6c service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:13.696812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2d3ee-0b7f-4579-a274-0c0c63169d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:13.697099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2d3ee-0b7f-4579-a274-0c0c63169d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:13.741045 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2963/5932] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:13 2022] POST /identity/v3/users => generated 286 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:13.744538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bc1a7-c8a3-4b6d-a638-ad13d82a4b29 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:13.775788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bc1a7-c8a3-4b6d-a638-ad13d82a4b29 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:13.789944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53405-eef6-4c6f-8844-af24bfcc971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:13.790944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53405-eef6-4c6f-8844-af24bfcc971f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:13.791448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53405-eef6-4c6f-8844-af24bfcc971f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:13.793542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53405-eef6-4c6f-8844-af24bfcc971f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:13.794852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b53405-eef6-4c6f-8844-af24bfcc971f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:13.798560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b53405-eef6-4c6f-8844-af24bfcc971f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:13.825521 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2964/5933] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:13.831394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53405-eef6-4c6f-8844-af24bfcc971f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:13.851890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53405-eef6-4c6f-8844-af24bfcc971f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:13.868156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84ef29-6649-48be-8295-b223ef71b64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:13.868731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2d3ee-0b7f-4579-a274-0c0c63169d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:13.869445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84ef29-6649-48be-8295-b223ef71b64f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:13.869952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84ef29-6649-48be-8295-b223ef71b64f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:13.870519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84ef29-6649-48be-8295-b223ef71b64f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:13.870641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2d3ee-0b7f-4579-a274-0c0c63169d6c service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:13.871498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84ef29-6649-48be-8295-b223ef71b64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:13.873373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84ef29-6649-48be-8295-b223ef71b64f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:13.895234 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2970/5934] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:13.905275 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2965/5935] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:13.910094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2d3ee-0b7f-4579-a274-0c0c63169d6c service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:14.001690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2d3ee-0b7f-4579-a274-0c0c63169d6c service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:14.018590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e0312-74da-4dfe-bfe3-e68e42cb4d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:14.019461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0312-74da-4dfe-bfe3-e68e42cb4d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:14.019748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0312-74da-4dfe-bfe3-e68e42cb4d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:14.020022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0312-74da-4dfe-bfe3-e68e42cb4d4f admin admin] PATH_INFO: `/v3/projects/560306a7b81d4470a01de0a4e2191308/users/aa239b9975bc46659dd8801fb1e0fa7f/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:14.039441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:14.067585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e0312-74da-4dfe-bfe3-e68e42cb4d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=560306a7b81d4470a01de0a4e2191308, user_id=aa239b9975bc46659dd8801fb1e0fa7f, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:14.070449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e0312-74da-4dfe-bfe3-e68e42cb4d4f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:14.125118 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2971/5936] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:13 2022] PUT /identity/v3/projects/560306a7b81d4470a01de0a4e2191308/users/aa239b9975bc46659dd8801fb1e0fa7f/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:14.136294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9a417-7270-4b22-b835-8093e5b7a1a5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:14.136656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9a417-7270-4b22-b835-8093e5b7a1a5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:14.136910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9a417-7270-4b22-b835-8093e5b7a1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:14.208161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d6b9a417-7270-4b22-b835-8093e5b7a1a5 None None] MFA Rules not processed for user `aa239b9975bc46659dd8801fb1e0fa7f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:14.209604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d6b9a417-7270-4b22-b835-8093e5b7a1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:14.421725 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2966/5937] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:14.459677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e0312-74da-4dfe-bfe3-e68e42cb4d4f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:14.462899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-080e0312-74da-4dfe-bfe3-e68e42cb4d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:14.618625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e0312-74da-4dfe-bfe3-e68e42cb4d4f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:14.629399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6056c42-9ac4-4eb9-abdd-a1837c95b30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:14.630186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056c42-9ac4-4eb9-abdd-a1837c95b30e service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:14.630541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056c42-9ac4-4eb9-abdd-a1837c95b30e service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:14.630881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056c42-9ac4-4eb9-abdd-a1837c95b30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:14.661079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6056c42-9ac4-4eb9-abdd-a1837c95b30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:14.662661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6056c42-9ac4-4eb9-abdd-a1837c95b30e service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:14.688413 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2972/5938] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:15.945410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9a417-7270-4b22-b835-8093e5b7a1a5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:16.160542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9a417-7270-4b22-b835-8093e5b7a1a5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:16.186317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:16.188014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:16.188784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:16.189133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] PATH_INFO: `/v3/users/7528c528ac6b42c189eb04ac37eeff6d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:16.191622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7528c528ac6b42c189eb04ac37eeff6d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:16.194657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:16.312059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:16.354824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7528c528ac6b42c189eb04ac37eeff6d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:16.375157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7528c528ac6b42c189eb04ac37eeff6d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:16.377612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7528c528ac6b42c189eb04ac37eeff6d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:16.379231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7528c528ac6b42c189eb04ac37eeff6d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:16.429219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7528c528ac6b42c189eb04ac37eeff6d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:16.461595 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2967/5939] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:15 2022] DELETE /identity/v3/users/7528c528ac6b42c189eb04ac37eeff6d => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:16.467508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f28de-efcf-4ab2-b95b-4e05490fed76 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:16.468528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f28de-efcf-4ab2-b95b-4e05490fed76 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:16.469022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f28de-efcf-4ab2-b95b-4e05490fed76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:16.529208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-980f28de-efcf-4ab2-b95b-4e05490fed76 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:16.531639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-980f28de-efcf-4ab2-b95b-4e05490fed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:16.626349 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2973/5940] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:16.655370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:16.656965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:16.862915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca35a8-a9e7-46ae-a30b-a3b51e1d2896 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:16.868336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009873f-9bab-4871-9b2c-3ae955b3e31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:16.871588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009873f-9bab-4871-9b2c-3ae955b3e31f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:16.871956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009873f-9bab-4871-9b2c-3ae955b3e31f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:16.872239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009873f-9bab-4871-9b2c-3ae955b3e31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:16.886563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009873f-9bab-4871-9b2c-3ae955b3e31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:16.888739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009873f-9bab-4871-9b2c-3ae955b3e31f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:16.903447 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2968/5941] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:17.453999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f28de-efcf-4ab2-b95b-4e05490fed76 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:17.457538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-980f28de-efcf-4ab2-b95b-4e05490fed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:17.509519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f28de-efcf-4ab2-b95b-4e05490fed76 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:17.520022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:17.521443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:17.522045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:17.522547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] PATH_INFO: `/v3/users/aa239b9975bc46659dd8801fb1e0fa7f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:17.524658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa239b9975bc46659dd8801fb1e0fa7f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:17.528220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:17.605092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa239b9975bc46659dd8801fb1e0fa7f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:17.618793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa239b9975bc46659dd8801fb1e0fa7f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:17.619621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa239b9975bc46659dd8801fb1e0fa7f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:17.620386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa239b9975bc46659dd8801fb1e0fa7f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:17.645607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa239b9975bc46659dd8801fb1e0fa7f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:17.672917 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2974/5942] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:17 2022] DELETE /identity/v3/users/aa239b9975bc46659dd8801fb1e0fa7f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:17.675677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2c4bb-bab6-4b93-ae55-74874d71182d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:17.676147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2c4bb-bab6-4b93-ae55-74874d71182d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:17.676246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2c4bb-bab6-4b93-ae55-74874d71182d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:17.713962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-34b2c4bb-bab6-4b93-ae55-74874d71182d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:17.715410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-34b2c4bb-bab6-4b93-ae55-74874d71182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:17.810973 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2969/5943] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:17.831875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:17.837923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:17.850711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:17.946940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f05cb-2394-4898-9b22-76b83fc7482e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:17.954496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247408e-331d-46a9-96fb-79015b70fc71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:17.955785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247408e-331d-46a9-96fb-79015b70fc71 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:17.956064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247408e-331d-46a9-96fb-79015b70fc71 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:17.956345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247408e-331d-46a9-96fb-79015b70fc71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:17.968366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247408e-331d-46a9-96fb-79015b70fc71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:17.969954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247408e-331d-46a9-96fb-79015b70fc71 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:17.984614 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2975/5944] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:18.530306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2c4bb-bab6-4b93-ae55-74874d71182d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:18.532028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-34b2c4bb-bab6-4b93-ae55-74874d71182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:18.556485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2c4bb-bab6-4b93-ae55-74874d71182d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:18.561584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3efde0-da0c-4add-bac2-05967db01790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:18.562320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3efde0-da0c-4add-bac2-05967db01790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:18.562583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3efde0-da0c-4add-bac2-05967db01790 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:18.562916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3efde0-da0c-4add-bac2-05967db01790 admin admin] PATH_INFO: `/v3/projects/257d8893699c47eea348f25eaf2479d5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:18.564139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3efde0-da0c-4add-bac2-05967db01790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=257d8893699c47eea348f25eaf2479d5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:18.566820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3efde0-da0c-4add-bac2-05967db01790 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:18.663379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:18.666381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7d3efde0-da0c-4add-bac2-05967db01790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257d8893699c47eea348f25eaf2479d5', 'request_id': 'req-7d3efde0-da0c-4add-bac2-05967db01790'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:18.683704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7d3efde0-da0c-4add-bac2-05967db01790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257d8893699c47eea348f25eaf2479d5', 'request_id': 'req-7d3efde0-da0c-4add-bac2-05967db01790'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:18.693655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7d3efde0-da0c-4add-bac2-05967db01790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257d8893699c47eea348f25eaf2479d5', 'request_id': 'req-7d3efde0-da0c-4add-bac2-05967db01790'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:18.710922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247408e-331d-46a9-96fb-79015b70fc71 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:18.712322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7d3efde0-da0c-4add-bac2-05967db01790 admin admin] The token cache is being invalidate because project 257d8893699c47eea348f25eaf2479d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:18.712636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7d3efde0-da0c-4add-bac2-05967db01790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:18.713368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7d3efde0-da0c-4add-bac2-05967db01790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:18.714042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b247408e-331d-46a9-96fb-79015b70fc71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:18.715286 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2970/5945] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:18 2022] DELETE /identity/v3/projects/257d8893699c47eea348f25eaf2479d5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:18.719769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e4e56-363d-4435-9b45-43af06e7e7d0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:18.720233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e4e56-363d-4435-9b45-43af06e7e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:18.720630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e4e56-363d-4435-9b45-43af06e7e7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:18.746431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247408e-331d-46a9-96fb-79015b70fc71 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:18.750930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f45e4e56-363d-4435-9b45-43af06e7e7d0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:18.753218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f45e4e56-363d-4435-9b45-43af06e7e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:18.850863 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2971/5946] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:14:18.859678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d529884-4987-42e3-8273-ae4fd1658d78 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:18.860086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d529884-4987-42e3-8273-ae4fd1658d78 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:18.860935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d529884-4987-42e3-8273-ae4fd1658d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:18.892617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9d529884-4987-42e3-8273-ae4fd1658d78 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:18.895566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9d529884-4987-42e3-8273-ae4fd1658d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:18.898612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:18.899276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:18.899556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:18.899885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] PATH_INFO: `/v3/users/b6300eee278b4fad9561ebea03c2eeaa` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:18.901099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6300eee278b4fad9561ebea03c2eeaa)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:18.903074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:18.923130 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2972/5947] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:14:18.925354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d529884-4987-42e3-8273-ae4fd1658d78 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:18.938639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d529884-4987-42e3-8273-ae4fd1658d78 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:18.946466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe4490-7d64-406b-a1ec-63adb4074c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:18.947290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4490-7d64-406b-a1ec-63adb4074c29 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:18.947571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4490-7d64-406b-a1ec-63adb4074c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:18.947844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4490-7d64-406b-a1ec-63adb4074c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:18.949610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe4490-7d64-406b-a1ec-63adb4074c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:14:18.949929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe4490-7d64-406b-a1ec-63adb4074c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:18.959298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe4490-7d64-406b-a1ec-63adb4074c29 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:18.987668 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2973/5948] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:14:18.992113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe4490-7d64-406b-a1ec-63adb4074c29 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:19.012022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6300eee278b4fad9561ebea03c2eeaa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:19.022130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6300eee278b4fad9561ebea03c2eeaa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:19.022894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6300eee278b4fad9561ebea03c2eeaa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:19.024231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6300eee278b4fad9561ebea03c2eeaa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:19.030826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe4490-7d64-406b-a1ec-63adb4074c29 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:19.041163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f7df8-cefe-4399-beca-4e1ec571f165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:19.042710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f7df8-cefe-4399-beca-4e1ec571f165 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:19.043985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f7df8-cefe-4399-beca-4e1ec571f165 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:19.044986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f7df8-cefe-4399-beca-4e1ec571f165 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:19.045866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f7df8-cefe-4399-beca-4e1ec571f165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:19.049793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f7df8-cefe-4399-beca-4e1ec571f165 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:19.060114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6300eee278b4fad9561ebea03c2eeaa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:19.105234 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2976/5949] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:18 2022] DELETE /identity/v3/users/b6300eee278b4fad9561ebea03c2eeaa => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:14:19.125396 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2974/5950] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:18 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:19.126067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:19.128415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:19.208328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:19.345318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca2a4b-339c-477c-8847-8b22d6274e90 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:19.459503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839de961-ed26-49f8-ae75-474e00cbae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:19.462499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839de961-ed26-49f8-ae75-474e00cbae23 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:19.462499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839de961-ed26-49f8-ae75-474e00cbae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:19.462499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839de961-ed26-49f8-ae75-474e00cbae23 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:19.462499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839de961-ed26-49f8-ae75-474e00cbae23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:19.474579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839de961-ed26-49f8-ae75-474e00cbae23 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:19.522976 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2977/5951] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:19 2022] POST /identity/v3/users => generated 286 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:14:19.527134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f7df8-cefe-4399-beca-4e1ec571f165 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:19.538017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f7df8-cefe-4399-beca-4e1ec571f165 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:19.543364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd547d2-37e5-40bc-a2a5-6983894ac09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:19.543989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd547d2-37e5-40bc-a2a5-6983894ac09b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:19.544260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd547d2-37e5-40bc-a2a5-6983894ac09b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:19.545752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd547d2-37e5-40bc-a2a5-6983894ac09b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:19.545752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd547d2-37e5-40bc-a2a5-6983894ac09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:19.546969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd547d2-37e5-40bc-a2a5-6983894ac09b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:19.558366 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2975/5952] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:19.562435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839de961-ed26-49f8-ae75-474e00cbae23 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:19.574670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839de961-ed26-49f8-ae75-474e00cbae23 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:19.582294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60f8b1-8a7a-43d5-ad50-29b243577467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:19.582925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60f8b1-8a7a-43d5-ad50-29b243577467 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:19.583272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60f8b1-8a7a-43d5-ad50-29b243577467 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:19.583736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60f8b1-8a7a-43d5-ad50-29b243577467 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:19.584247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60f8b1-8a7a-43d5-ad50-29b243577467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:19.586949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60f8b1-8a7a-43d5-ad50-29b243577467 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:19.600629 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2978/5953] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:19.615479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd547d2-37e5-40bc-a2a5-6983894ac09b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:19.631799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd547d2-37e5-40bc-a2a5-6983894ac09b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:19.640566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c0639-12ef-47e5-8989-07ecaf1e19b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:19.641566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c0639-12ef-47e5-8989-07ecaf1e19b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:19.642091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c0639-12ef-47e5-8989-07ecaf1e19b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:19.643248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c0639-12ef-47e5-8989-07ecaf1e19b5 admin admin] PATH_INFO: `/v3/projects/37205dfda33f448c85cede3d7f19e3a1/users/cd3d8faf49eb4b41974db6a54d468edc/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:19.668832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c0639-12ef-47e5-8989-07ecaf1e19b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37205dfda33f448c85cede3d7f19e3a1, user_id=cd3d8faf49eb4b41974db6a54d468edc, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:19.670377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60f8b1-8a7a-43d5-ad50-29b243577467 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:19.672181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4e60f8b1-8a7a-43d5-ad50-29b243577467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:19.673960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c0639-12ef-47e5-8989-07ecaf1e19b5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:19.693420 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2976/5954] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:19 2022] PUT /identity/v3/projects/37205dfda33f448c85cede3d7f19e3a1/users/cd3d8faf49eb4b41974db6a54d468edc/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:19.696521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60f8b1-8a7a-43d5-ad50-29b243577467 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:19.703029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73ac4e-cf20-4597-8634-ec286d537c4f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:19.703349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73ac4e-cf20-4597-8634-ec286d537c4f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:19.703694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73ac4e-cf20-4597-8634-ec286d537c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:19.741316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9b73ac4e-cf20-4597-8634-ec286d537c4f None None] MFA Rules not processed for user `cd3d8faf49eb4b41974db6a54d468edc`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:19.742557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9b73ac4e-cf20-4597-8634-ec286d537c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:19.805530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:19.836877 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2977/5955] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:14:19.868992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73ac4e-cf20-4597-8634-ec286d537c4f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:19.870524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9b73ac4e-cf20-4597-8634-ec286d537c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:19.910811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e048a56-1224-4425-b8db-f04fb353bece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:19.911781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e048a56-1224-4425-b8db-f04fb353bece admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:19.912147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e048a56-1224-4425-b8db-f04fb353bece admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:19.912445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e048a56-1224-4425-b8db-f04fb353bece admin admin] PATH_INFO: `/v3/projects/560306a7b81d4470a01de0a4e2191308` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:19.914714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e048a56-1224-4425-b8db-f04fb353bece admin admin] RBAC: Authorizing `identity:delete_project(project_id=560306a7b81d4470a01de0a4e2191308)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:19.918234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e048a56-1224-4425-b8db-f04fb353bece admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:20.013474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6e048a56-1224-4425-b8db-f04fb353bece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560306a7b81d4470a01de0a4e2191308', 'request_id': 'req-6e048a56-1224-4425-b8db-f04fb353bece'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:20.019730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:20.029990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6e048a56-1224-4425-b8db-f04fb353bece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560306a7b81d4470a01de0a4e2191308', 'request_id': 'req-6e048a56-1224-4425-b8db-f04fb353bece'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:20.049570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73ac4e-cf20-4597-8634-ec286d537c4f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:20.054919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6e048a56-1224-4425-b8db-f04fb353bece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560306a7b81d4470a01de0a4e2191308', 'request_id': 'req-6e048a56-1224-4425-b8db-f04fb353bece'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:20.133755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6e048a56-1224-4425-b8db-f04fb353bece admin admin] The token cache is being invalidate because project 560306a7b81d4470a01de0a4e2191308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:20.135007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6e048a56-1224-4425-b8db-f04fb353bece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:20.138742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6e048a56-1224-4425-b8db-f04fb353bece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:20.149317 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2979/5956] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:19 2022] DELETE /identity/v3/projects/560306a7b81d4470a01de0a4e2191308 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:20.155049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d530af-4925-4401-b49e-ab8f848a447a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:20.156766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d530af-4925-4401-b49e-ab8f848a447a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:20.157068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d530af-4925-4401-b49e-ab8f848a447a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:20.234207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-30d530af-4925-4401-b49e-ab8f848a447a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:20.238458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-30d530af-4925-4401-b49e-ab8f848a447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:20.303728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955327c-2137-47e8-bb4d-15db6d38a57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:20.304595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955327c-2137-47e8-bb4d-15db6d38a57b service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:20.304989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955327c-2137-47e8-bb4d-15db6d38a57b service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:20.305308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955327c-2137-47e8-bb4d-15db6d38a57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:20.307971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f955327c-2137-47e8-bb4d-15db6d38a57b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:20.431356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955327c-2137-47e8-bb4d-15db6d38a57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:20.432913 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2980/5957] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:20.433971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d530af-4925-4401-b49e-ab8f848a447a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:20.436331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-30d530af-4925-4401-b49e-ab8f848a447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:20.437981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955327c-2137-47e8-bb4d-15db6d38a57b service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:20.456333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d530af-4925-4401-b49e-ab8f848a447a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:20.465927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0200dae-0047-441d-8a0c-ad4c92eb2607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:20.466831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0200dae-0047-441d-8a0c-ad4c92eb2607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:20.467254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0200dae-0047-441d-8a0c-ad4c92eb2607 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:20.467656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0200dae-0047-441d-8a0c-ad4c92eb2607 admin admin] PATH_INFO: `/v3/projects/38ddedd2c2754cdb8c60acf585f86f2a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:20.469285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0200dae-0047-441d-8a0c-ad4c92eb2607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38ddedd2c2754cdb8c60acf585f86f2a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:20.470198 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2978/5958] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:20.472555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a06d05-12c4-4ee7-8aec-4d1b826206c7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:20.472843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a06d05-12c4-4ee7-8aec-4d1b826206c7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:20.477690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a06d05-12c4-4ee7-8aec-4d1b826206c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:20.478086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0200dae-0047-441d-8a0c-ad4c92eb2607 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:20.540132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c0a06d05-12c4-4ee7-8aec-4d1b826206c7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:20.541724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c0a06d05-12c4-4ee7-8aec-4d1b826206c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:20.563946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e0200dae-0047-441d-8a0c-ad4c92eb2607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38ddedd2c2754cdb8c60acf585f86f2a', 'request_id': 'req-e0200dae-0047-441d-8a0c-ad4c92eb2607'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:20.582133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e0200dae-0047-441d-8a0c-ad4c92eb2607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38ddedd2c2754cdb8c60acf585f86f2a', 'request_id': 'req-e0200dae-0047-441d-8a0c-ad4c92eb2607'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:20.594525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e0200dae-0047-441d-8a0c-ad4c92eb2607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38ddedd2c2754cdb8c60acf585f86f2a', 'request_id': 'req-e0200dae-0047-441d-8a0c-ad4c92eb2607'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:20.632040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e0200dae-0047-441d-8a0c-ad4c92eb2607 admin admin] The token cache is being invalidate because project 38ddedd2c2754cdb8c60acf585f86f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:20.633977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e0200dae-0047-441d-8a0c-ad4c92eb2607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:20.636226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e0200dae-0047-441d-8a0c-ad4c92eb2607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:20.643687 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2981/5959] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:20 2022] DELETE /identity/v3/projects/38ddedd2c2754cdb8c60acf585f86f2a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:20.649511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaf1ba-d10a-4636-ab49-725f787a6e83 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:20.649799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaf1ba-d10a-4636-ab49-725f787a6e83 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:20.650077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaf1ba-d10a-4636-ab49-725f787a6e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:20.682086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:20.701965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6adaf1ba-d10a-4636-ab49-725f787a6e83 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:20.705651 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2979/5960] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:20.706509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6adaf1ba-d10a-4636-ab49-725f787a6e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:20.709476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a06d05-12c4-4ee7-8aec-4d1b826206c7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:20.730361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a06d05-12c4-4ee7-8aec-4d1b826206c7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:20.732391 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2982/5961] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:20.741779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04767e2-2b19-425a-a772-d46a373afa0d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:20.742064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04767e2-2b19-425a-a772-d46a373afa0d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:20.742366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04767e2-2b19-425a-a772-d46a373afa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:20.745630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e0eaf-722b-4256-8512-4d323ea07eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:20.746646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e0eaf-722b-4256-8512-4d323ea07eba admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:20.748800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e0eaf-722b-4256-8512-4d323ea07eba admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:20.749126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e0eaf-722b-4256-8512-4d323ea07eba admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:20.751582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e0eaf-722b-4256-8512-4d323ea07eba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:14:20.751962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e0eaf-722b-4256-8512-4d323ea07eba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:20.754930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e0eaf-722b-4256-8512-4d323ea07eba admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:20.794485 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2980/5962] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:14:20.794749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b04767e2-2b19-425a-a772-d46a373afa0d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:20.794749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b04767e2-2b19-425a-a772-d46a373afa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:20.797076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e0eaf-722b-4256-8512-4d323ea07eba admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:20.825358 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2983/5963] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:20.826357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e0eaf-722b-4256-8512-4d323ea07eba admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:20.829320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04767e2-2b19-425a-a772-d46a373afa0d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:20.840089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f44fc-b8c1-4b98-83b2-654050da67a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:20.843303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f44fc-b8c1-4b98-83b2-654050da67a2 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:20.845360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f44fc-b8c1-4b98-83b2-654050da67a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:20.846282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f44fc-b8c1-4b98-83b2-654050da67a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:20.848888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f44fc-b8c1-4b98-83b2-654050da67a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:20.854691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04767e2-2b19-425a-a772-d46a373afa0d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:20.856104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f44fc-b8c1-4b98-83b2-654050da67a2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:20.869260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47538e7-c2de-4876-b6ed-ac277ff9f22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:20.870427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47538e7-c2de-4876-b6ed-ac277ff9f22b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:20.870710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47538e7-c2de-4876-b6ed-ac277ff9f22b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:20.870987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47538e7-c2de-4876-b6ed-ac277ff9f22b admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:20.871658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47538e7-c2de-4876-b6ed-ac277ff9f22b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:14:20.871964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47538e7-c2de-4876-b6ed-ac277ff9f22b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:20.875415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47538e7-c2de-4876-b6ed-ac277ff9f22b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:20.909734 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2984/5964] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:14:20.922712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47538e7-c2de-4876-b6ed-ac277ff9f22b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:20.940184 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2981/5965] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:20 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:20.941986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f44fc-b8c1-4b98-83b2-654050da67a2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:20.953691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47538e7-c2de-4876-b6ed-ac277ff9f22b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:21.080524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:21.128820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed92a7-1b55-462b-aff9-fa963cd54c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:21.129703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed92a7-1b55-462b-aff9-fa963cd54c02 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:21.130901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed92a7-1b55-462b-aff9-fa963cd54c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:21.131714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed92a7-1b55-462b-aff9-fa963cd54c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:21.132991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed92a7-1b55-462b-aff9-fa963cd54c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:21.135536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed92a7-1b55-462b-aff9-fa963cd54c02 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:21.196288 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2985/5966] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:20 2022] POST /identity/v3/projects => generated 385 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:21.202485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed92a7-1b55-462b-aff9-fa963cd54c02 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:21.212859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f44fc-b8c1-4b98-83b2-654050da67a2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:21.379239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed92a7-1b55-462b-aff9-fa963cd54c02 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:21.390217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c11b53-0c76-41fc-9d5b-45a474e6efa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:21.390865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11b53-0c76-41fc-9d5b-45a474e6efa3 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:21.391145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11b53-0c76-41fc-9d5b-45a474e6efa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:21.391418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11b53-0c76-41fc-9d5b-45a474e6efa3 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:21.392052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c11b53-0c76-41fc-9d5b-45a474e6efa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:21.394046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c11b53-0c76-41fc-9d5b-45a474e6efa3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:21.402841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abbfb0-aae6-4771-ab50-891788a802ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:21.403486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abbfb0-aae6-4771-ab50-891788a802ae admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:21.403768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abbfb0-aae6-4771-ab50-891788a802ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:21.404233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abbfb0-aae6-4771-ab50-891788a802ae admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:21.407846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abbfb0-aae6-4771-ab50-891788a802ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:21.409802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abbfb0-aae6-4771-ab50-891788a802ae admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:21.462135 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2982/5967] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:20 2022] POST /identity/v3/users => generated 288 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:21.463348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c11b53-0c76-41fc-9d5b-45a474e6efa3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:21.468034 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2986/5968] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:21 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:21.471823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abbfb0-aae6-4771-ab50-891788a802ae admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:21.490117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c11b53-0c76-41fc-9d5b-45a474e6efa3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:21.496637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abbfb0-aae6-4771-ab50-891788a802ae admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:21.502846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6874bb-6c00-446c-b70d-1dc6cb1604f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:21.503475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6874bb-6c00-446c-b70d-1dc6cb1604f9 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:21.503755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6874bb-6c00-446c-b70d-1dc6cb1604f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:21.504029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6874bb-6c00-446c-b70d-1dc6cb1604f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:21.505332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6874bb-6c00-446c-b70d-1dc6cb1604f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:21.506992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6874bb-6c00-446c-b70d-1dc6cb1604f9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:21.510345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a5f54-d05e-424d-b580-d58ea86be31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:21.511124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a5f54-d05e-424d-b580-d58ea86be31b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:21.511368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a5f54-d05e-424d-b580-d58ea86be31b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:21.511709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a5f54-d05e-424d-b580-d58ea86be31b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:21.512272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a5f54-d05e-424d-b580-d58ea86be31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:21.513917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a5f54-d05e-424d-b580-d58ea86be31b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:21.535897 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2983/5969] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:21.536917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6874bb-6c00-446c-b70d-1dc6cb1604f9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:21.546286 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2987/5970] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:21.547761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a5f54-d05e-424d-b580-d58ea86be31b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:21.561460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6874bb-6c00-446c-b70d-1dc6cb1604f9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:21.564450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a5f54-d05e-424d-b580-d58ea86be31b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:21.581103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcd6cf-7533-4c9c-bb0a-420d3d63bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:21.581103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcd6cf-7533-4c9c-bb0a-420d3d63bcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:21.581103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcd6cf-7533-4c9c-bb0a-420d3d63bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:21.581103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcd6cf-7533-4c9c-bb0a-420d3d63bcf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:21.581770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcd6cf-7533-4c9c-bb0a-420d3d63bcf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:21.583486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcd6cf-7533-4c9c-bb0a-420d3d63bcf9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:21.586313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99187-74a4-4f6a-8b24-63f74c3a31ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:21.586944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99187-74a4-4f6a-8b24-63f74c3a31ac admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:21.587223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99187-74a4-4f6a-8b24-63f74c3a31ac admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:21.587493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99187-74a4-4f6a-8b24-63f74c3a31ac admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:21.588140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a99187-74a4-4f6a-8b24-63f74c3a31ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:21.589767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a99187-74a4-4f6a-8b24-63f74c3a31ac admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:21.608457 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2984/5971] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:21.614332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcd6cf-7533-4c9c-bb0a-420d3d63bcf9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:21.620183 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2988/5972] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:21.622100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99187-74a4-4f6a-8b24-63f74c3a31ac admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:21.647884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcd6cf-7533-4c9c-bb0a-420d3d63bcf9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:21.650792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99187-74a4-4f6a-8b24-63f74c3a31ac admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:21.653884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557621b7-941f-48f4-a8fe-2fa39478cbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:21.654704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557621b7-941f-48f4-a8fe-2fa39478cbd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:21.655091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557621b7-941f-48f4-a8fe-2fa39478cbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:21.655468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557621b7-941f-48f4-a8fe-2fa39478cbd2 admin admin] PATH_INFO: `/v3/projects/7a71b28a90e8417e965f79ff54d93365/users/512c04944a214073b424b8fee847887d/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:21.669007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2a562-a2a8-481d-b0c3-8bccbc5a8d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:21.671067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2a562-a2a8-481d-b0c3-8bccbc5a8d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:21.672515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2a562-a2a8-481d-b0c3-8bccbc5a8d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:21.673023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2a562-a2a8-481d-b0c3-8bccbc5a8d82 admin admin] PATH_INFO: `/v3/projects/f6ec9f1206bf4ee3bd5cf3793deea0d0/users/4553a445c3504769af44c91a30346aab/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:21.690743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557621b7-941f-48f4-a8fe-2fa39478cbd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a71b28a90e8417e965f79ff54d93365, user_id=512c04944a214073b424b8fee847887d, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:21.693994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557621b7-941f-48f4-a8fe-2fa39478cbd2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:21.724090 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2985/5973] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:21 2022] PUT /identity/v3/projects/7a71b28a90e8417e965f79ff54d93365/users/512c04944a214073b424b8fee847887d/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:21.737517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b7af4-3427-41d3-a79c-6c545c8ee964 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:21.738274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b7af4-3427-41d3-a79c-6c545c8ee964 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:21.738666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b7af4-3427-41d3-a79c-6c545c8ee964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:21.745698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2a562-a2a8-481d-b0c3-8bccbc5a8d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ec9f1206bf4ee3bd5cf3793deea0d0, user_id=4553a445c3504769af44c91a30346aab, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:21.762711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2a562-a2a8-481d-b0c3-8bccbc5a8d82 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:21.787051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-df7b7af4-3427-41d3-a79c-6c545c8ee964 None None] MFA Rules not processed for user `512c04944a214073b424b8fee847887d`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:21.788428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-df7b7af4-3427-41d3-a79c-6c545c8ee964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:21.788778 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2989/5974] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:21 2022] PUT /identity/v3/projects/f6ec9f1206bf4ee3bd5cf3793deea0d0/users/4553a445c3504769af44c91a30346aab/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:21.797396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b91aeb-1364-42ed-afc7-e4a6d2d9d600 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:21.798043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b91aeb-1364-42ed-afc7-e4a6d2d9d600 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:21.798482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b91aeb-1364-42ed-afc7-e4a6d2d9d600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:21.799351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:21.851206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-04b91aeb-1364-42ed-afc7-e4a6d2d9d600 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:21.852330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-04b91aeb-1364-42ed-afc7-e4a6d2d9d600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:21.952111 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2986/5975] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:21.967775 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2990/5976] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:21.978165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b7af4-3427-41d3-a79c-6c545c8ee964 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:21.979726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-df7b7af4-3427-41d3-a79c-6c545c8ee964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:22.038568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b91aeb-1364-42ed-afc7-e4a6d2d9d600 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:22.040069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-04b91aeb-1364-42ed-afc7-e4a6d2d9d600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:22.061125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:22.062169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b7af4-3427-41d3-a79c-6c545c8ee964 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:22.068266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2ca43-afd4-47ef-b0cc-8c7da97df583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:22.069329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ca43-afd4-47ef-b0cc-8c7da97df583 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:22.070009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ca43-afd4-47ef-b0cc-8c7da97df583 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:22.070715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ca43-afd4-47ef-b0cc-8c7da97df583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:22.082690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2ca43-afd4-47ef-b0cc-8c7da97df583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:22.084513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2ca43-afd4-47ef-b0cc-8c7da97df583 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:22.102099 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2987/5977] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:22.161645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b91aeb-1364-42ed-afc7-e4a6d2d9d600 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:22.166458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968ab32-256a-48a2-91b0-fec26cd711ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:22.167213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968ab32-256a-48a2-91b0-fec26cd711ea service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:22.167599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968ab32-256a-48a2-91b0-fec26cd711ea service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:22.168032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968ab32-256a-48a2-91b0-fec26cd711ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:22.195750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968ab32-256a-48a2-91b0-fec26cd711ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:22.198167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968ab32-256a-48a2-91b0-fec26cd711ea service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:22.218237 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2991/5978] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:14:23.678472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9425158-65cc-4909-be51-49b2c2316596 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:23.679600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9425158-65cc-4909-be51-49b2c2316596 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:23.679600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9425158-65cc-4909-be51-49b2c2316596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:23.754102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f9425158-65cc-4909-be51-49b2c2316596 None None] MFA Rules not processed for user `4553a445c3504769af44c91a30346aab`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:23.755492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f9425158-65cc-4909-be51-49b2c2316596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:23.883963 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2988/5979] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:23.899629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe3d78-7a06-48d0-a422-734cf2dbf0e7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:23.900437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe3d78-7a06-48d0-a422-734cf2dbf0e7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:23.900754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe3d78-7a06-48d0-a422-734cf2dbf0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:23.928271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2cfe3d78-7a06-48d0-a422-734cf2dbf0e7 None None] MFA Rules not processed for user `4553a445c3504769af44c91a30346aab`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:23.942803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2cfe3d78-7a06-48d0-a422-734cf2dbf0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:23.957220 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2992/5980] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:14:23.964795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9425158-65cc-4909-be51-49b2c2316596 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:23.967350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f9425158-65cc-4909-be51-49b2c2316596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:24.054850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:24.119563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9425158-65cc-4909-be51-49b2c2316596 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:24.137722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82241c28-490f-4309-8eb1-a2075214c6a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:24.138372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82241c28-490f-4309-8eb1-a2075214c6a2 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:24.138651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82241c28-490f-4309-8eb1-a2075214c6a2 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:24.138925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82241c28-490f-4309-8eb1-a2075214c6a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:24.149263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82241c28-490f-4309-8eb1-a2075214c6a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:24.151045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82241c28-490f-4309-8eb1-a2075214c6a2 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:24.163815 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2989/5981] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:26.595352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe3d78-7a06-48d0-a422-734cf2dbf0e7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:26.613904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe3d78-7a06-48d0-a422-734cf2dbf0e7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:26.629823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e2948-a278-44c1-b270-4bbed8dc2e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:26.632655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e2948-a278-44c1-b270-4bbed8dc2e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:26.633003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e2948-a278-44c1-b270-4bbed8dc2e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:26.633718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e2948-a278-44c1-b270-4bbed8dc2e84 admin admin] PATH_INFO: `/v3/users/4553a445c3504769af44c91a30346aab` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:26.637328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e2948-a278-44c1-b270-4bbed8dc2e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4553a445c3504769af44c91a30346aab)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:26.641646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e2948-a278-44c1-b270-4bbed8dc2e84 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:26.751457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-624e2948-a278-44c1-b270-4bbed8dc2e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4553a445c3504769af44c91a30346aab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:26.763429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-624e2948-a278-44c1-b270-4bbed8dc2e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4553a445c3504769af44c91a30346aab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:26.764215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-624e2948-a278-44c1-b270-4bbed8dc2e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4553a445c3504769af44c91a30346aab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:26.764860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-624e2948-a278-44c1-b270-4bbed8dc2e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4553a445c3504769af44c91a30346aab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:26.793013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-624e2948-a278-44c1-b270-4bbed8dc2e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4553a445c3504769af44c91a30346aab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:26.825153 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2993/5982] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:26 2022] DELETE /identity/v3/users/4553a445c3504769af44c91a30346aab => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:27.911326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82241c28-490f-4309-8eb1-a2075214c6a2 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:27.934022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82241c28-490f-4309-8eb1-a2075214c6a2 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:28.026473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccc606-4476-40f8-bdc6-2465d791b817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:28.027932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccc606-4476-40f8-bdc6-2465d791b817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:28.028762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccc606-4476-40f8-bdc6-2465d791b817 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:28.029238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccc606-4476-40f8-bdc6-2465d791b817 admin admin] PATH_INFO: `/v3/projects/f6ec9f1206bf4ee3bd5cf3793deea0d0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:28.030741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccc606-4476-40f8-bdc6-2465d791b817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ec9f1206bf4ee3bd5cf3793deea0d0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:28.033418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccc606-4476-40f8-bdc6-2465d791b817 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:28.133534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0ccc606-4476-40f8-bdc6-2465d791b817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ec9f1206bf4ee3bd5cf3793deea0d0', 'request_id': 'req-e0ccc606-4476-40f8-bdc6-2465d791b817'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:28.156850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0ccc606-4476-40f8-bdc6-2465d791b817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ec9f1206bf4ee3bd5cf3793deea0d0', 'request_id': 'req-e0ccc606-4476-40f8-bdc6-2465d791b817'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:28.172640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0ccc606-4476-40f8-bdc6-2465d791b817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ec9f1206bf4ee3bd5cf3793deea0d0', 'request_id': 'req-e0ccc606-4476-40f8-bdc6-2465d791b817'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:28.195255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0ccc606-4476-40f8-bdc6-2465d791b817 admin admin] The token cache is being invalidate because project f6ec9f1206bf4ee3bd5cf3793deea0d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:28.195668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0ccc606-4476-40f8-bdc6-2465d791b817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:28.196459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e0ccc606-4476-40f8-bdc6-2465d791b817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:28.198859 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2990/5983] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:27 2022] DELETE /identity/v3/projects/f6ec9f1206bf4ee3bd5cf3793deea0d0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:28.203936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e900f-628d-4673-aa6a-66dedd3b3f96 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:28.204456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e900f-628d-4673-aa6a-66dedd3b3f96 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:28.204594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e900f-628d-4673-aa6a-66dedd3b3f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:28.252690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-dd6e900f-628d-4673-aa6a-66dedd3b3f96 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:28.254004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dd6e900f-628d-4673-aa6a-66dedd3b3f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:28.390239 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2994/5984] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:28.393309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fdfee-cc01-4f15-b190-33954bdadaae None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:28.393309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fdfee-cc01-4f15-b190-33954bdadaae None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:28.394133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fdfee-cc01-4f15-b190-33954bdadaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:28.445850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ec5fdfee-cc01-4f15-b190-33954bdadaae None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:28.448216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ec5fdfee-cc01-4f15-b190-33954bdadaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:28.467320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e900f-628d-4673-aa6a-66dedd3b3f96 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:28.483434 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2991/5985] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:14:28.502564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e900f-628d-4673-aa6a-66dedd3b3f96 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:28.508390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e95557-16d8-4845-84bf-a50521ecaf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:28.509392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e95557-16d8-4845-84bf-a50521ecaf21 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:28.509957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e95557-16d8-4845-84bf-a50521ecaf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:28.510453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e95557-16d8-4845-84bf-a50521ecaf21 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:28.511359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e95557-16d8-4845-84bf-a50521ecaf21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:14:28.511868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e95557-16d8-4845-84bf-a50521ecaf21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:28.513912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e95557-16d8-4845-84bf-a50521ecaf21 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:28.535347 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2995/5986] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:14:28.537776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fdfee-cc01-4f15-b190-33954bdadaae None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:28.554377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fdfee-cc01-4f15-b190-33954bdadaae None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:28.561224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c3a2-5401-4164-aae8-7c4b68800fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:28.561840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c3a2-5401-4164-aae8-7c4b68800fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:28.562162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c3a2-5401-4164-aae8-7c4b68800fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:28.562438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c3a2-5401-4164-aae8-7c4b68800fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:28.563073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03c3a2-5401-4164-aae8-7c4b68800fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:28.565243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03c3a2-5401-4164-aae8-7c4b68800fc3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:28.626546 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2992/5987] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:28 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:28.628700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e95557-16d8-4845-84bf-a50521ecaf21 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:28.634372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:28.640579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e95557-16d8-4845-84bf-a50521ecaf21 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:28.726293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262819a-9671-4da8-958d-dacff8291d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:28.726970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262819a-9671-4da8-958d-dacff8291d36 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:28.727934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262819a-9671-4da8-958d-dacff8291d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:28.728391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262819a-9671-4da8-958d-dacff8291d36 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:28.729541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262819a-9671-4da8-958d-dacff8291d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:28.731859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262819a-9671-4da8-958d-dacff8291d36 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:28.787239 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2996/5988] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:28 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:28.791163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c3a2-5401-4164-aae8-7c4b68800fc3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:28.808265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c3a2-5401-4164-aae8-7c4b68800fc3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:28.824756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8547d3-6400-4f7d-a7e9-9200c2a38fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:28.825692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8547d3-6400-4f7d-a7e9-9200c2a38fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:28.826096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8547d3-6400-4f7d-a7e9-9200c2a38fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:28.826474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8547d3-6400-4f7d-a7e9-9200c2a38fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:28.830455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8547d3-6400-4f7d-a7e9-9200c2a38fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:28.832203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8547d3-6400-4f7d-a7e9-9200c2a38fa8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:28.856890 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2993/5989] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:28.860710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262819a-9671-4da8-958d-dacff8291d36 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:28.888154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262819a-9671-4da8-958d-dacff8291d36 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:28.904194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2beb8-80e6-4f1c-bde6-52935ab15b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:28.905888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2beb8-80e6-4f1c-bde6-52935ab15b08 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:28.906372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2beb8-80e6-4f1c-bde6-52935ab15b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:28.907089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2beb8-80e6-4f1c-bde6-52935ab15b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:28.908789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2beb8-80e6-4f1c-bde6-52935ab15b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:28.912913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2beb8-80e6-4f1c-bde6-52935ab15b08 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:28.931410 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2997/5990] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:28.935653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8547d3-6400-4f7d-a7e9-9200c2a38fa8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:28.951549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8547d3-6400-4f7d-a7e9-9200c2a38fa8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:28.958963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df8431-6121-4849-b0ad-b68a56a46a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:28.960081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df8431-6121-4849-b0ad-b68a56a46a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:28.960478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df8431-6121-4849-b0ad-b68a56a46a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:28.960942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df8431-6121-4849-b0ad-b68a56a46a28 admin admin] PATH_INFO: `/v3/projects/3d9d29b90ab34abbadd21edbca637d2e/users/8957041987c8487099f0d89f4c64af66/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:28.980882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:28.992581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df8431-6121-4849-b0ad-b68a56a46a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9d29b90ab34abbadd21edbca637d2e, user_id=8957041987c8487099f0d89f4c64af66, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:29.002779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df8431-6121-4849-b0ad-b68a56a46a28 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:29.043758 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2994/5991] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:28 2022] PUT /identity/v3/projects/3d9d29b90ab34abbadd21edbca637d2e/users/8957041987c8487099f0d89f4c64af66/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:14:29.049586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd265c3-3eea-46bf-9df4-8e6ae4f83c18 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:29.049944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd265c3-3eea-46bf-9df4-8e6ae4f83c18 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:29.050141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd265c3-3eea-46bf-9df4-8e6ae4f83c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:29.089281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-edd265c3-3eea-46bf-9df4-8e6ae4f83c18 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:29.090536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-edd265c3-3eea-46bf-9df4-8e6ae4f83c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:29.423381 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2998/5992] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:14:29.447114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df8431-6121-4849-b0ad-b68a56a46a28 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:29.449457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a8df8431-6121-4849-b0ad-b68a56a46a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:29.574100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df8431-6121-4849-b0ad-b68a56a46a28 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:29.579216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd09a3-065c-437a-9e5a-46ad5836b621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:29.580122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd09a3-065c-437a-9e5a-46ad5836b621 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:29.580587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd09a3-065c-437a-9e5a-46ad5836b621 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:29.581131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd09a3-065c-437a-9e5a-46ad5836b621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:29.620712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd09a3-065c-437a-9e5a-46ad5836b621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:29.622191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd09a3-065c-437a-9e5a-46ad5836b621 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:29.651468 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2995/5993] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:29.986039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd265c3-3eea-46bf-9df4-8e6ae4f83c18 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:29.988320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-edd265c3-3eea-46bf-9df4-8e6ae4f83c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:30.000799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd265c3-3eea-46bf-9df4-8e6ae4f83c18 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:30.006958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:30.008004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:30.008819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:30.009466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] PATH_INFO: `/v3/users/0a6b3f4cefa94e269186f9d9e5aff559` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:30.010914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6b3f4cefa94e269186f9d9e5aff559)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:30.013331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:30.078621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6b3f4cefa94e269186f9d9e5aff559'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:30.091748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6b3f4cefa94e269186f9d9e5aff559'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:30.091748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6b3f4cefa94e269186f9d9e5aff559'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:30.091748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6b3f4cefa94e269186f9d9e5aff559'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:30.105902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6b3f4cefa94e269186f9d9e5aff559'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:30.108566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:30.135213 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 2999/5994] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:29 2022] DELETE /identity/v3/users/0a6b3f4cefa94e269186f9d9e5aff559 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:31.103387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd09a3-065c-437a-9e5a-46ad5836b621 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:31.137726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd09a3-065c-437a-9e5a-46ad5836b621 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:31.417365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:31.418812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:31.419332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:31.420856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] PATH_INFO: `/v3/projects/195ea87b43684ed59b1b1c048b0584b3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:31.425704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=195ea87b43684ed59b1b1c048b0584b3)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:31.429522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:31.596923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195ea87b43684ed59b1b1c048b0584b3', 'request_id': 'req-2c633965-3ef4-4c6e-8f60-063dccb706e8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:31.613254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195ea87b43684ed59b1b1c048b0584b3', 'request_id': 'req-2c633965-3ef4-4c6e-8f60-063dccb706e8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:31.628376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195ea87b43684ed59b1b1c048b0584b3', 'request_id': 'req-2c633965-3ef4-4c6e-8f60-063dccb706e8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:31.651373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] The token cache is being invalidate because project 195ea87b43684ed59b1b1c048b0584b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:31.651935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:31.653344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:31.656262 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2996/5995] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:31 2022] DELETE /identity/v3/projects/195ea87b43684ed59b1b1c048b0584b3 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:31.660468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:31.662504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:31.685660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e627876-1f22-4670-81e5-a320a363fc72 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:31.792421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8c6df-268b-4d5c-b898-5f4e752b55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:31.797099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8c6df-268b-4d5c-b898-5f4e752b55fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:31.797810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8c6df-268b-4d5c-b898-5f4e752b55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:31.798309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8c6df-268b-4d5c-b898-5f4e752b55fb admin admin] PATH_INFO: `/v3/users/6aef5df0d6004b968d4280a94e1847da` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:31.801043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8c6df-268b-4d5c-b898-5f4e752b55fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aef5df0d6004b968d4280a94e1847da)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:31.804194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8c6df-268b-4d5c-b898-5f4e752b55fb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:31.876384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ce8c6df-268b-4d5c-b898-5f4e752b55fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aef5df0d6004b968d4280a94e1847da'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:31.887056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ce8c6df-268b-4d5c-b898-5f4e752b55fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aef5df0d6004b968d4280a94e1847da'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:31.887854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ce8c6df-268b-4d5c-b898-5f4e752b55fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aef5df0d6004b968d4280a94e1847da'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:31.888551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ce8c6df-268b-4d5c-b898-5f4e752b55fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aef5df0d6004b968d4280a94e1847da'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:31.906956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ce8c6df-268b-4d5c-b898-5f4e752b55fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aef5df0d6004b968d4280a94e1847da'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:31.953549 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3000/5996] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:31 2022] DELETE /identity/v3/users/6aef5df0d6004b968d4280a94e1847da => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:32.717453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:32.719543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:32.741300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c633965-3ef4-4c6e-8f60-063dccb706e8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:32.787809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:32.882128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d1ae0-9388-4ff6-834f-795adb188a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:32.883190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d1ae0-9388-4ff6-834f-795adb188a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:32.883938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d1ae0-9388-4ff6-834f-795adb188a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:32.884578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d1ae0-9388-4ff6-834f-795adb188a23 admin admin] PATH_INFO: `/v3/projects/0a006f4c3b3647d6989274bbdfad0049` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:32.887543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d1ae0-9388-4ff6-834f-795adb188a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a006f4c3b3647d6989274bbdfad0049)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:32.889715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d1ae0-9388-4ff6-834f-795adb188a23 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:33.025314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cf6d1ae0-9388-4ff6-834f-795adb188a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a006f4c3b3647d6989274bbdfad0049', 'request_id': 'req-cf6d1ae0-9388-4ff6-834f-795adb188a23'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:33.112865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cf6d1ae0-9388-4ff6-834f-795adb188a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a006f4c3b3647d6989274bbdfad0049', 'request_id': 'req-cf6d1ae0-9388-4ff6-834f-795adb188a23'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:33.126262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cf6d1ae0-9388-4ff6-834f-795adb188a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a006f4c3b3647d6989274bbdfad0049', 'request_id': 'req-cf6d1ae0-9388-4ff6-834f-795adb188a23'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:33.149270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cf6d1ae0-9388-4ff6-834f-795adb188a23 admin admin] The token cache is being invalidate because project 0a006f4c3b3647d6989274bbdfad0049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:33.149953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cf6d1ae0-9388-4ff6-834f-795adb188a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:33.150933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cf6d1ae0-9388-4ff6-834f-795adb188a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:33.153001 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2997/5997] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:32 2022] DELETE /identity/v3/projects/0a006f4c3b3647d6989274bbdfad0049 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:33.157960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a438-88eb-4074-8cfc-d0fc2e202d09 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:33.158498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a438-88eb-4074-8cfc-d0fc2e202d09 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:33.158498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a438-88eb-4074-8cfc-d0fc2e202d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:33.199101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-14f6a438-88eb-4074-8cfc-d0fc2e202d09 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:33.200331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-14f6a438-88eb-4074-8cfc-d0fc2e202d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:33.297508 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3001/5998] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:33.306787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7787ce9-8ca2-4b6f-8398-ea3ad4998091 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:33.307179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7787ce9-8ca2-4b6f-8398-ea3ad4998091 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:33.307363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7787ce9-8ca2-4b6f-8398-ea3ad4998091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:33.349442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f7787ce9-8ca2-4b6f-8398-ea3ad4998091 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:33.351083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f7787ce9-8ca2-4b6f-8398-ea3ad4998091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:33.381057 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2998/5999] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:14:33.385355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6a438-88eb-4074-8cfc-d0fc2e202d09 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:33.402505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6a438-88eb-4074-8cfc-d0fc2e202d09 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:33.424498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190c6cf-e3be-415b-8ace-6d3176f6f4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:33.427185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190c6cf-e3be-415b-8ace-6d3176f6f4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:33.427712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190c6cf-e3be-415b-8ace-6d3176f6f4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:33.428216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190c6cf-e3be-415b-8ace-6d3176f6f4c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:33.429111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190c6cf-e3be-415b-8ace-6d3176f6f4c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:14:33.429971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190c6cf-e3be-415b-8ace-6d3176f6f4c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:33.431802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190c6cf-e3be-415b-8ace-6d3176f6f4c4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:33.448084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:33.463048 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3002/6000] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:14:33.467525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7787ce9-8ca2-4b6f-8398-ea3ad4998091 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:33.488265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7787ce9-8ca2-4b6f-8398-ea3ad4998091 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:33.502879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4f1b-0106-419a-8265-cc4de46cb0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:33.505614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4f1b-0106-419a-8265-cc4de46cb0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:33.507257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4f1b-0106-419a-8265-cc4de46cb0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:33.507556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4f1b-0106-419a-8265-cc4de46cb0b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:33.508407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d4f1b-0106-419a-8265-cc4de46cb0b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:33.518317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d4f1b-0106-419a-8265-cc4de46cb0b2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:33.572934 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 2999/6001] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:33 2022] POST /identity/v3/projects => generated 361 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:33.574098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190c6cf-e3be-415b-8ace-6d3176f6f4c4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:33.589619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190c6cf-e3be-415b-8ace-6d3176f6f4c4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:33.678759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fd0cf-740f-42b1-aec6-c80823685994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:33.679818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fd0cf-740f-42b1-aec6-c80823685994 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:33.680444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fd0cf-740f-42b1-aec6-c80823685994 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:33.680952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fd0cf-740f-42b1-aec6-c80823685994 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:33.681815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fd0cf-740f-42b1-aec6-c80823685994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:33.684358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fd0cf-740f-42b1-aec6-c80823685994 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:33.739401 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3003/6002] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:33 2022] POST /identity/v3/users => generated 281 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:33.741097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4f1b-0106-419a-8265-cc4de46cb0b2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:33.763866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4f1b-0106-419a-8265-cc4de46cb0b2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:33.776932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2b57-84da-4369-9de9-cebbcd4c0817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:33.780060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2b57-84da-4369-9de9-cebbcd4c0817 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:33.780352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2b57-84da-4369-9de9-cebbcd4c0817 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:33.780971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2b57-84da-4369-9de9-cebbcd4c0817 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:33.784017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c2b57-84da-4369-9de9-cebbcd4c0817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:33.789050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c2b57-84da-4369-9de9-cebbcd4c0817 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:33.815298 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3000/6003] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:33.819875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fd0cf-740f-42b1-aec6-c80823685994 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:33.843877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fd0cf-740f-42b1-aec6-c80823685994 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:33.857576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2eea6-e5da-434d-b5fe-a5fdc125eb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:33.858261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2eea6-e5da-434d-b5fe-a5fdc125eb97 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:33.858544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2eea6-e5da-434d-b5fe-a5fdc125eb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:33.858817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2eea6-e5da-434d-b5fe-a5fdc125eb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:33.859468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2eea6-e5da-434d-b5fe-a5fdc125eb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:33.861088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2eea6-e5da-434d-b5fe-a5fdc125eb97 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:33.904878 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3004/6004] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:33.906633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2b57-84da-4369-9de9-cebbcd4c0817 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:33.921644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2b57-84da-4369-9de9-cebbcd4c0817 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:33.927690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245443b-256e-4282-86f6-c6464c47bece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:33.928442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245443b-256e-4282-86f6-c6464c47bece admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:33.928724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245443b-256e-4282-86f6-c6464c47bece admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:33.929565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245443b-256e-4282-86f6-c6464c47bece admin admin] PATH_INFO: `/v3/projects/78f1da8b90f649c5914d2ce30625c86b/users/7af28df81b5d4a529cfd35e2c8735ba0/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:33.953941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245443b-256e-4282-86f6-c6464c47bece admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f1da8b90f649c5914d2ce30625c86b, user_id=7af28df81b5d4a529cfd35e2c8735ba0, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:33.957922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245443b-256e-4282-86f6-c6464c47bece admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:33.992307 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3001/6005] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:33 2022] PUT /identity/v3/projects/78f1da8b90f649c5914d2ce30625c86b/users/7af28df81b5d4a529cfd35e2c8735ba0/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:34.004114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc613c-3180-4f77-8c85-38fb03932e4e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:34.004423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc613c-3180-4f77-8c85-38fb03932e4e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:34.004877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc613c-3180-4f77-8c85-38fb03932e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:34.082515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cffc613c-3180-4f77-8c85-38fb03932e4e None None] MFA Rules not processed for user `7af28df81b5d4a529cfd35e2c8735ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:34.083775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cffc613c-3180-4f77-8c85-38fb03932e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:34.231832 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3005/6006] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:34.298091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245443b-256e-4282-86f6-c6464c47bece admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:34.393174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:34.435420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245443b-256e-4282-86f6-c6464c47bece admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:34.444185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:34.445007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:34.445331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:34.445640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] PATH_INFO: `/v3/users/7af28df81b5d4a529cfd35e2c8735ba0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:34.464442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af28df81b5d4a529cfd35e2c8735ba0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:34.470131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:34.621175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af28df81b5d4a529cfd35e2c8735ba0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:34.637954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af28df81b5d4a529cfd35e2c8735ba0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:34.638496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af28df81b5d4a529cfd35e2c8735ba0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:34.646576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af28df81b5d4a529cfd35e2c8735ba0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:34.671752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af28df81b5d4a529cfd35e2c8735ba0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:34.700064 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3002/6007] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:34 2022] DELETE /identity/v3/users/7af28df81b5d4a529cfd35e2c8735ba0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:34.701866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3752ae-428a-48cc-b649-b83f9822673d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:34.702264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3752ae-428a-48cc-b649-b83f9822673d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:34.702653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3752ae-428a-48cc-b649-b83f9822673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:34.740040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1f3752ae-428a-48cc-b649-b83f9822673d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:34.741420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1f3752ae-428a-48cc-b649-b83f9822673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:34.889418 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3006/6008] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:35.349779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:35.352195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:35.470035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86831815-125d-472a-83a5-499ca7050559 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:35.476377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80252af5-abf6-4879-8f95-d19148c8c02a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:35.477457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80252af5-abf6-4879-8f95-d19148c8c02a service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:35.477907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80252af5-abf6-4879-8f95-d19148c8c02a service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:35.478383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80252af5-abf6-4879-8f95-d19148c8c02a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:35.497221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80252af5-abf6-4879-8f95-d19148c8c02a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:35.500881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80252af5-abf6-4879-8f95-d19148c8c02a service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:35.534062 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3003/6009] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:37.467439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3752ae-428a-48cc-b649-b83f9822673d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:37.468892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1f3752ae-428a-48cc-b649-b83f9822673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:37.509338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3752ae-428a-48cc-b649-b83f9822673d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:37.529389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04ef42-247c-4626-97c1-7f162cadbc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:37.533398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04ef42-247c-4626-97c1-7f162cadbc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:37.534006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04ef42-247c-4626-97c1-7f162cadbc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:37.534554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04ef42-247c-4626-97c1-7f162cadbc44 admin admin] PATH_INFO: `/v3/projects/78f1da8b90f649c5914d2ce30625c86b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:37.536451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04ef42-247c-4626-97c1-7f162cadbc44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f1da8b90f649c5914d2ce30625c86b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:37.539159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04ef42-247c-4626-97c1-7f162cadbc44 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:37.551615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:37.664165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff04ef42-247c-4626-97c1-7f162cadbc44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f1da8b90f649c5914d2ce30625c86b', 'request_id': 'req-ff04ef42-247c-4626-97c1-7f162cadbc44'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:37.691227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff04ef42-247c-4626-97c1-7f162cadbc44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f1da8b90f649c5914d2ce30625c86b', 'request_id': 'req-ff04ef42-247c-4626-97c1-7f162cadbc44'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:37.706489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff04ef42-247c-4626-97c1-7f162cadbc44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f1da8b90f649c5914d2ce30625c86b', 'request_id': 'req-ff04ef42-247c-4626-97c1-7f162cadbc44'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:37.737347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff04ef42-247c-4626-97c1-7f162cadbc44 admin admin] The token cache is being invalidate because project 78f1da8b90f649c5914d2ce30625c86b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:37.737923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff04ef42-247c-4626-97c1-7f162cadbc44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:37.739808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff04ef42-247c-4626-97c1-7f162cadbc44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:37.751255 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3007/6010] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:37 2022] DELETE /identity/v3/projects/78f1da8b90f649c5914d2ce30625c86b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:37.753198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2123cf-518f-4f09-8133-0a5986c25a52 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:37.754050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2123cf-518f-4f09-8133-0a5986c25a52 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:37.754524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2123cf-518f-4f09-8133-0a5986c25a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:37.802842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0c2123cf-518f-4f09-8133-0a5986c25a52 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:37.804154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0c2123cf-518f-4f09-8133-0a5986c25a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:37.974172 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3004/6011] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:37.980851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e046-0f0a-4b1b-85c6-1805bcfefe76 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:37.981641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e046-0f0a-4b1b-85c6-1805bcfefe76 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:37.982162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e046-0f0a-4b1b-85c6-1805bcfefe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:38.043088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5289e046-0f0a-4b1b-85c6-1805bcfefe76 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:38.049536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5289e046-0f0a-4b1b-85c6-1805bcfefe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:38.080829 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3008/6012] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:38.082947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2123cf-518f-4f09-8133-0a5986c25a52 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:38.098597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2123cf-518f-4f09-8133-0a5986c25a52 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:38.115083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebe61f-ef0e-4596-83a5-0a47f3ea0e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:38.116034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe61f-ef0e-4596-83a5-0a47f3ea0e4f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:38.116995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe61f-ef0e-4596-83a5-0a47f3ea0e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:38.117496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe61f-ef0e-4596-83a5-0a47f3ea0e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:38.118342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebe61f-ef0e-4596-83a5-0a47f3ea0e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:14:38.118820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebe61f-ef0e-4596-83a5-0a47f3ea0e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:38.121780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebe61f-ef0e-4596-83a5-0a47f3ea0e4f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:38.150682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:38.173502 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3005/6013] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:14:38.178567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e046-0f0a-4b1b-85c6-1805bcfefe76 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:38.196364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e046-0f0a-4b1b-85c6-1805bcfefe76 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:38.224676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b6ab1-2851-4fd3-88da-6bfb1ff43503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:38.225315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b6ab1-2851-4fd3-88da-6bfb1ff43503 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:38.225853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b6ab1-2851-4fd3-88da-6bfb1ff43503 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:38.226310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b6ab1-2851-4fd3-88da-6bfb1ff43503 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:38.228686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b6ab1-2851-4fd3-88da-6bfb1ff43503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:38.238193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b6ab1-2851-4fd3-88da-6bfb1ff43503 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:38.312138 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3009/6014] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:38 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:38.316779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebe61f-ef0e-4596-83a5-0a47f3ea0e4f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:38.340950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebe61f-ef0e-4596-83a5-0a47f3ea0e4f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:38.568196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438eba8d-f1a4-4554-9289-5edd145e0a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:38.569616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438eba8d-f1a4-4554-9289-5edd145e0a8e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:38.570070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438eba8d-f1a4-4554-9289-5edd145e0a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:38.570761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438eba8d-f1a4-4554-9289-5edd145e0a8e admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:38.571593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438eba8d-f1a4-4554-9289-5edd145e0a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:38.573773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438eba8d-f1a4-4554-9289-5edd145e0a8e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:38.623476 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3006/6015] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:38 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:38.628496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b6ab1-2851-4fd3-88da-6bfb1ff43503 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:38.648498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b6ab1-2851-4fd3-88da-6bfb1ff43503 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:38.661261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbef15-56c7-4a72-8697-f305a3f771a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:38.663349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbef15-56c7-4a72-8697-f305a3f771a4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:38.664969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbef15-56c7-4a72-8697-f305a3f771a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:38.665289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbef15-56c7-4a72-8697-f305a3f771a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:38.666645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbef15-56c7-4a72-8697-f305a3f771a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:38.674221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbef15-56c7-4a72-8697-f305a3f771a4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:38.702382 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3010/6016] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:38.703710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438eba8d-f1a4-4554-9289-5edd145e0a8e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:38.724903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438eba8d-f1a4-4554-9289-5edd145e0a8e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:38.744374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cd4d0-1955-4455-b211-218c9179bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:38.750684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cd4d0-1955-4455-b211-218c9179bd72 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:38.754220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cd4d0-1955-4455-b211-218c9179bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:38.755129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cd4d0-1955-4455-b211-218c9179bd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:38.760055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cd4d0-1955-4455-b211-218c9179bd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:38.766445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cd4d0-1955-4455-b211-218c9179bd72 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:38.809160 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3007/6017] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:38.811038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbef15-56c7-4a72-8697-f305a3f771a4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:38.827025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbef15-56c7-4a72-8697-f305a3f771a4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:38.834256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab63fc-a2ea-4d0e-a760-664d8076aba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:38.835120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab63fc-a2ea-4d0e-a760-664d8076aba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:38.836114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab63fc-a2ea-4d0e-a760-664d8076aba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:38.836416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab63fc-a2ea-4d0e-a760-664d8076aba6 admin admin] PATH_INFO: `/v3/projects/1b6c92954a6d44d696ebe30667846593/users/02f652d7e76c491abb65c38cf0fc28b9/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:38.884098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab63fc-a2ea-4d0e-a760-664d8076aba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6c92954a6d44d696ebe30667846593, user_id=02f652d7e76c491abb65c38cf0fc28b9, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:38.889843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab63fc-a2ea-4d0e-a760-664d8076aba6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:38.921874 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3011/6018] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:38 2022] PUT /identity/v3/projects/1b6c92954a6d44d696ebe30667846593/users/02f652d7e76c491abb65c38cf0fc28b9/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:38.937049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee701dbe-5f8c-4fed-a5d3-8f56c3dec5d2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:38.938615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee701dbe-5f8c-4fed-a5d3-8f56c3dec5d2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:38.938953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee701dbe-5f8c-4fed-a5d3-8f56c3dec5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:39.035142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ee701dbe-5f8c-4fed-a5d3-8f56c3dec5d2 None None] MFA Rules not processed for user `02f652d7e76c491abb65c38cf0fc28b9`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:39.037802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ee701dbe-5f8c-4fed-a5d3-8f56c3dec5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:39.251554 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3008/6019] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:39.252801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab63fc-a2ea-4d0e-a760-664d8076aba6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:39.395011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab63fc-a2ea-4d0e-a760-664d8076aba6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:39.400289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d54b-70b0-4e78-b133-c5b1c3be6b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:39.401148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d54b-70b0-4e78-b133-c5b1c3be6b84 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:39.401495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d54b-70b0-4e78-b133-c5b1c3be6b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:39.401907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d54b-70b0-4e78-b133-c5b1c3be6b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:39.403092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535d54b-70b0-4e78-b133-c5b1c3be6b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:39.405599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535d54b-70b0-4e78-b133-c5b1c3be6b84 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:39.477289 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3012/6020] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:39 2022] POST /identity/v3/projects => generated 381 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:39.480513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee701dbe-5f8c-4fed-a5d3-8f56c3dec5d2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:39.523847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee701dbe-5f8c-4fed-a5d3-8f56c3dec5d2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:39.735205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dc5d7-6096-428e-9921-f6b45beb343c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:39.737766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc5d7-6096-428e-9921-f6b45beb343c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:39.738919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc5d7-6096-428e-9921-f6b45beb343c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:39.740427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc5d7-6096-428e-9921-f6b45beb343c admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:39.741679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dc5d7-6096-428e-9921-f6b45beb343c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:39.748829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dc5d7-6096-428e-9921-f6b45beb343c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:39.787509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:39.839335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d54b-70b0-4e78-b133-c5b1c3be6b84 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:39.841318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d535d54b-70b0-4e78-b133-c5b1c3be6b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:39.862463 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3009/6021] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:39 2022] POST /identity/v3/users => generated 297 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:39.869969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dc5d7-6096-428e-9921-f6b45beb343c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:39.870678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:39.902744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dc5d7-6096-428e-9921-f6b45beb343c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:39.915841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8b5a-b26c-4e9c-a13c-4f37a1ba5bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:39.916462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8b5a-b26c-4e9c-a13c-4f37a1ba5bdf admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:39.916904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8b5a-b26c-4e9c-a13c-4f37a1ba5bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:39.917196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8b5a-b26c-4e9c-a13c-4f37a1ba5bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:39.918119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8b5a-b26c-4e9c-a13c-4f37a1ba5bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:39.925209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8b5a-b26c-4e9c-a13c-4f37a1ba5bdf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:39.971372 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3010/6022] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:39.976087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8b5a-b26c-4e9c-a13c-4f37a1ba5bdf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:40.004499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8b5a-b26c-4e9c-a13c-4f37a1ba5bdf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:40.020266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e72dd-b963-401d-992b-1f39b36c715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:40.021232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e72dd-b963-401d-992b-1f39b36c715d admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:40.021680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e72dd-b963-401d-992b-1f39b36c715d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:40.022119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e72dd-b963-401d-992b-1f39b36c715d admin admin] PATH_INFO: `/v3/projects/df1bf20f76644727afeb79c35ff591c6/users/161418c635694563b28691c473f9512f/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:40.049422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d54b-70b0-4e78-b133-c5b1c3be6b84 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:40.054555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e72dd-b963-401d-992b-1f39b36c715d admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1bf20f76644727afeb79c35ff591c6, user_id=161418c635694563b28691c473f9512f, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:40.057617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e72dd-b963-401d-992b-1f39b36c715d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:40.064096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ed30a-a9f8-4321-9f7a-1481ade3568c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:40.065629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ed30a-a9f8-4321-9f7a-1481ade3568c service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:40.066038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ed30a-a9f8-4321-9f7a-1481ade3568c service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:40.066421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ed30a-a9f8-4321-9f7a-1481ade3568c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:40.075467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-854ed30a-a9f8-4321-9f7a-1481ade3568c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:40.092296 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3011/6023] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:39 2022] PUT /identity/v3/projects/df1bf20f76644727afeb79c35ff591c6/users/161418c635694563b28691c473f9512f/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:40.096139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e72dd-b963-401d-992b-1f39b36c715d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:40.110502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ed30a-a9f8-4321-9f7a-1481ade3568c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:40.113589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ed30a-a9f8-4321-9f7a-1481ade3568c service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:40.133565 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3013/6024] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:14:40.284939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e72dd-b963-401d-992b-1f39b36c715d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:40.300152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101da98-65cb-49cc-afe0-77df6567a24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:40.301056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101da98-65cb-49cc-afe0-77df6567a24a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:40.301562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101da98-65cb-49cc-afe0-77df6567a24a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:40.302012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101da98-65cb-49cc-afe0-77df6567a24a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:40.302832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101da98-65cb-49cc-afe0-77df6567a24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:40.312202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101da98-65cb-49cc-afe0-77df6567a24a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:40.338741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ed30a-a9f8-4321-9f7a-1481ade3568c service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:40.340673 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3012/6025] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:14:40.354141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ed30a-a9f8-4321-9f7a-1481ade3568c service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:40.368840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b47004-176b-4699-9ca8-dcf4dca45684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:40.369772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b47004-176b-4699-9ca8-dcf4dca45684 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:40.370171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b47004-176b-4699-9ca8-dcf4dca45684 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:40.370559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b47004-176b-4699-9ca8-dcf4dca45684 admin admin] PATH_INFO: `/v3/projects/df1bf20f76644727afeb79c35ff591c6/users/161418c635694563b28691c473f9512f/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:40.375919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b47004-176b-4699-9ca8-dcf4dca45684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1bf20f76644727afeb79c35ff591c6, user_id=161418c635694563b28691c473f9512f, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:40.386679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b47004-176b-4699-9ca8-dcf4dca45684 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:40.409052 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3014/6026] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:40 2022] PUT /identity/v3/projects/df1bf20f76644727afeb79c35ff591c6/users/161418c635694563b28691c473f9512f/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:14:40.419543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f400a6-02cd-4f1c-b01d-380bb3dd1d79 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:40.419833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f400a6-02cd-4f1c-b01d-380bb3dd1d79 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:40.420116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f400a6-02cd-4f1c-b01d-380bb3dd1d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:40.464147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-20f400a6-02cd-4f1c-b01d-380bb3dd1d79 None None] MFA Rules not processed for user `161418c635694563b28691c473f9512f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:40.465466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-20f400a6-02cd-4f1c-b01d-380bb3dd1d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:40.679740 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3013/6027] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:40.685047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b47004-176b-4699-9ca8-dcf4dca45684 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:40.708305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b47004-176b-4699-9ca8-dcf4dca45684 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:40.713349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18051d-7437-4668-80c4-8335caba7fab tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '161418c635694563b28691c473f9512f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1bf20f76644727afeb79c35ff591c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:40.714369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18051d-7437-4668-80c4-8335caba7fab tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:40.714369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18051d-7437-4668-80c4-8335caba7fab tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:40.714626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18051d-7437-4668-80c4-8335caba7fab tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:40.715093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18051d-7437-4668-80c4-8335caba7fab tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:40.716714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18051d-7437-4668-80c4-8335caba7fab tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-8b18051d-7437-4668-80c4-8335caba7fab tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invalid input for field 'name': '' is too short Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: Failed validating 'minLength' in schema['properties']['name']: Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: On instance['name']: Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: Failed validating 'minLength' in schema['properties']['name']: Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: On instance['name']: Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: '' Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise error Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application On instance['name']: Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application '' Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:14:40.729370 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 08 21:14:40.731189 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 08 21:14:40.732452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 08 21:14:40.732452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 08 21:14:40.732452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:14:40.732452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 08 21:14:40.732452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:14:40.732452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:14:40.732452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application On instance['name']: Oct 08 21:14:40.732452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application '' Oct 08 21:14:40.732452 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:14:40.732452 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3015/6028] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:14:40 2022] POST /identity/v3/domains => generated 283 bytes in 44 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 08 21:14:40.736667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f400a6-02cd-4f1c-b01d-380bb3dd1d79 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:40.753794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f400a6-02cd-4f1c-b01d-380bb3dd1d79 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:40.760428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615efc7d-3000-4830-b31e-0242b2f74249 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '161418c635694563b28691c473f9512f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1bf20f76644727afeb79c35ff591c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:40.761128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615efc7d-3000-4830-b31e-0242b2f74249 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:40.761409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615efc7d-3000-4830-b31e-0242b2f74249 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:40.761562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615efc7d-3000-4830-b31e-0242b2f74249 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:40.762227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615efc7d-3000-4830-b31e-0242b2f74249 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:40.775649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615efc7d-3000-4830-b31e-0242b2f74249 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-615efc7d-3000-4830-b31e-0242b2f74249 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: Failed validating 'maxLength' in schema['properties']['name']: Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: On instance['name']: Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: Failed validating 'maxLength' in schema['properties']['name']: Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: On instance['name']: Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise error Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:14:40.787903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application On instance['name']: Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 08 21:14:40.790072 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 08 21:14:40.792039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 08 21:14:40.792039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 08 21:14:40.792039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 08 21:14:40.792039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 08 21:14:40.792039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:14:40.792039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:40.792039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 08 21:14:40.792039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:14:40.792039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:40.792039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application On instance['name']: Oct 08 21:14:40.792039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 08 21:14:40.792039 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:40.811005 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3014/6029] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:14:40 2022] POST /identity/v3/domains => generated 412 bytes in 75 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 08 21:14:40.815305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18051d-7437-4668-80c4-8335caba7fab tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:40.835236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18051d-7437-4668-80c4-8335caba7fab tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:40.856854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4763db1-1a4a-4c45-a83d-69113fafd09c tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '161418c635694563b28691c473f9512f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1bf20f76644727afeb79c35ff591c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:40.857568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4763db1-1a4a-4c45-a83d-69113fafd09c tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:40.857798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4763db1-1a4a-4c45-a83d-69113fafd09c tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:40.858278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4763db1-1a4a-4c45-a83d-69113fafd09c tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:40.858960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4763db1-1a4a-4c45-a83d-69113fafd09c tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:40.860562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4763db1-1a4a-4c45-a83d-69113fafd09c tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:40.894307 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3016/6030] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:14:40 2022] POST /identity/v3/domains => generated 277 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:40.898344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615efc7d-3000-4830-b31e-0242b2f74249 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:40.916358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615efc7d-3000-4830-b31e-0242b2f74249 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:40.978893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:41.045374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a224d0c-615a-44c0-915d-fe5e66c5bf15 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '161418c635694563b28691c473f9512f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1bf20f76644727afeb79c35ff591c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:41.046008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a224d0c-615a-44c0-915d-fe5e66c5bf15 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:41.046808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a224d0c-615a-44c0-915d-fe5e66c5bf15 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:41.046808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a224d0c-615a-44c0-915d-fe5e66c5bf15 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] PATH_INFO: `/v3/domains/916ec65f6a9c4efdbd7829ca42e1d333` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:41.078644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a224d0c-615a-44c0-915d-fe5e66c5bf15 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=916ec65f6a9c4efdbd7829ca42e1d333)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:41.080905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a224d0c-615a-44c0-915d-fe5e66c5bf15 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-0a224d0c-615a-44c0-915d-fe5e66c5bf15 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 08 21:14:41.116284 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 08 21:14:41.117492 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:14:41.117492 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:14:41.117492 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 08 21:14:41.117492 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 08 21:14:41.117492 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 08 21:14:41.117492 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 08 21:14:41.117492 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 08 21:14:41.117492 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:41.118091 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3015/6031] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:14:40 2022] DELETE /identity/v3/domains/916ec65f6a9c4efdbd7829ca42e1d333 => generated 120 bytes in 220 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:14:41.122053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4763db1-1a4a-4c45-a83d-69113fafd09c tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:41.142987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4763db1-1a4a-4c45-a83d-69113fafd09c tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:41.149767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcbd2e-14b6-4d6a-80b0-50788d6d5469 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '161418c635694563b28691c473f9512f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1bf20f76644727afeb79c35ff591c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:41.150433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcbd2e-14b6-4d6a-80b0-50788d6d5469 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:41.150719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcbd2e-14b6-4d6a-80b0-50788d6d5469 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:41.150998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcbd2e-14b6-4d6a-80b0-50788d6d5469 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] PATH_INFO: `/v3/domains/916ec65f6a9c4efdbd7829ca42e1d333` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:41.152629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcbd2e-14b6-4d6a-80b0-50788d6d5469 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=916ec65f6a9c4efdbd7829ca42e1d333)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:41.154286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcbd2e-14b6-4d6a-80b0-50788d6d5469 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:41.230769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-39bcbd2e-14b6-4d6a-80b0-50788d6d5469 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '916ec65f6a9c4efdbd7829ca42e1d333'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.233589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-39bcbd2e-14b6-4d6a-80b0-50788d6d5469 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '916ec65f6a9c4efdbd7829ca42e1d333'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.294464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-39bcbd2e-14b6-4d6a-80b0-50788d6d5469 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '916ec65f6a9c4efdbd7829ca42e1d333'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.297553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-39bcbd2e-14b6-4d6a-80b0-50788d6d5469 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '916ec65f6a9c4efdbd7829ca42e1d333'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.303153 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3017/6032] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:14:41 2022] PATCH /identity/v3/domains/916ec65f6a9c4efdbd7829ca42e1d333 => generated 278 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:14:41.307574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a224d0c-615a-44c0-915d-fe5e66c5bf15 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:41.310794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0a224d0c-615a-44c0-915d-fe5e66c5bf15 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:41.336176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a224d0c-615a-44c0-915d-fe5e66c5bf15 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:41.470229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '161418c635694563b28691c473f9512f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1bf20f76644727afeb79c35ff591c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:41.471017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:41.471216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:41.473633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] PATH_INFO: `/v3/domains/916ec65f6a9c4efdbd7829ca42e1d333` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:41.489004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcbd2e-14b6-4d6a-80b0-50788d6d5469 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:41.497013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-39bcbd2e-14b6-4d6a-80b0-50788d6d5469 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:41.505499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=916ec65f6a9c4efdbd7829ca42e1d333)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:41.507147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:41.578297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '916ec65f6a9c4efdbd7829ca42e1d333'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.614740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '916ec65f6a9c4efdbd7829ca42e1d333'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.700434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcbd2e-14b6-4d6a-80b0-50788d6d5469 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:41.711252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916ec65f6a9c4efdbd7829ca42e1d333', 'request_id': 'req-16584923-9638-4547-9565-8e70335deb2a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.749006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916ec65f6a9c4efdbd7829ca42e1d333', 'request_id': 'req-16584923-9638-4547-9565-8e70335deb2a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.784053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:41.799002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916ec65f6a9c4efdbd7829ca42e1d333', 'request_id': 'req-16584923-9638-4547-9565-8e70335deb2a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.843626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] The token cache is being invalidate because project 916ec65f6a9c4efdbd7829ca42e1d333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:41.846161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.847324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.858168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '916ec65f6a9c4efdbd7829ca42e1d333', 'request_id': 'req-16584923-9638-4547-9565-8e70335deb2a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.860366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '916ec65f6a9c4efdbd7829ca42e1d333', 'request_id': 'req-16584923-9638-4547-9565-8e70335deb2a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.874730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '916ec65f6a9c4efdbd7829ca42e1d333', 'request_id': 'req-16584923-9638-4547-9565-8e70335deb2a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:41.892485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:41.898201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd250192-eb47-457e-896a-25b73d2f78fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:41.899808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250192-eb47-457e-896a-25b73d2f78fa service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:41.900502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250192-eb47-457e-896a-25b73d2f78fa service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:41.901114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250192-eb47-457e-896a-25b73d2f78fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:41.910530 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3016/6033] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:14:41 2022] DELETE /identity/v3/domains/916ec65f6a9c4efdbd7829ca42e1d333 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:41.914752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:41.916206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cd250192-eb47-457e-896a-25b73d2f78fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:41.919028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:41.952492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd250192-eb47-457e-896a-25b73d2f78fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:41.971188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd250192-eb47-457e-896a-25b73d2f78fa service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:42.011355 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3018/6034] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:14:42.169805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16584923-9638-4547-9565-8e70335deb2a tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:42.191080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e54294-acf6-427c-b7fa-d6d76e02e926 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '161418c635694563b28691c473f9512f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1bf20f76644727afeb79c35ff591c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:42.192214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e54294-acf6-427c-b7fa-d6d76e02e926 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:42.192400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e54294-acf6-427c-b7fa-d6d76e02e926 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:42.192626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e54294-acf6-427c-b7fa-d6d76e02e926 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] PATH_INFO: `/v3/domains/e6e453499cf74d81b869feb943019251` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:42.230544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e54294-acf6-427c-b7fa-d6d76e02e926 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-a1e54294-acf6-427c-b7fa-d6d76e02e926 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Could not find domain: e6e453499cf74d81b869feb943019251.: keystone.exception.DomainNotFound: Could not find domain: e6e453499cf74d81b869feb943019251. Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e6e453499cf74d81b869feb943019251. Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:14:42.256332 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:14:42.257751 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:14:42.263085 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e6e453499cf74d81b869feb943019251. Oct 08 21:14:42.264324 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:42.264324 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3017/6035] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:14:41 2022] DELETE /identity/v3/domains/e6e453499cf74d81b869feb943019251 => generated 112 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:14:42.264485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd250192-eb47-457e-896a-25b73d2f78fa service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:42.293158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd250192-eb47-457e-896a-25b73d2f78fa service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:42.319243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ff521-36cd-4f7f-aaa0-adde774b4874 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '161418c635694563b28691c473f9512f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1bf20f76644727afeb79c35ff591c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:42.319890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ff521-36cd-4f7f-aaa0-adde774b4874 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:42.320175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ff521-36cd-4f7f-aaa0-adde774b4874 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:42.320451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ff521-36cd-4f7f-aaa0-adde774b4874 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:42.321113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ff521-36cd-4f7f-aaa0-adde774b4874 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:42.324428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ff521-36cd-4f7f-aaa0-adde774b4874 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:42.423467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e54294-acf6-427c-b7fa-d6d76e02e926 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:42.433324 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3019/6036] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:14:42 2022] POST /identity/v3/domains => generated 252 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:42.463439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e54294-acf6-427c-b7fa-d6d76e02e926 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:42.634701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d034d-643a-4290-8822-ac90c3874273 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '161418c635694563b28691c473f9512f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1bf20f76644727afeb79c35ff591c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:42.635524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d034d-643a-4290-8822-ac90c3874273 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:42.635913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d034d-643a-4290-8822-ac90c3874273 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:42.636303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d034d-643a-4290-8822-ac90c3874273 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:42.637083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d034d-643a-4290-8822-ac90c3874273 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:42.638968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d034d-643a-4290-8822-ac90c3874273 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:42.664374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.sql.core [None req-095d034d-643a-4290-8822-ac90c3874273 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-339335488' for key 'project.ixu_project_name_domain_id'") Oct 08 21:14:42.664374 ncdv-master-1 devstack@keystone.service[99084]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 08 21:14:42.664374 ncdv-master-1 devstack@keystone.service[99084]: [parameters: {'id': '7e6d141345214554859652e599c094db', 'name': 'tempest-domain-dup-339335488', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 08 21:14:42.664374 ncdv-master-1 devstack@keystone.service[99084]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=99084) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 08 21:14:42.693920 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-095d034d-643a-4290-8822-ac90c3874273 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-339335488.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-339335488. Oct 08 21:14:42.693920 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:42.693920 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 21:14:42.693920 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 21:14:42.693920 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 21:14:42.693920 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 21:14:42.693920 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 21:14:42.693920 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 21:14:42.693920 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 21:14:42.693920 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application conn.query(q) Oct 08 21:14:42.693920 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 21:14:42.693920 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 21:14:42.693920 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result.read() Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-339335488' for key 'project.ixu_project_name_domain_id'") Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 08 21:14:42.695130 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application next(self.gen) Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application yield resource Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application next(self.gen) Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.session.rollback() Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.force_reraise() Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise self.value Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application session.commit() Oct 08 21:14:42.696421 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._prepare_impl() Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.session.flush() Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._flush(objects) Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application compat.raise_( Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application flush_context.execute() Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 08 21:14:42.697907 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rec.execute(self) Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 08 21:14:42.699161 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application conn.query(q) Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application result.read() Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 21:14:42.700363 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-339335488' for key 'project.ixu_project_name_domain_id'") Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [parameters: {'id': '7e6d141345214554859652e599c094db', 'name': 'tempest-domain-dup-339335488', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:42.701739 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-339335488. Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:14:42.702903 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-339335488. Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:14:42.704343 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3018/6037] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:14:42 2022] POST /identity/v3/domains => generated 211 bytes in 280 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 08 21:14:42.708527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ff521-36cd-4f7f-aaa0-adde774b4874 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:42.724619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ff521-36cd-4f7f-aaa0-adde774b4874 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:42.732964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606768ff-8c29-406a-810c-cb1cfa89bf11 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '161418c635694563b28691c473f9512f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1bf20f76644727afeb79c35ff591c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:42.733882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606768ff-8c29-406a-810c-cb1cfa89bf11 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:42.735307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606768ff-8c29-406a-810c-cb1cfa89bf11 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:42.735764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606768ff-8c29-406a-810c-cb1cfa89bf11 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] PATH_INFO: `/v3/domains/df79c4edfd8d495f93c1be3159bf8119` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:42.754303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606768ff-8c29-406a-810c-cb1cfa89bf11 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=df79c4edfd8d495f93c1be3159bf8119)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:42.756756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606768ff-8c29-406a-810c-cb1cfa89bf11 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:42.796950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-606768ff-8c29-406a-810c-cb1cfa89bf11 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'df79c4edfd8d495f93c1be3159bf8119'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:42.798190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-606768ff-8c29-406a-810c-cb1cfa89bf11 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'df79c4edfd8d495f93c1be3159bf8119'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:42.829394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-606768ff-8c29-406a-810c-cb1cfa89bf11 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'df79c4edfd8d495f93c1be3159bf8119'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:42.830804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-606768ff-8c29-406a-810c-cb1cfa89bf11 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'df79c4edfd8d495f93c1be3159bf8119'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:42.836978 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3020/6038] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:14:42 2022] PATCH /identity/v3/domains/df79c4edfd8d495f93c1be3159bf8119 => generated 253 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:14:42.837908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d034d-643a-4290-8822-ac90c3874273 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:42.839878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-095d034d-643a-4290-8822-ac90c3874273 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:42.867428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d034d-643a-4290-8822-ac90c3874273 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:43.005410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '161418c635694563b28691c473f9512f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1bf20f76644727afeb79c35ff591c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:43.006086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:43.006356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:43.006634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] PATH_INFO: `/v3/domains/df79c4edfd8d495f93c1be3159bf8119` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:43.020291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=df79c4edfd8d495f93c1be3159bf8119)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:43.022067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:43.069620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'df79c4edfd8d495f93c1be3159bf8119'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.083110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'df79c4edfd8d495f93c1be3159bf8119'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.084773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:43.143798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df79c4edfd8d495f93c1be3159bf8119', 'request_id': 'req-427a0ab2-8a35-4907-b382-0c6bd8812eb8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.154737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df79c4edfd8d495f93c1be3159bf8119', 'request_id': 'req-427a0ab2-8a35-4907-b382-0c6bd8812eb8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.161493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df79c4edfd8d495f93c1be3159bf8119', 'request_id': 'req-427a0ab2-8a35-4907-b382-0c6bd8812eb8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.175185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] The token cache is being invalidate because project df79c4edfd8d495f93c1be3159bf8119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:43.175637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.176378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.188525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'df79c4edfd8d495f93c1be3159bf8119', 'request_id': 'req-427a0ab2-8a35-4907-b382-0c6bd8812eb8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.190011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'df79c4edfd8d495f93c1be3159bf8119', 'request_id': 'req-427a0ab2-8a35-4907-b382-0c6bd8812eb8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.198656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'df79c4edfd8d495f93c1be3159bf8119', 'request_id': 'req-427a0ab2-8a35-4907-b382-0c6bd8812eb8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.205607 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3019/6039] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:14:42 2022] DELETE /identity/v3/domains/df79c4edfd8d495f93c1be3159bf8119 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:14:43.210705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606768ff-8c29-406a-810c-cb1cfa89bf11 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:43.224102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606768ff-8c29-406a-810c-cb1cfa89bf11 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:43.301280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea236a-39dc-4f11-a5be-8db109953457 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '161418c635694563b28691c473f9512f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1bf20f76644727afeb79c35ff591c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:43.302136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea236a-39dc-4f11-a5be-8db109953457 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:43.302429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea236a-39dc-4f11-a5be-8db109953457 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:43.302721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea236a-39dc-4f11-a5be-8db109953457 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] PATH_INFO: `/v3/domains/916ec65f6a9c4efdbd7829ca42e1d333` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:43.311878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea236a-39dc-4f11-a5be-8db109953457 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-24ea236a-39dc-4f11-a5be-8db109953457 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Could not find domain: 916ec65f6a9c4efdbd7829ca42e1d333.: keystone.exception.DomainNotFound: Could not find domain: 916ec65f6a9c4efdbd7829ca42e1d333. Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 916ec65f6a9c4efdbd7829ca42e1d333. Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:14:43.317605 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:14:43.319058 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:14:43.320132 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 916ec65f6a9c4efdbd7829ca42e1d333. Oct 08 21:14:43.321346 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:14:43.323501 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3021/6040] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:14:43 2022] PATCH /identity/v3/domains/916ec65f6a9c4efdbd7829ca42e1d333 => generated 112 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:14:43.327419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:43.329510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:43.408935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a0ab2-8a35-4907-b382-0c6bd8812eb8 tempest-DomainsNegativeTestJSON-647550489 tempest-DomainsNegativeTestJSON-647550489-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:43.414694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:43.415280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:43.415679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:43.416134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] PATH_INFO: `/v3/users/02f652d7e76c491abb65c38cf0fc28b9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:43.417665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f652d7e76c491abb65c38cf0fc28b9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:43.419840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:43.547140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f652d7e76c491abb65c38cf0fc28b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.561038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f652d7e76c491abb65c38cf0fc28b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.562069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f652d7e76c491abb65c38cf0fc28b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.562771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f652d7e76c491abb65c38cf0fc28b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.579509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f652d7e76c491abb65c38cf0fc28b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:43.594792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:43.603639 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3020/6041] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:43 2022] DELETE /identity/v3/users/02f652d7e76c491abb65c38cf0fc28b9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:43.605361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff909f0-6217-4bbc-9697-c6415b7355b8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:43.605862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff909f0-6217-4bbc-9697-c6415b7355b8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:43.606318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff909f0-6217-4bbc-9697-c6415b7355b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:43.637492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8ff909f0-6217-4bbc-9697-c6415b7355b8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:43.638759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8ff909f0-6217-4bbc-9697-c6415b7355b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:43.784847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:43.808177 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3022/6042] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:43.910781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:43.912363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:44.009748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc073b-10ad-411b-88a3-26f5cb29f60e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:44.014500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27241-63d8-456b-b273-8bd86a1ff31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:44.015265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27241-63d8-456b-b273-8bd86a1ff31e service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:44.015730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27241-63d8-456b-b273-8bd86a1ff31e service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:44.016105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27241-63d8-456b-b273-8bd86a1ff31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:44.027514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa27241-63d8-456b-b273-8bd86a1ff31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:44.030300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa27241-63d8-456b-b273-8bd86a1ff31e service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:44.043295 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3021/6043] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:45.405735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69ecfd-6848-4d21-9d75-5d75d9d30cf3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:45.406226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69ecfd-6848-4d21-9d75-5d75d9d30cf3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:45.406489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69ecfd-6848-4d21-9d75-5d75d9d30cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:45.496085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bd69ecfd-6848-4d21-9d75-5d75d9d30cf3 None None] MFA Rules not processed for user `8957041987c8487099f0d89f4c64af66`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:45.497737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bd69ecfd-6848-4d21-9d75-5d75d9d30cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:45.773899 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3023/6044] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:45.789154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27241-63d8-456b-b273-8bd86a1ff31e service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:45.791302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eaa27241-63d8-456b-b273-8bd86a1ff31e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:45.970050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27241-63d8-456b-b273-8bd86a1ff31e service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:45.984140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77978eab-c07d-45cb-a932-27c3e0891dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:45.984829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77978eab-c07d-45cb-a932-27c3e0891dc8 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:45.985116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77978eab-c07d-45cb-a932-27c3e0891dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:45.985415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77978eab-c07d-45cb-a932-27c3e0891dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:45.999780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77978eab-c07d-45cb-a932-27c3e0891dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:46.002599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77978eab-c07d-45cb-a932-27c3e0891dc8 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:46.021363 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3022/6045] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:46.066805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69ecfd-6848-4d21-9d75-5d75d9d30cf3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:46.068503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bd69ecfd-6848-4d21-9d75-5d75d9d30cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:46.094411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69ecfd-6848-4d21-9d75-5d75d9d30cf3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:46.105060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:46.106580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:46.108535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:46.109523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] PATH_INFO: `/v3/projects/1b6c92954a6d44d696ebe30667846593` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:46.111430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6c92954a6d44d696ebe30667846593)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:46.115030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:46.221041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6c92954a6d44d696ebe30667846593', 'request_id': 'req-76a80687-8bf9-4d11-b284-2d21b9abcf05'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:46.237144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6c92954a6d44d696ebe30667846593', 'request_id': 'req-76a80687-8bf9-4d11-b284-2d21b9abcf05'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:46.257385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6c92954a6d44d696ebe30667846593', 'request_id': 'req-76a80687-8bf9-4d11-b284-2d21b9abcf05'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:46.272938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] The token cache is being invalidate because project 1b6c92954a6d44d696ebe30667846593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:46.273320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:46.274322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:46.280322 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3024/6046] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:46 2022] DELETE /identity/v3/projects/1b6c92954a6d44d696ebe30667846593 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:46.285234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77978eab-c07d-45cb-a932-27c3e0891dc8 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:46.301370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77978eab-c07d-45cb-a932-27c3e0891dc8 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:46.431001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ec099-8642-4d22-8156-08432dce7dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:46.431654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ec099-8642-4d22-8156-08432dce7dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:46.431936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ec099-8642-4d22-8156-08432dce7dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:46.432373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ec099-8642-4d22-8156-08432dce7dcf admin admin] PATH_INFO: `/v3/users/161418c635694563b28691c473f9512f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:46.435003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ec099-8642-4d22-8156-08432dce7dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=161418c635694563b28691c473f9512f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:46.438030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ec099-8642-4d22-8156-08432dce7dcf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:46.497314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:46.555956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-675ec099-8642-4d22-8156-08432dce7dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '161418c635694563b28691c473f9512f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:46.570537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-675ec099-8642-4d22-8156-08432dce7dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '161418c635694563b28691c473f9512f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:46.576376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-675ec099-8642-4d22-8156-08432dce7dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '161418c635694563b28691c473f9512f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:46.577395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-675ec099-8642-4d22-8156-08432dce7dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '161418c635694563b28691c473f9512f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:46.629844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-675ec099-8642-4d22-8156-08432dce7dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '161418c635694563b28691c473f9512f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:46.650830 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3023/6047] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:46 2022] DELETE /identity/v3/users/161418c635694563b28691c473f9512f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:49.547762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:49.550337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:49.575901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a80687-8bf9-4d11-b284-2d21b9abcf05 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:49.701974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:49.702896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:49.703414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:49.705174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] PATH_INFO: `/v3/projects/df1bf20f76644727afeb79c35ff591c6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:49.706848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1bf20f76644727afeb79c35ff591c6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:49.710293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:49.732521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:49.807506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1bf20f76644727afeb79c35ff591c6', 'request_id': 'req-672067ab-a792-44dc-99f2-37f911707256'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:49.824294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1bf20f76644727afeb79c35ff591c6', 'request_id': 'req-672067ab-a792-44dc-99f2-37f911707256'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:49.852927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1bf20f76644727afeb79c35ff591c6', 'request_id': 'req-672067ab-a792-44dc-99f2-37f911707256'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:49.869689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] The token cache is being invalidate because project df1bf20f76644727afeb79c35ff591c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:49.870118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:49.870887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:49.872937 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3025/6048] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:49 2022] DELETE /identity/v3/projects/df1bf20f76644727afeb79c35ff591c6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:49.878293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0659c74-07b8-4a0b-865c-ce3acf42564b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:49.878930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0659c74-07b8-4a0b-865c-ce3acf42564b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:49.879439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0659c74-07b8-4a0b-865c-ce3acf42564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:49.887204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:49.896675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:49.963200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f0659c74-07b8-4a0b-865c-ce3acf42564b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:49.964511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f0659c74-07b8-4a0b-865c-ce3acf42564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:50.117624 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3024/6049] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:14:50.125631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af8965-f831-4ed7-83a5-cc2b352ef121 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:50.125976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af8965-f831-4ed7-83a5-cc2b352ef121 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:50.126200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af8965-f831-4ed7-83a5-cc2b352ef121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:50.134138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672067ab-a792-44dc-99f2-37f911707256 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:50.140925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:50.141621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:50.141908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:50.142837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] PATH_INFO: `/v3/users/7af21976e8bf4aae97aaa8971e38ede5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:50.146099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af21976e8bf4aae97aaa8971e38ede5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:50.148788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:50.153892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-97af8965-f831-4ed7-83a5-cc2b352ef121 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:50.155179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-97af8965-f831-4ed7-83a5-cc2b352ef121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:50.166464 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3025/6050] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:14:50.171446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af8965-f831-4ed7-83a5-cc2b352ef121 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:50.193869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af8965-f831-4ed7-83a5-cc2b352ef121 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:50.203835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19475cc0-8f39-40f7-8902-894beb7bee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:50.205307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19475cc0-8f39-40f7-8902-894beb7bee75 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:50.205599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19475cc0-8f39-40f7-8902-894beb7bee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:50.205878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19475cc0-8f39-40f7-8902-894beb7bee75 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:50.206545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19475cc0-8f39-40f7-8902-894beb7bee75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:14:50.206950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19475cc0-8f39-40f7-8902-894beb7bee75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:50.209285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19475cc0-8f39-40f7-8902-894beb7bee75 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:50.243458 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3026/6051] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:14:50.248470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19475cc0-8f39-40f7-8902-894beb7bee75 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:50.262738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af21976e8bf4aae97aaa8971e38ede5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:50.266765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19475cc0-8f39-40f7-8902-894beb7bee75 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:50.273008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce3f91-448d-4a42-bf08-0dd2be5b5065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:50.274200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce3f91-448d-4a42-bf08-0dd2be5b5065 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:50.274756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce3f91-448d-4a42-bf08-0dd2be5b5065 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:50.275283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce3f91-448d-4a42-bf08-0dd2be5b5065 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:50.276376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce3f91-448d-4a42-bf08-0dd2be5b5065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:50.279258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce3f91-448d-4a42-bf08-0dd2be5b5065 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:50.279504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af21976e8bf4aae97aaa8971e38ede5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:50.282169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af21976e8bf4aae97aaa8971e38ede5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:50.283510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af21976e8bf4aae97aaa8971e38ede5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:50.304903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af21976e8bf4aae97aaa8971e38ede5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:50.333203 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3026/6052] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:49 2022] DELETE /identity/v3/users/7af21976e8bf4aae97aaa8971e38ede5 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:50.335502 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3027/6053] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:50 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:50.348205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:50.350207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a0eef-476c-4a18-bb0e-d6bcde0cd5e6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:50.350752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a0eef-476c-4a18-bb0e-d6bcde0cd5e6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:50.351148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a0eef-476c-4a18-bb0e-d6bcde0cd5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:50.362578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:50.386970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ef2a0eef-476c-4a18-bb0e-d6bcde0cd5e6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:50.388653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ef2a0eef-476c-4a18-bb0e-d6bcde0cd5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:50.409171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:50.507586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:50.514063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64089f-9fec-4021-b40c-d7885be3cf37 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:50.523793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ad39d-2ec1-4f8c-9115-d12bde8fb30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:50.524487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ad39d-2ec1-4f8c-9115-d12bde8fb30f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:50.524987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ad39d-2ec1-4f8c-9115-d12bde8fb30f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:50.525354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ad39d-2ec1-4f8c-9115-d12bde8fb30f admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:50.527179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ad39d-2ec1-4f8c-9115-d12bde8fb30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:50.531623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ad39d-2ec1-4f8c-9115-d12bde8fb30f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:50.532638 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3028/6054] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:50.570223 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3027/6055] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:50 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:50.574411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a0eef-476c-4a18-bb0e-d6bcde0cd5e6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:50.574716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ad39d-2ec1-4f8c-9115-d12bde8fb30f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:50.576109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ef2a0eef-476c-4a18-bb0e-d6bcde0cd5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:50.593343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ad39d-2ec1-4f8c-9115-d12bde8fb30f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:50.605842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74279cbe-e212-447d-9d76-aa91d2c0f3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:50.607214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74279cbe-e212-447d-9d76-aa91d2c0f3fb admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:50.607809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74279cbe-e212-447d-9d76-aa91d2c0f3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:50.615514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74279cbe-e212-447d-9d76-aa91d2c0f3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:50.616727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74279cbe-e212-447d-9d76-aa91d2c0f3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:50.618963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74279cbe-e212-447d-9d76-aa91d2c0f3fb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:50.648155 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3028/6056] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:50.649858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74279cbe-e212-447d-9d76-aa91d2c0f3fb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:50.677951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74279cbe-e212-447d-9d76-aa91d2c0f3fb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:50.686108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9026cc-1b39-4d8d-9e67-ab2004ed6817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:50.687551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9026cc-1b39-4d8d-9e67-ab2004ed6817 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:50.688062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9026cc-1b39-4d8d-9e67-ab2004ed6817 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:50.688574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9026cc-1b39-4d8d-9e67-ab2004ed6817 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:50.690095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9026cc-1b39-4d8d-9e67-ab2004ed6817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:50.692313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9026cc-1b39-4d8d-9e67-ab2004ed6817 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:50.710872 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3029/6057] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:50.714977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9026cc-1b39-4d8d-9e67-ab2004ed6817 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:50.717620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a0eef-476c-4a18-bb0e-d6bcde0cd5e6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:50.722021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928e23d-b9a7-438c-a5fd-74a92f3a4e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:50.722757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928e23d-b9a7-438c-a5fd-74a92f3a4e9e service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:50.723160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928e23d-b9a7-438c-a5fd-74a92f3a4e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:50.723537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928e23d-b9a7-438c-a5fd-74a92f3a4e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:50.732176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9026cc-1b39-4d8d-9e67-ab2004ed6817 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:50.739887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928e23d-b9a7-438c-a5fd-74a92f3a4e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:50.741035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928e23d-b9a7-438c-a5fd-74a92f3a4e9e service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:50.749657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59b5ab-6d12-4748-8983-ce27fa9e1b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:50.752474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59b5ab-6d12-4748-8983-ce27fa9e1b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:50.753169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59b5ab-6d12-4748-8983-ce27fa9e1b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:50.753650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59b5ab-6d12-4748-8983-ce27fa9e1b3e admin admin] PATH_INFO: `/v3/projects/cd4b00f4dfd445418ff22da8281a5291/users/0bb1bac203b347d89701ee4a49bdb6b7/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:50.755147 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3029/6058] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:14:50.783205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59b5ab-6d12-4748-8983-ce27fa9e1b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4b00f4dfd445418ff22da8281a5291, user_id=0bb1bac203b347d89701ee4a49bdb6b7, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:50.786697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59b5ab-6d12-4748-8983-ce27fa9e1b3e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:50.806877 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3030/6059] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:50 2022] PUT /identity/v3/projects/cd4b00f4dfd445418ff22da8281a5291/users/0bb1bac203b347d89701ee4a49bdb6b7/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:14:50.822935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352763e-dc66-4f33-8317-bd0d5d9a564a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:50.825449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352763e-dc66-4f33-8317-bd0d5d9a564a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:50.825805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352763e-dc66-4f33-8317-bd0d5d9a564a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:50.884418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8352763e-dc66-4f33-8317-bd0d5d9a564a None None] MFA Rules not processed for user `0bb1bac203b347d89701ee4a49bdb6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:50.885793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8352763e-dc66-4f33-8317-bd0d5d9a564a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:51.025714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59b5ab-6d12-4748-8983-ce27fa9e1b3e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:51.033281 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3030/6060] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:51.092526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea8f0-da52-4bbc-8607-bd6068a69e94 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:51.093683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea8f0-da52-4bbc-8607-bd6068a69e94 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:51.096165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea8f0-da52-4bbc-8607-bd6068a69e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:51.172799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59b5ab-6d12-4748-8983-ce27fa9e1b3e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:51.184663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-015ea8f0-da52-4bbc-8607-bd6068a69e94 None None] MFA Rules not processed for user `8957041987c8487099f0d89f4c64af66`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:51.185571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917722f9-5dc2-4fc7-a1c2-b0508fee8725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:51.186618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917722f9-5dc2-4fc7-a1c2-b0508fee8725 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:51.187948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-015ea8f0-da52-4bbc-8607-bd6068a69e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:51.188660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917722f9-5dc2-4fc7-a1c2-b0508fee8725 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:51.189286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917722f9-5dc2-4fc7-a1c2-b0508fee8725 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:51.190223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917722f9-5dc2-4fc7-a1c2-b0508fee8725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:51.194610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917722f9-5dc2-4fc7-a1c2-b0508fee8725 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:51.269731 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3031/6061] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:51 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:51.272064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917722f9-5dc2-4fc7-a1c2-b0508fee8725 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:51.338393 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3031/6062] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:51.420322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:51.459372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917722f9-5dc2-4fc7-a1c2-b0508fee8725 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:51.471573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6745e-df5f-45c1-ad97-3ce507ef41ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:51.472464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6745e-df5f-45c1-ad97-3ce507ef41ca admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:51.473433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6745e-df5f-45c1-ad97-3ce507ef41ca admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:51.473712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6745e-df5f-45c1-ad97-3ce507ef41ca admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:51.474359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6745e-df5f-45c1-ad97-3ce507ef41ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:51.476578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6745e-df5f-45c1-ad97-3ce507ef41ca admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:51.523784 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3032/6063] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:51 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:51.527655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ea8f0-da52-4bbc-8607-bd6068a69e94 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:51.561852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ea8f0-da52-4bbc-8607-bd6068a69e94 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:51.582076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae169d-b803-4173-ad3d-32037b87ff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:51.582806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae169d-b803-4173-ad3d-32037b87ff3a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:51.583096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae169d-b803-4173-ad3d-32037b87ff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:51.583374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae169d-b803-4173-ad3d-32037b87ff3a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:51.585349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae169d-b803-4173-ad3d-32037b87ff3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:51.588099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae169d-b803-4173-ad3d-32037b87ff3a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:51.619088 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3032/6064] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:51.619700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6745e-df5f-45c1-ad97-3ce507ef41ca admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:51.639783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6745e-df5f-45c1-ad97-3ce507ef41ca admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:51.652240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43024e57-f6fa-499d-94bc-c17fc4484a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:51.653620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43024e57-f6fa-499d-94bc-c17fc4484a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:51.654214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43024e57-f6fa-499d-94bc-c17fc4484a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:51.654506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43024e57-f6fa-499d-94bc-c17fc4484a8f admin admin] PATH_INFO: `/v3/projects/a21ebca1c93c4a60813567698a165528/users/a4dfa1783aa14a138685b38abac9af3b/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:51.690910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43024e57-f6fa-499d-94bc-c17fc4484a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21ebca1c93c4a60813567698a165528, user_id=a4dfa1783aa14a138685b38abac9af3b, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:51.701879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43024e57-f6fa-499d-94bc-c17fc4484a8f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:51.747900 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3033/6065] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:51 2022] PUT /identity/v3/projects/a21ebca1c93c4a60813567698a165528/users/a4dfa1783aa14a138685b38abac9af3b/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:14:51.752877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae169d-b803-4173-ad3d-32037b87ff3a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:51.765516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae169d-b803-4173-ad3d-32037b87ff3a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:51.814631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:51.887671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480af7f7-7c5f-4b91-b776-cef0059c4b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:51.889131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af7f7-7c5f-4b91-b776-cef0059c4b19 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:51.889550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af7f7-7c5f-4b91-b776-cef0059c4b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:51.889936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af7f7-7c5f-4b91-b776-cef0059c4b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:51.891267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480af7f7-7c5f-4b91-b776-cef0059c4b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:51.897422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480af7f7-7c5f-4b91-b776-cef0059c4b19 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:51.921277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43024e57-f6fa-499d-94bc-c17fc4484a8f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:51.942890 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3033/6066] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:51.953059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43024e57-f6fa-499d-94bc-c17fc4484a8f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:51.961201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d035f0-1a4d-4c16-a783-0f7210cee6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:51.962436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d035f0-1a4d-4c16-a783-0f7210cee6df admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:51.962984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d035f0-1a4d-4c16-a783-0f7210cee6df admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:51.964245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d035f0-1a4d-4c16-a783-0f7210cee6df admin admin] PATH_INFO: `/v3/projects/a21ebca1c93c4a60813567698a165528/users/a4dfa1783aa14a138685b38abac9af3b/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:51.968582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d035f0-1a4d-4c16-a783-0f7210cee6df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21ebca1c93c4a60813567698a165528, user_id=a4dfa1783aa14a138685b38abac9af3b, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:51.987092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d035f0-1a4d-4c16-a783-0f7210cee6df admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:52.030801 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3034/6067] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:51 2022] PUT /identity/v3/projects/a21ebca1c93c4a60813567698a165528/users/a4dfa1783aa14a138685b38abac9af3b/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:52.041459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7223280-2cd6-4884-9d92-0fa2f6af4fc9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:52.041848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7223280-2cd6-4884-9d92-0fa2f6af4fc9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:52.042440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7223280-2cd6-4884-9d92-0fa2f6af4fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:52.101163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c7223280-2cd6-4884-9d92-0fa2f6af4fc9 None None] MFA Rules not processed for user `a4dfa1783aa14a138685b38abac9af3b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:52.102887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c7223280-2cd6-4884-9d92-0fa2f6af4fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:52.269977 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3034/6068] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:52.271494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d035f0-1a4d-4c16-a783-0f7210cee6df admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:52.294777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d035f0-1a4d-4c16-a783-0f7210cee6df admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:52.302892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7223280-2cd6-4884-9d92-0fa2f6af4fc9 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:52.305227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c7223280-2cd6-4884-9d92-0fa2f6af4fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:52.308868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028e106-0ac8-492c-88a5-3cc19e41b893 tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4dfa1783aa14a138685b38abac9af3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a21ebca1c93c4a60813567698a165528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:52.309478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028e106-0ac8-492c-88a5-3cc19e41b893 tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:52.309760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028e106-0ac8-492c-88a5-3cc19e41b893 tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:52.310031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028e106-0ac8-492c-88a5-3cc19e41b893 tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:52.310675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028e106-0ac8-492c-88a5-3cc19e41b893 tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:52.312767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028e106-0ac8-492c-88a5-3cc19e41b893 tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:52.407529 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3035/6069] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:52 2022] POST /identity/v3/projects => generated 359 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:52.412249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028e106-0ac8-492c-88a5-3cc19e41b893 tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:52.554939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7223280-2cd6-4884-9d92-0fa2f6af4fc9 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:52.593852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028e106-0ac8-492c-88a5-3cc19e41b893 tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:52.605858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca0d0c-c443-4e50-89d6-0016772dbd58 tempest-ProjectsNegativeTestJSON-779399856 tempest-ProjectsNegativeTestJSON-779399856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bb1bac203b347d89701ee4a49bdb6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd4b00f4dfd445418ff22da8281a5291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:52.606594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca0d0c-c443-4e50-89d6-0016772dbd58 tempest-ProjectsNegativeTestJSON-779399856 tempest-ProjectsNegativeTestJSON-779399856-project] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:52.606888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca0d0c-c443-4e50-89d6-0016772dbd58 tempest-ProjectsNegativeTestJSON-779399856 tempest-ProjectsNegativeTestJSON-779399856-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:52.607162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca0d0c-c443-4e50-89d6-0016772dbd58 tempest-ProjectsNegativeTestJSON-779399856 tempest-ProjectsNegativeTestJSON-779399856-project] PATH_INFO: `/v3/projects/3471229c58894f28891c569c345a36d3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:52.619344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca0d0c-c443-4e50-89d6-0016772dbd58 tempest-ProjectsNegativeTestJSON-779399856 tempest-ProjectsNegativeTestJSON-779399856-project] RBAC: Authorizing `identity:delete_project(project_id=3471229c58894f28891c569c345a36d3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-7eca0d0c-c443-4e50-89d6-0016772dbd58 tempest-ProjectsNegativeTestJSON-779399856 tempest-ProjectsNegativeTestJSON-779399856-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 08 21:14:52.630880 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 08 21:14:52.632581 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 08 21:14:52.632581 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 08 21:14:52.632581 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 08 21:14:52.632581 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 08 21:14:52.632581 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 21:14:52.632581 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 08 21:14:52.632581 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 08 21:14:52.632581 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:14:52.632581 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3036/6070] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:52 2022] DELETE /identity/v3/projects/3471229c58894f28891c569c345a36d3 => generated 136 bytes in 221 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 08 21:14:52.636630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca0d0c-c443-4e50-89d6-0016772dbd58 tempest-ProjectsNegativeTestJSON-779399856 tempest-ProjectsNegativeTestJSON-779399856-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:52.661256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:52.697330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba62d56-f906-4d40-8df7-592791daf875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:52.698421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62d56-f906-4d40-8df7-592791daf875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:52.698758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62d56-f906-4d40-8df7-592791daf875 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:52.699047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62d56-f906-4d40-8df7-592791daf875 admin admin] PATH_INFO: `/v3/projects/8607d75f5fa04fb886aaeb401d706bce` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:52.701219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba62d56-f906-4d40-8df7-592791daf875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8607d75f5fa04fb886aaeb401d706bce)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:52.703263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba62d56-f906-4d40-8df7-592791daf875 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:52.770447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca0d0c-c443-4e50-89d6-0016772dbd58 tempest-ProjectsNegativeTestJSON-779399856 tempest-ProjectsNegativeTestJSON-779399856-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:52.778410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4dfa1783aa14a138685b38abac9af3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a21ebca1c93c4a60813567698a165528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:52.779342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:52.779791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:52.780241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] PATH_INFO: `/v3/projects/3471229c58894f28891c569c345a36d3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:52.781725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3471229c58894f28891c569c345a36d3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:52.784419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:52.846908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:52.855281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ba62d56-f906-4d40-8df7-592791daf875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8607d75f5fa04fb886aaeb401d706bce', 'request_id': 'req-9ba62d56-f906-4d40-8df7-592791daf875'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:52.875410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3471229c58894f28891c569c345a36d3', 'request_id': 'req-daa64af1-cc02-43aa-abc4-923d9c30f68b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:52.877652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ba62d56-f906-4d40-8df7-592791daf875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8607d75f5fa04fb886aaeb401d706bce', 'request_id': 'req-9ba62d56-f906-4d40-8df7-592791daf875'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:52.890681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ba62d56-f906-4d40-8df7-592791daf875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8607d75f5fa04fb886aaeb401d706bce', 'request_id': 'req-9ba62d56-f906-4d40-8df7-592791daf875'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:52.895097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3471229c58894f28891c569c345a36d3', 'request_id': 'req-daa64af1-cc02-43aa-abc4-923d9c30f68b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:52.910508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3471229c58894f28891c569c345a36d3', 'request_id': 'req-daa64af1-cc02-43aa-abc4-923d9c30f68b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:52.917999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ba62d56-f906-4d40-8df7-592791daf875 admin admin] The token cache is being invalidate because project 8607d75f5fa04fb886aaeb401d706bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:52.922627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ba62d56-f906-4d40-8df7-592791daf875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:52.924943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ba62d56-f906-4d40-8df7-592791daf875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:52.926474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] The token cache is being invalidate because project 3471229c58894f28891c569c345a36d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:52.926779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:52.928397 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3035/6071] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:52 2022] DELETE /identity/v3/projects/8607d75f5fa04fb886aaeb401d706bce => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:14:52.928631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:52.932905 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3037/6072] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:52 2022] DELETE /identity/v3/projects/3471229c58894f28891c569c345a36d3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:14:52.934584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf34eb-9f0c-4f44-a36d-e085898ed815 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:52.936149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf34eb-9f0c-4f44-a36d-e085898ed815 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:52.936430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf34eb-9f0c-4f44-a36d-e085898ed815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:52.946200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:52.948140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:52.968203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6fcf34eb-9f0c-4f44-a36d-e085898ed815 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:52.969957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6fcf34eb-9f0c-4f44-a36d-e085898ed815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:53.056925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa64af1-cc02-43aa-abc4-923d9c30f68b tempest-ProjectsNegativeTestJSON-1635523744 tempest-ProjectsNegativeTestJSON-1635523744-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:53.070760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbc700-53b5-496c-abc9-0a0f219336ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:53.071426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbc700-53b5-496c-abc9-0a0f219336ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:53.071709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbc700-53b5-496c-abc9-0a0f219336ef admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:53.071989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbc700-53b5-496c-abc9-0a0f219336ef admin admin] PATH_INFO: `/v3/users/0bb1bac203b347d89701ee4a49bdb6b7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:53.073849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbc700-53b5-496c-abc9-0a0f219336ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb1bac203b347d89701ee4a49bdb6b7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:53.075978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbc700-53b5-496c-abc9-0a0f219336ef admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:53.094804 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3036/6073] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:53.104044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24ad27-745d-453e-bdf1-2e3bdc4295e3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:53.104537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24ad27-745d-453e-bdf1-2e3bdc4295e3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:53.104973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24ad27-745d-453e-bdf1-2e3bdc4295e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:53.129633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8a24ad27-745d-453e-bdf1-2e3bdc4295e3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:53.131250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8a24ad27-745d-453e-bdf1-2e3bdc4295e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:53.138113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8bbc700-53b5-496c-abc9-0a0f219336ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb1bac203b347d89701ee4a49bdb6b7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:53.148749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8bbc700-53b5-496c-abc9-0a0f219336ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb1bac203b347d89701ee4a49bdb6b7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:53.149577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8bbc700-53b5-496c-abc9-0a0f219336ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb1bac203b347d89701ee4a49bdb6b7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:53.150354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8bbc700-53b5-496c-abc9-0a0f219336ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb1bac203b347d89701ee4a49bdb6b7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:53.155674 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3037/6074] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:53.158146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24ad27-745d-453e-bdf1-2e3bdc4295e3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:53.166551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8bbc700-53b5-496c-abc9-0a0f219336ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb1bac203b347d89701ee4a49bdb6b7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:53.180162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24ad27-745d-453e-bdf1-2e3bdc4295e3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:53.188791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8c6d0-a5b2-4036-89cc-acc7ec7d9da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:53.190435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8c6d0-a5b2-4036-89cc-acc7ec7d9da0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:53.190907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8c6d0-a5b2-4036-89cc-acc7ec7d9da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:53.191408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8c6d0-a5b2-4036-89cc-acc7ec7d9da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:53.192251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8c6d0-a5b2-4036-89cc-acc7ec7d9da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:14:53.192731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8c6d0-a5b2-4036-89cc-acc7ec7d9da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:53.194989 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3038/6075] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:52 2022] DELETE /identity/v3/users/0bb1bac203b347d89701ee4a49bdb6b7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:53.195767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8c6d0-a5b2-4036-89cc-acc7ec7d9da0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:53.199918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d208-8276-4399-a41f-9e4892d61d87 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:53.200249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d208-8276-4399-a41f-9e4892d61d87 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:53.201292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d208-8276-4399-a41f-9e4892d61d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:53.228452 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3038/6076] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:14:53.229855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8c6d0-a5b2-4036-89cc-acc7ec7d9da0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:53.233015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-32f8c6d0-a5b2-4036-89cc-acc7ec7d9da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:53.266809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f8a9d208-8276-4399-a41f-9e4892d61d87 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:53.268226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f8a9d208-8276-4399-a41f-9e4892d61d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:53.271251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8c6d0-a5b2-4036-89cc-acc7ec7d9da0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:53.335378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:53.366137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f37e3-4ed7-4389-a1e4-336ab8a54f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:53.367206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f37e3-4ed7-4389-a1e4-336ab8a54f25 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:53.367649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f37e3-4ed7-4389-a1e4-336ab8a54f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:53.368098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f37e3-4ed7-4389-a1e4-336ab8a54f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:53.368901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f37e3-4ed7-4389-a1e4-336ab8a54f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:53.372125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f37e3-4ed7-4389-a1e4-336ab8a54f25 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:53.389068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:53.406262 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3039/6077] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:53.424224 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3039/6078] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:53 2022] POST /identity/v3/projects => generated 359 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:53.424815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d208-8276-4399-a41f-9e4892d61d87 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:53.440845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d208-8276-4399-a41f-9e4892d61d87 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:53.493116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f37e3-4ed7-4389-a1e4-336ab8a54f25 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:53.495041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7c7f37e3-4ed7-4389-a1e4-336ab8a54f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:53.569179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a65446-c20e-4683-97b9-75a7bfe17fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:53.569849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a65446-c20e-4683-97b9-75a7bfe17fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:53.570127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a65446-c20e-4683-97b9-75a7bfe17fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:53.570400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a65446-c20e-4683-97b9-75a7bfe17fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:53.571031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a65446-c20e-4683-97b9-75a7bfe17fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:53.573280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a65446-c20e-4683-97b9-75a7bfe17fe4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:53.617856 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3040/6079] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:53 2022] POST /identity/v3/users => generated 280 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:53.620234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a65446-c20e-4683-97b9-75a7bfe17fe4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:53.677231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a65446-c20e-4683-97b9-75a7bfe17fe4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:53.700884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f37e3-4ed7-4389-a1e4-336ab8a54f25 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:53.701325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930c569-5116-48a5-91c0-e08441d73bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:53.705834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930c569-5116-48a5-91c0-e08441d73bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:53.706393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930c569-5116-48a5-91c0-e08441d73bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:53.707628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930c569-5116-48a5-91c0-e08441d73bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:53.710676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930c569-5116-48a5-91c0-e08441d73bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:53.714405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930c569-5116-48a5-91c0-e08441d73bb1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:53.726267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee7c4a-efbe-475d-b70e-7070daf68fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:53.738018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7c4a-efbe-475d-b70e-7070daf68fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:53.738418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7c4a-efbe-475d-b70e-7070daf68fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:53.738691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7c4a-efbe-475d-b70e-7070daf68fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:53.748969 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3041/6080] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:53.759927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930c569-5116-48a5-91c0-e08441d73bb1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:53.795519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930c569-5116-48a5-91c0-e08441d73bb1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:53.797727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee7c4a-efbe-475d-b70e-7070daf68fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:53.805477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee7c4a-efbe-475d-b70e-7070daf68fd1 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:53.807487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee662dd-c696-48f0-aaf0-c1e202943d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:53.808124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee662dd-c696-48f0-aaf0-c1e202943d41 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:53.808403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee662dd-c696-48f0-aaf0-c1e202943d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:53.808673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee662dd-c696-48f0-aaf0-c1e202943d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:53.809348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee662dd-c696-48f0-aaf0-c1e202943d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:53.819699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee662dd-c696-48f0-aaf0-c1e202943d41 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:53.834438 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3042/6081] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:53.847604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee662dd-c696-48f0-aaf0-c1e202943d41 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:53.849609 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3040/6082] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:53.860391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee662dd-c696-48f0-aaf0-c1e202943d41 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:53.875072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714345-b354-403d-8262-cd6aad159bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:53.875942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714345-b354-403d-8262-cd6aad159bea admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:53.876231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714345-b354-403d-8262-cd6aad159bea admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:53.876544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714345-b354-403d-8262-cd6aad159bea admin admin] PATH_INFO: `/v3/projects/935605cfe00e428aa23ef63115f397a0/users/f2935fc074f24e6c9187a73ef912e6a3/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:53.929414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7714345-b354-403d-8262-cd6aad159bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=935605cfe00e428aa23ef63115f397a0, user_id=f2935fc074f24e6c9187a73ef912e6a3, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:53.932459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7714345-b354-403d-8262-cd6aad159bea admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:53.960406 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3043/6083] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:53 2022] PUT /identity/v3/projects/935605cfe00e428aa23ef63115f397a0/users/f2935fc074f24e6c9187a73ef912e6a3/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:53.969906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034e497-7168-438b-bca2-8968e1f92dad None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:53.971048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034e497-7168-438b-bca2-8968e1f92dad None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:53.971048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034e497-7168-438b-bca2-8968e1f92dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:54.020405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7034e497-7168-438b-bca2-8968e1f92dad None None] MFA Rules not processed for user `f2935fc074f24e6c9187a73ef912e6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:54.021995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7034e497-7168-438b-bca2-8968e1f92dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:54.119632 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3041/6084] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:54.177331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714345-b354-403d-8262-cd6aad159bea admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:54.261875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714345-b354-403d-8262-cd6aad159bea admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:54.265935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde45bb8-6ba6-4ff2-a26e-95767e9e53ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:54.266561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde45bb8-6ba6-4ff2-a26e-95767e9e53ad service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:54.267345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde45bb8-6ba6-4ff2-a26e-95767e9e53ad service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:54.268144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde45bb8-6ba6-4ff2-a26e-95767e9e53ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:54.278974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde45bb8-6ba6-4ff2-a26e-95767e9e53ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:54.280553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde45bb8-6ba6-4ff2-a26e-95767e9e53ad service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:54.296538 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3044/6085] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:14:55.863624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034e497-7168-438b-bca2-8968e1f92dad None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:55.865235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7034e497-7168-438b-bca2-8968e1f92dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:55.965118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034e497-7168-438b-bca2-8968e1f92dad None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:55.970834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:55.971482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:55.972016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:55.972634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] PATH_INFO: `/v3/projects/cd4b00f4dfd445418ff22da8281a5291` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:55.974008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4b00f4dfd445418ff22da8281a5291)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:55.976363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:56.048177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:56.075028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4b00f4dfd445418ff22da8281a5291', 'request_id': 'req-75945a92-fefe-46c9-9852-4ed1aaf955c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:56.089435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4b00f4dfd445418ff22da8281a5291', 'request_id': 'req-75945a92-fefe-46c9-9852-4ed1aaf955c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:56.102781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4b00f4dfd445418ff22da8281a5291', 'request_id': 'req-75945a92-fefe-46c9-9852-4ed1aaf955c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:56.124572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] The token cache is being invalidate because project cd4b00f4dfd445418ff22da8281a5291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:56.125132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:56.126002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:56.131545 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3042/6086] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:55 2022] DELETE /identity/v3/projects/cd4b00f4dfd445418ff22da8281a5291 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:56.132581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde45bb8-6ba6-4ff2-a26e-95767e9e53ad service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:56.144663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde45bb8-6ba6-4ff2-a26e-95767e9e53ad service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:56.180870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:56.231638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8455903-5e94-40c0-8ade-f89dc40ecd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:56.232293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8455903-5e94-40c0-8ade-f89dc40ecd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:56.232720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8455903-5e94-40c0-8ade-f89dc40ecd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:56.233223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8455903-5e94-40c0-8ade-f89dc40ecd13 admin admin] PATH_INFO: `/v3/users/a4dfa1783aa14a138685b38abac9af3b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:56.234220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8455903-5e94-40c0-8ade-f89dc40ecd13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4dfa1783aa14a138685b38abac9af3b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:56.237294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8455903-5e94-40c0-8ade-f89dc40ecd13 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:56.322655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8455903-5e94-40c0-8ade-f89dc40ecd13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4dfa1783aa14a138685b38abac9af3b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:56.336603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8455903-5e94-40c0-8ade-f89dc40ecd13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4dfa1783aa14a138685b38abac9af3b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:56.337679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8455903-5e94-40c0-8ade-f89dc40ecd13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4dfa1783aa14a138685b38abac9af3b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:56.338671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8455903-5e94-40c0-8ade-f89dc40ecd13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4dfa1783aa14a138685b38abac9af3b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:56.363504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8455903-5e94-40c0-8ade-f89dc40ecd13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4dfa1783aa14a138685b38abac9af3b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:56.395937 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3045/6087] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:14:56 2022] DELETE /identity/v3/users/a4dfa1783aa14a138685b38abac9af3b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:57.894895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:57.896349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:57.915817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945a92-fefe-46c9-9852-4ed1aaf955c0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:58.074958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071be92-5116-4b95-9496-bdb2b68d98ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:58.076032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071be92-5116-4b95-9496-bdb2b68d98ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:58.076324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071be92-5116-4b95-9496-bdb2b68d98ab admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:58.076607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071be92-5116-4b95-9496-bdb2b68d98ab admin admin] PATH_INFO: `/v3/projects/a21ebca1c93c4a60813567698a165528` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:58.078154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071be92-5116-4b95-9496-bdb2b68d98ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21ebca1c93c4a60813567698a165528)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:58.080998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071be92-5116-4b95-9496-bdb2b68d98ab admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:58.162137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c071be92-5116-4b95-9496-bdb2b68d98ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21ebca1c93c4a60813567698a165528', 'request_id': 'req-c071be92-5116-4b95-9496-bdb2b68d98ab'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:58.175851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c071be92-5116-4b95-9496-bdb2b68d98ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21ebca1c93c4a60813567698a165528', 'request_id': 'req-c071be92-5116-4b95-9496-bdb2b68d98ab'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:58.203260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c071be92-5116-4b95-9496-bdb2b68d98ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21ebca1c93c4a60813567698a165528', 'request_id': 'req-c071be92-5116-4b95-9496-bdb2b68d98ab'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:58.235910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c071be92-5116-4b95-9496-bdb2b68d98ab admin admin] The token cache is being invalidate because project a21ebca1c93c4a60813567698a165528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:14:58.238460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c071be92-5116-4b95-9496-bdb2b68d98ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:58.240604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c071be92-5116-4b95-9496-bdb2b68d98ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:14:58.245467 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3043/6088] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:14:57 2022] DELETE /identity/v3/projects/a21ebca1c93c4a60813567698a165528 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:58.251930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794650cc-b152-4459-a26b-40594acdbd11 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:58.252476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794650cc-b152-4459-a26b-40594acdbd11 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:58.252570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794650cc-b152-4459-a26b-40594acdbd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:58.292840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-794650cc-b152-4459-a26b-40594acdbd11 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:58.294828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-794650cc-b152-4459-a26b-40594acdbd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:58.429021 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3046/6089] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:58.437235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111c1c8-668b-48ab-9a6d-a5aaaabf7ddd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:58.437442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111c1c8-668b-48ab-9a6d-a5aaaabf7ddd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:58.437707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111c1c8-668b-48ab-9a6d-a5aaaabf7ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:58.497097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1111c1c8-668b-48ab-9a6d-a5aaaabf7ddd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:58.498411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1111c1c8-668b-48ab-9a6d-a5aaaabf7ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:58.540530 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3044/6090] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:58.541785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794650cc-b152-4459-a26b-40594acdbd11 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:58.577882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794650cc-b152-4459-a26b-40594acdbd11 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:58.585316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33577d0d-a03a-4263-9b48-f763cc03f61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:58.586493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33577d0d-a03a-4263-9b48-f763cc03f61f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:58.587160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33577d0d-a03a-4263-9b48-f763cc03f61f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:58.587442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33577d0d-a03a-4263-9b48-f763cc03f61f admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:58.588126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33577d0d-a03a-4263-9b48-f763cc03f61f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:14:58.603838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33577d0d-a03a-4263-9b48-f763cc03f61f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:58.605727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33577d0d-a03a-4263-9b48-f763cc03f61f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:58.643020 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3047/6091] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:14:58.644593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111c1c8-668b-48ab-9a6d-a5aaaabf7ddd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:58.666756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111c1c8-668b-48ab-9a6d-a5aaaabf7ddd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:58.677208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c097b8-873b-4fb5-8b71-f97b6b80bf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:58.680160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c097b8-873b-4fb5-8b71-f97b6b80bf76 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:58.680747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c097b8-873b-4fb5-8b71-f97b6b80bf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:58.681083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c097b8-873b-4fb5-8b71-f97b6b80bf76 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:58.681874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c097b8-873b-4fb5-8b71-f97b6b80bf76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:58.693678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c097b8-873b-4fb5-8b71-f97b6b80bf76 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:58.768241 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3045/6092] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:58 2022] POST /identity/v3/projects => generated 391 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:14:58.771715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33577d0d-a03a-4263-9b48-f763cc03f61f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:58.787702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33577d0d-a03a-4263-9b48-f763cc03f61f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:58.855631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:58.945486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ef27d-76ee-4be0-a271-36f614977859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:58.947434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ef27d-76ee-4be0-a271-36f614977859 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:58.947728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ef27d-76ee-4be0-a271-36f614977859 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:58.948008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ef27d-76ee-4be0-a271-36f614977859 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:58.948670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ef27d-76ee-4be0-a271-36f614977859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:58.954989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ef27d-76ee-4be0-a271-36f614977859 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:59.003923 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3048/6093] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:58 2022] POST /identity/v3/users => generated 302 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:14:59.008253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c097b8-873b-4fb5-8b71-f97b6b80bf76 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:59.025424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c097b8-873b-4fb5-8b71-f97b6b80bf76 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:59.037286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669b28e-0e7d-4095-91a6-f080d0323b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:59.038610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669b28e-0e7d-4095-91a6-f080d0323b26 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:59.039062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669b28e-0e7d-4095-91a6-f080d0323b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:59.039495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669b28e-0e7d-4095-91a6-f080d0323b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:59.040309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669b28e-0e7d-4095-91a6-f080d0323b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:59.042098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669b28e-0e7d-4095-91a6-f080d0323b26 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:59.061054 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3046/6094] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:59.065691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ef27d-76ee-4be0-a271-36f614977859 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:59.080664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ef27d-76ee-4be0-a271-36f614977859 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:59.086795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f493930-3837-4cf3-a0c7-c14c38f42fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:59.087723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f493930-3837-4cf3-a0c7-c14c38f42fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:59.088969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f493930-3837-4cf3-a0c7-c14c38f42fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:59.089499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f493930-3837-4cf3-a0c7-c14c38f42fb2 admin admin] PATH_INFO: `/v3/projects/74832c13dae343a59c6037242bbd5cbc/users/c56373cae8ad4654a2a9ec17f871e3fe/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:59.113772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f493930-3837-4cf3-a0c7-c14c38f42fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74832c13dae343a59c6037242bbd5cbc, user_id=c56373cae8ad4654a2a9ec17f871e3fe, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:59.117096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f493930-3837-4cf3-a0c7-c14c38f42fb2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:59.135124 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3049/6095] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:59 2022] PUT /identity/v3/projects/74832c13dae343a59c6037242bbd5cbc/users/c56373cae8ad4654a2a9ec17f871e3fe/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:59.139178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669b28e-0e7d-4095-91a6-f080d0323b26 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:59.148941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:59.153471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669b28e-0e7d-4095-91a6-f080d0323b26 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:59.223284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da648d-5db6-45cb-9f00-4e209b92971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:59.223836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da648d-5db6-45cb-9f00-4e209b92971e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:59.224118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da648d-5db6-45cb-9f00-4e209b92971e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:59.224398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da648d-5db6-45cb-9f00-4e209b92971e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:59.225041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da648d-5db6-45cb-9f00-4e209b92971e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:59.227024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da648d-5db6-45cb-9f00-4e209b92971e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:59.241884 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3047/6096] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:14:59.243113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f493930-3837-4cf3-a0c7-c14c38f42fb2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:59.254254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f493930-3837-4cf3-a0c7-c14c38f42fb2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:59.262921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0b84c-7211-43f8-8ce9-7a48a9da7b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:59.265372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0b84c-7211-43f8-8ce9-7a48a9da7b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:59.265805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0b84c-7211-43f8-8ce9-7a48a9da7b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:59.266196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0b84c-7211-43f8-8ce9-7a48a9da7b22 admin admin] PATH_INFO: `/v3/projects/74832c13dae343a59c6037242bbd5cbc/users/c56373cae8ad4654a2a9ec17f871e3fe/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:59.268372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0b84c-7211-43f8-8ce9-7a48a9da7b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74832c13dae343a59c6037242bbd5cbc, user_id=c56373cae8ad4654a2a9ec17f871e3fe, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:59.271136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0b84c-7211-43f8-8ce9-7a48a9da7b22 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:59.283076 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3050/6097] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:59 2022] PUT /identity/v3/projects/74832c13dae343a59c6037242bbd5cbc/users/c56373cae8ad4654a2a9ec17f871e3fe/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:14:59.294948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59db7-602d-4d82-b2d8-809a09896c24 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:59.295292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59db7-602d-4d82-b2d8-809a09896c24 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:59.295589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59db7-602d-4d82-b2d8-809a09896c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:59.325076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3fa59db7-602d-4d82-b2d8-809a09896c24 None None] MFA Rules not processed for user `c56373cae8ad4654a2a9ec17f871e3fe`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:59.326358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3fa59db7-602d-4d82-b2d8-809a09896c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:59.409639 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3048/6098] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:59.414563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0b84c-7211-43f8-8ce9-7a48a9da7b22 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:59.510203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0b84c-7211-43f8-8ce9-7a48a9da7b22 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:59.517637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124630a-d568-4b1a-ae75-5fade72a8f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:59.518268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124630a-d568-4b1a-ae75-5fade72a8f6f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:59.518550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124630a-d568-4b1a-ae75-5fade72a8f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:59.518824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124630a-d568-4b1a-ae75-5fade72a8f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:59.520584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124630a-d568-4b1a-ae75-5fade72a8f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:59.522239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124630a-d568-4b1a-ae75-5fade72a8f6f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:59.557246 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3051/6099] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:14:59 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:14:59.559266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59db7-602d-4d82-b2d8-809a09896c24 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:59.570826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59db7-602d-4d82-b2d8-809a09896c24 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:59.635292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf5a9d-7757-48be-9a69-a28eab5bfae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:59.636060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf5a9d-7757-48be-9a69-a28eab5bfae6 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:59.637446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf5a9d-7757-48be-9a69-a28eab5bfae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:59.637446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf5a9d-7757-48be-9a69-a28eab5bfae6 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:59.637446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf5a9d-7757-48be-9a69-a28eab5bfae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:59.639990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf5a9d-7757-48be-9a69-a28eab5bfae6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:59.663594 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3049/6100] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:14:59 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:14:59.667421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124630a-d568-4b1a-ae75-5fade72a8f6f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:59.677873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124630a-d568-4b1a-ae75-5fade72a8f6f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:59.682532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4d409-36ea-44a9-9006-3e41857c6e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:59.683128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4d409-36ea-44a9-9006-3e41857c6e46 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:59.683411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4d409-36ea-44a9-9006-3e41857c6e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:59.683682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4d409-36ea-44a9-9006-3e41857c6e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:59.684322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4d409-36ea-44a9-9006-3e41857c6e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:59.686183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4d409-36ea-44a9-9006-3e41857c6e46 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:59.697354 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3052/6101] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:59.713815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf5a9d-7757-48be-9a69-a28eab5bfae6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:59.726586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf5a9d-7757-48be-9a69-a28eab5bfae6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:59.731549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e1c50-bfb4-4970-8ebf-7a85a345790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:59.732170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1c50-bfb4-4970-8ebf-7a85a345790f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:59.732453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1c50-bfb4-4970-8ebf-7a85a345790f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:59.732731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1c50-bfb4-4970-8ebf-7a85a345790f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:59.733434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e1c50-bfb4-4970-8ebf-7a85a345790f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:59.735084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e1c50-bfb4-4970-8ebf-7a85a345790f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:59.746977 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3050/6102] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:14:59.750893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4d409-36ea-44a9-9006-3e41857c6e46 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:59.763977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4d409-36ea-44a9-9006-3e41857c6e46 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:14:59.770526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897aeb25-2076-4240-a3c3-7f738e5a3b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:14:59.771168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897aeb25-2076-4240-a3c3-7f738e5a3b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:59.771514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897aeb25-2076-4240-a3c3-7f738e5a3b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:59.771798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897aeb25-2076-4240-a3c3-7f738e5a3b3f admin admin] PATH_INFO: `/v3/projects/9098173efc244e3f92e8273b82465c96/users/8daa29dc4e084ba2ac02384429ca5811/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:59.789543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897aeb25-2076-4240-a3c3-7f738e5a3b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9098173efc244e3f92e8273b82465c96, user_id=8daa29dc4e084ba2ac02384429ca5811, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:14:59.792320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897aeb25-2076-4240-a3c3-7f738e5a3b3f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:14:59.810078 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3053/6103] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:14:59 2022] PUT /identity/v3/projects/9098173efc244e3f92e8273b82465c96/users/8daa29dc4e084ba2ac02384429ca5811/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:14:59.821069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc259-6e76-4753-add0-61b03a7188af None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:14:59.821395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc259-6e76-4753-add0-61b03a7188af None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:14:59.821678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc259-6e76-4753-add0-61b03a7188af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:14:59.831163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:59.856961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-899bc259-6e76-4753-add0-61b03a7188af None None] MFA Rules not processed for user `8daa29dc4e084ba2ac02384429ca5811`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:14:59.859119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-899bc259-6e76-4753-add0-61b03a7188af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:59.943564 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3051/6104] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:14:59.957120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897aeb25-2076-4240-a3c3-7f738e5a3b3f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:14:59.959320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-897aeb25-2076-4240-a3c3-7f738e5a3b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:14:59.999969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:00.047942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897aeb25-2076-4240-a3c3-7f738e5a3b3f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:00.053882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a3be9-06f7-41bb-82d9-4c0467548fc7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:00.054706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a3be9-06f7-41bb-82d9-4c0467548fc7 service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:00.054993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a3be9-06f7-41bb-82d9-4c0467548fc7 service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:00.055471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a3be9-06f7-41bb-82d9-4c0467548fc7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:00.124427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a3be9-06f7-41bb-82d9-4c0467548fc7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:00.126753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a3be9-06f7-41bb-82d9-4c0467548fc7 service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:00.138153 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3054/6105] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:14:59 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:01.510659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bc259-6e76-4753-add0-61b03a7188af None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:01.629776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bc259-6e76-4753-add0-61b03a7188af None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:01.634275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:01.635248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:01.635248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:01.635574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] PATH_INFO: `/v3/users/c56373cae8ad4654a2a9ec17f871e3fe` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:01.636745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56373cae8ad4654a2a9ec17f871e3fe)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:01.638920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:01.702969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56373cae8ad4654a2a9ec17f871e3fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:01.717623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56373cae8ad4654a2a9ec17f871e3fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:01.718652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56373cae8ad4654a2a9ec17f871e3fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:01.719545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56373cae8ad4654a2a9ec17f871e3fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:01.741598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56373cae8ad4654a2a9ec17f871e3fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:01.772526 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3052/6106] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:15:01 2022] DELETE /identity/v3/users/c56373cae8ad4654a2a9ec17f871e3fe => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:01.774683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e83353-067b-452d-95ea-996f3c4282d8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:01.775180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e83353-067b-452d-95ea-996f3c4282d8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:01.775493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e83353-067b-452d-95ea-996f3c4282d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:01.815159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-88e83353-067b-452d-95ea-996f3c4282d8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:01.818700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-88e83353-067b-452d-95ea-996f3c4282d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:01.977839 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3055/6107] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:01.992833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:01.995367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:02.061072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:02.177927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22e136-1c5d-48a8-be97-7ef07fe6d686 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:02.184111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa7d62-c2bb-45b6-baf6-48f463146eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:02.184866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa7d62-c2bb-45b6-baf6-48f463146eed service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:02.185153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa7d62-c2bb-45b6-baf6-48f463146eed service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:02.185469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa7d62-c2bb-45b6-baf6-48f463146eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:02.198744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa7d62-c2bb-45b6-baf6-48f463146eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:02.200624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa7d62-c2bb-45b6-baf6-48f463146eed service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:02.218003 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3053/6108] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:03.188267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e83353-067b-452d-95ea-996f3c4282d8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:03.189851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-88e83353-067b-452d-95ea-996f3c4282d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:03.214811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e83353-067b-452d-95ea-996f3c4282d8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:03.236435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:03.237096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:03.239525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:03.240138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215 admin admin] PATH_INFO: `/v3/projects/74832c13dae343a59c6037242bbd5cbc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:03.243699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74832c13dae343a59c6037242bbd5cbc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:03.253258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:03.356732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74832c13dae343a59c6037242bbd5cbc', 'request_id': 'req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:03.379734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74832c13dae343a59c6037242bbd5cbc', 'request_id': 'req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:03.395718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74832c13dae343a59c6037242bbd5cbc', 'request_id': 'req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:03.397612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:03.426738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215 admin admin] The token cache is being invalidate because project 74832c13dae343a59c6037242bbd5cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:15:03.428377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:03.430262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aa20cf8b-d363-4dc1-ac74-7ff74a25e215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:03.436867 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3056/6109] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:15:03 2022] DELETE /identity/v3/projects/74832c13dae343a59c6037242bbd5cbc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:03.441993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa7d62-c2bb-45b6-baf6-48f463146eed service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:03.459137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa7d62-c2bb-45b6-baf6-48f463146eed service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:03.632261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:03.632932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:03.633351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:03.633587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] PATH_INFO: `/v3/users/8daa29dc4e084ba2ac02384429ca5811` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:03.636035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8daa29dc4e084ba2ac02384429ca5811)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:03.638340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:03.716531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8daa29dc4e084ba2ac02384429ca5811'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:03.730156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8daa29dc4e084ba2ac02384429ca5811'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:03.730579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8daa29dc4e084ba2ac02384429ca5811'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:03.731611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8daa29dc4e084ba2ac02384429ca5811'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:03.755550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8daa29dc4e084ba2ac02384429ca5811'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:03.789820 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3054/6110] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:15:03 2022] DELETE /identity/v3/users/8daa29dc4e084ba2ac02384429ca5811 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:04.092550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770a338-b06f-4f7a-bd48-254bb885542d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:04.092832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770a338-b06f-4f7a-bd48-254bb885542d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:04.093085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770a338-b06f-4f7a-bd48-254bb885542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:04.127795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1770a338-b06f-4f7a-bd48-254bb885542d None None] MFA Rules not processed for user `de71b64a2e1c4b6aaa15b5ee75003add`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:04.129298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1770a338-b06f-4f7a-bd48-254bb885542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:04.249385 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3057/6111] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:05.297359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:05.300737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:05.332989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770a338-b06f-4f7a-bd48-254bb885542d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:05.334479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1770a338-b06f-4f7a-bd48-254bb885542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:05.386276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:05.439251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445fec2-fcf3-4143-903f-3dd22995dbbf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:05.444431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe35b74-645b-4ce9-a8ff-0cb41e1094af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:05.456836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe35b74-645b-4ce9-a8ff-0cb41e1094af service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:05.459013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe35b74-645b-4ce9-a8ff-0cb41e1094af service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:05.459013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe35b74-645b-4ce9-a8ff-0cb41e1094af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:05.490305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ebe35b74-645b-4ce9-a8ff-0cb41e1094af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:05.506814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770a338-b06f-4f7a-bd48-254bb885542d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:05.514219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:05.515136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:05.515689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:05.515982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4 admin admin] PATH_INFO: `/v3/projects/9098173efc244e3f92e8273b82465c96` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:05.522248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9098173efc244e3f92e8273b82465c96)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:05.524250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:05.541155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe35b74-645b-4ce9-a8ff-0cb41e1094af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:05.547495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe35b74-645b-4ce9-a8ff-0cb41e1094af service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:05.563516 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3055/6112] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:05.613762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9098173efc244e3f92e8273b82465c96', 'request_id': 'req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:05.624789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9098173efc244e3f92e8273b82465c96', 'request_id': 'req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:05.632484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9098173efc244e3f92e8273b82465c96', 'request_id': 'req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:05.646340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4 admin admin] The token cache is being invalidate because project 9098173efc244e3f92e8273b82465c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:15:05.646634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:05.647656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a376aa0-86cd-4b3f-a1df-5bbeed8b4ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:05.649591 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3058/6113] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:15:05 2022] DELETE /identity/v3/projects/9098173efc244e3f92e8273b82465c96 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:15:05.654424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1a4d2-5218-4ba6-843b-601f4841ec85 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:05.654710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1a4d2-5218-4ba6-843b-601f4841ec85 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:05.654987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1a4d2-5218-4ba6-843b-601f4841ec85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:05.694903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e8c1a4d2-5218-4ba6-843b-601f4841ec85 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:05.696388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e8c1a4d2-5218-4ba6-843b-601f4841ec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:05.794980 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3056/6114] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:05.804056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716e95a-f6e8-494d-9c52-e34e54afbbe6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:05.804350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716e95a-f6e8-494d-9c52-e34e54afbbe6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:05.804633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716e95a-f6e8-494d-9c52-e34e54afbbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:05.826849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1716e95a-f6e8-494d-9c52-e34e54afbbe6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:05.828562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1716e95a-f6e8-494d-9c52-e34e54afbbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:05.841967 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3059/6115] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:15:05.846854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1a4d2-5218-4ba6-843b-601f4841ec85 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:05.861125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1a4d2-5218-4ba6-843b-601f4841ec85 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:05.867999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148c37e-9451-4059-b2e6-1386f8c7c4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:05.869038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148c37e-9451-4059-b2e6-1386f8c7c4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:05.869422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148c37e-9451-4059-b2e6-1386f8c7c4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:05.869842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148c37e-9451-4059-b2e6-1386f8c7c4a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:05.870621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148c37e-9451-4059-b2e6-1386f8c7c4a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:15:05.871030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148c37e-9451-4059-b2e6-1386f8c7c4a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:05.872952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148c37e-9451-4059-b2e6-1386f8c7c4a3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:05.890150 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3057/6116] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:15:05.894612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716e95a-f6e8-494d-9c52-e34e54afbbe6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:05.922208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716e95a-f6e8-494d-9c52-e34e54afbbe6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:05.936720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d14399-e3e3-475e-af0a-e494fdc6ddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:05.938152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d14399-e3e3-475e-af0a-e494fdc6ddca admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:05.939491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d14399-e3e3-475e-af0a-e494fdc6ddca admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:05.940084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d14399-e3e3-475e-af0a-e494fdc6ddca admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:05.942314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d14399-e3e3-475e-af0a-e494fdc6ddca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:05.944341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d14399-e3e3-475e-af0a-e494fdc6ddca admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:05.995144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:06.008238 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3060/6117] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:15:05 2022] POST /identity/v3/projects => generated 359 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:06.012426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148c37e-9451-4059-b2e6-1386f8c7c4a3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:06.030268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148c37e-9451-4059-b2e6-1386f8c7c4a3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:06.118954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7feb3-1fd0-4afc-bb50-d3aedb4b50ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:06.121864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7feb3-1fd0-4afc-bb50-d3aedb4b50ec admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:06.122937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7feb3-1fd0-4afc-bb50-d3aedb4b50ec admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:06.123447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7feb3-1fd0-4afc-bb50-d3aedb4b50ec admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:06.125082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7feb3-1fd0-4afc-bb50-d3aedb4b50ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:06.127853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7feb3-1fd0-4afc-bb50-d3aedb4b50ec admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:06.159190 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3058/6118] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:15:06 2022] POST /identity/v3/users => generated 280 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:06.160812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d14399-e3e3-475e-af0a-e494fdc6ddca admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:06.172762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d14399-e3e3-475e-af0a-e494fdc6ddca admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:06.188044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44b38-7943-4faa-8900-f7a0ffa62c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:06.188751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44b38-7943-4faa-8900-f7a0ffa62c30 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:06.189039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44b38-7943-4faa-8900-f7a0ffa62c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:06.189342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44b38-7943-4faa-8900-f7a0ffa62c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:06.190000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e44b38-7943-4faa-8900-f7a0ffa62c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:06.191632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e44b38-7943-4faa-8900-f7a0ffa62c30 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:06.207218 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3061/6119] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:06.208475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7feb3-1fd0-4afc-bb50-d3aedb4b50ec admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:06.221137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7feb3-1fd0-4afc-bb50-d3aedb4b50ec admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:06.227968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af54fd7-1bb1-433b-a5a7-af7bbfe2d71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:06.228593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af54fd7-1bb1-433b-a5a7-af7bbfe2d71f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:06.228868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af54fd7-1bb1-433b-a5a7-af7bbfe2d71f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:06.229248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af54fd7-1bb1-433b-a5a7-af7bbfe2d71f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:06.229963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af54fd7-1bb1-433b-a5a7-af7bbfe2d71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:06.231550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af54fd7-1bb1-433b-a5a7-af7bbfe2d71f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:06.284894 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3059/6120] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:06.289094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44b38-7943-4faa-8900-f7a0ffa62c30 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:06.304901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44b38-7943-4faa-8900-f7a0ffa62c30 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:06.310905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dd06d-f101-46c7-bf2b-40a65434606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:06.312406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dd06d-f101-46c7-bf2b-40a65434606f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:06.312837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dd06d-f101-46c7-bf2b-40a65434606f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:06.313467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dd06d-f101-46c7-bf2b-40a65434606f admin admin] PATH_INFO: `/v3/projects/4498f276876d4d00a21a1f7f6d280aa1/users/954f9ea297ed4cb49df18d041dc8dcd5/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:06.347336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dd06d-f101-46c7-bf2b-40a65434606f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4498f276876d4d00a21a1f7f6d280aa1, user_id=954f9ea297ed4cb49df18d041dc8dcd5, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:06.350912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dd06d-f101-46c7-bf2b-40a65434606f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:06.396136 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3062/6121] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:06 2022] PUT /identity/v3/projects/4498f276876d4d00a21a1f7f6d280aa1/users/954f9ea297ed4cb49df18d041dc8dcd5/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:06.492991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41611b91-29d1-48c8-b7f3-f0225efe242c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:06.494208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41611b91-29d1-48c8-b7f3-f0225efe242c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:06.494658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41611b91-29d1-48c8-b7f3-f0225efe242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:06.540776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-41611b91-29d1-48c8-b7f3-f0225efe242c None None] MFA Rules not processed for user `954f9ea297ed4cb49df18d041dc8dcd5`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:06.542220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-41611b91-29d1-48c8-b7f3-f0225efe242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:06.582331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:06.634551 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3060/6122] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:06.643649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dd06d-f101-46c7-bf2b-40a65434606f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:06.750488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dd06d-f101-46c7-bf2b-40a65434606f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:06.756407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:06.758321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:06.759640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:06.760149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] PATH_INFO: `/v3/users/954f9ea297ed4cb49df18d041dc8dcd5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:06.761999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=954f9ea297ed4cb49df18d041dc8dcd5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:06.765731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:06.860559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954f9ea297ed4cb49df18d041dc8dcd5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:06.886699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954f9ea297ed4cb49df18d041dc8dcd5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:06.887837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954f9ea297ed4cb49df18d041dc8dcd5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:06.889535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954f9ea297ed4cb49df18d041dc8dcd5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:06.911222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954f9ea297ed4cb49df18d041dc8dcd5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:06.971180 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3063/6123] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:15:06 2022] DELETE /identity/v3/users/954f9ea297ed4cb49df18d041dc8dcd5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:06.975207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57068d19-9a80-48fe-8fc5-fdd902a593eb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:06.975537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57068d19-9a80-48fe-8fc5-fdd902a593eb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:06.977121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57068d19-9a80-48fe-8fc5-fdd902a593eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:07.017768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-57068d19-9a80-48fe-8fc5-fdd902a593eb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:07.019236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-57068d19-9a80-48fe-8fc5-fdd902a593eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:07.167693 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3061/6124] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:07.230170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:07.232716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:07.284352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:07.306357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dace31-8f3c-4977-9ee2-23c42f73aecf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:07.317171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e4590-2dda-4be5-8fd0-b44cdad4a37f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:07.319240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e4590-2dda-4be5-8fd0-b44cdad4a37f service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:07.319688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e4590-2dda-4be5-8fd0-b44cdad4a37f service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:07.320037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e4590-2dda-4be5-8fd0-b44cdad4a37f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:07.337362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e4590-2dda-4be5-8fd0-b44cdad4a37f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:07.339382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e4590-2dda-4be5-8fd0-b44cdad4a37f service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:07.352988 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3064/6125] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:09.284449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57068d19-9a80-48fe-8fc5-fdd902a593eb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:09.286929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-57068d19-9a80-48fe-8fc5-fdd902a593eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:09.304745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57068d19-9a80-48fe-8fc5-fdd902a593eb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:09.322174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fd675-cbee-40ec-83b2-6687b00c5961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:09.323314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fd675-cbee-40ec-83b2-6687b00c5961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:09.323798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fd675-cbee-40ec-83b2-6687b00c5961 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:09.324325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fd675-cbee-40ec-83b2-6687b00c5961 admin admin] PATH_INFO: `/v3/projects/4498f276876d4d00a21a1f7f6d280aa1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:09.326282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fd675-cbee-40ec-83b2-6687b00c5961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4498f276876d4d00a21a1f7f6d280aa1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:09.329485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fd675-cbee-40ec-83b2-6687b00c5961 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:09.495759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d94fd675-cbee-40ec-83b2-6687b00c5961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4498f276876d4d00a21a1f7f6d280aa1', 'request_id': 'req-d94fd675-cbee-40ec-83b2-6687b00c5961'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:09.520786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d94fd675-cbee-40ec-83b2-6687b00c5961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4498f276876d4d00a21a1f7f6d280aa1', 'request_id': 'req-d94fd675-cbee-40ec-83b2-6687b00c5961'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:09.537365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d94fd675-cbee-40ec-83b2-6687b00c5961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4498f276876d4d00a21a1f7f6d280aa1', 'request_id': 'req-d94fd675-cbee-40ec-83b2-6687b00c5961'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:09.567206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d94fd675-cbee-40ec-83b2-6687b00c5961 admin admin] The token cache is being invalidate because project 4498f276876d4d00a21a1f7f6d280aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:15:09.567923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d94fd675-cbee-40ec-83b2-6687b00c5961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:09.568905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d94fd675-cbee-40ec-83b2-6687b00c5961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:09.570802 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3062/6126] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:15:09 2022] DELETE /identity/v3/projects/4498f276876d4d00a21a1f7f6d280aa1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:09.575875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0944e-8dc7-4071-85c3-451be7de9655 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:09.576417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0944e-8dc7-4071-85c3-451be7de9655 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:09.576417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0944e-8dc7-4071-85c3-451be7de9655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:09.609237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e1f0944e-8dc7-4071-85c3-451be7de9655 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:09.611425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e1f0944e-8dc7-4071-85c3-451be7de9655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:09.776266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05e98a-4aaa-467c-ab7a-6b782f47b2ed None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:09.779055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05e98a-4aaa-467c-ab7a-6b782f47b2ed None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:09.779563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05e98a-4aaa-467c-ab7a-6b782f47b2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:09.783897 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3065/6127] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:09.819690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7b05e98a-4aaa-467c-ab7a-6b782f47b2ed None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:09.821483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7b05e98a-4aaa-467c-ab7a-6b782f47b2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:09.838472 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3063/6128] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:15:09.839795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0944e-8dc7-4071-85c3-451be7de9655 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:09.855733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0944e-8dc7-4071-85c3-451be7de9655 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:09.865720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4938eb-ce6e-4e8a-9ad2-6c0c670095ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:09.866518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4938eb-ce6e-4e8a-9ad2-6c0c670095ae admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:09.866997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4938eb-ce6e-4e8a-9ad2-6c0c670095ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:09.867500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4938eb-ce6e-4e8a-9ad2-6c0c670095ae admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:09.869435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4938eb-ce6e-4e8a-9ad2-6c0c670095ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:15:09.870148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4938eb-ce6e-4e8a-9ad2-6c0c670095ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:09.872834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4938eb-ce6e-4e8a-9ad2-6c0c670095ae admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:09.900817 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3066/6129] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:15:09.905927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05e98a-4aaa-467c-ab7a-6b782f47b2ed None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:09.928145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05e98a-4aaa-467c-ab7a-6b782f47b2ed None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:09.941098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd4e7a-0553-4dca-a287-37ea0c04ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:09.941926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd4e7a-0553-4dca-a287-37ea0c04ff20 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:09.946472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd4e7a-0553-4dca-a287-37ea0c04ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:09.946799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd4e7a-0553-4dca-a287-37ea0c04ff20 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:09.947708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd4e7a-0553-4dca-a287-37ea0c04ff20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:09.949839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd4e7a-0553-4dca-a287-37ea0c04ff20 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:10.004855 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3064/6130] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:15:09 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:15:10.008899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4938eb-ce6e-4e8a-9ad2-6c0c670095ae admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:10.025941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4938eb-ce6e-4e8a-9ad2-6c0c670095ae admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:10.111201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010a331-8e4b-402e-ae44-ec382d825149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:10.112203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010a331-8e4b-402e-ae44-ec382d825149 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:10.112655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010a331-8e4b-402e-ae44-ec382d825149 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:10.113243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010a331-8e4b-402e-ae44-ec382d825149 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:10.114214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010a331-8e4b-402e-ae44-ec382d825149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:10.116987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010a331-8e4b-402e-ae44-ec382d825149 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:10.156949 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3067/6131] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:15:10 2022] POST /identity/v3/users => generated 284 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:10.160730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd4e7a-0553-4dca-a287-37ea0c04ff20 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:10.178802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd4e7a-0553-4dca-a287-37ea0c04ff20 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:10.189786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3bae2-3271-4419-a8f2-046a8d359640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:10.191992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3bae2-3271-4419-a8f2-046a8d359640 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:10.192354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3bae2-3271-4419-a8f2-046a8d359640 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:10.192642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3bae2-3271-4419-a8f2-046a8d359640 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:10.196061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3bae2-3271-4419-a8f2-046a8d359640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:10.197844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3bae2-3271-4419-a8f2-046a8d359640 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:10.218894 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3065/6132] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:10.221631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010a331-8e4b-402e-ae44-ec382d825149 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:10.240750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010a331-8e4b-402e-ae44-ec382d825149 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:10.247489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006c17d-73cc-4039-91a5-0f918edb8564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:10.248359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006c17d-73cc-4039-91a5-0f918edb8564 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:10.248812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006c17d-73cc-4039-91a5-0f918edb8564 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:10.249457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006c17d-73cc-4039-91a5-0f918edb8564 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:10.250500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006c17d-73cc-4039-91a5-0f918edb8564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:10.252576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006c17d-73cc-4039-91a5-0f918edb8564 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:10.273162 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3068/6133] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:10.273422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3bae2-3271-4419-a8f2-046a8d359640 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:10.283306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006c17d-73cc-4039-91a5-0f918edb8564 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:10.285284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a006c17d-73cc-4039-91a5-0f918edb8564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:10.288436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3bae2-3271-4419-a8f2-046a8d359640 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:10.304707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80500564-6a52-4356-9643-1058f669f1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:10.305792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80500564-6a52-4356-9643-1058f669f1c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:10.306082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80500564-6a52-4356-9643-1058f669f1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:10.306363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80500564-6a52-4356-9643-1058f669f1c1 admin admin] PATH_INFO: `/v3/projects/c8a8d606b1494556bfe5d92e8c722105/users/b4a31e8f85b44f349dd0ef0dd04a2d78/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:10.339871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80500564-6a52-4356-9643-1058f669f1c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a8d606b1494556bfe5d92e8c722105, user_id=b4a31e8f85b44f349dd0ef0dd04a2d78, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:10.342816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80500564-6a52-4356-9643-1058f669f1c1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:10.345864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:10.375605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:10.386610 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3066/6134] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:10 2022] PUT /identity/v3/projects/c8a8d606b1494556bfe5d92e8c722105/users/b4a31e8f85b44f349dd0ef0dd04a2d78/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:10.390857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd7a06-8c6b-4e8c-8aae-7be0f7468f07 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:10.391402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd7a06-8c6b-4e8c-8aae-7be0f7468f07 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:10.391879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd7a06-8c6b-4e8c-8aae-7be0f7468f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:10.431231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-69fd7a06-8c6b-4e8c-8aae-7be0f7468f07 None None] MFA Rules not processed for user `b4a31e8f85b44f349dd0ef0dd04a2d78`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:10.433037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-69fd7a06-8c6b-4e8c-8aae-7be0f7468f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:10.442001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006c17d-73cc-4039-91a5-0f918edb8564 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:10.613802 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3067/6135] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:10.621679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd7a06-8c6b-4e8c-8aae-7be0f7468f07 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:10.634502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f971e-2e49-4f01-82d8-f1ab6dc6ff01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:10.635122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f971e-2e49-4f01-82d8-f1ab6dc6ff01 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:10.635122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f971e-2e49-4f01-82d8-f1ab6dc6ff01 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:10.635551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f971e-2e49-4f01-82d8-f1ab6dc6ff01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:10.637672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-115f971e-2e49-4f01-82d8-f1ab6dc6ff01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:10.665237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f971e-2e49-4f01-82d8-f1ab6dc6ff01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:10.671268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f971e-2e49-4f01-82d8-f1ab6dc6ff01 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:10.705411 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3069/6136] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:10.753567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd7a06-8c6b-4e8c-8aae-7be0f7468f07 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:10.764104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2cb8-f1e1-4d1d-9a01-c5d7cb467ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:10.764741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2cb8-f1e1-4d1d-9a01-c5d7cb467ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:10.768025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2cb8-f1e1-4d1d-9a01-c5d7cb467ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:10.768698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2cb8-f1e1-4d1d-9a01-c5d7cb467ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:10.768989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2cb8-f1e1-4d1d-9a01-c5d7cb467ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:10.771785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2cb8-f1e1-4d1d-9a01-c5d7cb467ef4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:10.833416 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3068/6137] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:15:10 2022] POST /identity/v3/projects => generated 367 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:10.835993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f971e-2e49-4f01-82d8-f1ab6dc6ff01 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:10.850896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f971e-2e49-4f01-82d8-f1ab6dc6ff01 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:11.013743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8ed03-a2a2-47aa-868c-25bb0a244833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:11.014830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8ed03-a2a2-47aa-868c-25bb0a244833 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:11.015476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8ed03-a2a2-47aa-868c-25bb0a244833 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:11.015937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8ed03-a2a2-47aa-868c-25bb0a244833 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:11.020182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8ed03-a2a2-47aa-868c-25bb0a244833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:11.024543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8ed03-a2a2-47aa-868c-25bb0a244833 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:11.066848 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3070/6138] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:15:10 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:11.070475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2cb8-f1e1-4d1d-9a01-c5d7cb467ef4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:11.105310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2cb8-f1e1-4d1d-9a01-c5d7cb467ef4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:11.116022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0424e-29a1-44ea-8d06-c51ad0bd271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:11.117088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0424e-29a1-44ea-8d06-c51ad0bd271c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:11.117554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0424e-29a1-44ea-8d06-c51ad0bd271c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:11.117985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0424e-29a1-44ea-8d06-c51ad0bd271c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:11.118926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0424e-29a1-44ea-8d06-c51ad0bd271c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:11.127949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0424e-29a1-44ea-8d06-c51ad0bd271c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:11.141670 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3069/6139] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:15:11.145839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8ed03-a2a2-47aa-868c-25bb0a244833 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:11.159315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8ed03-a2a2-47aa-868c-25bb0a244833 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:11.172845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce87000-7787-4dec-a2f9-f86aa5bb931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:11.175829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce87000-7787-4dec-a2f9-f86aa5bb931e admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:11.176446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce87000-7787-4dec-a2f9-f86aa5bb931e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:11.176956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce87000-7787-4dec-a2f9-f86aa5bb931e admin admin] PATH_INFO: `/v3/projects/f8c7ad284231439a9351bdf9be50a0f2/users/5cb5dbcfe081459fb6f652ed76f770f6/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:11.232177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce87000-7787-4dec-a2f9-f86aa5bb931e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c7ad284231439a9351bdf9be50a0f2, user_id=5cb5dbcfe081459fb6f652ed76f770f6, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:11.236626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce87000-7787-4dec-a2f9-f86aa5bb931e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:11.262773 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3071/6140] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:11 2022] PUT /identity/v3/projects/f8c7ad284231439a9351bdf9be50a0f2/users/5cb5dbcfe081459fb6f652ed76f770f6/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:11.266610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0424e-29a1-44ea-8d06-c51ad0bd271c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:11.285590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0424e-29a1-44ea-8d06-c51ad0bd271c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:11.400966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:11.412616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb9123-f68e-41d6-9d99-86f1a1673e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:11.413613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb9123-f68e-41d6-9d99-86f1a1673e10 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:11.413904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb9123-f68e-41d6-9d99-86f1a1673e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:11.414179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb9123-f68e-41d6-9d99-86f1a1673e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:11.414845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb9123-f68e-41d6-9d99-86f1a1673e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:11.416550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb9123-f68e-41d6-9d99-86f1a1673e10 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:11.439347 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3070/6141] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:11.448503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce87000-7787-4dec-a2f9-f86aa5bb931e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:11.473368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce87000-7787-4dec-a2f9-f86aa5bb931e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:11.507128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58423e36-2a73-4c8c-b085-15087c478e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:11.507895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58423e36-2a73-4c8c-b085-15087c478e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:11.508367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58423e36-2a73-4c8c-b085-15087c478e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:11.508649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58423e36-2a73-4c8c-b085-15087c478e7c admin admin] PATH_INFO: `/v3/projects/f8c7ad284231439a9351bdf9be50a0f2/users/5cb5dbcfe081459fb6f652ed76f770f6/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:11.512741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58423e36-2a73-4c8c-b085-15087c478e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c7ad284231439a9351bdf9be50a0f2, user_id=5cb5dbcfe081459fb6f652ed76f770f6, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:11.518329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58423e36-2a73-4c8c-b085-15087c478e7c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:11.541309 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3072/6142] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:11 2022] PUT /identity/v3/projects/f8c7ad284231439a9351bdf9be50a0f2/users/5cb5dbcfe081459fb6f652ed76f770f6/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:11.544295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcbb9d-71a5-4074-a6c2-a7abda9b1576 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:11.544614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcbb9d-71a5-4074-a6c2-a7abda9b1576 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:11.544894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcbb9d-71a5-4074-a6c2-a7abda9b1576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:11.615884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-57bcbb9d-71a5-4074-a6c2-a7abda9b1576 None None] MFA Rules not processed for user `5cb5dbcfe081459fb6f652ed76f770f6`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:11.617354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-57bcbb9d-71a5-4074-a6c2-a7abda9b1576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:11.805178 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3071/6143] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:11.901558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58423e36-2a73-4c8c-b085-15087c478e7c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:11.904952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-58423e36-2a73-4c8c-b085-15087c478e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:11.976578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:12.046213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58423e36-2a73-4c8c-b085-15087c478e7c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:12.053272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02086414-4ba1-4ec8-92fd-93b7b129ad32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:12.054017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02086414-4ba1-4ec8-92fd-93b7b129ad32 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:12.054399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02086414-4ba1-4ec8-92fd-93b7b129ad32 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:12.054796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02086414-4ba1-4ec8-92fd-93b7b129ad32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:12.083171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02086414-4ba1-4ec8-92fd-93b7b129ad32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:12.084920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02086414-4ba1-4ec8-92fd-93b7b129ad32 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:12.109783 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3073/6144] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:13.435909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcbb9d-71a5-4074-a6c2-a7abda9b1576 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:13.441447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-57bcbb9d-71a5-4074-a6c2-a7abda9b1576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:13.606338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcbb9d-71a5-4074-a6c2-a7abda9b1576 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:13.623877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:13.624700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:13.626184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:13.626579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] PATH_INFO: `/v3/users/512c04944a214073b424b8fee847887d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:13.628022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=512c04944a214073b424b8fee847887d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:13.632033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:13.768820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '512c04944a214073b424b8fee847887d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:13.790920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '512c04944a214073b424b8fee847887d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:13.791747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '512c04944a214073b424b8fee847887d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:13.792370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '512c04944a214073b424b8fee847887d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:13.826686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '512c04944a214073b424b8fee847887d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:13.861705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:13.889418 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3072/6145] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:15:13 2022] DELETE /identity/v3/users/512c04944a214073b424b8fee847887d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:13.893933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c2762-08f0-44d9-b678-eccc56ba3347 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:13.894759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c2762-08f0-44d9-b678-eccc56ba3347 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:13.895222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c2762-08f0-44d9-b678-eccc56ba3347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:13.940605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c58c2762-08f0-44d9-b678-eccc56ba3347 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:13.942061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c58c2762-08f0-44d9-b678-eccc56ba3347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:14.121807 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3074/6146] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:14.153225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:14.155944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:14.294851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8b0c6-f25e-4b68-ba7c-5612b824a915 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:14.305830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da82a5-39ef-4f39-a66b-52ff359c7096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:14.306268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da82a5-39ef-4f39-a66b-52ff359c7096 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:14.306652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da82a5-39ef-4f39-a66b-52ff359c7096 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:14.306932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da82a5-39ef-4f39-a66b-52ff359c7096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:14.341861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da82a5-39ef-4f39-a66b-52ff359c7096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:14.349267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da82a5-39ef-4f39-a66b-52ff359c7096 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:14.365337 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3073/6147] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:15.178008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c2762-08f0-44d9-b678-eccc56ba3347 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:15.179596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c58c2762-08f0-44d9-b678-eccc56ba3347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:15.197968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c2762-08f0-44d9-b678-eccc56ba3347 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:15.214313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12751e5e-aabe-4089-a777-5779850cdc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:15.215073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751e5e-aabe-4089-a777-5779850cdc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:15.215539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751e5e-aabe-4089-a777-5779850cdc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:15.227182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751e5e-aabe-4089-a777-5779850cdc7c admin admin] PATH_INFO: `/v3/projects/7a71b28a90e8417e965f79ff54d93365` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:15.230492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12751e5e-aabe-4089-a777-5779850cdc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a71b28a90e8417e965f79ff54d93365)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:15.234966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12751e5e-aabe-4089-a777-5779850cdc7c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:15.305999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-12751e5e-aabe-4089-a777-5779850cdc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a71b28a90e8417e965f79ff54d93365', 'request_id': 'req-12751e5e-aabe-4089-a777-5779850cdc7c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:15.317363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-12751e5e-aabe-4089-a777-5779850cdc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a71b28a90e8417e965f79ff54d93365', 'request_id': 'req-12751e5e-aabe-4089-a777-5779850cdc7c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:15.331132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-12751e5e-aabe-4089-a777-5779850cdc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a71b28a90e8417e965f79ff54d93365', 'request_id': 'req-12751e5e-aabe-4089-a777-5779850cdc7c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:15.355204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-12751e5e-aabe-4089-a777-5779850cdc7c admin admin] The token cache is being invalidate because project 7a71b28a90e8417e965f79ff54d93365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:15:15.357969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-12751e5e-aabe-4089-a777-5779850cdc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:15.359518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-12751e5e-aabe-4089-a777-5779850cdc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:15.362924 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3075/6148] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:15:15 2022] DELETE /identity/v3/projects/7a71b28a90e8417e965f79ff54d93365 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:15.368559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82aef8-b91e-45a0-82b9-ed126d4a5843 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:15.369067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82aef8-b91e-45a0-82b9-ed126d4a5843 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:15.369226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82aef8-b91e-45a0-82b9-ed126d4a5843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:15.402644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1d82aef8-b91e-45a0-82b9-ed126d4a5843 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:15.404586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1d82aef8-b91e-45a0-82b9-ed126d4a5843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:15.530388 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3074/6149] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:15.538545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21dbc1-194f-4324-8956-9978a94ae244 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:15.538958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21dbc1-194f-4324-8956-9978a94ae244 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:15.539337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21dbc1-194f-4324-8956-9978a94ae244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:15.581086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0d21dbc1-194f-4324-8956-9978a94ae244 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:15.582490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0d21dbc1-194f-4324-8956-9978a94ae244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:15.602883 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3076/6150] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:15.607436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82aef8-b91e-45a0-82b9-ed126d4a5843 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:15.623243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82aef8-b91e-45a0-82b9-ed126d4a5843 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:15.638552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fa477-f29c-4149-9499-8126fff89f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:15.639198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fa477-f29c-4149-9499-8126fff89f23 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:15.639485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fa477-f29c-4149-9499-8126fff89f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:15.639790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fa477-f29c-4149-9499-8126fff89f23 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:15.640489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fa477-f29c-4149-9499-8126fff89f23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:15:15.640800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fa477-f29c-4149-9499-8126fff89f23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:15.647427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fa477-f29c-4149-9499-8126fff89f23 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:15.691065 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3075/6151] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:15:15.697461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21dbc1-194f-4324-8956-9978a94ae244 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:15.738340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21dbc1-194f-4324-8956-9978a94ae244 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:15.753906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788097dc-eba6-4807-8293-0cc01d0661d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:15.756272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788097dc-eba6-4807-8293-0cc01d0661d8 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:15.756775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788097dc-eba6-4807-8293-0cc01d0661d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:15.757303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788097dc-eba6-4807-8293-0cc01d0661d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:15.759188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788097dc-eba6-4807-8293-0cc01d0661d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:15.762312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788097dc-eba6-4807-8293-0cc01d0661d8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:15.823500 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3077/6152] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:15:15 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:15.826130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fa477-f29c-4149-9499-8126fff89f23 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:15.854400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fa477-f29c-4149-9499-8126fff89f23 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:15.974422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac829d-a3f4-4304-9f81-d92976f9d42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:15.976505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac829d-a3f4-4304-9f81-d92976f9d42a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:15.976901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac829d-a3f4-4304-9f81-d92976f9d42a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:15.977316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac829d-a3f4-4304-9f81-d92976f9d42a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:15.978068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac829d-a3f4-4304-9f81-d92976f9d42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:15.988615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac829d-a3f4-4304-9f81-d92976f9d42a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:16.062848 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3076/6153] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:15:15 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:16.067185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788097dc-eba6-4807-8293-0cc01d0661d8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:16.084145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788097dc-eba6-4807-8293-0cc01d0661d8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:16.099349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e53ba0-5495-4f4b-9674-d47780724e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:16.100119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e53ba0-5495-4f4b-9674-d47780724e5f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:16.100403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e53ba0-5495-4f4b-9674-d47780724e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:16.100927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e53ba0-5495-4f4b-9674-d47780724e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:16.101604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e53ba0-5495-4f4b-9674-d47780724e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:16.106852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e53ba0-5495-4f4b-9674-d47780724e5f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:16.123606 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3078/6154] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:16.128026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac829d-a3f4-4304-9f81-d92976f9d42a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:16.153899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac829d-a3f4-4304-9f81-d92976f9d42a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:16.163984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b91587-2fb6-4e84-bfb4-6de9530eb60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:16.164550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b91587-2fb6-4e84-bfb4-6de9530eb60d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:16.164936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b91587-2fb6-4e84-bfb4-6de9530eb60d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:16.165348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b91587-2fb6-4e84-bfb4-6de9530eb60d admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:16.166245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b91587-2fb6-4e84-bfb4-6de9530eb60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:16.169937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b91587-2fb6-4e84-bfb4-6de9530eb60d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:16.194025 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3077/6155] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:16.203110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e53ba0-5495-4f4b-9674-d47780724e5f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:16.213649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e53ba0-5495-4f4b-9674-d47780724e5f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:16.220644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66db324-e925-4c26-8bfa-8fbf01cd0940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:16.221376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66db324-e925-4c26-8bfa-8fbf01cd0940 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:16.221899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66db324-e925-4c26-8bfa-8fbf01cd0940 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:16.222172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66db324-e925-4c26-8bfa-8fbf01cd0940 admin admin] PATH_INFO: `/v3/projects/b71ca510f84c4abd891cab667165572e/users/4e5b591592214435bf4c1b7f14dd9b93/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:16.241480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:16.249358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66db324-e925-4c26-8bfa-8fbf01cd0940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b71ca510f84c4abd891cab667165572e, user_id=4e5b591592214435bf4c1b7f14dd9b93, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:16.252559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66db324-e925-4c26-8bfa-8fbf01cd0940 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:16.281099 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3079/6156] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:16 2022] PUT /identity/v3/projects/b71ca510f84c4abd891cab667165572e/users/4e5b591592214435bf4c1b7f14dd9b93/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:16.401942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457bc8b-f35a-47ff-9c2f-6b5f7f5aa1b3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:16.402600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457bc8b-f35a-47ff-9c2f-6b5f7f5aa1b3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:16.402600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457bc8b-f35a-47ff-9c2f-6b5f7f5aa1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:16.423571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:16.462346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a457bc8b-f35a-47ff-9c2f-6b5f7f5aa1b3 None None] MFA Rules not processed for user `4e5b591592214435bf4c1b7f14dd9b93`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:16.464117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a457bc8b-f35a-47ff-9c2f-6b5f7f5aa1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:16.639595 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3078/6157] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:15:16.643783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66db324-e925-4c26-8bfa-8fbf01cd0940 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:16.756157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66db324-e925-4c26-8bfa-8fbf01cd0940 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:16.761605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfb70f-d6b0-4e51-9a1a-fdc0771bf83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:16.762649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfb70f-d6b0-4e51-9a1a-fdc0771bf83f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:16.762845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfb70f-d6b0-4e51-9a1a-fdc0771bf83f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:16.763302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfb70f-d6b0-4e51-9a1a-fdc0771bf83f admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:16.764739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfb70f-d6b0-4e51-9a1a-fdc0771bf83f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:16.768038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfb70f-d6b0-4e51-9a1a-fdc0771bf83f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:16.810616 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3080/6158] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:15:16 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:16.814750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457bc8b-f35a-47ff-9c2f-6b5f7f5aa1b3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:16.831101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457bc8b-f35a-47ff-9c2f-6b5f7f5aa1b3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:16.944509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31626352-b129-4f40-8b70-0fab634c32bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:16.945361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31626352-b129-4f40-8b70-0fab634c32bd admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:16.946422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31626352-b129-4f40-8b70-0fab634c32bd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:16.946815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31626352-b129-4f40-8b70-0fab634c32bd admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:16.947572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31626352-b129-4f40-8b70-0fab634c32bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:16.950102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31626352-b129-4f40-8b70-0fab634c32bd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:16.979363 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3079/6159] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:15:16 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:16.980966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfb70f-d6b0-4e51-9a1a-fdc0771bf83f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:16.995274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfb70f-d6b0-4e51-9a1a-fdc0771bf83f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:17.001704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33d73-7f08-40e9-844d-234519b848ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:17.002650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33d73-7f08-40e9-844d-234519b848ec admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:17.003041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33d73-7f08-40e9-844d-234519b848ec admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:17.003425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33d73-7f08-40e9-844d-234519b848ec admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:17.005066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c33d73-7f08-40e9-844d-234519b848ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:17.006965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c33d73-7f08-40e9-844d-234519b848ec admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:17.023422 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3081/6160] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:17.027771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31626352-b129-4f40-8b70-0fab634c32bd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:17.047356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31626352-b129-4f40-8b70-0fab634c32bd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:17.052787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498b14c-c22a-4ae3-b6e8-4b571d969f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:17.053693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498b14c-c22a-4ae3-b6e8-4b571d969f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:17.054050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498b14c-c22a-4ae3-b6e8-4b571d969f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:17.054396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498b14c-c22a-4ae3-b6e8-4b571d969f89 admin admin] PATH_INFO: `/v3/projects/00529fbcfb5746488ded8ba86107af17/users/e2d7e3826b20402691dca3a91b6b2aa5/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:17.080555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498b14c-c22a-4ae3-b6e8-4b571d969f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00529fbcfb5746488ded8ba86107af17, user_id=e2d7e3826b20402691dca3a91b6b2aa5, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:17.083442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498b14c-c22a-4ae3-b6e8-4b571d969f89 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:17.110662 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3080/6161] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:17 2022] PUT /identity/v3/projects/00529fbcfb5746488ded8ba86107af17/users/e2d7e3826b20402691dca3a91b6b2aa5/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:17.114569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33d73-7f08-40e9-844d-234519b848ec admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:17.127650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33d73-7f08-40e9-844d-234519b848ec admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:17.269315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1c909-141a-41e2-b4ad-953e21214587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:17.271519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1c909-141a-41e2-b4ad-953e21214587 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:17.272346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1c909-141a-41e2-b4ad-953e21214587 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:17.273325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1c909-141a-41e2-b4ad-953e21214587 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:17.275550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1c909-141a-41e2-b4ad-953e21214587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:17.277667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1c909-141a-41e2-b4ad-953e21214587 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:17.308019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498b14c-c22a-4ae3-b6e8-4b571d969f89 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:17.308603 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3082/6162] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:17.324739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498b14c-c22a-4ae3-b6e8-4b571d969f89 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:17.339497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bcd21-e539-402f-9701-246cb066fd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:17.339497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bcd21-e539-402f-9701-246cb066fd68 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:17.339497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bcd21-e539-402f-9701-246cb066fd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:17.339497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bcd21-e539-402f-9701-246cb066fd68 admin admin] PATH_INFO: `/v3/projects/00529fbcfb5746488ded8ba86107af17/users/e2d7e3826b20402691dca3a91b6b2aa5/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:17.342902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bcd21-e539-402f-9701-246cb066fd68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00529fbcfb5746488ded8ba86107af17, user_id=e2d7e3826b20402691dca3a91b6b2aa5, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:17.349556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bcd21-e539-402f-9701-246cb066fd68 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:17.367784 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3081/6163] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:17 2022] PUT /identity/v3/projects/00529fbcfb5746488ded8ba86107af17/users/e2d7e3826b20402691dca3a91b6b2aa5/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:15:17.369740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c03d0-e9d5-4dde-9894-8ed15471bd79 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:17.370142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c03d0-e9d5-4dde-9894-8ed15471bd79 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:17.370524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c03d0-e9d5-4dde-9894-8ed15471bd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:17.421360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8c0c03d0-e9d5-4dde-9894-8ed15471bd79 None None] MFA Rules not processed for user `e2d7e3826b20402691dca3a91b6b2aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:17.423323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8c0c03d0-e9d5-4dde-9894-8ed15471bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:17.429963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bcd21-e539-402f-9701-246cb066fd68 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:17.432676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-626bcd21-e539-402f-9701-246cb066fd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:17.516098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:17.537044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:17.561743 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3083/6164] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:17.576443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c03d0-e9d5-4dde-9894-8ed15471bd79 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:17.578242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8c0c03d0-e9d5-4dde-9894-8ed15471bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:17.585706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bcd21-e539-402f-9701-246cb066fd68 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:17.591597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72e5bb-43b8-4829-8e38-b38a8a536508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:17.601682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e5bb-43b8-4829-8e38-b38a8a536508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:17.602269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e5bb-43b8-4829-8e38-b38a8a536508 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:17.602704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e5bb-43b8-4829-8e38-b38a8a536508 admin admin] PATH_INFO: `/v3/users/b4a31e8f85b44f349dd0ef0dd04a2d78` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:17.604733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72e5bb-43b8-4829-8e38-b38a8a536508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a31e8f85b44f349dd0ef0dd04a2d78)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:17.607037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72e5bb-43b8-4829-8e38-b38a8a536508 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:17.689034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac72e5bb-43b8-4829-8e38-b38a8a536508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a31e8f85b44f349dd0ef0dd04a2d78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:17.699164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac72e5bb-43b8-4829-8e38-b38a8a536508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a31e8f85b44f349dd0ef0dd04a2d78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:17.700367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac72e5bb-43b8-4829-8e38-b38a8a536508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a31e8f85b44f349dd0ef0dd04a2d78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:17.701785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac72e5bb-43b8-4829-8e38-b38a8a536508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a31e8f85b44f349dd0ef0dd04a2d78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:17.723817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac72e5bb-43b8-4829-8e38-b38a8a536508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a31e8f85b44f349dd0ef0dd04a2d78'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:17.736959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c03d0-e9d5-4dde-9894-8ed15471bd79 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:17.743302 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3082/6165] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:15:17 2022] DELETE /identity/v3/users/b4a31e8f85b44f349dd0ef0dd04a2d78 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:17.748545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ead37-170e-4f08-ba72-6add65b81a65 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:17.748545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ead37-170e-4f08-ba72-6add65b81a65 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:17.748545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ead37-170e-4f08-ba72-6add65b81a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:17.750350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb0fa5-4406-4893-bd2a-cf62b8473fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:17.751333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb0fa5-4406-4893-bd2a-cf62b8473fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:17.751616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb0fa5-4406-4893-bd2a-cf62b8473fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:17.751889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb0fa5-4406-4893-bd2a-cf62b8473fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:17.754396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9bfb0fa5-4406-4893-bd2a-cf62b8473fe7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:17.770367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb0fa5-4406-4893-bd2a-cf62b8473fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:17.772661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb0fa5-4406-4893-bd2a-cf62b8473fe7 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:17.774594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-043ead37-170e-4f08-ba72-6add65b81a65 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:17.776721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-043ead37-170e-4f08-ba72-6add65b81a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:17.799598 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3084/6166] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:15:17.878882 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3083/6167] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:17.895485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb0fa5-4406-4893-bd2a-cf62b8473fe7 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:17.898297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9bfb0fa5-4406-4893-bd2a-cf62b8473fe7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:17.971592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ead37-170e-4f08-ba72-6add65b81a65 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:17.973995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-043ead37-170e-4f08-ba72-6add65b81a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:17.990244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ead37-170e-4f08-ba72-6add65b81a65 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:17.995803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:17.997041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:17.997427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:17.997773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] PATH_INFO: `/v3/users/4e5b591592214435bf4c1b7f14dd9b93` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:17.999111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5b591592214435bf4c1b7f14dd9b93)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:18.001851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:18.033580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb0fa5-4406-4893-bd2a-cf62b8473fe7 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:18.115219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5b591592214435bf4c1b7f14dd9b93'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:18.125214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5b591592214435bf4c1b7f14dd9b93'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:18.126278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5b591592214435bf4c1b7f14dd9b93'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:18.127239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5b591592214435bf4c1b7f14dd9b93'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:18.133801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90a703-c4db-4416-963e-f746d7409fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:18.134727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90a703-c4db-4416-963e-f746d7409fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:18.137205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90a703-c4db-4416-963e-f746d7409fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:18.138068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90a703-c4db-4416-963e-f746d7409fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:18.140295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8b90a703-c4db-4416-963e-f746d7409fd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:18.141714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:18.159929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5b591592214435bf4c1b7f14dd9b93'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:18.161013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90a703-c4db-4416-963e-f746d7409fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:18.163202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90a703-c4db-4416-963e-f746d7409fd5 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:18.184966 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3085/6168] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:18.190602 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3084/6169] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:15:17 2022] DELETE /identity/v3/users/4e5b591592214435bf4c1b7f14dd9b93 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:15:18.192513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c1bc0-d514-449e-b5a9-b34cb4d23cb5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:18.192803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c1bc0-d514-449e-b5a9-b34cb4d23cb5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:18.193078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c1bc0-d514-449e-b5a9-b34cb4d23cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:18.227705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d22c1bc0-d514-449e-b5a9-b34cb4d23cb5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:18.228950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d22c1bc0-d514-449e-b5a9-b34cb4d23cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:18.284340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:18.342701 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3086/6170] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:18.361127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:18.363345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:18.467331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3451e-bffe-4eca-b2ea-55216040cd6b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:18.472150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0650feb-ef93-438f-9319-dcfd37defb21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:18.472795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0650feb-ef93-438f-9319-dcfd37defb21 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:18.473078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0650feb-ef93-438f-9319-dcfd37defb21 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:18.473377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0650feb-ef93-438f-9319-dcfd37defb21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:18.490431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0650feb-ef93-438f-9319-dcfd37defb21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:18.491832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0650feb-ef93-438f-9319-dcfd37defb21 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:18.506569 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3085/6171] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:19.511294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c1bc0-d514-449e-b5a9-b34cb4d23cb5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:19.517671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d22c1bc0-d514-449e-b5a9-b34cb4d23cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:19.537657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c1bc0-d514-449e-b5a9-b34cb4d23cb5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:19.562404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:19.563083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:19.564224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:19.564503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] PATH_INFO: `/v3/projects/c8a8d606b1494556bfe5d92e8c722105` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:19.566846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a8d606b1494556bfe5d92e8c722105)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:19.568786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:19.714796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a8d606b1494556bfe5d92e8c722105', 'request_id': 'req-8a95474b-1c45-4848-a31d-c6bd6c28eee5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:19.733111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a8d606b1494556bfe5d92e8c722105', 'request_id': 'req-8a95474b-1c45-4848-a31d-c6bd6c28eee5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:19.743631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a8d606b1494556bfe5d92e8c722105', 'request_id': 'req-8a95474b-1c45-4848-a31d-c6bd6c28eee5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:19.776015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] The token cache is being invalidate because project c8a8d606b1494556bfe5d92e8c722105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:15:19.776316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:19.779535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:19.789068 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3087/6172] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:15:19 2022] DELETE /identity/v3/projects/c8a8d606b1494556bfe5d92e8c722105 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:19.789893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0650feb-ef93-438f-9319-dcfd37defb21 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:19.800160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0650feb-ef93-438f-9319-dcfd37defb21 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:19.869153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:19.870307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:19.870866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:19.871477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] PATH_INFO: `/v3/users/5cb5dbcfe081459fb6f652ed76f770f6` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:19.873493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb5dbcfe081459fb6f652ed76f770f6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:19.875686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:19.935661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb5dbcfe081459fb6f652ed76f770f6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:19.947752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb5dbcfe081459fb6f652ed76f770f6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:19.948536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb5dbcfe081459fb6f652ed76f770f6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:19.949420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb5dbcfe081459fb6f652ed76f770f6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:19.964648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb5dbcfe081459fb6f652ed76f770f6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:19.980570 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3086/6173] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:15:19 2022] DELETE /identity/v3/users/5cb5dbcfe081459fb6f652ed76f770f6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:15:19.997549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:19.999521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:20.018923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95474b-1c45-4848-a31d-c6bd6c28eee5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:20.231814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:20.233749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:20.236073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:20.237860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] PATH_INFO: `/v3/projects/b71ca510f84c4abd891cab667165572e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:20.239750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b71ca510f84c4abd891cab667165572e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:20.242849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:20.341529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b71ca510f84c4abd891cab667165572e', 'request_id': 'req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.363465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b71ca510f84c4abd891cab667165572e', 'request_id': 'req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.371111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:20.374218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b71ca510f84c4abd891cab667165572e', 'request_id': 'req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.426192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] The token cache is being invalidate because project b71ca510f84c4abd891cab667165572e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:15:20.426619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.427445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.431303 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3088/6174] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:15:19 2022] DELETE /identity/v3/projects/b71ca510f84c4abd891cab667165572e => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:20.434800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:20.436577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:20.450570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:20.475987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5577ee-e65f-4532-9af6-e423c2e71a34 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:20.638590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7c0ea-0104-4fee-8a0b-9eb42e7ab78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:20.638590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7c0ea-0104-4fee-8a0b-9eb42e7ab78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:20.638590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7c0ea-0104-4fee-8a0b-9eb42e7ab78c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:20.638590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7c0ea-0104-4fee-8a0b-9eb42e7ab78c admin admin] PATH_INFO: `/v3/users/e2d7e3826b20402691dca3a91b6b2aa5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:20.640869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7c0ea-0104-4fee-8a0b-9eb42e7ab78c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d7e3826b20402691dca3a91b6b2aa5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:20.643314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7c0ea-0104-4fee-8a0b-9eb42e7ab78c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:20.646676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:20.660663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:20.697969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7221d4-00d6-486f-9ebe-fc24d0b6dd99 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:20.713973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c88f8-b8de-4b86-80c0-199e278bd95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:20.714640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c88f8-b8de-4b86-80c0-199e278bd95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:20.714927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c88f8-b8de-4b86-80c0-199e278bd95b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:20.715288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c88f8-b8de-4b86-80c0-199e278bd95b admin admin] PATH_INFO: `/v3/projects/f8c7ad284231439a9351bdf9be50a0f2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:20.720948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c88f8-b8de-4b86-80c0-199e278bd95b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c7ad284231439a9351bdf9be50a0f2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:20.723106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c88f8-b8de-4b86-80c0-199e278bd95b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:20.784587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e9a7c0ea-0104-4fee-8a0b-9eb42e7ab78c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d7e3826b20402691dca3a91b6b2aa5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.802050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e9a7c0ea-0104-4fee-8a0b-9eb42e7ab78c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d7e3826b20402691dca3a91b6b2aa5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.804111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e9a7c0ea-0104-4fee-8a0b-9eb42e7ab78c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d7e3826b20402691dca3a91b6b2aa5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.805713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e9a7c0ea-0104-4fee-8a0b-9eb42e7ab78c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d7e3826b20402691dca3a91b6b2aa5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.832154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e9a7c0ea-0104-4fee-8a0b-9eb42e7ab78c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d7e3826b20402691dca3a91b6b2aa5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.835701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc8c88f8-b8de-4b86-80c0-199e278bd95b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c7ad284231439a9351bdf9be50a0f2', 'request_id': 'req-bc8c88f8-b8de-4b86-80c0-199e278bd95b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.857153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc8c88f8-b8de-4b86-80c0-199e278bd95b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c7ad284231439a9351bdf9be50a0f2', 'request_id': 'req-bc8c88f8-b8de-4b86-80c0-199e278bd95b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.861440 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3087/6175] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:15:20 2022] DELETE /identity/v3/users/e2d7e3826b20402691dca3a91b6b2aa5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:20.873056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc8c88f8-b8de-4b86-80c0-199e278bd95b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c7ad284231439a9351bdf9be50a0f2', 'request_id': 'req-bc8c88f8-b8de-4b86-80c0-199e278bd95b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.894893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc8c88f8-b8de-4b86-80c0-199e278bd95b admin admin] The token cache is being invalidate because project f8c7ad284231439a9351bdf9be50a0f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:15:20.895953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc8c88f8-b8de-4b86-80c0-199e278bd95b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.896971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc8c88f8-b8de-4b86-80c0-199e278bd95b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:20.899550 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3089/6176] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:15:20 2022] DELETE /identity/v3/projects/f8c7ad284231439a9351bdf9be50a0f2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:15:20.905279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c59d4-a767-457f-9a9f-6b15c3d66b66 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:20.905562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c59d4-a767-457f-9a9f-6b15c3d66b66 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:20.906217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c59d4-a767-457f-9a9f-6b15c3d66b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:20.941402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-952c59d4-a767-457f-9a9f-6b15c3d66b66 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:20.943323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-952c59d4-a767-457f-9a9f-6b15c3d66b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:21.058971 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3088/6177] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:21.067114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2f658-de30-4b96-9afc-24e87a8e7bce None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:21.067497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2f658-de30-4b96-9afc-24e87a8e7bce None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:21.067861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2f658-de30-4b96-9afc-24e87a8e7bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:21.102574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c4a2f658-de30-4b96-9afc-24e87a8e7bce None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:21.103716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c4a2f658-de30-4b96-9afc-24e87a8e7bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:21.119071 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3090/6178] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:21.123298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c59d4-a767-457f-9a9f-6b15c3d66b66 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:21.139505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c59d4-a767-457f-9a9f-6b15c3d66b66 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:21.156096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7e469-8a12-4417-aa9e-6b6f128b3519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:21.156738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7e469-8a12-4417-aa9e-6b6f128b3519 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:21.157696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7e469-8a12-4417-aa9e-6b6f128b3519 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:21.157980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7e469-8a12-4417-aa9e-6b6f128b3519 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:21.158692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7e469-8a12-4417-aa9e-6b6f128b3519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:15:21.158999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7e469-8a12-4417-aa9e-6b6f128b3519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:21.160631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7e469-8a12-4417-aa9e-6b6f128b3519 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:21.180938 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3089/6179] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:15:21.184880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2f658-de30-4b96-9afc-24e87a8e7bce None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:21.197125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2f658-de30-4b96-9afc-24e87a8e7bce None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:21.203244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d244d3-379e-48e1-883d-08ec5ed8c8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:21.204780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d244d3-379e-48e1-883d-08ec5ed8c8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:21.205362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d244d3-379e-48e1-883d-08ec5ed8c8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:21.205734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d244d3-379e-48e1-883d-08ec5ed8c8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:21.206987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d244d3-379e-48e1-883d-08ec5ed8c8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:21.209150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d244d3-379e-48e1-883d-08ec5ed8c8d4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:21.257881 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3091/6180] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:15:21 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:15:21.261869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7e469-8a12-4417-aa9e-6b6f128b3519 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:21.277994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7e469-8a12-4417-aa9e-6b6f128b3519 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:21.286923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:21.375593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775a1a3-d17f-4cb2-83d9-973f5c9f11a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:21.377872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a1a3-d17f-4cb2-83d9-973f5c9f11a1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:21.378564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a1a3-d17f-4cb2-83d9-973f5c9f11a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:21.379131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a1a3-d17f-4cb2-83d9-973f5c9f11a1 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:21.380369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775a1a3-d17f-4cb2-83d9-973f5c9f11a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:21.382812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775a1a3-d17f-4cb2-83d9-973f5c9f11a1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:21.422646 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3090/6181] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:15:21 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:21.427122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d244d3-379e-48e1-883d-08ec5ed8c8d4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:21.447663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d244d3-379e-48e1-883d-08ec5ed8c8d4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:21.454787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef89b1-7139-471e-ab5d-3b1dfdedf81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:21.455791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef89b1-7139-471e-ab5d-3b1dfdedf81b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:21.456251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef89b1-7139-471e-ab5d-3b1dfdedf81b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:21.456720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef89b1-7139-471e-ab5d-3b1dfdedf81b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:21.457498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef89b1-7139-471e-ab5d-3b1dfdedf81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:21.459196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef89b1-7139-471e-ab5d-3b1dfdedf81b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:21.488091 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3092/6182] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:21.494239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775a1a3-d17f-4cb2-83d9-973f5c9f11a1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:21.510383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775a1a3-d17f-4cb2-83d9-973f5c9f11a1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:21.526437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8133-c5db-49fa-a4c5-d75ede885d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:21.527813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8133-c5db-49fa-a4c5-d75ede885d5e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:21.528416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8133-c5db-49fa-a4c5-d75ede885d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:21.529082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8133-c5db-49fa-a4c5-d75ede885d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:21.530366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b8133-c5db-49fa-a4c5-d75ede885d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:21.533744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b8133-c5db-49fa-a4c5-d75ede885d5e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:21.564984 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3091/6183] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:21.571868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef89b1-7139-471e-ab5d-3b1dfdedf81b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:21.591249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef89b1-7139-471e-ab5d-3b1dfdedf81b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:21.597767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8133-c5db-49fa-a4c5-d75ede885d5e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:21.599657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-537b8133-c5db-49fa-a4c5-d75ede885d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:21.605933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f36d9-99be-49aa-8ea2-304be6937181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:21.607769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f36d9-99be-49aa-8ea2-304be6937181 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:21.608294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f36d9-99be-49aa-8ea2-304be6937181 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:21.608625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f36d9-99be-49aa-8ea2-304be6937181 admin admin] PATH_INFO: `/v3/projects/a4a7293fb4ce491693974bd285f04609/users/79ab2ee3f8744e769ea54aa19cfd44e9/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:21.623067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8133-c5db-49fa-a4c5-d75ede885d5e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:21.633179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31434760-5f2f-4e26-9e3f-98c622b54174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:21.633876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434760-5f2f-4e26-9e3f-98c622b54174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:21.634155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434760-5f2f-4e26-9e3f-98c622b54174 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:21.634447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31434760-5f2f-4e26-9e3f-98c622b54174 admin admin] PATH_INFO: `/v3/projects/00529fbcfb5746488ded8ba86107af17` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:21.637703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31434760-5f2f-4e26-9e3f-98c622b54174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00529fbcfb5746488ded8ba86107af17)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:21.639716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31434760-5f2f-4e26-9e3f-98c622b54174 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:21.642915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f36d9-99be-49aa-8ea2-304be6937181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a7293fb4ce491693974bd285f04609, user_id=79ab2ee3f8744e769ea54aa19cfd44e9, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:21.648706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f36d9-99be-49aa-8ea2-304be6937181 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:21.691842 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3093/6184] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:21 2022] PUT /identity/v3/projects/a4a7293fb4ce491693974bd285f04609/users/79ab2ee3f8744e769ea54aa19cfd44e9/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:21.696020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e2a5c-8f22-4922-969b-e903b2fcabcd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:21.696020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e2a5c-8f22-4922-969b-e903b2fcabcd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:21.696020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e2a5c-8f22-4922-969b-e903b2fcabcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:21.766754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-607e2a5c-8f22-4922-969b-e903b2fcabcd None None] MFA Rules not processed for user `79ab2ee3f8744e769ea54aa19cfd44e9`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:21.768702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-607e2a5c-8f22-4922-969b-e903b2fcabcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:21.784907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-31434760-5f2f-4e26-9e3f-98c622b54174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00529fbcfb5746488ded8ba86107af17', 'request_id': 'req-31434760-5f2f-4e26-9e3f-98c622b54174'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:21.818179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-31434760-5f2f-4e26-9e3f-98c622b54174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00529fbcfb5746488ded8ba86107af17', 'request_id': 'req-31434760-5f2f-4e26-9e3f-98c622b54174'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:21.827658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-31434760-5f2f-4e26-9e3f-98c622b54174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00529fbcfb5746488ded8ba86107af17', 'request_id': 'req-31434760-5f2f-4e26-9e3f-98c622b54174'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:21.846980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-31434760-5f2f-4e26-9e3f-98c622b54174 admin admin] The token cache is being invalidate because project 00529fbcfb5746488ded8ba86107af17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:15:21.847453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-31434760-5f2f-4e26-9e3f-98c622b54174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:21.848141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-31434760-5f2f-4e26-9e3f-98c622b54174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:21.856444 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3092/6185] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:15:21 2022] DELETE /identity/v3/projects/00529fbcfb5746488ded8ba86107af17 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:21.857940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99500b-e2be-49ea-b74d-294330a5c4a5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:21.859346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99500b-e2be-49ea-b74d-294330a5c4a5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:21.859566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99500b-e2be-49ea-b74d-294330a5c4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:21.902543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0c99500b-e2be-49ea-b74d-294330a5c4a5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:21.905026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0c99500b-e2be-49ea-b74d-294330a5c4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:21.927422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:21.937978 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3094/6186] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:21.942141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e2a5c-8f22-4922-969b-e903b2fcabcd None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:21.943803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-607e2a5c-8f22-4922-969b-e903b2fcabcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:22.025512 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3093/6187] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:22.039080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fe004-77d9-42ac-a3fd-19ba3b66799c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:22.039438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fe004-77d9-42ac-a3fd-19ba3b66799c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:22.039719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fe004-77d9-42ac-a3fd-19ba3b66799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:22.114088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e2a5c-8f22-4922-969b-e903b2fcabcd None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:22.115388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cc2fe004-77d9-42ac-a3fd-19ba3b66799c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:22.118800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cc2fe004-77d9-42ac-a3fd-19ba3b66799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:22.133862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f691b5a-67ee-445c-b228-582151d30899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:22.134836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f691b5a-67ee-445c-b228-582151d30899 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:22.135508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f691b5a-67ee-445c-b228-582151d30899 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:22.136276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f691b5a-67ee-445c-b228-582151d30899 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:22.137748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f691b5a-67ee-445c-b228-582151d30899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:22.142239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f691b5a-67ee-445c-b228-582151d30899 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:22.147686 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3094/6188] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:22.152419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fe004-77d9-42ac-a3fd-19ba3b66799c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:22.167553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:22.176597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fe004-77d9-42ac-a3fd-19ba3b66799c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:22.186982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403da65-0121-4c8c-98cb-c25390a2c4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:22.188442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403da65-0121-4c8c-98cb-c25390a2c4bf admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:22.189008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403da65-0121-4c8c-98cb-c25390a2c4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:22.189823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403da65-0121-4c8c-98cb-c25390a2c4bf admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:22.190867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403da65-0121-4c8c-98cb-c25390a2c4bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:15:22.191424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403da65-0121-4c8c-98cb-c25390a2c4bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:22.206649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403da65-0121-4c8c-98cb-c25390a2c4bf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:22.217810 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3095/6189] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:15:21 2022] POST /identity/v3/projects => generated 367 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:22.222735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f691b5a-67ee-445c-b228-582151d30899 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:22.239369 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3095/6190] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:15:22.251050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403da65-0121-4c8c-98cb-c25390a2c4bf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:22.272241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403da65-0121-4c8c-98cb-c25390a2c4bf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:22.391337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91b0a7-f509-4504-94a5-671c0a03a671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:22.392025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91b0a7-f509-4504-94a5-671c0a03a671 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:22.392313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91b0a7-f509-4504-94a5-671c0a03a671 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:22.392588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91b0a7-f509-4504-94a5-671c0a03a671 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:22.393259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91b0a7-f509-4504-94a5-671c0a03a671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:22.412587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91b0a7-f509-4504-94a5-671c0a03a671 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:22.425629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f691b5a-67ee-445c-b228-582151d30899 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:22.443705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683fd42-7dd9-47c6-97ac-a11d51bdb9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:22.444957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683fd42-7dd9-47c6-97ac-a11d51bdb9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:22.445478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683fd42-7dd9-47c6-97ac-a11d51bdb9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:22.445961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683fd42-7dd9-47c6-97ac-a11d51bdb9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:22.446992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683fd42-7dd9-47c6-97ac-a11d51bdb9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:22.450240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683fd42-7dd9-47c6-97ac-a11d51bdb9c1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:22.511781 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3096/6191] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:15:22 2022] POST /identity/v3/projects => generated 381 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:15:22.517313 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3096/6192] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:15:22 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:22.518174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91b0a7-f509-4504-94a5-671c0a03a671 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:22.519733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683fd42-7dd9-47c6-97ac-a11d51bdb9c1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:22.562364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683fd42-7dd9-47c6-97ac-a11d51bdb9c1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:22.771093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91b0a7-f509-4504-94a5-671c0a03a671 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:22.778893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54532b3-2c42-4dc2-8f05-fcd62a2c1908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:22.779609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54532b3-2c42-4dc2-8f05-fcd62a2c1908 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:22.780862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54532b3-2c42-4dc2-8f05-fcd62a2c1908 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:22.782309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54532b3-2c42-4dc2-8f05-fcd62a2c1908 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:22.783002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54532b3-2c42-4dc2-8f05-fcd62a2c1908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:22.784624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54532b3-2c42-4dc2-8f05-fcd62a2c1908 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:22.791128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed37e3-cd2f-4085-beb5-65337b5cee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:22.791753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed37e3-cd2f-4085-beb5-65337b5cee8b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:22.792036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed37e3-cd2f-4085-beb5-65337b5cee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:22.792297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed37e3-cd2f-4085-beb5-65337b5cee8b admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:22.792930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed37e3-cd2f-4085-beb5-65337b5cee8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:22.794909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed37e3-cd2f-4085-beb5-65337b5cee8b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:22.812798 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3097/6193] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:22.814922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54532b3-2c42-4dc2-8f05-fcd62a2c1908 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:22.831392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54532b3-2c42-4dc2-8f05-fcd62a2c1908 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:22.846132 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3097/6194] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:15:22 2022] POST /identity/v3/users => generated 291 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:22.848076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed37e3-cd2f-4085-beb5-65337b5cee8b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:22.851711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cb94e-ab06-455d-b6d6-2c6a26f89da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:22.855818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cb94e-ab06-455d-b6d6-2c6a26f89da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:22.856908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cb94e-ab06-455d-b6d6-2c6a26f89da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:22.858423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cb94e-ab06-455d-b6d6-2c6a26f89da6 admin admin] PATH_INFO: `/v3/projects/be109f34c3c94294aa6ce8e419a64a41/users/e988bf0a7f9a40e99f838ae4147ddbd7/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:22.875339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed37e3-cd2f-4085-beb5-65337b5cee8b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:22.878015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:22.892626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee05da8-758e-4a79-8101-7126e2a9d65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:22.893061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee05da8-758e-4a79-8101-7126e2a9d65e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:22.893376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee05da8-758e-4a79-8101-7126e2a9d65e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:22.893654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee05da8-758e-4a79-8101-7126e2a9d65e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:22.894839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cb94e-ab06-455d-b6d6-2c6a26f89da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be109f34c3c94294aa6ce8e419a64a41, user_id=e988bf0a7f9a40e99f838ae4147ddbd7, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:22.895974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee05da8-758e-4a79-8101-7126e2a9d65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:22.898756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cb94e-ab06-455d-b6d6-2c6a26f89da6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:22.901527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee05da8-758e-4a79-8101-7126e2a9d65e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:22.966267 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3098/6195] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:22 2022] PUT /identity/v3/projects/be109f34c3c94294aa6ce8e419a64a41/users/e988bf0a7f9a40e99f838ae4147ddbd7/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:22.974028 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3098/6196] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:22.975026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee05da8-758e-4a79-8101-7126e2a9d65e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:22.976837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cb94e-ab06-455d-b6d6-2c6a26f89da6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:23.016162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee05da8-758e-4a79-8101-7126e2a9d65e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:23.112347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:23.145319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f1e97-ca43-43ff-973a-b3e02bb87bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:23.145950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f1e97-ca43-43ff-973a-b3e02bb87bec admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:23.146644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f1e97-ca43-43ff-973a-b3e02bb87bec admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:23.167264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f1e97-ca43-43ff-973a-b3e02bb87bec admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:23.168023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f1e97-ca43-43ff-973a-b3e02bb87bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:23.181871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f1e97-ca43-43ff-973a-b3e02bb87bec admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:23.222413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cb94e-ab06-455d-b6d6-2c6a26f89da6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:23.262862 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3099/6197] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:23.263591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37623207-e2e5-4fe0-b3cd-908fc6d5550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:23.264448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f1e97-ca43-43ff-973a-b3e02bb87bec admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:23.264597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37623207-e2e5-4fe0-b3cd-908fc6d5550d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:23.264917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37623207-e2e5-4fe0-b3cd-908fc6d5550d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:23.265217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37623207-e2e5-4fe0-b3cd-908fc6d5550d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:23.265878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37623207-e2e5-4fe0-b3cd-908fc6d5550d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:23.268748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37623207-e2e5-4fe0-b3cd-908fc6d5550d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:23.304107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f1e97-ca43-43ff-973a-b3e02bb87bec admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:23.311930 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3099/6198] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:23.314939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37623207-e2e5-4fe0-b3cd-908fc6d5550d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:23.318631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edd44a-72cd-4c79-94fb-12e231bf4a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:23.319430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd44a-72cd-4c79-94fb-12e231bf4a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:23.319792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd44a-72cd-4c79-94fb-12e231bf4a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:23.322122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd44a-72cd-4c79-94fb-12e231bf4a53 admin admin] PATH_INFO: `/v3/projects/64d2965f2beb43ce8004ca62c59739f8/users/61b5ebddaf27412da1e7955cff384cb3/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:23.345537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37623207-e2e5-4fe0-b3cd-908fc6d5550d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:23.372105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edd44a-72cd-4c79-94fb-12e231bf4a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d2965f2beb43ce8004ca62c59739f8, user_id=61b5ebddaf27412da1e7955cff384cb3, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:23.378274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edd44a-72cd-4c79-94fb-12e231bf4a53 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:23.384801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e459633-0c14-4c9e-b0db-b6296b5e601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:23.385595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e459633-0c14-4c9e-b0db-b6296b5e601c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:23.385924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e459633-0c14-4c9e-b0db-b6296b5e601c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:23.386203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e459633-0c14-4c9e-b0db-b6296b5e601c admin admin] PATH_INFO: `/v3/projects/be109f34c3c94294aa6ce8e419a64a41/users/e988bf0a7f9a40e99f838ae4147ddbd7/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:23.390566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e459633-0c14-4c9e-b0db-b6296b5e601c admin admin] RBAC: Authorizing `identity:create_grant(project_id=be109f34c3c94294aa6ce8e419a64a41, user_id=e988bf0a7f9a40e99f838ae4147ddbd7, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:23.402796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e459633-0c14-4c9e-b0db-b6296b5e601c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:23.412727 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3100/6199] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:23 2022] PUT /identity/v3/projects/64d2965f2beb43ce8004ca62c59739f8/users/61b5ebddaf27412da1e7955cff384cb3/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:23.427539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16541ca-f689-4171-9621-3377977ad1ce None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:23.427910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16541ca-f689-4171-9621-3377977ad1ce None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:23.428180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16541ca-f689-4171-9621-3377977ad1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:23.488480 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3100/6200] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:23 2022] PUT /identity/v3/projects/be109f34c3c94294aa6ce8e419a64a41/users/e988bf0a7f9a40e99f838ae4147ddbd7/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:23.493788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c480f8-efa6-43a3-a36a-69864d21b1c8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:23.494365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c480f8-efa6-43a3-a36a-69864d21b1c8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:23.494675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c480f8-efa6-43a3-a36a-69864d21b1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:23.505853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c16541ca-f689-4171-9621-3377977ad1ce None None] MFA Rules not processed for user `61b5ebddaf27412da1e7955cff384cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:23.507156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c16541ca-f689-4171-9621-3377977ad1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:23.610598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e3c480f8-efa6-43a3-a36a-69864d21b1c8 None None] MFA Rules not processed for user `e988bf0a7f9a40e99f838ae4147ddbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:23.612292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e3c480f8-efa6-43a3-a36a-69864d21b1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:23.718436 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3101/6201] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:15:23.722863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16541ca-f689-4171-9621-3377977ad1ce None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:23.760030 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3101/6202] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:23.852081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16541ca-f689-4171-9621-3377977ad1ce None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:23.858641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b64aa-261b-45cf-9e32-4a9fd579c3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:23.859738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b64aa-261b-45cf-9e32-4a9fd579c3bf admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:23.860855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b64aa-261b-45cf-9e32-4a9fd579c3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:23.861408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b64aa-261b-45cf-9e32-4a9fd579c3bf admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:23.862314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b64aa-261b-45cf-9e32-4a9fd579c3bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:23.864515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b64aa-261b-45cf-9e32-4a9fd579c3bf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:23.917424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c480f8-efa6-43a3-a36a-69864d21b1c8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:23.919969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e3c480f8-efa6-43a3-a36a-69864d21b1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:23.933764 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3102/6203] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:15:23 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:23.935853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b64aa-261b-45cf-9e32-4a9fd579c3bf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:24.040746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c480f8-efa6-43a3-a36a-69864d21b1c8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:24.041531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:24.069314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:24.079359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b64aa-261b-45cf-9e32-4a9fd579c3bf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:24.086588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82418d-5c7f-4027-b1a4-10177246107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:24.087215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82418d-5c7f-4027-b1a4-10177246107e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:24.087493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82418d-5c7f-4027-b1a4-10177246107e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:24.087771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82418d-5c7f-4027-b1a4-10177246107e admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:24.088409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82418d-5c7f-4027-b1a4-10177246107e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:24.091847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82418d-5c7f-4027-b1a4-10177246107e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:24.144477 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3103/6204] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:15:23 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:24.148560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82418d-5c7f-4027-b1a4-10177246107e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:24.165450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82418d-5c7f-4027-b1a4-10177246107e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:24.183073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d98ce0-e5d6-4557-9c6b-7f0c8337bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:24.184730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d98ce0-e5d6-4557-9c6b-7f0c8337bae2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:24.185035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d98ce0-e5d6-4557-9c6b-7f0c8337bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:24.185481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d98ce0-e5d6-4557-9c6b-7f0c8337bae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:24.186332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d98ce0-e5d6-4557-9c6b-7f0c8337bae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:24.187952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d98ce0-e5d6-4557-9c6b-7f0c8337bae2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:24.215718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18227c1f-cd9c-49bb-8ec2-831cfaafda13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:24.216185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227c1f-cd9c-49bb-8ec2-831cfaafda13 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:24.216571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227c1f-cd9c-49bb-8ec2-831cfaafda13 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:24.217325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227c1f-cd9c-49bb-8ec2-831cfaafda13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:24.220932 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3104/6205] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:24.224518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d98ce0-e5d6-4557-9c6b-7f0c8337bae2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:24.255082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d98ce0-e5d6-4557-9c6b-7f0c8337bae2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:24.260835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043afa8-205b-4e5d-990f-6f1c63a6423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:24.262355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043afa8-205b-4e5d-990f-6f1c63a6423b admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:24.262959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043afa8-205b-4e5d-990f-6f1c63a6423b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:24.263420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043afa8-205b-4e5d-990f-6f1c63a6423b admin admin] PATH_INFO: `/v3/projects/7a518846c18b45a195227125c9a71c70/users/73cea88f6c41419abf208ea235ea2a52/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:24.298954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043afa8-205b-4e5d-990f-6f1c63a6423b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a518846c18b45a195227125c9a71c70, user_id=73cea88f6c41419abf208ea235ea2a52, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:24.302681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043afa8-205b-4e5d-990f-6f1c63a6423b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:24.353733 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3105/6206] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:24 2022] PUT /identity/v3/projects/7a518846c18b45a195227125c9a71c70/users/73cea88f6c41419abf208ea235ea2a52/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:24.357775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043afa8-205b-4e5d-990f-6f1c63a6423b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:24.394726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18227c1f-cd9c-49bb-8ec2-831cfaafda13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:24.400060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18227c1f-cd9c-49bb-8ec2-831cfaafda13 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:24.414000 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3102/6207] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:24.496463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043afa8-205b-4e5d-990f-6f1c63a6423b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:24.514339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837df30-cd10-4150-9b9a-8b3267620625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:24.514913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837df30-cd10-4150-9b9a-8b3267620625 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:24.515837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837df30-cd10-4150-9b9a-8b3267620625 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:24.516231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837df30-cd10-4150-9b9a-8b3267620625 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:24.517127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837df30-cd10-4150-9b9a-8b3267620625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:24.524073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837df30-cd10-4150-9b9a-8b3267620625 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:24.565673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18227c1f-cd9c-49bb-8ec2-831cfaafda13 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:24.570259 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3106/6208] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:24.582383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18227c1f-cd9c-49bb-8ec2-831cfaafda13 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:24.588701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18e916-9f2e-4d56-80f5-2f873562aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:24.590097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e916-9f2e-4d56-80f5-2f873562aa61 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:24.590490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e916-9f2e-4d56-80f5-2f873562aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:24.590852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e916-9f2e-4d56-80f5-2f873562aa61 admin admin] PATH_INFO: `/v3/projects/7a518846c18b45a195227125c9a71c70/users/73cea88f6c41419abf208ea235ea2a52/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:24.593279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18e916-9f2e-4d56-80f5-2f873562aa61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a518846c18b45a195227125c9a71c70, user_id=73cea88f6c41419abf208ea235ea2a52, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:24.596733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18e916-9f2e-4d56-80f5-2f873562aa61 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:24.634869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94591455-8b3a-4b98-8089-2c9f6d0d151e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:24.635339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94591455-8b3a-4b98-8089-2c9f6d0d151e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:24.635624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94591455-8b3a-4b98-8089-2c9f6d0d151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:24.639469 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3103/6209] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:24 2022] PUT /identity/v3/projects/7a518846c18b45a195227125c9a71c70/users/73cea88f6c41419abf208ea235ea2a52/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:15:24.707576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-94591455-8b3a-4b98-8089-2c9f6d0d151e None None] MFA Rules not processed for user `73cea88f6c41419abf208ea235ea2a52`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:24.709122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-94591455-8b3a-4b98-8089-2c9f6d0d151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:24.821541 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3107/6210] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:24.834715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18e916-9f2e-4d56-80f5-2f873562aa61 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:24.836868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8e18e916-9f2e-4d56-80f5-2f873562aa61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:24.987793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18e916-9f2e-4d56-80f5-2f873562aa61 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:24.997098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b46f-8794-4a95-a334-36a8da28f4ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:24.997861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b46f-8794-4a95-a334-36a8da28f4ff service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:24.998204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b46f-8794-4a95-a334-36a8da28f4ff service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:24.998630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b46f-8794-4a95-a334-36a8da28f4ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:25.104324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7b46f-8794-4a95-a334-36a8da28f4ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:25.106884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7b46f-8794-4a95-a334-36a8da28f4ff service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:25.122839 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3104/6211] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:30.465308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94591455-8b3a-4b98-8089-2c9f6d0d151e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:30.467967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-94591455-8b3a-4b98-8089-2c9f6d0d151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:30.502627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94591455-8b3a-4b98-8089-2c9f6d0d151e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:30.511839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059a649-814f-4212-8631-327918adbfbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:30.514723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059a649-814f-4212-8631-327918adbfbe service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:30.515356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059a649-814f-4212-8631-327918adbfbe service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:30.515874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059a649-814f-4212-8631-327918adbfbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:30.531955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059a649-814f-4212-8631-327918adbfbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:30.533931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059a649-814f-4212-8631-327918adbfbe service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:30.562817 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3108/6212] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:35.115324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:36.199956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b46f-8794-4a95-a334-36a8da28f4ff service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:36.339288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b46f-8794-4a95-a334-36a8da28f4ff service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:36.350515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:36.351454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:36.351738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:36.352010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] PATH_INFO: `/v3/users/61b5ebddaf27412da1e7955cff384cb3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:36.353925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b5ebddaf27412da1e7955cff384cb3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:36.359444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:36.492169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b5ebddaf27412da1e7955cff384cb3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:36.523372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b5ebddaf27412da1e7955cff384cb3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:36.524151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b5ebddaf27412da1e7955cff384cb3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:36.524847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b5ebddaf27412da1e7955cff384cb3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:36.543851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b5ebddaf27412da1e7955cff384cb3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:36.568241 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3105/6213] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:15:36 2022] DELETE /identity/v3/users/61b5ebddaf27412da1e7955cff384cb3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:36.577297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624101ef-aba8-4111-a4e7-2810c8dd8475 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:36.578299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624101ef-aba8-4111-a4e7-2810c8dd8475 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:36.579017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624101ef-aba8-4111-a4e7-2810c8dd8475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:36.590698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:36.610552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-624101ef-aba8-4111-a4e7-2810c8dd8475 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:36.612867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-624101ef-aba8-4111-a4e7-2810c8dd8475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:36.702475 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3109/6214] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:36.735907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:36.738838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:36.946705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae86e33-28fc-4925-9450-c397ef72599c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:36.956353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dcbfb-efde-4f6a-b6c3-fd6e8723560d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:36.958663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dcbfb-efde-4f6a-b6c3-fd6e8723560d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:36.959690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dcbfb-efde-4f6a-b6c3-fd6e8723560d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:36.959984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dcbfb-efde-4f6a-b6c3-fd6e8723560d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:36.984037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dcbfb-efde-4f6a-b6c3-fd6e8723560d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:36.986358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dcbfb-efde-4f6a-b6c3-fd6e8723560d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:37.009350 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3106/6215] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:37.313639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624101ef-aba8-4111-a4e7-2810c8dd8475 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:37.315198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-624101ef-aba8-4111-a4e7-2810c8dd8475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:37.468064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624101ef-aba8-4111-a4e7-2810c8dd8475 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:37.484296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf4e44-83b0-45c2-984f-47c20e8a2beb tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e988bf0a7f9a40e99f838ae4147ddbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be109f34c3c94294aa6ce8e419a64a41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:37.485845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf4e44-83b0-45c2-984f-47c20e8a2beb tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:37.486133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf4e44-83b0-45c2-984f-47c20e8a2beb tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:37.486414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf4e44-83b0-45c2-984f-47c20e8a2beb tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:37.487087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf4e44-83b0-45c2-984f-47c20e8a2beb tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:15:37.487398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf4e44-83b0-45c2-984f-47c20e8a2beb tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:37.489049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf4e44-83b0-45c2-984f-47c20e8a2beb tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:37.522084 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3110/6216] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:15:37.523510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dcbfb-efde-4f6a-b6c3-fd6e8723560d service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:37.541326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dcbfb-efde-4f6a-b6c3-fd6e8723560d service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:37.553012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f7000-58aa-4474-8b74-eb7c205558c2 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e988bf0a7f9a40e99f838ae4147ddbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be109f34c3c94294aa6ce8e419a64a41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:37.554534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f7000-58aa-4474-8b74-eb7c205558c2 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:37.554534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f7000-58aa-4474-8b74-eb7c205558c2 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:37.554534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f7000-58aa-4474-8b74-eb7c205558c2 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:37.554979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f7000-58aa-4474-8b74-eb7c205558c2 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:37.562763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f7000-58aa-4474-8b74-eb7c205558c2 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:37.618548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:37.629842 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3107/6217] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:15:37 2022] POST /identity/v3/projects => generated 348 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:37.631252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf4e44-83b0-45c2-984f-47c20e8a2beb tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:37.647437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf4e44-83b0-45c2-984f-47c20e8a2beb tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:37.792640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f006d65-8772-4b02-92fc-7ed6b48ac819 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e988bf0a7f9a40e99f838ae4147ddbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be109f34c3c94294aa6ce8e419a64a41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:37.793313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f006d65-8772-4b02-92fc-7ed6b48ac819 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:37.793604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f006d65-8772-4b02-92fc-7ed6b48ac819 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:37.801409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f006d65-8772-4b02-92fc-7ed6b48ac819 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:37.802350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f006d65-8772-4b02-92fc-7ed6b48ac819 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:15:37.802667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f006d65-8772-4b02-92fc-7ed6b48ac819 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:37.807682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f006d65-8772-4b02-92fc-7ed6b48ac819 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:37.856325 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3111/6218] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:15:38.568475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f7000-58aa-4474-8b74-eb7c205558c2 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:38.570743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a13f7000-58aa-4474-8b74-eb7c205558c2 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:38.695942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f7000-58aa-4474-8b74-eb7c205558c2 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:38.710661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:38.712599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:38.713008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:38.713562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] PATH_INFO: `/v3/projects/64d2965f2beb43ce8004ca62c59739f8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:38.716458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d2965f2beb43ce8004ca62c59739f8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:38.725628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:38.827546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d2965f2beb43ce8004ca62c59739f8', 'request_id': 'req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:38.842797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d2965f2beb43ce8004ca62c59739f8', 'request_id': 'req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:38.853853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d2965f2beb43ce8004ca62c59739f8', 'request_id': 'req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:38.880598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] The token cache is being invalidate because project 64d2965f2beb43ce8004ca62c59739f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:15:38.881249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:38.882203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:38.885095 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3108/6219] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:15:38 2022] DELETE /identity/v3/projects/64d2965f2beb43ce8004ca62c59739f8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:38.889060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f006d65-8772-4b02-92fc-7ed6b48ac819 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:38.893699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4f006d65-8772-4b02-92fc-7ed6b48ac819 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:38.920346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f006d65-8772-4b02-92fc-7ed6b48ac819 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:38.998592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:39.043557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:39.044569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:39.045049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:39.045528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] PATH_INFO: `/v3/users/73cea88f6c41419abf208ea235ea2a52` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:39.046975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73cea88f6c41419abf208ea235ea2a52)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:39.049693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:39.156230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73cea88f6c41419abf208ea235ea2a52'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:39.168224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73cea88f6c41419abf208ea235ea2a52'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:39.169665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73cea88f6c41419abf208ea235ea2a52'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:39.170459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73cea88f6c41419abf208ea235ea2a52'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:39.192895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73cea88f6c41419abf208ea235ea2a52'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:39.218424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:39.222439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:39.239161 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3112/6220] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:15:38 2022] DELETE /identity/v3/users/73cea88f6c41419abf208ea235ea2a52 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:39.368019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9306f-ca9c-4f5b-af88-3253adf2bd1c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:39.450163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:39.503994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e988bf0a7f9a40e99f838ae4147ddbd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be109f34c3c94294aa6ce8e419a64a41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:39.510971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:39.511284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:39.512415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] PATH_INFO: `/v3/projects/6431d3e20fd04ae99e2f965bf3cebbe0` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:39.514120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6431d3e20fd04ae99e2f965bf3cebbe0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:39.517559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:39.611814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6431d3e20fd04ae99e2f965bf3cebbe0', 'request_id': 'req-98906532-6939-4a23-87de-2d7e9f314fd0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:39.629687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6431d3e20fd04ae99e2f965bf3cebbe0', 'request_id': 'req-98906532-6939-4a23-87de-2d7e9f314fd0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:39.641410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6431d3e20fd04ae99e2f965bf3cebbe0', 'request_id': 'req-98906532-6939-4a23-87de-2d7e9f314fd0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:39.661811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] The token cache is being invalidate because project 6431d3e20fd04ae99e2f965bf3cebbe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:15:39.661811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:39.662498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:39.664382 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3109/6221] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:15:39 2022] DELETE /identity/v3/projects/6431d3e20fd04ae99e2f965bf3cebbe0 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:39.707153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:39.708816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:39.838009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683ee22-0336-4029-9208-387fbd75855e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:39.913672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64e706-7155-489f-802b-c0022fecba96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:39.914470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64e706-7155-489f-802b-c0022fecba96 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:39.915040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64e706-7155-489f-802b-c0022fecba96 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:39.915553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64e706-7155-489f-802b-c0022fecba96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:39.917920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8d64e706-7155-489f-802b-c0022fecba96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:39.958272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:40.043667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64e706-7155-489f-802b-c0022fecba96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:40.046822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64e706-7155-489f-802b-c0022fecba96 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:40.075098 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3113/6222] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:41.824489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:41.829410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:41.996621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98906532-6939-4a23-87de-2d7e9f314fd0 tempest-RoutersAdminTest-921911214 tempest-RoutersAdminTest-921911214-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:42.018890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c5a32-c29a-443a-b094-a7308a872c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:42.019593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c5a32-c29a-443a-b094-a7308a872c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:42.020002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c5a32-c29a-443a-b094-a7308a872c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:42.020493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c5a32-c29a-443a-b094-a7308a872c4f admin admin] PATH_INFO: `/v3/projects/7a518846c18b45a195227125c9a71c70` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:42.023465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c5a32-c29a-443a-b094-a7308a872c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a518846c18b45a195227125c9a71c70)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:42.025422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c5a32-c29a-443a-b094-a7308a872c4f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:42.112841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-511c5a32-c29a-443a-b094-a7308a872c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a518846c18b45a195227125c9a71c70', 'request_id': 'req-511c5a32-c29a-443a-b094-a7308a872c4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:42.140376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-511c5a32-c29a-443a-b094-a7308a872c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a518846c18b45a195227125c9a71c70', 'request_id': 'req-511c5a32-c29a-443a-b094-a7308a872c4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:42.147620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-511c5a32-c29a-443a-b094-a7308a872c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a518846c18b45a195227125c9a71c70', 'request_id': 'req-511c5a32-c29a-443a-b094-a7308a872c4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:42.159682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:42.175723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-511c5a32-c29a-443a-b094-a7308a872c4f admin admin] The token cache is being invalidate because project 7a518846c18b45a195227125c9a71c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:15:42.175843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-511c5a32-c29a-443a-b094-a7308a872c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:42.177147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-511c5a32-c29a-443a-b094-a7308a872c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:42.185679 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3110/6223] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:15:41 2022] DELETE /identity/v3/projects/7a518846c18b45a195227125c9a71c70 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:42.186670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e0738-ece5-4f56-b42c-c9a8b5ab2a73 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:42.187649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e0738-ece5-4f56-b42c-c9a8b5ab2a73 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:42.188317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e0738-ece5-4f56-b42c-c9a8b5ab2a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:42.234998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d30e0738-ece5-4f56-b42c-c9a8b5ab2a73 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:42.237669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d30e0738-ece5-4f56-b42c-c9a8b5ab2a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:42.427835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903f920-d7df-44de-8cf7-b9dc1ce3728c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:42.428174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903f920-d7df-44de-8cf7-b9dc1ce3728c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:42.428603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903f920-d7df-44de-8cf7-b9dc1ce3728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:42.454168 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3114/6224] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:42.523566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3903f920-d7df-44de-8cf7-b9dc1ce3728c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:42.526945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3903f920-d7df-44de-8cf7-b9dc1ce3728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:42.550209 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3111/6225] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:42.554861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e0738-ece5-4f56-b42c-c9a8b5ab2a73 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:42.585023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e0738-ece5-4f56-b42c-c9a8b5ab2a73 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:42.598329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fca6b-b01e-4fc9-800a-96770d479d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:42.605451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fca6b-b01e-4fc9-800a-96770d479d46 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:42.606020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fca6b-b01e-4fc9-800a-96770d479d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:42.606458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fca6b-b01e-4fc9-800a-96770d479d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:42.620928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fca6b-b01e-4fc9-800a-96770d479d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:15:42.621739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fca6b-b01e-4fc9-800a-96770d479d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:42.626146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fca6b-b01e-4fc9-800a-96770d479d46 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:42.668882 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3115/6226] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:15:42.682166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903f920-d7df-44de-8cf7-b9dc1ce3728c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:42.711800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903f920-d7df-44de-8cf7-b9dc1ce3728c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:42.733907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac36b2-7dde-4bfd-839c-18b3d1bd7cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:42.734539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac36b2-7dde-4bfd-839c-18b3d1bd7cef admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:42.735510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac36b2-7dde-4bfd-839c-18b3d1bd7cef admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:42.735783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac36b2-7dde-4bfd-839c-18b3d1bd7cef admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:42.737369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac36b2-7dde-4bfd-839c-18b3d1bd7cef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:42.739728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac36b2-7dde-4bfd-839c-18b3d1bd7cef admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:42.804286 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3112/6227] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:15:42 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:42.806370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fca6b-b01e-4fc9-800a-96770d479d46 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:42.824338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fca6b-b01e-4fc9-800a-96770d479d46 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:42.929836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f3178-b1de-444c-a30f-1c9499bfd6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:42.931757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3178-b1de-444c-a30f-1c9499bfd6da admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:42.932697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3178-b1de-444c-a30f-1c9499bfd6da admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:42.933585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3178-b1de-444c-a30f-1c9499bfd6da admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:42.936630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f3178-b1de-444c-a30f-1c9499bfd6da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:42.943674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f3178-b1de-444c-a30f-1c9499bfd6da admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:42.983002 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3116/6228] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:15:42 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:42.984326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac36b2-7dde-4bfd-839c-18b3d1bd7cef admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:43.002306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac36b2-7dde-4bfd-839c-18b3d1bd7cef admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:43.009903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997ab88-79bf-447d-b5a7-f801ae176ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:43.010815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997ab88-79bf-447d-b5a7-f801ae176ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:43.011325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997ab88-79bf-447d-b5a7-f801ae176ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:43.011817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997ab88-79bf-447d-b5a7-f801ae176ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:43.013667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997ab88-79bf-447d-b5a7-f801ae176ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:43.015612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997ab88-79bf-447d-b5a7-f801ae176ce2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:43.031391 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3113/6229] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:43.036378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f3178-b1de-444c-a30f-1c9499bfd6da admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:43.052351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f3178-b1de-444c-a30f-1c9499bfd6da admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:43.067783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9794c-d0ac-4bb2-b62d-c4cbc8457dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:43.068482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9794c-d0ac-4bb2-b62d-c4cbc8457dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:43.068864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9794c-d0ac-4bb2-b62d-c4cbc8457dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:43.071264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9794c-d0ac-4bb2-b62d-c4cbc8457dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:43.072252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9794c-d0ac-4bb2-b62d-c4cbc8457dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:43.075201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9794c-d0ac-4bb2-b62d-c4cbc8457dc8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:43.098326 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3117/6230] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:43.102900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997ab88-79bf-447d-b5a7-f801ae176ce2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:43.147266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997ab88-79bf-447d-b5a7-f801ae176ce2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:43.165881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5123836-c518-4f04-9c91-75f182ca7659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:43.167351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5123836-c518-4f04-9c91-75f182ca7659 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:43.167990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5123836-c518-4f04-9c91-75f182ca7659 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:43.169080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5123836-c518-4f04-9c91-75f182ca7659 admin admin] PATH_INFO: `/v3/projects/ee6970076b9341de9781166a8502d776/users/d6708073d4c54435899f2a0a8565ca08/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:43.201458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5123836-c518-4f04-9c91-75f182ca7659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6970076b9341de9781166a8502d776, user_id=d6708073d4c54435899f2a0a8565ca08, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:43.210022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5123836-c518-4f04-9c91-75f182ca7659 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:43.246330 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3114/6231] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:43 2022] PUT /identity/v3/projects/ee6970076b9341de9781166a8502d776/users/d6708073d4c54435899f2a0a8565ca08/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:43.257969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0210b2-f086-49cf-9628-271942945fb7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:43.258541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0210b2-f086-49cf-9628-271942945fb7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:43.260541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0210b2-f086-49cf-9628-271942945fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:43.335243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6c0210b2-f086-49cf-9628-271942945fb7 None None] MFA Rules not processed for user `d6708073d4c54435899f2a0a8565ca08`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:43.336803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6c0210b2-f086-49cf-9628-271942945fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:43.380486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:43.492472 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3118/6232] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:43.507586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5123836-c518-4f04-9c91-75f182ca7659 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:43.509472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c5123836-c518-4f04-9c91-75f182ca7659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:43.649536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5123836-c518-4f04-9c91-75f182ca7659 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:43.657432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed107e-d1d8-4b69-8d0e-e493112a268b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:43.658803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed107e-d1d8-4b69-8d0e-e493112a268b service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:43.659030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed107e-d1d8-4b69-8d0e-e493112a268b service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:43.659308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed107e-d1d8-4b69-8d0e-e493112a268b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:43.675370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed107e-d1d8-4b69-8d0e-e493112a268b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:43.700097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed107e-d1d8-4b69-8d0e-e493112a268b service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:43.720625 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3115/6233] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:15:46.846076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0210b2-f086-49cf-9628-271942945fb7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:46.851249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed107e-d1d8-4b69-8d0e-e493112a268b service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:46.852760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6c0210b2-f086-49cf-9628-271942945fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:47.042962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed107e-d1d8-4b69-8d0e-e493112a268b service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:47.049288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0210b2-f086-49cf-9628-271942945fb7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:47.056123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a211d-83af-4894-b1a5-611ddcbe21ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:47.056791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a211d-83af-4894-b1a5-611ddcbe21ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:47.057072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a211d-83af-4894-b1a5-611ddcbe21ca admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:47.057376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a211d-83af-4894-b1a5-611ddcbe21ca admin admin] PATH_INFO: `/v3/users/d6708073d4c54435899f2a0a8565ca08` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:47.061977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a211d-83af-4894-b1a5-611ddcbe21ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6708073d4c54435899f2a0a8565ca08)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:47.064484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a211d-83af-4894-b1a5-611ddcbe21ca admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:47.067356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:47.077059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:47.077714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:47.078229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] PATH_INFO: `/v3/users/de71b64a2e1c4b6aaa15b5ee75003add` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:47.079901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de71b64a2e1c4b6aaa15b5ee75003add)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:47.082188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:47.175804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:47.196270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-858a211d-83af-4894-b1a5-611ddcbe21ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6708073d4c54435899f2a0a8565ca08'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:47.210025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de71b64a2e1c4b6aaa15b5ee75003add'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:47.232514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de71b64a2e1c4b6aaa15b5ee75003add'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:47.233599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de71b64a2e1c4b6aaa15b5ee75003add'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:47.234541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de71b64a2e1c4b6aaa15b5ee75003add'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:47.236350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-858a211d-83af-4894-b1a5-611ddcbe21ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6708073d4c54435899f2a0a8565ca08'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:47.238627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-858a211d-83af-4894-b1a5-611ddcbe21ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6708073d4c54435899f2a0a8565ca08'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:47.239822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-858a211d-83af-4894-b1a5-611ddcbe21ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6708073d4c54435899f2a0a8565ca08'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:47.270989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-858a211d-83af-4894-b1a5-611ddcbe21ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6708073d4c54435899f2a0a8565ca08'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:47.278162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de71b64a2e1c4b6aaa15b5ee75003add'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:47.297832 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3116/6234] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:15:46 2022] DELETE /identity/v3/users/d6708073d4c54435899f2a0a8565ca08 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:47.303116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e81cf1-7bef-4c4e-89bf-bdfe0a44389e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:47.305096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e81cf1-7bef-4c4e-89bf-bdfe0a44389e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:47.306879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e81cf1-7bef-4c4e-89bf-bdfe0a44389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:47.313539 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3119/6235] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:15:46 2022] DELETE /identity/v3/users/de71b64a2e1c4b6aaa15b5ee75003add => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:47.368789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-74e81cf1-7bef-4c4e-89bf-bdfe0a44389e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:47.390150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-74e81cf1-7bef-4c4e-89bf-bdfe0a44389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:47.563763 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3117/6236] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:47.614339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:47.618337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:47.759582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:47.796323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cda0d6-0500-42c2-b5cd-3eea5a96687b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:47.805374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c6ac5-608f-4565-ac0c-1a07330780d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:47.807030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6ac5-608f-4565-ac0c-1a07330780d9 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:47.807322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6ac5-608f-4565-ac0c-1a07330780d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:47.807803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6ac5-608f-4565-ac0c-1a07330780d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:47.822799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c6ac5-608f-4565-ac0c-1a07330780d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:47.825416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c6ac5-608f-4565-ac0c-1a07330780d9 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:47.850717 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3120/6237] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:48.640510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e81cf1-7bef-4c4e-89bf-bdfe0a44389e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:48.646537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-74e81cf1-7bef-4c4e-89bf-bdfe0a44389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:48.668197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e81cf1-7bef-4c4e-89bf-bdfe0a44389e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:48.682806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd77037-7621-4b96-a314-400c7a39449f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:48.683772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd77037-7621-4b96-a314-400c7a39449f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:48.684233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd77037-7621-4b96-a314-400c7a39449f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:48.684669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd77037-7621-4b96-a314-400c7a39449f admin admin] PATH_INFO: `/v3/projects/7994439815e0416180c95158033ae3f2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:48.686602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd77037-7621-4b96-a314-400c7a39449f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7994439815e0416180c95158033ae3f2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:48.696320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd77037-7621-4b96-a314-400c7a39449f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:48.857977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9bd77037-7621-4b96-a314-400c7a39449f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7994439815e0416180c95158033ae3f2', 'request_id': 'req-9bd77037-7621-4b96-a314-400c7a39449f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:48.889678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9bd77037-7621-4b96-a314-400c7a39449f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7994439815e0416180c95158033ae3f2', 'request_id': 'req-9bd77037-7621-4b96-a314-400c7a39449f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:48.920928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9bd77037-7621-4b96-a314-400c7a39449f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7994439815e0416180c95158033ae3f2', 'request_id': 'req-9bd77037-7621-4b96-a314-400c7a39449f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:48.996815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9bd77037-7621-4b96-a314-400c7a39449f admin admin] The token cache is being invalidate because project 7994439815e0416180c95158033ae3f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:15:48.997304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9bd77037-7621-4b96-a314-400c7a39449f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:48.998631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9bd77037-7621-4b96-a314-400c7a39449f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:49.015089 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3118/6238] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:15:48 2022] DELETE /identity/v3/projects/7994439815e0416180c95158033ae3f2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:49.015663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb5528-71b7-48b1-837f-b86d17c5d64b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:49.016334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb5528-71b7-48b1-837f-b86d17c5d64b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:49.016482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb5528-71b7-48b1-837f-b86d17c5d64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:49.099086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dfeb5528-71b7-48b1-837f-b86d17c5d64b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:49.102006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dfeb5528-71b7-48b1-837f-b86d17c5d64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:49.299910 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3121/6239] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:49.309002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484ddb2-a2a8-4fb2-8763-e41a19d8816f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:49.309603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484ddb2-a2a8-4fb2-8763-e41a19d8816f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:49.309881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484ddb2-a2a8-4fb2-8763-e41a19d8816f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:49.354608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6484ddb2-a2a8-4fb2-8763-e41a19d8816f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:49.356043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6484ddb2-a2a8-4fb2-8763-e41a19d8816f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:49.372156 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3119/6240] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:49.377830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb5528-71b7-48b1-837f-b86d17c5d64b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:49.398922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb5528-71b7-48b1-837f-b86d17c5d64b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:49.409032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191515b-4a90-45ad-8b68-19b325036a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:49.409683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191515b-4a90-45ad-8b68-19b325036a4c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:49.411568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191515b-4a90-45ad-8b68-19b325036a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:49.412553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191515b-4a90-45ad-8b68-19b325036a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:49.413282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191515b-4a90-45ad-8b68-19b325036a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:15:49.413592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191515b-4a90-45ad-8b68-19b325036a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:49.420130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191515b-4a90-45ad-8b68-19b325036a4c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:49.455517 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3122/6241] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:15:49.460469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484ddb2-a2a8-4fb2-8763-e41a19d8816f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:49.479076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484ddb2-a2a8-4fb2-8763-e41a19d8816f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:49.486242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445dea8-3bf9-4c54-804a-437d8827183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:49.487119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445dea8-3bf9-4c54-804a-437d8827183d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:49.487580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445dea8-3bf9-4c54-804a-437d8827183d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:49.488580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445dea8-3bf9-4c54-804a-437d8827183d admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:49.489508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445dea8-3bf9-4c54-804a-437d8827183d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:49.491878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445dea8-3bf9-4c54-804a-437d8827183d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:49.546475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:49.579368 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3120/6242] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:15:49 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:49.583910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191515b-4a90-45ad-8b68-19b325036a4c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:49.600478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191515b-4a90-45ad-8b68-19b325036a4c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:49.741276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f1423-c867-4fdd-8277-990ba2371ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:49.742010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1423-c867-4fdd-8277-990ba2371ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:49.742373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1423-c867-4fdd-8277-990ba2371ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:49.742770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1423-c867-4fdd-8277-990ba2371ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:49.743546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f1423-c867-4fdd-8277-990ba2371ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:49.749173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f1423-c867-4fdd-8277-990ba2371ab1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:49.808229 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3123/6243] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:15:49 2022] POST /identity/v3/users => generated 296 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:49.812144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445dea8-3bf9-4c54-804a-437d8827183d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:49.834245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445dea8-3bf9-4c54-804a-437d8827183d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:49.840617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f2c8f-96cb-4283-9b2e-5ee4749a2dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:49.841644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f2c8f-96cb-4283-9b2e-5ee4749a2dbb admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:49.842103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f2c8f-96cb-4283-9b2e-5ee4749a2dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:49.842588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f2c8f-96cb-4283-9b2e-5ee4749a2dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:49.843502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f2c8f-96cb-4283-9b2e-5ee4749a2dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:49.847423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f2c8f-96cb-4283-9b2e-5ee4749a2dbb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:49.871019 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3121/6244] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:49.872285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f1423-c867-4fdd-8277-990ba2371ab1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:49.895060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f1423-c867-4fdd-8277-990ba2371ab1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:49.901087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cc49a-a008-4397-ab9a-bf100de735c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:49.901681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cc49a-a008-4397-ab9a-bf100de735c5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:49.902012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cc49a-a008-4397-ab9a-bf100de735c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:49.902327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cc49a-a008-4397-ab9a-bf100de735c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:49.902988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cc49a-a008-4397-ab9a-bf100de735c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:49.904724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cc49a-a008-4397-ab9a-bf100de735c5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:49.921855 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3124/6245] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:49.925751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f2c8f-96cb-4283-9b2e-5ee4749a2dbb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:49.939074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f2c8f-96cb-4283-9b2e-5ee4749a2dbb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:49.947118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fccb9-3f9c-4758-9641-ad40004faec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:49.947806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fccb9-3f9c-4758-9641-ad40004faec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:49.948086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fccb9-3f9c-4758-9641-ad40004faec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:49.948362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fccb9-3f9c-4758-9641-ad40004faec1 admin admin] PATH_INFO: `/v3/projects/173beeb5bce346eabf2a2d19f4c381d6/users/1af17546ab4745d8b92eab4f5c3ebb14/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:49.968978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fccb9-3f9c-4758-9641-ad40004faec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173beeb5bce346eabf2a2d19f4c381d6, user_id=1af17546ab4745d8b92eab4f5c3ebb14, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:49.988365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fccb9-3f9c-4758-9641-ad40004faec1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:50.037675 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3122/6246] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:49 2022] PUT /identity/v3/projects/173beeb5bce346eabf2a2d19f4c381d6/users/1af17546ab4745d8b92eab4f5c3ebb14/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:50.043911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91919e59-7f68-4e44-b697-b3a50a2c0b82 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:50.045178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91919e59-7f68-4e44-b697-b3a50a2c0b82 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:50.045178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91919e59-7f68-4e44-b697-b3a50a2c0b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:50.066725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:50.102789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-91919e59-7f68-4e44-b697-b3a50a2c0b82 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:50.108855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-91919e59-7f68-4e44-b697-b3a50a2c0b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:50.268596 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3125/6247] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:50.277596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fccb9-3f9c-4758-9641-ad40004faec1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:50.279394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-004fccb9-3f9c-4758-9641-ad40004faec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:50.315878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fccb9-3f9c-4758-9641-ad40004faec1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:50.329661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91919e59-7f68-4e44-b697-b3a50a2c0b82 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:50.332924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-91919e59-7f68-4e44-b697-b3a50a2c0b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:50.358533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0345a-9917-4751-964d-e6a0d7909d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:50.359200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0345a-9917-4751-964d-e6a0d7909d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:50.359475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0345a-9917-4751-964d-e6a0d7909d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:50.359828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0345a-9917-4751-964d-e6a0d7909d86 admin admin] PATH_INFO: `/v3/projects/ee6970076b9341de9781166a8502d776` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:50.379385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0345a-9917-4751-964d-e6a0d7909d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6970076b9341de9781166a8502d776)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:50.381417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0345a-9917-4751-964d-e6a0d7909d86 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:50.585198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91919e59-7f68-4e44-b697-b3a50a2c0b82 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:50.590229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-94f0345a-9917-4751-964d-e6a0d7909d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6970076b9341de9781166a8502d776', 'request_id': 'req-94f0345a-9917-4751-964d-e6a0d7909d86'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:50.610028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-94f0345a-9917-4751-964d-e6a0d7909d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6970076b9341de9781166a8502d776', 'request_id': 'req-94f0345a-9917-4751-964d-e6a0d7909d86'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:50.623201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-94f0345a-9917-4751-964d-e6a0d7909d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6970076b9341de9781166a8502d776', 'request_id': 'req-94f0345a-9917-4751-964d-e6a0d7909d86'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:50.649687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-94f0345a-9917-4751-964d-e6a0d7909d86 admin admin] The token cache is being invalidate because project ee6970076b9341de9781166a8502d776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:15:50.649953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-94f0345a-9917-4751-964d-e6a0d7909d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:50.651423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-94f0345a-9917-4751-964d-e6a0d7909d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:15:50.655194 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3123/6248] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:15:50 2022] DELETE /identity/v3/projects/ee6970076b9341de9781166a8502d776 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:50.659988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3660b-f906-456b-b72e-5a5b00c46a13 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:50.660275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3660b-f906-456b-b72e-5a5b00c46a13 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:50.660552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3660b-f906-456b-b72e-5a5b00c46a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:50.707584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-96d3660b-f906-456b-b72e-5a5b00c46a13 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:50.710611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-96d3660b-f906-456b-b72e-5a5b00c46a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:50.728141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6c645-9d5f-4389-a643-71b963edf402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:50.729710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6c645-9d5f-4389-a643-71b963edf402 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:50.730239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6c645-9d5f-4389-a643-71b963edf402 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:50.731239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6c645-9d5f-4389-a643-71b963edf402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:50.743731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0ee6c645-9d5f-4389-a643-71b963edf402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:50.884102 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3124/6249] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:50.892488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc168-eb15-43f3-a028-586ca745cef9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:50.892968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc168-eb15-43f3-a028-586ca745cef9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:50.893465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc168-eb15-43f3-a028-586ca745cef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:50.898032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6c645-9d5f-4389-a643-71b963edf402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:50.908681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6c645-9d5f-4389-a643-71b963edf402 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:50.922406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ea1fc168-eb15-43f3-a028-586ca745cef9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:50.923906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ea1fc168-eb15-43f3-a028-586ca745cef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:50.939191 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3126/6250] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:15:50.943660 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3125/6251] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:50.944565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6c645-9d5f-4389-a643-71b963edf402 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:50.967910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6c645-9d5f-4389-a643-71b963edf402 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:50.977697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b200e70-7b1d-424d-b5c4-843c753cf552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:50.978341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b200e70-7b1d-424d-b5c4-843c753cf552 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:50.978604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b200e70-7b1d-424d-b5c4-843c753cf552 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:50.978885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b200e70-7b1d-424d-b5c4-843c753cf552 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:50.979550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b200e70-7b1d-424d-b5c4-843c753cf552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:15:50.979858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b200e70-7b1d-424d-b5c4-843c753cf552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:50.981528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b200e70-7b1d-424d-b5c4-843c753cf552 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:51.002815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:51.021745 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3127/6252] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:15:51.023332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fc168-eb15-43f3-a028-586ca745cef9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:51.062214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fc168-eb15-43f3-a028-586ca745cef9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:51.088255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9220a8-fc18-400a-8430-12c4ee8b7740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:51.088971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9220a8-fc18-400a-8430-12c4ee8b7740 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:51.089281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9220a8-fc18-400a-8430-12c4ee8b7740 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:51.089565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9220a8-fc18-400a-8430-12c4ee8b7740 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:51.091003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9220a8-fc18-400a-8430-12c4ee8b7740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:51.101769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9220a8-fc18-400a-8430-12c4ee8b7740 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:51.190918 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3126/6253] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:15:51 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:51.195395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b200e70-7b1d-424d-b5c4-843c753cf552 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:51.209601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b200e70-7b1d-424d-b5c4-843c753cf552 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:51.410851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795281f-c886-48c6-8049-ca3708279a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:51.412594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795281f-c886-48c6-8049-ca3708279a51 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:51.413086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795281f-c886-48c6-8049-ca3708279a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:51.413620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795281f-c886-48c6-8049-ca3708279a51 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:51.415706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795281f-c886-48c6-8049-ca3708279a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:51.420827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795281f-c886-48c6-8049-ca3708279a51 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:51.465438 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3128/6254] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:15:51 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:15:51.469054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9220a8-fc18-400a-8430-12c4ee8b7740 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:51.508633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9220a8-fc18-400a-8430-12c4ee8b7740 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:51.514990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9d29d-4d3b-47be-9eef-8e7c94bce43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:51.516421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9d29d-4d3b-47be-9eef-8e7c94bce43c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:51.516750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9d29d-4d3b-47be-9eef-8e7c94bce43c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:51.517140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9d29d-4d3b-47be-9eef-8e7c94bce43c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:51.517934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9d29d-4d3b-47be-9eef-8e7c94bce43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:51.520311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9d29d-4d3b-47be-9eef-8e7c94bce43c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:51.547997 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3127/6255] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:51.552745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795281f-c886-48c6-8049-ca3708279a51 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:51.565454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795281f-c886-48c6-8049-ca3708279a51 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:51.577165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fd29a-eff7-4930-afc7-33848a91ed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:51.577814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fd29a-eff7-4930-afc7-33848a91ed64 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:51.578095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fd29a-eff7-4930-afc7-33848a91ed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:51.578399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fd29a-eff7-4930-afc7-33848a91ed64 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:51.579057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fd29a-eff7-4930-afc7-33848a91ed64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:51.580825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fd29a-eff7-4930-afc7-33848a91ed64 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:51.599008 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3129/6256] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:15:51.603813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9d29d-4d3b-47be-9eef-8e7c94bce43c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:51.628859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9d29d-4d3b-47be-9eef-8e7c94bce43c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:51.636783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459021d-0e79-4349-8a45-28a3a11510df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:51.637856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459021d-0e79-4349-8a45-28a3a11510df admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:51.638137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459021d-0e79-4349-8a45-28a3a11510df admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:51.638414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459021d-0e79-4349-8a45-28a3a11510df admin admin] PATH_INFO: `/v3/projects/19e30a611f6a4275ad45c71c3e8cc569/users/2131126b6717405198c779d8c7198532/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:51.667183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:51.703161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459021d-0e79-4349-8a45-28a3a11510df admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e30a611f6a4275ad45c71c3e8cc569, user_id=2131126b6717405198c779d8c7198532, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:51.706856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459021d-0e79-4349-8a45-28a3a11510df admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:51.747690 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3128/6257] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:15:51 2022] PUT /identity/v3/projects/19e30a611f6a4275ad45c71c3e8cc569/users/2131126b6717405198c779d8c7198532/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:15:51.752941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbb4a7-edd4-41f0-bd69-1540c4948a1d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:51.752941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbb4a7-edd4-41f0-bd69-1540c4948a1d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:51.752941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbb4a7-edd4-41f0-bd69-1540c4948a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:51.824370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8fdbb4a7-edd4-41f0-bd69-1540c4948a1d None None] MFA Rules not processed for user `2131126b6717405198c779d8c7198532`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:51.830202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8fdbb4a7-edd4-41f0-bd69-1540c4948a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:51.983501 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3130/6258] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:15:51.994660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459021d-0e79-4349-8a45-28a3a11510df admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:15:51.997083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b459021d-0e79-4349-8a45-28a3a11510df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:52.089728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459021d-0e79-4349-8a45-28a3a11510df admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:15:52.094271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032ebd0-0788-411f-a626-f5e7fedbc2a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:15:52.095067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032ebd0-0788-411f-a626-f5e7fedbc2a5 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:52.095450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032ebd0-0788-411f-a626-f5e7fedbc2a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:52.095967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032ebd0-0788-411f-a626-f5e7fedbc2a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:52.108429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032ebd0-0788-411f-a626-f5e7fedbc2a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:15:52.111581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032ebd0-0788-411f-a626-f5e7fedbc2a5 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:15:52.127208 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3129/6259] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:15:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:15:58.629462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4324b-1f5f-42b7-868b-87365bd63662 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:15:58.629462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4324b-1f5f-42b7-868b-87365bd63662 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:15:58.629462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4324b-1f5f-42b7-868b-87365bd63662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:15:58.666172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-88f4324b-1f5f-42b7-868b-87365bd63662 None None] MFA Rules not processed for user `8957041987c8487099f0d89f4c64af66`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:15:58.667429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-88f4324b-1f5f-42b7-868b-87365bd63662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:15:58.756826 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3131/6260] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:16:02.119473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:05.854227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032ebd0-0788-411f-a626-f5e7fedbc2a5 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:06.162062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032ebd0-0788-411f-a626-f5e7fedbc2a5 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:06.187180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:06.188428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:06.188809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:06.190093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] PATH_INFO: `/v3/users/2131126b6717405198c779d8c7198532` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:06.192638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2131126b6717405198c779d8c7198532)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:06.200461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:06.350501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2131126b6717405198c779d8c7198532'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:06.362577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2131126b6717405198c779d8c7198532'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:06.363625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2131126b6717405198c779d8c7198532'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:06.364479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2131126b6717405198c779d8c7198532'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:06.422818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2131126b6717405198c779d8c7198532'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:06.476718 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3130/6261] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:16:05 2022] DELETE /identity/v3/users/2131126b6717405198c779d8c7198532 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:16:06.483278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c054c-2645-4b64-b630-bec3260e0799 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:06.483829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c054c-2645-4b64-b630-bec3260e0799 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:06.483829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c054c-2645-4b64-b630-bec3260e0799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:06.581408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:06.611130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-400c054c-2645-4b64-b630-bec3260e0799 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:16:06.612408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-400c054c-2645-4b64-b630-bec3260e0799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:06.768968 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3132/6262] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:16:06.866222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:06.868365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:07.068952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f021d3b-d8d0-4baa-9f33-ed6b6f6c6439 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:07.077613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b051525-f168-40fd-9df6-75b882efca0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:07.078502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b051525-f168-40fd-9df6-75b882efca0c service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:07.078885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b051525-f168-40fd-9df6-75b882efca0c service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:07.079262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b051525-f168-40fd-9df6-75b882efca0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:07.089179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:07.096747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b051525-f168-40fd-9df6-75b882efca0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:07.098412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b051525-f168-40fd-9df6-75b882efca0c service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:07.123963 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3131/6263] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:16:09.442251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c054c-2645-4b64-b630-bec3260e0799 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:09.446263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-400c054c-2645-4b64-b630-bec3260e0799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:09.485925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c054c-2645-4b64-b630-bec3260e0799 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:09.490980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ccc56-8315-45ef-8023-0843bd1d6653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:09.491656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ccc56-8315-45ef-8023-0843bd1d6653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:09.491933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ccc56-8315-45ef-8023-0843bd1d6653 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:09.492648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ccc56-8315-45ef-8023-0843bd1d6653 admin admin] PATH_INFO: `/v3/projects/19e30a611f6a4275ad45c71c3e8cc569` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:09.494012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ccc56-8315-45ef-8023-0843bd1d6653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e30a611f6a4275ad45c71c3e8cc569)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:09.499374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ccc56-8315-45ef-8023-0843bd1d6653 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:09.640673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-227ccc56-8315-45ef-8023-0843bd1d6653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e30a611f6a4275ad45c71c3e8cc569', 'request_id': 'req-227ccc56-8315-45ef-8023-0843bd1d6653'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:09.657774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-227ccc56-8315-45ef-8023-0843bd1d6653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e30a611f6a4275ad45c71c3e8cc569', 'request_id': 'req-227ccc56-8315-45ef-8023-0843bd1d6653'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:09.684252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-227ccc56-8315-45ef-8023-0843bd1d6653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e30a611f6a4275ad45c71c3e8cc569', 'request_id': 'req-227ccc56-8315-45ef-8023-0843bd1d6653'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:09.714963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-227ccc56-8315-45ef-8023-0843bd1d6653 admin admin] The token cache is being invalidate because project 19e30a611f6a4275ad45c71c3e8cc569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:16:09.715668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-227ccc56-8315-45ef-8023-0843bd1d6653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:09.717043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-227ccc56-8315-45ef-8023-0843bd1d6653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:09.720952 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3133/6264] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:16:09 2022] DELETE /identity/v3/projects/19e30a611f6a4275ad45c71c3e8cc569 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:16:09.725468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82b90b-a5ba-4194-96a9-27067f5348f8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:09.727120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82b90b-a5ba-4194-96a9-27067f5348f8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:09.727681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82b90b-a5ba-4194-96a9-27067f5348f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:09.830209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9b82b90b-a5ba-4194-96a9-27067f5348f8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:16:09.838006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9b82b90b-a5ba-4194-96a9-27067f5348f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:10.001390 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3132/6265] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:16:10.009554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf934bcc-138a-456d-8647-096d3bfbfcc8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:10.009787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf934bcc-138a-456d-8647-096d3bfbfcc8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:10.010302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf934bcc-138a-456d-8647-096d3bfbfcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:10.048012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cf934bcc-138a-456d-8647-096d3bfbfcc8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:16:10.049325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cf934bcc-138a-456d-8647-096d3bfbfcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:10.062160 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3134/6266] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:16:10.067113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82b90b-a5ba-4194-96a9-27067f5348f8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:10.079539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82b90b-a5ba-4194-96a9-27067f5348f8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:10.085972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fdbff-fb0c-4392-90d9-c7bf35a31996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:10.086612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fdbff-fb0c-4392-90d9-c7bf35a31996 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:10.086929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fdbff-fb0c-4392-90d9-c7bf35a31996 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:10.087534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fdbff-fb0c-4392-90d9-c7bf35a31996 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:10.087969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fdbff-fb0c-4392-90d9-c7bf35a31996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:16:10.088276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fdbff-fb0c-4392-90d9-c7bf35a31996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:10.090091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fdbff-fb0c-4392-90d9-c7bf35a31996 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:10.110312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf934bcc-138a-456d-8647-096d3bfbfcc8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:10.110681 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3133/6267] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:16:10.122408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf934bcc-138a-456d-8647-096d3bfbfcc8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:10.129421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de466b-3ad9-4457-bdd4-5a5af701ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:10.130364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de466b-3ad9-4457-bdd4-5a5af701ce1a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:10.130845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de466b-3ad9-4457-bdd4-5a5af701ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:10.132512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de466b-3ad9-4457-bdd4-5a5af701ce1a admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:10.133718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de466b-3ad9-4457-bdd4-5a5af701ce1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:10.136878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de466b-3ad9-4457-bdd4-5a5af701ce1a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:10.203514 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3135/6268] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:16:10 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:16:10.207570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fdbff-fb0c-4392-90d9-c7bf35a31996 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:10.230552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fdbff-fb0c-4392-90d9-c7bf35a31996 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:10.375821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f8d87-28e3-4dcf-9416-dd0052fc8ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:10.376562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f8d87-28e3-4dcf-9416-dd0052fc8ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:10.376913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f8d87-28e3-4dcf-9416-dd0052fc8ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:10.377897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f8d87-28e3-4dcf-9416-dd0052fc8ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:10.378620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f8d87-28e3-4dcf-9416-dd0052fc8ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:10.380833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f8d87-28e3-4dcf-9416-dd0052fc8ec2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:10.427301 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3134/6269] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:16:10 2022] POST /identity/v3/users => generated 291 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:16:10.427484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de466b-3ad9-4457-bdd4-5a5af701ce1a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:10.442296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de466b-3ad9-4457-bdd4-5a5af701ce1a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:10.455963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36f0c9-803f-414b-b93a-639b40585db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:10.456637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36f0c9-803f-414b-b93a-639b40585db2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:10.456919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36f0c9-803f-414b-b93a-639b40585db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:10.457241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36f0c9-803f-414b-b93a-639b40585db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:10.458001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36f0c9-803f-414b-b93a-639b40585db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:10.460975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36f0c9-803f-414b-b93a-639b40585db2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:10.486489 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3136/6270] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:16:10.490397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f8d87-28e3-4dcf-9416-dd0052fc8ec2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:10.502802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f8d87-28e3-4dcf-9416-dd0052fc8ec2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:10.509408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d84d3-56d6-4e04-b361-4d99d6d11da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:10.510139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d84d3-56d6-4e04-b361-4d99d6d11da6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:10.510626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d84d3-56d6-4e04-b361-4d99d6d11da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:10.510901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d84d3-56d6-4e04-b361-4d99d6d11da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:10.511566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d84d3-56d6-4e04-b361-4d99d6d11da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:10.515226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d84d3-56d6-4e04-b361-4d99d6d11da6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:10.532273 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3135/6271] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:16:10.536588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36f0c9-803f-414b-b93a-639b40585db2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:10.550900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36f0c9-803f-414b-b93a-639b40585db2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:10.563851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfc58d-76ac-47f7-86b4-ed1879014dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:10.564954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfc58d-76ac-47f7-86b4-ed1879014dde admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:10.565546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfc58d-76ac-47f7-86b4-ed1879014dde admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:10.566045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfc58d-76ac-47f7-86b4-ed1879014dde admin admin] PATH_INFO: `/v3/projects/6fdea37d91ed431aa0dc780148174e5b/users/3a292ffe2c5c41ef8d281fa525792b16/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:10.606810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfc58d-76ac-47f7-86b4-ed1879014dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fdea37d91ed431aa0dc780148174e5b, user_id=3a292ffe2c5c41ef8d281fa525792b16, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:10.610733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfc58d-76ac-47f7-86b4-ed1879014dde admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:10.640036 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3137/6272] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:16:10 2022] PUT /identity/v3/projects/6fdea37d91ed431aa0dc780148174e5b/users/3a292ffe2c5c41ef8d281fa525792b16/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:16:10.649805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f543c-1f4f-45e9-ae02-87c70d243c5d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:10.650100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f543c-1f4f-45e9-ae02-87c70d243c5d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:10.650382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f543c-1f4f-45e9-ae02-87c70d243c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:10.699535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c94f543c-1f4f-45e9-ae02-87c70d243c5d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:16:10.700929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c94f543c-1f4f-45e9-ae02-87c70d243c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:10.780306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:10.831812 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3136/6273] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:16:10.893129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfc58d-76ac-47f7-86b4-ed1879014dde admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:10.895159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ccbfc58d-76ac-47f7-86b4-ed1879014dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:10.980913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:11.099920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfc58d-76ac-47f7-86b4-ed1879014dde admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:11.106919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d0046-b208-4206-983e-7b2f2594155d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:11.107995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d0046-b208-4206-983e-7b2f2594155d service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:11.108444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d0046-b208-4206-983e-7b2f2594155d service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:11.109842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d0046-b208-4206-983e-7b2f2594155d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:11.122069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d0046-b208-4206-983e-7b2f2594155d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:11.123851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d0046-b208-4206-983e-7b2f2594155d service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:11.137710 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3138/6274] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:16:12.590955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6b17b-9163-46c8-ac8d-91bc38071b46 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:12.591418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6b17b-9163-46c8-ac8d-91bc38071b46 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:12.591513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6b17b-9163-46c8-ac8d-91bc38071b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:12.680560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-50d6b17b-9163-46c8-ac8d-91bc38071b46 None None] MFA Rules not processed for user `1af17546ab4745d8b92eab4f5c3ebb14`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:16:12.682081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-50d6b17b-9163-46c8-ac8d-91bc38071b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:12.864772 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3137/6275] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:16:12.865407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eecf65-9449-4c41-b6d3-1f0e831b28ff None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:12.865925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eecf65-9449-4c41-b6d3-1f0e831b28ff None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:12.866047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eecf65-9449-4c41-b6d3-1f0e831b28ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:12.904354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c3eecf65-9449-4c41-b6d3-1f0e831b28ff None None] MFA Rules not processed for user `1af17546ab4745d8b92eab4f5c3ebb14`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:16:12.907601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c3eecf65-9449-4c41-b6d3-1f0e831b28ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:12.927081 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3139/6276] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:16:12.942734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6b17b-9163-46c8-ac8d-91bc38071b46 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:12.945897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-50d6b17b-9163-46c8-ac8d-91bc38071b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:13.106640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6b17b-9163-46c8-ac8d-91bc38071b46 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:13.113390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31703cb5-62c6-475a-9e34-a8f8a6d59644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:13.114024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703cb5-62c6-475a-9e34-a8f8a6d59644 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:13.114308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703cb5-62c6-475a-9e34-a8f8a6d59644 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:13.114854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703cb5-62c6-475a-9e34-a8f8a6d59644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:13.133414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31703cb5-62c6-475a-9e34-a8f8a6d59644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:13.136136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31703cb5-62c6-475a-9e34-a8f8a6d59644 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:13.158156 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3138/6277] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:16:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:16:14.870589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4ed4b-5353-4ccd-a312-a575acda26d6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:14.871168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4ed4b-5353-4ccd-a312-a575acda26d6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:14.871551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4ed4b-5353-4ccd-a312-a575acda26d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:14.929037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-25d4ed4b-5353-4ccd-a312-a575acda26d6 None None] MFA Rules not processed for user `3a292ffe2c5c41ef8d281fa525792b16`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:16:14.930300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-25d4ed4b-5353-4ccd-a312-a575acda26d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:15.110982 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3140/6278] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:16:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:16:15.119256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31703cb5-62c6-475a-9e34-a8f8a6d59644 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:15.120797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-31703cb5-62c6-475a-9e34-a8f8a6d59644 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:15.227138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31703cb5-62c6-475a-9e34-a8f8a6d59644 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:15.235242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc02b4f-d2b3-419c-8b4c-2bb93e5109ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:15.236374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc02b4f-d2b3-419c-8b4c-2bb93e5109ae service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:15.236957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc02b4f-d2b3-419c-8b4c-2bb93e5109ae service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:15.237564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc02b4f-d2b3-419c-8b4c-2bb93e5109ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:15.252910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:15.255826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc02b4f-d2b3-419c-8b4c-2bb93e5109ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:15.257475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc02b4f-d2b3-419c-8b4c-2bb93e5109ae service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:15.273213 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3139/6279] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:16:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:16:25.097996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=54 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:25.266103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:37.444403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4ed4b-5353-4ccd-a312-a575acda26d6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:37.446548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-25d4ed4b-5353-4ccd-a312-a575acda26d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:37.602759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4ed4b-5353-4ccd-a312-a575acda26d6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:37.609004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d436e-c79b-4345-9dd9-d454d5e5ec2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:37.611404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d436e-c79b-4345-9dd9-d454d5e5ec2a service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:37.611996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d436e-c79b-4345-9dd9-d454d5e5ec2a service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:37.612412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d436e-c79b-4345-9dd9-d454d5e5ec2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:37.614512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-904d436e-c79b-4345-9dd9-d454d5e5ec2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:37.634635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d436e-c79b-4345-9dd9-d454d5e5ec2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:37.638055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d436e-c79b-4345-9dd9-d454d5e5ec2a service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:37.680144 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3141/6280] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:16:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:16:47.654151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=32 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:51.051117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37150af-2a1e-43fb-877a-3dc49288130f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:51.051686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37150af-2a1e-43fb-877a-3dc49288130f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:51.051884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37150af-2a1e-43fb-877a-3dc49288130f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:51.081338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f37150af-2a1e-43fb-877a-3dc49288130f None None] MFA Rules not processed for user `3a292ffe2c5c41ef8d281fa525792b16`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:16:51.082711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f37150af-2a1e-43fb-877a-3dc49288130f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:51.091114 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3140/6281] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:16:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:16:51.200020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d436e-c79b-4345-9dd9-d454d5e5ec2a service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:51.201745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-904d436e-c79b-4345-9dd9-d454d5e5ec2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:51.356209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d436e-c79b-4345-9dd9-d454d5e5ec2a service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:51.361089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eca9db-59de-4da1-8abd-6153be4186e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:51.361795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eca9db-59de-4da1-8abd-6153be4186e7 service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:51.362076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eca9db-59de-4da1-8abd-6153be4186e7 service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:51.362540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eca9db-59de-4da1-8abd-6153be4186e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:51.369086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-49eca9db-59de-4da1-8abd-6153be4186e7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:51.404990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eca9db-59de-4da1-8abd-6153be4186e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:51.407384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eca9db-59de-4da1-8abd-6153be4186e7 service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:51.427439 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3142/6282] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:16:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:16:53.596721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37150af-2a1e-43fb-877a-3dc49288130f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:53.612955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37150af-2a1e-43fb-877a-3dc49288130f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:53.617688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e046e83-b327-497a-927b-2e78b0ab3e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:53.618307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e046e83-b327-497a-927b-2e78b0ab3e16 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:53.618586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e046e83-b327-497a-927b-2e78b0ab3e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:53.618856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e046e83-b327-497a-927b-2e78b0ab3e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:53.624110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1e046e83-b327-497a-927b-2e78b0ab3e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:53.671909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e046e83-b327-497a-927b-2e78b0ab3e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:53.673746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e046e83-b327-497a-927b-2e78b0ab3e16 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:53.709507 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3141/6283] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:16:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:16:58.003963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eca9db-59de-4da1-8abd-6153be4186e7 service glance] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:58.005489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-49eca9db-59de-4da1-8abd-6153be4186e7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:58.032393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eca9db-59de-4da1-8abd-6153be4186e7 service glance] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:58.041880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:58.042896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:58.043456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:58.043931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] PATH_INFO: `/v3/users/cd3d8faf49eb4b41974db6a54d468edc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:58.047707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3d8faf49eb4b41974db6a54d468edc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:58.050623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:58.241256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3d8faf49eb4b41974db6a54d468edc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:58.261808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3d8faf49eb4b41974db6a54d468edc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:58.262990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3d8faf49eb4b41974db6a54d468edc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:58.263753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3d8faf49eb4b41974db6a54d468edc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:58.283022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3d8faf49eb4b41974db6a54d468edc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:58.315619 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3143/6284] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:16:58 2022] DELETE /identity/v3/users/cd3d8faf49eb4b41974db6a54d468edc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:16:58.317426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec942c9-3252-4fce-931b-edb5a86311d3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:58.318228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec942c9-3252-4fce-931b-edb5a86311d3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:58.318655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec942c9-3252-4fce-931b-edb5a86311d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:58.346533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1ec942c9-3252-4fce-931b-edb5a86311d3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:16:58.348267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1ec942c9-3252-4fce-931b-edb5a86311d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:58.434354 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3142/6285] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:16:58.463370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:58.464886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:58.555393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748bab9-2fbf-4aa5-8d0f-05fa567aa777 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:58.560045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272b427-ee58-41e6-89fa-74245703060e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:58.561118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272b427-ee58-41e6-89fa-74245703060e service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:58.562607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272b427-ee58-41e6-89fa-74245703060e service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:58.563125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272b427-ee58-41e6-89fa-74245703060e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:58.576666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272b427-ee58-41e6-89fa-74245703060e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:58.581221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272b427-ee58-41e6-89fa-74245703060e service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:58.609392 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3144/6286] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:16:59.294680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec942c9-3252-4fce-931b-edb5a86311d3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:59.299893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1ec942c9-3252-4fce-931b-edb5a86311d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:59.363410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec942c9-3252-4fce-931b-edb5a86311d3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:59.377400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ce560-0851-49ad-b371-e82430836c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:59.378400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ce560-0851-49ad-b371-e82430836c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:59.378847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ce560-0851-49ad-b371-e82430836c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:59.379855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ce560-0851-49ad-b371-e82430836c7b admin admin] PATH_INFO: `/v3/projects/37205dfda33f448c85cede3d7f19e3a1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:59.381547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ce560-0851-49ad-b371-e82430836c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=37205dfda33f448c85cede3d7f19e3a1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:59.385129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ce560-0851-49ad-b371-e82430836c7b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:59.502503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d58ce560-0851-49ad-b371-e82430836c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37205dfda33f448c85cede3d7f19e3a1', 'request_id': 'req-d58ce560-0851-49ad-b371-e82430836c7b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:59.512858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d58ce560-0851-49ad-b371-e82430836c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37205dfda33f448c85cede3d7f19e3a1', 'request_id': 'req-d58ce560-0851-49ad-b371-e82430836c7b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:59.519862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272b427-ee58-41e6-89fa-74245703060e service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:59.523622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5272b427-ee58-41e6-89fa-74245703060e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:59.529901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d58ce560-0851-49ad-b371-e82430836c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37205dfda33f448c85cede3d7f19e3a1', 'request_id': 'req-d58ce560-0851-49ad-b371-e82430836c7b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:59.551852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d58ce560-0851-49ad-b371-e82430836c7b admin admin] The token cache is being invalidate because project 37205dfda33f448c85cede3d7f19e3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:16:59.552137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d58ce560-0851-49ad-b371-e82430836c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:59.553172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d58ce560-0851-49ad-b371-e82430836c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:16:59.555882 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3143/6287] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:16:59 2022] DELETE /identity/v3/projects/37205dfda33f448c85cede3d7f19e3a1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:16:59.562913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f647331-f812-4f5e-ac45-747bee1354ed None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:59.563513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f647331-f812-4f5e-ac45-747bee1354ed None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:59.564198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f647331-f812-4f5e-ac45-747bee1354ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:59.581089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:59.616315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6f647331-f812-4f5e-ac45-747bee1354ed None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:16:59.618898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6f647331-f812-4f5e-ac45-747bee1354ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:59.710018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272b427-ee58-41e6-89fa-74245703060e service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:59.871068 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3144/6288] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:16:59.871068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f647331-f812-4f5e-ac45-747bee1354ed None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:16:59.871068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6f647331-f812-4f5e-ac45-747bee1354ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:59.872584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cad4a-221d-4cff-8820-bdb8d94562ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:59.873353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cad4a-221d-4cff-8820-bdb8d94562ae service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:59.873680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cad4a-221d-4cff-8820-bdb8d94562ae service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:59.874357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cad4a-221d-4cff-8820-bdb8d94562ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:59.886425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:59.890257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f647331-f812-4f5e-ac45-747bee1354ed None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:16:59.890567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-263cad4a-221d-4cff-8820-bdb8d94562ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:16:59.906996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87852d31-fb90-421d-a595-768711061ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:16:59.907676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87852d31-fb90-421d-a595-768711061ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:16:59.907971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87852d31-fb90-421d-a595-768711061ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:16:59.908238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87852d31-fb90-421d-a595-768711061ae8 admin admin] PATH_INFO: `/v3/users/1af17546ab4745d8b92eab4f5c3ebb14` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:16:59.909467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87852d31-fb90-421d-a595-768711061ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af17546ab4745d8b92eab4f5c3ebb14)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:59.911466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87852d31-fb90-421d-a595-768711061ae8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:59.929534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cad4a-221d-4cff-8820-bdb8d94562ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:16:59.934514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cad4a-221d-4cff-8820-bdb8d94562ae service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:16:59.997802 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3145/6289] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:16:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:00.000523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551fa8-6dbd-41c1-a4a0-a62d191f3899 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:00.000523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551fa8-6dbd-41c1-a4a0-a62d191f3899 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:00.000523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551fa8-6dbd-41c1-a4a0-a62d191f3899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:00.032213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87852d31-fb90-421d-a595-768711061ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af17546ab4745d8b92eab4f5c3ebb14'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:00.041761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87852d31-fb90-421d-a595-768711061ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af17546ab4745d8b92eab4f5c3ebb14'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:00.053375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ab551fa8-6dbd-41c1-a4a0-a62d191f3899 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:00.054376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87852d31-fb90-421d-a595-768711061ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af17546ab4745d8b92eab4f5c3ebb14'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:00.054929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ab551fa8-6dbd-41c1-a4a0-a62d191f3899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:00.055396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87852d31-fb90-421d-a595-768711061ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af17546ab4745d8b92eab4f5c3ebb14'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:00.077953 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3146/6290] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:00.078799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87852d31-fb90-421d-a595-768711061ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af17546ab4745d8b92eab4f5c3ebb14'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:00.079118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab551fa8-6dbd-41c1-a4a0-a62d191f3899 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:00.098300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab551fa8-6dbd-41c1-a4a0-a62d191f3899 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:00.112467 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3145/6291] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:16:59 2022] DELETE /identity/v3/users/1af17546ab4745d8b92eab4f5c3ebb14 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:00.117667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1beb90-9ed7-4697-8289-22e1ce1edff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:00.119598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1beb90-9ed7-4697-8289-22e1ce1edff4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:00.120114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1beb90-9ed7-4697-8289-22e1ce1edff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:00.120703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1beb90-9ed7-4697-8289-22e1ce1edff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:00.125227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1beb90-9ed7-4697-8289-22e1ce1edff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:17:00.125744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1beb90-9ed7-4697-8289-22e1ce1edff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:00.127770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1beb90-9ed7-4697-8289-22e1ce1edff4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:00.160201 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3147/6292] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:17:00.163982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87852d31-fb90-421d-a595-768711061ae8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:00.325451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87852d31-fb90-421d-a595-768711061ae8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:00.343439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba714d43-49bc-41d1-b1a6-303066ca02d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:00.344356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba714d43-49bc-41d1-b1a6-303066ca02d3 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:00.344839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba714d43-49bc-41d1-b1a6-303066ca02d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:00.345416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba714d43-49bc-41d1-b1a6-303066ca02d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:00.346798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba714d43-49bc-41d1-b1a6-303066ca02d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:00.349240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba714d43-49bc-41d1-b1a6-303066ca02d3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:00.416265 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3146/6293] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:00 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:00.420381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1beb90-9ed7-4697-8289-22e1ce1edff4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:00.435051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1beb90-9ed7-4697-8289-22e1ce1edff4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:00.570005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ab57f-cc88-46b6-80b0-c7756ae992bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:00.570627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ab57f-cc88-46b6-80b0-c7756ae992bf admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:00.570897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ab57f-cc88-46b6-80b0-c7756ae992bf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:00.571715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ab57f-cc88-46b6-80b0-c7756ae992bf admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:00.571823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ab57f-cc88-46b6-80b0-c7756ae992bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:00.574479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ab57f-cc88-46b6-80b0-c7756ae992bf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:00.605858 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3148/6294] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:00 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:00.611883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba714d43-49bc-41d1-b1a6-303066ca02d3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:00.630627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba714d43-49bc-41d1-b1a6-303066ca02d3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:00.636872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df82bd-e9ac-4f20-bfe3-b78f1b7c71df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:00.637566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df82bd-e9ac-4f20-bfe3-b78f1b7c71df admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:00.637843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df82bd-e9ac-4f20-bfe3-b78f1b7c71df admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:00.639381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df82bd-e9ac-4f20-bfe3-b78f1b7c71df admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:00.640831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df82bd-e9ac-4f20-bfe3-b78f1b7c71df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:00.649431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df82bd-e9ac-4f20-bfe3-b78f1b7c71df admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:00.673000 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3147/6295] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:00.676889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ab57f-cc88-46b6-80b0-c7756ae992bf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:00.689111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ab57f-cc88-46b6-80b0-c7756ae992bf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:00.694313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972da59a-f0df-4457-bcf5-8840cc12ca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:00.695151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972da59a-f0df-4457-bcf5-8840cc12ca64 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:00.695812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972da59a-f0df-4457-bcf5-8840cc12ca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:00.696259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972da59a-f0df-4457-bcf5-8840cc12ca64 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:00.697008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972da59a-f0df-4457-bcf5-8840cc12ca64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:00.698982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972da59a-f0df-4457-bcf5-8840cc12ca64 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:00.713142 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3149/6296] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:17:00.717397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df82bd-e9ac-4f20-bfe3-b78f1b7c71df admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:00.731657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df82bd-e9ac-4f20-bfe3-b78f1b7c71df admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:00.749552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571ee72-f497-4c20-b61a-251cc96cde6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:00.751175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ee72-f497-4c20-b61a-251cc96cde6c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:00.751713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ee72-f497-4c20-b61a-251cc96cde6c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:00.752361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ee72-f497-4c20-b61a-251cc96cde6c admin admin] PATH_INFO: `/v3/projects/009cc3cd15a54c0ea7c30b4cfcb76da7/users/bec611d6873d431da1838e95803c775a/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:00.793718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571ee72-f497-4c20-b61a-251cc96cde6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=009cc3cd15a54c0ea7c30b4cfcb76da7, user_id=bec611d6873d431da1838e95803c775a, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:00.800777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571ee72-f497-4c20-b61a-251cc96cde6c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:00.815373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972da59a-f0df-4457-bcf5-8840cc12ca64 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:00.818384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-972da59a-f0df-4457-bcf5-8840cc12ca64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:00.844463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972da59a-f0df-4457-bcf5-8840cc12ca64 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:00.848180 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3148/6297] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:00 2022] PUT /identity/v3/projects/009cc3cd15a54c0ea7c30b4cfcb76da7/users/bec611d6873d431da1838e95803c775a/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:00.858727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:00.860554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae79af9-32cb-4354-8734-40798a3f5be8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:00.861256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae79af9-32cb-4354-8734-40798a3f5be8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:00.861721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae79af9-32cb-4354-8734-40798a3f5be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:00.949126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2ae79af9-32cb-4354-8734-40798a3f5be8 None None] MFA Rules not processed for user `bec611d6873d431da1838e95803c775a`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:00.954985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2ae79af9-32cb-4354-8734-40798a3f5be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:01.006418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:01.035097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c80eb7-f37d-4caf-b297-4394045e441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:01.038351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c80eb7-f37d-4caf-b297-4394045e441e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:01.038811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c80eb7-f37d-4caf-b297-4394045e441e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:01.039240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c80eb7-f37d-4caf-b297-4394045e441e admin admin] PATH_INFO: `/v3/projects/173beeb5bce346eabf2a2d19f4c381d6` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:01.040980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c80eb7-f37d-4caf-b297-4394045e441e admin admin] RBAC: Authorizing `identity:delete_project(project_id=173beeb5bce346eabf2a2d19f4c381d6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:01.047979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c80eb7-f37d-4caf-b297-4394045e441e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:01.145924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39c80eb7-f37d-4caf-b297-4394045e441e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173beeb5bce346eabf2a2d19f4c381d6', 'request_id': 'req-39c80eb7-f37d-4caf-b297-4394045e441e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:01.172264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39c80eb7-f37d-4caf-b297-4394045e441e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173beeb5bce346eabf2a2d19f4c381d6', 'request_id': 'req-39c80eb7-f37d-4caf-b297-4394045e441e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:01.179696 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3149/6298] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:01.194464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39c80eb7-f37d-4caf-b297-4394045e441e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173beeb5bce346eabf2a2d19f4c381d6', 'request_id': 'req-39c80eb7-f37d-4caf-b297-4394045e441e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:01.213984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39c80eb7-f37d-4caf-b297-4394045e441e admin admin] The token cache is being invalidate because project 173beeb5bce346eabf2a2d19f4c381d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:01.214426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39c80eb7-f37d-4caf-b297-4394045e441e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:01.215271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39c80eb7-f37d-4caf-b297-4394045e441e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:01.217312 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3150/6299] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:00 2022] DELETE /identity/v3/projects/173beeb5bce346eabf2a2d19f4c381d6 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:01.222326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ca6d9-c472-46e8-9ff9-eb5b96d1ebc8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:01.222784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ca6d9-c472-46e8-9ff9-eb5b96d1ebc8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:01.222997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae79af9-32cb-4354-8734-40798a3f5be8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:01.223259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ca6d9-c472-46e8-9ff9-eb5b96d1ebc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:01.224728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2ae79af9-32cb-4354-8734-40798a3f5be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:01.247477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-814ca6d9-c472-46e8-9ff9-eb5b96d1ebc8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:01.248909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-814ca6d9-c472-46e8-9ff9-eb5b96d1ebc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:01.341337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae79af9-32cb-4354-8734-40798a3f5be8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:01.365278 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3151/6300] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:01.376194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c66651-e181-4c8c-815c-9d7718475283 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:01.376584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c66651-e181-4c8c-815c-9d7718475283 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:01.376948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c66651-e181-4c8c-815c-9d7718475283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:01.401891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-16c66651-e181-4c8c-815c-9d7718475283 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:01.403583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-16c66651-e181-4c8c-815c-9d7718475283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:01.413615 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3152/6301] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:01.417687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c66651-e181-4c8c-815c-9d7718475283 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:01.441877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c66651-e181-4c8c-815c-9d7718475283 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:01.457290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a2ad1-689e-4507-9b6b-33dc004bd98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:01.458310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a2ad1-689e-4507-9b6b-33dc004bd98f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:01.458430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a2ad1-689e-4507-9b6b-33dc004bd98f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:01.458620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a2ad1-689e-4507-9b6b-33dc004bd98f admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:01.459278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a2ad1-689e-4507-9b6b-33dc004bd98f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:17:01.459579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a2ad1-689e-4507-9b6b-33dc004bd98f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:01.461172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a2ad1-689e-4507-9b6b-33dc004bd98f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:01.466043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f905441-c1e3-4d73-87b6-bb0df57827c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:01.466683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f905441-c1e3-4d73-87b6-bb0df57827c5 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:01.467138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f905441-c1e3-4d73-87b6-bb0df57827c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:01.467418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f905441-c1e3-4d73-87b6-bb0df57827c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:01.470371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4f905441-c1e3-4d73-87b6-bb0df57827c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:01.496250 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3153/6302] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:17:01.497167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a2ad1-689e-4507-9b6b-33dc004bd98f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:01.519916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a2ad1-689e-4507-9b6b-33dc004bd98f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:01.532107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7200e2-94dc-4352-b182-ecbdb4dbf75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:01.532788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7200e2-94dc-4352-b182-ecbdb4dbf75a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:01.533079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7200e2-94dc-4352-b182-ecbdb4dbf75a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:01.533886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7200e2-94dc-4352-b182-ecbdb4dbf75a admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:01.534589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7200e2-94dc-4352-b182-ecbdb4dbf75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:01.538411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7200e2-94dc-4352-b182-ecbdb4dbf75a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:01.598503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:01.621592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f905441-c1e3-4d73-87b6-bb0df57827c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:01.623420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f905441-c1e3-4d73-87b6-bb0df57827c5 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:01.640173 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3154/6303] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:01 2022] POST /identity/v3/projects => generated 397 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:01.648876 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3150/6304] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:01.651257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7200e2-94dc-4352-b182-ecbdb4dbf75a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:01.805742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7200e2-94dc-4352-b182-ecbdb4dbf75a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:01.814397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21534bdd-2bf0-4872-bae3-3a5e8ef1da2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:01.815143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21534bdd-2bf0-4872-bae3-3a5e8ef1da2d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:01.815499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21534bdd-2bf0-4872-bae3-3a5e8ef1da2d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:01.815867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21534bdd-2bf0-4872-bae3-3a5e8ef1da2d admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:01.816591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21534bdd-2bf0-4872-bae3-3a5e8ef1da2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:01.818742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21534bdd-2bf0-4872-bae3-3a5e8ef1da2d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:01.887959 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3155/6305] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:01 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:01.899618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f905441-c1e3-4d73-87b6-bb0df57827c5 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:01.916446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f905441-c1e3-4d73-87b6-bb0df57827c5 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:01.930049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71173ba2-ea45-4d10-81a9-86fc9633e71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:01.932528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71173ba2-ea45-4d10-81a9-86fc9633e71e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:01.932935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71173ba2-ea45-4d10-81a9-86fc9633e71e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:01.934092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71173ba2-ea45-4d10-81a9-86fc9633e71e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:01.936875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71173ba2-ea45-4d10-81a9-86fc9633e71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:01.938701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71173ba2-ea45-4d10-81a9-86fc9633e71e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:01.958275 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3151/6306] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:01.962753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21534bdd-2bf0-4872-bae3-3a5e8ef1da2d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:01.979760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21534bdd-2bf0-4872-bae3-3a5e8ef1da2d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:01.996752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491fca7-d675-4863-bb5c-fd9562ef0907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:01.997413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491fca7-d675-4863-bb5c-fd9562ef0907 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:01.997690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491fca7-d675-4863-bb5c-fd9562ef0907 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:01.997960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491fca7-d675-4863-bb5c-fd9562ef0907 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:01.998612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491fca7-d675-4863-bb5c-fd9562ef0907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:02.000363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491fca7-d675-4863-bb5c-fd9562ef0907 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:02.021501 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3156/6307] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:02.025360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71173ba2-ea45-4d10-81a9-86fc9633e71e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:02.043983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71173ba2-ea45-4d10-81a9-86fc9633e71e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:02.058949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a665f-8859-44cc-a4a3-c78bf024b4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:02.059611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a665f-8859-44cc-a4a3-c78bf024b4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:02.062200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a665f-8859-44cc-a4a3-c78bf024b4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:02.062845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a665f-8859-44cc-a4a3-c78bf024b4cc admin admin] PATH_INFO: `/v3/projects/601b7d01a1044882ab0935fadcc65449/users/5ba12893b3764aae950d7e38ff22322e/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:02.087973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:02.094959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a665f-8859-44cc-a4a3-c78bf024b4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=601b7d01a1044882ab0935fadcc65449, user_id=5ba12893b3764aae950d7e38ff22322e, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:02.117353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a665f-8859-44cc-a4a3-c78bf024b4cc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:02.169093 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3152/6308] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:02 2022] PUT /identity/v3/projects/601b7d01a1044882ab0935fadcc65449/users/5ba12893b3764aae950d7e38ff22322e/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:02.180745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a978a6-5a91-4dc3-85a7-f9cae4b4f327 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:02.181064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a978a6-5a91-4dc3-85a7-f9cae4b4f327 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:02.181327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a978a6-5a91-4dc3-85a7-f9cae4b4f327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:02.246898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-61a978a6-5a91-4dc3-85a7-f9cae4b4f327 None None] MFA Rules not processed for user `5ba12893b3764aae950d7e38ff22322e`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:02.248629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-61a978a6-5a91-4dc3-85a7-f9cae4b4f327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:02.419773 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3157/6309] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:02.432638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c3a5e-7912-4c1e-91dd-ae6d84e78042 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:02.433539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c3a5e-7912-4c1e-91dd-ae6d84e78042 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:02.434019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c3a5e-7912-4c1e-91dd-ae6d84e78042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:02.498281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-163c3a5e-7912-4c1e-91dd-ae6d84e78042 None None] MFA Rules not processed for user `5ba12893b3764aae950d7e38ff22322e`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:02.500128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-163c3a5e-7912-4c1e-91dd-ae6d84e78042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:02.532034 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3153/6310] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:02.691771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a978a6-5a91-4dc3-85a7-f9cae4b4f327 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:02.693722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-61a978a6-5a91-4dc3-85a7-f9cae4b4f327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:02.849797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:02.860347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a978a6-5a91-4dc3-85a7-f9cae4b4f327 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:02.869593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4f3d8-93e5-4ee8-a8e5-95373aac77b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:02.870659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4f3d8-93e5-4ee8-a8e5-95373aac77b9 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:02.870659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4f3d8-93e5-4ee8-a8e5-95373aac77b9 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:02.870874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4f3d8-93e5-4ee8-a8e5-95373aac77b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:02.889233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4f3d8-93e5-4ee8-a8e5-95373aac77b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:02.890965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4f3d8-93e5-4ee8-a8e5-95373aac77b9 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:02.933269 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3158/6311] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:02 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:02.953131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905bb98-247f-41ce-b67d-f94115a89148 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:02.953521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905bb98-247f-41ce-b67d-f94115a89148 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:02.953925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905bb98-247f-41ce-b67d-f94115a89148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:02.998085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1905bb98-247f-41ce-b67d-f94115a89148 None None] MFA Rules not processed for user `5ba12893b3764aae950d7e38ff22322e`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:03.000281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1905bb98-247f-41ce-b67d-f94115a89148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:03.011724 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3154/6312] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:03.052155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cac808-fbc8-4143-968a-946a88eedcf7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:03.052807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cac808-fbc8-4143-968a-946a88eedcf7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:03.052807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cac808-fbc8-4143-968a-946a88eedcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:03.080741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-31cac808-fbc8-4143-968a-946a88eedcf7 None None] MFA Rules not processed for user `5ba12893b3764aae950d7e38ff22322e`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:03.082115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-31cac808-fbc8-4143-968a-946a88eedcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:03.100303 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3159/6313] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:03.126956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412b3f-81e0-4d17-b03f-89ec4ce03083 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:03.127442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412b3f-81e0-4d17-b03f-89ec4ce03083 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:03.127792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412b3f-81e0-4d17-b03f-89ec4ce03083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:03.164596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c3412b3f-81e0-4d17-b03f-89ec4ce03083 None None] MFA Rules not processed for user `5ba12893b3764aae950d7e38ff22322e`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:03.167007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c3412b3f-81e0-4d17-b03f-89ec4ce03083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:03.189132 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3155/6314] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:03.235173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bc223-a641-4b75-92b9-4d7dfca0505f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:03.235706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bc223-a641-4b75-92b9-4d7dfca0505f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:03.236157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bc223-a641-4b75-92b9-4d7dfca0505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:03.286493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-095bc223-a641-4b75-92b9-4d7dfca0505f None None] MFA Rules not processed for user `5ba12893b3764aae950d7e38ff22322e`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:03.288052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-095bc223-a641-4b75-92b9-4d7dfca0505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:03.301437 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3160/6315] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:03.321309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3412b3f-81e0-4d17-b03f-89ec4ce03083 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:03.431500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3412b3f-81e0-4d17-b03f-89ec4ce03083 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:03.439252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:03.440275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:03.440800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:03.441364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] PATH_INFO: `/v3/users/5ba12893b3764aae950d7e38ff22322e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:03.443581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba12893b3764aae950d7e38ff22322e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:03.445947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:03.537320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba12893b3764aae950d7e38ff22322e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:03.547116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba12893b3764aae950d7e38ff22322e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:03.548028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba12893b3764aae950d7e38ff22322e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:03.548750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba12893b3764aae950d7e38ff22322e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:03.567255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba12893b3764aae950d7e38ff22322e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:03.600077 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3156/6316] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:03 2022] DELETE /identity/v3/users/5ba12893b3764aae950d7e38ff22322e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:03.604968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572a69f-b21c-4b37-bc12-25da6a02b6c6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:03.605289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572a69f-b21c-4b37-bc12-25da6a02b6c6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:03.605570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572a69f-b21c-4b37-bc12-25da6a02b6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:03.631405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9572a69f-b21c-4b37-bc12-25da6a02b6c6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:03.632035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9572a69f-b21c-4b37-bc12-25da6a02b6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:03.714550 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3161/6317] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:03.756567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:03.758689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:03.879653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76f2e4-624d-4e2f-8095-673a3c02d253 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:03.886262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370be9af-71f8-4786-b338-4b4727b006cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:03.886843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370be9af-71f8-4786-b338-4b4727b006cb service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:03.887897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370be9af-71f8-4786-b338-4b4727b006cb service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:03.888122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370be9af-71f8-4786-b338-4b4727b006cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:03.897420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:03.927426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370be9af-71f8-4786-b338-4b4727b006cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:03.929546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370be9af-71f8-4786-b338-4b4727b006cb service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:03.951490 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3157/6318] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:05.531032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572a69f-b21c-4b37-bc12-25da6a02b6c6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:05.533141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9572a69f-b21c-4b37-bc12-25da6a02b6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:05.559260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572a69f-b21c-4b37-bc12-25da6a02b6c6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:05.571780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f509186-6c71-4069-a74c-410f5ede7502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:05.572428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f509186-6c71-4069-a74c-410f5ede7502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:05.572710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f509186-6c71-4069-a74c-410f5ede7502 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:05.572991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f509186-6c71-4069-a74c-410f5ede7502 admin admin] PATH_INFO: `/v3/projects/601b7d01a1044882ab0935fadcc65449` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:05.574211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f509186-6c71-4069-a74c-410f5ede7502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=601b7d01a1044882ab0935fadcc65449)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:05.576156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f509186-6c71-4069-a74c-410f5ede7502 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:05.651812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f509186-6c71-4069-a74c-410f5ede7502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '601b7d01a1044882ab0935fadcc65449', 'request_id': 'req-4f509186-6c71-4069-a74c-410f5ede7502'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:05.678960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f509186-6c71-4069-a74c-410f5ede7502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '601b7d01a1044882ab0935fadcc65449', 'request_id': 'req-4f509186-6c71-4069-a74c-410f5ede7502'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:05.692484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f509186-6c71-4069-a74c-410f5ede7502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '601b7d01a1044882ab0935fadcc65449', 'request_id': 'req-4f509186-6c71-4069-a74c-410f5ede7502'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:05.706612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f509186-6c71-4069-a74c-410f5ede7502 admin admin] The token cache is being invalidate because project 601b7d01a1044882ab0935fadcc65449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:05.707357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f509186-6c71-4069-a74c-410f5ede7502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:05.708192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f509186-6c71-4069-a74c-410f5ede7502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:05.711687 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3162/6319] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:05 2022] DELETE /identity/v3/projects/601b7d01a1044882ab0935fadcc65449 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:05.716312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f2aa1-ea00-4514-891c-e9d1b9b9cf6b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:05.717245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f2aa1-ea00-4514-891c-e9d1b9b9cf6b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:05.717861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f2aa1-ea00-4514-891c-e9d1b9b9cf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:05.766176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8e4f2aa1-ea00-4514-891c-e9d1b9b9cf6b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:05.767712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8e4f2aa1-ea00-4514-891c-e9d1b9b9cf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:05.880167 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3158/6320] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:05.887447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04124f77-a5e6-4d1f-b3f3-a04cb9f5fd7d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:05.887738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04124f77-a5e6-4d1f-b3f3-a04cb9f5fd7d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:05.888017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04124f77-a5e6-4d1f-b3f3-a04cb9f5fd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:05.931384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-04124f77-a5e6-4d1f-b3f3-a04cb9f5fd7d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:05.933075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-04124f77-a5e6-4d1f-b3f3-a04cb9f5fd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:05.944137 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3163/6321] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:05.948598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f2aa1-ea00-4514-891c-e9d1b9b9cf6b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:05.965072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f2aa1-ea00-4514-891c-e9d1b9b9cf6b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:05.985883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f27f6b-5176-4758-a0de-1402929c9f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:05.987528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f27f6b-5176-4758-a0de-1402929c9f41 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:05.988061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f27f6b-5176-4758-a0de-1402929c9f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:05.988551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f27f6b-5176-4758-a0de-1402929c9f41 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:05.989626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f27f6b-5176-4758-a0de-1402929c9f41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:17:05.990508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f27f6b-5176-4758-a0de-1402929c9f41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:05.992384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f27f6b-5176-4758-a0de-1402929c9f41 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:06.008228 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3159/6322] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:17:06.015508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04124f77-a5e6-4d1f-b3f3-a04cb9f5fd7d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:06.029411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04124f77-a5e6-4d1f-b3f3-a04cb9f5fd7d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:06.035849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead2182-f7d7-46d5-8380-20ff6894b907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:06.039339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead2182-f7d7-46d5-8380-20ff6894b907 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:06.039845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead2182-f7d7-46d5-8380-20ff6894b907 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:06.040287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead2182-f7d7-46d5-8380-20ff6894b907 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:06.041538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead2182-f7d7-46d5-8380-20ff6894b907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:06.044013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead2182-f7d7-46d5-8380-20ff6894b907 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:06.091312 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3164/6323] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:06 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:06.092303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f27f6b-5176-4758-a0de-1402929c9f41 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:06.105311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f27f6b-5176-4758-a0de-1402929c9f41 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:06.282062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d983a2-e358-46c2-b100-26060aff9e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:06.282713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d983a2-e358-46c2-b100-26060aff9e07 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:06.283002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d983a2-e358-46c2-b100-26060aff9e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:06.283477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d983a2-e358-46c2-b100-26060aff9e07 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:06.284283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d983a2-e358-46c2-b100-26060aff9e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:06.286384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d983a2-e358-46c2-b100-26060aff9e07 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:06.320931 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3160/6324] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:06 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:06.325230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead2182-f7d7-46d5-8380-20ff6894b907 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:06.343404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead2182-f7d7-46d5-8380-20ff6894b907 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:06.352628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf15ef2-95d6-4fa7-87f2-58830b1cfa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:06.353704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15ef2-95d6-4fa7-87f2-58830b1cfa1b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:06.354340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15ef2-95d6-4fa7-87f2-58830b1cfa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:06.354767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15ef2-95d6-4fa7-87f2-58830b1cfa1b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:06.369908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf15ef2-95d6-4fa7-87f2-58830b1cfa1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:06.370006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf15ef2-95d6-4fa7-87f2-58830b1cfa1b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:06.407545 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3165/6325] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:17:06.408812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d983a2-e358-46c2-b100-26060aff9e07 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:06.454744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d983a2-e358-46c2-b100-26060aff9e07 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:06.462313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618610d-539c-45ee-b83e-33a036c215c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:06.463167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618610d-539c-45ee-b83e-33a036c215c8 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:06.463556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618610d-539c-45ee-b83e-33a036c215c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:06.464298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618610d-539c-45ee-b83e-33a036c215c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:06.465123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618610d-539c-45ee-b83e-33a036c215c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:06.467573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618610d-539c-45ee-b83e-33a036c215c8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:06.482370 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3161/6326] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:06.492069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf15ef2-95d6-4fa7-87f2-58830b1cfa1b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:06.505692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf15ef2-95d6-4fa7-87f2-58830b1cfa1b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:06.512883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037e471-e81d-4d28-abc6-84a333ccd412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:06.513991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037e471-e81d-4d28-abc6-84a333ccd412 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:06.514367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037e471-e81d-4d28-abc6-84a333ccd412 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:06.515417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037e471-e81d-4d28-abc6-84a333ccd412 admin admin] PATH_INFO: `/v3/projects/bd563fa73afb42c6b26eca3737d7a355/users/2f98e01cab6b49c7a5d239aee95f4a64/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:06.539062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037e471-e81d-4d28-abc6-84a333ccd412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd563fa73afb42c6b26eca3737d7a355, user_id=2f98e01cab6b49c7a5d239aee95f4a64, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:06.541760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037e471-e81d-4d28-abc6-84a333ccd412 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:06.553679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:06.560497 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3166/6327] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:06 2022] PUT /identity/v3/projects/bd563fa73afb42c6b26eca3737d7a355/users/2f98e01cab6b49c7a5d239aee95f4a64/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:06.566756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b1b50-d3ab-444c-9ba3-c9f9278c025f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:06.567375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b1b50-d3ab-444c-9ba3-c9f9278c025f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:06.567799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b1b50-d3ab-444c-9ba3-c9f9278c025f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:06.591507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f80b1b50-d3ab-444c-9ba3-c9f9278c025f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:06.593335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f80b1b50-d3ab-444c-9ba3-c9f9278c025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:06.653910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:06.668915 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3162/6328] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:17:06.705771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037e471-e81d-4d28-abc6-84a333ccd412 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:06.709991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7037e471-e81d-4d28-abc6-84a333ccd412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:06.786994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037e471-e81d-4d28-abc6-84a333ccd412 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:06.791020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4062017-5ee2-49aa-9613-016d2babae70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:06.792202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4062017-5ee2-49aa-9613-016d2babae70 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:06.792549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4062017-5ee2-49aa-9613-016d2babae70 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:06.793024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4062017-5ee2-49aa-9613-016d2babae70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:06.810271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4062017-5ee2-49aa-9613-016d2babae70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:06.814324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4062017-5ee2-49aa-9613-016d2babae70 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:06.825862 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3167/6329] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:17:07.344452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b1b50-d3ab-444c-9ba3-c9f9278c025f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:07.347218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f80b1b50-d3ab-444c-9ba3-c9f9278c025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:07.367084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b1b50-d3ab-444c-9ba3-c9f9278c025f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:07.372877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:07.374232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:07.374797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:07.375221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] PATH_INFO: `/v3/users/79ab2ee3f8744e769ea54aa19cfd44e9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:07.377381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ab2ee3f8744e769ea54aa19cfd44e9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:07.379633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:07.453764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ab2ee3f8744e769ea54aa19cfd44e9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:07.465129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ab2ee3f8744e769ea54aa19cfd44e9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:07.466196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ab2ee3f8744e769ea54aa19cfd44e9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:07.467633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ab2ee3f8744e769ea54aa19cfd44e9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:07.501989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ab2ee3f8744e769ea54aa19cfd44e9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:07.533244 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3163/6330] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:07 2022] DELETE /identity/v3/users/79ab2ee3f8744e769ea54aa19cfd44e9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:07.539184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a6a4-29b2-4ea4-b9fe-f21f19be44e1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:07.539724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a6a4-29b2-4ea4-b9fe-f21f19be44e1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:07.540201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a6a4-29b2-4ea4-b9fe-f21f19be44e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:07.567300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-05a1a6a4-29b2-4ea4-b9fe-f21f19be44e1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:07.570489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-05a1a6a4-29b2-4ea4-b9fe-f21f19be44e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:07.677219 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3168/6331] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:07.741967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:07.743450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:07.907483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2ef4a-0095-4ada-92e0-2e1eab3e8e2a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:07.921739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddda8f-f646-4abf-a5c3-c2e07557b1bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:07.922738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddda8f-f646-4abf-a5c3-c2e07557b1bf service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:07.923184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddda8f-f646-4abf-a5c3-c2e07557b1bf service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:07.923910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddda8f-f646-4abf-a5c3-c2e07557b1bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:07.950161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddda8f-f646-4abf-a5c3-c2e07557b1bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:07.955769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddda8f-f646-4abf-a5c3-c2e07557b1bf service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:07.983381 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3164/6332] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:09.283988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1a6a4-29b2-4ea4-b9fe-f21f19be44e1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:09.285820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-05a1a6a4-29b2-4ea4-b9fe-f21f19be44e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:09.307701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1a6a4-29b2-4ea4-b9fe-f21f19be44e1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:09.316832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:09.317762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:09.318190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:09.318846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] PATH_INFO: `/v3/projects/a4a7293fb4ce491693974bd285f04609` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:09.320414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a7293fb4ce491693974bd285f04609)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:09.322865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:09.412475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a7293fb4ce491693974bd285f04609', 'request_id': 'req-56344bed-d23b-4f0a-8de1-25406ba17f77'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:09.442632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a7293fb4ce491693974bd285f04609', 'request_id': 'req-56344bed-d23b-4f0a-8de1-25406ba17f77'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:09.456949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a7293fb4ce491693974bd285f04609', 'request_id': 'req-56344bed-d23b-4f0a-8de1-25406ba17f77'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:09.491559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] The token cache is being invalidate because project a4a7293fb4ce491693974bd285f04609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:09.494083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:09.494998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:09.496636 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3169/6333] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:09 2022] DELETE /identity/v3/projects/a4a7293fb4ce491693974bd285f04609 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:09.501043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddda8f-f646-4abf-a5c3-c2e07557b1bf service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:09.531638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddda8f-f646-4abf-a5c3-c2e07557b1bf service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:09.667105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844f9e3-962b-4dd5-a983-fdbb45d46ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:09.668139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844f9e3-962b-4dd5-a983-fdbb45d46ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:09.668597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844f9e3-962b-4dd5-a983-fdbb45d46ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:09.669163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844f9e3-962b-4dd5-a983-fdbb45d46ac1 admin admin] PATH_INFO: `/v3/users/e988bf0a7f9a40e99f838ae4147ddbd7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:09.672367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844f9e3-962b-4dd5-a983-fdbb45d46ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e988bf0a7f9a40e99f838ae4147ddbd7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:09.674696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844f9e3-962b-4dd5-a983-fdbb45d46ac1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:09.697452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:09.744524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c844f9e3-962b-4dd5-a983-fdbb45d46ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e988bf0a7f9a40e99f838ae4147ddbd7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:09.754195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c844f9e3-962b-4dd5-a983-fdbb45d46ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e988bf0a7f9a40e99f838ae4147ddbd7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:09.754370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c844f9e3-962b-4dd5-a983-fdbb45d46ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e988bf0a7f9a40e99f838ae4147ddbd7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:09.756011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c844f9e3-962b-4dd5-a983-fdbb45d46ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e988bf0a7f9a40e99f838ae4147ddbd7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:09.779491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c844f9e3-962b-4dd5-a983-fdbb45d46ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e988bf0a7f9a40e99f838ae4147ddbd7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:09.808466 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3165/6334] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:09 2022] DELETE /identity/v3/users/e988bf0a7f9a40e99f838ae4147ddbd7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:11.480307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:11.483727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:11.506362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56344bed-d23b-4f0a-8de1-25406ba17f77 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:11.560583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:11.633915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1436aa-46de-4238-9894-c4bfce0f0598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:11.634600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1436aa-46de-4238-9894-c4bfce0f0598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:11.634837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1436aa-46de-4238-9894-c4bfce0f0598 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:11.635117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1436aa-46de-4238-9894-c4bfce0f0598 admin admin] PATH_INFO: `/v3/projects/be109f34c3c94294aa6ce8e419a64a41` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:11.647163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1436aa-46de-4238-9894-c4bfce0f0598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be109f34c3c94294aa6ce8e419a64a41)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:11.649833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1436aa-46de-4238-9894-c4bfce0f0598 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:11.723170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3c1436aa-46de-4238-9894-c4bfce0f0598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be109f34c3c94294aa6ce8e419a64a41', 'request_id': 'req-3c1436aa-46de-4238-9894-c4bfce0f0598'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:11.739544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3c1436aa-46de-4238-9894-c4bfce0f0598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be109f34c3c94294aa6ce8e419a64a41', 'request_id': 'req-3c1436aa-46de-4238-9894-c4bfce0f0598'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:11.752109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3c1436aa-46de-4238-9894-c4bfce0f0598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be109f34c3c94294aa6ce8e419a64a41', 'request_id': 'req-3c1436aa-46de-4238-9894-c4bfce0f0598'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:11.767761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3c1436aa-46de-4238-9894-c4bfce0f0598 admin admin] The token cache is being invalidate because project be109f34c3c94294aa6ce8e419a64a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:11.768340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3c1436aa-46de-4238-9894-c4bfce0f0598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:11.769177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3c1436aa-46de-4238-9894-c4bfce0f0598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:11.771490 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3170/6335] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:11 2022] DELETE /identity/v3/projects/be109f34c3c94294aa6ce8e419a64a41 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:11.776124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bab73-c848-4465-87d0-fe140514bdcf None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:11.777212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bab73-c848-4465-87d0-fe140514bdcf None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:11.777513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bab73-c848-4465-87d0-fe140514bdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:11.801758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-022bab73-c848-4465-87d0-fe140514bdcf None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:11.803222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-022bab73-c848-4465-87d0-fe140514bdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:11.985821 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3166/6336] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:11.993877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588187c-4154-425b-a4e3-ace6dda04838 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:11.994206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588187c-4154-425b-a4e3-ace6dda04838 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:11.994492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588187c-4154-425b-a4e3-ace6dda04838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:12.081264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4588187c-4154-425b-a4e3-ace6dda04838 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:12.082257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4588187c-4154-425b-a4e3-ace6dda04838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:12.097991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bab73-c848-4465-87d0-fe140514bdcf None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:12.114571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bab73-c848-4465-87d0-fe140514bdcf None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:12.114847 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3171/6337] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:12.120277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe764e4-0698-4aad-bff4-2c16b40b7397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:12.122580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe764e4-0698-4aad-bff4-2c16b40b7397 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:12.123333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe764e4-0698-4aad-bff4-2c16b40b7397 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:12.123811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe764e4-0698-4aad-bff4-2c16b40b7397 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:12.124592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe764e4-0698-4aad-bff4-2c16b40b7397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:17:12.124963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe764e4-0698-4aad-bff4-2c16b40b7397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:12.126773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe764e4-0698-4aad-bff4-2c16b40b7397 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:12.161800 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3167/6338] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:17:12.162568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588187c-4154-425b-a4e3-ace6dda04838 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:12.189295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588187c-4154-425b-a4e3-ace6dda04838 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:12.194715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d65c9d-4a29-49d3-9ac1-cb415d4b4d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:12.195343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d65c9d-4a29-49d3-9ac1-cb415d4b4d44 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:12.195620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d65c9d-4a29-49d3-9ac1-cb415d4b4d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:12.195899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d65c9d-4a29-49d3-9ac1-cb415d4b4d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:12.196788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d65c9d-4a29-49d3-9ac1-cb415d4b4d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:12.198777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d65c9d-4a29-49d3-9ac1-cb415d4b4d44 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:12.247770 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3172/6339] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:12 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:17:12.250482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe764e4-0698-4aad-bff4-2c16b40b7397 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:12.286777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe764e4-0698-4aad-bff4-2c16b40b7397 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:12.470542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe26d4-02b6-4bae-aa54-59e2d7481a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:12.471242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe26d4-02b6-4bae-aa54-59e2d7481a92 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:12.471609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe26d4-02b6-4bae-aa54-59e2d7481a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:12.471950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe26d4-02b6-4bae-aa54-59e2d7481a92 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:12.472648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe26d4-02b6-4bae-aa54-59e2d7481a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:12.480859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe26d4-02b6-4bae-aa54-59e2d7481a92 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:12.530371 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3168/6340] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:12 2022] POST /identity/v3/users => generated 292 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:12.531603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d65c9d-4a29-49d3-9ac1-cb415d4b4d44 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:12.546486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d65c9d-4a29-49d3-9ac1-cb415d4b4d44 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:12.557238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a223d-88b0-4def-bb02-ad5f614a2687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:12.559062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a223d-88b0-4def-bb02-ad5f614a2687 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:12.559351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a223d-88b0-4def-bb02-ad5f614a2687 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:12.559625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a223d-88b0-4def-bb02-ad5f614a2687 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:12.562488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a223d-88b0-4def-bb02-ad5f614a2687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:12.567446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a223d-88b0-4def-bb02-ad5f614a2687 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:12.584381 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3173/6341] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:12.588317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe26d4-02b6-4bae-aa54-59e2d7481a92 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:12.605617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe26d4-02b6-4bae-aa54-59e2d7481a92 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:12.628086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b685780-ef7d-4711-b5f1-706095e7bc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:12.629121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b685780-ef7d-4711-b5f1-706095e7bc24 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:12.629287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b685780-ef7d-4711-b5f1-706095e7bc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:12.629801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b685780-ef7d-4711-b5f1-706095e7bc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:12.630386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b685780-ef7d-4711-b5f1-706095e7bc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:12.632098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b685780-ef7d-4711-b5f1-706095e7bc24 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:12.647971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:12.669987 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3169/6342] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:12.673742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a223d-88b0-4def-bb02-ad5f614a2687 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:12.686138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a223d-88b0-4def-bb02-ad5f614a2687 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:12.691404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9adb8-e914-4035-8c0f-7e75b5d3f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:12.692080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9adb8-e914-4035-8c0f-7e75b5d3f662 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:12.692356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9adb8-e914-4035-8c0f-7e75b5d3f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:12.692633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9adb8-e914-4035-8c0f-7e75b5d3f662 admin admin] PATH_INFO: `/v3/projects/8128c843910b4105aa18267db5cc75e4/users/a5e7a94f7ab8484ebb25ac833df5dc3a/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:12.724595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9adb8-e914-4035-8c0f-7e75b5d3f662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8128c843910b4105aa18267db5cc75e4, user_id=a5e7a94f7ab8484ebb25ac833df5dc3a, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:12.730050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9adb8-e914-4035-8c0f-7e75b5d3f662 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:12.778392 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3174/6343] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:12 2022] PUT /identity/v3/projects/8128c843910b4105aa18267db5cc75e4/users/a5e7a94f7ab8484ebb25ac833df5dc3a/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:12.781424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e784a9c-8388-459c-b4a7-ebdb086042b8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:12.782498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e784a9c-8388-459c-b4a7-ebdb086042b8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:12.782938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e784a9c-8388-459c-b4a7-ebdb086042b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:12.820874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2e784a9c-8388-459c-b4a7-ebdb086042b8 None None] MFA Rules not processed for user `a5e7a94f7ab8484ebb25ac833df5dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:12.822369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2e784a9c-8388-459c-b4a7-ebdb086042b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:12.929218 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3170/6344] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:12.929424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9adb8-e914-4035-8c0f-7e75b5d3f662 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:13.000239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:13.021817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9adb8-e914-4035-8c0f-7e75b5d3f662 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:13.033678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc61f9-dc70-4d3d-8c4a-03efd416e8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:13.034318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc61f9-dc70-4d3d-8c4a-03efd416e8fe admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:13.034598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc61f9-dc70-4d3d-8c4a-03efd416e8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:13.035018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc61f9-dc70-4d3d-8c4a-03efd416e8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:13.036495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc61f9-dc70-4d3d-8c4a-03efd416e8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:13.040891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc61f9-dc70-4d3d-8c4a-03efd416e8fe admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:13.093745 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3175/6345] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:12 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:13.095285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e784a9c-8388-459c-b4a7-ebdb086042b8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:13.118757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e784a9c-8388-459c-b4a7-ebdb086042b8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:13.274215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a0a72-e669-4b9c-88dc-fded501440b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:13.274939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a0a72-e669-4b9c-88dc-fded501440b6 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:13.275327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a0a72-e669-4b9c-88dc-fded501440b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:13.275541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a0a72-e669-4b9c-88dc-fded501440b6 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:13.276633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a0a72-e669-4b9c-88dc-fded501440b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:13.278787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a0a72-e669-4b9c-88dc-fded501440b6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:13.332519 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3171/6346] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:13 2022] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:13.336621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc61f9-dc70-4d3d-8c4a-03efd416e8fe admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:13.355581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc61f9-dc70-4d3d-8c4a-03efd416e8fe admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:13.364238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93210aa0-c1a9-434b-bcf3-f8e7a94f7780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:13.364624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93210aa0-c1a9-434b-bcf3-f8e7a94f7780 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:13.365503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93210aa0-c1a9-434b-bcf3-f8e7a94f7780 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:13.365782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93210aa0-c1a9-434b-bcf3-f8e7a94f7780 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:13.366438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93210aa0-c1a9-434b-bcf3-f8e7a94f7780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:13.368250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93210aa0-c1a9-434b-bcf3-f8e7a94f7780 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:13.410427 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3176/6347] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:13.414810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a0a72-e669-4b9c-88dc-fded501440b6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:13.441090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a0a72-e669-4b9c-88dc-fded501440b6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:13.461209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c16fa-17f0-4696-9a70-bd59b22e649c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:13.463685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c16fa-17f0-4696-9a70-bd59b22e649c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:13.464264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c16fa-17f0-4696-9a70-bd59b22e649c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:13.464546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c16fa-17f0-4696-9a70-bd59b22e649c admin admin] PATH_INFO: `/v3/projects/ec7719dc7c3b4345868139dbdf36fba9/users/44ce789a59f6474ebd0f1803755eaa03/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:13.508158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c16fa-17f0-4696-9a70-bd59b22e649c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7719dc7c3b4345868139dbdf36fba9, user_id=44ce789a59f6474ebd0f1803755eaa03, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:13.518199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c16fa-17f0-4696-9a70-bd59b22e649c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:13.557100 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3172/6348] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:13 2022] PUT /identity/v3/projects/ec7719dc7c3b4345868139dbdf36fba9/users/44ce789a59f6474ebd0f1803755eaa03/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:17:13.561784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93210aa0-c1a9-434b-bcf3-f8e7a94f7780 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:13.579513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93210aa0-c1a9-434b-bcf3-f8e7a94f7780 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:13.674523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20c2a2-8c1c-421a-8895-6768f949b6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:13.674523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20c2a2-8c1c-421a-8895-6768f949b6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:13.674523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20c2a2-8c1c-421a-8895-6768f949b6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:13.674928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20c2a2-8c1c-421a-8895-6768f949b6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:13.675601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20c2a2-8c1c-421a-8895-6768f949b6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:13.677932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20c2a2-8c1c-421a-8895-6768f949b6b7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:13.694048 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3177/6349] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:13.695226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c16fa-17f0-4696-9a70-bd59b22e649c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:13.709473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c16fa-17f0-4696-9a70-bd59b22e649c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:13.715342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e543c-0c9e-4e77-9bd4-ef8537b429bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:13.715997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e543c-0c9e-4e77-9bd4-ef8537b429bc admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:13.716336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e543c-0c9e-4e77-9bd4-ef8537b429bc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:13.716542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e543c-0c9e-4e77-9bd4-ef8537b429bc admin admin] PATH_INFO: `/v3/projects/ec7719dc7c3b4345868139dbdf36fba9/users/44ce789a59f6474ebd0f1803755eaa03/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:13.719776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e543c-0c9e-4e77-9bd4-ef8537b429bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7719dc7c3b4345868139dbdf36fba9, user_id=44ce789a59f6474ebd0f1803755eaa03, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:13.722835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e543c-0c9e-4e77-9bd4-ef8537b429bc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:13.735760 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3173/6350] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:13 2022] PUT /identity/v3/projects/ec7719dc7c3b4345868139dbdf36fba9/users/44ce789a59f6474ebd0f1803755eaa03/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:13.751207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f831d9f-dfc1-45e4-97ed-1e30b164b59f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:13.751506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f831d9f-dfc1-45e4-97ed-1e30b164b59f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:13.751850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f831d9f-dfc1-45e4-97ed-1e30b164b59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:13.788344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9f831d9f-dfc1-45e4-97ed-1e30b164b59f None None] MFA Rules not processed for user `44ce789a59f6474ebd0f1803755eaa03`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:13.789628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9f831d9f-dfc1-45e4-97ed-1e30b164b59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:13.882958 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3178/6351] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:13.899161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e543c-0c9e-4e77-9bd4-ef8537b429bc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:13.901636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ad4e543c-0c9e-4e77-9bd4-ef8537b429bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:13.997686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:14.019549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e543c-0c9e-4e77-9bd4-ef8537b429bc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:14.025512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad0b95-105b-4e7e-886b-81c351dd58fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:14.026396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad0b95-105b-4e7e-886b-81c351dd58fe service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:14.026652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad0b95-105b-4e7e-886b-81c351dd58fe service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:14.027018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad0b95-105b-4e7e-886b-81c351dd58fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:14.041171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad0b95-105b-4e7e-886b-81c351dd58fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:14.042897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad0b95-105b-4e7e-886b-81c351dd58fe service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:14.084315 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3174/6352] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:17.743221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f831d9f-dfc1-45e4-97ed-1e30b164b59f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:17.744832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9f831d9f-dfc1-45e4-97ed-1e30b164b59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:17.908174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:17.935910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f831d9f-dfc1-45e4-97ed-1e30b164b59f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:17.941497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:17.942410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:17.942852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:17.943284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] PATH_INFO: `/v3/users/bec611d6873d431da1838e95803c775a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:17.944754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec611d6873d431da1838e95803c775a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:17.947136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:18.055348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec611d6873d431da1838e95803c775a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:18.072439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec611d6873d431da1838e95803c775a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:18.074598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec611d6873d431da1838e95803c775a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:18.075928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec611d6873d431da1838e95803c775a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:18.105938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec611d6873d431da1838e95803c775a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:18.154466 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3179/6353] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:17 2022] DELETE /identity/v3/users/bec611d6873d431da1838e95803c775a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:18.157479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ee056-fd85-4651-b801-76c6cad7476a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:18.157962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ee056-fd85-4651-b801-76c6cad7476a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:18.158061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ee056-fd85-4651-b801-76c6cad7476a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:18.193091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ed4ee056-fd85-4651-b801-76c6cad7476a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:18.198011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ed4ee056-fd85-4651-b801-76c6cad7476a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:18.298029 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3175/6354] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:17:18.363852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:18.366503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:18.521396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c197a-75f3-4db1-95ad-bec7b6397b87 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:18.537825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b133349-8edf-4c32-844b-64354537b01c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:18.538904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b133349-8edf-4c32-844b-64354537b01c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:18.539323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b133349-8edf-4c32-844b-64354537b01c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:18.539764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b133349-8edf-4c32-844b-64354537b01c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:18.564569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b133349-8edf-4c32-844b-64354537b01c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:18.569729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b133349-8edf-4c32-844b-64354537b01c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:18.587106 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3180/6355] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:19.587503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ee056-fd85-4651-b801-76c6cad7476a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:19.590315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ed4ee056-fd85-4651-b801-76c6cad7476a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:19.616066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ee056-fd85-4651-b801-76c6cad7476a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:19.629662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dc87d-b89d-48e6-b769-53189fd46ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:19.630574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dc87d-b89d-48e6-b769-53189fd46ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:19.631004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dc87d-b89d-48e6-b769-53189fd46ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:19.631428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dc87d-b89d-48e6-b769-53189fd46ed1 admin admin] PATH_INFO: `/v3/projects/009cc3cd15a54c0ea7c30b4cfcb76da7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:19.642087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dc87d-b89d-48e6-b769-53189fd46ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=009cc3cd15a54c0ea7c30b4cfcb76da7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:19.644245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dc87d-b89d-48e6-b769-53189fd46ed1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:19.728502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-857dc87d-b89d-48e6-b769-53189fd46ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009cc3cd15a54c0ea7c30b4cfcb76da7', 'request_id': 'req-857dc87d-b89d-48e6-b769-53189fd46ed1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:19.743858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-857dc87d-b89d-48e6-b769-53189fd46ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009cc3cd15a54c0ea7c30b4cfcb76da7', 'request_id': 'req-857dc87d-b89d-48e6-b769-53189fd46ed1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:19.754776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-857dc87d-b89d-48e6-b769-53189fd46ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009cc3cd15a54c0ea7c30b4cfcb76da7', 'request_id': 'req-857dc87d-b89d-48e6-b769-53189fd46ed1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:19.788680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-857dc87d-b89d-48e6-b769-53189fd46ed1 admin admin] The token cache is being invalidate because project 009cc3cd15a54c0ea7c30b4cfcb76da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:19.789542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-857dc87d-b89d-48e6-b769-53189fd46ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:19.790485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-857dc87d-b89d-48e6-b769-53189fd46ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:19.792524 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3176/6356] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:19 2022] DELETE /identity/v3/projects/009cc3cd15a54c0ea7c30b4cfcb76da7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:19.797909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526a6e-6ecb-4da0-9b8e-7cd5a5d51f78 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:19.798396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526a6e-6ecb-4da0-9b8e-7cd5a5d51f78 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:19.798500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526a6e-6ecb-4da0-9b8e-7cd5a5d51f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:19.829487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e3526a6e-6ecb-4da0-9b8e-7cd5a5d51f78 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:19.832254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e3526a6e-6ecb-4da0-9b8e-7cd5a5d51f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:20.025332 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3181/6357] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:20.028217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bac38-abbd-4487-a617-81dd401ccf1f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:20.029099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bac38-abbd-4487-a617-81dd401ccf1f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:20.029581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bac38-abbd-4487-a617-81dd401ccf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:20.086582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-803bac38-abbd-4487-a617-81dd401ccf1f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:20.087985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-803bac38-abbd-4487-a617-81dd401ccf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:20.131307 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3177/6358] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:20.135576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526a6e-6ecb-4da0-9b8e-7cd5a5d51f78 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:20.149695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526a6e-6ecb-4da0-9b8e-7cd5a5d51f78 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:20.162433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334db77-8da0-4c52-8ac1-2a29d158d214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:20.163058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334db77-8da0-4c52-8ac1-2a29d158d214 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:20.163333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334db77-8da0-4c52-8ac1-2a29d158d214 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:20.163603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334db77-8da0-4c52-8ac1-2a29d158d214 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:20.164259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334db77-8da0-4c52-8ac1-2a29d158d214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:17:20.164611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334db77-8da0-4c52-8ac1-2a29d158d214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:20.171313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334db77-8da0-4c52-8ac1-2a29d158d214 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:20.180575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:20.203679 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3182/6359] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:17:20.205628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bac38-abbd-4487-a617-81dd401ccf1f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:20.219606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bac38-abbd-4487-a617-81dd401ccf1f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:20.229784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8061836-ba9d-4cfb-beec-f750fbf1f8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:20.231147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8061836-ba9d-4cfb-beec-f750fbf1f8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:20.232337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8061836-ba9d-4cfb-beec-f750fbf1f8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:20.232717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8061836-ba9d-4cfb-beec-f750fbf1f8c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:20.234508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8061836-ba9d-4cfb-beec-f750fbf1f8c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:20.242567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8061836-ba9d-4cfb-beec-f750fbf1f8c2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:20.297225 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3178/6360] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:20 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:20.301128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334db77-8da0-4c52-8ac1-2a29d158d214 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:20.320212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334db77-8da0-4c52-8ac1-2a29d158d214 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:20.468359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b54dc-2c9b-431b-b927-052e7996f7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:20.469961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b54dc-2c9b-431b-b927-052e7996f7ac admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:20.470439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b54dc-2c9b-431b-b927-052e7996f7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:20.470923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b54dc-2c9b-431b-b927-052e7996f7ac admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:20.471808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b54dc-2c9b-431b-b927-052e7996f7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:20.474415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b54dc-2c9b-431b-b927-052e7996f7ac admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:20.514372 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3183/6361] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:20 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:20.515242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8061836-ba9d-4cfb-beec-f750fbf1f8c2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:20.534669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8061836-ba9d-4cfb-beec-f750fbf1f8c2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:20.556045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a0260-b279-40a0-870f-0fe4d395eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:20.556943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a0260-b279-40a0-870f-0fe4d395eb33 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:20.557835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a0260-b279-40a0-870f-0fe4d395eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:20.558709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a0260-b279-40a0-870f-0fe4d395eb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:20.559571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a0260-b279-40a0-870f-0fe4d395eb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:20.562298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a0260-b279-40a0-870f-0fe4d395eb33 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:20.591469 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3179/6362] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:17:20.596414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b54dc-2c9b-431b-b927-052e7996f7ac admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:20.613788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b54dc-2c9b-431b-b927-052e7996f7ac admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:20.626056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bf9a7-aa26-4be5-bc41-d14c0cfd10a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:20.627239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf9a7-aa26-4be5-bc41-d14c0cfd10a4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:20.627698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf9a7-aa26-4be5-bc41-d14c0cfd10a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:20.628659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf9a7-aa26-4be5-bc41-d14c0cfd10a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:20.629510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bf9a7-aa26-4be5-bc41-d14c0cfd10a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:20.631815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bf9a7-aa26-4be5-bc41-d14c0cfd10a4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:20.665544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a0260-b279-40a0-870f-0fe4d395eb33 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:20.668021 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3184/6363] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:20.680779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a0260-b279-40a0-870f-0fe4d395eb33 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:20.697591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389145f-4967-4e1a-a9a4-11e2ffcc30c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:20.698951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389145f-4967-4e1a-a9a4-11e2ffcc30c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:20.699509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389145f-4967-4e1a-a9a4-11e2ffcc30c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:20.700030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389145f-4967-4e1a-a9a4-11e2ffcc30c4 admin admin] PATH_INFO: `/v3/projects/1a9dbdd56c6045d694dfe04e7bfbc59b/users/e8a3ed58b99f4f2f9770c9a86162984a/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:20.738211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389145f-4967-4e1a-a9a4-11e2ffcc30c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9dbdd56c6045d694dfe04e7bfbc59b, user_id=e8a3ed58b99f4f2f9770c9a86162984a, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:20.744880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389145f-4967-4e1a-a9a4-11e2ffcc30c4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:20.780529 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3180/6364] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:20 2022] PUT /identity/v3/projects/1a9dbdd56c6045d694dfe04e7bfbc59b/users/e8a3ed58b99f4f2f9770c9a86162984a/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:20.792925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd47d9-24df-4ed7-9df3-b85b00434134 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:20.793262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd47d9-24df-4ed7-9df3-b85b00434134 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:20.793616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd47d9-24df-4ed7-9df3-b85b00434134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:20.829945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a7bd47d9-24df-4ed7-9df3-b85b00434134 None None] MFA Rules not processed for user `e8a3ed58b99f4f2f9770c9a86162984a`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:20.832507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a7bd47d9-24df-4ed7-9df3-b85b00434134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:20.927795 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3185/6365] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:20.988808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389145f-4967-4e1a-a9a4-11e2ffcc30c4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:20.990651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f389145f-4967-4e1a-a9a4-11e2ffcc30c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:20.999306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:21.088058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389145f-4967-4e1a-a9a4-11e2ffcc30c4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:21.092152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999cac5-007f-412a-953c-9ee284f1bb4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:21.092863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999cac5-007f-412a-953c-9ee284f1bb4a service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:21.093145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999cac5-007f-412a-953c-9ee284f1bb4a service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:21.093552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999cac5-007f-412a-953c-9ee284f1bb4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:21.103430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999cac5-007f-412a-953c-9ee284f1bb4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:21.104920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999cac5-007f-412a-953c-9ee284f1bb4a service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:21.116596 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3181/6366] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:21.254159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd47d9-24df-4ed7-9df3-b85b00434134 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:21.447528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd47d9-24df-4ed7-9df3-b85b00434134 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:21.454551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:21.460832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:21.461127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:21.461426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] PATH_INFO: `/v3/users/e8a3ed58b99f4f2f9770c9a86162984a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:21.463019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a3ed58b99f4f2f9770c9a86162984a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:21.465072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:21.473484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:21.668419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a3ed58b99f4f2f9770c9a86162984a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:21.689702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a3ed58b99f4f2f9770c9a86162984a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:21.690961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a3ed58b99f4f2f9770c9a86162984a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:21.691656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a3ed58b99f4f2f9770c9a86162984a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:21.719117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a3ed58b99f4f2f9770c9a86162984a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:21.742305 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3186/6367] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:21 2022] DELETE /identity/v3/users/e8a3ed58b99f4f2f9770c9a86162984a => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:21.746966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b34d82-699d-427e-b0f7-c0d7c30ac9df None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:21.748071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b34d82-699d-427e-b0f7-c0d7c30ac9df None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:21.750813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b34d82-699d-427e-b0f7-c0d7c30ac9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:21.798329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a3b34d82-699d-427e-b0f7-c0d7c30ac9df None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:21.800484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a3b34d82-699d-427e-b0f7-c0d7c30ac9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:21.942465 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3182/6368] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:21.971743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:21.973651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:22.144325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb73062-56bf-46e9-bb8c-95f73cf980ac admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:22.154320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757084a-4153-41a3-b36d-8bbfbeb5797e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:22.155462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757084a-4153-41a3-b36d-8bbfbeb5797e service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:22.156039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757084a-4153-41a3-b36d-8bbfbeb5797e service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:22.156542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757084a-4153-41a3-b36d-8bbfbeb5797e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:22.169037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757084a-4153-41a3-b36d-8bbfbeb5797e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:22.171559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757084a-4153-41a3-b36d-8bbfbeb5797e service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:22.187796 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3187/6369] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:22.210421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442d0b0-b763-4c92-80b9-4453e02bda19 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:22.210761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442d0b0-b763-4c92-80b9-4453e02bda19 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:22.211047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442d0b0-b763-4c92-80b9-4453e02bda19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:22.281013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6442d0b0-b763-4c92-80b9-4453e02bda19 None None] MFA Rules not processed for user `2f98e01cab6b49c7a5d239aee95f4a64`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:22.282307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6442d0b0-b763-4c92-80b9-4453e02bda19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:22.495994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757084a-4153-41a3-b36d-8bbfbeb5797e service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:22.499198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1757084a-4153-41a3-b36d-8bbfbeb5797e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:22.536969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757084a-4153-41a3-b36d-8bbfbeb5797e service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:22.568875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e4474-6a10-4d9c-86f3-4db72954a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:22.569558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e4474-6a10-4d9c-86f3-4db72954a9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:22.569844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e4474-6a10-4d9c-86f3-4db72954a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:22.570124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e4474-6a10-4d9c-86f3-4db72954a9f1 admin admin] PATH_INFO: `/v3/users/a5e7a94f7ab8484ebb25ac833df5dc3a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:22.582127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e4474-6a10-4d9c-86f3-4db72954a9f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e7a94f7ab8484ebb25ac833df5dc3a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:22.586011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e4474-6a10-4d9c-86f3-4db72954a9f1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:22.683540 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3183/6370] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:22.701297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442d0b0-b763-4c92-80b9-4453e02bda19 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:22.703322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6442d0b0-b763-4c92-80b9-4453e02bda19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:22.778011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a2e4474-6a10-4d9c-86f3-4db72954a9f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e7a94f7ab8484ebb25ac833df5dc3a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:22.808919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:22.812058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a2e4474-6a10-4d9c-86f3-4db72954a9f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e7a94f7ab8484ebb25ac833df5dc3a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:22.814682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a2e4474-6a10-4d9c-86f3-4db72954a9f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e7a94f7ab8484ebb25ac833df5dc3a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:22.816936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a2e4474-6a10-4d9c-86f3-4db72954a9f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e7a94f7ab8484ebb25ac833df5dc3a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:22.873149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442d0b0-b763-4c92-80b9-4453e02bda19 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:22.874086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a2e4474-6a10-4d9c-86f3-4db72954a9f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e7a94f7ab8484ebb25ac833df5dc3a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:22.880380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e485a7-57f5-415f-ab52-194c9894cab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:22.881300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e485a7-57f5-415f-ab52-194c9894cab0 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:22.881731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e485a7-57f5-415f-ab52-194c9894cab0 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:22.882327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e485a7-57f5-415f-ab52-194c9894cab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:22.884639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-10e485a7-57f5-415f-ab52-194c9894cab0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:22.892481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:22.901685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e485a7-57f5-415f-ab52-194c9894cab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:22.903889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e485a7-57f5-415f-ab52-194c9894cab0 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:22.907237 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3188/6371] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:22 2022] DELETE /identity/v3/users/a5e7a94f7ab8484ebb25ac833df5dc3a => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:22.914494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccc1bb-9566-4ebf-91a3-b54d665528a9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:22.914887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccc1bb-9566-4ebf-91a3-b54d665528a9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:22.919462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccc1bb-9566-4ebf-91a3-b54d665528a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:22.942411 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3184/6372] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:17:22.974452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dfccc1bb-9566-4ebf-91a3-b54d665528a9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:22.975962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dfccc1bb-9566-4ebf-91a3-b54d665528a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:23.149229 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3189/6373] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:23.183109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e485a7-57f5-415f-ab52-194c9894cab0 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:23.184771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-10e485a7-57f5-415f-ab52-194c9894cab0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:23.219606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e485a7-57f5-415f-ab52-194c9894cab0 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:23.362200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041f3aa-45a8-4c9e-99d5-2e9100287282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:23.363315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041f3aa-45a8-4c9e-99d5-2e9100287282 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:23.363643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041f3aa-45a8-4c9e-99d5-2e9100287282 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:23.364132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041f3aa-45a8-4c9e-99d5-2e9100287282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:23.393273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041f3aa-45a8-4c9e-99d5-2e9100287282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:23.395147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041f3aa-45a8-4c9e-99d5-2e9100287282 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:23.421296 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3185/6374] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:23.919231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccc1bb-9566-4ebf-91a3-b54d665528a9 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:23.921312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dfccc1bb-9566-4ebf-91a3-b54d665528a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:23.941482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccc1bb-9566-4ebf-91a3-b54d665528a9 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:23.958856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a864-7aa2-41cc-8df0-19b38e9afde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:23.960013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a864-7aa2-41cc-8df0-19b38e9afde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:23.960013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a864-7aa2-41cc-8df0-19b38e9afde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:23.960013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a864-7aa2-41cc-8df0-19b38e9afde8 admin admin] PATH_INFO: `/v3/projects/1a9dbdd56c6045d694dfe04e7bfbc59b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:23.965079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253a864-7aa2-41cc-8df0-19b38e9afde8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9dbdd56c6045d694dfe04e7bfbc59b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:23.965836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253a864-7aa2-41cc-8df0-19b38e9afde8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:24.108501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b253a864-7aa2-41cc-8df0-19b38e9afde8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9dbdd56c6045d694dfe04e7bfbc59b', 'request_id': 'req-b253a864-7aa2-41cc-8df0-19b38e9afde8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:24.129163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b253a864-7aa2-41cc-8df0-19b38e9afde8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9dbdd56c6045d694dfe04e7bfbc59b', 'request_id': 'req-b253a864-7aa2-41cc-8df0-19b38e9afde8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:24.138795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b253a864-7aa2-41cc-8df0-19b38e9afde8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9dbdd56c6045d694dfe04e7bfbc59b', 'request_id': 'req-b253a864-7aa2-41cc-8df0-19b38e9afde8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:24.179460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b253a864-7aa2-41cc-8df0-19b38e9afde8 admin admin] The token cache is being invalidate because project 1a9dbdd56c6045d694dfe04e7bfbc59b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:24.179768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b253a864-7aa2-41cc-8df0-19b38e9afde8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:24.182238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b253a864-7aa2-41cc-8df0-19b38e9afde8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:24.195786 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3190/6375] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:23 2022] DELETE /identity/v3/projects/1a9dbdd56c6045d694dfe04e7bfbc59b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:24.201290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ae388-7d58-4dd3-a6c5-bd0df1ef0e25 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:24.202559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ae388-7d58-4dd3-a6c5-bd0df1ef0e25 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:24.202559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ae388-7d58-4dd3-a6c5-bd0df1ef0e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:24.254902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cb6ae388-7d58-4dd3-a6c5-bd0df1ef0e25 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:24.258900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cb6ae388-7d58-4dd3-a6c5-bd0df1ef0e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:24.354137 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3186/6376] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:24.362030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee40a3-e65c-4a67-81f9-57c3b6f822b3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:24.362313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee40a3-e65c-4a67-81f9-57c3b6f822b3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:24.362861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee40a3-e65c-4a67-81f9-57c3b6f822b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:24.401829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-34ee40a3-e65c-4a67-81f9-57c3b6f822b3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:24.404112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-34ee40a3-e65c-4a67-81f9-57c3b6f822b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:24.431878 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3191/6377] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:24.438354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ae388-7d58-4dd3-a6c5-bd0df1ef0e25 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:24.494222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ae388-7d58-4dd3-a6c5-bd0df1ef0e25 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:24.513567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e5d29-5e47-4e30-b65f-45177c9109ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:24.515391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e5d29-5e47-4e30-b65f-45177c9109ea admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:24.515864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e5d29-5e47-4e30-b65f-45177c9109ea admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:24.516292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e5d29-5e47-4e30-b65f-45177c9109ea admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:24.517122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e5d29-5e47-4e30-b65f-45177c9109ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:17:24.517734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e5d29-5e47-4e30-b65f-45177c9109ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:24.522291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e5d29-5e47-4e30-b65f-45177c9109ea admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:24.550984 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3187/6378] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:17:24.554526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee40a3-e65c-4a67-81f9-57c3b6f822b3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:24.570791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee40a3-e65c-4a67-81f9-57c3b6f822b3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:24.584639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b098c-e9c2-4c53-8d6e-934e1ce5664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:24.587415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b098c-e9c2-4c53-8d6e-934e1ce5664a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:24.588262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b098c-e9c2-4c53-8d6e-934e1ce5664a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:24.591078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b098c-e9c2-4c53-8d6e-934e1ce5664a admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:24.593562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b098c-e9c2-4c53-8d6e-934e1ce5664a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:24.603675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b098c-e9c2-4c53-8d6e-934e1ce5664a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:24.720166 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3192/6379] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:24 2022] POST /identity/v3/projects => generated 405 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:24.720512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e5d29-5e47-4e30-b65f-45177c9109ea admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:24.733526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e5d29-5e47-4e30-b65f-45177c9109ea admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:24.855427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:24.867406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80307f67-cc2d-4b60-81fc-bd1f44d40541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:24.868033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80307f67-cc2d-4b60-81fc-bd1f44d40541 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:24.868426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80307f67-cc2d-4b60-81fc-bd1f44d40541 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:24.868584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80307f67-cc2d-4b60-81fc-bd1f44d40541 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:24.869248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80307f67-cc2d-4b60-81fc-bd1f44d40541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:24.871173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80307f67-cc2d-4b60-81fc-bd1f44d40541 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:24.919288 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3188/6380] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:24 2022] POST /identity/v3/users => generated 303 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:17:24.920509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b098c-e9c2-4c53-8d6e-934e1ce5664a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:24.941164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b098c-e9c2-4c53-8d6e-934e1ce5664a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:24.944128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80307f67-cc2d-4b60-81fc-bd1f44d40541 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:24.946793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-80307f67-cc2d-4b60-81fc-bd1f44d40541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:24.958281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202d887-67dc-41f2-b44b-c7e7f9e5408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:24.958909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202d887-67dc-41f2-b44b-c7e7f9e5408a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:24.959185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202d887-67dc-41f2-b44b-c7e7f9e5408a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:24.959460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202d887-67dc-41f2-b44b-c7e7f9e5408a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:24.960111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202d887-67dc-41f2-b44b-c7e7f9e5408a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:24.961981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202d887-67dc-41f2-b44b-c7e7f9e5408a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:24.973830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80307f67-cc2d-4b60-81fc-bd1f44d40541 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:24.981126 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3193/6381] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:24.984056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202d887-67dc-41f2-b44b-c7e7f9e5408a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:24.990151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:24.990820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:24.991103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:24.991378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] PATH_INFO: `/v3/projects/8128c843910b4105aa18267db5cc75e4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:24.995984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8128c843910b4105aa18267db5cc75e4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:24.997966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:25.014929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202d887-67dc-41f2-b44b-c7e7f9e5408a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:25.031777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233e38a-a12f-4279-919e-cc29dda1d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:25.032412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233e38a-a12f-4279-919e-cc29dda1d15e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:25.033464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233e38a-a12f-4279-919e-cc29dda1d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:25.033464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233e38a-a12f-4279-919e-cc29dda1d15e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:25.033654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233e38a-a12f-4279-919e-cc29dda1d15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:25.035232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233e38a-a12f-4279-919e-cc29dda1d15e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:25.074788 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3194/6382] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:25.079004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233e38a-a12f-4279-919e-cc29dda1d15e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:25.111251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233e38a-a12f-4279-919e-cc29dda1d15e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:25.143977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8128c843910b4105aa18267db5cc75e4', 'request_id': 'req-9bf2a823-a797-4ad1-abd6-17a3d7074e00'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:25.159893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8128c843910b4105aa18267db5cc75e4', 'request_id': 'req-9bf2a823-a797-4ad1-abd6-17a3d7074e00'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:25.175344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:25.176756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8128c843910b4105aa18267db5cc75e4', 'request_id': 'req-9bf2a823-a797-4ad1-abd6-17a3d7074e00'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:25.220314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] The token cache is being invalidate because project 8128c843910b4105aa18267db5cc75e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:25.220901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:25.223157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:25.230416 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3189/6383] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:24 2022] DELETE /identity/v3/projects/8128c843910b4105aa18267db5cc75e4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:25.234507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:25.240187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:25.290027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b375c2b-0c3e-4fa2-9909-7424d7381b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:25.292757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b375c2b-0c3e-4fa2-9909-7424d7381b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:25.294599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b375c2b-0c3e-4fa2-9909-7424d7381b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:25.295124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b375c2b-0c3e-4fa2-9909-7424d7381b00 admin admin] PATH_INFO: `/v3/projects/77f1c82ed91b42f4b5dc0ec7060f0ce2/users/b75263b3c72646ef86b9db150c76d2d0/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:25.337988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b375c2b-0c3e-4fa2-9909-7424d7381b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f1c82ed91b42f4b5dc0ec7060f0ce2, user_id=b75263b3c72646ef86b9db150c76d2d0, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:25.340958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b375c2b-0c3e-4fa2-9909-7424d7381b00 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:25.341723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2a823-a797-4ad1-abd6-17a3d7074e00 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:25.353414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d695fc4-e9dc-4722-93bc-594ca38eb9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:25.354231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d695fc4-e9dc-4722-93bc-594ca38eb9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:25.354518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d695fc4-e9dc-4722-93bc-594ca38eb9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:25.354792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d695fc4-e9dc-4722-93bc-594ca38eb9fa admin admin] PATH_INFO: `/v3/users/44ce789a59f6474ebd0f1803755eaa03` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:25.355973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d695fc4-e9dc-4722-93bc-594ca38eb9fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ce789a59f6474ebd0f1803755eaa03)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:25.362907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d695fc4-e9dc-4722-93bc-594ca38eb9fa admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:25.372408 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3195/6384] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:25 2022] PUT /identity/v3/projects/77f1c82ed91b42f4b5dc0ec7060f0ce2/users/b75263b3c72646ef86b9db150c76d2d0/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:25.385375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ef1ad-f9b7-4b41-a001-9f7bff864018 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:25.386009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ef1ad-f9b7-4b41-a001-9f7bff864018 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:25.386764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ef1ad-f9b7-4b41-a001-9f7bff864018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:25.454038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bd0ef1ad-f9b7-4b41-a001-9f7bff864018 None None] MFA Rules not processed for user `b75263b3c72646ef86b9db150c76d2d0`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:25.455438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bd0ef1ad-f9b7-4b41-a001-9f7bff864018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:25.495303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d695fc4-e9dc-4722-93bc-594ca38eb9fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ce789a59f6474ebd0f1803755eaa03'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:25.525718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d695fc4-e9dc-4722-93bc-594ca38eb9fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ce789a59f6474ebd0f1803755eaa03'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:25.529380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d695fc4-e9dc-4722-93bc-594ca38eb9fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ce789a59f6474ebd0f1803755eaa03'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:25.531331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d695fc4-e9dc-4722-93bc-594ca38eb9fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ce789a59f6474ebd0f1803755eaa03'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:25.572781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:25.601039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d695fc4-e9dc-4722-93bc-594ca38eb9fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ce789a59f6474ebd0f1803755eaa03'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:25.643503 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3196/6385] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:25.647646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ef1ad-f9b7-4b41-a001-9f7bff864018 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:25.649180 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3190/6386] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:25 2022] DELETE /identity/v3/users/44ce789a59f6474ebd0f1803755eaa03 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:17:25.651803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bd0ef1ad-f9b7-4b41-a001-9f7bff864018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:25.784640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ef1ad-f9b7-4b41-a001-9f7bff864018 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:25.930693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:25.959071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b14e28-ead5-402f-9242-58110e1d3f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:25.959941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b14e28-ead5-402f-9242-58110e1d3f14 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:25.960208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b14e28-ead5-402f-9242-58110e1d3f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:25.960490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b14e28-ead5-402f-9242-58110e1d3f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:25.961149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b14e28-ead5-402f-9242-58110e1d3f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:25.963962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b14e28-ead5-402f-9242-58110e1d3f14 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:26.030483 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3197/6387] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:25 2022] POST /identity/v3/projects => generated 403 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:26.037568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d695fc4-e9dc-4722-93bc-594ca38eb9fa admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:26.062313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d695fc4-e9dc-4722-93bc-594ca38eb9fa admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:26.156196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6d216-c9cf-468d-a5ec-d8ff31f42305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:26.157543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6d216-c9cf-468d-a5ec-d8ff31f42305 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:26.157825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6d216-c9cf-468d-a5ec-d8ff31f42305 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:26.158101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6d216-c9cf-468d-a5ec-d8ff31f42305 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:26.159495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6d216-c9cf-468d-a5ec-d8ff31f42305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:26.163372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6d216-c9cf-468d-a5ec-d8ff31f42305 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:26.219958 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3191/6388] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:26 2022] POST /identity/v3/users => generated 308 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:26.220563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b14e28-ead5-402f-9242-58110e1d3f14 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:26.235727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b14e28-ead5-402f-9242-58110e1d3f14 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:26.247945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191ab10-0200-48bc-829e-464a603fc300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:26.249365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191ab10-0200-48bc-829e-464a603fc300 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:26.249593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191ab10-0200-48bc-829e-464a603fc300 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:26.249866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191ab10-0200-48bc-829e-464a603fc300 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:26.250524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191ab10-0200-48bc-829e-464a603fc300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:26.252132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191ab10-0200-48bc-829e-464a603fc300 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:26.285282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6d216-c9cf-468d-a5ec-d8ff31f42305 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:26.307235 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3198/6389] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:26.327689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6d216-c9cf-468d-a5ec-d8ff31f42305 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:26.334980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b0960-8a27-4fce-9a07-f96edb444df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:26.335703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b0960-8a27-4fce-9a07-f96edb444df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:26.336151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b0960-8a27-4fce-9a07-f96edb444df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:26.336253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b0960-8a27-4fce-9a07-f96edb444df5 admin admin] PATH_INFO: `/v3/projects/cad202def6db4b8193797fd64bceeb72/users/89297ba372ac417f95f89465abc2b30a/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:26.364815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b0960-8a27-4fce-9a07-f96edb444df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad202def6db4b8193797fd64bceeb72, user_id=89297ba372ac417f95f89465abc2b30a, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:26.369513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b0960-8a27-4fce-9a07-f96edb444df5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:26.415263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191ab10-0200-48bc-829e-464a603fc300 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:26.429235 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3192/6390] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:26 2022] PUT /identity/v3/projects/cad202def6db4b8193797fd64bceeb72/users/89297ba372ac417f95f89465abc2b30a/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:26.432879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191ab10-0200-48bc-829e-464a603fc300 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:26.584958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d98fa-f56f-4bc0-affd-ffbb68488416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:26.589940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d98fa-f56f-4bc0-affd-ffbb68488416 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:26.589940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d98fa-f56f-4bc0-affd-ffbb68488416 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:26.589940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d98fa-f56f-4bc0-affd-ffbb68488416 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:26.589940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d98fa-f56f-4bc0-affd-ffbb68488416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:26.593065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d98fa-f56f-4bc0-affd-ffbb68488416 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:26.619282 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3199/6391] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:26.620467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b0960-8a27-4fce-9a07-f96edb444df5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:26.635575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b0960-8a27-4fce-9a07-f96edb444df5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:26.663753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24125404-a997-4c41-bbd9-7ae4e7cb897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:26.664266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24125404-a997-4c41-bbd9-7ae4e7cb897d admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:26.664632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24125404-a997-4c41-bbd9-7ae4e7cb897d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:26.664831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24125404-a997-4c41-bbd9-7ae4e7cb897d admin admin] PATH_INFO: `/v3/projects/cad202def6db4b8193797fd64bceeb72/users/89297ba372ac417f95f89465abc2b30a/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:26.670013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24125404-a997-4c41-bbd9-7ae4e7cb897d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad202def6db4b8193797fd64bceeb72, user_id=89297ba372ac417f95f89465abc2b30a, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:26.675154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24125404-a997-4c41-bbd9-7ae4e7cb897d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:26.717323 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3193/6392] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:26 2022] PUT /identity/v3/projects/cad202def6db4b8193797fd64bceeb72/users/89297ba372ac417f95f89465abc2b30a/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:17:26.727448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64a3f8-817f-4097-904b-c5cf3a918dfb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:26.727739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64a3f8-817f-4097-904b-c5cf3a918dfb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:26.728018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64a3f8-817f-4097-904b-c5cf3a918dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:26.784318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-df64a3f8-817f-4097-904b-c5cf3a918dfb None None] MFA Rules not processed for user `89297ba372ac417f95f89465abc2b30a`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:26.786595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-df64a3f8-817f-4097-904b-c5cf3a918dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:26.950718 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3200/6393] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:26 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:26.960027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24125404-a997-4c41-bbd9-7ae4e7cb897d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:26.963680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-24125404-a997-4c41-bbd9-7ae4e7cb897d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:27.128743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24125404-a997-4c41-bbd9-7ae4e7cb897d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:27.138116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d2b52-5647-43df-af6d-663dac6d99be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:27.138939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d2b52-5647-43df-af6d-663dac6d99be service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:27.139220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d2b52-5647-43df-af6d-663dac6d99be service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:27.139490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d2b52-5647-43df-af6d-663dac6d99be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:27.169424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d2b52-5647-43df-af6d-663dac6d99be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:27.174043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d2b52-5647-43df-af6d-663dac6d99be service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:27.205881 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3194/6394] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:26 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:27.234390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64a3f8-817f-4097-904b-c5cf3a918dfb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:27.237040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-df64a3f8-817f-4097-904b-c5cf3a918dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:27.399509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:27.448730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d2b52-5647-43df-af6d-663dac6d99be service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:27.454395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64a3f8-817f-4097-904b-c5cf3a918dfb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:27.470106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d2b52-5647-43df-af6d-663dac6d99be service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:27.472889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdcca7-0d68-4249-b230-3253b67efa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:27.473581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdcca7-0d68-4249-b230-3253b67efa60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:27.480811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdcca7-0d68-4249-b230-3253b67efa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:27.481091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdcca7-0d68-4249-b230-3253b67efa60 admin admin] PATH_INFO: `/v3/projects/ec7719dc7c3b4345868139dbdf36fba9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:27.483677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c25066-f012-48f0-8a6a-f21fb239ee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:27.483984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdcca7-0d68-4249-b230-3253b67efa60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec7719dc7c3b4345868139dbdf36fba9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:27.484515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c25066-f012-48f0-8a6a-f21fb239ee62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:27.484891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c25066-f012-48f0-8a6a-f21fb239ee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:27.485293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c25066-f012-48f0-8a6a-f21fb239ee62 admin admin] PATH_INFO: `/v3/users/b75263b3c72646ef86b9db150c76d2d0` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:27.486589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c25066-f012-48f0-8a6a-f21fb239ee62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b75263b3c72646ef86b9db150c76d2d0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:27.488631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c25066-f012-48f0-8a6a-f21fb239ee62 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:27.493034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdcca7-0d68-4249-b230-3253b67efa60 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:27.594023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:27.612130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ecbdcca7-0d68-4249-b230-3253b67efa60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec7719dc7c3b4345868139dbdf36fba9', 'request_id': 'req-ecbdcca7-0d68-4249-b230-3253b67efa60'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:27.614214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-42c25066-f012-48f0-8a6a-f21fb239ee62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b75263b3c72646ef86b9db150c76d2d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:27.626027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ecbdcca7-0d68-4249-b230-3253b67efa60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec7719dc7c3b4345868139dbdf36fba9', 'request_id': 'req-ecbdcca7-0d68-4249-b230-3253b67efa60'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:27.640066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ecbdcca7-0d68-4249-b230-3253b67efa60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec7719dc7c3b4345868139dbdf36fba9', 'request_id': 'req-ecbdcca7-0d68-4249-b230-3253b67efa60'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:27.655564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-42c25066-f012-48f0-8a6a-f21fb239ee62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b75263b3c72646ef86b9db150c76d2d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:27.657382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-42c25066-f012-48f0-8a6a-f21fb239ee62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b75263b3c72646ef86b9db150c76d2d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:27.658435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ecbdcca7-0d68-4249-b230-3253b67efa60 admin admin] The token cache is being invalidate because project ec7719dc7c3b4345868139dbdf36fba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:27.659135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ecbdcca7-0d68-4249-b230-3253b67efa60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:27.659883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ecbdcca7-0d68-4249-b230-3253b67efa60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:27.660842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-42c25066-f012-48f0-8a6a-f21fb239ee62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b75263b3c72646ef86b9db150c76d2d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:27.661962 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3201/6395] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:27 2022] DELETE /identity/v3/projects/ec7719dc7c3b4345868139dbdf36fba9 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:27.697534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e539c-00c6-48ba-8ec3-eb58cfd32f4e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:27.697933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e539c-00c6-48ba-8ec3-eb58cfd32f4e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:27.698401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e539c-00c6-48ba-8ec3-eb58cfd32f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:27.710597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-42c25066-f012-48f0-8a6a-f21fb239ee62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b75263b3c72646ef86b9db150c76d2d0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:27.775912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-204e539c-00c6-48ba-8ec3-eb58cfd32f4e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:27.778572 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3195/6396] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:27 2022] DELETE /identity/v3/users/b75263b3c72646ef86b9db150c76d2d0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:27.782451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-204e539c-00c6-48ba-8ec3-eb58cfd32f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:27.783986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de1ba5-13a9-4f12-8cff-20260a99c050 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:27.784273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de1ba5-13a9-4f12-8cff-20260a99c050 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:27.784748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de1ba5-13a9-4f12-8cff-20260a99c050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:27.842736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-23de1ba5-13a9-4f12-8cff-20260a99c050 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:27.848514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-23de1ba5-13a9-4f12-8cff-20260a99c050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:27.956804 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3202/6397] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:27.965154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d3d94-0b19-4914-9bb7-dbef2e977b76 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:27.965720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d3d94-0b19-4914-9bb7-dbef2e977b76 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:27.966047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d3d94-0b19-4914-9bb7-dbef2e977b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:28.009719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-861d3d94-0b19-4914-9bb7-dbef2e977b76 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:28.010980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-861d3d94-0b19-4914-9bb7-dbef2e977b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:28.034464 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3203/6398] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:17:28.038248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d3d94-0b19-4914-9bb7-dbef2e977b76 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:28.048650 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3196/6399] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:28.057429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d3d94-0b19-4914-9bb7-dbef2e977b76 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:28.071505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506304da-1c9b-4632-8785-2649311a87db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:28.072155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506304da-1c9b-4632-8785-2649311a87db admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:28.072441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506304da-1c9b-4632-8785-2649311a87db admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:28.074336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506304da-1c9b-4632-8785-2649311a87db admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:28.075054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506304da-1c9b-4632-8785-2649311a87db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:17:28.075372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506304da-1c9b-4632-8785-2649311a87db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:28.080148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506304da-1c9b-4632-8785-2649311a87db admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:28.100898 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3204/6400] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:17:28.105316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de1ba5-13a9-4f12-8cff-20260a99c050 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:28.131754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de1ba5-13a9-4f12-8cff-20260a99c050 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:28.149224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35fc66-aac0-41ad-abd8-782b9b458f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:28.150125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35fc66-aac0-41ad-abd8-782b9b458f36 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:28.150408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35fc66-aac0-41ad-abd8-782b9b458f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:28.150675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35fc66-aac0-41ad-abd8-782b9b458f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:28.151402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35fc66-aac0-41ad-abd8-782b9b458f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:28.153484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35fc66-aac0-41ad-abd8-782b9b458f36 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:28.162284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506304da-1c9b-4632-8785-2649311a87db admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:28.164459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-506304da-1c9b-4632-8785-2649311a87db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:28.228764 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3197/6401] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:28 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:28.230327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f16f79-121a-4a26-b0bb-d08a715a8f7f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:28.230764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f16f79-121a-4a26-b0bb-d08a715a8f7f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:28.231234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f16f79-121a-4a26-b0bb-d08a715a8f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:28.282312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-70f16f79-121a-4a26-b0bb-d08a715a8f7f None None] MFA Rules not processed for user `8957041987c8487099f0d89f4c64af66`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:28.286182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-70f16f79-121a-4a26-b0bb-d08a715a8f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:28.288033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506304da-1c9b-4632-8785-2649311a87db admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:28.306728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:28.368113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c3ff1-e5e3-4188-8b36-50ee1dc4f620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:28.369101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c3ff1-e5e3-4188-8b36-50ee1dc4f620 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:28.369746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c3ff1-e5e3-4188-8b36-50ee1dc4f620 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:28.370257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c3ff1-e5e3-4188-8b36-50ee1dc4f620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:28.438455 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3198/6402] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:28.438455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f16f79-121a-4a26-b0bb-d08a715a8f7f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:28.490930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c3ff1-e5e3-4188-8b36-50ee1dc4f620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:28.493907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c3ff1-e5e3-4188-8b36-50ee1dc4f620 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:28.543224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:28.545910 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3205/6403] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:17:28.583506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f16f79-121a-4a26-b0bb-d08a715a8f7f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:28.591902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfafef-83b1-4bd4-916a-aa49c2f58b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:28.592670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfafef-83b1-4bd4-916a-aa49c2f58b89 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:28.593137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfafef-83b1-4bd4-916a-aa49c2f58b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:28.594798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfafef-83b1-4bd4-916a-aa49c2f58b89 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:28.595473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfafef-83b1-4bd4-916a-aa49c2f58b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:28.601438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfafef-83b1-4bd4-916a-aa49c2f58b89 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:28.674488 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3199/6404] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:28 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:28.679088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c3ff1-e5e3-4188-8b36-50ee1dc4f620 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:28.700511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c3ff1-e5e3-4188-8b36-50ee1dc4f620 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:28.718945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd5bcc-730f-45e9-a95c-970cd6f7c058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:28.721010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd5bcc-730f-45e9-a95c-970cd6f7c058 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:28.721560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd5bcc-730f-45e9-a95c-970cd6f7c058 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:28.722184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd5bcc-730f-45e9-a95c-970cd6f7c058 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:28.723165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd5bcc-730f-45e9-a95c-970cd6f7c058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:28.725692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd5bcc-730f-45e9-a95c-970cd6f7c058 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:28.747055 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3206/6405] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:28.750992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfafef-83b1-4bd4-916a-aa49c2f58b89 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:28.763514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfafef-83b1-4bd4-916a-aa49c2f58b89 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:28.769586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0a452-6ce4-4f2f-b764-e4de65840f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:28.770208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0a452-6ce4-4f2f-b764-e4de65840f4a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:28.770534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0a452-6ce4-4f2f-b764-e4de65840f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:28.770806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0a452-6ce4-4f2f-b764-e4de65840f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:28.771455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0a452-6ce4-4f2f-b764-e4de65840f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:28.777639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0a452-6ce4-4f2f-b764-e4de65840f4a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:28.798714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd5bcc-730f-45e9-a95c-970cd6f7c058 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:28.804885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3200/6406] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:28.813822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd5bcc-730f-45e9-a95c-970cd6f7c058 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:28.821053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8f095-82dc-4933-afcc-c823729c707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:28.822092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8f095-82dc-4933-afcc-c823729c707a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:28.822524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8f095-82dc-4933-afcc-c823729c707a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:28.822806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8f095-82dc-4933-afcc-c823729c707a admin admin] PATH_INFO: `/v3/projects/4c4fc631db814e8aaaf3285584613dad/users/064078ac91204130925ceef9b76bd334/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:28.855684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8f095-82dc-4933-afcc-c823729c707a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4fc631db814e8aaaf3285584613dad, user_id=064078ac91204130925ceef9b76bd334, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:28.858548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8f095-82dc-4933-afcc-c823729c707a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:28.894683 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3207/6407] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:28 2022] PUT /identity/v3/projects/4c4fc631db814e8aaaf3285584613dad/users/064078ac91204130925ceef9b76bd334/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:17:28.906378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b9bc-438c-421e-94e3-a8f15fc053b6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:28.906643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b9bc-438c-421e-94e3-a8f15fc053b6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:28.906866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b9bc-438c-421e-94e3-a8f15fc053b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:28.978210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6b33b9bc-438c-421e-94e3-a8f15fc053b6 None None] MFA Rules not processed for user `064078ac91204130925ceef9b76bd334`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:28.979931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6b33b9bc-438c-421e-94e3-a8f15fc053b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:29.104280 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3201/6408] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:29.126537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8f095-82dc-4933-afcc-c823729c707a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:29.128266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a1e8f095-82dc-4933-afcc-c823729c707a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:29.194382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc47f9-dd3e-4074-af9d-ef4bd9214892 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:29.194663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc47f9-dd3e-4074-af9d-ef4bd9214892 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:29.194934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc47f9-dd3e-4074-af9d-ef4bd9214892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:29.237706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2dcc47f9-dd3e-4074-af9d-ef4bd9214892 None None] MFA Rules not processed for user `2f98e01cab6b49c7a5d239aee95f4a64`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:29.239342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2dcc47f9-dd3e-4074-af9d-ef4bd9214892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:29.240251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8f095-82dc-4933-afcc-c823729c707a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:29.255779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a6796-8db8-459c-a649-2ffffe4c0c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:29.256693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a6796-8db8-459c-a649-2ffffe4c0c46 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:29.257107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a6796-8db8-459c-a649-2ffffe4c0c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:29.257653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a6796-8db8-459c-a649-2ffffe4c0c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:29.280810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a6796-8db8-459c-a649-2ffffe4c0c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:29.283875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a6796-8db8-459c-a649-2ffffe4c0c46 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:29.313126 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3208/6409] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:29.336999 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3202/6410] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:17:29.934022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a6796-8db8-459c-a649-2ffffe4c0c46 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:29.935493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9e5a6796-8db8-459c-a649-2ffffe4c0c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:30.018025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:30.091805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a6796-8db8-459c-a649-2ffffe4c0c46 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:30.101400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:30.102299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:30.102581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:30.102858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] PATH_INFO: `/v3/projects/77f1c82ed91b42f4b5dc0ec7060f0ce2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:30.105980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f1c82ed91b42f4b5dc0ec7060f0ce2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:30.117355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:30.225885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f1c82ed91b42f4b5dc0ec7060f0ce2', 'request_id': 'req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:30.243172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f1c82ed91b42f4b5dc0ec7060f0ce2', 'request_id': 'req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:30.254533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f1c82ed91b42f4b5dc0ec7060f0ce2', 'request_id': 'req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:30.291080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] The token cache is being invalidate because project 77f1c82ed91b42f4b5dc0ec7060f0ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:30.291863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:30.294235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:30.298351 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3209/6411] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:29 2022] DELETE /identity/v3/projects/77f1c82ed91b42f4b5dc0ec7060f0ce2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:30.302243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc47f9-dd3e-4074-af9d-ef4bd9214892 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:30.315753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc47f9-dd3e-4074-af9d-ef4bd9214892 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:30.455821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:30.475038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c08cd9-168f-45c8-933a-cb2238de6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:30.475708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c08cd9-168f-45c8-933a-cb2238de6314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:30.476210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c08cd9-168f-45c8-933a-cb2238de6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:30.476758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c08cd9-168f-45c8-933a-cb2238de6314 admin admin] PATH_INFO: `/v3/users/89297ba372ac417f95f89465abc2b30a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:30.479090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c08cd9-168f-45c8-933a-cb2238de6314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89297ba372ac417f95f89465abc2b30a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:30.489148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c08cd9-168f-45c8-933a-cb2238de6314 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:30.638659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-47c08cd9-168f-45c8-933a-cb2238de6314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89297ba372ac417f95f89465abc2b30a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:30.652528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-47c08cd9-168f-45c8-933a-cb2238de6314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89297ba372ac417f95f89465abc2b30a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:30.657852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-47c08cd9-168f-45c8-933a-cb2238de6314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89297ba372ac417f95f89465abc2b30a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:30.658925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-47c08cd9-168f-45c8-933a-cb2238de6314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89297ba372ac417f95f89465abc2b30a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:30.680870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-47c08cd9-168f-45c8-933a-cb2238de6314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89297ba372ac417f95f89465abc2b30a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:30.705731 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3203/6412] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:30 2022] DELETE /identity/v3/users/89297ba372ac417f95f89465abc2b30a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:17:32.175387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:32.181011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:32.209218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bafb8f-8a5f-407c-bd5b-cc418faf11b5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:32.380479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407df5f-fc4d-4f83-8f78-d812f428331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:32.381142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407df5f-fc4d-4f83-8f78-d812f428331f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:32.381453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407df5f-fc4d-4f83-8f78-d812f428331f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:32.381726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407df5f-fc4d-4f83-8f78-d812f428331f admin admin] PATH_INFO: `/v3/projects/cad202def6db4b8193797fd64bceeb72` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:32.388755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407df5f-fc4d-4f83-8f78-d812f428331f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad202def6db4b8193797fd64bceeb72)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:32.390772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407df5f-fc4d-4f83-8f78-d812f428331f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:32.546833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7407df5f-fc4d-4f83-8f78-d812f428331f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad202def6db4b8193797fd64bceeb72', 'request_id': 'req-7407df5f-fc4d-4f83-8f78-d812f428331f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:32.564537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7407df5f-fc4d-4f83-8f78-d812f428331f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad202def6db4b8193797fd64bceeb72', 'request_id': 'req-7407df5f-fc4d-4f83-8f78-d812f428331f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:32.579568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:32.593864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7407df5f-fc4d-4f83-8f78-d812f428331f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad202def6db4b8193797fd64bceeb72', 'request_id': 'req-7407df5f-fc4d-4f83-8f78-d812f428331f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:32.646497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7407df5f-fc4d-4f83-8f78-d812f428331f admin admin] The token cache is being invalidate because project cad202def6db4b8193797fd64bceeb72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:32.646793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7407df5f-fc4d-4f83-8f78-d812f428331f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:32.648975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7407df5f-fc4d-4f83-8f78-d812f428331f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:32.658180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac7e44-e21a-43ae-a879-2d78f92a9968 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:32.659030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac7e44-e21a-43ae-a879-2d78f92a9968 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:32.659454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac7e44-e21a-43ae-a879-2d78f92a9968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:32.663738 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3210/6413] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:32 2022] DELETE /identity/v3/projects/cad202def6db4b8193797fd64bceeb72 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:32.724081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-daac7e44-e21a-43ae-a879-2d78f92a9968 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:32.725480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-daac7e44-e21a-43ae-a879-2d78f92a9968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:32.874871 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3204/6414] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:32.879237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bca17-2d5f-49fa-afd7-a909e92a5f6d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:32.879578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bca17-2d5f-49fa-afd7-a909e92a5f6d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:32.879862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bca17-2d5f-49fa-afd7-a909e92a5f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:32.935376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-273bca17-2d5f-49fa-afd7-a909e92a5f6d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:32.936699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-273bca17-2d5f-49fa-afd7-a909e92a5f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:32.961294 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3211/6415] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:32.963411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac7e44-e21a-43ae-a879-2d78f92a9968 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:32.995760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac7e44-e21a-43ae-a879-2d78f92a9968 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:33.023078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c650ea-0e29-41c7-bad0-09807eaef16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:33.026854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c650ea-0e29-41c7-bad0-09807eaef16c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:33.027309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c650ea-0e29-41c7-bad0-09807eaef16c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:33.029118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c650ea-0e29-41c7-bad0-09807eaef16c admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:33.031411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c650ea-0e29-41c7-bad0-09807eaef16c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:17:33.031728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c650ea-0e29-41c7-bad0-09807eaef16c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:33.040941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c650ea-0e29-41c7-bad0-09807eaef16c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:33.064959 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3205/6416] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:17:33.070171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bca17-2d5f-49fa-afd7-a909e92a5f6d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:33.083460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bca17-2d5f-49fa-afd7-a909e92a5f6d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:33.105048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9eb13-a230-4f2b-80e9-2e6fe954d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:33.105892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9eb13-a230-4f2b-80e9-2e6fe954d50b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:33.106329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9eb13-a230-4f2b-80e9-2e6fe954d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:33.106746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9eb13-a230-4f2b-80e9-2e6fe954d50b admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:33.108226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9eb13-a230-4f2b-80e9-2e6fe954d50b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:33.110987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9eb13-a230-4f2b-80e9-2e6fe954d50b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:33.194192 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3212/6417] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:33 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:33.195444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c650ea-0e29-41c7-bad0-09807eaef16c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:33.225803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c650ea-0e29-41c7-bad0-09807eaef16c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:33.372898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:33.395209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4087d3b-2527-4af7-a861-9e8e0c1f3a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:33.400310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4087d3b-2527-4af7-a861-9e8e0c1f3a6c admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:33.400997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4087d3b-2527-4af7-a861-9e8e0c1f3a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:33.413617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4087d3b-2527-4af7-a861-9e8e0c1f3a6c admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:33.415735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4087d3b-2527-4af7-a861-9e8e0c1f3a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:33.422215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4087d3b-2527-4af7-a861-9e8e0c1f3a6c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:33.520406 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3206/6418] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:33 2022] POST /identity/v3/users => generated 285 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:33.522413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9eb13-a230-4f2b-80e9-2e6fe954d50b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:33.538934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9eb13-a230-4f2b-80e9-2e6fe954d50b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:33.568836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d20be8-6603-4694-8533-40eb4633bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:33.569473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d20be8-6603-4694-8533-40eb4633bc26 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:33.569913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d20be8-6603-4694-8533-40eb4633bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:33.570333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d20be8-6603-4694-8533-40eb4633bc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:33.571146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d20be8-6603-4694-8533-40eb4633bc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:33.572893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d20be8-6603-4694-8533-40eb4633bc26 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:33.600087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4087d3b-2527-4af7-a861-9e8e0c1f3a6c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:33.601842 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3213/6419] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:33.618187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4087d3b-2527-4af7-a861-9e8e0c1f3a6c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:33.630726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325e3a2-7e77-4ea8-8674-95377faac0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:33.633327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325e3a2-7e77-4ea8-8674-95377faac0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:33.633756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325e3a2-7e77-4ea8-8674-95377faac0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:33.634785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325e3a2-7e77-4ea8-8674-95377faac0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:33.636303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325e3a2-7e77-4ea8-8674-95377faac0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:33.641167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325e3a2-7e77-4ea8-8674-95377faac0d3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:33.672180 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3207/6420] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:17:33.676094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d20be8-6603-4694-8533-40eb4633bc26 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:33.691484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d20be8-6603-4694-8533-40eb4633bc26 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:33.701653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd432d7b-b39e-40e6-99ac-2a543ecddef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:33.702397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd432d7b-b39e-40e6-99ac-2a543ecddef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:33.702750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd432d7b-b39e-40e6-99ac-2a543ecddef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:33.703093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd432d7b-b39e-40e6-99ac-2a543ecddef0 admin admin] PATH_INFO: `/v3/projects/8fc6a80b32374885ab4dede44da4947c/users/791d7816ccae4d20910d9a10509f881a/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:33.735519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd432d7b-b39e-40e6-99ac-2a543ecddef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc6a80b32374885ab4dede44da4947c, user_id=791d7816ccae4d20910d9a10509f881a, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:33.738319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd432d7b-b39e-40e6-99ac-2a543ecddef0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:33.785226 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3214/6421] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:33 2022] PUT /identity/v3/projects/8fc6a80b32374885ab4dede44da4947c/users/791d7816ccae4d20910d9a10509f881a/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:33.790780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d78a3-c07a-4b48-a483-d4d90ad47014 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:33.791073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d78a3-c07a-4b48-a483-d4d90ad47014 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:33.791540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d78a3-c07a-4b48-a483-d4d90ad47014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:33.893744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6b2d78a3-c07a-4b48-a483-d4d90ad47014 None None] MFA Rules not processed for user `791d7816ccae4d20910d9a10509f881a`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:33.895736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6b2d78a3-c07a-4b48-a483-d4d90ad47014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:34.037232 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3208/6422] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:34.042690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd432d7b-b39e-40e6-99ac-2a543ecddef0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:34.188997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd432d7b-b39e-40e6-99ac-2a543ecddef0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:34.195848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f093b-5efd-4440-b603-dce60be9b377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:34.197227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f093b-5efd-4440-b603-dce60be9b377 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:34.197720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f093b-5efd-4440-b603-dce60be9b377 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:34.198207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f093b-5efd-4440-b603-dce60be9b377 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:34.199109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f093b-5efd-4440-b603-dce60be9b377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:34.201857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f093b-5efd-4440-b603-dce60be9b377 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:34.272266 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3215/6423] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:34 2022] POST /identity/v3/projects => generated 369 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:17:34.277082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d78a3-c07a-4b48-a483-d4d90ad47014 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:34.301243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d78a3-c07a-4b48-a483-d4d90ad47014 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:34.342951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f093b-5efd-4440-b603-dce60be9b377 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:34.346255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-597f093b-5efd-4440-b603-dce60be9b377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:34.467095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872b9a0-1dd1-401c-a13a-d4ca2d4a18df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:34.467732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872b9a0-1dd1-401c-a13a-d4ca2d4a18df admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:34.468017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872b9a0-1dd1-401c-a13a-d4ca2d4a18df admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:34.468294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872b9a0-1dd1-401c-a13a-d4ca2d4a18df admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:34.480651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872b9a0-1dd1-401c-a13a-d4ca2d4a18df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:34.488099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872b9a0-1dd1-401c-a13a-d4ca2d4a18df admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:34.507384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f093b-5efd-4440-b603-dce60be9b377 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:34.516876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebc0e0-b132-4ba3-9862-ea31c80b2413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:34.519218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebc0e0-b132-4ba3-9862-ea31c80b2413 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:34.519779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebc0e0-b132-4ba3-9862-ea31c80b2413 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:34.521810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebc0e0-b132-4ba3-9862-ea31c80b2413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:34.530590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8bebc0e0-b132-4ba3-9862-ea31c80b2413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:34.550897 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3209/6424] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:34 2022] POST /identity/v3/users => generated 291 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:34.555266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872b9a0-1dd1-401c-a13a-d4ca2d4a18df admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:34.562381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebc0e0-b132-4ba3-9862-ea31c80b2413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:34.564231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebc0e0-b132-4ba3-9862-ea31c80b2413 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:34.586745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872b9a0-1dd1-401c-a13a-d4ca2d4a18df admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:34.587401 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3216/6425] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:34.601148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e3ec1-b2ee-415e-84c1-921e9bca9a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:34.604564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e3ec1-b2ee-415e-84c1-921e9bca9a3a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:34.605059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e3ec1-b2ee-415e-84c1-921e9bca9a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:34.605495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e3ec1-b2ee-415e-84c1-921e9bca9a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:34.606310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e3ec1-b2ee-415e-84c1-921e9bca9a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:34.611399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e3ec1-b2ee-415e-84c1-921e9bca9a3a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:34.646449 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3210/6426] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:34.650461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebc0e0-b132-4ba3-9862-ea31c80b2413 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:34.673143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebc0e0-b132-4ba3-9862-ea31c80b2413 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:34.700370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e3849-6153-47a3-9c6e-f62623554e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:34.702589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e3849-6153-47a3-9c6e-f62623554e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:34.702866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e3849-6153-47a3-9c6e-f62623554e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:34.703310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e3849-6153-47a3-9c6e-f62623554e87 admin admin] PATH_INFO: `/v3/projects/fa23a78f5e364dea9488ce542b7a2b8a/users/3351c5e783ab475799a8a40a2cbb9661/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:34.762570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:34.768574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e3849-6153-47a3-9c6e-f62623554e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa23a78f5e364dea9488ce542b7a2b8a, user_id=3351c5e783ab475799a8a40a2cbb9661, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:34.773426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e3849-6153-47a3-9c6e-f62623554e87 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:34.805080 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3217/6427] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:34 2022] PUT /identity/v3/projects/fa23a78f5e364dea9488ce542b7a2b8a/users/3351c5e783ab475799a8a40a2cbb9661/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:34.809735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e3ec1-b2ee-415e-84c1-921e9bca9a3a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:34.823920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e3ec1-b2ee-415e-84c1-921e9bca9a3a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:35.004310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:35.036117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b9a73-d16c-4352-bac1-e63790c17bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:35.036908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b9a73-d16c-4352-bac1-e63790c17bcc admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:35.037179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b9a73-d16c-4352-bac1-e63790c17bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:35.037566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b9a73-d16c-4352-bac1-e63790c17bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:35.039674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b9a73-d16c-4352-bac1-e63790c17bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:35.041446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b9a73-d16c-4352-bac1-e63790c17bcc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:35.067880 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3211/6428] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:17:35.072565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e3849-6153-47a3-9c6e-f62623554e87 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:35.097780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e3849-6153-47a3-9c6e-f62623554e87 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:35.103590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b29d88-9912-49a8-b420-8c0c4aabeb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:35.104497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b29d88-9912-49a8-b420-8c0c4aabeb98 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:35.105365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b29d88-9912-49a8-b420-8c0c4aabeb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:35.105754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b29d88-9912-49a8-b420-8c0c4aabeb98 admin admin] PATH_INFO: `/v3/projects/fa23a78f5e364dea9488ce542b7a2b8a/users/3351c5e783ab475799a8a40a2cbb9661/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:35.109974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b29d88-9912-49a8-b420-8c0c4aabeb98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa23a78f5e364dea9488ce542b7a2b8a, user_id=3351c5e783ab475799a8a40a2cbb9661, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:35.113346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b29d88-9912-49a8-b420-8c0c4aabeb98 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:35.158207 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3218/6429] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:35 2022] PUT /identity/v3/projects/fa23a78f5e364dea9488ce542b7a2b8a/users/3351c5e783ab475799a8a40a2cbb9661/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:35.167603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b8e8-2931-45b0-b33f-ab7275b009d7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:35.167603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b8e8-2931-45b0-b33f-ab7275b009d7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:35.167904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b8e8-2931-45b0-b33f-ab7275b009d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:35.223124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8578b8e8-2931-45b0-b33f-ab7275b009d7 None None] MFA Rules not processed for user `3351c5e783ab475799a8a40a2cbb9661`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:35.224823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8578b8e8-2931-45b0-b33f-ab7275b009d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:35.400707 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3212/6430] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:35.414067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b29d88-9912-49a8-b420-8c0c4aabeb98 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:35.418969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d4b29d88-9912-49a8-b420-8c0c4aabeb98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:35.527400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b29d88-9912-49a8-b420-8c0c4aabeb98 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:35.540085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286d10f-3133-4991-84c0-ef0716b44ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:35.541429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286d10f-3133-4991-84c0-ef0716b44ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:35.541982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286d10f-3133-4991-84c0-ef0716b44ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:35.542574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286d10f-3133-4991-84c0-ef0716b44ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:35.561596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286d10f-3133-4991-84c0-ef0716b44ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:35.563323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286d10f-3133-4991-84c0-ef0716b44ca4 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:35.578508 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3219/6431] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:35.657527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578b8e8-2931-45b0-b33f-ab7275b009d7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:35.659779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8578b8e8-2931-45b0-b33f-ab7275b009d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:35.683323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578b8e8-2931-45b0-b33f-ab7275b009d7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:35.688110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0ba8d-b20a-4ee6-9291-c9f6de8f70ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:35.689006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0ba8d-b20a-4ee6-9291-c9f6de8f70ca service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:35.689436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0ba8d-b20a-4ee6-9291-c9f6de8f70ca service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:35.689861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0ba8d-b20a-4ee6-9291-c9f6de8f70ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:35.817627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0ba8d-b20a-4ee6-9291-c9f6de8f70ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:35.819757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0ba8d-b20a-4ee6-9291-c9f6de8f70ca service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:35.850293 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3213/6432] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:37.070112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286d10f-3133-4991-84c0-ef0716b44ca4 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:37.071892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c286d10f-3133-4991-84c0-ef0716b44ca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:37.222580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286d10f-3133-4991-84c0-ef0716b44ca4 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:37.230566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47eee-62bc-4baf-9807-3b78cd0a2a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:37.231954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47eee-62bc-4baf-9807-3b78cd0a2a0c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:37.232796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47eee-62bc-4baf-9807-3b78cd0a2a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:37.233442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47eee-62bc-4baf-9807-3b78cd0a2a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:37.250157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eec47eee-62bc-4baf-9807-3b78cd0a2a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:37.281082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec47eee-62bc-4baf-9807-3b78cd0a2a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:37.282661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec47eee-62bc-4baf-9807-3b78cd0a2a0c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:37.301868 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3220/6433] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:37.810784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0ba8d-b20a-4ee6-9291-c9f6de8f70ca service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:37.812485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b8f0ba8d-b20a-4ee6-9291-c9f6de8f70ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:37.960194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:38.003971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0ba8d-b20a-4ee6-9291-c9f6de8f70ca service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:38.018875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c69eee-a1f2-4846-b804-94fe9ff8bbcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:38.019698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c69eee-a1f2-4846-b804-94fe9ff8bbcb service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:38.019989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c69eee-a1f2-4846-b804-94fe9ff8bbcb service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:38.020275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c69eee-a1f2-4846-b804-94fe9ff8bbcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:38.026533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f0c69eee-a1f2-4846-b804-94fe9ff8bbcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:38.053617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c69eee-a1f2-4846-b804-94fe9ff8bbcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:38.055761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c69eee-a1f2-4846-b804-94fe9ff8bbcb service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:38.101942 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3214/6434] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:17:40.683426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47eee-62bc-4baf-9807-3b78cd0a2a0c service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:40.847263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47eee-62bc-4baf-9807-3b78cd0a2a0c service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:40.862275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:40.863101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:40.863396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:40.863678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] PATH_INFO: `/v3/users/791d7816ccae4d20910d9a10509f881a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:40.865894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=791d7816ccae4d20910d9a10509f881a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:40.868192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:40.953525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:40.984459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '791d7816ccae4d20910d9a10509f881a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:40.996519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '791d7816ccae4d20910d9a10509f881a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:40.997295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '791d7816ccae4d20910d9a10509f881a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:40.998779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '791d7816ccae4d20910d9a10509f881a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:41.031399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '791d7816ccae4d20910d9a10509f881a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:41.056716 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3221/6435] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:40 2022] DELETE /identity/v3/users/791d7816ccae4d20910d9a10509f881a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:41.059059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1fd15-9aed-46a7-811d-31723b39a315 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:41.062043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1fd15-9aed-46a7-811d-31723b39a315 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:41.063078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1fd15-9aed-46a7-811d-31723b39a315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:41.100812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ccb1fd15-9aed-46a7-811d-31723b39a315 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:41.102485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ccb1fd15-9aed-46a7-811d-31723b39a315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:41.208796 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3215/6436] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:41.298942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:41.300490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:41.347298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1fd15-9aed-46a7-811d-31723b39a315 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:41.349254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ccb1fd15-9aed-46a7-811d-31723b39a315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:41.373972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1fd15-9aed-46a7-811d-31723b39a315 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:41.401777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:41.402600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:41.403430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:41.405265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] PATH_INFO: `/v3/users/f2935fc074f24e6c9187a73ef912e6a3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:41.414131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2935fc074f24e6c9187a73ef912e6a3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:41.416378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:41.487847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcab434-068e-440d-859d-6ffa426b6e7d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:41.499510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a14a56-ca6b-4850-a0a6-7d7635835ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:41.501033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a14a56-ca6b-4850-a0a6-7d7635835ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:41.501597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a14a56-ca6b-4850-a0a6-7d7635835ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:41.501873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a14a56-ca6b-4850-a0a6-7d7635835ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:41.521579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a14a56-ca6b-4850-a0a6-7d7635835ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:41.527827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a14a56-ca6b-4850-a0a6-7d7635835ed0 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:41.531023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2935fc074f24e6c9187a73ef912e6a3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:41.549159 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3222/6437] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:41.598920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2935fc074f24e6c9187a73ef912e6a3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:41.599954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2935fc074f24e6c9187a73ef912e6a3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:41.602042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2935fc074f24e6c9187a73ef912e6a3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:41.624676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2935fc074f24e6c9187a73ef912e6a3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:41.648371 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3216/6438] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:41 2022] DELETE /identity/v3/users/f2935fc074f24e6c9187a73ef912e6a3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:41.653540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1c82-f93d-4c6a-8675-74279dd16ca7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:41.653831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1c82-f93d-4c6a-8675-74279dd16ca7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:41.654113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1c82-f93d-4c6a-8675-74279dd16ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:41.692826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-952b1c82-f93d-4c6a-8675-74279dd16ca7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:41.694109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-952b1c82-f93d-4c6a-8675-74279dd16ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:41.796840 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3223/6439] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:41.808861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:41.811307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:41.944006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3690eb-f816-4e2d-a544-a0249c6dd09c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:41.955316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d44a99-6875-46f3-b7b4-3c5f93f2322f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:41.956052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44a99-6875-46f3-b7b4-3c5f93f2322f service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:41.956342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44a99-6875-46f3-b7b4-3c5f93f2322f service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:41.957135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44a99-6875-46f3-b7b4-3c5f93f2322f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:41.984374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d44a99-6875-46f3-b7b4-3c5f93f2322f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:41.986424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d44a99-6875-46f3-b7b4-3c5f93f2322f service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:42.020375 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3217/6440] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:42.813931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b1c82-f93d-4c6a-8675-74279dd16ca7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:42.821825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-952b1c82-f93d-4c6a-8675-74279dd16ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:42.902781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b1c82-f93d-4c6a-8675-74279dd16ca7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:42.940075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:42.940794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:42.941089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:42.941393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] PATH_INFO: `/v3/projects/8fc6a80b32374885ab4dede44da4947c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:42.946531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fc6a80b32374885ab4dede44da4947c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:42.949543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d44a99-6875-46f3-b7b4-3c5f93f2322f service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:42.950830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-58d44a99-6875-46f3-b7b4-3c5f93f2322f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:42.963918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:42.974098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:43.004711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d44a99-6875-46f3-b7b4-3c5f93f2322f service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:43.018813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad494b-7fe3-43cb-8388-cf32b9f17024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:43.020545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad494b-7fe3-43cb-8388-cf32b9f17024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:43.020837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad494b-7fe3-43cb-8388-cf32b9f17024 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:43.021114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad494b-7fe3-43cb-8388-cf32b9f17024 admin admin] PATH_INFO: `/v3/projects/935605cfe00e428aa23ef63115f397a0` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:43.023502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad494b-7fe3-43cb-8388-cf32b9f17024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935605cfe00e428aa23ef63115f397a0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:43.044638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad494b-7fe3-43cb-8388-cf32b9f17024 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:43.156017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:43.174406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc6a80b32374885ab4dede44da4947c', 'request_id': 'req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.202154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc6a80b32374885ab4dede44da4947c', 'request_id': 'req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.230834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc6a80b32374885ab4dede44da4947c', 'request_id': 'req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.253770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50ad494b-7fe3-43cb-8388-cf32b9f17024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935605cfe00e428aa23ef63115f397a0', 'request_id': 'req-50ad494b-7fe3-43cb-8388-cf32b9f17024'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.272807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50ad494b-7fe3-43cb-8388-cf32b9f17024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935605cfe00e428aa23ef63115f397a0', 'request_id': 'req-50ad494b-7fe3-43cb-8388-cf32b9f17024'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.281610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] The token cache is being invalidate because project 8fc6a80b32374885ab4dede44da4947c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:43.282255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50ad494b-7fe3-43cb-8388-cf32b9f17024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935605cfe00e428aa23ef63115f397a0', 'request_id': 'req-50ad494b-7fe3-43cb-8388-cf32b9f17024'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.284311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.285081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.305872 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3224/6441] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:42 2022] DELETE /identity/v3/projects/8fc6a80b32374885ab4dede44da4947c => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:43.306872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:43.309309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50ad494b-7fe3-43cb-8388-cf32b9f17024 admin admin] The token cache is being invalidate because project 935605cfe00e428aa23ef63115f397a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:43.309658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50ad494b-7fe3-43cb-8388-cf32b9f17024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.313019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50ad494b-7fe3-43cb-8388-cf32b9f17024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.315001 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3218/6442] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:42 2022] DELETE /identity/v3/projects/935605cfe00e428aa23ef63115f397a0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:17:43.319804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe9077-d30b-4fb4-9da1-f2d65d7f6333 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:43.320194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe9077-d30b-4fb4-9da1-f2d65d7f6333 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:43.320476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe9077-d30b-4fb4-9da1-f2d65d7f6333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:43.321995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:43.378172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-42fe9077-d30b-4fb4-9da1-f2d65d7f6333 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:43.379467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-42fe9077-d30b-4fb4-9da1-f2d65d7f6333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:43.526602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5d750-ffaa-486c-af2f-e2c20bd39d5a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:43.570116 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3219/6443] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:43.577779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353bc0b-58db-4f53-b0e8-257497cf76d1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:43.578066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353bc0b-58db-4f53-b0e8-257497cf76d1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:43.578347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353bc0b-58db-4f53-b0e8-257497cf76d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:43.600436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0353bc0b-58db-4f53-b0e8-257497cf76d1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:43.602146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0353bc0b-58db-4f53-b0e8-257497cf76d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:43.621812 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3220/6444] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:43.622787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353bc0b-58db-4f53-b0e8-257497cf76d1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:43.641646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353bc0b-58db-4f53-b0e8-257497cf76d1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:43.648182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaefbaf-7fe5-49b1-b667-bd5ef224cf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:43.648814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaefbaf-7fe5-49b1-b667-bd5ef224cf93 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:43.649096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaefbaf-7fe5-49b1-b667-bd5ef224cf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:43.649415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaefbaf-7fe5-49b1-b667-bd5ef224cf93 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:43.650262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaefbaf-7fe5-49b1-b667-bd5ef224cf93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:17:43.650908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaefbaf-7fe5-49b1-b667-bd5ef224cf93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:43.652734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaefbaf-7fe5-49b1-b667-bd5ef224cf93 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:43.672723 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3221/6445] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:17:43.673267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:43.673710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaefbaf-7fe5-49b1-b667-bd5ef224cf93 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:43.673909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:43.674195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:43.674614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] PATH_INFO: `/v3/users/3351c5e783ab475799a8a40a2cbb9661` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:43.675929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3351c5e783ab475799a8a40a2cbb9661)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:43.678065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:43.690289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaefbaf-7fe5-49b1-b667-bd5ef224cf93 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:43.697099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff62c35-f3a9-473e-889b-fdcaba197ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:43.697786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff62c35-f3a9-473e-889b-fdcaba197ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:43.698464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff62c35-f3a9-473e-889b-fdcaba197ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:43.698746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff62c35-f3a9-473e-889b-fdcaba197ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:43.699387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff62c35-f3a9-473e-889b-fdcaba197ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:43.701890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff62c35-f3a9-473e-889b-fdcaba197ab0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:43.757877 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3222/6446] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:43 2022] POST /identity/v3/projects => generated 357 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:43.758919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff62c35-f3a9-473e-889b-fdcaba197ab0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:43.780767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3351c5e783ab475799a8a40a2cbb9661'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.789369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3351c5e783ab475799a8a40a2cbb9661'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.790123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3351c5e783ab475799a8a40a2cbb9661'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.790749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3351c5e783ab475799a8a40a2cbb9661'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.806606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3351c5e783ab475799a8a40a2cbb9661'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:43.811332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:43.836568 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3225/6447] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:43 2022] DELETE /identity/v3/users/3351c5e783ab475799a8a40a2cbb9661 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:43.879293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:43.944346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff62c35-f3a9-473e-889b-fdcaba197ab0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:44.079583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2526845-da82-4ef8-8e4a-928d8fd9f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:44.080910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2526845-da82-4ef8-8e4a-928d8fd9f37e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:44.081473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2526845-da82-4ef8-8e4a-928d8fd9f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:44.081948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2526845-da82-4ef8-8e4a-928d8fd9f37e admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:44.082945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2526845-da82-4ef8-8e4a-928d8fd9f37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:44.086797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2526845-da82-4ef8-8e4a-928d8fd9f37e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:44.132238 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3223/6448] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:43 2022] POST /identity/v3/users => generated 279 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:44.135910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:44.137451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:44.166722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3dc76-6632-4763-9f3d-99e96b1fd7e3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:44.178197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce73ce-6ab8-4e62-a9cf-c64a47b647b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:44.179488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce73ce-6ab8-4e62-a9cf-c64a47b647b9 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:44.180030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce73ce-6ab8-4e62-a9cf-c64a47b647b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:44.180319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce73ce-6ab8-4e62-a9cf-c64a47b647b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:44.181128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce73ce-6ab8-4e62-a9cf-c64a47b647b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:44.192648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce73ce-6ab8-4e62-a9cf-c64a47b647b9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:44.213538 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3226/6449] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:44.219564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2526845-da82-4ef8-8e4a-928d8fd9f37e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:44.240364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2526845-da82-4ef8-8e4a-928d8fd9f37e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:44.254215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b07078-3e22-4681-9fa9-d2f58475083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:44.255006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b07078-3e22-4681-9fa9-d2f58475083a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:44.255309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b07078-3e22-4681-9fa9-d2f58475083a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:44.256050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b07078-3e22-4681-9fa9-d2f58475083a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:44.258295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b07078-3e22-4681-9fa9-d2f58475083a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:44.260274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b07078-3e22-4681-9fa9-d2f58475083a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:44.300838 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3224/6450] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:17:44.302323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce73ce-6ab8-4e62-a9cf-c64a47b647b9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:44.334900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce73ce-6ab8-4e62-a9cf-c64a47b647b9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:44.356461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4c81c-d3b6-4a25-a6ac-d96823afc578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:44.359417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4c81c-d3b6-4a25-a6ac-d96823afc578 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:44.360116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4c81c-d3b6-4a25-a6ac-d96823afc578 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:44.360379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4c81c-d3b6-4a25-a6ac-d96823afc578 admin admin] PATH_INFO: `/v3/projects/16f8be6f280145d79b5f2d203f3ca491/users/dcc4014bc6e240b38cd74c2c7109b801/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:44.432627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4c81c-d3b6-4a25-a6ac-d96823afc578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f8be6f280145d79b5f2d203f3ca491, user_id=dcc4014bc6e240b38cd74c2c7109b801, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:44.459474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4c81c-d3b6-4a25-a6ac-d96823afc578 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:44.546885 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3227/6451] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:44 2022] PUT /identity/v3/projects/16f8be6f280145d79b5f2d203f3ca491/users/dcc4014bc6e240b38cd74c2c7109b801/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:44.565732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338134d4-2a9e-4912-9a4e-d80623b03723 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:44.566278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338134d4-2a9e-4912-9a4e-d80623b03723 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:44.567334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338134d4-2a9e-4912-9a4e-d80623b03723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:44.602071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-338134d4-2a9e-4912-9a4e-d80623b03723 None None] MFA Rules not processed for user `dcc4014bc6e240b38cd74c2c7109b801`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:44.603664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-338134d4-2a9e-4912-9a4e-d80623b03723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:44.739956 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3225/6452] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:44.782597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4c81c-d3b6-4a25-a6ac-d96823afc578 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:44.784960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bec4c81c-d3b6-4a25-a6ac-d96823afc578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:44.909931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4c81c-d3b6-4a25-a6ac-d96823afc578 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:44.914505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67748b6-0aea-4404-9bd5-484b734ef715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:44.914844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67748b6-0aea-4404-9bd5-484b734ef715 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:44.915264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67748b6-0aea-4404-9bd5-484b734ef715 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:44.916075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67748b6-0aea-4404-9bd5-484b734ef715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:44.932654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67748b6-0aea-4404-9bd5-484b734ef715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:44.934952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67748b6-0aea-4404-9bd5-484b734ef715 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:44.959624 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3228/6453] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:45.274319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338134d4-2a9e-4912-9a4e-d80623b03723 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:45.276865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-338134d4-2a9e-4912-9a4e-d80623b03723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:45.466486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338134d4-2a9e-4912-9a4e-d80623b03723 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:45.498814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1014a43-bc91-48e4-b623-0e60cc23127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:45.499498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1014a43-bc91-48e4-b623-0e60cc23127c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:45.499788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1014a43-bc91-48e4-b623-0e60cc23127c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:45.500067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1014a43-bc91-48e4-b623-0e60cc23127c admin admin] PATH_INFO: `/v3/projects/fa23a78f5e364dea9488ce542b7a2b8a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:45.501297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1014a43-bc91-48e4-b623-0e60cc23127c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa23a78f5e364dea9488ce542b7a2b8a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:45.503303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1014a43-bc91-48e4-b623-0e60cc23127c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:45.505407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:45.609555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d1014a43-bc91-48e4-b623-0e60cc23127c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa23a78f5e364dea9488ce542b7a2b8a', 'request_id': 'req-d1014a43-bc91-48e4-b623-0e60cc23127c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:45.621796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d1014a43-bc91-48e4-b623-0e60cc23127c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa23a78f5e364dea9488ce542b7a2b8a', 'request_id': 'req-d1014a43-bc91-48e4-b623-0e60cc23127c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:45.631180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d1014a43-bc91-48e4-b623-0e60cc23127c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa23a78f5e364dea9488ce542b7a2b8a', 'request_id': 'req-d1014a43-bc91-48e4-b623-0e60cc23127c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:45.647515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d1014a43-bc91-48e4-b623-0e60cc23127c admin admin] The token cache is being invalidate because project fa23a78f5e364dea9488ce542b7a2b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:45.648427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d1014a43-bc91-48e4-b623-0e60cc23127c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:45.649302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d1014a43-bc91-48e4-b623-0e60cc23127c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:45.652210 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3226/6454] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:45 2022] DELETE /identity/v3/projects/fa23a78f5e364dea9488ce542b7a2b8a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:45.659042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbb234-d844-4106-a0a7-4b35f9fb29e7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:45.659331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbb234-d844-4106-a0a7-4b35f9fb29e7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:45.659612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbb234-d844-4106-a0a7-4b35f9fb29e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:45.695086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6fcbb234-d844-4106-a0a7-4b35f9fb29e7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:45.695716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6fcbb234-d844-4106-a0a7-4b35f9fb29e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:45.801384 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3229/6455] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:45.813057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d7c2b-8981-4f35-9621-15f0032cb0fe None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:45.814535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d7c2b-8981-4f35-9621-15f0032cb0fe None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:45.814535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d7c2b-8981-4f35-9621-15f0032cb0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:45.866297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f99d7c2b-8981-4f35-9621-15f0032cb0fe None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:45.869988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f99d7c2b-8981-4f35-9621-15f0032cb0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:45.886554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbb234-d844-4106-a0a7-4b35f9fb29e7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:45.887315 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3227/6456] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:45.908351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbb234-d844-4106-a0a7-4b35f9fb29e7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:45.931198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01ff5a-3c70-4672-b33f-d8f4682e7dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:45.932796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01ff5a-3c70-4672-b33f-d8f4682e7dfe admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:45.933328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01ff5a-3c70-4672-b33f-d8f4682e7dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:45.933819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01ff5a-3c70-4672-b33f-d8f4682e7dfe admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:45.937342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01ff5a-3c70-4672-b33f-d8f4682e7dfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:17:45.938391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01ff5a-3c70-4672-b33f-d8f4682e7dfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:45.941028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01ff5a-3c70-4672-b33f-d8f4682e7dfe admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:45.984802 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3230/6457] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:17:45.986498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d7c2b-8981-4f35-9621-15f0032cb0fe None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:46.004751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d7c2b-8981-4f35-9621-15f0032cb0fe None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:46.030949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409cfcb-3942-4d1d-a43e-beec2b9ffb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:46.033753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409cfcb-3942-4d1d-a43e-beec2b9ffb2b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:46.034243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409cfcb-3942-4d1d-a43e-beec2b9ffb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:46.035312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409cfcb-3942-4d1d-a43e-beec2b9ffb2b admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:46.037482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409cfcb-3942-4d1d-a43e-beec2b9ffb2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:46.039764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409cfcb-3942-4d1d-a43e-beec2b9ffb2b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:46.112848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01ff5a-3c70-4672-b33f-d8f4682e7dfe admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:46.113063 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3228/6458] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:45 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:46.128942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01ff5a-3c70-4672-b33f-d8f4682e7dfe admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:46.214002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:46.238773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f098b3-4e75-4b8c-8050-00f4f2fb8afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:46.240312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f098b3-4e75-4b8c-8050-00f4f2fb8afb admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:46.241173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f098b3-4e75-4b8c-8050-00f4f2fb8afb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:46.241695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f098b3-4e75-4b8c-8050-00f4f2fb8afb admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:46.242692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f098b3-4e75-4b8c-8050-00f4f2fb8afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:46.246773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f098b3-4e75-4b8c-8050-00f4f2fb8afb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:46.295600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409cfcb-3942-4d1d-a43e-beec2b9ffb2b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:46.327474 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3231/6459] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:46 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:17:46.359507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409cfcb-3942-4d1d-a43e-beec2b9ffb2b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:46.378128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f3182-2d1f-4a1f-bcf8-b772eab1f9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:46.378872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f3182-2d1f-4a1f-bcf8-b772eab1f9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:46.379439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f3182-2d1f-4a1f-bcf8-b772eab1f9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:46.379837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f3182-2d1f-4a1f-bcf8-b772eab1f9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:46.380599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f3182-2d1f-4a1f-bcf8-b772eab1f9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:46.383648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f3182-2d1f-4a1f-bcf8-b772eab1f9a3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:46.399384 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3229/6460] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:46.407304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f098b3-4e75-4b8c-8050-00f4f2fb8afb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:46.420440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f098b3-4e75-4b8c-8050-00f4f2fb8afb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:46.425803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72531d-d6d5-40a4-87bf-548d049afcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:46.426432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72531d-d6d5-40a4-87bf-548d049afcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:46.426992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72531d-d6d5-40a4-87bf-548d049afcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:46.427985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72531d-d6d5-40a4-87bf-548d049afcd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:46.428494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72531d-d6d5-40a4-87bf-548d049afcd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:46.441756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72531d-d6d5-40a4-87bf-548d049afcd4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:46.489141 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3232/6461] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:46.490242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f3182-2d1f-4a1f-bcf8-b772eab1f9a3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:46.508721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f3182-2d1f-4a1f-bcf8-b772eab1f9a3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:46.528000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fa305-c6c3-4ebd-af03-7d328affe015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:46.532834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fa305-c6c3-4ebd-af03-7d328affe015 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:46.533285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fa305-c6c3-4ebd-af03-7d328affe015 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:46.535451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fa305-c6c3-4ebd-af03-7d328affe015 admin admin] PATH_INFO: `/v3/projects/31344940c49d48e7a73a474b7ba778b6/users/26d0055806e642de86caa8f715cee5fd/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:46.585703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fa305-c6c3-4ebd-af03-7d328affe015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31344940c49d48e7a73a474b7ba778b6, user_id=26d0055806e642de86caa8f715cee5fd, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:46.589994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fa305-c6c3-4ebd-af03-7d328affe015 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:46.646272 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3230/6462] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:46 2022] PUT /identity/v3/projects/31344940c49d48e7a73a474b7ba778b6/users/26d0055806e642de86caa8f715cee5fd/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:46.660224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b086bd3-9455-4d58-9408-1faad36e6939 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:46.660706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b086bd3-9455-4d58-9408-1faad36e6939 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:46.661116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b086bd3-9455-4d58-9408-1faad36e6939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:46.703579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1b086bd3-9455-4d58-9408-1faad36e6939 None None] MFA Rules not processed for user `26d0055806e642de86caa8f715cee5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:46.704984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1b086bd3-9455-4d58-9408-1faad36e6939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:46.792832 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3233/6463] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:46.793415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fa305-c6c3-4ebd-af03-7d328affe015 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:46.935553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fa305-c6c3-4ebd-af03-7d328affe015 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:46.959073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd195f-ebef-4a31-a49e-ca55b6267d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:46.959911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd195f-ebef-4a31-a49e-ca55b6267d22 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:46.960157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd195f-ebef-4a31-a49e-ca55b6267d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:46.962407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd195f-ebef-4a31-a49e-ca55b6267d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:46.965362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd195f-ebef-4a31-a49e-ca55b6267d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:46.971607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd195f-ebef-4a31-a49e-ca55b6267d22 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:47.044019 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3231/6464] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:46 2022] POST /identity/v3/projects => generated 365 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:47.050966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b086bd3-9455-4d58-9408-1faad36e6939 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:47.074178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b086bd3-9455-4d58-9408-1faad36e6939 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:47.242393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e554a1-78e0-4531-95b7-d19f994e0ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:47.244222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e554a1-78e0-4531-95b7-d19f994e0ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:47.245241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e554a1-78e0-4531-95b7-d19f994e0ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:47.245241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e554a1-78e0-4531-95b7-d19f994e0ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:47.246211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e554a1-78e0-4531-95b7-d19f994e0ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:47.248367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e554a1-78e0-4531-95b7-d19f994e0ed1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:47.300500 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3234/6465] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:47 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:47.300727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd195f-ebef-4a31-a49e-ca55b6267d22 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:47.324576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd195f-ebef-4a31-a49e-ca55b6267d22 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:47.340209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9d155-26ec-4521-8e8e-11637f6c7286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:47.340900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9d155-26ec-4521-8e8e-11637f6c7286 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:47.341219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9d155-26ec-4521-8e8e-11637f6c7286 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:47.341491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9d155-26ec-4521-8e8e-11637f6c7286 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:47.345136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9d155-26ec-4521-8e8e-11637f6c7286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:47.350498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9d155-26ec-4521-8e8e-11637f6c7286 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:47.369723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:47.395952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e554a1-78e0-4531-95b7-d19f994e0ed1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:47.396295 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3232/6466] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:47.422543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e554a1-78e0-4531-95b7-d19f994e0ed1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:47.435171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fe2b8-2a7b-4acb-8eb7-04e9a9dee2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:47.436733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe2b8-2a7b-4acb-8eb7-04e9a9dee2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:47.436733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe2b8-2a7b-4acb-8eb7-04e9a9dee2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:47.436930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe2b8-2a7b-4acb-8eb7-04e9a9dee2f4 admin admin] PATH_INFO: `/v3/projects/c7ca5aa769844f5eb977bf2ce47e32fa/users/215f443e19874ac9872d706413de6c0e/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:47.458277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fe2b8-2a7b-4acb-8eb7-04e9a9dee2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ca5aa769844f5eb977bf2ce47e32fa, user_id=215f443e19874ac9872d706413de6c0e, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:47.461396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fe2b8-2a7b-4acb-8eb7-04e9a9dee2f4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:47.505089 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3235/6467] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:47 2022] PUT /identity/v3/projects/c7ca5aa769844f5eb977bf2ce47e32fa/users/215f443e19874ac9872d706413de6c0e/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:17:47.510985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9d155-26ec-4521-8e8e-11637f6c7286 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:47.533479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9d155-26ec-4521-8e8e-11637f6c7286 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:47.680003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567847b-27d3-4581-88c8-08e9595d7cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:47.680886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567847b-27d3-4581-88c8-08e9595d7cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:47.681642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567847b-27d3-4581-88c8-08e9595d7cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:47.682031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567847b-27d3-4581-88c8-08e9595d7cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:47.682916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567847b-27d3-4581-88c8-08e9595d7cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:47.688823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567847b-27d3-4581-88c8-08e9595d7cb1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:47.715823 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3233/6468] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:47.717989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fe2b8-2a7b-4acb-8eb7-04e9a9dee2f4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:47.732607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fe2b8-2a7b-4acb-8eb7-04e9a9dee2f4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:47.738270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00870c-20e3-491c-888b-6f2655ba53b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:47.739148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00870c-20e3-491c-888b-6f2655ba53b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:47.739554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00870c-20e3-491c-888b-6f2655ba53b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:47.740102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00870c-20e3-491c-888b-6f2655ba53b9 admin admin] PATH_INFO: `/v3/projects/c7ca5aa769844f5eb977bf2ce47e32fa/users/215f443e19874ac9872d706413de6c0e/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:47.743084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00870c-20e3-491c-888b-6f2655ba53b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ca5aa769844f5eb977bf2ce47e32fa, user_id=215f443e19874ac9872d706413de6c0e, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:47.746397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00870c-20e3-491c-888b-6f2655ba53b9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:47.785279 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3236/6469] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:47 2022] PUT /identity/v3/projects/c7ca5aa769844f5eb977bf2ce47e32fa/users/215f443e19874ac9872d706413de6c0e/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:47.793611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d579c6-d731-46e4-a8f5-174ccb3587b8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:47.794071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d579c6-d731-46e4-a8f5-174ccb3587b8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:47.794402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d579c6-d731-46e4-a8f5-174ccb3587b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:47.866397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e6d579c6-d731-46e4-a8f5-174ccb3587b8 None None] MFA Rules not processed for user `215f443e19874ac9872d706413de6c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:47.868219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e6d579c6-d731-46e4-a8f5-174ccb3587b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:48.011931 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3234/6470] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:48.024671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00870c-20e3-491c-888b-6f2655ba53b9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:48.027218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8d00870c-20e3-491c-888b-6f2655ba53b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:48.062621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:48.172016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00870c-20e3-491c-888b-6f2655ba53b9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:48.183021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b1081-b877-4c7d-8152-718bb9cb6aff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:48.183667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b1081-b877-4c7d-8152-718bb9cb6aff service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:48.183955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b1081-b877-4c7d-8152-718bb9cb6aff service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:48.184343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b1081-b877-4c7d-8152-718bb9cb6aff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:48.206955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b1081-b877-4c7d-8152-718bb9cb6aff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:48.207263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b1081-b877-4c7d-8152-718bb9cb6aff service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:48.231069 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3237/6471] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:48.397239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d579c6-d731-46e4-a8f5-174ccb3587b8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:48.413253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d579c6-d731-46e4-a8f5-174ccb3587b8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:48.421854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adbbb2-3a82-4e39-8061-ee4b0fb85e78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:48.425042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adbbb2-3a82-4e39-8061-ee4b0fb85e78 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:48.426403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adbbb2-3a82-4e39-8061-ee4b0fb85e78 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:48.427299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adbbb2-3a82-4e39-8061-ee4b0fb85e78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:48.539311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adbbb2-3a82-4e39-8061-ee4b0fb85e78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:48.541435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adbbb2-3a82-4e39-8061-ee4b0fb85e78 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:48.555268 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3235/6472] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:48.864998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b1081-b877-4c7d-8152-718bb9cb6aff service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:48.866862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-075b1081-b877-4c7d-8152-718bb9cb6aff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:49.055722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b1081-b877-4c7d-8152-718bb9cb6aff service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:49.075786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:49.076355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:49.076634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:49.077082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] PATH_INFO: `/v3/users/7007fb264988426f927e5f98dba676a6` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:49.080704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=7007fb264988426f927e5f98dba676a6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:49.083892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:49.192277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7007fb264988426f927e5f98dba676a6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:49.201282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7007fb264988426f927e5f98dba676a6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:49.204148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7007fb264988426f927e5f98dba676a6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:49.205135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7007fb264988426f927e5f98dba676a6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:49.226186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7007fb264988426f927e5f98dba676a6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:49.269937 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3238/6473] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:48 2022] DELETE /identity/v3/users/7007fb264988426f927e5f98dba676a6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:49.271242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c93c5-f61f-4813-9094-f4c23cf2531f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:49.271380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c93c5-f61f-4813-9094-f4c23cf2531f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:49.271615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c93c5-f61f-4813-9094-f4c23cf2531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:49.315072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-030c93c5-f61f-4813-9094-f4c23cf2531f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:49.316325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-030c93c5-f61f-4813-9094-f4c23cf2531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:49.369804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:49.436617 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3236/6474] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:17:49.449178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:49.450848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:49.514680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:49.553134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06242c5a-7bcf-4bf9-8f65-88218efcd5db admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:49.558868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ebd3c-846e-431f-8ed4-4aa26e30f3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:49.559694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ebd3c-846e-431f-8ed4-4aa26e30f3ab service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:49.559962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ebd3c-846e-431f-8ed4-4aa26e30f3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:49.560272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ebd3c-846e-431f-8ed4-4aa26e30f3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:49.572821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ebd3c-846e-431f-8ed4-4aa26e30f3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:49.574513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ebd3c-846e-431f-8ed4-4aa26e30f3ab service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:49.588179 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3239/6475] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:50.291414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c93c5-f61f-4813-9094-f4c23cf2531f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:50.292935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-030c93c5-f61f-4813-9094-f4c23cf2531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:50.318346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c93c5-f61f-4813-9094-f4c23cf2531f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:50.332067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a749f3-6448-49f7-8d94-b35cc98caf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:50.335555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a749f3-6448-49f7-8d94-b35cc98caf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:50.336177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a749f3-6448-49f7-8d94-b35cc98caf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:50.336607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a749f3-6448-49f7-8d94-b35cc98caf13 admin admin] PATH_INFO: `/v3/projects/9dd51263022340de856a8aa8e2272499` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:50.346316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a749f3-6448-49f7-8d94-b35cc98caf13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd51263022340de856a8aa8e2272499)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:50.348737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a749f3-6448-49f7-8d94-b35cc98caf13 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:50.467290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-82a749f3-6448-49f7-8d94-b35cc98caf13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd51263022340de856a8aa8e2272499', 'request_id': 'req-82a749f3-6448-49f7-8d94-b35cc98caf13'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:50.492567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-82a749f3-6448-49f7-8d94-b35cc98caf13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd51263022340de856a8aa8e2272499', 'request_id': 'req-82a749f3-6448-49f7-8d94-b35cc98caf13'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:50.508460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-82a749f3-6448-49f7-8d94-b35cc98caf13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd51263022340de856a8aa8e2272499', 'request_id': 'req-82a749f3-6448-49f7-8d94-b35cc98caf13'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:50.549621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-82a749f3-6448-49f7-8d94-b35cc98caf13 admin admin] The token cache is being invalidate because project 9dd51263022340de856a8aa8e2272499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:50.549621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-82a749f3-6448-49f7-8d94-b35cc98caf13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:50.549621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-82a749f3-6448-49f7-8d94-b35cc98caf13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:50.549621 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3237/6476] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:50 2022] DELETE /identity/v3/projects/9dd51263022340de856a8aa8e2272499 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:50.559073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf065496-ab05-4bb5-a035-b57529f20b8c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:50.559605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf065496-ab05-4bb5-a035-b57529f20b8c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:50.560088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf065496-ab05-4bb5-a035-b57529f20b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:50.590170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bf065496-ab05-4bb5-a035-b57529f20b8c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:50.592346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bf065496-ab05-4bb5-a035-b57529f20b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:50.696339 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3240/6477] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:50.708211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b96c1-8fdf-4dff-afa0-2bca4d14454b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:50.708757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b96c1-8fdf-4dff-afa0-2bca4d14454b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:50.709883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b96c1-8fdf-4dff-afa0-2bca4d14454b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:50.756127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-673b96c1-8fdf-4dff-afa0-2bca4d14454b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:50.759654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-673b96c1-8fdf-4dff-afa0-2bca4d14454b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:50.777704 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3238/6478] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:50.782127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf065496-ab05-4bb5-a035-b57529f20b8c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:50.799145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf065496-ab05-4bb5-a035-b57529f20b8c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:50.806893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f584155-bd68-4ff9-bc3d-7880d4270332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:50.807830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f584155-bd68-4ff9-bc3d-7880d4270332 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:50.808341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f584155-bd68-4ff9-bc3d-7880d4270332 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:50.808791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f584155-bd68-4ff9-bc3d-7880d4270332 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:50.810038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f584155-bd68-4ff9-bc3d-7880d4270332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:17:50.811141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f584155-bd68-4ff9-bc3d-7880d4270332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:50.820704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f584155-bd68-4ff9-bc3d-7880d4270332 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:50.844622 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3241/6479] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:17:50.850669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b96c1-8fdf-4dff-afa0-2bca4d14454b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:50.864723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b96c1-8fdf-4dff-afa0-2bca4d14454b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:50.870148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977b0ce-a950-4a44-a88d-3e345086d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:50.871180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977b0ce-a950-4a44-a88d-3e345086d229 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:50.871627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977b0ce-a950-4a44-a88d-3e345086d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:50.872053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977b0ce-a950-4a44-a88d-3e345086d229 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:50.872863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977b0ce-a950-4a44-a88d-3e345086d229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:50.875746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977b0ce-a950-4a44-a88d-3e345086d229 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:50.908283 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3239/6480] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:50 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:17:50.912339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f584155-bd68-4ff9-bc3d-7880d4270332 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:50.923516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f584155-bd68-4ff9-bc3d-7880d4270332 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:51.032429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8eb1e-0029-4c37-b767-0faf2ac70b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:51.034331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8eb1e-0029-4c37-b767-0faf2ac70b16 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:51.034706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8eb1e-0029-4c37-b767-0faf2ac70b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:51.035204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8eb1e-0029-4c37-b767-0faf2ac70b16 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:51.035944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8eb1e-0029-4c37-b767-0faf2ac70b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:51.037941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8eb1e-0029-4c37-b767-0faf2ac70b16 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:51.084260 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3242/6481] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:50 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:51.087657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977b0ce-a950-4a44-a88d-3e345086d229 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:51.107591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977b0ce-a950-4a44-a88d-3e345086d229 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:51.121797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56428c-fd90-478d-9768-399bce7025c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:51.123466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56428c-fd90-478d-9768-399bce7025c8 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:51.128249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56428c-fd90-478d-9768-399bce7025c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:51.128952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56428c-fd90-478d-9768-399bce7025c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:51.130830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56428c-fd90-478d-9768-399bce7025c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:51.134500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56428c-fd90-478d-9768-399bce7025c8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:51.155972 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3240/6482] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:51.159581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8eb1e-0029-4c37-b767-0faf2ac70b16 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:51.173376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8eb1e-0029-4c37-b767-0faf2ac70b16 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:51.181221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5a04f-0472-4df0-a7f3-e69f531fe64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:51.182321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5a04f-0472-4df0-a7f3-e69f531fe64b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:51.182954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5a04f-0472-4df0-a7f3-e69f531fe64b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:51.183601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5a04f-0472-4df0-a7f3-e69f531fe64b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:51.184452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5a04f-0472-4df0-a7f3-e69f531fe64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:51.189547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5a04f-0472-4df0-a7f3-e69f531fe64b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:51.205245 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3243/6483] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:51.208692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56428c-fd90-478d-9768-399bce7025c8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:51.221824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56428c-fd90-478d-9768-399bce7025c8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:51.230109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9e45b-881b-486d-902d-8f71678b49cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:51.230812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e45b-881b-486d-902d-8f71678b49cf admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:51.231483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e45b-881b-486d-902d-8f71678b49cf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:51.231615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e45b-881b-486d-902d-8f71678b49cf admin admin] PATH_INFO: `/v3/projects/e45787bedc5242c3ac4194da2af183e1/users/b307316877f64e0cb0acc42080925e24/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:51.275277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9e45b-881b-486d-902d-8f71678b49cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45787bedc5242c3ac4194da2af183e1, user_id=b307316877f64e0cb0acc42080925e24, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:51.279342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9e45b-881b-486d-902d-8f71678b49cf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:51.308472 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3241/6484] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:51 2022] PUT /identity/v3/projects/e45787bedc5242c3ac4194da2af183e1/users/b307316877f64e0cb0acc42080925e24/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:51.321434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e685dca-7d04-490d-8ef5-816e3f06664e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:51.321731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e685dca-7d04-490d-8ef5-816e3f06664e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:51.322136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e685dca-7d04-490d-8ef5-816e3f06664e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:51.374982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3e685dca-7d04-490d-8ef5-816e3f06664e None None] MFA Rules not processed for user `b307316877f64e0cb0acc42080925e24`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:51.377121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3e685dca-7d04-490d-8ef5-816e3f06664e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:51.423212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:51.472206 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3244/6485] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:51.487772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9e45b-881b-486d-902d-8f71678b49cf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:51.490284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-49a9e45b-881b-486d-902d-8f71678b49cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:51.574311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:51.618029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9e45b-881b-486d-902d-8f71678b49cf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:51.628551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac329-100c-47b8-8de6-a6a969eff51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:51.632220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac329-100c-47b8-8de6-a6a969eff51b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:51.632811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac329-100c-47b8-8de6-a6a969eff51b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:51.633788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac329-100c-47b8-8de6-a6a969eff51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:51.659569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aac329-100c-47b8-8de6-a6a969eff51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:51.661614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aac329-100c-47b8-8de6-a6a969eff51b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:51.676731 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3242/6486] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:54.813145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e685dca-7d04-490d-8ef5-816e3f06664e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:54.814690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3e685dca-7d04-490d-8ef5-816e3f06664e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:54.934122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e685dca-7d04-490d-8ef5-816e3f06664e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:54.942454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:54.944537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:54.945073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:54.945540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] PATH_INFO: `/v3/users/26d0055806e642de86caa8f715cee5fd` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:54.947419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d0055806e642de86caa8f715cee5fd)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:54.950256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:55.042747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d0055806e642de86caa8f715cee5fd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:55.060453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d0055806e642de86caa8f715cee5fd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:55.061959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d0055806e642de86caa8f715cee5fd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:55.062723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d0055806e642de86caa8f715cee5fd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:55.080401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d0055806e642de86caa8f715cee5fd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:55.103129 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3245/6487] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:54 2022] DELETE /identity/v3/users/26d0055806e642de86caa8f715cee5fd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:55.107722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c711a-a019-4435-8bdb-9dfc503fed66 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:55.108655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c711a-a019-4435-8bdb-9dfc503fed66 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:55.109336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c711a-a019-4435-8bdb-9dfc503fed66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:55.134997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4f5c711a-a019-4435-8bdb-9dfc503fed66 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:55.138094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4f5c711a-a019-4435-8bdb-9dfc503fed66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:55.222116 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3243/6488] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:17:55.236421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:55.237907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:55.312432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1f716-058e-4cab-b69f-049415051c47 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:55.316460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2e2dd-554e-4a5d-bd41-f025c5215f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:55.317099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2e2dd-554e-4a5d-bd41-f025c5215f25 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:55.317410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2e2dd-554e-4a5d-bd41-f025c5215f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:55.317681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2e2dd-554e-4a5d-bd41-f025c5215f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:55.324482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:55.331678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2e2dd-554e-4a5d-bd41-f025c5215f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:55.334522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2e2dd-554e-4a5d-bd41-f025c5215f25 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:55.348538 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3246/6489] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:56.629352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c711a-a019-4435-8bdb-9dfc503fed66 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:56.632501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4f5c711a-a019-4435-8bdb-9dfc503fed66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:56.673526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c711a-a019-4435-8bdb-9dfc503fed66 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:56.691169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:56.691840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:56.692125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:56.692406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] PATH_INFO: `/v3/projects/31344940c49d48e7a73a474b7ba778b6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:56.693629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=31344940c49d48e7a73a474b7ba778b6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:56.695558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:56.807526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31344940c49d48e7a73a474b7ba778b6', 'request_id': 'req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:56.821902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31344940c49d48e7a73a474b7ba778b6', 'request_id': 'req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:56.832194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31344940c49d48e7a73a474b7ba778b6', 'request_id': 'req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:56.847920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] The token cache is being invalidate because project 31344940c49d48e7a73a474b7ba778b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:56.848808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:56.849734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:56.854023 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3244/6490] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:56 2022] DELETE /identity/v3/projects/31344940c49d48e7a73a474b7ba778b6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:56.858998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2e2dd-554e-4a5d-bd41-f025c5215f25 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:56.876605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2e2dd-554e-4a5d-bd41-f025c5215f25 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:56.975599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee699b-8d50-47a6-85a8-d654469e3337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:56.976215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee699b-8d50-47a6-85a8-d654469e3337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:56.976495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee699b-8d50-47a6-85a8-d654469e3337 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:56.977020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee699b-8d50-47a6-85a8-d654469e3337 admin admin] PATH_INFO: `/v3/users/215f443e19874ac9872d706413de6c0e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:56.985710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee699b-8d50-47a6-85a8-d654469e3337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=215f443e19874ac9872d706413de6c0e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:56.987691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee699b-8d50-47a6-85a8-d654469e3337 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:57.085785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-00ee699b-8d50-47a6-85a8-d654469e3337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215f443e19874ac9872d706413de6c0e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:57.098707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-00ee699b-8d50-47a6-85a8-d654469e3337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215f443e19874ac9872d706413de6c0e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:57.099695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-00ee699b-8d50-47a6-85a8-d654469e3337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215f443e19874ac9872d706413de6c0e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:57.102899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-00ee699b-8d50-47a6-85a8-d654469e3337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215f443e19874ac9872d706413de6c0e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:57.127160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-00ee699b-8d50-47a6-85a8-d654469e3337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215f443e19874ac9872d706413de6c0e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:57.158314 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3247/6491] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:17:56 2022] DELETE /identity/v3/users/215f443e19874ac9872d706413de6c0e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:57.557697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:57.562466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:57.584009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62fa2c-fa95-4ddf-84c0-c7f1a4eecccf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:57.673637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21eae6-7356-4f87-8c6f-faec351fbc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:57.675101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21eae6-7356-4f87-8c6f-faec351fbc64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:57.675543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21eae6-7356-4f87-8c6f-faec351fbc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:57.675978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21eae6-7356-4f87-8c6f-faec351fbc64 admin admin] PATH_INFO: `/v3/projects/c7ca5aa769844f5eb977bf2ce47e32fa` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:57.677742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21eae6-7356-4f87-8c6f-faec351fbc64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ca5aa769844f5eb977bf2ce47e32fa)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:57.680232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21eae6-7356-4f87-8c6f-faec351fbc64 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:57.694070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:57.762680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ce21eae6-7356-4f87-8c6f-faec351fbc64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ca5aa769844f5eb977bf2ce47e32fa', 'request_id': 'req-ce21eae6-7356-4f87-8c6f-faec351fbc64'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:57.774431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ce21eae6-7356-4f87-8c6f-faec351fbc64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ca5aa769844f5eb977bf2ce47e32fa', 'request_id': 'req-ce21eae6-7356-4f87-8c6f-faec351fbc64'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:57.783171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ce21eae6-7356-4f87-8c6f-faec351fbc64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ca5aa769844f5eb977bf2ce47e32fa', 'request_id': 'req-ce21eae6-7356-4f87-8c6f-faec351fbc64'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:57.803088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ce21eae6-7356-4f87-8c6f-faec351fbc64 admin admin] The token cache is being invalidate because project c7ca5aa769844f5eb977bf2ce47e32fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:17:57.803622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ce21eae6-7356-4f87-8c6f-faec351fbc64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:57.804562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ce21eae6-7356-4f87-8c6f-faec351fbc64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:17:57.806957 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3245/6492] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:17:57 2022] DELETE /identity/v3/projects/c7ca5aa769844f5eb977bf2ce47e32fa => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:57.812841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bec768-a32d-4101-b2df-b59ec1bb6df8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:57.813139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bec768-a32d-4101-b2df-b59ec1bb6df8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:57.813441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bec768-a32d-4101-b2df-b59ec1bb6df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:57.850534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-14bec768-a32d-4101-b2df-b59ec1bb6df8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:57.852354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-14bec768-a32d-4101-b2df-b59ec1bb6df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:57.973067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c39a3-83fe-444f-860b-264b0110f1ad None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:57.973067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c39a3-83fe-444f-860b-264b0110f1ad None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:57.973351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c39a3-83fe-444f-860b-264b0110f1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:57.977489 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3248/6493] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:58.004008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8f2c39a3-83fe-444f-860b-264b0110f1ad None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:58.005370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f2c39a3-83fe-444f-860b-264b0110f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:58.021965 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3246/6494] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:58.027416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bec768-a32d-4101-b2df-b59ec1bb6df8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:58.041450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bec768-a32d-4101-b2df-b59ec1bb6df8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:58.048837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5eb62-15d9-4402-b223-4058a4fcf9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:58.049855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5eb62-15d9-4402-b223-4058a4fcf9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:58.050322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5eb62-15d9-4402-b223-4058a4fcf9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:58.050761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5eb62-15d9-4402-b223-4058a4fcf9b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:58.051661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5eb62-15d9-4402-b223-4058a4fcf9b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:17:58.052134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5eb62-15d9-4402-b223-4058a4fcf9b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:58.053939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5eb62-15d9-4402-b223-4058a4fcf9b8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:58.065266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:58.075311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c39a3-83fe-444f-860b-264b0110f1ad None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:58.082137 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3249/6495] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:17:58.088920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c39a3-83fe-444f-860b-264b0110f1ad None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:58.095075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd4636-3464-431b-a99f-5fdbd5e2ddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:58.095922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd4636-3464-431b-a99f-5fdbd5e2ddde admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:58.096359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd4636-3464-431b-a99f-5fdbd5e2ddde admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:58.096798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd4636-3464-431b-a99f-5fdbd5e2ddde admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:58.098686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd4636-3464-431b-a99f-5fdbd5e2ddde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:58.100976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd4636-3464-431b-a99f-5fdbd5e2ddde admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:58.140755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5eb62-15d9-4402-b223-4058a4fcf9b8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:58.150048 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3247/6496] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:58 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:58.155078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5eb62-15d9-4402-b223-4058a4fcf9b8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:58.238628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149d655-e44c-4e75-a615-c650de9331d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:58.239823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149d655-e44c-4e75-a615-c650de9331d5 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:58.240319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149d655-e44c-4e75-a615-c650de9331d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:58.240845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149d655-e44c-4e75-a615-c650de9331d5 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:58.241719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149d655-e44c-4e75-a615-c650de9331d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:58.244070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149d655-e44c-4e75-a615-c650de9331d5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:58.277551 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3250/6497] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:58 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:58.279707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd4636-3464-431b-a99f-5fdbd5e2ddde admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:58.295485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd4636-3464-431b-a99f-5fdbd5e2ddde admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:58.301520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ae59-f116-437f-95da-43207786155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:58.302303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ae59-f116-437f-95da-43207786155d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:58.302647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ae59-f116-437f-95da-43207786155d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:58.304164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ae59-f116-437f-95da-43207786155d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:58.304164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69ae59-f116-437f-95da-43207786155d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:58.305404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69ae59-f116-437f-95da-43207786155d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:58.321857 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3248/6498] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:58.323114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149d655-e44c-4e75-a615-c650de9331d5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:58.334403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149d655-e44c-4e75-a615-c650de9331d5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:58.341705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f3d01-b87b-4be7-93d1-43cc982c4b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:58.341990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f3d01-b87b-4be7-93d1-43cc982c4b01 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:58.342334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f3d01-b87b-4be7-93d1-43cc982c4b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:58.342670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f3d01-b87b-4be7-93d1-43cc982c4b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:58.343378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f3d01-b87b-4be7-93d1-43cc982c4b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:58.345061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f3d01-b87b-4be7-93d1-43cc982c4b01 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:58.357768 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3251/6499] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:58.361953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ae59-f116-437f-95da-43207786155d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:58.374977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ae59-f116-437f-95da-43207786155d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:58.380362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315fad6-a3ee-4300-81a9-d7790fd23c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:58.381332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315fad6-a3ee-4300-81a9-d7790fd23c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:58.381620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315fad6-a3ee-4300-81a9-d7790fd23c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:58.381901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315fad6-a3ee-4300-81a9-d7790fd23c0f admin admin] PATH_INFO: `/v3/projects/53bca313139748f5bb1ac87e3406c094/users/748f001bf6324a98bf625a8e71bb7d4a/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:58.398176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315fad6-a3ee-4300-81a9-d7790fd23c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=53bca313139748f5bb1ac87e3406c094, user_id=748f001bf6324a98bf625a8e71bb7d4a, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:58.400891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315fad6-a3ee-4300-81a9-d7790fd23c0f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:58.418570 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3249/6500] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:58 2022] PUT /identity/v3/projects/53bca313139748f5bb1ac87e3406c094/users/748f001bf6324a98bf625a8e71bb7d4a/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:58.429031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908aedd-ceaf-4658-90cf-00b23fbe31c1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:58.429413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908aedd-ceaf-4658-90cf-00b23fbe31c1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:58.429779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908aedd-ceaf-4658-90cf-00b23fbe31c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:58.463243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8908aedd-ceaf-4658-90cf-00b23fbe31c1 None None] MFA Rules not processed for user `748f001bf6324a98bf625a8e71bb7d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:58.464471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8908aedd-ceaf-4658-90cf-00b23fbe31c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:58.576502 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3252/6501] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:17:58.577472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315fad6-a3ee-4300-81a9-d7790fd23c0f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:58.715694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315fad6-a3ee-4300-81a9-d7790fd23c0f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:58.725936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a606788-6978-4e03-9c34-9011147aa302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:58.727133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a606788-6978-4e03-9c34-9011147aa302 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:58.727980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a606788-6978-4e03-9c34-9011147aa302 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:58.728364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a606788-6978-4e03-9c34-9011147aa302 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:58.730366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a606788-6978-4e03-9c34-9011147aa302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:58.734725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a606788-6978-4e03-9c34-9011147aa302 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:58.783875 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3250/6502] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:17:58 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:58.788718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908aedd-ceaf-4658-90cf-00b23fbe31c1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:58.808172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908aedd-ceaf-4658-90cf-00b23fbe31c1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:58.893477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066a447-8aea-4e34-8b73-f7ad3408caff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:58.894354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066a447-8aea-4e34-8b73-f7ad3408caff admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:58.894842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066a447-8aea-4e34-8b73-f7ad3408caff admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:58.895314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066a447-8aea-4e34-8b73-f7ad3408caff admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:58.896180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066a447-8aea-4e34-8b73-f7ad3408caff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:58.898503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066a447-8aea-4e34-8b73-f7ad3408caff admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:58.928487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:58.941796 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3253/6503] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:17:58 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:17:58.942381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a606788-6978-4e03-9c34-9011147aa302 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:58.955246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a606788-6978-4e03-9c34-9011147aa302 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:58.965035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f8ef9-f2e3-4bef-8052-3662f9f1cee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:58.965939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f8ef9-f2e3-4bef-8052-3662f9f1cee5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:58.966369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f8ef9-f2e3-4bef-8052-3662f9f1cee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:58.966884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f8ef9-f2e3-4bef-8052-3662f9f1cee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:58.967821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f8ef9-f2e3-4bef-8052-3662f9f1cee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:58.970355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f8ef9-f2e3-4bef-8052-3662f9f1cee5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:58.988315 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3251/6504] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:58.992806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066a447-8aea-4e34-8b73-f7ad3408caff admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:59.012866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066a447-8aea-4e34-8b73-f7ad3408caff admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:59.018669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d97ee-0854-4c1b-a9ec-383672da9147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:59.021599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d97ee-0854-4c1b-a9ec-383672da9147 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:59.022190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d97ee-0854-4c1b-a9ec-383672da9147 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:59.022760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d97ee-0854-4c1b-a9ec-383672da9147 admin admin] PATH_INFO: `/v3/projects/3b95c3d79c154a179d68517024f6b81d/users/e5b94e59922f4dcbbeca1a04f199b1c0/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:59.062254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d97ee-0854-4c1b-a9ec-383672da9147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b95c3d79c154a179d68517024f6b81d, user_id=e5b94e59922f4dcbbeca1a04f199b1c0, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:59.064773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d97ee-0854-4c1b-a9ec-383672da9147 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:59.094222 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3254/6505] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:58 2022] PUT /identity/v3/projects/3b95c3d79c154a179d68517024f6b81d/users/e5b94e59922f4dcbbeca1a04f199b1c0/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:59.099076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f8ef9-f2e3-4bef-8052-3662f9f1cee5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:59.120186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f8ef9-f2e3-4bef-8052-3662f9f1cee5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:59.127484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:59.221419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a08db6-75eb-4742-8a16-e777b8974459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:59.222053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a08db6-75eb-4742-8a16-e777b8974459 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:59.222337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a08db6-75eb-4742-8a16-e777b8974459 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:59.222941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a08db6-75eb-4742-8a16-e777b8974459 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:59.223251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a08db6-75eb-4742-8a16-e777b8974459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:59.225052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a08db6-75eb-4742-8a16-e777b8974459 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:59.236940 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3252/6506] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:17:59.242006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d97ee-0854-4c1b-a9ec-383672da9147 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:59.253805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d97ee-0854-4c1b-a9ec-383672da9147 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:59.259456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baab00-83d7-4991-b8bf-f97692b13bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:59.260912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baab00-83d7-4991-b8bf-f97692b13bef admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:59.260912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baab00-83d7-4991-b8bf-f97692b13bef admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:59.261125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baab00-83d7-4991-b8bf-f97692b13bef admin admin] PATH_INFO: `/v3/projects/3b95c3d79c154a179d68517024f6b81d/users/e5b94e59922f4dcbbeca1a04f199b1c0/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:59.263782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07baab00-83d7-4991-b8bf-f97692b13bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b95c3d79c154a179d68517024f6b81d, user_id=e5b94e59922f4dcbbeca1a04f199b1c0, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:59.267255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07baab00-83d7-4991-b8bf-f97692b13bef admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:59.285233 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3255/6507] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:17:59 2022] PUT /identity/v3/projects/3b95c3d79c154a179d68517024f6b81d/users/e5b94e59922f4dcbbeca1a04f199b1c0/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:17:59.294441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc05d1-65d0-4c9e-8a40-e306cb301856 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:59.294441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc05d1-65d0-4c9e-8a40-e306cb301856 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:59.295237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc05d1-65d0-4c9e-8a40-e306cb301856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:59.325820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-56cc05d1-65d0-4c9e-8a40-e306cb301856 None None] MFA Rules not processed for user `e5b94e59922f4dcbbeca1a04f199b1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:17:59.327706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-56cc05d1-65d0-4c9e-8a40-e306cb301856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:59.409242 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3253/6508] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:17:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:17:59.422385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baab00-83d7-4991-b8bf-f97692b13bef admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:17:59.425284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-07baab00-83d7-4991-b8bf-f97692b13bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:17:59.505583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baab00-83d7-4991-b8bf-f97692b13bef admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:17:59.509899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55242d68-7718-49ae-a909-b62db61cb72d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:17:59.510516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55242d68-7718-49ae-a909-b62db61cb72d service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:17:59.510794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55242d68-7718-49ae-a909-b62db61cb72d service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:17:59.511064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55242d68-7718-49ae-a909-b62db61cb72d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:17:59.645641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55242d68-7718-49ae-a909-b62db61cb72d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:17:59.648110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55242d68-7718-49ae-a909-b62db61cb72d service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:17:59.677040 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3256/6509] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:17:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:02.295283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc05d1-65d0-4c9e-8a40-e306cb301856 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:02.297894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-56cc05d1-65d0-4c9e-8a40-e306cb301856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:02.423805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc05d1-65d0-4c9e-8a40-e306cb301856 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:02.429590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:02.430448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:02.430885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:02.431427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] PATH_INFO: `/v3/users/dcc4014bc6e240b38cd74c2c7109b801` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:02.432760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc4014bc6e240b38cd74c2c7109b801)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:02.435606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:02.500259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:02.532806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc4014bc6e240b38cd74c2c7109b801'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:02.544688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc4014bc6e240b38cd74c2c7109b801'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:02.545737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc4014bc6e240b38cd74c2c7109b801'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:02.546492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc4014bc6e240b38cd74c2c7109b801'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:02.577312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc4014bc6e240b38cd74c2c7109b801'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:02.606432 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3254/6510] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:02 2022] DELETE /identity/v3/users/dcc4014bc6e240b38cd74c2c7109b801 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:02.610836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01179fd-cbcc-4c71-acbe-7f35e01e9257 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:02.611358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01179fd-cbcc-4c71-acbe-7f35e01e9257 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:02.611440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01179fd-cbcc-4c71-acbe-7f35e01e9257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:02.631765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a01179fd-cbcc-4c71-acbe-7f35e01e9257 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:02.633267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a01179fd-cbcc-4c71-acbe-7f35e01e9257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:02.723972 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3257/6511] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:02.739666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:02.741204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:02.771275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01179fd-cbcc-4c71-acbe-7f35e01e9257 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:02.773114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a01179fd-cbcc-4c71-acbe-7f35e01e9257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:02.788741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01179fd-cbcc-4c71-acbe-7f35e01e9257 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:02.795631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:02.796615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:02.796999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:02.798159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] PATH_INFO: `/v3/users/748f001bf6324a98bf625a8e71bb7d4a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:02.800830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=748f001bf6324a98bf625a8e71bb7d4a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:02.807708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:02.818993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeff0bb-0170-48dc-a81e-4ac0ac7c7f6d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:02.823079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e4a9-301c-4e0a-8827-2f0a0df1b6e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:02.824103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e4a9-301c-4e0a-8827-2f0a0df1b6e0 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:02.824493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e4a9-301c-4e0a-8827-2f0a0df1b6e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:02.824875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e4a9-301c-4e0a-8827-2f0a0df1b6e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:02.828501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:02.837493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4e4a9-301c-4e0a-8827-2f0a0df1b6e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:02.839369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4e4a9-301c-4e0a-8827-2f0a0df1b6e0 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:02.853016 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3255/6512] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:02.883865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '748f001bf6324a98bf625a8e71bb7d4a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:02.894022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '748f001bf6324a98bf625a8e71bb7d4a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:02.895699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '748f001bf6324a98bf625a8e71bb7d4a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:02.896438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '748f001bf6324a98bf625a8e71bb7d4a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:02.913431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '748f001bf6324a98bf625a8e71bb7d4a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:02.940864 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3258/6513] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:02 2022] DELETE /identity/v3/users/748f001bf6324a98bf625a8e71bb7d4a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:18:02.946343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f3128-41e3-4be6-8400-e7c5d9733ea5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:02.947507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f3128-41e3-4be6-8400-e7c5d9733ea5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:02.947886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f3128-41e3-4be6-8400-e7c5d9733ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:02.972921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1d0f3128-41e3-4be6-8400-e7c5d9733ea5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:02.974244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1d0f3128-41e3-4be6-8400-e7c5d9733ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:03.095182 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3256/6514] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:03.111289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:03.112768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:03.138866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f3128-41e3-4be6-8400-e7c5d9733ea5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:03.140385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1d0f3128-41e3-4be6-8400-e7c5d9733ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:03.167008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f3128-41e3-4be6-8400-e7c5d9733ea5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:03.182232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b6972-71a4-435f-a7ec-61f6af3978f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:03.183835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b6972-71a4-435f-a7ec-61f6af3978f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:03.185309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b6972-71a4-435f-a7ec-61f6af3978f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:03.186214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b6972-71a4-435f-a7ec-61f6af3978f9 admin admin] PATH_INFO: `/v3/projects/16f8be6f280145d79b5f2d203f3ca491` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:03.191954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b6972-71a4-435f-a7ec-61f6af3978f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f8be6f280145d79b5f2d203f3ca491)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:03.195597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b6972-71a4-435f-a7ec-61f6af3978f9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:03.239742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067b4bf-d169-4d18-936c-4329bcc9f45e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:03.246681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12631031-a804-4663-9777-29a5242d51a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:03.247706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12631031-a804-4663-9777-29a5242d51a4 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:03.248308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12631031-a804-4663-9777-29a5242d51a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:03.248855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12631031-a804-4663-9777-29a5242d51a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:03.274467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12631031-a804-4663-9777-29a5242d51a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:03.276050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12631031-a804-4663-9777-29a5242d51a4 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:03.305849 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3259/6515] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:03.307171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:03.311657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff7b6972-71a4-435f-a7ec-61f6af3978f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f8be6f280145d79b5f2d203f3ca491', 'request_id': 'req-ff7b6972-71a4-435f-a7ec-61f6af3978f9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:03.328230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff7b6972-71a4-435f-a7ec-61f6af3978f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f8be6f280145d79b5f2d203f3ca491', 'request_id': 'req-ff7b6972-71a4-435f-a7ec-61f6af3978f9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:03.343097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff7b6972-71a4-435f-a7ec-61f6af3978f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f8be6f280145d79b5f2d203f3ca491', 'request_id': 'req-ff7b6972-71a4-435f-a7ec-61f6af3978f9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:03.361513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff7b6972-71a4-435f-a7ec-61f6af3978f9 admin admin] The token cache is being invalidate because project 16f8be6f280145d79b5f2d203f3ca491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:18:03.362075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff7b6972-71a4-435f-a7ec-61f6af3978f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:03.362970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ff7b6972-71a4-435f-a7ec-61f6af3978f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:03.367096 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3257/6516] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:03 2022] DELETE /identity/v3/projects/16f8be6f280145d79b5f2d203f3ca491 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:18:03.372729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2044115-abf7-449d-ae60-e825a73e6ebf None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:03.372729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2044115-abf7-449d-ae60-e825a73e6ebf None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:03.373544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2044115-abf7-449d-ae60-e825a73e6ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:03.406576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c2044115-abf7-449d-ae60-e825a73e6ebf None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:03.408475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c2044115-abf7-449d-ae60-e825a73e6ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:03.548824 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3260/6517] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:03.556624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991b73-a94f-4fbb-a01c-809262b40477 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:03.556843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991b73-a94f-4fbb-a01c-809262b40477 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:03.557035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991b73-a94f-4fbb-a01c-809262b40477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:03.580390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7c991b73-a94f-4fbb-a01c-809262b40477 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:03.581682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7c991b73-a94f-4fbb-a01c-809262b40477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:03.597477 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3258/6518] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:03.599176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2044115-abf7-449d-ae60-e825a73e6ebf None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:03.618107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2044115-abf7-449d-ae60-e825a73e6ebf None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:03.637494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1bd09-f11b-4f17-9d28-d43cafcba611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:03.639181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1bd09-f11b-4f17-9d28-d43cafcba611 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:03.639468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1bd09-f11b-4f17-9d28-d43cafcba611 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:03.639746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1bd09-f11b-4f17-9d28-d43cafcba611 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:03.640423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1bd09-f11b-4f17-9d28-d43cafcba611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:18:03.640731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1bd09-f11b-4f17-9d28-d43cafcba611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:03.642548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1bd09-f11b-4f17-9d28-d43cafcba611 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:03.666159 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3261/6519] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:18:03.670424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c991b73-a94f-4fbb-a01c-809262b40477 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:03.696113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c991b73-a94f-4fbb-a01c-809262b40477 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:03.706061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed80af6-629e-41d8-8ade-8218042f90e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:03.706811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed80af6-629e-41d8-8ade-8218042f90e7 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:03.707039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed80af6-629e-41d8-8ade-8218042f90e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:03.707310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed80af6-629e-41d8-8ade-8218042f90e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:03.707938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed80af6-629e-41d8-8ade-8218042f90e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:03.718655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed80af6-629e-41d8-8ade-8218042f90e7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:03.783709 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3259/6520] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:18:03 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:03.785022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1bd09-f11b-4f17-9d28-d43cafcba611 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:03.807104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1bd09-f11b-4f17-9d28-d43cafcba611 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:03.833442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:03.848179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed80af6-629e-41d8-8ade-8218042f90e7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:03.850564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7ed80af6-629e-41d8-8ade-8218042f90e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:03.959745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed80af6-629e-41d8-8ade-8218042f90e7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:03.966706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:03.968376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:03.968791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:03.969161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] PATH_INFO: `/v3/projects/53bca313139748f5bb1ac87e3406c094` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:03.971502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53bca313139748f5bb1ac87e3406c094)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:03.974402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:03.988418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54799a44-1751-419a-85d8-e16753dd4765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:03.989579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799a44-1751-419a-85d8-e16753dd4765 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:03.990520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799a44-1751-419a-85d8-e16753dd4765 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:03.991420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799a44-1751-419a-85d8-e16753dd4765 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:03.992252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54799a44-1751-419a-85d8-e16753dd4765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:03.996166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54799a44-1751-419a-85d8-e16753dd4765 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:04.051480 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3262/6521] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:18:03 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:04.058555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54799a44-1751-419a-85d8-e16753dd4765 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:04.077501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54799a44-1751-419a-85d8-e16753dd4765 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:04.080152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53bca313139748f5bb1ac87e3406c094', 'request_id': 'req-8ed9709f-0bb5-4076-98c7-04ac930b131d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:04.097822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53bca313139748f5bb1ac87e3406c094', 'request_id': 'req-8ed9709f-0bb5-4076-98c7-04ac930b131d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:04.112976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53bca313139748f5bb1ac87e3406c094', 'request_id': 'req-8ed9709f-0bb5-4076-98c7-04ac930b131d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:04.131551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] The token cache is being invalidate because project 53bca313139748f5bb1ac87e3406c094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:18:04.131917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:04.132662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:04.139229 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3260/6522] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:03 2022] DELETE /identity/v3/projects/53bca313139748f5bb1ac87e3406c094 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:04.140029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:04.141596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:04.195334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:04.218071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d26e2-91cc-40e3-98ad-10681ec8b903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:04.218969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d26e2-91cc-40e3-98ad-10681ec8b903 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:04.219479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d26e2-91cc-40e3-98ad-10681ec8b903 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:04.220252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d26e2-91cc-40e3-98ad-10681ec8b903 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:04.220670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d26e2-91cc-40e3-98ad-10681ec8b903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:04.223284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d26e2-91cc-40e3-98ad-10681ec8b903 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:04.240929 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3263/6523] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:04.243786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d26e2-91cc-40e3-98ad-10681ec8b903 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:04.245760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-698d26e2-91cc-40e3-98ad-10681ec8b903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:04.260430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9709f-0bb5-4076-98c7-04ac930b131d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:04.269002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d26e2-91cc-40e3-98ad-10681ec8b903 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:04.269829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:04.270609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:04.270898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:04.271179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] PATH_INFO: `/v3/users/e5b94e59922f4dcbbeca1a04f199b1c0` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:04.272706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b94e59922f4dcbbeca1a04f199b1c0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:04.274589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aaacb-329b-451d-a560-e774caf24bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:04.275346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aaacb-329b-451d-a560-e774caf24bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:04.275473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:04.275639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aaacb-329b-451d-a560-e774caf24bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:04.275894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aaacb-329b-451d-a560-e774caf24bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:04.276875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5aaacb-329b-451d-a560-e774caf24bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:04.278537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5aaacb-329b-451d-a560-e774caf24bd5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:04.295669 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3264/6524] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:04.296671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aaacb-329b-451d-a560-e774caf24bd5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:04.311786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aaacb-329b-451d-a560-e774caf24bd5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:04.316988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05661fc1-4aae-4b36-bf39-1d89135707c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:04.317694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05661fc1-4aae-4b36-bf39-1d89135707c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:04.317973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05661fc1-4aae-4b36-bf39-1d89135707c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:04.318253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05661fc1-4aae-4b36-bf39-1d89135707c3 admin admin] PATH_INFO: `/v3/projects/737c51c29cb341e0b188261dd84b17aa/users/5bd104847f15459d825cf91ffb192b3f/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:04.345456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05661fc1-4aae-4b36-bf39-1d89135707c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=737c51c29cb341e0b188261dd84b17aa, user_id=5bd104847f15459d825cf91ffb192b3f, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:04.348407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05661fc1-4aae-4b36-bf39-1d89135707c3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:04.378035 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3265/6525] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:04 2022] PUT /identity/v3/projects/737c51c29cb341e0b188261dd84b17aa/users/5bd104847f15459d825cf91ffb192b3f/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:04.394838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f698c-f652-42a8-be69-7a4aee320268 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:04.394838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f698c-f652-42a8-be69-7a4aee320268 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:04.395752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f698c-f652-42a8-be69-7a4aee320268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:04.400282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b94e59922f4dcbbeca1a04f199b1c0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:04.415640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b94e59922f4dcbbeca1a04f199b1c0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:04.416639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b94e59922f4dcbbeca1a04f199b1c0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:04.421775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b94e59922f4dcbbeca1a04f199b1c0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:04.451506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b94e59922f4dcbbeca1a04f199b1c0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:04.451809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ef2f698c-f652-42a8-be69-7a4aee320268 None None] MFA Rules not processed for user `5bd104847f15459d825cf91ffb192b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:04.453363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ef2f698c-f652-42a8-be69-7a4aee320268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:04.505521 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3261/6526] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:04 2022] DELETE /identity/v3/users/e5b94e59922f4dcbbeca1a04f199b1c0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:04.600009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:04.620154 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3266/6527] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:18:04.642881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:04.644550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:04.722682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f65b0-3001-471e-a8ab-d1cd0719b1ba admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:04.727685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375ba2-1f8a-408e-b1b2-edf0ed83d882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:04.728408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375ba2-1f8a-408e-b1b2-edf0ed83d882 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:04.729406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375ba2-1f8a-408e-b1b2-edf0ed83d882 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:04.729791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375ba2-1f8a-408e-b1b2-edf0ed83d882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:04.838219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10375ba2-1f8a-408e-b1b2-edf0ed83d882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:04.839673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10375ba2-1f8a-408e-b1b2-edf0ed83d882 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:04.862609 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3262/6528] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:04.899132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f698c-f652-42a8-be69-7a4aee320268 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:04.901883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ef2f698c-f652-42a8-be69-7a4aee320268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:05.002403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f698c-f652-42a8-be69-7a4aee320268 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:05.131851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea63fc-4f9a-4e9e-ab8b-ee84f8a758f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:05.133617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea63fc-4f9a-4e9e-ab8b-ee84f8a758f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:05.134131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea63fc-4f9a-4e9e-ab8b-ee84f8a758f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:05.134608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea63fc-4f9a-4e9e-ab8b-ee84f8a758f6 admin admin] PATH_INFO: `/v3/users/5bd104847f15459d825cf91ffb192b3f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:05.136089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea63fc-4f9a-4e9e-ab8b-ee84f8a758f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd104847f15459d825cf91ffb192b3f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:05.139157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea63fc-4f9a-4e9e-ab8b-ee84f8a758f6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:05.229569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ecea63fc-4f9a-4e9e-ab8b-ee84f8a758f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd104847f15459d825cf91ffb192b3f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:05.240009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375ba2-1f8a-408e-b1b2-edf0ed83d882 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:05.243601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-10375ba2-1f8a-408e-b1b2-edf0ed83d882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:05.247130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ecea63fc-4f9a-4e9e-ab8b-ee84f8a758f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd104847f15459d825cf91ffb192b3f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:05.248645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ecea63fc-4f9a-4e9e-ab8b-ee84f8a758f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd104847f15459d825cf91ffb192b3f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:05.249541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ecea63fc-4f9a-4e9e-ab8b-ee84f8a758f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd104847f15459d825cf91ffb192b3f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:05.270635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375ba2-1f8a-408e-b1b2-edf0ed83d882 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:05.277249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:05.278002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:05.278354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:05.278702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a admin admin] PATH_INFO: `/v3/projects/3b95c3d79c154a179d68517024f6b81d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:05.279942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ecea63fc-4f9a-4e9e-ab8b-ee84f8a758f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd104847f15459d825cf91ffb192b3f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:05.281352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b95c3d79c154a179d68517024f6b81d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:05.283514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:05.295540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:05.310935 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3267/6529] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:04 2022] DELETE /identity/v3/users/5bd104847f15459d825cf91ffb192b3f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:05.311538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff222f-0c45-4c96-8106-fbba85b3be65 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:05.312409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff222f-0c45-4c96-8106-fbba85b3be65 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:05.312409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff222f-0c45-4c96-8106-fbba85b3be65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:05.346334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-68ff222f-0c45-4c96-8106-fbba85b3be65 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:05.348339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-68ff222f-0c45-4c96-8106-fbba85b3be65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:05.371720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:05.405314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b95c3d79c154a179d68517024f6b81d', 'request_id': 'req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:05.427129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b95c3d79c154a179d68517024f6b81d', 'request_id': 'req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:05.432026 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3268/6530] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:05.439170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b95c3d79c154a179d68517024f6b81d', 'request_id': 'req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:05.455503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a admin admin] The token cache is being invalidate because project 3b95c3d79c154a179d68517024f6b81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:18:05.455735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff222f-0c45-4c96-8106-fbba85b3be65 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:05.457107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:05.457431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-68ff222f-0c45-4c96-8106-fbba85b3be65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:05.458969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3b49c788-6be2-4a62-8f49-3f1bd1a1639a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:05.461512 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3263/6531] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:05 2022] DELETE /identity/v3/projects/3b95c3d79c154a179d68517024f6b81d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:05.468630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b48576-b5e0-4094-9f99-ec0b7c32376c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:05.469419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b48576-b5e0-4094-9f99-ec0b7c32376c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:05.469957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b48576-b5e0-4094-9f99-ec0b7c32376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:05.498922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f5b48576-b5e0-4094-9f99-ec0b7c32376c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:05.500973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f5b48576-b5e0-4094-9f99-ec0b7c32376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:05.581013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff222f-0c45-4c96-8106-fbba85b3be65 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:05.643940 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3264/6532] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:05.645603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec1ebf-cd43-4833-9a2d-29a73841768a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:05.645896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec1ebf-cd43-4833-9a2d-29a73841768a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:05.646177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec1ebf-cd43-4833-9a2d-29a73841768a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:05.670538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c85a23-ee25-40c7-86ac-0ce0deba7e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:05.671119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c85a23-ee25-40c7-86ac-0ce0deba7e0f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:05.671204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bdec1ebf-cd43-4833-9a2d-29a73841768a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:05.671283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c85a23-ee25-40c7-86ac-0ce0deba7e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:05.671355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c85a23-ee25-40c7-86ac-0ce0deba7e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:05.672085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bdec1ebf-cd43-4833-9a2d-29a73841768a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:05.673742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e8c85a23-ee25-40c7-86ac-0ce0deba7e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:05.687024 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3265/6533] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:05.688681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c85a23-ee25-40c7-86ac-0ce0deba7e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:05.690479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c85a23-ee25-40c7-86ac-0ce0deba7e0f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:05.691340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec1ebf-cd43-4833-9a2d-29a73841768a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:05.702629 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3269/6534] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:05.703251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec1ebf-cd43-4833-9a2d-29a73841768a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:05.710024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faa7e1-6dea-4153-8309-4eabca7716da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:05.713456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faa7e1-6dea-4153-8309-4eabca7716da admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:05.713746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faa7e1-6dea-4153-8309-4eabca7716da admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:05.714026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faa7e1-6dea-4153-8309-4eabca7716da admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:05.714702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faa7e1-6dea-4153-8309-4eabca7716da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:18:05.715511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faa7e1-6dea-4153-8309-4eabca7716da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:05.717267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faa7e1-6dea-4153-8309-4eabca7716da admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:05.740675 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3266/6535] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:18:05.741928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c85a23-ee25-40c7-86ac-0ce0deba7e0f service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:05.760487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c85a23-ee25-40c7-86ac-0ce0deba7e0f service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:05.772299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ecef0-8b50-42f4-9cc4-8ed45e0ea903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:05.773051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ecef0-8b50-42f4-9cc4-8ed45e0ea903 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:05.773496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ecef0-8b50-42f4-9cc4-8ed45e0ea903 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:05.773879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ecef0-8b50-42f4-9cc4-8ed45e0ea903 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:05.774624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ecef0-8b50-42f4-9cc4-8ed45e0ea903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:05.777296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ecef0-8b50-42f4-9cc4-8ed45e0ea903 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:05.821367 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3270/6536] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:18:05 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:18:05.824010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faa7e1-6dea-4153-8309-4eabca7716da admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:05.839827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faa7e1-6dea-4153-8309-4eabca7716da admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:05.958970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3971ad-9e1a-468d-83f1-9d7a4669ee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:05.959797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3971ad-9e1a-468d-83f1-9d7a4669ee6f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:05.960702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3971ad-9e1a-468d-83f1-9d7a4669ee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:05.961128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3971ad-9e1a-468d-83f1-9d7a4669ee6f admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:05.961892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3971ad-9e1a-468d-83f1-9d7a4669ee6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:05.964362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3971ad-9e1a-468d-83f1-9d7a4669ee6f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:05.998819 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3267/6537] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:18:05 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:18:05.999352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ecef0-8b50-42f4-9cc4-8ed45e0ea903 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:06.011448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ecef0-8b50-42f4-9cc4-8ed45e0ea903 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:06.017523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d132e85-05ac-4b17-9af4-23e94fdace00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:06.018192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d132e85-05ac-4b17-9af4-23e94fdace00 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:06.018617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d132e85-05ac-4b17-9af4-23e94fdace00 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:06.018902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d132e85-05ac-4b17-9af4-23e94fdace00 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:06.020448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d132e85-05ac-4b17-9af4-23e94fdace00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:06.023553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d132e85-05ac-4b17-9af4-23e94fdace00 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:06.037958 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3271/6538] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:18:06.042940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3971ad-9e1a-468d-83f1-9d7a4669ee6f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:06.061228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:06.071196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3971ad-9e1a-468d-83f1-9d7a4669ee6f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:06.084595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24ad0b-4d81-43f7-a2ea-653096b3f19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:06.085516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24ad0b-4d81-43f7-a2ea-653096b3f19e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:06.085902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24ad0b-4d81-43f7-a2ea-653096b3f19e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:06.086285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24ad0b-4d81-43f7-a2ea-653096b3f19e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:06.111598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24ad0b-4d81-43f7-a2ea-653096b3f19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:06.114136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24ad0b-4d81-43f7-a2ea-653096b3f19e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:06.133551 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3268/6539] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:06.134339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d132e85-05ac-4b17-9af4-23e94fdace00 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:06.149275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d132e85-05ac-4b17-9af4-23e94fdace00 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:06.155583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0123247-7b8c-4853-8527-d9ad8fba7859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:06.156271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0123247-7b8c-4853-8527-d9ad8fba7859 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:06.156551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0123247-7b8c-4853-8527-d9ad8fba7859 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:06.156826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0123247-7b8c-4853-8527-d9ad8fba7859 admin admin] PATH_INFO: `/v3/projects/a6be7867bc474ab3891f0fca5c672906/users/30b9b4baf6294cec96bb5c4a38359036/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:06.174556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0123247-7b8c-4853-8527-d9ad8fba7859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6be7867bc474ab3891f0fca5c672906, user_id=30b9b4baf6294cec96bb5c4a38359036, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:06.177406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0123247-7b8c-4853-8527-d9ad8fba7859 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:06.196516 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3272/6540] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:06 2022] PUT /identity/v3/projects/a6be7867bc474ab3891f0fca5c672906/users/30b9b4baf6294cec96bb5c4a38359036/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:06.207976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f10f7-d4aa-49a8-b7fe-5048fd34d211 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:06.208260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f10f7-d4aa-49a8-b7fe-5048fd34d211 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:06.208541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f10f7-d4aa-49a8-b7fe-5048fd34d211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:06.244087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bf4f10f7-d4aa-49a8-b7fe-5048fd34d211 None None] MFA Rules not processed for user `30b9b4baf6294cec96bb5c4a38359036`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:06.245377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bf4f10f7-d4aa-49a8-b7fe-5048fd34d211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:06.343949 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3269/6541] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:06.355840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0123247-7b8c-4853-8527-d9ad8fba7859 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:06.358737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b0123247-7b8c-4853-8527-d9ad8fba7859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:06.397070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:06.434811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0123247-7b8c-4853-8527-d9ad8fba7859 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:06.439706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c675549-12f9-4663-8165-5cf624267d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:06.440813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c675549-12f9-4663-8165-5cf624267d99 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:06.440813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c675549-12f9-4663-8165-5cf624267d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:06.441017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c675549-12f9-4663-8165-5cf624267d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:06.451202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c675549-12f9-4663-8165-5cf624267d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:06.453417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c675549-12f9-4663-8165-5cf624267d99 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:06.463569 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3273/6542] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:06.494252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f10f7-d4aa-49a8-b7fe-5048fd34d211 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:06.596117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f10f7-d4aa-49a8-b7fe-5048fd34d211 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:06.604948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73959054-4003-44de-95cf-d260ca0e6b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:06.605916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959054-4003-44de-95cf-d260ca0e6b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:06.610017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959054-4003-44de-95cf-d260ca0e6b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:06.610496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959054-4003-44de-95cf-d260ca0e6b9c admin admin] PATH_INFO: `/v3/users/30b9b4baf6294cec96bb5c4a38359036` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:06.613087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73959054-4003-44de-95cf-d260ca0e6b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b9b4baf6294cec96bb5c4a38359036)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:06.615278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73959054-4003-44de-95cf-d260ca0e6b9c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:06.692304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-73959054-4003-44de-95cf-d260ca0e6b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b9b4baf6294cec96bb5c4a38359036'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:06.704168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-73959054-4003-44de-95cf-d260ca0e6b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b9b4baf6294cec96bb5c4a38359036'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:06.704929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-73959054-4003-44de-95cf-d260ca0e6b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b9b4baf6294cec96bb5c4a38359036'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:06.705576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-73959054-4003-44de-95cf-d260ca0e6b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b9b4baf6294cec96bb5c4a38359036'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:06.710695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c675549-12f9-4663-8165-5cf624267d99 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:06.712156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9c675549-12f9-4663-8165-5cf624267d99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:06.727725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c675549-12f9-4663-8165-5cf624267d99 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:06.733648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-73959054-4003-44de-95cf-d260ca0e6b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b9b4baf6294cec96bb5c4a38359036'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:06.734207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656e596-0b9c-4d75-9a40-61b8044fcc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:06.735080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e596-0b9c-4d75-9a40-61b8044fcc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:06.735600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e596-0b9c-4d75-9a40-61b8044fcc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:06.736415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e596-0b9c-4d75-9a40-61b8044fcc60 admin admin] PATH_INFO: `/v3/projects/737c51c29cb341e0b188261dd84b17aa` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:06.737922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656e596-0b9c-4d75-9a40-61b8044fcc60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=737c51c29cb341e0b188261dd84b17aa)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:06.740513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656e596-0b9c-4d75-9a40-61b8044fcc60 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:06.751557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:06.758909 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3270/6543] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:06 2022] DELETE /identity/v3/users/30b9b4baf6294cec96bb5c4a38359036 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:06.764501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7e827-6b16-4816-b1f1-b1dd9cc518c7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:06.764951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7e827-6b16-4816-b1f1-b1dd9cc518c7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:06.765482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7e827-6b16-4816-b1f1-b1dd9cc518c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:06.790481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-66d7e827-6b16-4816-b1f1-b1dd9cc518c7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:06.793268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-66d7e827-6b16-4816-b1f1-b1dd9cc518c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:06.836479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f656e596-0b9c-4d75-9a40-61b8044fcc60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737c51c29cb341e0b188261dd84b17aa', 'request_id': 'req-f656e596-0b9c-4d75-9a40-61b8044fcc60'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:06.852334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f656e596-0b9c-4d75-9a40-61b8044fcc60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737c51c29cb341e0b188261dd84b17aa', 'request_id': 'req-f656e596-0b9c-4d75-9a40-61b8044fcc60'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:06.863916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f656e596-0b9c-4d75-9a40-61b8044fcc60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737c51c29cb341e0b188261dd84b17aa', 'request_id': 'req-f656e596-0b9c-4d75-9a40-61b8044fcc60'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:06.884847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f656e596-0b9c-4d75-9a40-61b8044fcc60 admin admin] The token cache is being invalidate because project 737c51c29cb341e0b188261dd84b17aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:18:06.884847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f656e596-0b9c-4d75-9a40-61b8044fcc60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:06.884847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f656e596-0b9c-4d75-9a40-61b8044fcc60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:06.886354 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3271/6544] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:18:06.890881 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3274/6545] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:06 2022] DELETE /identity/v3/projects/737c51c29cb341e0b188261dd84b17aa => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:06.895053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7e827-6b16-4816-b1f1-b1dd9cc518c7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:06.897429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-66d7e827-6b16-4816-b1f1-b1dd9cc518c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:06.898810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e53f40-5fa1-4e3b-958e-3d9cdc34808b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:06.899811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e53f40-5fa1-4e3b-958e-3d9cdc34808b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:06.900202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e53f40-5fa1-4e3b-958e-3d9cdc34808b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:06.929172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d4e53f40-5fa1-4e3b-958e-3d9cdc34808b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:06.930561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d4e53f40-5fa1-4e3b-958e-3d9cdc34808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:06.972333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7e827-6b16-4816-b1f1-b1dd9cc518c7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:07.025600 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3275/6546] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:07.034001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a22f9-ebfb-423f-a901-f71d3e240ddc None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:07.035300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a22f9-ebfb-423f-a901-f71d3e240ddc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:07.035808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a22f9-ebfb-423f-a901-f71d3e240ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:07.042027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff9980-5861-4f71-b185-fd423c633642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:07.042779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff9980-5861-4f71-b185-fd423c633642 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:07.043140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff9980-5861-4f71-b185-fd423c633642 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:07.043493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff9980-5861-4f71-b185-fd423c633642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:07.046392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fbff9980-5861-4f71-b185-fd423c633642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:07.064935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-316a22f9-ebfb-423f-a901-f71d3e240ddc None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:07.065147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff9980-5861-4f71-b185-fd423c633642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:07.066349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-316a22f9-ebfb-423f-a901-f71d3e240ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:07.066865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff9980-5861-4f71-b185-fd423c633642 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:07.077901 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3272/6547] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:18:07.091319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff9980-5861-4f71-b185-fd423c633642 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:07.091691 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3276/6548] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:18:07.104032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff9980-5861-4f71-b185-fd423c633642 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:07.110637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e392c-a359-4d40-a86a-2cd728b8e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:07.111265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e392c-a359-4d40-a86a-2cd728b8e922 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:07.112098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e392c-a359-4d40-a86a-2cd728b8e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:07.112383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e392c-a359-4d40-a86a-2cd728b8e922 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:07.113103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e392c-a359-4d40-a86a-2cd728b8e922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:18:07.113447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e392c-a359-4d40-a86a-2cd728b8e922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:07.115178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e392c-a359-4d40-a86a-2cd728b8e922 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:07.131304 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3273/6549] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:18:07.135954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a22f9-ebfb-423f-a901-f71d3e240ddc None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:07.150639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a22f9-ebfb-423f-a901-f71d3e240ddc None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:07.156525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa385a-b9d2-4c2f-b4cc-e3f0201503a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:07.157125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa385a-b9d2-4c2f-b4cc-e3f0201503a0 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:07.157586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa385a-b9d2-4c2f-b4cc-e3f0201503a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:07.158007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa385a-b9d2-4c2f-b4cc-e3f0201503a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:07.158729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa385a-b9d2-4c2f-b4cc-e3f0201503a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:07.160983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa385a-b9d2-4c2f-b4cc-e3f0201503a0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:07.192864 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3277/6550] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:18:07 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:07.197136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e392c-a359-4d40-a86a-2cd728b8e922 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:07.207841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e392c-a359-4d40-a86a-2cd728b8e922 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:07.268393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:07.283497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b9f94-6f53-4a0f-bd0c-6304d4720ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:07.284447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b9f94-6f53-4a0f-bd0c-6304d4720ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:07.284678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b9f94-6f53-4a0f-bd0c-6304d4720ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:07.284913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b9f94-6f53-4a0f-bd0c-6304d4720ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:07.285675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b9f94-6f53-4a0f-bd0c-6304d4720ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:07.287677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b9f94-6f53-4a0f-bd0c-6304d4720ae2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:07.317438 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3274/6551] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:18:07 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:07.319332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa385a-b9d2-4c2f-b4cc-e3f0201503a0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:07.332457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa385a-b9d2-4c2f-b4cc-e3f0201503a0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:07.344366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e964c7d-62db-41c7-a752-dbdb23d4aa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:07.345094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e964c7d-62db-41c7-a752-dbdb23d4aa86 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:07.345499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e964c7d-62db-41c7-a752-dbdb23d4aa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:07.345847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e964c7d-62db-41c7-a752-dbdb23d4aa86 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:07.346558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e964c7d-62db-41c7-a752-dbdb23d4aa86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:07.348227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e964c7d-62db-41c7-a752-dbdb23d4aa86 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:07.360178 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3278/6552] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:07.364323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b9f94-6f53-4a0f-bd0c-6304d4720ae2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:07.376256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b9f94-6f53-4a0f-bd0c-6304d4720ae2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:07.382237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9abefd-484e-4ece-a3ec-fec1e85a513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:07.382955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9abefd-484e-4ece-a3ec-fec1e85a513f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:07.383303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9abefd-484e-4ece-a3ec-fec1e85a513f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:07.383648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9abefd-484e-4ece-a3ec-fec1e85a513f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:07.384355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9abefd-484e-4ece-a3ec-fec1e85a513f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:07.386137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9abefd-484e-4ece-a3ec-fec1e85a513f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:07.401272 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3275/6553] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:07.401709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e964c7d-62db-41c7-a752-dbdb23d4aa86 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:07.413438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e964c7d-62db-41c7-a752-dbdb23d4aa86 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:07.418351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54111b76-ac33-4def-9b09-6c7972c7d081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:07.419239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111b76-ac33-4def-9b09-6c7972c7d081 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:07.420151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111b76-ac33-4def-9b09-6c7972c7d081 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:07.420493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111b76-ac33-4def-9b09-6c7972c7d081 admin admin] PATH_INFO: `/v3/projects/a6e1abce050a4cbcaf6f838d4abfa728/users/c82cfdffdac24d0ba847681ad82a2928/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:07.432284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:07.438591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54111b76-ac33-4def-9b09-6c7972c7d081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e1abce050a4cbcaf6f838d4abfa728, user_id=c82cfdffdac24d0ba847681ad82a2928, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:07.443476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54111b76-ac33-4def-9b09-6c7972c7d081 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:07.464024 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3279/6554] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:07 2022] PUT /identity/v3/projects/a6e1abce050a4cbcaf6f838d4abfa728/users/c82cfdffdac24d0ba847681ad82a2928/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:07.474740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb8231-5a72-4c0f-885f-2e853f4d4145 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:07.475031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb8231-5a72-4c0f-885f-2e853f4d4145 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:07.475301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb8231-5a72-4c0f-885f-2e853f4d4145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:07.514981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cacb8231-5a72-4c0f-885f-2e853f4d4145 None None] MFA Rules not processed for user `c82cfdffdac24d0ba847681ad82a2928`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:07.516916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cacb8231-5a72-4c0f-885f-2e853f4d4145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:07.604809 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3276/6555] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:07.610011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54111b76-ac33-4def-9b09-6c7972c7d081 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:07.712395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54111b76-ac33-4def-9b09-6c7972c7d081 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:07.718206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25438160-11ec-48d5-a236-997946fbdcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:07.719911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25438160-11ec-48d5-a236-997946fbdcf6 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:07.719911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25438160-11ec-48d5-a236-997946fbdcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:07.719911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25438160-11ec-48d5-a236-997946fbdcf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:07.720327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25438160-11ec-48d5-a236-997946fbdcf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:07.722870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25438160-11ec-48d5-a236-997946fbdcf6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:07.752482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb8231-5a72-4c0f-885f-2e853f4d4145 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:07.753983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cacb8231-5a72-4c0f-885f-2e853f4d4145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:07.765375 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3280/6556] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:18:07 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:07.769280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25438160-11ec-48d5-a236-997946fbdcf6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:07.771147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb8231-5a72-4c0f-885f-2e853f4d4145 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:07.839781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf484dd-fb48-457b-8184-4eeb45318c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:07.840246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf484dd-fb48-457b-8184-4eeb45318c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:07.840700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf484dd-fb48-457b-8184-4eeb45318c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:07.841161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf484dd-fb48-457b-8184-4eeb45318c0a admin admin] PATH_INFO: `/v3/projects/a6be7867bc474ab3891f0fca5c672906` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:07.842930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf484dd-fb48-457b-8184-4eeb45318c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6be7867bc474ab3891f0fca5c672906)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:07.845439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf484dd-fb48-457b-8184-4eeb45318c0a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:07.873884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25438160-11ec-48d5-a236-997946fbdcf6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:07.881853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1c179-3675-4529-b8f9-ba16911399af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:07.882804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1c179-3675-4529-b8f9-ba16911399af admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:07.883607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1c179-3675-4529-b8f9-ba16911399af admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:07.883607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1c179-3675-4529-b8f9-ba16911399af admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:07.884544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1c179-3675-4529-b8f9-ba16911399af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:07.887842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1c179-3675-4529-b8f9-ba16911399af admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:07.915088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-edf484dd-fb48-457b-8184-4eeb45318c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6be7867bc474ab3891f0fca5c672906', 'request_id': 'req-edf484dd-fb48-457b-8184-4eeb45318c0a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:07.923005 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3281/6557] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:18:07 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:07.926715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-edf484dd-fb48-457b-8184-4eeb45318c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6be7867bc474ab3891f0fca5c672906', 'request_id': 'req-edf484dd-fb48-457b-8184-4eeb45318c0a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:07.927452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1c179-3675-4529-b8f9-ba16911399af admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:07.928453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:07.936195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-edf484dd-fb48-457b-8184-4eeb45318c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6be7867bc474ab3891f0fca5c672906', 'request_id': 'req-edf484dd-fb48-457b-8184-4eeb45318c0a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:07.945336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1c179-3675-4529-b8f9-ba16911399af admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:07.975489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-edf484dd-fb48-457b-8184-4eeb45318c0a admin admin] The token cache is being invalidate because project a6be7867bc474ab3891f0fca5c672906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:18:07.975711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-edf484dd-fb48-457b-8184-4eeb45318c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:07.976491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-edf484dd-fb48-457b-8184-4eeb45318c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:07.985668 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3277/6558] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:07 2022] DELETE /identity/v3/projects/a6be7867bc474ab3891f0fca5c672906 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:07.989403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e30c5-a628-4a94-8599-a3ab41feb615 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:07.989691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e30c5-a628-4a94-8599-a3ab41feb615 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:07.989970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e30c5-a628-4a94-8599-a3ab41feb615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.013001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f1c7a-c65e-4bd0-a2b3-9e04b4edc36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:08.014847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f1c7a-c65e-4bd0-a2b3-9e04b4edc36a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.015232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f1c7a-c65e-4bd0-a2b3-9e04b4edc36a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.015349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a80e30c5-a628-4a94-8599-a3ab41feb615 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:08.015685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f1c7a-c65e-4bd0-a2b3-9e04b4edc36a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.016436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f1c7a-c65e-4bd0-a2b3-9e04b4edc36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:08.017148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a80e30c5-a628-4a94-8599-a3ab41feb615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:08.018370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f1c7a-c65e-4bd0-a2b3-9e04b4edc36a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:08.024350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:08.035890 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3282/6559] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:08.036301 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3278/6560] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:08.037962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f1c7a-c65e-4bd0-a2b3-9e04b4edc36a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:08.039026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee0fbc-95e3-4b68-8868-dec1bab00710 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.039308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee0fbc-95e3-4b68-8868-dec1bab00710 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.039587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee0fbc-95e3-4b68-8868-dec1bab00710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.041523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d05f1c7a-c65e-4bd0-a2b3-9e04b4edc36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:08.061853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f1c7a-c65e-4bd0-a2b3-9e04b4edc36a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:08.063253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e5ee0fbc-95e3-4b68-8868-dec1bab00710 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:08.064570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e5ee0fbc-95e3-4b68-8868-dec1bab00710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:08.067905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6cb99-ea95-4145-9d86-2ed0364d3b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:08.068911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6cb99-ea95-4145-9d86-2ed0364d3b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.069713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6cb99-ea95-4145-9d86-2ed0364d3b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.070200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6cb99-ea95-4145-9d86-2ed0364d3b4f admin admin] PATH_INFO: `/v3/projects/63ccbc7631cf498daa8457f57c927f55/users/b9727463ad0344ec99ed235d3f9598f6/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.077169 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3279/6561] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:08.082894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee0fbc-95e3-4b68-8868-dec1bab00710 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:08.088150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6cb99-ea95-4145-9d86-2ed0364d3b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ccbc7631cf498daa8457f57c927f55, user_id=b9727463ad0344ec99ed235d3f9598f6, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:08.091748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6cb99-ea95-4145-9d86-2ed0364d3b4f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:08.095102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee0fbc-95e3-4b68-8868-dec1bab00710 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:08.103890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ed79c-596f-405c-a024-1ff013c6fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:08.104554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ed79c-596f-405c-a024-1ff013c6fad5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.104804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ed79c-596f-405c-a024-1ff013c6fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.105080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ed79c-596f-405c-a024-1ff013c6fad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.105766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ed79c-596f-405c-a024-1ff013c6fad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:18:08.106075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ed79c-596f-405c-a024-1ff013c6fad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:08.107928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ed79c-596f-405c-a024-1ff013c6fad5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:08.117875 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3283/6562] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:08 2022] PUT /identity/v3/projects/63ccbc7631cf498daa8457f57c927f55/users/b9727463ad0344ec99ed235d3f9598f6/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:08.121631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6cb99-ea95-4145-9d86-2ed0364d3b4f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:08.125367 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3280/6563] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:18:08.126257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ed79c-596f-405c-a024-1ff013c6fad5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:08.137764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ed79c-596f-405c-a024-1ff013c6fad5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:08.203453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6cb99-ea95-4145-9d86-2ed0364d3b4f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:08.211287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0f580-2b15-4cc0-85c5-0d5e466de8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:08.211916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0f580-2b15-4cc0-85c5-0d5e466de8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.212200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0f580-2b15-4cc0-85c5-0d5e466de8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.212579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0f580-2b15-4cc0-85c5-0d5e466de8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.213595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0f580-2b15-4cc0-85c5-0d5e466de8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:08.216141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0f580-2b15-4cc0-85c5-0d5e466de8c3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:08.236092 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3284/6564] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:08.237247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0f580-2b15-4cc0-85c5-0d5e466de8c3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:08.239403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f0e44-b708-4dfd-b23b-1dc6ee765db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:08.240211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f0e44-b708-4dfd-b23b-1dc6ee765db1 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.240773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f0e44-b708-4dfd-b23b-1dc6ee765db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.241285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f0e44-b708-4dfd-b23b-1dc6ee765db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.242216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f0e44-b708-4dfd-b23b-1dc6ee765db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:08.245651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f0e44-b708-4dfd-b23b-1dc6ee765db1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:08.251243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0f580-2b15-4cc0-85c5-0d5e466de8c3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:08.258933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028334c-be14-463c-914e-42019ac056b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:08.259673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028334c-be14-463c-914e-42019ac056b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.260577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028334c-be14-463c-914e-42019ac056b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.260898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028334c-be14-463c-914e-42019ac056b1 admin admin] PATH_INFO: `/v3/projects/63ccbc7631cf498daa8457f57c927f55/users/b9727463ad0344ec99ed235d3f9598f6/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.263242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028334c-be14-463c-914e-42019ac056b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ccbc7631cf498daa8457f57c927f55, user_id=b9727463ad0344ec99ed235d3f9598f6, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:08.267139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028334c-be14-463c-914e-42019ac056b1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:08.290861 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3285/6565] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:08 2022] PUT /identity/v3/projects/63ccbc7631cf498daa8457f57c927f55/users/b9727463ad0344ec99ed235d3f9598f6/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:18:08.293445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdcfa8-ef82-4194-873f-50e50d539e5e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.294538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdcfa8-ef82-4194-873f-50e50d539e5e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.295058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdcfa8-ef82-4194-873f-50e50d539e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.302587 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3281/6566] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:18:08 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:08.303563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f0e44-b708-4dfd-b23b-1dc6ee765db1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:08.330681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f6bdcfa8-ef82-4194-873f-50e50d539e5e None None] MFA Rules not processed for user `b9727463ad0344ec99ed235d3f9598f6`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:08.332563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f6bdcfa8-ef82-4194-873f-50e50d539e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:08.387180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f0e44-b708-4dfd-b23b-1dc6ee765db1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:08.395870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec338e-9ef7-4de7-af0c-bf65bc1b3253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:08.397055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec338e-9ef7-4de7-af0c-bf65bc1b3253 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.402452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec338e-9ef7-4de7-af0c-bf65bc1b3253 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.402930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec338e-9ef7-4de7-af0c-bf65bc1b3253 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.404211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec338e-9ef7-4de7-af0c-bf65bc1b3253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:08.406508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec338e-9ef7-4de7-af0c-bf65bc1b3253 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:08.430119 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3282/6567] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:18:08 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:08.433719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec338e-9ef7-4de7-af0c-bf65bc1b3253 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:08.441766 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3286/6568] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:18:08.450263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec338e-9ef7-4de7-af0c-bf65bc1b3253 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:08.451515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdcfa8-ef82-4194-873f-50e50d539e5e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:08.453272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f6bdcfa8-ef82-4194-873f-50e50d539e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:08.457101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a080c8-1d4e-4929-b61a-30ab1f7bba59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:08.457862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a080c8-1d4e-4929-b61a-30ab1f7bba59 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.458242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a080c8-1d4e-4929-b61a-30ab1f7bba59 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.458623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a080c8-1d4e-4929-b61a-30ab1f7bba59 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.459453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a080c8-1d4e-4929-b61a-30ab1f7bba59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:08.469905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a080c8-1d4e-4929-b61a-30ab1f7bba59 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:08.499038 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3283/6569] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:18:08.503432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a080c8-1d4e-4929-b61a-30ab1f7bba59 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:08.515716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a080c8-1d4e-4929-b61a-30ab1f7bba59 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:08.523189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e5900-73da-4cf3-9987-42ca669716c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:08.524055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e5900-73da-4cf3-9987-42ca669716c1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.524507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e5900-73da-4cf3-9987-42ca669716c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.525816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e5900-73da-4cf3-9987-42ca669716c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.526761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e5900-73da-4cf3-9987-42ca669716c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:08.530229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e5900-73da-4cf3-9987-42ca669716c1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:08.550253 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3284/6570] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:18:08.554025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e5900-73da-4cf3-9987-42ca669716c1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:08.570065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:08.571846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e5900-73da-4cf3-9987-42ca669716c1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:08.582124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afef77-e41d-43e2-b760-64122f58631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:08.584490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afef77-e41d-43e2-b760-64122f58631e admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.584490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afef77-e41d-43e2-b760-64122f58631e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.584490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afef77-e41d-43e2-b760-64122f58631e admin admin] PATH_INFO: `/v3/projects/9e8fbf829e45416b8d40ff3a9e512fe8/users/0405dc39ca524c87ae5a99db8d85e615/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.591467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdcfa8-ef82-4194-873f-50e50d539e5e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:08.596345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc027b-18e0-4bbe-8931-48e4c50329b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:08.597437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc027b-18e0-4bbe-8931-48e4c50329b1 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.597952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc027b-18e0-4bbe-8931-48e4c50329b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.598478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:08.599748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc027b-18e0-4bbe-8931-48e4c50329b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.611776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afef77-e41d-43e2-b760-64122f58631e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8fbf829e45416b8d40ff3a9e512fe8, user_id=0405dc39ca524c87ae5a99db8d85e615, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:08.618514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc027b-18e0-4bbe-8931-48e4c50329b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:08.619565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afef77-e41d-43e2-b760-64122f58631e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:08.621709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc027b-18e0-4bbe-8931-48e4c50329b1 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:08.640921 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3285/6571] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:08 2022] PUT /identity/v3/projects/9e8fbf829e45416b8d40ff3a9e512fe8/users/0405dc39ca524c87ae5a99db8d85e615/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:18:08.641355 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3287/6572] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:08.651283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc6476-d494-46b5-9525-82f392781c78 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.652183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc6476-d494-46b5-9525-82f392781c78 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.652930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc6476-d494-46b5-9525-82f392781c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.723448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cdcc6476-d494-46b5-9525-82f392781c78 None None] MFA Rules not processed for user `0405dc39ca524c87ae5a99db8d85e615`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:08.724769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cdcc6476-d494-46b5-9525-82f392781c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:08.742519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc027b-18e0-4bbe-8931-48e4c50329b1 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:08.744147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b6fc027b-18e0-4bbe-8931-48e4c50329b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:08.762760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc027b-18e0-4bbe-8931-48e4c50329b1 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:08.809305 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3286/6573] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:08.817879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86966310-1bd9-4874-99b8-846fc18d6aeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:08.818523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86966310-1bd9-4874-99b8-846fc18d6aeb service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.818805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86966310-1bd9-4874-99b8-846fc18d6aeb service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.819077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86966310-1bd9-4874-99b8-846fc18d6aeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.820992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-86966310-1bd9-4874-99b8-846fc18d6aeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:08.825299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc6476-d494-46b5-9525-82f392781c78 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:08.837928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc6476-d494-46b5-9525-82f392781c78 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:08.842414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6bc72-b637-45dd-a6fb-6b608e03cf26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:08.843129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6bc72-b637-45dd-a6fb-6b608e03cf26 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:08.843507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6bc72-b637-45dd-a6fb-6b608e03cf26 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:08.843868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6bc72-b637-45dd-a6fb-6b608e03cf26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:08.853718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6bc72-b637-45dd-a6fb-6b608e03cf26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:08.855144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6bc72-b637-45dd-a6fb-6b608e03cf26 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:08.865693 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3287/6574] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:08.890810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86966310-1bd9-4874-99b8-846fc18d6aeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:08.891917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86966310-1bd9-4874-99b8-846fc18d6aeb service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:08.902199 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3288/6575] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:10.381882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e812a-ee17-4545-91ec-d3bf88c3e42b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:10.382453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e812a-ee17-4545-91ec-d3bf88c3e42b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:10.382453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e812a-ee17-4545-91ec-d3bf88c3e42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:10.406110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a02e812a-ee17-4545-91ec-d3bf88c3e42b None None] MFA Rules not processed for user `0405dc39ca524c87ae5a99db8d85e615`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:10.409538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a02e812a-ee17-4545-91ec-d3bf88c3e42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:10.424889 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3288/6576] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:11.221498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86966310-1bd9-4874-99b8-846fc18d6aeb service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:11.222976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-86966310-1bd9-4874-99b8-846fc18d6aeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:11.331584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86966310-1bd9-4874-99b8-846fc18d6aeb service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:11.345543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ba25d-4c2d-41ad-b9b1-f28d6d73b03a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:11.346177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ba25d-4c2d-41ad-b9b1-f28d6d73b03a service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:11.346452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ba25d-4c2d-41ad-b9b1-f28d6d73b03a service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:11.346729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ba25d-4c2d-41ad-b9b1-f28d6d73b03a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:11.363752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-af6ba25d-4c2d-41ad-b9b1-f28d6d73b03a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:11.365826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ba25d-4c2d-41ad-b9b1-f28d6d73b03a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:11.367463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ba25d-4c2d-41ad-b9b1-f28d6d73b03a service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:11.382951 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3289/6577] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:18.698527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e812a-ee17-4545-91ec-d3bf88c3e42b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:18.700465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a02e812a-ee17-4545-91ec-d3bf88c3e42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:18.785350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e812a-ee17-4545-91ec-d3bf88c3e42b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:18.791417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:18.792463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:18.793035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:18.793727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] PATH_INFO: `/v3/users/064078ac91204130925ceef9b76bd334` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:18.795578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] RBAC: Authorizing `identity:delete_user(user_id=064078ac91204130925ceef9b76bd334)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:18.798724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:18.873976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '064078ac91204130925ceef9b76bd334'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:18.882213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '064078ac91204130925ceef9b76bd334'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:18.883476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '064078ac91204130925ceef9b76bd334'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:18.883801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '064078ac91204130925ceef9b76bd334'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:18.886361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:18.907972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '064078ac91204130925ceef9b76bd334'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:18.925036 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3289/6578] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:18 2022] DELETE /identity/v3/users/064078ac91204130925ceef9b76bd334 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:18.929373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15d84b-0be7-4c94-9053-b596ca278062 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:18.930464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15d84b-0be7-4c94-9053-b596ca278062 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:18.930812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15d84b-0be7-4c94-9053-b596ca278062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:18.953693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cc15d84b-0be7-4c94-9053-b596ca278062 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:18.955056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cc15d84b-0be7-4c94-9053-b596ca278062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:18.988295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:19.047611 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3290/6579] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:19.056707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:19.058496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:19.146072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7294cc-27b4-494f-a583-88762ff632df admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:19.152522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0898d58-33fe-4c68-8c79-a996e107d3b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:19.153457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0898d58-33fe-4c68-8c79-a996e107d3b4 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:19.154682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0898d58-33fe-4c68-8c79-a996e107d3b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:19.155815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0898d58-33fe-4c68-8c79-a996e107d3b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:19.174127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0898d58-33fe-4c68-8c79-a996e107d3b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:19.176089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0898d58-33fe-4c68-8c79-a996e107d3b4 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:19.194105 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3290/6580] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:19.413816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15d84b-0be7-4c94-9053-b596ca278062 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:19.415573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cc15d84b-0be7-4c94-9053-b596ca278062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:19.428578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15d84b-0be7-4c94-9053-b596ca278062 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:19.434035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20339f9-3410-40c7-a7f3-e4c89bb440f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:19.434749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20339f9-3410-40c7-a7f3-e4c89bb440f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:19.435570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20339f9-3410-40c7-a7f3-e4c89bb440f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:19.435959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20339f9-3410-40c7-a7f3-e4c89bb440f0 admin admin] PATH_INFO: `/v3/projects/4c4fc631db814e8aaaf3285584613dad` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:19.437214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20339f9-3410-40c7-a7f3-e4c89bb440f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4fc631db814e8aaaf3285584613dad)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:19.439199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20339f9-3410-40c7-a7f3-e4c89bb440f0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:19.494500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f20339f9-3410-40c7-a7f3-e4c89bb440f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4fc631db814e8aaaf3285584613dad', 'request_id': 'req-f20339f9-3410-40c7-a7f3-e4c89bb440f0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:19.502851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f20339f9-3410-40c7-a7f3-e4c89bb440f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4fc631db814e8aaaf3285584613dad', 'request_id': 'req-f20339f9-3410-40c7-a7f3-e4c89bb440f0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:19.508979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f20339f9-3410-40c7-a7f3-e4c89bb440f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4fc631db814e8aaaf3285584613dad', 'request_id': 'req-f20339f9-3410-40c7-a7f3-e4c89bb440f0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:19.521345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f20339f9-3410-40c7-a7f3-e4c89bb440f0 admin admin] The token cache is being invalidate because project 4c4fc631db814e8aaaf3285584613dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:18:19.522340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f20339f9-3410-40c7-a7f3-e4c89bb440f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:19.523133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f20339f9-3410-40c7-a7f3-e4c89bb440f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:19.524753 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3291/6581] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:19 2022] DELETE /identity/v3/projects/4c4fc631db814e8aaaf3285584613dad => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:19.530303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8f0a-2535-48cd-8a60-6bc32b37d738 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:19.530619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8f0a-2535-48cd-8a60-6bc32b37d738 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:19.531052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8f0a-2535-48cd-8a60-6bc32b37d738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:19.552221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5f4b8f0a-2535-48cd-8a60-6bc32b37d738 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:19.553961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5f4b8f0a-2535-48cd-8a60-6bc32b37d738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:19.636372 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3291/6582] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:19.644729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc744a-da20-4f4b-912a-5bb8e878f50b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:19.645013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc744a-da20-4f4b-912a-5bb8e878f50b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:19.645325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc744a-da20-4f4b-912a-5bb8e878f50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:19.679686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-42fc744a-da20-4f4b-912a-5bb8e878f50b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:19.680841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-42fc744a-da20-4f4b-912a-5bb8e878f50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:19.691699 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3292/6583] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:19.696205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b8f0a-2535-48cd-8a60-6bc32b37d738 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:19.707629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b8f0a-2535-48cd-8a60-6bc32b37d738 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:19.712377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52b9ec-ee10-4be2-a3ac-9c9d3ebd46f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:19.712993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52b9ec-ee10-4be2-a3ac-9c9d3ebd46f7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:19.713299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52b9ec-ee10-4be2-a3ac-9c9d3ebd46f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:19.713575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52b9ec-ee10-4be2-a3ac-9c9d3ebd46f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:19.714222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52b9ec-ee10-4be2-a3ac-9c9d3ebd46f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:18:19.714526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52b9ec-ee10-4be2-a3ac-9c9d3ebd46f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:19.716157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52b9ec-ee10-4be2-a3ac-9c9d3ebd46f7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:19.733623 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3292/6584] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:18:19.734808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc744a-da20-4f4b-912a-5bb8e878f50b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:19.745959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc744a-da20-4f4b-912a-5bb8e878f50b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:19.751451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03a674-08fc-43c5-b092-cbb4853cdf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:19.752053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03a674-08fc-43c5-b092-cbb4853cdf40 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:19.752329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03a674-08fc-43c5-b092-cbb4853cdf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:19.752675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03a674-08fc-43c5-b092-cbb4853cdf40 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:19.753340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03a674-08fc-43c5-b092-cbb4853cdf40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:19.755224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03a674-08fc-43c5-b092-cbb4853cdf40 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:19.789135 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3293/6585] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:18:19 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:19.793771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52b9ec-ee10-4be2-a3ac-9c9d3ebd46f7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:19.820245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52b9ec-ee10-4be2-a3ac-9c9d3ebd46f7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:19.892502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1646e72-cd7b-497d-bc4d-0a18010ae23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:19.893133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646e72-cd7b-497d-bc4d-0a18010ae23f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:19.893457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646e72-cd7b-497d-bc4d-0a18010ae23f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:19.893875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646e72-cd7b-497d-bc4d-0a18010ae23f admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:19.894532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1646e72-cd7b-497d-bc4d-0a18010ae23f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:19.897138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1646e72-cd7b-497d-bc4d-0a18010ae23f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:19.909508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:19.941310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03a674-08fc-43c5-b092-cbb4853cdf40 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:19.941862 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3293/6586] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:18:19 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:19.953462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03a674-08fc-43c5-b092-cbb4853cdf40 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:19.958201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c360ba0-b7b1-4524-98fa-0bc20f8e85c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:19.958852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360ba0-b7b1-4524-98fa-0bc20f8e85c2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:19.959135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360ba0-b7b1-4524-98fa-0bc20f8e85c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:19.959406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360ba0-b7b1-4524-98fa-0bc20f8e85c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:19.960047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c360ba0-b7b1-4524-98fa-0bc20f8e85c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:19.962225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c360ba0-b7b1-4524-98fa-0bc20f8e85c2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:19.973215 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3294/6587] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:19.976788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1646e72-cd7b-497d-bc4d-0a18010ae23f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:19.987768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1646e72-cd7b-497d-bc4d-0a18010ae23f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:19.992767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235db6b-39ea-4a01-9c7d-92066609d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:19.993399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235db6b-39ea-4a01-9c7d-92066609d381 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:19.993680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235db6b-39ea-4a01-9c7d-92066609d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:19.994066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235db6b-39ea-4a01-9c7d-92066609d381 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:19.994707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235db6b-39ea-4a01-9c7d-92066609d381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:19.996305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235db6b-39ea-4a01-9c7d-92066609d381 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:20.007673 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3294/6588] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:20.012157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c360ba0-b7b1-4524-98fa-0bc20f8e85c2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:20.022634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c360ba0-b7b1-4524-98fa-0bc20f8e85c2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:20.027461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c5be1-60d3-496c-aebf-1da3d4341228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:20.028196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c5be1-60d3-496c-aebf-1da3d4341228 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:20.028602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c5be1-60d3-496c-aebf-1da3d4341228 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:20.028941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c5be1-60d3-496c-aebf-1da3d4341228 admin admin] PATH_INFO: `/v3/projects/6bafdc6f3825498fa68bb2deb65d4cf1/users/87950beae1244450af2eca9f7f1ff8fc/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:20.045880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c5be1-60d3-496c-aebf-1da3d4341228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bafdc6f3825498fa68bb2deb65d4cf1, user_id=87950beae1244450af2eca9f7f1ff8fc, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:20.048575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c5be1-60d3-496c-aebf-1da3d4341228 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:20.062605 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3295/6589] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:20 2022] PUT /identity/v3/projects/6bafdc6f3825498fa68bb2deb65d4cf1/users/87950beae1244450af2eca9f7f1ff8fc/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:20.072954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9b527-6d76-469b-9502-d5c936b8e077 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:20.073595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9b527-6d76-469b-9502-d5c936b8e077 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:20.074063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9b527-6d76-469b-9502-d5c936b8e077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:20.104517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ffe9b527-6d76-469b-9502-d5c936b8e077 None None] MFA Rules not processed for user `87950beae1244450af2eca9f7f1ff8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:20.105728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ffe9b527-6d76-469b-9502-d5c936b8e077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:20.174780 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3295/6590] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:20.186392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c5be1-60d3-496c-aebf-1da3d4341228 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:20.189936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-640c5be1-60d3-496c-aebf-1da3d4341228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:20.249234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c5be1-60d3-496c-aebf-1da3d4341228 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:20.252983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503ae81-9a61-4e68-8409-7a9249ad13f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:20.253618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503ae81-9a61-4e68-8409-7a9249ad13f9 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:20.253900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503ae81-9a61-4e68-8409-7a9249ad13f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:20.254218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503ae81-9a61-4e68-8409-7a9249ad13f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:20.259486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:20.264448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503ae81-9a61-4e68-8409-7a9249ad13f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:20.266777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503ae81-9a61-4e68-8409-7a9249ad13f9 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:20.277025 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3296/6591] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:22.983903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9b527-6d76-469b-9502-d5c936b8e077 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:22.986532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ffe9b527-6d76-469b-9502-d5c936b8e077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:23.184454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9b527-6d76-469b-9502-d5c936b8e077 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:23.210385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771b597-732a-4374-b52b-98fde2679243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:23.211151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b597-732a-4374-b52b-98fde2679243 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:23.211691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b597-732a-4374-b52b-98fde2679243 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:23.212188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b597-732a-4374-b52b-98fde2679243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:23.214280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6771b597-732a-4374-b52b-98fde2679243 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:23.231442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771b597-732a-4374-b52b-98fde2679243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:23.235728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771b597-732a-4374-b52b-98fde2679243 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:23.261375 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3296/6592] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:29.486443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9a496-e6d8-441e-95f2-2810bf5a6799 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:29.487382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9a496-e6d8-441e-95f2-2810bf5a6799 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:29.487965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9a496-e6d8-441e-95f2-2810bf5a6799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:29.539713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2ab9a496-e6d8-441e-95f2-2810bf5a6799 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:29.541747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2ab9a496-e6d8-441e-95f2-2810bf5a6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:29.651533 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3297/6593] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:18:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:29.709955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771b597-732a-4374-b52b-98fde2679243 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:29.711844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6771b597-732a-4374-b52b-98fde2679243 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:29.778811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:29.787279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771b597-732a-4374-b52b-98fde2679243 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:29.792548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45820d40-4e9e-4fa5-b2c0-b5568603401c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:29.793206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45820d40-4e9e-4fa5-b2c0-b5568603401c service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:29.793503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45820d40-4e9e-4fa5-b2c0-b5568603401c service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:29.793844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45820d40-4e9e-4fa5-b2c0-b5568603401c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:29.802977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45820d40-4e9e-4fa5-b2c0-b5568603401c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:29.804560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45820d40-4e9e-4fa5-b2c0-b5568603401c service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:29.821518 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3297/6594] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:18:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:18:30.183884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9a496-e6d8-441e-95f2-2810bf5a6799 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:30.269392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9a496-e6d8-441e-95f2-2810bf5a6799 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:30.275260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:30.276310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:30.276310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:30.276786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] PATH_INFO: `/v3/users/87950beae1244450af2eca9f7f1ff8fc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:30.278208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=87950beae1244450af2eca9f7f1ff8fc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:30.280778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:30.336993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87950beae1244450af2eca9f7f1ff8fc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:30.348035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87950beae1244450af2eca9f7f1ff8fc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:30.348647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87950beae1244450af2eca9f7f1ff8fc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:30.349718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87950beae1244450af2eca9f7f1ff8fc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:30.372844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87950beae1244450af2eca9f7f1ff8fc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:30.398088 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3298/6595] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:30 2022] DELETE /identity/v3/users/87950beae1244450af2eca9f7f1ff8fc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:30.402748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b74b-9465-4207-85b5-4cd7d78395a2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:30.403124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b74b-9465-4207-85b5-4cd7d78395a2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:30.403555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b74b-9465-4207-85b5-4cd7d78395a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:30.423927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6dc5b74b-9465-4207-85b5-4cd7d78395a2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:30.425132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6dc5b74b-9465-4207-85b5-4cd7d78395a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:30.512258 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3298/6596] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:30.523948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:30.526214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:30.548631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:30.593616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cf6dc-e1f5-4bf6-a2de-46426b1e16ec None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:30.593616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cf6dc-e1f5-4bf6-a2de-46426b1e16ec None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:30.593886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cf6dc-e1f5-4bf6-a2de-46426b1e16ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:30.634459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e04cf6dc-e1f5-4bf6-a2de-46426b1e16ec None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:30.635811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e04cf6dc-e1f5-4bf6-a2de-46426b1e16ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:30.643243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d95c9-c464-4a16-a9bd-eedeef24af6d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:30.648526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5321ab-85dc-410c-8183-1ea28410cc3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:30.649252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5321ab-85dc-410c-8183-1ea28410cc3d service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:30.649815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5321ab-85dc-410c-8183-1ea28410cc3d service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:30.650215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5321ab-85dc-410c-8183-1ea28410cc3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:30.665107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5321ab-85dc-410c-8183-1ea28410cc3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:30.666588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5321ab-85dc-410c-8183-1ea28410cc3d service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:30.680468 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3299/6597] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:30.759379 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3299/6598] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:18:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:18:30.779620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5321ab-85dc-410c-8183-1ea28410cc3d service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:30.781104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8c5321ab-85dc-410c-8183-1ea28410cc3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:30.897597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5321ab-85dc-410c-8183-1ea28410cc3d service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:30.904313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1796a59-f5b0-4fb1-a852-d59bae20cfbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:30.904929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1796a59-f5b0-4fb1-a852-d59bae20cfbe service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:30.905308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1796a59-f5b0-4fb1-a852-d59bae20cfbe service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:30.905697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1796a59-f5b0-4fb1-a852-d59bae20cfbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:30.915979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1796a59-f5b0-4fb1-a852-d59bae20cfbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:30.918225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1796a59-f5b0-4fb1-a852-d59bae20cfbe service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:30.931975 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3300/6599] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:18:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:18:31.010805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cf6dc-e1f5-4bf6-a2de-46426b1e16ec None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:31.013138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e04cf6dc-e1f5-4bf6-a2de-46426b1e16ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:31.062757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cf6dc-e1f5-4bf6-a2de-46426b1e16ec None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:31.070438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:31.071609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:31.072261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:31.073203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9 admin admin] PATH_INFO: `/v3/projects/6bafdc6f3825498fa68bb2deb65d4cf1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:31.076420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bafdc6f3825498fa68bb2deb65d4cf1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:31.079273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:31.167166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bafdc6f3825498fa68bb2deb65d4cf1', 'request_id': 'req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:31.188120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bafdc6f3825498fa68bb2deb65d4cf1', 'request_id': 'req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:31.202962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bafdc6f3825498fa68bb2deb65d4cf1', 'request_id': 'req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:31.229378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9 admin admin] The token cache is being invalidate because project 6bafdc6f3825498fa68bb2deb65d4cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:18:31.229840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:31.230824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d6bfe2bf-a037-45a4-8d15-0a9324010ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:31.247276 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3300/6600] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:31 2022] DELETE /identity/v3/projects/6bafdc6f3825498fa68bb2deb65d4cf1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:31.247407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc418b00-7a2b-4a8f-9673-5363634f9379 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:31.247707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc418b00-7a2b-4a8f-9673-5363634f9379 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:31.248177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc418b00-7a2b-4a8f-9673-5363634f9379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:31.283506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fc418b00-7a2b-4a8f-9673-5363634f9379 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:31.284851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fc418b00-7a2b-4a8f-9673-5363634f9379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:31.332410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf7ad1-ba92-455a-9b73-6dd45b95435b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:31.332698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf7ad1-ba92-455a-9b73-6dd45b95435b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:31.332980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf7ad1-ba92-455a-9b73-6dd45b95435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:31.354620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0dbf7ad1-ba92-455a-9b73-6dd45b95435b None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:31.355847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0dbf7ad1-ba92-455a-9b73-6dd45b95435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:31.371066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:31.411801 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3301/6601] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:31.419699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30329fa0-2997-4d00-8e8c-e33d10acd45a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:31.419989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30329fa0-2997-4d00-8e8c-e33d10acd45a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:31.420268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30329fa0-2997-4d00-8e8c-e33d10acd45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:31.434333 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3301/6602] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:18:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:18:31.442698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-30329fa0-2997-4d00-8e8c-e33d10acd45a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:31.443813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-30329fa0-2997-4d00-8e8c-e33d10acd45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:31.450118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf7ad1-ba92-455a-9b73-6dd45b95435b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:31.452660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0dbf7ad1-ba92-455a-9b73-6dd45b95435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:31.454761 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3302/6603] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:18:31.458223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30329fa0-2997-4d00-8e8c-e33d10acd45a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:31.470330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30329fa0-2997-4d00-8e8c-e33d10acd45a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:31.476420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b5770-c319-424c-a4de-c1187d4c5d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:31.477420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b5770-c319-424c-a4de-c1187d4c5d93 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:31.477781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b5770-c319-424c-a4de-c1187d4c5d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:31.478183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b5770-c319-424c-a4de-c1187d4c5d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:31.478914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b5770-c319-424c-a4de-c1187d4c5d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:18:31.479295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b5770-c319-424c-a4de-c1187d4c5d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:31.481098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b5770-c319-424c-a4de-c1187d4c5d93 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:31.510463 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3303/6604] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:18:31.514755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b5770-c319-424c-a4de-c1187d4c5d93 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:31.526718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b5770-c319-424c-a4de-c1187d4c5d93 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:31.535996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2f360-efe3-43ef-bb71-d81e0a1d7fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:31.536829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2f360-efe3-43ef-bb71-d81e0a1d7fdb admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:31.537373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2f360-efe3-43ef-bb71-d81e0a1d7fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:31.537873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2f360-efe3-43ef-bb71-d81e0a1d7fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:31.538531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2f360-efe3-43ef-bb71-d81e0a1d7fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:31.540659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2f360-efe3-43ef-bb71-d81e0a1d7fdb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:31.585304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:31.601664 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3304/6605] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:18:31 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:31.603945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf7ad1-ba92-455a-9b73-6dd45b95435b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:31.605956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2f360-efe3-43ef-bb71-d81e0a1d7fdb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:31.707796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf553cd-72ed-4ec7-b334-a0637eda1b0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:31.708533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf553cd-72ed-4ec7-b334-a0637eda1b0a service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:31.708823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf553cd-72ed-4ec7-b334-a0637eda1b0a service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:31.709375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf553cd-72ed-4ec7-b334-a0637eda1b0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:31.719209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2f360-efe3-43ef-bb71-d81e0a1d7fdb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:31.724317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c28aa-72d1-4450-86a6-4cd5a9fc5f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:31.725037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c28aa-72d1-4450-86a6-4cd5a9fc5f1c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:31.725307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c28aa-72d1-4450-86a6-4cd5a9fc5f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:31.725684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c28aa-72d1-4450-86a6-4cd5a9fc5f1c admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:31.726272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c28aa-72d1-4450-86a6-4cd5a9fc5f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:31.728562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c28aa-72d1-4450-86a6-4cd5a9fc5f1c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:31.761631 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3305/6606] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:18:31 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:18:31.763431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c28aa-72d1-4450-86a6-4cd5a9fc5f1c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:31.775845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c28aa-72d1-4450-86a6-4cd5a9fc5f1c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:31.782077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405df8e2-ee97-4e31-914b-fe9ad0489328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:31.783183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405df8e2-ee97-4e31-914b-fe9ad0489328 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:31.784208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405df8e2-ee97-4e31-914b-fe9ad0489328 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:31.784672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405df8e2-ee97-4e31-914b-fe9ad0489328 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:31.785558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405df8e2-ee97-4e31-914b-fe9ad0489328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:31.788086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405df8e2-ee97-4e31-914b-fe9ad0489328 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:31.807543 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3306/6607] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:31.810873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405df8e2-ee97-4e31-914b-fe9ad0489328 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:31.819457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf553cd-72ed-4ec7-b334-a0637eda1b0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:31.821094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf553cd-72ed-4ec7-b334-a0637eda1b0a service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:31.823936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405df8e2-ee97-4e31-914b-fe9ad0489328 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:31.831659 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3302/6608] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:18:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:18:31.839718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4335dfa-0cee-46f8-a914-f0327112e282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:31.840504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4335dfa-0cee-46f8-a914-f0327112e282 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:31.841541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4335dfa-0cee-46f8-a914-f0327112e282 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:31.842058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4335dfa-0cee-46f8-a914-f0327112e282 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:31.843046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4335dfa-0cee-46f8-a914-f0327112e282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:31.844825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4335dfa-0cee-46f8-a914-f0327112e282 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:31.859909 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3307/6609] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:31.863773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf553cd-72ed-4ec7-b334-a0637eda1b0a service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:31.878564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf553cd-72ed-4ec7-b334-a0637eda1b0a service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:31.886615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69da84-8fcd-4ad2-9376-6cd9b4980532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:31.887484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69da84-8fcd-4ad2-9376-6cd9b4980532 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:31.887579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69da84-8fcd-4ad2-9376-6cd9b4980532 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:31.888490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69da84-8fcd-4ad2-9376-6cd9b4980532 admin admin] PATH_INFO: `/v3/projects/e0efbcc5526141d6be54191aaf22a2e0/users/d9ad20ed0b6f45029f5409601348756f/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:31.895168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:31.911976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69da84-8fcd-4ad2-9376-6cd9b4980532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0efbcc5526141d6be54191aaf22a2e0, user_id=d9ad20ed0b6f45029f5409601348756f, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:31.915243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69da84-8fcd-4ad2-9376-6cd9b4980532 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:31.933113 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3303/6610] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:31 2022] PUT /identity/v3/projects/e0efbcc5526141d6be54191aaf22a2e0/users/d9ad20ed0b6f45029f5409601348756f/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:31.943520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452bdc1-7d1d-4a4d-89b1-0ca59576db99 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:31.943882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452bdc1-7d1d-4a4d-89b1-0ca59576db99 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:31.944167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452bdc1-7d1d-4a4d-89b1-0ca59576db99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:31.985178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6452bdc1-7d1d-4a4d-89b1-0ca59576db99 None None] MFA Rules not processed for user `d9ad20ed0b6f45029f5409601348756f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:31.986873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6452bdc1-7d1d-4a4d-89b1-0ca59576db99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:32.128419 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3308/6611] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:32.138710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69da84-8fcd-4ad2-9376-6cd9b4980532 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:32.140693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d69da84-8fcd-4ad2-9376-6cd9b4980532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:32.245092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69da84-8fcd-4ad2-9376-6cd9b4980532 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:32.245570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3e6a8-0067-4240-bccb-64dd1daafd99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:32.248443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3e6a8-0067-4240-bccb-64dd1daafd99 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:32.248862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3e6a8-0067-4240-bccb-64dd1daafd99 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:32.249292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3e6a8-0067-4240-bccb-64dd1daafd99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:32.263495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3e6a8-0067-4240-bccb-64dd1daafd99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:32.264965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3e6a8-0067-4240-bccb-64dd1daafd99 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:32.287566 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3304/6612] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:32.331889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e5162-08ef-4288-bd76-4aa1338c35a1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:32.332186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e5162-08ef-4288-bd76-4aa1338c35a1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:32.332533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e5162-08ef-4288-bd76-4aa1338c35a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:32.361719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-294e5162-08ef-4288-bd76-4aa1338c35a1 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:32.362934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-294e5162-08ef-4288-bd76-4aa1338c35a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:32.461367 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3309/6613] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:18:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:18:32.474178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3e6a8-0067-4240-bccb-64dd1daafd99 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:32.614700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3e6a8-0067-4240-bccb-64dd1daafd99 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:32.629162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6b91d-e9a3-42ca-a7cb-8db6d535e895 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:32.630683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b91d-e9a3-42ca-a7cb-8db6d535e895 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:32.632153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b91d-e9a3-42ca-a7cb-8db6d535e895 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:32.633997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b91d-e9a3-42ca-a7cb-8db6d535e895 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:32.647440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b91d-e9a3-42ca-a7cb-8db6d535e895 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:32.649112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b91d-e9a3-42ca-a7cb-8db6d535e895 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:32.658383 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3305/6614] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:18:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:18:35.083887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e5162-08ef-4288-bd76-4aa1338c35a1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:35.085472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-294e5162-08ef-4288-bd76-4aa1338c35a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:35.090667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:35.198772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e5162-08ef-4288-bd76-4aa1338c35a1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:35.203703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:35.204358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:35.204638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:35.204910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] PATH_INFO: `/v3/users/0405dc39ca524c87ae5a99db8d85e615` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:35.206103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0405dc39ca524c87ae5a99db8d85e615)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:35.208349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:35.272827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0405dc39ca524c87ae5a99db8d85e615'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:35.287969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0405dc39ca524c87ae5a99db8d85e615'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:35.289811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0405dc39ca524c87ae5a99db8d85e615'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:35.290798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0405dc39ca524c87ae5a99db8d85e615'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:35.316830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0405dc39ca524c87ae5a99db8d85e615'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:35.340964 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3310/6615] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:35 2022] DELETE /identity/v3/users/0405dc39ca524c87ae5a99db8d85e615 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:35.343887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cde470-8f42-4cd8-a1dc-994347a807b6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:35.344291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cde470-8f42-4cd8-a1dc-994347a807b6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:35.344599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cde470-8f42-4cd8-a1dc-994347a807b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:35.380870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e0cde470-8f42-4cd8-a1dc-994347a807b6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:35.382407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e0cde470-8f42-4cd8-a1dc-994347a807b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:35.557252 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3306/6616] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:35.683316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:35.686260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:35.846199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02581dd-9268-4818-ae0d-d047dd4f1e28 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:35.853732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1d7f-f55a-4f8a-b154-964b82e603d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:35.854894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1d7f-f55a-4f8a-b154-964b82e603d2 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:35.855626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1d7f-f55a-4f8a-b154-964b82e603d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:35.856117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1d7f-f55a-4f8a-b154-964b82e603d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:35.891821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1d7f-f55a-4f8a-b154-964b82e603d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:35.893716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1d7f-f55a-4f8a-b154-964b82e603d2 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:35.922079 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3311/6617] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:36.388760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cde470-8f42-4cd8-a1dc-994347a807b6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:36.394485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e0cde470-8f42-4cd8-a1dc-994347a807b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:36.420575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cde470-8f42-4cd8-a1dc-994347a807b6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:36.434743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:36.435900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:36.436498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:36.437393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] PATH_INFO: `/v3/projects/9e8fbf829e45416b8d40ff3a9e512fe8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:36.439353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8fbf829e45416b8d40ff3a9e512fe8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:36.442643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:36.467320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:36.582836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8fbf829e45416b8d40ff3a9e512fe8', 'request_id': 'req-b471c75b-e7e5-42d5-9da7-796f75d183ae'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:36.602928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8fbf829e45416b8d40ff3a9e512fe8', 'request_id': 'req-b471c75b-e7e5-42d5-9da7-796f75d183ae'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:36.623013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8fbf829e45416b8d40ff3a9e512fe8', 'request_id': 'req-b471c75b-e7e5-42d5-9da7-796f75d183ae'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:36.649560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] The token cache is being invalidate because project 9e8fbf829e45416b8d40ff3a9e512fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:18:36.651911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:36.654197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:36.656417 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3307/6618] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:36 2022] DELETE /identity/v3/projects/9e8fbf829e45416b8d40ff3a9e512fe8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:18:37.272268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfed963-2359-4fde-8bdf-0bc7e86bc6f7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:37.272818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfed963-2359-4fde-8bdf-0bc7e86bc6f7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:37.273317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfed963-2359-4fde-8bdf-0bc7e86bc6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:37.314390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7cfed963-2359-4fde-8bdf-0bc7e86bc6f7 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:37.316932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7cfed963-2359-4fde-8bdf-0bc7e86bc6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:37.349857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:37.410703 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3312/6619] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:18:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:18:37.426066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:37.428567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:37.535064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471c75b-e7e5-42d5-9da7-796f75d183ae admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:37.544551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a13119-5309-418b-ba4a-aa87ca02b4ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:37.546195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a13119-5309-418b-ba4a-aa87ca02b4ce service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:37.546817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a13119-5309-418b-ba4a-aa87ca02b4ce service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:37.547262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a13119-5309-418b-ba4a-aa87ca02b4ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:37.560217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a13119-5309-418b-ba4a-aa87ca02b4ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:37.562152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a13119-5309-418b-ba4a-aa87ca02b4ce service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:37.574806 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3308/6620] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:18:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:18:41.308917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127f107-687c-48b6-a1c1-48d9cf249339 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:41.309842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127f107-687c-48b6-a1c1-48d9cf249339 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:41.310284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127f107-687c-48b6-a1c1-48d9cf249339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:41.332545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d127f107-687c-48b6-a1c1-48d9cf249339 None None] MFA Rules not processed for user `8957041987c8487099f0d89f4c64af66`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:41.335539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d127f107-687c-48b6-a1c1-48d9cf249339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:41.484029 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3313/6621] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:43.165467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a13119-5309-418b-ba4a-aa87ca02b4ce service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:43.167698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-10a13119-5309-418b-ba4a-aa87ca02b4ce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:43.283667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a13119-5309-418b-ba4a-aa87ca02b4ce service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:43.290476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:43.291125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:43.291776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:43.292209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] PATH_INFO: `/v3/users/d9ad20ed0b6f45029f5409601348756f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:43.294276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ad20ed0b6f45029f5409601348756f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:43.305813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:43.376118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:43.426434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ad20ed0b6f45029f5409601348756f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:43.437572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ad20ed0b6f45029f5409601348756f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:43.439100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ad20ed0b6f45029f5409601348756f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:43.440089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ad20ed0b6f45029f5409601348756f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:43.467246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ad20ed0b6f45029f5409601348756f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:43.508468 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3309/6622] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:43 2022] DELETE /identity/v3/users/d9ad20ed0b6f45029f5409601348756f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:43.516512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a7514-f5a0-41f5-b8bf-4557cdb19266 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:43.517942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a7514-f5a0-41f5-b8bf-4557cdb19266 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:43.518497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a7514-f5a0-41f5-b8bf-4557cdb19266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:43.552781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fd6a7514-f5a0-41f5-b8bf-4557cdb19266 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:43.554409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fd6a7514-f5a0-41f5-b8bf-4557cdb19266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:43.667450 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3314/6623] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:18:43.680236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:43.684206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:43.813545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d99940-33c7-44e0-96b8-be98ce9c9ec3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:43.824129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bef7bd-c1a7-42f8-aa7a-57aca831b56f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:43.824773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bef7bd-c1a7-42f8-aa7a-57aca831b56f service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:43.825086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bef7bd-c1a7-42f8-aa7a-57aca831b56f service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:43.825460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bef7bd-c1a7-42f8-aa7a-57aca831b56f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:43.843434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bef7bd-c1a7-42f8-aa7a-57aca831b56f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:43.844887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bef7bd-c1a7-42f8-aa7a-57aca831b56f service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:43.867749 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3310/6624] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:44.242045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a7514-f5a0-41f5-b8bf-4557cdb19266 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:44.243931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fd6a7514-f5a0-41f5-b8bf-4557cdb19266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:44.266184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a7514-f5a0-41f5-b8bf-4557cdb19266 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:44.277774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662cec1-6f57-47fa-9623-4a1f9e60ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:44.279283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662cec1-6f57-47fa-9623-4a1f9e60ede4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:44.280087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662cec1-6f57-47fa-9623-4a1f9e60ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:44.280530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662cec1-6f57-47fa-9623-4a1f9e60ede4 admin admin] PATH_INFO: `/v3/projects/e0efbcc5526141d6be54191aaf22a2e0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:44.282569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662cec1-6f57-47fa-9623-4a1f9e60ede4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0efbcc5526141d6be54191aaf22a2e0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:44.285527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662cec1-6f57-47fa-9623-4a1f9e60ede4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:44.374424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5662cec1-6f57-47fa-9623-4a1f9e60ede4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0efbcc5526141d6be54191aaf22a2e0', 'request_id': 'req-5662cec1-6f57-47fa-9623-4a1f9e60ede4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:44.386239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5662cec1-6f57-47fa-9623-4a1f9e60ede4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0efbcc5526141d6be54191aaf22a2e0', 'request_id': 'req-5662cec1-6f57-47fa-9623-4a1f9e60ede4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:44.393528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5662cec1-6f57-47fa-9623-4a1f9e60ede4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0efbcc5526141d6be54191aaf22a2e0', 'request_id': 'req-5662cec1-6f57-47fa-9623-4a1f9e60ede4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:44.404921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:44.412776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5662cec1-6f57-47fa-9623-4a1f9e60ede4 admin admin] The token cache is being invalidate because project e0efbcc5526141d6be54191aaf22a2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:18:44.413094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5662cec1-6f57-47fa-9623-4a1f9e60ede4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:44.413934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5662cec1-6f57-47fa-9623-4a1f9e60ede4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:44.420137 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3315/6625] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:44 2022] DELETE /identity/v3/projects/e0efbcc5526141d6be54191aaf22a2e0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:44.421846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8798-cc72-4071-b3ce-ac00df41ed81 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:44.422394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8798-cc72-4071-b3ce-ac00df41ed81 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:44.422394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8798-cc72-4071-b3ce-ac00df41ed81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:44.463828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-418c8798-cc72-4071-b3ce-ac00df41ed81 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:44.466866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-418c8798-cc72-4071-b3ce-ac00df41ed81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:44.630231 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3311/6626] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:44.632009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1317ac-2986-44fd-b8a7-f95e33cb4753 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:44.632415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1317ac-2986-44fd-b8a7-f95e33cb4753 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:44.632563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1317ac-2986-44fd-b8a7-f95e33cb4753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:44.682498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-de1317ac-2986-44fd-b8a7-f95e33cb4753 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:44.683845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-de1317ac-2986-44fd-b8a7-f95e33cb4753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:44.710956 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3316/6627] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:44.712563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c8798-cc72-4071-b3ce-ac00df41ed81 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:44.733968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c8798-cc72-4071-b3ce-ac00df41ed81 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:44.746631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76384b3-a475-40b3-a548-e05c06a98fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:44.747713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76384b3-a475-40b3-a548-e05c06a98fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:44.748008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76384b3-a475-40b3-a548-e05c06a98fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:44.749042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76384b3-a475-40b3-a548-e05c06a98fb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:44.749951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76384b3-a475-40b3-a548-e05c06a98fb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:18:44.750263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76384b3-a475-40b3-a548-e05c06a98fb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:44.751887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76384b3-a475-40b3-a548-e05c06a98fb9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:44.775274 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3312/6628] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:18:44.777397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1317ac-2986-44fd-b8a7-f95e33cb4753 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:44.792298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1317ac-2986-44fd-b8a7-f95e33cb4753 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:44.806793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8f65a-126f-4af2-9c31-bd15079b1fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:44.807421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8f65a-126f-4af2-9c31-bd15079b1fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:44.807699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8f65a-126f-4af2-9c31-bd15079b1fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:44.807969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8f65a-126f-4af2-9c31-bd15079b1fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:44.808658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8f65a-126f-4af2-9c31-bd15079b1fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:44.811126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8f65a-126f-4af2-9c31-bd15079b1fc1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:44.868132 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3317/6629] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:18:44 2022] POST /identity/v3/projects => generated 393 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:44.875229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76384b3-a475-40b3-a548-e05c06a98fb9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:44.896763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76384b3-a475-40b3-a548-e05c06a98fb9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:44.971043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:45.021240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae1d64-b5b0-476b-b20e-f1396102c506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:45.022250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae1d64-b5b0-476b-b20e-f1396102c506 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:45.022902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae1d64-b5b0-476b-b20e-f1396102c506 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:45.024975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae1d64-b5b0-476b-b20e-f1396102c506 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:45.026833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae1d64-b5b0-476b-b20e-f1396102c506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:45.047479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae1d64-b5b0-476b-b20e-f1396102c506 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:45.134445 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3313/6630] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:18:44 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:45.138602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8f65a-126f-4af2-9c31-bd15079b1fc1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:45.154343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8f65a-126f-4af2-9c31-bd15079b1fc1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:45.171915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f872fd-4c98-4bab-8d52-b843710d92c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:45.172598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f872fd-4c98-4bab-8d52-b843710d92c9 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:45.172881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f872fd-4c98-4bab-8d52-b843710d92c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:45.173218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f872fd-4c98-4bab-8d52-b843710d92c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:45.173944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f872fd-4c98-4bab-8d52-b843710d92c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:45.175793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f872fd-4c98-4bab-8d52-b843710d92c9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:45.199757 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3318/6631] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:45.204735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae1d64-b5b0-476b-b20e-f1396102c506 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:45.221621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae1d64-b5b0-476b-b20e-f1396102c506 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:45.234288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3e4ce-5681-4d32-a77f-992a1b27b839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:45.234911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e4ce-5681-4d32-a77f-992a1b27b839 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:45.235190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e4ce-5681-4d32-a77f-992a1b27b839 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:45.235463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e4ce-5681-4d32-a77f-992a1b27b839 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:45.236223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3e4ce-5681-4d32-a77f-992a1b27b839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:45.237722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3e4ce-5681-4d32-a77f-992a1b27b839 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:45.256092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f872fd-4c98-4bab-8d52-b843710d92c9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:45.264796 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3314/6632] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:45.268831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f872fd-4c98-4bab-8d52-b843710d92c9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:45.274542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4300e4-0dc3-477e-bf2b-049242f5e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:45.275347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4300e4-0dc3-477e-bf2b-049242f5e44d admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:45.275731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4300e4-0dc3-477e-bf2b-049242f5e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:45.276105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4300e4-0dc3-477e-bf2b-049242f5e44d admin admin] PATH_INFO: `/v3/projects/28b0a6c5619d46929802ef47ff71127f/users/2799e2cc255e45d8becb3c9be42f61c9/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:45.299232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4300e4-0dc3-477e-bf2b-049242f5e44d admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b0a6c5619d46929802ef47ff71127f, user_id=2799e2cc255e45d8becb3c9be42f61c9, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:45.302025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4300e4-0dc3-477e-bf2b-049242f5e44d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:45.333535 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3319/6633] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:45 2022] PUT /identity/v3/projects/28b0a6c5619d46929802ef47ff71127f/users/2799e2cc255e45d8becb3c9be42f61c9/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:45.335463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc65f1b-fe9a-43c6-a294-0e6279f1acb1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:45.335997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc65f1b-fe9a-43c6-a294-0e6279f1acb1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:45.336483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc65f1b-fe9a-43c6-a294-0e6279f1acb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:45.402369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4bc65f1b-fe9a-43c6-a294-0e6279f1acb1 None None] MFA Rules not processed for user `2799e2cc255e45d8becb3c9be42f61c9`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:45.403715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4bc65f1b-fe9a-43c6-a294-0e6279f1acb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:45.604133 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3315/6634] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:45.609048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4300e4-0dc3-477e-bf2b-049242f5e44d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:45.713103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4300e4-0dc3-477e-bf2b-049242f5e44d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:45.721754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ba9dc-f0ea-4752-9545-73934dcea9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:45.723316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ba9dc-f0ea-4752-9545-73934dcea9ce admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:45.723316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ba9dc-f0ea-4752-9545-73934dcea9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:45.723775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ba9dc-f0ea-4752-9545-73934dcea9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:45.725101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ba9dc-f0ea-4752-9545-73934dcea9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:45.730280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ba9dc-f0ea-4752-9545-73934dcea9ce admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:45.769100 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3320/6635] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:18:45 2022] POST /identity/v3/projects => generated 393 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:45.772859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc65f1b-fe9a-43c6-a294-0e6279f1acb1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:45.785015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc65f1b-fe9a-43c6-a294-0e6279f1acb1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:45.943042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78888e1d-d43f-4671-b34b-353c27bfd241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:45.943676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78888e1d-d43f-4671-b34b-353c27bfd241 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:45.943979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78888e1d-d43f-4671-b34b-353c27bfd241 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:45.944233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78888e1d-d43f-4671-b34b-353c27bfd241 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:45.945296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78888e1d-d43f-4671-b34b-353c27bfd241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:45.948748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78888e1d-d43f-4671-b34b-353c27bfd241 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:45.998759 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3316/6636] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:18:45 2022] POST /identity/v3/users => generated 303 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:46.002895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ba9dc-f0ea-4752-9545-73934dcea9ce admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:46.021004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ba9dc-f0ea-4752-9545-73934dcea9ce admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:46.034556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c8d00-5db5-4633-8f85-89b472596e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:46.035671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c8d00-5db5-4633-8f85-89b472596e87 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:46.046920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c8d00-5db5-4633-8f85-89b472596e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:46.047607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c8d00-5db5-4633-8f85-89b472596e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:46.050197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c8d00-5db5-4633-8f85-89b472596e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:46.055282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c8d00-5db5-4633-8f85-89b472596e87 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:46.082767 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3321/6637] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:46.087014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78888e1d-d43f-4671-b34b-353c27bfd241 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:46.115816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78888e1d-d43f-4671-b34b-353c27bfd241 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:46.129433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6be258-f526-43f2-b9d7-2c5d0390ba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:46.150953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be258-f526-43f2-b9d7-2c5d0390ba9f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:46.153037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be258-f526-43f2-b9d7-2c5d0390ba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:46.153886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be258-f526-43f2-b9d7-2c5d0390ba9f admin admin] PATH_INFO: `/v3/projects/f42b4d919ee04965a2ccdae4648c1560/users/b35cf541612146d2b6c05b38e76f6413/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:46.220831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6be258-f526-43f2-b9d7-2c5d0390ba9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42b4d919ee04965a2ccdae4648c1560, user_id=b35cf541612146d2b6c05b38e76f6413, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:46.225743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6be258-f526-43f2-b9d7-2c5d0390ba9f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:46.280836 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3317/6638] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:46 2022] PUT /identity/v3/projects/f42b4d919ee04965a2ccdae4648c1560/users/b35cf541612146d2b6c05b38e76f6413/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:46.285000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c8d00-5db5-4633-8f85-89b472596e87 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:46.314478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c8d00-5db5-4633-8f85-89b472596e87 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:46.530776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19318dc5-0d32-472d-bcdf-1f215164b792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:46.531862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318dc5-0d32-472d-bcdf-1f215164b792 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:46.532300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318dc5-0d32-472d-bcdf-1f215164b792 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:46.532568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318dc5-0d32-472d-bcdf-1f215164b792 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:46.533330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19318dc5-0d32-472d-bcdf-1f215164b792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:46.539923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19318dc5-0d32-472d-bcdf-1f215164b792 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:46.576193 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3322/6639] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:46.580625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6be258-f526-43f2-b9d7-2c5d0390ba9f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:46.596926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6be258-f526-43f2-b9d7-2c5d0390ba9f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:46.603231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd44674-52e4-41e4-8bc0-a8ffa70e25e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:46.604106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd44674-52e4-41e4-8bc0-a8ffa70e25e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:46.604468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd44674-52e4-41e4-8bc0-a8ffa70e25e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:46.607531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd44674-52e4-41e4-8bc0-a8ffa70e25e5 admin admin] PATH_INFO: `/v3/projects/f42b4d919ee04965a2ccdae4648c1560/users/b35cf541612146d2b6c05b38e76f6413/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:46.609813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd44674-52e4-41e4-8bc0-a8ffa70e25e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42b4d919ee04965a2ccdae4648c1560, user_id=b35cf541612146d2b6c05b38e76f6413, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:46.613007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd44674-52e4-41e4-8bc0-a8ffa70e25e5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:46.630581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:46.654607 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3318/6640] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:46 2022] PUT /identity/v3/projects/f42b4d919ee04965a2ccdae4648c1560/users/b35cf541612146d2b6c05b38e76f6413/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:18:46.664466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8ce0-a1ec-43bc-b87a-bc5cdc5b0f24 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:46.664758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8ce0-a1ec-43bc-b87a-bc5cdc5b0f24 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:46.665166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8ce0-a1ec-43bc-b87a-bc5cdc5b0f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:46.677427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:46.784639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a49b8ce0-a1ec-43bc-b87a-bc5cdc5b0f24 None None] MFA Rules not processed for user `b35cf541612146d2b6c05b38e76f6413`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:46.785962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a49b8ce0-a1ec-43bc-b87a-bc5cdc5b0f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:46.881299 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3323/6641] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:46.895383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd44674-52e4-41e4-8bc0-a8ffa70e25e5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:46.898008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6fd44674-52e4-41e4-8bc0-a8ffa70e25e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:47.063704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd44674-52e4-41e4-8bc0-a8ffa70e25e5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:47.074473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36baa43-bef7-4be2-8450-f3ec28e36e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:47.075346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36baa43-bef7-4be2-8450-f3ec28e36e99 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:47.075775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36baa43-bef7-4be2-8450-f3ec28e36e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:47.076201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36baa43-bef7-4be2-8450-f3ec28e36e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:47.105427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36baa43-bef7-4be2-8450-f3ec28e36e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:47.107490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36baa43-bef7-4be2-8450-f3ec28e36e99 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:47.134837 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3319/6642] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:46 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:47.248914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b8ce0-a1ec-43bc-b87a-bc5cdc5b0f24 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:47.252014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a49b8ce0-a1ec-43bc-b87a-bc5cdc5b0f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:47.272841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b8ce0-a1ec-43bc-b87a-bc5cdc5b0f24 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:47.281522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3602b-1ffa-429d-8541-9948f6982568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:47.301383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3602b-1ffa-429d-8541-9948f6982568 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:47.301731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3602b-1ffa-429d-8541-9948f6982568 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:47.301946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3602b-1ffa-429d-8541-9948f6982568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:47.445254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3602b-1ffa-429d-8541-9948f6982568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:47.446783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3602b-1ffa-429d-8541-9948f6982568 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:47.516665 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3324/6643] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:48.746678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36baa43-bef7-4be2-8450-f3ec28e36e99 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:48.749099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b36baa43-bef7-4be2-8450-f3ec28e36e99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:48.895876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36baa43-bef7-4be2-8450-f3ec28e36e99 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:48.900772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:48.901572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:48.901947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:48.902318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] PATH_INFO: `/v3/users/c82cfdffdac24d0ba847681ad82a2928` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:48.904620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82cfdffdac24d0ba847681ad82a2928)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:48.906813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:48.982435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82cfdffdac24d0ba847681ad82a2928'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:48.990987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82cfdffdac24d0ba847681ad82a2928'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:48.992141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82cfdffdac24d0ba847681ad82a2928'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:48.993825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82cfdffdac24d0ba847681ad82a2928'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:49.013084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82cfdffdac24d0ba847681ad82a2928'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:49.033498 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3320/6644] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:48 2022] DELETE /identity/v3/users/c82cfdffdac24d0ba847681ad82a2928 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:49.037885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b473896-1b93-474f-87f7-d2156efe10b2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:49.039042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b473896-1b93-474f-87f7-d2156efe10b2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:49.039566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b473896-1b93-474f-87f7-d2156efe10b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:49.084234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8b473896-1b93-474f-87f7-d2156efe10b2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:49.085775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8b473896-1b93-474f-87f7-d2156efe10b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:49.192539 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3325/6645] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:49.203800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:49.205520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:49.245762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:49.304127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe4a5d-8330-4235-9bba-87957ff4ddab admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:49.308166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bff255-23a2-4a41-b3bb-d419caffe2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:49.309310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bff255-23a2-4a41-b3bb-d419caffe2fe service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:49.309997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bff255-23a2-4a41-b3bb-d419caffe2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:49.310398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bff255-23a2-4a41-b3bb-d419caffe2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:49.329180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bff255-23a2-4a41-b3bb-d419caffe2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:49.333627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bff255-23a2-4a41-b3bb-d419caffe2fe service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:49.349869 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3321/6646] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:50.365160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b473896-1b93-474f-87f7-d2156efe10b2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:50.366719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8b473896-1b93-474f-87f7-d2156efe10b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:50.395647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b473896-1b93-474f-87f7-d2156efe10b2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:50.411522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:50.412708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:50.412708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:50.412881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] PATH_INFO: `/v3/projects/a6e1abce050a4cbcaf6f838d4abfa728` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:50.415285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e1abce050a4cbcaf6f838d4abfa728)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:50.420038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:50.528528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:50.598102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e1abce050a4cbcaf6f838d4abfa728', 'request_id': 'req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:50.603661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e1abce050a4cbcaf6f838d4abfa728', 'request_id': 'req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:50.614942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e1abce050a4cbcaf6f838d4abfa728', 'request_id': 'req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:50.648060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] The token cache is being invalidate because project a6e1abce050a4cbcaf6f838d4abfa728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:18:50.648356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:50.649169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:50.658022 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3326/6647] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:50 2022] DELETE /identity/v3/projects/a6e1abce050a4cbcaf6f838d4abfa728 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:50.661739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bff255-23a2-4a41-b3bb-d419caffe2fe service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:50.683149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bff255-23a2-4a41-b3bb-d419caffe2fe service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:50.780107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:50.780722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:50.781122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:50.781586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] PATH_INFO: `/v3/users/b9727463ad0344ec99ed235d3f9598f6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:50.782886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9727463ad0344ec99ed235d3f9598f6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:50.785024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:50.913467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9727463ad0344ec99ed235d3f9598f6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:50.925703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9727463ad0344ec99ed235d3f9598f6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:50.926942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9727463ad0344ec99ed235d3f9598f6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:50.929035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9727463ad0344ec99ed235d3f9598f6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:50.953619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9727463ad0344ec99ed235d3f9598f6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:50.972816 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3322/6648] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:50 2022] DELETE /identity/v3/users/b9727463ad0344ec99ed235d3f9598f6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:51.866104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:51.868608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:51.931904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2614b1-492f-4314-a8fd-0c8511fe7fa1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:52.056495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:52.058001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:52.101456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f00728-db91-4078-9efd-14216c5cd018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:52.102508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f00728-db91-4078-9efd-14216c5cd018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:52.102917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f00728-db91-4078-9efd-14216c5cd018 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:52.103298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f00728-db91-4078-9efd-14216c5cd018 admin admin] PATH_INFO: `/v3/projects/63ccbc7631cf498daa8457f57c927f55` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:52.104622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f00728-db91-4078-9efd-14216c5cd018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ccbc7631cf498daa8457f57c927f55)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:52.106932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f00728-db91-4078-9efd-14216c5cd018 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:52.163549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:52.207792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb6fc9-9a24-459c-b848-09928d6d9982 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:52.219810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0932888-fc3e-43bf-8627-0f5639fd3d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:52.223290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0932888-fc3e-43bf-8627-0f5639fd3d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:52.223610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0932888-fc3e-43bf-8627-0f5639fd3d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:52.223898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0932888-fc3e-43bf-8627-0f5639fd3d7b admin admin] PATH_INFO: `/v3/users/2799e2cc255e45d8becb3c9be42f61c9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:52.226873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0932888-fc3e-43bf-8627-0f5639fd3d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2799e2cc255e45d8becb3c9be42f61c9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:52.232853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0932888-fc3e-43bf-8627-0f5639fd3d7b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:52.245073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-66f00728-db91-4078-9efd-14216c5cd018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ccbc7631cf498daa8457f57c927f55', 'request_id': 'req-66f00728-db91-4078-9efd-14216c5cd018'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:52.258383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-66f00728-db91-4078-9efd-14216c5cd018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ccbc7631cf498daa8457f57c927f55', 'request_id': 'req-66f00728-db91-4078-9efd-14216c5cd018'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:52.271264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-66f00728-db91-4078-9efd-14216c5cd018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ccbc7631cf498daa8457f57c927f55', 'request_id': 'req-66f00728-db91-4078-9efd-14216c5cd018'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:52.298948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-66f00728-db91-4078-9efd-14216c5cd018 admin admin] The token cache is being invalidate because project 63ccbc7631cf498daa8457f57c927f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:18:52.299293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-66f00728-db91-4078-9efd-14216c5cd018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:52.300136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-66f00728-db91-4078-9efd-14216c5cd018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:52.302172 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3327/6649] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:51 2022] DELETE /identity/v3/projects/63ccbc7631cf498daa8457f57c927f55 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:52.306961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade6f79-ccec-4e89-8ed5-613c9a3b46ad None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:52.307361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade6f79-ccec-4e89-8ed5-613c9a3b46ad None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:52.307887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade6f79-ccec-4e89-8ed5-613c9a3b46ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:52.332921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0932888-fc3e-43bf-8627-0f5639fd3d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2799e2cc255e45d8becb3c9be42f61c9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:52.339273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6ade6f79-ccec-4e89-8ed5-613c9a3b46ad None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:52.343318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6ade6f79-ccec-4e89-8ed5-613c9a3b46ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:52.354134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0932888-fc3e-43bf-8627-0f5639fd3d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2799e2cc255e45d8becb3c9be42f61c9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:52.357832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0932888-fc3e-43bf-8627-0f5639fd3d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2799e2cc255e45d8becb3c9be42f61c9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:52.358988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0932888-fc3e-43bf-8627-0f5639fd3d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2799e2cc255e45d8becb3c9be42f61c9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:52.391465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0932888-fc3e-43bf-8627-0f5639fd3d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2799e2cc255e45d8becb3c9be42f61c9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:52.412586 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3323/6650] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:52 2022] DELETE /identity/v3/users/2799e2cc255e45d8becb3c9be42f61c9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:52.425614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bf383-b7f5-436f-bfd7-babc8e912c69 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:52.426216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bf383-b7f5-436f-bfd7-babc8e912c69 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:52.427427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bf383-b7f5-436f-bfd7-babc8e912c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:52.436693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:52.469173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-251bf383-b7f5-436f-bfd7-babc8e912c69 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:52.472993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-251bf383-b7f5-436f-bfd7-babc8e912c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:52.479048 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3328/6651] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:52.490360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98665c33-a800-4a72-ae81-b36fada80e4d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:52.491873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98665c33-a800-4a72-ae81-b36fada80e4d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:52.492258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98665c33-a800-4a72-ae81-b36fada80e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:52.532817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-98665c33-a800-4a72-ae81-b36fada80e4d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:52.536381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-98665c33-a800-4a72-ae81-b36fada80e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:52.607682 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3324/6652] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:52.620195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bf383-b7f5-436f-bfd7-babc8e912c69 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:52.624100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-251bf383-b7f5-436f-bfd7-babc8e912c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:52.670502 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3329/6653] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:52.674483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98665c33-a800-4a72-ae81-b36fada80e4d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:52.692065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98665c33-a800-4a72-ae81-b36fada80e4d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:52.704552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414de4b-1007-4dc6-a95a-83cc500f24e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:52.705818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414de4b-1007-4dc6-a95a-83cc500f24e6 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:52.706593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414de4b-1007-4dc6-a95a-83cc500f24e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:52.708326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414de4b-1007-4dc6-a95a-83cc500f24e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:52.709222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414de4b-1007-4dc6-a95a-83cc500f24e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:18:52.709749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414de4b-1007-4dc6-a95a-83cc500f24e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:52.711667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414de4b-1007-4dc6-a95a-83cc500f24e6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:52.735867 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3330/6654] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:18:52.736905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414de4b-1007-4dc6-a95a-83cc500f24e6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:52.750922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bf383-b7f5-436f-bfd7-babc8e912c69 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:52.754515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414de4b-1007-4dc6-a95a-83cc500f24e6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:52.761011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f36cd-a22f-4045-add1-b1c34c8b0b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:52.761459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583f857-9b0e-4c27-9c86-5e5a44256f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:52.761680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f36cd-a22f-4045-add1-b1c34c8b0b89 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:52.761958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f36cd-a22f-4045-add1-b1c34c8b0b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:52.762080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583f857-9b0e-4c27-9c86-5e5a44256f2a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:52.762242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f36cd-a22f-4045-add1-b1c34c8b0b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:52.762380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583f857-9b0e-4c27-9c86-5e5a44256f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:52.762628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583f857-9b0e-4c27-9c86-5e5a44256f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:52.763243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583f857-9b0e-4c27-9c86-5e5a44256f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:52.765159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583f857-9b0e-4c27-9c86-5e5a44256f2a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:52.777241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f36cd-a22f-4045-add1-b1c34c8b0b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:52.779154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f36cd-a22f-4045-add1-b1c34c8b0b89 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:52.815983 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3331/6655] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:18:52 2022] POST /identity/v3/projects => generated 363 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:52.817475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583f857-9b0e-4c27-9c86-5e5a44256f2a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:52.848792 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3325/6656] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:18:52.969834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583f857-9b0e-4c27-9c86-5e5a44256f2a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:52.978366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920b023-6502-4476-bf70-576398224aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:52.979156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920b023-6502-4476-bf70-576398224aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:52.979537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920b023-6502-4476-bf70-576398224aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:52.979896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920b023-6502-4476-bf70-576398224aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:52.980653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920b023-6502-4476-bf70-576398224aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:52.995724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920b023-6502-4476-bf70-576398224aa7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:53.048511 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3332/6657] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:18:52 2022] POST /identity/v3/users => generated 282 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:18:53.050195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f36cd-a22f-4045-add1-b1c34c8b0b89 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:53.057150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:53.071127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f36cd-a22f-4045-add1-b1c34c8b0b89 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:53.082135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cf5e5-eb52-4a85-9780-8715ce38b633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:53.082908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cf5e5-eb52-4a85-9780-8715ce38b633 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:53.083261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cf5e5-eb52-4a85-9780-8715ce38b633 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:53.083645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cf5e5-eb52-4a85-9780-8715ce38b633 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:53.084372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cf5e5-eb52-4a85-9780-8715ce38b633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:53.086235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cf5e5-eb52-4a85-9780-8715ce38b633 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:53.103226 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3326/6658] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:53.105591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920b023-6502-4476-bf70-576398224aa7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:53.116757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920b023-6502-4476-bf70-576398224aa7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:53.132419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19760bc5-d65b-4aa2-b3ab-59aeeee0112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:53.133054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19760bc5-d65b-4aa2-b3ab-59aeeee0112e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:53.133366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19760bc5-d65b-4aa2-b3ab-59aeeee0112e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:53.133646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19760bc5-d65b-4aa2-b3ab-59aeeee0112e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:53.134308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19760bc5-d65b-4aa2-b3ab-59aeeee0112e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:53.135943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19760bc5-d65b-4aa2-b3ab-59aeeee0112e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:53.185077 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3333/6659] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:53.188211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cf5e5-eb52-4a85-9780-8715ce38b633 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:53.207934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cf5e5-eb52-4a85-9780-8715ce38b633 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:53.215222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab226ca2-fe99-4653-af8e-1acb949cd6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:53.216707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab226ca2-fe99-4653-af8e-1acb949cd6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:53.217174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab226ca2-fe99-4653-af8e-1acb949cd6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:53.217615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab226ca2-fe99-4653-af8e-1acb949cd6bc admin admin] PATH_INFO: `/v3/projects/ab63c22d5c524f6ab848fcef36225bfb/users/3bbe159be0b843d89b2ac36e3edd15e4/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:53.264666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab226ca2-fe99-4653-af8e-1acb949cd6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab63c22d5c524f6ab848fcef36225bfb, user_id=3bbe159be0b843d89b2ac36e3edd15e4, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:53.271172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab226ca2-fe99-4653-af8e-1acb949cd6bc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:53.303387 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3327/6660] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:53 2022] PUT /identity/v3/projects/ab63c22d5c524f6ab848fcef36225bfb/users/3bbe159be0b843d89b2ac36e3edd15e4/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:53.315384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892022-b7c2-42b0-aa56-b328d43999f7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:53.315658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892022-b7c2-42b0-aa56-b328d43999f7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:53.315959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892022-b7c2-42b0-aa56-b328d43999f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:53.377473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2c892022-b7c2-42b0-aa56-b328d43999f7 None None] MFA Rules not processed for user `3bbe159be0b843d89b2ac36e3edd15e4`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:53.378772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2c892022-b7c2-42b0-aa56-b328d43999f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:53.421854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:53.570232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab226ca2-fe99-4653-af8e-1acb949cd6bc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:53.572321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ab226ca2-fe99-4653-af8e-1acb949cd6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:53.762483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab226ca2-fe99-4653-af8e-1acb949cd6bc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:53.769097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:53.769909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:53.770850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:53.771242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] PATH_INFO: `/v3/projects/28b0a6c5619d46929802ef47ff71127f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:53.772499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b0a6c5619d46929802ef47ff71127f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:53.775518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:53.792108 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3334/6661] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:53.798461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892022-b7c2-42b0-aa56-b328d43999f7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:53.813809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892022-b7c2-42b0-aa56-b328d43999f7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:53.819823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295490d9-7cd5-43ff-a4a6-e0dadbe97d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:53.820672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295490d9-7cd5-43ff-a4a6-e0dadbe97d5d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:53.821808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295490d9-7cd5-43ff-a4a6-e0dadbe97d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:53.822274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295490d9-7cd5-43ff-a4a6-e0dadbe97d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:53.823210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295490d9-7cd5-43ff-a4a6-e0dadbe97d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:53.826466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295490d9-7cd5-43ff-a4a6-e0dadbe97d5d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:53.873308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b0a6c5619d46929802ef47ff71127f', 'request_id': 'req-142e8c89-85f6-4afd-97ea-c19f1ddc5873'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:53.886354 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3335/6662] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:18:53 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:53.889898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295490d9-7cd5-43ff-a4a6-e0dadbe97d5d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:53.892954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b0a6c5619d46929802ef47ff71127f', 'request_id': 'req-142e8c89-85f6-4afd-97ea-c19f1ddc5873'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:53.901968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b0a6c5619d46929802ef47ff71127f', 'request_id': 'req-142e8c89-85f6-4afd-97ea-c19f1ddc5873'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:53.931061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] The token cache is being invalidate because project 28b0a6c5619d46929802ef47ff71127f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:18:53.931355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:53.932082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:53.941450 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3328/6663] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:53 2022] DELETE /identity/v3/projects/28b0a6c5619d46929802ef47ff71127f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:53.942451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:53.943872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:54.041978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8c89-85f6-4afd-97ea-c19f1ddc5873 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:54.051239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295490d9-7cd5-43ff-a4a6-e0dadbe97d5d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:54.054293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bec8c-b953-4ee6-b64e-bc0aa7ef48a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:54.055756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bec8c-b953-4ee6-b64e-bc0aa7ef48a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:54.056042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bec8c-b953-4ee6-b64e-bc0aa7ef48a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:54.056317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bec8c-b953-4ee6-b64e-bc0aa7ef48a9 admin admin] PATH_INFO: `/v3/users/b35cf541612146d2b6c05b38e76f6413` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:54.057910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bec8c-b953-4ee6-b64e-bc0aa7ef48a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35cf541612146d2b6c05b38e76f6413)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:54.060792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bec8c-b953-4ee6-b64e-bc0aa7ef48a9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:54.062298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:54.077203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eecf3-cd57-4b50-b942-6088bea6f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:54.077998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eecf3-cd57-4b50-b942-6088bea6f442 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:54.078385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eecf3-cd57-4b50-b942-6088bea6f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:54.078980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eecf3-cd57-4b50-b942-6088bea6f442 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:54.079733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494eecf3-cd57-4b50-b942-6088bea6f442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:54.082033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494eecf3-cd57-4b50-b942-6088bea6f442 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:54.128578 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3336/6664] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:18:53 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:54.130014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eecf3-cd57-4b50-b942-6088bea6f442 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:54.136191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-494eecf3-cd57-4b50-b942-6088bea6f442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:54.140165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-521bec8c-b953-4ee6-b64e-bc0aa7ef48a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35cf541612146d2b6c05b38e76f6413'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:54.149233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-521bec8c-b953-4ee6-b64e-bc0aa7ef48a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35cf541612146d2b6c05b38e76f6413'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:54.149928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-521bec8c-b953-4ee6-b64e-bc0aa7ef48a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35cf541612146d2b6c05b38e76f6413'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:54.150579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-521bec8c-b953-4ee6-b64e-bc0aa7ef48a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35cf541612146d2b6c05b38e76f6413'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:54.157861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eecf3-cd57-4b50-b942-6088bea6f442 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:54.163786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ef81f-26a2-48da-ba8e-6966014394d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:54.164809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ef81f-26a2-48da-ba8e-6966014394d8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:54.165052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-521bec8c-b953-4ee6-b64e-bc0aa7ef48a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35cf541612146d2b6c05b38e76f6413'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:54.165558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ef81f-26a2-48da-ba8e-6966014394d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:54.166043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ef81f-26a2-48da-ba8e-6966014394d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:54.167022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ef81f-26a2-48da-ba8e-6966014394d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:54.169677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ef81f-26a2-48da-ba8e-6966014394d8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:54.192385 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3337/6665] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:54.193954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ef81f-26a2-48da-ba8e-6966014394d8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:54.196285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6c5ef81f-26a2-48da-ba8e-6966014394d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:54.212725 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3329/6666] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:53 2022] DELETE /identity/v3/users/b35cf541612146d2b6c05b38e76f6413 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:54.214698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ef81f-26a2-48da-ba8e-6966014394d8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:54.307202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f6ec4-360c-4775-bf02-b6542350a40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:54.312256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6ec4-360c-4775-bf02-b6542350a40c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:54.313119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6ec4-360c-4775-bf02-b6542350a40c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:54.313431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6ec4-360c-4775-bf02-b6542350a40c admin admin] PATH_INFO: `/v3/projects/a513c55eab1e4833a6d6aa5fab194a00/users/4904a7cfda5c42de9858cc99a79c3533/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:54.337553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f6ec4-360c-4775-bf02-b6542350a40c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a513c55eab1e4833a6d6aa5fab194a00, user_id=4904a7cfda5c42de9858cc99a79c3533, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:54.340485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f6ec4-360c-4775-bf02-b6542350a40c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:54.345657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:54.367960 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3338/6667] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:54 2022] PUT /identity/v3/projects/a513c55eab1e4833a6d6aa5fab194a00/users/4904a7cfda5c42de9858cc99a79c3533/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:54.372232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bec8c-b953-4ee6-b64e-bc0aa7ef48a9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:54.385306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bec8c-b953-4ee6-b64e-bc0aa7ef48a9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:54.522414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1ec12-8c4e-4292-bffb-4419203df801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:54.523487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1ec12-8c4e-4292-bffb-4419203df801 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:54.526707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1ec12-8c4e-4292-bffb-4419203df801 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:54.526707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1ec12-8c4e-4292-bffb-4419203df801 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:54.529552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1ec12-8c4e-4292-bffb-4419203df801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:54.535177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1ec12-8c4e-4292-bffb-4419203df801 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:54.572190 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3330/6668] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:18:54.575514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f6ec4-360c-4775-bf02-b6542350a40c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:54.589524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f6ec4-360c-4775-bf02-b6542350a40c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:54.599867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d958a-f176-4543-958e-5033c3f193a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:54.601218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d958a-f176-4543-958e-5033c3f193a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:54.601752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d958a-f176-4543-958e-5033c3f193a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:54.602373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d958a-f176-4543-958e-5033c3f193a2 admin admin] PATH_INFO: `/v3/projects/a513c55eab1e4833a6d6aa5fab194a00/users/4904a7cfda5c42de9858cc99a79c3533/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:54.607477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d958a-f176-4543-958e-5033c3f193a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a513c55eab1e4833a6d6aa5fab194a00, user_id=4904a7cfda5c42de9858cc99a79c3533, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:54.633930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d958a-f176-4543-958e-5033c3f193a2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:54.660897 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3339/6669] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:54 2022] PUT /identity/v3/projects/a513c55eab1e4833a6d6aa5fab194a00/users/4904a7cfda5c42de9858cc99a79c3533/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:54.674452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3d73b-4431-44c8-a9e9-ed40966cf7be None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:54.675180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3d73b-4431-44c8-a9e9-ed40966cf7be None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:54.675612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3d73b-4431-44c8-a9e9-ed40966cf7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:54.723552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-beb3d73b-4431-44c8-a9e9-ed40966cf7be None None] MFA Rules not processed for user `4904a7cfda5c42de9858cc99a79c3533`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:54.739643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-beb3d73b-4431-44c8-a9e9-ed40966cf7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:54.867406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:54.875885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3331/6670] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:54.894357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d958a-f176-4543-958e-5033c3f193a2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:54.897442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2a2d958a-f176-4543-958e-5033c3f193a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:55.011736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d958a-f176-4543-958e-5033c3f193a2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:55.014209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3d73b-4431-44c8-a9e9-ed40966cf7be None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:55.015710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-beb3d73b-4431-44c8-a9e9-ed40966cf7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:55.018790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b1df6-208d-42df-a8b6-34d1f725be5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:55.019472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b1df6-208d-42df-a8b6-34d1f725be5c service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:55.019755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b1df6-208d-42df-a8b6-34d1f725be5c service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:55.020184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b1df6-208d-42df-a8b6-34d1f725be5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:55.033666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b1df6-208d-42df-a8b6-34d1f725be5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:55.035635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b1df6-208d-42df-a8b6-34d1f725be5c service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:55.056587 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3340/6671] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:55.126661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3d73b-4431-44c8-a9e9-ed40966cf7be None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:55.132306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae400e-7e55-467e-94c6-542cf9fa6af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:55.133178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae400e-7e55-467e-94c6-542cf9fa6af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:55.133686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae400e-7e55-467e-94c6-542cf9fa6af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:55.134280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae400e-7e55-467e-94c6-542cf9fa6af5 admin admin] PATH_INFO: `/v3/projects/f42b4d919ee04965a2ccdae4648c1560` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:55.135938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae400e-7e55-467e-94c6-542cf9fa6af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42b4d919ee04965a2ccdae4648c1560)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:55.139052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae400e-7e55-467e-94c6-542cf9fa6af5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:55.186952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b1df6-208d-42df-a8b6-34d1f725be5c service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:55.219680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b1df6-208d-42df-a8b6-34d1f725be5c service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:55.243418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-85ae400e-7e55-467e-94c6-542cf9fa6af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42b4d919ee04965a2ccdae4648c1560', 'request_id': 'req-85ae400e-7e55-467e-94c6-542cf9fa6af5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:55.255364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-85ae400e-7e55-467e-94c6-542cf9fa6af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42b4d919ee04965a2ccdae4648c1560', 'request_id': 'req-85ae400e-7e55-467e-94c6-542cf9fa6af5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:55.264914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-85ae400e-7e55-467e-94c6-542cf9fa6af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42b4d919ee04965a2ccdae4648c1560', 'request_id': 'req-85ae400e-7e55-467e-94c6-542cf9fa6af5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:55.287350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-85ae400e-7e55-467e-94c6-542cf9fa6af5 admin admin] The token cache is being invalidate because project f42b4d919ee04965a2ccdae4648c1560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:18:55.287857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-85ae400e-7e55-467e-94c6-542cf9fa6af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:55.288620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-85ae400e-7e55-467e-94c6-542cf9fa6af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:55.290943 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3332/6672] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:55 2022] DELETE /identity/v3/projects/f42b4d919ee04965a2ccdae4648c1560 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:55.295549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015d25f-6774-439c-a012-edef6dfd56da None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:55.295963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015d25f-6774-439c-a012-edef6dfd56da None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:55.296496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015d25f-6774-439c-a012-edef6dfd56da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:55.323127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7015d25f-6774-439c-a012-edef6dfd56da None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:55.324656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7015d25f-6774-439c-a012-edef6dfd56da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:55.442042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d5fc1-6582-48dc-86c9-6e4ce6c14c17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:55.443242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d5fc1-6582-48dc-86c9-6e4ce6c14c17 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:55.443606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d5fc1-6582-48dc-86c9-6e4ce6c14c17 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:55.444212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d5fc1-6582-48dc-86c9-6e4ce6c14c17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:55.447021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-349d5fc1-6582-48dc-86c9-6e4ce6c14c17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:55.493971 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3333/6673] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:18:55.505236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd3c50-3d5d-4392-a6f8-3134a1c62acd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:55.505630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd3c50-3d5d-4392-a6f8-3134a1c62acd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:55.505855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd3c50-3d5d-4392-a6f8-3134a1c62acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:55.530552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-49cd3c50-3d5d-4392-a6f8-3134a1c62acd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:55.531907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-49cd3c50-3d5d-4392-a6f8-3134a1c62acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:55.546348 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3334/6674] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:55.551530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd3c50-3d5d-4392-a6f8-3134a1c62acd None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:55.573106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd3c50-3d5d-4392-a6f8-3134a1c62acd None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:55.582523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d5fc1-6582-48dc-86c9-6e4ce6c14c17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:55.584551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d5fc1-6582-48dc-86c9-6e4ce6c14c17 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:55.588847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2f5c1-be71-4e75-92f3-8b9897169c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:55.590788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2f5c1-be71-4e75-92f3-8b9897169c6e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:55.591197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2f5c1-be71-4e75-92f3-8b9897169c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:55.593352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2f5c1-be71-4e75-92f3-8b9897169c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:55.594115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2f5c1-be71-4e75-92f3-8b9897169c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:18:55.594501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2f5c1-be71-4e75-92f3-8b9897169c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:55.599729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2f5c1-be71-4e75-92f3-8b9897169c6e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:55.615130 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3341/6675] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:18:55.628827 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3335/6676] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:18:55.630047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d5fc1-6582-48dc-86c9-6e4ce6c14c17 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:55.647207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d5fc1-6582-48dc-86c9-6e4ce6c14c17 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:55.652691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302854e5-f915-4f28-9367-e049da05c2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:55.653991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302854e5-f915-4f28-9367-e049da05c2ab admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:55.654467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302854e5-f915-4f28-9367-e049da05c2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:55.654825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302854e5-f915-4f28-9367-e049da05c2ab admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:55.655524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302854e5-f915-4f28-9367-e049da05c2ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:55.657518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302854e5-f915-4f28-9367-e049da05c2ab admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:55.711836 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3342/6677] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:18:55 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:55.713332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2f5c1-be71-4e75-92f3-8b9897169c6e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:55.736047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2f5c1-be71-4e75-92f3-8b9897169c6e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:55.755874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:55.880044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a3a23-48d7-44a0-9b93-9d2fb3af4872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:55.881071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3a23-48d7-44a0-9b93-9d2fb3af4872 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:55.885812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3a23-48d7-44a0-9b93-9d2fb3af4872 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:55.885812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3a23-48d7-44a0-9b93-9d2fb3af4872 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:55.885812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a3a23-48d7-44a0-9b93-9d2fb3af4872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:55.885812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a3a23-48d7-44a0-9b93-9d2fb3af4872 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:55.915158 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3336/6678] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:18:55 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:18:55.919528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302854e5-f915-4f28-9367-e049da05c2ab admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:55.937295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302854e5-f915-4f28-9367-e049da05c2ab admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:55.947845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae58b5-6b93-4ea8-a55b-111f8da224a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:55.949376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae58b5-6b93-4ea8-a55b-111f8da224a7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:55.952445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae58b5-6b93-4ea8-a55b-111f8da224a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:55.953620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae58b5-6b93-4ea8-a55b-111f8da224a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:55.954527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae58b5-6b93-4ea8-a55b-111f8da224a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:55.959356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae58b5-6b93-4ea8-a55b-111f8da224a7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:55.979421 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3343/6679] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:55.984037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a3a23-48d7-44a0-9b93-9d2fb3af4872 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:55.997348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a3a23-48d7-44a0-9b93-9d2fb3af4872 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:56.006179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd79a79-f348-499f-b6cb-e44a576c4c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:56.006834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd79a79-f348-499f-b6cb-e44a576c4c67 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:56.007115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd79a79-f348-499f-b6cb-e44a576c4c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:56.007389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd79a79-f348-499f-b6cb-e44a576c4c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:56.008044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd79a79-f348-499f-b6cb-e44a576c4c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:56.010103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd79a79-f348-499f-b6cb-e44a576c4c67 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:56.039070 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3337/6680] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:18:56.039697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae58b5-6b93-4ea8-a55b-111f8da224a7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:56.051794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae58b5-6b93-4ea8-a55b-111f8da224a7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:56.057321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42070a-49a0-46a8-a5a8-378096ac6f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:56.058059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42070a-49a0-46a8-a5a8-378096ac6f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:56.058586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42070a-49a0-46a8-a5a8-378096ac6f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:56.058586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42070a-49a0-46a8-a5a8-378096ac6f4b admin admin] PATH_INFO: `/v3/projects/04ea7cbf6a7b4308beae5549b270f971/users/49bba657d34043c5a9e315ecf287e875/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:56.061523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:56.082010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42070a-49a0-46a8-a5a8-378096ac6f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ea7cbf6a7b4308beae5549b270f971, user_id=49bba657d34043c5a9e315ecf287e875, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:56.085398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42070a-49a0-46a8-a5a8-378096ac6f4b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:56.108762 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3344/6681] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:56 2022] PUT /identity/v3/projects/04ea7cbf6a7b4308beae5549b270f971/users/49bba657d34043c5a9e315ecf287e875/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:56.118794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d06f3-ac71-4093-97aa-2ae940d39dac None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:56.119333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d06f3-ac71-4093-97aa-2ae940d39dac None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:56.119612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d06f3-ac71-4093-97aa-2ae940d39dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:56.187796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c82d06f3-ac71-4093-97aa-2ae940d39dac None None] MFA Rules not processed for user `49bba657d34043c5a9e315ecf287e875`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:56.189037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c82d06f3-ac71-4093-97aa-2ae940d39dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:56.306051 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3338/6682] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:56.307013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42070a-49a0-46a8-a5a8-378096ac6f4b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:56.404367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42070a-49a0-46a8-a5a8-378096ac6f4b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:56.412071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85580797-c2ee-439a-9e58-3e3a668a84d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:56.413417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85580797-c2ee-439a-9e58-3e3a668a84d7 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:56.414030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85580797-c2ee-439a-9e58-3e3a668a84d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:56.414428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85580797-c2ee-439a-9e58-3e3a668a84d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:56.415325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85580797-c2ee-439a-9e58-3e3a668a84d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:56.420933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85580797-c2ee-439a-9e58-3e3a668a84d7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:56.517243 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3345/6683] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:18:56 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:56.518285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d06f3-ac71-4093-97aa-2ae940d39dac None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:56.549467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d06f3-ac71-4093-97aa-2ae940d39dac None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:56.678795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a843a-2477-442a-81bf-45a2cb2d9e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:56.679437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a843a-2477-442a-81bf-45a2cb2d9e04 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:56.679716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a843a-2477-442a-81bf-45a2cb2d9e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:56.680334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a843a-2477-442a-81bf-45a2cb2d9e04 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:56.680663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a843a-2477-442a-81bf-45a2cb2d9e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:56.682615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a843a-2477-442a-81bf-45a2cb2d9e04 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:56.731894 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3339/6684] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:18:56 2022] POST /identity/v3/users => generated 296 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:18:56.735908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85580797-c2ee-439a-9e58-3e3a668a84d7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:56.759590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85580797-c2ee-439a-9e58-3e3a668a84d7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:56.775666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fffcf7-755f-4065-b023-a1884a63c8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:56.776300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fffcf7-755f-4065-b023-a1884a63c8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:56.776579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fffcf7-755f-4065-b023-a1884a63c8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:56.776848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fffcf7-755f-4065-b023-a1884a63c8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:56.777543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fffcf7-755f-4065-b023-a1884a63c8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:56.779172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fffcf7-755f-4065-b023-a1884a63c8d7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:56.799959 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3346/6685] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:56.804562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a843a-2477-442a-81bf-45a2cb2d9e04 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:56.817837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a843a-2477-442a-81bf-45a2cb2d9e04 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:56.823913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1636e-16a1-4424-bd21-5aea053e204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:56.824832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1636e-16a1-4424-bd21-5aea053e204f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:56.825202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1636e-16a1-4424-bd21-5aea053e204f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:56.826148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1636e-16a1-4424-bd21-5aea053e204f admin admin] PATH_INFO: `/v3/projects/f7cc858b52624d00bebe9bc4a5b79de7/users/65f6cf5a47a94f44a473e5002281e479/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:56.832489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:56.853496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1636e-16a1-4424-bd21-5aea053e204f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cc858b52624d00bebe9bc4a5b79de7, user_id=65f6cf5a47a94f44a473e5002281e479, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:56.867419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1636e-16a1-4424-bd21-5aea053e204f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:56.897540 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3340/6686] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:56 2022] PUT /identity/v3/projects/f7cc858b52624d00bebe9bc4a5b79de7/users/65f6cf5a47a94f44a473e5002281e479/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:56.901412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fffcf7-755f-4065-b023-a1884a63c8d7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:56.916885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fffcf7-755f-4065-b023-a1884a63c8d7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:57.001765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573c339-0d4e-43b8-8fdf-c5f50981e2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:57.002397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573c339-0d4e-43b8-8fdf-c5f50981e2ad admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:57.002685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573c339-0d4e-43b8-8fdf-c5f50981e2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:57.009413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573c339-0d4e-43b8-8fdf-c5f50981e2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:57.011534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573c339-0d4e-43b8-8fdf-c5f50981e2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:57.016077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573c339-0d4e-43b8-8fdf-c5f50981e2ad admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:57.027307 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3347/6687] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:18:57.032487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1636e-16a1-4424-bd21-5aea053e204f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:57.054826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1636e-16a1-4424-bd21-5aea053e204f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:57.065737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f53961-465d-48ff-a9ae-cf81777c9973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:57.067296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f53961-465d-48ff-a9ae-cf81777c9973 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:57.067944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f53961-465d-48ff-a9ae-cf81777c9973 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:57.068434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f53961-465d-48ff-a9ae-cf81777c9973 admin admin] PATH_INFO: `/v3/projects/f7cc858b52624d00bebe9bc4a5b79de7/users/65f6cf5a47a94f44a473e5002281e479/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:57.073432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f53961-465d-48ff-a9ae-cf81777c9973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cc858b52624d00bebe9bc4a5b79de7, user_id=65f6cf5a47a94f44a473e5002281e479, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:57.096655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f53961-465d-48ff-a9ae-cf81777c9973 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:57.117927 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3341/6688] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:18:57 2022] PUT /identity/v3/projects/f7cc858b52624d00bebe9bc4a5b79de7/users/65f6cf5a47a94f44a473e5002281e479/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:57.131216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b6960-bba1-48b2-947c-48bb09cc07bb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:57.131815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b6960-bba1-48b2-947c-48bb09cc07bb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:57.132029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b6960-bba1-48b2-947c-48bb09cc07bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:57.195763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2e5b6960-bba1-48b2-947c-48bb09cc07bb None None] MFA Rules not processed for user `65f6cf5a47a94f44a473e5002281e479`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:57.197145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2e5b6960-bba1-48b2-947c-48bb09cc07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:57.290871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:57.337334 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3348/6689] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:57.359017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f53961-465d-48ff-a9ae-cf81777c9973 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:57.360774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-98f53961-465d-48ff-a9ae-cf81777c9973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:57.466637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f53961-465d-48ff-a9ae-cf81777c9973 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:57.473029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d8443-8b1b-4974-a278-13e7e10c94ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:57.484691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d8443-8b1b-4974-a278-13e7e10c94ba service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:57.492593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d8443-8b1b-4974-a278-13e7e10c94ba service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:57.492889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d8443-8b1b-4974-a278-13e7e10c94ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:57.522167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d8443-8b1b-4974-a278-13e7e10c94ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:57.524082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d8443-8b1b-4974-a278-13e7e10c94ba service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:57.542879 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3342/6690] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:57.733545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b6960-bba1-48b2-947c-48bb09cc07bb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:57.758804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b6960-bba1-48b2-947c-48bb09cc07bb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:57.771100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc691ae0-1587-41e2-b7e6-1e49010114e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:57.772083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691ae0-1587-41e2-b7e6-1e49010114e0 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:57.772439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691ae0-1587-41e2-b7e6-1e49010114e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:57.772781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691ae0-1587-41e2-b7e6-1e49010114e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:57.872555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc691ae0-1587-41e2-b7e6-1e49010114e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:57.874681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc691ae0-1587-41e2-b7e6-1e49010114e0 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:57.890187 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3349/6691] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:58.865461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d8443-8b1b-4974-a278-13e7e10c94ba service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:58.867235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-af0d8443-8b1b-4974-a278-13e7e10c94ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:58.985091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d8443-8b1b-4974-a278-13e7e10c94ba service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:58.992415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:58.994806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:58.995159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:58.995505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] PATH_INFO: `/v3/users/3bbe159be0b843d89b2ac36e3edd15e4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:58.997156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bbe159be0b843d89b2ac36e3edd15e4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:58.999247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:59.070951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bbe159be0b843d89b2ac36e3edd15e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:59.080375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bbe159be0b843d89b2ac36e3edd15e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:59.081468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bbe159be0b843d89b2ac36e3edd15e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:59.082521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bbe159be0b843d89b2ac36e3edd15e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:59.099786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bbe159be0b843d89b2ac36e3edd15e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:18:59.103100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:59.128021 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3343/6692] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:18:58 2022] DELETE /identity/v3/users/3bbe159be0b843d89b2ac36e3edd15e4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:18:59.130401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdb0c9-fe2a-48d2-913d-bf85d75c810f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:59.130866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdb0c9-fe2a-48d2-913d-bf85d75c810f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:59.130977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdb0c9-fe2a-48d2-913d-bf85d75c810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:59.167323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-65cdb0c9-fe2a-48d2-913d-bf85d75c810f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:18:59.168799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-65cdb0c9-fe2a-48d2-913d-bf85d75c810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:59.258754 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3350/6693] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:18:59.266516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:59.267963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:59.363964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d296a3-8bac-4d51-a181-e3c0cbbd7faf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:59.367861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369a25a-7ebe-4ca7-bff8-6230bfada3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:59.368485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369a25a-7ebe-4ca7-bff8-6230bfada3eb service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:59.368766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369a25a-7ebe-4ca7-bff8-6230bfada3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:59.369044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369a25a-7ebe-4ca7-bff8-6230bfada3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:59.380003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369a25a-7ebe-4ca7-bff8-6230bfada3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:59.381393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369a25a-7ebe-4ca7-bff8-6230bfada3eb service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:18:59.392422 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3344/6694] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:18:59.945495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdb0c9-fe2a-48d2-913d-bf85d75c810f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:18:59.947209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-65cdb0c9-fe2a-48d2-913d-bf85d75c810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:18:59.963723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdb0c9-fe2a-48d2-913d-bf85d75c810f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:18:59.970313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:18:59.970965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:18:59.971262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:18:59.971615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] PATH_INFO: `/v3/projects/ab63c22d5c524f6ab848fcef36225bfb` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:18:59.973205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab63c22d5c524f6ab848fcef36225bfb)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:18:59.975159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:00.030931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab63c22d5c524f6ab848fcef36225bfb', 'request_id': 'req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.039443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab63c22d5c524f6ab848fcef36225bfb', 'request_id': 'req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.047402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab63c22d5c524f6ab848fcef36225bfb', 'request_id': 'req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.056556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:00.060884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] The token cache is being invalidate because project ab63c22d5c524f6ab848fcef36225bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:00.061425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.062484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.064221 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3351/6695] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:18:59 2022] DELETE /identity/v3/projects/ab63c22d5c524f6ab848fcef36225bfb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:00.069015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369a25a-7ebe-4ca7-bff8-6230bfada3eb service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:00.078741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369a25a-7ebe-4ca7-bff8-6230bfada3eb service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:00.146860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4c127-b2ce-4b1d-a72e-2393ed029256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:00.147593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4c127-b2ce-4b1d-a72e-2393ed029256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:00.147981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4c127-b2ce-4b1d-a72e-2393ed029256 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:00.148351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4c127-b2ce-4b1d-a72e-2393ed029256 admin admin] PATH_INFO: `/v3/users/4904a7cfda5c42de9858cc99a79c3533` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:00.149662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4c127-b2ce-4b1d-a72e-2393ed029256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4904a7cfda5c42de9858cc99a79c3533)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:00.151738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4c127-b2ce-4b1d-a72e-2393ed029256 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:00.206551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7a4c127-b2ce-4b1d-a72e-2393ed029256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4904a7cfda5c42de9858cc99a79c3533'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.214318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7a4c127-b2ce-4b1d-a72e-2393ed029256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4904a7cfda5c42de9858cc99a79c3533'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.216052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7a4c127-b2ce-4b1d-a72e-2393ed029256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4904a7cfda5c42de9858cc99a79c3533'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.216784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7a4c127-b2ce-4b1d-a72e-2393ed029256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4904a7cfda5c42de9858cc99a79c3533'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.236151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7a4c127-b2ce-4b1d-a72e-2393ed029256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4904a7cfda5c42de9858cc99a79c3533'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.261379 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3345/6696] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:00 2022] DELETE /identity/v3/users/4904a7cfda5c42de9858cc99a79c3533 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:00.542802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:00.544963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:00.566662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ba1ff-1c7a-4b76-a6c5-d6107dce46e9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:00.635020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:00.635661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:00.636108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:00.636395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] PATH_INFO: `/v3/projects/a513c55eab1e4833a6d6aa5fab194a00` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:00.637764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a513c55eab1e4833a6d6aa5fab194a00)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:00.639665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:00.689940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a513c55eab1e4833a6d6aa5fab194a00', 'request_id': 'req-efbb4441-02ac-48f9-ad2a-3693c30047d5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.698101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a513c55eab1e4833a6d6aa5fab194a00', 'request_id': 'req-efbb4441-02ac-48f9-ad2a-3693c30047d5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.704084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a513c55eab1e4833a6d6aa5fab194a00', 'request_id': 'req-efbb4441-02ac-48f9-ad2a-3693c30047d5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.716128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] The token cache is being invalidate because project a513c55eab1e4833a6d6aa5fab194a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:00.716452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.717133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:00.718659 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3352/6697] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:00 2022] DELETE /identity/v3/projects/a513c55eab1e4833a6d6aa5fab194a00 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:00.723883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac059bf-dc0d-4638-9b1c-0a4f07b47259 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:00.724387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac059bf-dc0d-4638-9b1c-0a4f07b47259 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:00.724731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac059bf-dc0d-4638-9b1c-0a4f07b47259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:00.745048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-eac059bf-dc0d-4638-9b1c-0a4f07b47259 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:00.746292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eac059bf-dc0d-4638-9b1c-0a4f07b47259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:00.756287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:00.811281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:00.813835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:00.835440 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3346/6698] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:00.837911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd11f6a-1b5b-4340-9d95-291fc0258c17 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:00.838357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd11f6a-1b5b-4340-9d95-291fc0258c17 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:00.838729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd11f6a-1b5b-4340-9d95-291fc0258c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:00.864066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1cd11f6a-1b5b-4340-9d95-291fc0258c17 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:00.865761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1cd11f6a-1b5b-4340-9d95-291fc0258c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:00.875071 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3347/6699] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:00.879405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd11f6a-1b5b-4340-9d95-291fc0258c17 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:00.889552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd11f6a-1b5b-4340-9d95-291fc0258c17 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:00.890611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb4441-02ac-48f9-ad2a-3693c30047d5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:00.894931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7e5b9-4fc3-4ea5-be4e-c35351a96c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:00.895107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a3646-7f18-4d67-8524-b1e614a8dfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:00.895332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7e5b9-4fc3-4ea5-be4e-c35351a96c30 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:00.895636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7e5b9-4fc3-4ea5-be4e-c35351a96c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:00.895747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a3646-7f18-4d67-8524-b1e614a8dfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:00.895934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7e5b9-4fc3-4ea5-be4e-c35351a96c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:00.896036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a3646-7f18-4d67-8524-b1e614a8dfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:00.896228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a3646-7f18-4d67-8524-b1e614a8dfb1 admin admin] PATH_INFO: `/v3/users/49bba657d34043c5a9e315ecf287e875` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:00.896534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7e5b9-4fc3-4ea5-be4e-c35351a96c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:00.897772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7e5b9-4fc3-4ea5-be4e-c35351a96c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:00.897911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a3646-7f18-4d67-8524-b1e614a8dfb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49bba657d34043c5a9e315ecf287e875)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:00.898724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7e5b9-4fc3-4ea5-be4e-c35351a96c30 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:00.899550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a3646-7f18-4d67-8524-b1e614a8dfb1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:00.915944 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3348/6700] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:19:00.920936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7e5b9-4fc3-4ea5-be4e-c35351a96c30 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:00.936973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7e5b9-4fc3-4ea5-be4e-c35351a96c30 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:00.948594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56176dd1-6cb2-4220-aac9-47006cb86f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:00.953036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56176dd1-6cb2-4220-aac9-47006cb86f32 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:00.953325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56176dd1-6cb2-4220-aac9-47006cb86f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:00.953542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56176dd1-6cb2-4220-aac9-47006cb86f32 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:00.954176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56176dd1-6cb2-4220-aac9-47006cb86f32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:00.958597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56176dd1-6cb2-4220-aac9-47006cb86f32 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:00.959166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:00.994845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e24a3646-7f18-4d67-8524-b1e614a8dfb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49bba657d34043c5a9e315ecf287e875'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:01.000722 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3349/6701] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:00 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:01.005469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56176dd1-6cb2-4220-aac9-47006cb86f32 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:01.013490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e24a3646-7f18-4d67-8524-b1e614a8dfb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49bba657d34043c5a9e315ecf287e875'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:01.014312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e24a3646-7f18-4d67-8524-b1e614a8dfb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49bba657d34043c5a9e315ecf287e875'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:01.015074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e24a3646-7f18-4d67-8524-b1e614a8dfb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49bba657d34043c5a9e315ecf287e875'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:01.031390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e24a3646-7f18-4d67-8524-b1e614a8dfb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49bba657d34043c5a9e315ecf287e875'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:01.058830 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3353/6702] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:00 2022] DELETE /identity/v3/users/49bba657d34043c5a9e315ecf287e875 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:01.060482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd020f-7d42-4e14-95a1-f83df24fdeb4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:01.060766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd020f-7d42-4e14-95a1-f83df24fdeb4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:01.061038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd020f-7d42-4e14-95a1-f83df24fdeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:01.081612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f2bd020f-7d42-4e14-95a1-f83df24fdeb4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:01.082834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f2bd020f-7d42-4e14-95a1-f83df24fdeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:01.100691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56176dd1-6cb2-4220-aac9-47006cb86f32 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:01.153704 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3354/6703] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:01.163891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd020f-7d42-4e14-95a1-f83df24fdeb4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:01.165589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f2bd020f-7d42-4e14-95a1-f83df24fdeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:01.178741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a23eb-2166-4950-bb90-7734e2dbd394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:01.179360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a23eb-2166-4950-bb90-7734e2dbd394 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:01.179634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a23eb-2166-4950-bb90-7734e2dbd394 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:01.180382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a23eb-2166-4950-bb90-7734e2dbd394 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:01.181075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a23eb-2166-4950-bb90-7734e2dbd394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:01.182984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a23eb-2166-4950-bb90-7734e2dbd394 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:01.209908 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3350/6704] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:01 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:01.214702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a23eb-2166-4950-bb90-7734e2dbd394 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:01.217747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-598a23eb-2166-4950-bb90-7734e2dbd394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:01.231432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a23eb-2166-4950-bb90-7734e2dbd394 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:01.235993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd020f-7d42-4e14-95a1-f83df24fdeb4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:01.237504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669432b-ec51-49d5-8c25-1c3edcb2accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:01.238230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669432b-ec51-49d5-8c25-1c3edcb2accc admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:01.239095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669432b-ec51-49d5-8c25-1c3edcb2accc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:01.239513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669432b-ec51-49d5-8c25-1c3edcb2accc admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:01.240671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669432b-ec51-49d5-8c25-1c3edcb2accc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:01.241520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b79a51-6f84-4543-bb2b-04dca1349ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:01.241907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669432b-ec51-49d5-8c25-1c3edcb2accc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:01.243915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b79a51-6f84-4543-bb2b-04dca1349ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:01.243915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b79a51-6f84-4543-bb2b-04dca1349ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:01.243915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b79a51-6f84-4543-bb2b-04dca1349ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:01.253914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b79a51-6f84-4543-bb2b-04dca1349ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:01.255609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:01.255923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b79a51-6f84-4543-bb2b-04dca1349ba4 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:01.264119 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3351/6705] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:01.269241 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3355/6706] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:01.274222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669432b-ec51-49d5-8c25-1c3edcb2accc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:01.286961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669432b-ec51-49d5-8c25-1c3edcb2accc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:01.293091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380b475-6934-4ba6-a179-34bf08bc23ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:01.293837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380b475-6934-4ba6-a179-34bf08bc23ac admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:01.294178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380b475-6934-4ba6-a179-34bf08bc23ac admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:01.294517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380b475-6934-4ba6-a179-34bf08bc23ac admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:01.295279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380b475-6934-4ba6-a179-34bf08bc23ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:01.297018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380b475-6934-4ba6-a179-34bf08bc23ac admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:01.314017 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3352/6707] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:01.316409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b79a51-6f84-4543-bb2b-04dca1349ba4 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:01.335860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b79a51-6f84-4543-bb2b-04dca1349ba4 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:01.343330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac4afd-d8ef-4778-ad37-f328c2c3a707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:01.344404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac4afd-d8ef-4778-ad37-f328c2c3a707 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:01.344741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac4afd-d8ef-4778-ad37-f328c2c3a707 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:01.344950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac4afd-d8ef-4778-ad37-f328c2c3a707 admin admin] PATH_INFO: `/v3/projects/7aa90a708c724f4bb994fc5e434c0691/users/2a490f36457c4ab8b4f3d57469d3d9dd/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:01.371362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac4afd-d8ef-4778-ad37-f328c2c3a707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa90a708c724f4bb994fc5e434c0691, user_id=2a490f36457c4ab8b4f3d57469d3d9dd, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:01.375075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac4afd-d8ef-4778-ad37-f328c2c3a707 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:01.397369 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3356/6708] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:01 2022] PUT /identity/v3/projects/7aa90a708c724f4bb994fc5e434c0691/users/2a490f36457c4ab8b4f3d57469d3d9dd/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:01.509057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1df241-bb39-4151-bba6-db7aaafe975c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:01.509391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1df241-bb39-4151-bba6-db7aaafe975c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:01.509686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1df241-bb39-4151-bba6-db7aaafe975c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:01.550203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ff1df241-bb39-4151-bba6-db7aaafe975c None None] MFA Rules not processed for user `2a490f36457c4ab8b4f3d57469d3d9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:01.551563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ff1df241-bb39-4151-bba6-db7aaafe975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:01.660549 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3353/6709] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:01.665878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac4afd-d8ef-4778-ad37-f328c2c3a707 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:01.704548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:01.742987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac4afd-d8ef-4778-ad37-f328c2c3a707 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:01.749938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e844e4a-b680-4ac8-9b73-7797458f859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:01.750972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e844e4a-b680-4ac8-9b73-7797458f859f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:01.750972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e844e4a-b680-4ac8-9b73-7797458f859f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:01.751297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e844e4a-b680-4ac8-9b73-7797458f859f admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:01.751937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e844e4a-b680-4ac8-9b73-7797458f859f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:01.754370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e844e4a-b680-4ac8-9b73-7797458f859f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:01.781826 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3357/6710] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:01 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:01.785986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1df241-bb39-4151-bba6-db7aaafe975c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:01.799303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1df241-bb39-4151-bba6-db7aaafe975c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:01.852021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e844e4a-b680-4ac8-9b73-7797458f859f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:01.854034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0e844e4a-b680-4ac8-9b73-7797458f859f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:01.872986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb3c95-1ee4-4d60-a38f-92253a730258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:01.873651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb3c95-1ee4-4d60-a38f-92253a730258 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:01.873919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb3c95-1ee4-4d60-a38f-92253a730258 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:01.874185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb3c95-1ee4-4d60-a38f-92253a730258 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:01.874805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb3c95-1ee4-4d60-a38f-92253a730258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:01.878342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb3c95-1ee4-4d60-a38f-92253a730258 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:01.905416 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3354/6711] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:01 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:19:01.909870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb3c95-1ee4-4d60-a38f-92253a730258 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:01.923318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb3c95-1ee4-4d60-a38f-92253a730258 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:01.931130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba268f-62b4-4bfd-8422-eab40c259431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:01.931821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba268f-62b4-4bfd-8422-eab40c259431 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:01.932229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba268f-62b4-4bfd-8422-eab40c259431 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:01.932513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba268f-62b4-4bfd-8422-eab40c259431 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:01.933235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba268f-62b4-4bfd-8422-eab40c259431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:01.935585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba268f-62b4-4bfd-8422-eab40c259431 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:01.943612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e844e4a-b680-4ac8-9b73-7797458f859f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:01.947156 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3355/6712] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:19:01.951518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:01.951879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba268f-62b4-4bfd-8422-eab40c259431 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:01.952160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:01.952443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:01.952716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] PATH_INFO: `/v3/projects/04ea7cbf6a7b4308beae5549b270f971` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:01.953939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ea7cbf6a7b4308beae5549b270f971)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:01.955900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:01.962350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba268f-62b4-4bfd-8422-eab40c259431 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:01.967756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff6bc8-dfba-477a-9e13-09f8d81d50fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:01.968483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff6bc8-dfba-477a-9e13-09f8d81d50fc admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:01.968834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff6bc8-dfba-477a-9e13-09f8d81d50fc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:01.969217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff6bc8-dfba-477a-9e13-09f8d81d50fc admin admin] PATH_INFO: `/v3/projects/0908ff2d2bbe4588944e21865be48635/users/79b0f79082834c85a6fa8d6746feb6b6/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:01.985817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff6bc8-dfba-477a-9e13-09f8d81d50fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0908ff2d2bbe4588944e21865be48635, user_id=79b0f79082834c85a6fa8d6746feb6b6, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:01.988817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff6bc8-dfba-477a-9e13-09f8d81d50fc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:02.006758 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3356/6713] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:01 2022] PUT /identity/v3/projects/0908ff2d2bbe4588944e21865be48635/users/79b0f79082834c85a6fa8d6746feb6b6/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:02.010621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff6bc8-dfba-477a-9e13-09f8d81d50fc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:02.030788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ea7cbf6a7b4308beae5549b270f971', 'request_id': 'req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:02.045709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ea7cbf6a7b4308beae5549b270f971', 'request_id': 'req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:02.058104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ea7cbf6a7b4308beae5549b270f971', 'request_id': 'req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:02.074602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] The token cache is being invalidate because project 04ea7cbf6a7b4308beae5549b270f971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:02.075442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:02.076106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:02.076225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:02.078532 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3358/6714] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:01 2022] DELETE /identity/v3/projects/04ea7cbf6a7b4308beae5549b270f971 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:02.082250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:02.085406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:02.117881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff6bc8-dfba-477a-9e13-09f8d81d50fc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:02.147053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:02.180136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3d5c6-9f3a-4097-be76-26bd5901b3b2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:02.186409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:02.187057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:02.187339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:02.187614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] PATH_INFO: `/v3/users/65f6cf5a47a94f44a473e5002281e479` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:02.188912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f6cf5a47a94f44a473e5002281e479)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:02.191213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:02.208906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa11126-df58-4cc6-9cdd-09e0c7eaf1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:02.209965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa11126-df58-4cc6-9cdd-09e0c7eaf1cb admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:02.210453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa11126-df58-4cc6-9cdd-09e0c7eaf1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:02.210963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa11126-df58-4cc6-9cdd-09e0c7eaf1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:02.211968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa11126-df58-4cc6-9cdd-09e0c7eaf1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:02.215749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa11126-df58-4cc6-9cdd-09e0c7eaf1cb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:02.237880 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3357/6715] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:19:02.240289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa11126-df58-4cc6-9cdd-09e0c7eaf1cb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:02.249024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dfa11126-df58-4cc6-9cdd-09e0c7eaf1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:02.265896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa11126-df58-4cc6-9cdd-09e0c7eaf1cb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:02.271965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51656f-aecd-4215-9b19-c41dfa870f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:02.273040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51656f-aecd-4215-9b19-c41dfa870f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:02.273040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51656f-aecd-4215-9b19-c41dfa870f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:02.273269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51656f-aecd-4215-9b19-c41dfa870f05 admin admin] PATH_INFO: `/v3/projects/0908ff2d2bbe4588944e21865be48635/users/79b0f79082834c85a6fa8d6746feb6b6/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:02.274407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f6cf5a47a94f44a473e5002281e479'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:02.275318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51656f-aecd-4215-9b19-c41dfa870f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0908ff2d2bbe4588944e21865be48635, user_id=79b0f79082834c85a6fa8d6746feb6b6, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:02.279278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51656f-aecd-4215-9b19-c41dfa870f05 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:02.284303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f6cf5a47a94f44a473e5002281e479'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:02.285237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f6cf5a47a94f44a473e5002281e479'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:02.285937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f6cf5a47a94f44a473e5002281e479'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:02.295004 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3358/6716] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:02 2022] PUT /identity/v3/projects/0908ff2d2bbe4588944e21865be48635/users/79b0f79082834c85a6fa8d6746feb6b6/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:02.301604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f6cf5a47a94f44a473e5002281e479'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:02.305282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061ce40-1b74-48df-94ed-d41edde5b95a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:02.305894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061ce40-1b74-48df-94ed-d41edde5b95a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:02.305894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061ce40-1b74-48df-94ed-d41edde5b95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:02.323594 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3359/6717] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:02 2022] DELETE /identity/v3/users/65f6cf5a47a94f44a473e5002281e479 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:02.359984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c061ce40-1b74-48df-94ed-d41edde5b95a None None] MFA Rules not processed for user `79b0f79082834c85a6fa8d6746feb6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:02.362267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c061ce40-1b74-48df-94ed-d41edde5b95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:02.520608 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3359/6718] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:02.534820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:02.538647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:02.652943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ed821-ba42-49d9-b395-ef21ea2b8002 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:02.665820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13db09-319a-483e-8ca3-218fd5ffc242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:02.667177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13db09-319a-483e-8ca3-218fd5ffc242 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:02.669786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13db09-319a-483e-8ca3-218fd5ffc242 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:02.673041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13db09-319a-483e-8ca3-218fd5ffc242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:02.692158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13db09-319a-483e-8ca3-218fd5ffc242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:02.694949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13db09-319a-483e-8ca3-218fd5ffc242 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:02.733937 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3360/6719] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:02.816782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061ce40-1b74-48df-94ed-d41edde5b95a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:02.818837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c061ce40-1b74-48df-94ed-d41edde5b95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:02.826492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13db09-319a-483e-8ca3-218fd5ffc242 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:02.828559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1c13db09-319a-483e-8ca3-218fd5ffc242 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:02.942284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:02.969451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061ce40-1b74-48df-94ed-d41edde5b95a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:02.979644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb186d-709a-4a0b-9cb4-a5d8b0e0174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:02.980041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13db09-319a-483e-8ca3-218fd5ffc242 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:02.981490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb186d-709a-4a0b-9cb4-a5d8b0e0174e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:02.981972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb186d-709a-4a0b-9cb4-a5d8b0e0174e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:02.982830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb186d-709a-4a0b-9cb4-a5d8b0e0174e admin admin] PATH_INFO: `/v3/users/2a490f36457c4ab8b4f3d57469d3d9dd` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:02.984426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb186d-709a-4a0b-9cb4-a5d8b0e0174e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a490f36457c4ab8b4f3d57469d3d9dd)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:02.986636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de882-4f1b-47ca-88a5-a37b4d54267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:02.987263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de882-4f1b-47ca-88a5-a37b4d54267f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:02.987694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de882-4f1b-47ca-88a5-a37b4d54267f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:02.987834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de882-4f1b-47ca-88a5-a37b4d54267f admin admin] PATH_INFO: `/v3/projects/f7cc858b52624d00bebe9bc4a5b79de7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:02.990567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb186d-709a-4a0b-9cb4-a5d8b0e0174e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:02.990700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593de882-4f1b-47ca-88a5-a37b4d54267f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7cc858b52624d00bebe9bc4a5b79de7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:02.993128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593de882-4f1b-47ca-88a5-a37b4d54267f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:03.012837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:03.066347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-00cb186d-709a-4a0b-9cb4-a5d8b0e0174e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a490f36457c4ab8b4f3d57469d3d9dd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.066909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-593de882-4f1b-47ca-88a5-a37b4d54267f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7cc858b52624d00bebe9bc4a5b79de7', 'request_id': 'req-593de882-4f1b-47ca-88a5-a37b4d54267f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.073944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-00cb186d-709a-4a0b-9cb4-a5d8b0e0174e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a490f36457c4ab8b4f3d57469d3d9dd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.075301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-00cb186d-709a-4a0b-9cb4-a5d8b0e0174e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a490f36457c4ab8b4f3d57469d3d9dd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.075962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-00cb186d-709a-4a0b-9cb4-a5d8b0e0174e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a490f36457c4ab8b4f3d57469d3d9dd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.077229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-593de882-4f1b-47ca-88a5-a37b4d54267f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7cc858b52624d00bebe9bc4a5b79de7', 'request_id': 'req-593de882-4f1b-47ca-88a5-a37b4d54267f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.084773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-593de882-4f1b-47ca-88a5-a37b4d54267f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7cc858b52624d00bebe9bc4a5b79de7', 'request_id': 'req-593de882-4f1b-47ca-88a5-a37b4d54267f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.089409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-00cb186d-709a-4a0b-9cb4-a5d8b0e0174e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a490f36457c4ab8b4f3d57469d3d9dd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.101177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-593de882-4f1b-47ca-88a5-a37b4d54267f admin admin] The token cache is being invalidate because project f7cc858b52624d00bebe9bc4a5b79de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:03.101499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-593de882-4f1b-47ca-88a5-a37b4d54267f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.103059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-593de882-4f1b-47ca-88a5-a37b4d54267f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.104578 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3361/6720] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:02 2022] DELETE /identity/v3/projects/f7cc858b52624d00bebe9bc4a5b79de7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:03.105310 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3360/6721] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:02 2022] DELETE /identity/v3/users/2a490f36457c4ab8b4f3d57469d3d9dd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:03.109763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb07b2-0de7-49a7-853e-d221ea90e522 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.110141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1752c0-3c0f-43b3-a1ad-70c69cee2965 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.110484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb07b2-0de7-49a7-853e-d221ea90e522 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.110614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1752c0-3c0f-43b3-a1ad-70c69cee2965 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.110783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1752c0-3c0f-43b3-a1ad-70c69cee2965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.111235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb07b2-0de7-49a7-853e-d221ea90e522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.133901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dcdb07b2-0de7-49a7-853e-d221ea90e522 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:03.135090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dcdb07b2-0de7-49a7-853e-d221ea90e522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:03.140804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4d1752c0-3c0f-43b3-a1ad-70c69cee2965 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:03.142220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4d1752c0-3c0f-43b3-a1ad-70c69cee2965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:03.205601 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3362/6722] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:03.213445 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3361/6723] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:03.221591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1752c0-3c0f-43b3-a1ad-70c69cee2965 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:03.222143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e65f3-a3cb-491e-b2ee-3474c0550ae3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.222421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e65f3-a3cb-491e-b2ee-3474c0550ae3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.222652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e65f3-a3cb-491e-b2ee-3474c0550ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.223121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4d1752c0-3c0f-43b3-a1ad-70c69cee2965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:03.255282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c62e65f3-a3cb-491e-b2ee-3474c0550ae3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:03.259478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c62e65f3-a3cb-491e-b2ee-3474c0550ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:03.269826 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3363/6724] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:03.274210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e65f3-a3cb-491e-b2ee-3474c0550ae3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:03.284082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e65f3-a3cb-491e-b2ee-3474c0550ae3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:03.299913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7611fb-abcd-4dfd-bb27-0a8b4523f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:03.300541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7611fb-abcd-4dfd-bb27-0a8b4523f285 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.300958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7611fb-abcd-4dfd-bb27-0a8b4523f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.301269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7611fb-abcd-4dfd-bb27-0a8b4523f285 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.301929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7611fb-abcd-4dfd-bb27-0a8b4523f285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:03.302233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7611fb-abcd-4dfd-bb27-0a8b4523f285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:03.303895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7611fb-abcd-4dfd-bb27-0a8b4523f285 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:03.306130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1752c0-3c0f-43b3-a1ad-70c69cee2965 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:03.310594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50d17f-3855-4871-88ae-dddaab0a4ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:03.311772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50d17f-3855-4871-88ae-dddaab0a4ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.312065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50d17f-3855-4871-88ae-dddaab0a4ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.312466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50d17f-3855-4871-88ae-dddaab0a4ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.316659 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3364/6725] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:19:03.320594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7611fb-abcd-4dfd-bb27-0a8b4523f285 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:03.324142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50d17f-3855-4871-88ae-dddaab0a4ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:03.326570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50d17f-3855-4871-88ae-dddaab0a4ff7 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:03.331796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7611fb-abcd-4dfd-bb27-0a8b4523f285 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:03.338651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b79b11-41a6-45c6-b771-5a6c907e305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:03.338797 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3362/6726] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:03.339122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b79b11-41a6-45c6-b771-5a6c907e305e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.339304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b79b11-41a6-45c6-b771-5a6c907e305e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.339537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b79b11-41a6-45c6-b771-5a6c907e305e admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.340201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b79b11-41a6-45c6-b771-5a6c907e305e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:03.342928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b79b11-41a6-45c6-b771-5a6c907e305e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:03.374053 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3365/6727] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:03 2022] POST /identity/v3/projects => generated 407 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:19:03.378048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50d17f-3855-4871-88ae-dddaab0a4ff7 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:03.388440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50d17f-3855-4871-88ae-dddaab0a4ff7 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:03.396751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:03.452078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d6fed-085d-44dc-9fc0-20f71f0f5582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:03.452840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6fed-085d-44dc-9fc0-20f71f0f5582 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.453160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6fed-085d-44dc-9fc0-20f71f0f5582 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.453713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6fed-085d-44dc-9fc0-20f71f0f5582 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.454362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d6fed-085d-44dc-9fc0-20f71f0f5582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:03.456341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d6fed-085d-44dc-9fc0-20f71f0f5582 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:03.479647 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3363/6728] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:03 2022] POST /identity/v3/users => generated 304 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:19:03.484734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b79b11-41a6-45c6-b771-5a6c907e305e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:03.497695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b79b11-41a6-45c6-b771-5a6c907e305e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:03.502360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871460c-f313-44cc-8f9c-3c4dde0d33fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:03.502960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871460c-f313-44cc-8f9c-3c4dde0d33fe admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.503240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871460c-f313-44cc-8f9c-3c4dde0d33fe admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.503513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871460c-f313-44cc-8f9c-3c4dde0d33fe admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.504157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871460c-f313-44cc-8f9c-3c4dde0d33fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:03.505777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871460c-f313-44cc-8f9c-3c4dde0d33fe admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:03.515848 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3366/6729] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:03.520153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d6fed-085d-44dc-9fc0-20f71f0f5582 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:03.532523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d6fed-085d-44dc-9fc0-20f71f0f5582 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:03.538028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586806e-05e7-45b0-859f-472629face67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:03.538648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586806e-05e7-45b0-859f-472629face67 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.538951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586806e-05e7-45b0-859f-472629face67 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.539220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586806e-05e7-45b0-859f-472629face67 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.539908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586806e-05e7-45b0-859f-472629face67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:03.541613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586806e-05e7-45b0-859f-472629face67 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:03.553225 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3364/6730] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:03.558654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871460c-f313-44cc-8f9c-3c4dde0d33fe admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:03.569567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871460c-f313-44cc-8f9c-3c4dde0d33fe admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:03.574272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc5ff-633b-4326-bbc0-899fbe1f94b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:03.574921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc5ff-633b-4326-bbc0-899fbe1f94b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.575200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc5ff-633b-4326-bbc0-899fbe1f94b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.575474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc5ff-633b-4326-bbc0-899fbe1f94b9 admin admin] PATH_INFO: `/v3/projects/ac9f34a3f75d4a89aa479c070da8473b/users/b6c2435b9e9b4ce0bdddeb9d8d9d398a/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.590752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dc5ff-633b-4326-bbc0-899fbe1f94b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9f34a3f75d4a89aa479c070da8473b, user_id=b6c2435b9e9b4ce0bdddeb9d8d9d398a, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:03.593426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dc5ff-633b-4326-bbc0-899fbe1f94b9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:03.608915 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3367/6731] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:03 2022] PUT /identity/v3/projects/ac9f34a3f75d4a89aa479c070da8473b/users/b6c2435b9e9b4ce0bdddeb9d8d9d398a/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:03.619615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8b13e-6154-47d2-a2fe-7e541b96fe70 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.620096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8b13e-6154-47d2-a2fe-7e541b96fe70 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.620515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8b13e-6154-47d2-a2fe-7e541b96fe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.650962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e2d8b13e-6154-47d2-a2fe-7e541b96fe70 None None] MFA Rules not processed for user `b6c2435b9e9b4ce0bdddeb9d8d9d398a`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:03.652179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e2d8b13e-6154-47d2-a2fe-7e541b96fe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:03.753553 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3365/6732] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:03 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:03.755848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc5ff-633b-4326-bbc0-899fbe1f94b9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:03.771085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8b13e-6154-47d2-a2fe-7e541b96fe70 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:03.772744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e2d8b13e-6154-47d2-a2fe-7e541b96fe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:03.783425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:03.833027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc5ff-633b-4326-bbc0-899fbe1f94b9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:03.840031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd05e30-bf4e-4ad2-996c-131ede78bf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:03.841993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05e30-bf4e-4ad2-996c-131ede78bf57 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.842700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05e30-bf4e-4ad2-996c-131ede78bf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.843126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05e30-bf4e-4ad2-996c-131ede78bf57 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.844051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd05e30-bf4e-4ad2-996c-131ede78bf57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:03.847347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd05e30-bf4e-4ad2-996c-131ede78bf57 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:03.857289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8b13e-6154-47d2-a2fe-7e541b96fe70 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:03.864341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:03.865122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.865466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.865757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] PATH_INFO: `/v3/users/b307316877f64e0cb0acc42080925e24` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.866975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b307316877f64e0cb0acc42080925e24)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:03.869056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:03.879423 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3368/6733] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:03 2022] POST /identity/v3/projects => generated 409 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:03.880255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd05e30-bf4e-4ad2-996c-131ede78bf57 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:03.883671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-edd05e30-bf4e-4ad2-996c-131ede78bf57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:03.894888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:03.932935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b307316877f64e0cb0acc42080925e24'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.940653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b307316877f64e0cb0acc42080925e24'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.941387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b307316877f64e0cb0acc42080925e24'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.942031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b307316877f64e0cb0acc42080925e24'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.955469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b307316877f64e0cb0acc42080925e24'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:03.958025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd05e30-bf4e-4ad2-996c-131ede78bf57 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:03.963493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73183e16-a73e-4a29-a78b-3ed9983ea80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:03.964241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73183e16-a73e-4a29-a78b-3ed9983ea80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:03.964595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73183e16-a73e-4a29-a78b-3ed9983ea80e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:03.964943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73183e16-a73e-4a29-a78b-3ed9983ea80e admin admin] PATH_INFO: `/v3/projects/7aa90a708c724f4bb994fc5e434c0691` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:03.966243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73183e16-a73e-4a29-a78b-3ed9983ea80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aa90a708c724f4bb994fc5e434c0691)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:03.968189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73183e16-a73e-4a29-a78b-3ed9983ea80e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:03.969308 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3366/6734] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:03 2022] DELETE /identity/v3/users/b307316877f64e0cb0acc42080925e24 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:03.973329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:03.974786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:04.016923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-73183e16-a73e-4a29-a78b-3ed9983ea80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa90a708c724f4bb994fc5e434c0691', 'request_id': 'req-73183e16-a73e-4a29-a78b-3ed9983ea80e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:04.025624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-73183e16-a73e-4a29-a78b-3ed9983ea80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa90a708c724f4bb994fc5e434c0691', 'request_id': 'req-73183e16-a73e-4a29-a78b-3ed9983ea80e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:04.031495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-73183e16-a73e-4a29-a78b-3ed9983ea80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa90a708c724f4bb994fc5e434c0691', 'request_id': 'req-73183e16-a73e-4a29-a78b-3ed9983ea80e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:04.044989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-73183e16-a73e-4a29-a78b-3ed9983ea80e admin admin] The token cache is being invalidate because project 7aa90a708c724f4bb994fc5e434c0691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:04.044989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-73183e16-a73e-4a29-a78b-3ed9983ea80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:04.045655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-73183e16-a73e-4a29-a78b-3ed9983ea80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:04.047202 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3369/6735] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:03 2022] DELETE /identity/v3/projects/7aa90a708c724f4bb994fc5e434c0691 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:04.048403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61415a8-6597-4313-918c-bcf601c7ec62 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:04.048688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61415a8-6597-4313-918c-bcf601c7ec62 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:04.048963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61415a8-6597-4313-918c-bcf601c7ec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:04.052922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37680378-6987-4a92-9390-55d49e5971dc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:04.071022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c61415a8-6597-4313-918c-bcf601c7ec62 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:04.072254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c61415a8-6597-4313-918c-bcf601c7ec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:04.106452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:04.133291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232712f-5d10-4821-b746-6e5e278df37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:04.133899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232712f-5d10-4821-b746-6e5e278df37b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:04.134206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232712f-5d10-4821-b746-6e5e278df37b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:04.134433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232712f-5d10-4821-b746-6e5e278df37b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:04.135129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232712f-5d10-4821-b746-6e5e278df37b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:04.137089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232712f-5d10-4821-b746-6e5e278df37b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:04.142330 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3370/6736] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:04.143175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61415a8-6597-4313-918c-bcf601c7ec62 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:04.146855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c61415a8-6597-4313-918c-bcf601c7ec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:04.160372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61415a8-6597-4313-918c-bcf601c7ec62 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:04.167856 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3367/6737] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:03 2022] POST /identity/v3/users => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:04.167856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232712f-5d10-4821-b746-6e5e278df37b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:04.168497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6232712f-5d10-4821-b746-6e5e278df37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:04.169639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:04.170410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:04.170603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:04.170894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] PATH_INFO: `/v3/users/79b0f79082834c85a6fa8d6746feb6b6` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:04.172069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b0f79082834c85a6fa8d6746feb6b6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:04.175077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:04.215948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:04.234739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b0f79082834c85a6fa8d6746feb6b6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:04.241645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232712f-5d10-4821-b746-6e5e278df37b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:04.244561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b0f79082834c85a6fa8d6746feb6b6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:04.245326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b0f79082834c85a6fa8d6746feb6b6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:04.245698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f1bb2-92c6-418c-8680-e54a889f3d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:04.246112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b0f79082834c85a6fa8d6746feb6b6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:04.246687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f1bb2-92c6-418c-8680-e54a889f3d0b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:04.247089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f1bb2-92c6-418c-8680-e54a889f3d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:04.249566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f1bb2-92c6-418c-8680-e54a889f3d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:04.251726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ba6f1bb2-92c6-418c-8680-e54a889f3d0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:04.263046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b0f79082834c85a6fa8d6746feb6b6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:04.266384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f1bb2-92c6-418c-8680-e54a889f3d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:04.267752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f1bb2-92c6-418c-8680-e54a889f3d0b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:04.279638 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3371/6738] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:04 2022] DELETE /identity/v3/users/79b0f79082834c85a6fa8d6746feb6b6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:04.282963 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3368/6739] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:04.283101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:04.283792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:04.368063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b09fc-7b5e-4e7c-95bd-860a0d33318c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:04.377897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd85fea-10cc-43e9-8971-675e529d16b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:04.378528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd85fea-10cc-43e9-8971-675e529d16b9 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:04.379428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd85fea-10cc-43e9-8971-675e529d16b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:04.379860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd85fea-10cc-43e9-8971-675e529d16b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:04.380488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd85fea-10cc-43e9-8971-675e529d16b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:04.382250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd85fea-10cc-43e9-8971-675e529d16b9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:04.400808 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3372/6740] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:04.402218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f1bb2-92c6-418c-8680-e54a889f3d0b service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:04.416088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f1bb2-92c6-418c-8680-e54a889f3d0b service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:04.425069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b51bd-89f8-4a6c-9c51-da11c966899f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:04.425858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b51bd-89f8-4a6c-9c51-da11c966899f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:04.426151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b51bd-89f8-4a6c-9c51-da11c966899f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:04.426483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b51bd-89f8-4a6c-9c51-da11c966899f admin admin] PATH_INFO: `/v3/projects/4c34ed296b0c4d33b9b6b7d4ce1ea3d8/users/ab660a1eea2d4722b3312b68b9349192/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:04.448469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b51bd-89f8-4a6c-9c51-da11c966899f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c34ed296b0c4d33b9b6b7d4ce1ea3d8, user_id=ab660a1eea2d4722b3312b68b9349192, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:04.452471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b51bd-89f8-4a6c-9c51-da11c966899f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:04.466585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd242a5-d92f-405c-80e8-9a3fd18631dc None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:04.466886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd242a5-d92f-405c-80e8-9a3fd18631dc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:04.467192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd242a5-d92f-405c-80e8-9a3fd18631dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:04.483283 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3369/6741] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:04 2022] PUT /identity/v3/projects/4c34ed296b0c4d33b9b6b7d4ce1ea3d8/users/ab660a1eea2d4722b3312b68b9349192/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:04.493297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3fd242a5-d92f-405c-80e8-9a3fd18631dc None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:04.493628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b51bd-89f8-4a6c-9c51-da11c966899f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:04.495245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3fd242a5-d92f-405c-80e8-9a3fd18631dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:04.560886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:04.595600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b51bd-89f8-4a6c-9c51-da11c966899f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:04.598942 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3373/6742] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:04.605482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ef307-f8a2-4344-beea-3b75d38f2496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:04.607777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ef307-f8a2-4344-beea-3b75d38f2496 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:04.607777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ef307-f8a2-4344-beea-3b75d38f2496 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:04.608157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ef307-f8a2-4344-beea-3b75d38f2496 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:04.608820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ef307-f8a2-4344-beea-3b75d38f2496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:04.610698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ef307-f8a2-4344-beea-3b75d38f2496 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:04.612604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd242a5-d92f-405c-80e8-9a3fd18631dc None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:04.614426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3fd242a5-d92f-405c-80e8-9a3fd18631dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:04.626518 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3370/6743] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:04.630286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ef307-f8a2-4344-beea-3b75d38f2496 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:04.644679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ef307-f8a2-4344-beea-3b75d38f2496 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:04.650977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a42a-2799-443d-ab6f-864c2a53307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:04.651646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a42a-2799-443d-ab6f-864c2a53307b admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:04.651931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a42a-2799-443d-ab6f-864c2a53307b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:04.652208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a42a-2799-443d-ab6f-864c2a53307b admin admin] PATH_INFO: `/v3/projects/4c34ed296b0c4d33b9b6b7d4ce1ea3d8/users/ab660a1eea2d4722b3312b68b9349192/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:04.655385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8a42a-2799-443d-ab6f-864c2a53307b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c34ed296b0c4d33b9b6b7d4ce1ea3d8, user_id=ab660a1eea2d4722b3312b68b9349192, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:04.657730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8a42a-2799-443d-ab6f-864c2a53307b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:04.670027 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3371/6744] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:04 2022] PUT /identity/v3/projects/4c34ed296b0c4d33b9b6b7d4ce1ea3d8/users/ab660a1eea2d4722b3312b68b9349192/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:04.681318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5620e8-efdc-49fd-9b28-87470b3655d8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:04.681630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5620e8-efdc-49fd-9b28-87470b3655d8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:04.681906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5620e8-efdc-49fd-9b28-87470b3655d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:04.698278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd242a5-d92f-405c-80e8-9a3fd18631dc None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:04.736589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9c5620e8-efdc-49fd-9b28-87470b3655d8 None None] MFA Rules not processed for user `ab660a1eea2d4722b3312b68b9349192`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:04.738964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9c5620e8-efdc-49fd-9b28-87470b3655d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:04.794115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70559b1c-e36c-4161-95c5-1f276331f2a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:04.794905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70559b1c-e36c-4161-95c5-1f276331f2a8 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:04.795332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70559b1c-e36c-4161-95c5-1f276331f2a8 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:04.795802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70559b1c-e36c-4161-95c5-1f276331f2a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:04.845672 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3372/6745] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:04.851885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5620e8-efdc-49fd-9b28-87470b3655d8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:04.852802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9c5620e8-efdc-49fd-9b28-87470b3655d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:04.884176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:04.887348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70559b1c-e36c-4161-95c5-1f276331f2a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:04.890080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70559b1c-e36c-4161-95c5-1f276331f2a8 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:04.913670 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3374/6746] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:19:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:19:04.915085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70559b1c-e36c-4161-95c5-1f276331f2a8 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:04.916882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-70559b1c-e36c-4161-95c5-1f276331f2a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:04.952467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5620e8-efdc-49fd-9b28-87470b3655d8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:04.957844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:04.958987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:04.959277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:04.959556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] PATH_INFO: `/v3/projects/e45787bedc5242c3ac4194da2af183e1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:04.960928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45787bedc5242c3ac4194da2af183e1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:04.963161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:04.985553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:05.045397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70559b1c-e36c-4161-95c5-1f276331f2a8 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:05.053747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45787bedc5242c3ac4194da2af183e1', 'request_id': 'req-dafd521f-fed5-4e20-80d5-dc8370df2edc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:05.080007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45787bedc5242c3ac4194da2af183e1', 'request_id': 'req-dafd521f-fed5-4e20-80d5-dc8370df2edc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:05.093423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45787bedc5242c3ac4194da2af183e1', 'request_id': 'req-dafd521f-fed5-4e20-80d5-dc8370df2edc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:05.113908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] The token cache is being invalidate because project e45787bedc5242c3ac4194da2af183e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:05.114603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:05.115673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:05.117468 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3373/6747] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:04 2022] DELETE /identity/v3/projects/e45787bedc5242c3ac4194da2af183e1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:05.118482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:05.120246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:05.134391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dba94-932c-4380-aa1f-d30971d7bd46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:05.135005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dba94-932c-4380-aa1f-d30971d7bd46 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:05.135285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dba94-932c-4380-aa1f-d30971d7bd46 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:05.135553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dba94-932c-4380-aa1f-d30971d7bd46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:05.138180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6b0dba94-932c-4380-aa1f-d30971d7bd46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:05.218326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd521f-fed5-4e20-80d5-dc8370df2edc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:05.227806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:05.228868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:05.229424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:05.230167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28 admin admin] PATH_INFO: `/v3/projects/0908ff2d2bbe4588944e21865be48635` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:05.232722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0908ff2d2bbe4588944e21865be48635)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:05.234114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dba94-932c-4380-aa1f-d30971d7bd46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:05.235264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:05.235596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dba94-932c-4380-aa1f-d30971d7bd46 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:05.251218 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3375/6748] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:04 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:05.252572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d8df-8ba4-4ee1-9b0e-bdf2d0047986 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:05.252858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d8df-8ba4-4ee1-9b0e-bdf2d0047986 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:05.253133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d8df-8ba4-4ee1-9b0e-bdf2d0047986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:05.294249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5386d8df-8ba4-4ee1-9b0e-bdf2d0047986 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:05.297908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5386d8df-8ba4-4ee1-9b0e-bdf2d0047986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:05.316341 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3376/6749] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:05.324673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a78f3-1ae1-42f4-b425-ff6d08bc4e14 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:05.325705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a78f3-1ae1-42f4-b425-ff6d08bc4e14 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:05.326056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a78f3-1ae1-42f4-b425-ff6d08bc4e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:05.343067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0908ff2d2bbe4588944e21865be48635', 'request_id': 'req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:05.352789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:05.367928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0908ff2d2bbe4588944e21865be48635', 'request_id': 'req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:05.375569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ca8a78f3-1ae1-42f4-b425-ff6d08bc4e14 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:05.376796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ca8a78f3-1ae1-42f4-b425-ff6d08bc4e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:05.385787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0908ff2d2bbe4588944e21865be48635', 'request_id': 'req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:05.403873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28 admin admin] The token cache is being invalidate because project 0908ff2d2bbe4588944e21865be48635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:05.404328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:05.405225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-25d7cfdd-e50f-42b9-a1c5-ea4b1e0f9e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:05.407355 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3374/6750] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:05 2022] DELETE /identity/v3/projects/0908ff2d2bbe4588944e21865be48635 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:05.414276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc86f88-08f9-4520-bf91-e3054c62b532 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:05.415193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc86f88-08f9-4520-bf91-e3054c62b532 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:05.415479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc86f88-08f9-4520-bf91-e3054c62b532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:05.453237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5bc86f88-08f9-4520-bf91-e3054c62b532 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:05.454696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5bc86f88-08f9-4520-bf91-e3054c62b532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:05.550730 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3377/6751] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:05.556657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a78f3-1ae1-42f4-b425-ff6d08bc4e14 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:05.591314 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3375/6752] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:05.591529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a78f3-1ae1-42f4-b425-ff6d08bc4e14 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:05.595098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828169f-e580-4c23-924b-851797ba6172 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:05.595592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828169f-e580-4c23-924b-851797ba6172 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:05.595943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828169f-e580-4c23-924b-851797ba6172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:05.606457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8196d-65a4-43d7-a132-6714e95c56b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:05.608653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8196d-65a4-43d7-a132-6714e95c56b1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:05.609049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8196d-65a4-43d7-a132-6714e95c56b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:05.610682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8196d-65a4-43d7-a132-6714e95c56b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:05.611500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8196d-65a4-43d7-a132-6714e95c56b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:05.612668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8196d-65a4-43d7-a132-6714e95c56b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:05.617296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8196d-65a4-43d7-a132-6714e95c56b1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:05.625316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a828169f-e580-4c23-924b-851797ba6172 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:05.627830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a828169f-e580-4c23-924b-851797ba6172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:05.641874 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3378/6753] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:19:05.646464 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3376/6754] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:05.655298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8196d-65a4-43d7-a132-6714e95c56b1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:05.656508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828169f-e580-4c23-924b-851797ba6172 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:05.674379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828169f-e580-4c23-924b-851797ba6172 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:05.674865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8196d-65a4-43d7-a132-6714e95c56b1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:05.680750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30792e55-eb66-4859-9349-29fff26691ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:05.681211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26985d0a-8a57-4159-bb5f-7952f60a196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:05.681617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30792e55-eb66-4859-9349-29fff26691ab admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:05.681882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985d0a-8a57-4159-bb5f-7952f60a196d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:05.682122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30792e55-eb66-4859-9349-29fff26691ab admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:05.682334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985d0a-8a57-4159-bb5f-7952f60a196d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:05.682452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985d0a-8a57-4159-bb5f-7952f60a196d admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:05.682729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30792e55-eb66-4859-9349-29fff26691ab admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:05.683040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26985d0a-8a57-4159-bb5f-7952f60a196d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:05.684879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30792e55-eb66-4859-9349-29fff26691ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:05.685330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30792e55-eb66-4859-9349-29fff26691ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:05.685772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26985d0a-8a57-4159-bb5f-7952f60a196d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:05.687181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30792e55-eb66-4859-9349-29fff26691ab admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:05.712690 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3377/6755] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:19:05.712690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30792e55-eb66-4859-9349-29fff26691ab admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:05.713748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-30792e55-eb66-4859-9349-29fff26691ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:05.718983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:05.728139 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3379/6756] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:05 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:05.729031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26985d0a-8a57-4159-bb5f-7952f60a196d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:05.844910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30792e55-eb66-4859-9349-29fff26691ab admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:05.848058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26985d0a-8a57-4159-bb5f-7952f60a196d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:05.858404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064049f7-353f-4858-9552-7a7ef0555eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:05.859028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064049f7-353f-4858-9552-7a7ef0555eea admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:05.859316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064049f7-353f-4858-9552-7a7ef0555eea admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:05.859599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064049f7-353f-4858-9552-7a7ef0555eea admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:05.860234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064049f7-353f-4858-9552-7a7ef0555eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:05.862202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064049f7-353f-4858-9552-7a7ef0555eea admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:05.900637 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3380/6757] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:05 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:05.904283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064049f7-353f-4858-9552-7a7ef0555eea admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:05.915463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f472a90-98b0-4ce2-a722-4e8e3ea09872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:05.916099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f472a90-98b0-4ce2-a722-4e8e3ea09872 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:05.916369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f472a90-98b0-4ce2-a722-4e8e3ea09872 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:05.916652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f472a90-98b0-4ce2-a722-4e8e3ea09872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:05.918518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0f472a90-98b0-4ce2-a722-4e8e3ea09872 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:05.962984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:06.005425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f472a90-98b0-4ce2-a722-4e8e3ea09872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:06.006982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f472a90-98b0-4ce2-a722-4e8e3ea09872 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:06.019035 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3378/6758] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:05 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:06.020094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f472a90-98b0-4ce2-a722-4e8e3ea09872 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:06.032271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f472a90-98b0-4ce2-a722-4e8e3ea09872 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:06.037652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632a55e-8383-4065-adfd-5a8b4301f293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:06.038357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632a55e-8383-4065-adfd-5a8b4301f293 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.038727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632a55e-8383-4065-adfd-5a8b4301f293 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.039081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632a55e-8383-4065-adfd-5a8b4301f293 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.039978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632a55e-8383-4065-adfd-5a8b4301f293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:06.040186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064049f7-353f-4858-9552-7a7ef0555eea admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:06.042162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632a55e-8383-4065-adfd-5a8b4301f293 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:06.046503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f153170-d8cd-4cb4-8cb8-b5e18580d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:06.047704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f153170-d8cd-4cb4-8cb8-b5e18580d231 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.048822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f153170-d8cd-4cb4-8cb8-b5e18580d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.049265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f153170-d8cd-4cb4-8cb8-b5e18580d231 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.050229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f153170-d8cd-4cb4-8cb8-b5e18580d231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:06.053226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f153170-d8cd-4cb4-8cb8-b5e18580d231 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:06.082425 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3379/6759] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:06 2022] POST /identity/v3/users => generated 294 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:06.086576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632a55e-8383-4065-adfd-5a8b4301f293 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:06.110504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632a55e-8383-4065-adfd-5a8b4301f293 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:06.129392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae55a07-11fc-4a73-98bf-2da9981ab90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:06.130143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae55a07-11fc-4a73-98bf-2da9981ab90f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.131817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae55a07-11fc-4a73-98bf-2da9981ab90f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.132200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae55a07-11fc-4a73-98bf-2da9981ab90f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.133298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae55a07-11fc-4a73-98bf-2da9981ab90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:06.138596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae55a07-11fc-4a73-98bf-2da9981ab90f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:06.142869 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3381/6760] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:05 2022] POST /identity/v3/users => generated 295 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:06.145455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f153170-d8cd-4cb4-8cb8-b5e18580d231 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:06.164829 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3380/6761] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:06.166844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f153170-d8cd-4cb4-8cb8-b5e18580d231 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:06.171498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae55a07-11fc-4a73-98bf-2da9981ab90f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:06.189618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83179f-ab54-4207-9f21-38fc2f1c4e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:06.190568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83179f-ab54-4207-9f21-38fc2f1c4e20 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.191027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83179f-ab54-4207-9f21-38fc2f1c4e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.191287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83179f-ab54-4207-9f21-38fc2f1c4e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.191944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83179f-ab54-4207-9f21-38fc2f1c4e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:06.193574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83179f-ab54-4207-9f21-38fc2f1c4e20 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:06.200802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae55a07-11fc-4a73-98bf-2da9981ab90f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:06.209666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b93fa-9bcd-4c64-bf6b-adddab290452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:06.210314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b93fa-9bcd-4c64-bf6b-adddab290452 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.210597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b93fa-9bcd-4c64-bf6b-adddab290452 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.210864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b93fa-9bcd-4c64-bf6b-adddab290452 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.211563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b93fa-9bcd-4c64-bf6b-adddab290452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:06.214141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b93fa-9bcd-4c64-bf6b-adddab290452 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:06.221259 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3382/6762] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:06.227488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83179f-ab54-4207-9f21-38fc2f1c4e20 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:06.238593 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3381/6763] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:19:06.239509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b93fa-9bcd-4c64-bf6b-adddab290452 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:06.248647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83179f-ab54-4207-9f21-38fc2f1c4e20 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:06.252473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b93fa-9bcd-4c64-bf6b-adddab290452 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:06.258011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4e0a3-abd3-4a39-aec4-7f2baf5c6871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:06.258497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b0ea5-c44b-4435-b10e-49aec8272789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:06.258867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4e0a3-abd3-4a39-aec4-7f2baf5c6871 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.259165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b0ea5-c44b-4435-b10e-49aec8272789 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.259342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4e0a3-abd3-4a39-aec4-7f2baf5c6871 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.259464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b0ea5-c44b-4435-b10e-49aec8272789 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.259767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b0ea5-c44b-4435-b10e-49aec8272789 admin admin] PATH_INFO: `/v3/projects/1b5ebbb0ec7c4a92aa6b857dc95dc620/users/41787fb5fc0e4c328f5c42d7ccaa4420/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.259882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4e0a3-abd3-4a39-aec4-7f2baf5c6871 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.260683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4e0a3-abd3-4a39-aec4-7f2baf5c6871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:06.264038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4e0a3-abd3-4a39-aec4-7f2baf5c6871 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:06.276608 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3383/6764] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:06.281540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4e0a3-abd3-4a39-aec4-7f2baf5c6871 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:06.282973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b0ea5-c44b-4435-b10e-49aec8272789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5ebbb0ec7c4a92aa6b857dc95dc620, user_id=41787fb5fc0e4c328f5c42d7ccaa4420, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:06.291872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b0ea5-c44b-4435-b10e-49aec8272789 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:06.295984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4e0a3-abd3-4a39-aec4-7f2baf5c6871 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:06.307326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a0afb-add9-49a6-9382-284597cea739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:06.307998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a0afb-add9-49a6-9382-284597cea739 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.309931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a0afb-add9-49a6-9382-284597cea739 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.310219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a0afb-add9-49a6-9382-284597cea739 admin admin] PATH_INFO: `/v3/projects/5de90233a30e448db726f4d7f6b5907e/users/16dd376c9ca94b93a943cf19df9582df/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.316992 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3382/6765] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:06 2022] PUT /identity/v3/projects/1b5ebbb0ec7c4a92aa6b857dc95dc620/users/41787fb5fc0e4c328f5c42d7ccaa4420/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:06.333321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e9458-612b-47cd-8f32-6aeb93d274f0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.333689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e9458-612b-47cd-8f32-6aeb93d274f0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.333858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e9458-612b-47cd-8f32-6aeb93d274f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.367456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a0afb-add9-49a6-9382-284597cea739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de90233a30e448db726f4d7f6b5907e, user_id=16dd376c9ca94b93a943cf19df9582df, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:06.373125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a0afb-add9-49a6-9382-284597cea739 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:06.381557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9a3e9458-612b-47cd-8f32-6aeb93d274f0 None None] MFA Rules not processed for user `41787fb5fc0e4c328f5c42d7ccaa4420`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:06.383424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9a3e9458-612b-47cd-8f32-6aeb93d274f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:06.395431 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3384/6766] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:06 2022] PUT /identity/v3/projects/5de90233a30e448db726f4d7f6b5907e/users/16dd376c9ca94b93a943cf19df9582df/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:06.406907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537312a-363a-4de9-a4d4-bc25a72a6779 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.408693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537312a-363a-4de9-a4d4-bc25a72a6779 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.409561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537312a-363a-4de9-a4d4-bc25a72a6779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.495359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d537312a-363a-4de9-a4d4-bc25a72a6779 None None] MFA Rules not processed for user `16dd376c9ca94b93a943cf19df9582df`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:06.497539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d537312a-363a-4de9-a4d4-bc25a72a6779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:06.517925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:06.546343 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3383/6767] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:06.552575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e9458-612b-47cd-8f32-6aeb93d274f0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:06.616228 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3385/6768] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:06.627609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537312a-363a-4de9-a4d4-bc25a72a6779 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:06.630131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d537312a-363a-4de9-a4d4-bc25a72a6779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:06.650593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e9458-612b-47cd-8f32-6aeb93d274f0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:06.656768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7690c3-9299-4e69-b730-51daa1a1ee01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:06.657438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7690c3-9299-4e69-b730-51daa1a1ee01 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.657724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7690c3-9299-4e69-b730-51daa1a1ee01 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.657999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7690c3-9299-4e69-b730-51daa1a1ee01 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.658633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7690c3-9299-4e69-b730-51daa1a1ee01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:06.660545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7690c3-9299-4e69-b730-51daa1a1ee01 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:06.665656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:06.705359 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3384/6769] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:06 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:06.708067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7690c3-9299-4e69-b730-51daa1a1ee01 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:06.735361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537312a-363a-4de9-a4d4-bc25a72a6779 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:06.819496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7690c3-9299-4e69-b730-51daa1a1ee01 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:06.829925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cff78-bbc6-4ba7-add3-aa4331c70b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:06.830848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cff78-bbc6-4ba7-add3-aa4331c70b85 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.831215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cff78-bbc6-4ba7-add3-aa4331c70b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.831586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cff78-bbc6-4ba7-add3-aa4331c70b85 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.832802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cff78-bbc6-4ba7-add3-aa4331c70b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:06.834500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cff78-bbc6-4ba7-add3-aa4331c70b85 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:06.857786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70c074-b8a2-496a-98de-25eda2f39b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:06.859409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c074-b8a2-496a-98de-25eda2f39b18 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.860025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c074-b8a2-496a-98de-25eda2f39b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.860531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c074-b8a2-496a-98de-25eda2f39b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.867173 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3385/6770] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:06 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:19:06.875043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cff78-bbc6-4ba7-add3-aa4331c70b85 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:06.900670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cff78-bbc6-4ba7-add3-aa4331c70b85 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:06.909386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32d8bb-28d2-44dc-99c3-9bec7a3523b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:06.910250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32d8bb-28d2-44dc-99c3-9bec7a3523b7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:06.910666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32d8bb-28d2-44dc-99c3-9bec7a3523b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:06.911013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32d8bb-28d2-44dc-99c3-9bec7a3523b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:06.911879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32d8bb-28d2-44dc-99c3-9bec7a3523b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:06.913711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32d8bb-28d2-44dc-99c3-9bec7a3523b7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:06.960833 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3386/6771] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:06.964953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32d8bb-28d2-44dc-99c3-9bec7a3523b7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:06.978233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70c074-b8a2-496a-98de-25eda2f39b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:06.979757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70c074-b8a2-496a-98de-25eda2f39b18 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:06.990358 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3386/6772] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:06.994723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32d8bb-28d2-44dc-99c3-9bec7a3523b7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:07.000199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29975b-d911-4ecf-86c7-e670dd41de7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:07.000954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29975b-d911-4ecf-86c7-e670dd41de7a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:07.001361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29975b-d911-4ecf-86c7-e670dd41de7a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:07.001966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29975b-d911-4ecf-86c7-e670dd41de7a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:07.002718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29975b-d911-4ecf-86c7-e670dd41de7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:07.005375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29975b-d911-4ecf-86c7-e670dd41de7a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:07.027365 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3387/6773] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:07.032754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70c074-b8a2-496a-98de-25eda2f39b18 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:07.050230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70c074-b8a2-496a-98de-25eda2f39b18 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:07.059134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1686391-a1e5-460e-acf2-088bf6459247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:07.059817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1686391-a1e5-460e-acf2-088bf6459247 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:07.060236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1686391-a1e5-460e-acf2-088bf6459247 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:07.060522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1686391-a1e5-460e-acf2-088bf6459247 admin admin] PATH_INFO: `/v3/projects/ba49908b51854e7d8d8fc3c2234eb52e/users/c62692620049448db2140ef689132a60/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:07.085517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1686391-a1e5-460e-acf2-088bf6459247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba49908b51854e7d8d8fc3c2234eb52e, user_id=c62692620049448db2140ef689132a60, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:07.088976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1686391-a1e5-460e-acf2-088bf6459247 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:07.112585 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3387/6774] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:07 2022] PUT /identity/v3/projects/ba49908b51854e7d8d8fc3c2234eb52e/users/c62692620049448db2140ef689132a60/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:07.124629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dacc8-39a7-485c-acbe-0bb0ca31ee4a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:07.125943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dacc8-39a7-485c-acbe-0bb0ca31ee4a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:07.125943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dacc8-39a7-485c-acbe-0bb0ca31ee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:07.182184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4d8dacc8-39a7-485c-acbe-0bb0ca31ee4a None None] MFA Rules not processed for user `c62692620049448db2140ef689132a60`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:07.183529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4d8dacc8-39a7-485c-acbe-0bb0ca31ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:07.335784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1686391-a1e5-460e-acf2-088bf6459247 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:07.336487 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3388/6775] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:07.341365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:07.434624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1686391-a1e5-460e-acf2-088bf6459247 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:07.439494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aa247-3b39-4578-b008-175a4ccae18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:07.440110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aa247-3b39-4578-b008-175a4ccae18c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:07.440391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aa247-3b39-4578-b008-175a4ccae18c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:07.441341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aa247-3b39-4578-b008-175a4ccae18c admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:07.441341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03aa247-3b39-4578-b008-175a4ccae18c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:07.443555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03aa247-3b39-4578-b008-175a4ccae18c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:07.494880 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3388/6776] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:07 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:07.503968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dacc8-39a7-485c-acbe-0bb0ca31ee4a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:07.535359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dacc8-39a7-485c-acbe-0bb0ca31ee4a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:07.643905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:07.682095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082e42f-397e-4a9f-99e3-a95744f59068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:07.682959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082e42f-397e-4a9f-99e3-a95744f59068 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:07.683219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082e42f-397e-4a9f-99e3-a95744f59068 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:07.683494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082e42f-397e-4a9f-99e3-a95744f59068 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:07.684155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082e42f-397e-4a9f-99e3-a95744f59068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:07.686126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082e42f-397e-4a9f-99e3-a95744f59068 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:07.729048 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3389/6777] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:07 2022] POST /identity/v3/users => generated 300 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:07.730344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aa247-3b39-4578-b008-175a4ccae18c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:07.748981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aa247-3b39-4578-b008-175a4ccae18c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:07.763725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f142c-d5ea-45e4-b4a4-020e3e5778c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:07.764365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f142c-d5ea-45e4-b4a4-020e3e5778c8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:07.765886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f142c-d5ea-45e4-b4a4-020e3e5778c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:07.766941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f142c-d5ea-45e4-b4a4-020e3e5778c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:07.768247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f142c-d5ea-45e4-b4a4-020e3e5778c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:07.776255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f142c-d5ea-45e4-b4a4-020e3e5778c8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:07.808119 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3389/6778] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:07.809530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082e42f-397e-4a9f-99e3-a95744f59068 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:07.828195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082e42f-397e-4a9f-99e3-a95744f59068 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:07.860014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046438b8-0871-4c63-b1de-cb71bc5e970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:07.862216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046438b8-0871-4c63-b1de-cb71bc5e970e admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:07.864270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046438b8-0871-4c63-b1de-cb71bc5e970e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:07.864604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046438b8-0871-4c63-b1de-cb71bc5e970e admin admin] PATH_INFO: `/v3/projects/99dbe87cad764366b636f4bea0036a0b/users/e55f4db48308479eb270380f6ee42a66/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:07.917338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046438b8-0871-4c63-b1de-cb71bc5e970e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99dbe87cad764366b636f4bea0036a0b, user_id=e55f4db48308479eb270380f6ee42a66, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:07.923109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046438b8-0871-4c63-b1de-cb71bc5e970e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:07.975647 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3390/6779] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:07 2022] PUT /identity/v3/projects/99dbe87cad764366b636f4bea0036a0b/users/e55f4db48308479eb270380f6ee42a66/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:07.977002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f142c-d5ea-45e4-b4a4-020e3e5778c8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:07.998818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f142c-d5ea-45e4-b4a4-020e3e5778c8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:08.131834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d7de7-cf0b-4cad-bb17-40f2ad2d5316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:08.132740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7de7-cf0b-4cad-bb17-40f2ad2d5316 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:08.133119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7de7-cf0b-4cad-bb17-40f2ad2d5316 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:08.133932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7de7-cf0b-4cad-bb17-40f2ad2d5316 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:08.134648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d7de7-cf0b-4cad-bb17-40f2ad2d5316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:08.137979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d7de7-cf0b-4cad-bb17-40f2ad2d5316 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:08.153486 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3390/6780] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:08.157371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046438b8-0871-4c63-b1de-cb71bc5e970e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:08.172089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046438b8-0871-4c63-b1de-cb71bc5e970e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:08.178511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b70842-339b-4675-ba29-78b783261872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:08.179320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70842-339b-4675-ba29-78b783261872 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:08.179625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70842-339b-4675-ba29-78b783261872 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:08.179956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70842-339b-4675-ba29-78b783261872 admin admin] PATH_INFO: `/v3/projects/99dbe87cad764366b636f4bea0036a0b/users/e55f4db48308479eb270380f6ee42a66/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:08.182366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b70842-339b-4675-ba29-78b783261872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99dbe87cad764366b636f4bea0036a0b, user_id=e55f4db48308479eb270380f6ee42a66, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:08.186515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b70842-339b-4675-ba29-78b783261872 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:08.201103 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3391/6781] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:08 2022] PUT /identity/v3/projects/99dbe87cad764366b636f4bea0036a0b/users/e55f4db48308479eb270380f6ee42a66/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:08.213236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344f1ed-556f-4987-bb6f-d47434f78097 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:08.213953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344f1ed-556f-4987-bb6f-d47434f78097 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:08.215368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344f1ed-556f-4987-bb6f-d47434f78097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:08.266064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a344f1ed-556f-4987-bb6f-d47434f78097 None None] MFA Rules not processed for user `e55f4db48308479eb270380f6ee42a66`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:08.268099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a344f1ed-556f-4987-bb6f-d47434f78097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:08.420667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:08.428337 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3391/6782] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:08.441577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b70842-339b-4675-ba29-78b783261872 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:08.552593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b70842-339b-4675-ba29-78b783261872 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:08.558386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79db422-a09a-4e7f-a2fe-00c369edd0f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:08.559365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79db422-a09a-4e7f-a2fe-00c369edd0f0 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:08.559747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79db422-a09a-4e7f-a2fe-00c369edd0f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:08.560137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79db422-a09a-4e7f-a2fe-00c369edd0f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:08.574409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79db422-a09a-4e7f-a2fe-00c369edd0f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:08.578122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79db422-a09a-4e7f-a2fe-00c369edd0f0 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:08.594079 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3392/6783] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:09.604527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344f1ed-556f-4987-bb6f-d47434f78097 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:09.606360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a344f1ed-556f-4987-bb6f-d47434f78097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:09.634390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344f1ed-556f-4987-bb6f-d47434f78097 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:09.642070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f416c-3f14-42da-b3cb-7c9c0a3c41ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:09.642823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f416c-3f14-42da-b3cb-7c9c0a3c41ec service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:09.643176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f416c-3f14-42da-b3cb-7c9c0a3c41ec service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:09.643520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f416c-3f14-42da-b3cb-7c9c0a3c41ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:09.795629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f416c-3f14-42da-b3cb-7c9c0a3c41ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:09.797101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f416c-3f14-42da-b3cb-7c9c0a3c41ec service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:09.814602 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3392/6784] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:12.108354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f43619-a02b-4ce5-bb3a-e640d198acd5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:12.109663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f43619-a02b-4ce5-bb3a-e640d198acd5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:12.110055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f43619-a02b-4ce5-bb3a-e640d198acd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:12.148335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d2f43619-a02b-4ce5-bb3a-e640d198acd5 None None] MFA Rules not processed for user `3a292ffe2c5c41ef8d281fa525792b16`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:12.150159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d2f43619-a02b-4ce5-bb3a-e640d198acd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:12.292652 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3393/6785] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:12.791021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f416c-3f14-42da-b3cb-7c9c0a3c41ec service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:12.793852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fc1f416c-3f14-42da-b3cb-7c9c0a3c41ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:12.956967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f416c-3f14-42da-b3cb-7c9c0a3c41ec service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:12.965317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13fd65-451c-444e-bc83-f8bd05135f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:12.965958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13fd65-451c-444e-bc83-f8bd05135f49 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:12.966238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13fd65-451c-444e-bc83-f8bd05135f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:12.966561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13fd65-451c-444e-bc83-f8bd05135f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:12.969960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ad13fd65-451c-444e-bc83-f8bd05135f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:12.993358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13fd65-451c-444e-bc83-f8bd05135f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:12.996298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13fd65-451c-444e-bc83-f8bd05135f49 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:13.022673 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3393/6786] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:14.662560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f43619-a02b-4ce5-bb3a-e640d198acd5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:14.664531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d2f43619-a02b-4ce5-bb3a-e640d198acd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:14.787171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:14.843112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f43619-a02b-4ce5-bb3a-e640d198acd5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:14.863697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:14.865387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:14.865677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:14.865957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] PATH_INFO: `/v3/users/b6c2435b9e9b4ce0bdddeb9d8d9d398a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:14.870927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c2435b9e9b4ce0bdddeb9d8d9d398a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:14.877317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:14.901789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13fd65-451c-444e-bc83-f8bd05135f49 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:14.916694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13fd65-451c-444e-bc83-f8bd05135f49 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:14.926155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f27bf3-c4f6-45a7-8390-233d3aa1730c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:14.927823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f27bf3-c4f6-45a7-8390-233d3aa1730c service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:14.928315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f27bf3-c4f6-45a7-8390-233d3aa1730c service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:14.928741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f27bf3-c4f6-45a7-8390-233d3aa1730c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:15.009294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f27bf3-c4f6-45a7-8390-233d3aa1730c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:15.010042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c2435b9e9b4ce0bdddeb9d8d9d398a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:15.011141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f27bf3-c4f6-45a7-8390-233d3aa1730c service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:15.025662 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3394/6787] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:15.044446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c2435b9e9b4ce0bdddeb9d8d9d398a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:15.049651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c2435b9e9b4ce0bdddeb9d8d9d398a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:15.050281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c2435b9e9b4ce0bdddeb9d8d9d398a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:15.065641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c2435b9e9b4ce0bdddeb9d8d9d398a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:15.087568 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3394/6788] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:14 2022] DELETE /identity/v3/users/b6c2435b9e9b4ce0bdddeb9d8d9d398a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:15.092453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c1b88-dc84-479c-b785-d8754626a2c9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:15.092857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c1b88-dc84-479c-b785-d8754626a2c9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:15.093247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c1b88-dc84-479c-b785-d8754626a2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:15.124187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f97c1b88-dc84-479c-b785-d8754626a2c9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:15.127849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f97c1b88-dc84-479c-b785-d8754626a2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:15.208489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:15.244161 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3395/6789] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:15.263583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:15.265090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:15.742438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06635509-b21f-43ff-8f9d-df20ea335f02 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:15.748066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae93d46-c9f7-44c7-88c6-c15250c13e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:15.749157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae93d46-c9f7-44c7-88c6-c15250c13e02 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:15.749640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae93d46-c9f7-44c7-88c6-c15250c13e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:15.750119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae93d46-c9f7-44c7-88c6-c15250c13e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:15.761538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae93d46-c9f7-44c7-88c6-c15250c13e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:15.763891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae93d46-c9f7-44c7-88c6-c15250c13e02 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:15.776402 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3395/6790] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:16.519503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c1b88-dc84-479c-b785-d8754626a2c9 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:16.521166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f97c1b88-dc84-479c-b785-d8754626a2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:16.588566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c1b88-dc84-479c-b785-d8754626a2c9 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:16.611212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:16.613974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:16.614515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:16.615017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] PATH_INFO: `/v3/projects/ac9f34a3f75d4a89aa479c070da8473b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:16.616648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9f34a3f75d4a89aa479c070da8473b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:16.624370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:16.810385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9f34a3f75d4a89aa479c070da8473b', 'request_id': 'req-4e711fcb-225b-42fe-86d5-a50a0c4812b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:16.829461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9f34a3f75d4a89aa479c070da8473b', 'request_id': 'req-4e711fcb-225b-42fe-86d5-a50a0c4812b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:16.836924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9f34a3f75d4a89aa479c070da8473b', 'request_id': 'req-4e711fcb-225b-42fe-86d5-a50a0c4812b9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:16.849948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] The token cache is being invalidate because project ac9f34a3f75d4a89aa479c070da8473b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:16.850239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:16.850992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:16.857492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae93d46-c9f7-44c7-88c6-c15250c13e02 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:16.868350 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3396/6791] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:16 2022] DELETE /identity/v3/projects/ac9f34a3f75d4a89aa479c070da8473b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:16.869724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae93d46-c9f7-44c7-88c6-c15250c13e02 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:17.021594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:17.023794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:17.023794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:17.025790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] PATH_INFO: `/v3/users/ab660a1eea2d4722b3312b68b9349192` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:17.027225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab660a1eea2d4722b3312b68b9349192)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:17.031296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:17.047868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:17.131772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab660a1eea2d4722b3312b68b9349192'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:17.148237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab660a1eea2d4722b3312b68b9349192'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:17.149076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab660a1eea2d4722b3312b68b9349192'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:17.149725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab660a1eea2d4722b3312b68b9349192'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:17.180849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab660a1eea2d4722b3312b68b9349192'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:17.212648 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3396/6792] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:16 2022] DELETE /identity/v3/users/ab660a1eea2d4722b3312b68b9349192 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:18.390184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:18.392988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:18.437384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e711fcb-225b-42fe-86d5-a50a0c4812b9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:18.605881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36c175-d0b6-4e67-b10d-00b844024e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:18.606788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36c175-d0b6-4e67-b10d-00b844024e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:18.607245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36c175-d0b6-4e67-b10d-00b844024e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:18.608089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36c175-d0b6-4e67-b10d-00b844024e67 admin admin] PATH_INFO: `/v3/projects/4c34ed296b0c4d33b9b6b7d4ce1ea3d8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:18.609560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36c175-d0b6-4e67-b10d-00b844024e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c34ed296b0c4d33b9b6b7d4ce1ea3d8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:18.611894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36c175-d0b6-4e67-b10d-00b844024e67 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:18.624387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:18.625930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:18.645175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab8720-bb37-436f-ae26-9f0f6941e2f5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:18.659046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962695b-d26a-4611-aaee-cafe54c33d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:18.661578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962695b-d26a-4611-aaee-cafe54c33d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:18.662262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962695b-d26a-4611-aaee-cafe54c33d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:18.663923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962695b-d26a-4611-aaee-cafe54c33d8c admin admin] PATH_INFO: `/v3/users/41787fb5fc0e4c328f5c42d7ccaa4420` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:18.666008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962695b-d26a-4611-aaee-cafe54c33d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=41787fb5fc0e4c328f5c42d7ccaa4420)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:18.669972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962695b-d26a-4611-aaee-cafe54c33d8c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:18.677987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9f36c175-d0b6-4e67-b10d-00b844024e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c34ed296b0c4d33b9b6b7d4ce1ea3d8', 'request_id': 'req-9f36c175-d0b6-4e67-b10d-00b844024e67'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:18.691740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9f36c175-d0b6-4e67-b10d-00b844024e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c34ed296b0c4d33b9b6b7d4ce1ea3d8', 'request_id': 'req-9f36c175-d0b6-4e67-b10d-00b844024e67'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:18.698712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:18.700884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9f36c175-d0b6-4e67-b10d-00b844024e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c34ed296b0c4d33b9b6b7d4ce1ea3d8', 'request_id': 'req-9f36c175-d0b6-4e67-b10d-00b844024e67'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:18.727279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9f36c175-d0b6-4e67-b10d-00b844024e67 admin admin] The token cache is being invalidate because project 4c34ed296b0c4d33b9b6b7d4ce1ea3d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:18.728207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9f36c175-d0b6-4e67-b10d-00b844024e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:18.729498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9f36c175-d0b6-4e67-b10d-00b844024e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:18.752907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6962695b-d26a-4611-aaee-cafe54c33d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41787fb5fc0e4c328f5c42d7ccaa4420'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:18.753664 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3397/6793] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:18 2022] DELETE /identity/v3/projects/4c34ed296b0c4d33b9b6b7d4ce1ea3d8 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:18.758308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db227990-e69c-4ffe-931c-0d78dbfe93ba None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:18.759610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db227990-e69c-4ffe-931c-0d78dbfe93ba None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:18.760796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db227990-e69c-4ffe-931c-0d78dbfe93ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:18.767797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6962695b-d26a-4611-aaee-cafe54c33d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41787fb5fc0e4c328f5c42d7ccaa4420'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:18.769285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6962695b-d26a-4611-aaee-cafe54c33d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41787fb5fc0e4c328f5c42d7ccaa4420'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:18.770185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6962695b-d26a-4611-aaee-cafe54c33d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41787fb5fc0e4c328f5c42d7ccaa4420'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:18.788717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6962695b-d26a-4611-aaee-cafe54c33d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41787fb5fc0e4c328f5c42d7ccaa4420'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:18.812931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-db227990-e69c-4ffe-931c-0d78dbfe93ba None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:18.816310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-db227990-e69c-4ffe-931c-0d78dbfe93ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:18.818975 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3397/6794] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:18 2022] DELETE /identity/v3/users/41787fb5fc0e4c328f5c42d7ccaa4420 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:18.825959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256ede4-7d37-44eb-b528-f0e8da7ff6fc None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:18.826255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256ede4-7d37-44eb-b528-f0e8da7ff6fc None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:18.826622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256ede4-7d37-44eb-b528-f0e8da7ff6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:18.884220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3256ede4-7d37-44eb-b528-f0e8da7ff6fc None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:18.885528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3256ede4-7d37-44eb-b528-f0e8da7ff6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:18.991741 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3398/6795] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:19.000174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71addb-48b4-41e0-9d5a-f26e5e76116b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:19.000638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71addb-48b4-41e0-9d5a-f26e5e76116b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:19.000923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71addb-48b4-41e0-9d5a-f26e5e76116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:19.010554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:19.045833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-df71addb-48b4-41e0-9d5a-f26e5e76116b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:19.047123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-df71addb-48b4-41e0-9d5a-f26e5e76116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:19.049394 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3398/6796] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:19.059110 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3399/6797] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:19.063428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256ede4-7d37-44eb-b528-f0e8da7ff6fc None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:19.063866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71addb-48b4-41e0-9d5a-f26e5e76116b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:19.068597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-df71addb-48b4-41e0-9d5a-f26e5e76116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:19.079367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256ede4-7d37-44eb-b528-f0e8da7ff6fc None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:19.087089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdcc4a-6e9a-4d45-8501-409e7218ee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:19.088052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdcc4a-6e9a-4d45-8501-409e7218ee88 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:19.088924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdcc4a-6e9a-4d45-8501-409e7218ee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:19.089605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdcc4a-6e9a-4d45-8501-409e7218ee88 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:19.091305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdcc4a-6e9a-4d45-8501-409e7218ee88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:19.092495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdcc4a-6e9a-4d45-8501-409e7218ee88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:19.094411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdcc4a-6e9a-4d45-8501-409e7218ee88 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:19.118121 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3399/6798] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:19:19.119525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdcc4a-6e9a-4d45-8501-409e7218ee88 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:19.144989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71addb-48b4-41e0-9d5a-f26e5e76116b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:19.148721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbb653-ee87-40fc-b3c9-85731816d4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:19.149363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbb653-ee87-40fc-b3c9-85731816d4be service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:19.149644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbb653-ee87-40fc-b3c9-85731816d4be service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:19.149915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbb653-ee87-40fc-b3c9-85731816d4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:19.160386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbb653-ee87-40fc-b3c9-85731816d4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:19.162187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbb653-ee87-40fc-b3c9-85731816d4be service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:19.170943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdcc4a-6e9a-4d45-8501-409e7218ee88 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:19.175281 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3400/6799] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:19:19.210819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c67813-2489-4b0f-aab3-5f761332d07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:19.211713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c67813-2489-4b0f-aab3-5f761332d07c admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:19.212052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c67813-2489-4b0f-aab3-5f761332d07c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:19.212279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c67813-2489-4b0f-aab3-5f761332d07c admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:19.212922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c67813-2489-4b0f-aab3-5f761332d07c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:19.223945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c67813-2489-4b0f-aab3-5f761332d07c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:19.274137 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3400/6800] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:19 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:19.279010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbb653-ee87-40fc-b3c9-85731816d4be service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:19.300015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbb653-ee87-40fc-b3c9-85731816d4be service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:19.437110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4337d44-f759-4f4a-a7d4-b17fcb7296aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:19.437887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4337d44-f759-4f4a-a7d4-b17fcb7296aa admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:19.438802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4337d44-f759-4f4a-a7d4-b17fcb7296aa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:19.439183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4337d44-f759-4f4a-a7d4-b17fcb7296aa admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:19.441404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4337d44-f759-4f4a-a7d4-b17fcb7296aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:19.445563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4337d44-f759-4f4a-a7d4-b17fcb7296aa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:19.529097 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3401/6801] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:19 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:19.531236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c67813-2489-4b0f-aab3-5f761332d07c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:19.545479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c67813-2489-4b0f-aab3-5f761332d07c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:19.552088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0296809-22eb-413d-ae2e-ab1b36a9ff5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:19.552952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0296809-22eb-413d-ae2e-ab1b36a9ff5a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:19.553433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0296809-22eb-413d-ae2e-ab1b36a9ff5a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:19.553914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0296809-22eb-413d-ae2e-ab1b36a9ff5a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:19.554749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0296809-22eb-413d-ae2e-ab1b36a9ff5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:19.556543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0296809-22eb-413d-ae2e-ab1b36a9ff5a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:19.576139 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3401/6802] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:19.577802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4337d44-f759-4f4a-a7d4-b17fcb7296aa admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:19.596101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4337d44-f759-4f4a-a7d4-b17fcb7296aa admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:19.607481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbda33-77c7-4668-9db4-3f19c9315d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:19.608685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbda33-77c7-4668-9db4-3f19c9315d2e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:19.609694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbda33-77c7-4668-9db4-3f19c9315d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:19.610383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbda33-77c7-4668-9db4-3f19c9315d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:19.612250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbda33-77c7-4668-9db4-3f19c9315d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:19.615567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbda33-77c7-4668-9db4-3f19c9315d2e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:19.641178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0296809-22eb-413d-ae2e-ab1b36a9ff5a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:19.643441 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3402/6803] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:19.655156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0296809-22eb-413d-ae2e-ab1b36a9ff5a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:19.660809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ac036-cece-4fd1-b741-76a45d2fb178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:19.661726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac036-cece-4fd1-b741-76a45d2fb178 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:19.662310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac036-cece-4fd1-b741-76a45d2fb178 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:19.663684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac036-cece-4fd1-b741-76a45d2fb178 admin admin] PATH_INFO: `/v3/projects/a01b0df5d26345f4bd46b9d95953458f/users/0a088ba15d034d75a34542eb9c5907da/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:19.695353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ac036-cece-4fd1-b741-76a45d2fb178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01b0df5d26345f4bd46b9d95953458f, user_id=0a088ba15d034d75a34542eb9c5907da, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:19.698991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ac036-cece-4fd1-b741-76a45d2fb178 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:19.700726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbda33-77c7-4668-9db4-3f19c9315d2e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:19.702981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4ddbda33-77c7-4668-9db4-3f19c9315d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:19.755263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbda33-77c7-4668-9db4-3f19c9315d2e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:19.767162 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3402/6804] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:19 2022] PUT /identity/v3/projects/a01b0df5d26345f4bd46b9d95953458f/users/0a088ba15d034d75a34542eb9c5907da/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:19.768481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:19.780639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674818e9-298b-4298-a9f5-834705f8c0c3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:19.780841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674818e9-298b-4298-a9f5-834705f8c0c3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:19.781127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674818e9-298b-4298-a9f5-834705f8c0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:19.865035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-674818e9-298b-4298-a9f5-834705f8c0c3 None None] MFA Rules not processed for user `0a088ba15d034d75a34542eb9c5907da`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:19.866448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-674818e9-298b-4298-a9f5-834705f8c0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:19.878443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:19.879175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:19.879527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:19.879878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] PATH_INFO: `/v3/projects/1b5ebbb0ec7c4a92aa6b857dc95dc620` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:19.881214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5ebbb0ec7c4a92aa6b857dc95dc620)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:19.883452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:19.964013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5ebbb0ec7c4a92aa6b857dc95dc620', 'request_id': 'req-5c4a60d5-be07-4cc7-90be-123c3939dad6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:19.977827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5ebbb0ec7c4a92aa6b857dc95dc620', 'request_id': 'req-5c4a60d5-be07-4cc7-90be-123c3939dad6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:19.988721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5ebbb0ec7c4a92aa6b857dc95dc620', 'request_id': 'req-5c4a60d5-be07-4cc7-90be-123c3939dad6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:19.997133 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3403/6805] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:20.004626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674818e9-298b-4298-a9f5-834705f8c0c3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:20.006120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-674818e9-298b-4298-a9f5-834705f8c0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:20.020269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] The token cache is being invalidate because project 1b5ebbb0ec7c4a92aa6b857dc95dc620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:20.020567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:20.023556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:20.045869 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3403/6806] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:19 2022] DELETE /identity/v3/projects/1b5ebbb0ec7c4a92aa6b857dc95dc620 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:20.052107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:20.056160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:20.104131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674818e9-298b-4298-a9f5-834705f8c0c3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:20.161119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:20.172873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a60d5-be07-4cc7-90be-123c3939dad6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:20.179473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:20.180123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:20.180398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:20.180667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] PATH_INFO: `/v3/users/c62692620049448db2140ef689132a60` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:20.182538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62692620049448db2140ef689132a60)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:20.184222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:20.206339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70f2f8-1588-47a1-a708-ba9d74c3d1fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:20.206995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70f2f8-1588-47a1-a708-ba9d74c3d1fe service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:20.207273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70f2f8-1588-47a1-a708-ba9d74c3d1fe service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:20.207544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70f2f8-1588-47a1-a708-ba9d74c3d1fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:20.210824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-de70f2f8-1588-47a1-a708-ba9d74c3d1fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:20.260848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:20.272374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62692620049448db2140ef689132a60'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:20.284722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62692620049448db2140ef689132a60'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:20.285692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62692620049448db2140ef689132a60'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:20.286372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62692620049448db2140ef689132a60'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:20.306440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62692620049448db2140ef689132a60'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:20.335319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70f2f8-1588-47a1-a708-ba9d74c3d1fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:20.336783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70f2f8-1588-47a1-a708-ba9d74c3d1fe service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:20.339070 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3404/6807] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:20 2022] DELETE /identity/v3/users/c62692620049448db2140ef689132a60 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:20.374551 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3404/6808] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:20.390847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:20.392425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:20.514964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827cd54-d336-454a-86a6-b789a081945f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:20.532773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:20.533466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:20.533746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:20.534020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] PATH_INFO: `/v3/users/0a088ba15d034d75a34542eb9c5907da` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:20.535206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a088ba15d034d75a34542eb9c5907da)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:20.537172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:20.670344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a088ba15d034d75a34542eb9c5907da'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:20.682742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a088ba15d034d75a34542eb9c5907da'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:20.684114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a088ba15d034d75a34542eb9c5907da'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:20.684971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a088ba15d034d75a34542eb9c5907da'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:20.724687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a088ba15d034d75a34542eb9c5907da'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:20.765783 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3405/6809] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:20 2022] DELETE /identity/v3/users/0a088ba15d034d75a34542eb9c5907da => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:20.774866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7450d-7a4f-4827-a6d0-1fbd5dcdd1ec None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:20.775342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7450d-7a4f-4827-a6d0-1fbd5dcdd1ec None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:20.775802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7450d-7a4f-4827-a6d0-1fbd5dcdd1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:20.835943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:20.845811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:20.888785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-98b7450d-7a4f-4827-a6d0-1fbd5dcdd1ec None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:20.896434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-98b7450d-7a4f-4827-a6d0-1fbd5dcdd1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:20.971629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:21.049832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59384f7-4d51-404d-b966-cf4c41ba760f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:21.056068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:21.056720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:21.057005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:21.057339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] PATH_INFO: `/v3/projects/ba49908b51854e7d8d8fc3c2234eb52e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:21.058850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba49908b51854e7d8d8fc3c2234eb52e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:21.061379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:21.093307 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3405/6810] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:21.127327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7450d-7a4f-4827-a6d0-1fbd5dcdd1ec None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:21.129414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-98b7450d-7a4f-4827-a6d0-1fbd5dcdd1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:21.166801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba49908b51854e7d8d8fc3c2234eb52e', 'request_id': 'req-391b3cd2-ca66-49a5-804e-b6599ce04140'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:21.184549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba49908b51854e7d8d8fc3c2234eb52e', 'request_id': 'req-391b3cd2-ca66-49a5-804e-b6599ce04140'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:21.195935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba49908b51854e7d8d8fc3c2234eb52e', 'request_id': 'req-391b3cd2-ca66-49a5-804e-b6599ce04140'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:21.224551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] The token cache is being invalidate because project ba49908b51854e7d8d8fc3c2234eb52e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:21.224836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:21.227880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:21.234238 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3406/6811] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:20 2022] DELETE /identity/v3/projects/ba49908b51854e7d8d8fc3c2234eb52e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:21.238192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:21.239624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:21.293175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7450d-7a4f-4827-a6d0-1fbd5dcdd1ec None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:21.347231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b3cd2-ca66-49a5-804e-b6599ce04140 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:21.354746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3791a-4ab2-4a0a-8f65-aebcd620ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:21.355517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3791a-4ab2-4a0a-8f65-aebcd620ab3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:21.356163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3791a-4ab2-4a0a-8f65-aebcd620ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:21.356587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3791a-4ab2-4a0a-8f65-aebcd620ab3e admin admin] PATH_INFO: `/v3/users/e55f4db48308479eb270380f6ee42a66` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:21.358129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3791a-4ab2-4a0a-8f65-aebcd620ab3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55f4db48308479eb270380f6ee42a66)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:21.360398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3791a-4ab2-4a0a-8f65-aebcd620ab3e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:21.380938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:21.404642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2c4b2-bf01-4d02-9b62-fc9cfb0576aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:21.405531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2c4b2-bf01-4d02-9b62-fc9cfb0576aa service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:21.405885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2c4b2-bf01-4d02-9b62-fc9cfb0576aa service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:21.406275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2c4b2-bf01-4d02-9b62-fc9cfb0576aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:21.409104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-91c2c4b2-bf01-4d02-9b62-fc9cfb0576aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:21.440536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2c4b2-bf01-4d02-9b62-fc9cfb0576aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:21.451031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2c4b2-bf01-4d02-9b62-fc9cfb0576aa service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:21.464361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03e3791a-4ab2-4a0a-8f65-aebcd620ab3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55f4db48308479eb270380f6ee42a66'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:21.479367 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3406/6812] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:19:21.483497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03e3791a-4ab2-4a0a-8f65-aebcd620ab3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55f4db48308479eb270380f6ee42a66'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:21.484318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03e3791a-4ab2-4a0a-8f65-aebcd620ab3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55f4db48308479eb270380f6ee42a66'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:21.489016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03e3791a-4ab2-4a0a-8f65-aebcd620ab3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55f4db48308479eb270380f6ee42a66'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:21.502518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:21.509915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-03e3791a-4ab2-4a0a-8f65-aebcd620ab3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55f4db48308479eb270380f6ee42a66'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:21.532281 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3407/6813] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:21 2022] DELETE /identity/v3/users/e55f4db48308479eb270380f6ee42a66 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:21.954551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2c4b2-bf01-4d02-9b62-fc9cfb0576aa service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:21.976494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2c4b2-bf01-4d02-9b62-fc9cfb0576aa service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:22.170168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:22.171435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:22.171727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:22.174262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] PATH_INFO: `/v3/projects/99dbe87cad764366b636f4bea0036a0b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:22.175648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99dbe87cad764366b636f4bea0036a0b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:22.186159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:22.317518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99dbe87cad764366b636f4bea0036a0b', 'request_id': 'req-ec0f4e9b-2850-436e-91f7-559e2289d131'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:22.338516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99dbe87cad764366b636f4bea0036a0b', 'request_id': 'req-ec0f4e9b-2850-436e-91f7-559e2289d131'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:22.348091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99dbe87cad764366b636f4bea0036a0b', 'request_id': 'req-ec0f4e9b-2850-436e-91f7-559e2289d131'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:22.378864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] The token cache is being invalidate because project 99dbe87cad764366b636f4bea0036a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:22.379375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:22.381730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:22.389027 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3407/6814] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:21 2022] DELETE /identity/v3/projects/99dbe87cad764366b636f4bea0036a0b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:22.390803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed2111-d19a-46c1-8ecc-06fffb4fcdf0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:22.391091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed2111-d19a-46c1-8ecc-06fffb4fcdf0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:22.391367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed2111-d19a-46c1-8ecc-06fffb4fcdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:22.440443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b6ed2111-d19a-46c1-8ecc-06fffb4fcdf0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:22.442070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b6ed2111-d19a-46c1-8ecc-06fffb4fcdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:22.550376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:22.552283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:22.609938 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3408/6815] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:22.619714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704b401-476e-4e34-8c42-4d5a4f3fdb21 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:22.620348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704b401-476e-4e34-8c42-4d5a4f3fdb21 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:22.620824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704b401-476e-4e34-8c42-4d5a4f3fdb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:22.666009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d704b401-476e-4e34-8c42-4d5a4f3fdb21 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:22.667320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d704b401-476e-4e34-8c42-4d5a4f3fdb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:22.688718 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3409/6816] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:22.692941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704b401-476e-4e34-8c42-4d5a4f3fdb21 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:22.694624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f4e9b-2850-436e-91f7-559e2289d131 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:22.701765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc5a38-7d70-439f-a8b1-426d84c467d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:22.702735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc5a38-7d70-439f-a8b1-426d84c467d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:22.703205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc5a38-7d70-439f-a8b1-426d84c467d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:22.703677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc5a38-7d70-439f-a8b1-426d84c467d4 admin admin] PATH_INFO: `/v3/projects/a01b0df5d26345f4bd46b9d95953458f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:22.705107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc5a38-7d70-439f-a8b1-426d84c467d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01b0df5d26345f4bd46b9d95953458f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:22.706544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704b401-476e-4e34-8c42-4d5a4f3fdb21 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:22.707687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc5a38-7d70-439f-a8b1-426d84c467d4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:22.719080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25acc29-6140-48ab-9e8a-3487f980f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:22.719769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25acc29-6140-48ab-9e8a-3487f980f18f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:22.720054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25acc29-6140-48ab-9e8a-3487f980f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:22.720325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25acc29-6140-48ab-9e8a-3487f980f18f admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:22.720978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25acc29-6140-48ab-9e8a-3487f980f18f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:22.721304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25acc29-6140-48ab-9e8a-3487f980f18f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:22.723037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25acc29-6140-48ab-9e8a-3487f980f18f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:22.730300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:22.749911 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3410/6817] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:19:22.755065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25acc29-6140-48ab-9e8a-3487f980f18f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:22.783936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25acc29-6140-48ab-9e8a-3487f980f18f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:22.795022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-81dc5a38-7d70-439f-a8b1-426d84c467d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01b0df5d26345f4bd46b9d95953458f', 'request_id': 'req-81dc5a38-7d70-439f-a8b1-426d84c467d4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:22.880485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-81dc5a38-7d70-439f-a8b1-426d84c467d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01b0df5d26345f4bd46b9d95953458f', 'request_id': 'req-81dc5a38-7d70-439f-a8b1-426d84c467d4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:22.905063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-81dc5a38-7d70-439f-a8b1-426d84c467d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01b0df5d26345f4bd46b9d95953458f', 'request_id': 'req-81dc5a38-7d70-439f-a8b1-426d84c467d4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:22.921607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-81dc5a38-7d70-439f-a8b1-426d84c467d4 admin admin] The token cache is being invalidate because project a01b0df5d26345f4bd46b9d95953458f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:22.921861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-81dc5a38-7d70-439f-a8b1-426d84c467d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:22.922606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-81dc5a38-7d70-439f-a8b1-426d84c467d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:22.928868 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3408/6818] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:22 2022] DELETE /identity/v3/projects/a01b0df5d26345f4bd46b9d95953458f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:22.930887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12449e17-3572-4fad-ab3e-7e35f4f9b8a8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:22.933234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12449e17-3572-4fad-ab3e-7e35f4f9b8a8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:22.933734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12449e17-3572-4fad-ab3e-7e35f4f9b8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:22.933867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4757309-9e58-4fce-a8ef-4e51fa61a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:22.934361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4757309-9e58-4fce-a8ef-4e51fa61a90a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:22.935241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4757309-9e58-4fce-a8ef-4e51fa61a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:22.935241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4757309-9e58-4fce-a8ef-4e51fa61a90a admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:22.936561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4757309-9e58-4fce-a8ef-4e51fa61a90a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:22.937656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4757309-9e58-4fce-a8ef-4e51fa61a90a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:22.984786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-12449e17-3572-4fad-ab3e-7e35f4f9b8a8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:22.986103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-12449e17-3572-4fad-ab3e-7e35f4f9b8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:22.994770 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3409/6819] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:23.002219 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3411/6820] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:22 2022] POST /identity/v3/projects => generated 399 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:23.007198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12449e17-3572-4fad-ab3e-7e35f4f9b8a8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.014257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-12449e17-3572-4fad-ab3e-7e35f4f9b8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:23.032815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12449e17-3572-4fad-ab3e-7e35f4f9b8a8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.105694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242033b1-c4ce-4c5f-8418-525b2be93ceb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.106935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242033b1-c4ce-4c5f-8418-525b2be93ceb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.107358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242033b1-c4ce-4c5f-8418-525b2be93ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.141161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-242033b1-c4ce-4c5f-8418-525b2be93ceb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:23.142537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-242033b1-c4ce-4c5f-8418-525b2be93ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:23.151911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb824e-7c2e-4f58-8c00-ef6928191527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.153429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb824e-7c2e-4f58-8c00-ef6928191527 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.153972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb824e-7c2e-4f58-8c00-ef6928191527 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.154508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb824e-7c2e-4f58-8c00-ef6928191527 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.155763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb824e-7c2e-4f58-8c00-ef6928191527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.158388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb824e-7c2e-4f58-8c00-ef6928191527 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:23.187009 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3410/6821] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:23 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:23.191159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb824e-7c2e-4f58-8c00-ef6928191527 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.201942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:23.203342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb824e-7c2e-4f58-8c00-ef6928191527 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.214234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f8dcf-22cb-4824-b50f-471f25621f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.215898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f8dcf-22cb-4824-b50f-471f25621f4c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.216353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f8dcf-22cb-4824-b50f-471f25621f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.216937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f8dcf-22cb-4824-b50f-471f25621f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.217895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f8dcf-22cb-4824-b50f-471f25621f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.219658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f8dcf-22cb-4824-b50f-471f25621f4c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:23.223199 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3412/6822] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:23.229723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242033b1-c4ce-4c5f-8418-525b2be93ceb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.232923 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3411/6823] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:23.236860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f8dcf-22cb-4824-b50f-471f25621f4c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.242554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242033b1-c4ce-4c5f-8418-525b2be93ceb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.247722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e905-6ff6-4f3f-98d4-03b7a5cebcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.249122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e905-6ff6-4f3f-98d4-03b7a5cebcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.249122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e905-6ff6-4f3f-98d4-03b7a5cebcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.249122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e905-6ff6-4f3f-98d4-03b7a5cebcb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.249441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f8dcf-22cb-4824-b50f-471f25621f4c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.249716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070e905-6ff6-4f3f-98d4-03b7a5cebcb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:23.250155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070e905-6ff6-4f3f-98d4-03b7a5cebcb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.251837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070e905-6ff6-4f3f-98d4-03b7a5cebcb7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:23.253746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0ed63-5e4a-43c7-9831-a90b27d6af30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.254357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0ed63-5e4a-43c7-9831-a90b27d6af30 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.254637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0ed63-5e4a-43c7-9831-a90b27d6af30 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.255049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0ed63-5e4a-43c7-9831-a90b27d6af30 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.255541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0ed63-5e4a-43c7-9831-a90b27d6af30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.257096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0ed63-5e4a-43c7-9831-a90b27d6af30 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:23.266987 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3413/6824] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:19:23.269227 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3412/6825] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:19:23.273298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0ed63-5e4a-43c7-9831-a90b27d6af30 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.273469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e905-6ff6-4f3f-98d4-03b7a5cebcb7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.284428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e905-6ff6-4f3f-98d4-03b7a5cebcb7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.284823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0ed63-5e4a-43c7-9831-a90b27d6af30 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.290037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24a9fd-e3e5-41e9-a691-3c08729241aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.290675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24a9fd-e3e5-41e9-a691-3c08729241aa admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.290955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24a9fd-e3e5-41e9-a691-3c08729241aa admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.291230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24a9fd-e3e5-41e9-a691-3c08729241aa admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.291586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49201d4-bbdd-4fb6-81d4-501e0ab79bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.291861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24a9fd-e3e5-41e9-a691-3c08729241aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.292592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49201d4-bbdd-4fb6-81d4-501e0ab79bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.293107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49201d4-bbdd-4fb6-81d4-501e0ab79bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.293429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49201d4-bbdd-4fb6-81d4-501e0ab79bc6 admin admin] PATH_INFO: `/v3/projects/7c155f60b9604c2ba97908597a0dfd93/users/1d5a4119d245437ba730c5168145382d/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.293821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24a9fd-e3e5-41e9-a691-3c08729241aa admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:23.311333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49201d4-bbdd-4fb6-81d4-501e0ab79bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c155f60b9604c2ba97908597a0dfd93, user_id=1d5a4119d245437ba730c5168145382d, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.314466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49201d4-bbdd-4fb6-81d4-501e0ab79bc6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:23.327629 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3413/6826] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:23 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:23.328710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24a9fd-e3e5-41e9-a691-3c08729241aa admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.329953 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3414/6827] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:23 2022] PUT /identity/v3/projects/7c155f60b9604c2ba97908597a0dfd93/users/1d5a4119d245437ba730c5168145382d/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:23.343143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06e53-8986-4b2e-aa72-0f63ad2c07bc None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.343460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06e53-8986-4b2e-aa72-0f63ad2c07bc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.343689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06e53-8986-4b2e-aa72-0f63ad2c07bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.383515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-91f06e53-8986-4b2e-aa72-0f63ad2c07bc None None] MFA Rules not processed for user `1d5a4119d245437ba730c5168145382d`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:23.384921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-91f06e53-8986-4b2e-aa72-0f63ad2c07bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:23.388497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:23.416650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24a9fd-e3e5-41e9-a691-3c08729241aa admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.500689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b86fe-c04d-48d5-9ce9-b48d843a5daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.502278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b86fe-c04d-48d5-9ce9-b48d843a5daf admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.502894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b86fe-c04d-48d5-9ce9-b48d843a5daf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.503179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b86fe-c04d-48d5-9ce9-b48d843a5daf admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.503815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b86fe-c04d-48d5-9ce9-b48d843a5daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.511049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b86fe-c04d-48d5-9ce9-b48d843a5daf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:23.522595 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3415/6828] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:23.524319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f06e53-8986-4b2e-aa72-0f63ad2c07bc None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.541630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f06e53-8986-4b2e-aa72-0f63ad2c07bc None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.548868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede4a1b-b2b1-4742-935c-2abd02f041ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.549785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede4a1b-b2b1-4742-935c-2abd02f041ac admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.550241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede4a1b-b2b1-4742-935c-2abd02f041ac admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.550450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede4a1b-b2b1-4742-935c-2abd02f041ac admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.551166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede4a1b-b2b1-4742-935c-2abd02f041ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.558133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede4a1b-b2b1-4742-935c-2abd02f041ac admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:23.570515 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3414/6829] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:23 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:23.572926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b86fe-c04d-48d5-9ce9-b48d843a5daf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.599663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b86fe-c04d-48d5-9ce9-b48d843a5daf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.605452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724d3e8-4188-4500-b3d8-a0bb06217cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.607681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724d3e8-4188-4500-b3d8-a0bb06217cbc admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.607950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724d3e8-4188-4500-b3d8-a0bb06217cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.608238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724d3e8-4188-4500-b3d8-a0bb06217cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.608963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724d3e8-4188-4500-b3d8-a0bb06217cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.610878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724d3e8-4188-4500-b3d8-a0bb06217cbc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:23.628061 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3415/6830] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:19:23.629226 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3416/6831] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:23 2022] POST /identity/v3/projects => generated 399 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:23.632260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724d3e8-4188-4500-b3d8-a0bb06217cbc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.632995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede4a1b-b2b1-4742-935c-2abd02f041ac admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.645822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724d3e8-4188-4500-b3d8-a0bb06217cbc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.716280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede4a1b-b2b1-4742-935c-2abd02f041ac admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.723273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0035d6f-19af-40a8-b3ab-463000568754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.723844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0035d6f-19af-40a8-b3ab-463000568754 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.724142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0035d6f-19af-40a8-b3ab-463000568754 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.724763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0035d6f-19af-40a8-b3ab-463000568754 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.725445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0035d6f-19af-40a8-b3ab-463000568754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.729408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0035d6f-19af-40a8-b3ab-463000568754 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:23.733503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb62c1b-bca5-4ab4-8c95-8b8cfbf0ea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.734208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb62c1b-bca5-4ab4-8c95-8b8cfbf0ea71 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.734562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb62c1b-bca5-4ab4-8c95-8b8cfbf0ea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.734927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb62c1b-bca5-4ab4-8c95-8b8cfbf0ea71 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.735631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb62c1b-bca5-4ab4-8c95-8b8cfbf0ea71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.737436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb62c1b-bca5-4ab4-8c95-8b8cfbf0ea71 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:23.755373 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3416/6832] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:23.757936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb62c1b-bca5-4ab4-8c95-8b8cfbf0ea71 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.765602 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3417/6833] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:23 2022] POST /identity/v3/users => generated 306 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:23.769425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0035d6f-19af-40a8-b3ab-463000568754 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.777284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb62c1b-bca5-4ab4-8c95-8b8cfbf0ea71 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.783229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0035d6f-19af-40a8-b3ab-463000568754 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.784069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5ac56-7a80-4328-8bf2-c34a4fcf8ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.784761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ac56-7a80-4328-8bf2-c34a4fcf8ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.785051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ac56-7a80-4328-8bf2-c34a4fcf8ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.785411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ac56-7a80-4328-8bf2-c34a4fcf8ff9 admin admin] PATH_INFO: `/v3/projects/87bcd32262fb4b00b99260e3db3e5246/users/2564503039b343d8a2f5a483fd05c84e/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.790411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef1cbb-2eb1-4736-bda3-f594e365a7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.791746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef1cbb-2eb1-4736-bda3-f594e365a7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.792295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef1cbb-2eb1-4736-bda3-f594e365a7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.792903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef1cbb-2eb1-4736-bda3-f594e365a7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.793543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef1cbb-2eb1-4736-bda3-f594e365a7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.795345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef1cbb-2eb1-4736-bda3-f594e365a7f9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:23.803546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:23.803865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5ac56-7a80-4328-8bf2-c34a4fcf8ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87bcd32262fb4b00b99260e3db3e5246, user_id=2564503039b343d8a2f5a483fd05c84e, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.808450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5ac56-7a80-4328-8bf2-c34a4fcf8ff9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:23.813402 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3418/6834] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:23.817077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef1cbb-2eb1-4736-bda3-f594e365a7f9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:23.828684 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3417/6835] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:23 2022] PUT /identity/v3/projects/87bcd32262fb4b00b99260e3db3e5246/users/2564503039b343d8a2f5a483fd05c84e/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:23.831619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef1cbb-2eb1-4736-bda3-f594e365a7f9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:23.839518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70690a7-50c6-4a61-9e2c-1f2db0ebdc80 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.840636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70690a7-50c6-4a61-9e2c-1f2db0ebdc80 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.841024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70690a7-50c6-4a61-9e2c-1f2db0ebdc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.885773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e70690a7-50c6-4a61-9e2c-1f2db0ebdc80 None None] MFA Rules not processed for user `2564503039b343d8a2f5a483fd05c84e`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:23.892086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e70690a7-50c6-4a61-9e2c-1f2db0ebdc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:23.922071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08bf09-dd16-4321-b64e-f14aa6e5b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:23.925782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08bf09-dd16-4321-b64e-f14aa6e5b305 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:23.926661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08bf09-dd16-4321-b64e-f14aa6e5b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:23.928030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08bf09-dd16-4321-b64e-f14aa6e5b305 admin admin] PATH_INFO: `/v3/projects/e11cb1981ab44b23a1ce65c57da83c97/users/a542f954ed7d431ebbca2858a2dbfd32/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:23.962285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:23.971896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08bf09-dd16-4321-b64e-f14aa6e5b305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11cb1981ab44b23a1ce65c57da83c97, user_id=a542f954ed7d431ebbca2858a2dbfd32, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:23.975412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08bf09-dd16-4321-b64e-f14aa6e5b305 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:24.012585 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3419/6836] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:23 2022] PUT /identity/v3/projects/e11cb1981ab44b23a1ce65c57da83c97/users/a542f954ed7d431ebbca2858a2dbfd32/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:24.016005 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3418/6837] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:24.016706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08bf09-dd16-4321-b64e-f14aa6e5b305 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:24.044760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70690a7-50c6-4a61-9e2c-1f2db0ebdc80 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:24.046373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e70690a7-50c6-4a61-9e2c-1f2db0ebdc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:24.139644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70690a7-50c6-4a61-9e2c-1f2db0ebdc80 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:24.185762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08bf09-dd16-4321-b64e-f14aa6e5b305 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:24.192016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e282af0-acfb-4aaf-ae1b-5ffaa030033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:24.192637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e282af0-acfb-4aaf-ae1b-5ffaa030033e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:24.192920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e282af0-acfb-4aaf-ae1b-5ffaa030033e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:24.193283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e282af0-acfb-4aaf-ae1b-5ffaa030033e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:24.193939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e282af0-acfb-4aaf-ae1b-5ffaa030033e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:24.195775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e282af0-acfb-4aaf-ae1b-5ffaa030033e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:24.201169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54415a4-9efb-4fbb-aef1-b2d6992b5307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:24.201815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54415a4-9efb-4fbb-aef1-b2d6992b5307 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:24.202095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54415a4-9efb-4fbb-aef1-b2d6992b5307 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:24.202376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54415a4-9efb-4fbb-aef1-b2d6992b5307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:24.212529 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3420/6838] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:24.213826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e282af0-acfb-4aaf-ae1b-5ffaa030033e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:24.225956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e282af0-acfb-4aaf-ae1b-5ffaa030033e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:24.232570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35c625-d637-4d06-b9f6-7b8ae5eafd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:24.233289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35c625-d637-4d06-b9f6-7b8ae5eafd28 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:24.233576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35c625-d637-4d06-b9f6-7b8ae5eafd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:24.233860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35c625-d637-4d06-b9f6-7b8ae5eafd28 admin admin] PATH_INFO: `/v3/projects/e11cb1981ab44b23a1ce65c57da83c97/users/a542f954ed7d431ebbca2858a2dbfd32/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:24.236932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35c625-d637-4d06-b9f6-7b8ae5eafd28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11cb1981ab44b23a1ce65c57da83c97, user_id=a542f954ed7d431ebbca2858a2dbfd32, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:24.240950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35c625-d637-4d06-b9f6-7b8ae5eafd28 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:24.254128 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3421/6839] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:24 2022] PUT /identity/v3/projects/e11cb1981ab44b23a1ce65c57da83c97/users/a542f954ed7d431ebbca2858a2dbfd32/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:24.273009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a73221-49a9-4085-b2ab-2018edfff0ec None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:24.274269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a73221-49a9-4085-b2ab-2018edfff0ec None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:24.274448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a73221-49a9-4085-b2ab-2018edfff0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:24.355252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-30a73221-49a9-4085-b2ab-2018edfff0ec None None] MFA Rules not processed for user `a542f954ed7d431ebbca2858a2dbfd32`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:24.360480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-30a73221-49a9-4085-b2ab-2018edfff0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:24.372151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54415a4-9efb-4fbb-aef1-b2d6992b5307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:24.396088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54415a4-9efb-4fbb-aef1-b2d6992b5307 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:24.425543 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3419/6840] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:19:24.455617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:24.490440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54415a4-9efb-4fbb-aef1-b2d6992b5307 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:24.492281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c54415a4-9efb-4fbb-aef1-b2d6992b5307 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:24.495872 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3422/6841] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:24.509923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a73221-49a9-4085-b2ab-2018edfff0ec None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:24.513257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-30a73221-49a9-4085-b2ab-2018edfff0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:24.521615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54415a4-9efb-4fbb-aef1-b2d6992b5307 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:24.590575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:24.631733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a73221-49a9-4085-b2ab-2018edfff0ec None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:24.634664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:24.635662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:24.636252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:24.636981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] PATH_INFO: `/v3/users/16dd376c9ca94b93a943cf19df9582df` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:24.638615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16dd376c9ca94b93a943cf19df9582df)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:24.641734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253d6de-d060-4673-9456-72dc674c8ce1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:24.642153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:24.642380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253d6de-d060-4673-9456-72dc674c8ce1 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:24.642666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253d6de-d060-4673-9456-72dc674c8ce1 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:24.645601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253d6de-d060-4673-9456-72dc674c8ce1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:24.666365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253d6de-d060-4673-9456-72dc674c8ce1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:24.667897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253d6de-d060-4673-9456-72dc674c8ce1 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:24.690612 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3423/6842] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:24 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:19:24.713522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16dd376c9ca94b93a943cf19df9582df'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:24.729545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16dd376c9ca94b93a943cf19df9582df'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:24.730370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16dd376c9ca94b93a943cf19df9582df'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:24.731578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16dd376c9ca94b93a943cf19df9582df'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:24.750385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16dd376c9ca94b93a943cf19df9582df'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:24.767843 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3420/6843] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:24 2022] DELETE /identity/v3/users/16dd376c9ca94b93a943cf19df9582df => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:24.772937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be11eb-eb95-46ed-9204-094526fb07a8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:24.773269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be11eb-eb95-46ed-9204-094526fb07a8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:24.773596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be11eb-eb95-46ed-9204-094526fb07a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:24.799501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:24.801407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:24.802004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b5be11eb-eb95-46ed-9204-094526fb07a8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:24.803178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b5be11eb-eb95-46ed-9204-094526fb07a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:24.901400 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3424/6844] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:24.910651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de8986-28eb-4c13-be10-a64005491b76 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:24.912316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be11eb-eb95-46ed-9204-094526fb07a8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:24.914139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b5be11eb-eb95-46ed-9204-094526fb07a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:24.921309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e0606-b0e6-4a31-93ed-c12e2b25e89e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:24.922052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e0606-b0e6-4a31-93ed-c12e2b25e89e service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:24.922250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e0606-b0e6-4a31-93ed-c12e2b25e89e service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:24.922494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e0606-b0e6-4a31-93ed-c12e2b25e89e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:24.924838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9b0e0606-b0e6-4a31-93ed-c12e2b25e89e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:24.992856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be11eb-eb95-46ed-9204-094526fb07a8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:24.996039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e0606-b0e6-4a31-93ed-c12e2b25e89e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:24.997036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275247e2-8157-4b28-b9cc-c5015b398d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:24.997775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275247e2-8157-4b28-b9cc-c5015b398d5c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:24.997896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e0606-b0e6-4a31-93ed-c12e2b25e89e service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:24.998063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275247e2-8157-4b28-b9cc-c5015b398d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:24.998340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275247e2-8157-4b28-b9cc-c5015b398d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:25.008005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275247e2-8157-4b28-b9cc-c5015b398d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:25.009466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275247e2-8157-4b28-b9cc-c5015b398d5c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:25.013881 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3421/6845] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:24 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:25.019752 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3425/6846] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:19:25.254524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e0606-b0e6-4a31-93ed-c12e2b25e89e service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:25.256126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9b0e0606-b0e6-4a31-93ed-c12e2b25e89e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:25.283326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e0606-b0e6-4a31-93ed-c12e2b25e89e service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:25.291393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:25.292220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:25.292625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:25.293088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4 admin admin] PATH_INFO: `/v3/projects/5de90233a30e448db726f4d7f6b5907e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:25.295255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de90233a30e448db726f4d7f6b5907e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:25.297138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:25.309442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:25.360761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de90233a30e448db726f4d7f6b5907e', 'request_id': 'req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:25.371783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de90233a30e448db726f4d7f6b5907e', 'request_id': 'req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:25.379047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de90233a30e448db726f4d7f6b5907e', 'request_id': 'req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:25.392723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4 admin admin] The token cache is being invalidate because project 5de90233a30e448db726f4d7f6b5907e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:25.393125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:25.393928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-78bc8dbc-ed48-4b33-9b4a-b303f95396f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:25.395697 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3422/6847] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:25 2022] DELETE /identity/v3/projects/5de90233a30e448db726f4d7f6b5907e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:25.402689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f12b4-78d8-4408-9d62-0256c79cb73a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:25.402972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f12b4-78d8-4408-9d62-0256c79cb73a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:25.403266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f12b4-78d8-4408-9d62-0256c79cb73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:25.430378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e05f12b4-78d8-4408-9d62-0256c79cb73a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:25.431878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e05f12b4-78d8-4408-9d62-0256c79cb73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:25.466862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:25.499270 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3426/6848] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:25.507146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86263635-1ed7-4f6e-943b-d693512b1d3f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:25.507498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86263635-1ed7-4f6e-943b-d693512b1d3f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:25.507993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86263635-1ed7-4f6e-943b-d693512b1d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:25.528224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-86263635-1ed7-4f6e-943b-d693512b1d3f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:25.529528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-86263635-1ed7-4f6e-943b-d693512b1d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:25.537824 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3423/6849] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:25.542021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f12b4-78d8-4408-9d62-0256c79cb73a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:25.552758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f12b4-78d8-4408-9d62-0256c79cb73a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:25.557402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c80bd-4853-4b25-a1c4-22fe058256e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:25.557992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c80bd-4853-4b25-a1c4-22fe058256e6 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:25.558271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c80bd-4853-4b25-a1c4-22fe058256e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:25.558544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c80bd-4853-4b25-a1c4-22fe058256e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:25.559753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c80bd-4853-4b25-a1c4-22fe058256e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:25.560061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c80bd-4853-4b25-a1c4-22fe058256e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:25.561782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c80bd-4853-4b25-a1c4-22fe058256e6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:25.574234 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3427/6850] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:19:25.579140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86263635-1ed7-4f6e-943b-d693512b1d3f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:25.590217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86263635-1ed7-4f6e-943b-d693512b1d3f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:25.595317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ad950-3c56-4e10-8f7f-653a232f8abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:25.595947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ad950-3c56-4e10-8f7f-653a232f8abd admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:25.596230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ad950-3c56-4e10-8f7f-653a232f8abd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:25.596633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ad950-3c56-4e10-8f7f-653a232f8abd admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:25.597312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ad950-3c56-4e10-8f7f-653a232f8abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:25.599602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ad950-3c56-4e10-8f7f-653a232f8abd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:25.629518 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3424/6851] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:25 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:25.634013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c80bd-4853-4b25-a1c4-22fe058256e6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:25.644144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c80bd-4853-4b25-a1c4-22fe058256e6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:25.702411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952a114-0e47-4e77-93f6-5b4fbf88d7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:25.703018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952a114-0e47-4e77-93f6-5b4fbf88d7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:25.703303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952a114-0e47-4e77-93f6-5b4fbf88d7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:25.703584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952a114-0e47-4e77-93f6-5b4fbf88d7b3 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:25.704209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952a114-0e47-4e77-93f6-5b4fbf88d7b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:25.706168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952a114-0e47-4e77-93f6-5b4fbf88d7b3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:25.727365 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3428/6852] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:25 2022] POST /identity/v3/users => generated 281 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:25.732210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ad950-3c56-4e10-8f7f-653a232f8abd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:25.742543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ad950-3c56-4e10-8f7f-653a232f8abd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:25.747667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2fbc7-b75e-4c67-8df5-1b86d303b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:25.748331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2fbc7-b75e-4c67-8df5-1b86d303b6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:25.748662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2fbc7-b75e-4c67-8df5-1b86d303b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:25.748955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2fbc7-b75e-4c67-8df5-1b86d303b6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:25.749665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2fbc7-b75e-4c67-8df5-1b86d303b6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:25.751445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2fbc7-b75e-4c67-8df5-1b86d303b6a9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:25.762302 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3425/6853] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:25.766045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952a114-0e47-4e77-93f6-5b4fbf88d7b3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:25.778067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952a114-0e47-4e77-93f6-5b4fbf88d7b3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:25.783690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f7e4c-3bcc-4dbb-9d2f-a06cee33addf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:25.784344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f7e4c-3bcc-4dbb-9d2f-a06cee33addf admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:25.784629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f7e4c-3bcc-4dbb-9d2f-a06cee33addf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:25.784950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f7e4c-3bcc-4dbb-9d2f-a06cee33addf admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:25.785683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f7e4c-3bcc-4dbb-9d2f-a06cee33addf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:25.790183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f7e4c-3bcc-4dbb-9d2f-a06cee33addf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:25.802227 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3429/6854] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:25.806362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2fbc7-b75e-4c67-8df5-1b86d303b6a9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:25.823368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2fbc7-b75e-4c67-8df5-1b86d303b6a9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:25.831613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e97d2-ea9a-47e3-afe1-a47b9b42bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:25.832387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e97d2-ea9a-47e3-afe1-a47b9b42bae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:25.832733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e97d2-ea9a-47e3-afe1-a47b9b42bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:25.833432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e97d2-ea9a-47e3-afe1-a47b9b42bae3 admin admin] PATH_INFO: `/v3/projects/0ea8d6673de74bd4915a3c29d0ebfc4f/users/6c8d602df5fc4c43865ce6b12586c528/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:25.852949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e97d2-ea9a-47e3-afe1-a47b9b42bae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea8d6673de74bd4915a3c29d0ebfc4f, user_id=6c8d602df5fc4c43865ce6b12586c528, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:25.856213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e97d2-ea9a-47e3-afe1-a47b9b42bae3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:25.870005 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3426/6855] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:25 2022] PUT /identity/v3/projects/0ea8d6673de74bd4915a3c29d0ebfc4f/users/6c8d602df5fc4c43865ce6b12586c528/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:25.880857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66dd6d-5b20-4b2d-96db-d5825f779691 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:25.881361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66dd6d-5b20-4b2d-96db-d5825f779691 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:25.881750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66dd6d-5b20-4b2d-96db-d5825f779691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:25.916114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1a66dd6d-5b20-4b2d-96db-d5825f779691 None None] MFA Rules not processed for user `6c8d602df5fc4c43865ce6b12586c528`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:25.917544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1a66dd6d-5b20-4b2d-96db-d5825f779691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:26.003358 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3430/6856] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:26.014418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e97d2-ea9a-47e3-afe1-a47b9b42bae3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:26.017408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7d0e97d2-ea9a-47e3-afe1-a47b9b42bae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:26.082224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e97d2-ea9a-47e3-afe1-a47b9b42bae3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:26.086454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72533a5e-fc07-42bd-9ea5-75a8f1f300be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:26.087148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72533a5e-fc07-42bd-9ea5-75a8f1f300be service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:26.087427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72533a5e-fc07-42bd-9ea5-75a8f1f300be service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:26.087700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72533a5e-fc07-42bd-9ea5-75a8f1f300be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:26.097569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72533a5e-fc07-42bd-9ea5-75a8f1f300be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:26.099010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72533a5e-fc07-42bd-9ea5-75a8f1f300be service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:26.108438 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3427/6857] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:29.008925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039be651-d7e1-4ee2-acc3-86909d47d70c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:29.009475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039be651-d7e1-4ee2-acc3-86909d47d70c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:29.009571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039be651-d7e1-4ee2-acc3-86909d47d70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:29.044807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-039be651-d7e1-4ee2-acc3-86909d47d70c None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:29.046072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-039be651-d7e1-4ee2-acc3-86909d47d70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:29.077703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:29.112144 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3431/6858] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:19:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:29.143943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72533a5e-fc07-42bd-9ea5-75a8f1f300be service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:29.148553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-72533a5e-fc07-42bd-9ea5-75a8f1f300be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:29.231285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:29.285100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72533a5e-fc07-42bd-9ea5-75a8f1f300be service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:29.292122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b54a1-c0d7-40f6-87ea-60956816ec60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:29.292833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b54a1-c0d7-40f6-87ea-60956816ec60 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:29.293775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b54a1-c0d7-40f6-87ea-60956816ec60 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:29.294207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b54a1-c0d7-40f6-87ea-60956816ec60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:29.303160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b54a1-c0d7-40f6-87ea-60956816ec60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:29.304792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b54a1-c0d7-40f6-87ea-60956816ec60 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:29.315713 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3428/6859] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:19:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:19:29.804701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039be651-d7e1-4ee2-acc3-86909d47d70c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:29.807339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-039be651-d7e1-4ee2-acc3-86909d47d70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:29.946149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039be651-d7e1-4ee2-acc3-86909d47d70c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:29.983978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:29.984780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:29.985069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:29.985391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] PATH_INFO: `/v3/users/1d5a4119d245437ba730c5168145382d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:29.989103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5a4119d245437ba730c5168145382d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:29.993599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:30.082431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5a4119d245437ba730c5168145382d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:30.091846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5a4119d245437ba730c5168145382d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:30.092779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5a4119d245437ba730c5168145382d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:30.093506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5a4119d245437ba730c5168145382d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:30.110687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5a4119d245437ba730c5168145382d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:30.138244 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3432/6860] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:29 2022] DELETE /identity/v3/users/1d5a4119d245437ba730c5168145382d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:30.143101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810a3d-8d43-4547-a35a-8918c2d641d7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:30.143667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810a3d-8d43-4547-a35a-8918c2d641d7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:30.144161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810a3d-8d43-4547-a35a-8918c2d641d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:30.180657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bc810a3d-8d43-4547-a35a-8918c2d641d7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:30.182995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bc810a3d-8d43-4547-a35a-8918c2d641d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:30.342283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:30.343738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:30.372322 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3429/6861] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:30.373592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810a3d-8d43-4547-a35a-8918c2d641d7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:30.375722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bc810a3d-8d43-4547-a35a-8918c2d641d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:30.505494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:30.517177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d5289-e750-4db2-ac9a-0532ecc63bcd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:30.528314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:30.529393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:30.530012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:30.530296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] PATH_INFO: `/v3/users/2564503039b343d8a2f5a483fd05c84e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:30.532726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2564503039b343d8a2f5a483fd05c84e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:30.535591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:30.556500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810a3d-8d43-4547-a35a-8918c2d641d7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:30.572729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94576923-4256-40c6-9722-2c2b9c915d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:30.576458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94576923-4256-40c6-9722-2c2b9c915d3f service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:30.577075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94576923-4256-40c6-9722-2c2b9c915d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:30.577657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94576923-4256-40c6-9722-2c2b9c915d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:30.644698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94576923-4256-40c6-9722-2c2b9c915d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:30.646187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94576923-4256-40c6-9722-2c2b9c915d3f service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:30.673860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2564503039b343d8a2f5a483fd05c84e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:30.678076 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3430/6862] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:30.686909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2564503039b343d8a2f5a483fd05c84e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:30.687832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2564503039b343d8a2f5a483fd05c84e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:30.688465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2564503039b343d8a2f5a483fd05c84e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:30.706446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2564503039b343d8a2f5a483fd05c84e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:30.728157 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3433/6863] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:30 2022] DELETE /identity/v3/users/2564503039b343d8a2f5a483fd05c84e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:30.733146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8d04a-f1a5-4c92-a366-48d969b30b6e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:30.733577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8d04a-f1a5-4c92-a366-48d969b30b6e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:30.733878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8d04a-f1a5-4c92-a366-48d969b30b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:30.772309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-64d8d04a-f1a5-4c92-a366-48d969b30b6e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:30.775261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-64d8d04a-f1a5-4c92-a366-48d969b30b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:30.905300 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3431/6864] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:30.918599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:30.920795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:31.053115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22951db8-7241-4f5e-9dac-e756e4b6a13d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:31.079125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e322118-cd9d-4a4b-810c-b90f1bb88fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:31.080020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e322118-cd9d-4a4b-810c-b90f1bb88fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:31.080365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e322118-cd9d-4a4b-810c-b90f1bb88fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:31.082722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e322118-cd9d-4a4b-810c-b90f1bb88fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:31.095310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e322118-cd9d-4a4b-810c-b90f1bb88fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:31.097085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e322118-cd9d-4a4b-810c-b90f1bb88fd3 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:31.116893 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3434/6865] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:31.422527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8d04a-f1a5-4c92-a366-48d969b30b6e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:31.424020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-64d8d04a-f1a5-4c92-a366-48d969b30b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:31.440354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8d04a-f1a5-4c92-a366-48d969b30b6e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:31.447607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:31.448733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:31.449884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:31.450443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] PATH_INFO: `/v3/projects/7c155f60b9604c2ba97908597a0dfd93` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:31.452260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c155f60b9604c2ba97908597a0dfd93)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:31.455246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:31.467773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:31.489323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e322118-cd9d-4a4b-810c-b90f1bb88fd3 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:31.491888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8e322118-cd9d-4a4b-810c-b90f1bb88fd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:31.532032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e322118-cd9d-4a4b-810c-b90f1bb88fd3 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:31.561991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8e420-e624-46c4-b558-a96e8d02cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:31.565400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e420-e624-46c4-b558-a96e8d02cd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:31.566314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e420-e624-46c4-b558-a96e8d02cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:31.567696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e420-e624-46c4-b558-a96e8d02cd36 admin admin] PATH_INFO: `/v3/projects/87bcd32262fb4b00b99260e3db3e5246` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:31.573115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8e420-e624-46c4-b558-a96e8d02cd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87bcd32262fb4b00b99260e3db3e5246)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:31.579691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8e420-e624-46c4-b558-a96e8d02cd36 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:31.629760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c155f60b9604c2ba97908597a0dfd93', 'request_id': 'req-8895c856-1d69-4b90-ba6a-38779a847b5d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:31.644405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c155f60b9604c2ba97908597a0dfd93', 'request_id': 'req-8895c856-1d69-4b90-ba6a-38779a847b5d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:31.658926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c155f60b9604c2ba97908597a0dfd93', 'request_id': 'req-8895c856-1d69-4b90-ba6a-38779a847b5d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:31.683511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] The token cache is being invalidate because project 7c155f60b9604c2ba97908597a0dfd93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:31.684224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0bf8e420-e624-46c4-b558-a96e8d02cd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87bcd32262fb4b00b99260e3db3e5246', 'request_id': 'req-0bf8e420-e624-46c4-b558-a96e8d02cd36'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:31.684319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:31.685104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:31.691521 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3432/6866] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:31 2022] DELETE /identity/v3/projects/7c155f60b9604c2ba97908597a0dfd93 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:31.695981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:31.700460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:31.716988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0bf8e420-e624-46c4-b558-a96e8d02cd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87bcd32262fb4b00b99260e3db3e5246', 'request_id': 'req-0bf8e420-e624-46c4-b558-a96e8d02cd36'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:31.724750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0bf8e420-e624-46c4-b558-a96e8d02cd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87bcd32262fb4b00b99260e3db3e5246', 'request_id': 'req-0bf8e420-e624-46c4-b558-a96e8d02cd36'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:31.758684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0bf8e420-e624-46c4-b558-a96e8d02cd36 admin admin] The token cache is being invalidate because project 87bcd32262fb4b00b99260e3db3e5246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:31.758980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0bf8e420-e624-46c4-b558-a96e8d02cd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:31.759790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0bf8e420-e624-46c4-b558-a96e8d02cd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:31.764249 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3435/6867] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:31 2022] DELETE /identity/v3/projects/87bcd32262fb4b00b99260e3db3e5246 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:31.768754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae438e-9b90-451e-910d-43bab3a2bcbe None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:31.769422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae438e-9b90-451e-910d-43bab3a2bcbe None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:31.769646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae438e-9b90-451e-910d-43bab3a2bcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:31.783190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:31.811625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-51ae438e-9b90-451e-910d-43bab3a2bcbe None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:31.816507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-51ae438e-9b90-451e-910d-43bab3a2bcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:31.833094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895c856-1d69-4b90-ba6a-38779a847b5d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:31.953821 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3436/6868] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:31.961136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e2a06-907b-4ab4-bb66-d4e5a502ade6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:31.961576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e2a06-907b-4ab4-bb66-d4e5a502ade6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:31.962124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e2a06-907b-4ab4-bb66-d4e5a502ade6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:31.982837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db28774-79b6-4dde-aeda-1b45342051eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:31.984213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28774-79b6-4dde-aeda-1b45342051eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:31.985437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28774-79b6-4dde-aeda-1b45342051eb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:31.985885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28774-79b6-4dde-aeda-1b45342051eb admin admin] PATH_INFO: `/v3/users/a542f954ed7d431ebbca2858a2dbfd32` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:31.992115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7f1e2a06-907b-4ab4-bb66-d4e5a502ade6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:31.993506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7f1e2a06-907b-4ab4-bb66-d4e5a502ade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:31.994247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db28774-79b6-4dde-aeda-1b45342051eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a542f954ed7d431ebbca2858a2dbfd32)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:32.001031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db28774-79b6-4dde-aeda-1b45342051eb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:32.009328 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3437/6869] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:32.014034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e2a06-907b-4ab4-bb66-d4e5a502ade6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:32.028402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e2a06-907b-4ab4-bb66-d4e5a502ade6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:32.041293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db27291-803a-47e1-9eeb-f81cc6309dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:32.045994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27291-803a-47e1-9eeb-f81cc6309dda admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:32.046846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27291-803a-47e1-9eeb-f81cc6309dda admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:32.047284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27291-803a-47e1-9eeb-f81cc6309dda admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:32.048100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db27291-803a-47e1-9eeb-f81cc6309dda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:32.048585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db27291-803a-47e1-9eeb-f81cc6309dda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:32.052114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db27291-803a-47e1-9eeb-f81cc6309dda admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:32.079571 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3438/6870] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:19:32.084145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db27291-803a-47e1-9eeb-f81cc6309dda admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:32.100882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db27291-803a-47e1-9eeb-f81cc6309dda admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:32.118815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5243e40-8219-4f43-a2aa-5249a479b8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:32.119634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5243e40-8219-4f43-a2aa-5249a479b8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:32.119961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5243e40-8219-4f43-a2aa-5249a479b8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:32.120266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5243e40-8219-4f43-a2aa-5249a479b8c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:32.120925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5243e40-8219-4f43-a2aa-5249a479b8c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:32.124394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5243e40-8219-4f43-a2aa-5249a479b8c0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:32.129038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:32.133155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4db28774-79b6-4dde-aeda-1b45342051eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a542f954ed7d431ebbca2858a2dbfd32'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:32.156108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4db28774-79b6-4dde-aeda-1b45342051eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a542f954ed7d431ebbca2858a2dbfd32'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:32.158324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4db28774-79b6-4dde-aeda-1b45342051eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a542f954ed7d431ebbca2858a2dbfd32'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:32.159515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4db28774-79b6-4dde-aeda-1b45342051eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a542f954ed7d431ebbca2858a2dbfd32'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:32.215956 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3439/6871] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:32 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:19:32.220401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5243e40-8219-4f43-a2aa-5249a479b8c0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:32.224156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4db28774-79b6-4dde-aeda-1b45342051eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a542f954ed7d431ebbca2858a2dbfd32'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:32.225853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a5243e40-8219-4f43-a2aa-5249a479b8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:32.247098 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3433/6872] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:31 2022] DELETE /identity/v3/users/a542f954ed7d431ebbca2858a2dbfd32 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:32.345286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5243e40-8219-4f43-a2aa-5249a479b8c0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:32.508441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19ba87-b3d6-4c3d-8a40-7d31e3128768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:32.509398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19ba87-b3d6-4c3d-8a40-7d31e3128768 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:32.509835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19ba87-b3d6-4c3d-8a40-7d31e3128768 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:32.510283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19ba87-b3d6-4c3d-8a40-7d31e3128768 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:32.511426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19ba87-b3d6-4c3d-8a40-7d31e3128768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:32.516180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19ba87-b3d6-4c3d-8a40-7d31e3128768 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:32.559142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:32.567610 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3440/6873] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:32 2022] POST /identity/v3/users => generated 285 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:32.570539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db28774-79b6-4dde-aeda-1b45342051eb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:32.610770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db28774-79b6-4dde-aeda-1b45342051eb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:32.630482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af54c76-e12d-458b-a40a-aa4c215c30d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:32.631148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54c76-e12d-458b-a40a-aa4c215c30d7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:32.631386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54c76-e12d-458b-a40a-aa4c215c30d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:32.631655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54c76-e12d-458b-a40a-aa4c215c30d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:32.632321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af54c76-e12d-458b-a40a-aa4c215c30d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:32.651048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af54c76-e12d-458b-a40a-aa4c215c30d7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:32.682504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19ba87-b3d6-4c3d-8a40-7d31e3128768 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:32.682714 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3434/6874] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:32.705813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19ba87-b3d6-4c3d-8a40-7d31e3128768 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:32.722104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edf9be-00d6-4753-af7a-286d28a1609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:32.722741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edf9be-00d6-4753-af7a-286d28a1609c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:32.723057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edf9be-00d6-4753-af7a-286d28a1609c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:32.723337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edf9be-00d6-4753-af7a-286d28a1609c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:32.723985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edf9be-00d6-4753-af7a-286d28a1609c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:32.725619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edf9be-00d6-4753-af7a-286d28a1609c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:32.751236 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3441/6875] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:32.751742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af54c76-e12d-458b-a40a-aa4c215c30d7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:32.773549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af54c76-e12d-458b-a40a-aa4c215c30d7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:32.801553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a0440-c717-4032-b8b4-cb266d31b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:32.802304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a0440-c717-4032-b8b4-cb266d31b39c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:32.802585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a0440-c717-4032-b8b4-cb266d31b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:32.802881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a0440-c717-4032-b8b4-cb266d31b39c admin admin] PATH_INFO: `/v3/projects/2f564837d8eb4b3192109d0dfc9a6fab/users/537b77eca97d4c1395eeb164bc5e7205/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:32.857986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a0440-c717-4032-b8b4-cb266d31b39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f564837d8eb4b3192109d0dfc9a6fab, user_id=537b77eca97d4c1395eeb164bc5e7205, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:32.860664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a0440-c717-4032-b8b4-cb266d31b39c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:32.895523 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3435/6876] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:32 2022] PUT /identity/v3/projects/2f564837d8eb4b3192109d0dfc9a6fab/users/537b77eca97d4c1395eeb164bc5e7205/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:32.898469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d75f1-42ac-4d31-849b-5c02e0b4ad19 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:32.898751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d75f1-42ac-4d31-849b-5c02e0b4ad19 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:32.899052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d75f1-42ac-4d31-849b-5c02e0b4ad19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:32.937576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3f6d75f1-42ac-4d31-849b-5c02e0b4ad19 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:32.939236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3f6d75f1-42ac-4d31-849b-5c02e0b4ad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:32.975989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a0440-c717-4032-b8b4-cb266d31b39c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:32.978037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c42a0440-c717-4032-b8b4-cb266d31b39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:33.082540 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3442/6877] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:33.098343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d75f1-42ac-4d31-849b-5c02e0b4ad19 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:33.101614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3f6d75f1-42ac-4d31-849b-5c02e0b4ad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:33.146567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a0440-c717-4032-b8b4-cb266d31b39c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:33.154701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:33.155790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:33.156718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:33.157225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6 admin admin] PATH_INFO: `/v3/projects/e11cb1981ab44b23a1ce65c57da83c97` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:33.158711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11cb1981ab44b23a1ce65c57da83c97)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:33.160939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:33.242733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d75f1-42ac-4d31-849b-5c02e0b4ad19 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:33.253257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e0e50-9bc2-400e-9514-671695783e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:33.255076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e0e50-9bc2-400e-9514-671695783e75 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:33.255350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e0e50-9bc2-400e-9514-671695783e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:33.255967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e0e50-9bc2-400e-9514-671695783e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:33.275228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e0e50-9bc2-400e-9514-671695783e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:33.276797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e0e50-9bc2-400e-9514-671695783e75 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:33.290172 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3443/6878] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:33.353200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11cb1981ab44b23a1ce65c57da83c97', 'request_id': 'req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:33.389889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11cb1981ab44b23a1ce65c57da83c97', 'request_id': 'req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:33.399361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11cb1981ab44b23a1ce65c57da83c97', 'request_id': 'req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:33.522760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6 admin admin] The token cache is being invalidate because project e11cb1981ab44b23a1ce65c57da83c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:33.523058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:33.527177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3a862d21-7ea7-40bf-938a-a9a97c08a6a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:33.530656 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3436/6879] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:32 2022] DELETE /identity/v3/projects/e11cb1981ab44b23a1ce65c57da83c97 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:33.545652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5cd8c-f396-45cd-8c73-d1f566548b3f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:33.545652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5cd8c-f396-45cd-8c73-d1f566548b3f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:33.545652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5cd8c-f396-45cd-8c73-d1f566548b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:33.574756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-02d5cd8c-f396-45cd-8c73-d1f566548b3f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:33.574756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-02d5cd8c-f396-45cd-8c73-d1f566548b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:33.672582 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3444/6880] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:33.679515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fcfaf-0ba7-4159-a6e1-cffb491b822b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:33.680200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fcfaf-0ba7-4159-a6e1-cffb491b822b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:33.680200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fcfaf-0ba7-4159-a6e1-cffb491b822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:33.716075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e97fcfaf-0ba7-4159-a6e1-cffb491b822b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:33.717443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e97fcfaf-0ba7-4159-a6e1-cffb491b822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:33.757872 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3437/6881] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:33.759342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5cd8c-f396-45cd-8c73-d1f566548b3f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:33.772800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5cd8c-f396-45cd-8c73-d1f566548b3f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:33.784666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07eb7d-696b-4bed-b2b9-55d0d1a8c0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:33.785425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07eb7d-696b-4bed-b2b9-55d0d1a8c0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:33.785696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07eb7d-696b-4bed-b2b9-55d0d1a8c0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:33.786328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07eb7d-696b-4bed-b2b9-55d0d1a8c0f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:33.786668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07eb7d-696b-4bed-b2b9-55d0d1a8c0f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:33.786990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07eb7d-696b-4bed-b2b9-55d0d1a8c0f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:33.788711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07eb7d-696b-4bed-b2b9-55d0d1a8c0f6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:33.821292 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3445/6882] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:19:33.822171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fcfaf-0ba7-4159-a6e1-cffb491b822b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:33.836525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fcfaf-0ba7-4159-a6e1-cffb491b822b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:33.845387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c2fbc-3b63-4c76-a137-47807a8cbff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:33.846242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c2fbc-3b63-4c76-a137-47807a8cbff7 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:33.846681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c2fbc-3b63-4c76-a137-47807a8cbff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:33.847114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c2fbc-3b63-4c76-a137-47807a8cbff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:33.848698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c2fbc-3b63-4c76-a137-47807a8cbff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:33.851361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c2fbc-3b63-4c76-a137-47807a8cbff7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:33.861237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:33.937078 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3438/6883] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:33 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:33.941899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07eb7d-696b-4bed-b2b9-55d0d1a8c0f6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:33.960707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07eb7d-696b-4bed-b2b9-55d0d1a8c0f6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:33.991431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:34.143734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450e62e-b730-4309-8258-33e410280590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:34.144449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450e62e-b730-4309-8258-33e410280590 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:34.147483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450e62e-b730-4309-8258-33e410280590 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:34.147874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450e62e-b730-4309-8258-33e410280590 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:34.158022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450e62e-b730-4309-8258-33e410280590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:34.165778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450e62e-b730-4309-8258-33e410280590 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:34.260659 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3446/6884] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:33 2022] POST /identity/v3/users => generated 288 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:34.265396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c2fbc-3b63-4c76-a137-47807a8cbff7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:34.281449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c2fbc-3b63-4c76-a137-47807a8cbff7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:34.291646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915bcf7-4c0d-463c-a774-c8873fe3181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:34.297748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915bcf7-4c0d-463c-a774-c8873fe3181c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:34.298045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915bcf7-4c0d-463c-a774-c8873fe3181c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:34.298321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915bcf7-4c0d-463c-a774-c8873fe3181c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:34.299015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915bcf7-4c0d-463c-a774-c8873fe3181c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:34.300983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915bcf7-4c0d-463c-a774-c8873fe3181c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:34.329387 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3439/6885] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:34.347062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450e62e-b730-4309-8258-33e410280590 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:34.364056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450e62e-b730-4309-8258-33e410280590 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:34.381655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f81c72-fc98-42e2-ab28-0816c8e6bed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:34.382031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f81c72-fc98-42e2-ab28-0816c8e6bed1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:34.382375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f81c72-fc98-42e2-ab28-0816c8e6bed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:34.382725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f81c72-fc98-42e2-ab28-0816c8e6bed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:34.383375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f81c72-fc98-42e2-ab28-0816c8e6bed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:34.385509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f81c72-fc98-42e2-ab28-0816c8e6bed1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:34.412597 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3447/6886] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:34.414119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915bcf7-4c0d-463c-a774-c8873fe3181c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:34.440737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915bcf7-4c0d-463c-a774-c8873fe3181c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:34.455058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d55ab-5abe-45f8-acf2-8d11f7efa956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:34.455875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d55ab-5abe-45f8-acf2-8d11f7efa956 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:34.456160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d55ab-5abe-45f8-acf2-8d11f7efa956 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:34.456452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d55ab-5abe-45f8-acf2-8d11f7efa956 admin admin] PATH_INFO: `/v3/projects/18743cc3f9464d598ab746f2f6fee56f/users/3d82af78ce1b4924bcb5fc7fc86579ce/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:34.501355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d55ab-5abe-45f8-acf2-8d11f7efa956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18743cc3f9464d598ab746f2f6fee56f, user_id=3d82af78ce1b4924bcb5fc7fc86579ce, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:34.505260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d55ab-5abe-45f8-acf2-8d11f7efa956 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:34.542234 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3440/6887] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:34 2022] PUT /identity/v3/projects/18743cc3f9464d598ab746f2f6fee56f/users/3d82af78ce1b4924bcb5fc7fc86579ce/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:34.544921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2a49-ab16-4814-9826-74f0253c956a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:34.545242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2a49-ab16-4814-9826-74f0253c956a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:34.545516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2a49-ab16-4814-9826-74f0253c956a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:34.606231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-abac2a49-ab16-4814-9826-74f0253c956a None None] MFA Rules not processed for user `3d82af78ce1b4924bcb5fc7fc86579ce`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:34.607709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-abac2a49-ab16-4814-9826-74f0253c956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:34.837252 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3448/6888] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:34.863026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d55ab-5abe-45f8-acf2-8d11f7efa956 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:34.875827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e32d55ab-5abe-45f8-acf2-8d11f7efa956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:35.008431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d55ab-5abe-45f8-acf2-8d11f7efa956 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:35.022004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796df16a-bc77-48ee-b8e0-7106e105689e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:35.023189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796df16a-bc77-48ee-b8e0-7106e105689e service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:35.023700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796df16a-bc77-48ee-b8e0-7106e105689e service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:35.024945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796df16a-bc77-48ee-b8e0-7106e105689e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:35.036646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4644c9d-384c-4f68-bde1-84f29bcd64d7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:35.037138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4644c9d-384c-4f68-bde1-84f29bcd64d7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:35.037796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4644c9d-384c-4f68-bde1-84f29bcd64d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:35.052711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796df16a-bc77-48ee-b8e0-7106e105689e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:35.056255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796df16a-bc77-48ee-b8e0-7106e105689e service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:35.082951 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3441/6889] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:35.096326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d4644c9d-384c-4f68-bde1-84f29bcd64d7 None None] MFA Rules not processed for user `537b77eca97d4c1395eeb164bc5e7205`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:35.099499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d4644c9d-384c-4f68-bde1-84f29bcd64d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:35.323358 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3449/6890] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:35.633316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796df16a-bc77-48ee-b8e0-7106e105689e service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:35.650660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796df16a-bc77-48ee-b8e0-7106e105689e service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:35.654887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41375a3c-4f0a-48cd-b506-c0a72f149917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:35.655506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375a3c-4f0a-48cd-b506-c0a72f149917 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:35.655794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375a3c-4f0a-48cd-b506-c0a72f149917 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:35.656071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375a3c-4f0a-48cd-b506-c0a72f149917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:35.666482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41375a3c-4f0a-48cd-b506-c0a72f149917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:35.668856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41375a3c-4f0a-48cd-b506-c0a72f149917 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:35.679991 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3442/6891] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:37.648887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23f493-a807-41e6-8f3d-6301e85f5266 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:37.649484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23f493-a807-41e6-8f3d-6301e85f5266 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:37.649484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23f493-a807-41e6-8f3d-6301e85f5266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:37.681995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8f23f493-a807-41e6-8f3d-6301e85f5266 None None] MFA Rules not processed for user `537b77eca97d4c1395eeb164bc5e7205`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:37.683235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8f23f493-a807-41e6-8f3d-6301e85f5266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:37.695540 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3450/6892] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:38.631596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41375a3c-4f0a-48cd-b506-c0a72f149917 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:38.811907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41375a3c-4f0a-48cd-b506-c0a72f149917 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:38.825025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:38.826074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:38.826696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:38.827248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] PATH_INFO: `/v3/users/3d82af78ce1b4924bcb5fc7fc86579ce` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:38.828966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d82af78ce1b4924bcb5fc7fc86579ce)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:38.831168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:38.968230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:38.971287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d82af78ce1b4924bcb5fc7fc86579ce'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:38.985777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d82af78ce1b4924bcb5fc7fc86579ce'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:38.989976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d82af78ce1b4924bcb5fc7fc86579ce'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:38.991474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d82af78ce1b4924bcb5fc7fc86579ce'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:39.040994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d82af78ce1b4924bcb5fc7fc86579ce'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:39.070385 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3443/6893] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:38 2022] DELETE /identity/v3/users/3d82af78ce1b4924bcb5fc7fc86579ce => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:39.075140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4789c01-08ce-4bc5-bac2-7bd3e458f9a0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:39.075576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4789c01-08ce-4bc5-bac2-7bd3e458f9a0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:39.076016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4789c01-08ce-4bc5-bac2-7bd3e458f9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:39.107267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b4789c01-08ce-4bc5-bac2-7bd3e458f9a0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:39.110953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b4789c01-08ce-4bc5-bac2-7bd3e458f9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:39.123949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:39.330015 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3451/6894] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:39.450290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:39.451702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:39.554341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4789c01-08ce-4bc5-bac2-7bd3e458f9a0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:39.556181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b4789c01-08ce-4bc5-bac2-7bd3e458f9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:39.572724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4789c01-08ce-4bc5-bac2-7bd3e458f9a0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:39.576461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756af12f-ce8b-4479-8f0d-c9e13f9cde31 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:39.585962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cfd4f-6861-4592-8ca9-f191fa45c504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:39.586514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:39.587192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:39.587691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:39.588135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] PATH_INFO: `/v3/users/6c8d602df5fc4c43865ce6b12586c528` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:39.588774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cfd4f-6861-4592-8ca9-f191fa45c504 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:39.590215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8d602df5fc4c43865ce6b12586c528)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:39.590372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cfd4f-6861-4592-8ca9-f191fa45c504 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:39.590869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cfd4f-6861-4592-8ca9-f191fa45c504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:39.593138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:39.606941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cfd4f-6861-4592-8ca9-f191fa45c504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:39.609928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cfd4f-6861-4592-8ca9-f191fa45c504 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:39.625617 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3444/6895] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:39.687568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8d602df5fc4c43865ce6b12586c528'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:39.702496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8d602df5fc4c43865ce6b12586c528'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:39.704797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8d602df5fc4c43865ce6b12586c528'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:39.706094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8d602df5fc4c43865ce6b12586c528'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:39.736075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8d602df5fc4c43865ce6b12586c528'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:39.759428 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3452/6896] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:39 2022] DELETE /identity/v3/users/6c8d602df5fc4c43865ce6b12586c528 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:39.764365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867a521-d8ec-4e81-9a75-3cb43b1e0989 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:39.765059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867a521-d8ec-4e81-9a75-3cb43b1e0989 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:39.765059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867a521-d8ec-4e81-9a75-3cb43b1e0989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:39.807316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8867a521-d8ec-4e81-9a75-3cb43b1e0989 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:39.809355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8867a521-d8ec-4e81-9a75-3cb43b1e0989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:39.916078 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3445/6897] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:39.928672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:39.931223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:40.091906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98f759-e653-4e93-adcb-016cde577410 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:40.105352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5c0c7-6d2a-45d1-86fa-21a6af4a8126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:40.106766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5c0c7-6d2a-45d1-86fa-21a6af4a8126 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:40.107210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5c0c7-6d2a-45d1-86fa-21a6af4a8126 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:40.107879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5c0c7-6d2a-45d1-86fa-21a6af4a8126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:40.129485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5c0c7-6d2a-45d1-86fa-21a6af4a8126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:40.131588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5c0c7-6d2a-45d1-86fa-21a6af4a8126 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:40.145391 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3453/6898] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:40.167935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867a521-d8ec-4e81-9a75-3cb43b1e0989 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:40.171768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8867a521-d8ec-4e81-9a75-3cb43b1e0989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:40.219442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867a521-d8ec-4e81-9a75-3cb43b1e0989 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:40.233951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:40.234776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:40.235059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:40.235337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] PATH_INFO: `/v3/projects/18743cc3f9464d598ab746f2f6fee56f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:40.237322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18743cc3f9464d598ab746f2f6fee56f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:40.239418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:40.356156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18743cc3f9464d598ab746f2f6fee56f', 'request_id': 'req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:40.377047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18743cc3f9464d598ab746f2f6fee56f', 'request_id': 'req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:40.382309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:40.391485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18743cc3f9464d598ab746f2f6fee56f', 'request_id': 'req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:40.417434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] The token cache is being invalidate because project 18743cc3f9464d598ab746f2f6fee56f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:40.418296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:40.418924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:40.420667 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3446/6899] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:40 2022] DELETE /identity/v3/projects/18743cc3f9464d598ab746f2f6fee56f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:40.425940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb53a0-b256-4f09-a11a-2f843a3f3b65 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:40.426399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb53a0-b256-4f09-a11a-2f843a3f3b65 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:40.427352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb53a0-b256-4f09-a11a-2f843a3f3b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:40.462049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bdfb53a0-b256-4f09-a11a-2f843a3f3b65 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:40.464197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bdfb53a0-b256-4f09-a11a-2f843a3f3b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:40.493754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:40.533131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:40.535277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:40.619831 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3454/6900] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:40.627384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027e2cf-0d72-4e4a-a13b-d57bb6880935 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:40.627674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027e2cf-0d72-4e4a-a13b-d57bb6880935 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:40.628004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027e2cf-0d72-4e4a-a13b-d57bb6880935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:40.671165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b027e2cf-0d72-4e4a-a13b-d57bb6880935 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:40.672668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b027e2cf-0d72-4e4a-a13b-d57bb6880935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:40.689664 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3455/6901] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:40.693928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027e2cf-0d72-4e4a-a13b-d57bb6880935 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:40.706915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027e2cf-0d72-4e4a-a13b-d57bb6880935 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:40.708173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e3d40-0cc8-48c9-9d8d-f25fc0e6bb01 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:40.716039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7cb90-a849-467d-a1fc-b3396762749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:40.716862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7cb90-a849-467d-a1fc-b3396762749e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:40.717342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7cb90-a849-467d-a1fc-b3396762749e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:40.717754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7cb90-a849-467d-a1fc-b3396762749e admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:40.718641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7cb90-a849-467d-a1fc-b3396762749e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:40.719402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7cb90-a849-467d-a1fc-b3396762749e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:40.721424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7cb90-a849-467d-a1fc-b3396762749e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:40.728109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418880bf-fc75-4fe0-b524-f00f4a6f4508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:40.728925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418880bf-fc75-4fe0-b524-f00f4a6f4508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:40.729296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418880bf-fc75-4fe0-b524-f00f4a6f4508 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:40.729573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418880bf-fc75-4fe0-b524-f00f4a6f4508 admin admin] PATH_INFO: `/v3/projects/0ea8d6673de74bd4915a3c29d0ebfc4f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:40.730891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418880bf-fc75-4fe0-b524-f00f4a6f4508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea8d6673de74bd4915a3c29d0ebfc4f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:40.732769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418880bf-fc75-4fe0-b524-f00f4a6f4508 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:40.758173 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3456/6902] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:19:40.763483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7cb90-a849-467d-a1fc-b3396762749e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:40.790552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7cb90-a849-467d-a1fc-b3396762749e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:40.807997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d81e7-eb5e-4bd3-a73e-e5fe39abae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:40.809589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d81e7-eb5e-4bd3-a73e-e5fe39abae39 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:40.811403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d81e7-eb5e-4bd3-a73e-e5fe39abae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:40.812493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d81e7-eb5e-4bd3-a73e-e5fe39abae39 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:40.816109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d81e7-eb5e-4bd3-a73e-e5fe39abae39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:40.821789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d81e7-eb5e-4bd3-a73e-e5fe39abae39 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:40.828945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-418880bf-fc75-4fe0-b524-f00f4a6f4508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea8d6673de74bd4915a3c29d0ebfc4f', 'request_id': 'req-418880bf-fc75-4fe0-b524-f00f4a6f4508'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:40.864670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-418880bf-fc75-4fe0-b524-f00f4a6f4508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea8d6673de74bd4915a3c29d0ebfc4f', 'request_id': 'req-418880bf-fc75-4fe0-b524-f00f4a6f4508'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:40.891191 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3457/6903] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:40 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:40.896924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d81e7-eb5e-4bd3-a73e-e5fe39abae39 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:40.898730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-418880bf-fc75-4fe0-b524-f00f4a6f4508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea8d6673de74bd4915a3c29d0ebfc4f', 'request_id': 'req-418880bf-fc75-4fe0-b524-f00f4a6f4508'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:40.921387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-418880bf-fc75-4fe0-b524-f00f4a6f4508 admin admin] The token cache is being invalidate because project 0ea8d6673de74bd4915a3c29d0ebfc4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:40.932408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-418880bf-fc75-4fe0-b524-f00f4a6f4508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:40.934712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-418880bf-fc75-4fe0-b524-f00f4a6f4508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:40.941007 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3447/6904] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:40 2022] DELETE /identity/v3/projects/0ea8d6673de74bd4915a3c29d0ebfc4f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:40.946134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2af65-5c77-4439-8899-6fde11fef446 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:40.946421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2af65-5c77-4439-8899-6fde11fef446 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:40.946704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2af65-5c77-4439-8899-6fde11fef446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:40.988565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-45d2af65-5c77-4439-8899-6fde11fef446 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:40.989835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-45d2af65-5c77-4439-8899-6fde11fef446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:40.990336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d81e7-eb5e-4bd3-a73e-e5fe39abae39 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:40.996350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab870bc-9bca-4f88-bb70-75e80d1d2cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:40.996962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab870bc-9bca-4f88-bb70-75e80d1d2cca admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:40.997405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab870bc-9bca-4f88-bb70-75e80d1d2cca admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:40.997906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab870bc-9bca-4f88-bb70-75e80d1d2cca admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:40.998716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab870bc-9bca-4f88-bb70-75e80d1d2cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.008206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab870bc-9bca-4f88-bb70-75e80d1d2cca admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.009479 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3448/6905] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:41.016906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f3f86-35c5-45c9-8396-f32cfeddd591 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.017477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f3f86-35c5-45c9-8396-f32cfeddd591 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.017995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f3f86-35c5-45c9-8396-f32cfeddd591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.054041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8e8f3f86-35c5-45c9-8396-f32cfeddd591 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:41.055349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8e8f3f86-35c5-45c9-8396-f32cfeddd591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:41.059000 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3458/6906] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:40 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:41.062896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab870bc-9bca-4f88-bb70-75e80d1d2cca admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.074568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0ab870bc-9bca-4f88-bb70-75e80d1d2cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:41.075301 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3449/6907] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:41.076209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f3f86-35c5-45c9-8396-f32cfeddd591 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.087478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f3f86-35c5-45c9-8396-f32cfeddd591 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.088628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab870bc-9bca-4f88-bb70-75e80d1d2cca admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.093955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef4e04-5536-4df5-840c-c64b0fd8c1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.094678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef4e04-5536-4df5-840c-c64b0fd8c1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.094960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef4e04-5536-4df5-840c-c64b0fd8c1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.095232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef4e04-5536-4df5-840c-c64b0fd8c1f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.095881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef4e04-5536-4df5-840c-c64b0fd8c1f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:41.096687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef4e04-5536-4df5-840c-c64b0fd8c1f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.098445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0e133-0ac7-432b-8e4e-f2f61e1c2662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.100739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef4e04-5536-4df5-840c-c64b0fd8c1f1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.102389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0e133-0ac7-432b-8e4e-f2f61e1c2662 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.103141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0e133-0ac7-432b-8e4e-f2f61e1c2662 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.103625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0e133-0ac7-432b-8e4e-f2f61e1c2662 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.104542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0e133-0ac7-432b-8e4e-f2f61e1c2662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.106331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0e133-0ac7-432b-8e4e-f2f61e1c2662 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.114805 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3450/6908] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:19:41.119836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef4e04-5536-4df5-840c-c64b0fd8c1f1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.120411 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3459/6909] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:41.124708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0e133-0ac7-432b-8e4e-f2f61e1c2662 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.139505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef4e04-5536-4df5-840c-c64b0fd8c1f1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.143496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0e133-0ac7-432b-8e4e-f2f61e1c2662 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.149834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488829d-1438-4a27-a6c5-da42ad7753e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.150477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488829d-1438-4a27-a6c5-da42ad7753e9 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.150755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488829d-1438-4a27-a6c5-da42ad7753e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.151029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488829d-1438-4a27-a6c5-da42ad7753e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.151282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf721a26-41e1-469e-ad55-b4e8f6532c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.151662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488829d-1438-4a27-a6c5-da42ad7753e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.152102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf721a26-41e1-469e-ad55-b4e8f6532c47 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.152992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf721a26-41e1-469e-ad55-b4e8f6532c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.153397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf721a26-41e1-469e-ad55-b4e8f6532c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.154138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf721a26-41e1-469e-ad55-b4e8f6532c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.154482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488829d-1438-4a27-a6c5-da42ad7753e9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.161900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf721a26-41e1-469e-ad55-b4e8f6532c47 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.177748 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3460/6910] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:41.180068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf721a26-41e1-469e-ad55-b4e8f6532c47 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.194129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf721a26-41e1-469e-ad55-b4e8f6532c47 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.201036 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3451/6911] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:41 2022] POST /identity/v3/projects => generated 405 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:41.205304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488829d-1438-4a27-a6c5-da42ad7753e9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.206392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37215d4a-7782-4770-82e3-0d0077ae76bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.207191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37215d4a-7782-4770-82e3-0d0077ae76bf admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.207475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37215d4a-7782-4770-82e3-0d0077ae76bf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.207747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37215d4a-7782-4770-82e3-0d0077ae76bf admin admin] PATH_INFO: `/v3/projects/fbe1a9c7dceb4c20b33ec10277b70c7e/users/4b747613f34b45d08905aa98dec04f60/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.232516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37215d4a-7782-4770-82e3-0d0077ae76bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe1a9c7dceb4c20b33ec10277b70c7e, user_id=4b747613f34b45d08905aa98dec04f60, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.235456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37215d4a-7782-4770-82e3-0d0077ae76bf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.260400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:41.263197 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3461/6912] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:41 2022] PUT /identity/v3/projects/fbe1a9c7dceb4c20b33ec10277b70c7e/users/4b747613f34b45d08905aa98dec04f60/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:41.275865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f740b-51b5-4481-ac02-91bd42452b00 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.276241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f740b-51b5-4481-ac02-91bd42452b00 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.276701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f740b-51b5-4481-ac02-91bd42452b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.329431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f38f740b-51b5-4481-ac02-91bd42452b00 None None] MFA Rules not processed for user `4b747613f34b45d08905aa98dec04f60`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:41.330986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f38f740b-51b5-4481-ac02-91bd42452b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:41.338564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488829d-1438-4a27-a6c5-da42ad7753e9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.347158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:41.429980 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3462/6913] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:41.432919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c94ab3-315b-4e9f-8d7d-dc103669401d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.434187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c94ab3-315b-4e9f-8d7d-dc103669401d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.434470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c94ab3-315b-4e9f-8d7d-dc103669401d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.434739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c94ab3-315b-4e9f-8d7d-dc103669401d admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.435373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c94ab3-315b-4e9f-8d7d-dc103669401d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.435748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f740b-51b5-4481-ac02-91bd42452b00 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.437297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c94ab3-315b-4e9f-8d7d-dc103669401d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.451549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f740b-51b5-4481-ac02-91bd42452b00 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.457988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca50b4d-2cbd-4d04-9ccc-c9efd8e5688e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.458801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca50b4d-2cbd-4d04-9ccc-c9efd8e5688e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.459625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca50b4d-2cbd-4d04-9ccc-c9efd8e5688e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.460010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca50b4d-2cbd-4d04-9ccc-c9efd8e5688e admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.460997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca50b4d-2cbd-4d04-9ccc-c9efd8e5688e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.463518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca50b4d-2cbd-4d04-9ccc-c9efd8e5688e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.466342 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3452/6914] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:41 2022] POST /identity/v3/users => generated 303 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:19:41.470527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c94ab3-315b-4e9f-8d7d-dc103669401d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.482693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c94ab3-315b-4e9f-8d7d-dc103669401d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.489009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5cbd2-f7eb-486f-aaaf-1a4162134388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.490063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5cbd2-f7eb-486f-aaaf-1a4162134388 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.490351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5cbd2-f7eb-486f-aaaf-1a4162134388 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.490627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5cbd2-f7eb-486f-aaaf-1a4162134388 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.491277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5cbd2-f7eb-486f-aaaf-1a4162134388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.492883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5cbd2-f7eb-486f-aaaf-1a4162134388 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.511892 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3453/6915] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:41.513180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5cbd2-f7eb-486f-aaaf-1a4162134388 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.514212 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3463/6916] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:41 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:41.526022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5cbd2-f7eb-486f-aaaf-1a4162134388 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.534308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca50b4d-2cbd-4d04-9ccc-c9efd8e5688e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.619431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58674646-5edd-463f-bff0-7a3d3b670ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.619955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58674646-5edd-463f-bff0-7a3d3b670ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.620241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58674646-5edd-463f-bff0-7a3d3b670ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.620512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58674646-5edd-463f-bff0-7a3d3b670ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.621208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58674646-5edd-463f-bff0-7a3d3b670ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.622037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca50b4d-2cbd-4d04-9ccc-c9efd8e5688e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.622946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58674646-5edd-463f-bff0-7a3d3b670ec7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.628329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e2523-835f-46bf-a094-861abd449c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.629156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e2523-835f-46bf-a094-861abd449c8e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.629398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e2523-835f-46bf-a094-861abd449c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.629639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e2523-835f-46bf-a094-861abd449c8e admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.630331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e2523-835f-46bf-a094-861abd449c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.632753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e2523-835f-46bf-a094-861abd449c8e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.637018 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3454/6917] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:41.638097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58674646-5edd-463f-bff0-7a3d3b670ec7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.649336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58674646-5edd-463f-bff0-7a3d3b670ec7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.657812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e8302-2c67-4793-ab88-39abad8572ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.658486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e8302-2c67-4793-ab88-39abad8572ff admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.658773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e8302-2c67-4793-ab88-39abad8572ff admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.659064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e8302-2c67-4793-ab88-39abad8572ff admin admin] PATH_INFO: `/v3/projects/49cabdf4863c44bea468fafb7168a2c9/users/728dcd67e32c4a5cb4fcdfd5922a17fc/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.669972 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3464/6918] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:41 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:41.673935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e2523-835f-46bf-a094-861abd449c8e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.677086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e8302-2c67-4793-ab88-39abad8572ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=49cabdf4863c44bea468fafb7168a2c9, user_id=728dcd67e32c4a5cb4fcdfd5922a17fc, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.679843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e8302-2c67-4793-ab88-39abad8572ff admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.686346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e2523-835f-46bf-a094-861abd449c8e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.692346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de15d66-5fae-4f40-8cd7-328deac856f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.692969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de15d66-5fae-4f40-8cd7-328deac856f3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.693392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de15d66-5fae-4f40-8cd7-328deac856f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.693762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de15d66-5fae-4f40-8cd7-328deac856f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.694505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de15d66-5fae-4f40-8cd7-328deac856f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.696203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de15d66-5fae-4f40-8cd7-328deac856f3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.697233 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3455/6919] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:41 2022] PUT /identity/v3/projects/49cabdf4863c44bea468fafb7168a2c9/users/728dcd67e32c4a5cb4fcdfd5922a17fc/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:41.702232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916e96b-b3ea-4a35-adc1-fe38ca9fc833 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.702731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916e96b-b3ea-4a35-adc1-fe38ca9fc833 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.703213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916e96b-b3ea-4a35-adc1-fe38ca9fc833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.710793 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3465/6920] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:19:41.717105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de15d66-5fae-4f40-8cd7-328deac856f3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.727055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1916e96b-b3ea-4a35-adc1-fe38ca9fc833 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:41.728763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1916e96b-b3ea-4a35-adc1-fe38ca9fc833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:41.729816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de15d66-5fae-4f40-8cd7-328deac856f3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.754211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:41.809855 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3456/6921] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:41.819956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916e96b-b3ea-4a35-adc1-fe38ca9fc833 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.823642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1916e96b-b3ea-4a35-adc1-fe38ca9fc833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:41.828823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86007027-3d13-47b2-b0ae-4e34814b981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.829698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86007027-3d13-47b2-b0ae-4e34814b981c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.830098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86007027-3d13-47b2-b0ae-4e34814b981c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.830486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86007027-3d13-47b2-b0ae-4e34814b981c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.831399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86007027-3d13-47b2-b0ae-4e34814b981c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.833285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86007027-3d13-47b2-b0ae-4e34814b981c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.852174 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3466/6922] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:41.854606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86007027-3d13-47b2-b0ae-4e34814b981c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:41.874211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86007027-3d13-47b2-b0ae-4e34814b981c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.880564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02edad-b4f3-4cd3-a413-82b02f641c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.881480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02edad-b4f3-4cd3-a413-82b02f641c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.881777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02edad-b4f3-4cd3-a413-82b02f641c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.881867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02edad-b4f3-4cd3-a413-82b02f641c7f admin admin] PATH_INFO: `/v3/projects/d28335994a184648967973fb27ac6499/users/bd4efa6c59e24df78ac36cfdfeab805d/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.885462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:41.902193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02edad-b4f3-4cd3-a413-82b02f641c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28335994a184648967973fb27ac6499, user_id=bd4efa6c59e24df78ac36cfdfeab805d, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.905210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02edad-b4f3-4cd3-a413-82b02f641c7f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.908469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916e96b-b3ea-4a35-adc1-fe38ca9fc833 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:41.913468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3f835-8acd-4adb-9de3-d9d1a7903489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:41.914313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3f835-8acd-4adb-9de3-d9d1a7903489 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.914743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3f835-8acd-4adb-9de3-d9d1a7903489 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.917242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3f835-8acd-4adb-9de3-d9d1a7903489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.925235 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3467/6923] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:41 2022] PUT /identity/v3/projects/d28335994a184648967973fb27ac6499/users/bd4efa6c59e24df78ac36cfdfeab805d/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:41.929351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3f835-8acd-4adb-9de3-d9d1a7903489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:41.931158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3f835-8acd-4adb-9de3-d9d1a7903489 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:41.936301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee069c-e39b-40b0-8a8d-a587c0fac7aa None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:41.936588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee069c-e39b-40b0-8a8d-a587c0fac7aa None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:41.936865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee069c-e39b-40b0-8a8d-a587c0fac7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:41.943464 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3457/6924] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:19:41.986223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-11ee069c-e39b-40b0-8a8d-a587c0fac7aa None None] MFA Rules not processed for user `bd4efa6c59e24df78ac36cfdfeab805d`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:41.989994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-11ee069c-e39b-40b0-8a8d-a587c0fac7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:42.164437 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3468/6925] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:42.174292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3f835-8acd-4adb-9de3-d9d1a7903489 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:42.192938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3f835-8acd-4adb-9de3-d9d1a7903489 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:42.336597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3b8db-839a-420d-8f85-1dc6947c4a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:42.338210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b8db-839a-420d-8f85-1dc6947c4a63 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:42.338601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b8db-839a-420d-8f85-1dc6947c4a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:42.338991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b8db-839a-420d-8f85-1dc6947c4a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:42.340260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3b8db-839a-420d-8f85-1dc6947c4a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:42.343348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3b8db-839a-420d-8f85-1dc6947c4a63 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:42.384536 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3458/6926] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:42 2022] POST /identity/v3/projects => generated 383 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:42.385875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee069c-e39b-40b0-8a8d-a587c0fac7aa None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:42.398738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee069c-e39b-40b0-8a8d-a587c0fac7aa None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:42.558919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41696cc6-f547-42cb-8ba4-6a36fdb17d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:42.559947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696cc6-f547-42cb-8ba4-6a36fdb17d02 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:42.560435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696cc6-f547-42cb-8ba4-6a36fdb17d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:42.560945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696cc6-f547-42cb-8ba4-6a36fdb17d02 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:42.565213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41696cc6-f547-42cb-8ba4-6a36fdb17d02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:42.569376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41696cc6-f547-42cb-8ba4-6a36fdb17d02 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:42.619141 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3469/6927] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:42 2022] POST /identity/v3/users => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:42.623263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3b8db-839a-420d-8f85-1dc6947c4a63 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:42.635339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3b8db-839a-420d-8f85-1dc6947c4a63 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:42.640890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ebd0d-5f72-4f47-ab61-a6f20cebae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:42.641615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ebd0d-5f72-4f47-ab61-a6f20cebae81 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:42.641900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ebd0d-5f72-4f47-ab61-a6f20cebae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:42.642186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ebd0d-5f72-4f47-ab61-a6f20cebae81 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:42.642957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ebd0d-5f72-4f47-ab61-a6f20cebae81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:42.644562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ebd0d-5f72-4f47-ab61-a6f20cebae81 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:42.657552 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3459/6928] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:42.663414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41696cc6-f547-42cb-8ba4-6a36fdb17d02 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:42.675534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41696cc6-f547-42cb-8ba4-6a36fdb17d02 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:42.680372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f2833-f8ae-49e2-ae3e-8115e209002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:42.681057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f2833-f8ae-49e2-ae3e-8115e209002c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:42.681374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f2833-f8ae-49e2-ae3e-8115e209002c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:42.681898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f2833-f8ae-49e2-ae3e-8115e209002c admin admin] PATH_INFO: `/v3/projects/751f5e4d246f4d5b9c059b6b188f46be/users/979dadf5480a4565bbeb7af55dee5fab/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:42.702550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f2833-f8ae-49e2-ae3e-8115e209002c admin admin] RBAC: Authorizing `identity:create_grant(project_id=751f5e4d246f4d5b9c059b6b188f46be, user_id=979dadf5480a4565bbeb7af55dee5fab, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:42.705969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f2833-f8ae-49e2-ae3e-8115e209002c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:42.726510 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3470/6929] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:42 2022] PUT /identity/v3/projects/751f5e4d246f4d5b9c059b6b188f46be/users/979dadf5480a4565bbeb7af55dee5fab/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:42.729055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ebd0d-5f72-4f47-ab61-a6f20cebae81 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:42.742292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ebd0d-5f72-4f47-ab61-a6f20cebae81 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:42.806857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:42.837697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6d3a8-620d-45cb-8a0f-7b0e4acc3b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:42.838378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6d3a8-620d-45cb-8a0f-7b0e4acc3b4e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:42.838676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6d3a8-620d-45cb-8a0f-7b0e4acc3b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:42.838936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6d3a8-620d-45cb-8a0f-7b0e4acc3b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:42.840378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6d3a8-620d-45cb-8a0f-7b0e4acc3b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:42.842740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6d3a8-620d-45cb-8a0f-7b0e4acc3b4e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:42.861328 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3460/6930] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:42.863958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f2833-f8ae-49e2-ae3e-8115e209002c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:42.878784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f2833-f8ae-49e2-ae3e-8115e209002c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:42.885094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66317bf1-ad08-47e1-926c-b1449b77cffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:42.886979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66317bf1-ad08-47e1-926c-b1449b77cffa admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:42.887358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66317bf1-ad08-47e1-926c-b1449b77cffa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:42.887706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66317bf1-ad08-47e1-926c-b1449b77cffa admin admin] PATH_INFO: `/v3/projects/751f5e4d246f4d5b9c059b6b188f46be/users/979dadf5480a4565bbeb7af55dee5fab/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:42.891132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66317bf1-ad08-47e1-926c-b1449b77cffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=751f5e4d246f4d5b9c059b6b188f46be, user_id=979dadf5480a4565bbeb7af55dee5fab, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:42.893922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66317bf1-ad08-47e1-926c-b1449b77cffa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:42.906501 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3471/6931] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:42 2022] PUT /identity/v3/projects/751f5e4d246f4d5b9c059b6b188f46be/users/979dadf5480a4565bbeb7af55dee5fab/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:42.917028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab41d4-28b2-42d2-b6ac-f7771b86acaa None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:42.918283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab41d4-28b2-42d2-b6ac-f7771b86acaa None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:42.919123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab41d4-28b2-42d2-b6ac-f7771b86acaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:42.962195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-37ab41d4-28b2-42d2-b6ac-f7771b86acaa None None] MFA Rules not processed for user `979dadf5480a4565bbeb7af55dee5fab`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:42.964385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-37ab41d4-28b2-42d2-b6ac-f7771b86acaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:43.075044 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3461/6932] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:43.092646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66317bf1-ad08-47e1-926c-b1449b77cffa admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:43.095255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-66317bf1-ad08-47e1-926c-b1449b77cffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:43.145292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:43.198519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66317bf1-ad08-47e1-926c-b1449b77cffa admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:43.204517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab0726-1ba2-4635-9f13-f4e382800492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:43.205479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab0726-1ba2-4635-9f13-f4e382800492 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:43.206008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab0726-1ba2-4635-9f13-f4e382800492 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:43.206522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab0726-1ba2-4635-9f13-f4e382800492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:43.286236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab0726-1ba2-4635-9f13-f4e382800492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:43.287968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab0726-1ba2-4635-9f13-f4e382800492 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:43.298717 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3472/6933] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:44.436073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601756-642c-49d5-ac0e-f011a2ec9970 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:44.436623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601756-642c-49d5-ac0e-f011a2ec9970 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:44.436871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601756-642c-49d5-ac0e-f011a2ec9970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:44.484973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7f601756-642c-49d5-ac0e-f011a2ec9970 None None] MFA Rules not processed for user `728dcd67e32c4a5cb4fcdfd5922a17fc`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:44.486635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7f601756-642c-49d5-ac0e-f011a2ec9970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:44.612451 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3462/6934] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:44 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:44.617461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab0726-1ba2-4635-9f13-f4e382800492 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:44.809225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab0726-1ba2-4635-9f13-f4e382800492 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:44.815409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038e0fd-4cda-4472-a06e-af697ca49fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:44.816262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038e0fd-4cda-4472-a06e-af697ca49fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:44.816716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038e0fd-4cda-4472-a06e-af697ca49fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:44.817176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038e0fd-4cda-4472-a06e-af697ca49fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:44.818008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038e0fd-4cda-4472-a06e-af697ca49fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:44.820253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038e0fd-4cda-4472-a06e-af697ca49fe6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:44.858149 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3473/6935] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:44 2022] POST /identity/v3/projects => generated 403 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:44.862888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f601756-642c-49d5-ac0e-f011a2ec9970 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:44.876741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f601756-642c-49d5-ac0e-f011a2ec9970 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:45.056502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:45.110850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27541fd6-93fc-41e1-a2e6-6aa97ed6072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:45.111826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27541fd6-93fc-41e1-a2e6-6aa97ed6072e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:45.112271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27541fd6-93fc-41e1-a2e6-6aa97ed6072e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:45.112536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27541fd6-93fc-41e1-a2e6-6aa97ed6072e admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:45.113777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27541fd6-93fc-41e1-a2e6-6aa97ed6072e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:45.122123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27541fd6-93fc-41e1-a2e6-6aa97ed6072e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:45.183648 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3463/6936] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:44 2022] POST /identity/v3/users => generated 308 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:45.185000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038e0fd-4cda-4472-a06e-af697ca49fe6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:45.212596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038e0fd-4cda-4472-a06e-af697ca49fe6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:45.226167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc566bc6-7f98-44af-b513-4677570765a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:45.226803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566bc6-7f98-44af-b513-4677570765a1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:45.227849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566bc6-7f98-44af-b513-4677570765a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:45.227849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566bc6-7f98-44af-b513-4677570765a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:45.228263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc566bc6-7f98-44af-b513-4677570765a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:45.230496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc566bc6-7f98-44af-b513-4677570765a1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:45.270798 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3474/6937] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:45.272313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27541fd6-93fc-41e1-a2e6-6aa97ed6072e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:45.285170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27541fd6-93fc-41e1-a2e6-6aa97ed6072e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:45.291278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3efd90-eafb-4914-954e-d0500e5efdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:45.292225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3efd90-eafb-4914-954e-d0500e5efdb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:45.292609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3efd90-eafb-4914-954e-d0500e5efdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:45.293008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3efd90-eafb-4914-954e-d0500e5efdb8 admin admin] PATH_INFO: `/v3/projects/5e75727b84224665ba8c00778b208df2/users/7eb0d3ab8dd849cd83b9df54a51e91dc/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:45.336486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc566bc6-7f98-44af-b513-4677570765a1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:45.337048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3efd90-eafb-4914-954e-d0500e5efdb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e75727b84224665ba8c00778b208df2, user_id=7eb0d3ab8dd849cd83b9df54a51e91dc, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:45.340415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3efd90-eafb-4914-954e-d0500e5efdb8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:45.371402 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3464/6938] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:45 2022] PUT /identity/v3/projects/5e75727b84224665ba8c00778b208df2/users/7eb0d3ab8dd849cd83b9df54a51e91dc/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:45.372480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3efd90-eafb-4914-954e-d0500e5efdb8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:45.593841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc566bc6-7f98-44af-b513-4677570765a1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:45.625152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:45.665730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3efd90-eafb-4914-954e-d0500e5efdb8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:45.672666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa928d1c-cc60-45d1-b9ca-3995ce82c4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:45.673567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa928d1c-cc60-45d1-b9ca-3995ce82c4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:45.674023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa928d1c-cc60-45d1-b9ca-3995ce82c4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:45.674457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa928d1c-cc60-45d1-b9ca-3995ce82c4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:45.675274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa928d1c-cc60-45d1-b9ca-3995ce82c4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:45.680054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa928d1c-cc60-45d1-b9ca-3995ce82c4e5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:45.700845 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3465/6939] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:45.702526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa928d1c-cc60-45d1-b9ca-3995ce82c4e5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:45.706978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-aa928d1c-cc60-45d1-b9ca-3995ce82c4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:45.732268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb84114-894b-4d76-b01c-f73cbc5e8e6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:45.733052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb84114-894b-4d76-b01c-f73cbc5e8e6e service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:45.733561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb84114-894b-4d76-b01c-f73cbc5e8e6e service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:45.733909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb84114-894b-4d76-b01c-f73cbc5e8e6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:45.868959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb84114-894b-4d76-b01c-f73cbc5e8e6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:45.874005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb84114-894b-4d76-b01c-f73cbc5e8e6e service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:45.894420 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3475/6940] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:19:45.897971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb84114-894b-4d76-b01c-f73cbc5e8e6e service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:45.915856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa928d1c-cc60-45d1-b9ca-3995ce82c4e5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:45.921112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb84114-894b-4d76-b01c-f73cbc5e8e6e service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:45.942738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff174-3264-47a5-8005-2e062d0748c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:45.943383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff174-3264-47a5-8005-2e062d0748c1 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:45.943653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff174-3264-47a5-8005-2e062d0748c1 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:45.943924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff174-3264-47a5-8005-2e062d0748c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:45.945947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609fe92-3452-4921-a8a7-cada7597f36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:45.946783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609fe92-3452-4921-a8a7-cada7597f36e admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:45.947162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609fe92-3452-4921-a8a7-cada7597f36e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:45.947437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609fe92-3452-4921-a8a7-cada7597f36e admin admin] PATH_INFO: `/v3/projects/5e75727b84224665ba8c00778b208df2/users/7eb0d3ab8dd849cd83b9df54a51e91dc/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:45.955547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d6bff174-3264-47a5-8005-2e062d0748c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:45.958764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609fe92-3452-4921-a8a7-cada7597f36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e75727b84224665ba8c00778b208df2, user_id=7eb0d3ab8dd849cd83b9df54a51e91dc, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:45.968398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609fe92-3452-4921-a8a7-cada7597f36e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:45.994690 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3476/6941] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:45 2022] PUT /identity/v3/projects/5e75727b84224665ba8c00778b208df2/users/7eb0d3ab8dd849cd83b9df54a51e91dc/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:46.015958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609fe92-3452-4921-a8a7-cada7597f36e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:46.036642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f609fe92-3452-4921-a8a7-cada7597f36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:46.185095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:46.194642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bff174-3264-47a5-8005-2e062d0748c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:46.195897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bff174-3264-47a5-8005-2e062d0748c1 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:46.217689 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3466/6942] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:46.316066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609fe92-3452-4921-a8a7-cada7597f36e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:46.323069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced00b88-ec95-4938-b7ab-2174096ca430 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:46.323837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00b88-ec95-4938-b7ab-2174096ca430 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:46.324715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00b88-ec95-4938-b7ab-2174096ca430 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:46.325204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00b88-ec95-4938-b7ab-2174096ca430 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:46.327586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ced00b88-ec95-4938-b7ab-2174096ca430 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:46.366348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced00b88-ec95-4938-b7ab-2174096ca430 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:46.372034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced00b88-ec95-4938-b7ab-2174096ca430 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:46.392362 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3477/6943] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:47.046081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff174-3264-47a5-8005-2e062d0748c1 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:47.047681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d6bff174-3264-47a5-8005-2e062d0748c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:47.070613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015af6-ec2d-49d4-86de-5d4b449cd4a4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:47.071568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015af6-ec2d-49d4-86de-5d4b449cd4a4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:47.072012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015af6-ec2d-49d4-86de-5d4b449cd4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:47.084589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff174-3264-47a5-8005-2e062d0748c1 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:47.094597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9c015af6-ec2d-49d4-86de-5d4b449cd4a4 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:47.096223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9c015af6-ec2d-49d4-86de-5d4b449cd4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:47.133930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:47.205577 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3478/6944] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:19:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:47.208624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c015af6-ec2d-49d4-86de-5d4b449cd4a4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:47.216348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9c015af6-ec2d-49d4-86de-5d4b449cd4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:47.244251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aad545-57c5-4655-9e95-cd0f997d3e64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:47.244915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aad545-57c5-4655-9e95-cd0f997d3e64 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:47.245230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aad545-57c5-4655-9e95-cd0f997d3e64 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:47.245516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aad545-57c5-4655-9e95-cd0f997d3e64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:47.375099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aad545-57c5-4655-9e95-cd0f997d3e64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:47.376611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aad545-57c5-4655-9e95-cd0f997d3e64 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:47.381508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c015af6-ec2d-49d4-86de-5d4b449cd4a4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:47.388827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd19bd1-cccf-4412-994b-7d94aa078a10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:47.389775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd19bd1-cccf-4412-994b-7d94aa078a10 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:47.390222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd19bd1-cccf-4412-994b-7d94aa078a10 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:47.390779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd19bd1-cccf-4412-994b-7d94aa078a10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:47.400951 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3467/6945] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:47.405982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd19bd1-cccf-4412-994b-7d94aa078a10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:47.407952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd19bd1-cccf-4412-994b-7d94aa078a10 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:47.420412 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3479/6946] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:19:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:19:47.469660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf713bd-78df-4085-b477-f0762fb4a797 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:47.470052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf713bd-78df-4085-b477-f0762fb4a797 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:47.470439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf713bd-78df-4085-b477-f0762fb4a797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:47.563391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ddf713bd-78df-4085-b477-f0762fb4a797 None None] MFA Rules not processed for user `7eb0d3ab8dd849cd83b9df54a51e91dc`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:47.567172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ddf713bd-78df-4085-b477-f0762fb4a797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:47.785900 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3468/6947] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:47 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:47.980879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd19bd1-cccf-4412-994b-7d94aa078a10 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:47.982839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2bd19bd1-cccf-4412-994b-7d94aa078a10 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:48.022045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd19bd1-cccf-4412-994b-7d94aa078a10 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:48.033383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b64ba-b008-49c2-9bd2-ace613305c9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:48.034663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b64ba-b008-49c2-9bd2-ace613305c9c service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:48.034954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b64ba-b008-49c2-9bd2-ace613305c9c service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:48.035315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b64ba-b008-49c2-9bd2-ace613305c9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:48.039870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b96b64ba-b008-49c2-9bd2-ace613305c9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:48.066710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b64ba-b008-49c2-9bd2-ace613305c9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:48.068459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b64ba-b008-49c2-9bd2-ace613305c9c service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:48.082180 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3480/6948] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:48.845810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8975894-7a90-45f2-9e38-b570e8aec065 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:48.846323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8975894-7a90-45f2-9e38-b570e8aec065 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:48.846503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8975894-7a90-45f2-9e38-b570e8aec065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:48.879217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e8975894-7a90-45f2-9e38-b570e8aec065 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:48.881132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e8975894-7a90-45f2-9e38-b570e8aec065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:48.910314 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3469/6949] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:19:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:48.943820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b64ba-b008-49c2-9bd2-ace613305c9c service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:48.962125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b64ba-b008-49c2-9bd2-ace613305c9c service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:48.974577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75cd1f-2c73-4bb3-b7de-3e301312b00d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:48.975743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75cd1f-2c73-4bb3-b7de-3e301312b00d service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:48.976422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75cd1f-2c73-4bb3-b7de-3e301312b00d service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:48.977015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75cd1f-2c73-4bb3-b7de-3e301312b00d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:48.990627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75cd1f-2c73-4bb3-b7de-3e301312b00d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:48.992955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75cd1f-2c73-4bb3-b7de-3e301312b00d service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:49.018211 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3481/6950] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:19:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:19:49.547693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d38493-e4ce-452c-b312-384d2d1932c9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:49.547978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d38493-e4ce-452c-b312-384d2d1932c9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:49.548256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d38493-e4ce-452c-b312-384d2d1932c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:49.571255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-72d38493-e4ce-452c-b312-384d2d1932c9 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:49.572779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-72d38493-e4ce-452c-b312-384d2d1932c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:49.594037 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3470/6951] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:19:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:49.603434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75cd1f-2c73-4bb3-b7de-3e301312b00d service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:49.620067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75cd1f-2c73-4bb3-b7de-3e301312b00d service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:49.626798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b477b8-f6b5-4fd1-a8cc-faaf04466989 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:49.627945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b477b8-f6b5-4fd1-a8cc-faaf04466989 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:49.634552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b477b8-f6b5-4fd1-a8cc-faaf04466989 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:49.635059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b477b8-f6b5-4fd1-a8cc-faaf04466989 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:49.652920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b477b8-f6b5-4fd1-a8cc-faaf04466989 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:49.654652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b477b8-f6b5-4fd1-a8cc-faaf04466989 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:49.665581 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3482/6952] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:19:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:19:49.753304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d38493-e4ce-452c-b312-384d2d1932c9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:49.774537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:49.827687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d38493-e4ce-452c-b312-384d2d1932c9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:49.833240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:49.833960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:49.834245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:49.834519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] PATH_INFO: `/v3/users/728dcd67e32c4a5cb4fcdfd5922a17fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:49.835718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=728dcd67e32c4a5cb4fcdfd5922a17fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:49.838070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:49.909702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728dcd67e32c4a5cb4fcdfd5922a17fc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:49.920597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728dcd67e32c4a5cb4fcdfd5922a17fc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:49.921364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728dcd67e32c4a5cb4fcdfd5922a17fc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:49.921988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728dcd67e32c4a5cb4fcdfd5922a17fc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:49.942759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728dcd67e32c4a5cb4fcdfd5922a17fc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:49.960967 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3471/6953] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:49 2022] DELETE /identity/v3/users/728dcd67e32c4a5cb4fcdfd5922a17fc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:50.226041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b477b8-f6b5-4fd1-a8cc-faaf04466989 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:50.249934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b477b8-f6b5-4fd1-a8cc-faaf04466989 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:50.374590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:50.375342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:50.375754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:50.376378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] PATH_INFO: `/v3/projects/49cabdf4863c44bea468fafb7168a2c9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:50.378527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49cabdf4863c44bea468fafb7168a2c9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:50.380597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:50.423863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:50.468893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49cabdf4863c44bea468fafb7168a2c9', 'request_id': 'req-9e2eca6c-72f8-4002-a302-75927d74cc03'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:50.520173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49cabdf4863c44bea468fafb7168a2c9', 'request_id': 'req-9e2eca6c-72f8-4002-a302-75927d74cc03'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:50.520173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49cabdf4863c44bea468fafb7168a2c9', 'request_id': 'req-9e2eca6c-72f8-4002-a302-75927d74cc03'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:50.527545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] The token cache is being invalidate because project 49cabdf4863c44bea468fafb7168a2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:50.527985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:50.529075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:50.531403 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3483/6954] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:50 2022] DELETE /identity/v3/projects/49cabdf4863c44bea468fafb7168a2c9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:50.536140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:50.536907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:50.553536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de220a6-6845-4ca3-bf18-2d1758cb0820 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:50.680552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:50.681245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:50.681533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:50.681820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] PATH_INFO: `/v3/users/7eb0d3ab8dd849cd83b9df54a51e91dc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:50.684626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb0d3ab8dd849cd83b9df54a51e91dc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:50.689233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:50.791446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:50.812168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb0d3ab8dd849cd83b9df54a51e91dc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:50.858127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb0d3ab8dd849cd83b9df54a51e91dc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:50.860405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb0d3ab8dd849cd83b9df54a51e91dc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:50.863218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb0d3ab8dd849cd83b9df54a51e91dc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:50.886922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb0d3ab8dd849cd83b9df54a51e91dc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:50.910081 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3472/6955] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:50 2022] DELETE /identity/v3/users/7eb0d3ab8dd849cd83b9df54a51e91dc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:51.690721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:51.692371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:51.705666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2eca6c-72f8-4002-a302-75927d74cc03 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:51.820345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb06ad4-3960-40d6-ab97-db4d698f49e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:51.821068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb06ad4-3960-40d6-ab97-db4d698f49e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:51.821782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb06ad4-3960-40d6-ab97-db4d698f49e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:51.821782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb06ad4-3960-40d6-ab97-db4d698f49e9 admin admin] PATH_INFO: `/v3/projects/5e75727b84224665ba8c00778b208df2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:51.823107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb06ad4-3960-40d6-ab97-db4d698f49e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e75727b84224665ba8c00778b208df2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:51.825383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb06ad4-3960-40d6-ab97-db4d698f49e9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:51.845591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:51.847377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:51.868748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfab336-39f9-4ac9-a45d-0b1c1ee8f4ad admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:51.875678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989588f-3c7d-41a2-bed0-408d79119931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:51.876566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989588f-3c7d-41a2-bed0-408d79119931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:51.877086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989588f-3c7d-41a2-bed0-408d79119931 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:51.877558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989588f-3c7d-41a2-bed0-408d79119931 admin admin] PATH_INFO: `/v3/users/4b747613f34b45d08905aa98dec04f60` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:51.879069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989588f-3c7d-41a2-bed0-408d79119931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b747613f34b45d08905aa98dec04f60)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:51.890887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989588f-3c7d-41a2-bed0-408d79119931 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:51.919491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eeb06ad4-3960-40d6-ab97-db4d698f49e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e75727b84224665ba8c00778b208df2', 'request_id': 'req-eeb06ad4-3960-40d6-ab97-db4d698f49e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:51.945980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eeb06ad4-3960-40d6-ab97-db4d698f49e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e75727b84224665ba8c00778b208df2', 'request_id': 'req-eeb06ad4-3960-40d6-ab97-db4d698f49e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:51.955392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eeb06ad4-3960-40d6-ab97-db4d698f49e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e75727b84224665ba8c00778b208df2', 'request_id': 'req-eeb06ad4-3960-40d6-ab97-db4d698f49e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:51.974722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eeb06ad4-3960-40d6-ab97-db4d698f49e9 admin admin] The token cache is being invalidate because project 5e75727b84224665ba8c00778b208df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:51.975521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eeb06ad4-3960-40d6-ab97-db4d698f49e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:51.976489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eeb06ad4-3960-40d6-ab97-db4d698f49e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:51.978813 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3484/6956] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:51 2022] DELETE /identity/v3/projects/5e75727b84224665ba8c00778b208df2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:51.988542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce782a7c-bb6f-48f6-8291-268a0691eb93 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:51.988542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce782a7c-bb6f-48f6-8291-268a0691eb93 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:51.988542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce782a7c-bb6f-48f6-8291-268a0691eb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:52.010681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2989588f-3c7d-41a2-bed0-408d79119931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b747613f34b45d08905aa98dec04f60'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:52.013659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ce782a7c-bb6f-48f6-8291-268a0691eb93 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:52.015029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ce782a7c-bb6f-48f6-8291-268a0691eb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:52.062237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2989588f-3c7d-41a2-bed0-408d79119931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b747613f34b45d08905aa98dec04f60'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:52.068790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2989588f-3c7d-41a2-bed0-408d79119931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b747613f34b45d08905aa98dec04f60'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:52.075011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2989588f-3c7d-41a2-bed0-408d79119931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b747613f34b45d08905aa98dec04f60'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:52.080558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:52.107891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2989588f-3c7d-41a2-bed0-408d79119931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b747613f34b45d08905aa98dec04f60'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:52.121443 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3485/6957] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:52.138310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c23e2f-1f48-41d5-868d-743d54fe5f11 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:52.139233 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3473/6958] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:51 2022] DELETE /identity/v3/users/4b747613f34b45d08905aa98dec04f60 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:52.144661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744275c2-d6cd-4771-ac9f-def51f18f422 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:52.145307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744275c2-d6cd-4771-ac9f-def51f18f422 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:52.145937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744275c2-d6cd-4771-ac9f-def51f18f422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:52.157809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c23e2f-1f48-41d5-868d-743d54fe5f11 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:52.159430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c23e2f-1f48-41d5-868d-743d54fe5f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:52.172519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-744275c2-d6cd-4771-ac9f-def51f18f422 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:52.175169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-744275c2-d6cd-4771-ac9f-def51f18f422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:52.228289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-69c23e2f-1f48-41d5-868d-743d54fe5f11 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:52.231126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-69c23e2f-1f48-41d5-868d-743d54fe5f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:52.305954 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3474/6959] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:52.317035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744275c2-d6cd-4771-ac9f-def51f18f422 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:52.319280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-744275c2-d6cd-4771-ac9f-def51f18f422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:52.320751 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3486/6960] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:52.325594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c23e2f-1f48-41d5-868d-743d54fe5f11 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:52.336720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c23e2f-1f48-41d5-868d-743d54fe5f11 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:52.342095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b76369-c157-4c2c-a7f9-57bd7d39d69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:52.342740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b76369-c157-4c2c-a7f9-57bd7d39d69a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:52.343137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b76369-c157-4c2c-a7f9-57bd7d39d69a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:52.343413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b76369-c157-4c2c-a7f9-57bd7d39d69a admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:52.344066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b76369-c157-4c2c-a7f9-57bd7d39d69a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:52.344372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b76369-c157-4c2c-a7f9-57bd7d39d69a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:52.346406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b76369-c157-4c2c-a7f9-57bd7d39d69a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:52.364133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:52.374095 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3487/6961] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:19:52.378208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b76369-c157-4c2c-a7f9-57bd7d39d69a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:52.391499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b76369-c157-4c2c-a7f9-57bd7d39d69a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:52.398307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ce6a8-f2c8-4187-987c-aba3ee0ac6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:52.398989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ce6a8-f2c8-4187-987c-aba3ee0ac6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:52.399891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ce6a8-f2c8-4187-987c-aba3ee0ac6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:52.400231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ce6a8-f2c8-4187-987c-aba3ee0ac6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:52.400872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ce6a8-f2c8-4187-987c-aba3ee0ac6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:52.404292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ce6a8-f2c8-4187-987c-aba3ee0ac6e5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:52.420714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744275c2-d6cd-4771-ac9f-def51f18f422 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:52.426686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117bc02-31a3-4228-8801-8f3191f17186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:52.427457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117bc02-31a3-4228-8801-8f3191f17186 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:52.427902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117bc02-31a3-4228-8801-8f3191f17186 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:52.428482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117bc02-31a3-4228-8801-8f3191f17186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:52.444562 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3488/6962] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:52 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:52.449941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ce6a8-f2c8-4187-987c-aba3ee0ac6e5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:52.452068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117bc02-31a3-4228-8801-8f3191f17186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:52.453686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117bc02-31a3-4228-8801-8f3191f17186 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:52.467039 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3475/6963] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:52.576391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ce6a8-f2c8-4187-987c-aba3ee0ac6e5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:52.582491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a7887-8df0-4939-9e3f-4510e16f6611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:52.583008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a7887-8df0-4939-9e3f-4510e16f6611 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:52.583321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a7887-8df0-4939-9e3f-4510e16f6611 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:52.584163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a7887-8df0-4939-9e3f-4510e16f6611 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:52.584943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a7887-8df0-4939-9e3f-4510e16f6611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:52.589145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a7887-8df0-4939-9e3f-4510e16f6611 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:52.619910 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3489/6964] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:52 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:19:52.625266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117bc02-31a3-4228-8801-8f3191f17186 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:52.638757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117bc02-31a3-4228-8801-8f3191f17186 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:52.646150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292b2ba-57dc-4a36-bacd-3ebd116fd77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:52.646797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292b2ba-57dc-4a36-bacd-3ebd116fd77d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:52.647085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292b2ba-57dc-4a36-bacd-3ebd116fd77d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:52.647371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292b2ba-57dc-4a36-bacd-3ebd116fd77d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:52.648167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292b2ba-57dc-4a36-bacd-3ebd116fd77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:52.649938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292b2ba-57dc-4a36-bacd-3ebd116fd77d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:52.661225 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3476/6965] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:19:52.665938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a7887-8df0-4939-9e3f-4510e16f6611 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:52.678067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a7887-8df0-4939-9e3f-4510e16f6611 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:52.684372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f0aa9-baa5-4d48-b83a-b1df08f5bcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:52.685093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f0aa9-baa5-4d48-b83a-b1df08f5bcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:52.685409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f0aa9-baa5-4d48-b83a-b1df08f5bcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:52.685681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f0aa9-baa5-4d48-b83a-b1df08f5bcd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:52.686383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f0aa9-baa5-4d48-b83a-b1df08f5bcd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:52.688014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f0aa9-baa5-4d48-b83a-b1df08f5bcd1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:52.703440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292b2ba-57dc-4a36-bacd-3ebd116fd77d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:52.705727 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3490/6966] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:52.717960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292b2ba-57dc-4a36-bacd-3ebd116fd77d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:52.724366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84086acb-06e8-41e5-a18e-5ff472177a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:52.725094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84086acb-06e8-41e5-a18e-5ff472177a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:52.725542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84086acb-06e8-41e5-a18e-5ff472177a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:52.725984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84086acb-06e8-41e5-a18e-5ff472177a86 admin admin] PATH_INFO: `/v3/projects/7413241cfbe34ff096b358975770748c/users/72fa79cb09384a5094b7b9b4fb2948d7/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:52.746152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84086acb-06e8-41e5-a18e-5ff472177a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7413241cfbe34ff096b358975770748c, user_id=72fa79cb09384a5094b7b9b4fb2948d7, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:52.748906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84086acb-06e8-41e5-a18e-5ff472177a86 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:52.765148 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3477/6967] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:52 2022] PUT /identity/v3/projects/7413241cfbe34ff096b358975770748c/users/72fa79cb09384a5094b7b9b4fb2948d7/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:52.775733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae4dbe-d3ec-48da-a95b-c453e4d1a1fd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:52.778326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae4dbe-d3ec-48da-a95b-c453e4d1a1fd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:52.778520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae4dbe-d3ec-48da-a95b-c453e4d1a1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:52.817804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6cae4dbe-d3ec-48da-a95b-c453e4d1a1fd None None] MFA Rules not processed for user `72fa79cb09384a5094b7b9b4fb2948d7`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:52.819066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6cae4dbe-d3ec-48da-a95b-c453e4d1a1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:52.840797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:52.897646 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3491/6968] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:52.902716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84086acb-06e8-41e5-a18e-5ff472177a86 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:52.973821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84086acb-06e8-41e5-a18e-5ff472177a86 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:52.982056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae4dbe-d3ec-48da-a95b-c453e4d1a1fd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:52.982344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24efcd-cfc6-4365-8da2-d6cab010709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:52.982969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24efcd-cfc6-4365-8da2-d6cab010709f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:52.983272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24efcd-cfc6-4365-8da2-d6cab010709f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:52.983557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24efcd-cfc6-4365-8da2-d6cab010709f admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:52.983757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6cae4dbe-d3ec-48da-a95b-c453e4d1a1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:52.984448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24efcd-cfc6-4365-8da2-d6cab010709f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:52.986122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24efcd-cfc6-4365-8da2-d6cab010709f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:53.000193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae4dbe-d3ec-48da-a95b-c453e4d1a1fd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:53.006220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:53.007124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:53.007486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:53.007804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] PATH_INFO: `/v3/projects/fbe1a9c7dceb4c20b33ec10277b70c7e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:53.009052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe1a9c7dceb4c20b33ec10277b70c7e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:53.011114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:53.028015 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3478/6969] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:52 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:53.031698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24efcd-cfc6-4365-8da2-d6cab010709f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:53.077878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe1a9c7dceb4c20b33ec10277b70c7e', 'request_id': 'req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:53.088774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe1a9c7dceb4c20b33ec10277b70c7e', 'request_id': 'req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:53.099276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe1a9c7dceb4c20b33ec10277b70c7e', 'request_id': 'req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:53.114110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] The token cache is being invalidate because project fbe1a9c7dceb4c20b33ec10277b70c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:53.114404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:53.115078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:53.115574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24efcd-cfc6-4365-8da2-d6cab010709f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:53.117141 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3492/6970] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:52 2022] DELETE /identity/v3/projects/fbe1a9c7dceb4c20b33ec10277b70c7e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:53.121123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:53.123685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:53.155639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:53.215807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85508f64-bd34-4598-8330-2049424fc111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:53.216012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85508f64-bd34-4598-8330-2049424fc111 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:53.216247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85508f64-bd34-4598-8330-2049424fc111 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:53.216522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85508f64-bd34-4598-8330-2049424fc111 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:53.217151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85508f64-bd34-4598-8330-2049424fc111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:53.217599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a1c2e-c213-4420-9b56-ef1c75d9c73b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:53.219955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85508f64-bd34-4598-8330-2049424fc111 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:53.223095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:53.224382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:53.224920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:53.225654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] PATH_INFO: `/v3/users/bd4efa6c59e24df78ac36cfdfeab805d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:53.227273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd4efa6c59e24df78ac36cfdfeab805d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:53.231900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:53.269624 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3479/6971] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:53 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:53.273695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85508f64-bd34-4598-8330-2049424fc111 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:53.280598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-85508f64-bd34-4598-8330-2049424fc111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:53.298368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85508f64-bd34-4598-8330-2049424fc111 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:53.306661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916d635-34d0-45d6-9e66-f87984d1d756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:53.307426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916d635-34d0-45d6-9e66-f87984d1d756 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:53.307930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916d635-34d0-45d6-9e66-f87984d1d756 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:53.308864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916d635-34d0-45d6-9e66-f87984d1d756 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:53.310010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916d635-34d0-45d6-9e66-f87984d1d756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:53.312838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916d635-34d0-45d6-9e66-f87984d1d756 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:53.329486 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3480/6972] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:53.332478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916d635-34d0-45d6-9e66-f87984d1d756 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:53.341082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:53.344802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd4efa6c59e24df78ac36cfdfeab805d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:53.355867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916d635-34d0-45d6-9e66-f87984d1d756 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:53.357089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bcbec-d73e-4e64-b656-ca52ac6fd6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:53.358915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bcbec-d73e-4e64-b656-ca52ac6fd6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:53.359232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bcbec-d73e-4e64-b656-ca52ac6fd6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:53.359536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bcbec-d73e-4e64-b656-ca52ac6fd6e3 admin admin] PATH_INFO: `/v3/projects/ab80fe8bba754305aec2cce1474023ad/users/522f83335032403db303a917430056c6/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:53.368449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd4efa6c59e24df78ac36cfdfeab805d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:53.369522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd4efa6c59e24df78ac36cfdfeab805d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:53.371487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd4efa6c59e24df78ac36cfdfeab805d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:53.384131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bcbec-d73e-4e64-b656-ca52ac6fd6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab80fe8bba754305aec2cce1474023ad, user_id=522f83335032403db303a917430056c6, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:53.387683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bcbec-d73e-4e64-b656-ca52ac6fd6e3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:53.396194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd4efa6c59e24df78ac36cfdfeab805d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:53.412052 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3481/6973] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:53 2022] PUT /identity/v3/projects/ab80fe8bba754305aec2cce1474023ad/users/522f83335032403db303a917430056c6/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:53.413418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bcbec-d73e-4e64-b656-ca52ac6fd6e3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:53.415067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fe8bcbec-d73e-4e64-b656-ca52ac6fd6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:53.432577 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3493/6974] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:53 2022] DELETE /identity/v3/users/bd4efa6c59e24df78ac36cfdfeab805d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:53.500320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:53.501868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:53.568810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bcbec-d73e-4e64-b656-ca52ac6fd6e3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:53.590534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969f75d-85ca-434b-92e3-019c71309489 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:53.597656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c960e-9e34-460e-b4db-8e8da7ffb2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:53.599015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c960e-9e34-460e-b4db-8e8da7ffb2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:53.599299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c960e-9e34-460e-b4db-8e8da7ffb2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:53.599574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c960e-9e34-460e-b4db-8e8da7ffb2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:53.601705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-095c960e-9e34-460e-b4db-8e8da7ffb2f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:53.655245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff148575-3945-4dc8-baf5-10dd4f9287c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:53.656530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff148575-3945-4dc8-baf5-10dd4f9287c1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:53.656836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff148575-3945-4dc8-baf5-10dd4f9287c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:53.657115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff148575-3945-4dc8-baf5-10dd4f9287c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:53.657927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff148575-3945-4dc8-baf5-10dd4f9287c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:53.659766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff148575-3945-4dc8-baf5-10dd4f9287c1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:53.673229 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3482/6975] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:53.677558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c960e-9e34-460e-b4db-8e8da7ffb2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:53.678900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff148575-3945-4dc8-baf5-10dd4f9287c1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:53.679158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c960e-9e34-460e-b4db-8e8da7ffb2f7 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:53.691455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff148575-3945-4dc8-baf5-10dd4f9287c1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:53.691645 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3494/6976] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:53.697169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916e33d-5f75-4280-99d5-9700701d22c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:53.697907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916e33d-5f75-4280-99d5-9700701d22c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:53.698200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916e33d-5f75-4280-99d5-9700701d22c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:53.698478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916e33d-5f75-4280-99d5-9700701d22c1 admin admin] PATH_INFO: `/v3/projects/ab80fe8bba754305aec2cce1474023ad/users/522f83335032403db303a917430056c6/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:53.702387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916e33d-5f75-4280-99d5-9700701d22c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab80fe8bba754305aec2cce1474023ad, user_id=522f83335032403db303a917430056c6, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:53.705066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916e33d-5f75-4280-99d5-9700701d22c1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:53.716810 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3483/6977] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:53 2022] PUT /identity/v3/projects/ab80fe8bba754305aec2cce1474023ad/users/522f83335032403db303a917430056c6/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:53.727000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746bf5f-4db2-40f2-b9d7-9eb3bfd5ac89 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:53.727522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746bf5f-4db2-40f2-b9d7-9eb3bfd5ac89 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:53.727522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746bf5f-4db2-40f2-b9d7-9eb3bfd5ac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:53.767108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4746bf5f-4db2-40f2-b9d7-9eb3bfd5ac89 None None] MFA Rules not processed for user `522f83335032403db303a917430056c6`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:53.768352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4746bf5f-4db2-40f2-b9d7-9eb3bfd5ac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:53.853509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:53.862280 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3495/6978] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:53.878706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916e33d-5f75-4280-99d5-9700701d22c1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:53.880577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c916e33d-5f75-4280-99d5-9700701d22c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:53.901579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:53.968935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916e33d-5f75-4280-99d5-9700701d22c1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:53.973609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5a1de-adf5-4a71-83cd-24fbf81ca165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:53.974234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5a1de-adf5-4a71-83cd-24fbf81ca165 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:53.974572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5a1de-adf5-4a71-83cd-24fbf81ca165 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:53.974850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5a1de-adf5-4a71-83cd-24fbf81ca165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:53.994989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5a1de-adf5-4a71-83cd-24fbf81ca165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:53.996547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5a1de-adf5-4a71-83cd-24fbf81ca165 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:54.013871 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3484/6979] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:19:54.015708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746bf5f-4db2-40f2-b9d7-9eb3bfd5ac89 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:54.017132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4746bf5f-4db2-40f2-b9d7-9eb3bfd5ac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:54.144157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746bf5f-4db2-40f2-b9d7-9eb3bfd5ac89 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:54.150857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:54.151594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:54.152595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:54.152952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] PATH_INFO: `/v3/projects/d28335994a184648967973fb27ac6499` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:54.154481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d28335994a184648967973fb27ac6499)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:54.156808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:54.249116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd28335994a184648967973fb27ac6499', 'request_id': 'req-c7f0507b-db09-4e74-9e3f-32a3aec48895'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.269725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd28335994a184648967973fb27ac6499', 'request_id': 'req-c7f0507b-db09-4e74-9e3f-32a3aec48895'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.277719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd28335994a184648967973fb27ac6499', 'request_id': 'req-c7f0507b-db09-4e74-9e3f-32a3aec48895'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.295975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] The token cache is being invalidate because project d28335994a184648967973fb27ac6499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:54.296384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.297112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.299001 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3496/6980] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:54 2022] DELETE /identity/v3/projects/d28335994a184648967973fb27ac6499 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:54.302887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5a1de-adf5-4a71-83cd-24fbf81ca165 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:54.317860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5a1de-adf5-4a71-83cd-24fbf81ca165 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:54.398284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce22480-ac93-425a-b115-2e705fca6231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:54.398938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22480-ac93-425a-b115-2e705fca6231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:54.399221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22480-ac93-425a-b115-2e705fca6231 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:54.399500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22480-ac93-425a-b115-2e705fca6231 admin admin] PATH_INFO: `/v3/users/979dadf5480a4565bbeb7af55dee5fab` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:54.405397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce22480-ac93-425a-b115-2e705fca6231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=979dadf5480a4565bbeb7af55dee5fab)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:54.405397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce22480-ac93-425a-b115-2e705fca6231 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:54.465261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ce22480-ac93-425a-b115-2e705fca6231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979dadf5480a4565bbeb7af55dee5fab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.481209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ce22480-ac93-425a-b115-2e705fca6231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979dadf5480a4565bbeb7af55dee5fab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.481209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ce22480-ac93-425a-b115-2e705fca6231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979dadf5480a4565bbeb7af55dee5fab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.481209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ce22480-ac93-425a-b115-2e705fca6231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979dadf5480a4565bbeb7af55dee5fab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.499346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ce22480-ac93-425a-b115-2e705fca6231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979dadf5480a4565bbeb7af55dee5fab'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.516109 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3485/6981] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:54 2022] DELETE /identity/v3/users/979dadf5480a4565bbeb7af55dee5fab => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:54.636059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:54.638508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:54.658699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0507b-db09-4e74-9e3f-32a3aec48895 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:54.771793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:54.772732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:54.773060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:54.773551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] PATH_INFO: `/v3/users/72fa79cb09384a5094b7b9b4fb2948d7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:54.782116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72fa79cb09384a5094b7b9b4fb2948d7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:54.784059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:54.827892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:54.880845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72fa79cb09384a5094b7b9b4fb2948d7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.892994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72fa79cb09384a5094b7b9b4fb2948d7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.893891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72fa79cb09384a5094b7b9b4fb2948d7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.894536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72fa79cb09384a5094b7b9b4fb2948d7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.917055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72fa79cb09384a5094b7b9b4fb2948d7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:54.938352 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3497/6982] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:54 2022] DELETE /identity/v3/users/72fa79cb09384a5094b7b9b4fb2948d7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:54.942853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8484a3f-fe9d-4faa-99a4-766315e82aed None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:54.943140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8484a3f-fe9d-4faa-99a4-766315e82aed None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:54.943415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8484a3f-fe9d-4faa-99a4-766315e82aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:54.972221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a8484a3f-fe9d-4faa-99a4-766315e82aed None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:54.973463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a8484a3f-fe9d-4faa-99a4-766315e82aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:55.011534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:55.060230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:55.062181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:55.067110 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3486/6983] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:55.073917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8484a3f-fe9d-4faa-99a4-766315e82aed None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:55.077780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a8484a3f-fe9d-4faa-99a4-766315e82aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:55.091524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ccf6-2667-43d2-a6d5-eb60cc075fb6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:55.115314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b821e0e-68c1-4b32-a470-42cfa1c59c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:55.116407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b821e0e-68c1-4b32-a470-42cfa1c59c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:55.116693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b821e0e-68c1-4b32-a470-42cfa1c59c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:55.116970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b821e0e-68c1-4b32-a470-42cfa1c59c42 admin admin] PATH_INFO: `/v3/projects/751f5e4d246f4d5b9c059b6b188f46be` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:55.118748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b821e0e-68c1-4b32-a470-42cfa1c59c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=751f5e4d246f4d5b9c059b6b188f46be)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:55.120835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b821e0e-68c1-4b32-a470-42cfa1c59c42 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:55.162384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8484a3f-fe9d-4faa-99a4-766315e82aed None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:55.166280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e9cc6-eab0-4587-8aa9-6c26bbe6e3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:55.166909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e9cc6-eab0-4587-8aa9-6c26bbe6e3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:55.167191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e9cc6-eab0-4587-8aa9-6c26bbe6e3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:55.167487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e9cc6-eab0-4587-8aa9-6c26bbe6e3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:55.178648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e9cc6-eab0-4587-8aa9-6c26bbe6e3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:55.180269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e9cc6-eab0-4587-8aa9-6c26bbe6e3f4 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:55.187152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2b821e0e-68c1-4b32-a470-42cfa1c59c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751f5e4d246f4d5b9c059b6b188f46be', 'request_id': 'req-2b821e0e-68c1-4b32-a470-42cfa1c59c42'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:55.192600 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3487/6984] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:19:55.194183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142d99-4949-42ad-abd4-b7b069ce61ce None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:55.194470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142d99-4949-42ad-abd4-b7b069ce61ce None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:55.194749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142d99-4949-42ad-abd4-b7b069ce61ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:55.198713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2b821e0e-68c1-4b32-a470-42cfa1c59c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751f5e4d246f4d5b9c059b6b188f46be', 'request_id': 'req-2b821e0e-68c1-4b32-a470-42cfa1c59c42'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:55.208897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2b821e0e-68c1-4b32-a470-42cfa1c59c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751f5e4d246f4d5b9c059b6b188f46be', 'request_id': 'req-2b821e0e-68c1-4b32-a470-42cfa1c59c42'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:55.222511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2b821e0e-68c1-4b32-a470-42cfa1c59c42 admin admin] The token cache is being invalidate because project 751f5e4d246f4d5b9c059b6b188f46be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:55.222941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2b821e0e-68c1-4b32-a470-42cfa1c59c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:55.224103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2b821e0e-68c1-4b32-a470-42cfa1c59c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:55.225741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a8142d99-4949-42ad-abd4-b7b069ce61ce None None] MFA Rules not processed for user `2f98e01cab6b49c7a5d239aee95f4a64`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:55.227039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a8142d99-4949-42ad-abd4-b7b069ce61ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:55.229259 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3498/6985] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:55 2022] DELETE /identity/v3/projects/751f5e4d246f4d5b9c059b6b188f46be => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:55.232396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44899524-fe18-4380-aba0-b7f6cda29cbd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:55.234167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44899524-fe18-4380-aba0-b7f6cda29cbd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:55.234656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44899524-fe18-4380-aba0-b7f6cda29cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:55.258704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-44899524-fe18-4380-aba0-b7f6cda29cbd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:55.260133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-44899524-fe18-4380-aba0-b7f6cda29cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:55.305930 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3488/6986] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:55.334171 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3499/6987] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:55.344156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d42245-23e0-4438-8811-0312cc059a12 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:55.344156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d42245-23e0-4438-8811-0312cc059a12 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:55.344364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d42245-23e0-4438-8811-0312cc059a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:55.366884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-13d42245-23e0-4438-8811-0312cc059a12 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:55.368647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-13d42245-23e0-4438-8811-0312cc059a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:55.380716 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3489/6988] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:55.385438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44899524-fe18-4380-aba0-b7f6cda29cbd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:55.397621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44899524-fe18-4380-aba0-b7f6cda29cbd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:55.403919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed792471-9831-4f7e-b8b9-dd862e166615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:55.404637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792471-9831-4f7e-b8b9-dd862e166615 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:55.405018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792471-9831-4f7e-b8b9-dd862e166615 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:55.405462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792471-9831-4f7e-b8b9-dd862e166615 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:55.406219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed792471-9831-4f7e-b8b9-dd862e166615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:55.406625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed792471-9831-4f7e-b8b9-dd862e166615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:55.408469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed792471-9831-4f7e-b8b9-dd862e166615 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:55.422695 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3500/6989] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:19:55.426815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d42245-23e0-4438-8811-0312cc059a12 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:55.437252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d42245-23e0-4438-8811-0312cc059a12 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:55.444198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b961bc-4a14-4c73-9d4a-e25cd7e6269c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:55.445077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b961bc-4a14-4c73-9d4a-e25cd7e6269c admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:55.445368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b961bc-4a14-4c73-9d4a-e25cd7e6269c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:55.445557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b961bc-4a14-4c73-9d4a-e25cd7e6269c admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:55.446246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b961bc-4a14-4c73-9d4a-e25cd7e6269c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:55.448152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b961bc-4a14-4c73-9d4a-e25cd7e6269c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:55.485541 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3490/6990] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:55 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:55.486583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed792471-9831-4f7e-b8b9-dd862e166615 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:55.501025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed792471-9831-4f7e-b8b9-dd862e166615 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:55.516886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:55.566818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb18603-531c-4069-8b2c-2966fafcbe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:55.567461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb18603-531c-4069-8b2c-2966fafcbe7b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:55.567750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb18603-531c-4069-8b2c-2966fafcbe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:55.568183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb18603-531c-4069-8b2c-2966fafcbe7b admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:55.568843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb18603-531c-4069-8b2c-2966fafcbe7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:55.570856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb18603-531c-4069-8b2c-2966fafcbe7b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:55.598949 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3501/6991] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:55 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:55.603820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b961bc-4a14-4c73-9d4a-e25cd7e6269c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:55.618482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b961bc-4a14-4c73-9d4a-e25cd7e6269c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:55.624395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f70ee-7449-43e9-8288-9fe08c9b9293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:55.625316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f70ee-7449-43e9-8288-9fe08c9b9293 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:55.625846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f70ee-7449-43e9-8288-9fe08c9b9293 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:55.626279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f70ee-7449-43e9-8288-9fe08c9b9293 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:55.627269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f70ee-7449-43e9-8288-9fe08c9b9293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:55.629501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f70ee-7449-43e9-8288-9fe08c9b9293 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:55.643138 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3491/6992] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:55.646783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb18603-531c-4069-8b2c-2966fafcbe7b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:55.664761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb18603-531c-4069-8b2c-2966fafcbe7b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:55.670248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0471c5-abc3-4f5c-bab3-9bfa1eb277f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:55.671016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0471c5-abc3-4f5c-bab3-9bfa1eb277f3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:55.671306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0471c5-abc3-4f5c-bab3-9bfa1eb277f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:55.671583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0471c5-abc3-4f5c-bab3-9bfa1eb277f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:55.672488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0471c5-abc3-4f5c-bab3-9bfa1eb277f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:55.673940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0471c5-abc3-4f5c-bab3-9bfa1eb277f3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:55.686245 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3502/6993] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:19:55.690568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f70ee-7449-43e9-8288-9fe08c9b9293 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:55.701508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f70ee-7449-43e9-8288-9fe08c9b9293 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:55.707517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b05d0-b638-407a-8e35-f0c3900335d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:55.707517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b05d0-b638-407a-8e35-f0c3900335d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:55.707517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b05d0-b638-407a-8e35-f0c3900335d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:55.707845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b05d0-b638-407a-8e35-f0c3900335d2 admin admin] PATH_INFO: `/v3/projects/90569d889a8148318bb629bdf68736a5/users/ff7aacc302d34bc380b2b30ff3f2e65e/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:55.732478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b05d0-b638-407a-8e35-f0c3900335d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90569d889a8148318bb629bdf68736a5, user_id=ff7aacc302d34bc380b2b30ff3f2e65e, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:55.735209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b05d0-b638-407a-8e35-f0c3900335d2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:55.754303 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3492/6994] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:55 2022] PUT /identity/v3/projects/90569d889a8148318bb629bdf68736a5/users/ff7aacc302d34bc380b2b30ff3f2e65e/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:55.765605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8792e-5c2d-4e41-aba3-80db5cd414c6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:55.765916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8792e-5c2d-4e41-aba3-80db5cd414c6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:55.766240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8792e-5c2d-4e41-aba3-80db5cd414c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:55.775704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b05d0-b638-407a-8e35-f0c3900335d2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:55.778653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8e6b05d0-b638-407a-8e35-f0c3900335d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:55.806580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7dd8792e-5c2d-4e41-aba3-80db5cd414c6 None None] MFA Rules not processed for user `ff7aacc302d34bc380b2b30ff3f2e65e`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:55.807810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7dd8792e-5c2d-4e41-aba3-80db5cd414c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:55.826094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:55.874790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b05d0-b638-407a-8e35-f0c3900335d2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:55.880894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:55.881731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:55.882092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:55.882487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] PATH_INFO: `/v3/projects/7413241cfbe34ff096b358975770748c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:55.884055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7413241cfbe34ff096b358975770748c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:55.886335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:55.905135 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3503/6995] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:55.907469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8792e-5c2d-4e41-aba3-80db5cd414c6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:55.926600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8792e-5c2d-4e41-aba3-80db5cd414c6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:55.954132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7413241cfbe34ff096b358975770748c', 'request_id': 'req-ef7aef9b-fb05-4298-bbe4-ed35bb849998'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:55.972537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7413241cfbe34ff096b358975770748c', 'request_id': 'req-ef7aef9b-fb05-4298-bbe4-ed35bb849998'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:55.985157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7413241cfbe34ff096b358975770748c', 'request_id': 'req-ef7aef9b-fb05-4298-bbe4-ed35bb849998'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:56.004538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] The token cache is being invalidate because project 7413241cfbe34ff096b358975770748c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:56.005337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:56.006987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:56.009375 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3493/6996] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:55 2022] DELETE /identity/v3/projects/7413241cfbe34ff096b358975770748c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:56.015386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:56.017840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:56.025700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5309c8-03b2-4430-a895-0eb292d7777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:56.026329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5309c8-03b2-4430-a895-0eb292d7777f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:56.026613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5309c8-03b2-4430-a895-0eb292d7777f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:56.026977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5309c8-03b2-4430-a895-0eb292d7777f admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:56.027768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5309c8-03b2-4430-a895-0eb292d7777f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:56.029875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5309c8-03b2-4430-a895-0eb292d7777f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:56.068240 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3504/6997] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:55 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:56.073821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5309c8-03b2-4430-a895-0eb292d7777f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:56.076661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ef5309c8-03b2-4430-a895-0eb292d7777f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:56.091633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:56.139380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aef9b-fb05-4298-bbe4-ed35bb849998 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:56.172462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5309c8-03b2-4430-a895-0eb292d7777f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:56.178139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f7254-cd46-4e4a-9436-2adcb05586ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:56.178886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f7254-cd46-4e4a-9436-2adcb05586ee admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:56.179205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f7254-cd46-4e4a-9436-2adcb05586ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:56.179478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f7254-cd46-4e4a-9436-2adcb05586ee admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:56.180162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f7254-cd46-4e4a-9436-2adcb05586ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:56.182162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f7254-cd46-4e4a-9436-2adcb05586ee admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:56.220174 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3505/6998] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:56 2022] POST /identity/v3/users => generated 301 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:56.222968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f7254-cd46-4e4a-9436-2adcb05586ee admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:56.241249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:56.245780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f7254-cd46-4e4a-9436-2adcb05586ee admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:56.253177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:56.253831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:56.254294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:56.255090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] PATH_INFO: `/v3/users/522f83335032403db303a917430056c6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:56.258091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=522f83335032403db303a917430056c6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:56.263035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:56.263194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864ce3a-3dda-443b-8210-4518b1733e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:56.263588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864ce3a-3dda-443b-8210-4518b1733e89 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:56.264187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864ce3a-3dda-443b-8210-4518b1733e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:56.264531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864ce3a-3dda-443b-8210-4518b1733e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:56.266263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864ce3a-3dda-443b-8210-4518b1733e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:56.269709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864ce3a-3dda-443b-8210-4518b1733e89 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:56.293639 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3506/6999] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:56.300648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864ce3a-3dda-443b-8210-4518b1733e89 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:56.320338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864ce3a-3dda-443b-8210-4518b1733e89 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:56.331821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795d5c1-6a1b-47ee-a01c-0f48890131b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:56.333171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795d5c1-6a1b-47ee-a01c-0f48890131b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:56.334195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795d5c1-6a1b-47ee-a01c-0f48890131b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:56.334738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795d5c1-6a1b-47ee-a01c-0f48890131b5 admin admin] PATH_INFO: `/v3/projects/cb92f556e2944d6e8e1463aebb07019a/users/9ece9631d65349ddb772911de5dd86fb/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:56.335753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522f83335032403db303a917430056c6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:56.359982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522f83335032403db303a917430056c6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:56.360859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522f83335032403db303a917430056c6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:56.361950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522f83335032403db303a917430056c6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:56.369294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795d5c1-6a1b-47ee-a01c-0f48890131b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb92f556e2944d6e8e1463aebb07019a, user_id=9ece9631d65349ddb772911de5dd86fb, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:56.374666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795d5c1-6a1b-47ee-a01c-0f48890131b5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:56.381106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522f83335032403db303a917430056c6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:56.397318 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3507/7000] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:56 2022] PUT /identity/v3/projects/cb92f556e2944d6e8e1463aebb07019a/users/9ece9631d65349ddb772911de5dd86fb/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:56.407089 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3494/7001] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:56 2022] DELETE /identity/v3/users/522f83335032403db303a917430056c6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:56.410331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54787c-af43-442a-979c-438368ed6341 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:56.413096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54787c-af43-442a-979c-438368ed6341 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:56.414113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54787c-af43-442a-979c-438368ed6341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:56.495502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7e54787c-af43-442a-979c-438368ed6341 None None] MFA Rules not processed for user `9ece9631d65349ddb772911de5dd86fb`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:56.500323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7e54787c-af43-442a-979c-438368ed6341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:56.647624 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3508/7002] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:56 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:56.691102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:56.693242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:56.921565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4a10d-24ad-4e02-9570-eb661b4dcf5f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:56.933822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2693248-c023-452e-9911-9186cf558300 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:56.934370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2693248-c023-452e-9911-9186cf558300 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:56.934648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2693248-c023-452e-9911-9186cf558300 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:56.934921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2693248-c023-452e-9911-9186cf558300 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:56.947974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2693248-c023-452e-9911-9186cf558300 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:56.952917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2693248-c023-452e-9911-9186cf558300 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:56.978420 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3495/7003] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:19:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:19:56.999763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54787c-af43-442a-979c-438368ed6341 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:57.001367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7e54787c-af43-442a-979c-438368ed6341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:57.193921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:57.228058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54787c-af43-442a-979c-438368ed6341 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:57.234365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add3b5e-2a31-4802-b080-bdee99fce313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:57.235186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add3b5e-2a31-4802-b080-bdee99fce313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:57.235541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add3b5e-2a31-4802-b080-bdee99fce313 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:57.235891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add3b5e-2a31-4802-b080-bdee99fce313 admin admin] PATH_INFO: `/v3/projects/ab80fe8bba754305aec2cce1474023ad` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:57.240316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add3b5e-2a31-4802-b080-bdee99fce313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab80fe8bba754305aec2cce1474023ad)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:57.242745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add3b5e-2a31-4802-b080-bdee99fce313 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:57.339362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9add3b5e-2a31-4802-b080-bdee99fce313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab80fe8bba754305aec2cce1474023ad', 'request_id': 'req-9add3b5e-2a31-4802-b080-bdee99fce313'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:57.354045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9add3b5e-2a31-4802-b080-bdee99fce313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab80fe8bba754305aec2cce1474023ad', 'request_id': 'req-9add3b5e-2a31-4802-b080-bdee99fce313'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:57.361664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9add3b5e-2a31-4802-b080-bdee99fce313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab80fe8bba754305aec2cce1474023ad', 'request_id': 'req-9add3b5e-2a31-4802-b080-bdee99fce313'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:57.379374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9add3b5e-2a31-4802-b080-bdee99fce313 admin admin] The token cache is being invalidate because project ab80fe8bba754305aec2cce1474023ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:57.379853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9add3b5e-2a31-4802-b080-bdee99fce313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:57.381295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9add3b5e-2a31-4802-b080-bdee99fce313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:57.394109 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3509/7004] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:56 2022] DELETE /identity/v3/projects/ab80fe8bba754305aec2cce1474023ad => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:57.398897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e629bfa-0080-4ca4-b72c-3f27b48e310c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:57.399387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e629bfa-0080-4ca4-b72c-3f27b48e310c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:57.399471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e629bfa-0080-4ca4-b72c-3f27b48e310c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:57.428248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8e629bfa-0080-4ca4-b72c-3f27b48e310c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:57.430759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8e629bfa-0080-4ca4-b72c-3f27b48e310c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:57.545234 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3496/7005] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:57.552638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc872d-8389-4aab-bcd5-786edf965e82 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:57.553100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc872d-8389-4aab-bcd5-786edf965e82 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:57.553483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc872d-8389-4aab-bcd5-786edf965e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:57.603062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-82dc872d-8389-4aab-bcd5-786edf965e82 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:57.609118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-82dc872d-8389-4aab-bcd5-786edf965e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:57.631914 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3510/7006] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:57.633677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e629bfa-0080-4ca4-b72c-3f27b48e310c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:57.641858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:57.649107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e629bfa-0080-4ca4-b72c-3f27b48e310c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:57.663206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa87ce-08d9-4657-946c-dd7976d796f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:57.664878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa87ce-08d9-4657-946c-dd7976d796f8 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:57.665715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa87ce-08d9-4657-946c-dd7976d796f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:57.665715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa87ce-08d9-4657-946c-dd7976d796f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:57.667120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa87ce-08d9-4657-946c-dd7976d796f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:19:57.668213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa87ce-08d9-4657-946c-dd7976d796f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:57.670581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa87ce-08d9-4657-946c-dd7976d796f8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:57.689877 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3497/7007] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:19:57.694630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc872d-8389-4aab-bcd5-786edf965e82 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:57.706699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc872d-8389-4aab-bcd5-786edf965e82 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:57.716526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b35a-fd01-4a97-89f9-4246e474097f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:57.718427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b35a-fd01-4a97-89f9-4246e474097f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:57.718787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b35a-fd01-4a97-89f9-4246e474097f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:57.719218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b35a-fd01-4a97-89f9-4246e474097f admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:57.719965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6b35a-fd01-4a97-89f9-4246e474097f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:57.722173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6b35a-fd01-4a97-89f9-4246e474097f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:57.797164 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3511/7008] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:57 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:57.798823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa87ce-08d9-4657-946c-dd7976d796f8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:57.814920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa87ce-08d9-4657-946c-dd7976d796f8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:57.921044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd035-c13f-47fb-b3dd-adaba703bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:57.921697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd035-c13f-47fb-b3dd-adaba703bcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:57.921989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd035-c13f-47fb-b3dd-adaba703bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:57.922256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd035-c13f-47fb-b3dd-adaba703bcb1 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:57.922864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bd035-c13f-47fb-b3dd-adaba703bcb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:57.924889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bd035-c13f-47fb-b3dd-adaba703bcb1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:57.952543 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3498/7009] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:57 2022] POST /identity/v3/users => generated 283 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:19:57.953953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b35a-fd01-4a97-89f9-4246e474097f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:57.963074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd035-c13f-47fb-b3dd-adaba703bcb1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:57.965630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ff9bd035-c13f-47fb-b3dd-adaba703bcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:57.967421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b35a-fd01-4a97-89f9-4246e474097f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:57.974569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550db5b5-3f4d-4400-b40d-73c4ef025a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:57.976011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550db5b5-3f4d-4400-b40d-73c4ef025a7c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:57.976355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550db5b5-3f4d-4400-b40d-73c4ef025a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:57.981219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550db5b5-3f4d-4400-b40d-73c4ef025a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:57.981219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550db5b5-3f4d-4400-b40d-73c4ef025a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:57.981219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550db5b5-3f4d-4400-b40d-73c4ef025a7c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:57.981533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd035-c13f-47fb-b3dd-adaba703bcb1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:57.987023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deeb2c-c717-428b-9c53-ba45638a0b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:57.987919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deeb2c-c717-428b-9c53-ba45638a0b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:57.987919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deeb2c-c717-428b-9c53-ba45638a0b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:57.988191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deeb2c-c717-428b-9c53-ba45638a0b20 admin admin] PATH_INFO: `/v3/users/ff7aacc302d34bc380b2b30ff3f2e65e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:57.989852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96deeb2c-c717-428b-9c53-ba45638a0b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff7aacc302d34bc380b2b30ff3f2e65e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:57.993225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96deeb2c-c717-428b-9c53-ba45638a0b20 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:57.993355 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3512/7010] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:19:57.995572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550db5b5-3f4d-4400-b40d-73c4ef025a7c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:58.005852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550db5b5-3f4d-4400-b40d-73c4ef025a7c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:58.010536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcbcae-9dbb-4ed2-aed7-1ad0f0b0ba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:58.011127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcbcae-9dbb-4ed2-aed7-1ad0f0b0ba67 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:58.011466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcbcae-9dbb-4ed2-aed7-1ad0f0b0ba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:58.011740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcbcae-9dbb-4ed2-aed7-1ad0f0b0ba67 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:58.012395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcbcae-9dbb-4ed2-aed7-1ad0f0b0ba67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:58.014034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcbcae-9dbb-4ed2-aed7-1ad0f0b0ba67 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:58.025149 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3513/7011] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:19:58.029716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcbcae-9dbb-4ed2-aed7-1ad0f0b0ba67 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:58.043093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcbcae-9dbb-4ed2-aed7-1ad0f0b0ba67 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:58.054114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435919ce-98b8-4569-80ce-17ec033de1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:58.055154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435919ce-98b8-4569-80ce-17ec033de1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:58.055393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-96deeb2c-c717-428b-9c53-ba45638a0b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff7aacc302d34bc380b2b30ff3f2e65e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:58.055512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435919ce-98b8-4569-80ce-17ec033de1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:58.056405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435919ce-98b8-4569-80ce-17ec033de1ca admin admin] PATH_INFO: `/v3/projects/1038cf24a4d14f5aaf42fc18b1d15569/users/178eda00ec4d4658be24753e493891c4/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:58.065031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-96deeb2c-c717-428b-9c53-ba45638a0b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff7aacc302d34bc380b2b30ff3f2e65e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:58.065988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-96deeb2c-c717-428b-9c53-ba45638a0b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff7aacc302d34bc380b2b30ff3f2e65e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:58.066881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-96deeb2c-c717-428b-9c53-ba45638a0b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff7aacc302d34bc380b2b30ff3f2e65e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:58.074958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435919ce-98b8-4569-80ce-17ec033de1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1038cf24a4d14f5aaf42fc18b1d15569, user_id=178eda00ec4d4658be24753e493891c4, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:58.077693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435919ce-98b8-4569-80ce-17ec033de1ca admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:58.085712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-96deeb2c-c717-428b-9c53-ba45638a0b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff7aacc302d34bc380b2b30ff3f2e65e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:58.096442 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3514/7012] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:58 2022] PUT /identity/v3/projects/1038cf24a4d14f5aaf42fc18b1d15569/users/178eda00ec4d4658be24753e493891c4/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:58.108143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf3de0-456b-48d9-8995-7337c7eac3a8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:58.108425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf3de0-456b-48d9-8995-7337c7eac3a8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:58.108700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf3de0-456b-48d9-8995-7337c7eac3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:58.121269 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3499/7013] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:57 2022] DELETE /identity/v3/users/ff7aacc302d34bc380b2b30ff3f2e65e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:58.123834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ce6a2-5042-4c2e-9c3f-1c6c3d30ada6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:58.124331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ce6a2-5042-4c2e-9c3f-1c6c3d30ada6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:58.124805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ce6a2-5042-4c2e-9c3f-1c6c3d30ada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:58.158678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ff9ce6a2-5042-4c2e-9c3f-1c6c3d30ada6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:58.160143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ff9ce6a2-5042-4c2e-9c3f-1c6c3d30ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:58.167298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-14bf3de0-456b-48d9-8995-7337c7eac3a8 None None] MFA Rules not processed for user `178eda00ec4d4658be24753e493891c4`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:58.172422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-14bf3de0-456b-48d9-8995-7337c7eac3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:58.256554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:58.284301 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3500/7014] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:58.311667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ce6a2-5042-4c2e-9c3f-1c6c3d30ada6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:58.314004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ff9ce6a2-5042-4c2e-9c3f-1c6c3d30ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:58.373748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:58.397070 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3515/7015] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:19:58.399870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf3de0-456b-48d9-8995-7337c7eac3a8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:58.401403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-14bf3de0-456b-48d9-8995-7337c7eac3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:58.438524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf3de0-456b-48d9-8995-7337c7eac3a8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:58.452945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a6b2b-9d25-404c-82ca-4a90f45efd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:58.453685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a6b2b-9d25-404c-82ca-4a90f45efd68 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:58.453972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a6b2b-9d25-404c-82ca-4a90f45efd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:58.454247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a6b2b-9d25-404c-82ca-4a90f45efd68 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:58.454886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a6b2b-9d25-404c-82ca-4a90f45efd68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:58.461962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a6b2b-9d25-404c-82ca-4a90f45efd68 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:58.504540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ce6a2-5042-4c2e-9c3f-1c6c3d30ada6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:58.513883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751df54-7992-488b-a56a-a197f03ed4b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:58.514516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751df54-7992-488b-a56a-a197f03ed4b5 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:58.514819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751df54-7992-488b-a56a-a197f03ed4b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:58.515080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751df54-7992-488b-a56a-a197f03ed4b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:58.521045 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3516/7016] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:19:58 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:19:58.524886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a6b2b-9d25-404c-82ca-4a90f45efd68 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:58.562071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751df54-7992-488b-a56a-a197f03ed4b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:58.563004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751df54-7992-488b-a56a-a197f03ed4b5 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:58.603815 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3501/7017] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:19:58.670386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a6b2b-9d25-404c-82ca-4a90f45efd68 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:58.678821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cad4e-cbe1-4cab-ab20-806d6f8ca9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:58.679839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cad4e-cbe1-4cab-ab20-806d6f8ca9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:58.680127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cad4e-cbe1-4cab-ab20-806d6f8ca9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:58.680404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cad4e-cbe1-4cab-ab20-806d6f8ca9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:58.681050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cad4e-cbe1-4cab-ab20-806d6f8ca9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:58.683863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cad4e-cbe1-4cab-ab20-806d6f8ca9f3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:58.722039 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3517/7018] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:19:58 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:19:58.729343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751df54-7992-488b-a56a-a197f03ed4b5 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:58.751401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751df54-7992-488b-a56a-a197f03ed4b5 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:58.764699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f43182-5d62-43b3-92c7-30875aecce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:58.764699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f43182-5d62-43b3-92c7-30875aecce4d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:58.764699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f43182-5d62-43b3-92c7-30875aecce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:58.764699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f43182-5d62-43b3-92c7-30875aecce4d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:58.765311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f43182-5d62-43b3-92c7-30875aecce4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:58.765311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f43182-5d62-43b3-92c7-30875aecce4d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:58.790826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cad4e-cbe1-4cab-ab20-806d6f8ca9f3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:58.791383 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3502/7019] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:58.806277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cad4e-cbe1-4cab-ab20-806d6f8ca9f3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:58.813981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44168e41-e69a-488c-b142-86ce3bf1dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:58.814819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44168e41-e69a-488c-b142-86ce3bf1dcd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:58.815512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44168e41-e69a-488c-b142-86ce3bf1dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:58.815975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44168e41-e69a-488c-b142-86ce3bf1dcd3 admin admin] PATH_INFO: `/v3/projects/0a33670895c84303bc8423d59982e045/users/b70445b61eaa42389108d4a378c267d5/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:58.840085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44168e41-e69a-488c-b142-86ce3bf1dcd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a33670895c84303bc8423d59982e045, user_id=b70445b61eaa42389108d4a378c267d5, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:58.845848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44168e41-e69a-488c-b142-86ce3bf1dcd3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:58.893283 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3518/7020] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:58 2022] PUT /identity/v3/projects/0a33670895c84303bc8423d59982e045/users/b70445b61eaa42389108d4a378c267d5/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:58.893454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f43182-5d62-43b3-92c7-30875aecce4d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:58.912272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f43182-5d62-43b3-92c7-30875aecce4d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:59.035942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df81385-ccbf-4e14-95bf-e73cec540670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:59.036933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df81385-ccbf-4e14-95bf-e73cec540670 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:59.037405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df81385-ccbf-4e14-95bf-e73cec540670 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:59.037783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df81385-ccbf-4e14-95bf-e73cec540670 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:59.038554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df81385-ccbf-4e14-95bf-e73cec540670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:59.040363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df81385-ccbf-4e14-95bf-e73cec540670 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:59.057798 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3503/7021] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:19:59.059381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44168e41-e69a-488c-b142-86ce3bf1dcd3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:59.082076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44168e41-e69a-488c-b142-86ce3bf1dcd3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:59.101423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf42133-49b8-4a0f-a682-493d4bee5353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:59.102320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf42133-49b8-4a0f-a682-493d4bee5353 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:59.103003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf42133-49b8-4a0f-a682-493d4bee5353 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:59.103456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf42133-49b8-4a0f-a682-493d4bee5353 admin admin] PATH_INFO: `/v3/projects/0a33670895c84303bc8423d59982e045/users/b70445b61eaa42389108d4a378c267d5/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:59.106697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf42133-49b8-4a0f-a682-493d4bee5353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a33670895c84303bc8423d59982e045, user_id=b70445b61eaa42389108d4a378c267d5, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:59.110153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf42133-49b8-4a0f-a682-493d4bee5353 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:59.124250 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3519/7022] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:19:59 2022] PUT /identity/v3/projects/0a33670895c84303bc8423d59982e045/users/b70445b61eaa42389108d4a378c267d5/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:19:59.233583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78d6d-7045-4f8d-bae1-9a9a7808c4a4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:59.234384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78d6d-7045-4f8d-bae1-9a9a7808c4a4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:59.234501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78d6d-7045-4f8d-bae1-9a9a7808c4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:59.302178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-28d78d6d-7045-4f8d-bae1-9a9a7808c4a4 None None] MFA Rules not processed for user `b70445b61eaa42389108d4a378c267d5`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:19:59.303482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-28d78d6d-7045-4f8d-bae1-9a9a7808c4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:59.358782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf42133-49b8-4a0f-a682-493d4bee5353 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:59.361161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-eaf42133-49b8-4a0f-a682-493d4bee5353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:59.452346 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3504/7023] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:19:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:19:59.456573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d78d6d-7045-4f8d-bae1-9a9a7808c4a4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:59.458877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-28d78d6d-7045-4f8d-bae1-9a9a7808c4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:59.482262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:59.499475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf42133-49b8-4a0f-a682-493d4bee5353 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:59.504265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:59.504976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:59.505385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:59.507677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] PATH_INFO: `/v3/users/8957041987c8487099f0d89f4c64af66` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:59.507677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8957041987c8487099f0d89f4c64af66)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:59.509088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:59.554564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:59.570991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d78d6d-7045-4f8d-bae1-9a9a7808c4a4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:59.578444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8957041987c8487099f0d89f4c64af66'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:59.586111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:59.586786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:59.587060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:59.588869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] PATH_INFO: `/v3/projects/90569d889a8148318bb629bdf68736a5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:59.590897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90569d889a8148318bb629bdf68736a5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:59.593176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:59.595308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8957041987c8487099f0d89f4c64af66'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:59.596855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8957041987c8487099f0d89f4c64af66'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:59.599084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8957041987c8487099f0d89f4c64af66'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:59.616102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8957041987c8487099f0d89f4c64af66'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:59.640045 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3520/7024] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:59 2022] DELETE /identity/v3/users/8957041987c8487099f0d89f4c64af66 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:59.641468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:59.643880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:59.715283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90569d889a8148318bb629bdf68736a5', 'request_id': 'req-ba3b0c57-df2f-43cf-942d-c47b590d0d32'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:59.735220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39500890-7101-4118-b8d8-a3b1d8d637a9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:59.744036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90569d889a8148318bb629bdf68736a5', 'request_id': 'req-ba3b0c57-df2f-43cf-942d-c47b590d0d32'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:59.755328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90569d889a8148318bb629bdf68736a5', 'request_id': 'req-ba3b0c57-df2f-43cf-942d-c47b590d0d32'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:59.773672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] The token cache is being invalidate because project 90569d889a8148318bb629bdf68736a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:19:59.773968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:59.775071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:59.780227 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3505/7025] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:59 2022] DELETE /identity/v3/projects/90569d889a8148318bb629bdf68736a5 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:19:59.781135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:19:59.782793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:59.818315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54e7a4-cb15-476b-aaf6-58697a82ff0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:59.819030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54e7a4-cb15-476b-aaf6-58697a82ff0b service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:59.819385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54e7a4-cb15-476b-aaf6-58697a82ff0b service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:59.819657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54e7a4-cb15-476b-aaf6-58697a82ff0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:59.821956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cb54e7a4-cb15-476b-aaf6-58697a82ff0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:19:59.887078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b0c57-df2f-43cf-942d-c47b590d0d32 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:19:59.894049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:19:59.894049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:19:59.894370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:19:59.894582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] PATH_INFO: `/v3/users/9ece9631d65349ddb772911de5dd86fb` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:19:59.895952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ece9631d65349ddb772911de5dd86fb)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:59.898069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:59.963433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:59.972717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54e7a4-cb15-476b-aaf6-58697a82ff0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:19:59.976264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54e7a4-cb15-476b-aaf6-58697a82ff0b service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:19:59.984331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ece9631d65349ddb772911de5dd86fb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:19:59.999880 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3521/7026] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:19:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:00.000247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ece9631d65349ddb772911de5dd86fb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.004826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54e7a4-cb15-476b-aaf6-58697a82ff0b service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:00.005001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ece9631d65349ddb772911de5dd86fb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.005001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ece9631d65349ddb772911de5dd86fb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.005911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cb54e7a4-cb15-476b-aaf6-58697a82ff0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:00.028067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ece9631d65349ddb772911de5dd86fb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.034267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54e7a4-cb15-476b-aaf6-58697a82ff0b service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:00.044456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf28e11-9468-477a-be24-d7a453e4ac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:00.045111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf28e11-9468-477a-be24-d7a453e4ac14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:00.045415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf28e11-9468-477a-be24-d7a453e4ac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:00.045736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf28e11-9468-477a-be24-d7a453e4ac14 admin admin] PATH_INFO: `/v3/projects/3d9d29b90ab34abbadd21edbca637d2e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:00.049302 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3506/7027] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:19:59 2022] DELETE /identity/v3/users/9ece9631d65349ddb772911de5dd86fb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:00.052467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf28e11-9468-477a-be24-d7a453e4ac14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9d29b90ab34abbadd21edbca637d2e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:00.054833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf28e11-9468-477a-be24-d7a453e4ac14 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:00.074310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:00.157288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2cf28e11-9468-477a-be24-d7a453e4ac14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9d29b90ab34abbadd21edbca637d2e', 'request_id': 'req-2cf28e11-9468-477a-be24-d7a453e4ac14'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.158997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:00.160727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:00.175124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2cf28e11-9468-477a-be24-d7a453e4ac14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9d29b90ab34abbadd21edbca637d2e', 'request_id': 'req-2cf28e11-9468-477a-be24-d7a453e4ac14'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.193140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2cf28e11-9468-477a-be24-d7a453e4ac14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9d29b90ab34abbadd21edbca637d2e', 'request_id': 'req-2cf28e11-9468-477a-be24-d7a453e4ac14'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.225740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2cf28e11-9468-477a-be24-d7a453e4ac14 admin admin] The token cache is being invalidate because project 3d9d29b90ab34abbadd21edbca637d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:00.226057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2cf28e11-9468-477a-be24-d7a453e4ac14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.227004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2cf28e11-9468-477a-be24-d7a453e4ac14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.232989 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3522/7028] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:19:59 2022] DELETE /identity/v3/projects/3d9d29b90ab34abbadd21edbca637d2e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:00.236995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e4e26-7ac9-47df-930f-5d30c7379c4d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:00.237305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e4e26-7ac9-47df-930f-5d30c7379c4d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:00.237616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e4e26-7ac9-47df-930f-5d30c7379c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:00.288366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-649e4e26-7ac9-47df-930f-5d30c7379c4d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:00.303063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-649e4e26-7ac9-47df-930f-5d30c7379c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:00.323656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795c091-2080-4113-a747-f7134ef14d42 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:00.404068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98f227-7945-432b-a002-cbec04a10945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:00.404898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98f227-7945-432b-a002-cbec04a10945 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:00.405205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98f227-7945-432b-a002-cbec04a10945 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:00.405930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98f227-7945-432b-a002-cbec04a10945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:00.407871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2a98f227-7945-432b-a002-cbec04a10945 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:00.457706 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3523/7029] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:00.465722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b249-38b4-49e5-881c-5dce7bf32cba None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:00.466144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b249-38b4-49e5-881c-5dce7bf32cba None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:00.466439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b249-38b4-49e5-881c-5dce7bf32cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:00.498532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6c17b249-38b4-49e5-881c-5dce7bf32cba None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:00.499783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6c17b249-38b4-49e5-881c-5dce7bf32cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:00.508748 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3524/7030] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:00.509915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98f227-7945-432b-a002-cbec04a10945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:00.513041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98f227-7945-432b-a002-cbec04a10945 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:00.514651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17b249-38b4-49e5-881c-5dce7bf32cba None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:00.524159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17b249-38b4-49e5-881c-5dce7bf32cba None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:00.526180 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3507/7031] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:20:00.531657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc076837-42db-4c4f-bb64-3d6c66f87cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:00.532366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc076837-42db-4c4f-bb64-3d6c66f87cfc admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:00.532693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc076837-42db-4c4f-bb64-3d6c66f87cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:00.532899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc076837-42db-4c4f-bb64-3d6c66f87cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:00.533690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc076837-42db-4c4f-bb64-3d6c66f87cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:00.533875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc076837-42db-4c4f-bb64-3d6c66f87cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:00.535473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc076837-42db-4c4f-bb64-3d6c66f87cfc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:00.551890 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3525/7032] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:00.552824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98f227-7945-432b-a002-cbec04a10945 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:00.570775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98f227-7945-432b-a002-cbec04a10945 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:00.582828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef000ccd-72b2-4477-8d1b-a1e4ee350fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:00.583593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef000ccd-72b2-4477-8d1b-a1e4ee350fca admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:00.584151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef000ccd-72b2-4477-8d1b-a1e4ee350fca admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:00.584429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef000ccd-72b2-4477-8d1b-a1e4ee350fca admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:00.585209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef000ccd-72b2-4477-8d1b-a1e4ee350fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:00.587392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef000ccd-72b2-4477-8d1b-a1e4ee350fca admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:00.617719 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3508/7033] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:00 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:00.622320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc076837-42db-4c4f-bb64-3d6c66f87cfc admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:00.634668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc076837-42db-4c4f-bb64-3d6c66f87cfc admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:00.712744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef000ccd-72b2-4477-8d1b-a1e4ee350fca admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:00.715284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ef000ccd-72b2-4477-8d1b-a1e4ee350fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:00.724348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:00.763319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df749b-eec7-472f-99e3-d72369556226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:00.763972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df749b-eec7-472f-99e3-d72369556226 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:00.764809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df749b-eec7-472f-99e3-d72369556226 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:00.764809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df749b-eec7-472f-99e3-d72369556226 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:00.765415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df749b-eec7-472f-99e3-d72369556226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:00.767674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df749b-eec7-472f-99e3-d72369556226 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:00.801927 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3526/7034] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:00 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:00.803034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df749b-eec7-472f-99e3-d72369556226 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:00.813161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df749b-eec7-472f-99e3-d72369556226 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:00.818240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88095e4-63f8-41f5-9b06-b6fa25c704aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:00.818673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88095e4-63f8-41f5-9b06-b6fa25c704aa admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:00.818954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88095e4-63f8-41f5-9b06-b6fa25c704aa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:00.819336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88095e4-63f8-41f5-9b06-b6fa25c704aa admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:00.820019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88095e4-63f8-41f5-9b06-b6fa25c704aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:00.821729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88095e4-63f8-41f5-9b06-b6fa25c704aa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:00.825140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:00.832711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef000ccd-72b2-4477-8d1b-a1e4ee350fca admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:00.835933 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3527/7035] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:00.840532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88095e4-63f8-41f5-9b06-b6fa25c704aa admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:00.841123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266c7fc-c6de-46b2-99c9-89c42fd789d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:00.842315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266c7fc-c6de-46b2-99c9-89c42fd789d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:00.842695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266c7fc-c6de-46b2-99c9-89c42fd789d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:00.843187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266c7fc-c6de-46b2-99c9-89c42fd789d2 admin admin] PATH_INFO: `/v3/projects/cb92f556e2944d6e8e1463aebb07019a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:00.844492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266c7fc-c6de-46b2-99c9-89c42fd789d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb92f556e2944d6e8e1463aebb07019a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:00.846512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266c7fc-c6de-46b2-99c9-89c42fd789d2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:00.853812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88095e4-63f8-41f5-9b06-b6fa25c704aa admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:00.859765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dbd0d-5a5f-4463-a403-a1f903ff7a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:00.860921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dbd0d-5a5f-4463-a403-a1f903ff7a17 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:00.861891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dbd0d-5a5f-4463-a403-a1f903ff7a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:00.862122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dbd0d-5a5f-4463-a403-a1f903ff7a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:00.862873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dbd0d-5a5f-4463-a403-a1f903ff7a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:00.864604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dbd0d-5a5f-4463-a403-a1f903ff7a17 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:00.875875 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3528/7036] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:00.880101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dbd0d-5a5f-4463-a403-a1f903ff7a17 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:00.892597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dbd0d-5a5f-4463-a403-a1f903ff7a17 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:00.909061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0266c7fc-c6de-46b2-99c9-89c42fd789d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb92f556e2944d6e8e1463aebb07019a', 'request_id': 'req-0266c7fc-c6de-46b2-99c9-89c42fd789d2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.920090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0266c7fc-c6de-46b2-99c9-89c42fd789d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb92f556e2944d6e8e1463aebb07019a', 'request_id': 'req-0266c7fc-c6de-46b2-99c9-89c42fd789d2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.927461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0266c7fc-c6de-46b2-99c9-89c42fd789d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb92f556e2944d6e8e1463aebb07019a', 'request_id': 'req-0266c7fc-c6de-46b2-99c9-89c42fd789d2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.943596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0266c7fc-c6de-46b2-99c9-89c42fd789d2 admin admin] The token cache is being invalidate because project cb92f556e2944d6e8e1463aebb07019a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:00.943897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0266c7fc-c6de-46b2-99c9-89c42fd789d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.944689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0266c7fc-c6de-46b2-99c9-89c42fd789d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:00.952316 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3509/7037] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:00 2022] DELETE /identity/v3/projects/cb92f556e2944d6e8e1463aebb07019a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:00.969878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a33d-0fbb-40f8-9c12-6b8596a3588e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:00.970786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a33d-0fbb-40f8-9c12-6b8596a3588e admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:00.971012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a33d-0fbb-40f8-9c12-6b8596a3588e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:00.971429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a33d-0fbb-40f8-9c12-6b8596a3588e admin admin] PATH_INFO: `/v3/projects/0ba0c1d321704635930a5017713e75b1/users/41b81a1fe7a245a5bd454b97e7365dfa/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:00.990828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780a33d-0fbb-40f8-9c12-6b8596a3588e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba0c1d321704635930a5017713e75b1, user_id=41b81a1fe7a245a5bd454b97e7365dfa, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:00.993855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780a33d-0fbb-40f8-9c12-6b8596a3588e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:01.022213 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3529/7038] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:00 2022] PUT /identity/v3/projects/0ba0c1d321704635930a5017713e75b1/users/41b81a1fe7a245a5bd454b97e7365dfa/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:01.027814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f4523-3a60-4c8a-b2c6-f0b496e9a1ea None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:01.028182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f4523-3a60-4c8a-b2c6-f0b496e9a1ea None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:01.028364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f4523-3a60-4c8a-b2c6-f0b496e9a1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:01.066953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c56f4523-3a60-4c8a-b2c6-f0b496e9a1ea None None] MFA Rules not processed for user `41b81a1fe7a245a5bd454b97e7365dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:01.068466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c56f4523-3a60-4c8a-b2c6-f0b496e9a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:01.171267 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3510/7039] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:01.178303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a33d-0fbb-40f8-9c12-6b8596a3588e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:01.180223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8780a33d-0fbb-40f8-9c12-6b8596a3588e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:01.270990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a33d-0fbb-40f8-9c12-6b8596a3588e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:01.277658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b24bc-4431-409a-9174-83db3381aa31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:01.278294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b24bc-4431-409a-9174-83db3381aa31 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:01.278580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b24bc-4431-409a-9174-83db3381aa31 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:01.278852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b24bc-4431-409a-9174-83db3381aa31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:01.288336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b24bc-4431-409a-9174-83db3381aa31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:01.290023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b24bc-4431-409a-9174-83db3381aa31 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:01.302331 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3530/7040] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:01.537904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4007742-b0f2-43f5-93fa-3913714743b9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:01.538272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4007742-b0f2-43f5-93fa-3913714743b9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:01.538695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4007742-b0f2-43f5-93fa-3913714743b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:01.560750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e4007742-b0f2-43f5-93fa-3913714743b9 None None] MFA Rules not processed for user `537b77eca97d4c1395eeb164bc5e7205`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:01.562857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e4007742-b0f2-43f5-93fa-3913714743b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:01.597620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:01.659090 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3511/7041] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:04.452786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b24bc-4431-409a-9174-83db3381aa31 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:04.454667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e32b24bc-4431-409a-9174-83db3381aa31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:04.526805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:04.532772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b24bc-4431-409a-9174-83db3381aa31 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:04.539254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:04.539884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:04.540159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:04.540424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] PATH_INFO: `/v3/users/41b81a1fe7a245a5bd454b97e7365dfa` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:04.541587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b81a1fe7a245a5bd454b97e7365dfa)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:04.544109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:04.592912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b81a1fe7a245a5bd454b97e7365dfa'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:04.600785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b81a1fe7a245a5bd454b97e7365dfa'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:04.601591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b81a1fe7a245a5bd454b97e7365dfa'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:04.602277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b81a1fe7a245a5bd454b97e7365dfa'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:04.618067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b81a1fe7a245a5bd454b97e7365dfa'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:04.640713 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3531/7042] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:04 2022] DELETE /identity/v3/users/41b81a1fe7a245a5bd454b97e7365dfa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:04.640825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192742a9-e8b3-4c94-b8fa-038861d7fb4b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:04.640825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192742a9-e8b3-4c94-b8fa-038861d7fb4b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:04.640825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192742a9-e8b3-4c94-b8fa-038861d7fb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:04.659937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-192742a9-e8b3-4c94-b8fa-038861d7fb4b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:04.661383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-192742a9-e8b3-4c94-b8fa-038861d7fb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:04.724261 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3512/7043] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:04.735116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:04.736509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:04.799500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b69283-bc87-4be2-ba29-c6933397e7d0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:04.803127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6542a54-0852-43cb-900a-be6a77430f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:04.803727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542a54-0852-43cb-900a-be6a77430f41 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:04.804006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542a54-0852-43cb-900a-be6a77430f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:04.804274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542a54-0852-43cb-900a-be6a77430f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:04.814010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6542a54-0852-43cb-900a-be6a77430f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:04.815431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6542a54-0852-43cb-900a-be6a77430f41 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:04.825892 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3532/7044] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:05.315747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192742a9-e8b3-4c94-b8fa-038861d7fb4b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:05.318871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-192742a9-e8b3-4c94-b8fa-038861d7fb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:05.345545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192742a9-e8b3-4c94-b8fa-038861d7fb4b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:05.361280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7936b-be0f-4ced-a941-f169daee5ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:05.362265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7936b-be0f-4ced-a941-f169daee5ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:05.362552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7936b-be0f-4ced-a941-f169daee5ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:05.362828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7936b-be0f-4ced-a941-f169daee5ce9 admin admin] PATH_INFO: `/v3/projects/0ba0c1d321704635930a5017713e75b1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:05.364039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7936b-be0f-4ced-a941-f169daee5ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba0c1d321704635930a5017713e75b1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:05.366952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7936b-be0f-4ced-a941-f169daee5ce9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:05.421325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ebf7936b-be0f-4ced-a941-f169daee5ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba0c1d321704635930a5017713e75b1', 'request_id': 'req-ebf7936b-be0f-4ced-a941-f169daee5ce9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:05.430555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ebf7936b-be0f-4ced-a941-f169daee5ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba0c1d321704635930a5017713e75b1', 'request_id': 'req-ebf7936b-be0f-4ced-a941-f169daee5ce9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:05.437719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ebf7936b-be0f-4ced-a941-f169daee5ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba0c1d321704635930a5017713e75b1', 'request_id': 'req-ebf7936b-be0f-4ced-a941-f169daee5ce9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:05.450680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ebf7936b-be0f-4ced-a941-f169daee5ce9 admin admin] The token cache is being invalidate because project 0ba0c1d321704635930a5017713e75b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:05.450975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ebf7936b-be0f-4ced-a941-f169daee5ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:05.452099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ebf7936b-be0f-4ced-a941-f169daee5ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:05.458874 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3513/7045] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:05 2022] DELETE /identity/v3/projects/0ba0c1d321704635930a5017713e75b1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:05.461223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6c457-92e0-4118-8c7b-108f31cb3b54 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:05.461223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6c457-92e0-4118-8c7b-108f31cb3b54 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:05.461756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6c457-92e0-4118-8c7b-108f31cb3b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:05.484261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9dd6c457-92e0-4118-8c7b-108f31cb3b54 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:05.486362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9dd6c457-92e0-4118-8c7b-108f31cb3b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:05.563980 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3533/7046] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:05.573023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b3779-26ab-4627-bce7-2af325b92061 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:05.573331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b3779-26ab-4627-bce7-2af325b92061 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:05.574297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b3779-26ab-4627-bce7-2af325b92061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:05.597583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8b4b3779-26ab-4627-bce7-2af325b92061 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:05.598714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8b4b3779-26ab-4627-bce7-2af325b92061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:05.607022 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3514/7047] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:05.611259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6c457-92e0-4118-8c7b-108f31cb3b54 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:05.621569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6c457-92e0-4118-8c7b-108f31cb3b54 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:05.626127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befee84-7966-4395-8d69-a7dcba9e5f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:05.626727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befee84-7966-4395-8d69-a7dcba9e5f5d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:05.627002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befee84-7966-4395-8d69-a7dcba9e5f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:05.627279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befee84-7966-4395-8d69-a7dcba9e5f5d admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:05.627918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befee84-7966-4395-8d69-a7dcba9e5f5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:05.628224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befee84-7966-4395-8d69-a7dcba9e5f5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:05.629840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befee84-7966-4395-8d69-a7dcba9e5f5d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:05.645784 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3534/7048] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:05.646845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b3779-26ab-4627-bce7-2af325b92061 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:05.656433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b3779-26ab-4627-bce7-2af325b92061 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:05.661168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a1f7c-5caf-4697-9e45-8410a3e9a35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:05.661801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a1f7c-5caf-4697-9e45-8410a3e9a35d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:05.662079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a1f7c-5caf-4697-9e45-8410a3e9a35d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:05.662352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a1f7c-5caf-4697-9e45-8410a3e9a35d admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:05.662987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a1f7c-5caf-4697-9e45-8410a3e9a35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:05.664973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a1f7c-5caf-4697-9e45-8410a3e9a35d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:05.700900 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3515/7049] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:05 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:05.703020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befee84-7966-4395-8d69-a7dcba9e5f5d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:05.709973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:05.714544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befee84-7966-4395-8d69-a7dcba9e5f5d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:05.780204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52552377-ed57-4359-8f69-3788b4354928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:05.780837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52552377-ed57-4359-8f69-3788b4354928 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:05.781116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52552377-ed57-4359-8f69-3788b4354928 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:05.781436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52552377-ed57-4359-8f69-3788b4354928 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:05.782077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52552377-ed57-4359-8f69-3788b4354928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:05.784005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52552377-ed57-4359-8f69-3788b4354928 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:05.809893 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3535/7050] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:05 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:05.811119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a1f7c-5caf-4697-9e45-8410a3e9a35d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:05.822809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a1f7c-5caf-4697-9e45-8410a3e9a35d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:05.828330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783dc05-5568-4e10-8a11-216761556715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:05.829013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783dc05-5568-4e10-8a11-216761556715 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:05.829385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783dc05-5568-4e10-8a11-216761556715 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:05.829690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783dc05-5568-4e10-8a11-216761556715 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:05.830400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783dc05-5568-4e10-8a11-216761556715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:05.832045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783dc05-5568-4e10-8a11-216761556715 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:05.842269 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3516/7051] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:05.846403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52552377-ed57-4359-8f69-3788b4354928 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:05.857287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52552377-ed57-4359-8f69-3788b4354928 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:05.861950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc875be-e9ca-476d-b4de-c4c6cc877aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:05.862545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc875be-e9ca-476d-b4de-c4c6cc877aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:05.862826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc875be-e9ca-476d-b4de-c4c6cc877aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:05.863119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc875be-e9ca-476d-b4de-c4c6cc877aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:05.863789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc875be-e9ca-476d-b4de-c4c6cc877aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:05.865415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc875be-e9ca-476d-b4de-c4c6cc877aa0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:05.876779 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3536/7052] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:05.880942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783dc05-5568-4e10-8a11-216761556715 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:05.891156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783dc05-5568-4e10-8a11-216761556715 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:05.895766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac3365-ff23-41d5-b2b8-4552766cc146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:05.896415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3365-ff23-41d5-b2b8-4552766cc146 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:05.896694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3365-ff23-41d5-b2b8-4552766cc146 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:05.896969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3365-ff23-41d5-b2b8-4552766cc146 admin admin] PATH_INFO: `/v3/projects/2484b535eadb4f0ab538842b6e9bf71a/users/3de5dd9e77554185b5ae1a3f126474cc/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:05.907976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:05.912316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac3365-ff23-41d5-b2b8-4552766cc146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2484b535eadb4f0ab538842b6e9bf71a, user_id=3de5dd9e77554185b5ae1a3f126474cc, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:05.915187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac3365-ff23-41d5-b2b8-4552766cc146 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:05.928733 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3517/7053] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:05 2022] PUT /identity/v3/projects/2484b535eadb4f0ab538842b6e9bf71a/users/3de5dd9e77554185b5ae1a3f126474cc/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:05.939566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e89dfd-f071-49f8-b58c-f783da333469 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:05.939948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e89dfd-f071-49f8-b58c-f783da333469 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:05.940296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e89dfd-f071-49f8-b58c-f783da333469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:05.968393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-42e89dfd-f071-49f8-b58c-f783da333469 None None] MFA Rules not processed for user `3de5dd9e77554185b5ae1a3f126474cc`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:05.969788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-42e89dfd-f071-49f8-b58c-f783da333469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:06.039394 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3537/7054] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:06.044546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac3365-ff23-41d5-b2b8-4552766cc146 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:06.108613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac3365-ff23-41d5-b2b8-4552766cc146 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:06.113157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3f5c-9d83-47c8-b57f-be85220620e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:06.113788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3f5c-9d83-47c8-b57f-be85220620e1 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:06.114063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3f5c-9d83-47c8-b57f-be85220620e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:06.114334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3f5c-9d83-47c8-b57f-be85220620e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:06.114957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f3f5c-9d83-47c8-b57f-be85220620e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:06.116849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f3f5c-9d83-47c8-b57f-be85220620e1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:06.142660 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3518/7055] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:06 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:06.146891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e89dfd-f071-49f8-b58c-f783da333469 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:06.157963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e89dfd-f071-49f8-b58c-f783da333469 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:06.217545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479ff0b-6c40-4380-91e4-97dd4ded6d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:06.218266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479ff0b-6c40-4380-91e4-97dd4ded6d8f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:06.218554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479ff0b-6c40-4380-91e4-97dd4ded6d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:06.218827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479ff0b-6c40-4380-91e4-97dd4ded6d8f admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:06.219463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479ff0b-6c40-4380-91e4-97dd4ded6d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:06.221398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479ff0b-6c40-4380-91e4-97dd4ded6d8f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:06.248610 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3538/7056] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:06 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:06.250087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3f5c-9d83-47c8-b57f-be85220620e1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:06.261949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3f5c-9d83-47c8-b57f-be85220620e1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:06.267154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433c283-84f1-421d-bc80-83bf7a8822a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:06.267883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433c283-84f1-421d-bc80-83bf7a8822a5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:06.268170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433c283-84f1-421d-bc80-83bf7a8822a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:06.268586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433c283-84f1-421d-bc80-83bf7a8822a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:06.269326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433c283-84f1-421d-bc80-83bf7a8822a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:06.271450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433c283-84f1-421d-bc80-83bf7a8822a5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:06.285256 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3519/7057] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:06.289594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479ff0b-6c40-4380-91e4-97dd4ded6d8f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:06.296354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:06.304350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479ff0b-6c40-4380-91e4-97dd4ded6d8f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:06.312841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893a1b7-c2a1-459f-9d3b-4d19b431e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:06.315276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893a1b7-c2a1-459f-9d3b-4d19b431e689 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:06.315755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893a1b7-c2a1-459f-9d3b-4d19b431e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:06.316158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893a1b7-c2a1-459f-9d3b-4d19b431e689 admin admin] PATH_INFO: `/v3/projects/1e2f3cd56b36408d9edc99d4f85f4b05/users/c1cd153534e447bb924f22f736c3c654/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:06.360322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893a1b7-c2a1-459f-9d3b-4d19b431e689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2f3cd56b36408d9edc99d4f85f4b05, user_id=c1cd153534e447bb924f22f736c3c654, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:06.365569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893a1b7-c2a1-459f-9d3b-4d19b431e689 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:06.387730 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3539/7058] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:06 2022] PUT /identity/v3/projects/1e2f3cd56b36408d9edc99d4f85f4b05/users/c1cd153534e447bb924f22f736c3c654/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:06.391577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433c283-84f1-421d-bc80-83bf7a8822a5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:06.402579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433c283-84f1-421d-bc80-83bf7a8822a5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:06.489163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d966f-88aa-4abc-b23d-affb760c1a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:06.491591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d966f-88aa-4abc-b23d-affb760c1a35 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:06.491776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d966f-88aa-4abc-b23d-affb760c1a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:06.492053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d966f-88aa-4abc-b23d-affb760c1a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:06.492705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d966f-88aa-4abc-b23d-affb760c1a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:06.494461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d966f-88aa-4abc-b23d-affb760c1a35 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:06.514290 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3520/7059] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:06.515861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893a1b7-c2a1-459f-9d3b-4d19b431e689 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:06.528448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893a1b7-c2a1-459f-9d3b-4d19b431e689 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:06.534474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72163d-1b59-4435-9c5d-4752969c02fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:06.535145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72163d-1b59-4435-9c5d-4752969c02fb admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:06.535427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72163d-1b59-4435-9c5d-4752969c02fb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:06.535710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72163d-1b59-4435-9c5d-4752969c02fb admin admin] PATH_INFO: `/v3/projects/1e2f3cd56b36408d9edc99d4f85f4b05/users/c1cd153534e447bb924f22f736c3c654/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:06.540873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72163d-1b59-4435-9c5d-4752969c02fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2f3cd56b36408d9edc99d4f85f4b05, user_id=c1cd153534e447bb924f22f736c3c654, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:06.541239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72163d-1b59-4435-9c5d-4752969c02fb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:06.554941 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3540/7060] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:06 2022] PUT /identity/v3/projects/1e2f3cd56b36408d9edc99d4f85f4b05/users/c1cd153534e447bb924f22f736c3c654/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:06.566092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f73a1-0d58-4c89-b2bb-4cf7785bdb78 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:06.567110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f73a1-0d58-4c89-b2bb-4cf7785bdb78 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:06.567110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f73a1-0d58-4c89-b2bb-4cf7785bdb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:06.616765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ed3f73a1-0d58-4c89-b2bb-4cf7785bdb78 None None] MFA Rules not processed for user `c1cd153534e447bb924f22f736c3c654`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:06.618805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ed3f73a1-0d58-4c89-b2bb-4cf7785bdb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:06.730075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:06.810636 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3521/7061] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:06.814842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72163d-1b59-4435-9c5d-4752969c02fb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:06.831546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72163d-1b59-4435-9c5d-4752969c02fb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:06.842001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb45f06-8ed9-4574-baa4-407f725e322d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:06.844449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb45f06-8ed9-4574-baa4-407f725e322d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:06.844804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb45f06-8ed9-4574-baa4-407f725e322d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:06.845092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb45f06-8ed9-4574-baa4-407f725e322d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:06.845777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb45f06-8ed9-4574-baa4-407f725e322d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:06.849223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb45f06-8ed9-4574-baa4-407f725e322d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:06.880002 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3541/7062] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:06 2022] POST /identity/v3/services => generated 286 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:06.884033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f73a1-0d58-4c89-b2bb-4cf7785bdb78 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:06.894550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f73a1-0d58-4c89-b2bb-4cf7785bdb78 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:06.915349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00563fef-0ae3-4ae3-a4c7-0c21a60a7c2b tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:06.916098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00563fef-0ae3-4ae3-a4c7-0c21a60a7c2b tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:06.917006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00563fef-0ae3-4ae3-a4c7-0c21a60a7c2b tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:06.917006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00563fef-0ae3-4ae3-a4c7-0c21a60a7c2b tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:06.918185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00563fef-0ae3-4ae3-a4c7-0c21a60a7c2b tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:06.919673 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-00563fef-0ae3-4ae3-a4c7-0c21a60a7c2b tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:20:06.919673 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:20:06.919673 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:20:06.920454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00563fef-0ae3-4ae3-a4c7-0c21a60a7c2b tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:06.936800 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3522/7063] 10.222.0.26 () {60 vars in 1213 bytes} [Sat Oct 8 21:20:06 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 331 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:06.942697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb45f06-8ed9-4574-baa4-407f725e322d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:06.956655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb45f06-8ed9-4574-baa4-407f725e322d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:06.963120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96014d-9631-4a02-bed0-80ad57f7da18 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:06.963862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96014d-9631-4a02-bed0-80ad57f7da18 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:06.964802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96014d-9631-4a02-bed0-80ad57f7da18 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:06.965305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96014d-9631-4a02-bed0-80ad57f7da18 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:06.966043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96014d-9631-4a02-bed0-80ad57f7da18 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:06.968337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96014d-9631-4a02-bed0-80ad57f7da18 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:06.987676 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3542/7064] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:06 2022] POST /identity/v3/services => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:06.991798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00563fef-0ae3-4ae3-a4c7-0c21a60a7c2b tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.003607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00563fef-0ae3-4ae3-a4c7-0c21a60a7c2b tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.025808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98224855-5371-4a62-94c2-2a3910c3dc9a tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.026494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98224855-5371-4a62-94c2-2a3910c3dc9a tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.027539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98224855-5371-4a62-94c2-2a3910c3dc9a tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.027980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98224855-5371-4a62-94c2-2a3910c3dc9a tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.028384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98224855-5371-4a62-94c2-2a3910c3dc9a tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.030195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98224855-5371-4a62-94c2-2a3910c3dc9a tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.046698 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3523/7065] 10.222.0.26 () {60 vars in 1213 bytes} [Sat Oct 8 21:20:06 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:07.048032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96014d-9631-4a02-bed0-80ad57f7da18 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.059712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96014d-9631-4a02-bed0-80ad57f7da18 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.065074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64869a-cde0-46a6-b370-e0fe4766548c tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.065845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64869a-cde0-46a6-b370-e0fe4766548c tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.066025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64869a-cde0-46a6-b370-e0fe4766548c tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.066329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64869a-cde0-46a6-b370-e0fe4766548c tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.066984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64869a-cde0-46a6-b370-e0fe4766548c tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.067970 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-ce64869a-cde0-46a6-b370-e0fe4766548c tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:20:07.067970 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:20:07.067970 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:20:07.068878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64869a-cde0-46a6-b370-e0fe4766548c tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.085235 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3543/7066] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Oct 8 21:20:07 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 762 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:07.088927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98224855-5371-4a62-94c2-2a3910c3dc9a tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.101121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98224855-5371-4a62-94c2-2a3910c3dc9a tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.107603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc15ed7-1b3f-4ef2-9ea9-6e0a255ccf94 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.108474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15ed7-1b3f-4ef2-9ea9-6e0a255ccf94 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.108756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15ed7-1b3f-4ef2-9ea9-6e0a255ccf94 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.109032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15ed7-1b3f-4ef2-9ea9-6e0a255ccf94 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/11c8c48cab8649008d21c7845c8c7613` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.109679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc15ed7-1b3f-4ef2-9ea9-6e0a255ccf94 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=11c8c48cab8649008d21c7845c8c7613)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.110674 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-dbc15ed7-1b3f-4ef2-9ea9-6e0a255ccf94 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:20:07.110674 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:20:07.110674 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:20:07.111546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc15ed7-1b3f-4ef2-9ea9-6e0a255ccf94 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.118259 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3524/7067] 10.222.0.26 () {58 vars in 1290 bytes} [Sat Oct 8 21:20:07 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/11c8c48cab8649008d21c7845c8c7613 => generated 333 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:07.122164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64869a-cde0-46a6-b370-e0fe4766548c tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.132611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64869a-cde0-46a6-b370-e0fe4766548c tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.138179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575cf03-125c-4baa-b33f-bcfc0d8ba97d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.138404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575cf03-125c-4baa-b33f-bcfc0d8ba97d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.138682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575cf03-125c-4baa-b33f-bcfc0d8ba97d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.138956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575cf03-125c-4baa-b33f-bcfc0d8ba97d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/11c8c48cab8649008d21c7845c8c7613` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.139665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575cf03-125c-4baa-b33f-bcfc0d8ba97d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=11c8c48cab8649008d21c7845c8c7613)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.140697 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-c575cf03-125c-4baa-b33f-bcfc0d8ba97d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:20:07.140697 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:20:07.140697 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:20:07.141619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575cf03-125c-4baa-b33f-bcfc0d8ba97d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.147482 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3544/7068] 10.222.0.26 () {58 vars in 1291 bytes} [Sat Oct 8 21:20:07 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/11c8c48cab8649008d21c7845c8c7613 => generated 0 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 08 21:20:07.151504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc15ed7-1b3f-4ef2-9ea9-6e0a255ccf94 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.162529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc15ed7-1b3f-4ef2-9ea9-6e0a255ccf94 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.167121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd957368-91f3-4226-8e27-2e3b0cefdc42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.168444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd957368-91f3-4226-8e27-2e3b0cefdc42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.168726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd957368-91f3-4226-8e27-2e3b0cefdc42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.168995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd957368-91f3-4226-8e27-2e3b0cefdc42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/11c8c48cab8649008d21c7845c8c7613` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.169597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd957368-91f3-4226-8e27-2e3b0cefdc42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=11c8c48cab8649008d21c7845c8c7613)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.170588 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-cd957368-91f3-4226-8e27-2e3b0cefdc42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:20:07.170588 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:20:07.170588 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:20:07.171460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd957368-91f3-4226-8e27-2e3b0cefdc42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.182936 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3525/7069] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 8 21:20:07 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/11c8c48cab8649008d21c7845c8c7613 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:07.187183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575cf03-125c-4baa-b33f-bcfc0d8ba97d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.197545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575cf03-125c-4baa-b33f-bcfc0d8ba97d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.202210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4bd35-5135-4964-ae71-995f3372872d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.202801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4bd35-5135-4964-ae71-995f3372872d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.203073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4bd35-5135-4964-ae71-995f3372872d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.203350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4bd35-5135-4964-ae71-995f3372872d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.203954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4bd35-5135-4964-ae71-995f3372872d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.205564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4bd35-5135-4964-ae71-995f3372872d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.210010 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3545/7070] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Oct 8 21:20:07 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 448 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:07.214043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd957368-91f3-4226-8e27-2e3b0cefdc42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.225035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd957368-91f3-4226-8e27-2e3b0cefdc42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.230959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a76557-c758-427d-a21f-0c4490418842 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.231587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a76557-c758-427d-a21f-0c4490418842 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.231978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a76557-c758-427d-a21f-0c4490418842 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.232260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a76557-c758-427d-a21f-0c4490418842 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/11c8c48cab8649008d21c7845c8c7613` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.232837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a76557-c758-427d-a21f-0c4490418842 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=11c8c48cab8649008d21c7845c8c7613)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.234456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a76557-c758-427d-a21f-0c4490418842 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-f6a76557-c758-427d-a21f-0c4490418842 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Could not find Endpoint Group: 11c8c48cab8649008d21c7845c8c7613.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 11c8c48cab8649008d21c7845c8c7613. Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 08 21:20:07.249415 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 08 21:20:07.250474 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 08 21:20:07.250474 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 08 21:20:07.250474 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 08 21:20:07.250474 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 08 21:20:07.250474 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 11c8c48cab8649008d21c7845c8c7613. Oct 08 21:20:07.250474 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:20:07.250474 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3526/7071] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 8 21:20:07 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/11c8c48cab8649008d21c7845c8c7613 => generated 120 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:20:07.254406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4bd35-5135-4964-ae71-995f3372872d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.264446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4bd35-5135-4964-ae71-995f3372872d tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.269062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ad388-f119-45ad-af9e-225b2ca5d668 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.269728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ad388-f119-45ad-af9e-225b2ca5d668 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.270009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ad388-f119-45ad-af9e-225b2ca5d668 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.270280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ad388-f119-45ad-af9e-225b2ca5d668 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/services/78d42f1cbacc4deda51162a1a536da03` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.270855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ad388-f119-45ad-af9e-225b2ca5d668 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:delete_service(service_id=78d42f1cbacc4deda51162a1a536da03)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.272428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ad388-f119-45ad-af9e-225b2ca5d668 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.295736 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3546/7072] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:07 2022] DELETE /identity/v3/services/78d42f1cbacc4deda51162a1a536da03 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:07.300707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a76557-c758-427d-a21f-0c4490418842 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.311646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a76557-c758-427d-a21f-0c4490418842 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.327568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce21fe-b44c-41a6-ac59-a3f8e787efe1 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.328202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce21fe-b44c-41a6-ac59-a3f8e787efe1 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.328492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce21fe-b44c-41a6-ac59-a3f8e787efe1 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.328766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce21fe-b44c-41a6-ac59-a3f8e787efe1 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.329445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce21fe-b44c-41a6-ac59-a3f8e787efe1 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.331027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce21fe-b44c-41a6-ac59-a3f8e787efe1 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.345015 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3527/7073] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:07 2022] POST /identity/v3/services => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:07.349026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ad388-f119-45ad-af9e-225b2ca5d668 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.360102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ad388-f119-45ad-af9e-225b2ca5d668 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.375057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dd6e2-3772-41e6-b725-642f217fbc37 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.375619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dd6e2-3772-41e6-b725-642f217fbc37 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.375894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dd6e2-3772-41e6-b725-642f217fbc37 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.376168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dd6e2-3772-41e6-b725-642f217fbc37 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.376801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dd6e2-3772-41e6-b725-642f217fbc37 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.377829 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-665dd6e2-3772-41e6-b725-642f217fbc37 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:20:07.377829 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:20:07.377829 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:20:07.378757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dd6e2-3772-41e6-b725-642f217fbc37 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.391724 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3547/7074] 10.222.0.26 () {60 vars in 1213 bytes} [Sat Oct 8 21:20:07 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:07.393028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce21fe-b44c-41a6-ac59-a3f8e787efe1 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.404038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce21fe-b44c-41a6-ac59-a3f8e787efe1 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.408938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03dc558-cf8b-4b07-b65e-606b5b226c85 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.409568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dc558-cf8b-4b07-b65e-606b5b226c85 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.409846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dc558-cf8b-4b07-b65e-606b5b226c85 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.410766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dc558-cf8b-4b07-b65e-606b5b226c85 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/services` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.411435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03dc558-cf8b-4b07-b65e-606b5b226c85 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.412992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03dc558-cf8b-4b07-b65e-606b5b226c85 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.431320 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3528/7075] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:07 2022] POST /identity/v3/services => generated 289 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:07.435657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dd6e2-3772-41e6-b725-642f217fbc37 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.445593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dd6e2-3772-41e6-b725-642f217fbc37 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.461059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf603c-daaf-4be4-893b-cace7b86e24f tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.461738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf603c-daaf-4be4-893b-cace7b86e24f tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.462015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf603c-daaf-4be4-893b-cace7b86e24f tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.462288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf603c-daaf-4be4-893b-cace7b86e24f tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8cb2854fa2f24548a44d8bc7cb4a4356` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.463490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf603c-daaf-4be4-893b-cace7b86e24f tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=8cb2854fa2f24548a44d8bc7cb4a4356)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.463950 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-6dcf603c-daaf-4be4-893b-cace7b86e24f tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:20:07.463950 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:20:07.463950 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:20:07.464867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf603c-daaf-4be4-893b-cace7b86e24f tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.479399 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3548/7076] 10.222.0.26 () {60 vars in 1313 bytes} [Sat Oct 8 21:20:07 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/8cb2854fa2f24548a44d8bc7cb4a4356 => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:07.483869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03dc558-cf8b-4b07-b65e-606b5b226c85 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.494665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03dc558-cf8b-4b07-b65e-606b5b226c85 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.500059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4354e-a84f-492c-8350-c454809194e8 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.500696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4354e-a84f-492c-8350-c454809194e8 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.500982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4354e-a84f-492c-8350-c454809194e8 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.501299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4354e-a84f-492c-8350-c454809194e8 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/services/59a9c3d7a4df47d98f402cc66e718114` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.501884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4354e-a84f-492c-8350-c454809194e8 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:delete_service(service_id=59a9c3d7a4df47d98f402cc66e718114)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.503456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4354e-a84f-492c-8350-c454809194e8 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.529833 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3529/7077] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:07 2022] DELETE /identity/v3/services/59a9c3d7a4df47d98f402cc66e718114 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:07.534058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf603c-daaf-4be4-893b-cace7b86e24f tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.545090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf603c-daaf-4be4-893b-cace7b86e24f tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.560879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626a9aa-40e1-4372-af90-c9573f175b42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.561546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626a9aa-40e1-4372-af90-c9573f175b42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.561860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626a9aa-40e1-4372-af90-c9573f175b42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.562137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626a9aa-40e1-4372-af90-c9573f175b42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8cb2854fa2f24548a44d8bc7cb4a4356` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.562763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626a9aa-40e1-4372-af90-c9573f175b42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=8cb2854fa2f24548a44d8bc7cb4a4356)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.563795 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-a626a9aa-40e1-4372-af90-c9573f175b42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:20:07.563795 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:20:07.563795 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:20:07.564681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626a9aa-40e1-4372-af90-c9573f175b42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.574336 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3549/7078] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 8 21:20:07 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/8cb2854fa2f24548a44d8bc7cb4a4356 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:07.579127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4354e-a84f-492c-8350-c454809194e8 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.592122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4354e-a84f-492c-8350-c454809194e8 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.596946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b0d87-3271-4e2d-a23c-37067f0b857e tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.597601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b0d87-3271-4e2d-a23c-37067f0b857e tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.597887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b0d87-3271-4e2d-a23c-37067f0b857e tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.598164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b0d87-3271-4e2d-a23c-37067f0b857e tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/services/fd8bac5b3a574633b7c1db7e5c7b7274` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.598743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b0d87-3271-4e2d-a23c-37067f0b857e tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fd8bac5b3a574633b7c1db7e5c7b7274)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.600325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b0d87-3271-4e2d-a23c-37067f0b857e tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.622040 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3530/7079] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:07 2022] DELETE /identity/v3/services/fd8bac5b3a574633b7c1db7e5c7b7274 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:07.628431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626a9aa-40e1-4372-af90-c9573f175b42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.638419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626a9aa-40e1-4372-af90-c9573f175b42 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.652775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53513c77-c38f-4c9f-aae6-53e902541c21 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.653428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53513c77-c38f-4c9f-aae6-53e902541c21 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.653723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53513c77-c38f-4c9f-aae6-53e902541c21 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.653985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53513c77-c38f-4c9f-aae6-53e902541c21 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/875019cfc7984aa7a6faa42c9c113ca1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.654559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53513c77-c38f-4c9f-aae6-53e902541c21 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=875019cfc7984aa7a6faa42c9c113ca1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.656175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53513c77-c38f-4c9f-aae6-53e902541c21 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.665291 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3550/7080] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 8 21:20:07 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/875019cfc7984aa7a6faa42c9c113ca1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:07.669716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b0d87-3271-4e2d-a23c-37067f0b857e tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.680733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b0d87-3271-4e2d-a23c-37067f0b857e tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.686279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5accb7-5ab9-4849-ab9e-faca8422ae78 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1cd153534e447bb924f22f736c3c654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e2f3cd56b36408d9edc99d4f85f4b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.686926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5accb7-5ab9-4849-ab9e-faca8422ae78 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.687212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5accb7-5ab9-4849-ab9e-faca8422ae78 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.687489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5accb7-5ab9-4849-ab9e-faca8422ae78 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] PATH_INFO: `/v3/services/cfcda962723a45adaa9c83f10d9293a0` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.688073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5accb7-5ab9-4849-ab9e-faca8422ae78 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorizing `identity:delete_service(service_id=cfcda962723a45adaa9c83f10d9293a0)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.689709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5accb7-5ab9-4849-ab9e-faca8422ae78 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.710353 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3531/7081] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:07 2022] DELETE /identity/v3/services/cfcda962723a45adaa9c83f10d9293a0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:07.714930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53513c77-c38f-4c9f-aae6-53e902541c21 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:07.745015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:07.788710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53513c77-c38f-4c9f-aae6-53e902541c21 tempest-EndPointGroupsTest-2013037091 tempest-EndPointGroupsTest-2013037091-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:07.803540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:07.804166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.804435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.804693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] PATH_INFO: `/v3/users/3de5dd9e77554185b5ae1a3f126474cc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.805887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de5dd9e77554185b5ae1a3f126474cc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:07.807811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:07.863553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de5dd9e77554185b5ae1a3f126474cc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:07.871515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de5dd9e77554185b5ae1a3f126474cc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:07.872250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de5dd9e77554185b5ae1a3f126474cc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:07.872884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de5dd9e77554185b5ae1a3f126474cc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:07.888337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de5dd9e77554185b5ae1a3f126474cc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:07.905224 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3551/7082] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:07 2022] DELETE /identity/v3/users/3de5dd9e77554185b5ae1a3f126474cc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:07.909594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0de016-b184-44b8-8e4a-cd47559a7890 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:07.910057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0de016-b184-44b8-8e4a-cd47559a7890 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:07.910185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0de016-b184-44b8-8e4a-cd47559a7890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:07.937605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8e0de016-b184-44b8-8e4a-cd47559a7890 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:07.938854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8e0de016-b184-44b8-8e4a-cd47559a7890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:07.966001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:08.146577 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3532/7083] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:08.156461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:08.157940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:08.227597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2bdc5-c5c8-425c-814a-2b99bd280758 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:08.232791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804ffe1-5e9a-4e99-bf6b-1848e67687c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:08.233194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ffe1-5e9a-4e99-bf6b-1848e67687c4 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:08.233774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ffe1-5e9a-4e99-bf6b-1848e67687c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:08.233774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ffe1-5e9a-4e99-bf6b-1848e67687c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:08.243417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804ffe1-5e9a-4e99-bf6b-1848e67687c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:08.244859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804ffe1-5e9a-4e99-bf6b-1848e67687c4 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:08.255832 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3552/7084] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:20:08.554152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0de016-b184-44b8-8e4a-cd47559a7890 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:08.555587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8e0de016-b184-44b8-8e4a-cd47559a7890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:08.568989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0de016-b184-44b8-8e4a-cd47559a7890 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:08.575661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:08.576698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:08.577032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:08.577412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] PATH_INFO: `/v3/projects/2484b535eadb4f0ab538842b6e9bf71a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:08.579011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2484b535eadb4f0ab538842b6e9bf71a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:08.581352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:08.643178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2484b535eadb4f0ab538842b6e9bf71a', 'request_id': 'req-131a72c8-923c-417b-85d6-b5afd154d25a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:08.654065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2484b535eadb4f0ab538842b6e9bf71a', 'request_id': 'req-131a72c8-923c-417b-85d6-b5afd154d25a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:08.660467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2484b535eadb4f0ab538842b6e9bf71a', 'request_id': 'req-131a72c8-923c-417b-85d6-b5afd154d25a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:08.673409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] The token cache is being invalidate because project 2484b535eadb4f0ab538842b6e9bf71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:08.673696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:08.674357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:08.675813 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3533/7085] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:08 2022] DELETE /identity/v3/projects/2484b535eadb4f0ab538842b6e9bf71a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:08.680145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804ffe1-5e9a-4e99-bf6b-1848e67687c4 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:08.689950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804ffe1-5e9a-4e99-bf6b-1848e67687c4 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:08.709804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:08.754303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bc972-a305-44d3-a117-ce8995a812d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:08.754929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bc972-a305-44d3-a117-ce8995a812d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:08.755209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bc972-a305-44d3-a117-ce8995a812d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:08.755498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bc972-a305-44d3-a117-ce8995a812d1 admin admin] PATH_INFO: `/v3/users/c1cd153534e447bb924f22f736c3c654` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:08.756601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bc972-a305-44d3-a117-ce8995a812d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1cd153534e447bb924f22f736c3c654)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:08.758538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bc972-a305-44d3-a117-ce8995a812d1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:08.804192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-317bc972-a305-44d3-a117-ce8995a812d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1cd153534e447bb924f22f736c3c654'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:08.810960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-317bc972-a305-44d3-a117-ce8995a812d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1cd153534e447bb924f22f736c3c654'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:08.811607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-317bc972-a305-44d3-a117-ce8995a812d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1cd153534e447bb924f22f736c3c654'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:08.812210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-317bc972-a305-44d3-a117-ce8995a812d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1cd153534e447bb924f22f736c3c654'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:08.824151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-317bc972-a305-44d3-a117-ce8995a812d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1cd153534e447bb924f22f736c3c654'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:08.836448 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3553/7086] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:08 2022] DELETE /identity/v3/users/c1cd153534e447bb924f22f736c3c654 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:09.144194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:09.145687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:09.159772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a72c8-923c-417b-85d6-b5afd154d25a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:09.247651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc7873-a928-4057-ab85-6d46c62ff440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:09.248444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc7873-a928-4057-ab85-6d46c62ff440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:09.248821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc7873-a928-4057-ab85-6d46c62ff440 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:09.249214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc7873-a928-4057-ab85-6d46c62ff440 admin admin] PATH_INFO: `/v3/projects/1e2f3cd56b36408d9edc99d4f85f4b05` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:09.253292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc7873-a928-4057-ab85-6d46c62ff440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2f3cd56b36408d9edc99d4f85f4b05)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:09.256650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc7873-a928-4057-ab85-6d46c62ff440 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:09.339472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fedc7873-a928-4057-ab85-6d46c62ff440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2f3cd56b36408d9edc99d4f85f4b05', 'request_id': 'req-fedc7873-a928-4057-ab85-6d46c62ff440'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:09.348471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fedc7873-a928-4057-ab85-6d46c62ff440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2f3cd56b36408d9edc99d4f85f4b05', 'request_id': 'req-fedc7873-a928-4057-ab85-6d46c62ff440'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:09.350412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:09.358787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fedc7873-a928-4057-ab85-6d46c62ff440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2f3cd56b36408d9edc99d4f85f4b05', 'request_id': 'req-fedc7873-a928-4057-ab85-6d46c62ff440'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:09.374128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fedc7873-a928-4057-ab85-6d46c62ff440 admin admin] The token cache is being invalidate because project 1e2f3cd56b36408d9edc99d4f85f4b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:09.374768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fedc7873-a928-4057-ab85-6d46c62ff440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:09.376029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fedc7873-a928-4057-ab85-6d46c62ff440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:09.377969 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3534/7087] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:09 2022] DELETE /identity/v3/projects/1e2f3cd56b36408d9edc99d4f85f4b05 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:09.383621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24f27b-7b8f-499c-8831-4c486fc6184c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:09.384100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24f27b-7b8f-499c-8831-4c486fc6184c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:09.384472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24f27b-7b8f-499c-8831-4c486fc6184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:09.407700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8e24f27b-7b8f-499c-8831-4c486fc6184c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:09.409176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8e24f27b-7b8f-499c-8831-4c486fc6184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:09.482889 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3554/7088] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:09.575847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3c739-5b2f-4c58-abce-cdeb5bf82ea2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:09.576555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3c739-5b2f-4c58-abce-cdeb5bf82ea2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:09.576947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3c739-5b2f-4c58-abce-cdeb5bf82ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:09.599596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-20e3c739-5b2f-4c58-abce-cdeb5bf82ea2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:09.600798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-20e3c739-5b2f-4c58-abce-cdeb5bf82ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:09.612351 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3535/7089] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:09.617227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24f27b-7b8f-499c-8831-4c486fc6184c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:09.631555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24f27b-7b8f-499c-8831-4c486fc6184c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:09.637481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a04ad6-dacc-44ca-97fb-0af413b4b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:09.638093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a04ad6-dacc-44ca-97fb-0af413b4b9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:09.638371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a04ad6-dacc-44ca-97fb-0af413b4b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:09.638642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a04ad6-dacc-44ca-97fb-0af413b4b9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:09.639323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a04ad6-dacc-44ca-97fb-0af413b4b9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:09.639626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a04ad6-dacc-44ca-97fb-0af413b4b9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:09.641453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a04ad6-dacc-44ca-97fb-0af413b4b9f1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:09.658929 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3555/7090] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:09.660425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3c739-5b2f-4c58-abce-cdeb5bf82ea2 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:09.672884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3c739-5b2f-4c58-abce-cdeb5bf82ea2 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:09.682226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c94776-e6ac-4618-b1f2-8132cf37b7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:09.683323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c94776-e6ac-4618-b1f2-8132cf37b7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:09.683826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c94776-e6ac-4618-b1f2-8132cf37b7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:09.684158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c94776-e6ac-4618-b1f2-8132cf37b7b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:09.685626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c94776-e6ac-4618-b1f2-8132cf37b7b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:09.688655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c94776-e6ac-4618-b1f2-8132cf37b7b8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:09.723820 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3536/7091] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:09 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:09.728078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a04ad6-dacc-44ca-97fb-0af413b4b9f1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:09.741998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a04ad6-dacc-44ca-97fb-0af413b4b9f1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:09.780258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:09.835186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbf854-b02b-40fb-9d56-4b04d346e5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:09.835965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbf854-b02b-40fb-9d56-4b04d346e5cb admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:09.836314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbf854-b02b-40fb-9d56-4b04d346e5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:09.836808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbf854-b02b-40fb-9d56-4b04d346e5cb admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:09.837577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbf854-b02b-40fb-9d56-4b04d346e5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:09.840554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbf854-b02b-40fb-9d56-4b04d346e5cb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:09.865249 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3556/7092] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:09 2022] POST /identity/v3/users => generated 284 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:09.867712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c94776-e6ac-4618-b1f2-8132cf37b7b8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:09.889646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c94776-e6ac-4618-b1f2-8132cf37b7b8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:09.894870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c185d7e-df72-43b5-995a-46d11d5905b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:09.895474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c185d7e-df72-43b5-995a-46d11d5905b2 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:09.895748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c185d7e-df72-43b5-995a-46d11d5905b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:09.896203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c185d7e-df72-43b5-995a-46d11d5905b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:09.896652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c185d7e-df72-43b5-995a-46d11d5905b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:09.898244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c185d7e-df72-43b5-995a-46d11d5905b2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:09.910245 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3537/7093] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:09.914622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbf854-b02b-40fb-9d56-4b04d346e5cb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:09.924804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbf854-b02b-40fb-9d56-4b04d346e5cb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:09.929530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ebc44-40a7-465e-ab7a-a3f542186a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:09.930125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ebc44-40a7-465e-ab7a-a3f542186a26 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:09.930404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ebc44-40a7-465e-ab7a-a3f542186a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:09.930676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ebc44-40a7-465e-ab7a-a3f542186a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:09.931314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ebc44-40a7-465e-ab7a-a3f542186a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:09.932924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ebc44-40a7-465e-ab7a-a3f542186a26 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:09.942897 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3557/7094] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:09.947026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c185d7e-df72-43b5-995a-46d11d5905b2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:09.958158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c185d7e-df72-43b5-995a-46d11d5905b2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:09.962648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25300fe-51d6-481b-a5c9-8d26f9790b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:09.963298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25300fe-51d6-481b-a5c9-8d26f9790b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:09.963573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25300fe-51d6-481b-a5c9-8d26f9790b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:09.963841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25300fe-51d6-481b-a5c9-8d26f9790b22 admin admin] PATH_INFO: `/v3/projects/c0cf43baaa7d425e912989d8eebaed1f/users/acc7212219b04e279b326ae0dbf5f2db/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:09.979430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25300fe-51d6-481b-a5c9-8d26f9790b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cf43baaa7d425e912989d8eebaed1f, user_id=acc7212219b04e279b326ae0dbf5f2db, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:09.982262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25300fe-51d6-481b-a5c9-8d26f9790b22 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:09.994939 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3538/7095] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:09 2022] PUT /identity/v3/projects/c0cf43baaa7d425e912989d8eebaed1f/users/acc7212219b04e279b326ae0dbf5f2db/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:10.005325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b8a23-826a-405e-ae78-875e994fc681 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.005682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b8a23-826a-405e-ae78-875e994fc681 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.005986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b8a23-826a-405e-ae78-875e994fc681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.034028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6c3b8a23-826a-405e-ae78-875e994fc681 None None] MFA Rules not processed for user `acc7212219b04e279b326ae0dbf5f2db`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:10.035279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6c3b8a23-826a-405e-ae78-875e994fc681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:10.097859 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3558/7096] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:10.102417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25300fe-51d6-481b-a5c9-8d26f9790b22 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:10.165288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25300fe-51d6-481b-a5c9-8d26f9790b22 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:10.170045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424555c-9d1e-4d43-892f-15bc70e60d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:10.170647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424555c-9d1e-4d43-892f-15bc70e60d13 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.170925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424555c-9d1e-4d43-892f-15bc70e60d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.171195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424555c-9d1e-4d43-892f-15bc70e60d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.171845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424555c-9d1e-4d43-892f-15bc70e60d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:10.173750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424555c-9d1e-4d43-892f-15bc70e60d13 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:10.200279 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3539/7097] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:10 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:10.204406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b8a23-826a-405e-ae78-875e994fc681 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:10.215224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b8a23-826a-405e-ae78-875e994fc681 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:10.274824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40550dc0-cedd-4c3f-af5c-5259fefe9f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:10.275347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40550dc0-cedd-4c3f-af5c-5259fefe9f56 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.275627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40550dc0-cedd-4c3f-af5c-5259fefe9f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.275901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40550dc0-cedd-4c3f-af5c-5259fefe9f56 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.276641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40550dc0-cedd-4c3f-af5c-5259fefe9f56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:10.278625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40550dc0-cedd-4c3f-af5c-5259fefe9f56 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:10.302926 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3559/7098] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:10 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:10.304429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424555c-9d1e-4d43-892f-15bc70e60d13 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:10.317452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424555c-9d1e-4d43-892f-15bc70e60d13 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:10.322048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4e3a6-5ce6-4024-9bcf-af435a4fc25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:10.322651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4e3a6-5ce6-4024-9bcf-af435a4fc25b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.322925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4e3a6-5ce6-4024-9bcf-af435a4fc25b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.323193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4e3a6-5ce6-4024-9bcf-af435a4fc25b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.324852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4e3a6-5ce6-4024-9bcf-af435a4fc25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:10.326066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4e3a6-5ce6-4024-9bcf-af435a4fc25b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:10.336224 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3540/7099] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:10.340434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40550dc0-cedd-4c3f-af5c-5259fefe9f56 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:10.350592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40550dc0-cedd-4c3f-af5c-5259fefe9f56 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:10.356119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06268fe7-51d4-4cc9-95c8-7fbc40e9ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:10.356771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06268fe7-51d4-4cc9-95c8-7fbc40e9ed9f admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.357044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06268fe7-51d4-4cc9-95c8-7fbc40e9ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.357351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06268fe7-51d4-4cc9-95c8-7fbc40e9ed9f admin admin] PATH_INFO: `/v3/projects/e310a39896324e66bebcd7803ac3d01c/users/5788b75346d546eea0ff324a7fc6c0d4/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.374303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06268fe7-51d4-4cc9-95c8-7fbc40e9ed9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e310a39896324e66bebcd7803ac3d01c, user_id=5788b75346d546eea0ff324a7fc6c0d4, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:10.376881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06268fe7-51d4-4cc9-95c8-7fbc40e9ed9f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:10.398408 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3560/7100] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:10 2022] PUT /identity/v3/projects/e310a39896324e66bebcd7803ac3d01c/users/5788b75346d546eea0ff324a7fc6c0d4/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:10.402415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4e3a6-5ce6-4024-9bcf-af435a4fc25b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:10.416567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4e3a6-5ce6-4024-9bcf-af435a4fc25b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:10.488073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:10.503489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7e4bc-47f9-4dd9-8e3a-48e04d4c3fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:10.505322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e4bc-47f9-4dd9-8e3a-48e04d4c3fad admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.506016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e4bc-47f9-4dd9-8e3a-48e04d4c3fad admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.506435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e4bc-47f9-4dd9-8e3a-48e04d4c3fad admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.507842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7e4bc-47f9-4dd9-8e3a-48e04d4c3fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:10.510133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7e4bc-47f9-4dd9-8e3a-48e04d4c3fad admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:10.534234 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3541/7101] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:10.535033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06268fe7-51d4-4cc9-95c8-7fbc40e9ed9f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:10.542131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:10.548700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7e4bc-47f9-4dd9-8e3a-48e04d4c3fad admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:10.552007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2fa7e4bc-47f9-4dd9-8e3a-48e04d4c3fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:10.554051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06268fe7-51d4-4cc9-95c8-7fbc40e9ed9f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:10.560735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a74b2-8546-4762-a4cb-feda52272f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:10.562203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a74b2-8546-4762-a4cb-feda52272f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.562203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a74b2-8546-4762-a4cb-feda52272f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.562203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a74b2-8546-4762-a4cb-feda52272f7c admin admin] PATH_INFO: `/v3/projects/e310a39896324e66bebcd7803ac3d01c/users/5788b75346d546eea0ff324a7fc6c0d4/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.565163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a74b2-8546-4762-a4cb-feda52272f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e310a39896324e66bebcd7803ac3d01c, user_id=5788b75346d546eea0ff324a7fc6c0d4, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:10.565595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7e4bc-47f9-4dd9-8e3a-48e04d4c3fad admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:10.568417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a74b2-8546-4762-a4cb-feda52272f7c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:10.570600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981170b4-caae-4c23-8917-95d5b5057323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:10.571306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981170b4-caae-4c23-8917-95d5b5057323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.571668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981170b4-caae-4c23-8917-95d5b5057323 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.572107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981170b4-caae-4c23-8917-95d5b5057323 admin admin] PATH_INFO: `/v3/users/178eda00ec4d4658be24753e493891c4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.573222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981170b4-caae-4c23-8917-95d5b5057323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=178eda00ec4d4658be24753e493891c4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:10.575732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981170b4-caae-4c23-8917-95d5b5057323 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:10.583400 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3561/7102] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:10 2022] PUT /identity/v3/projects/e310a39896324e66bebcd7803ac3d01c/users/5788b75346d546eea0ff324a7fc6c0d4/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:10.595018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4baa-320b-4a7e-b4ff-abfe7ef5ebe2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.595298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4baa-320b-4a7e-b4ff-abfe7ef5ebe2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.595569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4baa-320b-4a7e-b4ff-abfe7ef5ebe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.626880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6cec4baa-320b-4a7e-b4ff-abfe7ef5ebe2 None None] MFA Rules not processed for user `5788b75346d546eea0ff324a7fc6c0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:10.628328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6cec4baa-320b-4a7e-b4ff-abfe7ef5ebe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:10.650889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-981170b4-caae-4c23-8917-95d5b5057323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '178eda00ec4d4658be24753e493891c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:10.661424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-981170b4-caae-4c23-8917-95d5b5057323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '178eda00ec4d4658be24753e493891c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:10.662430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-981170b4-caae-4c23-8917-95d5b5057323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '178eda00ec4d4658be24753e493891c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:10.663218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-981170b4-caae-4c23-8917-95d5b5057323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '178eda00ec4d4658be24753e493891c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:10.680795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-981170b4-caae-4c23-8917-95d5b5057323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '178eda00ec4d4658be24753e493891c4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:10.696319 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3542/7103] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:10 2022] DELETE /identity/v3/users/178eda00ec4d4658be24753e493891c4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:10.706981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2181-6cf2-47b0-a800-b7b5a84bda27 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.707318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2181-6cf2-47b0-a800-b7b5a84bda27 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.707595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2181-6cf2-47b0-a800-b7b5a84bda27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.720407 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3562/7104] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:10.725420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4baa-320b-4a7e-b4ff-abfe7ef5ebe2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:10.727497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-445e2181-6cf2-47b0-a800-b7b5a84bda27 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:10.728948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-445e2181-6cf2-47b0-a800-b7b5a84bda27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:10.734516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4baa-320b-4a7e-b4ff-abfe7ef5ebe2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:10.789921 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3543/7105] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:10.794463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54657c6b-c577-4f41-8bec-b157f3ef1e1c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:10.795074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54657c6b-c577-4f41-8bec-b157f3ef1e1c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.795354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54657c6b-c577-4f41-8bec-b157f3ef1e1c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.795628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54657c6b-c577-4f41-8bec-b157f3ef1e1c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.796274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54657c6b-c577-4f41-8bec-b157f3ef1e1c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:10.798150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54657c6b-c577-4f41-8bec-b157f3ef1e1c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:10.799470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e2181-6cf2-47b0-a800-b7b5a84bda27 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:10.800793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-445e2181-6cf2-47b0-a800-b7b5a84bda27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:10.830661 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3563/7106] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:10 2022] POST /identity/v3/projects => generated 360 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:10.834790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54657c6b-c577-4f41-8bec-b157f3ef1e1c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:10.862403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e2181-6cf2-47b0-a800-b7b5a84bda27 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:10.880517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:10.898875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54657c6b-c577-4f41-8bec-b157f3ef1e1c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:10.903986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106b5c8-251f-4986-b08f-df4b86bebe60 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:10.904585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106b5c8-251f-4986-b08f-df4b86bebe60 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.904875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106b5c8-251f-4986-b08f-df4b86bebe60 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.905144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106b5c8-251f-4986-b08f-df4b86bebe60 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.905797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106b5c8-251f-4986-b08f-df4b86bebe60 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:10.907843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106b5c8-251f-4986-b08f-df4b86bebe60 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:10.915918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48ec68-f538-488b-bc79-7c8ff5a203cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:10.916600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48ec68-f538-488b-bc79-7c8ff5a203cb service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.916882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48ec68-f538-488b-bc79-7c8ff5a203cb service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.917330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:10.917475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48ec68-f538-488b-bc79-7c8ff5a203cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.939041 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3564/7107] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:10 2022] POST /identity/v3/users => generated 416 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:10.942925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106b5c8-251f-4986-b08f-df4b86bebe60 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:10.953210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106b5c8-251f-4986-b08f-df4b86bebe60 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:10.957781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731f920-bca8-4d83-82e1-8d885d3d5cf6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:10.958383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731f920-bca8-4d83-82e1-8d885d3d5cf6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:10.958662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731f920-bca8-4d83-82e1-8d885d3d5cf6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:10.958935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731f920-bca8-4d83-82e1-8d885d3d5cf6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/users/18becd75ac964c7ea6e98bb7edef3cff` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:10.972886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731f920-bca8-4d83-82e1-8d885d3d5cf6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:get_user(user_id=18becd75ac964c7ea6e98bb7edef3cff)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:10.976062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731f920-bca8-4d83-82e1-8d885d3d5cf6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:10.978764 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3565/7108] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:20:10 2022] GET /identity/v3/users/18becd75ac964c7ea6e98bb7edef3cff => generated 416 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:10.982908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48ec68-f538-488b-bc79-7c8ff5a203cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:10.983060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731f920-bca8-4d83-82e1-8d885d3d5cf6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:10.984682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48ec68-f538-488b-bc79-7c8ff5a203cb service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:10.993984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731f920-bca8-4d83-82e1-8d885d3d5cf6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:10.995900 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3544/7109] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:20:10.999815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:11.000552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:11.000904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:11.001282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/users/18becd75ac964c7ea6e98bb7edef3cff` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:11.002515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_user(user_id=18becd75ac964c7ea6e98bb7edef3cff)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:11.004559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:11.060494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18becd75ac964c7ea6e98bb7edef3cff'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.070835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18becd75ac964c7ea6e98bb7edef3cff'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.072536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18becd75ac964c7ea6e98bb7edef3cff'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.073417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18becd75ac964c7ea6e98bb7edef3cff'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.088261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18becd75ac964c7ea6e98bb7edef3cff'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.116326 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3566/7110] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:10 2022] DELETE /identity/v3/users/18becd75ac964c7ea6e98bb7edef3cff => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:11.117596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48ec68-f538-488b-bc79-7c8ff5a203cb service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:11.130813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48ec68-f538-488b-bc79-7c8ff5a203cb service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:11.196637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:11.197421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:11.197656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:11.197929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/45555871715648fca81d203a9b915574` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:11.200665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=45555871715648fca81d203a9b915574)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:11.202640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:11.260448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45555871715648fca81d203a9b915574', 'request_id': 'req-8b191388-b83c-4a06-9d55-39f9baeccc6e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.270598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45555871715648fca81d203a9b915574', 'request_id': 'req-8b191388-b83c-4a06-9d55-39f9baeccc6e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.278285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45555871715648fca81d203a9b915574', 'request_id': 'req-8b191388-b83c-4a06-9d55-39f9baeccc6e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.289069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:11.298792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project 45555871715648fca81d203a9b915574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:11.299115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.300240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.305970 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3545/7111] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:11 2022] DELETE /identity/v3/projects/45555871715648fca81d203a9b915574 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:11.307501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:11.309390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:11.316691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:11.318574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:11.333347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b1fd5-233d-468f-924d-a999c24a4b5a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:11.399805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1936552-136b-4f07-89aa-3e07783fa22d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:11.400559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1936552-136b-4f07-89aa-3e07783fa22d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:11.401147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1936552-136b-4f07-89aa-3e07783fa22d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:11.401439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1936552-136b-4f07-89aa-3e07783fa22d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:11.402461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1936552-136b-4f07-89aa-3e07783fa22d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:11.404515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1936552-136b-4f07-89aa-3e07783fa22d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:11.409769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191388-b83c-4a06-9d55-39f9baeccc6e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:11.414768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:11.415480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:11.416065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:11.416404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] PATH_INFO: `/v3/projects/1038cf24a4d14f5aaf42fc18b1d15569` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:11.418314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1038cf24a4d14f5aaf42fc18b1d15569)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:11.420491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:11.446504 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3567/7112] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:11 2022] POST /identity/v3/projects => generated 348 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:11.447531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1936552-136b-4f07-89aa-3e07783fa22d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:11.449368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e1936552-136b-4f07-89aa-3e07783fa22d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:11.488857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1038cf24a4d14f5aaf42fc18b1d15569', 'request_id': 'req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.498962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1038cf24a4d14f5aaf42fc18b1d15569', 'request_id': 'req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.505686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1038cf24a4d14f5aaf42fc18b1d15569', 'request_id': 'req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.519424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] The token cache is being invalidate because project 1038cf24a4d14f5aaf42fc18b1d15569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:11.519716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.520414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.522073 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3546/7113] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:11 2022] DELETE /identity/v3/projects/1038cf24a4d14f5aaf42fc18b1d15569 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:11.525946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:11.526384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:11.528931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:11.566934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1936552-136b-4f07-89aa-3e07783fa22d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:11.615682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb50aa-be08-42d8-9a74-fd1c9d36539a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:11.622194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e0bc0-5a9a-4a7b-8c68-5ce02aa50f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:11.622835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e0bc0-5a9a-4a7b-8c68-5ce02aa50f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:11.623186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e0bc0-5a9a-4a7b-8c68-5ce02aa50f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:11.623372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e0bc0-5a9a-4a7b-8c68-5ce02aa50f60 admin admin] PATH_INFO: `/v3/users/b70445b61eaa42389108d4a378c267d5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:11.624585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e0bc0-5a9a-4a7b-8c68-5ce02aa50f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70445b61eaa42389108d4a378c267d5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:11.626645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e0bc0-5a9a-4a7b-8c68-5ce02aa50f60 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:11.634257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45b5c6-b608-4329-bb5b-324caa665bff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:11.634872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45b5c6-b608-4329-bb5b-324caa665bff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:11.635152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45b5c6-b608-4329-bb5b-324caa665bff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:11.635425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45b5c6-b608-4329-bb5b-324caa665bff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:11.636117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45b5c6-b608-4329-bb5b-324caa665bff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:11.636417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45b5c6-b608-4329-bb5b-324caa665bff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:11.638289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45b5c6-b608-4329-bb5b-324caa665bff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:11.656761 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3568/7114] 10.222.0.26 () {58 vars in 1160 bytes} [Sat Oct 8 21:20:11 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:11.661154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45b5c6-b608-4329-bb5b-324caa665bff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:11.662856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:11.663036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ba45b5c6-b608-4329-bb5b-324caa665bff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:11.676886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45b5c6-b608-4329-bb5b-324caa665bff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:11.678355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f6e0bc0-5a9a-4a7b-8c68-5ce02aa50f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70445b61eaa42389108d4a378c267d5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.681530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f6e12-7b4d-4a46-b112-2240083abe8f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:11.682118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f6e12-7b4d-4a46-b112-2240083abe8f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:11.682396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f6e12-7b4d-4a46-b112-2240083abe8f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:11.682665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f6e12-7b4d-4a46-b112-2240083abe8f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:11.683298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f6e12-7b4d-4a46-b112-2240083abe8f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:11.684865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f6e12-7b4d-4a46-b112-2240083abe8f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:11.685671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f6e0bc0-5a9a-4a7b-8c68-5ce02aa50f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70445b61eaa42389108d4a378c267d5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.686556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f6e0bc0-5a9a-4a7b-8c68-5ce02aa50f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70445b61eaa42389108d4a378c267d5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.687392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f6e0bc0-5a9a-4a7b-8c68-5ce02aa50f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70445b61eaa42389108d4a378c267d5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.696891 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3569/7115] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 8 21:20:11 2022] GET /identity/v3/domains => generated 829 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:11.700443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f6e0bc0-5a9a-4a7b-8c68-5ce02aa50f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70445b61eaa42389108d4a378c267d5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.700868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f6e12-7b4d-4a46-b112-2240083abe8f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:11.702612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a45f6e12-7b4d-4a46-b112-2240083abe8f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:11.716289 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3547/7116] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:11 2022] DELETE /identity/v3/users/b70445b61eaa42389108d4a378c267d5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:11.717501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f6e12-7b4d-4a46-b112-2240083abe8f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:11.790706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:11.792158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:11.792720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:11.793210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/156195b13d47460895e614c945748259` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:11.794630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:update_project(project_id=156195b13d47460895e614c945748259)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:11.795810 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:20:11.795810 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:20:11.795810 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:20:11.797224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:11.811071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '156195b13d47460895e614c945748259'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.812068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '156195b13d47460895e614c945748259'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.841431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '156195b13d47460895e614c945748259'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.842060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '156195b13d47460895e614c945748259'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.844507 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3570/7117] 10.222.0.26 () {60 vars in 1252 bytes} [Sat Oct 8 21:20:11 2022] PATCH /identity/v3/projects/156195b13d47460895e614c945748259 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:11.848641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e0bc0-5a9a-4a7b-8c68-5ce02aa50f60 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:11.860204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e0bc0-5a9a-4a7b-8c68-5ce02aa50f60 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:11.947123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:11.947811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:11.948031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:11.948383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/156195b13d47460895e614c945748259` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:11.959615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=156195b13d47460895e614c945748259)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:11.961354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:11.985729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '156195b13d47460895e614c945748259'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:11.996310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '156195b13d47460895e614c945748259'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.042133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '156195b13d47460895e614c945748259', 'request_id': 'req-db533f97-0d40-479a-a95d-372af7e7851d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.047944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.049491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:12.054401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '156195b13d47460895e614c945748259', 'request_id': 'req-db533f97-0d40-479a-a95d-372af7e7851d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.061676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '156195b13d47460895e614c945748259', 'request_id': 'req-db533f97-0d40-479a-a95d-372af7e7851d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.076193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project 156195b13d47460895e614c945748259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:12.076486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.077159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.081853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:12.087332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '156195b13d47460895e614c945748259', 'request_id': 'req-db533f97-0d40-479a-a95d-372af7e7851d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.091743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '156195b13d47460895e614c945748259', 'request_id': 'req-db533f97-0d40-479a-a95d-372af7e7851d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.092973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '156195b13d47460895e614c945748259', 'request_id': 'req-db533f97-0d40-479a-a95d-372af7e7851d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.098651 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3548/7118] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:11 2022] DELETE /identity/v3/projects/156195b13d47460895e614c945748259 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:12.104597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.106636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:12.110294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:12.133691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f5fc4-88f4-4437-b36a-3bbe3de7a956 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.177961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db533f97-0d40-479a-a95d-372af7e7851d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.184823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbef32-ca7d-4f7a-98ac-8fd9399876b7 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.184981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbef32-ca7d-4f7a-98ac-8fd9399876b7 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.189588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbef32-ca7d-4f7a-98ac-8fd9399876b7 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.190092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbef32-ca7d-4f7a-98ac-8fd9399876b7 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.190890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbef32-ca7d-4f7a-98ac-8fd9399876b7 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.192002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1826e-72d8-4821-82e9-b0d85e99d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.192739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbef32-ca7d-4f7a-98ac-8fd9399876b7 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.192852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1826e-72d8-4821-82e9-b0d85e99d46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.193054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1826e-72d8-4821-82e9-b0d85e99d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.193361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1826e-72d8-4821-82e9-b0d85e99d46c admin admin] PATH_INFO: `/v3/projects/0a33670895c84303bc8423d59982e045` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.194503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1826e-72d8-4821-82e9-b0d85e99d46c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a33670895c84303bc8423d59982e045)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.196427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1826e-72d8-4821-82e9-b0d85e99d46c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.226846 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3549/7119] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:12 2022] POST /identity/v3/projects => generated 360 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:12.232005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbef32-ca7d-4f7a-98ac-8fd9399876b7 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.255178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eca1826e-72d8-4821-82e9-b0d85e99d46c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a33670895c84303bc8423d59982e045', 'request_id': 'req-eca1826e-72d8-4821-82e9-b0d85e99d46c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.264197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eca1826e-72d8-4821-82e9-b0d85e99d46c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a33670895c84303bc8423d59982e045', 'request_id': 'req-eca1826e-72d8-4821-82e9-b0d85e99d46c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.271214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eca1826e-72d8-4821-82e9-b0d85e99d46c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a33670895c84303bc8423d59982e045', 'request_id': 'req-eca1826e-72d8-4821-82e9-b0d85e99d46c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.283912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eca1826e-72d8-4821-82e9-b0d85e99d46c admin admin] The token cache is being invalidate because project 0a33670895c84303bc8423d59982e045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:12.284238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eca1826e-72d8-4821-82e9-b0d85e99d46c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.284852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-eca1826e-72d8-4821-82e9-b0d85e99d46c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.286394 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3571/7120] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:12 2022] DELETE /identity/v3/projects/0a33670895c84303bc8423d59982e045 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:12.291226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d2777-9915-4286-bbf8-6c806b77b99f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.291940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d2777-9915-4286-bbf8-6c806b77b99f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.293477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d2777-9915-4286-bbf8-6c806b77b99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.304970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbef32-ca7d-4f7a-98ac-8fd9399876b7 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.316477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-263d2777-9915-4286-bbf8-6c806b77b99f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:12.317744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-263d2777-9915-4286-bbf8-6c806b77b99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:12.371865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6d8ff-8bc7-4717-8738-a474b3e007e1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.372625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6d8ff-8bc7-4717-8738-a474b3e007e1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.372980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6d8ff-8bc7-4717-8738-a474b3e007e1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.373516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6d8ff-8bc7-4717-8738-a474b3e007e1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/172832e24b344c06b31a0a67f86727d8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.374760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6d8ff-8bc7-4717-8738-a474b3e007e1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:get_project(project_id=172832e24b344c06b31a0a67f86727d8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.376995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6d8ff-8bc7-4717-8738-a474b3e007e1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.378896 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3550/7121] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:20:12 2022] GET /identity/v3/projects/172832e24b344c06b31a0a67f86727d8 => generated 360 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:12.384985 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3572/7122] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:12.385236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6d8ff-8bc7-4717-8738-a474b3e007e1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.387619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f4d6d8ff-8bc7-4717-8738-a474b3e007e1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:12.392790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd25a20-015d-4ee8-8403-6c1b39d40ccb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.393151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd25a20-015d-4ee8-8403-6c1b39d40ccb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.393468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd25a20-015d-4ee8-8403-6c1b39d40ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.402008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6d8ff-8bc7-4717-8738-a474b3e007e1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.406618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.407264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.407545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.407821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/172832e24b344c06b31a0a67f86727d8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.408937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=172832e24b344c06b31a0a67f86727d8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.410943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.412973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9cd25a20-015d-4ee8-8403-6c1b39d40ccb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:12.414188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9cd25a20-015d-4ee8-8403-6c1b39d40ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:12.422761 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3573/7123] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:12.426834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd25a20-015d-4ee8-8403-6c1b39d40ccb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.430682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:12.436630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd25a20-015d-4ee8-8403-6c1b39d40ccb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.442255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7a3b0-23c9-4e85-aad6-52a7a46e7823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.442885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7a3b0-23c9-4e85-aad6-52a7a46e7823 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.443250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7a3b0-23c9-4e85-aad6-52a7a46e7823 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.443523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7a3b0-23c9-4e85-aad6-52a7a46e7823 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.444207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7a3b0-23c9-4e85-aad6-52a7a46e7823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:12.444513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7a3b0-23c9-4e85-aad6-52a7a46e7823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.446337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7a3b0-23c9-4e85-aad6-52a7a46e7823 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.456362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:12.460454 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3574/7124] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:12.464046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172832e24b344c06b31a0a67f86727d8', 'request_id': 'req-ba17f07f-1e78-41ba-81f8-99a691c84281'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.464279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7a3b0-23c9-4e85-aad6-52a7a46e7823 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.473480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172832e24b344c06b31a0a67f86727d8', 'request_id': 'req-ba17f07f-1e78-41ba-81f8-99a691c84281'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.478109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7a3b0-23c9-4e85-aad6-52a7a46e7823 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.480193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172832e24b344c06b31a0a67f86727d8', 'request_id': 'req-ba17f07f-1e78-41ba-81f8-99a691c84281'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.495070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project 172832e24b344c06b31a0a67f86727d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:12.497012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.498109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.499879 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3551/7125] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:12 2022] DELETE /identity/v3/projects/172832e24b344c06b31a0a67f86727d8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:12.505082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.506557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:12.565058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753cce1-aa23-4c6b-a964-f03b264f077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.565841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753cce1-aa23-4c6b-a964-f03b264f077b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.566273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753cce1-aa23-4c6b-a964-f03b264f077b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.566613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753cce1-aa23-4c6b-a964-f03b264f077b admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.568020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753cce1-aa23-4c6b-a964-f03b264f077b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.570370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753cce1-aa23-4c6b-a964-f03b264f077b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.589063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17f07f-1e78-41ba-81f8-99a691c84281 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.594244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6572c7-448e-4c28-9f8a-3e357133ef3c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.594863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6572c7-448e-4c28-9f8a-3e357133ef3c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.595146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6572c7-448e-4c28-9f8a-3e357133ef3c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.595420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6572c7-448e-4c28-9f8a-3e357133ef3c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.596060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6572c7-448e-4c28-9f8a-3e357133ef3c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.597938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6572c7-448e-4c28-9f8a-3e357133ef3c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.606259 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3575/7126] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:12 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:12.607286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753cce1-aa23-4c6b-a964-f03b264f077b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.608973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d753cce1-aa23-4c6b-a964-f03b264f077b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:12.641891 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3552/7127] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:12 2022] POST /identity/v3/projects => generated 360 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:12.643358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6572c7-448e-4c28-9f8a-3e357133ef3c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.677422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753cce1-aa23-4c6b-a964-f03b264f077b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.707013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6572c7-448e-4c28-9f8a-3e357133ef3c tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.711912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077edad-1a50-4e26-bd70-b6ab87949bed tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.712549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077edad-1a50-4e26-bd70-b6ab87949bed tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.712831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077edad-1a50-4e26-bd70-b6ab87949bed tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.713106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077edad-1a50-4e26-bd70-b6ab87949bed tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/f792f1b3a6eb40de8dea04d41ddb1389` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.714331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077edad-1a50-4e26-bd70-b6ab87949bed tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:get_project(project_id=f792f1b3a6eb40de8dea04d41ddb1389)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.716484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077edad-1a50-4e26-bd70-b6ab87949bed tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.718140 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3553/7128] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:20:12 2022] GET /identity/v3/projects/f792f1b3a6eb40de8dea04d41ddb1389 => generated 360 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:12.722185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077edad-1a50-4e26-bd70-b6ab87949bed tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.734020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077edad-1a50-4e26-bd70-b6ab87949bed tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.738634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.739146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80894f6c-52e3-4c03-8661-35e85880f143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.739308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.739620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.739776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80894f6c-52e3-4c03-8661-35e85880f143 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.739898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/f792f1b3a6eb40de8dea04d41ddb1389` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.740056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80894f6c-52e3-4c03-8661-35e85880f143 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.740328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80894f6c-52e3-4c03-8661-35e85880f143 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.740992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80894f6c-52e3-4c03-8661-35e85880f143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.741123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f792f1b3a6eb40de8dea04d41ddb1389)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.742923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80894f6c-52e3-4c03-8661-35e85880f143 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.743036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.768553 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3576/7129] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:12 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:12.769752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80894f6c-52e3-4c03-8661-35e85880f143 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.776396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:12.781301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80894f6c-52e3-4c03-8661-35e85880f143 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.794874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f792f1b3a6eb40de8dea04d41ddb1389', 'request_id': 'req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.800736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:12.803893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f792f1b3a6eb40de8dea04d41ddb1389', 'request_id': 'req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.810314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f792f1b3a6eb40de8dea04d41ddb1389', 'request_id': 'req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.822343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project f792f1b3a6eb40de8dea04d41ddb1389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:12.822825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.823629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:12.825216 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3554/7130] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:12 2022] DELETE /identity/v3/projects/f792f1b3a6eb40de8dea04d41ddb1389 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:12.830552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.832279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:12.841732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1014aa9-94f6-4254-a2b2-fd254d544611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.842345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014aa9-94f6-4254-a2b2-fd254d544611 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.842629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014aa9-94f6-4254-a2b2-fd254d544611 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.842900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014aa9-94f6-4254-a2b2-fd254d544611 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.843574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1014aa9-94f6-4254-a2b2-fd254d544611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.845172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1014aa9-94f6-4254-a2b2-fd254d544611 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.856029 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3577/7131] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:12.859716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1014aa9-94f6-4254-a2b2-fd254d544611 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.861446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f1014aa9-94f6-4254-a2b2-fd254d544611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:12.874187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1014aa9-94f6-4254-a2b2-fd254d544611 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.879607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0db01-2452-4215-a371-09dc20f1f9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.880337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0db01-2452-4215-a371-09dc20f1f9ee admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.880621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0db01-2452-4215-a371-09dc20f1f9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.880897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0db01-2452-4215-a371-09dc20f1f9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.881573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0db01-2452-4215-a371-09dc20f1f9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.883156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0db01-2452-4215-a371-09dc20f1f9ee admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.893135 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3578/7132] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:12.897117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0db01-2452-4215-a371-09dc20f1f9ee admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.900179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30e793-dcb8-4ad0-ab28-1fe86366b8c9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.905452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce162e9-eddb-4109-a056-ce5d576140bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.906162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce162e9-eddb-4109-a056-ce5d576140bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.906449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce162e9-eddb-4109-a056-ce5d576140bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.906739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce162e9-eddb-4109-a056-ce5d576140bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.907016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0db01-2452-4215-a371-09dc20f1f9ee admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:12.907353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce162e9-eddb-4109-a056-ce5d576140bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.909214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce162e9-eddb-4109-a056-ce5d576140bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.911614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a4046-c242-4d0a-bedc-8f6f73ebb634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:12.912243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a4046-c242-4d0a-bedc-8f6f73ebb634 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.912532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a4046-c242-4d0a-bedc-8f6f73ebb634 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.912809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a4046-c242-4d0a-bedc-8f6f73ebb634 admin admin] PATH_INFO: `/v3/projects/88d0573333b94accaf2ed9966370ee5c/users/657e45fce3a14ade9cd7fdd4605ece69/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:12.930191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a4046-c242-4d0a-bedc-8f6f73ebb634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d0573333b94accaf2ed9966370ee5c, user_id=657e45fce3a14ade9cd7fdd4605ece69, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:12.933631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a4046-c242-4d0a-bedc-8f6f73ebb634 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:12.946241 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3555/7133] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:20:12 2022] POST /identity/v3/projects => generated 348 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:12.950505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce162e9-eddb-4109-a056-ce5d576140bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:12.953650 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3579/7134] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:12 2022] PUT /identity/v3/projects/88d0573333b94accaf2ed9966370ee5c/users/657e45fce3a14ade9cd7fdd4605ece69/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:12.963674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275b111-1958-4695-8a4a-4764724a8612 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:12.963959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275b111-1958-4695-8a4a-4764724a8612 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:12.964748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275b111-1958-4695-8a4a-4764724a8612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.010819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b275b111-1958-4695-8a4a-4764724a8612 None None] MFA Rules not processed for user `657e45fce3a14ade9cd7fdd4605ece69`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:13.012479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b275b111-1958-4695-8a4a-4764724a8612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:13.033125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce162e9-eddb-4109-a056-ce5d576140bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.085863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:13.086624 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3580/7135] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:13.091839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275b111-1958-4695-8a4a-4764724a8612 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:13.102501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4801d2-3d22-43fb-81a3-7344acb45798 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.103445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4801d2-3d22-43fb-81a3-7344acb45798 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.103676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4801d2-3d22-43fb-81a3-7344acb45798 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.103955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4801d2-3d22-43fb-81a3-7344acb45798 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/089dff0d15db4b24bc52a1855a41cef4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.105706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4801d2-3d22-43fb-81a3-7344acb45798 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:get_project(project_id=089dff0d15db4b24bc52a1855a41cef4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:13.107867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4801d2-3d22-43fb-81a3-7344acb45798 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:13.109542 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3556/7136] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:20:12 2022] GET /identity/v3/projects/089dff0d15db4b24bc52a1855a41cef4 => generated 348 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:13.114263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4801d2-3d22-43fb-81a3-7344acb45798 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:13.126458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4801d2-3d22-43fb-81a3-7344acb45798 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.135823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.136511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.137069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.137376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/089dff0d15db4b24bc52a1855a41cef4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.138776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=089dff0d15db4b24bc52a1855a41cef4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:13.140770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:13.162069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275b111-1958-4695-8a4a-4764724a8612 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.166636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab031560-0423-4703-a97c-8c760cf4d564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.167970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab031560-0423-4703-a97c-8c760cf4d564 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.168269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab031560-0423-4703-a97c-8c760cf4d564 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.168612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab031560-0423-4703-a97c-8c760cf4d564 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.169085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab031560-0423-4703-a97c-8c760cf4d564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:13.171048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab031560-0423-4703-a97c-8c760cf4d564 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:13.188752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '089dff0d15db4b24bc52a1855a41cef4', 'request_id': 'req-b5fc9a98-61f1-4d56-aa43-781de4ab549a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:13.194709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:13.198193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '089dff0d15db4b24bc52a1855a41cef4', 'request_id': 'req-b5fc9a98-61f1-4d56-aa43-781de4ab549a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:13.204840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '089dff0d15db4b24bc52a1855a41cef4', 'request_id': 'req-b5fc9a98-61f1-4d56-aa43-781de4ab549a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:13.205712 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3581/7137] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:13 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:13.209416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab031560-0423-4703-a97c-8c760cf4d564 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:13.216711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project 089dff0d15db4b24bc52a1855a41cef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:13.217001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:13.217796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:13.219337 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3557/7138] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:13 2022] DELETE /identity/v3/projects/089dff0d15db4b24bc52a1855a41cef4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:13.224229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:13.226324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:13.274691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab031560-0423-4703-a97c-8c760cf4d564 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.280218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e17ef-d571-4762-89c1-9e223701c316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.280821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e17ef-d571-4762-89c1-9e223701c316 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.281234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e17ef-d571-4762-89c1-9e223701c316 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.281516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e17ef-d571-4762-89c1-9e223701c316 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.282139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e17ef-d571-4762-89c1-9e223701c316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:13.284045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e17ef-d571-4762-89c1-9e223701c316 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:13.294339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc9a98-61f1-4d56-aa43-781de4ab549a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.306976 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3582/7139] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:13 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:13.310531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e17ef-d571-4762-89c1-9e223701c316 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:13.312734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7e8e17ef-d571-4762-89c1-9e223701c316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:13.325956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e17ef-d571-4762-89c1-9e223701c316 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.331696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a12a96-7864-452e-ba95-4333474dffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.332300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a12a96-7864-452e-ba95-4333474dffb9 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.332580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a12a96-7864-452e-ba95-4333474dffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.332854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a12a96-7864-452e-ba95-4333474dffb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.333533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a12a96-7864-452e-ba95-4333474dffb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:13.335734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a12a96-7864-452e-ba95-4333474dffb9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:13.351967 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3583/7140] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:13.353791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a12a96-7864-452e-ba95-4333474dffb9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:13.354778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a0567-7530-451e-8e6e-5a919991e442 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.355409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0567-7530-451e-8e6e-5a919991e442 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.355690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0567-7530-451e-8e6e-5a919991e442 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.355983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0567-7530-451e-8e6e-5a919991e442 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.356633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a0567-7530-451e-8e6e-5a919991e442 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:13.358244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a0567-7530-451e-8e6e-5a919991e442 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:13.363466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a12a96-7864-452e-ba95-4333474dffb9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.368989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06222a37-c1bb-4100-8278-5178c801e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.369717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06222a37-c1bb-4100-8278-5178c801e85e admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.369996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06222a37-c1bb-4100-8278-5178c801e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.370316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06222a37-c1bb-4100-8278-5178c801e85e admin admin] PATH_INFO: `/v3/projects/aa7b8302bf6744ed9b5ab0770370c9ab/users/692d610c8bd744b39816683e52986841/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.374877 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3558/7141] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:20:13 2022] POST /identity/v3/domains => generated 276 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:13.378899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a0567-7530-451e-8e6e-5a919991e442 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:13.389050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06222a37-c1bb-4100-8278-5178c801e85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7b8302bf6744ed9b5ab0770370c9ab, user_id=692d610c8bd744b39816683e52986841, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:13.391751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06222a37-c1bb-4100-8278-5178c801e85e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:13.398533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:13.410315 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3584/7142] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:13 2022] PUT /identity/v3/projects/aa7b8302bf6744ed9b5ab0770370c9ab/users/692d610c8bd744b39816683e52986841/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:13.411219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06222a37-c1bb-4100-8278-5178c801e85e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:13.454935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a0567-7530-451e-8e6e-5a919991e442 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.496367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06222a37-c1bb-4100-8278-5178c801e85e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.504685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7c31e-7d5b-43ff-b019-e87c80d92620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.505472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c31e-7d5b-43ff-b019-e87c80d92620 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.505886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c31e-7d5b-43ff-b019-e87c80d92620 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.506163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c31e-7d5b-43ff-b019-e87c80d92620 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.506808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7c31e-7d5b-43ff-b019-e87c80d92620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:13.508550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7c31e-7d5b-43ff-b019-e87c80d92620 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:13.525824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a12a0-c07d-4672-9e71-b96e09b579c6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.526648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a12a0-c07d-4672-9e71-b96e09b579c6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.527564 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3585/7143] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:13.530929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a12a0-c07d-4672-9e71-b96e09b579c6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.531312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a12a0-c07d-4672-9e71-b96e09b579c6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.532344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7c31e-7d5b-43ff-b019-e87c80d92620 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:13.532772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a12a0-c07d-4672-9e71-b96e09b579c6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:13.534837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a12a0-c07d-4672-9e71-b96e09b579c6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:13.544660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7c31e-7d5b-43ff-b019-e87c80d92620 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.553511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81524cc-aca3-438c-a78e-93a00b64480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.554289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81524cc-aca3-438c-a78e-93a00b64480b admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.554574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81524cc-aca3-438c-a78e-93a00b64480b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.554847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81524cc-aca3-438c-a78e-93a00b64480b admin admin] PATH_INFO: `/v3/projects/aa7b8302bf6744ed9b5ab0770370c9ab/users/692d610c8bd744b39816683e52986841/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.557791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81524cc-aca3-438c-a78e-93a00b64480b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7b8302bf6744ed9b5ab0770370c9ab, user_id=692d610c8bd744b39816683e52986841, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:13.561618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81524cc-aca3-438c-a78e-93a00b64480b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:13.579133 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3586/7144] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:13 2022] PUT /identity/v3/projects/aa7b8302bf6744ed9b5ab0770370c9ab/users/692d610c8bd744b39816683e52986841/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:13.592845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5193-59a9-4550-9c29-b67a34832298 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.593036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5193-59a9-4550-9c29-b67a34832298 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.593747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5193-59a9-4550-9c29-b67a34832298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.610971 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3559/7145] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:13 2022] POST /identity/v3/projects => generated 403 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:13.612138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a12a0-c07d-4672-9e71-b96e09b579c6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:13.630331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cb8e5193-59a9-4550-9c29-b67a34832298 None None] MFA Rules not processed for user `692d610c8bd744b39816683e52986841`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:13.631729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cb8e5193-59a9-4550-9c29-b67a34832298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:13.665433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:13.692447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a12a0-c07d-4672-9e71-b96e09b579c6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.704849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba38023-1eb5-4c6b-be42-67c9b32fe2f6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.705635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba38023-1eb5-4c6b-be42-67c9b32fe2f6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.705972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba38023-1eb5-4c6b-be42-67c9b32fe2f6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.706162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba38023-1eb5-4c6b-be42-67c9b32fe2f6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/6f03256edfbc450cb5bf3b387ba50e32` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.707803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba38023-1eb5-4c6b-be42-67c9b32fe2f6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:get_project(project_id=6f03256edfbc450cb5bf3b387ba50e32)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:13.712133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba38023-1eb5-4c6b-be42-67c9b32fe2f6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:13.717244 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3560/7146] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:20:13 2022] GET /identity/v3/projects/6f03256edfbc450cb5bf3b387ba50e32 => generated 403 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:13.719005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba38023-1eb5-4c6b-be42-67c9b32fe2f6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:13.732101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba38023-1eb5-4c6b-be42-67c9b32fe2f6 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.738588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.738588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.738588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.738957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/6f03256edfbc450cb5bf3b387ba50e32` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.739854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6f03256edfbc450cb5bf3b387ba50e32)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:13.742283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:13.764934 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3587/7147] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:13.777303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e5193-59a9-4550-9c29-b67a34832298 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:13.778806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cb8e5193-59a9-4550-9c29-b67a34832298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:13.796640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:13.809084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f03256edfbc450cb5bf3b387ba50e32', 'request_id': 'req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:13.819079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f03256edfbc450cb5bf3b387ba50e32', 'request_id': 'req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:13.828043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f03256edfbc450cb5bf3b387ba50e32', 'request_id': 'req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:13.840006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project 6f03256edfbc450cb5bf3b387ba50e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:13.840293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:13.841601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:13.843085 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3561/7148] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:13 2022] DELETE /identity/v3/projects/6f03256edfbc450cb5bf3b387ba50e32 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:13.847209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:13.848482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:13.867744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e5193-59a9-4550-9c29-b67a34832298 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.925624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd998c2-8f3f-4480-8dc4-5e7eb09d718e tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:13.930497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1ec8f-7daf-4f40-a091-9a32f35bdaec tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.930697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60f09d-2b6c-4a64-9f08-2fe98e3c675c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:13.931131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1ec8f-7daf-4f40-a091-9a32f35bdaec tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.931380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60f09d-2b6c-4a64-9f08-2fe98e3c675c service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:13.931494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1ec8f-7daf-4f40-a091-9a32f35bdaec tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.931729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1ec8f-7daf-4f40-a091-9a32f35bdaec tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/domains/e0778dfaa4fa4ff5bed98a3c5fda00b1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.931995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60f09d-2b6c-4a64-9f08-2fe98e3c675c service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:13.932341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60f09d-2b6c-4a64-9f08-2fe98e3c675c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:13.933457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1ec8f-7daf-4f40-a091-9a32f35bdaec tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e0778dfaa4fa4ff5bed98a3c5fda00b1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:13.935032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1ec8f-7daf-4f40-a091-9a32f35bdaec tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:13.938780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-af60f09d-2b6c-4a64-9f08-2fe98e3c675c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:13.959346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-76d1ec8f-7daf-4f40-a091-9a32f35bdaec tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e0778dfaa4fa4ff5bed98a3c5fda00b1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:13.960102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-76d1ec8f-7daf-4f40-a091-9a32f35bdaec tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e0778dfaa4fa4ff5bed98a3c5fda00b1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:13.998222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-76d1ec8f-7daf-4f40-a091-9a32f35bdaec tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e0778dfaa4fa4ff5bed98a3c5fda00b1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:13.998971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-76d1ec8f-7daf-4f40-a091-9a32f35bdaec tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e0778dfaa4fa4ff5bed98a3c5fda00b1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.001751 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3562/7149] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:20:13 2022] PATCH /identity/v3/domains/e0778dfaa4fa4ff5bed98a3c5fda00b1 => generated 277 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:14.005835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1ec8f-7daf-4f40-a091-9a32f35bdaec tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:14.007407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-76d1ec8f-7daf-4f40-a091-9a32f35bdaec tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:14.012090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60f09d-2b6c-4a64-9f08-2fe98e3c675c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:14.013544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60f09d-2b6c-4a64-9f08-2fe98e3c675c service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:14.025046 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3588/7150] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:14.090341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1ec8f-7daf-4f40-a091-9a32f35bdaec tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:14.104540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:14.105778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:14.106059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:14.106607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/domains/e0778dfaa4fa4ff5bed98a3c5fda00b1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:14.118062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e0778dfaa4fa4ff5bed98a3c5fda00b1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:14.120142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:14.147022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e0778dfaa4fa4ff5bed98a3c5fda00b1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.149296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:14.165983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e0778dfaa4fa4ff5bed98a3c5fda00b1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.194747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60f09d-2b6c-4a64-9f08-2fe98e3c675c service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:14.196642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-af60f09d-2b6c-4a64-9f08-2fe98e3c675c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:14.225001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0778dfaa4fa4ff5bed98a3c5fda00b1', 'request_id': 'req-e570c6b1-e978-43b4-b39b-625de397902a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.225858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:14.236041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0778dfaa4fa4ff5bed98a3c5fda00b1', 'request_id': 'req-e570c6b1-e978-43b4-b39b-625de397902a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.245012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0778dfaa4fa4ff5bed98a3c5fda00b1', 'request_id': 'req-e570c6b1-e978-43b4-b39b-625de397902a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.264919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project e0778dfaa4fa4ff5bed98a3c5fda00b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:14.265645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.266522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.280187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e0778dfaa4fa4ff5bed98a3c5fda00b1', 'request_id': 'req-e570c6b1-e978-43b4-b39b-625de397902a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.285232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e0778dfaa4fa4ff5bed98a3c5fda00b1', 'request_id': 'req-e570c6b1-e978-43b4-b39b-625de397902a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.286103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e0778dfaa4fa4ff5bed98a3c5fda00b1', 'request_id': 'req-e570c6b1-e978-43b4-b39b-625de397902a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.293776 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3563/7151] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:20:14 2022] DELETE /identity/v3/domains/e0778dfaa4fa4ff5bed98a3c5fda00b1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:14.298720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:14.300717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:14.327969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60f09d-2b6c-4a64-9f08-2fe98e3c675c service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:14.375114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570c6b1-e978-43b4-b39b-625de397902a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:14.379892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6b76-8978-4c06-a484-a96b457d0ddf tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:14.380508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6b76-8978-4c06-a484-a96b457d0ddf tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:14.380787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6b76-8978-4c06-a484-a96b457d0ddf tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:14.381056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6b76-8978-4c06-a484-a96b457d0ddf tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:14.381777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad6b76-8978-4c06-a484-a96b457d0ddf tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:14.383448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad6b76-8978-4c06-a484-a96b457d0ddf tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:14.403754 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3564/7152] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:20:14 2022] POST /identity/v3/domains => generated 277 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:14.407582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6b76-8978-4c06-a484-a96b457d0ddf tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:14.419833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a13a2b-cb3f-4547-a0df-f3676b5ffd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:14.421037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a13a2b-cb3f-4547-a0df-f3676b5ffd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:14.421378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a13a2b-cb3f-4547-a0df-f3676b5ffd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:14.421739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a13a2b-cb3f-4547-a0df-f3676b5ffd7e admin admin] PATH_INFO: `/v3/users/657e45fce3a14ade9cd7fdd4605ece69` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:14.423121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a13a2b-cb3f-4547-a0df-f3676b5ffd7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=657e45fce3a14ade9cd7fdd4605ece69)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:14.425267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a13a2b-cb3f-4547-a0df-f3676b5ffd7e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:14.482828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-82a13a2b-cb3f-4547-a0df-f3676b5ffd7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '657e45fce3a14ade9cd7fdd4605ece69'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.486082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6b76-8978-4c06-a484-a96b457d0ddf tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:14.490654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40887-053f-434d-b0b8-ba475aed537d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:14.491267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40887-053f-434d-b0b8-ba475aed537d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:14.491551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40887-053f-434d-b0b8-ba475aed537d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:14.491829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40887-053f-434d-b0b8-ba475aed537d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:14.492465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c40887-053f-434d-b0b8-ba475aed537d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:14.495086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c40887-053f-434d-b0b8-ba475aed537d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:14.498471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-82a13a2b-cb3f-4547-a0df-f3676b5ffd7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '657e45fce3a14ade9cd7fdd4605ece69'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.499171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-82a13a2b-cb3f-4547-a0df-f3676b5ffd7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '657e45fce3a14ade9cd7fdd4605ece69'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.499789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-82a13a2b-cb3f-4547-a0df-f3676b5ffd7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '657e45fce3a14ade9cd7fdd4605ece69'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.500393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:14.513704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-82a13a2b-cb3f-4547-a0df-f3676b5ffd7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '657e45fce3a14ade9cd7fdd4605ece69'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.528640 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3589/7153] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:14 2022] DELETE /identity/v3/users/657e45fce3a14ade9cd7fdd4605ece69 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:14.533787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f9b3f-cff0-4e30-a3a3-4e8160739769 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:14.534076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f9b3f-cff0-4e30-a3a3-4e8160739769 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:14.534355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f9b3f-cff0-4e30-a3a3-4e8160739769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:14.545634 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3565/7154] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:14 2022] POST /identity/v3/projects => generated 409 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:14.546883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40887-053f-434d-b0b8-ba475aed537d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:14.548659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-92c40887-053f-434d-b0b8-ba475aed537d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:14.555850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a94f9b3f-cff0-4e30-a3a3-4e8160739769 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:14.557024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a94f9b3f-cff0-4e30-a3a3-4e8160739769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:14.602018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:14.623917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40887-053f-434d-b0b8-ba475aed537d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:14.625765 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3590/7155] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:14.628624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f3004-456b-4396-be76-90b724ba102f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:14.629260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f3004-456b-4396-be76-90b724ba102f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:14.629547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f3004-456b-4396-be76-90b724ba102f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:14.629823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f3004-456b-4396-be76-90b724ba102f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:14.630475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f3004-456b-4396-be76-90b724ba102f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:14.632371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f3004-456b-4396-be76-90b724ba102f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:14.635226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f9b3f-cff0-4e30-a3a3-4e8160739769 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:14.636741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a94f9b3f-cff0-4e30-a3a3-4e8160739769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:14.668380 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3566/7156] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:14 2022] POST /identity/v3/projects => generated 404 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:14.672624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f3004-456b-4396-be76-90b724ba102f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:14.699070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f9b3f-cff0-4e30-a3a3-4e8160739769 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:14.734726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f3004-456b-4396-be76-90b724ba102f tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:14.739377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:14.740001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:14.740278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:14.740666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/af366b2559c448b6a9e682afe10c669e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:14.741808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=af366b2559c448b6a9e682afe10c669e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:14.743684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:14.750580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6a8b-fd86-4fbb-8812-0b608307eb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:14.751191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6a8b-fd86-4fbb-8812-0b608307eb3a service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:14.751477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6a8b-fd86-4fbb-8812-0b608307eb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:14.751751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6a8b-fd86-4fbb-8812-0b608307eb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:14.806565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af366b2559c448b6a9e682afe10c669e', 'request_id': 'req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.816463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af366b2559c448b6a9e682afe10c669e', 'request_id': 'req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.818525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:14.824262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af366b2559c448b6a9e682afe10c669e', 'request_id': 'req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.831580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f6a8b-fd86-4fbb-8812-0b608307eb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:14.833049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f6a8b-fd86-4fbb-8812-0b608307eb3a service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:14.837374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project af366b2559c448b6a9e682afe10c669e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:14.837671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.838341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.840495 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3567/7157] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:14 2022] DELETE /identity/v3/projects/af366b2559c448b6a9e682afe10c669e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:14.844010 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3591/7158] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:14.844804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:14.846253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:14.922325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f7142-bb1e-4f3d-a6c3-f3c09ccfe078 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:14.927722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:14.928355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:14.928690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:14.928966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/456511b77b7a47d4929a9185baf42e24` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:14.930119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=456511b77b7a47d4929a9185baf42e24)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:14.932005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:14.982540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '456511b77b7a47d4929a9185baf42e24', 'request_id': 'req-f7ada426-f24c-4290-abb7-e2411e172c9a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.990259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '456511b77b7a47d4929a9185baf42e24', 'request_id': 'req-f7ada426-f24c-4290-abb7-e2411e172c9a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:14.995905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '456511b77b7a47d4929a9185baf42e24', 'request_id': 'req-f7ada426-f24c-4290-abb7-e2411e172c9a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.007517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project 456511b77b7a47d4929a9185baf42e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:15.007900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.008481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.010096 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3568/7159] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:14 2022] DELETE /identity/v3/projects/456511b77b7a47d4929a9185baf42e24 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:15.014754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6a8b-fd86-4fbb-8812-0b608307eb3a service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:15.025927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6a8b-fd86-4fbb-8812-0b608307eb3a service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:15.077398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:15.090027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837634b-06b4-430f-a4af-fd44b9836771 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:15.090664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837634b-06b4-430f-a4af-fd44b9836771 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:15.090941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837634b-06b4-430f-a4af-fd44b9836771 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:15.091209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837634b-06b4-430f-a4af-fd44b9836771 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/domains/e797f393d4be498a8c344f54ab187ee9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:15.092461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837634b-06b4-430f-a4af-fd44b9836771 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e797f393d4be498a8c344f54ab187ee9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:15.094313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837634b-06b4-430f-a4af-fd44b9836771 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:15.116220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1837634b-06b4-430f-a4af-fd44b9836771 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e797f393d4be498a8c344f54ab187ee9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.117071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1837634b-06b4-430f-a4af-fd44b9836771 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e797f393d4be498a8c344f54ab187ee9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.147387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:15.148331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1837634b-06b4-430f-a4af-fd44b9836771 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e797f393d4be498a8c344f54ab187ee9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.148949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1837634b-06b4-430f-a4af-fd44b9836771 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e797f393d4be498a8c344f54ab187ee9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.149399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:15.152491 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3592/7160] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:20:15 2022] PATCH /identity/v3/domains/e797f393d4be498a8c344f54ab187ee9 => generated 278 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:15.155939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837634b-06b4-430f-a4af-fd44b9836771 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:15.162306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1837634b-06b4-430f-a4af-fd44b9836771 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:15.225285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ada426-f24c-4290-abb7-e2411e172c9a tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:15.235248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837634b-06b4-430f-a4af-fd44b9836771 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:15.240170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:15.240843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:15.241069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:15.241375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/domains/e797f393d4be498a8c344f54ab187ee9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:15.247096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:15.252949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e797f393d4be498a8c344f54ab187ee9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:15.254638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:15.278212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e797f393d4be498a8c344f54ab187ee9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.285113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:15.285828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:15.286107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:15.286377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] PATH_INFO: `/v3/projects/88d0573333b94accaf2ed9966370ee5c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:15.287555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d0573333b94accaf2ed9966370ee5c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:15.287757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e797f393d4be498a8c344f54ab187ee9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.289590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:15.328519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e797f393d4be498a8c344f54ab187ee9', 'request_id': 'req-d4260e78-ff44-4dd8-b559-519672201781'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.335954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e797f393d4be498a8c344f54ab187ee9', 'request_id': 'req-d4260e78-ff44-4dd8-b559-519672201781'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.340916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d0573333b94accaf2ed9966370ee5c', 'request_id': 'req-645a298a-2f42-44e4-a930-3a1a21bfbfa0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.343075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e797f393d4be498a8c344f54ab187ee9', 'request_id': 'req-d4260e78-ff44-4dd8-b559-519672201781'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.348855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d0573333b94accaf2ed9966370ee5c', 'request_id': 'req-645a298a-2f42-44e4-a930-3a1a21bfbfa0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.355904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d0573333b94accaf2ed9966370ee5c', 'request_id': 'req-645a298a-2f42-44e4-a930-3a1a21bfbfa0'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.356083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project e797f393d4be498a8c344f54ab187ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:15.356348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.357019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.364551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e797f393d4be498a8c344f54ab187ee9', 'request_id': 'req-d4260e78-ff44-4dd8-b559-519672201781'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.365199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e797f393d4be498a8c344f54ab187ee9', 'request_id': 'req-d4260e78-ff44-4dd8-b559-519672201781'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.366703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:15.367766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] The token cache is being invalidate because project 88d0573333b94accaf2ed9966370ee5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:15.367908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.368631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.370846 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3569/7161] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:15 2022] DELETE /identity/v3/projects/88d0573333b94accaf2ed9966370ee5c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:15.371659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e797f393d4be498a8c344f54ab187ee9', 'request_id': 'req-d4260e78-ff44-4dd8-b559-519672201781'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.374525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:15.375934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:15.380697 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3593/7162] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:20:15 2022] DELETE /identity/v3/domains/e797f393d4be498a8c344f54ab187ee9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:15.385547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:15.389006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:15.458827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a298a-2f42-44e4-a930-3a1a21bfbfa0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:15.464016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:15.464734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:15.465099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:15.465479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] PATH_INFO: `/v3/users/692d610c8bd744b39816683e52986841` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:15.466775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=692d610c8bd744b39816683e52986841)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:15.468648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:15.471214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4260e78-ff44-4dd8-b559-519672201781 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:15.541729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e88db-4301-4f6b-bc02-f1793cf243ff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:15.542874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e88db-4301-4f6b-bc02-f1793cf243ff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:15.543260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e88db-4301-4f6b-bc02-f1793cf243ff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:15.543611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e88db-4301-4f6b-bc02-f1793cf243ff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:15.544651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e88db-4301-4f6b-bc02-f1793cf243ff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:15.547258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e88db-4301-4f6b-bc02-f1793cf243ff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:15.547473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '692d610c8bd744b39816683e52986841'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.571215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '692d610c8bd744b39816683e52986841'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.572057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '692d610c8bd744b39816683e52986841'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.572924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '692d610c8bd744b39816683e52986841'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.575043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:15.597637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '692d610c8bd744b39816683e52986841'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.616262 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3570/7163] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:15 2022] DELETE /identity/v3/users/692d610c8bd744b39816683e52986841 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:15.624808 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3594/7164] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:15 2022] POST /identity/v3/projects => generated 376 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:15.625703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:15.627260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:15.702601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5b37-475d-4a45-a6bd-a38ef2684d89 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:15.710226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14f893-4a07-4864-86a7-b629f3c29e39 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:15.711186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f893-4a07-4864-86a7-b629f3c29e39 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:15.711659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f893-4a07-4864-86a7-b629f3c29e39 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:15.712036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f893-4a07-4864-86a7-b629f3c29e39 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/0ac29ea2931b45af91b15a188e9831a3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:15.713378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14f893-4a07-4864-86a7-b629f3c29e39 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:get_project(project_id=0ac29ea2931b45af91b15a188e9831a3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:15.715727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14f893-4a07-4864-86a7-b629f3c29e39 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:15.718269 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3571/7165] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:20:15 2022] GET /identity/v3/projects/0ac29ea2931b45af91b15a188e9831a3 => generated 376 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:15.722777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e88db-4301-4f6b-bc02-f1793cf243ff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:15.796894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e88db-4301-4f6b-bc02-f1793cf243ff tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:15.801757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c9f0d-7e77-45cb-b65b-3cf16edfdb38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:15.802368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c9f0d-7e77-45cb-b65b-3cf16edfdb38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:15.802655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c9f0d-7e77-45cb-b65b-3cf16edfdb38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:15.802940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c9f0d-7e77-45cb-b65b-3cf16edfdb38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:15.803586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c9f0d-7e77-45cb-b65b-3cf16edfdb38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:15.805652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c9f0d-7e77-45cb-b65b-3cf16edfdb38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:15.823591 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3595/7166] 10.222.0.26 () {58 vars in 1131 bytes} [Sat Oct 8 21:20:15 2022] GET /identity/v3/projects => generated 5095 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:15.828971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14f893-4a07-4864-86a7-b629f3c29e39 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:15.839372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14f893-4a07-4864-86a7-b629f3c29e39 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:15.844628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:15.845371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:15.845657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:15.845937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/0ac29ea2931b45af91b15a188e9831a3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:15.847073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ac29ea2931b45af91b15a188e9831a3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:15.848963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:15.901433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac29ea2931b45af91b15a188e9831a3', 'request_id': 'req-979e25d2-3a6d-4f8f-8484-9be38431195d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.909620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac29ea2931b45af91b15a188e9831a3', 'request_id': 'req-979e25d2-3a6d-4f8f-8484-9be38431195d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.915688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac29ea2931b45af91b15a188e9831a3', 'request_id': 'req-979e25d2-3a6d-4f8f-8484-9be38431195d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.928949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project 0ac29ea2931b45af91b15a188e9831a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:15.929346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.930318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:15.932117 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3572/7167] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:15 2022] DELETE /identity/v3/projects/0ac29ea2931b45af91b15a188e9831a3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:15.938407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c9f0d-7e77-45cb-b65b-3cf16edfdb38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:15.940620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e91c9f0d-7e77-45cb-b65b-3cf16edfdb38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:15.958800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c9f0d-7e77-45cb-b65b-3cf16edfdb38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:15.973309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:16.031217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebb019-6780-468f-9ee9-45a22c2a37a1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.031940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebb019-6780-468f-9ee9-45a22c2a37a1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.032310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebb019-6780-468f-9ee9-45a22c2a37a1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.032669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebb019-6780-468f-9ee9-45a22c2a37a1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.033415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebb019-6780-468f-9ee9-45a22c2a37a1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.035352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebb019-6780-468f-9ee9-45a22c2a37a1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.071659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.073160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:16.075619 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3596/7168] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:20:15 2022] POST /identity/v3/projects => generated 347 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:16.085165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebb019-6780-468f-9ee9-45a22c2a37a1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.182638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:16.184554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebb019-6780-468f-9ee9-45a22c2a37a1 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.190664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac30724-9d47-4e90-b84a-773062c33a0d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.191334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e25d2-3a6d-4f8f-8484-9be38431195d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.191473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac30724-9d47-4e90-b84a-773062c33a0d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.191627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac30724-9d47-4e90-b84a-773062c33a0d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.191976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac30724-9d47-4e90-b84a-773062c33a0d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/7a745031bae7420e92114676aadeefe0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.193385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac30724-9d47-4e90-b84a-773062c33a0d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:update_project(project_id=7a745031bae7420e92114676aadeefe0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.196222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac30724-9d47-4e90-b84a-773062c33a0d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.241413 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3597/7169] 10.222.0.26 () {60 vars in 1252 bytes} [Sat Oct 8 21:20:16 2022] PATCH /identity/v3/projects/7a745031bae7420e92114676aadeefe0 => generated 360 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:16.243683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac30724-9d47-4e90-b84a-773062c33a0d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.256306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac30724-9d47-4e90-b84a-773062c33a0d tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.263082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bc739-f3c8-416e-b461-987b87febbc9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.263918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bc739-f3c8-416e-b461-987b87febbc9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.264217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762592bd-bf89-4d53-91c8-86e2b2e0a530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.264570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bc739-f3c8-416e-b461-987b87febbc9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.264931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762592bd-bf89-4d53-91c8-86e2b2e0a530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.265180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bc739-f3c8-416e-b461-987b87febbc9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/7a745031bae7420e92114676aadeefe0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.265337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762592bd-bf89-4d53-91c8-86e2b2e0a530 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.265522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762592bd-bf89-4d53-91c8-86e2b2e0a530 admin admin] PATH_INFO: `/v3/projects/aa7b8302bf6744ed9b5ab0770370c9ab` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.267763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762592bd-bf89-4d53-91c8-86e2b2e0a530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7b8302bf6744ed9b5ab0770370c9ab)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.269741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762592bd-bf89-4d53-91c8-86e2b2e0a530 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.279927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bc739-f3c8-416e-b461-987b87febbc9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:get_project(project_id=7a745031bae7420e92114676aadeefe0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.282322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bc739-f3c8-416e-b461-987b87febbc9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.284268 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3598/7170] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:20:16 2022] GET /identity/v3/projects/7a745031bae7420e92114676aadeefe0 => generated 347 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:16.288876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bc739-f3c8-416e-b461-987b87febbc9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.303268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bc739-f3c8-416e-b461-987b87febbc9 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.310498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.311241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.311520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.311798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/7a745031bae7420e92114676aadeefe0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.312953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7a745031bae7420e92114676aadeefe0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.315791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.333877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-762592bd-bf89-4d53-91c8-86e2b2e0a530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7b8302bf6744ed9b5ab0770370c9ab', 'request_id': 'req-762592bd-bf89-4d53-91c8-86e2b2e0a530'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.343365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-762592bd-bf89-4d53-91c8-86e2b2e0a530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7b8302bf6744ed9b5ab0770370c9ab', 'request_id': 'req-762592bd-bf89-4d53-91c8-86e2b2e0a530'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.350765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-762592bd-bf89-4d53-91c8-86e2b2e0a530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7b8302bf6744ed9b5ab0770370c9ab', 'request_id': 'req-762592bd-bf89-4d53-91c8-86e2b2e0a530'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.365096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-762592bd-bf89-4d53-91c8-86e2b2e0a530 admin admin] The token cache is being invalidate because project aa7b8302bf6744ed9b5ab0770370c9ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:16.365432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-762592bd-bf89-4d53-91c8-86e2b2e0a530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.366078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-762592bd-bf89-4d53-91c8-86e2b2e0a530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.367881 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3573/7171] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:16 2022] DELETE /identity/v3/projects/aa7b8302bf6744ed9b5ab0770370c9ab => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:16.373260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89e52-85a1-4d4a-876b-0096f61ddeaa None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.373546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89e52-85a1-4d4a-876b-0096f61ddeaa None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.373828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89e52-85a1-4d4a-876b-0096f61ddeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.382652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a745031bae7420e92114676aadeefe0', 'request_id': 'req-d0e76782-cf8b-4c85-8437-bc6183edae19'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.391566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a745031bae7420e92114676aadeefe0', 'request_id': 'req-d0e76782-cf8b-4c85-8437-bc6183edae19'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.397169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:16.397885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b1f89e52-85a1-4d4a-876b-0096f61ddeaa None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:16.398743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a745031bae7420e92114676aadeefe0', 'request_id': 'req-d0e76782-cf8b-4c85-8437-bc6183edae19'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.399111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b1f89e52-85a1-4d4a-876b-0096f61ddeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:16.415398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project 7a745031bae7420e92114676aadeefe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:16.416086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.417579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.419596 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3599/7172] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:16 2022] DELETE /identity/v3/projects/7a745031bae7420e92114676aadeefe0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:16.424316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.425926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:16.464900 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3574/7173] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:16.472502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60e82-9cd7-4f3d-9b80-9bf1bf3b53b1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.473077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60e82-9cd7-4f3d-9b80-9bf1bf3b53b1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.473077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60e82-9cd7-4f3d-9b80-9bf1bf3b53b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.494533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e76782-cf8b-4c85-8437-bc6183edae19 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.497442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-36a60e82-9cd7-4f3d-9b80-9bf1bf3b53b1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:16.498648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-36a60e82-9cd7-4f3d-9b80-9bf1bf3b53b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:16.500065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623ed5d-694b-4176-9fed-cf731bc78be3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.500787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623ed5d-694b-4176-9fed-cf731bc78be3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.501071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623ed5d-694b-4176-9fed-cf731bc78be3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.501412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623ed5d-694b-4176-9fed-cf731bc78be3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.502036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623ed5d-694b-4176-9fed-cf731bc78be3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.503865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623ed5d-694b-4176-9fed-cf731bc78be3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.507277 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3575/7174] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:16.511414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a60e82-9cd7-4f3d-9b80-9bf1bf3b53b1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.520467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a60e82-9cd7-4f3d-9b80-9bf1bf3b53b1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.525273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c298f8-afcd-4f4d-aa02-b0089fc1d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.525839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c298f8-afcd-4f4d-aa02-b0089fc1d84d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.526134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c298f8-afcd-4f4d-aa02-b0089fc1d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.526473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c298f8-afcd-4f4d-aa02-b0089fc1d84d admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.527130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c298f8-afcd-4f4d-aa02-b0089fc1d84d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:16.527433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c298f8-afcd-4f4d-aa02-b0089fc1d84d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.529020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c298f8-afcd-4f4d-aa02-b0089fc1d84d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.537618 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3600/7175] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:16 2022] POST /identity/v3/projects => generated 361 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:16.539026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623ed5d-694b-4176-9fed-cf731bc78be3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.541105 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3576/7176] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:16.545853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c298f8-afcd-4f4d-aa02-b0089fc1d84d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.555988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c298f8-afcd-4f4d-aa02-b0089fc1d84d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.571691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:16.614587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623ed5d-694b-4176-9fed-cf731bc78be3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.619901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24faa-862f-40dd-84bf-02a3cf3a4100 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.621142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24faa-862f-40dd-84bf-02a3cf3a4100 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.621466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24faa-862f-40dd-84bf-02a3cf3a4100 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.621841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24faa-862f-40dd-84bf-02a3cf3a4100 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/a6b5ba695a4047ce97bcfdb69c4b43ad` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.623193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f24faa-862f-40dd-84bf-02a3cf3a4100 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:update_project(project_id=a6b5ba695a4047ce97bcfdb69c4b43ad)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.625345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f24faa-862f-40dd-84bf-02a3cf3a4100 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.640652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1693ba-9ee4-48c1-a5d7-3b69d1ec4cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.641586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1693ba-9ee4-48c1-a5d7-3b69d1ec4cfb admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.642058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1693ba-9ee4-48c1-a5d7-3b69d1ec4cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.642436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1693ba-9ee4-48c1-a5d7-3b69d1ec4cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.643249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1693ba-9ee4-48c1-a5d7-3b69d1ec4cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.645639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1693ba-9ee4-48c1-a5d7-3b69d1ec4cfb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.682581 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3577/7177] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:16 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:16.685994 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3601/7178] 10.222.0.26 () {60 vars in 1252 bytes} [Sat Oct 8 21:20:16 2022] PATCH /identity/v3/projects/a6b5ba695a4047ce97bcfdb69c4b43ad => generated 373 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:16.689804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1693ba-9ee4-48c1-a5d7-3b69d1ec4cfb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.691066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24faa-862f-40dd-84bf-02a3cf3a4100 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.710130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24faa-862f-40dd-84bf-02a3cf3a4100 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.769113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:16.801897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f6f58-6c5d-4080-a003-997afb9a13d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.802921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f6f58-6c5d-4080-a003-997afb9a13d8 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.803273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f6f58-6c5d-4080-a003-997afb9a13d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.804302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f6f58-6c5d-4080-a003-997afb9a13d8 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.805245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f6f58-6c5d-4080-a003-997afb9a13d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.818112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f6f58-6c5d-4080-a003-997afb9a13d8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.827158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1693ba-9ee4-48c1-a5d7-3b69d1ec4cfb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.833014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba571abd-f149-431e-a923-334d3fddbb73 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.833744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571abd-f149-431e-a923-334d3fddbb73 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.834057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571abd-f149-431e-a923-334d3fddbb73 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.834306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571abd-f149-431e-a923-334d3fddbb73 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/a6b5ba695a4047ce97bcfdb69c4b43ad` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.847147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba571abd-f149-431e-a923-334d3fddbb73 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:get_project(project_id=a6b5ba695a4047ce97bcfdb69c4b43ad)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.849223 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3602/7179] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:16 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:16.849365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba571abd-f149-431e-a923-334d3fddbb73 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.851031 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3578/7180] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:20:16 2022] GET /identity/v3/projects/a6b5ba695a4047ce97bcfdb69c4b43ad => generated 360 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:16.855369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba571abd-f149-431e-a923-334d3fddbb73 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.855514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f6f58-6c5d-4080-a003-997afb9a13d8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.866683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba571abd-f149-431e-a923-334d3fddbb73 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.867144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f6f58-6c5d-4080-a003-997afb9a13d8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.881402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.881402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.881655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f699d-35d6-4d8c-9cb6-a991d9659b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.881765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.881765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/a6b5ba695a4047ce97bcfdb69c4b43ad` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.881976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f699d-35d6-4d8c-9cb6-a991d9659b42 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.881976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f699d-35d6-4d8c-9cb6-a991d9659b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.881976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f699d-35d6-4d8c-9cb6-a991d9659b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.882265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a6b5ba695a4047ce97bcfdb69c4b43ad)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.882371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f699d-35d6-4d8c-9cb6-a991d9659b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.882371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f699d-35d6-4d8c-9cb6-a991d9659b42 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.882544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.889523 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3579/7181] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:16.893677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f699d-35d6-4d8c-9cb6-a991d9659b42 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.904802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f699d-35d6-4d8c-9cb6-a991d9659b42 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.910752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb17826-cd67-4c73-bfe9-29d733b2cc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:16.911357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb17826-cd67-4c73-bfe9-29d733b2cc66 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:16.911644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb17826-cd67-4c73-bfe9-29d733b2cc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:16.911949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb17826-cd67-4c73-bfe9-29d733b2cc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:16.912582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb17826-cd67-4c73-bfe9-29d733b2cc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:16.914215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb17826-cd67-4c73-bfe9-29d733b2cc66 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:16.928958 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3580/7182] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:16.930208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb17826-cd67-4c73-bfe9-29d733b2cc66 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.930899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b5ba695a4047ce97bcfdb69c4b43ad', 'request_id': 'req-7566e10a-795c-42c5-8d4b-d4c83227de38'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.941782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb17826-cd67-4c73-bfe9-29d733b2cc66 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:16.942131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b5ba695a4047ce97bcfdb69c4b43ad', 'request_id': 'req-7566e10a-795c-42c5-8d4b-d4c83227de38'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.949034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b5ba695a4047ce97bcfdb69c4b43ad', 'request_id': 'req-7566e10a-795c-42c5-8d4b-d4c83227de38'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.961467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project a6b5ba695a4047ce97bcfdb69c4b43ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:16.961797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.962668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:16.965464 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3603/7183] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:16 2022] DELETE /identity/v3/projects/a6b5ba695a4047ce97bcfdb69c4b43ad => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:16.970344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:16.971903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:17.013564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b3f76-ee67-43d9-a8e8-33d3c101fbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.014524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b3f76-ee67-43d9-a8e8-33d3c101fbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.014807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b3f76-ee67-43d9-a8e8-33d3c101fbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.015174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b3f76-ee67-43d9-a8e8-33d3c101fbfe admin admin] PATH_INFO: `/v3/projects/4b697eef36e34d1f9bd41f249415de68/users/03fc0111e2c74a3fabce75ea464c6de5/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.032307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b3f76-ee67-43d9-a8e8-33d3c101fbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b697eef36e34d1f9bd41f249415de68, user_id=03fc0111e2c74a3fabce75ea464c6de5, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:17.035272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b3f76-ee67-43d9-a8e8-33d3c101fbfe admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:17.038950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:17.055113 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3581/7184] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:16 2022] PUT /identity/v3/projects/4b697eef36e34d1f9bd41f249415de68/users/03fc0111e2c74a3fabce75ea464c6de5/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:17.056543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566e10a-795c-42c5-8d4b-d4c83227de38 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.067225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f376-37aa-45f8-8cb7-f5df4069d4f9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.067589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f376-37aa-45f8-8cb7-f5df4069d4f9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.067807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f376-37aa-45f8-8cb7-f5df4069d4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.099938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e4e5f376-37aa-45f8-8cb7-f5df4069d4f9 None None] MFA Rules not processed for user `03fc0111e2c74a3fabce75ea464c6de5`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:17.101110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e4e5f376-37aa-45f8-8cb7-f5df4069d4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:17.125664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa2b5c-1841-4a39-a83d-7872aff03b26 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.126366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa2b5c-1841-4a39-a83d-7872aff03b26 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.126642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa2b5c-1841-4a39-a83d-7872aff03b26 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.126916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa2b5c-1841-4a39-a83d-7872aff03b26 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.127540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa2b5c-1841-4a39-a83d-7872aff03b26 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:17.129412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa2b5c-1841-4a39-a83d-7872aff03b26 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:17.135008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:17.191765 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3604/7185] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:16 2022] POST /identity/v3/projects => generated 355 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:17.198927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa2b5c-1841-4a39-a83d-7872aff03b26 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.202578 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3582/7186] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:17.206805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f376-37aa-45f8-8cb7-f5df4069d4f9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.208116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e4e5f376-37aa-45f8-8cb7-f5df4069d4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:17.266353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa2b5c-1841-4a39-a83d-7872aff03b26 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.271023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1dac8-5759-404f-a954-5fd6919454bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.271647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1dac8-5759-404f-a954-5fd6919454bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.271930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1dac8-5759-404f-a954-5fd6919454bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.272205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1dac8-5759-404f-a954-5fd6919454bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/0f9550b04a68487aa562e473a77eb460` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.273497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1dac8-5759-404f-a954-5fd6919454bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:update_project(project_id=0f9550b04a68487aa562e473a77eb460)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:17.274701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f376-37aa-45f8-8cb7-f5df4069d4f9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.275574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1dac8-5759-404f-a954-5fd6919454bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:17.309971 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3605/7187] 10.222.0.26 () {60 vars in 1252 bytes} [Sat Oct 8 21:20:17 2022] PATCH /identity/v3/projects/0f9550b04a68487aa562e473a77eb460 => generated 369 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:17.313849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1dac8-5759-404f-a954-5fd6919454bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.323582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1dac8-5759-404f-a954-5fd6919454bc tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.328488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a747-6a45-423e-9735-7676966c7c83 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.329233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a747-6a45-423e-9735-7676966c7c83 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.329527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a747-6a45-423e-9735-7676966c7c83 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.329807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a747-6a45-423e-9735-7676966c7c83 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/0f9550b04a68487aa562e473a77eb460` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.334317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9446d-bd0f-4a3e-b0d4-b4afcf4df778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.334924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9446d-bd0f-4a3e-b0d4-b4afcf4df778 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.335200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9446d-bd0f-4a3e-b0d4-b4afcf4df778 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.335470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9446d-bd0f-4a3e-b0d4-b4afcf4df778 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.336090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9446d-bd0f-4a3e-b0d4-b4afcf4df778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:17.338058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9446d-bd0f-4a3e-b0d4-b4afcf4df778 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:17.340881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1a747-6a45-423e-9735-7676966c7c83 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:get_project(project_id=0f9550b04a68487aa562e473a77eb460)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:17.342968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1a747-6a45-423e-9735-7676966c7c83 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:17.347596 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3606/7188] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:20:17 2022] GET /identity/v3/projects/0f9550b04a68487aa562e473a77eb460 => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:17.348556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a747-6a45-423e-9735-7676966c7c83 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.360173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a747-6a45-423e-9735-7676966c7c83 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.365292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.365909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.366194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.366316 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3583/7189] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:17 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:17.366814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/projects/0f9550b04a68487aa562e473a77eb460` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.367629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f9550b04a68487aa562e473a77eb460)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:17.369678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:17.370212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9446d-bd0f-4a3e-b0d4-b4afcf4df778 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.389612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:17.418672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f9550b04a68487aa562e473a77eb460', 'request_id': 'req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:17.426338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f9550b04a68487aa562e473a77eb460', 'request_id': 'req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:17.432356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f9550b04a68487aa562e473a77eb460', 'request_id': 'req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:17.435434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9446d-bd0f-4a3e-b0d4-b4afcf4df778 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.444530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] The token cache is being invalidate because project 0f9550b04a68487aa562e473a77eb460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:17.444822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:17.445593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:17.447121 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3607/7190] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:17 2022] DELETE /identity/v3/projects/0f9550b04a68487aa562e473a77eb460 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:17.452565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.454682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:17.494081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:17.502419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c0364-b796-43af-bef8-153d0e69b455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.503032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c0364-b796-43af-bef8-153d0e69b455 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.503309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c0364-b796-43af-bef8-153d0e69b455 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.503647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c0364-b796-43af-bef8-153d0e69b455 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.504345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c0364-b796-43af-bef8-153d0e69b455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:17.506336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c0364-b796-43af-bef8-153d0e69b455 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:17.529222 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3584/7191] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:17 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:17.529415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd59ad-8f09-4fe5-9669-52bd37e13c32 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.532977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c0364-b796-43af-bef8-153d0e69b455 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.534346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3d98d-80b8-45f3-b478-a2ff24fa3cf3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.534841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f16c0364-b796-43af-bef8-153d0e69b455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:17.535010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3d98d-80b8-45f3-b478-a2ff24fa3cf3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.535246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3d98d-80b8-45f3-b478-a2ff24fa3cf3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.535533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3d98d-80b8-45f3-b478-a2ff24fa3cf3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/domains/e797f393d4be498a8c344f54ab187ee9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.543117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3d98d-80b8-45f3-b478-a2ff24fa3cf3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:20:17.546482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c0364-b796-43af-bef8-153d0e69b455 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-06f3d98d-80b8-45f3-b478-a2ff24fa3cf3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Could not find domain: e797f393d4be498a8c344f54ab187ee9.: keystone.exception.DomainNotFound: Could not find domain: e797f393d4be498a8c344f54ab187ee9. Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e797f393d4be498a8c344f54ab187ee9. Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:20:17.547872 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:20:17.549270 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e797f393d4be498a8c344f54ab187ee9. Oct 08 21:20:17.550513 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:20:17.552580 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3608/7192] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:20:17 2022] PATCH /identity/v3/domains/e797f393d4be498a8c344f54ab187ee9 => generated 112 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 08 21:20:17.555085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d2dde-4b82-49c0-9df0-c770cba9a7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.555799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d2dde-4b82-49c0-9df0-c770cba9a7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.556081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d2dde-4b82-49c0-9df0-c770cba9a7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.556353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d2dde-4b82-49c0-9df0-c770cba9a7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.556467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3d98d-80b8-45f3-b478-a2ff24fa3cf3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.556998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d2dde-4b82-49c0-9df0-c770cba9a7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:17.559183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d2dde-4b82-49c0-9df0-c770cba9a7b6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:17.567935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3d98d-80b8-45f3-b478-a2ff24fa3cf3 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.569655 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3585/7193] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:17.574309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d2dde-4b82-49c0-9df0-c770cba9a7b6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.576047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fc9a7-007b-4345-8ef0-7916cf210966 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5788b75346d546eea0ff324a7fc6c0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e310a39896324e66bebcd7803ac3d01c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.576901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fc9a7-007b-4345-8ef0-7916cf210966 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.577112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fc9a7-007b-4345-8ef0-7916cf210966 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.577441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fc9a7-007b-4345-8ef0-7916cf210966 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] PATH_INFO: `/v3/domains/e0778dfaa4fa4ff5bed98a3c5fda00b1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.586624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fc9a7-007b-4345-8ef0-7916cf210966 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:20:17.586786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d2dde-4b82-49c0-9df0-c770cba9a7b6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-e56fc9a7-007b-4345-8ef0-7916cf210966 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Could not find domain: e0778dfaa4fa4ff5bed98a3c5fda00b1.: keystone.exception.DomainNotFound: Could not find domain: e0778dfaa4fa4ff5bed98a3c5fda00b1. Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e0778dfaa4fa4ff5bed98a3c5fda00b1. Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:20:17.591859 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:20:17.592940 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e0778dfaa4fa4ff5bed98a3c5fda00b1. Oct 08 21:20:17.594401 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:20:17.595451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ef761-26bc-4b2a-9b14-7a0a8de31b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.595451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ef761-26bc-4b2a-9b14-7a0a8de31b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.595451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ef761-26bc-4b2a-9b14-7a0a8de31b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.595894 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3609/7194] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:20:17 2022] PATCH /identity/v3/domains/e0778dfaa4fa4ff5bed98a3c5fda00b1 => generated 112 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:20:17.595987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ef761-26bc-4b2a-9b14-7a0a8de31b9b admin admin] PATH_INFO: `/v3/projects/43f9a422917c4ba986a4f3e436dea2bd/users/d8ed1c3de3f448aab86a99d68320730d/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.596894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fc9a7-007b-4345-8ef0-7916cf210966 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.598573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e56fc9a7-007b-4345-8ef0-7916cf210966 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:17.610632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ef761-26bc-4b2a-9b14-7a0a8de31b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f9a422917c4ba986a4f3e436dea2bd, user_id=d8ed1c3de3f448aab86a99d68320730d, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:17.613376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fc9a7-007b-4345-8ef0-7916cf210966 tempest-ProjectsTestJSON-348852989 tempest-ProjectsTestJSON-348852989-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.613519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ef761-26bc-4b2a-9b14-7a0a8de31b9b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:17.618306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce5a34-0159-404d-877b-3497e93e2067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.619093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5a34-0159-404d-877b-3497e93e2067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.619379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5a34-0159-404d-877b-3497e93e2067 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.619657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5a34-0159-404d-877b-3497e93e2067 admin admin] PATH_INFO: `/v3/users/acc7212219b04e279b326ae0dbf5f2db` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.621499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce5a34-0159-404d-877b-3497e93e2067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc7212219b04e279b326ae0dbf5f2db)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:17.623501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce5a34-0159-404d-877b-3497e93e2067 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:17.627033 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3586/7195] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:17 2022] PUT /identity/v3/projects/43f9a422917c4ba986a4f3e436dea2bd/users/d8ed1c3de3f448aab86a99d68320730d/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:17.630963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ef761-26bc-4b2a-9b14-7a0a8de31b9b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.676551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ebce5a34-0159-404d-877b-3497e93e2067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc7212219b04e279b326ae0dbf5f2db'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:17.683911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ebce5a34-0159-404d-877b-3497e93e2067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc7212219b04e279b326ae0dbf5f2db'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:17.685021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ebce5a34-0159-404d-877b-3497e93e2067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc7212219b04e279b326ae0dbf5f2db'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:17.685817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ebce5a34-0159-404d-877b-3497e93e2067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc7212219b04e279b326ae0dbf5f2db'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:17.695341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ef761-26bc-4b2a-9b14-7a0a8de31b9b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.698956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ebce5a34-0159-404d-877b-3497e93e2067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc7212219b04e279b326ae0dbf5f2db'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:17.700075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435732d8-3452-4e9a-989c-910513131714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.700678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435732d8-3452-4e9a-989c-910513131714 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.700957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435732d8-3452-4e9a-989c-910513131714 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.701287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435732d8-3452-4e9a-989c-910513131714 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.701927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435732d8-3452-4e9a-989c-910513131714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:17.703752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435732d8-3452-4e9a-989c-910513131714 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:17.712918 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3610/7196] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:17 2022] DELETE /identity/v3/users/acc7212219b04e279b326ae0dbf5f2db => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:17.717219 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3587/7197] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:17.718027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bc4de-20cb-4841-b8ea-23f1f8016e00 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.718325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bc4de-20cb-4841-b8ea-23f1f8016e00 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.718603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bc4de-20cb-4841-b8ea-23f1f8016e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.721097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435732d8-3452-4e9a-989c-910513131714 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.722783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-435732d8-3452-4e9a-989c-910513131714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:17.736272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435732d8-3452-4e9a-989c-910513131714 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.738665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-634bc4de-20cb-4841-b8ea-23f1f8016e00 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:17.739853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-634bc4de-20cb-4841-b8ea-23f1f8016e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:17.748408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:17.799842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7252c11-936d-40f0-bc5a-10f6c59abebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.800505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7252c11-936d-40f0-bc5a-10f6c59abebc admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.800628 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3611/7198] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:17.800837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7252c11-936d-40f0-bc5a-10f6c59abebc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.801136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7252c11-936d-40f0-bc5a-10f6c59abebc admin admin] PATH_INFO: `/v3/projects/43f9a422917c4ba986a4f3e436dea2bd/users/d8ed1c3de3f448aab86a99d68320730d/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.803185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7252c11-936d-40f0-bc5a-10f6c59abebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f9a422917c4ba986a4f3e436dea2bd, user_id=d8ed1c3de3f448aab86a99d68320730d, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:17.805943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7252c11-936d-40f0-bc5a-10f6c59abebc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:17.811042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bc4de-20cb-4841-b8ea-23f1f8016e00 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.812395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-634bc4de-20cb-4841-b8ea-23f1f8016e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:17.816964 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3588/7199] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:17 2022] PUT /identity/v3/projects/43f9a422917c4ba986a4f3e436dea2bd/users/d8ed1c3de3f448aab86a99d68320730d/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:17.827740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6deab2-33c8-46d3-8c86-ce00d321bfd6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.828026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6deab2-33c8-46d3-8c86-ce00d321bfd6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.828306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6deab2-33c8-46d3-8c86-ce00d321bfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.860582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:17.863840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0f6deab2-33c8-46d3-8c86-ce00d321bfd6 None None] MFA Rules not processed for user `d8ed1c3de3f448aab86a99d68320730d`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:17.865479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0f6deab2-33c8-46d3-8c86-ce00d321bfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:17.882367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bc4de-20cb-4841-b8ea-23f1f8016e00 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:17.959732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f008cc-1112-45cc-8728-281f2a092c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:17.960569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f008cc-1112-45cc-8728-281f2a092c48 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:17.960855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f008cc-1112-45cc-8728-281f2a092c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:17.961134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f008cc-1112-45cc-8728-281f2a092c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:17.974737 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3589/7200] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:17.986232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6deab2-33c8-46d3-8c86-ce00d321bfd6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:17.988036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0f6deab2-33c8-46d3-8c86-ce00d321bfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:18.046520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f008cc-1112-45cc-8728-281f2a092c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:18.048538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f008cc-1112-45cc-8728-281f2a092c48 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:18.060672 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3612/7201] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:20:18.072327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6deab2-33c8-46d3-8c86-ce00d321bfd6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:18.076261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe012f2-7d9b-4cdc-a8b1-f225ea8eed3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:18.076903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe012f2-7d9b-4cdc-a8b1-f225ea8eed3d service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:18.077207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe012f2-7d9b-4cdc-a8b1-f225ea8eed3d service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:18.077491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe012f2-7d9b-4cdc-a8b1-f225ea8eed3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:18.088561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe012f2-7d9b-4cdc-a8b1-f225ea8eed3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:18.090157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe012f2-7d9b-4cdc-a8b1-f225ea8eed3d service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:18.101951 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3590/7202] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:20:18.396230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f008cc-1112-45cc-8728-281f2a092c48 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:18.398514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-82f008cc-1112-45cc-8728-281f2a092c48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:18.417919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f008cc-1112-45cc-8728-281f2a092c48 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:18.425126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:18.426808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:18.427491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:18.427763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] PATH_INFO: `/v3/projects/c0cf43baaa7d425e912989d8eebaed1f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:18.428928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0cf43baaa7d425e912989d8eebaed1f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:18.430891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:18.508058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0cf43baaa7d425e912989d8eebaed1f', 'request_id': 'req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.519125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0cf43baaa7d425e912989d8eebaed1f', 'request_id': 'req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.527821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0cf43baaa7d425e912989d8eebaed1f', 'request_id': 'req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.540194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] The token cache is being invalidate because project c0cf43baaa7d425e912989d8eebaed1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:18.540565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.541331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.543512 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3613/7203] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:18 2022] DELETE /identity/v3/projects/c0cf43baaa7d425e912989d8eebaed1f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:18.547651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe012f2-7d9b-4cdc-a8b1-f225ea8eed3d service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:18.560847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe012f2-7d9b-4cdc-a8b1-f225ea8eed3d service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:18.602196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:18.622764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:18.624305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:18.634356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0eced-3300-4007-9e8c-525c5181ecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:18.635191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0eced-3300-4007-9e8c-525c5181ecbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:18.635570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0eced-3300-4007-9e8c-525c5181ecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:18.636442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0eced-3300-4007-9e8c-525c5181ecbf admin admin] PATH_INFO: `/v3/users/5788b75346d546eea0ff324a7fc6c0d4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:18.637733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0eced-3300-4007-9e8c-525c5181ecbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5788b75346d546eea0ff324a7fc6c0d4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:18.639745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0eced-3300-4007-9e8c-525c5181ecbf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:18.658205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:18.697571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5ba0eced-3300-4007-9e8c-525c5181ecbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5788b75346d546eea0ff324a7fc6c0d4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.705561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5ba0eced-3300-4007-9e8c-525c5181ecbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5788b75346d546eea0ff324a7fc6c0d4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.706244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5ba0eced-3300-4007-9e8c-525c5181ecbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5788b75346d546eea0ff324a7fc6c0d4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.706871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5ba0eced-3300-4007-9e8c-525c5181ecbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5788b75346d546eea0ff324a7fc6c0d4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.709065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbed8d5-9761-4011-b941-1b3a0fe40b0a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:18.715213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:18.715860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:18.716142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:18.716422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] PATH_INFO: `/v3/users/03fc0111e2c74a3fabce75ea464c6de5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:18.717846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fc0111e2c74a3fabce75ea464c6de5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:18.720458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5ba0eced-3300-4007-9e8c-525c5181ecbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5788b75346d546eea0ff324a7fc6c0d4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.720798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:18.737242 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3591/7204] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:18 2022] DELETE /identity/v3/users/5788b75346d546eea0ff324a7fc6c0d4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:18.788643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fc0111e2c74a3fabce75ea464c6de5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.796925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fc0111e2c74a3fabce75ea464c6de5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.797777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fc0111e2c74a3fabce75ea464c6de5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.798397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fc0111e2c74a3fabce75ea464c6de5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.813222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fc0111e2c74a3fabce75ea464c6de5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:18.828418 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3614/7205] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:18 2022] DELETE /identity/v3/users/03fc0111e2c74a3fabce75ea464c6de5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:18.832873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151d4b-31d0-4562-8a69-8943f6b95be3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:18.833309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151d4b-31d0-4562-8a69-8943f6b95be3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:18.833462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151d4b-31d0-4562-8a69-8943f6b95be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:18.855442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b6151d4b-31d0-4562-8a69-8943f6b95be3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:18.856680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b6151d4b-31d0-4562-8a69-8943f6b95be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:18.940487 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3592/7206] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:18.950464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:18.951882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:19.023024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33229ea-b69e-4744-9ef5-c21efa183092 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:19.027732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c05ea-7023-42a0-b524-4815ea3bc100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:19.028401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c05ea-7023-42a0-b524-4815ea3bc100 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:19.028686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c05ea-7023-42a0-b524-4815ea3bc100 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:19.028966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c05ea-7023-42a0-b524-4815ea3bc100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:19.040268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c05ea-7023-42a0-b524-4815ea3bc100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:19.041823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c05ea-7023-42a0-b524-4815ea3bc100 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:19.046356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6151d4b-31d0-4562-8a69-8943f6b95be3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:19.047712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b6151d4b-31d0-4562-8a69-8943f6b95be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:19.066622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6151d4b-31d0-4562-8a69-8943f6b95be3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:19.072391 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3615/7207] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:19.075546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f73bec-554a-412b-b630-cc3eed0b6cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:19.076193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f73bec-554a-412b-b630-cc3eed0b6cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:19.076468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f73bec-554a-412b-b630-cc3eed0b6cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:19.077480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f73bec-554a-412b-b630-cc3eed0b6cc6 admin admin] PATH_INFO: `/v3/projects/e310a39896324e66bebcd7803ac3d01c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:19.078655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f73bec-554a-412b-b630-cc3eed0b6cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e310a39896324e66bebcd7803ac3d01c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:19.080724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f73bec-554a-412b-b630-cc3eed0b6cc6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:19.142253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-89f73bec-554a-412b-b630-cc3eed0b6cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e310a39896324e66bebcd7803ac3d01c', 'request_id': 'req-89f73bec-554a-412b-b630-cc3eed0b6cc6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:19.144960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:19.154159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-89f73bec-554a-412b-b630-cc3eed0b6cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e310a39896324e66bebcd7803ac3d01c', 'request_id': 'req-89f73bec-554a-412b-b630-cc3eed0b6cc6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:19.163449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-89f73bec-554a-412b-b630-cc3eed0b6cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e310a39896324e66bebcd7803ac3d01c', 'request_id': 'req-89f73bec-554a-412b-b630-cc3eed0b6cc6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:19.177851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-89f73bec-554a-412b-b630-cc3eed0b6cc6 admin admin] The token cache is being invalidate because project e310a39896324e66bebcd7803ac3d01c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:19.178144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-89f73bec-554a-412b-b630-cc3eed0b6cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:19.178850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-89f73bec-554a-412b-b630-cc3eed0b6cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:19.180522 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3593/7208] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:19 2022] DELETE /identity/v3/projects/e310a39896324e66bebcd7803ac3d01c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:19.186248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9d2ab-5923-47c3-9c67-554d7547652a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:19.186818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9d2ab-5923-47c3-9c67-554d7547652a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:19.188548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9d2ab-5923-47c3-9c67-554d7547652a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:19.220044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-edf9d2ab-5923-47c3-9c67-554d7547652a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:19.221449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-edf9d2ab-5923-47c3-9c67-554d7547652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:19.315450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:19.361585 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3616/7209] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:19.369919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27200-400c-40f9-abe9-0e8c1e877248 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:19.370305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27200-400c-40f9-abe9-0e8c1e877248 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:19.371109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27200-400c-40f9-abe9-0e8c1e877248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:19.434785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f3e27200-400c-40f9-abe9-0e8c1e877248 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:19.437610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f3e27200-400c-40f9-abe9-0e8c1e877248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:19.462460 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3594/7210] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:19.466819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9d2ab-5923-47c3-9c67-554d7547652a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:19.490769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9d2ab-5923-47c3-9c67-554d7547652a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:19.497833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe356a-81f9-4aad-8114-890254549aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:19.498470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe356a-81f9-4aad-8114-890254549aaf admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:19.498776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe356a-81f9-4aad-8114-890254549aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:19.499077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe356a-81f9-4aad-8114-890254549aaf admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:19.499750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe356a-81f9-4aad-8114-890254549aaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:19.500060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe356a-81f9-4aad-8114-890254549aaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:19.501789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe356a-81f9-4aad-8114-890254549aaf admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:19.541965 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3617/7211] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:19.547729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e27200-400c-40f9-abe9-0e8c1e877248 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:19.560561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e27200-400c-40f9-abe9-0e8c1e877248 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:19.565740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe2b47-ca80-4980-b555-eb3912e6acca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:19.566384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe2b47-ca80-4980-b555-eb3912e6acca admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:19.566732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe2b47-ca80-4980-b555-eb3912e6acca admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:19.567225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe2b47-ca80-4980-b555-eb3912e6acca admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:19.567687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe2b47-ca80-4980-b555-eb3912e6acca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:19.569707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe2b47-ca80-4980-b555-eb3912e6acca admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:19.599236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe356a-81f9-4aad-8114-890254549aaf admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:19.601496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-72fe356a-81f9-4aad-8114-890254549aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:19.617063 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3595/7212] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:19 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:19.621629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe2b47-ca80-4980-b555-eb3912e6acca admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:19.629320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe356a-81f9-4aad-8114-890254549aaf admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:19.710364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe2b47-ca80-4980-b555-eb3912e6acca admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:19.716389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ec91b-add6-4cd6-a3de-1b8bd01b7353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:19.717038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ec91b-add6-4cd6-a3de-1b8bd01b7353 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:19.717419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ec91b-add6-4cd6-a3de-1b8bd01b7353 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:19.717754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ec91b-add6-4cd6-a3de-1b8bd01b7353 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:19.718396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ec91b-add6-4cd6-a3de-1b8bd01b7353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:19.720962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ec91b-add6-4cd6-a3de-1b8bd01b7353 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:19.725662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:19.726710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:19.727157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:19.727592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] PATH_INFO: `/v3/projects/4b697eef36e34d1f9bd41f249415de68` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:19.729303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b697eef36e34d1f9bd41f249415de68)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:19.732815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:19.753123 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3596/7213] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:19 2022] POST /identity/v3/users => generated 284 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:19.757157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ec91b-add6-4cd6-a3de-1b8bd01b7353 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:19.774339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ec91b-add6-4cd6-a3de-1b8bd01b7353 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:19.780749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b553d39-bca7-4c00-9a7e-50aef5fd27f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:19.781589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b553d39-bca7-4c00-9a7e-50aef5fd27f3 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:19.781944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b553d39-bca7-4c00-9a7e-50aef5fd27f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:19.782310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b553d39-bca7-4c00-9a7e-50aef5fd27f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:19.783126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b553d39-bca7-4c00-9a7e-50aef5fd27f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:19.785378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b553d39-bca7-4c00-9a7e-50aef5fd27f3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:19.799737 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3597/7214] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:19.803962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b553d39-bca7-4c00-9a7e-50aef5fd27f3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:19.817449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b697eef36e34d1f9bd41f249415de68', 'request_id': 'req-d9346808-42eb-46c3-8839-abd653b98f93'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:19.823295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b553d39-bca7-4c00-9a7e-50aef5fd27f3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:19.828960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b697eef36e34d1f9bd41f249415de68', 'request_id': 'req-d9346808-42eb-46c3-8839-abd653b98f93'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:19.838365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b697eef36e34d1f9bd41f249415de68', 'request_id': 'req-d9346808-42eb-46c3-8839-abd653b98f93'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:19.852574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] The token cache is being invalidate because project 4b697eef36e34d1f9bd41f249415de68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:19.852797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:19.853682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:19.859760 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3618/7215] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:19 2022] DELETE /identity/v3/projects/4b697eef36e34d1f9bd41f249415de68 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:19.860988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:19.863427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:19.912777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23068276-6e13-4dc5-aced-99757a1ee25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:19.913971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23068276-6e13-4dc5-aced-99757a1ee25d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:19.914256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23068276-6e13-4dc5-aced-99757a1ee25d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:19.914560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23068276-6e13-4dc5-aced-99757a1ee25d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:19.916034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23068276-6e13-4dc5-aced-99757a1ee25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:19.918004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23068276-6e13-4dc5-aced-99757a1ee25d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:19.934298 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3598/7216] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:19.935174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23068276-6e13-4dc5-aced-99757a1ee25d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:19.937388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-23068276-6e13-4dc5-aced-99757a1ee25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:19.950342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23068276-6e13-4dc5-aced-99757a1ee25d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:19.955724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770fb73-1a54-4242-8178-fb172cc10b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:19.956804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770fb73-1a54-4242-8178-fb172cc10b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:19.956944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770fb73-1a54-4242-8178-fb172cc10b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:19.957116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770fb73-1a54-4242-8178-fb172cc10b27 admin admin] PATH_INFO: `/v3/projects/2405c4dcd0544ef497c9a9b33de34fda/users/484b4f5467de44f7b4131da88f3f2c62/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:19.976123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770fb73-1a54-4242-8178-fb172cc10b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2405c4dcd0544ef497c9a9b33de34fda, user_id=484b4f5467de44f7b4131da88f3f2c62, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:19.978493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9346808-42eb-46c3-8839-abd653b98f93 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:19.979194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770fb73-1a54-4242-8178-fb172cc10b27 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:19.985174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2524a-56b2-4025-a7c0-a4652a9ece15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:19.986095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2524a-56b2-4025-a7c0-a4652a9ece15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:19.986481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2524a-56b2-4025-a7c0-a4652a9ece15 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:19.986767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2524a-56b2-4025-a7c0-a4652a9ece15 admin admin] PATH_INFO: `/v3/users/d8ed1c3de3f448aab86a99d68320730d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:19.988751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2524a-56b2-4025-a7c0-a4652a9ece15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ed1c3de3f448aab86a99d68320730d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:19.991164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2524a-56b2-4025-a7c0-a4652a9ece15 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:19.999893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:20.005272 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3599/7217] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:19 2022] PUT /identity/v3/projects/2405c4dcd0544ef497c9a9b33de34fda/users/484b4f5467de44f7b4131da88f3f2c62/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:20.012038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf6179-5049-4dc0-b06b-424d58588c3b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:20.012431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf6179-5049-4dc0-b06b-424d58588c3b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:20.013022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf6179-5049-4dc0-b06b-424d58588c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:20.021074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:20.046993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-40bf6179-5049-4dc0-b06b-424d58588c3b None None] MFA Rules not processed for user `484b4f5467de44f7b4131da88f3f2c62`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:20.048204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-40bf6179-5049-4dc0-b06b-424d58588c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:20.051521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-19a2524a-56b2-4025-a7c0-a4652a9ece15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ed1c3de3f448aab86a99d68320730d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:20.059569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-19a2524a-56b2-4025-a7c0-a4652a9ece15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ed1c3de3f448aab86a99d68320730d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:20.060282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-19a2524a-56b2-4025-a7c0-a4652a9ece15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ed1c3de3f448aab86a99d68320730d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:20.061093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-19a2524a-56b2-4025-a7c0-a4652a9ece15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ed1c3de3f448aab86a99d68320730d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:20.074236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-19a2524a-56b2-4025-a7c0-a4652a9ece15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ed1c3de3f448aab86a99d68320730d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:20.088327 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3619/7218] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:19 2022] DELETE /identity/v3/users/d8ed1c3de3f448aab86a99d68320730d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:20.092825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86072789-3252-4247-ba00-cd678a788b72 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:20.093114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86072789-3252-4247-ba00-cd678a788b72 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:20.093531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86072789-3252-4247-ba00-cd678a788b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:20.116216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-86072789-3252-4247-ba00-cd678a788b72 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:20.117567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-86072789-3252-4247-ba00-cd678a788b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:20.121332 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3600/7219] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:20.124639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf6179-5049-4dc0-b06b-424d58588c3b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:20.126910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-40bf6179-5049-4dc0-b06b-424d58588c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:20.210340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf6179-5049-4dc0-b06b-424d58588c3b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:20.215518 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3620/7220] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:20:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:20.233757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86072789-3252-4247-ba00-cd678a788b72 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:20.235325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-86072789-3252-4247-ba00-cd678a788b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:20.285748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505645f0-1387-40cb-8b63-8b29e7f2795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:20.286382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505645f0-1387-40cb-8b63-8b29e7f2795f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:20.286669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505645f0-1387-40cb-8b63-8b29e7f2795f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:20.287364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505645f0-1387-40cb-8b63-8b29e7f2795f admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:20.287559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505645f0-1387-40cb-8b63-8b29e7f2795f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:20.289743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505645f0-1387-40cb-8b63-8b29e7f2795f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:20.325275 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3601/7221] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:20 2022] POST /identity/v3/projects => generated 367 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:20.326966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505645f0-1387-40cb-8b63-8b29e7f2795f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:20.339232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86072789-3252-4247-ba00-cd678a788b72 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:20.343341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:20.370829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:20.423819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251eb92-3cc6-4b75-8481-bca84866ecee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:20.424524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251eb92-3cc6-4b75-8481-bca84866ecee service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:20.424995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251eb92-3cc6-4b75-8481-bca84866ecee service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:20.425383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251eb92-3cc6-4b75-8481-bca84866ecee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:20.448765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505645f0-1387-40cb-8b63-8b29e7f2795f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:20.457465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63774a35-066b-465e-bcff-11f323424662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:20.458153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63774a35-066b-465e-bcff-11f323424662 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:20.458441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63774a35-066b-465e-bcff-11f323424662 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:20.458846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63774a35-066b-465e-bcff-11f323424662 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:20.459710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63774a35-066b-465e-bcff-11f323424662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:20.461995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63774a35-066b-465e-bcff-11f323424662 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:20.491597 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3602/7222] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:20 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:20.492824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63774a35-066b-465e-bcff-11f323424662 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:20.495059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-63774a35-066b-465e-bcff-11f323424662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:20.507744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63774a35-066b-465e-bcff-11f323424662 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:20.512747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251eb92-3cc6-4b75-8481-bca84866ecee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:20.512923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:20.513527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:20.513809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:20.514081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2 admin admin] PATH_INFO: `/v3/projects/43f9a422917c4ba986a4f3e436dea2bd` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:20.514366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251eb92-3cc6-4b75-8481-bca84866ecee service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:20.515278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f9a422917c4ba986a4f3e436dea2bd)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:20.517159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:20.523498 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3621/7223] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:20:20.524944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251eb92-3cc6-4b75-8481-bca84866ecee service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:20.536948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251eb92-3cc6-4b75-8481-bca84866ecee service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:20.546698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ce3fe-99b2-486d-8fa3-5bd6176621ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:20.547321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ce3fe-99b2-486d-8fa3-5bd6176621ca admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:20.547601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ce3fe-99b2-486d-8fa3-5bd6176621ca admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:20.547871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ce3fe-99b2-486d-8fa3-5bd6176621ca admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:20.548511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ce3fe-99b2-486d-8fa3-5bd6176621ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:20.550141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ce3fe-99b2-486d-8fa3-5bd6176621ca admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:20.563291 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3622/7224] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:20.567970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ce3fe-99b2-486d-8fa3-5bd6176621ca admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:20.579947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ce3fe-99b2-486d-8fa3-5bd6176621ca admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:20.589999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f9a422917c4ba986a4f3e436dea2bd', 'request_id': 'req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:20.605173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f9a422917c4ba986a4f3e436dea2bd', 'request_id': 'req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:20.612998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f9a422917c4ba986a4f3e436dea2bd', 'request_id': 'req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:20.629454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2 admin admin] The token cache is being invalidate because project 43f9a422917c4ba986a4f3e436dea2bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:20.629755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:20.630649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-78b0c37c-7238-46f0-b7e0-d06d2823d7d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:20.636628 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3603/7225] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:20 2022] DELETE /identity/v3/projects/43f9a422917c4ba986a4f3e436dea2bd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:20.638067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae79599-cf20-46b1-9076-d518ed622733 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:20.638359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae79599-cf20-46b1-9076-d518ed622733 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:20.638637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae79599-cf20-46b1-9076-d518ed622733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:20.666343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8ae79599-cf20-46b1-9076-d518ed622733 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:20.668274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8ae79599-cf20-46b1-9076-d518ed622733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:20.688412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a09297-5b33-47ed-aaaa-0fe0d6cd52b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:20.689508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a09297-5b33-47ed-aaaa-0fe0d6cd52b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:20.690355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a09297-5b33-47ed-aaaa-0fe0d6cd52b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:20.690764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a09297-5b33-47ed-aaaa-0fe0d6cd52b4 admin admin] PATH_INFO: `/v3/projects/130695f407914fac818eca42619084d1/users/aecc991f49db461e93a451decbe3e7a8/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:20.714472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a09297-5b33-47ed-aaaa-0fe0d6cd52b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130695f407914fac818eca42619084d1, user_id=aecc991f49db461e93a451decbe3e7a8, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:20.720910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a09297-5b33-47ed-aaaa-0fe0d6cd52b4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:20.744012 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3623/7226] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:20 2022] PUT /identity/v3/projects/130695f407914fac818eca42619084d1/users/aecc991f49db461e93a451decbe3e7a8/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:20.748872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a09297-5b33-47ed-aaaa-0fe0d6cd52b4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:20.751372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-27a09297-5b33-47ed-aaaa-0fe0d6cd52b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:20.764977 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3604/7227] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:20.772744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0fc2e-01d1-450f-b647-a8c2d271dfa0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:20.773102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0fc2e-01d1-450f-b647-a8c2d271dfa0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:20.773488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0fc2e-01d1-450f-b647-a8c2d271dfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:20.779546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:20.803560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9ec0fc2e-01d1-450f-b647-a8c2d271dfa0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:20.805655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9ec0fc2e-01d1-450f-b647-a8c2d271dfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:20.847114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a09297-5b33-47ed-aaaa-0fe0d6cd52b4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:20.849588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:20.855721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2cf9a-2d3c-48c4-a7e2-c0a3e5a74c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:20.856512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2cf9a-2d3c-48c4-a7e2-c0a3e5a74c3b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:20.856954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2cf9a-2d3c-48c4-a7e2-c0a3e5a74c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:20.857341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2cf9a-2d3c-48c4-a7e2-c0a3e5a74c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:20.858216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2cf9a-2d3c-48c4-a7e2-c0a3e5a74c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:20.860067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2cf9a-2d3c-48c4-a7e2-c0a3e5a74c3b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:20.876158 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3624/7228] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:20.880161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2cf9a-2d3c-48c4-a7e2-c0a3e5a74c3b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:20.897336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2cf9a-2d3c-48c4-a7e2-c0a3e5a74c3b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:20.904992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c657c0-de0e-4457-a997-60c0a69995ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:20.906285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c657c0-de0e-4457-a997-60c0a69995ce admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:20.906598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c657c0-de0e-4457-a997-60c0a69995ce admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:20.906877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c657c0-de0e-4457-a997-60c0a69995ce admin admin] PATH_INFO: `/v3/projects/130695f407914fac818eca42619084d1/users/aecc991f49db461e93a451decbe3e7a8/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:20.910211 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3605/7229] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:20.910394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c657c0-de0e-4457-a997-60c0a69995ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=130695f407914fac818eca42619084d1, user_id=aecc991f49db461e93a451decbe3e7a8, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:20.913367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0fc2e-01d1-450f-b647-a8c2d271dfa0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:20.915384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c657c0-de0e-4457-a997-60c0a69995ce admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:20.924942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0fc2e-01d1-450f-b647-a8c2d271dfa0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:20.930786 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3625/7230] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:20 2022] PUT /identity/v3/projects/130695f407914fac818eca42619084d1/users/aecc991f49db461e93a451decbe3e7a8/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:20.944954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfcd9e-acf2-4f80-a6e3-edc00fa134bb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:20.945339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfcd9e-acf2-4f80-a6e3-edc00fa134bb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:20.945581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfcd9e-acf2-4f80-a6e3-edc00fa134bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:20.992733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a9dfcd9e-acf2-4f80-a6e3-edc00fa134bb None None] MFA Rules not processed for user `aecc991f49db461e93a451decbe3e7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:20.993891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a9dfcd9e-acf2-4f80-a6e3-edc00fa134bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:21.016633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a068f8-7a99-4fdb-950f-2537a7f0732a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:21.017385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a068f8-7a99-4fdb-950f-2537a7f0732a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:21.018037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a068f8-7a99-4fdb-950f-2537a7f0732a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:21.018600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a068f8-7a99-4fdb-950f-2537a7f0732a admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:21.019673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a068f8-7a99-4fdb-950f-2537a7f0732a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:21.020068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a068f8-7a99-4fdb-950f-2537a7f0732a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:21.022033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a068f8-7a99-4fdb-950f-2537a7f0732a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:21.040571 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3606/7231] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:21.041636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a068f8-7a99-4fdb-950f-2537a7f0732a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:21.063358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a068f8-7a99-4fdb-950f-2537a7f0732a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:21.068975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951d9c3-36b6-42e7-b3a9-5faf08fb1a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:21.069709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951d9c3-36b6-42e7-b3a9-5faf08fb1a85 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:21.070072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951d9c3-36b6-42e7-b3a9-5faf08fb1a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:21.070625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951d9c3-36b6-42e7-b3a9-5faf08fb1a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:21.071261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951d9c3-36b6-42e7-b3a9-5faf08fb1a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:21.073170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951d9c3-36b6-42e7-b3a9-5faf08fb1a85 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:21.099805 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3626/7232] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:21.106751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfcd9e-acf2-4f80-a6e3-edc00fa134bb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:21.115021 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3607/7233] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:21 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:21.118830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951d9c3-36b6-42e7-b3a9-5faf08fb1a85 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:21.131032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfcd9e-acf2-4f80-a6e3-edc00fa134bb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:21.213885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951d9c3-36b6-42e7-b3a9-5faf08fb1a85 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:21.221726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b08bcb-4429-45ed-8be5-b8f1697f3dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:21.223431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08bcb-4429-45ed-8be5-b8f1697f3dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:21.223897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08bcb-4429-45ed-8be5-b8f1697f3dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:21.224504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08bcb-4429-45ed-8be5-b8f1697f3dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:21.225493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b08bcb-4429-45ed-8be5-b8f1697f3dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:21.230633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b08bcb-4429-45ed-8be5-b8f1697f3dc3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:21.233857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec9f1-7f4f-4822-862c-528d5784c9c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:21.238771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec9f1-7f4f-4822-862c-528d5784c9c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:21.239058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec9f1-7f4f-4822-862c-528d5784c9c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:21.239413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec9f1-7f4f-4822-862c-528d5784c9c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:21.240901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bec9f1-7f4f-4822-862c-528d5784c9c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:21.244143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bec9f1-7f4f-4822-862c-528d5784c9c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:21.276415 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3608/7234] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:21 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:21.280401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b08bcb-4429-45ed-8be5-b8f1697f3dc3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:21.294734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b08bcb-4429-45ed-8be5-b8f1697f3dc3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:21.297500 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3627/7235] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:21 2022] POST /identity/v3/projects => generated 360 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:21.302985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec9f1-7f4f-4822-862c-528d5784c9c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:21.322357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:21.351173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:21.378061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f70a1-3347-4941-b13c-248f0b8e69b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:21.379234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f70a1-3347-4941-b13c-248f0b8e69b4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:21.379648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f70a1-3347-4941-b13c-248f0b8e69b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:21.380271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f70a1-3347-4941-b13c-248f0b8e69b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:21.381457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f70a1-3347-4941-b13c-248f0b8e69b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:21.384172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f70a1-3347-4941-b13c-248f0b8e69b4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:21.395257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec9f1-7f4f-4822-862c-528d5784c9c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:21.396787 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3609/7236] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:21.401847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f70a1-3347-4941-b13c-248f0b8e69b4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:21.404683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf4da6-549e-4205-a179-0299845841c1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:21.405594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf4da6-549e-4205-a179-0299845841c1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:21.405955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf4da6-549e-4205-a179-0299845841c1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:21.406436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf4da6-549e-4205-a179-0299845841c1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:21.407705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf4da6-549e-4205-a179-0299845841c1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:21.410986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf4da6-549e-4205-a179-0299845841c1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:21.417979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f70a1-3347-4941-b13c-248f0b8e69b4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:21.422858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e4790-9f9b-44b2-b9a0-b3e046580787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:21.423470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e4790-9f9b-44b2-b9a0-b3e046580787 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:21.423754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e4790-9f9b-44b2-b9a0-b3e046580787 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:21.424053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e4790-9f9b-44b2-b9a0-b3e046580787 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:21.424691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e4790-9f9b-44b2-b9a0-b3e046580787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:21.426347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e4790-9f9b-44b2-b9a0-b3e046580787 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:21.438864 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3610/7237] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:21.442863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e4790-9f9b-44b2-b9a0-b3e046580787 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:21.445207 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3628/7238] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:21 2022] POST /identity/v3/users => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:21.449860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf4da6-549e-4205-a179-0299845841c1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:21.462538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf4da6-549e-4205-a179-0299845841c1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:21.463359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e4790-9f9b-44b2-b9a0-b3e046580787 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:21.472521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22a813-cedd-4daa-b916-4a136a8f8be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:21.473248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22a813-cedd-4daa-b916-4a136a8f8be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:21.473530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22a813-cedd-4daa-b916-4a136a8f8be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:21.473802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22a813-cedd-4daa-b916-4a136a8f8be7 admin admin] PATH_INFO: `/v3/projects/0240a45227f84c3b878916f995557237/users/9033fa35246a4a238e144b223317339e/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:21.493352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cca64-94aa-4ecd-9e9e-dc749d86cc2e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:21.494029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cca64-94aa-4ecd-9e9e-dc749d86cc2e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:21.494356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cca64-94aa-4ecd-9e9e-dc749d86cc2e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:21.494576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cca64-94aa-4ecd-9e9e-dc749d86cc2e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/66fe3340e6724ec0bc832a29222176d5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:21.508025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22a813-cedd-4daa-b916-4a136a8f8be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0240a45227f84c3b878916f995557237, user_id=9033fa35246a4a238e144b223317339e, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:21.510712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22a813-cedd-4daa-b916-4a136a8f8be7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:21.518943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cca64-94aa-4ecd-9e9e-dc749d86cc2e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:get_user(user_id=66fe3340e6724ec0bc832a29222176d5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:21.521783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cca64-94aa-4ecd-9e9e-dc749d86cc2e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:21.523472 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3629/7239] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:20:21 2022] GET /identity/v3/users/66fe3340e6724ec0bc832a29222176d5 => generated 373 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:21.527959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cca64-94aa-4ecd-9e9e-dc749d86cc2e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:21.540074 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3611/7240] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:21 2022] PUT /identity/v3/projects/0240a45227f84c3b878916f995557237/users/9033fa35246a4a238e144b223317339e/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:21.540280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cca64-94aa-4ecd-9e9e-dc749d86cc2e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:21.551806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558673f-21fe-40c4-9091-95437e1c9c5e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:21.552346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558673f-21fe-40c4-9091-95437e1c9c5e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:21.552801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558673f-21fe-40c4-9091-95437e1c9c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:21.617919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a558673f-21fe-40c4-9091-95437e1c9c5e None None] MFA Rules not processed for user `9033fa35246a4a238e144b223317339e`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:21.619390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a558673f-21fe-40c4-9091-95437e1c9c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:21.673725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:21.675072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:21.675430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:21.675776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/66fe3340e6724ec0bc832a29222176d5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:21.677795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:delete_user(user_id=66fe3340e6724ec0bc832a29222176d5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:21.680511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:21.721147 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3612/7241] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:21.726041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558673f-21fe-40c4-9091-95437e1c9c5e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:21.784332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66fe3340e6724ec0bc832a29222176d5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:21.795528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66fe3340e6724ec0bc832a29222176d5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:21.797605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66fe3340e6724ec0bc832a29222176d5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:21.801711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66fe3340e6724ec0bc832a29222176d5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:21.822421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66fe3340e6724ec0bc832a29222176d5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:21.848120 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3630/7242] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:21 2022] DELETE /identity/v3/users/66fe3340e6724ec0bc832a29222176d5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:21.849266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:21.851537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:21.858313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558673f-21fe-40c4-9091-95437e1c9c5e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:21.865396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:21.911477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:21.940505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d83a22-231d-4c7a-9c74-8269b605824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:21.941156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d83a22-231d-4c7a-9c74-8269b605824a admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:21.941695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d83a22-231d-4c7a-9c74-8269b605824a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:21.941881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d83a22-231d-4c7a-9c74-8269b605824a admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:21.942472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d83a22-231d-4c7a-9c74-8269b605824a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:21.944372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d83a22-231d-4c7a-9c74-8269b605824a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:21.948004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37347fde-26ad-4604-913e-05575727bfe6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:21.953993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:21.954644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:21.954961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:21.955672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects/ff175b770e8d4cad8e42e9ac8051b1de` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:21.956623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ff175b770e8d4cad8e42e9ac8051b1de)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:21.958689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:21.994101 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3613/7243] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:21 2022] POST /identity/v3/projects => generated 381 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:21.999997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d83a22-231d-4c7a-9c74-8269b605824a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:22.003039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-91d83a22-231d-4c7a-9c74-8269b605824a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:22.036140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff175b770e8d4cad8e42e9ac8051b1de', 'request_id': 'req-bf9e222b-31d4-4840-b098-0a75b2ef9a46'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:22.053739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff175b770e8d4cad8e42e9ac8051b1de', 'request_id': 'req-bf9e222b-31d4-4840-b098-0a75b2ef9a46'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:22.062295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff175b770e8d4cad8e42e9ac8051b1de', 'request_id': 'req-bf9e222b-31d4-4840-b098-0a75b2ef9a46'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:22.084061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] The token cache is being invalidate because project ff175b770e8d4cad8e42e9ac8051b1de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:22.084362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:22.085017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:22.086590 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3631/7244] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:21 2022] DELETE /identity/v3/projects/ff175b770e8d4cad8e42e9ac8051b1de => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:22.091770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:22.093373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:22.113068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d83a22-231d-4c7a-9c74-8269b605824a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:22.190533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550b3b3-3029-4613-a1e8-56b5d3c879a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:22.191017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550b3b3-3029-4613-a1e8-56b5d3c879a8 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:22.191298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550b3b3-3029-4613-a1e8-56b5d3c879a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:22.191603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550b3b3-3029-4613-a1e8-56b5d3c879a8 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:22.192214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550b3b3-3029-4613-a1e8-56b5d3c879a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:22.194905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550b3b3-3029-4613-a1e8-56b5d3c879a8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:22.212808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e222b-31d4-4840-b098-0a75b2ef9a46 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:22.224544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4e68d-6297-48fe-8065-9315f2764676 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:22.225651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4e68d-6297-48fe-8065-9315f2764676 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:22.226498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4e68d-6297-48fe-8065-9315f2764676 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:22.226940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4e68d-6297-48fe-8065-9315f2764676 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:22.227796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4e68d-6297-48fe-8065-9315f2764676 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:22.230988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4e68d-6297-48fe-8065-9315f2764676 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:22.232328 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3614/7245] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:21 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:22.236595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550b3b3-3029-4613-a1e8-56b5d3c879a8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:22.243539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5550b3b3-3029-4613-a1e8-56b5d3c879a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:22.258886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550b3b3-3029-4613-a1e8-56b5d3c879a8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:22.264743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e388-c569-4a54-b3b1-ff58e53e8408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:22.265428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e388-c569-4a54-b3b1-ff58e53e8408 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:22.265729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e388-c569-4a54-b3b1-ff58e53e8408 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:22.266182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e388-c569-4a54-b3b1-ff58e53e8408 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:22.266835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2e388-c569-4a54-b3b1-ff58e53e8408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:22.268762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2e388-c569-4a54-b3b1-ff58e53e8408 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:22.279419 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3632/7246] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:22 2022] POST /identity/v3/projects => generated 359 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:22.281220 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3615/7247] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:22.283581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e388-c569-4a54-b3b1-ff58e53e8408 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:22.284879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4e68d-6297-48fe-8065-9315f2764676 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:22.297457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e388-c569-4a54-b3b1-ff58e53e8408 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:22.316130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:22.370989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:22.384154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4e68d-6297-48fe-8065-9315f2764676 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:22.392329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd1df8-18fb-4c12-ada5-4fa2123b2501 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:22.393461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd1df8-18fb-4c12-ada5-4fa2123b2501 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:22.393742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd1df8-18fb-4c12-ada5-4fa2123b2501 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:22.394017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd1df8-18fb-4c12-ada5-4fa2123b2501 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:22.394664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd1df8-18fb-4c12-ada5-4fa2123b2501 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:22.395940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80364c80-e5d3-4288-b644-2d7c4f2f8d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:22.396501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd1df8-18fb-4c12-ada5-4fa2123b2501 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:22.397095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80364c80-e5d3-4288-b644-2d7c4f2f8d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:22.397722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80364c80-e5d3-4288-b644-2d7c4f2f8d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:22.398229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80364c80-e5d3-4288-b644-2d7c4f2f8d93 admin admin] PATH_INFO: `/v3/projects/105b3cce66a94737ac5a518f4be99c72/users/0f4ea8f2d3f94a1a8517bebeaf74c6d1/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:22.418214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80364c80-e5d3-4288-b644-2d7c4f2f8d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105b3cce66a94737ac5a518f4be99c72, user_id=0f4ea8f2d3f94a1a8517bebeaf74c6d1, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:22.422417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80364c80-e5d3-4288-b644-2d7c4f2f8d93 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:22.436788 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3616/7248] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:22 2022] POST /identity/v3/users => generated 414 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:22.441318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd1df8-18fb-4c12-ada5-4fa2123b2501 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:22.445684 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3633/7249] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:22 2022] PUT /identity/v3/projects/105b3cce66a94737ac5a518f4be99c72/users/0f4ea8f2d3f94a1a8517bebeaf74c6d1/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:22.451111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80364c80-e5d3-4288-b644-2d7c4f2f8d93 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:22.454394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd1df8-18fb-4c12-ada5-4fa2123b2501 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:22.585603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80364c80-e5d3-4288-b644-2d7c4f2f8d93 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:22.591597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b74af7-81e4-4000-8eb0-990594a6157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:22.592311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74af7-81e4-4000-8eb0-990594a6157b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:22.592667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74af7-81e4-4000-8eb0-990594a6157b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:22.593078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74af7-81e4-4000-8eb0-990594a6157b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:22.593843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b74af7-81e4-4000-8eb0-990594a6157b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:22.596151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b74af7-81e4-4000-8eb0-990594a6157b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:22.636599 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3634/7250] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:22.637440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b74af7-81e4-4000-8eb0-990594a6157b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:22.651041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b74af7-81e4-4000-8eb0-990594a6157b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:22.658733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56b407-e7b5-4c08-a773-9a514dc34886 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:22.659725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56b407-e7b5-4c08-a773-9a514dc34886 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:22.660162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56b407-e7b5-4c08-a773-9a514dc34886 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:22.660703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56b407-e7b5-4c08-a773-9a514dc34886 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:22.661412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56b407-e7b5-4c08-a773-9a514dc34886 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:22.663410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8cb63-8748-4828-b077-4abf5bcb32b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:22.663789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56b407-e7b5-4c08-a773-9a514dc34886 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:22.664308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8cb63-8748-4828-b077-4abf5bcb32b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:22.664681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8cb63-8748-4828-b077-4abf5bcb32b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:22.665230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8cb63-8748-4828-b077-4abf5bcb32b2 admin admin] PATH_INFO: `/v3/projects/105b3cce66a94737ac5a518f4be99c72/users/0f4ea8f2d3f94a1a8517bebeaf74c6d1/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:22.668190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8cb63-8748-4828-b077-4abf5bcb32b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105b3cce66a94737ac5a518f4be99c72, user_id=0f4ea8f2d3f94a1a8517bebeaf74c6d1, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:22.671090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8cb63-8748-4828-b077-4abf5bcb32b2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:22.707992 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3617/7252] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:20:22 2022] POST /identity/v3/roles => generated 239 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:22.716590 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3635/7252] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:22 2022] PUT /identity/v3/projects/105b3cce66a94737ac5a518f4be99c72/users/0f4ea8f2d3f94a1a8517bebeaf74c6d1/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:22.721569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8cb63-8748-4828-b077-4abf5bcb32b2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:22.733980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07f4e2-73b9-47f7-aefb-9e7c9a6335df None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:22.734273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07f4e2-73b9-47f7-aefb-9e7c9a6335df None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:22.734651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07f4e2-73b9-47f7-aefb-9e7c9a6335df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:22.784629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0f07f4e2-73b9-47f7-aefb-9e7c9a6335df None None] MFA Rules not processed for user `0f4ea8f2d3f94a1a8517bebeaf74c6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:22.786722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0f07f4e2-73b9-47f7-aefb-9e7c9a6335df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:22.830652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8cb63-8748-4828-b077-4abf5bcb32b2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:22.836554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e305d-60bf-45fc-91e7-440d516b07e7 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:22.837224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e305d-60bf-45fc-91e7-440d516b07e7 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:22.837224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e305d-60bf-45fc-91e7-440d516b07e7 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:22.837432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e305d-60bf-45fc-91e7-440d516b07e7 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/904c00ca5b2f4149ba0f3bb5012cf5c9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:22.861953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e305d-60bf-45fc-91e7-440d516b07e7 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:get_user(user_id=904c00ca5b2f4149ba0f3bb5012cf5c9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:22.864845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e305d-60bf-45fc-91e7-440d516b07e7 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:22.870677 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3636/7253] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:20:22 2022] GET /identity/v3/users/904c00ca5b2f4149ba0f3bb5012cf5c9 => generated 414 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:22.871761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e305d-60bf-45fc-91e7-440d516b07e7 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:22.887068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e305d-60bf-45fc-91e7-440d516b07e7 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:22.895768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc69a9-b06c-4c71-aefe-44b47ad909c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:22.902920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc69a9-b06c-4c71-aefe-44b47ad909c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:22.903334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc69a9-b06c-4c71-aefe-44b47ad909c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:22.903605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc69a9-b06c-4c71-aefe-44b47ad909c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/roles/366becf6bc1a4f57b312b279bc0c0ec1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:22.906797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc69a9-b06c-4c71-aefe-44b47ad909c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:get_role(role_id=366becf6bc1a4f57b312b279bc0c0ec1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:22.907825 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-b5bc69a9-b06c-4c71-aefe-44b47ad909c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:20:22.907825 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:20:22.907825 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:20:22.910169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc69a9-b06c-4c71-aefe-44b47ad909c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:22.932356 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3637/7254] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:20:22 2022] GET /identity/v3/roles/366becf6bc1a4f57b312b279bc0c0ec1 => generated 239 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:22.936925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc69a9-b06c-4c71-aefe-44b47ad909c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:22.965001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc69a9-b06c-4c71-aefe-44b47ad909c6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:22.965389 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3618/7255] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:22.970996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1904fc-7974-4cd5-9395-4e0ebb45c411 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:22.971611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1904fc-7974-4cd5-9395-4e0ebb45c411 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:22.971741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07f4e2-73b9-47f7-aefb-9e7c9a6335df None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:22.971922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1904fc-7974-4cd5-9395-4e0ebb45c411 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:22.972155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1904fc-7974-4cd5-9395-4e0ebb45c411 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:22.972786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1904fc-7974-4cd5-9395-4e0ebb45c411 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:22.973551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0f07f4e2-73b9-47f7-aefb-9e7c9a6335df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:22.975346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1904fc-7974-4cd5-9395-4e0ebb45c411 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:22.999416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:23.039370 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3638/7256] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:22 2022] POST /identity/v3/projects => generated 359 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:23.040982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1904fc-7974-4cd5-9395-4e0ebb45c411 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:23.153448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07f4e2-73b9-47f7-aefb-9e7c9a6335df None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:23.177563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:23.182323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1904fc-7974-4cd5-9395-4e0ebb45c411 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:23.190071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb78b3-6f0f-485c-896a-41caab448e27 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:23.191046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb78b3-6f0f-485c-896a-41caab448e27 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:23.191526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb78b3-6f0f-485c-896a-41caab448e27 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:23.191996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb78b3-6f0f-485c-896a-41caab448e27 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects/3520523c93ac4a61a4d23ae3715e8f4d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:23.194181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb78b3-6f0f-485c-896a-41caab448e27 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:get_project(project_id=3520523c93ac4a61a4d23ae3715e8f4d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:23.198725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb78b3-6f0f-485c-896a-41caab448e27 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:23.204798 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3639/7257] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:20:23 2022] GET /identity/v3/projects/3520523c93ac4a61a4d23ae3715e8f4d => generated 359 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:23.208956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb78b3-6f0f-485c-896a-41caab448e27 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:23.223793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb78b3-6f0f-485c-896a-41caab448e27 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:23.230263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316220a-e5e5-4e05-a37c-bb04d1090110 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:23.233267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316220a-e5e5-4e05-a37c-bb04d1090110 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:23.233267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316220a-e5e5-4e05-a37c-bb04d1090110 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:23.233267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316220a-e5e5-4e05-a37c-bb04d1090110 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects/3520523c93ac4a61a4d23ae3715e8f4d/users/904c00ca5b2f4149ba0f3bb5012cf5c9/roles/366becf6bc1a4f57b312b279bc0c0ec1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:23.237398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316220a-e5e5-4e05-a37c-bb04d1090110 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3520523c93ac4a61a4d23ae3715e8f4d, user_id=904c00ca5b2f4149ba0f3bb5012cf5c9, role_id=366becf6bc1a4f57b312b279bc0c0ec1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:23.240938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316220a-e5e5-4e05-a37c-bb04d1090110 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:23.312415 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3640/7258] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:23 2022] PUT /identity/v3/projects/3520523c93ac4a61a4d23ae3715e8f4d/users/904c00ca5b2f4149ba0f3bb5012cf5c9/roles/366becf6bc1a4f57b312b279bc0c0ec1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:23.316782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316220a-e5e5-4e05-a37c-bb04d1090110 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:23.319919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d3005-59dd-4a6a-959d-eb120fab5193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:23.320565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d3005-59dd-4a6a-959d-eb120fab5193 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:23.321404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d3005-59dd-4a6a-959d-eb120fab5193 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:23.321899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d3005-59dd-4a6a-959d-eb120fab5193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:23.442388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316220a-e5e5-4e05-a37c-bb04d1090110 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:23.446567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d3005-59dd-4a6a-959d-eb120fab5193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:23.448094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f2b37-1386-473a-a728-5a183da3de6f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:23.449048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d3005-59dd-4a6a-959d-eb120fab5193 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:23.450068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f2b37-1386-473a-a728-5a183da3de6f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:23.450658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f2b37-1386-473a-a728-5a183da3de6f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:23.451045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f2b37-1386-473a-a728-5a183da3de6f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:23.451932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f2b37-1386-473a-a728-5a183da3de6f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:23.453940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f2b37-1386-473a-a728-5a183da3de6f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:23.478778 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3619/7259] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:20:23.507266 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3641/7260] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:23 2022] POST /identity/v3/projects => generated 358 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:23.512220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d3005-59dd-4a6a-959d-eb120fab5193 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:23.541001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d3005-59dd-4a6a-959d-eb120fab5193 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:23.577726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f2b37-1386-473a-a728-5a183da3de6f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:23.634061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa2a40-6f9e-4ab6-9bc4-892916739782 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:23.634940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa2a40-6f9e-4ab6-9bc4-892916739782 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:23.635224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa2a40-6f9e-4ab6-9bc4-892916739782 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:23.635500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa2a40-6f9e-4ab6-9bc4-892916739782 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects/5f59edd7d074406290e4aafac82c44a6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:23.637401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa2a40-6f9e-4ab6-9bc4-892916739782 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:get_project(project_id=5f59edd7d074406290e4aafac82c44a6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:23.639542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa2a40-6f9e-4ab6-9bc4-892916739782 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:23.641245 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3620/7261] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:20:23 2022] GET /identity/v3/projects/5f59edd7d074406290e4aafac82c44a6 => generated 358 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:23.645073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa2a40-6f9e-4ab6-9bc4-892916739782 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:23.657751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa2a40-6f9e-4ab6-9bc4-892916739782 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:23.663898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c84654-75d1-4906-8733-b89f80efe3b6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:23.665620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c84654-75d1-4906-8733-b89f80efe3b6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:23.665927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c84654-75d1-4906-8733-b89f80efe3b6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:23.666370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c84654-75d1-4906-8733-b89f80efe3b6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects/5f59edd7d074406290e4aafac82c44a6/users/904c00ca5b2f4149ba0f3bb5012cf5c9/roles/366becf6bc1a4f57b312b279bc0c0ec1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:23.670108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c84654-75d1-4906-8733-b89f80efe3b6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5f59edd7d074406290e4aafac82c44a6, user_id=904c00ca5b2f4149ba0f3bb5012cf5c9, role_id=366becf6bc1a4f57b312b279bc0c0ec1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:23.672936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c84654-75d1-4906-8733-b89f80efe3b6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:23.682275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f2b37-1386-473a-a728-5a183da3de6f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:23.687514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491db7cd-aefa-4d14-9b2c-9851287c8094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:23.688507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491db7cd-aefa-4d14-9b2c-9851287c8094 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:23.688792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491db7cd-aefa-4d14-9b2c-9851287c8094 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:23.689065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491db7cd-aefa-4d14-9b2c-9851287c8094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:23.691067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-491db7cd-aefa-4d14-9b2c-9851287c8094 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:23.693457 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3621/7262] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:23 2022] PUT /identity/v3/projects/5f59edd7d074406290e4aafac82c44a6/users/904c00ca5b2f4149ba0f3bb5012cf5c9/roles/366becf6bc1a4f57b312b279bc0c0ec1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:23.697942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c84654-75d1-4906-8733-b89f80efe3b6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:23.728338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:23.780338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491db7cd-aefa-4d14-9b2c-9851287c8094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:23.782213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491db7cd-aefa-4d14-9b2c-9851287c8094 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:23.786499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:23.802468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c84654-75d1-4906-8733-b89f80efe3b6 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:23.805063 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3642/7263] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:23.808277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e99cc-c9d7-4010-a2e1-b696e7fec90b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:23.808951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e99cc-c9d7-4010-a2e1-b696e7fec90b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:23.809257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e99cc-c9d7-4010-a2e1-b696e7fec90b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:23.809530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e99cc-c9d7-4010-a2e1-b696e7fec90b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/904c00ca5b2f4149ba0f3bb5012cf5c9/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:23.810727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e99cc-c9d7-4010-a2e1-b696e7fec90b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=904c00ca5b2f4149ba0f3bb5012cf5c9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:23.812810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e99cc-c9d7-4010-a2e1-b696e7fec90b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:23.879766 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3622/7264] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:20:23 2022] GET /identity/v3/users/904c00ca5b2f4149ba0f3bb5012cf5c9/projects => generated 841 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:23.884476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491db7cd-aefa-4d14-9b2c-9851287c8094 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:23.903209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491db7cd-aefa-4d14-9b2c-9851287c8094 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:23.913010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:23.913893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:23.914320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:23.914697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects/5f59edd7d074406290e4aafac82c44a6` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:23.916683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5f59edd7d074406290e4aafac82c44a6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:23.919543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:24.000340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f59edd7d074406290e4aafac82c44a6', 'request_id': 'req-a1cca067-ba3f-421e-8bfc-dc5720fe7834'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.012246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f59edd7d074406290e4aafac82c44a6', 'request_id': 'req-a1cca067-ba3f-421e-8bfc-dc5720fe7834'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.029244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f59edd7d074406290e4aafac82c44a6', 'request_id': 'req-a1cca067-ba3f-421e-8bfc-dc5720fe7834'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.046274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] The token cache is being invalidate because project 5f59edd7d074406290e4aafac82c44a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:24.046274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.047811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.052651 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3643/7265] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:23 2022] DELETE /identity/v3/projects/5f59edd7d074406290e4aafac82c44a6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:24.054231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e99cc-c9d7-4010-a2e1-b696e7fec90b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:24.056239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-242e99cc-c9d7-4010-a2e1-b696e7fec90b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:24.082138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e99cc-c9d7-4010-a2e1-b696e7fec90b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:24.170591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:24.172237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:24.177245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:24.177908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:24.178290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:24.178576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects/3520523c93ac4a61a4d23ae3715e8f4d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:24.180163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3520523c93ac4a61a4d23ae3715e8f4d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:24.184236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:24.303455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3520523c93ac4a61a4d23ae3715e8f4d', 'request_id': 'req-1e35070a-3901-43aa-9e01-dddaa4604452'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.315509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3520523c93ac4a61a4d23ae3715e8f4d', 'request_id': 'req-1e35070a-3901-43aa-9e01-dddaa4604452'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.318176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cca067-ba3f-421e-8bfc-dc5720fe7834 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:24.327492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3520523c93ac4a61a4d23ae3715e8f4d', 'request_id': 'req-1e35070a-3901-43aa-9e01-dddaa4604452'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.365157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] The token cache is being invalidate because project 3520523c93ac4a61a4d23ae3715e8f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:24.365157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.365157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.365157 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3623/7266] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:24 2022] DELETE /identity/v3/projects/3520523c93ac4a61a4d23ae3715e8f4d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:24.365913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:24.367058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:24.410396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:24.431720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:24.447379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed935e49-712e-418c-b14a-f55ab02b8995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:24.449543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed935e49-712e-418c-b14a-f55ab02b8995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:24.449828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed935e49-712e-418c-b14a-f55ab02b8995 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:24.450101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed935e49-712e-418c-b14a-f55ab02b8995 admin admin] PATH_INFO: `/v3/users/9033fa35246a4a238e144b223317339e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:24.451398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35070a-3901-43aa-9e01-dddaa4604452 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:24.452568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed935e49-712e-418c-b14a-f55ab02b8995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9033fa35246a4a238e144b223317339e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:24.457072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed935e49-712e-418c-b14a-f55ab02b8995 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:24.458040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f903b-198b-4477-9ed8-f3bbfa79b047 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:24.458706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f903b-198b-4477-9ed8-f3bbfa79b047 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:24.459028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f903b-198b-4477-9ed8-f3bbfa79b047 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:24.459482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f903b-198b-4477-9ed8-f3bbfa79b047 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/roles/366becf6bc1a4f57b312b279bc0c0ec1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:24.462125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f903b-198b-4477-9ed8-f3bbfa79b047 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:delete_role(role_id=366becf6bc1a4f57b312b279bc0c0ec1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:24.464889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f903b-198b-4477-9ed8-f3bbfa79b047 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:24.532915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4d2f903b-198b-4477-9ed8-f3bbfa79b047 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invalidating the token cache because role 366becf6bc1a4f57b312b279bc0c0ec1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:24.534165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4d2f903b-198b-4477-9ed8-f3bbfa79b047 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.534922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4d2f903b-198b-4477-9ed8-f3bbfa79b047 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.541068 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3624/7267] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:24 2022] DELETE /identity/v3/roles/366becf6bc1a4f57b312b279bc0c0ec1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:24.542424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f903b-198b-4477-9ed8-f3bbfa79b047 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:24.543906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4d2f903b-198b-4477-9ed8-f3bbfa79b047 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:24.560921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ed935e49-712e-418c-b14a-f55ab02b8995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9033fa35246a4a238e144b223317339e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.579709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ed935e49-712e-418c-b14a-f55ab02b8995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9033fa35246a4a238e144b223317339e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.579709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ed935e49-712e-418c-b14a-f55ab02b8995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9033fa35246a4a238e144b223317339e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.579709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ed935e49-712e-418c-b14a-f55ab02b8995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9033fa35246a4a238e144b223317339e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.617516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ed935e49-712e-418c-b14a-f55ab02b8995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9033fa35246a4a238e144b223317339e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.636467 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3644/7268] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:24 2022] DELETE /identity/v3/users/9033fa35246a4a238e144b223317339e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:24.642071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2531c7-6df7-47f7-9854-60f122dd5968 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:24.642558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2531c7-6df7-47f7-9854-60f122dd5968 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:24.642962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2531c7-6df7-47f7-9854-60f122dd5968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:24.644489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f903b-198b-4477-9ed8-f3bbfa79b047 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:24.670416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ba2531c7-6df7-47f7-9854-60f122dd5968 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:24.671465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ba2531c7-6df7-47f7-9854-60f122dd5968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:24.716907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:24.718415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:24.718887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:24.719247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/904c00ca5b2f4149ba0f3bb5012cf5c9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:24.720429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:delete_user(user_id=904c00ca5b2f4149ba0f3bb5012cf5c9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:24.722709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:24.761971 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3645/7269] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:24.772289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2531c7-6df7-47f7-9854-60f122dd5968 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:24.775118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ba2531c7-6df7-47f7-9854-60f122dd5968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:24.809455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904c00ca5b2f4149ba0f3bb5012cf5c9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.826927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904c00ca5b2f4149ba0f3bb5012cf5c9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.829105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904c00ca5b2f4149ba0f3bb5012cf5c9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.831360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904c00ca5b2f4149ba0f3bb5012cf5c9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.845441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:24.856905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904c00ca5b2f4149ba0f3bb5012cf5c9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:24.861395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2531c7-6df7-47f7-9854-60f122dd5968 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:24.867278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8619d3-1995-4cb8-9d89-b08a11a19639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:24.868719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8619d3-1995-4cb8-9d89-b08a11a19639 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:24.869178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8619d3-1995-4cb8-9d89-b08a11a19639 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:24.869880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8619d3-1995-4cb8-9d89-b08a11a19639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:24.873600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6c8619d3-1995-4cb8-9d89-b08a11a19639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:24.887642 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3625/7270] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:24 2022] DELETE /identity/v3/users/904c00ca5b2f4149ba0f3bb5012cf5c9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:24.892297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:24.895182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:24.920944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8619d3-1995-4cb8-9d89-b08a11a19639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:24.926720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8619d3-1995-4cb8-9d89-b08a11a19639 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:24.947457 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3646/7271] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:20:24.995282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763758b-e2f4-47f1-ad92-de73eafec76e tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:25.008227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:25.009670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:25.010053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:25.010402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects/1f656d0bf6354c8ca306949bb4cb0b6b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:25.012228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1f656d0bf6354c8ca306949bb4cb0b6b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:25.014555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:25.100656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f656d0bf6354c8ca306949bb4cb0b6b', 'request_id': 'req-9cb848fa-738e-4b38-b2a1-ba1d8996a449'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.117962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f656d0bf6354c8ca306949bb4cb0b6b', 'request_id': 'req-9cb848fa-738e-4b38-b2a1-ba1d8996a449'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.134148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f656d0bf6354c8ca306949bb4cb0b6b', 'request_id': 'req-9cb848fa-738e-4b38-b2a1-ba1d8996a449'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.152458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] The token cache is being invalidate because project 1f656d0bf6354c8ca306949bb4cb0b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:25.152842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.153633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.160652 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3626/7272] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:24 2022] DELETE /identity/v3/projects/1f656d0bf6354c8ca306949bb4cb0b6b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:25.161177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8619d3-1995-4cb8-9d89-b08a11a19639 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:25.175497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8619d3-1995-4cb8-9d89-b08a11a19639 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:25.203727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:25.271700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740b290-cf42-4493-b9e6-b3a82de46a57 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:25.273684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740b290-cf42-4493-b9e6-b3a82de46a57 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:25.274560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740b290-cf42-4493-b9e6-b3a82de46a57 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:25.275438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740b290-cf42-4493-b9e6-b3a82de46a57 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/484b4f5467de44f7b4131da88f3f2c62` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:25.277533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740b290-cf42-4493-b9e6-b3a82de46a57 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:update_user(user_id=484b4f5467de44f7b4131da88f3f2c62)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:25.278957 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-0740b290-cf42-4493-b9e6-b3a82de46a57 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:20:25.278957 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:20:25.278957 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:20:25.280780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740b290-cf42-4493-b9e6-b3a82de46a57 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:25.330328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:25.332066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:25.340070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0740b290-cf42-4493-b9e6-b3a82de46a57 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '484b4f5467de44f7b4131da88f3f2c62'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.367155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0740b290-cf42-4493-b9e6-b3a82de46a57 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invalidating the token cache because user 484b4f5467de44f7b4131da88f3f2c62 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:25.367787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0740b290-cf42-4493-b9e6-b3a82de46a57 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.368659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0740b290-cf42-4493-b9e6-b3a82de46a57 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.371989 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3647/7273] 10.222.0.26 () {60 vars in 1243 bytes} [Sat Oct 8 21:20:25 2022] PATCH /identity/v3/users/484b4f5467de44f7b4131da88f3f2c62 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:25.375743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e427dc0-604b-416c-a844-f51d8c660131 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:25.377523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e427dc0-604b-416c-a844-f51d8c660131 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:25.377851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e427dc0-604b-416c-a844-f51d8c660131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:25.413783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3e427dc0-604b-416c-a844-f51d8c660131 None None] MFA Rules not processed for user `484b4f5467de44f7b4131da88f3f2c62`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:25.414920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3e427dc0-604b-416c-a844-f51d8c660131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:25.423800 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3648/7274] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:25 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 21:20:25.424735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e427dc0-604b-416c-a844-f51d8c660131 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:25.427787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3e427dc0-604b-416c-a844-f51d8c660131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:25.439905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb848fa-738e-4b38-b2a1-ba1d8996a449 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:25.445048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:25.446051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:25.446328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:25.446605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] PATH_INFO: `/v3/projects/0240a45227f84c3b878916f995557237` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:25.447946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0240a45227f84c3b878916f995557237)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:25.450057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:25.459223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e427dc0-604b-416c-a844-f51d8c660131 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:25.468757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ac6d7-33e6-4a55-9de4-a01973a5c3f4 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:25.470449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac6d7-33e6-4a55-9de4-a01973a5c3f4 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:25.470736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac6d7-33e6-4a55-9de4-a01973a5c3f4 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:25.471648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac6d7-33e6-4a55-9de4-a01973a5c3f4 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/484b4f5467de44f7b4131da88f3f2c62` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:25.481482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ac6d7-33e6-4a55-9de4-a01973a5c3f4 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:update_user(user_id=484b4f5467de44f7b4131da88f3f2c62)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:25.481482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ac6d7-33e6-4a55-9de4-a01973a5c3f4 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:25.520410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:25.536078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-074ac6d7-33e6-4a55-9de4-a01973a5c3f4 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '484b4f5467de44f7b4131da88f3f2c62'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.548328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-074ac6d7-33e6-4a55-9de4-a01973a5c3f4 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invalidating the token cache because user 484b4f5467de44f7b4131da88f3f2c62 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:25.548681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-074ac6d7-33e6-4a55-9de4-a01973a5c3f4 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.551766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-074ac6d7-33e6-4a55-9de4-a01973a5c3f4 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.556870 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3649/7275] 10.222.0.26 () {60 vars in 1243 bytes} [Sat Oct 8 21:20:25 2022] PATCH /identity/v3/users/484b4f5467de44f7b4131da88f3f2c62 => generated 297 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:25.559273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ac6d7-33e6-4a55-9de4-a01973a5c3f4 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:25.560840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-074ac6d7-33e6-4a55-9de4-a01973a5c3f4 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:25.577234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ac6d7-33e6-4a55-9de4-a01973a5c3f4 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:25.598763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0240a45227f84c3b878916f995557237', 'request_id': 'req-a3a68624-4d9f-47b0-84ad-fff0b20e865f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.619432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0240a45227f84c3b878916f995557237', 'request_id': 'req-a3a68624-4d9f-47b0-84ad-fff0b20e865f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.630834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0240a45227f84c3b878916f995557237', 'request_id': 'req-a3a68624-4d9f-47b0-84ad-fff0b20e865f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.654824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] The token cache is being invalidate because project 0240a45227f84c3b878916f995557237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:25.656424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.657724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.660319 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3627/7276] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:25 2022] DELETE /identity/v3/projects/0240a45227f84c3b878916f995557237 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:25.665076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:25.670586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:25.725269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ccef0-e32e-4dee-84ec-ff273f8e72a1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:25.725269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ccef0-e32e-4dee-84ec-ff273f8e72a1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:25.725269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ccef0-e32e-4dee-84ec-ff273f8e72a1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:25.725693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ccef0-e32e-4dee-84ec-ff273f8e72a1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/484b4f5467de44f7b4131da88f3f2c62` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:25.754287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ccef0-e32e-4dee-84ec-ff273f8e72a1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:update_user(user_id=484b4f5467de44f7b4131da88f3f2c62)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:25.756384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ccef0-e32e-4dee-84ec-ff273f8e72a1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:25.812864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-009ccef0-e32e-4dee-84ec-ff273f8e72a1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '484b4f5467de44f7b4131da88f3f2c62'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.826245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a68624-4d9f-47b0-84ad-fff0b20e865f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:25.828261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-009ccef0-e32e-4dee-84ec-ff273f8e72a1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invalidating the token cache because user 484b4f5467de44f7b4131da88f3f2c62 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:25.828564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-009ccef0-e32e-4dee-84ec-ff273f8e72a1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.829497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-009ccef0-e32e-4dee-84ec-ff273f8e72a1 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.831523 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3650/7277] 10.222.0.26 () {60 vars in 1243 bytes} [Sat Oct 8 21:20:25 2022] PATCH /identity/v3/users/484b4f5467de44f7b4131da88f3f2c62 => generated 297 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:25.835513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaabd3f-a480-4be5-8191-08b65c963d7b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:25.835804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaabd3f-a480-4be5-8191-08b65c963d7b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:25.836082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaabd3f-a480-4be5-8191-08b65c963d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:25.840653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:25.842305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:25.843454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:25.844408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] PATH_INFO: `/v3/users/0f4ea8f2d3f94a1a8517bebeaf74c6d1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:25.847619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4ea8f2d3f94a1a8517bebeaf74c6d1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:25.850954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:25.857525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:UPDATE=3,keystone:INSERT=6,keystone:DELETE=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:25.890719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-faaabd3f-a480-4be5-8191-08b65c963d7b None None] MFA Rules not processed for user `484b4f5467de44f7b4131da88f3f2c62`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:25.892423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-faaabd3f-a480-4be5-8191-08b65c963d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:25.897359 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3651/7278] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:25 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 21:20:25.901863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaabd3f-a480-4be5-8191-08b65c963d7b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:25.903933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-faaabd3f-a480-4be5-8191-08b65c963d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:25.921909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4ea8f2d3f94a1a8517bebeaf74c6d1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.925477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaabd3f-a480-4be5-8191-08b65c963d7b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:25.933655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fd3a2-b855-4589-9396-af8ada25d750 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:25.934275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd3a2-b855-4589-9396-af8ada25d750 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:25.934559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd3a2-b855-4589-9396-af8ada25d750 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:25.934839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd3a2-b855-4589-9396-af8ada25d750 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/484b4f5467de44f7b4131da88f3f2c62` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:25.935828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4ea8f2d3f94a1a8517bebeaf74c6d1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.936095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fd3a2-b855-4589-9396-af8ada25d750 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:update_user(user_id=484b4f5467de44f7b4131da88f3f2c62)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:25.936677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4ea8f2d3f94a1a8517bebeaf74c6d1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.937479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4ea8f2d3f94a1a8517bebeaf74c6d1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.938488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fd3a2-b855-4589-9396-af8ada25d750 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:25.954653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4ea8f2d3f94a1a8517bebeaf74c6d1'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:25.976230 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3628/7279] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:25 2022] DELETE /identity/v3/users/0f4ea8f2d3f94a1a8517bebeaf74c6d1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:26.000672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df1fd3a2-b855-4589-9396-af8ada25d750 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '484b4f5467de44f7b4131da88f3f2c62'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:26.012728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df1fd3a2-b855-4589-9396-af8ada25d750 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invalidating the token cache because user 484b4f5467de44f7b4131da88f3f2c62 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:26.013330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df1fd3a2-b855-4589-9396-af8ada25d750 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:26.014068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-df1fd3a2-b855-4589-9396-af8ada25d750 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:26.017455 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3652/7280] 10.222.0.26 () {60 vars in 1243 bytes} [Sat Oct 8 21:20:25 2022] PATCH /identity/v3/users/484b4f5467de44f7b4131da88f3f2c62 => generated 297 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:26.021419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:26.023207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:26.070658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:26.128341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f02e1-ef10-4102-ac2c-8e7975001ff8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:26.133719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e237817-cc48-4fc5-8bf3-6500b81e6080 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:26.136903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e237817-cc48-4fc5-8bf3-6500b81e6080 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:26.136903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e237817-cc48-4fc5-8bf3-6500b81e6080 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:26.136903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e237817-cc48-4fc5-8bf3-6500b81e6080 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:26.136903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e237817-cc48-4fc5-8bf3-6500b81e6080 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:26.138652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e237817-cc48-4fc5-8bf3-6500b81e6080 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:26.175134 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3629/7281] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:20:26 2022] POST /identity/v3/users => generated 264 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:26.179006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fd3a2-b855-4589-9396-af8ada25d750 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:26.180902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-df1fd3a2-b855-4589-9396-af8ada25d750 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:26.198817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fd3a2-b855-4589-9396-af8ada25d750 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:26.205688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151e27e-af91-496a-b235-2af01afa9f1f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:26.206384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151e27e-af91-496a-b235-2af01afa9f1f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:26.207179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151e27e-af91-496a-b235-2af01afa9f1f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:26.207901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151e27e-af91-496a-b235-2af01afa9f1f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/fb1934672e5840c680cbcbf9ff0e5b8f/password` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:26.317787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3151e27e-af91-496a-b235-2af01afa9f1f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fb1934672e5840c680cbcbf9ff0e5b8f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:26.330725 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3653/7282] 10.222.0.26 () {60 vars in 1269 bytes} [Sat Oct 8 21:20:26 2022] POST /identity/v3/users/fb1934672e5840c680cbcbf9ff0e5b8f/password => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:26.366014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e237817-cc48-4fc5-8bf3-6500b81e6080 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:26.368382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0e237817-cc48-4fc5-8bf3-6500b81e6080 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:26.471858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e237817-cc48-4fc5-8bf3-6500b81e6080 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:26.481430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d409df-b72b-40ea-a37f-8eaff18584f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:26.482440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d409df-b72b-40ea-a37f-8eaff18584f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:26.483120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d409df-b72b-40ea-a37f-8eaff18584f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:26.483733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d409df-b72b-40ea-a37f-8eaff18584f3 admin admin] PATH_INFO: `/v3/projects/105b3cce66a94737ac5a518f4be99c72` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:26.485049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d409df-b72b-40ea-a37f-8eaff18584f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=105b3cce66a94737ac5a518f4be99c72)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:26.490082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d409df-b72b-40ea-a37f-8eaff18584f3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:26.566864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b6d409df-b72b-40ea-a37f-8eaff18584f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105b3cce66a94737ac5a518f4be99c72', 'request_id': 'req-b6d409df-b72b-40ea-a37f-8eaff18584f3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:26.577980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b6d409df-b72b-40ea-a37f-8eaff18584f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105b3cce66a94737ac5a518f4be99c72', 'request_id': 'req-b6d409df-b72b-40ea-a37f-8eaff18584f3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:26.587985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b6d409df-b72b-40ea-a37f-8eaff18584f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105b3cce66a94737ac5a518f4be99c72', 'request_id': 'req-b6d409df-b72b-40ea-a37f-8eaff18584f3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:26.604808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b6d409df-b72b-40ea-a37f-8eaff18584f3 admin admin] The token cache is being invalidate because project 105b3cce66a94737ac5a518f4be99c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:26.606418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b6d409df-b72b-40ea-a37f-8eaff18584f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:26.608702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b6d409df-b72b-40ea-a37f-8eaff18584f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:26.623929 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3630/7283] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:26 2022] DELETE /identity/v3/projects/105b3cce66a94737ac5a518f4be99c72 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:26.624226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087348a0-74fb-48fa-8814-d805c108c96c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:26.624719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087348a0-74fb-48fa-8814-d805c108c96c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:26.624719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087348a0-74fb-48fa-8814-d805c108c96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:26.681137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-087348a0-74fb-48fa-8814-d805c108c96c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:26.683413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-087348a0-74fb-48fa-8814-d805c108c96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:26.832403 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3654/7284] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:26.840421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4186f-5ef0-48b9-b985-c606e6cd4eff None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:26.840984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4186f-5ef0-48b9-b985-c606e6cd4eff None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:26.840984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4186f-5ef0-48b9-b985-c606e6cd4eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:26.890618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a6b4186f-5ef0-48b9-b985-c606e6cd4eff None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:26.893748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a6b4186f-5ef0-48b9-b985-c606e6cd4eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:26.910723 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3631/7285] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:26.915204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087348a0-74fb-48fa-8814-d805c108c96c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:26.927255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087348a0-74fb-48fa-8814-d805c108c96c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:26.952509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74764bcc-3e27-42af-a761-e07b846fbbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:26.953283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74764bcc-3e27-42af-a761-e07b846fbbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:26.953642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74764bcc-3e27-42af-a761-e07b846fbbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:26.953990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74764bcc-3e27-42af-a761-e07b846fbbb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:26.954776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74764bcc-3e27-42af-a761-e07b846fbbb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:26.955155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74764bcc-3e27-42af-a761-e07b846fbbb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:26.956836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74764bcc-3e27-42af-a761-e07b846fbbb8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:26.973821 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3655/7286] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:26.975381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4186f-5ef0-48b9-b985-c606e6cd4eff None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:26.989509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4186f-5ef0-48b9-b985-c606e6cd4eff None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:26.999317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b2a59-b2c5-47be-ae4a-c7f83daa5d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:27.002652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b2a59-b2c5-47be-ae4a-c7f83daa5d43 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:27.003079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b2a59-b2c5-47be-ae4a-c7f83daa5d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:27.003850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b2a59-b2c5-47be-ae4a-c7f83daa5d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:27.004604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b2a59-b2c5-47be-ae4a-c7f83daa5d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:27.008186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b2a59-b2c5-47be-ae4a-c7f83daa5d43 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:27.048004 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3632/7287] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:26 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:27.052844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74764bcc-3e27-42af-a761-e07b846fbbb8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:27.075924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74764bcc-3e27-42af-a761-e07b846fbbb8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:27.148270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:27.164366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea5935-4275-4ea3-b227-12965b57023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:27.165159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea5935-4275-4ea3-b227-12965b57023b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:27.165711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea5935-4275-4ea3-b227-12965b57023b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:27.166253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea5935-4275-4ea3-b227-12965b57023b admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:27.167275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea5935-4275-4ea3-b227-12965b57023b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:27.182350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea5935-4275-4ea3-b227-12965b57023b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:27.221085 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3656/7288] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:27 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:27.225575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b2a59-b2c5-47be-ae4a-c7f83daa5d43 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:27.238834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b2a59-b2c5-47be-ae4a-c7f83daa5d43 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:27.244206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab2af5-4a29-4797-889c-6d43ae89145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:27.244818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab2af5-4a29-4797-889c-6d43ae89145f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:27.245733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab2af5-4a29-4797-889c-6d43ae89145f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:27.246013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab2af5-4a29-4797-889c-6d43ae89145f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:27.246890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab2af5-4a29-4797-889c-6d43ae89145f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:27.249101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab2af5-4a29-4797-889c-6d43ae89145f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:27.262001 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3633/7289] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:27.265949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea5935-4275-4ea3-b227-12965b57023b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:27.276654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea5935-4275-4ea3-b227-12965b57023b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:27.283496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4be38-cf5d-4bae-9213-b2db8e0e596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:27.284131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4be38-cf5d-4bae-9213-b2db8e0e596f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:27.284395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4be38-cf5d-4bae-9213-b2db8e0e596f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:27.284673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4be38-cf5d-4bae-9213-b2db8e0e596f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:27.293746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4be38-cf5d-4bae-9213-b2db8e0e596f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:27.295481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4be38-cf5d-4bae-9213-b2db8e0e596f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:27.310090 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3657/7290] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:27.313967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab2af5-4a29-4797-889c-6d43ae89145f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:27.320974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:27.327327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab2af5-4a29-4797-889c-6d43ae89145f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:27.335340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f0697-bd50-4e6e-90ed-ad4374796dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:27.336288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f0697-bd50-4e6e-90ed-ad4374796dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:27.337210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f0697-bd50-4e6e-90ed-ad4374796dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:27.338218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f0697-bd50-4e6e-90ed-ad4374796dc8 admin admin] PATH_INFO: `/v3/projects/7948dcead48c45e8a73d309630d01966/users/77767a3d225c4ce98e673ca193dd01e9/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:27.338360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d8448-846b-42fd-b397-a26894805f4f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:27.338809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d8448-846b-42fd-b397-a26894805f4f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:27.339849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d8448-846b-42fd-b397-a26894805f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:27.359182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f0697-bd50-4e6e-90ed-ad4374796dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7948dcead48c45e8a73d309630d01966, user_id=77767a3d225c4ce98e673ca193dd01e9, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:27.362243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f0697-bd50-4e6e-90ed-ad4374796dc8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:27.366630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d54d8448-846b-42fd-b397-a26894805f4f None None] MFA Rules not processed for user `fb1934672e5840c680cbcbf9ff0e5b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:27.367817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d54d8448-846b-42fd-b397-a26894805f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:27.374315 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3658/7291] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:27 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 21:20:27.376002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d8448-846b-42fd-b397-a26894805f4f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:27.377731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d54d8448-846b-42fd-b397-a26894805f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:27.392631 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3634/7292] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:27 2022] PUT /identity/v3/projects/7948dcead48c45e8a73d309630d01966/users/77767a3d225c4ce98e673ca193dd01e9/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:27.399484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8f7bf-c221-4bf7-99cd-958f8d5672e8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:27.399774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8f7bf-c221-4bf7-99cd-958f8d5672e8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:27.400059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8f7bf-c221-4bf7-99cd-958f8d5672e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:27.451060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b5c8f7bf-c221-4bf7-99cd-958f8d5672e8 None None] MFA Rules not processed for user `77767a3d225c4ce98e673ca193dd01e9`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:27.452429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b5c8f7bf-c221-4bf7-99cd-958f8d5672e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:27.478830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d8448-846b-42fd-b397-a26894805f4f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:27.494503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d15cd6-0933-4fe0-b235-b8c1a0ec5a2f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:27.495669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d15cd6-0933-4fe0-b235-b8c1a0ec5a2f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:27.495964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d15cd6-0933-4fe0-b235-b8c1a0ec5a2f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:27.496247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d15cd6-0933-4fe0-b235-b8c1a0ec5a2f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:27.506177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d15cd6-0933-4fe0-b235-b8c1a0ec5a2f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:27.508698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d15cd6-0933-4fe0-b235-b8c1a0ec5a2f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:27.520971 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3659/7293] 10.222.0.26 () {56 vars in 1263 bytes} [Sat Oct 8 21:20:27 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 21:20:27.521984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d15cd6-0933-4fe0-b235-b8c1a0ec5a2f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:27.536245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d15cd6-0933-4fe0-b235-b8c1a0ec5a2f tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:27.542268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:27.542877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:27.543158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:27.543432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/fb1934672e5840c680cbcbf9ff0e5b8f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:27.544548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fb1934672e5840c680cbcbf9ff0e5b8f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:27.548228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:27.556586 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3635/7294] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:27.561434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8f7bf-c221-4bf7-99cd-958f8d5672e8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:27.672735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1934672e5840c680cbcbf9ff0e5b8f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:27.677795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8f7bf-c221-4bf7-99cd-958f8d5672e8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:27.682143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1934672e5840c680cbcbf9ff0e5b8f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:27.683831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38984395-6bbb-490a-89bd-6dfe271dc0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:27.684096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1934672e5840c680cbcbf9ff0e5b8f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:27.684639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38984395-6bbb-490a-89bd-6dfe271dc0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:27.685067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1934672e5840c680cbcbf9ff0e5b8f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:27.685224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38984395-6bbb-490a-89bd-6dfe271dc0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:27.685508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38984395-6bbb-490a-89bd-6dfe271dc0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:27.686228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38984395-6bbb-490a-89bd-6dfe271dc0e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:27.688836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38984395-6bbb-490a-89bd-6dfe271dc0e7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:27.700994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1934672e5840c680cbcbf9ff0e5b8f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:27.723304 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3636/7295] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:27 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:27.725265 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3660/7296] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:27 2022] DELETE /identity/v3/users/fb1934672e5840c680cbcbf9ff0e5b8f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:27.727164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38984395-6bbb-490a-89bd-6dfe271dc0e7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:27.731044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:27.733645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-38984395-6bbb-490a-89bd-6dfe271dc0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:27.735998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:27.802659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:27.835641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:27.844184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38984395-6bbb-490a-89bd-6dfe271dc0e7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:27.877441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c70df-2717-490b-a940-301ba1441700 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:27.883800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8b284-f7f5-4f94-8691-afb18ac1908c tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:27.884650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8b284-f7f5-4f94-8691-afb18ac1908c tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:27.884943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8b284-f7f5-4f94-8691-afb18ac1908c tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:27.885241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8b284-f7f5-4f94-8691-afb18ac1908c tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:27.886568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8b284-f7f5-4f94-8691-afb18ac1908c tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:27.889580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8b284-f7f5-4f94-8691-afb18ac1908c tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:27.930870 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3661/7297] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:27 2022] POST /identity/v3/users => generated 364 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:27.934782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8b284-f7f5-4f94-8691-afb18ac1908c tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:27.946310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb281a-913a-4bd9-b530-24a83f75bc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:27.947044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb281a-913a-4bd9-b530-24a83f75bc27 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:27.947631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb281a-913a-4bd9-b530-24a83f75bc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:27.947994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb281a-913a-4bd9-b530-24a83f75bc27 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:27.949270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb281a-913a-4bd9-b530-24a83f75bc27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:27.951869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb281a-913a-4bd9-b530-24a83f75bc27 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:27.961247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8b284-f7f5-4f94-8691-afb18ac1908c tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:27.970708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e0d5c-af66-4413-b462-4c84ec368daf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:27.972775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e0d5c-af66-4413-b462-4c84ec368daf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:27.973637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e0d5c-af66-4413-b462-4c84ec368daf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:27.974301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e0d5c-af66-4413-b462-4c84ec368daf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:27.975330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e0d5c-af66-4413-b462-4c84ec368daf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:27.977830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e0d5c-af66-4413-b462-4c84ec368daf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:27.988807 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3637/7298] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:27 2022] POST /identity/v3/users => generated 297 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:27.993102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb281a-913a-4bd9-b530-24a83f75bc27 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:28.022925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb281a-913a-4bd9-b530-24a83f75bc27 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:28.029466 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3662/7299] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:27 2022] POST /identity/v3/projects => generated 360 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:28.032608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e0d5c-af66-4413-b462-4c84ec368daf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:28.117370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e0d5c-af66-4413-b462-4c84ec368daf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:28.124089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c098f8c-b76c-46a0-b8ab-da9142603dbf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:28.124819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c098f8c-b76c-46a0-b8ab-da9142603dbf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:28.125206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c098f8c-b76c-46a0-b8ab-da9142603dbf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:28.125786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c098f8c-b76c-46a0-b8ab-da9142603dbf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/5eff85a271414fe5b21a57c666ae4f85` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:28.148836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c098f8c-b76c-46a0-b8ab-da9142603dbf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:update_user(user_id=5eff85a271414fe5b21a57c666ae4f85)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:28.151151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c098f8c-b76c-46a0-b8ab-da9142603dbf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:28.152456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb93b7b-d847-41ee-8037-22c163a8dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:28.153416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb93b7b-d847-41ee-8037-22c163a8dbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:28.153786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb93b7b-d847-41ee-8037-22c163a8dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:28.154252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb93b7b-d847-41ee-8037-22c163a8dbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:28.154974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb93b7b-d847-41ee-8037-22c163a8dbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:28.157172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb93b7b-d847-41ee-8037-22c163a8dbd2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:28.197246 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3638/7300] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:28.211938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb93b7b-d847-41ee-8037-22c163a8dbd2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:28.233798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb93b7b-d847-41ee-8037-22c163a8dbd2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:28.235358 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3663/7301] 10.222.0.26 () {60 vars in 1244 bytes} [Sat Oct 8 21:20:28 2022] PATCH /identity/v3/users/5eff85a271414fe5b21a57c666ae4f85 => generated 522 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:28.243844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c098f8c-b76c-46a0-b8ab-da9142603dbf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:28.264823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c098f8c-b76c-46a0-b8ab-da9142603dbf tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:28.267558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf1db2-0d97-4924-acc0-ecfbf86f56af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:28.268259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf1db2-0d97-4924-acc0-ecfbf86f56af admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:28.268544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf1db2-0d97-4924-acc0-ecfbf86f56af admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:28.268826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf1db2-0d97-4924-acc0-ecfbf86f56af admin admin] PATH_INFO: `/v3/projects/2cfa96136eb649d691765c421f6c9972/users/2b25c6c87e0e43909a8d0a089155f260/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:28.285216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e4563-1899-4729-9634-385e7e6a3a2b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:28.287067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e4563-1899-4729-9634-385e7e6a3a2b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:28.287539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e4563-1899-4729-9634-385e7e6a3a2b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:28.287985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e4563-1899-4729-9634-385e7e6a3a2b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/5eff85a271414fe5b21a57c666ae4f85` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:28.324423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf1db2-0d97-4924-acc0-ecfbf86f56af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfa96136eb649d691765c421f6c9972, user_id=2b25c6c87e0e43909a8d0a089155f260, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:28.327142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf1db2-0d97-4924-acc0-ecfbf86f56af admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:28.330841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e4563-1899-4729-9634-385e7e6a3a2b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:get_user(user_id=5eff85a271414fe5b21a57c666ae4f85)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:28.333258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e4563-1899-4729-9634-385e7e6a3a2b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:28.336137 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3664/7302] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:20:28 2022] GET /identity/v3/users/5eff85a271414fe5b21a57c666ae4f85 => generated 389 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:28.340534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e4563-1899-4729-9634-385e7e6a3a2b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:28.351260 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3639/7303] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:28 2022] PUT /identity/v3/projects/2cfa96136eb649d691765c421f6c9972/users/2b25c6c87e0e43909a8d0a089155f260/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:28.353751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e4563-1899-4729-9634-385e7e6a3a2b tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:28.356008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf1db2-0d97-4924-acc0-ecfbf86f56af admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:28.464422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:28.470340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf1db2-0d97-4924-acc0-ecfbf86f56af admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:28.474779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:28.475829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:28.476304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:28.476619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/projects/a73f2b9aa54e454db4525d4b67256de6` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:28.478303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a73f2b9aa54e454db4525d4b67256de6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:28.480563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:28.483387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87190b-6e35-4400-8ac6-347cbfa7a6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:28.484095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87190b-6e35-4400-8ac6-347cbfa7a6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:28.484427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87190b-6e35-4400-8ac6-347cbfa7a6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:28.485114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87190b-6e35-4400-8ac6-347cbfa7a6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:28.485806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87190b-6e35-4400-8ac6-347cbfa7a6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:28.487902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87190b-6e35-4400-8ac6-347cbfa7a6e5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:28.495186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:28.503986 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3640/7304] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:28.507684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87190b-6e35-4400-8ac6-347cbfa7a6e5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:28.522547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87190b-6e35-4400-8ac6-347cbfa7a6e5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:28.530185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd62ee-d676-4931-b446-153749c91fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:28.531124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd62ee-d676-4931-b446-153749c91fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:28.531441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd62ee-d676-4931-b446-153749c91fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:28.531718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd62ee-d676-4931-b446-153749c91fb0 admin admin] PATH_INFO: `/v3/projects/2cfa96136eb649d691765c421f6c9972/users/2b25c6c87e0e43909a8d0a089155f260/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:28.534513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd62ee-d676-4931-b446-153749c91fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfa96136eb649d691765c421f6c9972, user_id=2b25c6c87e0e43909a8d0a089155f260, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:28.538147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd62ee-d676-4931-b446-153749c91fb0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:28.551441 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3641/7305] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:28 2022] PUT /identity/v3/projects/2cfa96136eb649d691765c421f6c9972/users/2b25c6c87e0e43909a8d0a089155f260/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:28.559345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73f2b9aa54e454db4525d4b67256de6', 'request_id': 'req-e2169a45-7fd2-4f9f-95a8-f3b356086b52'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:28.565070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f41d68-2e10-486d-9355-171b7165add0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:28.565442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f41d68-2e10-486d-9355-171b7165add0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:28.565665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f41d68-2e10-486d-9355-171b7165add0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:28.571955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73f2b9aa54e454db4525d4b67256de6', 'request_id': 'req-e2169a45-7fd2-4f9f-95a8-f3b356086b52'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:28.586541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73f2b9aa54e454db4525d4b67256de6', 'request_id': 'req-e2169a45-7fd2-4f9f-95a8-f3b356086b52'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:28.599631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] The token cache is being invalidate because project a73f2b9aa54e454db4525d4b67256de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:28.599852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-76f41d68-2e10-486d-9355-171b7165add0 None None] MFA Rules not processed for user `2b25c6c87e0e43909a8d0a089155f260`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:28.600145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:28.600977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:28.601452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-76f41d68-2e10-486d-9355-171b7165add0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:28.603284 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3665/7306] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:28 2022] DELETE /identity/v3/projects/a73f2b9aa54e454db4525d4b67256de6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:28.606965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:28.608519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:28.724742 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3642/7307] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:28.736347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2169a45-7fd2-4f9f-95a8-f3b356086b52 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:28.738085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f41d68-2e10-486d-9355-171b7165add0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:28.739914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-76f41d68-2e10-486d-9355-171b7165add0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:28.813444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141628bd-153c-4a0b-94e7-abe6afe61c38 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aecc991f49db461e93a451decbe3e7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '130695f407914fac818eca42619084d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:28.814191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141628bd-153c-4a0b-94e7-abe6afe61c38 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:28.814480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141628bd-153c-4a0b-94e7-abe6afe61c38 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:28.814800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141628bd-153c-4a0b-94e7-abe6afe61c38 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] PATH_INFO: `/v3/users/5eff85a271414fe5b21a57c666ae4f85` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:28.816023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141628bd-153c-4a0b-94e7-abe6afe61c38 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5eff85a271414fe5b21a57c666ae4f85)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:28.817990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141628bd-153c-4a0b-94e7-abe6afe61c38 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:28.842225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f41d68-2e10-486d-9355-171b7165add0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:28.849726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d59b44-67ad-4fb7-8a12-dd77de58d205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:28.850597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d59b44-67ad-4fb7-8a12-dd77de58d205 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:28.850778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d59b44-67ad-4fb7-8a12-dd77de58d205 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:28.851102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d59b44-67ad-4fb7-8a12-dd77de58d205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:28.856949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b6d59b44-67ad-4fb7-8a12-dd77de58d205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:28.866710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:28.891258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-141628bd-153c-4a0b-94e7-abe6afe61c38 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eff85a271414fe5b21a57c666ae4f85'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:28.911979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-141628bd-153c-4a0b-94e7-abe6afe61c38 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eff85a271414fe5b21a57c666ae4f85'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:28.913074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-141628bd-153c-4a0b-94e7-abe6afe61c38 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eff85a271414fe5b21a57c666ae4f85'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:28.913795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-141628bd-153c-4a0b-94e7-abe6afe61c38 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eff85a271414fe5b21a57c666ae4f85'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:28.934847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-141628bd-153c-4a0b-94e7-abe6afe61c38 tempest-UsersV3TestJSON-1379022506 tempest-UsersV3TestJSON-1379022506-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eff85a271414fe5b21a57c666ae4f85'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:28.951589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d59b44-67ad-4fb7-8a12-dd77de58d205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:28.953575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d59b44-67ad-4fb7-8a12-dd77de58d205 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:28.964507 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3643/7308] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:20:28.966663 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3666/7309] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:28 2022] DELETE /identity/v3/users/5eff85a271414fe5b21a57c666ae4f85 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:28.971236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d59b44-67ad-4fb7-8a12-dd77de58d205 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:28.973223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b6d59b44-67ad-4fb7-8a12-dd77de58d205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:29.021418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:29.072818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d59b44-67ad-4fb7-8a12-dd77de58d205 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:29.161912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:29.163278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:29.163791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:29.164245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] PATH_INFO: `/v3/users/484b4f5467de44f7b4131da88f3f2c62` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:29.193624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=484b4f5467de44f7b4131da88f3f2c62)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:29.197152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:29.296126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '484b4f5467de44f7b4131da88f3f2c62'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:29.305541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '484b4f5467de44f7b4131da88f3f2c62'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:29.306318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '484b4f5467de44f7b4131da88f3f2c62'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:29.307187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '484b4f5467de44f7b4131da88f3f2c62'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:29.327504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '484b4f5467de44f7b4131da88f3f2c62'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:29.359561 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3644/7310] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:28 2022] DELETE /identity/v3/users/484b4f5467de44f7b4131da88f3f2c62 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:29.363526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d370-e94b-40ac-bd5f-4ffef2627b15 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:29.364143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d370-e94b-40ac-bd5f-4ffef2627b15 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:29.364702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d370-e94b-40ac-bd5f-4ffef2627b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:29.395109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7df8d370-e94b-40ac-bd5f-4ffef2627b15 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:29.398855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7df8d370-e94b-40ac-bd5f-4ffef2627b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:29.569357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:29.572429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:29.578847 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3667/7311] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:29.634456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:29.652459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d9e20-3175-4cbd-bbd6-c2dee3b46ea4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:29.657680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa6c08-5bc3-44ad-9151-38a80fc6e77b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:29.658560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa6c08-5bc3-44ad-9151-38a80fc6e77b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:29.659141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa6c08-5bc3-44ad-9151-38a80fc6e77b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:29.659490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa6c08-5bc3-44ad-9151-38a80fc6e77b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:29.670798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa6c08-5bc3-44ad-9151-38a80fc6e77b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:29.672678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa6c08-5bc3-44ad-9151-38a80fc6e77b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:29.690994 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3645/7312] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:20:30.057925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8d370-e94b-40ac-bd5f-4ffef2627b15 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:30.059517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7df8d370-e94b-40ac-bd5f-4ffef2627b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:30.081649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8d370-e94b-40ac-bd5f-4ffef2627b15 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:30.088653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:30.089773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:30.090314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:30.090602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] PATH_INFO: `/v3/projects/2405c4dcd0544ef497c9a9b33de34fda` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:30.091902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2405c4dcd0544ef497c9a9b33de34fda)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:30.093988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:30.157696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2405c4dcd0544ef497c9a9b33de34fda', 'request_id': 'req-b11b0833-e786-42d6-990b-f101253c68c8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:30.167754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2405c4dcd0544ef497c9a9b33de34fda', 'request_id': 'req-b11b0833-e786-42d6-990b-f101253c68c8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:30.174457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2405c4dcd0544ef497c9a9b33de34fda', 'request_id': 'req-b11b0833-e786-42d6-990b-f101253c68c8'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:30.193694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] The token cache is being invalidate because project 2405c4dcd0544ef497c9a9b33de34fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:30.194039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:30.194696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:30.196682 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3668/7313] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:30 2022] DELETE /identity/v3/projects/2405c4dcd0544ef497c9a9b33de34fda => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:30.200888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa6c08-5bc3-44ad-9151-38a80fc6e77b service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:30.211983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa6c08-5bc3-44ad-9151-38a80fc6e77b service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:30.310980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eac71-662f-4927-814e-82048a31cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:30.311917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eac71-662f-4927-814e-82048a31cd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:30.312311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eac71-662f-4927-814e-82048a31cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:30.312759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eac71-662f-4927-814e-82048a31cd1d admin admin] PATH_INFO: `/v3/users/aecc991f49db461e93a451decbe3e7a8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:30.314515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056eac71-662f-4927-814e-82048a31cd1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecc991f49db461e93a451decbe3e7a8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:30.316538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056eac71-662f-4927-814e-82048a31cd1d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:30.407342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-056eac71-662f-4927-814e-82048a31cd1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecc991f49db461e93a451decbe3e7a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:30.415878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-056eac71-662f-4927-814e-82048a31cd1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecc991f49db461e93a451decbe3e7a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:30.416708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-056eac71-662f-4927-814e-82048a31cd1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecc991f49db461e93a451decbe3e7a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:30.417428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-056eac71-662f-4927-814e-82048a31cd1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecc991f49db461e93a451decbe3e7a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:30.436316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-056eac71-662f-4927-814e-82048a31cd1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecc991f49db461e93a451decbe3e7a8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:30.461684 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3646/7314] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:30 2022] DELETE /identity/v3/users/aecc991f49db461e93a451decbe3e7a8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:30.983895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:30.989879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:31.021739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b0833-e786-42d6-990b-f101253c68c8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:31.079549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:31.112402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:31.113417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:31.113878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:31.114476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c admin admin] PATH_INFO: `/v3/projects/130695f407914fac818eca42619084d1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:31.115795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=130695f407914fac818eca42619084d1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:31.117949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:31.194764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130695f407914fac818eca42619084d1', 'request_id': 'req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:31.209234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130695f407914fac818eca42619084d1', 'request_id': 'req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:31.218747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130695f407914fac818eca42619084d1', 'request_id': 'req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:31.251611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c admin admin] The token cache is being invalidate because project 130695f407914fac818eca42619084d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:31.251904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:31.252578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dd2558e9-ae2a-4f58-bdc5-a093ee10f10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:31.258124 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3669/7315] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:30 2022] DELETE /identity/v3/projects/130695f407914fac818eca42619084d1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:31.259918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292016a0-69dc-47af-8e53-a495026dbd51 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:31.260428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292016a0-69dc-47af-8e53-a495026dbd51 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:31.260999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292016a0-69dc-47af-8e53-a495026dbd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:31.297523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-292016a0-69dc-47af-8e53-a495026dbd51 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:31.298878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-292016a0-69dc-47af-8e53-a495026dbd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:31.405259 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3647/7316] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:31.413606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decb655-bbbb-4838-bce5-d9cacac1fe53 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:31.413913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decb655-bbbb-4838-bce5-d9cacac1fe53 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:31.414186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decb655-bbbb-4838-bce5-d9cacac1fe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:31.446693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2decb655-bbbb-4838-bce5-d9cacac1fe53 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:31.449683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2decb655-bbbb-4838-bce5-d9cacac1fe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:31.465008 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3670/7317] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:31.469114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292016a0-69dc-47af-8e53-a495026dbd51 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:31.476523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:31.481996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292016a0-69dc-47af-8e53-a495026dbd51 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:31.493923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cbb4c-2a18-40da-ac76-ff6c4b7e4f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:31.494787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cbb4c-2a18-40da-ac76-ff6c4b7e4f6e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:31.499038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cbb4c-2a18-40da-ac76-ff6c4b7e4f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:31.499599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cbb4c-2a18-40da-ac76-ff6c4b7e4f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:31.500406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cbb4c-2a18-40da-ac76-ff6c4b7e4f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:31.513924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cbb4c-2a18-40da-ac76-ff6c4b7e4f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:31.517255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cbb4c-2a18-40da-ac76-ff6c4b7e4f6e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:31.533229 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3648/7318] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:20:31.535939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decb655-bbbb-4838-bce5-d9cacac1fe53 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:31.548516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decb655-bbbb-4838-bce5-d9cacac1fe53 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:31.553641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe8739-8b70-4f09-9eaf-d1c923c2cadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:31.554452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe8739-8b70-4f09-9eaf-d1c923c2cadd admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:31.554733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe8739-8b70-4f09-9eaf-d1c923c2cadd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:31.555003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe8739-8b70-4f09-9eaf-d1c923c2cadd admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:31.555641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe8739-8b70-4f09-9eaf-d1c923c2cadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:31.558224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe8739-8b70-4f09-9eaf-d1c923c2cadd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:31.631688 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3671/7319] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:31 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:31.640799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cbb4c-2a18-40da-ac76-ff6c4b7e4f6e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:31.654993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cbb4c-2a18-40da-ac76-ff6c4b7e4f6e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:31.738262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8581a9d-21e0-4a00-8858-6de45a8cc4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:31.739064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8581a9d-21e0-4a00-8858-6de45a8cc4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:31.740184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8581a9d-21e0-4a00-8858-6de45a8cc4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:31.740722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8581a9d-21e0-4a00-8858-6de45a8cc4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:31.742054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8581a9d-21e0-4a00-8858-6de45a8cc4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:31.744411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8581a9d-21e0-4a00-8858-6de45a8cc4d5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:31.786009 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3649/7320] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:31 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:31.787163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe8739-8b70-4f09-9eaf-d1c923c2cadd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:31.802455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe8739-8b70-4f09-9eaf-d1c923c2cadd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:31.816803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f15f2-c845-4d1e-873e-c1afe684d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:31.818119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f15f2-c845-4d1e-873e-c1afe684d0da admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:31.819495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f15f2-c845-4d1e-873e-c1afe684d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:31.820064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f15f2-c845-4d1e-873e-c1afe684d0da admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:31.823155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f15f2-c845-4d1e-873e-c1afe684d0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:31.839179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f15f2-c845-4d1e-873e-c1afe684d0da admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:31.855542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8581a9d-21e0-4a00-8858-6de45a8cc4d5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:31.866607 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3672/7321] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:31.867299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8581a9d-21e0-4a00-8858-6de45a8cc4d5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:31.872936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f92782-c7f7-47e2-8dab-3fb2bf8299c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:31.873676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f92782-c7f7-47e2-8dab-3fb2bf8299c6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:31.874099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f92782-c7f7-47e2-8dab-3fb2bf8299c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:31.874394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f92782-c7f7-47e2-8dab-3fb2bf8299c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:31.875035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f92782-c7f7-47e2-8dab-3fb2bf8299c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:31.876624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f92782-c7f7-47e2-8dab-3fb2bf8299c6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:31.892543 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3650/7322] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:31.897167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f15f2-c845-4d1e-873e-c1afe684d0da admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:31.911676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f15f2-c845-4d1e-873e-c1afe684d0da admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:31.915182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a66bf-916b-4502-8227-6679e841354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:31.916093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a66bf-916b-4502-8227-6679e841354a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:31.916378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a66bf-916b-4502-8227-6679e841354a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:31.916649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a66bf-916b-4502-8227-6679e841354a admin admin] PATH_INFO: `/v3/projects/578a1498b13b47fba11bbc7d32cb9fca/users/3d4c7b98a0a54c63b88e61b2a3d95612/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:31.938045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a66bf-916b-4502-8227-6679e841354a admin admin] RBAC: Authorizing `identity:create_grant(project_id=578a1498b13b47fba11bbc7d32cb9fca, user_id=3d4c7b98a0a54c63b88e61b2a3d95612, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:31.940973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a66bf-916b-4502-8227-6679e841354a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:31.963169 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3673/7323] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:31 2022] PUT /identity/v3/projects/578a1498b13b47fba11bbc7d32cb9fca/users/3d4c7b98a0a54c63b88e61b2a3d95612/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:31.974608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaff3a-26f4-4f7e-86f2-76816ad17169 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:31.974882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaff3a-26f4-4f7e-86f2-76816ad17169 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:31.975206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaff3a-26f4-4f7e-86f2-76816ad17169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:32.012375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8ccaff3a-26f4-4f7e-86f2-76816ad17169 None None] MFA Rules not processed for user `3d4c7b98a0a54c63b88e61b2a3d95612`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:32.015959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8ccaff3a-26f4-4f7e-86f2-76816ad17169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:32.113929 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3651/7324] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:32.115405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a66bf-916b-4502-8227-6679e841354a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:32.131619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a66bf-916b-4502-8227-6679e841354a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:32.144628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70f447-0025-4db8-ac31-24b9d39d09d0 tempest-DefaultDomainTestJSON-1395320284 tempest-DefaultDomainTestJSON-1395320284-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4c7b98a0a54c63b88e61b2a3d95612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578a1498b13b47fba11bbc7d32cb9fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:32.148471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70f447-0025-4db8-ac31-24b9d39d09d0 tempest-DefaultDomainTestJSON-1395320284 tempest-DefaultDomainTestJSON-1395320284-project] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:32.149615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70f447-0025-4db8-ac31-24b9d39d09d0 tempest-DefaultDomainTestJSON-1395320284 tempest-DefaultDomainTestJSON-1395320284-project] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:32.150304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70f447-0025-4db8-ac31-24b9d39d09d0 tempest-DefaultDomainTestJSON-1395320284 tempest-DefaultDomainTestJSON-1395320284-project] PATH_INFO: `/v3/domains/default` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:32.153084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70f447-0025-4db8-ac31-24b9d39d09d0 tempest-DefaultDomainTestJSON-1395320284 tempest-DefaultDomainTestJSON-1395320284-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:32.155415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70f447-0025-4db8-ac31-24b9d39d09d0 tempest-DefaultDomainTestJSON-1395320284 tempest-DefaultDomainTestJSON-1395320284-project] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:32.158731 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3674/7325] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 21:20:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:32.165106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaff3a-26f4-4f7e-86f2-76816ad17169 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:32.316493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaff3a-26f4-4f7e-86f2-76816ad17169 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:32.322943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:32.324231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:32.324649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:32.325273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] PATH_INFO: `/v3/users/3d4c7b98a0a54c63b88e61b2a3d95612` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:32.335792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d4c7b98a0a54c63b88e61b2a3d95612)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:32.339849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:32.342110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:32.414319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d4c7b98a0a54c63b88e61b2a3d95612'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:32.422427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d4c7b98a0a54c63b88e61b2a3d95612'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:32.423225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d4c7b98a0a54c63b88e61b2a3d95612'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:32.423921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d4c7b98a0a54c63b88e61b2a3d95612'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:32.446343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d4c7b98a0a54c63b88e61b2a3d95612'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:32.467709 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3652/7326] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:32 2022] DELETE /identity/v3/users/3d4c7b98a0a54c63b88e61b2a3d95612 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:32.472194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed5328-db31-41fe-8ed7-6d21dc0dfc8e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:32.472487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed5328-db31-41fe-8ed7-6d21dc0dfc8e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:32.472856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed5328-db31-41fe-8ed7-6d21dc0dfc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:32.494830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-46ed5328-db31-41fe-8ed7-6d21dc0dfc8e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:32.497291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-46ed5328-db31-41fe-8ed7-6d21dc0dfc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:32.583473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:32.596580 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3675/7327] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:32.606976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:32.608495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:32.687144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764236e5-f8e4-4dc2-9200-92b3a1b66685 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:32.691257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f6a0b-4866-45af-9a62-df80ffb13b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:32.692096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f6a0b-4866-45af-9a62-df80ffb13b56 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:32.692728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f6a0b-4866-45af-9a62-df80ffb13b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:32.693077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f6a0b-4866-45af-9a62-df80ffb13b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:32.704717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f6a0b-4866-45af-9a62-df80ffb13b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:32.706226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f6a0b-4866-45af-9a62-df80ffb13b56 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:32.733162 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3653/7328] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:33.084055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed5328-db31-41fe-8ed7-6d21dc0dfc8e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:33.085533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-46ed5328-db31-41fe-8ed7-6d21dc0dfc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:33.115375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed5328-db31-41fe-8ed7-6d21dc0dfc8e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:33.121096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5a260-ceca-4625-b028-850980cd5076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:33.121777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5a260-ceca-4625-b028-850980cd5076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:33.122030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5a260-ceca-4625-b028-850980cd5076 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:33.122302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5a260-ceca-4625-b028-850980cd5076 admin admin] PATH_INFO: `/v3/projects/578a1498b13b47fba11bbc7d32cb9fca` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:33.123426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5a260-ceca-4625-b028-850980cd5076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=578a1498b13b47fba11bbc7d32cb9fca)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:33.127240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5a260-ceca-4625-b028-850980cd5076 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:33.187847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-69e5a260-ceca-4625-b028-850980cd5076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578a1498b13b47fba11bbc7d32cb9fca', 'request_id': 'req-69e5a260-ceca-4625-b028-850980cd5076'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:33.198577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-69e5a260-ceca-4625-b028-850980cd5076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578a1498b13b47fba11bbc7d32cb9fca', 'request_id': 'req-69e5a260-ceca-4625-b028-850980cd5076'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:33.205872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-69e5a260-ceca-4625-b028-850980cd5076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578a1498b13b47fba11bbc7d32cb9fca', 'request_id': 'req-69e5a260-ceca-4625-b028-850980cd5076'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:33.219797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-69e5a260-ceca-4625-b028-850980cd5076 admin admin] The token cache is being invalidate because project 578a1498b13b47fba11bbc7d32cb9fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:33.220093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-69e5a260-ceca-4625-b028-850980cd5076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:33.220760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-69e5a260-ceca-4625-b028-850980cd5076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:33.222574 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3676/7329] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:33 2022] DELETE /identity/v3/projects/578a1498b13b47fba11bbc7d32cb9fca => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:33.229303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bc9e4-f63d-4343-af6e-1603b707f922 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:33.229880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bc9e4-f63d-4343-af6e-1603b707f922 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:33.230612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bc9e4-f63d-4343-af6e-1603b707f922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:33.269606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2e1bc9e4-f63d-4343-af6e-1603b707f922 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:33.270915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2e1bc9e4-f63d-4343-af6e-1603b707f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:33.346816 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3654/7330] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:33.356711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590689f-db1e-457e-9706-8dfeffb76654 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:33.357037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590689f-db1e-457e-9706-8dfeffb76654 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:33.357298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590689f-db1e-457e-9706-8dfeffb76654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:33.399844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b590689f-db1e-457e-9706-8dfeffb76654 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:33.409508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b590689f-db1e-457e-9706-8dfeffb76654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:33.425127 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3677/7331] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:33.429681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bc9e4-f63d-4343-af6e-1603b707f922 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:33.441031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bc9e4-f63d-4343-af6e-1603b707f922 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:33.446251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019103a-e872-45da-94c4-9558b7bdf4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:33.446995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019103a-e872-45da-94c4-9558b7bdf4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:33.447377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019103a-e872-45da-94c4-9558b7bdf4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:33.447791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019103a-e872-45da-94c4-9558b7bdf4a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:33.449265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019103a-e872-45da-94c4-9558b7bdf4a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:33.449676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019103a-e872-45da-94c4-9558b7bdf4a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:33.451345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019103a-e872-45da-94c4-9558b7bdf4a5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:33.464756 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3655/7332] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:33.473663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590689f-db1e-457e-9706-8dfeffb76654 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:33.507982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590689f-db1e-457e-9706-8dfeffb76654 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:33.517123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e335f7-fb28-4a4c-ad0f-bc181a4c184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:33.517769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e335f7-fb28-4a4c-ad0f-bc181a4c184f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:33.518079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e335f7-fb28-4a4c-ad0f-bc181a4c184f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:33.518661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e335f7-fb28-4a4c-ad0f-bc181a4c184f admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:33.519599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e335f7-fb28-4a4c-ad0f-bc181a4c184f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:33.521563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e335f7-fb28-4a4c-ad0f-bc181a4c184f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:33.568401 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3678/7333] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:33 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:33.572744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019103a-e872-45da-94c4-9558b7bdf4a5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:33.593637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019103a-e872-45da-94c4-9558b7bdf4a5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:33.605663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:33.707476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e457ba0-4b1c-4bf5-88bf-5202e25483bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:33.708208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e457ba0-4b1c-4bf5-88bf-5202e25483bd admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:33.708493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e457ba0-4b1c-4bf5-88bf-5202e25483bd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:33.708952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e457ba0-4b1c-4bf5-88bf-5202e25483bd admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:33.709887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e457ba0-4b1c-4bf5-88bf-5202e25483bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:33.712434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e457ba0-4b1c-4bf5-88bf-5202e25483bd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:33.744087 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3656/7334] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:33 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:33.748751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e335f7-fb28-4a4c-ad0f-bc181a4c184f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:33.759667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e335f7-fb28-4a4c-ad0f-bc181a4c184f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:33.764431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b41ad-b059-41d7-9fc7-c7ebc4113fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:33.765036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b41ad-b059-41d7-9fc7-c7ebc4113fdc admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:33.765388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b41ad-b059-41d7-9fc7-c7ebc4113fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:33.765675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b41ad-b059-41d7-9fc7-c7ebc4113fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:33.766346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b41ad-b059-41d7-9fc7-c7ebc4113fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:33.767957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b41ad-b059-41d7-9fc7-c7ebc4113fdc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:33.778999 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3679/7335] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:33.783806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e457ba0-4b1c-4bf5-88bf-5202e25483bd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:33.794798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e457ba0-4b1c-4bf5-88bf-5202e25483bd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:33.802196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8e2db-3f2f-454e-99bf-272c32174ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:33.802821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8e2db-3f2f-454e-99bf-272c32174ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:33.803092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8e2db-3f2f-454e-99bf-272c32174ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:33.803369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8e2db-3f2f-454e-99bf-272c32174ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:33.804016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8e2db-3f2f-454e-99bf-272c32174ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:33.805666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8e2db-3f2f-454e-99bf-272c32174ae4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:33.818501 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3657/7336] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:33.822455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b41ad-b059-41d7-9fc7-c7ebc4113fdc admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:33.837620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b41ad-b059-41d7-9fc7-c7ebc4113fdc admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:33.842797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ba0e6-6951-44cc-b731-54981dcfbb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:33.844003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ba0e6-6951-44cc-b731-54981dcfbb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:33.844466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ba0e6-6951-44cc-b731-54981dcfbb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:33.844917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ba0e6-6951-44cc-b731-54981dcfbb84 admin admin] PATH_INFO: `/v3/projects/ae0d1a0a211f4a34af38aae41119a052/users/525055f89ba844519803a25eddd2eb76/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:33.868245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ba0e6-6951-44cc-b731-54981dcfbb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0d1a0a211f4a34af38aae41119a052, user_id=525055f89ba844519803a25eddd2eb76, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:33.871754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ba0e6-6951-44cc-b731-54981dcfbb84 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:33.887432 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3680/7337] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:33 2022] PUT /identity/v3/projects/ae0d1a0a211f4a34af38aae41119a052/users/525055f89ba844519803a25eddd2eb76/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:33.900420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816c3ab-4d2d-4f5b-a006-dc4d0a1f64c8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:33.900707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816c3ab-4d2d-4f5b-a006-dc4d0a1f64c8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:33.900985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816c3ab-4d2d-4f5b-a006-dc4d0a1f64c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:33.936902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3816c3ab-4d2d-4f5b-a006-dc4d0a1f64c8 None None] MFA Rules not processed for user `525055f89ba844519803a25eddd2eb76`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:33.938462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3816c3ab-4d2d-4f5b-a006-dc4d0a1f64c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:34.065552 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3658/7338] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:34.078441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ba0e6-6951-44cc-b731-54981dcfbb84 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:34.080164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3e3ba0e6-6951-44cc-b731-54981dcfbb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:34.160987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ba0e6-6951-44cc-b731-54981dcfbb84 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:34.165065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59f144-b298-4cf0-860d-a49e12261010 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:34.165707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59f144-b298-4cf0-860d-a49e12261010 service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:34.165991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59f144-b298-4cf0-860d-a49e12261010 service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:34.166261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59f144-b298-4cf0-860d-a49e12261010 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:34.176840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59f144-b298-4cf0-860d-a49e12261010 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:34.179547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59f144-b298-4cf0-860d-a49e12261010 service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:34.190259 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3681/7339] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:34.352884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5889de0-41a2-42ae-a62f-754689b71e67 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:34.353697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5889de0-41a2-42ae-a62f-754689b71e67 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:34.353697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5889de0-41a2-42ae-a62f-754689b71e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:34.376716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e5889de0-41a2-42ae-a62f-754689b71e67 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:34.381045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e5889de0-41a2-42ae-a62f-754689b71e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:34.455344 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3659/7340] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:34.485555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59f144-b298-4cf0-860d-a49e12261010 service glance] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:34.487287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bd59f144-b298-4cf0-860d-a49e12261010 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:34.505930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:34.592231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59f144-b298-4cf0-860d-a49e12261010 service glance] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:34.599708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af28a3-0ff5-4003-97e0-532e762fdd95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:34.600599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af28a3-0ff5-4003-97e0-532e762fdd95 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:34.601056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af28a3-0ff5-4003-97e0-532e762fdd95 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:34.601470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af28a3-0ff5-4003-97e0-532e762fdd95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:34.613275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af28a3-0ff5-4003-97e0-532e762fdd95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:34.615348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af28a3-0ff5-4003-97e0-532e762fdd95 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:34.628028 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3682/7341] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:20:35.047225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60b1a4-ed36-4b87-9877-0181605b4953 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:35.047668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60b1a4-ed36-4b87-9877-0181605b4953 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:35.048031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60b1a4-ed36-4b87-9877-0181605b4953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:35.086941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cc60b1a4-ed36-4b87-9877-0181605b4953 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:35.100783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cc60b1a4-ed36-4b87-9877-0181605b4953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:35.130732 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3660/7342] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:20:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:35.150186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af28a3-0ff5-4003-97e0-532e762fdd95 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:35.165351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60b1a4-ed36-4b87-9877-0181605b4953 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:35.166945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cc60b1a4-ed36-4b87-9877-0181605b4953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:35.172083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af28a3-0ff5-4003-97e0-532e762fdd95 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:35.181834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b437af0-1962-4ddf-86d4-bb306b0d7be3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:35.182508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b437af0-1962-4ddf-86d4-bb306b0d7be3 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:35.182794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b437af0-1962-4ddf-86d4-bb306b0d7be3 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:35.183566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b437af0-1962-4ddf-86d4-bb306b0d7be3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:35.191824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:35.193839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b437af0-1962-4ddf-86d4-bb306b0d7be3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:35.195746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b437af0-1962-4ddf-86d4-bb306b0d7be3 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:35.209975 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3683/7343] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:20:35.269341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60b1a4-ed36-4b87-9877-0181605b4953 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:35.273610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce9f32-d784-4dc9-874b-efe1be0c71d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:35.274306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce9f32-d784-4dc9-874b-efe1be0c71d7 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:35.274790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce9f32-d784-4dc9-874b-efe1be0c71d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:35.275138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce9f32-d784-4dc9-874b-efe1be0c71d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:35.277780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-53ce9f32-d784-4dc9-874b-efe1be0c71d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:35.375544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce9f32-d784-4dc9-874b-efe1be0c71d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:35.377198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce9f32-d784-4dc9-874b-efe1be0c71d7 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:35.391624 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3661/7344] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:20:35.642318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7049da-023b-44be-97f2-c857ca4239d0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:35.645872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7049da-023b-44be-97f2-c857ca4239d0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:35.646367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7049da-023b-44be-97f2-c857ca4239d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:35.671952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cd7049da-023b-44be-97f2-c857ca4239d0 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:35.673835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cd7049da-023b-44be-97f2-c857ca4239d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:35.684426 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3684/7345] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:20:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:35.713560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce9f32-d784-4dc9-874b-efe1be0c71d7 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:35.730719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce9f32-d784-4dc9-874b-efe1be0c71d7 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:35.755827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b4a4-4c32-433d-914b-aa6528e4925a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:35.756824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b4a4-4c32-433d-914b-aa6528e4925a service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:35.757319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b4a4-4c32-433d-914b-aa6528e4925a service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:35.757608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b4a4-4c32-433d-914b-aa6528e4925a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:35.767782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b4a4-4c32-433d-914b-aa6528e4925a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:35.769421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b4a4-4c32-433d-914b-aa6528e4925a service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:35.780356 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3662/7346] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:20:36.289051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5bf9a-6ff4-4dcf-9822-3c8ca2a5d9e1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:36.289680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5bf9a-6ff4-4dcf-9822-3c8ca2a5d9e1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:36.289680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5bf9a-6ff4-4dcf-9822-3c8ca2a5d9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:36.318009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-52e5bf9a-6ff4-4dcf-9822-3c8ca2a5d9e1 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:36.320005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-52e5bf9a-6ff4-4dcf-9822-3c8ca2a5d9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:36.332015 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3685/7347] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:20:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:36.353514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b4a4-4c32-433d-914b-aa6528e4925a service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:36.367872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b4a4-4c32-433d-914b-aa6528e4925a service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:36.374072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f4208-d8cb-412f-af64-3e1ab21d3536 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:36.375064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4208-d8cb-412f-af64-3e1ab21d3536 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:36.375582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4208-d8cb-412f-af64-3e1ab21d3536 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:36.376176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4208-d8cb-412f-af64-3e1ab21d3536 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:36.391432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f4208-d8cb-412f-af64-3e1ab21d3536 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:36.393311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f4208-d8cb-412f-af64-3e1ab21d3536 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:36.409156 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3663/7348] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:20:36.761161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd494e7-9327-41e9-a8be-0b6b7cb610ec None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:36.761773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd494e7-9327-41e9-a8be-0b6b7cb610ec None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:36.762207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd494e7-9327-41e9-a8be-0b6b7cb610ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:36.786638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4dd494e7-9327-41e9-a8be-0b6b7cb610ec None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:36.787859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4dd494e7-9327-41e9-a8be-0b6b7cb610ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:36.799382 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3686/7349] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:20:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:36.827835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f4208-d8cb-412f-af64-3e1ab21d3536 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:36.840116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f4208-d8cb-412f-af64-3e1ab21d3536 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:36.851188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba87a47-0d74-4706-b0bc-bf6765686f00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:36.851807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87a47-0d74-4706-b0bc-bf6765686f00 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:36.852218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87a47-0d74-4706-b0bc-bf6765686f00 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:36.852509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87a47-0d74-4706-b0bc-bf6765686f00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:36.863310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba87a47-0d74-4706-b0bc-bf6765686f00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:36.865223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba87a47-0d74-4706-b0bc-bf6765686f00 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:36.875727 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3664/7350] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:20:37.316498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6e9fa-ed92-47a2-a228-c31d1581f5ab None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:37.316946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6e9fa-ed92-47a2-a228-c31d1581f5ab None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:37.317037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6e9fa-ed92-47a2-a228-c31d1581f5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:37.345355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8dc6e9fa-ed92-47a2-a228-c31d1581f5ab None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:37.349755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8dc6e9fa-ed92-47a2-a228-c31d1581f5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:37.373909 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3687/7351] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:20:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:37.388391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba87a47-0d74-4706-b0bc-bf6765686f00 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:37.402987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba87a47-0d74-4706-b0bc-bf6765686f00 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:37.419997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138202a-44e1-4e92-89f0-8331dd8562a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:37.421320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138202a-44e1-4e92-89f0-8331dd8562a3 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:37.421825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138202a-44e1-4e92-89f0-8331dd8562a3 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:37.425209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138202a-44e1-4e92-89f0-8331dd8562a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:37.438700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138202a-44e1-4e92-89f0-8331dd8562a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:37.440705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138202a-44e1-4e92-89f0-8331dd8562a3 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:37.457676 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3665/7352] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:20:38.716104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f135d2-2e76-43ae-979e-306c62804021 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:38.716713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f135d2-2e76-43ae-979e-306c62804021 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:38.716713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f135d2-2e76-43ae-979e-306c62804021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:38.746137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-85f135d2-2e76-43ae-979e-306c62804021 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:38.748538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-85f135d2-2e76-43ae-979e-306c62804021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:38.759595 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3688/7353] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:38.778354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138202a-44e1-4e92-89f0-8331dd8562a3 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:38.796229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138202a-44e1-4e92-89f0-8331dd8562a3 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:38.810958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7071f-b95f-45fd-b4c4-c7e99a6ee6b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:38.812309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7071f-b95f-45fd-b4c4-c7e99a6ee6b8 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:38.812743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7071f-b95f-45fd-b4c4-c7e99a6ee6b8 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:38.813118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7071f-b95f-45fd-b4c4-c7e99a6ee6b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:38.843284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7071f-b95f-45fd-b4c4-c7e99a6ee6b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:38.848540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7071f-b95f-45fd-b4c4-c7e99a6ee6b8 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:38.863387 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3666/7354] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:20:39.246698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f2fee-dc49-47af-909d-0c26bd914ded None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:39.247329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f2fee-dc49-47af-909d-0c26bd914ded None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:39.248148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f2fee-dc49-47af-909d-0c26bd914ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:39.285877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cd4f2fee-dc49-47af-909d-0c26bd914ded None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:39.289027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cd4f2fee-dc49-47af-909d-0c26bd914ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:39.301946 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3689/7355] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:39.310553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7071f-b95f-45fd-b4c4-c7e99a6ee6b8 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:39.329070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7071f-b95f-45fd-b4c4-c7e99a6ee6b8 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:39.337917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b029358-3620-4a51-8bb3-29b631899940 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:39.339313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b029358-3620-4a51-8bb3-29b631899940 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:39.339934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b029358-3620-4a51-8bb3-29b631899940 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:39.340370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b029358-3620-4a51-8bb3-29b631899940 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:39.360725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b029358-3620-4a51-8bb3-29b631899940 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:39.364729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b029358-3620-4a51-8bb3-29b631899940 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:39.383740 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3667/7356] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:20:39.658628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de5882-450a-4573-a73d-ddfa1bcf0063 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:39.658628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de5882-450a-4573-a73d-ddfa1bcf0063 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:39.658840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de5882-450a-4573-a73d-ddfa1bcf0063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:39.699457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-76de5882-450a-4573-a73d-ddfa1bcf0063 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:39.700803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-76de5882-450a-4573-a73d-ddfa1bcf0063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:39.721043 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3690/7357] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:39.751571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b029358-3620-4a51-8bb3-29b631899940 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:39.768885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b029358-3620-4a51-8bb3-29b631899940 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:39.777528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6617462-e07f-4e25-b172-cfa87185eb0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:39.778247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6617462-e07f-4e25-b172-cfa87185eb0e service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:39.778974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6617462-e07f-4e25-b172-cfa87185eb0e service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:39.779605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6617462-e07f-4e25-b172-cfa87185eb0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:39.789988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6617462-e07f-4e25-b172-cfa87185eb0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:39.792419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6617462-e07f-4e25-b172-cfa87185eb0e service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:39.821465 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3668/7358] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:20:40.089472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027807f8-298a-496a-af61-ef694ea277dc None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:40.089743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027807f8-298a-496a-af61-ef694ea277dc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:40.090191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027807f8-298a-496a-af61-ef694ea277dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:40.149169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-027807f8-298a-496a-af61-ef694ea277dc None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:40.151719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-027807f8-298a-496a-af61-ef694ea277dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:40.167867 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3691/7359] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:20:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:40.182090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6617462-e07f-4e25-b172-cfa87185eb0e service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:40.198809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6617462-e07f-4e25-b172-cfa87185eb0e service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:40.205282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa493ccf-37f5-4167-8cb1-e405f39f34be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:40.206012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa493ccf-37f5-4167-8cb1-e405f39f34be service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:40.206483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa493ccf-37f5-4167-8cb1-e405f39f34be service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:40.207045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa493ccf-37f5-4167-8cb1-e405f39f34be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:40.216591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa493ccf-37f5-4167-8cb1-e405f39f34be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:40.218690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa493ccf-37f5-4167-8cb1-e405f39f34be service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:40.227787 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3669/7360] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:20:40.442979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54574b53-3e37-4be6-a9bb-757bce786cab None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:40.443251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54574b53-3e37-4be6-a9bb-757bce786cab None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:40.443521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54574b53-3e37-4be6-a9bb-757bce786cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:40.470281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-54574b53-3e37-4be6-a9bb-757bce786cab None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:40.471517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-54574b53-3e37-4be6-a9bb-757bce786cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:40.497023 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3692/7361] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:20:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:40.513692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa493ccf-37f5-4167-8cb1-e405f39f34be service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:40.528144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa493ccf-37f5-4167-8cb1-e405f39f34be service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:40.535458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c405c-4ddd-4df0-b4ba-50717968e253 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:40.536141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c405c-4ddd-4df0-b4ba-50717968e253 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:40.536502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c405c-4ddd-4df0-b4ba-50717968e253 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:40.536838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c405c-4ddd-4df0-b4ba-50717968e253 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:40.546063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c405c-4ddd-4df0-b4ba-50717968e253 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:40.547724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c405c-4ddd-4df0-b4ba-50717968e253 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:40.557223 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3670/7362] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:20:40.762502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e8ff4-f5a8-4699-af8b-67db96d94e8e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:40.762975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e8ff4-f5a8-4699-af8b-67db96d94e8e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:40.763087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e8ff4-f5a8-4699-af8b-67db96d94e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:40.784179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fd3e8ff4-f5a8-4699-af8b-67db96d94e8e None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:40.785431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fd3e8ff4-f5a8-4699-af8b-67db96d94e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:40.793761 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3693/7363] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:20:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:40.807058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c405c-4ddd-4df0-b4ba-50717968e253 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:40.821004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c405c-4ddd-4df0-b4ba-50717968e253 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:40.831594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800f224-33c2-4de9-bfbf-d2a6996018d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:40.833105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800f224-33c2-4de9-bfbf-d2a6996018d5 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:40.833105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800f224-33c2-4de9-bfbf-d2a6996018d5 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:40.833914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800f224-33c2-4de9-bfbf-d2a6996018d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:40.844401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:40.850048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800f224-33c2-4de9-bfbf-d2a6996018d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:40.852349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800f224-33c2-4de9-bfbf-d2a6996018d5 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:40.865000 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3671/7364] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:20:40.999853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e8ff4-f5a8-4699-af8b-67db96d94e8e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:41.067373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e8ff4-f5a8-4699-af8b-67db96d94e8e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:41.072059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:41.072688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:41.073608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:41.073890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] PATH_INFO: `/v3/users/525055f89ba844519803a25eddd2eb76` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:41.075036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525055f89ba844519803a25eddd2eb76)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:41.076941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:41.099007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:41.123103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525055f89ba844519803a25eddd2eb76'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:41.130004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525055f89ba844519803a25eddd2eb76'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:41.130666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525055f89ba844519803a25eddd2eb76'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:41.131269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525055f89ba844519803a25eddd2eb76'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:41.143063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525055f89ba844519803a25eddd2eb76'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:41.157441 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3694/7365] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:40 2022] DELETE /identity/v3/users/525055f89ba844519803a25eddd2eb76 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:41.161685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e341e8-bc61-41a0-845d-e6b5323484d6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:41.161971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e341e8-bc61-41a0-845d-e6b5323484d6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:41.162247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e341e8-bc61-41a0-845d-e6b5323484d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:41.181609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b1e341e8-bc61-41a0-845d-e6b5323484d6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:41.183436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b1e341e8-bc61-41a0-845d-e6b5323484d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:41.245912 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3672/7366] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:41.255464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:41.256895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:41.319942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7183f1-2068-4e44-8504-c5971826f4c8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:41.323636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74791e60-982a-42e3-a98d-1b436a161eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:41.324242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74791e60-982a-42e3-a98d-1b436a161eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:41.324600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74791e60-982a-42e3-a98d-1b436a161eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:41.324902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74791e60-982a-42e3-a98d-1b436a161eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:41.335539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74791e60-982a-42e3-a98d-1b436a161eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:41.336942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74791e60-982a-42e3-a98d-1b436a161eb3 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:41.347391 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3695/7367] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:41.553693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a981-0167-4026-8813-f6ac24b55d3e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:41.553977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a981-0167-4026-8813-f6ac24b55d3e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:41.554278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a981-0167-4026-8813-f6ac24b55d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:41.580693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6294a981-0167-4026-8813-f6ac24b55d3e None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:41.582723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6294a981-0167-4026-8813-f6ac24b55d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:41.670860 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3673/7368] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:41.684499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74791e60-982a-42e3-a98d-1b436a161eb3 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:41.686300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-74791e60-982a-42e3-a98d-1b436a161eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:41.718214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a981-0167-4026-8813-f6ac24b55d3e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:41.720022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6294a981-0167-4026-8813-f6ac24b55d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:41.738646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a981-0167-4026-8813-f6ac24b55d3e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:41.745989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:41.746644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:41.746925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:41.747196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509 admin admin] PATH_INFO: `/v3/projects/ae0d1a0a211f4a34af38aae41119a052` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:41.748354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae0d1a0a211f4a34af38aae41119a052)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:41.750316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:41.813645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae0d1a0a211f4a34af38aae41119a052', 'request_id': 'req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:41.826949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae0d1a0a211f4a34af38aae41119a052', 'request_id': 'req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:41.828742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74791e60-982a-42e3-a98d-1b436a161eb3 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:41.838122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae0d1a0a211f4a34af38aae41119a052', 'request_id': 'req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:41.859935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509 admin admin] The token cache is being invalidate because project ae0d1a0a211f4a34af38aae41119a052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:41.860958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:41.861933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b76d8383-41d4-43ee-b9ad-b66e7c7d9509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:41.868724 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3674/7369] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:41 2022] DELETE /identity/v3/projects/ae0d1a0a211f4a34af38aae41119a052 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:41.874359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca71ef0-e479-4b12-a446-d6f82fe926a3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:41.875518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca71ef0-e479-4b12-a446-d6f82fe926a3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:41.875969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca71ef0-e479-4b12-a446-d6f82fe926a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:41.902588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:41.924471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0ca71ef0-e479-4b12-a446-d6f82fe926a3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:41.926065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0ca71ef0-e479-4b12-a446-d6f82fe926a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:41.933654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a42157-fe81-4c07-99cb-3012e1d438d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:41.934284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a42157-fe81-4c07-99cb-3012e1d438d6 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:41.935330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a42157-fe81-4c07-99cb-3012e1d438d6 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:41.936058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a42157-fe81-4c07-99cb-3012e1d438d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:41.938967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d4a42157-fe81-4c07-99cb-3012e1d438d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:41.950385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:42.044017 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3675/7370] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:42.051839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3c6b9-6d98-427a-95e5-ba8c11253a50 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:42.052330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3c6b9-6d98-427a-95e5-ba8c11253a50 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:42.052791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3c6b9-6d98-427a-95e5-ba8c11253a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:42.077109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c1d3c6b9-6d98-427a-95e5-ba8c11253a50 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:42.077331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a42157-fe81-4c07-99cb-3012e1d438d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:42.078352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c1d3c6b9-6d98-427a-95e5-ba8c11253a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:42.079261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a42157-fe81-4c07-99cb-3012e1d438d6 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:42.091379 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3696/7371] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:20:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:20:42.093356 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3676/7372] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:42.094486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a42157-fe81-4c07-99cb-3012e1d438d6 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:42.109646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a42157-fe81-4c07-99cb-3012e1d438d6 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:42.115384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef66e1-b661-4918-ba2c-b04dcf235358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:42.116389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef66e1-b661-4918-ba2c-b04dcf235358 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:42.116752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef66e1-b661-4918-ba2c-b04dcf235358 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:42.117390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef66e1-b661-4918-ba2c-b04dcf235358 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:42.117940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef66e1-b661-4918-ba2c-b04dcf235358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:42.118324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef66e1-b661-4918-ba2c-b04dcf235358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:42.120565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef66e1-b661-4918-ba2c-b04dcf235358 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:42.143419 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3697/7373] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:42.145004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3c6b9-6d98-427a-95e5-ba8c11253a50 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:42.156852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3c6b9-6d98-427a-95e5-ba8c11253a50 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:42.177919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ce919-79ba-497f-9898-8edcc50e7a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:42.178671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ce919-79ba-497f-9898-8edcc50e7a15 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:42.178947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ce919-79ba-497f-9898-8edcc50e7a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:42.179216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ce919-79ba-497f-9898-8edcc50e7a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:42.179853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ce919-79ba-497f-9898-8edcc50e7a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:42.181803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ce919-79ba-497f-9898-8edcc50e7a15 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:42.217644 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3677/7374] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:42 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:42.221864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef66e1-b661-4918-ba2c-b04dcf235358 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:42.234095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef66e1-b661-4918-ba2c-b04dcf235358 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:42.321696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507069b-b295-406f-b5ec-358d4f20b311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:42.322500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507069b-b295-406f-b5ec-358d4f20b311 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:42.323714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507069b-b295-406f-b5ec-358d4f20b311 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:42.324108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507069b-b295-406f-b5ec-358d4f20b311 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:42.325045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507069b-b295-406f-b5ec-358d4f20b311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:42.327320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507069b-b295-406f-b5ec-358d4f20b311 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:42.352392 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3698/7375] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:42 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:42.358341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ce919-79ba-497f-9898-8edcc50e7a15 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:42.374283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ce919-79ba-497f-9898-8edcc50e7a15 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:42.374815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57c35b-4dfb-4f32-938f-720edac15814 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:42.375271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57c35b-4dfb-4f32-938f-720edac15814 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:42.375700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57c35b-4dfb-4f32-938f-720edac15814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:42.380431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50451986-e021-4524-b1fd-c3dfdba01979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:42.381229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50451986-e021-4524-b1fd-c3dfdba01979 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:42.381766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50451986-e021-4524-b1fd-c3dfdba01979 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:42.382146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50451986-e021-4524-b1fd-c3dfdba01979 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:42.383236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50451986-e021-4524-b1fd-c3dfdba01979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:42.385055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50451986-e021-4524-b1fd-c3dfdba01979 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:42.396779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ac57c35b-4dfb-4f32-938f-720edac15814 None None] MFA Rules not processed for user `2f98e01cab6b49c7a5d239aee95f4a64`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:42.398105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ac57c35b-4dfb-4f32-938f-720edac15814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:42.401604 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3678/7376] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:42.404729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50451986-e021-4524-b1fd-c3dfdba01979 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:42.422460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50451986-e021-4524-b1fd-c3dfdba01979 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:42.428035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0b5fb-3e8f-49c8-a277-4240e52194fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:42.428647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0b5fb-3e8f-49c8-a277-4240e52194fb admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:42.428925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0b5fb-3e8f-49c8-a277-4240e52194fb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:42.429285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0b5fb-3e8f-49c8-a277-4240e52194fb admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:42.431523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0b5fb-3e8f-49c8-a277-4240e52194fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:42.435460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0b5fb-3e8f-49c8-a277-4240e52194fb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:42.446432 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3679/7377] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:42.451186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0b5fb-3e8f-49c8-a277-4240e52194fb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:42.461135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0b5fb-3e8f-49c8-a277-4240e52194fb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:42.467168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59555b7f-f3a7-45ec-9419-211717b5d31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:42.468187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59555b7f-f3a7-45ec-9419-211717b5d31a admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:42.470051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59555b7f-f3a7-45ec-9419-211717b5d31a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:42.470361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59555b7f-f3a7-45ec-9419-211717b5d31a admin admin] PATH_INFO: `/v3/projects/96fb129e70a34affbba9b39dd97e80a6/users/d224b4a7ddcd4be7b60d2ef1c2cb9c9c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:42.477099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:42.485314 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3699/7378] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:42.506366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59555b7f-f3a7-45ec-9419-211717b5d31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fb129e70a34affbba9b39dd97e80a6, user_id=d224b4a7ddcd4be7b60d2ef1c2cb9c9c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:42.509656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59555b7f-f3a7-45ec-9419-211717b5d31a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:42.526184 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3680/7379] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:42 2022] PUT /identity/v3/projects/96fb129e70a34affbba9b39dd97e80a6/users/d224b4a7ddcd4be7b60d2ef1c2cb9c9c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:42.538029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3134a2-4f83-4ede-9cf0-a7a63e14d368 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:42.538321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3134a2-4f83-4ede-9cf0-a7a63e14d368 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:42.538591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3134a2-4f83-4ede-9cf0-a7a63e14d368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:42.582540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5e3134a2-4f83-4ede-9cf0-a7a63e14d368 None None] MFA Rules not processed for user `d224b4a7ddcd4be7b60d2ef1c2cb9c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:42.584746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5e3134a2-4f83-4ede-9cf0-a7a63e14d368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:42.652293 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3700/7380] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:42.656856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59555b7f-f3a7-45ec-9419-211717b5d31a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:42.719981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59555b7f-f3a7-45ec-9419-211717b5d31a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:42.724708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf942ec4-899d-45ed-ab52-31471c548a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:42.725336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf942ec4-899d-45ed-ab52-31471c548a43 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:42.725611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf942ec4-899d-45ed-ab52-31471c548a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:42.725906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf942ec4-899d-45ed-ab52-31471c548a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:42.726530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf942ec4-899d-45ed-ab52-31471c548a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:42.728677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf942ec4-899d-45ed-ab52-31471c548a43 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:42.759832 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3681/7381] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:42 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:42.761837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3134a2-4f83-4ede-9cf0-a7a63e14d368 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:42.773368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3134a2-4f83-4ede-9cf0-a7a63e14d368 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:42.831825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357428-975f-43f6-af20-bc53eab00496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:42.832502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357428-975f-43f6-af20-bc53eab00496 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:42.832634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357428-975f-43f6-af20-bc53eab00496 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:42.832913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357428-975f-43f6-af20-bc53eab00496 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:42.833586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f357428-975f-43f6-af20-bc53eab00496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:42.835642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f357428-975f-43f6-af20-bc53eab00496 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:42.860749 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3701/7382] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:42 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:42.864465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf942ec4-899d-45ed-ab52-31471c548a43 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:42.875151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf942ec4-899d-45ed-ab52-31471c548a43 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:42.880007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbdd42-cf3c-4566-8b15-6978cbb81e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:42.880639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbdd42-cf3c-4566-8b15-6978cbb81e96 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:42.880923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbdd42-cf3c-4566-8b15-6978cbb81e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:42.881222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbdd42-cf3c-4566-8b15-6978cbb81e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:42.881868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbdd42-cf3c-4566-8b15-6978cbb81e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:42.883447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbdd42-cf3c-4566-8b15-6978cbb81e96 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:42.894987 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3682/7383] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:42.899580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357428-975f-43f6-af20-bc53eab00496 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:42.910309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357428-975f-43f6-af20-bc53eab00496 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:42.914806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3e6f-76fc-4e58-afd7-30631b464db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:42.915448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3e6f-76fc-4e58-afd7-30631b464db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:42.915726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3e6f-76fc-4e58-afd7-30631b464db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:42.915997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3e6f-76fc-4e58-afd7-30631b464db1 admin admin] PATH_INFO: `/v3/projects/1e5dddc4903e48ee8a717922fbbb1804/users/de3e848ccb4649539e1a4d2a87cd0181/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:42.930896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f3e6f-76fc-4e58-afd7-30631b464db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5dddc4903e48ee8a717922fbbb1804, user_id=de3e848ccb4649539e1a4d2a87cd0181, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:42.933706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f3e6f-76fc-4e58-afd7-30631b464db1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:42.947360 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3702/7384] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:42 2022] PUT /identity/v3/projects/1e5dddc4903e48ee8a717922fbbb1804/users/de3e848ccb4649539e1a4d2a87cd0181/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:42.953129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbdd42-cf3c-4566-8b15-6978cbb81e96 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:42.964830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbdd42-cf3c-4566-8b15-6978cbb81e96 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:42.987747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:43.047969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9895e9-bebf-4bf6-9a85-3b385f5e0612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:43.048608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9895e9-bebf-4bf6-9a85-3b385f5e0612 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:43.048911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9895e9-bebf-4bf6-9a85-3b385f5e0612 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:43.049278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9895e9-bebf-4bf6-9a85-3b385f5e0612 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:43.050211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9895e9-bebf-4bf6-9a85-3b385f5e0612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:43.056663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9895e9-bebf-4bf6-9a85-3b385f5e0612 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:43.071600 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3683/7385] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:43.077752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3e6f-76fc-4e58-afd7-30631b464db1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:43.110382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3e6f-76fc-4e58-afd7-30631b464db1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:43.121783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5fe28-6bdc-4f52-b793-ea0594ce47c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:43.122652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5fe28-6bdc-4f52-b793-ea0594ce47c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:43.122923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5fe28-6bdc-4f52-b793-ea0594ce47c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:43.123205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5fe28-6bdc-4f52-b793-ea0594ce47c2 admin admin] PATH_INFO: `/v3/projects/1e5dddc4903e48ee8a717922fbbb1804/users/de3e848ccb4649539e1a4d2a87cd0181/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:43.126376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5fe28-6bdc-4f52-b793-ea0594ce47c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5dddc4903e48ee8a717922fbbb1804, user_id=de3e848ccb4649539e1a4d2a87cd0181, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:43.142066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5fe28-6bdc-4f52-b793-ea0594ce47c2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:43.173907 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3703/7386] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:43 2022] PUT /identity/v3/projects/1e5dddc4903e48ee8a717922fbbb1804/users/de3e848ccb4649539e1a4d2a87cd0181/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:43.185449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4174d5-7adb-416e-ac84-5a02821b01e4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:43.186608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4174d5-7adb-416e-ac84-5a02821b01e4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:43.186973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4174d5-7adb-416e-ac84-5a02821b01e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:43.250933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5b4174d5-7adb-416e-ac84-5a02821b01e4 None None] MFA Rules not processed for user `de3e848ccb4649539e1a4d2a87cd0181`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:43.252309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5b4174d5-7adb-416e-ac84-5a02821b01e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:43.349315 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3684/7387] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:43.361807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5fe28-6bdc-4f52-b793-ea0594ce47c2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:43.363784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9dd5fe28-6bdc-4f52-b793-ea0594ce47c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:43.426030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:43.442683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5fe28-6bdc-4f52-b793-ea0594ce47c2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:43.448198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324626de-9444-4623-beac-bead31b37d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:43.448795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324626de-9444-4623-beac-bead31b37d8d service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:43.449163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324626de-9444-4623-beac-bead31b37d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:43.449492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324626de-9444-4623-beac-bead31b37d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:43.548364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324626de-9444-4623-beac-bead31b37d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:43.550160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324626de-9444-4623-beac-bead31b37d8d service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:43.561380 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3704/7388] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:43.913035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4174d5-7adb-416e-ac84-5a02821b01e4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:43.925425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4174d5-7adb-416e-ac84-5a02821b01e4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:43.929039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db196f-df19-42e3-ad7d-e80ee096881e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:43.929875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db196f-df19-42e3-ad7d-e80ee096881e service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:43.930157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db196f-df19-42e3-ad7d-e80ee096881e service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:43.930430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db196f-df19-42e3-ad7d-e80ee096881e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:43.941120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db196f-df19-42e3-ad7d-e80ee096881e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:43.943078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db196f-df19-42e3-ad7d-e80ee096881e service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:43.957158 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3685/7389] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:45.891470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324626de-9444-4623-beac-bead31b37d8d service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:45.895075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-324626de-9444-4623-beac-bead31b37d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:46.098799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324626de-9444-4623-beac-bead31b37d8d service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:46.114667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a09a43-b9af-4855-9f5c-448cd1b9f246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:46.115614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a09a43-b9af-4855-9f5c-448cd1b9f246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:46.116161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a09a43-b9af-4855-9f5c-448cd1b9f246 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:46.116587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a09a43-b9af-4855-9f5c-448cd1b9f246 admin admin] PATH_INFO: `/v3/users/537b77eca97d4c1395eeb164bc5e7205` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:46.118172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a09a43-b9af-4855-9f5c-448cd1b9f246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=537b77eca97d4c1395eeb164bc5e7205)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:46.122961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a09a43-b9af-4855-9f5c-448cd1b9f246 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:46.223226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-38a09a43-b9af-4855-9f5c-448cd1b9f246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '537b77eca97d4c1395eeb164bc5e7205'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:46.231967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-38a09a43-b9af-4855-9f5c-448cd1b9f246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '537b77eca97d4c1395eeb164bc5e7205'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:46.232979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-38a09a43-b9af-4855-9f5c-448cd1b9f246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '537b77eca97d4c1395eeb164bc5e7205'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:46.233936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-38a09a43-b9af-4855-9f5c-448cd1b9f246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '537b77eca97d4c1395eeb164bc5e7205'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:46.265510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-38a09a43-b9af-4855-9f5c-448cd1b9f246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '537b77eca97d4c1395eeb164bc5e7205'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:46.290730 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3705/7390] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:45 2022] DELETE /identity/v3/users/537b77eca97d4c1395eeb164bc5e7205 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:46.681716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db196f-df19-42e3-ad7d-e80ee096881e service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:46.701936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db196f-df19-42e3-ad7d-e80ee096881e service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:46.795929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e737170-ee83-411a-8a8a-439cd1c200fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:46.796707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e737170-ee83-411a-8a8a-439cd1c200fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:46.797299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e737170-ee83-411a-8a8a-439cd1c200fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:46.797816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e737170-ee83-411a-8a8a-439cd1c200fd admin admin] PATH_INFO: `/v3/projects/2f564837d8eb4b3192109d0dfc9a6fab` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:46.799918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e737170-ee83-411a-8a8a-439cd1c200fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f564837d8eb4b3192109d0dfc9a6fab)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:46.803655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e737170-ee83-411a-8a8a-439cd1c200fd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:46.871593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:46.904219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e737170-ee83-411a-8a8a-439cd1c200fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f564837d8eb4b3192109d0dfc9a6fab', 'request_id': 'req-4e737170-ee83-411a-8a8a-439cd1c200fd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:46.914912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e737170-ee83-411a-8a8a-439cd1c200fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f564837d8eb4b3192109d0dfc9a6fab', 'request_id': 'req-4e737170-ee83-411a-8a8a-439cd1c200fd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:46.924446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e737170-ee83-411a-8a8a-439cd1c200fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f564837d8eb4b3192109d0dfc9a6fab', 'request_id': 'req-4e737170-ee83-411a-8a8a-439cd1c200fd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:46.944264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e737170-ee83-411a-8a8a-439cd1c200fd admin admin] The token cache is being invalidate because project 2f564837d8eb4b3192109d0dfc9a6fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:46.944710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e737170-ee83-411a-8a8a-439cd1c200fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:46.945666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4e737170-ee83-411a-8a8a-439cd1c200fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:46.949408 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3686/7391] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:46 2022] DELETE /identity/v3/projects/2f564837d8eb4b3192109d0dfc9a6fab => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:46.954161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f87f5-a6aa-4a17-882b-39a3b3abfd0b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:46.954660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f87f5-a6aa-4a17-882b-39a3b3abfd0b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:46.955037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f87f5-a6aa-4a17-882b-39a3b3abfd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:46.988791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-681f87f5-a6aa-4a17-882b-39a3b3abfd0b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:46.991057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-681f87f5-a6aa-4a17-882b-39a3b3abfd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:47.035254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:47.158248 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3706/7392] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:47.165735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccddbb-dcdb-4d55-88ef-c233f1d3a4b1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:47.166028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccddbb-dcdb-4d55-88ef-c233f1d3a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:47.166302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccddbb-dcdb-4d55-88ef-c233f1d3a4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:47.197398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d8ccddbb-dcdb-4d55-88ef-c233f1d3a4b1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:47.199738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d8ccddbb-dcdb-4d55-88ef-c233f1d3a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:47.212498 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3687/7393] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:47.217426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f87f5-a6aa-4a17-882b-39a3b3abfd0b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:47.231750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f87f5-a6aa-4a17-882b-39a3b3abfd0b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:47.237140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33dcb6-56d5-483d-9fea-d550a5bc9da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:47.238591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33dcb6-56d5-483d-9fea-d550a5bc9da8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:47.239039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33dcb6-56d5-483d-9fea-d550a5bc9da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:47.239372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33dcb6-56d5-483d-9fea-d550a5bc9da8 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:47.240405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33dcb6-56d5-483d-9fea-d550a5bc9da8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:47.240851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33dcb6-56d5-483d-9fea-d550a5bc9da8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:47.242629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33dcb6-56d5-483d-9fea-d550a5bc9da8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:47.258847 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3707/7394] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:47.263540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccddbb-dcdb-4d55-88ef-c233f1d3a4b1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:47.274986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccddbb-dcdb-4d55-88ef-c233f1d3a4b1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:47.281689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fe77d-16f4-441e-b5d0-5134711d47a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:47.282463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe77d-16f4-441e-b5d0-5134711d47a0 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:47.283014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe77d-16f4-441e-b5d0-5134711d47a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:47.283403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe77d-16f4-441e-b5d0-5134711d47a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:47.284190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fe77d-16f4-441e-b5d0-5134711d47a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:47.286453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fe77d-16f4-441e-b5d0-5134711d47a0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:47.336015 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3688/7395] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:47 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:47.336853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33dcb6-56d5-483d-9fea-d550a5bc9da8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:47.348751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33dcb6-56d5-483d-9fea-d550a5bc9da8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:47.416207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8436f53-dfde-4794-bd93-11d0f9d7c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:47.417609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8436f53-dfde-4794-bd93-11d0f9d7c5ed admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:47.417822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8436f53-dfde-4794-bd93-11d0f9d7c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:47.418089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8436f53-dfde-4794-bd93-11d0f9d7c5ed admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:47.418727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8436f53-dfde-4794-bd93-11d0f9d7c5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:47.420642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8436f53-dfde-4794-bd93-11d0f9d7c5ed admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:47.447617 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3708/7396] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:47 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:47.452018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fe77d-16f4-441e-b5d0-5134711d47a0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:47.465043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fe77d-16f4-441e-b5d0-5134711d47a0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:47.470500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55c245-1721-4b44-8296-e002ee9695a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:47.471347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55c245-1721-4b44-8296-e002ee9695a5 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:47.471637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55c245-1721-4b44-8296-e002ee9695a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:47.471912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55c245-1721-4b44-8296-e002ee9695a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:47.472555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55c245-1721-4b44-8296-e002ee9695a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:47.483253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55c245-1721-4b44-8296-e002ee9695a5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:47.511685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8436f53-dfde-4794-bd93-11d0f9d7c5ed admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:47.512600 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3689/7397] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:47.525834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8436f53-dfde-4794-bd93-11d0f9d7c5ed admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:47.532318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22231bb-fa4d-44fd-aa9d-f7b90551a3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:47.533438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22231bb-fa4d-44fd-aa9d-f7b90551a3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:47.533723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22231bb-fa4d-44fd-aa9d-f7b90551a3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:47.534001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22231bb-fa4d-44fd-aa9d-f7b90551a3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:47.535426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22231bb-fa4d-44fd-aa9d-f7b90551a3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:47.537132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22231bb-fa4d-44fd-aa9d-f7b90551a3a0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:47.555702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55c245-1721-4b44-8296-e002ee9695a5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:47.575102 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3709/7398] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:47.579576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55c245-1721-4b44-8296-e002ee9695a5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:47.592028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1a5d8-60cf-4e28-8fb2-7924097a9b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:47.592724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1a5d8-60cf-4e28-8fb2-7924097a9b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:47.593072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1a5d8-60cf-4e28-8fb2-7924097a9b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:47.593394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1a5d8-60cf-4e28-8fb2-7924097a9b59 admin admin] PATH_INFO: `/v3/projects/fd238ac8ac5e4e7793c1ebb53a85eaef/users/a009ac77727640de9becf6a61c8f1662/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:47.622200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1a5d8-60cf-4e28-8fb2-7924097a9b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd238ac8ac5e4e7793c1ebb53a85eaef, user_id=a009ac77727640de9becf6a61c8f1662, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:47.625386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1a5d8-60cf-4e28-8fb2-7924097a9b59 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:47.641838 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3690/7399] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:47 2022] PUT /identity/v3/projects/fd238ac8ac5e4e7793c1ebb53a85eaef/users/a009ac77727640de9becf6a61c8f1662/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:47.653348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd6b1e-4775-4a14-8d1f-aeb62c29c590 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:47.653942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd6b1e-4775-4a14-8d1f-aeb62c29c590 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:47.654324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd6b1e-4775-4a14-8d1f-aeb62c29c590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:47.683598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e8fd6b1e-4775-4a14-8d1f-aeb62c29c590 None None] MFA Rules not processed for user `a009ac77727640de9becf6a61c8f1662`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:47.684992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e8fd6b1e-4775-4a14-8d1f-aeb62c29c590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:47.757076 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3710/7400] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:47.772070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1a5d8-60cf-4e28-8fb2-7924097a9b59 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:47.774783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d5c1a5d8-60cf-4e28-8fb2-7924097a9b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:47.868894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1a5d8-60cf-4e28-8fb2-7924097a9b59 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:47.873867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c73b-e255-494c-ab68-6cdc5770be7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:47.874066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c73b-e255-494c-ab68-6cdc5770be7f service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:47.874487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c73b-e255-494c-ab68-6cdc5770be7f service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:47.874764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c73b-e255-494c-ab68-6cdc5770be7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:47.885364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c73b-e255-494c-ab68-6cdc5770be7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:47.887626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c73b-e255-494c-ab68-6cdc5770be7f service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:47.906050 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3691/7401] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:49.368714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbcf0c-7b83-422f-869d-7d64f00a9f11 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:49.369177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbcf0c-7b83-422f-869d-7d64f00a9f11 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:49.369302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbcf0c-7b83-422f-869d-7d64f00a9f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:49.400259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5bcbcf0c-7b83-422f-869d-7d64f00a9f11 None None] MFA Rules not processed for user `a009ac77727640de9becf6a61c8f1662`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:49.402235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5bcbcf0c-7b83-422f-869d-7d64f00a9f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:49.411210 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3711/7402] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:52.860207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c73b-e255-494c-ab68-6cdc5770be7f service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:52.862212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6508c73b-e255-494c-ab68-6cdc5770be7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:53.016019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c73b-e255-494c-ab68-6cdc5770be7f service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:53.042361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:53.046632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:53.048461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:53.048844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] PATH_INFO: `/v3/users/d224b4a7ddcd4be7b60d2ef1c2cb9c9c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:53.052542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d224b4a7ddcd4be7b60d2ef1c2cb9c9c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:53.055114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:53.058824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:53.147616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd224b4a7ddcd4be7b60d2ef1c2cb9c9c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:53.158403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd224b4a7ddcd4be7b60d2ef1c2cb9c9c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:53.159325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd224b4a7ddcd4be7b60d2ef1c2cb9c9c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:53.159940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd224b4a7ddcd4be7b60d2ef1c2cb9c9c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:53.174891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd224b4a7ddcd4be7b60d2ef1c2cb9c9c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:53.193758 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3692/7403] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:52 2022] DELETE /identity/v3/users/d224b4a7ddcd4be7b60d2ef1c2cb9c9c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:53.198810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ab824-617e-4f33-a869-c97bba0d9091 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:53.199350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ab824-617e-4f33-a869-c97bba0d9091 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:53.199595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ab824-617e-4f33-a869-c97bba0d9091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:53.208387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:53.221943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d09ab824-617e-4f33-a869-c97bba0d9091 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:53.223339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d09ab824-617e-4f33-a869-c97bba0d9091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:53.326123 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3712/7404] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:53.333568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:53.335993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:53.437957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c75a8-0e2e-42c5-856f-557a87672a90 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:53.446322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5733af2-b0ec-47c9-96ba-cdf7e305cc26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:53.447116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5733af2-b0ec-47c9-96ba-cdf7e305cc26 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:53.447528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5733af2-b0ec-47c9-96ba-cdf7e305cc26 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:53.448437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5733af2-b0ec-47c9-96ba-cdf7e305cc26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:53.475642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5733af2-b0ec-47c9-96ba-cdf7e305cc26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:53.477166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5733af2-b0ec-47c9-96ba-cdf7e305cc26 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:53.497628 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3693/7405] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:53.926588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ab824-617e-4f33-a869-c97bba0d9091 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:53.928807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d09ab824-617e-4f33-a869-c97bba0d9091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:53.941500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ab824-617e-4f33-a869-c97bba0d9091 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:53.948445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:53.949656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:53.949656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:53.950158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] PATH_INFO: `/v3/projects/96fb129e70a34affbba9b39dd97e80a6` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:53.951466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96fb129e70a34affbba9b39dd97e80a6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:53.954411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:54.015646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96fb129e70a34affbba9b39dd97e80a6', 'request_id': 'req-2b54cad7-dead-4e50-bd2c-24a31379be04'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.023880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96fb129e70a34affbba9b39dd97e80a6', 'request_id': 'req-2b54cad7-dead-4e50-bd2c-24a31379be04'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.030857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96fb129e70a34affbba9b39dd97e80a6', 'request_id': 'req-2b54cad7-dead-4e50-bd2c-24a31379be04'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.044110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] The token cache is being invalidate because project 96fb129e70a34affbba9b39dd97e80a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:54.044543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.045505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.047472 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3713/7406] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:53 2022] DELETE /identity/v3/projects/96fb129e70a34affbba9b39dd97e80a6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:54.051080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5733af2-b0ec-47c9-96ba-cdf7e305cc26 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:54.065771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5733af2-b0ec-47c9-96ba-cdf7e305cc26 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:54.133524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280c3d0-8bdc-4f7d-97fa-ae8d392cbbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:54.134170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280c3d0-8bdc-4f7d-97fa-ae8d392cbbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:54.134447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280c3d0-8bdc-4f7d-97fa-ae8d392cbbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:54.134720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280c3d0-8bdc-4f7d-97fa-ae8d392cbbd8 admin admin] PATH_INFO: `/v3/users/de3e848ccb4649539e1a4d2a87cd0181` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:54.136431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280c3d0-8bdc-4f7d-97fa-ae8d392cbbd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3e848ccb4649539e1a4d2a87cd0181)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:54.144207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280c3d0-8bdc-4f7d-97fa-ae8d392cbbd8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:54.175492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:54.210123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a280c3d0-8bdc-4f7d-97fa-ae8d392cbbd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3e848ccb4649539e1a4d2a87cd0181'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.222437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a280c3d0-8bdc-4f7d-97fa-ae8d392cbbd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3e848ccb4649539e1a4d2a87cd0181'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.226183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a280c3d0-8bdc-4f7d-97fa-ae8d392cbbd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3e848ccb4649539e1a4d2a87cd0181'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.227476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a280c3d0-8bdc-4f7d-97fa-ae8d392cbbd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3e848ccb4649539e1a4d2a87cd0181'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.266209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a280c3d0-8bdc-4f7d-97fa-ae8d392cbbd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3e848ccb4649539e1a4d2a87cd0181'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.286456 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3694/7407] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:54 2022] DELETE /identity/v3/users/de3e848ccb4649539e1a4d2a87cd0181 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:54.672814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:54.674332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:54.691078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54cad7-dead-4e50-bd2c-24a31379be04 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:54.772822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:54.775114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:54.775400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:54.775696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7 admin admin] PATH_INFO: `/v3/projects/1e5dddc4903e48ee8a717922fbbb1804` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:54.776992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5dddc4903e48ee8a717922fbbb1804)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:54.778942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:54.814843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:54.835182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5dddc4903e48ee8a717922fbbb1804', 'request_id': 'req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.846970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5dddc4903e48ee8a717922fbbb1804', 'request_id': 'req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.855122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5dddc4903e48ee8a717922fbbb1804', 'request_id': 'req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.867867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7 admin admin] The token cache is being invalidate because project 1e5dddc4903e48ee8a717922fbbb1804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:54.868201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.873900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3f4999d9-28f7-4ba0-890a-d0cecb8f2bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:54.875736 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3714/7408] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:54 2022] DELETE /identity/v3/projects/1e5dddc4903e48ee8a717922fbbb1804 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:54.880615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885d4e-0df4-413b-8821-7a3e11169be1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:54.880941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885d4e-0df4-413b-8821-7a3e11169be1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:54.881243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885d4e-0df4-413b-8821-7a3e11169be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:54.905696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-67885d4e-0df4-413b-8821-7a3e11169be1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:54.907194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-67885d4e-0df4-413b-8821-7a3e11169be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:54.972653 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3695/7409] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:54.981539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5641714-4608-44ba-8d44-a81c4430cdf9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:54.981830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5641714-4608-44ba-8d44-a81c4430cdf9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:54.982132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5641714-4608-44ba-8d44-a81c4430cdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.002962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e5641714-4608-44ba-8d44-a81c4430cdf9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:55.004179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e5641714-4608-44ba-8d44-a81c4430cdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:55.012530 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3715/7410] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:55.016885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885d4e-0df4-413b-8821-7a3e11169be1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.027238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885d4e-0df4-413b-8821-7a3e11169be1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:55.031741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acb1f0-2eec-490c-b1ec-994b861590f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:55.032341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acb1f0-2eec-490c-b1ec-994b861590f0 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.032623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acb1f0-2eec-490c-b1ec-994b861590f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.032901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acb1f0-2eec-490c-b1ec-994b861590f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.033599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acb1f0-2eec-490c-b1ec-994b861590f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:55.033907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acb1f0-2eec-490c-b1ec-994b861590f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:55.035499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acb1f0-2eec-490c-b1ec-994b861590f0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:55.047643 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3696/7411] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:55.052011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5641714-4608-44ba-8d44-a81c4430cdf9 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.061403 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5641714-4608-44ba-8d44-a81c4430cdf9 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:55.066596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff08ad-0ccc-4e79-8ce1-32033a337752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:55.067189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff08ad-0ccc-4e79-8ce1-32033a337752 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.067469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff08ad-0ccc-4e79-8ce1-32033a337752 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.067741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff08ad-0ccc-4e79-8ce1-32033a337752 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.068375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff08ad-0ccc-4e79-8ce1-32033a337752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:55.070302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff08ad-0ccc-4e79-8ce1-32033a337752 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:55.096899 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3716/7412] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:55 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:55.100917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acb1f0-2eec-490c-b1ec-994b861590f0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.111919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acb1f0-2eec-490c-b1ec-994b861590f0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:55.174924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0bcec-5620-43d4-ab45-0b98bc60ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:55.175538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0bcec-5620-43d4-ab45-0b98bc60ed1c admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.175824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0bcec-5620-43d4-ab45-0b98bc60ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.176098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0bcec-5620-43d4-ab45-0b98bc60ed1c admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.176810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0bcec-5620-43d4-ab45-0b98bc60ed1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:55.178946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0bcec-5620-43d4-ab45-0b98bc60ed1c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:55.205794 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3697/7413] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:55 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:55.207395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff08ad-0ccc-4e79-8ce1-32033a337752 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.219003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff08ad-0ccc-4e79-8ce1-32033a337752 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:55.224514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912016-f66c-4604-9d2a-17ec4354cfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:55.225268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912016-f66c-4604-9d2a-17ec4354cfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.225596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912016-f66c-4604-9d2a-17ec4354cfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.225867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912016-f66c-4604-9d2a-17ec4354cfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.226606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912016-f66c-4604-9d2a-17ec4354cfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:55.228625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912016-f66c-4604-9d2a-17ec4354cfe7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:55.240679 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3717/7414] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:55.244838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0bcec-5620-43d4-ab45-0b98bc60ed1c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.255723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0bcec-5620-43d4-ab45-0b98bc60ed1c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:55.260731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104881da-2ed3-4bd9-84f2-f832220301cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:55.261524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104881da-2ed3-4bd9-84f2-f832220301cc admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.261768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104881da-2ed3-4bd9-84f2-f832220301cc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.262038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104881da-2ed3-4bd9-84f2-f832220301cc admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.262681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104881da-2ed3-4bd9-84f2-f832220301cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:55.264437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104881da-2ed3-4bd9-84f2-f832220301cc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:55.279780 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3698/7415] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:55.281040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912016-f66c-4604-9d2a-17ec4354cfe7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.292371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912016-f66c-4604-9d2a-17ec4354cfe7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:55.297168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c53388-169d-40b2-a50a-ad5adbaa7c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:55.297848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c53388-169d-40b2-a50a-ad5adbaa7c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.298128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c53388-169d-40b2-a50a-ad5adbaa7c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.298400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c53388-169d-40b2-a50a-ad5adbaa7c02 admin admin] PATH_INFO: `/v3/projects/caccf3d4ec5447b18f934c159e10d567/users/97d277aa3750419e9c70b98a97269347/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.315052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c53388-169d-40b2-a50a-ad5adbaa7c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caccf3d4ec5447b18f934c159e10d567, user_id=97d277aa3750419e9c70b98a97269347, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:55.317923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c53388-169d-40b2-a50a-ad5adbaa7c02 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:55.332127 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3718/7416] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:55 2022] PUT /identity/v3/projects/caccf3d4ec5447b18f934c159e10d567/users/97d277aa3750419e9c70b98a97269347/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:55.342982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d56bb-cc67-467d-94bf-0ebe1b483bad None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.343265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d56bb-cc67-467d-94bf-0ebe1b483bad None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.343547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d56bb-cc67-467d-94bf-0ebe1b483bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.358003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:55.376688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-401d56bb-cc67-467d-94bf-0ebe1b483bad None None] MFA Rules not processed for user `97d277aa3750419e9c70b98a97269347`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:55.377975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-401d56bb-cc67-467d-94bf-0ebe1b483bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:55.449222 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3699/7417] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:55.453705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c53388-169d-40b2-a50a-ad5adbaa7c02 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.525599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c53388-169d-40b2-a50a-ad5adbaa7c02 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:55.530281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d16752-f3eb-4ab5-bc3e-4fc4261d89a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:55.530816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d16752-f3eb-4ab5-bc3e-4fc4261d89a4 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.531094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d16752-f3eb-4ab5-bc3e-4fc4261d89a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.531364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d16752-f3eb-4ab5-bc3e-4fc4261d89a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.531989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d16752-f3eb-4ab5-bc3e-4fc4261d89a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:55.533915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d16752-f3eb-4ab5-bc3e-4fc4261d89a4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:55.563493 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3719/7418] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:55 2022] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:55.564951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d56bb-cc67-467d-94bf-0ebe1b483bad None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.575689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d56bb-cc67-467d-94bf-0ebe1b483bad None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:55.632943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103aa8d-b67c-4c09-83c5-e1e455f3a726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:55.633578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103aa8d-b67c-4c09-83c5-e1e455f3a726 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.633862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103aa8d-b67c-4c09-83c5-e1e455f3a726 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.634135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103aa8d-b67c-4c09-83c5-e1e455f3a726 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.634770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103aa8d-b67c-4c09-83c5-e1e455f3a726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:55.636739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103aa8d-b67c-4c09-83c5-e1e455f3a726 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:55.661271 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3700/7419] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:55 2022] POST /identity/v3/users => generated 306 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:55.661424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d16752-f3eb-4ab5-bc3e-4fc4261d89a4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.662332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103aa8d-b67c-4c09-83c5-e1e455f3a726 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.662656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-55d16752-f3eb-4ab5-bc3e-4fc4261d89a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:55.673012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103aa8d-b67c-4c09-83c5-e1e455f3a726 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:55.675631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d16752-f3eb-4ab5-bc3e-4fc4261d89a4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:55.677806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b8b0f-b0aa-4bfb-845e-5d13e6c14fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:55.678373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b8b0f-b0aa-4bfb-845e-5d13e6c14fae admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.678649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b8b0f-b0aa-4bfb-845e-5d13e6c14fae admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.678920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b8b0f-b0aa-4bfb-845e-5d13e6c14fae admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.679556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b8b0f-b0aa-4bfb-845e-5d13e6c14fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:55.680315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd1de2-21cc-4a19-ab3e-bc944e3f0320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:55.680925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd1de2-21cc-4a19-ab3e-bc944e3f0320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.681158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b8b0f-b0aa-4bfb-845e-5d13e6c14fae admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:55.681339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd1de2-21cc-4a19-ab3e-bc944e3f0320 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.681495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd1de2-21cc-4a19-ab3e-bc944e3f0320 admin admin] PATH_INFO: `/v3/users/77767a3d225c4ce98e673ca193dd01e9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.683269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd1de2-21cc-4a19-ab3e-bc944e3f0320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77767a3d225c4ce98e673ca193dd01e9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:55.685257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd1de2-21cc-4a19-ab3e-bc944e3f0320 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:55.694855 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3701/7420] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:55.695839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b8b0f-b0aa-4bfb-845e-5d13e6c14fae admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.706022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b8b0f-b0aa-4bfb-845e-5d13e6c14fae admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:55.710685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf730fc-d02a-4329-ae6f-955a57a4ac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:55.711321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf730fc-d02a-4329-ae6f-955a57a4ac49 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.711595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf730fc-d02a-4329-ae6f-955a57a4ac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.711869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf730fc-d02a-4329-ae6f-955a57a4ac49 admin admin] PATH_INFO: `/v3/projects/9896af9fcdc348bdb2dc4ee88c101413/users/7da6cba755054de6953059f4a76657bc/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.724245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:55.729807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf730fc-d02a-4329-ae6f-955a57a4ac49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9896af9fcdc348bdb2dc4ee88c101413, user_id=7da6cba755054de6953059f4a76657bc, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:55.732435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf730fc-d02a-4329-ae6f-955a57a4ac49 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:55.740019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-adbd1de2-21cc-4a19-ab3e-bc944e3f0320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77767a3d225c4ce98e673ca193dd01e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:55.750588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-adbd1de2-21cc-4a19-ab3e-bc944e3f0320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77767a3d225c4ce98e673ca193dd01e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:55.750731 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3702/7421] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:55 2022] PUT /identity/v3/projects/9896af9fcdc348bdb2dc4ee88c101413/users/7da6cba755054de6953059f4a76657bc/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:55.753614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-adbd1de2-21cc-4a19-ab3e-bc944e3f0320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77767a3d225c4ce98e673ca193dd01e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:55.753614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-adbd1de2-21cc-4a19-ab3e-bc944e3f0320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77767a3d225c4ce98e673ca193dd01e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:55.754667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf730fc-d02a-4329-ae6f-955a57a4ac49 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.756371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-edf730fc-d02a-4329-ae6f-955a57a4ac49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:55.764823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-adbd1de2-21cc-4a19-ab3e-bc944e3f0320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77767a3d225c4ce98e673ca193dd01e9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:55.778447 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3720/7422] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:55 2022] DELETE /identity/v3/users/77767a3d225c4ce98e673ca193dd01e9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:55.782716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e838c-2155-4f81-bb9f-b02c0fdc3a95 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.782950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e838c-2155-4f81-bb9f-b02c0fdc3a95 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.783240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e838c-2155-4f81-bb9f-b02c0fdc3a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.802562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-797e838c-2155-4f81-bb9f-b02c0fdc3a95 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:55.803769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-797e838c-2155-4f81-bb9f-b02c0fdc3a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:55.809688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:55.825231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf730fc-d02a-4329-ae6f-955a57a4ac49 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:55.865073 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3721/7423] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:55.878457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e838c-2155-4f81-bb9f-b02c0fdc3a95 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.881152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-797e838c-2155-4f81-bb9f-b02c0fdc3a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:55.887523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b53653-04c5-4123-b730-668732ae036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:55.888407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b53653-04c5-4123-b730-668732ae036f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.888793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b53653-04c5-4123-b730-668732ae036f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.889633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b53653-04c5-4123-b730-668732ae036f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.890512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b53653-04c5-4123-b730-668732ae036f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:55.892604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b53653-04c5-4123-b730-668732ae036f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:55.914514 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3703/7424] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:55.922223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b53653-04c5-4123-b730-668732ae036f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:55.933416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b53653-04c5-4123-b730-668732ae036f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:55.938512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d3ce7-82a2-4e05-b6c1-2369c43d7284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:55.939462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d3ce7-82a2-4e05-b6c1-2369c43d7284 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.939758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d3ce7-82a2-4e05-b6c1-2369c43d7284 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.940130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d3ce7-82a2-4e05-b6c1-2369c43d7284 admin admin] PATH_INFO: `/v3/projects/9896af9fcdc348bdb2dc4ee88c101413/users/7da6cba755054de6953059f4a76657bc/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.942458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d3ce7-82a2-4e05-b6c1-2369c43d7284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9896af9fcdc348bdb2dc4ee88c101413, user_id=7da6cba755054de6953059f4a76657bc, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:55.944922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d3ce7-82a2-4e05-b6c1-2369c43d7284 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:55.957833 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3704/7425] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:55 2022] PUT /identity/v3/projects/9896af9fcdc348bdb2dc4ee88c101413/users/7da6cba755054de6953059f4a76657bc/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:55.968114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9dbdb-5f43-4e06-8782-f61b7f66b84a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:55.968398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9dbdb-5f43-4e06-8782-f61b7f66b84a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:55.968671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9dbdb-5f43-4e06-8782-f61b7f66b84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:55.969019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e838c-2155-4f81-bb9f-b02c0fdc3a95 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:56.002857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-14d9dbdb-5f43-4e06-8782-f61b7f66b84a None None] MFA Rules not processed for user `7da6cba755054de6953059f4a76657bc`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:56.004105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-14d9dbdb-5f43-4e06-8782-f61b7f66b84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:56.026186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0eb1-e835-4996-b209-92e7b69463cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:56.027236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0eb1-e835-4996-b209-92e7b69463cc service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:56.027717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0eb1-e835-4996-b209-92e7b69463cc service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:56.028190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0eb1-e835-4996-b209-92e7b69463cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:56.064235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:56.098259 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3705/7426] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:56.114637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee0eb1-e835-4996-b209-92e7b69463cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:56.116336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee0eb1-e835-4996-b209-92e7b69463cc service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:56.126660 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3722/7427] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:56.137037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9dbdb-5f43-4e06-8782-f61b7f66b84a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:56.148376 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9dbdb-5f43-4e06-8782-f61b7f66b84a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:56.152548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978ce35-0e26-4819-979d-afceb83a851a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:56.153178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978ce35-0e26-4819-979d-afceb83a851a service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:56.153485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978ce35-0e26-4819-979d-afceb83a851a service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:56.153755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978ce35-0e26-4819-979d-afceb83a851a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:56.155489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0978ce35-0e26-4819-979d-afceb83a851a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:56.220269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978ce35-0e26-4819-979d-afceb83a851a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:56.221774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978ce35-0e26-4819-979d-afceb83a851a service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:56.231212 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3706/7428] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:56.722432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0eb1-e835-4996-b209-92e7b69463cc service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:56.723907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a8ee0eb1-e835-4996-b209-92e7b69463cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:56.739948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0eb1-e835-4996-b209-92e7b69463cc service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:56.745419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:56.746070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:56.746600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:56.746885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] PATH_INFO: `/v3/projects/7948dcead48c45e8a73d309630d01966` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:56.748398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7948dcead48c45e8a73d309630d01966)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:56.750511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:56.803866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7948dcead48c45e8a73d309630d01966', 'request_id': 'req-349a693d-dcd3-4b6b-b650-722b28ad5537'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:56.815632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7948dcead48c45e8a73d309630d01966', 'request_id': 'req-349a693d-dcd3-4b6b-b650-722b28ad5537'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:56.823375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7948dcead48c45e8a73d309630d01966', 'request_id': 'req-349a693d-dcd3-4b6b-b650-722b28ad5537'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:56.835195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] The token cache is being invalidate because project 7948dcead48c45e8a73d309630d01966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:56.835987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:56.836267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:56.837892 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3723/7429] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:56 2022] DELETE /identity/v3/projects/7948dcead48c45e8a73d309630d01966 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:56.842387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978ce35-0e26-4819-979d-afceb83a851a service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:56.849863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:56.855795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978ce35-0e26-4819-979d-afceb83a851a service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:56.873042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:56.874831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:56.929515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:56.930167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:56.930492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:56.930864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] PATH_INFO: `/v3/users/2b25c6c87e0e43909a8d0a089155f260` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:56.932692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b25c6c87e0e43909a8d0a089155f260)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:56.938341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:56.990745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b25c6c87e0e43909a8d0a089155f260'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:56.999367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b25c6c87e0e43909a8d0a089155f260'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:56.999558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b25c6c87e0e43909a8d0a089155f260'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:57.001385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b25c6c87e0e43909a8d0a089155f260'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:57.008147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a693d-dcd3-4b6b-b650-722b28ad5537 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:57.014361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b25c6c87e0e43909a8d0a089155f260'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:57.014883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39738cbf-6647-4da5-897d-02308ec7a599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:57.015503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39738cbf-6647-4da5-897d-02308ec7a599 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:57.015784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39738cbf-6647-4da5-897d-02308ec7a599 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:57.016182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39738cbf-6647-4da5-897d-02308ec7a599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:57.017996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-39738cbf-6647-4da5-897d-02308ec7a599 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:57.028813 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3707/7430] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:56 2022] DELETE /identity/v3/users/2b25c6c87e0e43909a8d0a089155f260 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:57.043121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:57.104776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39738cbf-6647-4da5-897d-02308ec7a599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:57.106460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39738cbf-6647-4da5-897d-02308ec7a599 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:57.117579 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3724/7431] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:56 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:20:57.317288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:57.318761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:57.389651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2124-2d9a-4c0f-967a-01333c060ade admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:57.394786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:57.395580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:57.396078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:57.396429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb admin admin] PATH_INFO: `/v3/projects/2cfa96136eb649d691765c421f6c9972` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:57.397758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cfa96136eb649d691765c421f6c9972)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:57.399814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:57.438398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:57.460661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cfa96136eb649d691765c421f6c9972', 'request_id': 'req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:57.470315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cfa96136eb649d691765c421f6c9972', 'request_id': 'req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:57.482785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cfa96136eb649d691765c421f6c9972', 'request_id': 'req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:57.500782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb admin admin] The token cache is being invalidate because project 2cfa96136eb649d691765c421f6c9972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:57.501140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:57.501773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bcc3bc9e-4e4b-48df-8602-0bb9ddc38feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:57.503537 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3708/7432] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:57 2022] DELETE /identity/v3/projects/2cfa96136eb649d691765c421f6c9972 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:57.508361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1078be-c3bd-49d5-bf01-093be2408b91 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:57.508642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1078be-c3bd-49d5-bf01-093be2408b91 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:57.508916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1078be-c3bd-49d5-bf01-093be2408b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:57.530822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fc1078be-c3bd-49d5-bf01-093be2408b91 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:57.532069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fc1078be-c3bd-49d5-bf01-093be2408b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:57.613371 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3725/7433] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:57.617718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7a8fd-99a7-4071-adcb-89e0b30c6746 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:57.618026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7a8fd-99a7-4071-adcb-89e0b30c6746 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:57.618303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7a8fd-99a7-4071-adcb-89e0b30c6746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:57.640516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-dfd7a8fd-99a7-4071-adcb-89e0b30c6746 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:57.641760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dfd7a8fd-99a7-4071-adcb-89e0b30c6746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:57.649788 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3709/7434] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:57.654271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1078be-c3bd-49d5-bf01-093be2408b91 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:57.664561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1078be-c3bd-49d5-bf01-093be2408b91 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:57.669983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66221845-45ee-4e5e-8d2d-98ee5f830ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:57.670593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66221845-45ee-4e5e-8d2d-98ee5f830ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:57.670869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66221845-45ee-4e5e-8d2d-98ee5f830ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:57.671143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66221845-45ee-4e5e-8d2d-98ee5f830ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:57.671831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66221845-45ee-4e5e-8d2d-98ee5f830ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:57.672131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66221845-45ee-4e5e-8d2d-98ee5f830ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:57.673759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66221845-45ee-4e5e-8d2d-98ee5f830ae1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:57.687052 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3726/7435] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:57.691452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7a8fd-99a7-4071-adcb-89e0b30c6746 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:57.701091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7a8fd-99a7-4071-adcb-89e0b30c6746 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:57.705787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7662158-0549-4e38-b356-9e267cb97394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:57.706400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7662158-0549-4e38-b356-9e267cb97394 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:57.706677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7662158-0549-4e38-b356-9e267cb97394 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:57.706949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7662158-0549-4e38-b356-9e267cb97394 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:57.707587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7662158-0549-4e38-b356-9e267cb97394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:57.709516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7662158-0549-4e38-b356-9e267cb97394 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:57.738929 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3710/7436] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:57 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:57.743134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66221845-45ee-4e5e-8d2d-98ee5f830ae1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:57.754424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66221845-45ee-4e5e-8d2d-98ee5f830ae1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:57.814656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece8ce3-fdb3-4eb5-90dd-0820ece82884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:57.814896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece8ce3-fdb3-4eb5-90dd-0820ece82884 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:57.815260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece8ce3-fdb3-4eb5-90dd-0820ece82884 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:57.815835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece8ce3-fdb3-4eb5-90dd-0820ece82884 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:57.816486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece8ce3-fdb3-4eb5-90dd-0820ece82884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:57.818405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece8ce3-fdb3-4eb5-90dd-0820ece82884 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:57.844439 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3727/7437] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:57 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:20:57.846282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7662158-0549-4e38-b356-9e267cb97394 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:57.858207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7662158-0549-4e38-b356-9e267cb97394 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:57.863548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e14637-bec2-44ae-b134-b40e3dfbdd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:57.864158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e14637-bec2-44ae-b134-b40e3dfbdd32 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:57.864465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e14637-bec2-44ae-b134-b40e3dfbdd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:57.864738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e14637-bec2-44ae-b134-b40e3dfbdd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:57.865423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e14637-bec2-44ae-b134-b40e3dfbdd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:57.867015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e14637-bec2-44ae-b134-b40e3dfbdd32 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:57.878807 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3711/7438] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:57.882848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece8ce3-fdb3-4eb5-90dd-0820ece82884 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:57.894422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece8ce3-fdb3-4eb5-90dd-0820ece82884 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:57.899130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b486a8-3c48-4a20-bda2-8ff30635bf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:57.899723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b486a8-3c48-4a20-bda2-8ff30635bf60 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:57.900002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b486a8-3c48-4a20-bda2-8ff30635bf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:57.900272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b486a8-3c48-4a20-bda2-8ff30635bf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:57.901491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b486a8-3c48-4a20-bda2-8ff30635bf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:57.903085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b486a8-3c48-4a20-bda2-8ff30635bf60 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:57.914123 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3728/7439] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:57.918462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e14637-bec2-44ae-b134-b40e3dfbdd32 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:57.929012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e14637-bec2-44ae-b134-b40e3dfbdd32 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:57.934286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c41b82-1b4f-42b6-8381-9c42296772c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:57.934954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c41b82-1b4f-42b6-8381-9c42296772c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:57.935211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c41b82-1b4f-42b6-8381-9c42296772c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:57.935555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c41b82-1b4f-42b6-8381-9c42296772c0 admin admin] PATH_INFO: `/v3/projects/476a21b12d634b3ca6ef52536d16fc25/users/b7a72e67e6b9442682a47503b326ed2d/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:57.953745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c41b82-1b4f-42b6-8381-9c42296772c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476a21b12d634b3ca6ef52536d16fc25, user_id=b7a72e67e6b9442682a47503b326ed2d, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:57.956589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c41b82-1b4f-42b6-8381-9c42296772c0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:57.974817 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3712/7440] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:57 2022] PUT /identity/v3/projects/476a21b12d634b3ca6ef52536d16fc25/users/b7a72e67e6b9442682a47503b326ed2d/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:20:57.985656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad5e8c-c60d-4550-8240-9e80f07e94e8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:57.986038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad5e8c-c60d-4550-8240-9e80f07e94e8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:57.986317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad5e8c-c60d-4550-8240-9e80f07e94e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:58.016024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f6ad5e8c-c60d-4550-8240-9e80f07e94e8 None None] MFA Rules not processed for user `b7a72e67e6b9442682a47503b326ed2d`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:58.017701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f6ad5e8c-c60d-4550-8240-9e80f07e94e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:58.032679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:58.104122 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3729/7441] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:58.111441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c41b82-1b4f-42b6-8381-9c42296772c0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:58.113766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c0c41b82-1b4f-42b6-8381-9c42296772c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:58.178942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c41b82-1b4f-42b6-8381-9c42296772c0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:58.183063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef406c12-d514-40cc-adde-09465284620c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:58.183667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406c12-d514-40cc-adde-09465284620c service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:58.183944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406c12-d514-40cc-adde-09465284620c service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:58.184211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406c12-d514-40cc-adde-09465284620c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:58.192899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef406c12-d514-40cc-adde-09465284620c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:58.194349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef406c12-d514-40cc-adde-09465284620c service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:58.205200 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3713/7442] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:58.224021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad5e8c-c60d-4550-8240-9e80f07e94e8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:58.287619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad5e8c-c60d-4550-8240-9e80f07e94e8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:58.292886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:58.293901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:58.294217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:58.294705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] PATH_INFO: `/v3/users/b7a72e67e6b9442682a47503b326ed2d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:58.296129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a72e67e6b9442682a47503b326ed2d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:58.298246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:58.352920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a72e67e6b9442682a47503b326ed2d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:58.361317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a72e67e6b9442682a47503b326ed2d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:58.362098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a72e67e6b9442682a47503b326ed2d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:58.362820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a72e67e6b9442682a47503b326ed2d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:58.375653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a72e67e6b9442682a47503b326ed2d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:58.391633 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3730/7443] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:20:58 2022] DELETE /identity/v3/users/b7a72e67e6b9442682a47503b326ed2d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:58.393791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67da009-9516-4339-b25b-40fd30a18560 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:58.394271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67da009-9516-4339-b25b-40fd30a18560 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:58.394371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67da009-9516-4339-b25b-40fd30a18560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:58.415755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e67da009-9516-4339-b25b-40fd30a18560 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:58.418006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e67da009-9516-4339-b25b-40fd30a18560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:58.467917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:58.494270 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3714/7444] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:58.504651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:58.506115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:58.538570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:58.570171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912caf92-b367-41b4-a942-bf12b803b837 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:58.574455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48a6fe-b1af-487a-8cc2-22113110295e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:58.575156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48a6fe-b1af-487a-8cc2-22113110295e service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:58.575439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48a6fe-b1af-487a-8cc2-22113110295e service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:58.575716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48a6fe-b1af-487a-8cc2-22113110295e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:58.595384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48a6fe-b1af-487a-8cc2-22113110295e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:58.598204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48a6fe-b1af-487a-8cc2-22113110295e service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:58.613176 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3731/7445] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:20:58.923865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67da009-9516-4339-b25b-40fd30a18560 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:58.925853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e67da009-9516-4339-b25b-40fd30a18560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:58.940063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67da009-9516-4339-b25b-40fd30a18560 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:58.960926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb589177-0872-4dad-9013-447b83c131cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:58.963027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589177-0872-4dad-9013-447b83c131cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:58.963510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589177-0872-4dad-9013-447b83c131cd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:58.964524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589177-0872-4dad-9013-447b83c131cd admin admin] PATH_INFO: `/v3/projects/476a21b12d634b3ca6ef52536d16fc25` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:58.968898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb589177-0872-4dad-9013-447b83c131cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=476a21b12d634b3ca6ef52536d16fc25)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:58.971052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb589177-0872-4dad-9013-447b83c131cd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:59.026408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cb589177-0872-4dad-9013-447b83c131cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476a21b12d634b3ca6ef52536d16fc25', 'request_id': 'req-cb589177-0872-4dad-9013-447b83c131cd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:59.034856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cb589177-0872-4dad-9013-447b83c131cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476a21b12d634b3ca6ef52536d16fc25', 'request_id': 'req-cb589177-0872-4dad-9013-447b83c131cd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:59.041319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cb589177-0872-4dad-9013-447b83c131cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476a21b12d634b3ca6ef52536d16fc25', 'request_id': 'req-cb589177-0872-4dad-9013-447b83c131cd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:59.053099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cb589177-0872-4dad-9013-447b83c131cd admin admin] The token cache is being invalidate because project 476a21b12d634b3ca6ef52536d16fc25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:20:59.053504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cb589177-0872-4dad-9013-447b83c131cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:59.054236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-cb589177-0872-4dad-9013-447b83c131cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:20:59.056043 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3715/7446] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:20:58 2022] DELETE /identity/v3/projects/476a21b12d634b3ca6ef52536d16fc25 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:59.061802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b02fe-a7fe-44d4-aa72-900014574e23 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:59.062407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b02fe-a7fe-44d4-aa72-900014574e23 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:59.062407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b02fe-a7fe-44d4-aa72-900014574e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:59.085448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-700b02fe-a7fe-44d4-aa72-900014574e23 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:59.086745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-700b02fe-a7fe-44d4-aa72-900014574e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:59.172376 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3732/7447] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:59.173556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79952d-df70-4c35-aeb4-1226bed5113e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:59.174120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79952d-df70-4c35-aeb4-1226bed5113e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:59.174394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79952d-df70-4c35-aeb4-1226bed5113e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:59.201324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6d79952d-df70-4c35-aeb4-1226bed5113e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:59.202782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6d79952d-df70-4c35-aeb4-1226bed5113e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:59.211408 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3716/7448] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:20:59.216873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b02fe-a7fe-44d4-aa72-900014574e23 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:59.227703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b02fe-a7fe-44d4-aa72-900014574e23 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:59.233372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a983f70-acb9-4db5-888d-938d2ab7bbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:59.234431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a983f70-acb9-4db5-888d-938d2ab7bbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:59.234431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a983f70-acb9-4db5-888d-938d2ab7bbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:59.234648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a983f70-acb9-4db5-888d-938d2ab7bbc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:59.235378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a983f70-acb9-4db5-888d-938d2ab7bbc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:20:59.236549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a983f70-acb9-4db5-888d-938d2ab7bbc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:59.237450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a983f70-acb9-4db5-888d-938d2ab7bbc5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:59.254642 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3733/7449] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:20:59.255539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79952d-df70-4c35-aeb4-1226bed5113e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:59.265384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79952d-df70-4c35-aeb4-1226bed5113e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:59.270294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e71c9-7f89-4116-be8e-18efcff059d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:59.270903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e71c9-7f89-4116-be8e-18efcff059d6 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:59.271182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e71c9-7f89-4116-be8e-18efcff059d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:59.271486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e71c9-7f89-4116-be8e-18efcff059d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:59.272126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e71c9-7f89-4116-be8e-18efcff059d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:59.274081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e71c9-7f89-4116-be8e-18efcff059d6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:59.305507 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3717/7450] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:20:59 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:59.306711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a983f70-acb9-4db5-888d-938d2ab7bbc5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:59.318584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a983f70-acb9-4db5-888d-938d2ab7bbc5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:59.376408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf965154-4ea4-4afb-9c7f-f4a406cd5f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:59.377048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf965154-4ea4-4afb-9c7f-f4a406cd5f54 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:59.377538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf965154-4ea4-4afb-9c7f-f4a406cd5f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:59.377822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf965154-4ea4-4afb-9c7f-f4a406cd5f54 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:59.378536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf965154-4ea4-4afb-9c7f-f4a406cd5f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:59.380704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf965154-4ea4-4afb-9c7f-f4a406cd5f54 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:59.402146 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3734/7451] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:20:59 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:20:59.406086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e71c9-7f89-4116-be8e-18efcff059d6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:59.417949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e71c9-7f89-4116-be8e-18efcff059d6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:59.423439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5adc1-70f6-4c9e-9ed7-4ff1f67d4e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:59.424226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5adc1-70f6-4c9e-9ed7-4ff1f67d4e43 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:59.424559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5adc1-70f6-4c9e-9ed7-4ff1f67d4e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:59.424831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5adc1-70f6-4c9e-9ed7-4ff1f67d4e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:59.425613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5adc1-70f6-4c9e-9ed7-4ff1f67d4e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:59.427219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5adc1-70f6-4c9e-9ed7-4ff1f67d4e43 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:59.438812 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3718/7452] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:20:59.442821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf965154-4ea4-4afb-9c7f-f4a406cd5f54 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:59.455115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf965154-4ea4-4afb-9c7f-f4a406cd5f54 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:59.460379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2943a8-6418-42f8-b04c-abbbdf44d7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:59.461004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2943a8-6418-42f8-b04c-abbbdf44d7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:59.461318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2943a8-6418-42f8-b04c-abbbdf44d7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:59.461597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2943a8-6418-42f8-b04c-abbbdf44d7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:59.462266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2943a8-6418-42f8-b04c-abbbdf44d7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:59.464425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2943a8-6418-42f8-b04c-abbbdf44d7a6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:59.488535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5adc1-70f6-4c9e-9ed7-4ff1f67d4e43 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:59.493892 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3735/7453] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:20:59.499317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5adc1-70f6-4c9e-9ed7-4ff1f67d4e43 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:59.504078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab69e8b-a30a-42ff-a2dc-0e208cb10334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:59.504745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab69e8b-a30a-42ff-a2dc-0e208cb10334 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:59.505071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab69e8b-a30a-42ff-a2dc-0e208cb10334 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:59.505330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab69e8b-a30a-42ff-a2dc-0e208cb10334 admin admin] PATH_INFO: `/v3/projects/7f78840b82af409ea762c732520aee70/users/c11f3e3284a346bcbcf0099c0a9bed7d/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:59.522623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab69e8b-a30a-42ff-a2dc-0e208cb10334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f78840b82af409ea762c732520aee70, user_id=c11f3e3284a346bcbcf0099c0a9bed7d, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:59.525318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab69e8b-a30a-42ff-a2dc-0e208cb10334 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:59.539699 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3719/7454] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:20:59 2022] PUT /identity/v3/projects/7f78840b82af409ea762c732520aee70/users/c11f3e3284a346bcbcf0099c0a9bed7d/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:20:59.551754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b03f5a-45ed-4570-ae2e-c65812871ace None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:59.552040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b03f5a-45ed-4570-ae2e-c65812871ace None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:59.552314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b03f5a-45ed-4570-ae2e-c65812871ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:59.581661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d9b03f5a-45ed-4570-ae2e-c65812871ace None None] MFA Rules not processed for user `c11f3e3284a346bcbcf0099c0a9bed7d`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:20:59.583160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d9b03f5a-45ed-4570-ae2e-c65812871ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:59.613385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:59.655712 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3736/7455] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:20:59.667729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab69e8b-a30a-42ff-a2dc-0e208cb10334 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:20:59.669645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5ab69e8b-a30a-42ff-a2dc-0e208cb10334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:20:59.736485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab69e8b-a30a-42ff-a2dc-0e208cb10334 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:20:59.740638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3fc7a-8c16-4b70-b906-46cc82ac6976 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:20:59.741526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3fc7a-8c16-4b70-b906-46cc82ac6976 service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:20:59.741808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3fc7a-8c16-4b70-b906-46cc82ac6976 service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:20:59.742082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3fc7a-8c16-4b70-b906-46cc82ac6976 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:20:59.752428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3fc7a-8c16-4b70-b906-46cc82ac6976 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:20:59.753912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3fc7a-8c16-4b70-b906-46cc82ac6976 service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:20:59.764046 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3720/7456] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:20:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:02.469742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b03f5a-45ed-4570-ae2e-c65812871ace None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:02.471759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d9b03f5a-45ed-4570-ae2e-c65812871ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:02.555624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b03f5a-45ed-4570-ae2e-c65812871ace None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:02.560970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:02.561708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:02.562233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:02.562585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] PATH_INFO: `/v3/users/97d277aa3750419e9c70b98a97269347` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:02.564231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d277aa3750419e9c70b98a97269347)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:02.566848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:02.623920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d277aa3750419e9c70b98a97269347'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:02.631414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d277aa3750419e9c70b98a97269347'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:02.632356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d277aa3750419e9c70b98a97269347'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:02.633014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d277aa3750419e9c70b98a97269347'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:02.645581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d277aa3750419e9c70b98a97269347'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:02.662665 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3737/7457] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:02 2022] DELETE /identity/v3/users/97d277aa3750419e9c70b98a97269347 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:02.668207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a5f56-9b46-48ef-ae34-39ca2a980aaf None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:02.668717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a5f56-9b46-48ef-ae34-39ca2a980aaf None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:02.668848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a5f56-9b46-48ef-ae34-39ca2a980aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:02.693554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3e0a5f56-9b46-48ef-ae34-39ca2a980aaf None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:02.694791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3e0a5f56-9b46-48ef-ae34-39ca2a980aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:02.704471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:02.768652 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3721/7458] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:02.780692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:02.782285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:02.856703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:02.866414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cc31f-097a-4ca3-991e-397a234fa404 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:02.872614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6733112-9955-4016-87f8-54cf5c160c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:02.873503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6733112-9955-4016-87f8-54cf5c160c7f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:02.873853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6733112-9955-4016-87f8-54cf5c160c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:02.874194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6733112-9955-4016-87f8-54cf5c160c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:02.889786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6733112-9955-4016-87f8-54cf5c160c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:02.891236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6733112-9955-4016-87f8-54cf5c160c7f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:02.903648 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3738/7459] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:03.107584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a5f56-9b46-48ef-ae34-39ca2a980aaf None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:03.109225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3e0a5f56-9b46-48ef-ae34-39ca2a980aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:03.131462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a5f56-9b46-48ef-ae34-39ca2a980aaf None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:03.153792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:03.155434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:03.155870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:03.156332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] PATH_INFO: `/v3/projects/caccf3d4ec5447b18f934c159e10d567` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:03.157817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caccf3d4ec5447b18f934c159e10d567)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:03.160350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:03.230678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caccf3d4ec5447b18f934c159e10d567', 'request_id': 'req-05178c42-7796-40e3-a3fa-41d71410c932'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.240441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caccf3d4ec5447b18f934c159e10d567', 'request_id': 'req-05178c42-7796-40e3-a3fa-41d71410c932'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.249834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caccf3d4ec5447b18f934c159e10d567', 'request_id': 'req-05178c42-7796-40e3-a3fa-41d71410c932'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.263059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] The token cache is being invalidate because project caccf3d4ec5447b18f934c159e10d567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:03.263356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.264022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.265596 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3722/7460] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:03 2022] DELETE /identity/v3/projects/caccf3d4ec5447b18f934c159e10d567 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:03.269638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6733112-9955-4016-87f8-54cf5c160c7f service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:03.279495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6733112-9955-4016-87f8-54cf5c160c7f service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:03.337533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317e720-ece4-4278-b773-5eea777b8909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:03.338190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317e720-ece4-4278-b773-5eea777b8909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:03.338474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317e720-ece4-4278-b773-5eea777b8909 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:03.338743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317e720-ece4-4278-b773-5eea777b8909 admin admin] PATH_INFO: `/v3/users/7da6cba755054de6953059f4a76657bc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:03.339858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317e720-ece4-4278-b773-5eea777b8909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7da6cba755054de6953059f4a76657bc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:03.341835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317e720-ece4-4278-b773-5eea777b8909 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:03.386201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2317e720-ece4-4278-b773-5eea777b8909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da6cba755054de6953059f4a76657bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.392802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2317e720-ece4-4278-b773-5eea777b8909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da6cba755054de6953059f4a76657bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.393476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2317e720-ece4-4278-b773-5eea777b8909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da6cba755054de6953059f4a76657bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.394074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2317e720-ece4-4278-b773-5eea777b8909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da6cba755054de6953059f4a76657bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.405707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2317e720-ece4-4278-b773-5eea777b8909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da6cba755054de6953059f4a76657bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.417997 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3739/7461] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:03 2022] DELETE /identity/v3/users/7da6cba755054de6953059f4a76657bc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:03.600515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:03.601965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:03.617234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05178c42-7796-40e3-a3fa-41d71410c932 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:03.677032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:03.677805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:03.677908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:03.678140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5 admin admin] PATH_INFO: `/v3/projects/9896af9fcdc348bdb2dc4ee88c101413` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:03.679257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9896af9fcdc348bdb2dc4ee88c101413)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:03.681131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:03.720831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:03.728590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9896af9fcdc348bdb2dc4ee88c101413', 'request_id': 'req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.736793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9896af9fcdc348bdb2dc4ee88c101413', 'request_id': 'req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.742689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9896af9fcdc348bdb2dc4ee88c101413', 'request_id': 'req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.754180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5 admin admin] The token cache is being invalidate because project 9896af9fcdc348bdb2dc4ee88c101413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:03.754465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.755107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b0a2b738-5e8c-4d85-92b4-18da9e46aed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:03.756576 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3723/7462] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:03 2022] DELETE /identity/v3/projects/9896af9fcdc348bdb2dc4ee88c101413 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:03.761427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5ab51-79c4-4cb1-a288-45694bc37aa7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:03.761892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5ab51-79c4-4cb1-a288-45694bc37aa7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:03.762012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5ab51-79c4-4cb1-a288-45694bc37aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:03.785089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d0b5ab51-79c4-4cb1-a288-45694bc37aa7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:03.786322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d0b5ab51-79c4-4cb1-a288-45694bc37aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:03.845696 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3740/7463] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:03.855320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027c69f-62bc-40e6-8dd6-d6dc9ce028de None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:03.855708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027c69f-62bc-40e6-8dd6-d6dc9ce028de None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:03.856055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027c69f-62bc-40e6-8dd6-d6dc9ce028de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:03.876609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2027c69f-62bc-40e6-8dd6-d6dc9ce028de None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:03.877854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2027c69f-62bc-40e6-8dd6-d6dc9ce028de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:03.885966 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3724/7464] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:03.890500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5ab51-79c4-4cb1-a288-45694bc37aa7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:03.900230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5ab51-79c4-4cb1-a288-45694bc37aa7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:03.904742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d06e1c-f539-482d-a5ee-87a01c3362d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:03.905382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d06e1c-f539-482d-a5ee-87a01c3362d2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:03.905658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d06e1c-f539-482d-a5ee-87a01c3362d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:03.905927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d06e1c-f539-482d-a5ee-87a01c3362d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:03.906557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d06e1c-f539-482d-a5ee-87a01c3362d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:21:03.906854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d06e1c-f539-482d-a5ee-87a01c3362d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:03.908412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d06e1c-f539-482d-a5ee-87a01c3362d2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:03.910703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:03.921457 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3741/7465] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:21:03.925343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027c69f-62bc-40e6-8dd6-d6dc9ce028de None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:03.935306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027c69f-62bc-40e6-8dd6-d6dc9ce028de None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:03.939921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ce9eb-f08a-4110-9f29-564b44a3beea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:03.940509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce9eb-f08a-4110-9f29-564b44a3beea admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:03.940787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce9eb-f08a-4110-9f29-564b44a3beea admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:03.941058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce9eb-f08a-4110-9f29-564b44a3beea admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:03.941713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ce9eb-f08a-4110-9f29-564b44a3beea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:03.943594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ce9eb-f08a-4110-9f29-564b44a3beea admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:03.973066 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3725/7466] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:03 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:03.974321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d06e1c-f539-482d-a5ee-87a01c3362d2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:03.985044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d06e1c-f539-482d-a5ee-87a01c3362d2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:04.039890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc2d91-0e65-4943-99d5-f5ac0164c5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:04.040465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc2d91-0e65-4943-99d5-f5ac0164c5da admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:04.040738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc2d91-0e65-4943-99d5-f5ac0164c5da admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:04.041009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc2d91-0e65-4943-99d5-f5ac0164c5da admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:04.042240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc2d91-0e65-4943-99d5-f5ac0164c5da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:04.044134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc2d91-0e65-4943-99d5-f5ac0164c5da admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:04.064067 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3742/7467] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:03 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:04.068261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ce9eb-f08a-4110-9f29-564b44a3beea admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:04.078491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ce9eb-f08a-4110-9f29-564b44a3beea admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:04.083017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ffd2-3999-4d57-97e5-77866da7ae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:04.083606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ffd2-3999-4d57-97e5-77866da7ae4f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:04.083879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ffd2-3999-4d57-97e5-77866da7ae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:04.084146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ffd2-3999-4d57-97e5-77866da7ae4f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:04.084797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571ffd2-3999-4d57-97e5-77866da7ae4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:04.086398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571ffd2-3999-4d57-97e5-77866da7ae4f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:04.096880 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3726/7468] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:04.100854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc2d91-0e65-4943-99d5-f5ac0164c5da admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:04.111786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc2d91-0e65-4943-99d5-f5ac0164c5da admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:04.116533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e3f4f-1452-4e4b-bb83-0b13b1699be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:04.117121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e3f4f-1452-4e4b-bb83-0b13b1699be4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:04.117425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e3f4f-1452-4e4b-bb83-0b13b1699be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:04.117697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e3f4f-1452-4e4b-bb83-0b13b1699be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:04.118364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e3f4f-1452-4e4b-bb83-0b13b1699be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:04.120043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e3f4f-1452-4e4b-bb83-0b13b1699be4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:04.136254 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3743/7469] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:21:04.140426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ffd2-3999-4d57-97e5-77866da7ae4f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:04.151291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ffd2-3999-4d57-97e5-77866da7ae4f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:04.156716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5db15-cfbf-4e53-a041-da89d4e95c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:04.157545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5db15-cfbf-4e53-a041-da89d4e95c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:04.157924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5db15-cfbf-4e53-a041-da89d4e95c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:04.158300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5db15-cfbf-4e53-a041-da89d4e95c13 admin admin] PATH_INFO: `/v3/projects/74b53fd9af1c40b08fb8224f280a3618/users/dc6e1652d3d74e1794d326e5584a507d/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:04.175697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5db15-cfbf-4e53-a041-da89d4e95c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b53fd9af1c40b08fb8224f280a3618, user_id=dc6e1652d3d74e1794d326e5584a507d, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:04.179418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5db15-cfbf-4e53-a041-da89d4e95c13 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:04.195905 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3727/7470] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:04 2022] PUT /identity/v3/projects/74b53fd9af1c40b08fb8224f280a3618/users/dc6e1652d3d74e1794d326e5584a507d/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:04.218800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829cafe-382e-4d1b-b997-f01a72794dac None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:04.219153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829cafe-382e-4d1b-b997-f01a72794dac None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:04.219370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829cafe-382e-4d1b-b997-f01a72794dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:04.251830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6829cafe-382e-4d1b-b997-f01a72794dac None None] MFA Rules not processed for user `dc6e1652d3d74e1794d326e5584a507d`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:04.253155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6829cafe-382e-4d1b-b997-f01a72794dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:04.328936 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3744/7471] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:04.333173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5db15-cfbf-4e53-a041-da89d4e95c13 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:04.405921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5db15-cfbf-4e53-a041-da89d4e95c13 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:04.411039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b364ab-ecff-4162-9289-c0eb4d20d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:04.411691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b364ab-ecff-4162-9289-c0eb4d20d915 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:04.411971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b364ab-ecff-4162-9289-c0eb4d20d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:04.412249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b364ab-ecff-4162-9289-c0eb4d20d915 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:04.412878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b364ab-ecff-4162-9289-c0eb4d20d915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:04.414832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b364ab-ecff-4162-9289-c0eb4d20d915 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:04.448591 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3728/7472] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:04 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:04.452541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829cafe-382e-4d1b-b997-f01a72794dac None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:04.463875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829cafe-382e-4d1b-b997-f01a72794dac None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:04.525764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874a9f5-ce52-46a8-bb3f-b2a677c2fa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:04.526371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874a9f5-ce52-46a8-bb3f-b2a677c2fa94 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:04.526652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874a9f5-ce52-46a8-bb3f-b2a677c2fa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:04.526924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874a9f5-ce52-46a8-bb3f-b2a677c2fa94 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:04.527541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874a9f5-ce52-46a8-bb3f-b2a677c2fa94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:04.529471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874a9f5-ce52-46a8-bb3f-b2a677c2fa94 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:04.539163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:04.554222 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3745/7473] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:04 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:04.559041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b364ab-ecff-4162-9289-c0eb4d20d915 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:04.570878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b364ab-ecff-4162-9289-c0eb4d20d915 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:04.576749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c27c47-b3b0-443e-bfdf-5f694cd5ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:04.577481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c27c47-b3b0-443e-bfdf-5f694cd5ed49 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:04.577832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c27c47-b3b0-443e-bfdf-5f694cd5ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:04.578179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c27c47-b3b0-443e-bfdf-5f694cd5ed49 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:04.578910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c27c47-b3b0-443e-bfdf-5f694cd5ed49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:04.580750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c27c47-b3b0-443e-bfdf-5f694cd5ed49 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:04.596339 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3729/7474] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:21:04.598544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874a9f5-ce52-46a8-bb3f-b2a677c2fa94 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:04.613507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874a9f5-ce52-46a8-bb3f-b2a677c2fa94 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:04.615895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57e7dc-266f-4ae5-b385-9a3a04abb49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:04.616543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57e7dc-266f-4ae5-b385-9a3a04abb49c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:04.616853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57e7dc-266f-4ae5-b385-9a3a04abb49c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:04.617126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57e7dc-266f-4ae5-b385-9a3a04abb49c admin admin] PATH_INFO: `/v3/projects/d97f56da2e6f4c108be762c9a4c7920d/users/4de0e6fd29ce4756ad13ea753e13c858/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:04.633209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57e7dc-266f-4ae5-b385-9a3a04abb49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97f56da2e6f4c108be762c9a4c7920d, user_id=4de0e6fd29ce4756ad13ea753e13c858, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:04.635904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57e7dc-266f-4ae5-b385-9a3a04abb49c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:04.648517 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3746/7475] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:04 2022] PUT /identity/v3/projects/d97f56da2e6f4c108be762c9a4c7920d/users/4de0e6fd29ce4756ad13ea753e13c858/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:21:04.652314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c27c47-b3b0-443e-bfdf-5f694cd5ed49 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:04.662677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c27c47-b3b0-443e-bfdf-5f694cd5ed49 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:04.702119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:04.722444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92193813-fe35-438c-bde5-4fc339339cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:04.723059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92193813-fe35-438c-bde5-4fc339339cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:04.723339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92193813-fe35-438c-bde5-4fc339339cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:04.723614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92193813-fe35-438c-bde5-4fc339339cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:04.724246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92193813-fe35-438c-bde5-4fc339339cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:04.725894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92193813-fe35-438c-bde5-4fc339339cb1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:04.736731 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3730/7476] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:04.740775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57e7dc-266f-4ae5-b385-9a3a04abb49c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:04.751394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57e7dc-266f-4ae5-b385-9a3a04abb49c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:04.756029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dafc1-52dd-42a8-89a9-c4ab486be553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:04.756754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dafc1-52dd-42a8-89a9-c4ab486be553 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:04.757099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dafc1-52dd-42a8-89a9-c4ab486be553 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:04.757470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dafc1-52dd-42a8-89a9-c4ab486be553 admin admin] PATH_INFO: `/v3/projects/d97f56da2e6f4c108be762c9a4c7920d/users/4de0e6fd29ce4756ad13ea753e13c858/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:04.759432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dafc1-52dd-42a8-89a9-c4ab486be553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97f56da2e6f4c108be762c9a4c7920d, user_id=4de0e6fd29ce4756ad13ea753e13c858, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:04.762269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dafc1-52dd-42a8-89a9-c4ab486be553 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:04.772297 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3747/7477] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:04 2022] PUT /identity/v3/projects/d97f56da2e6f4c108be762c9a4c7920d/users/4de0e6fd29ce4756ad13ea753e13c858/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:04.782980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c23fb4-026c-4f7d-b26b-2fb4a2c09bad None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:04.783337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c23fb4-026c-4f7d-b26b-2fb4a2c09bad None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:04.783675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c23fb4-026c-4f7d-b26b-2fb4a2c09bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:04.812384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d5c23fb4-026c-4f7d-b26b-2fb4a2c09bad None None] MFA Rules not processed for user `4de0e6fd29ce4756ad13ea753e13c858`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:04.813639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d5c23fb4-026c-4f7d-b26b-2fb4a2c09bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:04.882265 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3731/7478] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:21:04.892347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dafc1-52dd-42a8-89a9-c4ab486be553 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:04.894125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-540dafc1-52dd-42a8-89a9-c4ab486be553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:04.924044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c23fb4-026c-4f7d-b26b-2fb4a2c09bad None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:04.925832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d5c23fb4-026c-4f7d-b26b-2fb4a2c09bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:04.966484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dafc1-52dd-42a8-89a9-c4ab486be553 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:04.970383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cea77-f66a-4f6a-bb44-1f7c19965eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:04.971125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cea77-f66a-4f6a-bb44-1f7c19965eab service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:04.971577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cea77-f66a-4f6a-bb44-1f7c19965eab service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:04.971921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cea77-f66a-4f6a-bb44-1f7c19965eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:04.983158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cea77-f66a-4f6a-bb44-1f7c19965eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:04.984951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cea77-f66a-4f6a-bb44-1f7c19965eab service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:04.996518 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3748/7479] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:04.998084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c23fb4-026c-4f7d-b26b-2fb4a2c09bad None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:05.002716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:05.003422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:05.003775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:05.004123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] PATH_INFO: `/v3/users/c11f3e3284a346bcbcf0099c0a9bed7d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:05.005371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11f3e3284a346bcbcf0099c0a9bed7d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:05.007367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:05.068945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11f3e3284a346bcbcf0099c0a9bed7d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:05.079446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11f3e3284a346bcbcf0099c0a9bed7d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:05.080259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11f3e3284a346bcbcf0099c0a9bed7d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:05.080958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11f3e3284a346bcbcf0099c0a9bed7d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:05.086410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:05.097010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11f3e3284a346bcbcf0099c0a9bed7d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:05.113117 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3732/7480] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:04 2022] DELETE /identity/v3/users/c11f3e3284a346bcbcf0099c0a9bed7d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:21:05.117700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b2058-1442-4688-9d6b-ffed06bfe12c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:05.117979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b2058-1442-4688-9d6b-ffed06bfe12c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:05.118249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b2058-1442-4688-9d6b-ffed06bfe12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:05.139895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4b1b2058-1442-4688-9d6b-ffed06bfe12c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:05.141256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4b1b2058-1442-4688-9d6b-ffed06bfe12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:05.200433 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3749/7481] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:21:05.210395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:05.211883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:05.290665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273c69a-273e-40ca-96e9-27046b272fa5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:05.294429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd49f1-46ef-4cc2-a002-d7e25d7d3c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:05.295035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd49f1-46ef-4cc2-a002-d7e25d7d3c0f service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:05.295312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd49f1-46ef-4cc2-a002-d7e25d7d3c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:05.295581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd49f1-46ef-4cc2-a002-d7e25d7d3c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:05.304958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd49f1-46ef-4cc2-a002-d7e25d7d3c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:05.306455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd49f1-46ef-4cc2-a002-d7e25d7d3c0f service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:05.317033 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3733/7482] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:05.607039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b2058-1442-4688-9d6b-ffed06bfe12c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:05.608495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4b1b2058-1442-4688-9d6b-ffed06bfe12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:05.627302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b2058-1442-4688-9d6b-ffed06bfe12c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:05.647254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb050b-1c3e-41cd-9848-6c169cfe7b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:05.647996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb050b-1c3e-41cd-9848-6c169cfe7b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:05.648284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb050b-1c3e-41cd-9848-6c169cfe7b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:05.648852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb050b-1c3e-41cd-9848-6c169cfe7b42 admin admin] PATH_INFO: `/v3/projects/7f78840b82af409ea762c732520aee70` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:05.650276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb050b-1c3e-41cd-9848-6c169cfe7b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f78840b82af409ea762c732520aee70)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:05.654560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb050b-1c3e-41cd-9848-6c169cfe7b42 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:05.712515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-80cb050b-1c3e-41cd-9848-6c169cfe7b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f78840b82af409ea762c732520aee70', 'request_id': 'req-80cb050b-1c3e-41cd-9848-6c169cfe7b42'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:05.718520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:05.725726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-80cb050b-1c3e-41cd-9848-6c169cfe7b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f78840b82af409ea762c732520aee70', 'request_id': 'req-80cb050b-1c3e-41cd-9848-6c169cfe7b42'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:05.737756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-80cb050b-1c3e-41cd-9848-6c169cfe7b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f78840b82af409ea762c732520aee70', 'request_id': 'req-80cb050b-1c3e-41cd-9848-6c169cfe7b42'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:05.751328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-80cb050b-1c3e-41cd-9848-6c169cfe7b42 admin admin] The token cache is being invalidate because project 7f78840b82af409ea762c732520aee70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:05.751789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-80cb050b-1c3e-41cd-9848-6c169cfe7b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:05.752254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-80cb050b-1c3e-41cd-9848-6c169cfe7b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:05.754076 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3750/7483] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:05 2022] DELETE /identity/v3/projects/7f78840b82af409ea762c732520aee70 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:05.758960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2af61-be07-4dbf-88af-6667429ccba9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:05.759479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2af61-be07-4dbf-88af-6667429ccba9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:05.759744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2af61-be07-4dbf-88af-6667429ccba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:05.785570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b5a2af61-be07-4dbf-88af-6667429ccba9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:05.787543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b5a2af61-be07-4dbf-88af-6667429ccba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:05.877833 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3734/7484] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:21:05.886092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be9c64-d1af-495e-9a15-7523c0662494 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:05.886606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be9c64-d1af-495e-9a15-7523c0662494 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:05.886885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be9c64-d1af-495e-9a15-7523c0662494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:05.910012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d3be9c64-d1af-495e-9a15-7523c0662494 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:05.911482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d3be9c64-d1af-495e-9a15-7523c0662494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:05.925670 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3751/7485] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:21:05.930315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2af61-be07-4dbf-88af-6667429ccba9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:05.942218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2af61-be07-4dbf-88af-6667429ccba9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:05.947454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a278dd-cf1e-4b94-8996-e6f904a33979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:05.948683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a278dd-cf1e-4b94-8996-e6f904a33979 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:05.948963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a278dd-cf1e-4b94-8996-e6f904a33979 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:05.949300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a278dd-cf1e-4b94-8996-e6f904a33979 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:05.950085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a278dd-cf1e-4b94-8996-e6f904a33979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:21:05.950597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a278dd-cf1e-4b94-8996-e6f904a33979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:05.952207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a278dd-cf1e-4b94-8996-e6f904a33979 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:05.969296 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3735/7486] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:21:05.973208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be9c64-d1af-495e-9a15-7523c0662494 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:05.988111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be9c64-d1af-495e-9a15-7523c0662494 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:06.002715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd54c21-4098-4f55-8c4b-6d8b0d5f9cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:06.003966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd54c21-4098-4f55-8c4b-6d8b0d5f9cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:06.004302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd54c21-4098-4f55-8c4b-6d8b0d5f9cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:06.004606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd54c21-4098-4f55-8c4b-6d8b0d5f9cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:06.005368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd54c21-4098-4f55-8c4b-6d8b0d5f9cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:06.007294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd54c21-4098-4f55-8c4b-6d8b0d5f9cd9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:06.041844 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3752/7487] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:05 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:06.045277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a278dd-cf1e-4b94-8996-e6f904a33979 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:06.073982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a278dd-cf1e-4b94-8996-e6f904a33979 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:06.144432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740533b-fc7c-4390-9bfc-688910e9d383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:06.145119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740533b-fc7c-4390-9bfc-688910e9d383 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:06.145436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740533b-fc7c-4390-9bfc-688910e9d383 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:06.145768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740533b-fc7c-4390-9bfc-688910e9d383 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:06.146440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740533b-fc7c-4390-9bfc-688910e9d383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:06.148500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740533b-fc7c-4390-9bfc-688910e9d383 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:06.168018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:06.181672 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3736/7488] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:06 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:06.182742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd54c21-4098-4f55-8c4b-6d8b0d5f9cd9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:06.193077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd54c21-4098-4f55-8c4b-6d8b0d5f9cd9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:06.198345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a3015-2e0b-4602-be6a-d5454bad59c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:06.198943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a3015-2e0b-4602-be6a-d5454bad59c2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:06.199220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a3015-2e0b-4602-be6a-d5454bad59c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:06.199489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a3015-2e0b-4602-be6a-d5454bad59c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:06.200123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a3015-2e0b-4602-be6a-d5454bad59c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:06.201726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a3015-2e0b-4602-be6a-d5454bad59c2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:06.213806 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3753/7489] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:06.216858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740533b-fc7c-4390-9bfc-688910e9d383 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:06.227518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740533b-fc7c-4390-9bfc-688910e9d383 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:06.232419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b570b37-1ab1-4621-b221-32f84367a6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:06.233326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b570b37-1ab1-4621-b221-32f84367a6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:06.233506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b570b37-1ab1-4621-b221-32f84367a6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:06.233835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b570b37-1ab1-4621-b221-32f84367a6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:06.234450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b570b37-1ab1-4621-b221-32f84367a6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:06.237047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b570b37-1ab1-4621-b221-32f84367a6c4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:06.253436 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3737/7490] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:06.254893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a3015-2e0b-4602-be6a-d5454bad59c2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:06.266165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a3015-2e0b-4602-be6a-d5454bad59c2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:06.271147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5896fff-8347-4c07-b005-42fafb87cce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:06.271833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5896fff-8347-4c07-b005-42fafb87cce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:06.272114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5896fff-8347-4c07-b005-42fafb87cce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:06.272388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5896fff-8347-4c07-b005-42fafb87cce7 admin admin] PATH_INFO: `/v3/projects/c9c598da07d04b78bb32164d4e25d0d8/users/ad60755620514bea97406f99d69339bc/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:06.294907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5896fff-8347-4c07-b005-42fafb87cce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c598da07d04b78bb32164d4e25d0d8, user_id=ad60755620514bea97406f99d69339bc, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:06.303695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5896fff-8347-4c07-b005-42fafb87cce7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:06.320071 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3754/7491] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:06 2022] PUT /identity/v3/projects/c9c598da07d04b78bb32164d4e25d0d8/users/ad60755620514bea97406f99d69339bc/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:06.333755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ec1d4-504a-4d28-a21e-bc505ec66dad None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:06.334417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ec1d4-504a-4d28-a21e-bc505ec66dad None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:06.335106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ec1d4-504a-4d28-a21e-bc505ec66dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:06.406945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-351ec1d4-504a-4d28-a21e-bc505ec66dad None None] MFA Rules not processed for user `ad60755620514bea97406f99d69339bc`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:06.408228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-351ec1d4-504a-4d28-a21e-bc505ec66dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:06.519245 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3738/7492] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:06.523796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5896fff-8347-4c07-b005-42fafb87cce7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:06.591298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5896fff-8347-4c07-b005-42fafb87cce7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:06.596236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d03d44-eb1e-4e60-a28a-accea0799d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:06.597010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d03d44-eb1e-4e60-a28a-accea0799d3b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:06.597421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d03d44-eb1e-4e60-a28a-accea0799d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:06.597761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d03d44-eb1e-4e60-a28a-accea0799d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:06.598459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d03d44-eb1e-4e60-a28a-accea0799d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:06.600761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d03d44-eb1e-4e60-a28a-accea0799d3b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:06.632721 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3755/7493] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:06 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:06.636775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ec1d4-504a-4d28-a21e-bc505ec66dad None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:06.648354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ec1d4-504a-4d28-a21e-bc505ec66dad None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:06.718868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702c95e-310f-40b9-9801-ed205d498afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:06.719772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702c95e-310f-40b9-9801-ed205d498afc admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:06.720124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702c95e-310f-40b9-9801-ed205d498afc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:06.720469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702c95e-310f-40b9-9801-ed205d498afc admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:06.721767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702c95e-310f-40b9-9801-ed205d498afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:06.723900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702c95e-310f-40b9-9801-ed205d498afc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:06.754229 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3739/7494] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:06 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:21:06.757981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d03d44-eb1e-4e60-a28a-accea0799d3b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:06.769477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d03d44-eb1e-4e60-a28a-accea0799d3b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:06.775958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a0f19-2735-457a-a895-ee24386a2f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:06.777335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a0f19-2735-457a-a895-ee24386a2f15 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:06.777618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a0f19-2735-457a-a895-ee24386a2f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:06.777894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a0f19-2735-457a-a895-ee24386a2f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:06.778539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a0f19-2735-457a-a895-ee24386a2f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:06.780129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a0f19-2735-457a-a895-ee24386a2f15 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:06.792446 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3756/7495] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:21:06.796557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702c95e-310f-40b9-9801-ed205d498afc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:06.808222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702c95e-310f-40b9-9801-ed205d498afc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:06.813485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e347763-d8fa-4194-a614-441800151127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:06.814315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e347763-d8fa-4194-a614-441800151127 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:06.814594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e347763-d8fa-4194-a614-441800151127 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:06.814865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e347763-d8fa-4194-a614-441800151127 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:06.815560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e347763-d8fa-4194-a614-441800151127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:06.818847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e347763-d8fa-4194-a614-441800151127 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:06.831471 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3740/7496] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:06.832649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a0f19-2735-457a-a895-ee24386a2f15 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:06.847813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a0f19-2735-457a-a895-ee24386a2f15 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:06.855811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5d74f-27af-41ed-84bb-cd401095afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:06.856879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5d74f-27af-41ed-84bb-cd401095afd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:06.857359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5d74f-27af-41ed-84bb-cd401095afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:06.857963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5d74f-27af-41ed-84bb-cd401095afd8 admin admin] PATH_INFO: `/v3/projects/08d0fa09561f44de96c8bd76c5d1bc2a/users/1be6ea4cffaa46e7939cbe35dfb52c4f/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:06.882829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5d74f-27af-41ed-84bb-cd401095afd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d0fa09561f44de96c8bd76c5d1bc2a, user_id=1be6ea4cffaa46e7939cbe35dfb52c4f, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:06.886541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5d74f-27af-41ed-84bb-cd401095afd8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:06.909128 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3757/7497] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:06 2022] PUT /identity/v3/projects/08d0fa09561f44de96c8bd76c5d1bc2a/users/1be6ea4cffaa46e7939cbe35dfb52c4f/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:06.920490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47d24d-bb96-4ae1-8a87-a1e822635e6a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:06.920834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47d24d-bb96-4ae1-8a87-a1e822635e6a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:06.921048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47d24d-bb96-4ae1-8a87-a1e822635e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:06.953254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9f47d24d-bb96-4ae1-8a87-a1e822635e6a None None] MFA Rules not processed for user `1be6ea4cffaa46e7939cbe35dfb52c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:06.954483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9f47d24d-bb96-4ae1-8a87-a1e822635e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:06.981532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5d74f-27af-41ed-84bb-cd401095afd8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:06.983425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f5e5d74f-27af-41ed-84bb-cd401095afd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:07.009224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:07.020748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:07.035351 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3741/7498] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:07.041977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47d24d-bb96-4ae1-8a87-a1e822635e6a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:07.062472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5d74f-27af-41ed-84bb-cd401095afd8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:07.066384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d7df1-440f-469e-8567-a009f84aef40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:07.067123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d7df1-440f-469e-8567-a009f84aef40 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:07.067514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d7df1-440f-469e-8567-a009f84aef40 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:07.067894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d7df1-440f-469e-8567-a009f84aef40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:07.069789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-352d7df1-440f-469e-8567-a009f84aef40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:07.120341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47d24d-bb96-4ae1-8a87-a1e822635e6a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:07.125261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac61280-a3e9-4bca-9f29-d9ef2f182a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:07.125887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac61280-a3e9-4bca-9f29-d9ef2f182a57 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:07.126168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac61280-a3e9-4bca-9f29-d9ef2f182a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:07.126441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac61280-a3e9-4bca-9f29-d9ef2f182a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:07.127268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac61280-a3e9-4bca-9f29-d9ef2f182a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:07.129761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac61280-a3e9-4bca-9f29-d9ef2f182a57 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:07.139423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d7df1-440f-469e-8567-a009f84aef40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:07.141012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d7df1-440f-469e-8567-a009f84aef40 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:07.157692 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3758/7499] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:21:07.163295 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3742/7500] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:07 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:21:07.167208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d7df1-440f-469e-8567-a009f84aef40 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:07.178347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d7df1-440f-469e-8567-a009f84aef40 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:07.251922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27885fb1-7e64-48b8-b43d-f80ae951e464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:07.252575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27885fb1-7e64-48b8-b43d-f80ae951e464 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:07.252855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27885fb1-7e64-48b8-b43d-f80ae951e464 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:07.253311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27885fb1-7e64-48b8-b43d-f80ae951e464 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:07.253789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27885fb1-7e64-48b8-b43d-f80ae951e464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:07.255776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27885fb1-7e64-48b8-b43d-f80ae951e464 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:07.279554 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3759/7501] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:07 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:21:07.283907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac61280-a3e9-4bca-9f29-d9ef2f182a57 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:07.295214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac61280-a3e9-4bca-9f29-d9ef2f182a57 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:07.301281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e4494-32ba-454b-b545-7d726c3e656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:07.302162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e4494-32ba-454b-b545-7d726c3e656d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:07.302508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e4494-32ba-454b-b545-7d726c3e656d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:07.302783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e4494-32ba-454b-b545-7d726c3e656d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:07.303431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e4494-32ba-454b-b545-7d726c3e656d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:07.305012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e4494-32ba-454b-b545-7d726c3e656d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:07.318331 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3743/7502] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:07.323974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27885fb1-7e64-48b8-b43d-f80ae951e464 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:07.336627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27885fb1-7e64-48b8-b43d-f80ae951e464 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:07.343627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f125dd3-6368-4d2c-a77d-5131efd84d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:07.344479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f125dd3-6368-4d2c-a77d-5131efd84d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:07.344768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f125dd3-6368-4d2c-a77d-5131efd84d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:07.345053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f125dd3-6368-4d2c-a77d-5131efd84d9a admin admin] PATH_INFO: `/v3/projects/ecf024d7a22345f9baecd1a54c30067e/users/5a985c8a5037443bb654e75de3f65f74/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:07.364708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f125dd3-6368-4d2c-a77d-5131efd84d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf024d7a22345f9baecd1a54c30067e, user_id=5a985c8a5037443bb654e75de3f65f74, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:07.367618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f125dd3-6368-4d2c-a77d-5131efd84d9a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:07.390097 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3760/7503] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:07 2022] PUT /identity/v3/projects/ecf024d7a22345f9baecd1a54c30067e/users/5a985c8a5037443bb654e75de3f65f74/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:07.391861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e4494-32ba-454b-b545-7d726c3e656d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:07.403319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e4494-32ba-454b-b545-7d726c3e656d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:07.536395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3501561-8294-4ff1-b995-df4cc80e5a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:07.537519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3501561-8294-4ff1-b995-df4cc80e5a42 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:07.540644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3501561-8294-4ff1-b995-df4cc80e5a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:07.540984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3501561-8294-4ff1-b995-df4cc80e5a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:07.542223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3501561-8294-4ff1-b995-df4cc80e5a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:07.544043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3501561-8294-4ff1-b995-df4cc80e5a42 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:07.560909 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3744/7504] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:07.562289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f125dd3-6368-4d2c-a77d-5131efd84d9a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:07.576619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f125dd3-6368-4d2c-a77d-5131efd84d9a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:07.588208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941953a-b391-4d7c-a293-00abe1f8b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:07.591317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941953a-b391-4d7c-a293-00abe1f8b557 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:07.591609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941953a-b391-4d7c-a293-00abe1f8b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:07.591951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941953a-b391-4d7c-a293-00abe1f8b557 admin admin] PATH_INFO: `/v3/projects/ecf024d7a22345f9baecd1a54c30067e/users/5a985c8a5037443bb654e75de3f65f74/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:07.594746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941953a-b391-4d7c-a293-00abe1f8b557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf024d7a22345f9baecd1a54c30067e, user_id=5a985c8a5037443bb654e75de3f65f74, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:07.604609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941953a-b391-4d7c-a293-00abe1f8b557 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:07.626970 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3761/7505] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:07 2022] PUT /identity/v3/projects/ecf024d7a22345f9baecd1a54c30067e/users/5a985c8a5037443bb654e75de3f65f74/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:07.639291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d3961-8b97-4d03-9b7a-f076ac785b15 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:07.639575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d3961-8b97-4d03-9b7a-f076ac785b15 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:07.639855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d3961-8b97-4d03-9b7a-f076ac785b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:07.740610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b58d3961-8b97-4d03-9b7a-f076ac785b15 None None] MFA Rules not processed for user `5a985c8a5037443bb654e75de3f65f74`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:07.742176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b58d3961-8b97-4d03-9b7a-f076ac785b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:07.813942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:07.850667 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3745/7506] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:07.862551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941953a-b391-4d7c-a293-00abe1f8b557 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:07.864760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9941953a-b391-4d7c-a293-00abe1f8b557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:07.911934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:07.937948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941953a-b391-4d7c-a293-00abe1f8b557 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:07.951429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4856f2-3a45-4554-930f-b807dda91969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:07.952339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4856f2-3a45-4554-930f-b807dda91969 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:07.952782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4856f2-3a45-4554-930f-b807dda91969 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:07.953578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4856f2-3a45-4554-930f-b807dda91969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:08.021737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4856f2-3a45-4554-930f-b807dda91969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:08.023235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4856f2-3a45-4554-930f-b807dda91969 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:08.033032 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3762/7507] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:08.270869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d3961-8b97-4d03-9b7a-f076ac785b15 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:08.273678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b58d3961-8b97-4d03-9b7a-f076ac785b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:08.375251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d3961-8b97-4d03-9b7a-f076ac785b15 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:08.383548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:08.384347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:08.384726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:08.385212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] PATH_INFO: `/v3/users/dc6e1652d3d74e1794d326e5584a507d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:08.386480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6e1652d3d74e1794d326e5584a507d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:08.388848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:08.458502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6e1652d3d74e1794d326e5584a507d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:08.468643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6e1652d3d74e1794d326e5584a507d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:08.469729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6e1652d3d74e1794d326e5584a507d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:08.482219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6e1652d3d74e1794d326e5584a507d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:08.522415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6e1652d3d74e1794d326e5584a507d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:08.540582 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3746/7508] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:08 2022] DELETE /identity/v3/users/dc6e1652d3d74e1794d326e5584a507d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:08.545805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84ddc9-7f81-4368-b1d8-fbb0ae9a804d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:08.546317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84ddc9-7f81-4368-b1d8-fbb0ae9a804d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:08.546728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84ddc9-7f81-4368-b1d8-fbb0ae9a804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:08.574476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3f84ddc9-7f81-4368-b1d8-fbb0ae9a804d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:08.575921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3f84ddc9-7f81-4368-b1d8-fbb0ae9a804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:08.649239 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3763/7509] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:08.660297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:08.662568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:08.760610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2bee1-ac0f-44b9-88be-49c280fed2b8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:08.779173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3683c-ba59-4cec-a699-d88449547bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:08.779900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3683c-ba59-4cec-a699-d88449547bcf service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:08.780078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3683c-ba59-4cec-a699-d88449547bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:08.780350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3683c-ba59-4cec-a699-d88449547bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:08.790577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3683c-ba59-4cec-a699-d88449547bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:08.792718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3683c-ba59-4cec-a699-d88449547bcf service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:08.803385 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3747/7510] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:09.220204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84ddc9-7f81-4368-b1d8-fbb0ae9a804d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:09.227995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3f84ddc9-7f81-4368-b1d8-fbb0ae9a804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:09.241211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84ddc9-7f81-4368-b1d8-fbb0ae9a804d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:09.249891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:09.250536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:09.250815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:09.251412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] PATH_INFO: `/v3/projects/74b53fd9af1c40b08fb8224f280a3618` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:09.258153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b53fd9af1c40b08fb8224f280a3618)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:09.260293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:09.333101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b53fd9af1c40b08fb8224f280a3618', 'request_id': 'req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:09.342797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b53fd9af1c40b08fb8224f280a3618', 'request_id': 'req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:09.349587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b53fd9af1c40b08fb8224f280a3618', 'request_id': 'req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:09.366854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] The token cache is being invalidate because project 74b53fd9af1c40b08fb8224f280a3618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:09.367145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:09.367792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:09.369359 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3764/7511] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:09 2022] DELETE /identity/v3/projects/74b53fd9af1c40b08fb8224f280a3618 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:21:09.373379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3683c-ba59-4cec-a699-d88449547bcf service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:09.380296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:09.384408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3683c-ba59-4cec-a699-d88449547bcf service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:09.446101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:09.446731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:09.447008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:09.447277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] PATH_INFO: `/v3/users/4de0e6fd29ce4756ad13ea753e13c858` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:09.448424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de0e6fd29ce4756ad13ea753e13c858)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:09.450570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:09.509964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de0e6fd29ce4756ad13ea753e13c858'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:09.516940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de0e6fd29ce4756ad13ea753e13c858'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:09.517669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de0e6fd29ce4756ad13ea753e13c858'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:09.518274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de0e6fd29ce4756ad13ea753e13c858'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:09.531553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de0e6fd29ce4756ad13ea753e13c858'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:09.546532 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3748/7512] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:09 2022] DELETE /identity/v3/users/4de0e6fd29ce4756ad13ea753e13c858 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:09.595398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:09.597098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:09.612579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:09.662097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe1b81-9a4d-48c5-867a-0b897f10ae9e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:09.714252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162b8f2-2f0a-40c2-b1e0-df60e9ea8bc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:09.714868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162b8f2-2f0a-40c2-b1e0-df60e9ea8bc2 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:09.715150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162b8f2-2f0a-40c2-b1e0-df60e9ea8bc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:09.715425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162b8f2-2f0a-40c2-b1e0-df60e9ea8bc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:09.717258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c162b8f2-2f0a-40c2-b1e0-df60e9ea8bc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:09.778375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162b8f2-2f0a-40c2-b1e0-df60e9ea8bc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:09.779814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162b8f2-2f0a-40c2-b1e0-df60e9ea8bc2 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:09.789503 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3765/7513] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:21:09.854902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:09.856228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:09.939507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b43bd8-beee-49f8-95cb-c87dda2eff93 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:09.944181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:09.946039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:09.946332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:09.946606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7 admin admin] PATH_INFO: `/v3/projects/d97f56da2e6f4c108be762c9a4c7920d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:09.947790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97f56da2e6f4c108be762c9a4c7920d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:09.949794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:09.982128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:10.000486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97f56da2e6f4c108be762c9a4c7920d', 'request_id': 'req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:10.008283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97f56da2e6f4c108be762c9a4c7920d', 'request_id': 'req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:10.014378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97f56da2e6f4c108be762c9a4c7920d', 'request_id': 'req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:10.027297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7 admin admin] The token cache is being invalidate because project d97f56da2e6f4c108be762c9a4c7920d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:10.028037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:10.028370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8cf49172-e84e-4cc7-81e6-2ddb6c315cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:10.030147 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3749/7514] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:09 2022] DELETE /identity/v3/projects/d97f56da2e6f4c108be762c9a4c7920d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:10.034763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbea27-6aeb-4250-93d4-dee87a06f8bf None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:10.035121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbea27-6aeb-4250-93d4-dee87a06f8bf None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:10.035404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbea27-6aeb-4250-93d4-dee87a06f8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:10.056175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-67dbea27-6aeb-4250-93d4-dee87a06f8bf None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:10.057563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-67dbea27-6aeb-4250-93d4-dee87a06f8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:10.122102 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3766/7515] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:10.131306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb2458-7af0-439d-becc-7813cbff913b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:10.131591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb2458-7af0-439d-becc-7813cbff913b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:10.131866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb2458-7af0-439d-becc-7813cbff913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:10.154616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9dfb2458-7af0-439d-becc-7813cbff913b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:10.155926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9dfb2458-7af0-439d-becc-7813cbff913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:10.165011 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3750/7516] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:10.170124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbea27-6aeb-4250-93d4-dee87a06f8bf None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:10.189764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbea27-6aeb-4250-93d4-dee87a06f8bf None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:10.199442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f9f7a-e209-4c88-98c8-c49c2bf0bebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:10.200064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f9f7a-e209-4c88-98c8-c49c2bf0bebd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:10.200344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f9f7a-e209-4c88-98c8-c49c2bf0bebd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:10.200617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f9f7a-e209-4c88-98c8-c49c2bf0bebd admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:10.201400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f9f7a-e209-4c88-98c8-c49c2bf0bebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:21:10.201929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f9f7a-e209-4c88-98c8-c49c2bf0bebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:10.203988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f9f7a-e209-4c88-98c8-c49c2bf0bebd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:10.221955 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3767/7517] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:21:10.227629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb2458-7af0-439d-becc-7813cbff913b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:10.240904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb2458-7af0-439d-becc-7813cbff913b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:10.247705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c183f-5fac-4d2d-ba6f-a07486a4f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:10.248441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c183f-5fac-4d2d-ba6f-a07486a4f971 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:10.248932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c183f-5fac-4d2d-ba6f-a07486a4f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:10.249547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c183f-5fac-4d2d-ba6f-a07486a4f971 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:10.250373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c183f-5fac-4d2d-ba6f-a07486a4f971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:10.252553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c183f-5fac-4d2d-ba6f-a07486a4f971 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:10.301398 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3751/7518] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:10 2022] POST /identity/v3/projects => generated 361 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:10.304490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f9f7a-e209-4c88-98c8-c49c2bf0bebd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:10.317613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f9f7a-e209-4c88-98c8-c49c2bf0bebd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:10.331271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:10.421723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bf64c-0c81-4eb8-a7f2-9449332fad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:10.422340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bf64c-0c81-4eb8-a7f2-9449332fad51 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:10.422720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bf64c-0c81-4eb8-a7f2-9449332fad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:10.422882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bf64c-0c81-4eb8-a7f2-9449332fad51 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:10.423686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bf64c-0c81-4eb8-a7f2-9449332fad51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:10.425493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bf64c-0c81-4eb8-a7f2-9449332fad51 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:10.461753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c183f-5fac-4d2d-ba6f-a07486a4f971 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:10.462290 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3768/7519] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:10 2022] POST /identity/v3/users => generated 281 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:10.462398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4d0c183f-5fac-4d2d-ba6f-a07486a4f971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:10.470370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bf64c-0c81-4eb8-a7f2-9449332fad51 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:10.479265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bf64c-0c81-4eb8-a7f2-9449332fad51 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:10.484284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b45dbd-6fd3-44ae-a248-b5fdb2a720b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:10.484752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b45dbd-6fd3-44ae-a248-b5fdb2a720b1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:10.485612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b45dbd-6fd3-44ae-a248-b5fdb2a720b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:10.485612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b45dbd-6fd3-44ae-a248-b5fdb2a720b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:10.486170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b45dbd-6fd3-44ae-a248-b5fdb2a720b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:10.487932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b45dbd-6fd3-44ae-a248-b5fdb2a720b1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:10.517487 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3769/7520] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:10.518672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b45dbd-6fd3-44ae-a248-b5fdb2a720b1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:10.535256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b45dbd-6fd3-44ae-a248-b5fdb2a720b1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:10.541767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287e021-e368-4e37-b598-3b7557106cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:10.542714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287e021-e368-4e37-b598-3b7557106cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:10.543081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287e021-e368-4e37-b598-3b7557106cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:10.543574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287e021-e368-4e37-b598-3b7557106cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:10.544484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c183f-5fac-4d2d-ba6f-a07486a4f971 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:10.544637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287e021-e368-4e37-b598-3b7557106cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:10.546525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287e021-e368-4e37-b598-3b7557106cc3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:10.549856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb3dfc-6b04-4046-bdee-c6f7f1733f59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:10.550486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb3dfc-6b04-4046-bdee-c6f7f1733f59 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:10.550770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb3dfc-6b04-4046-bdee-c6f7f1733f59 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:10.551049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb3dfc-6b04-4046-bdee-c6f7f1733f59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:10.553296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c7cb3dfc-6b04-4046-bdee-c6f7f1733f59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:10.560191 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3770/7521] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:10.563794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287e021-e368-4e37-b598-3b7557106cc3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:10.574936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287e021-e368-4e37-b598-3b7557106cc3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:10.580013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4967f-9528-4440-8bdc-de1f4f032a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:10.580694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4967f-9528-4440-8bdc-de1f4f032a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:10.581087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4967f-9528-4440-8bdc-de1f4f032a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:10.581519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4967f-9528-4440-8bdc-de1f4f032a44 admin admin] PATH_INFO: `/v3/projects/1f82687dd0e94058a5ed5692c972d73e/users/8b48d8d91fcc437592d05d4198f3c0f2/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:10.597918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4967f-9528-4440-8bdc-de1f4f032a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f82687dd0e94058a5ed5692c972d73e, user_id=8b48d8d91fcc437592d05d4198f3c0f2, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:10.600710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4967f-9528-4440-8bdc-de1f4f032a44 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:10.617528 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3771/7522] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:10 2022] PUT /identity/v3/projects/1f82687dd0e94058a5ed5692c972d73e/users/8b48d8d91fcc437592d05d4198f3c0f2/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:21:10.628550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7bc51-e5f9-42f1-956f-48c70bd2402a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:10.628732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7bc51-e5f9-42f1-956f-48c70bd2402a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:10.628923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7bc51-e5f9-42f1-956f-48c70bd2402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:10.631144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb3dfc-6b04-4046-bdee-c6f7f1733f59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:10.632906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb3dfc-6b04-4046-bdee-c6f7f1733f59 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:10.644279 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3752/7523] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:10.660557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ecd7bc51-e5f9-42f1-956f-48c70bd2402a None None] MFA Rules not processed for user `8b48d8d91fcc437592d05d4198f3c0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:10.661958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ecd7bc51-e5f9-42f1-956f-48c70bd2402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:10.746697 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3772/7524] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:21:10.769531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb3dfc-6b04-4046-bdee-c6f7f1733f59 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:10.769531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c7cb3dfc-6b04-4046-bdee-c6f7f1733f59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:10.808455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:10.842522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb3dfc-6b04-4046-bdee-c6f7f1733f59 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:10.917424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29fea0-a4f8-4ddd-8729-9b02011aa510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:10.920225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29fea0-a4f8-4ddd-8729-9b02011aa510 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:10.920225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29fea0-a4f8-4ddd-8729-9b02011aa510 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:10.920225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29fea0-a4f8-4ddd-8729-9b02011aa510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:10.940826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29fea0-a4f8-4ddd-8729-9b02011aa510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:10.942394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29fea0-a4f8-4ddd-8729-9b02011aa510 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:10.959686 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3753/7525] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:14.855777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7bc51-e5f9-42f1-956f-48c70bd2402a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:14.857210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ecd7bc51-e5f9-42f1-956f-48c70bd2402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:14.919693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:14.948379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7bc51-e5f9-42f1-956f-48c70bd2402a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:14.952993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:14.953673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:14.954128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:14.954493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] PATH_INFO: `/v3/users/ad60755620514bea97406f99d69339bc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:14.956291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad60755620514bea97406f99d69339bc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:14.958213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:15.021439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad60755620514bea97406f99d69339bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:15.029773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad60755620514bea97406f99d69339bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:15.030515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad60755620514bea97406f99d69339bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:15.031178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad60755620514bea97406f99d69339bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:15.047350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad60755620514bea97406f99d69339bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:15.069261 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3773/7526] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:14 2022] DELETE /identity/v3/users/ad60755620514bea97406f99d69339bc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:15.073606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef917034-f9d8-4088-96bf-30503a01e40d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:15.074101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef917034-f9d8-4088-96bf-30503a01e40d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:15.074406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef917034-f9d8-4088-96bf-30503a01e40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:15.103173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ef917034-f9d8-4088-96bf-30503a01e40d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:15.105567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ef917034-f9d8-4088-96bf-30503a01e40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:15.209148 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3754/7527] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:21:15.219871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:15.221390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:15.293959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef917034-f9d8-4088-96bf-30503a01e40d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:15.295670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ef917034-f9d8-4088-96bf-30503a01e40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:15.317687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11a64-b528-4a51-8218-94ddf1646fa5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:15.325750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd297a-4cca-4058-a06c-874e8568e8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:15.326384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd297a-4cca-4058-a06c-874e8568e8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:15.326665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd297a-4cca-4058-a06c-874e8568e8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:15.327105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd297a-4cca-4058-a06c-874e8568e8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:15.348415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd297a-4cca-4058-a06c-874e8568e8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:15.350375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd297a-4cca-4058-a06c-874e8568e8e9 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:15.373344 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3774/7528] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:15.501100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef917034-f9d8-4088-96bf-30503a01e40d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:15.507199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fa620-f336-462e-9222-f7980c461750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:15.507774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fa620-f336-462e-9222-f7980c461750 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:15.508193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fa620-f336-462e-9222-f7980c461750 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:15.508550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fa620-f336-462e-9222-f7980c461750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:15.511458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fb4fa620-f336-462e-9222-f7980c461750 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:15.593640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:15.621171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fa620-f336-462e-9222-f7980c461750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:15.623430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fa620-f336-462e-9222-f7980c461750 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:15.649476 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3755/7529] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:16.467031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd297a-4cca-4058-a06c-874e8568e8e9 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:16.468506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ecdd297a-4cca-4058-a06c-874e8568e8e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:16.489976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd297a-4cca-4058-a06c-874e8568e8e9 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:16.496154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:16.496959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:16.497428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:16.498501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] PATH_INFO: `/v3/projects/c9c598da07d04b78bb32164d4e25d0d8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:16.499337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c598da07d04b78bb32164d4e25d0d8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:16.501699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:16.611809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c598da07d04b78bb32164d4e25d0d8', 'request_id': 'req-2aa91ca5-104f-4b61-a7ff-62663bf8579b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:16.625483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c598da07d04b78bb32164d4e25d0d8', 'request_id': 'req-2aa91ca5-104f-4b61-a7ff-62663bf8579b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:16.631835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:16.641706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c598da07d04b78bb32164d4e25d0d8', 'request_id': 'req-2aa91ca5-104f-4b61-a7ff-62663bf8579b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:16.669686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] The token cache is being invalidate because project c9c598da07d04b78bb32164d4e25d0d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:16.670153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:16.672265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:16.675165 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3775/7530] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:16 2022] DELETE /identity/v3/projects/c9c598da07d04b78bb32164d4e25d0d8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:16.679370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fa620-f336-462e-9222-f7980c461750 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:16.701695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fa620-f336-462e-9222-f7980c461750 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:16.854630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:16.855429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:16.855714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:16.856615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] PATH_INFO: `/v3/users/1be6ea4cffaa46e7939cbe35dfb52c4f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:16.857886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be6ea4cffaa46e7939cbe35dfb52c4f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:16.861452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:16.959810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be6ea4cffaa46e7939cbe35dfb52c4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:16.971264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be6ea4cffaa46e7939cbe35dfb52c4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:16.976368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be6ea4cffaa46e7939cbe35dfb52c4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:16.977351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be6ea4cffaa46e7939cbe35dfb52c4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:17.028010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be6ea4cffaa46e7939cbe35dfb52c4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:17.055695 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3756/7531] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:16 2022] DELETE /identity/v3/users/1be6ea4cffaa46e7939cbe35dfb52c4f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:17.692789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:17.692789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:17.709921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa91ca5-104f-4b61-a7ff-62663bf8579b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:17.808427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:17.809072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:17.809393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:17.809669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] PATH_INFO: `/v3/projects/08d0fa09561f44de96c8bd76c5d1bc2a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:17.810814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d0fa09561f44de96c8bd76c5d1bc2a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:17.812720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:17.878822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d0fa09561f44de96c8bd76c5d1bc2a', 'request_id': 'req-bcb7c453-eab8-4dcd-80d1-22345f7e7827'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:17.887859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d0fa09561f44de96c8bd76c5d1bc2a', 'request_id': 'req-bcb7c453-eab8-4dcd-80d1-22345f7e7827'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:17.895408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d0fa09561f44de96c8bd76c5d1bc2a', 'request_id': 'req-bcb7c453-eab8-4dcd-80d1-22345f7e7827'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:17.912319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] The token cache is being invalidate because project 08d0fa09561f44de96c8bd76c5d1bc2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:17.913024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:17.914271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:17.916931 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3776/7532] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:17 2022] DELETE /identity/v3/projects/08d0fa09561f44de96c8bd76c5d1bc2a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:17.921552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:17.924094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:17.962024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adac05-9e91-4d38-935d-1f70a5d0bf73 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:18.074054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59265b6-9887-44a4-bb66-a34bf5031a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:18.074283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59265b6-9887-44a4-bb66-a34bf5031a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:18.074501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59265b6-9887-44a4-bb66-a34bf5031a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:18.074772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59265b6-9887-44a4-bb66-a34bf5031a07 admin admin] PATH_INFO: `/v3/users/5a985c8a5037443bb654e75de3f65f74` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:18.078215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59265b6-9887-44a4-bb66-a34bf5031a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a985c8a5037443bb654e75de3f65f74)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:18.081780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59265b6-9887-44a4-bb66-a34bf5031a07 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:18.085379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:18.159016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b59265b6-9887-44a4-bb66-a34bf5031a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a985c8a5037443bb654e75de3f65f74'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:18.172328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b59265b6-9887-44a4-bb66-a34bf5031a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a985c8a5037443bb654e75de3f65f74'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:18.173529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b59265b6-9887-44a4-bb66-a34bf5031a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a985c8a5037443bb654e75de3f65f74'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:18.174324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b59265b6-9887-44a4-bb66-a34bf5031a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a985c8a5037443bb654e75de3f65f74'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:18.203883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b59265b6-9887-44a4-bb66-a34bf5031a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a985c8a5037443bb654e75de3f65f74'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:18.237530 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3757/7533] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:17 2022] DELETE /identity/v3/users/5a985c8a5037443bb654e75de3f65f74 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:18.716158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:18.718027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:18.746407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7c453-eab8-4dcd-80d1-22345f7e7827 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:18.880166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:18.880987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:18.881318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:18.881599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec admin admin] PATH_INFO: `/v3/projects/ecf024d7a22345f9baecd1a54c30067e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:18.886252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf024d7a22345f9baecd1a54c30067e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:18.888250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:18.937380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:19.004469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf024d7a22345f9baecd1a54c30067e', 'request_id': 'req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:19.024398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf024d7a22345f9baecd1a54c30067e', 'request_id': 'req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:19.033068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf024d7a22345f9baecd1a54c30067e', 'request_id': 'req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:19.071342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec admin admin] The token cache is being invalidate because project ecf024d7a22345f9baecd1a54c30067e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:19.071887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:19.073364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-640d8c55-98f7-4e3e-b0c4-30b928e7d7ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:19.076050 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3777/7534] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:18 2022] DELETE /identity/v3/projects/ecf024d7a22345f9baecd1a54c30067e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:19.080989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f19f5-e6e0-432d-91fb-e16059576d66 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:19.082208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f19f5-e6e0-432d-91fb-e16059576d66 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:19.082797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f19f5-e6e0-432d-91fb-e16059576d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:19.130475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-710f19f5-e6e0-432d-91fb-e16059576d66 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:19.137419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-710f19f5-e6e0-432d-91fb-e16059576d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:19.219497 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3758/7535] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:19.227533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616ddf-7b34-45a6-af19-57d2c17ee7f4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:19.227822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616ddf-7b34-45a6-af19-57d2c17ee7f4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:19.228102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616ddf-7b34-45a6-af19-57d2c17ee7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:19.248959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-96616ddf-7b34-45a6-af19-57d2c17ee7f4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:19.250195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-96616ddf-7b34-45a6-af19-57d2c17ee7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:19.258149 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3778/7536] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:19.263387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f19f5-e6e0-432d-91fb-e16059576d66 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:19.281741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f19f5-e6e0-432d-91fb-e16059576d66 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:19.287600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0144090-9185-4945-a7ad-36cec9b8e243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:19.288404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0144090-9185-4945-a7ad-36cec9b8e243 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:19.288840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0144090-9185-4945-a7ad-36cec9b8e243 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:19.289347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0144090-9185-4945-a7ad-36cec9b8e243 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:19.290145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0144090-9185-4945-a7ad-36cec9b8e243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:21:19.290588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0144090-9185-4945-a7ad-36cec9b8e243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:19.292389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0144090-9185-4945-a7ad-36cec9b8e243 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:19.309062 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3759/7537] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:21:19.310274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616ddf-7b34-45a6-af19-57d2c17ee7f4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:19.319781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616ddf-7b34-45a6-af19-57d2c17ee7f4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:19.325378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a64f1-2113-4cc8-b147-d59e7e45784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:19.325927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a64f1-2113-4cc8-b147-d59e7e45784e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:19.326205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a64f1-2113-4cc8-b147-d59e7e45784e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:19.326501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a64f1-2113-4cc8-b147-d59e7e45784e admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:19.327125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a64f1-2113-4cc8-b147-d59e7e45784e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:19.329041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a64f1-2113-4cc8-b147-d59e7e45784e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:19.374864 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3779/7538] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:19 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:19.379154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0144090-9185-4945-a7ad-36cec9b8e243 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:19.393852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0144090-9185-4945-a7ad-36cec9b8e243 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:19.510150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f285a93-7b58-420a-9a94-02b51d65ce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:19.510898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f285a93-7b58-420a-9a94-02b51d65ce3d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:19.511180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f285a93-7b58-420a-9a94-02b51d65ce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:19.511610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f285a93-7b58-420a-9a94-02b51d65ce3d admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:19.512253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f285a93-7b58-420a-9a94-02b51d65ce3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:19.514741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f285a93-7b58-420a-9a94-02b51d65ce3d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:19.527825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:19.547278 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3760/7539] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:19 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:19.549379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a64f1-2113-4cc8-b147-d59e7e45784e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:19.567123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a64f1-2113-4cc8-b147-d59e7e45784e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:19.573932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818f5bc-9906-4337-a196-50d7675c3585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:19.574527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818f5bc-9906-4337-a196-50d7675c3585 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:19.574815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818f5bc-9906-4337-a196-50d7675c3585 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:19.575203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818f5bc-9906-4337-a196-50d7675c3585 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:19.576120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818f5bc-9906-4337-a196-50d7675c3585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:19.578254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818f5bc-9906-4337-a196-50d7675c3585 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:19.600478 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3780/7540] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:19.605731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f285a93-7b58-420a-9a94-02b51d65ce3d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:19.617739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f285a93-7b58-420a-9a94-02b51d65ce3d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:19.623554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea767e-093e-4172-b54a-a2d4ed84404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:19.624161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea767e-093e-4172-b54a-a2d4ed84404f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:19.624597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea767e-093e-4172-b54a-a2d4ed84404f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:19.624944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea767e-093e-4172-b54a-a2d4ed84404f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:19.625697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea767e-093e-4172-b54a-a2d4ed84404f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:19.627919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea767e-093e-4172-b54a-a2d4ed84404f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:19.643385 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3761/7541] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:19.645540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818f5bc-9906-4337-a196-50d7675c3585 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:19.660355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818f5bc-9906-4337-a196-50d7675c3585 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:19.671628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ef32c-3d9a-4c9b-a886-ed63c970b54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:19.673269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ef32c-3d9a-4c9b-a886-ed63c970b54b admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:19.673863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ef32c-3d9a-4c9b-a886-ed63c970b54b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:19.674158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ef32c-3d9a-4c9b-a886-ed63c970b54b admin admin] PATH_INFO: `/v3/projects/b2000b1ff979408fb623e3160ada9e63/users/985e9bc4d4674a2b8b8e98807eca3db6/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:19.700325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ef32c-3d9a-4c9b-a886-ed63c970b54b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2000b1ff979408fb623e3160ada9e63, user_id=985e9bc4d4674a2b8b8e98807eca3db6, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:19.704827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ef32c-3d9a-4c9b-a886-ed63c970b54b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:19.725879 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3781/7542] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:19 2022] PUT /identity/v3/projects/b2000b1ff979408fb623e3160ada9e63/users/985e9bc4d4674a2b8b8e98807eca3db6/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:19.736696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d538cb7-e765-415e-b095-e12be145ec38 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:19.737577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d538cb7-e765-415e-b095-e12be145ec38 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:19.738035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d538cb7-e765-415e-b095-e12be145ec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:19.789055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8d538cb7-e765-415e-b095-e12be145ec38 None None] MFA Rules not processed for user `985e9bc4d4674a2b8b8e98807eca3db6`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:19.792315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8d538cb7-e765-415e-b095-e12be145ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:19.932571 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3762/7543] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:19.932730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ef32c-3d9a-4c9b-a886-ed63c970b54b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:19.935765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-773ef32c-3d9a-4c9b-a886-ed63c970b54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:20.036596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ef32c-3d9a-4c9b-a886-ed63c970b54b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:20.042526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22be34-434f-44a0-a2bf-10355503136b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:20.043272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22be34-434f-44a0-a2bf-10355503136b service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:20.043592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22be34-434f-44a0-a2bf-10355503136b service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:20.043965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22be34-434f-44a0-a2bf-10355503136b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:20.060808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22be34-434f-44a0-a2bf-10355503136b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:20.062878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22be34-434f-44a0-a2bf-10355503136b service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:20.074252 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3782/7544] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:21:29.891550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=39 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:30.070681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=7,keystone:SELECT=68,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:32.090140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d538cb7-e765-415e-b095-e12be145ec38 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:32.194240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d538cb7-e765-415e-b095-e12be145ec38 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:32.200620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:32.202266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:32.202871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:32.203261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] PATH_INFO: `/v3/users/985e9bc4d4674a2b8b8e98807eca3db6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:32.204795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=985e9bc4d4674a2b8b8e98807eca3db6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:32.207439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:32.279720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985e9bc4d4674a2b8b8e98807eca3db6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:32.295821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985e9bc4d4674a2b8b8e98807eca3db6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:32.296610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985e9bc4d4674a2b8b8e98807eca3db6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:32.297257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985e9bc4d4674a2b8b8e98807eca3db6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:32.311681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985e9bc4d4674a2b8b8e98807eca3db6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:32.327725 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3763/7545] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:32 2022] DELETE /identity/v3/users/985e9bc4d4674a2b8b8e98807eca3db6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:32.333145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa22e93-1c5c-4684-b612-010d123bc716 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:32.333822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa22e93-1c5c-4684-b612-010d123bc716 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:32.333822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa22e93-1c5c-4684-b612-010d123bc716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:32.356778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-daa22e93-1c5c-4684-b612-010d123bc716 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:32.358475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-daa22e93-1c5c-4684-b612-010d123bc716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:32.432815 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3783/7546] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:32.466589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:32.468088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:32.559703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1077f6-01b2-4efd-ae46-9aadb47c1b8c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:32.565609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc351c9-4679-45cc-afeb-216e1254a313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:32.566486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc351c9-4679-45cc-afeb-216e1254a313 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:32.567115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc351c9-4679-45cc-afeb-216e1254a313 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:32.567531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc351c9-4679-45cc-afeb-216e1254a313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:32.579418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc351c9-4679-45cc-afeb-216e1254a313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:32.580885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc351c9-4679-45cc-afeb-216e1254a313 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:32.594118 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3764/7547] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:33.579753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa22e93-1c5c-4684-b612-010d123bc716 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:33.581730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-daa22e93-1c5c-4684-b612-010d123bc716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:33.602816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa22e93-1c5c-4684-b612-010d123bc716 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:33.612679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e398c-d937-40cd-be93-cb62e3e74df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:33.613477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e398c-d937-40cd-be93-cb62e3e74df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:33.614483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e398c-d937-40cd-be93-cb62e3e74df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:33.614840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e398c-d937-40cd-be93-cb62e3e74df3 admin admin] PATH_INFO: `/v3/projects/b2000b1ff979408fb623e3160ada9e63` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:33.616248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e398c-d937-40cd-be93-cb62e3e74df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2000b1ff979408fb623e3160ada9e63)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:33.618568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e398c-d937-40cd-be93-cb62e3e74df3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:33.701438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a0e398c-d937-40cd-be93-cb62e3e74df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2000b1ff979408fb623e3160ada9e63', 'request_id': 'req-1a0e398c-d937-40cd-be93-cb62e3e74df3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:33.713115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a0e398c-d937-40cd-be93-cb62e3e74df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2000b1ff979408fb623e3160ada9e63', 'request_id': 'req-1a0e398c-d937-40cd-be93-cb62e3e74df3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:33.720856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a0e398c-d937-40cd-be93-cb62e3e74df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2000b1ff979408fb623e3160ada9e63', 'request_id': 'req-1a0e398c-d937-40cd-be93-cb62e3e74df3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:33.736702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a0e398c-d937-40cd-be93-cb62e3e74df3 admin admin] The token cache is being invalidate because project b2000b1ff979408fb623e3160ada9e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:33.737328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a0e398c-d937-40cd-be93-cb62e3e74df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:33.738200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a0e398c-d937-40cd-be93-cb62e3e74df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:33.739914 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3784/7548] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:33 2022] DELETE /identity/v3/projects/b2000b1ff979408fb623e3160ada9e63 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:33.747244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8fab8-fc63-49d4-a873-ddafc26ab0de None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:33.747812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8fab8-fc63-49d4-a873-ddafc26ab0de None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:33.747812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8fab8-fc63-49d4-a873-ddafc26ab0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:33.779562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-53c8fab8-fc63-49d4-a873-ddafc26ab0de None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:33.782892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-53c8fab8-fc63-49d4-a873-ddafc26ab0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:33.809027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:33.905359 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3765/7549] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:33.914768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f0fcf-19c5-49bb-950a-3cf3433bef48 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:33.915073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f0fcf-19c5-49bb-950a-3cf3433bef48 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:33.916613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f0fcf-19c5-49bb-950a-3cf3433bef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:33.945878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-504f0fcf-19c5-49bb-950a-3cf3433bef48 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:33.947339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-504f0fcf-19c5-49bb-950a-3cf3433bef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:33.959738 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3785/7550] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:33.964676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8fab8-fc63-49d4-a873-ddafc26ab0de None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:33.980770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8fab8-fc63-49d4-a873-ddafc26ab0de None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:33.986187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aaf71-776a-4de4-80f4-f6f29844302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:33.986772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aaf71-776a-4de4-80f4-f6f29844302d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:33.987055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aaf71-776a-4de4-80f4-f6f29844302d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:33.987469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aaf71-776a-4de4-80f4-f6f29844302d admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:33.988139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aaf71-776a-4de4-80f4-f6f29844302d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:21:33.988445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aaf71-776a-4de4-80f4-f6f29844302d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:33.990140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aaf71-776a-4de4-80f4-f6f29844302d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:34.009227 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3766/7551] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:21:34.014639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f0fcf-19c5-49bb-950a-3cf3433bef48 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:34.026689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f0fcf-19c5-49bb-950a-3cf3433bef48 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:34.037064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af09df-ac9b-4467-934b-787b34be53d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:34.037722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af09df-ac9b-4467-934b-787b34be53d0 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:34.038003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af09df-ac9b-4467-934b-787b34be53d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:34.038275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af09df-ac9b-4467-934b-787b34be53d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:34.038920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af09df-ac9b-4467-934b-787b34be53d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:34.041561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af09df-ac9b-4467-934b-787b34be53d0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:34.085778 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3786/7552] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:34 2022] POST /identity/v3/projects => generated 363 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:21:34.090936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aaf71-776a-4de4-80f4-f6f29844302d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:34.102831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aaf71-776a-4de4-80f4-f6f29844302d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:34.197700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6200ec7-8168-47bb-9bb4-61b29fbd59ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:34.198172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6200ec7-8168-47bb-9bb4-61b29fbd59ed admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:34.198511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6200ec7-8168-47bb-9bb4-61b29fbd59ed admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:34.198790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6200ec7-8168-47bb-9bb4-61b29fbd59ed admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:34.199674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6200ec7-8168-47bb-9bb4-61b29fbd59ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:34.201405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6200ec7-8168-47bb-9bb4-61b29fbd59ed admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:34.226944 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3767/7553] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:34 2022] POST /identity/v3/users => generated 282 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:34.231768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af09df-ac9b-4467-934b-787b34be53d0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:34.244134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af09df-ac9b-4467-934b-787b34be53d0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:34.249463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc86f8b-94ad-4854-9427-4e81d363eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:34.250082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc86f8b-94ad-4854-9427-4e81d363eeda admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:34.250361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc86f8b-94ad-4854-9427-4e81d363eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:34.250651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc86f8b-94ad-4854-9427-4e81d363eeda admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:34.251286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc86f8b-94ad-4854-9427-4e81d363eeda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:34.252888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc86f8b-94ad-4854-9427-4e81d363eeda admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:34.263889 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3787/7554] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:34.268123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6200ec7-8168-47bb-9bb4-61b29fbd59ed admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:34.280256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6200ec7-8168-47bb-9bb4-61b29fbd59ed admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:34.286016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592a55b-5c81-456d-a8d3-55d3a04bbaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:34.286808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592a55b-5c81-456d-a8d3-55d3a04bbaad admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:34.287191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592a55b-5c81-456d-a8d3-55d3a04bbaad admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:34.287572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592a55b-5c81-456d-a8d3-55d3a04bbaad admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:34.288328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592a55b-5c81-456d-a8d3-55d3a04bbaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:34.290415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592a55b-5c81-456d-a8d3-55d3a04bbaad admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:34.312286 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3768/7555] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:34.316384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc86f8b-94ad-4854-9427-4e81d363eeda admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:34.338595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc86f8b-94ad-4854-9427-4e81d363eeda admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:34.346826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dd690-2a6b-4ade-a15a-1ef3ddae4ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:34.347986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dd690-2a6b-4ade-a15a-1ef3ddae4ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:34.348275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dd690-2a6b-4ade-a15a-1ef3ddae4ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:34.348555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dd690-2a6b-4ade-a15a-1ef3ddae4ab3 admin admin] PATH_INFO: `/v3/projects/4772bcc4164e446598dade98933a9380/users/f4e770e68804425fa1955447b1b7bd71/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:34.372966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dd690-2a6b-4ade-a15a-1ef3ddae4ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4772bcc4164e446598dade98933a9380, user_id=f4e770e68804425fa1955447b1b7bd71, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:34.376253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dd690-2a6b-4ade-a15a-1ef3ddae4ab3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:34.392103 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3788/7556] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:34 2022] PUT /identity/v3/projects/4772bcc4164e446598dade98933a9380/users/f4e770e68804425fa1955447b1b7bd71/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:21:34.404149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9657d5-e482-44de-b0df-70fe989eb2ab None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:34.404430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9657d5-e482-44de-b0df-70fe989eb2ab None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:34.404702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9657d5-e482-44de-b0df-70fe989eb2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:34.446385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9e9657d5-e482-44de-b0df-70fe989eb2ab None None] MFA Rules not processed for user `f4e770e68804425fa1955447b1b7bd71`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:34.449072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9e9657d5-e482-44de-b0df-70fe989eb2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:34.567387 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3769/7557] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:34.581908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dd690-2a6b-4ade-a15a-1ef3ddae4ab3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:34.584434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-321dd690-2a6b-4ade-a15a-1ef3ddae4ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:34.638617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:34.711280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dd690-2a6b-4ade-a15a-1ef3ddae4ab3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:34.716835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50113cc3-8c02-4d02-805c-b87c3a60fd76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:34.718399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50113cc3-8c02-4d02-805c-b87c3a60fd76 service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:34.718824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50113cc3-8c02-4d02-805c-b87c3a60fd76 service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:34.719780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50113cc3-8c02-4d02-805c-b87c3a60fd76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:34.736794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50113cc3-8c02-4d02-805c-b87c3a60fd76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:34.738980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50113cc3-8c02-4d02-805c-b87c3a60fd76 service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:34.756201 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3789/7558] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:38.020704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9657d5-e482-44de-b0df-70fe989eb2ab None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:38.020704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9e9657d5-e482-44de-b0df-70fe989eb2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:38.094325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:38.282928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9657d5-e482-44de-b0df-70fe989eb2ab None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:38.301209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195e0e7-fa87-41af-9eb3-8906e81358b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:38.302164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195e0e7-fa87-41af-9eb3-8906e81358b2 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:38.302685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195e0e7-fa87-41af-9eb3-8906e81358b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:38.303445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195e0e7-fa87-41af-9eb3-8906e81358b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:38.329341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e195e0e7-fa87-41af-9eb3-8906e81358b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:38.564034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195e0e7-fa87-41af-9eb3-8906e81358b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:38.567241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195e0e7-fa87-41af-9eb3-8906e81358b2 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:38.609998 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3770/7559] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:39.722246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50113cc3-8c02-4d02-805c-b87c3a60fd76 service glance] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:39.725131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-50113cc3-8c02-4d02-805c-b87c3a60fd76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:39.754505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50113cc3-8c02-4d02-805c-b87c3a60fd76 service glance] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:39.761878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96789466-a2a2-47c8-9dd8-8c8a7e75f02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:39.762947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96789466-a2a2-47c8-9dd8-8c8a7e75f02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:39.763548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96789466-a2a2-47c8-9dd8-8c8a7e75f02a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:39.765663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96789466-a2a2-47c8-9dd8-8c8a7e75f02a admin admin] PATH_INFO: `/v3/users/3a292ffe2c5c41ef8d281fa525792b16` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:39.767872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96789466-a2a2-47c8-9dd8-8c8a7e75f02a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a292ffe2c5c41ef8d281fa525792b16)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:39.771299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96789466-a2a2-47c8-9dd8-8c8a7e75f02a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:39.866409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96789466-a2a2-47c8-9dd8-8c8a7e75f02a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a292ffe2c5c41ef8d281fa525792b16'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:39.876644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96789466-a2a2-47c8-9dd8-8c8a7e75f02a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a292ffe2c5c41ef8d281fa525792b16'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:39.877714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96789466-a2a2-47c8-9dd8-8c8a7e75f02a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a292ffe2c5c41ef8d281fa525792b16'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:39.878965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96789466-a2a2-47c8-9dd8-8c8a7e75f02a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a292ffe2c5c41ef8d281fa525792b16'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:39.904999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-96789466-a2a2-47c8-9dd8-8c8a7e75f02a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a292ffe2c5c41ef8d281fa525792b16'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:39.931602 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3790/7560] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:39 2022] DELETE /identity/v3/users/3a292ffe2c5c41ef8d281fa525792b16 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:40.140924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195e0e7-fa87-41af-9eb3-8906e81358b2 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:40.168479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195e0e7-fa87-41af-9eb3-8906e81358b2 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:40.235103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:40.235675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:40.235957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:40.236230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9 admin admin] PATH_INFO: `/v3/projects/6fdea37d91ed431aa0dc780148174e5b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:40.237401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fdea37d91ed431aa0dc780148174e5b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:40.239360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:40.290590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fdea37d91ed431aa0dc780148174e5b', 'request_id': 'req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:40.298845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fdea37d91ed431aa0dc780148174e5b', 'request_id': 'req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:40.305598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fdea37d91ed431aa0dc780148174e5b', 'request_id': 'req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:40.313863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:40.320033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9 admin admin] The token cache is being invalidate because project 6fdea37d91ed431aa0dc780148174e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:40.320552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:40.321681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-87ed8e5a-89a5-4f80-ae60-f25e78c240d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:40.324573 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3771/7561] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:40 2022] DELETE /identity/v3/projects/6fdea37d91ed431aa0dc780148174e5b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:40.329272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60286a4-2043-4f4e-9694-7fc936d021d1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:40.329582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60286a4-2043-4f4e-9694-7fc936d021d1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:40.329881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60286a4-2043-4f4e-9694-7fc936d021d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:40.366039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b60286a4-2043-4f4e-9694-7fc936d021d1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:40.367718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b60286a4-2043-4f4e-9694-7fc936d021d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:40.443460 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3791/7562] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:21:40.451432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6dab6-0d8f-449f-b801-5dca139aba36 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:40.451916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6dab6-0d8f-449f-b801-5dca139aba36 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:40.452378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6dab6-0d8f-449f-b801-5dca139aba36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:40.472199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e4e6dab6-0d8f-449f-b801-5dca139aba36 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:40.474082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e4e6dab6-0d8f-449f-b801-5dca139aba36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:40.484857 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3772/7563] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:21:40.488930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60286a4-2043-4f4e-9694-7fc936d021d1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:40.501608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60286a4-2043-4f4e-9694-7fc936d021d1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:40.507397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190d946-257b-490d-babe-867932e4ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:40.508390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190d946-257b-490d-babe-867932e4ca16 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:40.508663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190d946-257b-490d-babe-867932e4ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:40.511388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190d946-257b-490d-babe-867932e4ca16 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:40.512268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190d946-257b-490d-babe-867932e4ca16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:21:40.512616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190d946-257b-490d-babe-867932e4ca16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:40.515010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190d946-257b-490d-babe-867932e4ca16 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:40.528734 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3792/7564] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:21:40.533280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6dab6-0d8f-449f-b801-5dca139aba36 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:40.547075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6dab6-0d8f-449f-b801-5dca139aba36 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:40.556325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cc482-3841-404f-8d65-c7c6f6e423c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:40.557885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cc482-3841-404f-8d65-c7c6f6e423c4 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:40.558337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cc482-3841-404f-8d65-c7c6f6e423c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:40.559313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cc482-3841-404f-8d65-c7c6f6e423c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:40.561505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cc482-3841-404f-8d65-c7c6f6e423c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:40.564319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cc482-3841-404f-8d65-c7c6f6e423c4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:40.612840 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3773/7565] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:40 2022] POST /identity/v3/projects => generated 389 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:40.614607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190d946-257b-490d-babe-867932e4ca16 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:40.641465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190d946-257b-490d-babe-867932e4ca16 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:40.692771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:40.748413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b47a81-eeaf-4c38-a8d5-3677ca9b378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:40.750639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b47a81-eeaf-4c38-a8d5-3677ca9b378d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:40.750925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b47a81-eeaf-4c38-a8d5-3677ca9b378d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:40.751205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b47a81-eeaf-4c38-a8d5-3677ca9b378d admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:40.751843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b47a81-eeaf-4c38-a8d5-3677ca9b378d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:40.755325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b47a81-eeaf-4c38-a8d5-3677ca9b378d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:40.782594 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3793/7566] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:40 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:40.787567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cc482-3841-404f-8d65-c7c6f6e423c4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:40.799966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cc482-3841-404f-8d65-c7c6f6e423c4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:40.809066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f1c8c-f902-4695-b6db-5b0a6aaa3b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:40.809967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1c8c-f902-4695-b6db-5b0a6aaa3b91 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:40.810525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1c8c-f902-4695-b6db-5b0a6aaa3b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:40.810916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1c8c-f902-4695-b6db-5b0a6aaa3b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:40.812525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f1c8c-f902-4695-b6db-5b0a6aaa3b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:40.814887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f1c8c-f902-4695-b6db-5b0a6aaa3b91 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:40.832415 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3774/7567] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:21:40.836523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b47a81-eeaf-4c38-a8d5-3677ca9b378d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:40.848263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b47a81-eeaf-4c38-a8d5-3677ca9b378d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:40.854856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33419d-fe60-4b89-9f56-6de0d0fae188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:40.855886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33419d-fe60-4b89-9f56-6de0d0fae188 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:40.856236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33419d-fe60-4b89-9f56-6de0d0fae188 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:40.856578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33419d-fe60-4b89-9f56-6de0d0fae188 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:40.857583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33419d-fe60-4b89-9f56-6de0d0fae188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:40.859474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33419d-fe60-4b89-9f56-6de0d0fae188 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:40.873045 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3794/7568] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:40.877486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f1c8c-f902-4695-b6db-5b0a6aaa3b91 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:40.890976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f1c8c-f902-4695-b6db-5b0a6aaa3b91 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:40.896711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f012fe7-f23c-4511-b6af-72384a84eded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:40.897453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f012fe7-f23c-4511-b6af-72384a84eded admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:40.897738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f012fe7-f23c-4511-b6af-72384a84eded admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:40.898036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f012fe7-f23c-4511-b6af-72384a84eded admin admin] PATH_INFO: `/v3/projects/7fc40a09d4b147f6a41eacfd10097b28/users/868a6ce0f1f04f809bd0b432facc5534/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:40.920708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f012fe7-f23c-4511-b6af-72384a84eded admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc40a09d4b147f6a41eacfd10097b28, user_id=868a6ce0f1f04f809bd0b432facc5534, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:40.924686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f012fe7-f23c-4511-b6af-72384a84eded admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:40.951768 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3775/7569] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:40 2022] PUT /identity/v3/projects/7fc40a09d4b147f6a41eacfd10097b28/users/868a6ce0f1f04f809bd0b432facc5534/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:40.964094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d83d2-7ba7-4cdc-91e5-a6247f89ceff None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:40.964772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d83d2-7ba7-4cdc-91e5-a6247f89ceff None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:40.965308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d83d2-7ba7-4cdc-91e5-a6247f89ceff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:41.015734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ed5d83d2-7ba7-4cdc-91e5-a6247f89ceff None None] MFA Rules not processed for user `868a6ce0f1f04f809bd0b432facc5534`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:41.018111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ed5d83d2-7ba7-4cdc-91e5-a6247f89ceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:41.153508 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3795/7570] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:21:41.162104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f012fe7-f23c-4511-b6af-72384a84eded admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:41.164233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9f012fe7-f23c-4511-b6af-72384a84eded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:41.234028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f012fe7-f23c-4511-b6af-72384a84eded admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:41.238064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93baa1-c835-4ef0-bbb4-e304414582a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:41.238909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93baa1-c835-4ef0-bbb4-e304414582a3 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:41.239296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93baa1-c835-4ef0-bbb4-e304414582a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:41.239640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93baa1-c835-4ef0-bbb4-e304414582a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:41.249412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93baa1-c835-4ef0-bbb4-e304414582a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:41.251021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93baa1-c835-4ef0-bbb4-e304414582a3 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:41.262485 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3776/7571] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:46.766927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d83d2-7ba7-4cdc-91e5-a6247f89ceff None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:46.768429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ed5d83d2-7ba7-4cdc-91e5-a6247f89ceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:46.833553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d83d2-7ba7-4cdc-91e5-a6247f89ceff None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:46.838131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:46.838783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:46.839063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:46.839336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] PATH_INFO: `/v3/users/8b48d8d91fcc437592d05d4198f3c0f2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:46.840442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b48d8d91fcc437592d05d4198f3c0f2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:46.842438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:46.876049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:46.890241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b48d8d91fcc437592d05d4198f3c0f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:46.897357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b48d8d91fcc437592d05d4198f3c0f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:46.898016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b48d8d91fcc437592d05d4198f3c0f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:46.898620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b48d8d91fcc437592d05d4198f3c0f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:46.910235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b48d8d91fcc437592d05d4198f3c0f2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:46.922847 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3796/7572] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:46 2022] DELETE /identity/v3/users/8b48d8d91fcc437592d05d4198f3c0f2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:46.927416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaad55e-8c73-42ee-9d10-c868cd8819fd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:46.927909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaad55e-8c73-42ee-9d10-c868cd8819fd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:46.928012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaad55e-8c73-42ee-9d10-c868cd8819fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:46.949518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-feaad55e-8c73-42ee-9d10-c868cd8819fd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:46.950730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-feaad55e-8c73-42ee-9d10-c868cd8819fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:47.010657 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3777/7573] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:47.021032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:47.022450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:47.082219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9316bb-6c21-407f-be58-9f41494660e3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:47.085977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707dcb7-816f-4936-ab91-f91ff91dc360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:47.086590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707dcb7-816f-4936-ab91-f91ff91dc360 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:47.086874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707dcb7-816f-4936-ab91-f91ff91dc360 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:47.087270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707dcb7-816f-4936-ab91-f91ff91dc360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:47.096943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707dcb7-816f-4936-ab91-f91ff91dc360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:47.098524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707dcb7-816f-4936-ab91-f91ff91dc360 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:47.110131 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3797/7574] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:21:47.330495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaad55e-8c73-42ee-9d10-c868cd8819fd None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:47.333422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-feaad55e-8c73-42ee-9d10-c868cd8819fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:47.354847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaad55e-8c73-42ee-9d10-c868cd8819fd None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:47.360917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221d199-5f5a-4984-9ea3-61af71deb4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:47.361726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221d199-5f5a-4984-9ea3-61af71deb4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:47.362194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221d199-5f5a-4984-9ea3-61af71deb4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:47.362753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221d199-5f5a-4984-9ea3-61af71deb4dd admin admin] PATH_INFO: `/v3/projects/1f82687dd0e94058a5ed5692c972d73e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:47.364417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221d199-5f5a-4984-9ea3-61af71deb4dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f82687dd0e94058a5ed5692c972d73e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:47.367283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221d199-5f5a-4984-9ea3-61af71deb4dd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:47.414066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:47.430749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0221d199-5f5a-4984-9ea3-61af71deb4dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f82687dd0e94058a5ed5692c972d73e', 'request_id': 'req-0221d199-5f5a-4984-9ea3-61af71deb4dd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:47.440138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0221d199-5f5a-4984-9ea3-61af71deb4dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f82687dd0e94058a5ed5692c972d73e', 'request_id': 'req-0221d199-5f5a-4984-9ea3-61af71deb4dd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:47.447463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0221d199-5f5a-4984-9ea3-61af71deb4dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f82687dd0e94058a5ed5692c972d73e', 'request_id': 'req-0221d199-5f5a-4984-9ea3-61af71deb4dd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:47.462034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0221d199-5f5a-4984-9ea3-61af71deb4dd admin admin] The token cache is being invalidate because project 1f82687dd0e94058a5ed5692c972d73e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:47.462324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0221d199-5f5a-4984-9ea3-61af71deb4dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:47.463957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-0221d199-5f5a-4984-9ea3-61af71deb4dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:47.465452 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3778/7575] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:47 2022] DELETE /identity/v3/projects/1f82687dd0e94058a5ed5692c972d73e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:47.470864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf00c79-5478-4f81-a06a-48b952fee199 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:47.471285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf00c79-5478-4f81-a06a-48b952fee199 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:47.471692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf00c79-5478-4f81-a06a-48b952fee199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:47.498525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-aaf00c79-5478-4f81-a06a-48b952fee199 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:47.499875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-aaf00c79-5478-4f81-a06a-48b952fee199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:47.578894 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3798/7576] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:47.586400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de08e9-387d-4564-8142-c4f4f6716fdc None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:47.586677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de08e9-387d-4564-8142-c4f4f6716fdc None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:47.586951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de08e9-387d-4564-8142-c4f4f6716fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:47.618251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-08de08e9-387d-4564-8142-c4f4f6716fdc None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:47.619898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-08de08e9-387d-4564-8142-c4f4f6716fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:47.632110 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3779/7577] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:47.637212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf00c79-5478-4f81-a06a-48b952fee199 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:47.649161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf00c79-5478-4f81-a06a-48b952fee199 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:47.656076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac639c40-bcbb-4c83-a459-6124b98eec5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:47.657179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac639c40-bcbb-4c83-a459-6124b98eec5c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:47.657672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac639c40-bcbb-4c83-a459-6124b98eec5c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:47.657985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac639c40-bcbb-4c83-a459-6124b98eec5c admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:47.658904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac639c40-bcbb-4c83-a459-6124b98eec5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:21:47.659548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac639c40-bcbb-4c83-a459-6124b98eec5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:47.661789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac639c40-bcbb-4c83-a459-6124b98eec5c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:47.677360 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3799/7578] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:21:47.682174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de08e9-387d-4564-8142-c4f4f6716fdc None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:47.692768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de08e9-387d-4564-8142-c4f4f6716fdc None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:47.699602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe853360-163d-48fb-9d98-cd71dffdfd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:47.700260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe853360-163d-48fb-9d98-cd71dffdfd26 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:47.700560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe853360-163d-48fb-9d98-cd71dffdfd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:47.700890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe853360-163d-48fb-9d98-cd71dffdfd26 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:47.701614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe853360-163d-48fb-9d98-cd71dffdfd26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:47.704615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe853360-163d-48fb-9d98-cd71dffdfd26 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:47.741387 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3780/7579] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:47 2022] POST /identity/v3/projects => generated 357 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:47.742883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac639c40-bcbb-4c83-a459-6124b98eec5c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:47.757915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac639c40-bcbb-4c83-a459-6124b98eec5c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:47.810490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:47.835490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec498ecc-73c5-4ac8-a92b-e231b0db5543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:47.836109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec498ecc-73c5-4ac8-a92b-e231b0db5543 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:47.836391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec498ecc-73c5-4ac8-a92b-e231b0db5543 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:47.836667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec498ecc-73c5-4ac8-a92b-e231b0db5543 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:47.837339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec498ecc-73c5-4ac8-a92b-e231b0db5543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:47.839299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec498ecc-73c5-4ac8-a92b-e231b0db5543 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:47.863054 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3800/7580] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:47 2022] POST /identity/v3/users => generated 279 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:47.867370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe853360-163d-48fb-9d98-cd71dffdfd26 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:47.878825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe853360-163d-48fb-9d98-cd71dffdfd26 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:47.883567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0190bb-8e89-4bc2-9f78-6e2ec9467429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:47.884119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0190bb-8e89-4bc2-9f78-6e2ec9467429 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:47.884434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0190bb-8e89-4bc2-9f78-6e2ec9467429 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:47.884712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0190bb-8e89-4bc2-9f78-6e2ec9467429 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:47.885391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0190bb-8e89-4bc2-9f78-6e2ec9467429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:47.886997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0190bb-8e89-4bc2-9f78-6e2ec9467429 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:47.901095 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3781/7581] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:21:47.902525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec498ecc-73c5-4ac8-a92b-e231b0db5543 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:47.913417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec498ecc-73c5-4ac8-a92b-e231b0db5543 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:47.921379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f1d51-6d79-4902-b06d-f9d896a3dcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:47.922124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f1d51-6d79-4902-b06d-f9d896a3dcfc admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:47.922537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f1d51-6d79-4902-b06d-f9d896a3dcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:47.922884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f1d51-6d79-4902-b06d-f9d896a3dcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:47.923634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f1d51-6d79-4902-b06d-f9d896a3dcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:47.925610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f1d51-6d79-4902-b06d-f9d896a3dcfc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:47.940357 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3801/7582] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:47.941765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0190bb-8e89-4bc2-9f78-6e2ec9467429 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:47.952264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0190bb-8e89-4bc2-9f78-6e2ec9467429 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:47.957035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123c61e-f993-4fee-8df5-b6d30c99adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:47.957732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123c61e-f993-4fee-8df5-b6d30c99adde admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:47.958011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123c61e-f993-4fee-8df5-b6d30c99adde admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:47.958291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123c61e-f993-4fee-8df5-b6d30c99adde admin admin] PATH_INFO: `/v3/projects/75d7aea29a604ec396dc6948f2abb223/users/2c7a8733e171402e98d9c1bcd21dfc9e/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:47.974928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123c61e-f993-4fee-8df5-b6d30c99adde admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d7aea29a604ec396dc6948f2abb223, user_id=2c7a8733e171402e98d9c1bcd21dfc9e, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:47.977676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123c61e-f993-4fee-8df5-b6d30c99adde admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:47.990944 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3782/7583] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:47 2022] PUT /identity/v3/projects/75d7aea29a604ec396dc6948f2abb223/users/2c7a8733e171402e98d9c1bcd21dfc9e/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:48.002071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a20247-178d-4d7d-81e1-88eebe3e3efe None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:48.002448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a20247-178d-4d7d-81e1-88eebe3e3efe None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:48.002792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a20247-178d-4d7d-81e1-88eebe3e3efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:48.031190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d8a20247-178d-4d7d-81e1-88eebe3e3efe None None] MFA Rules not processed for user `2c7a8733e171402e98d9c1bcd21dfc9e`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:48.032410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d8a20247-178d-4d7d-81e1-88eebe3e3efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:48.094909 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3802/7584] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:48.106202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123c61e-f993-4fee-8df5-b6d30c99adde admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:48.107922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e123c61e-f993-4fee-8df5-b6d30c99adde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:48.166036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123c61e-f993-4fee-8df5-b6d30c99adde admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:48.169681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e6aab-07d3-4175-b8a2-9d5fd0145ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:48.170285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e6aab-07d3-4175-b8a2-9d5fd0145ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:48.170586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e6aab-07d3-4175-b8a2-9d5fd0145ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:48.170843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e6aab-07d3-4175-b8a2-9d5fd0145ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:48.179167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e6aab-07d3-4175-b8a2-9d5fd0145ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:48.180583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e6aab-07d3-4175-b8a2-9d5fd0145ca7 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:48.190223 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3783/7585] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:48.243704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a20247-178d-4d7d-81e1-88eebe3e3efe None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:48.244910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d8a20247-178d-4d7d-81e1-88eebe3e3efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:48.340003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a20247-178d-4d7d-81e1-88eebe3e3efe None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:48.346699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:48.348421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:48.348874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:48.349151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] PATH_INFO: `/v3/users/a009ac77727640de9becf6a61c8f1662` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:48.350651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a009ac77727640de9becf6a61c8f1662)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:48.353941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:48.413669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a009ac77727640de9becf6a61c8f1662'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:48.416967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:48.427887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a009ac77727640de9becf6a61c8f1662'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:48.429535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a009ac77727640de9becf6a61c8f1662'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:48.430450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a009ac77727640de9becf6a61c8f1662'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:48.455135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a009ac77727640de9becf6a61c8f1662'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:48.477217 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3803/7586] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:48 2022] DELETE /identity/v3/users/a009ac77727640de9becf6a61c8f1662 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:48.481441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fd6a8-8ef4-4ee7-8eb4-735a6c65650d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:48.481987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fd6a8-8ef4-4ee7-8eb4-735a6c65650d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:48.482525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fd6a8-8ef4-4ee7-8eb4-735a6c65650d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:48.513580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fd0fd6a8-8ef4-4ee7-8eb4-735a6c65650d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:48.514962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fd0fd6a8-8ef4-4ee7-8eb4-735a6c65650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:48.589926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:48.602606 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3784/7587] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:21:48.617696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:48.620918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:48.706564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57a9ad-ecd2-4f1e-aea8-ea359238c03b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:48.714948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793de74-f6e5-478a-8dd0-e72f8e3fb7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:48.715960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793de74-f6e5-478a-8dd0-e72f8e3fb7ca service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:48.716616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793de74-f6e5-478a-8dd0-e72f8e3fb7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:48.717023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793de74-f6e5-478a-8dd0-e72f8e3fb7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:48.733090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793de74-f6e5-478a-8dd0-e72f8e3fb7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:48.734886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793de74-f6e5-478a-8dd0-e72f8e3fb7ca service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:48.747365 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3804/7588] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:49.182555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fd6a8-8ef4-4ee7-8eb4-735a6c65650d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:49.183956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fd0fd6a8-8ef4-4ee7-8eb4-735a6c65650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:49.196274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fd6a8-8ef4-4ee7-8eb4-735a6c65650d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:49.202423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab666a-4e77-4878-8a6f-305f77ab504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:49.203159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab666a-4e77-4878-8a6f-305f77ab504d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:49.203444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab666a-4e77-4878-8a6f-305f77ab504d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:49.204245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab666a-4e77-4878-8a6f-305f77ab504d admin admin] PATH_INFO: `/v3/projects/fd238ac8ac5e4e7793c1ebb53a85eaef` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:49.204963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab666a-4e77-4878-8a6f-305f77ab504d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd238ac8ac5e4e7793c1ebb53a85eaef)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:49.207689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab666a-4e77-4878-8a6f-305f77ab504d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:49.274159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3ab666a-4e77-4878-8a6f-305f77ab504d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'request_id': 'req-b3ab666a-4e77-4878-8a6f-305f77ab504d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:49.287709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3ab666a-4e77-4878-8a6f-305f77ab504d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'request_id': 'req-b3ab666a-4e77-4878-8a6f-305f77ab504d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:49.300754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3ab666a-4e77-4878-8a6f-305f77ab504d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'request_id': 'req-b3ab666a-4e77-4878-8a6f-305f77ab504d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:49.329332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3ab666a-4e77-4878-8a6f-305f77ab504d admin admin] The token cache is being invalidate because project fd238ac8ac5e4e7793c1ebb53a85eaef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:49.329332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3ab666a-4e77-4878-8a6f-305f77ab504d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:49.329332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3ab666a-4e77-4878-8a6f-305f77ab504d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:49.329332 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3785/7589] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:49 2022] DELETE /identity/v3/projects/fd238ac8ac5e4e7793c1ebb53a85eaef => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:49.331374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120d717-885e-49a4-ac20-861f42c004a1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:49.331861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120d717-885e-49a4-ac20-861f42c004a1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:49.332079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120d717-885e-49a4-ac20-861f42c004a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:49.360487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b120d717-885e-49a4-ac20-861f42c004a1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:49.362624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b120d717-885e-49a4-ac20-861f42c004a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:49.486618 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3805/7590] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:49.496118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d479fe0-f34a-4de8-b7fd-d8db3479b895 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:49.496413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d479fe0-f34a-4de8-b7fd-d8db3479b895 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:49.496689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d479fe0-f34a-4de8-b7fd-d8db3479b895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:49.550236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3d479fe0-f34a-4de8-b7fd-d8db3479b895 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:49.556735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d479fe0-f34a-4de8-b7fd-d8db3479b895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:49.583297 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3786/7591] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:49.588789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120d717-885e-49a4-ac20-861f42c004a1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:49.604630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120d717-885e-49a4-ac20-861f42c004a1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:49.618408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa911e3-3183-48e6-808c-5c6d365c768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:49.622157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa911e3-3183-48e6-808c-5c6d365c768d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:49.624112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa911e3-3183-48e6-808c-5c6d365c768d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:49.627626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa911e3-3183-48e6-808c-5c6d365c768d admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:49.628804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa911e3-3183-48e6-808c-5c6d365c768d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:21:49.629334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa911e3-3183-48e6-808c-5c6d365c768d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:49.634182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa911e3-3183-48e6-808c-5c6d365c768d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:49.653880 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3806/7592] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:21:49.658628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d479fe0-f34a-4de8-b7fd-d8db3479b895 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:49.678762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d479fe0-f34a-4de8-b7fd-d8db3479b895 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:49.691859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad7e88-c426-48d0-bc85-526042499eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:49.693633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad7e88-c426-48d0-bc85-526042499eac admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:49.694206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad7e88-c426-48d0-bc85-526042499eac admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:49.694714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad7e88-c426-48d0-bc85-526042499eac admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:49.695596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad7e88-c426-48d0-bc85-526042499eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:49.699056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad7e88-c426-48d0-bc85-526042499eac admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:49.738264 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3787/7593] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:49 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:49.743448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa911e3-3183-48e6-808c-5c6d365c768d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:49.762495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa911e3-3183-48e6-808c-5c6d365c768d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:49.889902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:49.901721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d0924-36cb-4321-89ed-65a7ca5361c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:49.909744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d0924-36cb-4321-89ed-65a7ca5361c1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:49.911543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d0924-36cb-4321-89ed-65a7ca5361c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:49.915480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d0924-36cb-4321-89ed-65a7ca5361c1 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:49.917420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d0924-36cb-4321-89ed-65a7ca5361c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:49.920438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d0924-36cb-4321-89ed-65a7ca5361c1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:49.958686 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3807/7594] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:49 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:49.963133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad7e88-c426-48d0-bc85-526042499eac admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:49.977101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad7e88-c426-48d0-bc85-526042499eac admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:49.986693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd795047-ace5-47c4-99d0-bfae92b1da81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:49.987662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd795047-ace5-47c4-99d0-bfae92b1da81 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:49.987662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd795047-ace5-47c4-99d0-bfae92b1da81 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:49.988075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd795047-ace5-47c4-99d0-bfae92b1da81 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:49.988976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd795047-ace5-47c4-99d0-bfae92b1da81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:49.991700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd795047-ace5-47c4-99d0-bfae92b1da81 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:50.032522 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3788/7595] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:50.036901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d0924-36cb-4321-89ed-65a7ca5361c1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:50.051414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d0924-36cb-4321-89ed-65a7ca5361c1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:50.059108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0fd1d-b509-47c9-8075-c5b7b2145363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:50.059994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0fd1d-b509-47c9-8075-c5b7b2145363 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:50.060507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0fd1d-b509-47c9-8075-c5b7b2145363 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:50.061851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0fd1d-b509-47c9-8075-c5b7b2145363 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:50.063118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0fd1d-b509-47c9-8075-c5b7b2145363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:50.064894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0fd1d-b509-47c9-8075-c5b7b2145363 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:50.078437 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3808/7596] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:50.083005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd795047-ace5-47c4-99d0-bfae92b1da81 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:50.096794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd795047-ace5-47c4-99d0-bfae92b1da81 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:50.106096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3bbb-8642-4d8a-a89a-29a585766dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:50.110331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3bbb-8642-4d8a-a89a-29a585766dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:50.110841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3bbb-8642-4d8a-a89a-29a585766dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:50.111078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3bbb-8642-4d8a-a89a-29a585766dd6 admin admin] PATH_INFO: `/v3/projects/dc624af3e48644b6aebe170d1a212797/users/5e91290a4dac407c93f2aacb5f2b59fa/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:50.140364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a3bbb-8642-4d8a-a89a-29a585766dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc624af3e48644b6aebe170d1a212797, user_id=5e91290a4dac407c93f2aacb5f2b59fa, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:50.143859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a3bbb-8642-4d8a-a89a-29a585766dd6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:50.167014 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3789/7597] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:50 2022] PUT /identity/v3/projects/dc624af3e48644b6aebe170d1a212797/users/5e91290a4dac407c93f2aacb5f2b59fa/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:50.173541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c6db6-0937-4ce3-8bec-e8513e6c836b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:50.174094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c6db6-0937-4ce3-8bec-e8513e6c836b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:50.174455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c6db6-0937-4ce3-8bec-e8513e6c836b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:50.201221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-189c6db6-0937-4ce3-8bec-e8513e6c836b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:50.202995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-189c6db6-0937-4ce3-8bec-e8513e6c836b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:50.282140 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3809/7598] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:50.298363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3bbb-8642-4d8a-a89a-29a585766dd6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:50.300182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-052a3bbb-8642-4d8a-a89a-29a585766dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:50.382012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3bbb-8642-4d8a-a89a-29a585766dd6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:50.390760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafca9e1-810f-422d-95a8-91d2933f9606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:50.391380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafca9e1-810f-422d-95a8-91d2933f9606 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:50.391860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafca9e1-810f-422d-95a8-91d2933f9606 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:50.392309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafca9e1-810f-422d-95a8-91d2933f9606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:50.407039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafca9e1-810f-422d-95a8-91d2933f9606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:50.408993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafca9e1-810f-422d-95a8-91d2933f9606 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:50.423692 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3790/7599] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:50.687197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c6db6-0937-4ce3-8bec-e8513e6c836b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:50.689835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-189c6db6-0937-4ce3-8bec-e8513e6c836b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:50.716750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c6db6-0937-4ce3-8bec-e8513e6c836b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:50.725607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:50.726644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:50.727091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:50.727571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] PATH_INFO: `/v3/users/f4e770e68804425fa1955447b1b7bd71` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:50.730848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e770e68804425fa1955447b1b7bd71)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:50.733488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:50.835089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e770e68804425fa1955447b1b7bd71'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:50.849051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e770e68804425fa1955447b1b7bd71'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:50.854208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e770e68804425fa1955447b1b7bd71'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:50.855051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e770e68804425fa1955447b1b7bd71'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:50.874252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e770e68804425fa1955447b1b7bd71'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:50.893516 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3810/7600] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:50 2022] DELETE /identity/v3/users/f4e770e68804425fa1955447b1b7bd71 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:50.897824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e3336-7238-4076-a0d8-63970fe4d0fa None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:50.898320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e3336-7238-4076-a0d8-63970fe4d0fa None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:50.899751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e3336-7238-4076-a0d8-63970fe4d0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:50.949917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-106e3336-7238-4076-a0d8-63970fe4d0fa None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:50.951922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-106e3336-7238-4076-a0d8-63970fe4d0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:50.976048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:51.089446 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3791/7601] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:21:51.100098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:51.101594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:51.243262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:51.258565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fea0a5-78c5-4b37-b40f-c2315105ce63 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:51.273012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec59fc-fcdb-42a5-bf63-38b0edf8de58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:51.276702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec59fc-fcdb-42a5-bf63-38b0edf8de58 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:51.277152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec59fc-fcdb-42a5-bf63-38b0edf8de58 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:51.277493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec59fc-fcdb-42a5-bf63-38b0edf8de58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:51.294493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec59fc-fcdb-42a5-bf63-38b0edf8de58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:51.296320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec59fc-fcdb-42a5-bf63-38b0edf8de58 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:51.313691 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3811/7602] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:52.114271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e3336-7238-4076-a0d8-63970fe4d0fa None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:52.116648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-106e3336-7238-4076-a0d8-63970fe4d0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:52.133228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e3336-7238-4076-a0d8-63970fe4d0fa None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:52.186695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:52.187716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:52.188164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:52.188623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb admin admin] PATH_INFO: `/v3/projects/4772bcc4164e446598dade98933a9380` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:52.194918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4772bcc4164e446598dade98933a9380)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:52.201593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:52.310973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4772bcc4164e446598dade98933a9380', 'request_id': 'req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:52.326814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4772bcc4164e446598dade98933a9380', 'request_id': 'req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:52.347034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4772bcc4164e446598dade98933a9380', 'request_id': 'req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:52.370872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb admin admin] The token cache is being invalidate because project 4772bcc4164e446598dade98933a9380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:52.371168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:52.372877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-3e88566f-28ff-46b1-a8cd-da5dbe8ab1fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:52.375100 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3792/7603] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:52 2022] DELETE /identity/v3/projects/4772bcc4164e446598dade98933a9380 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:52.380311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2eb28-3448-4205-bf6c-18175f3a1fec None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:52.380816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2eb28-3448-4205-bf6c-18175f3a1fec None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:52.380928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2eb28-3448-4205-bf6c-18175f3a1fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:52.435908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6cd2eb28-3448-4205-bf6c-18175f3a1fec None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:52.437780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6cd2eb28-3448-4205-bf6c-18175f3a1fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:52.609651 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3812/7604] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:52.619275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1708-2055-4d8f-b588-8a9998b55d8d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:52.619935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1708-2055-4d8f-b588-8a9998b55d8d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:52.620462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1708-2055-4d8f-b588-8a9998b55d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:52.659553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-203c1708-2055-4d8f-b588-8a9998b55d8d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:52.660830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-203c1708-2055-4d8f-b588-8a9998b55d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:52.672345 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3793/7605] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:52.676749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2eb28-3448-4205-bf6c-18175f3a1fec None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:52.690307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2eb28-3448-4205-bf6c-18175f3a1fec None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:52.703212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14ed7-1275-438a-b76c-294dc7d248df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:52.704179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14ed7-1275-438a-b76c-294dc7d248df admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:52.704908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14ed7-1275-438a-b76c-294dc7d248df admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:52.705991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14ed7-1275-438a-b76c-294dc7d248df admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:52.706877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea14ed7-1275-438a-b76c-294dc7d248df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:21:52.707404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea14ed7-1275-438a-b76c-294dc7d248df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:52.710339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea14ed7-1275-438a-b76c-294dc7d248df admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:52.738404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c1708-2055-4d8f-b588-8a9998b55d8d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:52.739274 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3813/7606] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:21:52.752122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c1708-2055-4d8f-b588-8a9998b55d8d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:52.764959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c885ea4-99fc-4bad-ae4a-71d06615e6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:52.766157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c885ea4-99fc-4bad-ae4a-71d06615e6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:52.766776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c885ea4-99fc-4bad-ae4a-71d06615e6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:52.767250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c885ea4-99fc-4bad-ae4a-71d06615e6f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:52.769230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c885ea4-99fc-4bad-ae4a-71d06615e6f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:52.774679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c885ea4-99fc-4bad-ae4a-71d06615e6f6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:52.831197 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3794/7607] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:52 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:52.831540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14ed7-1275-438a-b76c-294dc7d248df admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:52.846032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14ed7-1275-438a-b76c-294dc7d248df admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:52.923402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001baa9-4dbb-45c2-b6bb-8e3955b53989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:52.924377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001baa9-4dbb-45c2-b6bb-8e3955b53989 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:52.924946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001baa9-4dbb-45c2-b6bb-8e3955b53989 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:52.925422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001baa9-4dbb-45c2-b6bb-8e3955b53989 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:52.928662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001baa9-4dbb-45c2-b6bb-8e3955b53989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:52.930471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001baa9-4dbb-45c2-b6bb-8e3955b53989 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:52.991754 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3814/7608] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:52 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:52.996905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c885ea4-99fc-4bad-ae4a-71d06615e6f6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:53.020223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c885ea4-99fc-4bad-ae4a-71d06615e6f6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:53.035886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a830809-40b4-4e1f-8fe8-110ca0541dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:53.036156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a830809-40b4-4e1f-8fe8-110ca0541dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:53.036416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a830809-40b4-4e1f-8fe8-110ca0541dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:53.036686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a830809-40b4-4e1f-8fe8-110ca0541dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:53.037385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a830809-40b4-4e1f-8fe8-110ca0541dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:53.040133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a830809-40b4-4e1f-8fe8-110ca0541dd7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:53.061696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001baa9-4dbb-45c2-b6bb-8e3955b53989 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:53.062112 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3795/7609] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:53.091729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001baa9-4dbb-45c2-b6bb-8e3955b53989 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:53.098856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c95b6-3a22-4169-926d-d0046364ba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:53.099489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c95b6-3a22-4169-926d-d0046364ba5f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:53.099771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c95b6-3a22-4169-926d-d0046364ba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:53.100465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c95b6-3a22-4169-926d-d0046364ba5f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:53.101131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c95b6-3a22-4169-926d-d0046364ba5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:53.104929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c95b6-3a22-4169-926d-d0046364ba5f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:53.142374 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3815/7610] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:21:53.147864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a830809-40b4-4e1f-8fe8-110ca0541dd7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:53.172211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a830809-40b4-4e1f-8fe8-110ca0541dd7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:53.186343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24467feb-bfc4-4292-a9d9-225ca32ed5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:53.187242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24467feb-bfc4-4292-a9d9-225ca32ed5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:53.187539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24467feb-bfc4-4292-a9d9-225ca32ed5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:53.187822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24467feb-bfc4-4292-a9d9-225ca32ed5b5 admin admin] PATH_INFO: `/v3/projects/d4f95ca7a58d453388cf41258f9898b9/users/87124fa1e1994feaa7d65efadf1feb5d/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:53.211953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24467feb-bfc4-4292-a9d9-225ca32ed5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f95ca7a58d453388cf41258f9898b9, user_id=87124fa1e1994feaa7d65efadf1feb5d, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:53.216961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24467feb-bfc4-4292-a9d9-225ca32ed5b5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:53.250785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8686ab3-c2c3-45a5-8214-a1a904305535 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:53.251214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8686ab3-c2c3-45a5-8214-a1a904305535 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:53.251607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8686ab3-c2c3-45a5-8214-a1a904305535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:53.255837 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3796/7611] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:53 2022] PUT /identity/v3/projects/d4f95ca7a58d453388cf41258f9898b9/users/87124fa1e1994feaa7d65efadf1feb5d/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:53.377366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a8686ab3-c2c3-45a5-8214-a1a904305535 None None] MFA Rules not processed for user `87124fa1e1994feaa7d65efadf1feb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:53.387824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a8686ab3-c2c3-45a5-8214-a1a904305535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:53.562756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:53.614156 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3816/7612] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 08 21:21:53.628079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24467feb-bfc4-4292-a9d9-225ca32ed5b5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:53.632521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-24467feb-bfc4-4292-a9d9-225ca32ed5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:53.733674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:53.758003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24467feb-bfc4-4292-a9d9-225ca32ed5b5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:53.767638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba255ce3-ae1b-48ab-b0ac-93aeb0b0c604 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:53.768275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba255ce3-ae1b-48ab-b0ac-93aeb0b0c604 service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:53.768559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba255ce3-ae1b-48ab-b0ac-93aeb0b0c604 service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:53.768838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba255ce3-ae1b-48ab-b0ac-93aeb0b0c604 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:53.787654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba255ce3-ae1b-48ab-b0ac-93aeb0b0c604 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:53.789435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba255ce3-ae1b-48ab-b0ac-93aeb0b0c604 service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:53.812719 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3797/7613] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:55.775772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8686ab3-c2c3-45a5-8214-a1a904305535 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:55.777224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a8686ab3-c2c3-45a5-8214-a1a904305535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:55.898620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8686ab3-c2c3-45a5-8214-a1a904305535 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:55.908809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:55.909958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:55.910435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:55.911675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] PATH_INFO: `/v3/users/868a6ce0f1f04f809bd0b432facc5534` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:55.912821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=868a6ce0f1f04f809bd0b432facc5534)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:55.915176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:56.025274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '868a6ce0f1f04f809bd0b432facc5534'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:56.047689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '868a6ce0f1f04f809bd0b432facc5534'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:56.049481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '868a6ce0f1f04f809bd0b432facc5534'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:56.050440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '868a6ce0f1f04f809bd0b432facc5534'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:56.072724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '868a6ce0f1f04f809bd0b432facc5534'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:56.096573 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3817/7614] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:21:55 2022] DELETE /identity/v3/users/868a6ce0f1f04f809bd0b432facc5534 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:56.101689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed140-615d-4a73-987d-28dbfa17e7d7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:56.102161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed140-615d-4a73-987d-28dbfa17e7d7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:56.102282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed140-615d-4a73-987d-28dbfa17e7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:56.150558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-39bed140-615d-4a73-987d-28dbfa17e7d7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:56.151801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-39bed140-615d-4a73-987d-28dbfa17e7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:56.300751 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3798/7615] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:56.316606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:56.319536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:56.448930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf95dc4-6a2f-4f97-be36-fef2160f0445 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:56.456543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee804bd-299b-4c5d-80be-e0f7e3348279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:56.457214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee804bd-299b-4c5d-80be-e0f7e3348279 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:56.457706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee804bd-299b-4c5d-80be-e0f7e3348279 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:56.457843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee804bd-299b-4c5d-80be-e0f7e3348279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:56.470780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee804bd-299b-4c5d-80be-e0f7e3348279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:56.472419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee804bd-299b-4c5d-80be-e0f7e3348279 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:56.496805 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3818/7616] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:57.463901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bed140-615d-4a73-987d-28dbfa17e7d7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:57.465551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-39bed140-615d-4a73-987d-28dbfa17e7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:57.500164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bed140-615d-4a73-987d-28dbfa17e7d7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:57.507541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668b1fb-3d68-479c-8bea-73942b8388db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:57.508663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b1fb-3d68-479c-8bea-73942b8388db admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:57.509145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b1fb-3d68-479c-8bea-73942b8388db admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:57.510557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b1fb-3d68-479c-8bea-73942b8388db admin admin] PATH_INFO: `/v3/projects/7fc40a09d4b147f6a41eacfd10097b28` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:57.518390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668b1fb-3d68-479c-8bea-73942b8388db admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc40a09d4b147f6a41eacfd10097b28)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:57.521536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668b1fb-3d68-479c-8bea-73942b8388db admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:57.677406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6668b1fb-3d68-479c-8bea-73942b8388db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc40a09d4b147f6a41eacfd10097b28', 'request_id': 'req-6668b1fb-3d68-479c-8bea-73942b8388db'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:57.698618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6668b1fb-3d68-479c-8bea-73942b8388db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc40a09d4b147f6a41eacfd10097b28', 'request_id': 'req-6668b1fb-3d68-479c-8bea-73942b8388db'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:57.707874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6668b1fb-3d68-479c-8bea-73942b8388db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc40a09d4b147f6a41eacfd10097b28', 'request_id': 'req-6668b1fb-3d68-479c-8bea-73942b8388db'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:57.739932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6668b1fb-3d68-479c-8bea-73942b8388db admin admin] The token cache is being invalidate because project 7fc40a09d4b147f6a41eacfd10097b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:21:57.740467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6668b1fb-3d68-479c-8bea-73942b8388db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:57.741331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6668b1fb-3d68-479c-8bea-73942b8388db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:21:57.744181 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3799/7617] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:21:57 2022] DELETE /identity/v3/projects/7fc40a09d4b147f6a41eacfd10097b28 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:57.750370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5c25-cf6d-463b-8d74-6eea7243d7c9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:57.751023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5c25-cf6d-463b-8d74-6eea7243d7c9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:57.751706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5c25-cf6d-463b-8d74-6eea7243d7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:57.777013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-15bd5c25-cf6d-463b-8d74-6eea7243d7c9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:57.778581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-15bd5c25-cf6d-463b-8d74-6eea7243d7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:57.784114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:57.911796 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3819/7618] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:57.920145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740b1b0-0b21-48fa-a090-cae3d605ff39 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:57.920426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740b1b0-0b21-48fa-a090-cae3d605ff39 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:57.920985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740b1b0-0b21-48fa-a090-cae3d605ff39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:57.946162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8740b1b0-0b21-48fa-a090-cae3d605ff39 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:57.948383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8740b1b0-0b21-48fa-a090-cae3d605ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:57.961698 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3800/7619] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:21:57.967027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd5c25-cf6d-463b-8d74-6eea7243d7c9 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:57.978557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd5c25-cf6d-463b-8d74-6eea7243d7c9 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:57.989264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee584fe2-f182-4256-9a8e-0c2f1ac66a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:57.990143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee584fe2-f182-4256-9a8e-0c2f1ac66a76 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:57.990583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee584fe2-f182-4256-9a8e-0c2f1ac66a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:57.991010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee584fe2-f182-4256-9a8e-0c2f1ac66a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:57.991843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee584fe2-f182-4256-9a8e-0c2f1ac66a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:21:57.992301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee584fe2-f182-4256-9a8e-0c2f1ac66a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:57.994626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee584fe2-f182-4256-9a8e-0c2f1ac66a76 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:58.044515 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3820/7620] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:21:58.049212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740b1b0-0b21-48fa-a090-cae3d605ff39 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:58.070017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740b1b0-0b21-48fa-a090-cae3d605ff39 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:58.079082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dde3e-3d54-4961-a90a-27c53bf37286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:58.080948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dde3e-3d54-4961-a90a-27c53bf37286 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:58.081498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dde3e-3d54-4961-a90a-27c53bf37286 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:58.081968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dde3e-3d54-4961-a90a-27c53bf37286 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:58.083755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dde3e-3d54-4961-a90a-27c53bf37286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:58.086451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dde3e-3d54-4961-a90a-27c53bf37286 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:58.142465 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3801/7621] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:58 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:58.143637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee584fe2-f182-4256-9a8e-0c2f1ac66a76 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:58.158087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee584fe2-f182-4256-9a8e-0c2f1ac66a76 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:58.325537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b710e5b-173e-416d-bc03-df66ad3c3205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:58.326170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b710e5b-173e-416d-bc03-df66ad3c3205 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:58.326449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b710e5b-173e-416d-bc03-df66ad3c3205 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:58.326721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b710e5b-173e-416d-bc03-df66ad3c3205 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:58.327358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b710e5b-173e-416d-bc03-df66ad3c3205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:58.329731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b710e5b-173e-416d-bc03-df66ad3c3205 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:58.366349 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3821/7622] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:58 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:58.370883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dde3e-3d54-4961-a90a-27c53bf37286 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:58.384261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dde3e-3d54-4961-a90a-27c53bf37286 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:58.396710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b1e33-1d58-4a29-82ca-95a0cdcdae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:58.405828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b1e33-1d58-4a29-82ca-95a0cdcdae02 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:58.406151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b1e33-1d58-4a29-82ca-95a0cdcdae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:58.408348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b1e33-1d58-4a29-82ca-95a0cdcdae02 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:58.409012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b1e33-1d58-4a29-82ca-95a0cdcdae02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:58.419146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b1e33-1d58-4a29-82ca-95a0cdcdae02 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:58.435846 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3802/7623] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:58.439680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b710e5b-173e-416d-bc03-df66ad3c3205 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:58.454345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b710e5b-173e-416d-bc03-df66ad3c3205 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:58.459241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0620c-036f-4afc-ab47-0aee6274af75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:58.459869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0620c-036f-4afc-ab47-0aee6274af75 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:58.460153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0620c-036f-4afc-ab47-0aee6274af75 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:58.460579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0620c-036f-4afc-ab47-0aee6274af75 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:58.461652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0620c-036f-4afc-ab47-0aee6274af75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:58.463372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0620c-036f-4afc-ab47-0aee6274af75 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:58.489809 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3822/7624] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:21:58.495849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b1e33-1d58-4a29-82ca-95a0cdcdae02 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:58.517442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b1e33-1d58-4a29-82ca-95a0cdcdae02 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:58.523927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bd028-a73a-4521-af80-cd9ea1b0c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:58.525593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bd028-a73a-4521-af80-cd9ea1b0c5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:58.526073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bd028-a73a-4521-af80-cd9ea1b0c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:58.529470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bd028-a73a-4521-af80-cd9ea1b0c5a2 admin admin] PATH_INFO: `/v3/projects/9b37e8634ac448ea9a86aff144098dd4/users/e28f7acd53094828a7863ce2fd775cdf/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:58.553832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bd028-a73a-4521-af80-cd9ea1b0c5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b37e8634ac448ea9a86aff144098dd4, user_id=e28f7acd53094828a7863ce2fd775cdf, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:58.559107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bd028-a73a-4521-af80-cd9ea1b0c5a2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:58.594301 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3803/7625] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:58 2022] PUT /identity/v3/projects/9b37e8634ac448ea9a86aff144098dd4/users/e28f7acd53094828a7863ce2fd775cdf/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:58.607739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ee868-cb2b-4a21-9771-4fb53672fdc2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:58.610136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ee868-cb2b-4a21-9771-4fb53672fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:58.610136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ee868-cb2b-4a21-9771-4fb53672fdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:58.687255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-639ee868-cb2b-4a21-9771-4fb53672fdc2 None None] MFA Rules not processed for user `e28f7acd53094828a7863ce2fd775cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:58.691404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-639ee868-cb2b-4a21-9771-4fb53672fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:58.849137 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3823/7626] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:21:58.854276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bd028-a73a-4521-af80-cd9ea1b0c5a2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:58.891539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:58.892845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979416-37d8-4de5-83e0-9d7915a0bb4d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:58.893101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979416-37d8-4de5-83e0-9d7915a0bb4d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:58.893427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979416-37d8-4de5-83e0-9d7915a0bb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:58.915455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:58.960971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6d979416-37d8-4de5-83e0-9d7915a0bb4d None None] MFA Rules not processed for user `5e91290a4dac407c93f2aacb5f2b59fa`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:21:58.962762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6d979416-37d8-4de5-83e0-9d7915a0bb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:59.035553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bd028-a73a-4521-af80-cd9ea1b0c5a2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:59.042984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d5569-47e0-44ee-9d43-17d521d1605c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:59.044049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5569-47e0-44ee-9d43-17d521d1605c admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:59.044434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5569-47e0-44ee-9d43-17d521d1605c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:59.044854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5569-47e0-44ee-9d43-17d521d1605c admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:59.045873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d5569-47e0-44ee-9d43-17d521d1605c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:59.048768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d5569-47e0-44ee-9d43-17d521d1605c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:59.072478 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3824/7627] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:21:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:21:59.076759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979416-37d8-4de5-83e0-9d7915a0bb4d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:59.079805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6d979416-37d8-4de5-83e0-9d7915a0bb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:59.113271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979416-37d8-4de5-83e0-9d7915a0bb4d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:59.127121 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3804/7628] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:58 2022] POST /identity/v3/projects => generated 373 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:59.129082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d5569-47e0-44ee-9d43-17d521d1605c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:59.141513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4b6a9-50d5-47e8-aebc-0301ed1ec0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:59.142149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4b6a9-50d5-47e8-aebc-0301ed1ec0eb admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:59.142435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4b6a9-50d5-47e8-aebc-0301ed1ec0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:59.142715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4b6a9-50d5-47e8-aebc-0301ed1ec0eb admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:59.143376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4b6a9-50d5-47e8-aebc-0301ed1ec0eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:59.146121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4b6a9-50d5-47e8-aebc-0301ed1ec0eb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:59.216518 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3825/7629] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:21:59 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:59.217885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4b6a9-50d5-47e8-aebc-0301ed1ec0eb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:59.265014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d5569-47e0-44ee-9d43-17d521d1605c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:59.371111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4b6a9-50d5-47e8-aebc-0301ed1ec0eb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:59.393207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b208eb-29a0-45c6-b639-15d137cbbb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:59.393207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b208eb-29a0-45c6-b639-15d137cbbb4a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:59.393207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b208eb-29a0-45c6-b639-15d137cbbb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:59.393207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b208eb-29a0-45c6-b639-15d137cbbb4a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:59.393861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b208eb-29a0-45c6-b639-15d137cbbb4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:59.393861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b208eb-29a0-45c6-b639-15d137cbbb4a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:59.445011 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3826/7630] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:59 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:59.447162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b208eb-29a0-45c6-b639-15d137cbbb4a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:59.450890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-31b208eb-29a0-45c6-b639-15d137cbbb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:59.510901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9632d50-f7af-400e-a9a4-80f68457ff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:59.512528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9632d50-f7af-400e-a9a4-80f68457ff30 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:59.513051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9632d50-f7af-400e-a9a4-80f68457ff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:59.513571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9632d50-f7af-400e-a9a4-80f68457ff30 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:59.514539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9632d50-f7af-400e-a9a4-80f68457ff30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:59.517843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9632d50-f7af-400e-a9a4-80f68457ff30 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:59.543447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b208eb-29a0-45c6-b639-15d137cbbb4a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:59.548619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bffbe9-868d-4923-ba05-2fd9d97b5bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:59.549421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bffbe9-868d-4923-ba05-2fd9d97b5bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:59.550027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bffbe9-868d-4923-ba05-2fd9d97b5bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:59.550887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bffbe9-868d-4923-ba05-2fd9d97b5bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:59.554009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-94bffbe9-868d-4923-ba05-2fd9d97b5bb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:21:59.566814 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3805/7631] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:21:59 2022] POST /identity/v3/users => generated 293 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:21:59.568571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9632d50-f7af-400e-a9a4-80f68457ff30 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:59.575767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:59.584794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9632d50-f7af-400e-a9a4-80f68457ff30 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:59.592756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a77a0-6d01-48a2-9bb4-6a57ffc8e535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:59.594427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a77a0-6d01-48a2-9bb4-6a57ffc8e535 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:59.594895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a77a0-6d01-48a2-9bb4-6a57ffc8e535 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:59.595677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a77a0-6d01-48a2-9bb4-6a57ffc8e535 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:59.596645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a77a0-6d01-48a2-9bb4-6a57ffc8e535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:59.598567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a77a0-6d01-48a2-9bb4-6a57ffc8e535 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:59.625067 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3806/7632] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:59.626287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a77a0-6d01-48a2-9bb4-6a57ffc8e535 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:59.652975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a77a0-6d01-48a2-9bb4-6a57ffc8e535 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:59.661636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814491a-38cb-4397-b0bb-b4a73afe6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:59.662562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814491a-38cb-4397-b0bb-b4a73afe6051 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:59.663068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814491a-38cb-4397-b0bb-b4a73afe6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:59.663685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814491a-38cb-4397-b0bb-b4a73afe6051 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:59.664409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814491a-38cb-4397-b0bb-b4a73afe6051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:59.667399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814491a-38cb-4397-b0bb-b4a73afe6051 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:59.685874 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3807/7633] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:21:59.687873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814491a-38cb-4397-b0bb-b4a73afe6051 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:59.703266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:59.705607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bffbe9-868d-4923-ba05-2fd9d97b5bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:59.707711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bffbe9-868d-4923-ba05-2fd9d97b5bb8 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:59.709469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814491a-38cb-4397-b0bb-b4a73afe6051 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:59.719290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cdfc0-4649-4ac1-a12c-65fafb178055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:59.720190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cdfc0-4649-4ac1-a12c-65fafb178055 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:59.720642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cdfc0-4649-4ac1-a12c-65fafb178055 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:59.721074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cdfc0-4649-4ac1-a12c-65fafb178055 admin admin] PATH_INFO: `/v3/projects/860cb9657c144026b4e01780764d9887/users/816afef29e124ee983b50c507e5412b9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:59.731251 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3827/7634] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:21:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:21:59.732435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bffbe9-868d-4923-ba05-2fd9d97b5bb8 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:59.741588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0cdfc0-4649-4ac1-a12c-65fafb178055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860cb9657c144026b4e01780764d9887, user_id=816afef29e124ee983b50c507e5412b9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:59.744763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0cdfc0-4649-4ac1-a12c-65fafb178055 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:59.745140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bffbe9-868d-4923-ba05-2fd9d97b5bb8 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:59.752319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6b723-550b-40ae-9f75-97d817aa5ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:59.753000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6b723-550b-40ae-9f75-97d817aa5ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:59.753337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6b723-550b-40ae-9f75-97d817aa5ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:59.753619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6b723-550b-40ae-9f75-97d817aa5ad9 admin admin] PATH_INFO: `/v3/projects/0ce8c80fa10e4f8db7abcbaf58aee065/users/4f85ac53974a4a459246bffdb9caae72/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:59.772737 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3808/7635] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:59 2022] PUT /identity/v3/projects/860cb9657c144026b4e01780764d9887/users/816afef29e124ee983b50c507e5412b9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:59.774125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cdfc0-4649-4ac1-a12c-65fafb178055 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:59.792226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6b723-550b-40ae-9f75-97d817aa5ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce8c80fa10e4f8db7abcbaf58aee065, user_id=4f85ac53974a4a459246bffdb9caae72, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:59.795970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6b723-550b-40ae-9f75-97d817aa5ad9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:59.818043 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3828/7636] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:59 2022] PUT /identity/v3/projects/0ce8c80fa10e4f8db7abcbaf58aee065/users/4f85ac53974a4a459246bffdb9caae72/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:21:59.822664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6b723-550b-40ae-9f75-97d817aa5ad9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:59.882819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cdfc0-4649-4ac1-a12c-65fafb178055 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:59.955023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6b723-550b-40ae-9f75-97d817aa5ad9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:21:59.959819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3326b6-6731-4ce5-8087-a778418e3d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:59.960443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3326b6-6731-4ce5-8087-a778418e3d82 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:59.960733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3326b6-6731-4ce5-8087-a778418e3d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:59.961014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3326b6-6731-4ce5-8087-a778418e3d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:59.961804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3326b6-6731-4ce5-8087-a778418e3d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:59.963456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3326b6-6731-4ce5-8087-a778418e3d82 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:59.976650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d5b3d-9fd3-4cdf-b6ef-38348b9293d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:21:59.977314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d5b3d-9fd3-4cdf-b6ef-38348b9293d1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:21:59.977314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d5b3d-9fd3-4cdf-b6ef-38348b9293d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:21:59.977805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d5b3d-9fd3-4cdf-b6ef-38348b9293d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:21:59.979790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d5b3d-9fd3-4cdf-b6ef-38348b9293d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:21:59.983679 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3829/7637] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:21:59.984166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d5b3d-9fd3-4cdf-b6ef-38348b9293d1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:21:59.984908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3326b6-6731-4ce5-8087-a778418e3d82 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:21:59.997005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3326b6-6731-4ce5-8087-a778418e3d82 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:00.002166 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3809/7638] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:22:00.004841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d5b3d-9fd3-4cdf-b6ef-38348b9293d1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:00.010262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009fa4f-cd74-48da-98b3-95e35ba70532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:00.011061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009fa4f-cd74-48da-98b3-95e35ba70532 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:00.011456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009fa4f-cd74-48da-98b3-95e35ba70532 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:00.011843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009fa4f-cd74-48da-98b3-95e35ba70532 admin admin] PATH_INFO: `/v3/projects/0ce8c80fa10e4f8db7abcbaf58aee065/users/4f85ac53974a4a459246bffdb9caae72/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:00.014151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009fa4f-cd74-48da-98b3-95e35ba70532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce8c80fa10e4f8db7abcbaf58aee065, user_id=4f85ac53974a4a459246bffdb9caae72, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:00.017080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009fa4f-cd74-48da-98b3-95e35ba70532 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:00.024298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d5b3d-9fd3-4cdf-b6ef-38348b9293d1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:00.041710 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3830/7639] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:21:59 2022] PUT /identity/v3/projects/0ce8c80fa10e4f8db7abcbaf58aee065/users/4f85ac53974a4a459246bffdb9caae72/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:22:00.043341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3742b60-7ffd-4496-bdd5-dce31e85e02d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:00.043542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3742b60-7ffd-4496-bdd5-dce31e85e02d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:00.043796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3742b60-7ffd-4496-bdd5-dce31e85e02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:00.104162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a3742b60-7ffd-4496-bdd5-dce31e85e02d None None] MFA Rules not processed for user `4f85ac53974a4a459246bffdb9caae72`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:00.108674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a3742b60-7ffd-4496-bdd5-dce31e85e02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:00.127225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49978604-0e8b-49ad-a6c7-a2b2781d96e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:00.130429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49978604-0e8b-49ad-a6c7-a2b2781d96e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:00.131651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49978604-0e8b-49ad-a6c7-a2b2781d96e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:00.133851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49978604-0e8b-49ad-a6c7-a2b2781d96e6 admin admin] PATH_INFO: `/v3/projects/860cb9657c144026b4e01780764d9887/users/816afef29e124ee983b50c507e5412b9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:00.141363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49978604-0e8b-49ad-a6c7-a2b2781d96e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860cb9657c144026b4e01780764d9887, user_id=816afef29e124ee983b50c507e5412b9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:00.152160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49978604-0e8b-49ad-a6c7-a2b2781d96e6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:00.166420 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3810/7640] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:22:00 2022] PUT /identity/v3/projects/860cb9657c144026b4e01780764d9887/users/816afef29e124ee983b50c507e5412b9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:22:00.180369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:00.229932 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3831/7641] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:00.245094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49978604-0e8b-49ad-a6c7-a2b2781d96e6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:00.249259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-49978604-0e8b-49ad-a6c7-a2b2781d96e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:00.302868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:00.408299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49978604-0e8b-49ad-a6c7-a2b2781d96e6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:00.416935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a8c35-3ac8-41ac-b4c4-87d66221ce26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:00.417431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a8c35-3ac8-41ac-b4c4-87d66221ce26 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:00.417718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a8c35-3ac8-41ac-b4c4-87d66221ce26 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:00.417995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a8c35-3ac8-41ac-b4c4-87d66221ce26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:00.566448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a8c35-3ac8-41ac-b4c4-87d66221ce26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:00.571713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a8c35-3ac8-41ac-b4c4-87d66221ce26 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:00.587778 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3811/7642] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:01.080625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3742b60-7ffd-4496-bdd5-dce31e85e02d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:01.269687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3742b60-7ffd-4496-bdd5-dce31e85e02d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:01.276072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4d067-4d00-47fd-b734-b7c1bfa15cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:01.277987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4d067-4d00-47fd-b734-b7c1bfa15cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:01.278865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4d067-4d00-47fd-b734-b7c1bfa15cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:01.279731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4d067-4d00-47fd-b734-b7c1bfa15cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:01.285606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-add4d067-4d00-47fd-b734-b7c1bfa15cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:01.534880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4d067-4d00-47fd-b734-b7c1bfa15cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:01.534880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4d067-4d00-47fd-b734-b7c1bfa15cb2 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:01.573113 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3832/7643] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:05.231041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a8c35-3ac8-41ac-b4c4-87d66221ce26 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:05.246797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a8c35-3ac8-41ac-b4c4-87d66221ce26 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:05.254272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344fb1a-0579-445b-8985-7c600d348dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:05.258264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344fb1a-0579-445b-8985-7c600d348dab service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:05.259584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344fb1a-0579-445b-8985-7c600d348dab service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:05.260164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344fb1a-0579-445b-8985-7c600d348dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:05.382746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344fb1a-0579-445b-8985-7c600d348dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:05.389243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344fb1a-0579-445b-8985-7c600d348dab service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:05.409400 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3812/7644] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:07.424182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4d067-4d00-47fd-b734-b7c1bfa15cb2 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:07.426306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-add4d067-4d00-47fd-b734-b7c1bfa15cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:07.604445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4d067-4d00-47fd-b734-b7c1bfa15cb2 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:07.619842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b9045-da1e-49e7-b120-27da0062bcff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:07.620719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b9045-da1e-49e7-b120-27da0062bcff service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:07.621049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b9045-da1e-49e7-b120-27da0062bcff service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:07.621530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b9045-da1e-49e7-b120-27da0062bcff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:07.626796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b84b9045-da1e-49e7-b120-27da0062bcff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:07.674032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b9045-da1e-49e7-b120-27da0062bcff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:07.676225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b9045-da1e-49e7-b120-27da0062bcff service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:07.707528 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3833/7645] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:08.837125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344fb1a-0579-445b-8985-7c600d348dab service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:08.838710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c344fb1a-0579-445b-8985-7c600d348dab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:08.990680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344fb1a-0579-445b-8985-7c600d348dab service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:09.001199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:09.002740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:09.003279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:09.003713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] PATH_INFO: `/v3/users/87124fa1e1994feaa7d65efadf1feb5d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:09.005942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=87124fa1e1994feaa7d65efadf1feb5d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:09.010333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:09.032455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:09.139663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87124fa1e1994feaa7d65efadf1feb5d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:09.157916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87124fa1e1994feaa7d65efadf1feb5d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:09.160528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87124fa1e1994feaa7d65efadf1feb5d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:09.162125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87124fa1e1994feaa7d65efadf1feb5d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:09.190790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87124fa1e1994feaa7d65efadf1feb5d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:09.218039 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3813/7646] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:22:08 2022] DELETE /identity/v3/users/87124fa1e1994feaa7d65efadf1feb5d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:22:09.224529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858fdbb-5805-4a5a-9de3-c39b4a768f66 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:09.225081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858fdbb-5805-4a5a-9de3-c39b4a768f66 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:09.225081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858fdbb-5805-4a5a-9de3-c39b4a768f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:09.261874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3858fdbb-5805-4a5a-9de3-c39b4a768f66 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:09.263135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3858fdbb-5805-4a5a-9de3-c39b4a768f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:09.277382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:09.564654 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3834/7647] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:09.594433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:09.595909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:09.732036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8065c30-c0eb-41cc-9acd-03c0fa8b18aa admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:09.754989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e9cf5-5798-4bb0-8d1d-cee171434436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:09.756556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e9cf5-5798-4bb0-8d1d-cee171434436 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:09.756979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e9cf5-5798-4bb0-8d1d-cee171434436 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:09.757433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e9cf5-5798-4bb0-8d1d-cee171434436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:09.783018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e9cf5-5798-4bb0-8d1d-cee171434436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:09.785068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e9cf5-5798-4bb0-8d1d-cee171434436 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:09.848530 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3814/7648] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:10.808729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b168d-bf9e-44f2-bfed-1724462d4687 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:10.809955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b168d-bf9e-44f2-bfed-1724462d4687 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:10.810498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b168d-bf9e-44f2-bfed-1724462d4687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:10.893931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f56b168d-bf9e-44f2-bfed-1724462d4687 None None] MFA Rules not processed for user `816afef29e124ee983b50c507e5412b9`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:10.895645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f56b168d-bf9e-44f2-bfed-1724462d4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:11.051612 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3835/7649] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:11.064162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e9cf5-5798-4bb0-8d1d-cee171434436 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:11.075841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b89e9cf5-5798-4bb0-8d1d-cee171434436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:11.195310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e9cf5-5798-4bb0-8d1d-cee171434436 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:11.202018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbd549-071f-498a-870f-1936148312e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:11.202901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbd549-071f-498a-870f-1936148312e3 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:11.203189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbd549-071f-498a-870f-1936148312e3 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:11.203462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbd549-071f-498a-870f-1936148312e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:11.203599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b168d-bf9e-44f2-bfed-1724462d4687 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:11.205055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f56b168d-bf9e-44f2-bfed-1724462d4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:11.214984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbd549-071f-498a-870f-1936148312e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:11.217429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbd549-071f-498a-870f-1936148312e3 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:11.223113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b168d-bf9e-44f2-bfed-1724462d4687 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:11.231241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:11.232186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:11.233610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:11.246585 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3815/7650] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:11.249388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] PATH_INFO: `/v3/projects/d4f95ca7a58d453388cf41258f9898b9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:11.253904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f95ca7a58d453388cf41258f9898b9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:11.256782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:11.397971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f95ca7a58d453388cf41258f9898b9', 'request_id': 'req-be074520-7830-49a5-ad07-6c3ad1b77c16'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:11.431944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f95ca7a58d453388cf41258f9898b9', 'request_id': 'req-be074520-7830-49a5-ad07-6c3ad1b77c16'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:11.453015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f95ca7a58d453388cf41258f9898b9', 'request_id': 'req-be074520-7830-49a5-ad07-6c3ad1b77c16'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:11.475073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] The token cache is being invalidate because project d4f95ca7a58d453388cf41258f9898b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:22:11.507726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:11.510669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:11.514042 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3836/7651] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:22:11 2022] DELETE /identity/v3/projects/d4f95ca7a58d453388cf41258f9898b9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:22:11.520314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78727d09-aebf-4e1c-a967-6e4f93742114 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:11.520604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78727d09-aebf-4e1c-a967-6e4f93742114 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:11.521120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78727d09-aebf-4e1c-a967-6e4f93742114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:11.559852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-78727d09-aebf-4e1c-a967-6e4f93742114 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:11.561081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-78727d09-aebf-4e1c-a967-6e4f93742114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:11.593524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:11.663518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:11.666358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:11.717578 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3816/7652] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:11.727039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e71b-1bf6-42da-8177-de3d2ed9a6c5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:11.729733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e71b-1bf6-42da-8177-de3d2ed9a6c5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:11.730049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e71b-1bf6-42da-8177-de3d2ed9a6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:11.744052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:11.771973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3d04e71b-1bf6-42da-8177-de3d2ed9a6c5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:11.773405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d04e71b-1bf6-42da-8177-de3d2ed9a6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:11.789252 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3817/7653] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:22:11.790848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04e71b-1bf6-42da-8177-de3d2ed9a6c5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:11.820866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04e71b-1bf6-42da-8177-de3d2ed9a6c5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:11.826955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7c68b-c2ac-469c-8e3e-dd3a84a096f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:11.828928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7c68b-c2ac-469c-8e3e-dd3a84a096f6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:11.836338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7c68b-c2ac-469c-8e3e-dd3a84a096f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:11.837136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7c68b-c2ac-469c-8e3e-dd3a84a096f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:11.837628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7c68b-c2ac-469c-8e3e-dd3a84a096f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:22:11.838009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7c68b-c2ac-469c-8e3e-dd3a84a096f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:11.846784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7c68b-c2ac-469c-8e3e-dd3a84a096f6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:11.863404 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3818/7654] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:22:11.870288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7c68b-c2ac-469c-8e3e-dd3a84a096f6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:11.885165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7c68b-c2ac-469c-8e3e-dd3a84a096f6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:11.897543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074520-7830-49a5-ad07-6c3ad1b77c16 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:11.898076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405a45c-f923-4af1-9209-e637ba499fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:11.899550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405a45c-f923-4af1-9209-e637ba499fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:11.899550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405a45c-f923-4af1-9209-e637ba499fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:11.899550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405a45c-f923-4af1-9209-e637ba499fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:11.899550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405a45c-f923-4af1-9209-e637ba499fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:11.901583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405a45c-f923-4af1-9209-e637ba499fe6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:11.915998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a1f85-7166-465b-aefb-534d560d4585 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:11.926252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a1f85-7166-465b-aefb-534d560d4585 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:11.926988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a1f85-7166-465b-aefb-534d560d4585 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:11.927512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a1f85-7166-465b-aefb-534d560d4585 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:11.934192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f66a1f85-7166-465b-aefb-534d560d4585 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:11.957952 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3819/7655] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:22:11 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:22:11.961159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405a45c-f923-4af1-9209-e637ba499fe6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:11.962271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a1f85-7166-465b-aefb-534d560d4585 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:11.967429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a1f85-7166-465b-aefb-534d560d4585 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:12.013707 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3837/7656] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:22:12.152664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405a45c-f923-4af1-9209-e637ba499fe6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:12.159644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96e895-e8d0-4dd6-ba40-b60eae436a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:12.160527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e895-e8d0-4dd6-ba40-b60eae436a31 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:12.160986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e895-e8d0-4dd6-ba40-b60eae436a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:12.161475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e895-e8d0-4dd6-ba40-b60eae436a31 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:12.162700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96e895-e8d0-4dd6-ba40-b60eae436a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:12.164816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96e895-e8d0-4dd6-ba40-b60eae436a31 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:12.205597 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3820/7657] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:22:11 2022] POST /identity/v3/users => generated 283 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:22:12.209970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a1f85-7166-465b-aefb-534d560d4585 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:12.239210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a1f85-7166-465b-aefb-534d560d4585 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:12.249295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d57c7-d4d0-4524-b2d3-9e3f70aacab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:12.249999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d57c7-d4d0-4524-b2d3-9e3f70aacab8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:12.250345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d57c7-d4d0-4524-b2d3-9e3f70aacab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:12.250650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d57c7-d4d0-4524-b2d3-9e3f70aacab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:12.251336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d57c7-d4d0-4524-b2d3-9e3f70aacab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:12.252979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d57c7-d4d0-4524-b2d3-9e3f70aacab8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:12.267961 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3838/7658] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:22:12.272057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96e895-e8d0-4dd6-ba40-b60eae436a31 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:12.287876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96e895-e8d0-4dd6-ba40-b60eae436a31 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:12.308110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27cefd-754f-4c2d-9c2a-d347d537f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:12.308734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27cefd-754f-4c2d-9c2a-d347d537f547 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:12.309016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27cefd-754f-4c2d-9c2a-d347d537f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:12.309415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27cefd-754f-4c2d-9c2a-d347d537f547 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:12.309985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27cefd-754f-4c2d-9c2a-d347d537f547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:12.317616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27cefd-754f-4c2d-9c2a-d347d537f547 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:12.341028 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3821/7659] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:22:12.345099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d57c7-d4d0-4524-b2d3-9e3f70aacab8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:12.360169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d57c7-d4d0-4524-b2d3-9e3f70aacab8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:12.374216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abd350-3c0f-46ec-8ead-957daefacb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:12.375041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd350-3c0f-46ec-8ead-957daefacb7d admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:12.375846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd350-3c0f-46ec-8ead-957daefacb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:12.375846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd350-3c0f-46ec-8ead-957daefacb7d admin admin] PATH_INFO: `/v3/projects/5186f4bdb40744599fddf443f05c9824/users/4db99ab4d71a4b9e99d509dc243f4928/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:12.420451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abd350-3c0f-46ec-8ead-957daefacb7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5186f4bdb40744599fddf443f05c9824, user_id=4db99ab4d71a4b9e99d509dc243f4928, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:12.430075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abd350-3c0f-46ec-8ead-957daefacb7d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:12.464130 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3839/7660] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:22:12 2022] PUT /identity/v3/projects/5186f4bdb40744599fddf443f05c9824/users/4db99ab4d71a4b9e99d509dc243f4928/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:22:12.586197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cf685-f519-409b-8e6b-2b727fecc992 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:12.586782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cf685-f519-409b-8e6b-2b727fecc992 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:12.587264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cf685-f519-409b-8e6b-2b727fecc992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:12.653909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-258cf685-f519-409b-8e6b-2b727fecc992 None None] MFA Rules not processed for user `4db99ab4d71a4b9e99d509dc243f4928`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:12.655220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-258cf685-f519-409b-8e6b-2b727fecc992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:12.698253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abd350-3c0f-46ec-8ead-957daefacb7d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:12.702690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-52abd350-3c0f-46ec-8ead-957daefacb7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:12.757910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:12.810985 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3822/7661] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:12.820303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cf685-f519-409b-8e6b-2b727fecc992 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:12.822060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-258cf685-f519-409b-8e6b-2b727fecc992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:12.925914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abd350-3c0f-46ec-8ead-957daefacb7d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:12.942439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cf685-f519-409b-8e6b-2b727fecc992 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:12.943824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f740fad-5539-4040-a55f-dbd03683831a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:12.944937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f740fad-5539-4040-a55f-dbd03683831a service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:12.945586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f740fad-5539-4040-a55f-dbd03683831a service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:12.946616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f740fad-5539-4040-a55f-dbd03683831a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:12.961355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7bf44-ea19-4aff-9482-e28f29d5160d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:12.968036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2f740fad-5539-4040-a55f-dbd03683831a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:12.970371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7bf44-ea19-4aff-9482-e28f29d5160d service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:12.971033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7bf44-ea19-4aff-9482-e28f29d5160d service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:12.971033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7bf44-ea19-4aff-9482-e28f29d5160d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:12.996112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7bf44-ea19-4aff-9482-e28f29d5160d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:12.997996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7bf44-ea19-4aff-9482-e28f29d5160d service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:13.009204 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3823/7662] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:13.009974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f740fad-5539-4040-a55f-dbd03683831a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:13.012768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f740fad-5539-4040-a55f-dbd03683831a service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:13.071080 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3840/7663] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:18.367878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e53aad-d124-4960-bbb4-bd5c0adf956a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:18.368977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e53aad-d124-4960-bbb4-bd5c0adf956a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:18.369092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e53aad-d124-4960-bbb4-bd5c0adf956a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:18.400842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a4e53aad-d124-4960-bbb4-bd5c0adf956a None None] MFA Rules not processed for user `e28f7acd53094828a7863ce2fd775cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:18.402500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a4e53aad-d124-4960-bbb4-bd5c0adf956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:18.540339 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3824/7664] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:23.033514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=71,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:24.911240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f740fad-5539-4040-a55f-dbd03683831a service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:24.931838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f740fad-5539-4040-a55f-dbd03683831a service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:24.948281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303629da-376c-4f37-b68a-348124f807ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:24.949014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303629da-376c-4f37-b68a-348124f807ba service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:24.949331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303629da-376c-4f37-b68a-348124f807ba service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:24.950822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303629da-376c-4f37-b68a-348124f807ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:24.976434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-303629da-376c-4f37-b68a-348124f807ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:24.977089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e53aad-d124-4960-bbb4-bd5c0adf956a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:24.978884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a4e53aad-d124-4960-bbb4-bd5c0adf956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:24.994422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303629da-376c-4f37-b68a-348124f807ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:24.996475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303629da-376c-4f37-b68a-348124f807ba service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:25.016964 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3841/7665] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:25.078538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e53aad-d124-4960-bbb4-bd5c0adf956a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:25.085607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:25.086584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:25.087835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:25.088277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] PATH_INFO: `/v3/users/5e91290a4dac407c93f2aacb5f2b59fa` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:25.090024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e91290a4dac407c93f2aacb5f2b59fa)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:25.093428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:25.154955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:25.178109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e91290a4dac407c93f2aacb5f2b59fa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.189629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e91290a4dac407c93f2aacb5f2b59fa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.190803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e91290a4dac407c93f2aacb5f2b59fa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.192192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e91290a4dac407c93f2aacb5f2b59fa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.215139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e91290a4dac407c93f2aacb5f2b59fa'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.234549 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3825/7666] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:22:24 2022] DELETE /identity/v3/users/5e91290a4dac407c93f2aacb5f2b59fa => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:22:25.508000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303629da-376c-4f37-b68a-348124f807ba service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:25.531054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303629da-376c-4f37-b68a-348124f807ba service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:25.646862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:25.647859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:25.648159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:25.648473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] PATH_INFO: `/v3/projects/dc624af3e48644b6aebe170d1a212797` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:25.650683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc624af3e48644b6aebe170d1a212797)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:25.652508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:25.729738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc624af3e48644b6aebe170d1a212797', 'request_id': 'req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.742861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc624af3e48644b6aebe170d1a212797', 'request_id': 'req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.750398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc624af3e48644b6aebe170d1a212797', 'request_id': 'req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.769747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] The token cache is being invalidate because project dc624af3e48644b6aebe170d1a212797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:22:25.770092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.770762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.775915 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3842/7667] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:22:25 2022] DELETE /identity/v3/projects/dc624af3e48644b6aebe170d1a212797 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:22:25.783800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:25.785598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:25.803940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe0cd6-9928-4648-94c3-2b2a9113e609 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:25.879311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab302bfc-e1ac-463b-b58f-86639fc3968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:25.879950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab302bfc-e1ac-463b-b58f-86639fc3968d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:25.881712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab302bfc-e1ac-463b-b58f-86639fc3968d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:25.881807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab302bfc-e1ac-463b-b58f-86639fc3968d admin admin] PATH_INFO: `/v3/users/816afef29e124ee983b50c507e5412b9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:25.884616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab302bfc-e1ac-463b-b58f-86639fc3968d admin admin] RBAC: Authorizing `identity:delete_user(user_id=816afef29e124ee983b50c507e5412b9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:25.886627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab302bfc-e1ac-463b-b58f-86639fc3968d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:25.958691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ab302bfc-e1ac-463b-b58f-86639fc3968d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816afef29e124ee983b50c507e5412b9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.970192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ab302bfc-e1ac-463b-b58f-86639fc3968d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816afef29e124ee983b50c507e5412b9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.971155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ab302bfc-e1ac-463b-b58f-86639fc3968d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816afef29e124ee983b50c507e5412b9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.972892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ab302bfc-e1ac-463b-b58f-86639fc3968d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816afef29e124ee983b50c507e5412b9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:25.988079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ab302bfc-e1ac-463b-b58f-86639fc3968d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816afef29e124ee983b50c507e5412b9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:26.011782 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3826/7668] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:22:25 2022] DELETE /identity/v3/users/816afef29e124ee983b50c507e5412b9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:22:26.269881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:26.271345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:26.297408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e00ee-dc9b-4140-8a8e-59ac56e3882e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:26.408657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bdaaf-91c7-4c48-a26e-983c6e425101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:26.409355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bdaaf-91c7-4c48-a26e-983c6e425101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:26.409682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bdaaf-91c7-4c48-a26e-983c6e425101 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:26.410171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bdaaf-91c7-4c48-a26e-983c6e425101 admin admin] PATH_INFO: `/v3/projects/860cb9657c144026b4e01780764d9887` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:26.411723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bdaaf-91c7-4c48-a26e-983c6e425101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=860cb9657c144026b4e01780764d9887)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:26.414832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bdaaf-91c7-4c48-a26e-983c6e425101 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:26.451143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:26.485800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-955bdaaf-91c7-4c48-a26e-983c6e425101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860cb9657c144026b4e01780764d9887', 'request_id': 'req-955bdaaf-91c7-4c48-a26e-983c6e425101'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:26.504521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-955bdaaf-91c7-4c48-a26e-983c6e425101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860cb9657c144026b4e01780764d9887', 'request_id': 'req-955bdaaf-91c7-4c48-a26e-983c6e425101'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:26.514948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-955bdaaf-91c7-4c48-a26e-983c6e425101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860cb9657c144026b4e01780764d9887', 'request_id': 'req-955bdaaf-91c7-4c48-a26e-983c6e425101'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:26.532514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-955bdaaf-91c7-4c48-a26e-983c6e425101 admin admin] The token cache is being invalidate because project 860cb9657c144026b4e01780764d9887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:22:26.533529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-955bdaaf-91c7-4c48-a26e-983c6e425101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:26.534691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-955bdaaf-91c7-4c48-a26e-983c6e425101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:26.537761 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3843/7669] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:22:26 2022] DELETE /identity/v3/projects/860cb9657c144026b4e01780764d9887 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:22:26.544057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11af3-0bde-4476-8951-650a9b2832a8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:26.544352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11af3-0bde-4476-8951-650a9b2832a8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:26.544690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11af3-0bde-4476-8951-650a9b2832a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:26.578152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c9d11af3-0bde-4476-8951-650a9b2832a8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:26.580755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c9d11af3-0bde-4476-8951-650a9b2832a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:26.638213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:26.699616 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3827/7670] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:26.710563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251a844-5f99-48cf-b311-57a865e44be6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:26.711394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251a844-5f99-48cf-b311-57a865e44be6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:26.712656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251a844-5f99-48cf-b311-57a865e44be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:26.740372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a251a844-5f99-48cf-b311-57a865e44be6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:26.741889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a251a844-5f99-48cf-b311-57a865e44be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:26.753643 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3844/7671] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:26.758711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d11af3-0bde-4476-8951-650a9b2832a8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:26.773622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d11af3-0bde-4476-8951-650a9b2832a8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:26.796176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d508d2-431f-45a4-8760-d83bd9a5cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:26.797266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d508d2-431f-45a4-8760-d83bd9a5cb03 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:26.797558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d508d2-431f-45a4-8760-d83bd9a5cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:26.797985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d508d2-431f-45a4-8760-d83bd9a5cb03 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:26.798841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d508d2-431f-45a4-8760-d83bd9a5cb03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:22:26.799025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d508d2-431f-45a4-8760-d83bd9a5cb03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:26.801463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d508d2-431f-45a4-8760-d83bd9a5cb03 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:26.819259 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3828/7672] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:22:26.825043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251a844-5f99-48cf-b311-57a865e44be6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:26.835634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251a844-5f99-48cf-b311-57a865e44be6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:26.845972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371473d-6d66-4149-ad76-a38f88b644e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:26.846597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371473d-6d66-4149-ad76-a38f88b644e4 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:26.846894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371473d-6d66-4149-ad76-a38f88b644e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:26.847159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371473d-6d66-4149-ad76-a38f88b644e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:26.847858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371473d-6d66-4149-ad76-a38f88b644e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:26.853373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371473d-6d66-4149-ad76-a38f88b644e4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:26.895005 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3845/7673] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:22:26 2022] POST /identity/v3/projects => generated 389 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:22:26.900435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d508d2-431f-45a4-8760-d83bd9a5cb03 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:26.924421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d508d2-431f-45a4-8760-d83bd9a5cb03 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:27.005687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691acb2-6617-4abd-bc69-8491a7bc2d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:27.007301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691acb2-6617-4abd-bc69-8491a7bc2d06 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:27.007851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691acb2-6617-4abd-bc69-8491a7bc2d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:27.008308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691acb2-6617-4abd-bc69-8491a7bc2d06 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:27.009525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691acb2-6617-4abd-bc69-8491a7bc2d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:27.011673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691acb2-6617-4abd-bc69-8491a7bc2d06 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:27.051734 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3829/7674] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:22:26 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:22:27.053874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371473d-6d66-4149-ad76-a38f88b644e4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:27.068463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371473d-6d66-4149-ad76-a38f88b644e4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:27.074569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0abe4-5da7-4277-a55c-2d98cf667dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:27.075729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0abe4-5da7-4277-a55c-2d98cf667dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:27.076270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0abe4-5da7-4277-a55c-2d98cf667dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:27.076775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0abe4-5da7-4277-a55c-2d98cf667dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:27.078309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0abe4-5da7-4277-a55c-2d98cf667dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:27.080548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0abe4-5da7-4277-a55c-2d98cf667dd2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:27.093229 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3846/7675] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:22:27.096533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691acb2-6617-4abd-bc69-8491a7bc2d06 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:27.114787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691acb2-6617-4abd-bc69-8491a7bc2d06 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:27.124261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508778a-516f-49b4-a10d-9a6efdadbe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:27.124907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508778a-516f-49b4-a10d-9a6efdadbe1a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:27.125176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508778a-516f-49b4-a10d-9a6efdadbe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:27.125482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508778a-516f-49b4-a10d-9a6efdadbe1a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:27.126136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508778a-516f-49b4-a10d-9a6efdadbe1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:27.127739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508778a-516f-49b4-a10d-9a6efdadbe1a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:27.141431 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3830/7676] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:22:27.145656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0abe4-5da7-4277-a55c-2d98cf667dd2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:27.157942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0abe4-5da7-4277-a55c-2d98cf667dd2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:27.163269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f256a87-93f0-460a-ab9c-a14ed170c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:27.163938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f256a87-93f0-460a-ab9c-a14ed170c5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:27.164219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f256a87-93f0-460a-ab9c-a14ed170c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:27.165237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f256a87-93f0-460a-ab9c-a14ed170c5f0 admin admin] PATH_INFO: `/v3/projects/e5fd83b3bdef4ba18ba56a9385e26d01/users/33a0d81fb2dd4891901f27890ce7688e/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:27.182746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f256a87-93f0-460a-ab9c-a14ed170c5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5fd83b3bdef4ba18ba56a9385e26d01, user_id=33a0d81fb2dd4891901f27890ce7688e, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:27.185961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f256a87-93f0-460a-ab9c-a14ed170c5f0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:27.210101 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3847/7677] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:22:27 2022] PUT /identity/v3/projects/e5fd83b3bdef4ba18ba56a9385e26d01/users/33a0d81fb2dd4891901f27890ce7688e/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:22:27.221297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86586f8-07df-4e51-b844-22d03ee89538 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:27.221590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86586f8-07df-4e51-b844-22d03ee89538 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:27.221876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86586f8-07df-4e51-b844-22d03ee89538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:27.265968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d86586f8-07df-4e51-b844-22d03ee89538 None None] MFA Rules not processed for user `33a0d81fb2dd4891901f27890ce7688e`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:27.267305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d86586f8-07df-4e51-b844-22d03ee89538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:27.349862 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3831/7678] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:27.355318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f256a87-93f0-460a-ab9c-a14ed170c5f0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:27.438207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f256a87-93f0-460a-ab9c-a14ed170c5f0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:27.450053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ffed3-a2d5-4e3d-b716-65d4bdbeef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:27.450686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ffed3-a2d5-4e3d-b716-65d4bdbeef8d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:27.450970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ffed3-a2d5-4e3d-b716-65d4bdbeef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:27.451245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ffed3-a2d5-4e3d-b716-65d4bdbeef8d admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:27.452235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ffed3-a2d5-4e3d-b716-65d4bdbeef8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:27.453910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ffed3-a2d5-4e3d-b716-65d4bdbeef8d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:27.502358 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3848/7679] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:22:27 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:22:27.506037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86586f8-07df-4e51-b844-22d03ee89538 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:27.523534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86586f8-07df-4e51-b844-22d03ee89538 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:27.549276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:27.602292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3231cd-4f0f-4d8e-b105-6068843c6d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:27.603047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3231cd-4f0f-4d8e-b105-6068843c6d17 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:27.603410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3231cd-4f0f-4d8e-b105-6068843c6d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:27.603750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3231cd-4f0f-4d8e-b105-6068843c6d17 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:27.604721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3231cd-4f0f-4d8e-b105-6068843c6d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:27.606782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3231cd-4f0f-4d8e-b105-6068843c6d17 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:27.635253 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3832/7680] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:22:27 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:22:27.636983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ffed3-a2d5-4e3d-b716-65d4bdbeef8d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:27.652730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ffed3-a2d5-4e3d-b716-65d4bdbeef8d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:27.658464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043d32a-6155-4069-a6d0-1f1ccd1c9063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:27.659285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043d32a-6155-4069-a6d0-1f1ccd1c9063 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:27.659615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043d32a-6155-4069-a6d0-1f1ccd1c9063 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:27.659861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043d32a-6155-4069-a6d0-1f1ccd1c9063 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:27.660650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043d32a-6155-4069-a6d0-1f1ccd1c9063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:27.662368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043d32a-6155-4069-a6d0-1f1ccd1c9063 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:27.682768 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3849/7681] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:22:27.683500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3231cd-4f0f-4d8e-b105-6068843c6d17 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:27.694345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3231cd-4f0f-4d8e-b105-6068843c6d17 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:27.700859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db49baa-0184-4b7c-818e-de740511f00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:27.701864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db49baa-0184-4b7c-818e-de740511f00b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:27.703293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db49baa-0184-4b7c-818e-de740511f00b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:27.704025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db49baa-0184-4b7c-818e-de740511f00b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:27.704942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db49baa-0184-4b7c-818e-de740511f00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:27.707118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db49baa-0184-4b7c-818e-de740511f00b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:27.722885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3833/7682] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:22:27.727065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043d32a-6155-4069-a6d0-1f1ccd1c9063 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:27.740679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043d32a-6155-4069-a6d0-1f1ccd1c9063 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:27.747729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814e80a-d314-4701-ac08-9c2955247a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:27.748420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814e80a-d314-4701-ac08-9c2955247a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:27.748769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814e80a-d314-4701-ac08-9c2955247a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:27.749181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814e80a-d314-4701-ac08-9c2955247a2c admin admin] PATH_INFO: `/v3/projects/aa8345d566614a48a20217feaf96f76b/users/a71abcce7dd744f9a193f5fd82d50f43/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:27.775109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814e80a-d314-4701-ac08-9c2955247a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8345d566614a48a20217feaf96f76b, user_id=a71abcce7dd744f9a193f5fd82d50f43, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:27.777853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814e80a-d314-4701-ac08-9c2955247a2c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:27.780291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:27.805507 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3850/7683] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:22:27 2022] PUT /identity/v3/projects/aa8345d566614a48a20217feaf96f76b/users/a71abcce7dd744f9a193f5fd82d50f43/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:22:27.813149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced966e-a379-4e83-8b83-5b57583ab320 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:27.813426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced966e-a379-4e83-8b83-5b57583ab320 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:27.813686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced966e-a379-4e83-8b83-5b57583ab320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:27.857831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1ced966e-a379-4e83-8b83-5b57583ab320 None None] MFA Rules not processed for user `a71abcce7dd744f9a193f5fd82d50f43`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:27.859525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1ced966e-a379-4e83-8b83-5b57583ab320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:27.964170 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3834/7684] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:22:27.965676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814e80a-d314-4701-ac08-9c2955247a2c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:28.059124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814e80a-d314-4701-ac08-9c2955247a2c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:28.065986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a4b03-2b4c-401f-9ab1-69b333e325b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:28.066539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4b03-2b4c-401f-9ab1-69b333e325b7 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:28.066880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4b03-2b4c-401f-9ab1-69b333e325b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:28.067095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4b03-2b4c-401f-9ab1-69b333e325b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:28.068043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a4b03-2b4c-401f-9ab1-69b333e325b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:28.070191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a4b03-2b4c-401f-9ab1-69b333e325b7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:28.120707 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3851/7685] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:22:27 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:22:28.122677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced966e-a379-4e83-8b83-5b57583ab320 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:28.151985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced966e-a379-4e83-8b83-5b57583ab320 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:28.283807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879b42e-84ba-4e76-a44c-39f5ec491e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:28.283807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b42e-84ba-4e76-a44c-39f5ec491e22 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:28.284107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b42e-84ba-4e76-a44c-39f5ec491e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:28.284351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b42e-84ba-4e76-a44c-39f5ec491e22 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:28.285020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879b42e-84ba-4e76-a44c-39f5ec491e22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:28.287427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879b42e-84ba-4e76-a44c-39f5ec491e22 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:28.325469 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3835/7686] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:22:28 2022] POST /identity/v3/users => generated 300 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:22:28.329376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a4b03-2b4c-401f-9ab1-69b333e325b7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:28.347608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a4b03-2b4c-401f-9ab1-69b333e325b7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:28.353342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e88afd-89bd-47f7-b6cb-a2b8e927328b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:28.354369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e88afd-89bd-47f7-b6cb-a2b8e927328b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:28.355114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e88afd-89bd-47f7-b6cb-a2b8e927328b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:28.355561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e88afd-89bd-47f7-b6cb-a2b8e927328b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:28.356622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e88afd-89bd-47f7-b6cb-a2b8e927328b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:28.357891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e88afd-89bd-47f7-b6cb-a2b8e927328b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:28.370112 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3852/7687] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:22:28.374361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879b42e-84ba-4e76-a44c-39f5ec491e22 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:28.384942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879b42e-84ba-4e76-a44c-39f5ec491e22 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:28.389826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298d77d-799e-4e2b-b9ce-69038079143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:28.390491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298d77d-799e-4e2b-b9ce-69038079143c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:28.390773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298d77d-799e-4e2b-b9ce-69038079143c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:28.391044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298d77d-799e-4e2b-b9ce-69038079143c admin admin] PATH_INFO: `/v3/projects/5286be7c4b2d495892edec8a012504fa/users/d68fd5a95f314a45bef189ba701c3f9c/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:28.408445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298d77d-799e-4e2b-b9ce-69038079143c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5286be7c4b2d495892edec8a012504fa, user_id=d68fd5a95f314a45bef189ba701c3f9c, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:28.411419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298d77d-799e-4e2b-b9ce-69038079143c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:28.415496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:28.434878 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3836/7688] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:22:28 2022] PUT /identity/v3/projects/5286be7c4b2d495892edec8a012504fa/users/d68fd5a95f314a45bef189ba701c3f9c/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:22:28.435809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e88afd-89bd-47f7-b6cb-a2b8e927328b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:28.449520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e88afd-89bd-47f7-b6cb-a2b8e927328b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:28.539081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432813a3-54e8-41c1-a158-45e1006eacd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:28.539720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432813a3-54e8-41c1-a158-45e1006eacd2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:28.540488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432813a3-54e8-41c1-a158-45e1006eacd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:28.540759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432813a3-54e8-41c1-a158-45e1006eacd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:28.541428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432813a3-54e8-41c1-a158-45e1006eacd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:28.543159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432813a3-54e8-41c1-a158-45e1006eacd2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:28.553622 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3853/7689] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:22:28.558153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298d77d-799e-4e2b-b9ce-69038079143c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:28.569842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298d77d-799e-4e2b-b9ce-69038079143c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:28.574847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74abd5-d7ab-43a1-b3ce-d4cdc6702912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:28.575564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74abd5-d7ab-43a1-b3ce-d4cdc6702912 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:28.575791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74abd5-d7ab-43a1-b3ce-d4cdc6702912 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:28.576070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74abd5-d7ab-43a1-b3ce-d4cdc6702912 admin admin] PATH_INFO: `/v3/projects/5286be7c4b2d495892edec8a012504fa/users/d68fd5a95f314a45bef189ba701c3f9c/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:28.578056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74abd5-d7ab-43a1-b3ce-d4cdc6702912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5286be7c4b2d495892edec8a012504fa, user_id=d68fd5a95f314a45bef189ba701c3f9c, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:28.580731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74abd5-d7ab-43a1-b3ce-d4cdc6702912 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:28.592182 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3837/7690] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:22:28 2022] PUT /identity/v3/projects/5286be7c4b2d495892edec8a012504fa/users/d68fd5a95f314a45bef189ba701c3f9c/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:22:28.602245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c8f98-74c7-47c4-9ac3-c156fd28a4c3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:28.603108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c8f98-74c7-47c4-9ac3-c156fd28a4c3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:28.603390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c8f98-74c7-47c4-9ac3-c156fd28a4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:28.635608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-907c8f98-74c7-47c4-9ac3-c156fd28a4c3 None None] MFA Rules not processed for user `d68fd5a95f314a45bef189ba701c3f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:28.636817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-907c8f98-74c7-47c4-9ac3-c156fd28a4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:28.687509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:28.707539 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3854/7691] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:28.722356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74abd5-d7ab-43a1-b3ce-d4cdc6702912 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:28.724128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6f74abd5-d7ab-43a1-b3ce-d4cdc6702912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:28.803786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74abd5-d7ab-43a1-b3ce-d4cdc6702912 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:28.809968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5924c4-0b49-4b3e-a768-12aa649b349d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:28.810573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5924c4-0b49-4b3e-a768-12aa649b349d service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:28.810849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5924c4-0b49-4b3e-a768-12aa649b349d service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:28.811118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5924c4-0b49-4b3e-a768-12aa649b349d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:28.873092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5924c4-0b49-4b3e-a768-12aa649b349d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:28.874700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5924c4-0b49-4b3e-a768-12aa649b349d service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:28.884483 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3838/7692] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:31.911937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c8f98-74c7-47c4-9ac3-c156fd28a4c3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:31.913519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-907c8f98-74c7-47c4-9ac3-c156fd28a4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:32.005336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c8f98-74c7-47c4-9ac3-c156fd28a4c3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:32.009304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709e374-3cbc-4e30-91f4-6c15da0a474c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:32.010005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709e374-3cbc-4e30-91f4-6c15da0a474c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:32.010443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709e374-3cbc-4e30-91f4-6c15da0a474c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:32.010907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709e374-3cbc-4e30-91f4-6c15da0a474c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:32.022243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709e374-3cbc-4e30-91f4-6c15da0a474c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:32.025595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709e374-3cbc-4e30-91f4-6c15da0a474c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:32.048562 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3855/7693] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:36.594216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5924c4-0b49-4b3e-a768-12aa649b349d service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:36.598226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2d5924c4-0b49-4b3e-a768-12aa649b349d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:36.637927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5924c4-0b49-4b3e-a768-12aa649b349d service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:36.666218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4aecbe-2d2e-40c5-be32-033107c1d410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:36.667038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aecbe-2d2e-40c5-be32-033107c1d410 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:36.667425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aecbe-2d2e-40c5-be32-033107c1d410 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:36.668581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4aecbe-2d2e-40c5-be32-033107c1d410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:36.671051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-aa4aecbe-2d2e-40c5-be32-033107c1d410 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:36.801951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4aecbe-2d2e-40c5-be32-033107c1d410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:36.803839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4aecbe-2d2e-40c5-be32-033107c1d410 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:36.826930 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3839/7694] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:38.474774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74646383-f4e6-45e1-84c2-6ab03ab40a66 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:38.477872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74646383-f4e6-45e1-84c2-6ab03ab40a66 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:38.478453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74646383-f4e6-45e1-84c2-6ab03ab40a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:38.520776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-74646383-f4e6-45e1-84c2-6ab03ab40a66 None None] MFA Rules not processed for user `33a0d81fb2dd4891901f27890ce7688e`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:38.544631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-74646383-f4e6-45e1-84c2-6ab03ab40a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:38.559051 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3856/7695] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:38.927657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64c5db-5b55-4ef8-a129-2dfe9b3369cb None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:38.928223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64c5db-5b55-4ef8-a129-2dfe9b3369cb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:38.928223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64c5db-5b55-4ef8-a129-2dfe9b3369cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:38.953775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5d64c5db-5b55-4ef8-a129-2dfe9b3369cb None None] MFA Rules not processed for user `2f98e01cab6b49c7a5d239aee95f4a64`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:38.955264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5d64c5db-5b55-4ef8-a129-2dfe9b3369cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:38.963718 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3840/7696] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:22:39.704628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74646383-f4e6-45e1-84c2-6ab03ab40a66 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:39.716937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74646383-f4e6-45e1-84c2-6ab03ab40a66 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:39.721216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197ba1e-ca0f-4fa4-9d74-80e278b17a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:39.721875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197ba1e-ca0f-4fa4-9d74-80e278b17a2b service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:39.722151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197ba1e-ca0f-4fa4-9d74-80e278b17a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:39.722421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197ba1e-ca0f-4fa4-9d74-80e278b17a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:39.724254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4197ba1e-ca0f-4fa4-9d74-80e278b17a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:39.738360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197ba1e-ca0f-4fa4-9d74-80e278b17a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:39.740039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197ba1e-ca0f-4fa4-9d74-80e278b17a2b service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:39.751806 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3857/7697] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:39.825080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64c5db-5b55-4ef8-a129-2dfe9b3369cb None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:39.826640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5d64c5db-5b55-4ef8-a129-2dfe9b3369cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:39.842451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:39.995217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64c5db-5b55-4ef8-a129-2dfe9b3369cb None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:40.003259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:40.004322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:40.004773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:40.005955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] PATH_INFO: `/v3/users/4db99ab4d71a4b9e99d509dc243f4928` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:40.007849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db99ab4d71a4b9e99d509dc243f4928)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:40.010770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:40.087951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db99ab4d71a4b9e99d509dc243f4928'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:40.097920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db99ab4d71a4b9e99d509dc243f4928'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:40.098991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db99ab4d71a4b9e99d509dc243f4928'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:40.099798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db99ab4d71a4b9e99d509dc243f4928'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:40.122701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db99ab4d71a4b9e99d509dc243f4928'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:40.157878 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3841/7698] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:22:39 2022] DELETE /identity/v3/users/4db99ab4d71a4b9e99d509dc243f4928 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:22:40.163660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9221dd-5231-4379-a0bc-1dd1de8014d6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:40.164239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9221dd-5231-4379-a0bc-1dd1de8014d6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:40.164714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9221dd-5231-4379-a0bc-1dd1de8014d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:40.204770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-de9221dd-5231-4379-a0bc-1dd1de8014d6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:40.206345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-de9221dd-5231-4379-a0bc-1dd1de8014d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:40.349920 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3858/7699] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:40.379269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:40.380994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:40.502694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7da278-c1d8-4229-8ef5-07c66835b732 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:40.513991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f27147-ef2c-4a2b-b960-58a4a70444bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:40.514933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f27147-ef2c-4a2b-b960-58a4a70444bd service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:40.515481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f27147-ef2c-4a2b-b960-58a4a70444bd service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:40.515952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f27147-ef2c-4a2b-b960-58a4a70444bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:40.528985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f27147-ef2c-4a2b-b960-58a4a70444bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:40.531994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f27147-ef2c-4a2b-b960-58a4a70444bd service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:40.553387 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3842/7700] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:40.904220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9221dd-5231-4379-a0bc-1dd1de8014d6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:40.906116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-de9221dd-5231-4379-a0bc-1dd1de8014d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:41.127678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9221dd-5231-4379-a0bc-1dd1de8014d6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:41.141141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f27147-ef2c-4a2b-b960-58a4a70444bd service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:41.143190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b5f27147-ef2c-4a2b-b960-58a4a70444bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:41.145414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ededf5-4e84-4268-aa5b-810139c416d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:41.146427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ededf5-4e84-4268-aa5b-810139c416d1 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:41.147313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ededf5-4e84-4268-aa5b-810139c416d1 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:41.148298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ededf5-4e84-4268-aa5b-810139c416d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:41.153369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-86ededf5-4e84-4268-aa5b-810139c416d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:41.170562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f27147-ef2c-4a2b-b960-58a4a70444bd service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:41.181737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ededf5-4e84-4268-aa5b-810139c416d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:41.183221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801f8aa-b1cb-4762-8146-25652c584ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:41.185467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801f8aa-b1cb-4762-8146-25652c584ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:41.185608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ededf5-4e84-4268-aa5b-810139c416d1 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:41.186169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801f8aa-b1cb-4762-8146-25652c584ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:41.187621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801f8aa-b1cb-4762-8146-25652c584ffc admin admin] PATH_INFO: `/v3/projects/5186f4bdb40744599fddf443f05c9824` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:41.190505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801f8aa-b1cb-4762-8146-25652c584ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5186f4bdb40744599fddf443f05c9824)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:41.192769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:41.197027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801f8aa-b1cb-4762-8146-25652c584ffc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:41.223476 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3859/7701] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:41.272643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:41.293652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8801f8aa-b1cb-4762-8146-25652c584ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5186f4bdb40744599fddf443f05c9824', 'request_id': 'req-8801f8aa-b1cb-4762-8146-25652c584ffc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:41.306616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8801f8aa-b1cb-4762-8146-25652c584ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5186f4bdb40744599fddf443f05c9824', 'request_id': 'req-8801f8aa-b1cb-4762-8146-25652c584ffc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:41.314540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8801f8aa-b1cb-4762-8146-25652c584ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5186f4bdb40744599fddf443f05c9824', 'request_id': 'req-8801f8aa-b1cb-4762-8146-25652c584ffc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:41.329731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8801f8aa-b1cb-4762-8146-25652c584ffc admin admin] The token cache is being invalidate because project 5186f4bdb40744599fddf443f05c9824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:22:41.330456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8801f8aa-b1cb-4762-8146-25652c584ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:41.331846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8801f8aa-b1cb-4762-8146-25652c584ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:22:41.334692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ededf5-4e84-4268-aa5b-810139c416d1 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:41.350827 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3843/7702] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:22:41 2022] DELETE /identity/v3/projects/5186f4bdb40744599fddf443f05c9824 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:22:41.352732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ededf5-4e84-4268-aa5b-810139c416d1 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:41.359803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e223fcf-919f-48ef-a434-23588d634e59 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:41.360190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e223fcf-919f-48ef-a434-23588d634e59 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:41.360563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e223fcf-919f-48ef-a434-23588d634e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:41.415849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7e223fcf-919f-48ef-a434-23588d634e59 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:41.422046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7e223fcf-919f-48ef-a434-23588d634e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:41.509406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc16cc4-71e3-4a80-9147-6cfd6ec31ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:41.510454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc16cc4-71e3-4a80-9147-6cfd6ec31ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:41.513069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc16cc4-71e3-4a80-9147-6cfd6ec31ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:41.515035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc16cc4-71e3-4a80-9147-6cfd6ec31ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:41.520187 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5dc16cc4-71e3-4a80-9147-6cfd6ec31ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:41.546471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc16cc4-71e3-4a80-9147-6cfd6ec31ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:41.548352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc16cc4-71e3-4a80-9147-6cfd6ec31ca0 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:41.561931 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3860/7703] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:22:41.575994 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3844/7704] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:41.583834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a83d1-3ca7-45a9-b3fc-8aa2416f8f7a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:41.584700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a83d1-3ca7-45a9-b3fc-8aa2416f8f7a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:41.584991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a83d1-3ca7-45a9-b3fc-8aa2416f8f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:41.625284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b27a83d1-3ca7-45a9-b3fc-8aa2416f8f7a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:41.628574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b27a83d1-3ca7-45a9-b3fc-8aa2416f8f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:41.652765 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3861/7705] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:41.656924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e223fcf-919f-48ef-a434-23588d634e59 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:41.672280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e223fcf-919f-48ef-a434-23588d634e59 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:41.701986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe80a6-18d3-4bf3-9a15-4c28ab3e149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:41.702831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe80a6-18d3-4bf3-9a15-4c28ab3e149a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:41.703303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe80a6-18d3-4bf3-9a15-4c28ab3e149a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:41.703956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe80a6-18d3-4bf3-9a15-4c28ab3e149a admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:41.704800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe80a6-18d3-4bf3-9a15-4c28ab3e149a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:22:41.705294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe80a6-18d3-4bf3-9a15-4c28ab3e149a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:41.707347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe80a6-18d3-4bf3-9a15-4c28ab3e149a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:41.728827 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3845/7706] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:22:41.729074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a83d1-3ca7-45a9-b3fc-8aa2416f8f7a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:41.740315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a83d1-3ca7-45a9-b3fc-8aa2416f8f7a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:41.756221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75252df9-0c85-4d91-ac49-e345b1b6c6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:41.758293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75252df9-0c85-4d91-ac49-e345b1b6c6dd admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:41.759677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75252df9-0c85-4d91-ac49-e345b1b6c6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:41.760243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75252df9-0c85-4d91-ac49-e345b1b6c6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:41.761281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75252df9-0c85-4d91-ac49-e345b1b6c6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:41.763459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75252df9-0c85-4d91-ac49-e345b1b6c6dd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:41.810407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe80a6-18d3-4bf3-9a15-4c28ab3e149a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:41.819507 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3862/7707] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:22:41 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:22:41.836230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe80a6-18d3-4bf3-9a15-4c28ab3e149a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:41.910590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262d53e-2643-4d99-8707-7bf43f6b2e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:41.911502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262d53e-2643-4d99-8707-7bf43f6b2e2b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:41.911502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262d53e-2643-4d99-8707-7bf43f6b2e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:41.911807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262d53e-2643-4d99-8707-7bf43f6b2e2b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:41.912431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262d53e-2643-4d99-8707-7bf43f6b2e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:41.921208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262d53e-2643-4d99-8707-7bf43f6b2e2b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:41.948903 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3846/7708] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:22:41 2022] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:22:41.956784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75252df9-0c85-4d91-ac49-e345b1b6c6dd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:41.969282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75252df9-0c85-4d91-ac49-e345b1b6c6dd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:41.979659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b087d-e6ce-43e8-9dfd-6b5b34240157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:41.980960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b087d-e6ce-43e8-9dfd-6b5b34240157 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:41.981752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b087d-e6ce-43e8-9dfd-6b5b34240157 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:41.982146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b087d-e6ce-43e8-9dfd-6b5b34240157 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:41.983022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b087d-e6ce-43e8-9dfd-6b5b34240157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:41.984865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b087d-e6ce-43e8-9dfd-6b5b34240157 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:42.003653 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3863/7709] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:22:42.004360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262d53e-2643-4d99-8707-7bf43f6b2e2b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:42.023216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262d53e-2643-4d99-8707-7bf43f6b2e2b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:42.035677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65d59d-9d58-4c0b-8104-5c8217154749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:42.035677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d59d-9d58-4c0b-8104-5c8217154749 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:42.036082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d59d-9d58-4c0b-8104-5c8217154749 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:42.036199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d59d-9d58-4c0b-8104-5c8217154749 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:42.036863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65d59d-9d58-4c0b-8104-5c8217154749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:42.038546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65d59d-9d58-4c0b-8104-5c8217154749 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:42.054036 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3847/7710] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:22:42.058635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b087d-e6ce-43e8-9dfd-6b5b34240157 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:42.075223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b087d-e6ce-43e8-9dfd-6b5b34240157 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:42.082683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ccf03-c60d-4228-a3f5-4403ddcf2c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:42.083641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ccf03-c60d-4228-a3f5-4403ddcf2c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:42.084109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ccf03-c60d-4228-a3f5-4403ddcf2c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:42.084563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ccf03-c60d-4228-a3f5-4403ddcf2c40 admin admin] PATH_INFO: `/v3/projects/79ca527e0ce04141918a22857853190d/users/eb3eab252f7b4f45b86de02d1b9e8583/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:42.119743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ccf03-c60d-4228-a3f5-4403ddcf2c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ca527e0ce04141918a22857853190d, user_id=eb3eab252f7b4f45b86de02d1b9e8583, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:42.123251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ccf03-c60d-4228-a3f5-4403ddcf2c40 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:42.144754 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3864/7711] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:22:42 2022] PUT /identity/v3/projects/79ca527e0ce04141918a22857853190d/users/eb3eab252f7b4f45b86de02d1b9e8583/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:22:42.151390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0c5aa-42cb-4fa3-aa8a-2f50bfde5579 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:42.151968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0c5aa-42cb-4fa3-aa8a-2f50bfde5579 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:42.152223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0c5aa-42cb-4fa3-aa8a-2f50bfde5579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:42.201583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7ba0c5aa-42cb-4fa3-aa8a-2f50bfde5579 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:42.207551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7ba0c5aa-42cb-4fa3-aa8a-2f50bfde5579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:42.241353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:42.369563 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3848/7712] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:42.402266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ccf03-c60d-4228-a3f5-4403ddcf2c40 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:42.404542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c92ccf03-c60d-4228-a3f5-4403ddcf2c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:42.560216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ccf03-c60d-4228-a3f5-4403ddcf2c40 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:42.572741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84497a-a6de-4a4a-9045-079817246212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:42.574144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84497a-a6de-4a4a-9045-079817246212 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:42.574433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84497a-a6de-4a4a-9045-079817246212 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:42.574719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84497a-a6de-4a4a-9045-079817246212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:42.593231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84497a-a6de-4a4a-9045-079817246212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:42.595861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84497a-a6de-4a4a-9045-079817246212 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:42.609087 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3865/7713] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:43.927022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0c5aa-42cb-4fa3-aa8a-2f50bfde5579 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:43.929020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7ba0c5aa-42cb-4fa3-aa8a-2f50bfde5579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:43.966596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0c5aa-42cb-4fa3-aa8a-2f50bfde5579 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:43.989788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065e1a7-169a-4cec-8163-ead416c98dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:43.990438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065e1a7-169a-4cec-8163-ead416c98dbf service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:43.990914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065e1a7-169a-4cec-8163-ead416c98dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:43.991361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065e1a7-169a-4cec-8163-ead416c98dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:43.997726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4065e1a7-169a-4cec-8163-ead416c98dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:44.031972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065e1a7-169a-4cec-8163-ead416c98dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:44.033622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065e1a7-169a-4cec-8163-ead416c98dbf service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:44.059797 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3849/7714] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:47.242286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84497a-a6de-4a4a-9045-079817246212 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:47.247352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6e84497a-a6de-4a4a-9045-079817246212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:47.302455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:47.356228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84497a-a6de-4a4a-9045-079817246212 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:47.364704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eba553-4d52-42c7-bb86-9534a07039c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:47.365427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eba553-4d52-42c7-bb86-9534a07039c2 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:47.366181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eba553-4d52-42c7-bb86-9534a07039c2 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:47.366325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eba553-4d52-42c7-bb86-9534a07039c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:47.368581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-51eba553-4d52-42c7-bb86-9534a07039c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:47.386131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eba553-4d52-42c7-bb86-9534a07039c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:47.387748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eba553-4d52-42c7-bb86-9534a07039c2 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:47.405579 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3866/7715] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:22:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:22:52.645384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd7392-b579-4a6a-b6a0-05a80867fb65 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:52.646290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd7392-b579-4a6a-b6a0-05a80867fb65 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:52.646739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd7392-b579-4a6a-b6a0-05a80867fb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:52.692071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7fbd7392-b579-4a6a-b6a0-05a80867fb65 None None] MFA Rules not processed for user `eb3eab252f7b4f45b86de02d1b9e8583`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:52.693779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7fbd7392-b579-4a6a-b6a0-05a80867fb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:52.838071 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3850/7716] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:22:52.843210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eba553-4d52-42c7-bb86-9534a07039c2 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:52.860598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eba553-4d52-42c7-bb86-9534a07039c2 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:52.868054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021a7c5-90a9-4760-8ca2-63aabe36c8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:52.869146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021a7c5-90a9-4760-8ca2-63aabe36c8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:52.869639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021a7c5-90a9-4760-8ca2-63aabe36c8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:52.870076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021a7c5-90a9-4760-8ca2-63aabe36c8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:52.870967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021a7c5-90a9-4760-8ca2-63aabe36c8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:52.873887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021a7c5-90a9-4760-8ca2-63aabe36c8b0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:52.913999 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3867/7717] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:22:52 2022] POST /identity/v3/users => generated 286 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:22:52.915794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd7392-b579-4a6a-b6a0-05a80867fb65 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:52.936776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd7392-b579-4a6a-b6a0-05a80867fb65 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:52.987937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde426da-6bd6-40c1-9a7c-b716df39e2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:52.988959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde426da-6bd6-40c1-9a7c-b716df39e2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:52.989324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde426da-6bd6-40c1-9a7c-b716df39e2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:52.989606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde426da-6bd6-40c1-9a7c-b716df39e2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:52.990934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde426da-6bd6-40c1-9a7c-b716df39e2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:52.993346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde426da-6bd6-40c1-9a7c-b716df39e2f7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:53.013425 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3851/7718] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:22:53.017591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021a7c5-90a9-4760-8ca2-63aabe36c8b0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:53.033657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021a7c5-90a9-4760-8ca2-63aabe36c8b0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:53.075345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d5028-485e-43be-a4ef-11b17421ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:53.078466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d5028-485e-43be-a4ef-11b17421ce9e admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:53.080440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d5028-485e-43be-a4ef-11b17421ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:53.080827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d5028-485e-43be-a4ef-11b17421ce9e admin admin] PATH_INFO: `/v3/system/users/88315d2acaba4b75b7bf26420532665c/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:53.108305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d5028-485e-43be-a4ef-11b17421ce9e admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=88315d2acaba4b75b7bf26420532665c, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:53.109472 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-6b1d5028-485e-43be-a4ef-11b17421ce9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:22:53.109472 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:22:53.109472 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:22:53.110517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d5028-485e-43be-a4ef-11b17421ce9e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:53.126384 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3868/7719] 10.222.0.26 () {60 vars in 1378 bytes} [Sat Oct 8 21:22:53 2022] PUT /identity/v3/system/users/88315d2acaba4b75b7bf26420532665c/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:22:53.136875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557dc15-899a-49b3-95c3-24687fe0e62a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:53.137161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557dc15-899a-49b3-95c3-24687fe0e62a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:53.137749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557dc15-899a-49b3-95c3-24687fe0e62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:53.188883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5557dc15-899a-49b3-95c3-24687fe0e62a None None] MFA Rules not processed for user `88315d2acaba4b75b7bf26420532665c`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:22:53.191086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5557dc15-899a-49b3-95c3-24687fe0e62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:22:53.295543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:53.306600 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3852/7720] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:22:53 2022] POST /identity/v3/auth/tokens => generated 2413 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 21:22:53.311117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d5028-485e-43be-a4ef-11b17421ce9e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:53.506870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d5028-485e-43be-a4ef-11b17421ce9e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:53.573693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6806071-c6c0-4279-a590-a1def90a63a0 None tempest-ImageQuotaTest-23092181-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88315d2acaba4b75b7bf26420532665c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:53.574823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806071-c6c0-4279-a590-a1def90a63a0 None tempest-ImageQuotaTest-23092181-system-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:53.575486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806071-c6c0-4279-a590-a1def90a63a0 None tempest-ImageQuotaTest-23092181-system-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:53.576051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806071-c6c0-4279-a590-a1def90a63a0 None tempest-ImageQuotaTest-23092181-system-admin] PATH_INFO: `/v3/services` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:53.577172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6806071-c6c0-4279-a590-a1def90a63a0 None tempest-ImageQuotaTest-23092181-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:53.579247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6806071-c6c0-4279-a590-a1def90a63a0 None tempest-ImageQuotaTest-23092181-system-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:53.581643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:53.597957 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3869/7721] 10.222.0.26 () {58 vars in 1110 bytes} [Sat Oct 8 21:22:53 2022] GET /identity/v3/services => generated 2191 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:22:53.602832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557dc15-899a-49b3-95c3-24687fe0e62a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:53.779622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557dc15-899a-49b3-95c3-24687fe0e62a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:53.861915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6318490-d94f-44ad-969c-49d4c16700ef None tempest-ImageQuotaTest-23092181-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88315d2acaba4b75b7bf26420532665c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:53.862554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6318490-d94f-44ad-969c-49d4c16700ef None tempest-ImageQuotaTest-23092181-system-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:53.862838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6318490-d94f-44ad-969c-49d4c16700ef None tempest-ImageQuotaTest-23092181-system-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:53.863113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6318490-d94f-44ad-969c-49d4c16700ef None tempest-ImageQuotaTest-23092181-system-admin] PATH_INFO: `/v3/limits` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:53.863768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6318490-d94f-44ad-969c-49d4c16700ef None tempest-ImageQuotaTest-23092181-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:53.865117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6318490-d94f-44ad-969c-49d4c16700ef None tempest-ImageQuotaTest-23092181-system-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-c6318490-d94f-44ad-969c-49d4c16700ef None tempest-ImageQuotaTest-23092181-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 08 21:22:53.925987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 08 21:22:53.927306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:22:53.927306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:22:53.927306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 08 21:22:53.927306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 08 21:22:53.927306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 08 21:22:53.927306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 08 21:22:53.927306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 08 21:22:53.927306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 08 21:22:53.927306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 08 21:22:53.927306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 08 21:22:53.927306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 08 21:22:53.927306 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:22:53.931604 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3853/7722] 10.222.0.26 () {60 vars in 1126 bytes} [Sat Oct 8 21:22:53 2022] POST /identity/v3/limits => generated 124 bytes in 330 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:22:53.936993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6806071-c6c0-4279-a590-a1def90a63a0 None tempest-ImageQuotaTest-23092181-system-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:54.190919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6806071-c6c0-4279-a590-a1def90a63a0 None tempest-ImageQuotaTest-23092181-system-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:54.265810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c6fab-0fb3-473a-977f-7da3f9297907 None tempest-ImageQuotaTest-23092181-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88315d2acaba4b75b7bf26420532665c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:54.266757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6fab-0fb3-473a-977f-7da3f9297907 None tempest-ImageQuotaTest-23092181-system-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:54.267788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6fab-0fb3-473a-977f-7da3f9297907 None tempest-ImageQuotaTest-23092181-system-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:54.268308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6fab-0fb3-473a-977f-7da3f9297907 None tempest-ImageQuotaTest-23092181-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:54.269457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c6fab-0fb3-473a-977f-7da3f9297907 None tempest-ImageQuotaTest-23092181-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:54.271629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c6fab-0fb3-473a-977f-7da3f9297907 None tempest-ImageQuotaTest-23092181-system-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:54.293002 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3870/7723] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 21:22:53 2022] GET /identity/v3/registered_limits => generated 129 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:22:54.295576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6318490-d94f-44ad-969c-49d4c16700ef None tempest-ImageQuotaTest-23092181-system-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:22:54.387135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:54.476466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6318490-d94f-44ad-969c-49d4c16700ef None tempest-ImageQuotaTest-23092181-system-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:22:54.526792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15dc73-c6e8-4e29-bf4d-1bdbdc721b08 None tempest-ImageQuotaTest-23092181-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88315d2acaba4b75b7bf26420532665c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:22:54.527627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15dc73-c6e8-4e29-bf4d-1bdbdc721b08 None tempest-ImageQuotaTest-23092181-system-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:22:54.528012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15dc73-c6e8-4e29-bf4d-1bdbdc721b08 None tempest-ImageQuotaTest-23092181-system-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:22:54.528407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15dc73-c6e8-4e29-bf4d-1bdbdc721b08 None tempest-ImageQuotaTest-23092181-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:22:54.529140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15dc73-c6e8-4e29-bf4d-1bdbdc721b08 None tempest-ImageQuotaTest-23092181-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:22:54.530361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15dc73-c6e8-4e29-bf4d-1bdbdc721b08 None tempest-ImageQuotaTest-23092181-system-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:22:54.543141 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3854/7724] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 21:22:54 2022] GET /identity/v3/registered_limits => generated 129 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:23:01.475294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c69c-4774-47a4-9f4b-c38910e79da3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:01.476133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c69c-4774-47a4-9f4b-c38910e79da3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:01.476561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c69c-4774-47a4-9f4b-c38910e79da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:01.508726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d084c69c-4774-47a4-9f4b-c38910e79da3 None None] MFA Rules not processed for user `2f98e01cab6b49c7a5d239aee95f4a64`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:01.510219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d084c69c-4774-47a4-9f4b-c38910e79da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:01.670266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15dc73-c6e8-4e29-bf4d-1bdbdc721b08 None tempest-ImageQuotaTest-23092181-system-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:01.684709 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3871/7725] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:01.706422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15dc73-c6e8-4e29-bf4d-1bdbdc721b08 None tempest-ImageQuotaTest-23092181-system-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:01.716015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:01.723394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:01.723661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:01.723945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] PATH_INFO: `/v3/users/eb3eab252f7b4f45b86de02d1b9e8583` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:01.728370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3eab252f7b4f45b86de02d1b9e8583)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:01.734183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:01.865697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3eab252f7b4f45b86de02d1b9e8583'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:01.897066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3eab252f7b4f45b86de02d1b9e8583'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:01.899252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3eab252f7b4f45b86de02d1b9e8583'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:01.899829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3eab252f7b4f45b86de02d1b9e8583'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:01.932656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3eab252f7b4f45b86de02d1b9e8583'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:01.973109 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3855/7726] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:23:01 2022] DELETE /identity/v3/users/eb3eab252f7b4f45b86de02d1b9e8583 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:02.222313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084c69c-4774-47a4-9f4b-c38910e79da3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:02.237816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084c69c-4774-47a4-9f4b-c38910e79da3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:02.257066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:02.344277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb1caa-2821-4466-8f39-8727524f75ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:02.346350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb1caa-2821-4466-8f39-8727524f75ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:02.346789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb1caa-2821-4466-8f39-8727524f75ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:02.347830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb1caa-2821-4466-8f39-8727524f75ae admin admin] PATH_INFO: `/v3/projects/79ca527e0ce04141918a22857853190d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:02.349783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb1caa-2821-4466-8f39-8727524f75ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ca527e0ce04141918a22857853190d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:02.353920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb1caa-2821-4466-8f39-8727524f75ae admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:02.438190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ebb1caa-2821-4466-8f39-8727524f75ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ca527e0ce04141918a22857853190d', 'request_id': 'req-9ebb1caa-2821-4466-8f39-8727524f75ae'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:02.448795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ebb1caa-2821-4466-8f39-8727524f75ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ca527e0ce04141918a22857853190d', 'request_id': 'req-9ebb1caa-2821-4466-8f39-8727524f75ae'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:02.460137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ebb1caa-2821-4466-8f39-8727524f75ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ca527e0ce04141918a22857853190d', 'request_id': 'req-9ebb1caa-2821-4466-8f39-8727524f75ae'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:02.486064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ebb1caa-2821-4466-8f39-8727524f75ae admin admin] The token cache is being invalidate because project 79ca527e0ce04141918a22857853190d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:23:02.487574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ebb1caa-2821-4466-8f39-8727524f75ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:02.492991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9ebb1caa-2821-4466-8f39-8727524f75ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:02.494789 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3872/7727] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:23:02 2022] DELETE /identity/v3/projects/79ca527e0ce04141918a22857853190d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:02.499407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:02.500974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:02.515730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9cb72-9e09-4da3-9eec-2b69d13f4646 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:02.567201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:02.593242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:02.594473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:02.595422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:02.595810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] PATH_INFO: `/v3/users/88315d2acaba4b75b7bf26420532665c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:02.599312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88315d2acaba4b75b7bf26420532665c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:02.602601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:02.696502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88315d2acaba4b75b7bf26420532665c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:02.705918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88315d2acaba4b75b7bf26420532665c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:02.706717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88315d2acaba4b75b7bf26420532665c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:02.707919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88315d2acaba4b75b7bf26420532665c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:02.724785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88315d2acaba4b75b7bf26420532665c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:02.744885 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3856/7728] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:23:02 2022] DELETE /identity/v3/users/88315d2acaba4b75b7bf26420532665c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:12.474361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:12.738423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=37,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:17.100016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed44e3-af32-4902-bb02-fadc967a0229 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:17.100617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed44e3-af32-4902-bb02-fadc967a0229 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:17.100898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed44e3-af32-4902-bb02-fadc967a0229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:17.130516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bbed44e3-af32-4902-bb02-fadc967a0229 None None] MFA Rules not processed for user `e28f7acd53094828a7863ce2fd775cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:17.132503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bbed44e3-af32-4902-bb02-fadc967a0229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:17.250665 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3873/7729] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:18.205013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:18.206715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:18.353463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d291ece-4d9b-4863-bb21-3416b38c2795 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:18.360536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a02885-41f0-428c-9446-e66dc5287429 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:18.361587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a02885-41f0-428c-9446-e66dc5287429 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:18.362210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a02885-41f0-428c-9446-e66dc5287429 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:18.363046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a02885-41f0-428c-9446-e66dc5287429 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:18.365163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e7a02885-41f0-428c-9446-e66dc5287429 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:18.385845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a02885-41f0-428c-9446-e66dc5287429 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:18.387714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a02885-41f0-428c-9446-e66dc5287429 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:18.405311 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3857/7730] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:23:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:23:22.830514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98872be5-e7d4-45d6-bda6-17f14b5d0dbd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:22.831083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98872be5-e7d4-45d6-bda6-17f14b5d0dbd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:22.831879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98872be5-e7d4-45d6-bda6-17f14b5d0dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:22.886165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-98872be5-e7d4-45d6-bda6-17f14b5d0dbd None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:22.887383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-98872be5-e7d4-45d6-bda6-17f14b5d0dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:22.942751 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3874/7731] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:23.018480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a02885-41f0-428c-9446-e66dc5287429 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:23.036850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e7a02885-41f0-428c-9446-e66dc5287429 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:23.137785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a02885-41f0-428c-9446-e66dc5287429 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:23.145837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4099a-39ff-4a59-a531-4ae6cd14c5ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:23.147337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4099a-39ff-4a59-a531-4ae6cd14c5ad service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:23.147627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4099a-39ff-4a59-a531-4ae6cd14c5ad service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:23.148050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4099a-39ff-4a59-a531-4ae6cd14c5ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:23.165679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4099a-39ff-4a59-a531-4ae6cd14c5ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:23.167232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4099a-39ff-4a59-a531-4ae6cd14c5ad service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:23.177349 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3858/7732] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:23:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:23:24.833970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98872be5-e7d4-45d6-bda6-17f14b5d0dbd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:24.836663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-98872be5-e7d4-45d6-bda6-17f14b5d0dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:24.973968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98872be5-e7d4-45d6-bda6-17f14b5d0dbd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:24.985119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c1ba1-73a1-4cb1-ad8d-63857c3dd2d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:24.986069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c1ba1-73a1-4cb1-ad8d-63857c3dd2d1 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:24.986422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c1ba1-73a1-4cb1-ad8d-63857c3dd2d1 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:24.986806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c1ba1-73a1-4cb1-ad8d-63857c3dd2d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:24.993060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-315c1ba1-73a1-4cb1-ad8d-63857c3dd2d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:25.040672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c1ba1-73a1-4cb1-ad8d-63857c3dd2d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:25.042518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c1ba1-73a1-4cb1-ad8d-63857c3dd2d1 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:25.058568 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3875/7733] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:23:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:23:32.142065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4099a-39ff-4a59-a531-4ae6cd14c5ad service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:32.147000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c4b4099a-39ff-4a59-a531-4ae6cd14c5ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:32.293489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4099a-39ff-4a59-a531-4ae6cd14c5ad service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:32.301632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:32.302340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:32.302800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:32.303215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] PATH_INFO: `/v3/users/2c7a8733e171402e98d9c1bcd21dfc9e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:32.314425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7a8733e171402e98d9c1bcd21dfc9e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:32.318019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:32.353580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:32.434112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7a8733e171402e98d9c1bcd21dfc9e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:32.450230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7a8733e171402e98d9c1bcd21dfc9e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:32.451341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7a8733e171402e98d9c1bcd21dfc9e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:32.452044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7a8733e171402e98d9c1bcd21dfc9e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:32.477454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7a8733e171402e98d9c1bcd21dfc9e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:32.505856 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3859/7734] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:23:32 2022] DELETE /identity/v3/users/2c7a8733e171402e98d9c1bcd21dfc9e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:32.511260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721cb80-2773-4b48-8455-a67dd64ab163 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:32.512140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721cb80-2773-4b48-8455-a67dd64ab163 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:32.512473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721cb80-2773-4b48-8455-a67dd64ab163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:32.535506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a721cb80-2773-4b48-8455-a67dd64ab163 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:32.536821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a721cb80-2773-4b48-8455-a67dd64ab163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:32.542825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:32.615963 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3876/7735] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:32.627216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:32.628804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:32.707655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab600c-99dc-4c83-9bfc-23dbaaf118cf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:32.712697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096be768-45f8-46e4-93f3-0339e74eff84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:32.713667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096be768-45f8-46e4-93f3-0339e74eff84 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:32.714090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096be768-45f8-46e4-93f3-0339e74eff84 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:32.717771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096be768-45f8-46e4-93f3-0339e74eff84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:32.731366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096be768-45f8-46e4-93f3-0339e74eff84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:32.735482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096be768-45f8-46e4-93f3-0339e74eff84 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:32.756599 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3860/7736] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:23:32.998636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721cb80-2773-4b48-8455-a67dd64ab163 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:33.000071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a721cb80-2773-4b48-8455-a67dd64ab163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:33.027321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721cb80-2773-4b48-8455-a67dd64ab163 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:33.034268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df1d51-a1e2-4407-8a23-d64a3b656ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:33.035228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df1d51-a1e2-4407-8a23-d64a3b656ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:33.048630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df1d51-a1e2-4407-8a23-d64a3b656ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:33.049371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df1d51-a1e2-4407-8a23-d64a3b656ccd admin admin] PATH_INFO: `/v3/projects/75d7aea29a604ec396dc6948f2abb223` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:33.051568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df1d51-a1e2-4407-8a23-d64a3b656ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d7aea29a604ec396dc6948f2abb223)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:33.053368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df1d51-a1e2-4407-8a23-d64a3b656ccd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:33.111446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70df1d51-a1e2-4407-8a23-d64a3b656ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d7aea29a604ec396dc6948f2abb223', 'request_id': 'req-70df1d51-a1e2-4407-8a23-d64a3b656ccd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:33.124473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70df1d51-a1e2-4407-8a23-d64a3b656ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d7aea29a604ec396dc6948f2abb223', 'request_id': 'req-70df1d51-a1e2-4407-8a23-d64a3b656ccd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:33.132074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70df1d51-a1e2-4407-8a23-d64a3b656ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d7aea29a604ec396dc6948f2abb223', 'request_id': 'req-70df1d51-a1e2-4407-8a23-d64a3b656ccd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:33.148217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70df1d51-a1e2-4407-8a23-d64a3b656ccd admin admin] The token cache is being invalidate because project 75d7aea29a604ec396dc6948f2abb223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:23:33.148451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70df1d51-a1e2-4407-8a23-d64a3b656ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:33.149085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-70df1d51-a1e2-4407-8a23-d64a3b656ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:33.150938 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3877/7737] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:23:32 2022] DELETE /identity/v3/projects/75d7aea29a604ec396dc6948f2abb223 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:33.156384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816d86a-e22e-40f0-86f7-af7ab31dbbeb None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:33.156862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816d86a-e22e-40f0-86f7-af7ab31dbbeb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:33.157137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816d86a-e22e-40f0-86f7-af7ab31dbbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:33.189841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c816d86a-e22e-40f0-86f7-af7ab31dbbeb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:33.191565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c816d86a-e22e-40f0-86f7-af7ab31dbbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:33.331967 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3861/7738] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:33.333698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80784d6b-ae32-4412-87cf-f706b2d908d9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:33.334074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80784d6b-ae32-4412-87cf-f706b2d908d9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:33.334287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80784d6b-ae32-4412-87cf-f706b2d908d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:33.386393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-80784d6b-ae32-4412-87cf-f706b2d908d9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:33.390582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-80784d6b-ae32-4412-87cf-f706b2d908d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:33.415521 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3878/7739] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:33.419654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816d86a-e22e-40f0-86f7-af7ab31dbbeb None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:33.443533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816d86a-e22e-40f0-86f7-af7ab31dbbeb None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:33.456391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66d3e6-171d-484e-be0f-6d42e53cf5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:33.457719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66d3e6-171d-484e-be0f-6d42e53cf5ce admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:33.458257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66d3e6-171d-484e-be0f-6d42e53cf5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:33.458763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66d3e6-171d-484e-be0f-6d42e53cf5ce admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:33.459666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66d3e6-171d-484e-be0f-6d42e53cf5ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:23:33.461454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66d3e6-171d-484e-be0f-6d42e53cf5ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:33.463622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66d3e6-171d-484e-be0f-6d42e53cf5ce admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:33.502425 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3862/7740] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:23:33.506483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80784d6b-ae32-4412-87cf-f706b2d908d9 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:33.520693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80784d6b-ae32-4412-87cf-f706b2d908d9 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:33.537784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beef86-762a-4a6d-88e5-4a2c1a1d2464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:33.538411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beef86-762a-4a6d-88e5-4a2c1a1d2464 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:33.538790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beef86-762a-4a6d-88e5-4a2c1a1d2464 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:33.540295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beef86-762a-4a6d-88e5-4a2c1a1d2464 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:33.540295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beef86-762a-4a6d-88e5-4a2c1a1d2464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:33.542866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beef86-762a-4a6d-88e5-4a2c1a1d2464 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:33.592443 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3879/7741] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:23:33 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:23:33.592861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66d3e6-171d-484e-be0f-6d42e53cf5ce admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:33.608694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66d3e6-171d-484e-be0f-6d42e53cf5ce admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:33.631945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:33.709444 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d14bf-a4fc-49e8-bd0f-8397829fd99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:33.710174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d14bf-a4fc-49e8-bd0f-8397829fd99e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:33.710533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d14bf-a4fc-49e8-bd0f-8397829fd99e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:33.711372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d14bf-a4fc-49e8-bd0f-8397829fd99e admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:33.712129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d14bf-a4fc-49e8-bd0f-8397829fd99e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:33.714286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d14bf-a4fc-49e8-bd0f-8397829fd99e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:33.749959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beef86-762a-4a6d-88e5-4a2c1a1d2464 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:33.756068 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3863/7742] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:23:33 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:23:33.763190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beef86-762a-4a6d-88e5-4a2c1a1d2464 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:33.774504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0220814-08d6-4866-aa18-62ec38d66db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:33.775158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0220814-08d6-4866-aa18-62ec38d66db8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:33.777598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0220814-08d6-4866-aa18-62ec38d66db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:33.777598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0220814-08d6-4866-aa18-62ec38d66db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:33.778080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0220814-08d6-4866-aa18-62ec38d66db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:33.779704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0220814-08d6-4866-aa18-62ec38d66db8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:33.798478 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3880/7743] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:23:33.799330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d14bf-a4fc-49e8-bd0f-8397829fd99e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:33.810964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d14bf-a4fc-49e8-bd0f-8397829fd99e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:33.816269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ecd60-a4b3-46c4-8c24-2f0674247e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:33.817944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ecd60-a4b3-46c4-8c24-2f0674247e6c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:33.821814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ecd60-a4b3-46c4-8c24-2f0674247e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:33.822691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ecd60-a4b3-46c4-8c24-2f0674247e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:33.823210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ecd60-a4b3-46c4-8c24-2f0674247e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:33.824845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ecd60-a4b3-46c4-8c24-2f0674247e6c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:33.842998 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3864/7744] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:23:33.846434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0220814-08d6-4866-aa18-62ec38d66db8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:33.857941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0220814-08d6-4866-aa18-62ec38d66db8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:33.869043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8cc09-6c57-4953-aa0d-177342071e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:33.869820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8cc09-6c57-4953-aa0d-177342071e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:33.870171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8cc09-6c57-4953-aa0d-177342071e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:33.870639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8cc09-6c57-4953-aa0d-177342071e5d admin admin] PATH_INFO: `/v3/projects/2c574e1aa9924aa8b56665f1763b7389/users/444ff66883fd4b718c20f51db921bba6/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:33.904859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8cc09-6c57-4953-aa0d-177342071e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c574e1aa9924aa8b56665f1763b7389, user_id=444ff66883fd4b718c20f51db921bba6, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:33.909805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8cc09-6c57-4953-aa0d-177342071e5d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:33.948544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037abb9-8b11-4882-8b95-4a4c14bba4df None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:33.949233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037abb9-8b11-4882-8b95-4a4c14bba4df None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:33.949694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037abb9-8b11-4882-8b95-4a4c14bba4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:33.953114 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3881/7745] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:23:33 2022] PUT /identity/v3/projects/2c574e1aa9924aa8b56665f1763b7389/users/444ff66883fd4b718c20f51db921bba6/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:34.004530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f037abb9-8b11-4882-8b95-4a4c14bba4df None None] MFA Rules not processed for user `444ff66883fd4b718c20f51db921bba6`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:34.006685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f037abb9-8b11-4882-8b95-4a4c14bba4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:34.161385 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3865/7746] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:34.180991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8cc09-6c57-4953-aa0d-177342071e5d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:34.183191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-85d8cc09-6c57-4953-aa0d-177342071e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:34.232135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:34.299376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8cc09-6c57-4953-aa0d-177342071e5d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:34.303647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cc063-2c4e-4fbb-b67f-68efac8a1263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:34.304479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cc063-2c4e-4fbb-b67f-68efac8a1263 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:34.304868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cc063-2c4e-4fbb-b67f-68efac8a1263 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:34.305328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cc063-2c4e-4fbb-b67f-68efac8a1263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:34.315331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cc063-2c4e-4fbb-b67f-68efac8a1263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:34.316999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cc063-2c4e-4fbb-b67f-68efac8a1263 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:34.336889 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3882/7747] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:23:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:23:35.160202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037abb9-8b11-4882-8b95-4a4c14bba4df None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:35.295565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037abb9-8b11-4882-8b95-4a4c14bba4df None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:35.302899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:35.304264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:35.305313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:35.305783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] PATH_INFO: `/v3/users/444ff66883fd4b718c20f51db921bba6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:35.307151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=444ff66883fd4b718c20f51db921bba6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:35.309545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:35.371375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:35.409094 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '444ff66883fd4b718c20f51db921bba6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:35.426990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '444ff66883fd4b718c20f51db921bba6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:35.427756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '444ff66883fd4b718c20f51db921bba6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:35.431479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '444ff66883fd4b718c20f51db921bba6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:35.458790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '444ff66883fd4b718c20f51db921bba6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:35.499713 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3866/7748] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:23:35 2022] DELETE /identity/v3/users/444ff66883fd4b718c20f51db921bba6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:35.504886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda6654-41ec-49a8-9c30-214b6102c8cb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:35.505498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda6654-41ec-49a8-9c30-214b6102c8cb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:35.505498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda6654-41ec-49a8-9c30-214b6102c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:35.543267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fcda6654-41ec-49a8-9c30-214b6102c8cb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:35.544509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fcda6654-41ec-49a8-9c30-214b6102c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:35.674595 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3883/7749] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:35.681450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:35.683122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:35.786173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df50aa2-108a-4f2f-aa57-c642f5ed4a50 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:35.792312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5c3ce-3122-4b8f-ac01-010f8592d499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:35.793269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5c3ce-3122-4b8f-ac01-010f8592d499 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:35.793657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5c3ce-3122-4b8f-ac01-010f8592d499 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:35.794083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5c3ce-3122-4b8f-ac01-010f8592d499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:35.806024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5c3ce-3122-4b8f-ac01-010f8592d499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:35.808830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5c3ce-3122-4b8f-ac01-010f8592d499 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:35.836473 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3867/7750] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:23:36.158594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda6654-41ec-49a8-9c30-214b6102c8cb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:36.160503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fcda6654-41ec-49a8-9c30-214b6102c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:36.182298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda6654-41ec-49a8-9c30-214b6102c8cb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:36.188223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:36.188973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:36.189359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:36.189875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3 admin admin] PATH_INFO: `/v3/projects/2c574e1aa9924aa8b56665f1763b7389` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:36.193939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c574e1aa9924aa8b56665f1763b7389)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:36.196855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:36.294551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c574e1aa9924aa8b56665f1763b7389', 'request_id': 'req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:36.306446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c574e1aa9924aa8b56665f1763b7389', 'request_id': 'req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:36.314485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c574e1aa9924aa8b56665f1763b7389', 'request_id': 'req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:36.336369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3 admin admin] The token cache is being invalidate because project 2c574e1aa9924aa8b56665f1763b7389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:23:36.336773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:36.345219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-83a213ce-87aa-4210-a6e4-77ce1ab08ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:36.349401 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3884/7751] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:23:36 2022] DELETE /identity/v3/projects/2c574e1aa9924aa8b56665f1763b7389 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:36.354504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf96e8e-0b3a-456e-ad4d-717e95739f2c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:36.355314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf96e8e-0b3a-456e-ad4d-717e95739f2c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:36.355434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf96e8e-0b3a-456e-ad4d-717e95739f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:36.384642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0bf96e8e-0b3a-456e-ad4d-717e95739f2c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:36.385933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0bf96e8e-0b3a-456e-ad4d-717e95739f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:36.467292 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3868/7752] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:36.479031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763443a0-8d49-4a7c-83b0-05b770d56223 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:36.479324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763443a0-8d49-4a7c-83b0-05b770d56223 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:36.479600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763443a0-8d49-4a7c-83b0-05b770d56223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:36.525905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-763443a0-8d49-4a7c-83b0-05b770d56223 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:36.525905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-763443a0-8d49-4a7c-83b0-05b770d56223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:36.541038 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3885/7753] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:36.545372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf96e8e-0b3a-456e-ad4d-717e95739f2c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:36.557136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf96e8e-0b3a-456e-ad4d-717e95739f2c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:36.561969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7d3e4-6ef8-471f-bb52-987a572cd8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:36.562660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7d3e4-6ef8-471f-bb52-987a572cd8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:36.563010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7d3e4-6ef8-471f-bb52-987a572cd8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:36.563355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7d3e4-6ef8-471f-bb52-987a572cd8e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:36.564074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7d3e4-6ef8-471f-bb52-987a572cd8e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:23:36.564448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7d3e4-6ef8-471f-bb52-987a572cd8e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:36.566165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7d3e4-6ef8-471f-bb52-987a572cd8e4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:36.579718 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3869/7754] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:23:36.592250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763443a0-8d49-4a7c-83b0-05b770d56223 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:36.603854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763443a0-8d49-4a7c-83b0-05b770d56223 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:36.614753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3efb-0fd1-4d81-a870-d09b138475d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:36.615499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3efb-0fd1-4d81-a870-d09b138475d6 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:36.615788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3efb-0fd1-4d81-a870-d09b138475d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:36.616630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3efb-0fd1-4d81-a870-d09b138475d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:36.616790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f3efb-0fd1-4d81-a870-d09b138475d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:36.619294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f3efb-0fd1-4d81-a870-d09b138475d6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:36.652473 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3886/7755] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:23:36 2022] POST /identity/v3/projects => generated 353 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:23:36.656589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7d3e4-6ef8-471f-bb52-987a572cd8e4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:36.671766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7d3e4-6ef8-471f-bb52-987a572cd8e4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:36.717016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:36.751748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711d8b8-9893-402a-8b5e-ff77dedaaa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:36.752391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711d8b8-9893-402a-8b5e-ff77dedaaa0b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:36.752670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711d8b8-9893-402a-8b5e-ff77dedaaa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:36.752944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711d8b8-9893-402a-8b5e-ff77dedaaa0b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:36.753800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711d8b8-9893-402a-8b5e-ff77dedaaa0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:36.755723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711d8b8-9893-402a-8b5e-ff77dedaaa0b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:36.781854 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3870/7756] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:23:36 2022] POST /identity/v3/users => generated 277 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:23:36.785915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3efb-0fd1-4d81-a870-d09b138475d6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:36.796811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3efb-0fd1-4d81-a870-d09b138475d6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:36.801683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4237f8e-4c25-4c6b-baf0-70da65230158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:36.802293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4237f8e-4c25-4c6b-baf0-70da65230158 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:36.802568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4237f8e-4c25-4c6b-baf0-70da65230158 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:36.802839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4237f8e-4c25-4c6b-baf0-70da65230158 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:36.803482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4237f8e-4c25-4c6b-baf0-70da65230158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:36.805134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4237f8e-4c25-4c6b-baf0-70da65230158 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:36.816748 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3887/7757] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:23:36.821674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711d8b8-9893-402a-8b5e-ff77dedaaa0b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:36.835766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711d8b8-9893-402a-8b5e-ff77dedaaa0b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:36.842021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37e3b8-3084-419f-ac78-1ef934a18f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:36.842918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37e3b8-3084-419f-ac78-1ef934a18f47 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:36.843201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37e3b8-3084-419f-ac78-1ef934a18f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:36.843480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37e3b8-3084-419f-ac78-1ef934a18f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:36.844134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37e3b8-3084-419f-ac78-1ef934a18f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:36.846114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37e3b8-3084-419f-ac78-1ef934a18f47 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:36.863931 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3871/7758] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:23:36.865623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4237f8e-4c25-4c6b-baf0-70da65230158 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:36.878567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4237f8e-4c25-4c6b-baf0-70da65230158 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:36.885449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc299180-288f-479f-818b-07d7fa7a0ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:36.885881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc299180-288f-479f-818b-07d7fa7a0ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:36.886299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc299180-288f-479f-818b-07d7fa7a0ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:36.886588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc299180-288f-479f-818b-07d7fa7a0ef6 admin admin] PATH_INFO: `/v3/projects/bd752a1690c947bebb31746852d083fb/users/39ad3724c62141ca8b94cc5cdcf9568e/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:36.904051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc299180-288f-479f-818b-07d7fa7a0ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd752a1690c947bebb31746852d083fb, user_id=39ad3724c62141ca8b94cc5cdcf9568e, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:36.906812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc299180-288f-479f-818b-07d7fa7a0ef6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:36.909416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:36.929235 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3888/7759] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:23:36 2022] PUT /identity/v3/projects/bd752a1690c947bebb31746852d083fb/users/39ad3724c62141ca8b94cc5cdcf9568e/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:23:36.936799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61213b-61d1-40c3-8d85-e00360dc4425 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:36.937076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61213b-61d1-40c3-8d85-e00360dc4425 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:36.937384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61213b-61d1-40c3-8d85-e00360dc4425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:36.969731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9e61213b-61d1-40c3-8d85-e00360dc4425 None None] MFA Rules not processed for user `39ad3724c62141ca8b94cc5cdcf9568e`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:36.970974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9e61213b-61d1-40c3-8d85-e00360dc4425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:37.047945 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3872/7760] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:37.059761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc299180-288f-479f-818b-07d7fa7a0ef6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:37.061722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bc299180-288f-479f-818b-07d7fa7a0ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:37.129844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc299180-288f-479f-818b-07d7fa7a0ef6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:37.134173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9bf85-9c94-4f4a-9ba5-99066ef063c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:37.134810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9bf85-9c94-4f4a-9ba5-99066ef063c7 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:37.135168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9bf85-9c94-4f4a-9ba5-99066ef063c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:37.135445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9bf85-9c94-4f4a-9ba5-99066ef063c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:37.146142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9bf85-9c94-4f4a-9ba5-99066ef063c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:37.147588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9bf85-9c94-4f4a-9ba5-99066ef063c7 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:37.158011 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3889/7761] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:23:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:23:40.114105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61213b-61d1-40c3-8d85-e00360dc4425 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:40.219463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61213b-61d1-40c3-8d85-e00360dc4425 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:40.225880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:40.227165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:40.227357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:40.227745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] PATH_INFO: `/v3/users/39ad3724c62141ca8b94cc5cdcf9568e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:40.228931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ad3724c62141ca8b94cc5cdcf9568e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:40.231414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:40.291724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:40.294325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ad3724c62141ca8b94cc5cdcf9568e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:40.307225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ad3724c62141ca8b94cc5cdcf9568e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:40.308025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ad3724c62141ca8b94cc5cdcf9568e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:40.308952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ad3724c62141ca8b94cc5cdcf9568e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:40.324926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ad3724c62141ca8b94cc5cdcf9568e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:40.348381 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3873/7762] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:23:40 2022] DELETE /identity/v3/users/39ad3724c62141ca8b94cc5cdcf9568e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:40.353241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea213b7-d481-453b-b383-c0e63412a862 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:40.354104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea213b7-d481-453b-b383-c0e63412a862 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:40.354628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea213b7-d481-453b-b383-c0e63412a862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:40.381874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-cea213b7-d481-453b-b383-c0e63412a862 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:40.384269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cea213b7-d481-453b-b383-c0e63412a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:40.532177 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3890/7763] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:23:40.543053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:40.545902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:40.694490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e9280-3dc9-4f30-a0c0-29fa80ced912 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:40.701522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97ccf9-8814-4ab3-a021-48a2a9a855a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:40.702391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97ccf9-8814-4ab3-a021-48a2a9a855a0 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:40.702846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97ccf9-8814-4ab3-a021-48a2a9a855a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:40.703357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97ccf9-8814-4ab3-a021-48a2a9a855a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:40.732202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97ccf9-8814-4ab3-a021-48a2a9a855a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:40.733758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97ccf9-8814-4ab3-a021-48a2a9a855a0 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:40.794221 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3874/7764] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:23:41.331059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea213b7-d481-453b-b383-c0e63412a862 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:41.332696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cea213b7-d481-453b-b383-c0e63412a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:41.350249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea213b7-d481-453b-b383-c0e63412a862 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:41.356752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2829d-3fda-4f41-9bec-23a107689149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:41.358331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2829d-3fda-4f41-9bec-23a107689149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:41.358816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2829d-3fda-4f41-9bec-23a107689149 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:41.359305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2829d-3fda-4f41-9bec-23a107689149 admin admin] PATH_INFO: `/v3/projects/bd752a1690c947bebb31746852d083fb` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:41.360543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2829d-3fda-4f41-9bec-23a107689149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd752a1690c947bebb31746852d083fb)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:41.362571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2829d-3fda-4f41-9bec-23a107689149 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:41.456879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7cd2829d-3fda-4f41-9bec-23a107689149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd752a1690c947bebb31746852d083fb', 'request_id': 'req-7cd2829d-3fda-4f41-9bec-23a107689149'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:41.473603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7cd2829d-3fda-4f41-9bec-23a107689149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd752a1690c947bebb31746852d083fb', 'request_id': 'req-7cd2829d-3fda-4f41-9bec-23a107689149'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:41.483839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7cd2829d-3fda-4f41-9bec-23a107689149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd752a1690c947bebb31746852d083fb', 'request_id': 'req-7cd2829d-3fda-4f41-9bec-23a107689149'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:41.498417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7cd2829d-3fda-4f41-9bec-23a107689149 admin admin] The token cache is being invalidate because project bd752a1690c947bebb31746852d083fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:23:41.499014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7cd2829d-3fda-4f41-9bec-23a107689149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:41.501180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7cd2829d-3fda-4f41-9bec-23a107689149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:41.506548 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3891/7765] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:23:41 2022] DELETE /identity/v3/projects/bd752a1690c947bebb31746852d083fb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:41.511440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fbec7-fc94-438d-bd8e-aaded6115870 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:41.511946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fbec7-fc94-438d-bd8e-aaded6115870 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:41.512053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fbec7-fc94-438d-bd8e-aaded6115870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:41.542433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fc9fbec7-fc94-438d-bd8e-aaded6115870 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:41.544492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fc9fbec7-fc94-438d-bd8e-aaded6115870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:41.654599 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3875/7766] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:41.656823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f0b38-ab2f-4ab5-b18f-3740b38bb7a7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:41.657201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f0b38-ab2f-4ab5-b18f-3740b38bb7a7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:41.657569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f0b38-ab2f-4ab5-b18f-3740b38bb7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:41.711017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0a4f0b38-ab2f-4ab5-b18f-3740b38bb7a7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:41.712341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0a4f0b38-ab2f-4ab5-b18f-3740b38bb7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:41.737494 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3892/7767] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:41.738838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fbec7-fc94-438d-bd8e-aaded6115870 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:41.758724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fbec7-fc94-438d-bd8e-aaded6115870 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:41.764958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba3a86-ba11-4b41-9836-54559650bb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:41.765630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba3a86-ba11-4b41-9836-54559650bb76 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:41.765910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba3a86-ba11-4b41-9836-54559650bb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:41.766182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba3a86-ba11-4b41-9836-54559650bb76 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:41.766840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba3a86-ba11-4b41-9836-54559650bb76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:23:41.767142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba3a86-ba11-4b41-9836-54559650bb76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:41.769556 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba3a86-ba11-4b41-9836-54559650bb76 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:41.789548 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3876/7768] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:23:41.790700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f0b38-ab2f-4ab5-b18f-3740b38bb7a7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:41.802446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f0b38-ab2f-4ab5-b18f-3740b38bb7a7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:41.809381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7792b9-a807-455e-ad24-0661d441ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:41.810390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7792b9-a807-455e-ad24-0661d441ba7a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:41.810847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7792b9-a807-455e-ad24-0661d441ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:41.811483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7792b9-a807-455e-ad24-0661d441ba7a admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:41.812291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7792b9-a807-455e-ad24-0661d441ba7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:41.814674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7792b9-a807-455e-ad24-0661d441ba7a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:41.828051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:41.878308 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3893/7769] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:23:41 2022] POST /identity/v3/projects => generated 369 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:23:41.883696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba3a86-ba11-4b41-9836-54559650bb76 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:41.909470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba3a86-ba11-4b41-9836-54559650bb76 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:41.997718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:42.013168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b28d52-7518-40a8-bdae-ee7f299ffa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:42.014346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b28d52-7518-40a8-bdae-ee7f299ffa89 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:42.014898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b28d52-7518-40a8-bdae-ee7f299ffa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:42.015892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b28d52-7518-40a8-bdae-ee7f299ffa89 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:42.016566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b28d52-7518-40a8-bdae-ee7f299ffa89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:42.019019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b28d52-7518-40a8-bdae-ee7f299ffa89 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:42.075041 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3877/7770] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:23:41 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:23:42.079366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7792b9-a807-455e-ad24-0661d441ba7a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:42.099230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7792b9-a807-455e-ad24-0661d441ba7a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:42.115175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409521a6-1285-4145-b4d1-89d43b634e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:42.116071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409521a6-1285-4145-b4d1-89d43b634e58 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:42.116524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409521a6-1285-4145-b4d1-89d43b634e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:42.117580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409521a6-1285-4145-b4d1-89d43b634e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:42.118707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409521a6-1285-4145-b4d1-89d43b634e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:42.120883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409521a6-1285-4145-b4d1-89d43b634e58 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:42.145503 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3894/7771] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:23:42.150454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b28d52-7518-40a8-bdae-ee7f299ffa89 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:42.162323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b28d52-7518-40a8-bdae-ee7f299ffa89 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:42.176113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cb2fb-8ebd-4f7c-82f4-b56f837e8349 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:42.176742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cb2fb-8ebd-4f7c-82f4-b56f837e8349 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:42.178415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cb2fb-8ebd-4f7c-82f4-b56f837e8349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:42.189843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad3e25-cd62-4bf7-9fdb-684467237a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:42.190568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad3e25-cd62-4bf7-9fdb-684467237a1d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:42.193048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad3e25-cd62-4bf7-9fdb-684467237a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:42.193486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad3e25-cd62-4bf7-9fdb-684467237a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:42.194174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad3e25-cd62-4bf7-9fdb-684467237a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:42.198218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad3e25-cd62-4bf7-9fdb-684467237a1d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:42.223138 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3878/7772] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:23:42.223374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ec7cb2fb-8ebd-4f7c-82f4-b56f837e8349 None None] MFA Rules not processed for user `33a0d81fb2dd4891901f27890ce7688e`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:42.224772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad3e25-cd62-4bf7-9fdb-684467237a1d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:42.225689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ec7cb2fb-8ebd-4f7c-82f4-b56f837e8349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:42.237580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad3e25-cd62-4bf7-9fdb-684467237a1d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:42.244893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe19971-901b-40d8-82ff-949da3c47903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:42.246738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe19971-901b-40d8-82ff-949da3c47903 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:42.246738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe19971-901b-40d8-82ff-949da3c47903 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:42.246738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe19971-901b-40d8-82ff-949da3c47903 admin admin] PATH_INFO: `/v3/projects/824575a8b01c480abeb4242e9f07764d/users/bfca4e20b536467e874db1eb9c8817c0/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:42.266329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe19971-901b-40d8-82ff-949da3c47903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824575a8b01c480abeb4242e9f07764d, user_id=bfca4e20b536467e874db1eb9c8817c0, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:42.269658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe19971-901b-40d8-82ff-949da3c47903 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:42.300007 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3879/7773] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:23:42 2022] PUT /identity/v3/projects/824575a8b01c480abeb4242e9f07764d/users/bfca4e20b536467e874db1eb9c8817c0/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:42.301818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53374df-edb4-4399-820e-8c6b6a5b0cd2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:42.302137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53374df-edb4-4399-820e-8c6b6a5b0cd2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:42.302421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53374df-edb4-4399-820e-8c6b6a5b0cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:42.340571 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3895/7774] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:42.347226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c53374df-edb4-4399-820e-8c6b6a5b0cd2 None None] MFA Rules not processed for user `bfca4e20b536467e874db1eb9c8817c0`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:42.348871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c53374df-edb4-4399-820e-8c6b6a5b0cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:42.454487 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3880/7775] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:23:42.459120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cb2fb-8ebd-4f7c-82f4-b56f837e8349 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:42.474228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cb2fb-8ebd-4f7c-82f4-b56f837e8349 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:42.559904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6bc78-2553-4357-8303-1906a0bedb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:42.561976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6bc78-2553-4357-8303-1906a0bedb08 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:42.562433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6bc78-2553-4357-8303-1906a0bedb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:42.562902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6bc78-2553-4357-8303-1906a0bedb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:42.564322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6bc78-2553-4357-8303-1906a0bedb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:42.566582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6bc78-2553-4357-8303-1906a0bedb08 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:42.614743 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3896/7776] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:23:42 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:23:42.620262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53374df-edb4-4399-820e-8c6b6a5b0cd2 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:42.637938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53374df-edb4-4399-820e-8c6b6a5b0cd2 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:42.704900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7100c-dfd1-4680-920e-25d2ca48a8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:42.705604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7100c-dfd1-4680-920e-25d2ca48a8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:42.705886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7100c-dfd1-4680-920e-25d2ca48a8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:42.706163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7100c-dfd1-4680-920e-25d2ca48a8f7 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:42.707002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7100c-dfd1-4680-920e-25d2ca48a8f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:42.709705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7100c-dfd1-4680-920e-25d2ca48a8f7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:42.737514 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3881/7777] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:23:42 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:23:42.741659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6bc78-2553-4357-8303-1906a0bedb08 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:42.753552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6bc78-2553-4357-8303-1906a0bedb08 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:42.759349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ccde2-dd64-40b0-a0ee-0c5d2b22e900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:42.759958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ccde2-dd64-40b0-a0ee-0c5d2b22e900 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:42.760247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ccde2-dd64-40b0-a0ee-0c5d2b22e900 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:42.760523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ccde2-dd64-40b0-a0ee-0c5d2b22e900 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:42.761170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ccde2-dd64-40b0-a0ee-0c5d2b22e900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:42.763315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ccde2-dd64-40b0-a0ee-0c5d2b22e900 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:42.776231 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3897/7778] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:23:42.780516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7100c-dfd1-4680-920e-25d2ca48a8f7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:42.791858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7100c-dfd1-4680-920e-25d2ca48a8f7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:42.797068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97370d-8b47-48dc-aac1-409956e525bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:42.798060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97370d-8b47-48dc-aac1-409956e525bf admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:42.798195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97370d-8b47-48dc-aac1-409956e525bf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:42.798472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97370d-8b47-48dc-aac1-409956e525bf admin admin] PATH_INFO: `/v3/projects/869b0d5f98594f0ebc59a33620458d3a/users/33ac6684766d424b83a39dcf7be387ab/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:42.816947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97370d-8b47-48dc-aac1-409956e525bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=869b0d5f98594f0ebc59a33620458d3a, user_id=33ac6684766d424b83a39dcf7be387ab, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:42.819793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97370d-8b47-48dc-aac1-409956e525bf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:42.837919 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3882/7779] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:23:42 2022] PUT /identity/v3/projects/869b0d5f98594f0ebc59a33620458d3a/users/33ac6684766d424b83a39dcf7be387ab/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:23:42.839263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ccde2-dd64-40b0-a0ee-0c5d2b22e900 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:42.849598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ccde2-dd64-40b0-a0ee-0c5d2b22e900 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:42.912447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47538b6e-a2d7-483d-801b-d8505381c670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:42.913215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47538b6e-a2d7-483d-801b-d8505381c670 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:42.914719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47538b6e-a2d7-483d-801b-d8505381c670 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:42.914719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47538b6e-a2d7-483d-801b-d8505381c670 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:42.917718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47538b6e-a2d7-483d-801b-d8505381c670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:42.919492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47538b6e-a2d7-483d-801b-d8505381c670 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:42.921377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:42.933234 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3898/7780] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:23:42.937109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97370d-8b47-48dc-aac1-409956e525bf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:42.943210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:42.951733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97370d-8b47-48dc-aac1-409956e525bf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:42.956990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ef0a6-7d3c-4861-9c2b-a93381aff660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:42.957806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ef0a6-7d3c-4861-9c2b-a93381aff660 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:42.958817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ef0a6-7d3c-4861-9c2b-a93381aff660 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:42.959206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ef0a6-7d3c-4861-9c2b-a93381aff660 admin admin] PATH_INFO: `/v3/projects/869b0d5f98594f0ebc59a33620458d3a/users/33ac6684766d424b83a39dcf7be387ab/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:42.962699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ef0a6-7d3c-4861-9c2b-a93381aff660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869b0d5f98594f0ebc59a33620458d3a, user_id=33ac6684766d424b83a39dcf7be387ab, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:42.966637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ef0a6-7d3c-4861-9c2b-a93381aff660 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:42.981125 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3883/7781] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:23:42 2022] PUT /identity/v3/projects/869b0d5f98594f0ebc59a33620458d3a/users/33ac6684766d424b83a39dcf7be387ab/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:43.080465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737ea7c-5d16-486f-b853-6bbfb3484c46 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:43.080735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737ea7c-5d16-486f-b853-6bbfb3484c46 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:43.081020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737ea7c-5d16-486f-b853-6bbfb3484c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:43.115342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f737ea7c-5d16-486f-b853-6bbfb3484c46 None None] MFA Rules not processed for user `33ac6684766d424b83a39dcf7be387ab`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:43.116696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f737ea7c-5d16-486f-b853-6bbfb3484c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:43.209664 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3899/7782] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:43.221826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ef0a6-7d3c-4861-9c2b-a93381aff660 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:43.223723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f62ef0a6-7d3c-4861-9c2b-a93381aff660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:43.308093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ef0a6-7d3c-4861-9c2b-a93381aff660 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:43.312992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ca9ed-b7d1-495b-9c4b-392339b9ddf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:43.313732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ca9ed-b7d1-495b-9c4b-392339b9ddf8 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:43.314127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ca9ed-b7d1-495b-9c4b-392339b9ddf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:43.314469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ca9ed-b7d1-495b-9c4b-392339b9ddf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:43.328885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ca9ed-b7d1-495b-9c4b-392339b9ddf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:43.330601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ca9ed-b7d1-495b-9c4b-392339b9ddf8 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:43.343244 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3884/7783] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:23:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:23:45.122812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737ea7c-5d16-486f-b853-6bbfb3484c46 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:45.211134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737ea7c-5d16-486f-b853-6bbfb3484c46 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:45.222974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:45.223989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:45.224443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:45.224898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] PATH_INFO: `/v3/users/bfca4e20b536467e874db1eb9c8817c0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:45.226843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfca4e20b536467e874db1eb9c8817c0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:45.228786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:45.318733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfca4e20b536467e874db1eb9c8817c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:45.330054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfca4e20b536467e874db1eb9c8817c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:45.331277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfca4e20b536467e874db1eb9c8817c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:45.332083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfca4e20b536467e874db1eb9c8817c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:45.380784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfca4e20b536467e874db1eb9c8817c0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:45.399154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:45.407814 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3900/7784] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:23:45 2022] DELETE /identity/v3/users/bfca4e20b536467e874db1eb9c8817c0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:45.412255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f70c08-270b-4246-aa56-ceb67766d6fe None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:45.412783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f70c08-270b-4246-aa56-ceb67766d6fe None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:45.412783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f70c08-270b-4246-aa56-ceb67766d6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:45.462555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-11f70c08-270b-4246-aa56-ceb67766d6fe None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:45.463658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-11f70c08-270b-4246-aa56-ceb67766d6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:45.529269 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3885/7785] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:45.539122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:45.540617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:45.609457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f2e90-b90f-4c5f-8cbc-9c14c52f2ba0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:45.613288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1602e1-3db6-40e4-a500-e4251a6e49a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:45.613972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1602e1-3db6-40e4-a500-e4251a6e49a8 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:45.614250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1602e1-3db6-40e4-a500-e4251a6e49a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:45.614519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1602e1-3db6-40e4-a500-e4251a6e49a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:45.624419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1602e1-3db6-40e4-a500-e4251a6e49a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:45.626270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1602e1-3db6-40e4-a500-e4251a6e49a8 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:45.637573 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3901/7786] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:23:45.942682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f70c08-270b-4246-aa56-ceb67766d6fe None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:45.944267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-11f70c08-270b-4246-aa56-ceb67766d6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:45.968432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f70c08-270b-4246-aa56-ceb67766d6fe None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:45.973433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:45.974384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:45.974763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:45.984328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] PATH_INFO: `/v3/projects/824575a8b01c480abeb4242e9f07764d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:45.990484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824575a8b01c480abeb4242e9f07764d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:45.991388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:46.059212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824575a8b01c480abeb4242e9f07764d', 'request_id': 'req-6c646cb0-f650-4b1f-95de-0a130cd10609'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.075210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824575a8b01c480abeb4242e9f07764d', 'request_id': 'req-6c646cb0-f650-4b1f-95de-0a130cd10609'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.086322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824575a8b01c480abeb4242e9f07764d', 'request_id': 'req-6c646cb0-f650-4b1f-95de-0a130cd10609'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.102961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] The token cache is being invalidate because project 824575a8b01c480abeb4242e9f07764d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:23:46.103407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.104201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.110077 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3886/7787] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:23:45 2022] DELETE /identity/v3/projects/824575a8b01c480abeb4242e9f07764d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:46.115169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1602e1-3db6-40e4-a500-e4251a6e49a8 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:46.135635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1602e1-3db6-40e4-a500-e4251a6e49a8 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:46.237260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b77de5-52ef-4f83-84a1-63593a6404d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:46.238366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b77de5-52ef-4f83-84a1-63593a6404d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:46.238835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b77de5-52ef-4f83-84a1-63593a6404d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:46.239287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b77de5-52ef-4f83-84a1-63593a6404d7 admin admin] PATH_INFO: `/v3/users/33ac6684766d424b83a39dcf7be387ab` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:46.241093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b77de5-52ef-4f83-84a1-63593a6404d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ac6684766d424b83a39dcf7be387ab)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:46.244100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b77de5-52ef-4f83-84a1-63593a6404d7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:46.335294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-04b77de5-52ef-4f83-84a1-63593a6404d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ac6684766d424b83a39dcf7be387ab'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.362884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-04b77de5-52ef-4f83-84a1-63593a6404d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ac6684766d424b83a39dcf7be387ab'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.365249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-04b77de5-52ef-4f83-84a1-63593a6404d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ac6684766d424b83a39dcf7be387ab'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.366209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-04b77de5-52ef-4f83-84a1-63593a6404d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ac6684766d424b83a39dcf7be387ab'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.391118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-04b77de5-52ef-4f83-84a1-63593a6404d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ac6684766d424b83a39dcf7be387ab'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.408232 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3902/7788] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:23:46 2022] DELETE /identity/v3/users/33ac6684766d424b83a39dcf7be387ab => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:23:46.721475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:46.722983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:46.739562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c646cb0-f650-4b1f-95de-0a130cd10609 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:46.752677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:46.804198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c1005-c0b5-41ba-81b0-f2e848eecffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:46.804831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c1005-c0b5-41ba-81b0-f2e848eecffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:46.805112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c1005-c0b5-41ba-81b0-f2e848eecffc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:46.805420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c1005-c0b5-41ba-81b0-f2e848eecffc admin admin] PATH_INFO: `/v3/projects/869b0d5f98594f0ebc59a33620458d3a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:46.806541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c1005-c0b5-41ba-81b0-f2e848eecffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=869b0d5f98594f0ebc59a33620458d3a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:46.808443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c1005-c0b5-41ba-81b0-f2e848eecffc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:46.855125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-128c1005-c0b5-41ba-81b0-f2e848eecffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869b0d5f98594f0ebc59a33620458d3a', 'request_id': 'req-128c1005-c0b5-41ba-81b0-f2e848eecffc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.862705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-128c1005-c0b5-41ba-81b0-f2e848eecffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869b0d5f98594f0ebc59a33620458d3a', 'request_id': 'req-128c1005-c0b5-41ba-81b0-f2e848eecffc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.868746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-128c1005-c0b5-41ba-81b0-f2e848eecffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869b0d5f98594f0ebc59a33620458d3a', 'request_id': 'req-128c1005-c0b5-41ba-81b0-f2e848eecffc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.879777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-128c1005-c0b5-41ba-81b0-f2e848eecffc admin admin] The token cache is being invalidate because project 869b0d5f98594f0ebc59a33620458d3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:23:46.880069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-128c1005-c0b5-41ba-81b0-f2e848eecffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.880703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-128c1005-c0b5-41ba-81b0-f2e848eecffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:46.882551 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3887/7789] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:23:46 2022] DELETE /identity/v3/projects/869b0d5f98594f0ebc59a33620458d3a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:46.887406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa843f1-33da-4873-9332-4770d7c5c329 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:46.887708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa843f1-33da-4873-9332-4770d7c5c329 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:46.887982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa843f1-33da-4873-9332-4770d7c5c329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:46.909398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6fa843f1-33da-4873-9332-4770d7c5c329 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:46.910602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6fa843f1-33da-4873-9332-4770d7c5c329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:46.927614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:46.971865 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3903/7790] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:46.980684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d055-24ce-4eb8-b8db-f55f205a9b85 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:46.980913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d055-24ce-4eb8-b8db-f55f205a9b85 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:46.981216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d055-24ce-4eb8-b8db-f55f205a9b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:47.000533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2007d055-24ce-4eb8-b8db-f55f205a9b85 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:47.001767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2007d055-24ce-4eb8-b8db-f55f205a9b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:47.009651 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3888/7791] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:47.013844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa843f1-33da-4873-9332-4770d7c5c329 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:47.024244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa843f1-33da-4873-9332-4770d7c5c329 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:47.028872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45fd2f-a75c-4b2e-ab38-fb307ac58868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:47.029486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45fd2f-a75c-4b2e-ab38-fb307ac58868 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:47.029770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45fd2f-a75c-4b2e-ab38-fb307ac58868 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:47.030042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45fd2f-a75c-4b2e-ab38-fb307ac58868 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:47.030679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45fd2f-a75c-4b2e-ab38-fb307ac58868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:23:47.030983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45fd2f-a75c-4b2e-ab38-fb307ac58868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:47.032568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45fd2f-a75c-4b2e-ab38-fb307ac58868 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:47.045448 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3904/7792] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:23:47.049739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007d055-24ce-4eb8-b8db-f55f205a9b85 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:47.058932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007d055-24ce-4eb8-b8db-f55f205a9b85 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:47.063653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaba30-6321-45df-b719-4d8e930e4d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:47.064247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaba30-6321-45df-b719-4d8e930e4d08 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:47.064524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaba30-6321-45df-b719-4d8e930e4d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:47.064793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaba30-6321-45df-b719-4d8e930e4d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:47.065454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaaba30-6321-45df-b719-4d8e930e4d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:47.067326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaaba30-6321-45df-b719-4d8e930e4d08 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:47.094668 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3889/7793] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:23:47 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:23:47.098698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45fd2f-a75c-4b2e-ab38-fb307ac58868 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:47.108958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45fd2f-a75c-4b2e-ab38-fb307ac58868 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:47.167658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a11962-1840-4a1b-acdb-1d2bb5d7af26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:47.168338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11962-1840-4a1b-acdb-1d2bb5d7af26 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:47.168552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11962-1840-4a1b-acdb-1d2bb5d7af26 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:47.168830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11962-1840-4a1b-acdb-1d2bb5d7af26 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:47.169499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a11962-1840-4a1b-acdb-1d2bb5d7af26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:47.171430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a11962-1840-4a1b-acdb-1d2bb5d7af26 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:47.197293 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3905/7794] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:23:47 2022] POST /identity/v3/users => generated 281 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:23:47.201029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaba30-6321-45df-b719-4d8e930e4d08 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:47.212958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaba30-6321-45df-b719-4d8e930e4d08 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:47.218202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919ed39-1d87-4671-987f-90419688745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:47.218819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919ed39-1d87-4671-987f-90419688745d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:47.219104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919ed39-1d87-4671-987f-90419688745d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:47.219378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919ed39-1d87-4671-987f-90419688745d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:47.220024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919ed39-1d87-4671-987f-90419688745d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:47.221833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919ed39-1d87-4671-987f-90419688745d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:47.232675 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3890/7795] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:23:47.236677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a11962-1840-4a1b-acdb-1d2bb5d7af26 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:47.247930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a11962-1840-4a1b-acdb-1d2bb5d7af26 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:47.252976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300814e7-5f19-4069-ac6c-8a59e24c0ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:47.253789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300814e7-5f19-4069-ac6c-8a59e24c0ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:47.254069 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300814e7-5f19-4069-ac6c-8a59e24c0ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:47.254341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300814e7-5f19-4069-ac6c-8a59e24c0ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:47.254977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300814e7-5f19-4069-ac6c-8a59e24c0ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:47.256854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300814e7-5f19-4069-ac6c-8a59e24c0ba6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:47.268711 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3906/7796] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:23:47.272940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919ed39-1d87-4671-987f-90419688745d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:47.285701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919ed39-1d87-4671-987f-90419688745d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:47.292785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff5ae0-6cb0-46cf-bd27-b8df6ac4c9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:47.293571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff5ae0-6cb0-46cf-bd27-b8df6ac4c9b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:47.294007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff5ae0-6cb0-46cf-bd27-b8df6ac4c9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:47.294270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff5ae0-6cb0-46cf-bd27-b8df6ac4c9b0 admin admin] PATH_INFO: `/v3/projects/7dc45c43c09046d5978812e779461b71/users/78b7c7f730114cff9ae092f01788e936/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:47.309890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff5ae0-6cb0-46cf-bd27-b8df6ac4c9b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc45c43c09046d5978812e779461b71, user_id=78b7c7f730114cff9ae092f01788e936, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:47.312527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff5ae0-6cb0-46cf-bd27-b8df6ac4c9b0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:47.329119 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3891/7797] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:23:47 2022] PUT /identity/v3/projects/7dc45c43c09046d5978812e779461b71/users/78b7c7f730114cff9ae092f01788e936/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:47.342337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95110e4-35cd-401a-9d0a-d4fe23f528ad None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:47.342625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95110e4-35cd-401a-9d0a-d4fe23f528ad None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:47.342903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95110e4-35cd-401a-9d0a-d4fe23f528ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:47.372128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f95110e4-35cd-401a-9d0a-d4fe23f528ad None None] MFA Rules not processed for user `78b7c7f730114cff9ae092f01788e936`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:47.373379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f95110e4-35cd-401a-9d0a-d4fe23f528ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:47.444458 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3907/7798] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:47.483782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff5ae0-6cb0-46cf-bd27-b8df6ac4c9b0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:47.485657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-acff5ae0-6cb0-46cf-bd27-b8df6ac4c9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:47.534986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:47.551803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff5ae0-6cb0-46cf-bd27-b8df6ac4c9b0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:47.556950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbbb69-9549-47d5-9097-8b7de0c77358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:47.557221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbbb69-9549-47d5-9097-8b7de0c77358 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:47.557932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbbb69-9549-47d5-9097-8b7de0c77358 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:47.558983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbbb69-9549-47d5-9097-8b7de0c77358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:47.569320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbbb69-9549-47d5-9097-8b7de0c77358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:47.571617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbbb69-9549-47d5-9097-8b7de0c77358 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:47.581700 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3892/7799] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:23:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:23:47.601277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95110e4-35cd-401a-9d0a-d4fe23f528ad None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:47.621823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:47.669498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95110e4-35cd-401a-9d0a-d4fe23f528ad None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:47.674083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:47.674712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:47.674988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:47.675261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] PATH_INFO: `/v3/users/78b7c7f730114cff9ae092f01788e936` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:47.676591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b7c7f730114cff9ae092f01788e936)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:47.678297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:47.732510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b7c7f730114cff9ae092f01788e936'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:47.739651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b7c7f730114cff9ae092f01788e936'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:47.740278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b7c7f730114cff9ae092f01788e936'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:47.740965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b7c7f730114cff9ae092f01788e936'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:47.753912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b7c7f730114cff9ae092f01788e936'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:47.769331 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3908/7800] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:23:47 2022] DELETE /identity/v3/users/78b7c7f730114cff9ae092f01788e936 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:47.774362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77660103-ca4d-40f6-b669-373219955c72 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:47.774877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77660103-ca4d-40f6-b669-373219955c72 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:47.774990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77660103-ca4d-40f6-b669-373219955c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:47.795278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-77660103-ca4d-40f6-b669-373219955c72 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:47.796499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-77660103-ca4d-40f6-b669-373219955c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:47.860247 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3893/7801] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:47.871056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:47.872481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:47.936606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08321165-d729-42f3-8305-ac3eb7f19ce6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:47.940873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b689f1e-c224-40a6-8b0d-ba6a13ef6cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:47.941756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689f1e-c224-40a6-8b0d-ba6a13ef6cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:47.942089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689f1e-c224-40a6-8b0d-ba6a13ef6cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:47.942447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689f1e-c224-40a6-8b0d-ba6a13ef6cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:47.952958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b689f1e-c224-40a6-8b0d-ba6a13ef6cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:47.954709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b689f1e-c224-40a6-8b0d-ba6a13ef6cd3 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:47.965133 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3909/7802] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:23:48.258656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77660103-ca4d-40f6-b669-373219955c72 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:48.260118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-77660103-ca4d-40f6-b669-373219955c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:48.273479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77660103-ca4d-40f6-b669-373219955c72 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:48.278309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:48.278979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:48.279313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:48.279593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3 admin admin] PATH_INFO: `/v3/projects/7dc45c43c09046d5978812e779461b71` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:48.280758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc45c43c09046d5978812e779461b71)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:48.282690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:48.331260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc45c43c09046d5978812e779461b71', 'request_id': 'req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:48.338467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc45c43c09046d5978812e779461b71', 'request_id': 'req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:48.344326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc45c43c09046d5978812e779461b71', 'request_id': 'req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:48.355985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3 admin admin] The token cache is being invalidate because project 7dc45c43c09046d5978812e779461b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:23:48.356277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:48.356928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4a9e3bfb-e1f5-41c1-ad3a-31cb3c2f6ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:48.358675 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3894/7803] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:23:48 2022] DELETE /identity/v3/projects/7dc45c43c09046d5978812e779461b71 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:48.363460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca5cfc-9a36-4e35-a782-71971d25ee6a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:48.363979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca5cfc-9a36-4e35-a782-71971d25ee6a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:48.364097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca5cfc-9a36-4e35-a782-71971d25ee6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:48.384407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fbca5cfc-9a36-4e35-a782-71971d25ee6a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:48.385766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fbca5cfc-9a36-4e35-a782-71971d25ee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:48.420875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:48.450169 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3910/7804] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:48.458063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ce80c-61e2-4ca5-bc45-4cb8c067a870 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:48.458350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ce80c-61e2-4ca5-bc45-4cb8c067a870 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:48.458626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ce80c-61e2-4ca5-bc45-4cb8c067a870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:48.479513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6a9ce80c-61e2-4ca5-bc45-4cb8c067a870 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:48.481093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6a9ce80c-61e2-4ca5-bc45-4cb8c067a870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:48.493825 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3895/7805] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:48.498060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca5cfc-9a36-4e35-a782-71971d25ee6a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:48.517059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca5cfc-9a36-4e35-a782-71971d25ee6a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:48.525557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a7719-8c16-450f-8323-f1689739222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:48.526179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a7719-8c16-450f-8323-f1689739222e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:48.526453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a7719-8c16-450f-8323-f1689739222e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:48.526723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a7719-8c16-450f-8323-f1689739222e admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:48.527379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a7719-8c16-450f-8323-f1689739222e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:23:48.527676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a7719-8c16-450f-8323-f1689739222e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:48.529285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a7719-8c16-450f-8323-f1689739222e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:48.541395 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3911/7806] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:23:48.545710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ce80c-61e2-4ca5-bc45-4cb8c067a870 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:48.556737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ce80c-61e2-4ca5-bc45-4cb8c067a870 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:48.561660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7030d-5c84-4e46-a0ca-dcddc7d6c2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:48.562305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7030d-5c84-4e46-a0ca-dcddc7d6c2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:48.562583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7030d-5c84-4e46-a0ca-dcddc7d6c2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:48.562852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7030d-5c84-4e46-a0ca-dcddc7d6c2c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:48.563479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7030d-5c84-4e46-a0ca-dcddc7d6c2c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:48.565620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7030d-5c84-4e46-a0ca-dcddc7d6c2c6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:48.594402 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3896/7807] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:23:48 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:23:48.598671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a7719-8c16-450f-8323-f1689739222e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:48.610434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a7719-8c16-450f-8323-f1689739222e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:48.683819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83e3a6-5af3-4c33-a594-d044710dfc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:48.684663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83e3a6-5af3-4c33-a594-d044710dfc19 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:48.685129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83e3a6-5af3-4c33-a594-d044710dfc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:48.685718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83e3a6-5af3-4c33-a594-d044710dfc19 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:48.686507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83e3a6-5af3-4c33-a594-d044710dfc19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:48.688824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83e3a6-5af3-4c33-a594-d044710dfc19 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:48.717643 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3912/7808] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:23:48 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:23:48.722127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7030d-5c84-4e46-a0ca-dcddc7d6c2c6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:48.734982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7030d-5c84-4e46-a0ca-dcddc7d6c2c6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:48.740551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc44ee-6bd5-4105-b99e-b857a29c78ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:48.741051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc44ee-6bd5-4105-b99e-b857a29c78ac admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:48.741459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc44ee-6bd5-4105-b99e-b857a29c78ac admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:48.742436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc44ee-6bd5-4105-b99e-b857a29c78ac admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:48.743180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc44ee-6bd5-4105-b99e-b857a29c78ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:48.744864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc44ee-6bd5-4105-b99e-b857a29c78ac admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:48.760045 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3897/7809] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:23:48.761741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83e3a6-5af3-4c33-a594-d044710dfc19 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:48.772996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83e3a6-5af3-4c33-a594-d044710dfc19 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:48.778739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16d68b-dcc3-43a8-a2d9-9e0883726386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:48.779350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16d68b-dcc3-43a8-a2d9-9e0883726386 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:48.779631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16d68b-dcc3-43a8-a2d9-9e0883726386 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:48.779903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16d68b-dcc3-43a8-a2d9-9e0883726386 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:48.780763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16d68b-dcc3-43a8-a2d9-9e0883726386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:48.783010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16d68b-dcc3-43a8-a2d9-9e0883726386 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:48.794427 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3913/7810] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:23:48.798495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc44ee-6bd5-4105-b99e-b857a29c78ac admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:48.809654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc44ee-6bd5-4105-b99e-b857a29c78ac admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:48.814426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8610021-abc9-4a91-9d44-b285a6eb2dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:48.840657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8610021-abc9-4a91-9d44-b285a6eb2dce admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:48.840657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8610021-abc9-4a91-9d44-b285a6eb2dce admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:48.840657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8610021-abc9-4a91-9d44-b285a6eb2dce admin admin] PATH_INFO: `/v3/projects/1015ad52f50940ddacb26dff52eafd2f/users/1596d81500d04ff9bc593b57750cd60c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:48.841047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8610021-abc9-4a91-9d44-b285a6eb2dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1015ad52f50940ddacb26dff52eafd2f, user_id=1596d81500d04ff9bc593b57750cd60c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:48.843872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8610021-abc9-4a91-9d44-b285a6eb2dce admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:48.858837 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3898/7811] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:23:48 2022] PUT /identity/v3/projects/1015ad52f50940ddacb26dff52eafd2f/users/1596d81500d04ff9bc593b57750cd60c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:23:48.869168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7054eab-a718-4af2-9d50-e2da4ef92f65 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:48.869624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7054eab-a718-4af2-9d50-e2da4ef92f65 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:48.870090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7054eab-a718-4af2-9d50-e2da4ef92f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:48.901703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d7054eab-a718-4af2-9d50-e2da4ef92f65 None None] MFA Rules not processed for user `1596d81500d04ff9bc593b57750cd60c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:48.902913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d7054eab-a718-4af2-9d50-e2da4ef92f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:48.969607 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3914/7812] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:48.984496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8610021-abc9-4a91-9d44-b285a6eb2dce admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:48.986270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b8610021-abc9-4a91-9d44-b285a6eb2dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:48.993319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:49.050018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8610021-abc9-4a91-9d44-b285a6eb2dce admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:49.053797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0493f39-b8e7-4fd3-a100-db330e514fa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:49.055034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0493f39-b8e7-4fd3-a100-db330e514fa0 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:49.055381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0493f39-b8e7-4fd3-a100-db330e514fa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:49.055650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0493f39-b8e7-4fd3-a100-db330e514fa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:49.064451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0493f39-b8e7-4fd3-a100-db330e514fa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:49.065923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0493f39-b8e7-4fd3-a100-db330e514fa0 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:49.075350 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3899/7813] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:23:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:23:57.378331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7054eab-a718-4af2-9d50-e2da4ef92f65 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:57.421968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:57.449066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7054eab-a718-4af2-9d50-e2da4ef92f65 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:57.456434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:57.456434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:57.456434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:57.456434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] PATH_INFO: `/v3/users/1596d81500d04ff9bc593b57750cd60c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:57.457796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1596d81500d04ff9bc593b57750cd60c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:57.459781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:57.529753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1596d81500d04ff9bc593b57750cd60c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:57.539902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1596d81500d04ff9bc593b57750cd60c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:57.540659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1596d81500d04ff9bc593b57750cd60c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:57.541310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1596d81500d04ff9bc593b57750cd60c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:57.558751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1596d81500d04ff9bc593b57750cd60c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:57.577502 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3915/7814] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:23:57 2022] DELETE /identity/v3/users/1596d81500d04ff9bc593b57750cd60c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:57.579334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902b677-d763-410b-a39c-4aa0fbe84020 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:57.579849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902b677-d763-410b-a39c-4aa0fbe84020 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:57.581830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902b677-d763-410b-a39c-4aa0fbe84020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:57.614342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c902b677-d763-410b-a39c-4aa0fbe84020 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:57.616062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c902b677-d763-410b-a39c-4aa0fbe84020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:57.767880 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3900/7815] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:57.786258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:57.788352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:57.871292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee04328-777d-4cd3-8011-d8ec9764ea49 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:57.875732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70567ea7-412d-42f9-96b0-3d531e8b6992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:57.876408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70567ea7-412d-42f9-96b0-3d531e8b6992 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:57.876694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70567ea7-412d-42f9-96b0-3d531e8b6992 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:57.876971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70567ea7-412d-42f9-96b0-3d531e8b6992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:57.889759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70567ea7-412d-42f9-96b0-3d531e8b6992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:57.891643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70567ea7-412d-42f9-96b0-3d531e8b6992 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:57.910740 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3916/7816] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:23:58.940989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902b677-d763-410b-a39c-4aa0fbe84020 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:58.942736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c902b677-d763-410b-a39c-4aa0fbe84020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:58.962306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902b677-d763-410b-a39c-4aa0fbe84020 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:58.969588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ff065-9770-4fe2-8f93-49d752d02f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:58.970256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ff065-9770-4fe2-8f93-49d752d02f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:58.971273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ff065-9770-4fe2-8f93-49d752d02f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:58.972112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ff065-9770-4fe2-8f93-49d752d02f5e admin admin] PATH_INFO: `/v3/projects/1015ad52f50940ddacb26dff52eafd2f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:58.973743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ff065-9770-4fe2-8f93-49d752d02f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1015ad52f50940ddacb26dff52eafd2f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:58.979399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ff065-9770-4fe2-8f93-49d752d02f5e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:59.031805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a52ff065-9770-4fe2-8f93-49d752d02f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1015ad52f50940ddacb26dff52eafd2f', 'request_id': 'req-a52ff065-9770-4fe2-8f93-49d752d02f5e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:59.041475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a52ff065-9770-4fe2-8f93-49d752d02f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1015ad52f50940ddacb26dff52eafd2f', 'request_id': 'req-a52ff065-9770-4fe2-8f93-49d752d02f5e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:59.049259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a52ff065-9770-4fe2-8f93-49d752d02f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1015ad52f50940ddacb26dff52eafd2f', 'request_id': 'req-a52ff065-9770-4fe2-8f93-49d752d02f5e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:59.064415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a52ff065-9770-4fe2-8f93-49d752d02f5e admin admin] The token cache is being invalidate because project 1015ad52f50940ddacb26dff52eafd2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:23:59.064777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a52ff065-9770-4fe2-8f93-49d752d02f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:59.065982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a52ff065-9770-4fe2-8f93-49d752d02f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:23:59.067702 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3901/7817] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:23:58 2022] DELETE /identity/v3/projects/1015ad52f50940ddacb26dff52eafd2f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:23:59.072999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb82a9-3903-45a1-a692-d02809a05bb8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.073619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb82a9-3903-45a1-a692-d02809a05bb8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.073619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb82a9-3903-45a1-a692-d02809a05bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:59.108992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-22eb82a9-3903-45a1-a692-d02809a05bb8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:59.110252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-22eb82a9-3903-45a1-a692-d02809a05bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:59.170259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:59.189401 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3917/7818] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:59.191689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fd73b-9159-436c-b108-de26386039f7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.198117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fd73b-9159-436c-b108-de26386039f7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.198630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fd73b-9159-436c-b108-de26386039f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:59.225926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4b4fd73b-9159-436c-b108-de26386039f7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:59.227594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4b4fd73b-9159-436c-b108-de26386039f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:59.236621 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3902/7819] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:23:59.241442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb82a9-3903-45a1-a692-d02809a05bb8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:59.251734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb82a9-3903-45a1-a692-d02809a05bb8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:59.257537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104504a-3aa3-47b2-a277-d5b5f5b2752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:59.258736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104504a-3aa3-47b2-a277-d5b5f5b2752c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.259023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104504a-3aa3-47b2-a277-d5b5f5b2752c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.259298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104504a-3aa3-47b2-a277-d5b5f5b2752c admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:59.259949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104504a-3aa3-47b2-a277-d5b5f5b2752c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:23:59.260739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104504a-3aa3-47b2-a277-d5b5f5b2752c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:59.262324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104504a-3aa3-47b2-a277-d5b5f5b2752c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:59.277824 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3918/7820] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:23:59.280106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fd73b-9159-436c-b108-de26386039f7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:59.290356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fd73b-9159-436c-b108-de26386039f7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:59.296269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8141a-835c-40f6-a60e-79198ee90789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:59.297092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8141a-835c-40f6-a60e-79198ee90789 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.297472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8141a-835c-40f6-a60e-79198ee90789 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.297833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8141a-835c-40f6-a60e-79198ee90789 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:59.298802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8141a-835c-40f6-a60e-79198ee90789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:59.301713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8141a-835c-40f6-a60e-79198ee90789 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:59.334690 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3903/7821] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:23:59 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:23:59.339633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104504a-3aa3-47b2-a277-d5b5f5b2752c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:59.349952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104504a-3aa3-47b2-a277-d5b5f5b2752c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:59.409834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576276e-dc7e-4bdf-97db-bed70318bd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:59.410359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576276e-dc7e-4bdf-97db-bed70318bd3c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.410642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576276e-dc7e-4bdf-97db-bed70318bd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.410914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576276e-dc7e-4bdf-97db-bed70318bd3c admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:59.411663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576276e-dc7e-4bdf-97db-bed70318bd3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:59.413786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576276e-dc7e-4bdf-97db-bed70318bd3c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:59.439341 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3919/7822] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:23:59 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:23:59.440579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8141a-835c-40f6-a60e-79198ee90789 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:59.446311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:59.452880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8141a-835c-40f6-a60e-79198ee90789 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:59.458943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f6a6-a6ba-4271-b24e-a660b5e506d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:59.459902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f6a6-a6ba-4271-b24e-a660b5e506d9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.460254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f6a6-a6ba-4271-b24e-a660b5e506d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.460593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f6a6-a6ba-4271-b24e-a660b5e506d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:59.461865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848f6a6-a6ba-4271-b24e-a660b5e506d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:59.463524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848f6a6-a6ba-4271-b24e-a660b5e506d9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:59.474023 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3904/7823] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:23:59.478407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576276e-dc7e-4bdf-97db-bed70318bd3c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:59.490146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576276e-dc7e-4bdf-97db-bed70318bd3c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:59.496167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcf875-3f73-4ee1-8d13-520bb43130e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:59.496871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcf875-3f73-4ee1-8d13-520bb43130e9 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.497156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcf875-3f73-4ee1-8d13-520bb43130e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.497469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcf875-3f73-4ee1-8d13-520bb43130e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:59.498141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcf875-3f73-4ee1-8d13-520bb43130e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:59.499896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcf875-3f73-4ee1-8d13-520bb43130e9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:59.519181 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3920/7824] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:23:59.519648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f6a6-a6ba-4271-b24e-a660b5e506d9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:59.530751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f6a6-a6ba-4271-b24e-a660b5e506d9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:59.535616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233a7f5-c202-4111-a2d7-2c40ebe2003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:59.536352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a7f5-c202-4111-a2d7-2c40ebe2003b admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.536703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a7f5-c202-4111-a2d7-2c40ebe2003b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.537051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a7f5-c202-4111-a2d7-2c40ebe2003b admin admin] PATH_INFO: `/v3/projects/4ee6c047574247b6a1d23aa9c9926313/users/2d77744e7dfa48ee9eff5abb6db01ef0/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:59.553389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233a7f5-c202-4111-a2d7-2c40ebe2003b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee6c047574247b6a1d23aa9c9926313, user_id=2d77744e7dfa48ee9eff5abb6db01ef0, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:59.556048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233a7f5-c202-4111-a2d7-2c40ebe2003b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:59.569827 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3905/7825] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:23:59 2022] PUT /identity/v3/projects/4ee6c047574247b6a1d23aa9c9926313/users/2d77744e7dfa48ee9eff5abb6db01ef0/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:23:59.580239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e2e9-f65b-4899-8309-58fafe414211 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.580521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e2e9-f65b-4899-8309-58fafe414211 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.580792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e2e9-f65b-4899-8309-58fafe414211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:59.611221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b7f9e2e9-f65b-4899-8309-58fafe414211 None None] MFA Rules not processed for user `2d77744e7dfa48ee9eff5abb6db01ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:23:59.612427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b7f9e2e9-f65b-4899-8309-58fafe414211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:23:59.686361 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3921/7826] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:23:59.690927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233a7f5-c202-4111-a2d7-2c40ebe2003b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:59.754517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233a7f5-c202-4111-a2d7-2c40ebe2003b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:59.759266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b74522-4386-47b5-b40d-42d2e93e42f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:59.759897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b74522-4386-47b5-b40d-42d2e93e42f5 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.760180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b74522-4386-47b5-b40d-42d2e93e42f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.760454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b74522-4386-47b5-b40d-42d2e93e42f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:59.761088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b74522-4386-47b5-b40d-42d2e93e42f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:59.763166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b74522-4386-47b5-b40d-42d2e93e42f5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:59.791350 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3906/7827] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:23:59 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:23:59.795373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9e2e9-f65b-4899-8309-58fafe414211 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:59.806269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9e2e9-f65b-4899-8309-58fafe414211 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:59.856486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:59.868570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84d930-47c7-48dd-a277-c1acb3a822d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:59.869195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84d930-47c7-48dd-a277-c1acb3a822d5 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.869491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84d930-47c7-48dd-a277-c1acb3a822d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.869790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84d930-47c7-48dd-a277-c1acb3a822d5 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:59.870432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84d930-47c7-48dd-a277-c1acb3a822d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:59.872386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84d930-47c7-48dd-a277-c1acb3a822d5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:59.894962 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3922/7828] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:23:59 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:23:59.899091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b74522-4386-47b5-b40d-42d2e93e42f5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:59.910566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b74522-4386-47b5-b40d-42d2e93e42f5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:59.917552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e8286-c8bf-45b3-8e03-834a084204d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:59.918516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e8286-c8bf-45b3-8e03-834a084204d7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.918516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e8286-c8bf-45b3-8e03-834a084204d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.918721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e8286-c8bf-45b3-8e03-834a084204d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:59.919336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e8286-c8bf-45b3-8e03-834a084204d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:59.921069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e8286-c8bf-45b3-8e03-834a084204d7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:59.935002 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3907/7829] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:23:59.939184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84d930-47c7-48dd-a277-c1acb3a822d5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:59.949787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84d930-47c7-48dd-a277-c1acb3a822d5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:59.955435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951d950-a658-45b1-a56a-ec0e1939d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:59.955650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951d950-a658-45b1-a56a-ec0e1939d0ff admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.956184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951d950-a658-45b1-a56a-ec0e1939d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.956302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951d950-a658-45b1-a56a-ec0e1939d0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:23:59.956938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951d950-a658-45b1-a56a-ec0e1939d0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:23:59.958568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951d950-a658-45b1-a56a-ec0e1939d0ff admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:23:59.972610 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3923/7830] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:23:59.973902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e8286-c8bf-45b3-8e03-834a084204d7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:23:59.987200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e8286-c8bf-45b3-8e03-834a084204d7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:23:59.993942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ef6db-f1af-46d9-bf02-43e9a402c454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:23:59.993942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ef6db-f1af-46d9-bf02-43e9a402c454 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:23:59.994241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ef6db-f1af-46d9-bf02-43e9a402c454 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:23:59.994481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ef6db-f1af-46d9-bf02-43e9a402c454 admin admin] PATH_INFO: `/v3/projects/a0f63ce63163448b87cbc752950fa256/users/a76958c4b3534df1a2398e329004a27d/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:00.019010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ef6db-f1af-46d9-bf02-43e9a402c454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f63ce63163448b87cbc752950fa256, user_id=a76958c4b3534df1a2398e329004a27d, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:00.021807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ef6db-f1af-46d9-bf02-43e9a402c454 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:00.048817 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3908/7831] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:23:59 2022] PUT /identity/v3/projects/a0f63ce63163448b87cbc752950fa256/users/a76958c4b3534df1a2398e329004a27d/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:00.061560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b8ad-45f5-495f-9fcc-58c5f0a7492d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:00.061847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b8ad-45f5-495f-9fcc-58c5f0a7492d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:00.062135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b8ad-45f5-495f-9fcc-58c5f0a7492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:00.090491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2f85b8ad-45f5-495f-9fcc-58c5f0a7492d None None] MFA Rules not processed for user `a76958c4b3534df1a2398e329004a27d`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:00.091700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2f85b8ad-45f5-495f-9fcc-58c5f0a7492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:00.169847 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3924/7832] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:00.174621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ef6db-f1af-46d9-bf02-43e9a402c454 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:00.294720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ef6db-f1af-46d9-bf02-43e9a402c454 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:00.300713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe76a62-49a1-4ad4-9ea4-108a3452cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:00.301369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76a62-49a1-4ad4-9ea4-108a3452cbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:00.301649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76a62-49a1-4ad4-9ea4-108a3452cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:00.302043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76a62-49a1-4ad4-9ea4-108a3452cbe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:00.302747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe76a62-49a1-4ad4-9ea4-108a3452cbe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:00.305538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe76a62-49a1-4ad4-9ea4-108a3452cbe3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:00.344257 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3909/7833] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:24:00 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:24:00.348368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85b8ad-45f5-495f-9fcc-58c5f0a7492d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:00.363317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85b8ad-45f5-495f-9fcc-58c5f0a7492d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:00.436969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb58412-c9a0-4420-9939-bfc96babd35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:00.437778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58412-c9a0-4420-9939-bfc96babd35d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:00.438126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58412-c9a0-4420-9939-bfc96babd35d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:00.438483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58412-c9a0-4420-9939-bfc96babd35d admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:00.439182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb58412-c9a0-4420-9939-bfc96babd35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:00.441694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb58412-c9a0-4420-9939-bfc96babd35d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:00.489126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe76a62-49a1-4ad4-9ea4-108a3452cbe3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:00.489713 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3925/7834] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:24:00 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:24:00.496270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:00.510967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe76a62-49a1-4ad4-9ea4-108a3452cbe3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:00.521970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6ba22-6f4f-4e5a-9dd7-878d85b71d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:00.522596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6ba22-6f4f-4e5a-9dd7-878d85b71d26 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:00.522875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6ba22-6f4f-4e5a-9dd7-878d85b71d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:00.523179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6ba22-6f4f-4e5a-9dd7-878d85b71d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:00.523911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6ba22-6f4f-4e5a-9dd7-878d85b71d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:00.525538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6ba22-6f4f-4e5a-9dd7-878d85b71d26 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:00.547201 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3910/7835] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:24:00.548622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb58412-c9a0-4420-9939-bfc96babd35d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:00.562451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb58412-c9a0-4420-9939-bfc96babd35d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:00.568938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf63c7-5e40-450f-b695-ffc821347dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:00.572804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf63c7-5e40-450f-b695-ffc821347dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:00.580760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf63c7-5e40-450f-b695-ffc821347dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:00.581072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf63c7-5e40-450f-b695-ffc821347dd8 admin admin] PATH_INFO: `/v3/projects/95cf7796338f494a9887c5f5a5bd1358/users/2b5a5be01bbe45fe8dc82ac9cfb5ad33/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:00.604815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf63c7-5e40-450f-b695-ffc821347dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cf7796338f494a9887c5f5a5bd1358, user_id=2b5a5be01bbe45fe8dc82ac9cfb5ad33, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:00.607896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf63c7-5e40-450f-b695-ffc821347dd8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:00.627302 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3926/7836] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:24:00 2022] PUT /identity/v3/projects/95cf7796338f494a9887c5f5a5bd1358/users/2b5a5be01bbe45fe8dc82ac9cfb5ad33/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:00.628693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6ba22-6f4f-4e5a-9dd7-878d85b71d26 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:00.643549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6ba22-6f4f-4e5a-9dd7-878d85b71d26 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:00.725309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60c1d0-eab9-4eda-ab80-32d4fe070868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:00.726146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60c1d0-eab9-4eda-ab80-32d4fe070868 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:00.728268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60c1d0-eab9-4eda-ab80-32d4fe070868 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:00.735475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60c1d0-eab9-4eda-ab80-32d4fe070868 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:00.736338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60c1d0-eab9-4eda-ab80-32d4fe070868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:00.738188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60c1d0-eab9-4eda-ab80-32d4fe070868 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:00.759080 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3911/7837] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:24:00.759316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf63c7-5e40-450f-b695-ffc821347dd8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:00.771605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf63c7-5e40-450f-b695-ffc821347dd8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:00.777307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedf120-12eb-44e8-801a-50ae9ce53114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:00.777970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf120-12eb-44e8-801a-50ae9ce53114 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:00.778612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf120-12eb-44e8-801a-50ae9ce53114 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:00.786166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf120-12eb-44e8-801a-50ae9ce53114 admin admin] PATH_INFO: `/v3/projects/95cf7796338f494a9887c5f5a5bd1358/users/2b5a5be01bbe45fe8dc82ac9cfb5ad33/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:00.790724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedf120-12eb-44e8-801a-50ae9ce53114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cf7796338f494a9887c5f5a5bd1358, user_id=2b5a5be01bbe45fe8dc82ac9cfb5ad33, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:00.793861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedf120-12eb-44e8-801a-50ae9ce53114 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:00.819191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41739d85-a2e6-41fe-b89a-efe272d2e433 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:00.819591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41739d85-a2e6-41fe-b89a-efe272d2e433 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:00.819990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41739d85-a2e6-41fe-b89a-efe272d2e433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:00.823475 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3927/7838] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:24:00 2022] PUT /identity/v3/projects/95cf7796338f494a9887c5f5a5bd1358/users/2b5a5be01bbe45fe8dc82ac9cfb5ad33/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:24:00.858853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-41739d85-a2e6-41fe-b89a-efe272d2e433 None None] MFA Rules not processed for user `2b5a5be01bbe45fe8dc82ac9cfb5ad33`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:00.860232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-41739d85-a2e6-41fe-b89a-efe272d2e433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:00.956336 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3912/7839] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:00.966507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedf120-12eb-44e8-801a-50ae9ce53114 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:00.968615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0fedf120-12eb-44e8-801a-50ae9ce53114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:00.995005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:01.031947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b42cd-84a8-4a34-a425-5611433b7fe3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:01.032466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b42cd-84a8-4a34-a425-5611433b7fe3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:01.032648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b42cd-84a8-4a34-a425-5611433b7fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:01.058703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-799b42cd-84a8-4a34-a425-5611433b7fe3 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:01.061351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-799b42cd-84a8-4a34-a425-5611433b7fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:01.091684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedf120-12eb-44e8-801a-50ae9ce53114 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:01.110662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbdd90-9be7-422b-89fd-dd4f5d233147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:01.111294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdd90-9be7-422b-89fd-dd4f5d233147 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:01.111581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdd90-9be7-422b-89fd-dd4f5d233147 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:01.111856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdd90-9be7-422b-89fd-dd4f5d233147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:01.159733 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3913/7840] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:24:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:01.174508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b42cd-84a8-4a34-a425-5611433b7fe3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:01.178158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-799b42cd-84a8-4a34-a425-5611433b7fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:01.202419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbdd90-9be7-422b-89fd-dd4f5d233147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:01.213481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbdd90-9be7-422b-89fd-dd4f5d233147 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:01.219213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:01.243252 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3928/7841] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:01.296045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b42cd-84a8-4a34-a425-5611433b7fe3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:01.305686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c0227-9329-4a3b-832c-7f09e72b9b25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:01.306410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c0227-9329-4a3b-832c-7f09e72b9b25 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:01.306694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c0227-9329-4a3b-832c-7f09e72b9b25 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:01.307505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c0227-9329-4a3b-832c-7f09e72b9b25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:01.322375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c0227-9329-4a3b-832c-7f09e72b9b25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:01.323799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c0227-9329-4a3b-832c-7f09e72b9b25 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:01.342113 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3914/7842] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:24:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:24:03.067787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbdd90-9be7-422b-89fd-dd4f5d233147 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:03.069447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2ddbdd90-9be7-422b-89fd-dd4f5d233147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:03.113495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbdd90-9be7-422b-89fd-dd4f5d233147 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:03.130226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8925c4e-c3ec-4426-9d05-6cff15c5f050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:03.130864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8925c4e-c3ec-4426-9d05-6cff15c5f050 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:03.131347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8925c4e-c3ec-4426-9d05-6cff15c5f050 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:03.132394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8925c4e-c3ec-4426-9d05-6cff15c5f050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:03.214797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8925c4e-c3ec-4426-9d05-6cff15c5f050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:03.218054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8925c4e-c3ec-4426-9d05-6cff15c5f050 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:03.231043 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3929/7843] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:04.044317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c0227-9329-4a3b-832c-7f09e72b9b25 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:04.059620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c0227-9329-4a3b-832c-7f09e72b9b25 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:04.063789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f932718-ac72-4afa-819d-2915555661f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:04.065266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f932718-ac72-4afa-819d-2915555661f1 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:04.066145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f932718-ac72-4afa-819d-2915555661f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:04.067140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f932718-ac72-4afa-819d-2915555661f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:04.095206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f932718-ac72-4afa-819d-2915555661f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:04.096903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f932718-ac72-4afa-819d-2915555661f1 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:04.109645 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3915/7844] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:08.202055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8925c4e-c3ec-4426-9d05-6cff15c5f050 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:08.283627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8925c4e-c3ec-4426-9d05-6cff15c5f050 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:08.289778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:08.290975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:08.291480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:08.291969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] PATH_INFO: `/v3/users/2d77744e7dfa48ee9eff5abb6db01ef0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:08.293428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d77744e7dfa48ee9eff5abb6db01ef0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:08.295718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:08.304028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:08.370576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d77744e7dfa48ee9eff5abb6db01ef0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:08.378963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d77744e7dfa48ee9eff5abb6db01ef0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:08.380138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d77744e7dfa48ee9eff5abb6db01ef0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:08.380555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d77744e7dfa48ee9eff5abb6db01ef0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:08.396341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d77744e7dfa48ee9eff5abb6db01ef0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:08.437239 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3930/7845] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:24:08 2022] DELETE /identity/v3/users/2d77744e7dfa48ee9eff5abb6db01ef0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:08.437496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d5ef6-ccf6-48e2-b056-4e250dfc4009 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:08.437496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d5ef6-ccf6-48e2-b056-4e250dfc4009 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:08.437496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d5ef6-ccf6-48e2-b056-4e250dfc4009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:08.463954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ba6d5ef6-ccf6-48e2-b056-4e250dfc4009 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:08.465534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ba6d5ef6-ccf6-48e2-b056-4e250dfc4009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:08.538763 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3916/7846] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:08.555097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:08.556546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:08.635698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f5cc7-6cc9-4ceb-9e61-b3cdaa6cc4df admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:08.639865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30417474-3ed5-4ead-8ba9-52d68e3b43f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:08.640487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30417474-3ed5-4ead-8ba9-52d68e3b43f5 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:08.640770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30417474-3ed5-4ead-8ba9-52d68e3b43f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:08.641043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30417474-3ed5-4ead-8ba9-52d68e3b43f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:08.652705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30417474-3ed5-4ead-8ba9-52d68e3b43f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:08.654193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30417474-3ed5-4ead-8ba9-52d68e3b43f5 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:08.666353 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3931/7847] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:08.944409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d5ef6-ccf6-48e2-b056-4e250dfc4009 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:08.946028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ba6d5ef6-ccf6-48e2-b056-4e250dfc4009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:08.964465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d5ef6-ccf6-48e2-b056-4e250dfc4009 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:08.969401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:08.970047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:08.970329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:08.970605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] PATH_INFO: `/v3/projects/4ee6c047574247b6a1d23aa9c9926313` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:08.971948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee6c047574247b6a1d23aa9c9926313)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:08.973764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:09.030582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee6c047574247b6a1d23aa9c9926313', 'request_id': 'req-8340573e-3995-490a-88e8-f66d131e3c7f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.039326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee6c047574247b6a1d23aa9c9926313', 'request_id': 'req-8340573e-3995-490a-88e8-f66d131e3c7f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.045286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee6c047574247b6a1d23aa9c9926313', 'request_id': 'req-8340573e-3995-490a-88e8-f66d131e3c7f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.058706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] The token cache is being invalidate because project 4ee6c047574247b6a1d23aa9c9926313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:24:09.059070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.059746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.061295 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3917/7848] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:24:08 2022] DELETE /identity/v3/projects/4ee6c047574247b6a1d23aa9c9926313 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:24:09.065638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30417474-3ed5-4ead-8ba9-52d68e3b43f5 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:09.076297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30417474-3ed5-4ead-8ba9-52d68e3b43f5 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:09.160668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:09.161721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:09.162323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:09.162661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] PATH_INFO: `/v3/users/a76958c4b3534df1a2398e329004a27d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:09.164721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76958c4b3534df1a2398e329004a27d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:09.166878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:09.206654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:09.223727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76958c4b3534df1a2398e329004a27d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.231702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76958c4b3534df1a2398e329004a27d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.232405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76958c4b3534df1a2398e329004a27d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.233014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76958c4b3534df1a2398e329004a27d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.245827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76958c4b3534df1a2398e329004a27d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.258359 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3932/7849] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:24:09 2022] DELETE /identity/v3/users/a76958c4b3534df1a2398e329004a27d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:09.588971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:09.594646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:09.613584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340573e-3995-490a-88e8-f66d131e3c7f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:09.631131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:09.690131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:09.690875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:09.691227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:09.691599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] PATH_INFO: `/v3/projects/a0f63ce63163448b87cbc752950fa256` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:09.692807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f63ce63163448b87cbc752950fa256)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:09.694824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:09.751331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f63ce63163448b87cbc752950fa256', 'request_id': 'req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.759232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f63ce63163448b87cbc752950fa256', 'request_id': 'req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.765035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f63ce63163448b87cbc752950fa256', 'request_id': 'req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.776175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] The token cache is being invalidate because project a0f63ce63163448b87cbc752950fa256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:24:09.776461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.777145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.778648 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3918/7850] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:24:09 2022] DELETE /identity/v3/projects/a0f63ce63163448b87cbc752950fa256 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:09.782576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:09.783972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:09.797420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72023813-bb06-447f-83a7-5d55bda06117 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:09.854914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f909fe-9911-4694-af3c-3ca2cbd86c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:09.855815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f909fe-9911-4694-af3c-3ca2cbd86c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:09.856094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f909fe-9911-4694-af3c-3ca2cbd86c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:09.856365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f909fe-9911-4694-af3c-3ca2cbd86c77 admin admin] PATH_INFO: `/v3/users/2b5a5be01bbe45fe8dc82ac9cfb5ad33` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:09.857551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f909fe-9911-4694-af3c-3ca2cbd86c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b5a5be01bbe45fe8dc82ac9cfb5ad33)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:09.859477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f909fe-9911-4694-af3c-3ca2cbd86c77 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:09.913147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9f909fe-9911-4694-af3c-3ca2cbd86c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b5a5be01bbe45fe8dc82ac9cfb5ad33'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.921928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9f909fe-9911-4694-af3c-3ca2cbd86c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b5a5be01bbe45fe8dc82ac9cfb5ad33'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.922508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9f909fe-9911-4694-af3c-3ca2cbd86c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b5a5be01bbe45fe8dc82ac9cfb5ad33'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.923221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9f909fe-9911-4694-af3c-3ca2cbd86c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b5a5be01bbe45fe8dc82ac9cfb5ad33'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.936395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a9f909fe-9911-4694-af3c-3ca2cbd86c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b5a5be01bbe45fe8dc82ac9cfb5ad33'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:09.950133 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3933/7851] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:24:09 2022] DELETE /identity/v3/users/2b5a5be01bbe45fe8dc82ac9cfb5ad33 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:10.302130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:10.303193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:10.317420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2bbd7-049d-49ee-b7b1-ff91c8384e0c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:10.393930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84069006-30f5-4afa-88cb-77b94ce493b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:10.394682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84069006-30f5-4afa-88cb-77b94ce493b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:10.394961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84069006-30f5-4afa-88cb-77b94ce493b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:10.395234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84069006-30f5-4afa-88cb-77b94ce493b8 admin admin] PATH_INFO: `/v3/projects/95cf7796338f494a9887c5f5a5bd1358` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:10.396437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84069006-30f5-4afa-88cb-77b94ce493b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95cf7796338f494a9887c5f5a5bd1358)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:10.399143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84069006-30f5-4afa-88cb-77b94ce493b8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:10.474126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84069006-30f5-4afa-88cb-77b94ce493b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95cf7796338f494a9887c5f5a5bd1358', 'request_id': 'req-84069006-30f5-4afa-88cb-77b94ce493b8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:10.477354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:10.499683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84069006-30f5-4afa-88cb-77b94ce493b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95cf7796338f494a9887c5f5a5bd1358', 'request_id': 'req-84069006-30f5-4afa-88cb-77b94ce493b8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:10.511764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84069006-30f5-4afa-88cb-77b94ce493b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95cf7796338f494a9887c5f5a5bd1358', 'request_id': 'req-84069006-30f5-4afa-88cb-77b94ce493b8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:10.530560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84069006-30f5-4afa-88cb-77b94ce493b8 admin admin] The token cache is being invalidate because project 95cf7796338f494a9887c5f5a5bd1358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:24:10.531026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84069006-30f5-4afa-88cb-77b94ce493b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:10.531928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84069006-30f5-4afa-88cb-77b94ce493b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:10.534195 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3919/7852] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:24:10 2022] DELETE /identity/v3/projects/95cf7796338f494a9887c5f5a5bd1358 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:10.540642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876225-1047-474a-9700-46e1801f9737 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:10.541542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876225-1047-474a-9700-46e1801f9737 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:10.542009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876225-1047-474a-9700-46e1801f9737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:10.566012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-39876225-1047-474a-9700-46e1801f9737 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:10.567902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-39876225-1047-474a-9700-46e1801f9737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:10.598523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:10.668471 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3934/7853] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:10.676569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fc15e-afae-429b-b0fc-24c6bc6df248 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:10.677137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fc15e-afae-429b-b0fc-24c6bc6df248 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:10.677425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fc15e-afae-429b-b0fc-24c6bc6df248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:10.700291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-195fc15e-afae-429b-b0fc-24c6bc6df248 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:10.701803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-195fc15e-afae-429b-b0fc-24c6bc6df248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:10.712192 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3920/7854] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:10.716565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876225-1047-474a-9700-46e1801f9737 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:10.730562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876225-1047-474a-9700-46e1801f9737 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:10.736245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e69a77-3a77-4b61-972a-90f828a8a78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:10.736959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69a77-3a77-4b61-972a-90f828a8a78c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:10.737283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69a77-3a77-4b61-972a-90f828a8a78c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:10.737562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69a77-3a77-4b61-972a-90f828a8a78c admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:10.738211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e69a77-3a77-4b61-972a-90f828a8a78c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:24:10.738706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e69a77-3a77-4b61-972a-90f828a8a78c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:10.740614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e69a77-3a77-4b61-972a-90f828a8a78c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:10.758579 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3935/7855] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:24:10.763179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fc15e-afae-429b-b0fc-24c6bc6df248 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:10.775629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fc15e-afae-429b-b0fc-24c6bc6df248 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:10.785364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39ffca-6d67-44f3-a963-60fe07147473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:10.786252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ffca-6d67-44f3-a963-60fe07147473 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:10.786542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ffca-6d67-44f3-a963-60fe07147473 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:10.787300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ffca-6d67-44f3-a963-60fe07147473 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:10.787478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39ffca-6d67-44f3-a963-60fe07147473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:10.789482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39ffca-6d67-44f3-a963-60fe07147473 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:10.833007 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3921/7856] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:24:10 2022] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:24:10.837996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e69a77-3a77-4b61-972a-90f828a8a78c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:10.850635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e69a77-3a77-4b61-972a-90f828a8a78c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:10.947538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc97534-ec50-44d4-a413-c993a4d5ef24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:10.948745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc97534-ec50-44d4-a413-c993a4d5ef24 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:10.948745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc97534-ec50-44d4-a413-c993a4d5ef24 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:10.948991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc97534-ec50-44d4-a413-c993a4d5ef24 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:10.949593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc97534-ec50-44d4-a413-c993a4d5ef24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:10.951964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc97534-ec50-44d4-a413-c993a4d5ef24 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:10.998877 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3936/7857] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:24:10 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:24:11.003076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39ffca-6d67-44f3-a963-60fe07147473 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:11.016628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39ffca-6d67-44f3-a963-60fe07147473 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:11.022230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89217e-e581-4ce5-9d2e-47dee52e4a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:11.023179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89217e-e581-4ce5-9d2e-47dee52e4a9f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:11.023736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89217e-e581-4ce5-9d2e-47dee52e4a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:11.023903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89217e-e581-4ce5-9d2e-47dee52e4a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:11.024721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89217e-e581-4ce5-9d2e-47dee52e4a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:11.026989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89217e-e581-4ce5-9d2e-47dee52e4a9f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:11.041659 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3922/7858] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:24:11.042762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc97534-ec50-44d4-a413-c993a4d5ef24 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:11.052921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc97534-ec50-44d4-a413-c993a4d5ef24 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:11.058111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48185114-4b25-4153-8f26-424a2517960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:11.058706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48185114-4b25-4153-8f26-424a2517960a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:11.059107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48185114-4b25-4153-8f26-424a2517960a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:11.059395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48185114-4b25-4153-8f26-424a2517960a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:11.060040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48185114-4b25-4153-8f26-424a2517960a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:11.061658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48185114-4b25-4153-8f26-424a2517960a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:11.072924 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3937/7859] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:24:11.077106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89217e-e581-4ce5-9d2e-47dee52e4a9f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:11.088611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89217e-e581-4ce5-9d2e-47dee52e4a9f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:11.093514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acae498-20e1-4992-8661-0a7c84f5ff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:11.094246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acae498-20e1-4992-8661-0a7c84f5ff4c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:11.095196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acae498-20e1-4992-8661-0a7c84f5ff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:11.095574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acae498-20e1-4992-8661-0a7c84f5ff4c admin admin] PATH_INFO: `/v3/projects/3eeb6be960cc408296ecce6353b72f6d/users/8219a93945a147c4a57bb6452212fe7c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:11.111650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acae498-20e1-4992-8661-0a7c84f5ff4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eeb6be960cc408296ecce6353b72f6d, user_id=8219a93945a147c4a57bb6452212fe7c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:11.114324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acae498-20e1-4992-8661-0a7c84f5ff4c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:11.127529 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3923/7860] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:24:11 2022] PUT /identity/v3/projects/3eeb6be960cc408296ecce6353b72f6d/users/8219a93945a147c4a57bb6452212fe7c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:24:11.140440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d6d00-2923-4313-aa68-c6246c4e03c2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:11.140746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d6d00-2923-4313-aa68-c6246c4e03c2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:11.141024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d6d00-2923-4313-aa68-c6246c4e03c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:11.169925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e58d6d00-2923-4313-aa68-c6246c4e03c2 None None] MFA Rules not processed for user `8219a93945a147c4a57bb6452212fe7c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:11.171179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e58d6d00-2923-4313-aa68-c6246c4e03c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:11.237541 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3938/7861] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:11.242481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acae498-20e1-4992-8661-0a7c84f5ff4c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:11.306701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acae498-20e1-4992-8661-0a7c84f5ff4c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:11.311581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a757e-4527-4519-af4d-022b7ea35cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:11.312196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a757e-4527-4519-af4d-022b7ea35cfa admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:11.312478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a757e-4527-4519-af4d-022b7ea35cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:11.312757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a757e-4527-4519-af4d-022b7ea35cfa admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:11.313415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a757e-4527-4519-af4d-022b7ea35cfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:11.315311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a757e-4527-4519-af4d-022b7ea35cfa admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:11.343257 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3924/7862] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:24:11 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:24:11.347115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d6d00-2923-4313-aa68-c6246c4e03c2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:11.359724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d6d00-2923-4313-aa68-c6246c4e03c2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:11.388631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:11.442495 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a52cd2-1a86-4a73-99d9-090600a24271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:11.443139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a52cd2-1a86-4a73-99d9-090600a24271 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:11.443467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a52cd2-1a86-4a73-99d9-090600a24271 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:11.443756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a52cd2-1a86-4a73-99d9-090600a24271 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:11.444391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a52cd2-1a86-4a73-99d9-090600a24271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:11.446920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a52cd2-1a86-4a73-99d9-090600a24271 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:11.475637 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3939/7863] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:24:11 2022] POST /identity/v3/users => generated 303 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:24:11.482872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a757e-4527-4519-af4d-022b7ea35cfa admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:11.491924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a757e-4527-4519-af4d-022b7ea35cfa admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:11.497284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ea8ed-bbdc-4003-8d54-3489d1b81561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:11.498232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ea8ed-bbdc-4003-8d54-3489d1b81561 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:11.498347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ea8ed-bbdc-4003-8d54-3489d1b81561 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:11.498631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ea8ed-bbdc-4003-8d54-3489d1b81561 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:11.499288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ea8ed-bbdc-4003-8d54-3489d1b81561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:11.501111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ea8ed-bbdc-4003-8d54-3489d1b81561 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:11.517123 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3925/7864] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:24:11.518483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a52cd2-1a86-4a73-99d9-090600a24271 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:11.529559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a52cd2-1a86-4a73-99d9-090600a24271 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:11.534317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3aeedd-da5e-4036-bab9-d08ab2fccf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:11.535049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3aeedd-da5e-4036-bab9-d08ab2fccf48 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:11.535498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3aeedd-da5e-4036-bab9-d08ab2fccf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:11.535781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3aeedd-da5e-4036-bab9-d08ab2fccf48 admin admin] PATH_INFO: `/v3/projects/3661b4b41b604beea175732bb476f4a7/users/a691762d84b24f50926fa20dfc4d4ad9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:11.552092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3aeedd-da5e-4036-bab9-d08ab2fccf48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3661b4b41b604beea175732bb476f4a7, user_id=a691762d84b24f50926fa20dfc4d4ad9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:11.554839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3aeedd-da5e-4036-bab9-d08ab2fccf48 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:11.571114 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3940/7865] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:24:11 2022] PUT /identity/v3/projects/3661b4b41b604beea175732bb476f4a7/users/a691762d84b24f50926fa20dfc4d4ad9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:11.585295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ea8ed-bbdc-4003-8d54-3489d1b81561 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:11.596465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ea8ed-bbdc-4003-8d54-3489d1b81561 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:11.648823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:11.663442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f323-8ec9-4b5e-bfe8-df595340a1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:11.664752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f323-8ec9-4b5e-bfe8-df595340a1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:11.665035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f323-8ec9-4b5e-bfe8-df595340a1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:11.665380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f323-8ec9-4b5e-bfe8-df595340a1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:11.666028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f323-8ec9-4b5e-bfe8-df595340a1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:11.667629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f323-8ec9-4b5e-bfe8-df595340a1e8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:11.677814 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3926/7866] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:24:11.681813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3aeedd-da5e-4036-bab9-d08ab2fccf48 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:11.692607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3aeedd-da5e-4036-bab9-d08ab2fccf48 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:11.697726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87216d-5e81-4b51-b18c-364afb639b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:11.698471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87216d-5e81-4b51-b18c-364afb639b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:11.698818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87216d-5e81-4b51-b18c-364afb639b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:11.699166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87216d-5e81-4b51-b18c-364afb639b6b admin admin] PATH_INFO: `/v3/projects/3661b4b41b604beea175732bb476f4a7/users/a691762d84b24f50926fa20dfc4d4ad9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:11.701892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87216d-5e81-4b51-b18c-364afb639b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3661b4b41b604beea175732bb476f4a7, user_id=a691762d84b24f50926fa20dfc4d4ad9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:11.704867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87216d-5e81-4b51-b18c-364afb639b6b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:11.725743 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3941/7867] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:24:11 2022] PUT /identity/v3/projects/3661b4b41b604beea175732bb476f4a7/users/a691762d84b24f50926fa20dfc4d4ad9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:11.730752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caab041-dacb-4e06-b7f1-e7194549c8e5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:11.731078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caab041-dacb-4e06-b7f1-e7194549c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:11.731387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caab041-dacb-4e06-b7f1-e7194549c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:11.760166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5caab041-dacb-4e06-b7f1-e7194549c8e5 None None] MFA Rules not processed for user `a691762d84b24f50926fa20dfc4d4ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:11.761343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5caab041-dacb-4e06-b7f1-e7194549c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:11.834808 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3927/7868] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:11.848749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87216d-5e81-4b51-b18c-364afb639b6b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:11.850482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-af87216d-5e81-4b51-b18c-364afb639b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:11.930593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87216d-5e81-4b51-b18c-364afb639b6b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:11.936256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04cc09-b482-46a3-861a-2758eaf8860b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:11.936863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04cc09-b482-46a3-861a-2758eaf8860b service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:11.937140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04cc09-b482-46a3-861a-2758eaf8860b service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:11.937440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04cc09-b482-46a3-861a-2758eaf8860b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:11.993551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04cc09-b482-46a3-861a-2758eaf8860b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:11.995148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04cc09-b482-46a3-861a-2758eaf8860b service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:12.004391 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3942/7869] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:16.935950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caab041-dacb-4e06-b7f1-e7194549c8e5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:16.937953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5caab041-dacb-4e06-b7f1-e7194549c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:17.016762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caab041-dacb-4e06-b7f1-e7194549c8e5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:17.021468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:17.022109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:17.022387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:17.022663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] PATH_INFO: `/v3/users/33a0d81fb2dd4891901f27890ce7688e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:17.024946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a0d81fb2dd4891901f27890ce7688e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:17.026898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:17.079596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a0d81fb2dd4891901f27890ce7688e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:17.087532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a0d81fb2dd4891901f27890ce7688e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:17.088222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a0d81fb2dd4891901f27890ce7688e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:17.088839 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a0d81fb2dd4891901f27890ce7688e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:17.099747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:17.101261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a0d81fb2dd4891901f27890ce7688e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:17.115347 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3928/7870] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:24:16 2022] DELETE /identity/v3/users/33a0d81fb2dd4891901f27890ce7688e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:17.120207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4ae78-5407-4530-a8b3-84d9ff5382fc None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:17.120682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4ae78-5407-4530-a8b3-84d9ff5382fc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:17.120792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4ae78-5407-4530-a8b3-84d9ff5382fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:17.141623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b6f4ae78-5407-4530-a8b3-84d9ff5382fc None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:17.142951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b6f4ae78-5407-4530-a8b3-84d9ff5382fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:17.148968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:17.205341 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3943/7871] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:17.216488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:17.218726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:17.280250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c44f8f-5517-41eb-9215-d484dd327ec0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:17.284565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaebf8-c554-41bc-b0f3-982cbf09fdaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:17.285228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaebf8-c554-41bc-b0f3-982cbf09fdaa service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:17.285513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaebf8-c554-41bc-b0f3-982cbf09fdaa service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:17.285811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaebf8-c554-41bc-b0f3-982cbf09fdaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:17.296860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaebf8-c554-41bc-b0f3-982cbf09fdaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:17.298439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaebf8-c554-41bc-b0f3-982cbf09fdaa service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:17.313905 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3929/7872] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:17.626420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4ae78-5407-4530-a8b3-84d9ff5382fc None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:17.628428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b6f4ae78-5407-4530-a8b3-84d9ff5382fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:17.645637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4ae78-5407-4530-a8b3-84d9ff5382fc None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:17.650696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4b404-ef6e-416c-9e14-d2c89505e0d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:17.652605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4b404-ef6e-416c-9e14-d2c89505e0d4 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:17.653255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4b404-ef6e-416c-9e14-d2c89505e0d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:17.653826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4b404-ef6e-416c-9e14-d2c89505e0d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:17.656068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-29c4b404-ef6e-416c-9e14-d2c89505e0d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:17.662168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaebf8-c554-41bc-b0f3-982cbf09fdaa service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:17.664310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bbbaebf8-c554-41bc-b0f3-982cbf09fdaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:17.684325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaebf8-c554-41bc-b0f3-982cbf09fdaa service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:17.698670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:17.699724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:17.700239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:17.700788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] PATH_INFO: `/v3/projects/e5fd83b3bdef4ba18ba56a9385e26d01` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:17.704687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5fd83b3bdef4ba18ba56a9385e26d01)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:17.707357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:17.793241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4b404-ef6e-416c-9e14-d2c89505e0d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:17.795236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4b404-ef6e-416c-9e14-d2c89505e0d4 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:17.807965 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3944/7873] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:17 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:17.816347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'request_id': 'req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:17.837650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'request_id': 'req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:17.850878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'request_id': 'req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:17.877979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] The token cache is being invalidate because project e5fd83b3bdef4ba18ba56a9385e26d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:24:17.878425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:17.879509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:17.881711 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3930/7874] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:24:17 2022] DELETE /identity/v3/projects/e5fd83b3bdef4ba18ba56a9385e26d01 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:17.885625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4b404-ef6e-416c-9e14-d2c89505e0d4 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:17.900294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4b404-ef6e-416c-9e14-d2c89505e0d4 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:17.990176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:17.990862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:17.991148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:17.991427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] PATH_INFO: `/v3/users/a71abcce7dd744f9a193f5fd82d50f43` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:17.993440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71abcce7dd744f9a193f5fd82d50f43)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:17.995395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:18.090346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71abcce7dd744f9a193f5fd82d50f43'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:18.091910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:18.104595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71abcce7dd744f9a193f5fd82d50f43'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:18.106906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71abcce7dd744f9a193f5fd82d50f43'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:18.108891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71abcce7dd744f9a193f5fd82d50f43'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:18.151568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71abcce7dd744f9a193f5fd82d50f43'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:18.181950 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3945/7875] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:24:17 2022] DELETE /identity/v3/users/a71abcce7dd744f9a193f5fd82d50f43 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:24:18.932165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:18.940056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:18.960768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd182d-6d01-476a-82ac-9d5cc15a2a57 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:19.031602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:19.032776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:19.033268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:19.034043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] PATH_INFO: `/v3/projects/aa8345d566614a48a20217feaf96f76b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:19.035572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8345d566614a48a20217feaf96f76b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:19.037848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:19.073326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:19.111346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8345d566614a48a20217feaf96f76b', 'request_id': 'req-a49e0127-2c45-4485-9afb-27c738e43ec4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.123610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8345d566614a48a20217feaf96f76b', 'request_id': 'req-a49e0127-2c45-4485-9afb-27c738e43ec4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.134929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8345d566614a48a20217feaf96f76b', 'request_id': 'req-a49e0127-2c45-4485-9afb-27c738e43ec4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.161516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] The token cache is being invalidate because project aa8345d566614a48a20217feaf96f76b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:24:19.161818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.162751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.165612 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3931/7876] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:24:18 2022] DELETE /identity/v3/projects/aa8345d566614a48a20217feaf96f76b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:19.169613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:19.171131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:19.189599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83985024-6ab8-4095-a30b-1c0e032d231c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:19.268899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e44531-468a-47ed-9da5-6060a6a76195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:19.269619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e44531-468a-47ed-9da5-6060a6a76195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:19.269907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e44531-468a-47ed-9da5-6060a6a76195 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:19.270181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e44531-468a-47ed-9da5-6060a6a76195 admin admin] PATH_INFO: `/v3/users/d68fd5a95f314a45bef189ba701c3f9c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:19.271534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e44531-468a-47ed-9da5-6060a6a76195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68fd5a95f314a45bef189ba701c3f9c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:19.274124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e44531-468a-47ed-9da5-6060a6a76195 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:19.354557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b1e44531-468a-47ed-9da5-6060a6a76195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68fd5a95f314a45bef189ba701c3f9c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.376097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b1e44531-468a-47ed-9da5-6060a6a76195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68fd5a95f314a45bef189ba701c3f9c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.376097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b1e44531-468a-47ed-9da5-6060a6a76195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68fd5a95f314a45bef189ba701c3f9c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.376097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b1e44531-468a-47ed-9da5-6060a6a76195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68fd5a95f314a45bef189ba701c3f9c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.402401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b1e44531-468a-47ed-9da5-6060a6a76195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68fd5a95f314a45bef189ba701c3f9c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.433290 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3946/7877] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:24:19 2022] DELETE /identity/v3/users/d68fd5a95f314a45bef189ba701c3f9c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:24:19.690481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:19.692246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:19.720619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e0127-2c45-4485-9afb-27c738e43ec4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:19.806282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:19.808618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:19.809137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:19.809721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16 admin admin] PATH_INFO: `/v3/projects/5286be7c4b2d495892edec8a012504fa` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:19.812942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5286be7c4b2d495892edec8a012504fa)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:19.816868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:19.892217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5286be7c4b2d495892edec8a012504fa', 'request_id': 'req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.902485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5286be7c4b2d495892edec8a012504fa', 'request_id': 'req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.913319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5286be7c4b2d495892edec8a012504fa', 'request_id': 'req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.933223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16 admin admin] The token cache is being invalidate because project 5286be7c4b2d495892edec8a012504fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:24:19.933790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.934246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-948e7bf3-22c7-41e8-bd04-b84b42ae8b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:19.937010 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3932/7878] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:24:19 2022] DELETE /identity/v3/projects/5286be7c4b2d495892edec8a012504fa => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:19.944809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4526f1a-fa88-43a4-8731-3013143d5624 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:19.945171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4526f1a-fa88-43a4-8731-3013143d5624 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:19.945536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4526f1a-fa88-43a4-8731-3013143d5624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:20.000209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c4526f1a-fa88-43a4-8731-3013143d5624 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:20.009323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c4526f1a-fa88-43a4-8731-3013143d5624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:20.120581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:20.176792 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3947/7879] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:20.186692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff6771-bad2-441f-8464-c58dde774b98 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:20.187022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff6771-bad2-441f-8464-c58dde774b98 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:20.187399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff6771-bad2-441f-8464-c58dde774b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:20.215270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ecff6771-bad2-441f-8464-c58dde774b98 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:20.217046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ecff6771-bad2-441f-8464-c58dde774b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:20.232298 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3933/7880] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:20.233829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4526f1a-fa88-43a4-8731-3013143d5624 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:20.251715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4526f1a-fa88-43a4-8731-3013143d5624 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:20.261140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362ac3-ffb9-4f0f-b387-8077156ba473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:20.261792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362ac3-ffb9-4f0f-b387-8077156ba473 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:20.262077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362ac3-ffb9-4f0f-b387-8077156ba473 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:20.262357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362ac3-ffb9-4f0f-b387-8077156ba473 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:20.264101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae362ac3-ffb9-4f0f-b387-8077156ba473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:24:20.264101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae362ac3-ffb9-4f0f-b387-8077156ba473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:20.265631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae362ac3-ffb9-4f0f-b387-8077156ba473 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:20.306877 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3948/7881] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:24:20.308489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff6771-bad2-441f-8464-c58dde774b98 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:20.321097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff6771-bad2-441f-8464-c58dde774b98 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:20.326279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6211838-3919-4f02-9fd9-9b9408da563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:20.327198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211838-3919-4f02-9fd9-9b9408da563c admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:20.327702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211838-3919-4f02-9fd9-9b9408da563c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:20.328210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211838-3919-4f02-9fd9-9b9408da563c admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:20.329085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6211838-3919-4f02-9fd9-9b9408da563c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:20.331237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6211838-3919-4f02-9fd9-9b9408da563c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:20.385675 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3934/7882] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:24:20 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:24:20.386223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362ac3-ffb9-4f0f-b387-8077156ba473 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:20.417269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362ac3-ffb9-4f0f-b387-8077156ba473 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:20.538045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabf22c-9822-400c-a4ee-83572dd24c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:20.539300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabf22c-9822-400c-a4ee-83572dd24c57 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:20.539590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabf22c-9822-400c-a4ee-83572dd24c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:20.539860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabf22c-9822-400c-a4ee-83572dd24c57 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:20.540496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabf22c-9822-400c-a4ee-83572dd24c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:20.542508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabf22c-9822-400c-a4ee-83572dd24c57 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:20.589989 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3949/7883] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:24:20 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:24:20.594574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6211838-3919-4f02-9fd9-9b9408da563c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:20.613808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6211838-3919-4f02-9fd9-9b9408da563c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:20.623144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4fa71-f736-4102-b818-66f3655c1a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:20.623994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4fa71-f736-4102-b818-66f3655c1a3c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:20.624336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4fa71-f736-4102-b818-66f3655c1a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:20.624601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4fa71-f736-4102-b818-66f3655c1a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:20.625371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4fa71-f736-4102-b818-66f3655c1a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:20.628812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4fa71-f736-4102-b818-66f3655c1a3c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:20.646204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:20.671237 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3935/7884] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:24:20.674031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabf22c-9822-400c-a4ee-83572dd24c57 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:20.689639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabf22c-9822-400c-a4ee-83572dd24c57 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:20.708694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19446bc4-1d01-468c-89c5-f4f7827b64a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:20.709994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19446bc4-1d01-468c-89c5-f4f7827b64a0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:20.711948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19446bc4-1d01-468c-89c5-f4f7827b64a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:20.712464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19446bc4-1d01-468c-89c5-f4f7827b64a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:20.715285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19446bc4-1d01-468c-89c5-f4f7827b64a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:20.717928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19446bc4-1d01-468c-89c5-f4f7827b64a0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:20.737293 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3950/7885] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:24:20.741397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4fa71-f736-4102-b818-66f3655c1a3c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:20.756742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4fa71-f736-4102-b818-66f3655c1a3c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:20.772349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c240c5-8dae-4da9-87cf-8595106c2eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:20.773070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c240c5-8dae-4da9-87cf-8595106c2eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:20.773900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c240c5-8dae-4da9-87cf-8595106c2eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:20.774250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c240c5-8dae-4da9-87cf-8595106c2eb6 admin admin] PATH_INFO: `/v3/projects/45a8512d937a429fbaf3b151cd7cfbaa/users/d5cd6f4a13a74dc4868d9efea064a047/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:20.809894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c240c5-8dae-4da9-87cf-8595106c2eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a8512d937a429fbaf3b151cd7cfbaa, user_id=d5cd6f4a13a74dc4868d9efea064a047, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:20.818652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c240c5-8dae-4da9-87cf-8595106c2eb6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:20.849250 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3936/7886] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:24:20 2022] PUT /identity/v3/projects/45a8512d937a429fbaf3b151cd7cfbaa/users/d5cd6f4a13a74dc4868d9efea064a047/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:20.855631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f141867-d458-418e-a508-74ee77cdced5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:20.855921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f141867-d458-418e-a508-74ee77cdced5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:20.856203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f141867-d458-418e-a508-74ee77cdced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:20.894487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3f141867-d458-418e-a508-74ee77cdced5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:20.896678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3f141867-d458-418e-a508-74ee77cdced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:20.991103 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3951/7887] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:21.031871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c240c5-8dae-4da9-87cf-8595106c2eb6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:21.038101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-30c240c5-8dae-4da9-87cf-8595106c2eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:21.158054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c240c5-8dae-4da9-87cf-8595106c2eb6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:21.164871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b0425-0bbf-4442-ab4c-5e176dd05c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:21.165471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b0425-0bbf-4442-ab4c-5e176dd05c21 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:21.165758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b0425-0bbf-4442-ab4c-5e176dd05c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:21.166037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b0425-0bbf-4442-ab4c-5e176dd05c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:21.192816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b0425-0bbf-4442-ab4c-5e176dd05c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:21.194940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b0425-0bbf-4442-ab4c-5e176dd05c21 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:21.221688 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3937/7888] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:23.923858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f141867-d458-418e-a508-74ee77cdced5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:23.944446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f141867-d458-418e-a508-74ee77cdced5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:23.951980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ae0e0-c270-4c32-bfa4-1895e1349e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:23.952821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ae0e0-c270-4c32-bfa4-1895e1349e2a service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:23.953542 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ae0e0-c270-4c32-bfa4-1895e1349e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:23.953982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ae0e0-c270-4c32-bfa4-1895e1349e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:23.962229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6d8ae0e0-c270-4c32-bfa4-1895e1349e2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:24.000944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ae0e0-c270-4c32-bfa4-1895e1349e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:24.002651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ae0e0-c270-4c32-bfa4-1895e1349e2a service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:24.028302 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3952/7889] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:25.284042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc89453-8ae0-450d-acae-3724919d081e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:25.284496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc89453-8ae0-450d-acae-3724919d081e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:25.284605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc89453-8ae0-450d-acae-3724919d081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:25.324973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cbc89453-8ae0-450d-acae-3724919d081e None None] MFA Rules not processed for user `8219a93945a147c4a57bb6452212fe7c`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:25.330499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cbc89453-8ae0-450d-acae-3724919d081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:25.458716 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3938/7890] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:31.358648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ae0e0-c270-4c32-bfa4-1895e1349e2a service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:31.360428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6d8ae0e0-c270-4c32-bfa4-1895e1349e2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:31.386265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ae0e0-c270-4c32-bfa4-1895e1349e2a service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:31.399590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee3619-7c9b-42fc-9e90-03088ecaa7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:31.400925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee3619-7c9b-42fc-9e90-03088ecaa7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:31.401630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee3619-7c9b-42fc-9e90-03088ecaa7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:31.402220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee3619-7c9b-42fc-9e90-03088ecaa7ce admin admin] PATH_INFO: `/v3/users/2f98e01cab6b49c7a5d239aee95f4a64` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:31.403831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee3619-7c9b-42fc-9e90-03088ecaa7ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f98e01cab6b49c7a5d239aee95f4a64)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:31.409367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee3619-7c9b-42fc-9e90-03088ecaa7ce admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:31.518639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:31.575205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-15ee3619-7c9b-42fc-9e90-03088ecaa7ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f98e01cab6b49c7a5d239aee95f4a64'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:31.592006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-15ee3619-7c9b-42fc-9e90-03088ecaa7ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f98e01cab6b49c7a5d239aee95f4a64'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:31.593150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-15ee3619-7c9b-42fc-9e90-03088ecaa7ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f98e01cab6b49c7a5d239aee95f4a64'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:31.594346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-15ee3619-7c9b-42fc-9e90-03088ecaa7ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f98e01cab6b49c7a5d239aee95f4a64'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:31.619891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-15ee3619-7c9b-42fc-9e90-03088ecaa7ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f98e01cab6b49c7a5d239aee95f4a64'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:31.647405 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3953/7891] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:24:31 2022] DELETE /identity/v3/users/2f98e01cab6b49c7a5d239aee95f4a64 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:32.235542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc89453-8ae0-450d-acae-3724919d081e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:32.255800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc89453-8ae0-450d-acae-3724919d081e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:32.390391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d09008-6112-43e3-8a17-e1670584e37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:32.391831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d09008-6112-43e3-8a17-e1670584e37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:32.392389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d09008-6112-43e3-8a17-e1670584e37c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:32.393381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d09008-6112-43e3-8a17-e1670584e37c admin admin] PATH_INFO: `/v3/projects/bd563fa73afb42c6b26eca3737d7a355` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:32.396265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d09008-6112-43e3-8a17-e1670584e37c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd563fa73afb42c6b26eca3737d7a355)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:32.399434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d09008-6112-43e3-8a17-e1670584e37c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:32.456783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:32.509974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c4d09008-6112-43e3-8a17-e1670584e37c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd563fa73afb42c6b26eca3737d7a355', 'request_id': 'req-c4d09008-6112-43e3-8a17-e1670584e37c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:32.523474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c4d09008-6112-43e3-8a17-e1670584e37c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd563fa73afb42c6b26eca3737d7a355', 'request_id': 'req-c4d09008-6112-43e3-8a17-e1670584e37c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:32.534789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c4d09008-6112-43e3-8a17-e1670584e37c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd563fa73afb42c6b26eca3737d7a355', 'request_id': 'req-c4d09008-6112-43e3-8a17-e1670584e37c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:32.552382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c4d09008-6112-43e3-8a17-e1670584e37c admin admin] The token cache is being invalidate because project bd563fa73afb42c6b26eca3737d7a355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:24:32.552973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c4d09008-6112-43e3-8a17-e1670584e37c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:32.553717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c4d09008-6112-43e3-8a17-e1670584e37c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:24:32.555892 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3939/7892] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:24:32 2022] DELETE /identity/v3/projects/bd563fa73afb42c6b26eca3737d7a355 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:32.563253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727c247-5763-43d9-8eea-cf7f1f0beb4f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:32.564657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727c247-5763-43d9-8eea-cf7f1f0beb4f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:32.565115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727c247-5763-43d9-8eea-cf7f1f0beb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:32.615376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9727c247-5763-43d9-8eea-cf7f1f0beb4f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:32.618269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9727c247-5763-43d9-8eea-cf7f1f0beb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:32.735015 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3954/7893] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:32.744590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd5943-d4cc-4404-b21d-4dc24e1a6421 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:32.745470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd5943-d4cc-4404-b21d-4dc24e1a6421 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:32.745999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd5943-d4cc-4404-b21d-4dc24e1a6421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:32.807030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-79fd5943-d4cc-4404-b21d-4dc24e1a6421 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:32.809984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-79fd5943-d4cc-4404-b21d-4dc24e1a6421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:32.831110 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3940/7894] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:32.835168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727c247-5763-43d9-8eea-cf7f1f0beb4f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:32.854973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727c247-5763-43d9-8eea-cf7f1f0beb4f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:32.865337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8576f0e-254f-4c7c-8559-2d578259a3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:32.866463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8576f0e-254f-4c7c-8559-2d578259a3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:32.867685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8576f0e-254f-4c7c-8559-2d578259a3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:32.868243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8576f0e-254f-4c7c-8559-2d578259a3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:32.869476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8576f0e-254f-4c7c-8559-2d578259a3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:24:32.870242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8576f0e-254f-4c7c-8559-2d578259a3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:32.872926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8576f0e-254f-4c7c-8559-2d578259a3f5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:32.889811 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3955/7895] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:24:32.895807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd5943-d4cc-4404-b21d-4dc24e1a6421 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:32.920102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd5943-d4cc-4404-b21d-4dc24e1a6421 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:32.937588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f66a80-1e5f-4a13-a76b-0dcfc86f2a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:32.938574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f66a80-1e5f-4a13-a76b-0dcfc86f2a2b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:32.945714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f66a80-1e5f-4a13-a76b-0dcfc86f2a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:32.946335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f66a80-1e5f-4a13-a76b-0dcfc86f2a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:32.948726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f66a80-1e5f-4a13-a76b-0dcfc86f2a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:32.958962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f66a80-1e5f-4a13-a76b-0dcfc86f2a2b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:33.006867 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3941/7896] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:24:32 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:24:33.013476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8576f0e-254f-4c7c-8559-2d578259a3f5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:33.034371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8576f0e-254f-4c7c-8559-2d578259a3f5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:33.225710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9f6a0-1791-4abc-a424-0c8e88df012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:33.227131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9f6a0-1791-4abc-a424-0c8e88df012a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:33.227419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9f6a0-1791-4abc-a424-0c8e88df012a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:33.227763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9f6a0-1791-4abc-a424-0c8e88df012a admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:33.228668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9f6a0-1791-4abc-a424-0c8e88df012a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:33.233258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9f6a0-1791-4abc-a424-0c8e88df012a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:33.289963 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3956/7897] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:24:33 2022] POST /identity/v3/users => generated 287 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:24:33.293476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f66a80-1e5f-4a13-a76b-0dcfc86f2a2b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:33.321452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f66a80-1e5f-4a13-a76b-0dcfc86f2a2b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:33.335541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4d957-fa64-4c1f-85a8-7f78464f3c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:33.336674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4d957-fa64-4c1f-85a8-7f78464f3c22 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:33.337279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4d957-fa64-4c1f-85a8-7f78464f3c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:33.337847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4d957-fa64-4c1f-85a8-7f78464f3c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:33.339010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4d957-fa64-4c1f-85a8-7f78464f3c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:33.342220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4d957-fa64-4c1f-85a8-7f78464f3c22 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:33.369719 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3942/7898] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:24:33.373773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9f6a0-1791-4abc-a424-0c8e88df012a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:33.390216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9f6a0-1791-4abc-a424-0c8e88df012a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:33.402571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff36fb-3dda-485a-8e39-0389174be7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:33.403912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff36fb-3dda-485a-8e39-0389174be7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:33.404660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff36fb-3dda-485a-8e39-0389174be7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:33.404975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff36fb-3dda-485a-8e39-0389174be7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:33.406437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff36fb-3dda-485a-8e39-0389174be7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:33.412101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff36fb-3dda-485a-8e39-0389174be7b7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:33.431759 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3957/7899] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:24:33.443276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4d957-fa64-4c1f-85a8-7f78464f3c22 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:33.443954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f88b17-b7fd-4f89-b623-8d2541e9c92e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:33.445347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f88b17-b7fd-4f89-b623-8d2541e9c92e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:33.445843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f88b17-b7fd-4f89-b623-8d2541e9c92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:33.463028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4d957-fa64-4c1f-85a8-7f78464f3c22 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:33.472753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec057682-0ed8-4b67-a126-ebbb859ded60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:33.474294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057682-0ed8-4b67-a126-ebbb859ded60 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:33.474580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057682-0ed8-4b67-a126-ebbb859ded60 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:33.474860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057682-0ed8-4b67-a126-ebbb859ded60 admin admin] PATH_INFO: `/v3/projects/53c1365cdc2f42e5ba271ee55f4d8406/users/a7000e1f74c84240a7f41e8b1da74eff/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:33.496800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-57f88b17-b7fd-4f89-b623-8d2541e9c92e None None] MFA Rules not processed for user `d5cd6f4a13a74dc4868d9efea064a047`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:33.498292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-57f88b17-b7fd-4f89-b623-8d2541e9c92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:33.502742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec057682-0ed8-4b67-a126-ebbb859ded60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c1365cdc2f42e5ba271ee55f4d8406, user_id=a7000e1f74c84240a7f41e8b1da74eff, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:33.503243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:33.506169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec057682-0ed8-4b67-a126-ebbb859ded60 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:33.538099 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3943/7900] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:24:33 2022] PUT /identity/v3/projects/53c1365cdc2f42e5ba271ee55f4d8406/users/a7000e1f74c84240a7f41e8b1da74eff/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:33.542354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191316c-54b7-42f3-afcb-330c9a96865c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:33.542827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191316c-54b7-42f3-afcb-330c9a96865c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:33.543228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191316c-54b7-42f3-afcb-330c9a96865c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:33.570944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e191316c-54b7-42f3-afcb-330c9a96865c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:33.573935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e191316c-54b7-42f3-afcb-330c9a96865c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:33.627961 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3958/7901] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:33.634219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f88b17-b7fd-4f89-b623-8d2541e9c92e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:33.637805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-57f88b17-b7fd-4f89-b623-8d2541e9c92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:33.660864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f88b17-b7fd-4f89-b623-8d2541e9c92e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:33.701914 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3944/7902] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:33.704072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040495aa-cef7-4f07-9c92-e00d8208fc69 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:33.714276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040495aa-cef7-4f07-9c92-e00d8208fc69 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:33.714550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040495aa-cef7-4f07-9c92-e00d8208fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:33.740206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082b267-d955-437d-b78a-cc74b9478612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:33.741286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082b267-d955-437d-b78a-cc74b9478612 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:33.742661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082b267-d955-437d-b78a-cc74b9478612 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:33.743115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082b267-d955-437d-b78a-cc74b9478612 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:33.743941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082b267-d955-437d-b78a-cc74b9478612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:33.746176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082b267-d955-437d-b78a-cc74b9478612 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:33.747626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-040495aa-cef7-4f07-9c92-e00d8208fc69 None None] MFA Rules not processed for user `e28f7acd53094828a7863ce2fd775cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:33.748902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-040495aa-cef7-4f07-9c92-e00d8208fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:33.786465 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3959/7903] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:24:33 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:24:33.787620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082b267-d955-437d-b78a-cc74b9478612 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:33.797213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a082b267-d955-437d-b78a-cc74b9478612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:33.863137 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:33.898138 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3945/7904] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:33.902979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040495aa-cef7-4f07-9c92-e00d8208fc69 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:33.936995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040495aa-cef7-4f07-9c92-e00d8208fc69 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:34.015033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082b267-d955-437d-b78a-cc74b9478612 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:34.028423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ced937-1f74-47c5-a521-a1c3edc4995c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:34.029811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ced937-1f74-47c5-a521-a1c3edc4995c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:34.031200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ced937-1f74-47c5-a521-a1c3edc4995c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:34.031586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ced937-1f74-47c5-a521-a1c3edc4995c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:34.094537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148fb27-35f0-4901-861b-00313f472adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:34.097534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148fb27-35f0-4901-861b-00313f472adc admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:34.097534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148fb27-35f0-4901-861b-00313f472adc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:34.097994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148fb27-35f0-4901-861b-00313f472adc admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:34.100507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148fb27-35f0-4901-861b-00313f472adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:34.107196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148fb27-35f0-4901-861b-00313f472adc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:34.158146 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3946/7905] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:24:33 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:24:34.162456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148fb27-35f0-4901-861b-00313f472adc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:34.171663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:34.196724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148fb27-35f0-4901-861b-00313f472adc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:34.215369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb35e02-0867-45de-a6f0-4bfb437fea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:34.216031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ced937-1f74-47c5-a521-a1c3edc4995c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:34.216167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb35e02-0867-45de-a6f0-4bfb437fea16 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:34.216284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb35e02-0867-45de-a6f0-4bfb437fea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:34.216529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb35e02-0867-45de-a6f0-4bfb437fea16 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:34.218793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb35e02-0867-45de-a6f0-4bfb437fea16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:34.222713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb35e02-0867-45de-a6f0-4bfb437fea16 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:34.226225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ced937-1f74-47c5-a521-a1c3edc4995c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:34.253462 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3947/7906] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:24:34.254403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb35e02-0867-45de-a6f0-4bfb437fea16 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:34.274901 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3960/7907] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:34.299830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb35e02-0867-45de-a6f0-4bfb437fea16 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:34.317090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7e0e9-b11b-4a22-955f-19c8f7313066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:34.317896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7e0e9-b11b-4a22-955f-19c8f7313066 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:34.318183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7e0e9-b11b-4a22-955f-19c8f7313066 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:34.318460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7e0e9-b11b-4a22-955f-19c8f7313066 admin admin] PATH_INFO: `/v3/projects/16eb444f844c4a1e8645da20451f4690/users/91a0e7f4cb9f4c91b9e923a5886b6579/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:34.345555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7e0e9-b11b-4a22-955f-19c8f7313066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16eb444f844c4a1e8645da20451f4690, user_id=91a0e7f4cb9f4c91b9e923a5886b6579, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:34.348591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7e0e9-b11b-4a22-955f-19c8f7313066 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:34.374257 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3948/7908] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:24:34 2022] PUT /identity/v3/projects/16eb444f844c4a1e8645da20451f4690/users/91a0e7f4cb9f4c91b9e923a5886b6579/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:34.378452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ced937-1f74-47c5-a521-a1c3edc4995c service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:34.394258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ced937-1f74-47c5-a521-a1c3edc4995c service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:34.535305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2c862-682e-43d2-a41e-5ca9d8c588cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:34.536152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2c862-682e-43d2-a41e-5ca9d8c588cd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:34.536543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2c862-682e-43d2-a41e-5ca9d8c588cd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:34.536949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2c862-682e-43d2-a41e-5ca9d8c588cd admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:34.538987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2c862-682e-43d2-a41e-5ca9d8c588cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:34.540976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2c862-682e-43d2-a41e-5ca9d8c588cd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:34.560339 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3961/7909] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:24:34.564571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7e0e9-b11b-4a22-955f-19c8f7313066 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:34.576708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7e0e9-b11b-4a22-955f-19c8f7313066 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:34.588758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3fa72-45e2-4592-9f40-6103de1a2374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:34.589632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3fa72-45e2-4592-9f40-6103de1a2374 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:34.590388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3fa72-45e2-4592-9f40-6103de1a2374 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:34.590673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3fa72-45e2-4592-9f40-6103de1a2374 admin admin] PATH_INFO: `/v3/projects/16eb444f844c4a1e8645da20451f4690/users/91a0e7f4cb9f4c91b9e923a5886b6579/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:34.597147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3fa72-45e2-4592-9f40-6103de1a2374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16eb444f844c4a1e8645da20451f4690, user_id=91a0e7f4cb9f4c91b9e923a5886b6579, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:34.605480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3fa72-45e2-4592-9f40-6103de1a2374 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:34.649893 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3949/7910] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:24:34 2022] PUT /identity/v3/projects/16eb444f844c4a1e8645da20451f4690/users/91a0e7f4cb9f4c91b9e923a5886b6579/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:24:34.707484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2c862-682e-43d2-a41e-5ca9d8c588cd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:34.831569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2c862-682e-43d2-a41e-5ca9d8c588cd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:34.974238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190bc03-12fa-422c-9814-8614eb1b93f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:34.974677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190bc03-12fa-422c-9814-8614eb1b93f7 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:34.974905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190bc03-12fa-422c-9814-8614eb1b93f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:34.975090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190bc03-12fa-422c-9814-8614eb1b93f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:34.978156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c190bc03-12fa-422c-9814-8614eb1b93f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:34.998865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190bc03-12fa-422c-9814-8614eb1b93f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:35.002182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190bc03-12fa-422c-9814-8614eb1b93f7 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:35.018319 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3962/7911] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:44.636689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=53,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:45.010144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:45.785897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1271e52-b80f-4c6e-a184-4634072c40bb None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:45.787072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1271e52-b80f-4c6e-a184-4634072c40bb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:45.787604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1271e52-b80f-4c6e-a184-4634072c40bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:45.850297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b1271e52-b80f-4c6e-a184-4634072c40bb None None] MFA Rules not processed for user `a7000e1f74c84240a7f41e8b1da74eff`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:45.852416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b1271e52-b80f-4c6e-a184-4634072c40bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:45.961038 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3950/7912] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:46.055569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0d30-b4ac-4408-b8a4-bd5c5cf8a6b4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:46.055569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0d30-b4ac-4408-b8a4-bd5c5cf8a6b4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:46.055569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0d30-b4ac-4408-b8a4-bd5c5cf8a6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:46.076554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e3df0d30-b4ac-4408-b8a4-bd5c5cf8a6b4 None None] MFA Rules not processed for user `a7000e1f74c84240a7f41e8b1da74eff`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:46.077831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e3df0d30-b4ac-4408-b8a4-bd5c5cf8a6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:46.092294 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3963/7913] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:46.111560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1271e52-b80f-4c6e-a184-4634072c40bb None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:46.114995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b1271e52-b80f-4c6e-a184-4634072c40bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:46.260755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1271e52-b80f-4c6e-a184-4634072c40bb None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:46.271332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a4c1f-51fd-463f-b60b-ffea931d2c3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:46.272051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a4c1f-51fd-463f-b60b-ffea931d2c3a service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:46.272397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a4c1f-51fd-463f-b60b-ffea931d2c3a service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:46.273398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a4c1f-51fd-463f-b60b-ffea931d2c3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:46.284251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a4c1f-51fd-463f-b60b-ffea931d2c3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:46.286681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a4c1f-51fd-463f-b60b-ffea931d2c3a service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:46.311368 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3951/7914] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:46.537581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e808c5-f68c-4353-9de6-9a2892461db9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:46.537867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e808c5-f68c-4353-9de6-9a2892461db9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:46.538137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e808c5-f68c-4353-9de6-9a2892461db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:46.569681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f3e808c5-f68c-4353-9de6-9a2892461db9 None None] MFA Rules not processed for user `91a0e7f4cb9f4c91b9e923a5886b6579`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:46.570909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f3e808c5-f68c-4353-9de6-9a2892461db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:46.658202 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3964/7915] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:46.753978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a4c1f-51fd-463f-b60b-ffea931d2c3a service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:46.753978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-553a4c1f-51fd-463f-b60b-ffea931d2c3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:46.753978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a4c1f-51fd-463f-b60b-ffea931d2c3a service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:46.754422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c6055-6a7d-4a49-8bcf-55be7790d929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:46.754422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c6055-6a7d-4a49-8bcf-55be7790d929 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:46.754422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c6055-6a7d-4a49-8bcf-55be7790d929 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:46.754422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c6055-6a7d-4a49-8bcf-55be7790d929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:46.755972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c6055-6a7d-4a49-8bcf-55be7790d929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:46.777286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c6055-6a7d-4a49-8bcf-55be7790d929 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:46.836259 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3952/7916] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:46.940930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054dbfa-0f0b-402b-81d9-71407b6936c5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:46.941078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054dbfa-0f0b-402b-81d9-71407b6936c5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:46.941445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054dbfa-0f0b-402b-81d9-71407b6936c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:46.990158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9054dbfa-0f0b-402b-81d9-71407b6936c5 None None] MFA Rules not processed for user `d5cd6f4a13a74dc4868d9efea064a047`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:24:46.991840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9054dbfa-0f0b-402b-81d9-71407b6936c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:47.079208 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3965/7917] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:24:49.111505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c6055-6a7d-4a49-8bcf-55be7790d929 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:49.113220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cb2c6055-6a7d-4a49-8bcf-55be7790d929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:49.181650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054dbfa-0f0b-402b-81d9-71407b6936c5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:49.183856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9054dbfa-0f0b-402b-81d9-71407b6936c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:49.275042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:49.284520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c6055-6a7d-4a49-8bcf-55be7790d929 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:49.295647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f3bb2-76cb-4d7e-8c6c-2827eddb0acf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:49.297624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f3bb2-76cb-4d7e-8c6c-2827eddb0acf service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:49.298222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f3bb2-76cb-4d7e-8c6c-2827eddb0acf service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:49.298815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f3bb2-76cb-4d7e-8c6c-2827eddb0acf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:49.302493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c79f3bb2-76cb-4d7e-8c6c-2827eddb0acf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:49.329535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f3bb2-76cb-4d7e-8c6c-2827eddb0acf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:49.332483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f3bb2-76cb-4d7e-8c6c-2827eddb0acf service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:49.347393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054dbfa-0f0b-402b-81d9-71407b6936c5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:49.357498 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3953/7918] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:49.359625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0d1c8-7814-45a7-964e-04ec8d9d3575 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:49.361522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0d1c8-7814-45a7-964e-04ec8d9d3575 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:49.361940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0d1c8-7814-45a7-964e-04ec8d9d3575 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:49.362223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0d1c8-7814-45a7-964e-04ec8d9d3575 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:49.403540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0d1c8-7814-45a7-964e-04ec8d9d3575 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:49.408010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0d1c8-7814-45a7-964e-04ec8d9d3575 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:49.439710 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3966/7919] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:24:55.675718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f3bb2-76cb-4d7e-8c6c-2827eddb0acf service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:24:55.688715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f3bb2-76cb-4d7e-8c6c-2827eddb0acf service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:24:55.693836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024aa53-cc42-4991-83ef-cbd0498ccde5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:24:55.694465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024aa53-cc42-4991-83ef-cbd0498ccde5 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:24:55.694744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024aa53-cc42-4991-83ef-cbd0498ccde5 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:24:55.695018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024aa53-cc42-4991-83ef-cbd0498ccde5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:24:55.696750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9024aa53-cc42-4991-83ef-cbd0498ccde5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:24:55.710659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024aa53-cc42-4991-83ef-cbd0498ccde5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:24:55.712214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024aa53-cc42-4991-83ef-cbd0498ccde5 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:24:55.724135 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3954/7920] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:24:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:24:59.424448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:02.318165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d8dff-fede-4688-9e93-c5ba593bbbf3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:02.318769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d8dff-fede-4688-9e93-c5ba593bbbf3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:02.318769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d8dff-fede-4688-9e93-c5ba593bbbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:02.337820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2c0d8dff-fede-4688-9e93-c5ba593bbbf3 None None] MFA Rules not processed for user `d5cd6f4a13a74dc4868d9efea064a047`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:02.338943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2c0d8dff-fede-4688-9e93-c5ba593bbbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:02.345785 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3967/7921] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:05.717833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=10 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:12.332732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:13.547000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024aa53-cc42-4991-83ef-cbd0498ccde5 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:13.639826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024aa53-cc42-4991-83ef-cbd0498ccde5 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:13.646131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb5efb-e104-478b-9d53-e9c718e2cc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:13.646787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb5efb-e104-478b-9d53-e9c718e2cc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:13.647160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb5efb-e104-478b-9d53-e9c718e2cc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:13.647466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb5efb-e104-478b-9d53-e9c718e2cc4e admin admin] PATH_INFO: `/v3/users/a7000e1f74c84240a7f41e8b1da74eff` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:13.648701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb5efb-e104-478b-9d53-e9c718e2cc4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7000e1f74c84240a7f41e8b1da74eff)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:13.650704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb5efb-e104-478b-9d53-e9c718e2cc4e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:13.709490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a8eb5efb-e104-478b-9d53-e9c718e2cc4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7000e1f74c84240a7f41e8b1da74eff'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:13.717737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a8eb5efb-e104-478b-9d53-e9c718e2cc4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7000e1f74c84240a7f41e8b1da74eff'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:13.718443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a8eb5efb-e104-478b-9d53-e9c718e2cc4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7000e1f74c84240a7f41e8b1da74eff'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:13.719050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a8eb5efb-e104-478b-9d53-e9c718e2cc4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7000e1f74c84240a7f41e8b1da74eff'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:13.736488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a8eb5efb-e104-478b-9d53-e9c718e2cc4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7000e1f74c84240a7f41e8b1da74eff'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:13.751997 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3955/7922] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:13 2022] DELETE /identity/v3/users/a7000e1f74c84240a7f41e8b1da74eff => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:13.952238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d8dff-fede-4688-9e93-c5ba593bbbf3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:13.970938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d8dff-fede-4688-9e93-c5ba593bbbf3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:14.044462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0984e-34e2-4ffe-bdd0-c38c244924e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:14.046009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0984e-34e2-4ffe-bdd0-c38c244924e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:14.046288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0984e-34e2-4ffe-bdd0-c38c244924e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:14.046557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0984e-34e2-4ffe-bdd0-c38c244924e2 admin admin] PATH_INFO: `/v3/projects/53c1365cdc2f42e5ba271ee55f4d8406` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:14.047736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0984e-34e2-4ffe-bdd0-c38c244924e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c1365cdc2f42e5ba271ee55f4d8406)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:14.049821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0984e-34e2-4ffe-bdd0-c38c244924e2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:14.105313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-79e0984e-34e2-4ffe-bdd0-c38c244924e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c1365cdc2f42e5ba271ee55f4d8406', 'request_id': 'req-79e0984e-34e2-4ffe-bdd0-c38c244924e2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:14.114980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-79e0984e-34e2-4ffe-bdd0-c38c244924e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c1365cdc2f42e5ba271ee55f4d8406', 'request_id': 'req-79e0984e-34e2-4ffe-bdd0-c38c244924e2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:14.122836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-79e0984e-34e2-4ffe-bdd0-c38c244924e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c1365cdc2f42e5ba271ee55f4d8406', 'request_id': 'req-79e0984e-34e2-4ffe-bdd0-c38c244924e2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:14.136940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-79e0984e-34e2-4ffe-bdd0-c38c244924e2 admin admin] The token cache is being invalidate because project 53c1365cdc2f42e5ba271ee55f4d8406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:14.137267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-79e0984e-34e2-4ffe-bdd0-c38c244924e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:14.137920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-79e0984e-34e2-4ffe-bdd0-c38c244924e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:14.139835 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3968/7923] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:13 2022] DELETE /identity/v3/projects/53c1365cdc2f42e5ba271ee55f4d8406 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:14.145224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866fe83-c724-43c4-a38a-ce387bd90161 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:14.145677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866fe83-c724-43c4-a38a-ce387bd90161 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:14.145952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866fe83-c724-43c4-a38a-ce387bd90161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:14.166827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4866fe83-c724-43c4-a38a-ce387bd90161 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:14.168102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4866fe83-c724-43c4-a38a-ce387bd90161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:14.245031 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3956/7924] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:14.252704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f078c-87dc-44aa-9249-5610cd1b5bf0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:14.252987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f078c-87dc-44aa-9249-5610cd1b5bf0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:14.253294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f078c-87dc-44aa-9249-5610cd1b5bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:14.275469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4b0f078c-87dc-44aa-9249-5610cd1b5bf0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:14.276675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4b0f078c-87dc-44aa-9249-5610cd1b5bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:14.284702 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3969/7925] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:14.289071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866fe83-c724-43c4-a38a-ce387bd90161 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:14.299140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866fe83-c724-43c4-a38a-ce387bd90161 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:14.303959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d651e0f-9a66-45be-8125-0d259540dc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:14.304569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d651e0f-9a66-45be-8125-0d259540dc75 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:14.304847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d651e0f-9a66-45be-8125-0d259540dc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:14.305158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d651e0f-9a66-45be-8125-0d259540dc75 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:14.305836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d651e0f-9a66-45be-8125-0d259540dc75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:25:14.306134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d651e0f-9a66-45be-8125-0d259540dc75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:14.307729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d651e0f-9a66-45be-8125-0d259540dc75 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:14.320578 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3957/7926] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:14.325153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f078c-87dc-44aa-9249-5610cd1b5bf0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:14.336323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f078c-87dc-44aa-9249-5610cd1b5bf0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:14.341292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5171598-4547-4396-b291-a0007df5423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:14.341949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5171598-4547-4396-b291-a0007df5423b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:14.342224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5171598-4547-4396-b291-a0007df5423b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:14.342500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5171598-4547-4396-b291-a0007df5423b admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:14.343277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5171598-4547-4396-b291-a0007df5423b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:14.345028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5171598-4547-4396-b291-a0007df5423b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:14.373695 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3970/7927] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:14 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:14.377718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d651e0f-9a66-45be-8125-0d259540dc75 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:14.388754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d651e0f-9a66-45be-8125-0d259540dc75 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:14.392530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:14.448866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577795b-a267-4d06-a115-b76f906fd929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:14.449505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577795b-a267-4d06-a115-b76f906fd929 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:14.449785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577795b-a267-4d06-a115-b76f906fd929 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:14.450051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577795b-a267-4d06-a115-b76f906fd929 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:14.450679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577795b-a267-4d06-a115-b76f906fd929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:14.452570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577795b-a267-4d06-a115-b76f906fd929 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:14.472704 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3958/7928] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:14 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:14.476909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5171598-4547-4396-b291-a0007df5423b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:14.487469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5171598-4547-4396-b291-a0007df5423b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:14.492694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a8046-c51c-4e60-a003-8a388c57904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:14.493323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a8046-c51c-4e60-a003-8a388c57904e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:14.493600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a8046-c51c-4e60-a003-8a388c57904e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:14.493870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a8046-c51c-4e60-a003-8a388c57904e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:14.494503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a8046-c51c-4e60-a003-8a388c57904e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:14.496075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a8046-c51c-4e60-a003-8a388c57904e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:14.505967 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3971/7929] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:25:14.510561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577795b-a267-4d06-a115-b76f906fd929 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:14.520505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577795b-a267-4d06-a115-b76f906fd929 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:14.525109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76abea-3b58-401b-b570-a6d31d751530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:14.525724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76abea-3b58-401b-b570-a6d31d751530 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:14.526003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76abea-3b58-401b-b570-a6d31d751530 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:14.526274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76abea-3b58-401b-b570-a6d31d751530 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:14.526927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76abea-3b58-401b-b570-a6d31d751530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:14.528606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76abea-3b58-401b-b570-a6d31d751530 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:14.539178 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3959/7930] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:14.543215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a8046-c51c-4e60-a003-8a388c57904e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:14.553915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a8046-c51c-4e60-a003-8a388c57904e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:14.558555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb948b-3aa9-490d-97fa-c6ea5ebba1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:14.559191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb948b-3aa9-490d-97fa-c6ea5ebba1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:14.559492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb948b-3aa9-490d-97fa-c6ea5ebba1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:14.559747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb948b-3aa9-490d-97fa-c6ea5ebba1e4 admin admin] PATH_INFO: `/v3/projects/faa655559fc846458e045eab4eaad787/users/6213dc972cdb4dfa839a2746b54c8403/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:14.574928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb948b-3aa9-490d-97fa-c6ea5ebba1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa655559fc846458e045eab4eaad787, user_id=6213dc972cdb4dfa839a2746b54c8403, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:14.577597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb948b-3aa9-490d-97fa-c6ea5ebba1e4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:14.589846 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3972/7931] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:14 2022] PUT /identity/v3/projects/faa655559fc846458e045eab4eaad787/users/6213dc972cdb4dfa839a2746b54c8403/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:14.594790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a391192-0755-4d6d-bb40-e33bb024d2ff None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:14.595254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a391192-0755-4d6d-bb40-e33bb024d2ff None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:14.595362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a391192-0755-4d6d-bb40-e33bb024d2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:14.613980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5a391192-0755-4d6d-bb40-e33bb024d2ff None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:14.615161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5a391192-0755-4d6d-bb40-e33bb024d2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:14.675673 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3960/7932] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:14.685830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb948b-3aa9-490d-97fa-c6ea5ebba1e4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:14.687540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-36fb948b-3aa9-490d-97fa-c6ea5ebba1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:14.718044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:14.748208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb948b-3aa9-490d-97fa-c6ea5ebba1e4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:14.751823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30332c03-c01c-4359-a9d8-1b1f073f316a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:14.752425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30332c03-c01c-4359-a9d8-1b1f073f316a service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:14.752706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30332c03-c01c-4359-a9d8-1b1f073f316a service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:14.753096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30332c03-c01c-4359-a9d8-1b1f073f316a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:14.762788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30332c03-c01c-4359-a9d8-1b1f073f316a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:14.764337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30332c03-c01c-4359-a9d8-1b1f073f316a service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:14.773728 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3973/7933] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:25:19.320853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1537540-2876-4cce-96ed-5676a4085790 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:19.321412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1537540-2876-4cce-96ed-5676a4085790 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:19.321412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1537540-2876-4cce-96ed-5676a4085790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:19.352452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a1537540-2876-4cce-96ed-5676a4085790 None None] MFA Rules not processed for user `6213dc972cdb4dfa839a2746b54c8403`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:19.354223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a1537540-2876-4cce-96ed-5676a4085790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:19.434684 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3961/7934] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:23.612985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30332c03-c01c-4359-a9d8-1b1f073f316a service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:23.625097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30332c03-c01c-4359-a9d8-1b1f073f316a service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:23.631078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:23.631429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:23.639398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:23.639821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] PATH_INFO: `/v3/users/6213dc972cdb4dfa839a2746b54c8403` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:23.641276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6213dc972cdb4dfa839a2746b54c8403)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:23.644360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:23.703480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6213dc972cdb4dfa839a2746b54c8403'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:23.714108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6213dc972cdb4dfa839a2746b54c8403'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:23.714905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6213dc972cdb4dfa839a2746b54c8403'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:23.715527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6213dc972cdb4dfa839a2746b54c8403'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:23.734215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6213dc972cdb4dfa839a2746b54c8403'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:23.751218 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3974/7935] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:23 2022] DELETE /identity/v3/users/6213dc972cdb4dfa839a2746b54c8403 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:24.172780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1537540-2876-4cce-96ed-5676a4085790 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:24.190089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1537540-2876-4cce-96ed-5676a4085790 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:24.215934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:24.278726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee8cb1-1d24-47fa-abe4-76d424a23610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:24.279365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee8cb1-1d24-47fa-abe4-76d424a23610 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:24.279646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee8cb1-1d24-47fa-abe4-76d424a23610 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:24.279915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee8cb1-1d24-47fa-abe4-76d424a23610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:24.281838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5fee8cb1-1d24-47fa-abe4-76d424a23610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:24.302328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee8cb1-1d24-47fa-abe4-76d424a23610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:24.304352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee8cb1-1d24-47fa-abe4-76d424a23610 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:24.320300 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3962/7936] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:25:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:25:24.363931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:24.365614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:24.429996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee8cb1-1d24-47fa-abe4-76d424a23610 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:24.431529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5fee8cb1-1d24-47fa-abe4-76d424a23610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:24.478897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68e8a7-e34c-44b3-9c53-929ed2082f31 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:24.484420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eaa111-f489-4889-b301-b85dfcd000fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:24.484789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaa111-f489-4889-b301-b85dfcd000fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:24.484894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaa111-f489-4889-b301-b85dfcd000fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:24.485167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaa111-f489-4889-b301-b85dfcd000fd admin admin] PATH_INFO: `/v3/projects/faa655559fc846458e045eab4eaad787` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:24.486351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eaa111-f489-4889-b301-b85dfcd000fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa655559fc846458e045eab4eaad787)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:24.488283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eaa111-f489-4889-b301-b85dfcd000fd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:24.535776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee8cb1-1d24-47fa-abe4-76d424a23610 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:24.538650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:24.543558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a3eaa111-f489-4889-b301-b85dfcd000fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa655559fc846458e045eab4eaad787', 'request_id': 'req-a3eaa111-f489-4889-b301-b85dfcd000fd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:24.553734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a3eaa111-f489-4889-b301-b85dfcd000fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa655559fc846458e045eab4eaad787', 'request_id': 'req-a3eaa111-f489-4889-b301-b85dfcd000fd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:24.563077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a3eaa111-f489-4889-b301-b85dfcd000fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa655559fc846458e045eab4eaad787', 'request_id': 'req-a3eaa111-f489-4889-b301-b85dfcd000fd'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:24.577166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a3eaa111-f489-4889-b301-b85dfcd000fd admin admin] The token cache is being invalidate because project faa655559fc846458e045eab4eaad787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:24.577491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a3eaa111-f489-4889-b301-b85dfcd000fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:24.578674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a3eaa111-f489-4889-b301-b85dfcd000fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:24.580719 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3975/7937] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:24 2022] DELETE /identity/v3/projects/faa655559fc846458e045eab4eaad787 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:24.586475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6216d0-1b7a-4837-a580-a531dfc62b88 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:24.586748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6216d0-1b7a-4837-a580-a531dfc62b88 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:24.587032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6216d0-1b7a-4837-a580-a531dfc62b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:24.609091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4a6216d0-1b7a-4837-a580-a531dfc62b88 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:24.610486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4a6216d0-1b7a-4837-a580-a531dfc62b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:24.623250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bbac3-3de2-45f2-93b1-abeae53ab391 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:24.623822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bbac3-3de2-45f2-93b1-abeae53ab391 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:24.624401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bbac3-3de2-45f2-93b1-abeae53ab391 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:24.624626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bbac3-3de2-45f2-93b1-abeae53ab391 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:24.627150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f86bbac3-3de2-45f2-93b1-abeae53ab391 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:24.649217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bbac3-3de2-45f2-93b1-abeae53ab391 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:24.651361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bbac3-3de2-45f2-93b1-abeae53ab391 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:24.666853 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3963/7938] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:25:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:25:24.685585 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3976/7939] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:24.687337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b4f4f-0eb4-45a1-9c3a-58a1effd238a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:24.687631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b4f4f-0eb4-45a1-9c3a-58a1effd238a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:24.687907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b4f4f-0eb4-45a1-9c3a-58a1effd238a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:24.715243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c66b4f4f-0eb4-45a1-9c3a-58a1effd238a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:24.716830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c66b4f4f-0eb4-45a1-9c3a-58a1effd238a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:24.730549 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3964/7940] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:24.735130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6216d0-1b7a-4837-a580-a531dfc62b88 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:24.748152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6216d0-1b7a-4837-a580-a531dfc62b88 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:24.755474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265ff18-760a-4006-891d-9d4df5d02cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:24.756143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265ff18-760a-4006-891d-9d4df5d02cbd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:24.756632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265ff18-760a-4006-891d-9d4df5d02cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:24.756911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265ff18-760a-4006-891d-9d4df5d02cbd admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:24.757614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265ff18-760a-4006-891d-9d4df5d02cbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:25:24.757918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265ff18-760a-4006-891d-9d4df5d02cbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:24.759964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265ff18-760a-4006-891d-9d4df5d02cbd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:24.778518 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3977/7941] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:24.778818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b4f4f-0eb4-45a1-9c3a-58a1effd238a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:24.807255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b4f4f-0eb4-45a1-9c3a-58a1effd238a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:24.820630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d319e-8fa3-4e32-98fc-b4e2c4699a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:24.821296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d319e-8fa3-4e32-98fc-b4e2c4699a44 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:24.821578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d319e-8fa3-4e32-98fc-b4e2c4699a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:24.821850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d319e-8fa3-4e32-98fc-b4e2c4699a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:24.824999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d319e-8fa3-4e32-98fc-b4e2c4699a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:24.830906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d319e-8fa3-4e32-98fc-b4e2c4699a44 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:24.890117 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3965/7942] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:24 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:24.892200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265ff18-760a-4006-891d-9d4df5d02cbd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:24.914109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265ff18-760a-4006-891d-9d4df5d02cbd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:24.945590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d319e-8fa3-4e32-98fc-b4e2c4699a44 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:24.947309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-121d319e-8fa3-4e32-98fc-b4e2c4699a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:24.993892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:25.018000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf85cbd-26bf-44be-a0c8-722a16b9ae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:25.018738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf85cbd-26bf-44be-a0c8-722a16b9ae79 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:25.019248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf85cbd-26bf-44be-a0c8-722a16b9ae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:25.019601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf85cbd-26bf-44be-a0c8-722a16b9ae79 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:25.020329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf85cbd-26bf-44be-a0c8-722a16b9ae79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:25.024520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf85cbd-26bf-44be-a0c8-722a16b9ae79 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:25.056792 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3978/7943] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:24 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:25.063620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf85cbd-26bf-44be-a0c8-722a16b9ae79 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:25.072345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d319e-8fa3-4e32-98fc-b4e2c4699a44 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:25.077479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf85cbd-26bf-44be-a0c8-722a16b9ae79 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:25.080220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0bb5c-246a-4847-bb2a-6a1d03a7cc03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:25.080850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0bb5c-246a-4847-bb2a-6a1d03a7cc03 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:25.081133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0bb5c-246a-4847-bb2a-6a1d03a7cc03 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:25.081460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0bb5c-246a-4847-bb2a-6a1d03a7cc03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:25.084073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e1e0bb5c-246a-4847-bb2a-6a1d03a7cc03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:25.090196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33721a27-4cb7-46e5-aa16-537e4a4a86e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:25.090826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33721a27-4cb7-46e5-aa16-537e4a4a86e7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:25.091105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33721a27-4cb7-46e5-aa16-537e4a4a86e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:25.091380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33721a27-4cb7-46e5-aa16-537e4a4a86e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:25.092035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33721a27-4cb7-46e5-aa16-537e4a4a86e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:25.093977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33721a27-4cb7-46e5-aa16-537e4a4a86e7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:25.124295 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3979/7944] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:25.124913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33721a27-4cb7-46e5-aa16-537e4a4a86e7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:25.149856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33721a27-4cb7-46e5-aa16-537e4a4a86e7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:25.160958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3de7e1-c315-4221-b8bc-76e48b989219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:25.163290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3de7e1-c315-4221-b8bc-76e48b989219 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:25.163426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3de7e1-c315-4221-b8bc-76e48b989219 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:25.165317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3de7e1-c315-4221-b8bc-76e48b989219 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:25.165317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3de7e1-c315-4221-b8bc-76e48b989219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:25.166909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3de7e1-c315-4221-b8bc-76e48b989219 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:25.192893 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3980/7945] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:25.196929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3de7e1-c315-4221-b8bc-76e48b989219 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:25.218059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3de7e1-c315-4221-b8bc-76e48b989219 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:25.236182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a97ef-6ef8-476a-a9fe-03389b0482e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:25.237126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a97ef-6ef8-476a-a9fe-03389b0482e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:25.237596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a97ef-6ef8-476a-a9fe-03389b0482e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:25.238032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a97ef-6ef8-476a-a9fe-03389b0482e7 admin admin] PATH_INFO: `/v3/projects/86c600f9eb3f4624b000b82040e33ab7/users/36674f16f20245c58952d937ea9ab7f4/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:25.249432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0bb5c-246a-4847-bb2a-6a1d03a7cc03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:25.251471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0bb5c-246a-4847-bb2a-6a1d03a7cc03 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:25.271435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a97ef-6ef8-476a-a9fe-03389b0482e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c600f9eb3f4624b000b82040e33ab7, user_id=36674f16f20245c58952d937ea9ab7f4, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:25.275709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a97ef-6ef8-476a-a9fe-03389b0482e7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:25.280320 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3966/7946] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:25:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:25:25.296245 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3981/7947] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:25 2022] PUT /identity/v3/projects/86c600f9eb3f4624b000b82040e33ab7/users/36674f16f20245c58952d937ea9ab7f4/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:25.306528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeacac3-4a1b-4d38-8b3f-cd3ac137cd92 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:25.306846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeacac3-4a1b-4d38-8b3f-cd3ac137cd92 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:25.307101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeacac3-4a1b-4d38-8b3f-cd3ac137cd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:25.349635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4eeacac3-4a1b-4d38-8b3f-cd3ac137cd92 None None] MFA Rules not processed for user `36674f16f20245c58952d937ea9ab7f4`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:25.352206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4eeacac3-4a1b-4d38-8b3f-cd3ac137cd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:25.457125 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3967/7948] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:25.728644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a97ef-6ef8-476a-a9fe-03389b0482e7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:25.731530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-011a97ef-6ef8-476a-a9fe-03389b0482e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:25.737085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:25.877925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a97ef-6ef8-476a-a9fe-03389b0482e7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:25.891942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529b089-b5e5-4f72-890e-3c9904be13a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:25.892832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529b089-b5e5-4f72-890e-3c9904be13a2 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:25.893646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529b089-b5e5-4f72-890e-3c9904be13a2 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:25.894043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529b089-b5e5-4f72-890e-3c9904be13a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:25.906330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529b089-b5e5-4f72-890e-3c9904be13a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:25.908056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529b089-b5e5-4f72-890e-3c9904be13a2 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:25.921360 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3982/7949] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:25:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:25:25.971204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeacac3-4a1b-4d38-8b3f-cd3ac137cd92 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:26.034063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:26.051448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeacac3-4a1b-4d38-8b3f-cd3ac137cd92 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:26.056579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:26.057322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:26.057666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:26.058005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] PATH_INFO: `/v3/users/36674f16f20245c58952d937ea9ab7f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:26.059559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=36674f16f20245c58952d937ea9ab7f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:26.061611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:26.119830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36674f16f20245c58952d937ea9ab7f4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:26.128668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36674f16f20245c58952d937ea9ab7f4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:26.129607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36674f16f20245c58952d937ea9ab7f4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:26.130375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36674f16f20245c58952d937ea9ab7f4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:26.149380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36674f16f20245c58952d937ea9ab7f4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:26.170724 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3968/7950] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:25 2022] DELETE /identity/v3/users/36674f16f20245c58952d937ea9ab7f4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:26.175022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290846b-af31-4dec-99ec-96bf1f2f277b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:26.175368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290846b-af31-4dec-99ec-96bf1f2f277b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:26.175622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290846b-af31-4dec-99ec-96bf1f2f277b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:26.195806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c290846b-af31-4dec-99ec-96bf1f2f277b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:26.197172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c290846b-af31-4dec-99ec-96bf1f2f277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:26.275101 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3983/7951] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:26.286121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:26.287873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:26.377879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db5656-2870-4e89-9d4d-093868d327ff admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:26.381920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe202a4-5bee-4682-acea-68cc7277c1c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:26.383078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe202a4-5bee-4682-acea-68cc7277c1c3 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:26.383078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe202a4-5bee-4682-acea-68cc7277c1c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:26.383558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe202a4-5bee-4682-acea-68cc7277c1c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:26.393660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe202a4-5bee-4682-acea-68cc7277c1c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:26.395102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe202a4-5bee-4682-acea-68cc7277c1c3 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:26.406788 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3969/7952] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:25:26.944524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290846b-af31-4dec-99ec-96bf1f2f277b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:26.951076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c290846b-af31-4dec-99ec-96bf1f2f277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:26.972391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290846b-af31-4dec-99ec-96bf1f2f277b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:26.998604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee8f4f-0ae5-498f-83a7-895fce059988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:26.999178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee8f4f-0ae5-498f-83a7-895fce059988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:26.999463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee8f4f-0ae5-498f-83a7-895fce059988 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:26.999751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee8f4f-0ae5-498f-83a7-895fce059988 admin admin] PATH_INFO: `/v3/projects/86c600f9eb3f4624b000b82040e33ab7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:27.004582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee8f4f-0ae5-498f-83a7-895fce059988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c600f9eb3f4624b000b82040e33ab7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:27.013531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee8f4f-0ae5-498f-83a7-895fce059988 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:27.135680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-faee8f4f-0ae5-498f-83a7-895fce059988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c600f9eb3f4624b000b82040e33ab7', 'request_id': 'req-faee8f4f-0ae5-498f-83a7-895fce059988'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:27.153838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-faee8f4f-0ae5-498f-83a7-895fce059988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c600f9eb3f4624b000b82040e33ab7', 'request_id': 'req-faee8f4f-0ae5-498f-83a7-895fce059988'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:27.167178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-faee8f4f-0ae5-498f-83a7-895fce059988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c600f9eb3f4624b000b82040e33ab7', 'request_id': 'req-faee8f4f-0ae5-498f-83a7-895fce059988'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:27.232535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-faee8f4f-0ae5-498f-83a7-895fce059988 admin admin] The token cache is being invalidate because project 86c600f9eb3f4624b000b82040e33ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:27.245510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-faee8f4f-0ae5-498f-83a7-895fce059988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:27.245510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-faee8f4f-0ae5-498f-83a7-895fce059988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:27.247406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e83671-35c6-4f08-9412-13d12957e986 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:27.247722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e83671-35c6-4f08-9412-13d12957e986 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:27.248001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e83671-35c6-4f08-9412-13d12957e986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:27.253945 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3984/7953] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:26 2022] DELETE /identity/v3/projects/86c600f9eb3f4624b000b82040e33ab7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:27.290091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c9e83671-35c6-4f08-9412-13d12957e986 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:27.291414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c9e83671-35c6-4f08-9412-13d12957e986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:27.382788 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3970/7954] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:27.391717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b50459-8af1-4c06-9833-2ebb4493497a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:27.392080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b50459-8af1-4c06-9833-2ebb4493497a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:27.392436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b50459-8af1-4c06-9833-2ebb4493497a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:27.421380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b5b50459-8af1-4c06-9833-2ebb4493497a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:27.423108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b5b50459-8af1-4c06-9833-2ebb4493497a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:27.436668 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3985/7955] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:27.440758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e83671-35c6-4f08-9412-13d12957e986 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:27.453130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e83671-35c6-4f08-9412-13d12957e986 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:27.463603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969613d-87d1-4540-bc66-f934d0eefb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:27.464667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969613d-87d1-4540-bc66-f934d0eefb8a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:27.465246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969613d-87d1-4540-bc66-f934d0eefb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:27.467083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969613d-87d1-4540-bc66-f934d0eefb8a admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:27.468919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969613d-87d1-4540-bc66-f934d0eefb8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:25:27.469565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969613d-87d1-4540-bc66-f934d0eefb8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:27.471501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969613d-87d1-4540-bc66-f934d0eefb8a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:27.513483 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3971/7956] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:27.522835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b50459-8af1-4c06-9833-2ebb4493497a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:27.531093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:27.544488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b50459-8af1-4c06-9833-2ebb4493497a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:27.551321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24699e-fb64-4992-be52-17d3fb8db72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:27.552135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24699e-fb64-4992-be52-17d3fb8db72f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:27.552794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24699e-fb64-4992-be52-17d3fb8db72f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:27.554648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24699e-fb64-4992-be52-17d3fb8db72f admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:27.555325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24699e-fb64-4992-be52-17d3fb8db72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:27.557659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24699e-fb64-4992-be52-17d3fb8db72f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:27.594323 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3986/7957] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:27 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:27.595547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969613d-87d1-4540-bc66-f934d0eefb8a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:27.601540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:27.608931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969613d-87d1-4540-bc66-f934d0eefb8a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:27.677925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d2405-1324-4a50-bfbb-56c1a8d75e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:27.679170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2405-1324-4a50-bfbb-56c1a8d75e47 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:27.679448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2405-1324-4a50-bfbb-56c1a8d75e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:27.679735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2405-1324-4a50-bfbb-56c1a8d75e47 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:27.680365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d2405-1324-4a50-bfbb-56c1a8d75e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:27.682332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d2405-1324-4a50-bfbb-56c1a8d75e47 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:27.709043 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3972/7958] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:27 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:27.710589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24699e-fb64-4992-be52-17d3fb8db72f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:27.721754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24699e-fb64-4992-be52-17d3fb8db72f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:27.727531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4acf8-58a3-4630-832b-4213196defc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:27.728301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4acf8-58a3-4630-832b-4213196defc7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:27.728580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4acf8-58a3-4630-832b-4213196defc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:27.728894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4acf8-58a3-4630-832b-4213196defc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:27.729565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4acf8-58a3-4630-832b-4213196defc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:27.731436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4acf8-58a3-4630-832b-4213196defc7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:27.743745 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3987/7959] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:27.747885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d2405-1324-4a50-bfbb-56c1a8d75e47 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:27.759337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d2405-1324-4a50-bfbb-56c1a8d75e47 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:27.764278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbbe4f-c1f9-40a4-92b7-059a02d7bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:27.764883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbbe4f-c1f9-40a4-92b7-059a02d7bfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:27.765208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbbe4f-c1f9-40a4-92b7-059a02d7bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:27.765492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbbe4f-c1f9-40a4-92b7-059a02d7bfc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:27.766177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbbe4f-c1f9-40a4-92b7-059a02d7bfc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:27.767793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbbe4f-c1f9-40a4-92b7-059a02d7bfc4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:27.779253 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3973/7960] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:25:27.783280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4acf8-58a3-4630-832b-4213196defc7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:27.806298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4acf8-58a3-4630-832b-4213196defc7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:27.811152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675982c-485e-423c-ba1f-25a16164cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:27.811956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675982c-485e-423c-ba1f-25a16164cc4f admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:27.812072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675982c-485e-423c-ba1f-25a16164cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:27.812342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675982c-485e-423c-ba1f-25a16164cc4f admin admin] PATH_INFO: `/v3/projects/068e58c58aaf42c3b58197042d0026ad/users/df864d8a6979495b945a6fdb4108f0f5/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:27.827633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675982c-485e-423c-ba1f-25a16164cc4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=068e58c58aaf42c3b58197042d0026ad, user_id=df864d8a6979495b945a6fdb4108f0f5, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:27.830357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675982c-485e-423c-ba1f-25a16164cc4f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:27.844655 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3988/7961] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:27 2022] PUT /identity/v3/projects/068e58c58aaf42c3b58197042d0026ad/users/df864d8a6979495b945a6fdb4108f0f5/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:27.855364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64596969-cdc0-402a-b6d7-a28d0c877169 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:27.855654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64596969-cdc0-402a-b6d7-a28d0c877169 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:27.856208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64596969-cdc0-402a-b6d7-a28d0c877169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:27.885936 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-64596969-cdc0-402a-b6d7-a28d0c877169 None None] MFA Rules not processed for user `df864d8a6979495b945a6fdb4108f0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:27.887164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-64596969-cdc0-402a-b6d7-a28d0c877169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:27.956802 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3974/7962] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:27.969042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675982c-485e-423c-ba1f-25a16164cc4f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:27.970951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0675982c-485e-423c-ba1f-25a16164cc4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:28.045411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675982c-485e-423c-ba1f-25a16164cc4f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:28.049865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4297875-9a42-4f90-8f6d-eca0890387e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:28.050552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4297875-9a42-4f90-8f6d-eca0890387e2 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:28.050858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4297875-9a42-4f90-8f6d-eca0890387e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:28.051130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4297875-9a42-4f90-8f6d-eca0890387e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:28.060419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4297875-9a42-4f90-8f6d-eca0890387e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:28.061869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4297875-9a42-4f90-8f6d-eca0890387e2 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:28.072331 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3989/7963] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:25:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:25:32.622200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64596969-cdc0-402a-b6d7-a28d0c877169 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:32.623797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-64596969-cdc0-402a-b6d7-a28d0c877169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:32.731565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64596969-cdc0-402a-b6d7-a28d0c877169 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:32.736812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:32.737723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:32.738010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:32.738290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] PATH_INFO: `/v3/users/d5cd6f4a13a74dc4868d9efea064a047` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:32.739606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5cd6f4a13a74dc4868d9efea064a047)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:32.742339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:32.763589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:32.806634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5cd6f4a13a74dc4868d9efea064a047'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:32.815523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5cd6f4a13a74dc4868d9efea064a047'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:32.816260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5cd6f4a13a74dc4868d9efea064a047'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:32.816978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5cd6f4a13a74dc4868d9efea064a047'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:32.836116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5cd6f4a13a74dc4868d9efea064a047'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:32.856394 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3975/7964] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:32 2022] DELETE /identity/v3/users/d5cd6f4a13a74dc4868d9efea064a047 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:33.077650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4297875-9a42-4f90-8f6d-eca0890387e2 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:33.095362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4297875-9a42-4f90-8f6d-eca0890387e2 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:33.223300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:33.223955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:33.224239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:33.224508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] PATH_INFO: `/v3/projects/45a8512d937a429fbaf3b151cd7cfbaa` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:33.228170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a8512d937a429fbaf3b151cd7cfbaa)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:33.231371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:33.289811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:33.304670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a8512d937a429fbaf3b151cd7cfbaa', 'request_id': 'req-69638204-241b-4a0c-8690-dfb7f4b18a4c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:33.319391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a8512d937a429fbaf3b151cd7cfbaa', 'request_id': 'req-69638204-241b-4a0c-8690-dfb7f4b18a4c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:33.326230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a8512d937a429fbaf3b151cd7cfbaa', 'request_id': 'req-69638204-241b-4a0c-8690-dfb7f4b18a4c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:33.339428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] The token cache is being invalidate because project 45a8512d937a429fbaf3b151cd7cfbaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:33.339721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:33.340432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:33.342400 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3990/7965] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:33 2022] DELETE /identity/v3/projects/45a8512d937a429fbaf3b151cd7cfbaa => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:33.346178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:33.347799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:33.364343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835494d-6b80-4c75-bf89-5d03f93f3d09 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:33.445543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:33.446192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:33.446695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:33.446975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] PATH_INFO: `/v3/users/91a0e7f4cb9f4c91b9e923a5886b6579` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:33.451068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a0e7f4cb9f4c91b9e923a5886b6579)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:33.453648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:33.514776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a0e7f4cb9f4c91b9e923a5886b6579'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:33.524282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a0e7f4cb9f4c91b9e923a5886b6579'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:33.525014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a0e7f4cb9f4c91b9e923a5886b6579'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:33.525868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a0e7f4cb9f4c91b9e923a5886b6579'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:33.541129 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a0e7f4cb9f4c91b9e923a5886b6579'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:33.558173 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3976/7966] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:33 2022] DELETE /identity/v3/users/91a0e7f4cb9f4c91b9e923a5886b6579 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:25:33.843458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:33.845593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:33.863397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69638204-241b-4a0c-8690-dfb7f4b18a4c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:33.941949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97956de3-0e84-49fb-824f-59732ccb654f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:33.942951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97956de3-0e84-49fb-824f-59732ccb654f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:33.943065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97956de3-0e84-49fb-824f-59732ccb654f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:33.945607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97956de3-0e84-49fb-824f-59732ccb654f admin admin] PATH_INFO: `/v3/projects/16eb444f844c4a1e8645da20451f4690` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:33.947918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97956de3-0e84-49fb-824f-59732ccb654f admin admin] RBAC: Authorizing `identity:delete_project(project_id=16eb444f844c4a1e8645da20451f4690)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:33.949814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97956de3-0e84-49fb-824f-59732ccb654f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:34.055657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-97956de3-0e84-49fb-824f-59732ccb654f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16eb444f844c4a1e8645da20451f4690', 'request_id': 'req-97956de3-0e84-49fb-824f-59732ccb654f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:34.067540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-97956de3-0e84-49fb-824f-59732ccb654f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16eb444f844c4a1e8645da20451f4690', 'request_id': 'req-97956de3-0e84-49fb-824f-59732ccb654f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:34.082867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-97956de3-0e84-49fb-824f-59732ccb654f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16eb444f844c4a1e8645da20451f4690', 'request_id': 'req-97956de3-0e84-49fb-824f-59732ccb654f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:34.101271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-97956de3-0e84-49fb-824f-59732ccb654f admin admin] The token cache is being invalidate because project 16eb444f844c4a1e8645da20451f4690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:34.101803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-97956de3-0e84-49fb-824f-59732ccb654f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:34.113674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-97956de3-0e84-49fb-824f-59732ccb654f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:34.116166 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3991/7967] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:33 2022] DELETE /identity/v3/projects/16eb444f844c4a1e8645da20451f4690 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:25:34.997532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:35.000040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:35.023616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b5628-875e-47fc-9c51-5df3dd7f0620 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:35.029175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:35.088752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:35.089423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:35.089735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:35.090052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] PATH_INFO: `/v3/users/e28f7acd53094828a7863ce2fd775cdf` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:35.091243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28f7acd53094828a7863ce2fd775cdf)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:35.093152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:35.142616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28f7acd53094828a7863ce2fd775cdf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.151442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28f7acd53094828a7863ce2fd775cdf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.152192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28f7acd53094828a7863ce2fd775cdf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.152876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28f7acd53094828a7863ce2fd775cdf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.170123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28f7acd53094828a7863ce2fd775cdf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.185334 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3977/7968] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:34 2022] DELETE /identity/v3/users/e28f7acd53094828a7863ce2fd775cdf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:35.189635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33726f-9c5d-4a21-8661-4e5b4dd63fb6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:35.190086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33726f-9c5d-4a21-8661-4e5b4dd63fb6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:35.190182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33726f-9c5d-4a21-8661-4e5b4dd63fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:35.211425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3b33726f-9c5d-4a21-8661-4e5b4dd63fb6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:35.212626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3b33726f-9c5d-4a21-8661-4e5b4dd63fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:35.272991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:35.288645 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3992/7969] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:35.299478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:35.301333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:35.424244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552e075-363c-49c6-9325-fa7bc619bbe1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:35.428849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19222a-ce6d-4a05-b9a3-1974f013d357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:35.429840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19222a-ce6d-4a05-b9a3-1974f013d357 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:35.430331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19222a-ce6d-4a05-b9a3-1974f013d357 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:35.430715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19222a-ce6d-4a05-b9a3-1974f013d357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:35.444434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19222a-ce6d-4a05-b9a3-1974f013d357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:35.446116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19222a-ce6d-4a05-b9a3-1974f013d357 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:35.456436 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3978/7970] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:25:35.631270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33726f-9c5d-4a21-8661-4e5b4dd63fb6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:35.632871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3b33726f-9c5d-4a21-8661-4e5b4dd63fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:35.645852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33726f-9c5d-4a21-8661-4e5b4dd63fb6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:35.651897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:35.652519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:35.652817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:35.653091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] PATH_INFO: `/v3/projects/9b37e8634ac448ea9a86aff144098dd4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:35.654269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b37e8634ac448ea9a86aff144098dd4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:35.656184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:35.702858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b37e8634ac448ea9a86aff144098dd4', 'request_id': 'req-2202bb33-2ae7-4f63-97f4-7907bfc20425'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.710541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b37e8634ac448ea9a86aff144098dd4', 'request_id': 'req-2202bb33-2ae7-4f63-97f4-7907bfc20425'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.716170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b37e8634ac448ea9a86aff144098dd4', 'request_id': 'req-2202bb33-2ae7-4f63-97f4-7907bfc20425'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.728529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] The token cache is being invalidate because project 9b37e8634ac448ea9a86aff144098dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:35.728835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.729516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.731256 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3993/7971] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:35 2022] DELETE /identity/v3/projects/9b37e8634ac448ea9a86aff144098dd4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:35.735231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19222a-ce6d-4a05-b9a3-1974f013d357 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:35.745116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19222a-ce6d-4a05-b9a3-1974f013d357 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:35.774496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:35.804331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:35.804958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:35.805332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:35.805608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] PATH_INFO: `/v3/users/4f85ac53974a4a459246bffdb9caae72` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:35.806715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f85ac53974a4a459246bffdb9caae72)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:35.808613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:35.853551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f85ac53974a4a459246bffdb9caae72'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.860844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f85ac53974a4a459246bffdb9caae72'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.861517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f85ac53974a4a459246bffdb9caae72'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.862162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f85ac53974a4a459246bffdb9caae72'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.873863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f85ac53974a4a459246bffdb9caae72'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:35.886969 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3979/7972] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:35 2022] DELETE /identity/v3/users/4f85ac53974a4a459246bffdb9caae72 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:36.186633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:36.188354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:36.216663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202bb33-2ae7-4f63-97f4-7907bfc20425 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:36.280869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f127925-bce0-422b-9f2b-f3a8a4a40b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:36.281875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127925-bce0-422b-9f2b-f3a8a4a40b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:36.282257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127925-bce0-422b-9f2b-f3a8a4a40b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:36.282762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127925-bce0-422b-9f2b-f3a8a4a40b33 admin admin] PATH_INFO: `/v3/projects/0ce8c80fa10e4f8db7abcbaf58aee065` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:36.284150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f127925-bce0-422b-9f2b-f3a8a4a40b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce8c80fa10e4f8db7abcbaf58aee065)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:36.286281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f127925-bce0-422b-9f2b-f3a8a4a40b33 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:36.336671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0f127925-bce0-422b-9f2b-f3a8a4a40b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce8c80fa10e4f8db7abcbaf58aee065', 'request_id': 'req-0f127925-bce0-422b-9f2b-f3a8a4a40b33'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:36.344924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0f127925-bce0-422b-9f2b-f3a8a4a40b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce8c80fa10e4f8db7abcbaf58aee065', 'request_id': 'req-0f127925-bce0-422b-9f2b-f3a8a4a40b33'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:36.351852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0f127925-bce0-422b-9f2b-f3a8a4a40b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce8c80fa10e4f8db7abcbaf58aee065', 'request_id': 'req-0f127925-bce0-422b-9f2b-f3a8a4a40b33'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:36.368335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0f127925-bce0-422b-9f2b-f3a8a4a40b33 admin admin] The token cache is being invalidate because project 0ce8c80fa10e4f8db7abcbaf58aee065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:36.368611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0f127925-bce0-422b-9f2b-f3a8a4a40b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:36.369372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0f127925-bce0-422b-9f2b-f3a8a4a40b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:36.370870 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3994/7973] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:36 2022] DELETE /identity/v3/projects/0ce8c80fa10e4f8db7abcbaf58aee065 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:37.197534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:37.198928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:37.212503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b4b6-49e6-4ed0-9d2d-065da0a3132a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:37.267499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:37.268126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:37.268404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:37.268675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] PATH_INFO: `/v3/users/df864d8a6979495b945a6fdb4108f0f5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:37.269785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df864d8a6979495b945a6fdb4108f0f5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:37.271668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:37.317606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df864d8a6979495b945a6fdb4108f0f5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:37.322452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:37.326277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df864d8a6979495b945a6fdb4108f0f5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:37.327010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df864d8a6979495b945a6fdb4108f0f5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:37.327947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df864d8a6979495b945a6fdb4108f0f5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:37.342035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df864d8a6979495b945a6fdb4108f0f5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:37.355523 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3980/7974] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:37 2022] DELETE /identity/v3/users/df864d8a6979495b945a6fdb4108f0f5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:37.360373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69589b8-d816-4112-a46d-00c848765c0a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:37.361139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69589b8-d816-4112-a46d-00c848765c0a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:37.361383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69589b8-d816-4112-a46d-00c848765c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:37.381268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e69589b8-d816-4112-a46d-00c848765c0a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:37.382456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e69589b8-d816-4112-a46d-00c848765c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:37.390382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:37.451737 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3995/7975] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:37.464461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:37.466486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:37.544572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1092f-7815-4501-8682-5a69e3ecb98c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:37.548244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aff641-3ddb-42e9-89a1-a6641b50b099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:37.548854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aff641-3ddb-42e9-89a1-a6641b50b099 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:37.549135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aff641-3ddb-42e9-89a1-a6641b50b099 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:37.549432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aff641-3ddb-42e9-89a1-a6641b50b099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:37.560266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aff641-3ddb-42e9-89a1-a6641b50b099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:37.561766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aff641-3ddb-42e9-89a1-a6641b50b099 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:37.571697 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3981/7976] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:25:37.965645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69589b8-d816-4112-a46d-00c848765c0a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:37.967110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e69589b8-d816-4112-a46d-00c848765c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:37.979610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69589b8-d816-4112-a46d-00c848765c0a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:37.985051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5407d1-7459-4992-9fce-90d1aae4b07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:37.985713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5407d1-7459-4992-9fce-90d1aae4b07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:37.985998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5407d1-7459-4992-9fce-90d1aae4b07d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:37.986275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5407d1-7459-4992-9fce-90d1aae4b07d admin admin] PATH_INFO: `/v3/projects/068e58c58aaf42c3b58197042d0026ad` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:37.987390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5407d1-7459-4992-9fce-90d1aae4b07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=068e58c58aaf42c3b58197042d0026ad)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:37.989331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5407d1-7459-4992-9fce-90d1aae4b07d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:38.035965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7b5407d1-7459-4992-9fce-90d1aae4b07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068e58c58aaf42c3b58197042d0026ad', 'request_id': 'req-7b5407d1-7459-4992-9fce-90d1aae4b07d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:38.043783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7b5407d1-7459-4992-9fce-90d1aae4b07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068e58c58aaf42c3b58197042d0026ad', 'request_id': 'req-7b5407d1-7459-4992-9fce-90d1aae4b07d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:38.049864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7b5407d1-7459-4992-9fce-90d1aae4b07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068e58c58aaf42c3b58197042d0026ad', 'request_id': 'req-7b5407d1-7459-4992-9fce-90d1aae4b07d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:38.060974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7b5407d1-7459-4992-9fce-90d1aae4b07d admin admin] The token cache is being invalidate because project 068e58c58aaf42c3b58197042d0026ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:38.061294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7b5407d1-7459-4992-9fce-90d1aae4b07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:38.061931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7b5407d1-7459-4992-9fce-90d1aae4b07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:38.063445 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3996/7977] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:37 2022] DELETE /identity/v3/projects/068e58c58aaf42c3b58197042d0026ad => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:25:38.068465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94d126-3c29-48ee-b880-bb2bb47187e4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.069308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94d126-3c29-48ee-b880-bb2bb47187e4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.069582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94d126-3c29-48ee-b880-bb2bb47187e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.089315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ad94d126-3c29-48ee-b880-bb2bb47187e4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:38.090441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ad94d126-3c29-48ee-b880-bb2bb47187e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:38.147979 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3982/7978] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:38.155979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814dc7d-9a58-44db-8e5c-58a76ae70a3b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.156281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814dc7d-9a58-44db-8e5c-58a76ae70a3b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.156560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814dc7d-9a58-44db-8e5c-58a76ae70a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.175870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1814dc7d-9a58-44db-8e5c-58a76ae70a3b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:38.177063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1814dc7d-9a58-44db-8e5c-58a76ae70a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:38.185529 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3997/7979] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:38.189579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94d126-3c29-48ee-b880-bb2bb47187e4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:38.199681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94d126-3c29-48ee-b880-bb2bb47187e4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:38.204262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262f870-dee2-4b73-8a02-cdb3682d1f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:38.204851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f870-dee2-4b73-8a02-cdb3682d1f9e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.205127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f870-dee2-4b73-8a02-cdb3682d1f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.205426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f870-dee2-4b73-8a02-cdb3682d1f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.206066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262f870-dee2-4b73-8a02-cdb3682d1f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:25:38.206388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262f870-dee2-4b73-8a02-cdb3682d1f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:38.207955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262f870-dee2-4b73-8a02-cdb3682d1f9e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:38.220294 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3983/7980] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:25:38.224475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814dc7d-9a58-44db-8e5c-58a76ae70a3b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:38.234039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814dc7d-9a58-44db-8e5c-58a76ae70a3b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:38.238635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac883d6-22a1-42a6-b95e-a041c3460629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:38.239222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac883d6-22a1-42a6-b95e-a041c3460629 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.239498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac883d6-22a1-42a6-b95e-a041c3460629 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.239768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac883d6-22a1-42a6-b95e-a041c3460629 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.240408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac883d6-22a1-42a6-b95e-a041c3460629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:38.242451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac883d6-22a1-42a6-b95e-a041c3460629 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:38.270003 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3998/7981] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:38 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:38.274882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262f870-dee2-4b73-8a02-cdb3682d1f9e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:38.284877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262f870-dee2-4b73-8a02-cdb3682d1f9e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:38.340443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37315d4c-eff4-4cb1-a3c5-044f853ff59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:38.340977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37315d4c-eff4-4cb1-a3c5-044f853ff59e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.341295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37315d4c-eff4-4cb1-a3c5-044f853ff59e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.341553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37315d4c-eff4-4cb1-a3c5-044f853ff59e admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.342169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37315d4c-eff4-4cb1-a3c5-044f853ff59e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:38.344056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37315d4c-eff4-4cb1-a3c5-044f853ff59e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:38.351902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:38.370094 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3984/7982] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:38 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:38.371269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac883d6-22a1-42a6-b95e-a041c3460629 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:38.382051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac883d6-22a1-42a6-b95e-a041c3460629 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:38.386686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69537bf2-498b-435a-bc14-a16e56f1704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:38.387279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69537bf2-498b-435a-bc14-a16e56f1704a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.387557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69537bf2-498b-435a-bc14-a16e56f1704a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.387828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69537bf2-498b-435a-bc14-a16e56f1704a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.388464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69537bf2-498b-435a-bc14-a16e56f1704a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:38.390089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69537bf2-498b-435a-bc14-a16e56f1704a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:38.400382 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 3999/7983] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:38.404419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37315d4c-eff4-4cb1-a3c5-044f853ff59e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:38.414421 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37315d4c-eff4-4cb1-a3c5-044f853ff59e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:38.419089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fee56-5b92-4260-87a0-77c4abd989f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:38.419715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fee56-5b92-4260-87a0-77c4abd989f2 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.420002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fee56-5b92-4260-87a0-77c4abd989f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.420278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fee56-5b92-4260-87a0-77c4abd989f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.420913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fee56-5b92-4260-87a0-77c4abd989f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:38.422527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fee56-5b92-4260-87a0-77c4abd989f2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:38.436680 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3985/7984] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:38.437867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69537bf2-498b-435a-bc14-a16e56f1704a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:38.448429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69537bf2-498b-435a-bc14-a16e56f1704a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:38.453056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75c10f-9a96-49e8-9c2d-f9a5e0653144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:38.453720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75c10f-9a96-49e8-9c2d-f9a5e0653144 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.453996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75c10f-9a96-49e8-9c2d-f9a5e0653144 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.454266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75c10f-9a96-49e8-9c2d-f9a5e0653144 admin admin] PATH_INFO: `/v3/projects/22138a7b4af5479aaa838ace280995ca/users/2cd9b2ea40e343958c2fff8deb594c06/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.468441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75c10f-9a96-49e8-9c2d-f9a5e0653144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22138a7b4af5479aaa838ace280995ca, user_id=2cd9b2ea40e343958c2fff8deb594c06, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:38.471088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75c10f-9a96-49e8-9c2d-f9a5e0653144 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:38.484048 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4000/7985] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:38 2022] PUT /identity/v3/projects/22138a7b4af5479aaa838ace280995ca/users/2cd9b2ea40e343958c2fff8deb594c06/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:38.496154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0927f-9a17-405f-b6cd-77280f077fd4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.496435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0927f-9a17-405f-b6cd-77280f077fd4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.496728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0927f-9a17-405f-b6cd-77280f077fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.526039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1ab0927f-9a17-405f-b6cd-77280f077fd4 None None] MFA Rules not processed for user `2cd9b2ea40e343958c2fff8deb594c06`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:38.527243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1ab0927f-9a17-405f-b6cd-77280f077fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:38.591339 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3986/7986] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:38.595875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75c10f-9a96-49e8-9c2d-f9a5e0653144 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:38.630197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:38.660978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75c10f-9a96-49e8-9c2d-f9a5e0653144 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:38.665779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378c15c-727e-4dde-b72c-d88030fbe7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:38.666385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378c15c-727e-4dde-b72c-d88030fbe7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.666666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378c15c-727e-4dde-b72c-d88030fbe7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.666935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378c15c-727e-4dde-b72c-d88030fbe7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.667567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378c15c-727e-4dde-b72c-d88030fbe7c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:38.669494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378c15c-727e-4dde-b72c-d88030fbe7c6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:38.696175 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4001/7987] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:38 2022] POST /identity/v3/projects => generated 401 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:38.700408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0927f-9a17-405f-b6cd-77280f077fd4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:38.711226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0927f-9a17-405f-b6cd-77280f077fd4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:38.767561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92ce4c-f39c-4c4e-95bf-0c2b1872d4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:38.768168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ce4c-f39c-4c4e-95bf-0c2b1872d4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.768442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ce4c-f39c-4c4e-95bf-0c2b1872d4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.768710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ce4c-f39c-4c4e-95bf-0c2b1872d4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.769360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92ce4c-f39c-4c4e-95bf-0c2b1872d4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:38.771244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92ce4c-f39c-4c4e-95bf-0c2b1872d4c1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:38.790976 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3987/7988] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:38 2022] POST /identity/v3/users => generated 307 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:38.794926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378c15c-727e-4dde-b72c-d88030fbe7c6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:38.805941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378c15c-727e-4dde-b72c-d88030fbe7c6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:38.810562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f66d0b-1bdf-4616-a4f8-1f8a03f681e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:38.811152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66d0b-1bdf-4616-a4f8-1f8a03f681e5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.811430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66d0b-1bdf-4616-a4f8-1f8a03f681e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.811706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66d0b-1bdf-4616-a4f8-1f8a03f681e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.812341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f66d0b-1bdf-4616-a4f8-1f8a03f681e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:38.814004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f66d0b-1bdf-4616-a4f8-1f8a03f681e5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:38.825036 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4002/7989] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:38.829145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92ce4c-f39c-4c4e-95bf-0c2b1872d4c1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:38.839122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92ce4c-f39c-4c4e-95bf-0c2b1872d4c1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:38.843724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b135fe2-dc8a-475e-a53d-db2544aa5cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:38.844310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135fe2-dc8a-475e-a53d-db2544aa5cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.844631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135fe2-dc8a-475e-a53d-db2544aa5cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.844907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135fe2-dc8a-475e-a53d-db2544aa5cf9 admin admin] PATH_INFO: `/v3/projects/1ada5fc232b44d4b91330504456a674a/users/d77accc9e3c9434b8e66d7aa518008ee/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.860825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b135fe2-dc8a-475e-a53d-db2544aa5cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ada5fc232b44d4b91330504456a674a, user_id=d77accc9e3c9434b8e66d7aa518008ee, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:38.863538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b135fe2-dc8a-475e-a53d-db2544aa5cf9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:38.878187 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3988/7990] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:38 2022] PUT /identity/v3/projects/1ada5fc232b44d4b91330504456a674a/users/d77accc9e3c9434b8e66d7aa518008ee/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:38.882263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f66d0b-1bdf-4616-a4f8-1f8a03f681e5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:38.892860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f66d0b-1bdf-4616-a4f8-1f8a03f681e5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:38.956873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547b94b-9592-4c7d-8062-3757a1a000d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:38.957652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b94b-9592-4c7d-8062-3757a1a000d4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.958051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b94b-9592-4c7d-8062-3757a1a000d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.958321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b94b-9592-4c7d-8062-3757a1a000d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.958961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547b94b-9592-4c7d-8062-3757a1a000d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:38.960725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547b94b-9592-4c7d-8062-3757a1a000d4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:38.973508 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4003/7991] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:38.978326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b135fe2-dc8a-475e-a53d-db2544aa5cf9 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:38.989506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b135fe2-dc8a-475e-a53d-db2544aa5cf9 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:38.995532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0c5ce-25eb-486e-ab48-5a684c0dbe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:38.996335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0c5ce-25eb-486e-ab48-5a684c0dbe56 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:38.996619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0c5ce-25eb-486e-ab48-5a684c0dbe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:38.996892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0c5ce-25eb-486e-ab48-5a684c0dbe56 admin admin] PATH_INFO: `/v3/projects/1ada5fc232b44d4b91330504456a674a/users/d77accc9e3c9434b8e66d7aa518008ee/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:38.998892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0c5ce-25eb-486e-ab48-5a684c0dbe56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ada5fc232b44d4b91330504456a674a, user_id=d77accc9e3c9434b8e66d7aa518008ee, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:39.001606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0c5ce-25eb-486e-ab48-5a684c0dbe56 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:39.013037 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3989/7992] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:38 2022] PUT /identity/v3/projects/1ada5fc232b44d4b91330504456a674a/users/d77accc9e3c9434b8e66d7aa518008ee/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:39.023469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c976e-e142-45ec-bf8b-7cc7d3f7aa8c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:39.023775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c976e-e142-45ec-bf8b-7cc7d3f7aa8c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:39.024037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c976e-e142-45ec-bf8b-7cc7d3f7aa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:39.053789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c07c976e-e142-45ec-bf8b-7cc7d3f7aa8c None None] MFA Rules not processed for user `d77accc9e3c9434b8e66d7aa518008ee`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:39.055013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c07c976e-e142-45ec-bf8b-7cc7d3f7aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:39.124428 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4004/7993] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:39.129382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0c5ce-25eb-486e-ab48-5a684c0dbe56 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:39.139891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0c5ce-25eb-486e-ab48-5a684c0dbe56 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:39.144370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a73611-9042-4955-93f4-b934f036b407 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77accc9e3c9434b8e66d7aa518008ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ada5fc232b44d4b91330504456a674a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:39.144968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a73611-9042-4955-93f4-b934f036b407 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:39.145285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a73611-9042-4955-93f4-b934f036b407 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:39.145574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a73611-9042-4955-93f4-b934f036b407 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:39.146211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a73611-9042-4955-93f4-b934f036b407 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:39.147777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a73611-9042-4955-93f4-b934f036b407 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:39.166350 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3990/7994] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:25:39 2022] POST /identity/v3/roles => generated 239 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:39.167465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c976e-e142-45ec-bf8b-7cc7d3f7aa8c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:39.176477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c976e-e142-45ec-bf8b-7cc7d3f7aa8c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:39.181730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ff88c-6d16-455f-bc0b-9ce7b22ae238 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77accc9e3c9434b8e66d7aa518008ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ada5fc232b44d4b91330504456a674a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:39.182370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ff88c-6d16-455f-bc0b-9ce7b22ae238 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:39.182648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ff88c-6d16-455f-bc0b-9ce7b22ae238 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:39.182921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ff88c-6d16-455f-bc0b-9ce7b22ae238 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] PATH_INFO: `/v3/projects/22138a7b4af5479aaa838ace280995ca/users/2cd9b2ea40e343958c2fff8deb594c06/roles/41fe21fc854247fe916e8763249ba133` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:39.185086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ff88c-6d16-455f-bc0b-9ce7b22ae238 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] RBAC: Authorizing `identity:create_grant(project_id=22138a7b4af5479aaa838ace280995ca, user_id=2cd9b2ea40e343958c2fff8deb594c06, role_id=41fe21fc854247fe916e8763249ba133)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:39.187787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ff88c-6d16-455f-bc0b-9ce7b22ae238 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:39.199887 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4005/7995] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:39 2022] PUT /identity/v3/projects/22138a7b4af5479aaa838ace280995ca/users/2cd9b2ea40e343958c2fff8deb594c06/roles/41fe21fc854247fe916e8763249ba133 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:25:39.204987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a73611-9042-4955-93f4-b934f036b407 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:39.215346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:39.273047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a73611-9042-4955-93f4-b934f036b407 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:39.327832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb012a9-03bc-4448-98f0-23e7df45a85a tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cd9b2ea40e343958c2fff8deb594c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22138a7b4af5479aaa838ace280995ca', 'project_domain_id': 'default', 'roles': ['tempest-test_role-608613028', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:39.328473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb012a9-03bc-4448-98f0-23e7df45a85a tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:39.328756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb012a9-03bc-4448-98f0-23e7df45a85a tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:39.329062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb012a9-03bc-4448-98f0-23e7df45a85a tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] PATH_INFO: `/v3/users/2cd9b2ea40e343958c2fff8deb594c06/application_credentials` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:39.329747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb012a9-03bc-4448-98f0-23e7df45a85a tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] RBAC: Authorizing `identity:create_application_credential(user_id=2cd9b2ea40e343958c2fff8deb594c06)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:39.330960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb012a9-03bc-4448-98f0-23e7df45a85a tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:39.400449 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3991/7996] 10.222.0.26 () {60 vars in 1315 bytes} [Sat Oct 8 21:25:39 2022] POST /identity/v3/users/2cd9b2ea40e343958c2fff8deb594c06/application_credentials => generated 659 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:39.404212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe5dd-fd12-4b04-ba4c-afcdc0b64308 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:39.404662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe5dd-fd12-4b04-ba4c-afcdc0b64308 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:39.404745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe5dd-fd12-4b04-ba4c-afcdc0b64308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:39.421858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:39.427425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f57fe5dd-fd12-4b04-ba4c-afcdc0b64308 None None] MFA Rules not processed for user `2cd9b2ea40e343958c2fff8deb594c06`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:39.429157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f57fe5dd-fd12-4b04-ba4c-afcdc0b64308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:39.535637 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4006/7997] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3394 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 08 21:25:39.540621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb012a9-03bc-4448-98f0-23e7df45a85a tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:39.550761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb012a9-03bc-4448-98f0-23e7df45a85a tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:39.555369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d46ff-bc12-4dff-a3f4-86e9e3951ce5 tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cd9b2ea40e343958c2fff8deb594c06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22138a7b4af5479aaa838ace280995ca', 'project_domain_id': 'default', 'roles': ['tempest-test_role-608613028', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:39.556014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d46ff-bc12-4dff-a3f4-86e9e3951ce5 tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:39.556298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d46ff-bc12-4dff-a3f4-86e9e3951ce5 tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:39.556576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d46ff-bc12-4dff-a3f4-86e9e3951ce5 tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] PATH_INFO: `/v3/users/2cd9b2ea40e343958c2fff8deb594c06/application_credentials/82f7ee95a0834bfa99117c3a913b90b7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:39.557806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d46ff-bc12-4dff-a3f4-86e9e3951ce5 tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] RBAC: Authorizing `identity:delete_application_credential(user_id=2cd9b2ea40e343958c2fff8deb594c06, application_credential_id=82f7ee95a0834bfa99117c3a913b90b7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:39.559292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d46ff-bc12-4dff-a3f4-86e9e3951ce5 tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:39.577420 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3992/7998] 10.222.0.26 () {58 vars in 1395 bytes} [Sat Oct 8 21:25:39 2022] DELETE /identity/v3/users/2cd9b2ea40e343958c2fff8deb594c06/application_credentials/82f7ee95a0834bfa99117c3a913b90b7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:39.581623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe5dd-fd12-4b04-ba4c-afcdc0b64308 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:39.642258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe5dd-fd12-4b04-ba4c-afcdc0b64308 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:39.649026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b94251-475e-437b-bb6b-d3340da9e704 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77accc9e3c9434b8e66d7aa518008ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ada5fc232b44d4b91330504456a674a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:39.649717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b94251-475e-437b-bb6b-d3340da9e704 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:39.650055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b94251-475e-437b-bb6b-d3340da9e704 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:39.650333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b94251-475e-437b-bb6b-d3340da9e704 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] PATH_INFO: `/v3/roles/41fe21fc854247fe916e8763249ba133` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:39.651857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b94251-475e-437b-bb6b-d3340da9e704 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] RBAC: Authorizing `identity:delete_role(role_id=41fe21fc854247fe916e8763249ba133)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:39.653558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b94251-475e-437b-bb6b-d3340da9e704 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:39.691328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-74b94251-475e-437b-bb6b-d3340da9e704 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] Invalidating the token cache because role 41fe21fc854247fe916e8763249ba133 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:39.691616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-74b94251-475e-437b-bb6b-d3340da9e704 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:39.692271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-74b94251-475e-437b-bb6b-d3340da9e704 tempest-ApplicationCredentialsV3AdminTest-500674791 tempest-ApplicationCredentialsV3AdminTest-500674791-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:39.694572 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4007/7999] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:39 2022] DELETE /identity/v3/roles/41fe21fc854247fe916e8763249ba133 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:39.699748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d46ff-bc12-4dff-a3f4-86e9e3951ce5 tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:39.701787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-667d46ff-bc12-4dff-a3f4-86e9e3951ce5 tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:39.737320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:39.771413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d46ff-bc12-4dff-a3f4-86e9e3951ce5 tempest-ApplicationCredentialsV3AdminTest-848457821 tempest-ApplicationCredentialsV3AdminTest-848457821-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:39.826923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:39.827558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:39.827841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:39.828115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] PATH_INFO: `/v3/users/2cd9b2ea40e343958c2fff8deb594c06` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:39.829279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd9b2ea40e343958c2fff8deb594c06)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:39.831185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:39.876074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd9b2ea40e343958c2fff8deb594c06'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:39.883455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd9b2ea40e343958c2fff8deb594c06'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:39.884150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd9b2ea40e343958c2fff8deb594c06'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:39.884807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd9b2ea40e343958c2fff8deb594c06'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:39.896673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd9b2ea40e343958c2fff8deb594c06'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:39.909766 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3993/8000] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:39 2022] DELETE /identity/v3/users/2cd9b2ea40e343958c2fff8deb594c06 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:25:39.914268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2416b-ba23-4dd8-bb1c-75117f028214 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:39.914560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2416b-ba23-4dd8-bb1c-75117f028214 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:39.914841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2416b-ba23-4dd8-bb1c-75117f028214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:39.934056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-47a2416b-ba23-4dd8-bb1c-75117f028214 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:39.935254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-47a2416b-ba23-4dd8-bb1c-75117f028214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:39.947358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:39.996847 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4008/8001] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:40.006996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:40.008437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:40.069364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005a70-3485-42b0-a86c-f68545cff3df admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:40.072976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7cd89-b508-4532-a319-bb2e5f06ae07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:40.073671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7cd89-b508-4532-a319-bb2e5f06ae07 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:40.073948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7cd89-b508-4532-a319-bb2e5f06ae07 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:40.074219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7cd89-b508-4532-a319-bb2e5f06ae07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:40.083237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7cd89-b508-4532-a319-bb2e5f06ae07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:40.084684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7cd89-b508-4532-a319-bb2e5f06ae07 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:40.089789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:40.098771 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3994/8002] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:25:40.367141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2416b-ba23-4dd8-bb1c-75117f028214 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:40.368607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-47a2416b-ba23-4dd8-bb1c-75117f028214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:40.381422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2416b-ba23-4dd8-bb1c-75117f028214 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:40.386047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:40.386698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:40.386973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:40.387244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] PATH_INFO: `/v3/projects/22138a7b4af5479aaa838ace280995ca` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:40.388431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22138a7b4af5479aaa838ace280995ca)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:40.390400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:40.437755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22138a7b4af5479aaa838ace280995ca', 'request_id': 'req-39f0b044-64b0-4864-991f-93a0a3cadf95'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:40.445026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22138a7b4af5479aaa838ace280995ca', 'request_id': 'req-39f0b044-64b0-4864-991f-93a0a3cadf95'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:40.450707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22138a7b4af5479aaa838ace280995ca', 'request_id': 'req-39f0b044-64b0-4864-991f-93a0a3cadf95'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:40.461622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] The token cache is being invalidate because project 22138a7b4af5479aaa838ace280995ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:40.461896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:40.462529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:40.463999 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4009/8003] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:40 2022] DELETE /identity/v3/projects/22138a7b4af5479aaa838ace280995ca => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:40.468026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7cd89-b508-4532-a319-bb2e5f06ae07 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:40.478605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7cd89-b508-4532-a319-bb2e5f06ae07 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:40.535156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2b01e-f813-4ba4-b0bf-09ec75256fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:40.535788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b01e-f813-4ba4-b0bf-09ec75256fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:40.536070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b01e-f813-4ba4-b0bf-09ec75256fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:40.536344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b01e-f813-4ba4-b0bf-09ec75256fdb admin admin] PATH_INFO: `/v3/users/d77accc9e3c9434b8e66d7aa518008ee` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:40.538074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2b01e-f813-4ba4-b0bf-09ec75256fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77accc9e3c9434b8e66d7aa518008ee)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:40.540064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2b01e-f813-4ba4-b0bf-09ec75256fdb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:40.587653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e7f2b01e-f813-4ba4-b0bf-09ec75256fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77accc9e3c9434b8e66d7aa518008ee'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:40.594652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e7f2b01e-f813-4ba4-b0bf-09ec75256fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77accc9e3c9434b8e66d7aa518008ee'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:40.595341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e7f2b01e-f813-4ba4-b0bf-09ec75256fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77accc9e3c9434b8e66d7aa518008ee'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:40.595995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e7f2b01e-f813-4ba4-b0bf-09ec75256fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77accc9e3c9434b8e66d7aa518008ee'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:40.608510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e7f2b01e-f813-4ba4-b0bf-09ec75256fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77accc9e3c9434b8e66d7aa518008ee'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:40.621671 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3995/8004] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:40 2022] DELETE /identity/v3/users/d77accc9e3c9434b8e66d7aa518008ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:40.900952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:40.902484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:40.915957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0b044-64b0-4864-991f-93a0a3cadf95 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:40.973379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498dbcf-2b70-4261-b5e5-516c3877c5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:40.973947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498dbcf-2b70-4261-b5e5-516c3877c5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:40.974227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498dbcf-2b70-4261-b5e5-516c3877c5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:40.974503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498dbcf-2b70-4261-b5e5-516c3877c5bc admin admin] PATH_INFO: `/v3/projects/1ada5fc232b44d4b91330504456a674a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:40.976213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498dbcf-2b70-4261-b5e5-516c3877c5bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ada5fc232b44d4b91330504456a674a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:40.978157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498dbcf-2b70-4261-b5e5-516c3877c5bc admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:41.020529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:41.025305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7498dbcf-2b70-4261-b5e5-516c3877c5bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ada5fc232b44d4b91330504456a674a', 'request_id': 'req-7498dbcf-2b70-4261-b5e5-516c3877c5bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:41.034208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7498dbcf-2b70-4261-b5e5-516c3877c5bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ada5fc232b44d4b91330504456a674a', 'request_id': 'req-7498dbcf-2b70-4261-b5e5-516c3877c5bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:41.040574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7498dbcf-2b70-4261-b5e5-516c3877c5bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ada5fc232b44d4b91330504456a674a', 'request_id': 'req-7498dbcf-2b70-4261-b5e5-516c3877c5bc'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:41.052118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7498dbcf-2b70-4261-b5e5-516c3877c5bc admin admin] The token cache is being invalidate because project 1ada5fc232b44d4b91330504456a674a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:41.052582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7498dbcf-2b70-4261-b5e5-516c3877c5bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:41.053370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7498dbcf-2b70-4261-b5e5-516c3877c5bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:41.054870 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4010/8005] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:40 2022] DELETE /identity/v3/projects/1ada5fc232b44d4b91330504456a674a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:41.059762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651baec-9154-4b6a-a40b-afc89e459218 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:41.060057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651baec-9154-4b6a-a40b-afc89e459218 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:41.060318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651baec-9154-4b6a-a40b-afc89e459218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:41.080863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2651baec-9154-4b6a-a40b-afc89e459218 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:41.082109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2651baec-9154-4b6a-a40b-afc89e459218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:41.149757 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3996/8006] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:41.157669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448abb54-c6e0-467b-8cac-fb61ec7f0282 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:41.157978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448abb54-c6e0-467b-8cac-fb61ec7f0282 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:41.158254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448abb54-c6e0-467b-8cac-fb61ec7f0282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:41.178433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-448abb54-c6e0-467b-8cac-fb61ec7f0282 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:41.179674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-448abb54-c6e0-467b-8cac-fb61ec7f0282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:41.187641 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4011/8007] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:41.192007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651baec-9154-4b6a-a40b-afc89e459218 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:41.202529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651baec-9154-4b6a-a40b-afc89e459218 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:41.207174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40122c0-ce22-4118-84a9-863c74dbb72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:41.207767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40122c0-ce22-4118-84a9-863c74dbb72a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:41.208042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40122c0-ce22-4118-84a9-863c74dbb72a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:41.208312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40122c0-ce22-4118-84a9-863c74dbb72a admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:41.208950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40122c0-ce22-4118-84a9-863c74dbb72a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:25:41.209826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40122c0-ce22-4118-84a9-863c74dbb72a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:41.211524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40122c0-ce22-4118-84a9-863c74dbb72a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:41.228712 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3997/8008] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:41.233264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448abb54-c6e0-467b-8cac-fb61ec7f0282 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:41.245147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448abb54-c6e0-467b-8cac-fb61ec7f0282 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:41.250449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce32f8-fc7c-45df-a2e9-0b583260c46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:41.251061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce32f8-fc7c-45df-a2e9-0b583260c46f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:41.251339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce32f8-fc7c-45df-a2e9-0b583260c46f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:41.251611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce32f8-fc7c-45df-a2e9-0b583260c46f admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:41.252504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce32f8-fc7c-45df-a2e9-0b583260c46f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:41.254757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce32f8-fc7c-45df-a2e9-0b583260c46f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:41.290932 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4012/8009] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:41 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:41.292097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40122c0-ce22-4118-84a9-863c74dbb72a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:41.303782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40122c0-ce22-4118-84a9-863c74dbb72a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:41.308739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:41.382058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1426b-a130-412f-8cee-6616bc268979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:41.382683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1426b-a130-412f-8cee-6616bc268979 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:41.383361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1426b-a130-412f-8cee-6616bc268979 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:41.383643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1426b-a130-412f-8cee-6616bc268979 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:41.384617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1426b-a130-412f-8cee-6616bc268979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:41.386499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1426b-a130-412f-8cee-6616bc268979 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:41.419674 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3998/8010] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:41 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:41.424176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce32f8-fc7c-45df-a2e9-0b583260c46f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:41.435546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce32f8-fc7c-45df-a2e9-0b583260c46f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:41.440436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa56eae-abbe-446f-a7be-6a878c897c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:41.441034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa56eae-abbe-446f-a7be-6a878c897c77 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:41.441351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa56eae-abbe-446f-a7be-6a878c897c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:41.441674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa56eae-abbe-446f-a7be-6a878c897c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:41.442325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa56eae-abbe-446f-a7be-6a878c897c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:41.443984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa56eae-abbe-446f-a7be-6a878c897c77 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:41.454520 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4013/8011] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:41.458475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1426b-a130-412f-8cee-6616bc268979 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:41.469178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1426b-a130-412f-8cee-6616bc268979 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:41.473867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecbe4b-7bcd-4e95-b461-d3a7b5c11832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:41.474508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecbe4b-7bcd-4e95-b461-d3a7b5c11832 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:41.474787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecbe4b-7bcd-4e95-b461-d3a7b5c11832 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:41.476150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecbe4b-7bcd-4e95-b461-d3a7b5c11832 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:41.476434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecbe4b-7bcd-4e95-b461-d3a7b5c11832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:41.478079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecbe4b-7bcd-4e95-b461-d3a7b5c11832 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:41.491818 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 3999/8012] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:41.495841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa56eae-abbe-446f-a7be-6a878c897c77 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:41.505921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa56eae-abbe-446f-a7be-6a878c897c77 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:41.511225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3ff74-3302-47b4-a2d2-277083d1d432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:41.511884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3ff74-3302-47b4-a2d2-277083d1d432 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:41.512145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3ff74-3302-47b4-a2d2-277083d1d432 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:41.512415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3ff74-3302-47b4-a2d2-277083d1d432 admin admin] PATH_INFO: `/v3/projects/f7c2bb38ef71450cbfec30c890eb2bce/users/76dfeb57657e4b0781af98c331691efd/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:41.527858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3ff74-3302-47b4-a2d2-277083d1d432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c2bb38ef71450cbfec30c890eb2bce, user_id=76dfeb57657e4b0781af98c331691efd, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:41.530599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3ff74-3302-47b4-a2d2-277083d1d432 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:41.543985 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4014/8013] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:41 2022] PUT /identity/v3/projects/f7c2bb38ef71450cbfec30c890eb2bce/users/76dfeb57657e4b0781af98c331691efd/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:41.555161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdedc37-2a4d-4056-965d-1af450e125a5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:41.555443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdedc37-2a4d-4056-965d-1af450e125a5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:41.555714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdedc37-2a4d-4056-965d-1af450e125a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:41.584804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1fdedc37-2a4d-4056-965d-1af450e125a5 None None] MFA Rules not processed for user `76dfeb57657e4b0781af98c331691efd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:41.586040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1fdedc37-2a4d-4056-965d-1af450e125a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:41.657356 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4000/8014] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:41.661959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3ff74-3302-47b4-a2d2-277083d1d432 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:41.728791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3ff74-3302-47b4-a2d2-277083d1d432 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:41.734816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee9abf-d31b-40d2-b166-adce19aaae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:41.735448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee9abf-d31b-40d2-b166-adce19aaae33 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:41.736070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee9abf-d31b-40d2-b166-adce19aaae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:41.736070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee9abf-d31b-40d2-b166-adce19aaae33 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:41.736750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee9abf-d31b-40d2-b166-adce19aaae33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:41.739005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee9abf-d31b-40d2-b166-adce19aaae33 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:41.769924 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4015/8015] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:41 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:41.774133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdedc37-2a4d-4056-965d-1af450e125a5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:41.786292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdedc37-2a4d-4056-965d-1af450e125a5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:41.845446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dcb99-f159-4bec-ab39-942b81ee6d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:41.846126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dcb99-f159-4bec-ab39-942b81ee6d78 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:41.846405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dcb99-f159-4bec-ab39-942b81ee6d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:41.846676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dcb99-f159-4bec-ab39-942b81ee6d78 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:41.847358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dcb99-f159-4bec-ab39-942b81ee6d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:41.849414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dcb99-f159-4bec-ab39-942b81ee6d78 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:41.873911 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4001/8016] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:41 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:41.877821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee9abf-d31b-40d2-b166-adce19aaae33 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:41.888152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee9abf-d31b-40d2-b166-adce19aaae33 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:41.893202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffcee8-9d3f-4d66-82c3-441d6ebfd2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:41.893811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffcee8-9d3f-4d66-82c3-441d6ebfd2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:41.894091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffcee8-9d3f-4d66-82c3-441d6ebfd2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:41.894361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffcee8-9d3f-4d66-82c3-441d6ebfd2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:41.894998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffcee8-9d3f-4d66-82c3-441d6ebfd2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:41.896580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffcee8-9d3f-4d66-82c3-441d6ebfd2b9 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:41.907952 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4016/8017] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:25:41.912866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dcb99-f159-4bec-ab39-942b81ee6d78 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:41.919976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:41.923937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dcb99-f159-4bec-ab39-942b81ee6d78 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:41.931168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f61398-30c9-4d6d-90c1-e0abb0c3d297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:41.931928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f61398-30c9-4d6d-90c1-e0abb0c3d297 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:41.932216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f61398-30c9-4d6d-90c1-e0abb0c3d297 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:41.932520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f61398-30c9-4d6d-90c1-e0abb0c3d297 admin admin] PATH_INFO: `/v3/projects/67c409151d55472585a59864371d0f8b/users/359efc4858f94ffcbf5c2ffc61659e7a/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:41.949112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f61398-30c9-4d6d-90c1-e0abb0c3d297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c409151d55472585a59864371d0f8b, user_id=359efc4858f94ffcbf5c2ffc61659e7a, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:41.951880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f61398-30c9-4d6d-90c1-e0abb0c3d297 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:41.965589 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4002/8018] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:41 2022] PUT /identity/v3/projects/67c409151d55472585a59864371d0f8b/users/359efc4858f94ffcbf5c2ffc61659e7a/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:25:41.969966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffcee8-9d3f-4d66-82c3-441d6ebfd2b9 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:41.981297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffcee8-9d3f-4d66-82c3-441d6ebfd2b9 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:42.022344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:42.042488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75146af8-fca9-4b87-9ac4-c736545da53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:42.043125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146af8-fca9-4b87-9ac4-c736545da53a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:42.043404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146af8-fca9-4b87-9ac4-c736545da53a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:42.043679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146af8-fca9-4b87-9ac4-c736545da53a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:42.044324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75146af8-fca9-4b87-9ac4-c736545da53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:42.046012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75146af8-fca9-4b87-9ac4-c736545da53a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:42.060518 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4017/8019] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:25:42.061819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f61398-30c9-4d6d-90c1-e0abb0c3d297 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:42.073442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f61398-30c9-4d6d-90c1-e0abb0c3d297 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:42.078631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef89a24-d977-43d9-9180-c5f945276cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:42.079326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef89a24-d977-43d9-9180-c5f945276cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:42.079611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef89a24-d977-43d9-9180-c5f945276cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:42.080320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef89a24-d977-43d9-9180-c5f945276cb6 admin admin] PATH_INFO: `/v3/projects/67c409151d55472585a59864371d0f8b/users/359efc4858f94ffcbf5c2ffc61659e7a/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:42.081956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef89a24-d977-43d9-9180-c5f945276cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c409151d55472585a59864371d0f8b, user_id=359efc4858f94ffcbf5c2ffc61659e7a, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:42.084743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef89a24-d977-43d9-9180-c5f945276cb6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:42.095778 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4003/8020] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:42 2022] PUT /identity/v3/projects/67c409151d55472585a59864371d0f8b/users/359efc4858f94ffcbf5c2ffc61659e7a/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:42.107529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0932e-cd89-4e97-8470-43b3eff63782 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:42.108054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0932e-cd89-4e97-8470-43b3eff63782 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:42.108329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0932e-cd89-4e97-8470-43b3eff63782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:42.138090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5ac0932e-cd89-4e97-8470-43b3eff63782 None None] MFA Rules not processed for user `359efc4858f94ffcbf5c2ffc61659e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:42.139465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5ac0932e-cd89-4e97-8470-43b3eff63782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:42.211097 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4018/8021] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:42.216083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef89a24-d977-43d9-9180-c5f945276cb6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:42.226890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef89a24-d977-43d9-9180-c5f945276cb6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:42.231784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1dba-4807-4b9f-bea7-9556808ce3b1 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359efc4858f94ffcbf5c2ffc61659e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c409151d55472585a59864371d0f8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:42.232387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1dba-4807-4b9f-bea7-9556808ce3b1 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:42.232670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1dba-4807-4b9f-bea7-9556808ce3b1 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:42.232975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1dba-4807-4b9f-bea7-9556808ce3b1 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:42.233660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b1dba-4807-4b9f-bea7-9556808ce3b1 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:42.235232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b1dba-4807-4b9f-bea7-9556808ce3b1 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:42.255914 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4004/8022] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:25:42 2022] POST /identity/v3/domains => generated 245 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:42.257931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0932e-cd89-4e97-8470-43b3eff63782 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:42.267582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0932e-cd89-4e97-8470-43b3eff63782 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:42.330924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a850a-85cb-4d37-b3b8-791e567f7d69 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359efc4858f94ffcbf5c2ffc61659e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c409151d55472585a59864371d0f8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:42.331457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a850a-85cb-4d37-b3b8-791e567f7d69 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:42.331761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a850a-85cb-4d37-b3b8-791e567f7d69 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:42.332043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a850a-85cb-4d37-b3b8-791e567f7d69 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:42.332678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a850a-85cb-4d37-b3b8-791e567f7d69 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:42.334615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a850a-85cb-4d37-b3b8-791e567f7d69 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:42.374388 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4019/8023] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:42 2022] POST /identity/v3/projects => generated 409 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:42.378718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1dba-4807-4b9f-bea7-9556808ce3b1 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:42.389458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1dba-4807-4b9f-bea7-9556808ce3b1 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:42.452638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc98ac-1176-4762-9e7f-9c301f0a038e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359efc4858f94ffcbf5c2ffc61659e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c409151d55472585a59864371d0f8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:42.453442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc98ac-1176-4762-9e7f-9c301f0a038e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:42.453730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc98ac-1176-4762-9e7f-9c301f0a038e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:42.454450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc98ac-1176-4762-9e7f-9c301f0a038e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:42.455213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc98ac-1176-4762-9e7f-9c301f0a038e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:42.460627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc98ac-1176-4762-9e7f-9c301f0a038e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:42.485691 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4005/8024] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:42 2022] POST /identity/v3/users => generated 347 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:42.492402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a850a-85cb-4d37-b3b8-791e567f7d69 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:42.504201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a850a-85cb-4d37-b3b8-791e567f7d69 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:42.510140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ef32c-3d1d-45b1-a4a4-bef89719a340 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359efc4858f94ffcbf5c2ffc61659e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c409151d55472585a59864371d0f8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:42.510761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ef32c-3d1d-45b1-a4a4-bef89719a340 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:42.511141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ef32c-3d1d-45b1-a4a4-bef89719a340 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:42.511436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ef32c-3d1d-45b1-a4a4-bef89719a340 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:42.516347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ef32c-3d1d-45b1-a4a4-bef89719a340 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:42.518201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ef32c-3d1d-45b1-a4a4-bef89719a340 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:42.530336 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4020/8025] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:42.534792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc98ac-1176-4762-9e7f-9c301f0a038e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:42.546385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc98ac-1176-4762-9e7f-9c301f0a038e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:42.551226 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9061b3d-31a5-4315-804d-bc54cb3ce4bb tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359efc4858f94ffcbf5c2ffc61659e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c409151d55472585a59864371d0f8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:42.551875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9061b3d-31a5-4315-804d-bc54cb3ce4bb tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:42.552159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9061b3d-31a5-4315-804d-bc54cb3ce4bb tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:42.552431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9061b3d-31a5-4315-804d-bc54cb3ce4bb tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] PATH_INFO: `/v3/projects/66e1de4d44304924b41a985e363aeeb7/users/49054fecc52d4150aaff26a0052a7a15/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:42.571381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9061b3d-31a5-4315-804d-bc54cb3ce4bb tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorizing `identity:create_grant(project_id=66e1de4d44304924b41a985e363aeeb7, user_id=49054fecc52d4150aaff26a0052a7a15, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:42.574240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9061b3d-31a5-4315-804d-bc54cb3ce4bb tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:42.590854 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4006/8026] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:42 2022] PUT /identity/v3/projects/66e1de4d44304924b41a985e363aeeb7/users/49054fecc52d4150aaff26a0052a7a15/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:42.595094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ba2d0-28b5-4bf0-b9e5-efacd922cab5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:42.595297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ba2d0-28b5-4bf0-b9e5-efacd922cab5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:42.595576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ba2d0-28b5-4bf0-b9e5-efacd922cab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:42.647485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:42.706489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-329ba2d0-28b5-4bf0-b9e5-efacd922cab5 None None] MFA Rules not processed for user `49054fecc52d4150aaff26a0052a7a15`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:42.707734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-329ba2d0-28b5-4bf0-b9e5-efacd922cab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:42.724130 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4021/8027] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3360 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:42.735708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032e633-9fe6-4353-a553-8a2c1acbdfd5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:42.736079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032e633-9fe6-4353-a553-8a2c1acbdfd5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:42.736524 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032e633-9fe6-4353-a553-8a2c1acbdfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:42.758271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5032e633-9fe6-4353-a553-8a2c1acbdfd5 None None] MFA Rules not processed for user `49054fecc52d4150aaff26a0052a7a15`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:42.759475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5032e633-9fe6-4353-a553-8a2c1acbdfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:42.766589 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4007/8028] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3360 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:42.770962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ba2d0-28b5-4bf0-b9e5-efacd922cab5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:42.780898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ba2d0-28b5-4bf0-b9e5-efacd922cab5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:42.785703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfd4b7-58d5-40a8-8fe1-a76d58d0105a tempest-test_project-1225407374 tempest-user-926753342] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49054fecc52d4150aaff26a0052a7a15', 'user_domain_id': '4643156afe8f4c16a86dd780095921c6', 'system_scope': None, 'project_id': '66e1de4d44304924b41a985e363aeeb7', 'project_domain_id': '4643156afe8f4c16a86dd780095921c6', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:42.786306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfd4b7-58d5-40a8-8fe1-a76d58d0105a tempest-test_project-1225407374 tempest-user-926753342] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:42.786618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfd4b7-58d5-40a8-8fe1-a76d58d0105a tempest-test_project-1225407374 tempest-user-926753342] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:42.786892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfd4b7-58d5-40a8-8fe1-a76d58d0105a tempest-test_project-1225407374 tempest-user-926753342] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:42.795866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfd4b7-58d5-40a8-8fe1-a76d58d0105a tempest-test_project-1225407374 tempest-user-926753342] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:42.797650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfd4b7-58d5-40a8-8fe1-a76d58d0105a tempest-test_project-1225407374 tempest-user-926753342] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:42.807474 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4022/8029] 10.222.0.26 () {56 vars in 1284 bytes} [Sat Oct 8 21:25:42 2022] GET /identity/v3/auth/tokens => generated 3360 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:25:42.811949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032e633-9fe6-4353-a553-8a2c1acbdfd5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:42.878663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032e633-9fe6-4353-a553-8a2c1acbdfd5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:42.884266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359efc4858f94ffcbf5c2ffc61659e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c409151d55472585a59864371d0f8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:42.884916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:42.885206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:42.885496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] PATH_INFO: `/v3/users/49054fecc52d4150aaff26a0052a7a15` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:42.886722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorizing `identity:delete_user(user_id=49054fecc52d4150aaff26a0052a7a15)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:42.889975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:42.904677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:42.947208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49054fecc52d4150aaff26a0052a7a15'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:42.956308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49054fecc52d4150aaff26a0052a7a15'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:42.957069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49054fecc52d4150aaff26a0052a7a15'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:42.957751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49054fecc52d4150aaff26a0052a7a15'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:42.971887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49054fecc52d4150aaff26a0052a7a15'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:42.985668 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4008/8030] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:42 2022] DELETE /identity/v3/users/49054fecc52d4150aaff26a0052a7a15 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:42.989897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfd4b7-58d5-40a8-8fe1-a76d58d0105a tempest-test_project-1225407374 tempest-user-926753342] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:43.000533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfd4b7-58d5-40a8-8fe1-a76d58d0105a tempest-test_project-1225407374 tempest-user-926753342] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:43.056344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359efc4858f94ffcbf5c2ffc61659e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c409151d55472585a59864371d0f8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:43.056971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:43.057283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:43.057559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] PATH_INFO: `/v3/projects/66e1de4d44304924b41a985e363aeeb7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:43.058660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorizing `identity:delete_project(project_id=66e1de4d44304924b41a985e363aeeb7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:43.060538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:43.107117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e1de4d44304924b41a985e363aeeb7', 'request_id': 'req-8fb27b8e-db36-4978-8770-cc6b58ecc24f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.114116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e1de4d44304924b41a985e363aeeb7', 'request_id': 'req-8fb27b8e-db36-4978-8770-cc6b58ecc24f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.119771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e1de4d44304924b41a985e363aeeb7', 'request_id': 'req-8fb27b8e-db36-4978-8770-cc6b58ecc24f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.130797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] The token cache is being invalidate because project 66e1de4d44304924b41a985e363aeeb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:43.131030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.132233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.133994 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4023/8031] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:42 2022] DELETE /identity/v3/projects/66e1de4d44304924b41a985e363aeeb7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:43.137935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:43.139324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:43.153353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3e467-acfb-44e9-9670-85e8ecc1f7a9 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:43.210284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f89af1-ea02-4789-8622-cc936baba56e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359efc4858f94ffcbf5c2ffc61659e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c409151d55472585a59864371d0f8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:43.210926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f89af1-ea02-4789-8622-cc936baba56e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:43.211207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f89af1-ea02-4789-8622-cc936baba56e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:43.211479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f89af1-ea02-4789-8622-cc936baba56e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] PATH_INFO: `/v3/domains/4643156afe8f4c16a86dd780095921c6` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:43.212714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f89af1-ea02-4789-8622-cc936baba56e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4643156afe8f4c16a86dd780095921c6)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:43.214335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f89af1-ea02-4789-8622-cc936baba56e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:43.235728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-44f89af1-ea02-4789-8622-cc936baba56e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4643156afe8f4c16a86dd780095921c6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.236404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-44f89af1-ea02-4789-8622-cc936baba56e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4643156afe8f4c16a86dd780095921c6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.260792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-44f89af1-ea02-4789-8622-cc936baba56e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4643156afe8f4c16a86dd780095921c6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.261469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-44f89af1-ea02-4789-8622-cc936baba56e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4643156afe8f4c16a86dd780095921c6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.266825 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4009/8032] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:25:43 2022] PATCH /identity/v3/domains/4643156afe8f4c16a86dd780095921c6 => generated 246 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:43.268972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:43.270522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:43.283640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb27b8e-db36-4978-8770-cc6b58ecc24f tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:43.296251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:43.342095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359efc4858f94ffcbf5c2ffc61659e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c409151d55472585a59864371d0f8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:43.342722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:43.343003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:43.343273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] PATH_INFO: `/v3/domains/4643156afe8f4c16a86dd780095921c6` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:43.353534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4643156afe8f4c16a86dd780095921c6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:43.355212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:43.377711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4643156afe8f4c16a86dd780095921c6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.388375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4643156afe8f4c16a86dd780095921c6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.426455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4643156afe8f4c16a86dd780095921c6', 'request_id': 'req-b7dd3c24-4668-4511-8185-97ed9d3f8f84'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.433701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4643156afe8f4c16a86dd780095921c6', 'request_id': 'req-b7dd3c24-4668-4511-8185-97ed9d3f8f84'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.439203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4643156afe8f4c16a86dd780095921c6', 'request_id': 'req-b7dd3c24-4668-4511-8185-97ed9d3f8f84'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.451269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] The token cache is being invalidate because project 4643156afe8f4c16a86dd780095921c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:43.451558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.452234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.459936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4643156afe8f4c16a86dd780095921c6', 'request_id': 'req-b7dd3c24-4668-4511-8185-97ed9d3f8f84'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.461237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4643156afe8f4c16a86dd780095921c6', 'request_id': 'req-b7dd3c24-4668-4511-8185-97ed9d3f8f84'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.464491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b7dd3c24-4668-4511-8185-97ed9d3f8f84 tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4643156afe8f4c16a86dd780095921c6', 'request_id': 'req-b7dd3c24-4668-4511-8185-97ed9d3f8f84'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.470670 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4024/8033] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:25:43 2022] DELETE /identity/v3/domains/4643156afe8f4c16a86dd780095921c6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:43.478312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f89af1-ea02-4789-8622-cc936baba56e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:43.479700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-44f89af1-ea02-4789-8622-cc936baba56e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:43.540494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:43.544712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f89af1-ea02-4789-8622-cc936baba56e tempest-TestDefaultProjectId-1470962479 tempest-TestDefaultProjectId-1470962479-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:43.601991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:43.602623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:43.602906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:43.603180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] PATH_INFO: `/v3/users/76dfeb57657e4b0781af98c331691efd` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:43.604305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=76dfeb57657e4b0781af98c331691efd)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:43.606541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:43.654016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76dfeb57657e4b0781af98c331691efd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.661136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76dfeb57657e4b0781af98c331691efd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.661848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76dfeb57657e4b0781af98c331691efd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.662453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76dfeb57657e4b0781af98c331691efd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.674983 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76dfeb57657e4b0781af98c331691efd'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:43.688328 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4010/8034] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:43 2022] DELETE /identity/v3/users/76dfeb57657e4b0781af98c331691efd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:43.692923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4520a7-df48-4df2-a8b1-c6ee52665f2c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:43.693452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4520a7-df48-4df2-a8b1-c6ee52665f2c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:43.693584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4520a7-df48-4df2-a8b1-c6ee52665f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:43.713548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ec4520a7-df48-4df2-a8b1-c6ee52665f2c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:43.714757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ec4520a7-df48-4df2-a8b1-c6ee52665f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:43.763437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:43.777962 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4025/8035] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:43.787722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:43.789288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:43.861379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640a167-0d7d-4387-8cd5-895976cac3ba admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:43.865179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bee5c-da59-4b43-a57c-ae1494096e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:43.865816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bee5c-da59-4b43-a57c-ae1494096e9e service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:43.866099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bee5c-da59-4b43-a57c-ae1494096e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:43.866371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bee5c-da59-4b43-a57c-ae1494096e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:43.876180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bee5c-da59-4b43-a57c-ae1494096e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:43.877638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bee5c-da59-4b43-a57c-ae1494096e9e service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:43.887734 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4011/8036] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:25:44.174938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4520a7-df48-4df2-a8b1-c6ee52665f2c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:44.176457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ec4520a7-df48-4df2-a8b1-c6ee52665f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:44.188921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4520a7-df48-4df2-a8b1-c6ee52665f2c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:44.195692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:44.196567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:44.196702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:44.196862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] PATH_INFO: `/v3/projects/f7c2bb38ef71450cbfec30c890eb2bce` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:44.198045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c2bb38ef71450cbfec30c890eb2bce)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:44.199962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:44.257066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c2bb38ef71450cbfec30c890eb2bce', 'request_id': 'req-1a15b895-15e8-48ed-b203-09ba01b758b3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:44.265982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c2bb38ef71450cbfec30c890eb2bce', 'request_id': 'req-1a15b895-15e8-48ed-b203-09ba01b758b3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:44.274876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c2bb38ef71450cbfec30c890eb2bce', 'request_id': 'req-1a15b895-15e8-48ed-b203-09ba01b758b3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:44.289682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] The token cache is being invalidate because project f7c2bb38ef71450cbfec30c890eb2bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:44.290067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:44.290716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:44.292250 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4026/8037] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:44 2022] DELETE /identity/v3/projects/f7c2bb38ef71450cbfec30c890eb2bce => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:44.296307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bee5c-da59-4b43-a57c-ae1494096e9e service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:44.307622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bee5c-da59-4b43-a57c-ae1494096e9e service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:44.352035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:44.396917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e76d9-6c0f-438e-b215-de95ffc0b2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:44.397684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e76d9-6c0f-438e-b215-de95ffc0b2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:44.398582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e76d9-6c0f-438e-b215-de95ffc0b2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:44.398920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e76d9-6c0f-438e-b215-de95ffc0b2a5 admin admin] PATH_INFO: `/v3/users/359efc4858f94ffcbf5c2ffc61659e7a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:44.400123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e76d9-6c0f-438e-b215-de95ffc0b2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359efc4858f94ffcbf5c2ffc61659e7a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:44.402176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e76d9-6c0f-438e-b215-de95ffc0b2a5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:44.451544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a34e76d9-6c0f-438e-b215-de95ffc0b2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359efc4858f94ffcbf5c2ffc61659e7a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:44.459160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a34e76d9-6c0f-438e-b215-de95ffc0b2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359efc4858f94ffcbf5c2ffc61659e7a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:44.459852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a34e76d9-6c0f-438e-b215-de95ffc0b2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359efc4858f94ffcbf5c2ffc61659e7a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:44.461106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a34e76d9-6c0f-438e-b215-de95ffc0b2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359efc4858f94ffcbf5c2ffc61659e7a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:44.480315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a34e76d9-6c0f-438e-b215-de95ffc0b2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359efc4858f94ffcbf5c2ffc61659e7a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:44.500778 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4012/8038] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:44 2022] DELETE /identity/v3/users/359efc4858f94ffcbf5c2ffc61659e7a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:45.140872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:45.143506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:45.159404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15b895-15e8-48ed-b203-09ba01b758b3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:45.259191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:45.259861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:45.260831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:45.260831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0 admin admin] PATH_INFO: `/v3/projects/67c409151d55472585a59864371d0f8b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:45.261783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c409151d55472585a59864371d0f8b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:45.264358 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:45.326626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c409151d55472585a59864371d0f8b', 'request_id': 'req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:45.342078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c409151d55472585a59864371d0f8b', 'request_id': 'req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:45.350679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c409151d55472585a59864371d0f8b', 'request_id': 'req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:45.365781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0 admin admin] The token cache is being invalidate because project 67c409151d55472585a59864371d0f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:45.366106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:45.366834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aecf7bd6-4178-4b28-8f59-41f32b5b02b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:45.373281 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4027/8039] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:45 2022] DELETE /identity/v3/projects/67c409151d55472585a59864371d0f8b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:45.373789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df693e-ddba-42ed-a023-77d113d49c85 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:45.374261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df693e-ddba-42ed-a023-77d113d49c85 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:45.374336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df693e-ddba-42ed-a023-77d113d49c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:45.401639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b0df693e-ddba-42ed-a023-77d113d49c85 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:45.403742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b0df693e-ddba-42ed-a023-77d113d49c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:45.482874 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4013/8040] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:45.489699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0418-30fa-415a-869f-e71438fed0d5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:45.490099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0418-30fa-415a-869f-e71438fed0d5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:45.490556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0418-30fa-415a-869f-e71438fed0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:45.505683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:45.512015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6c7b0418-30fa-415a-869f-e71438fed0d5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:45.513989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6c7b0418-30fa-415a-869f-e71438fed0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:45.524884 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4028/8041] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:45.529439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df693e-ddba-42ed-a023-77d113d49c85 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:45.541887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df693e-ddba-42ed-a023-77d113d49c85 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:45.547172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776966f6-959d-49e7-a1b6-55ccdd5dc6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:45.547829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776966f6-959d-49e7-a1b6-55ccdd5dc6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:45.548055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776966f6-959d-49e7-a1b6-55ccdd5dc6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:45.548327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776966f6-959d-49e7-a1b6-55ccdd5dc6e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:45.548978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776966f6-959d-49e7-a1b6-55ccdd5dc6e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:25:45.549314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776966f6-959d-49e7-a1b6-55ccdd5dc6e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:45.551087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776966f6-959d-49e7-a1b6-55ccdd5dc6e7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:45.565026 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4014/8042] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:45.569279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0418-30fa-415a-869f-e71438fed0d5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:45.579343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0418-30fa-415a-869f-e71438fed0d5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:45.584698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cab79-a018-4e57-818e-f24b7ce7e688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:45.585976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cab79-a018-4e57-818e-f24b7ce7e688 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:45.587167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cab79-a018-4e57-818e-f24b7ce7e688 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:45.588075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cab79-a018-4e57-818e-f24b7ce7e688 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:45.588814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cab79-a018-4e57-818e-f24b7ce7e688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:45.590978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cab79-a018-4e57-818e-f24b7ce7e688 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:45.628284 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4029/8043] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:45 2022] POST /identity/v3/projects => generated 397 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:45.629545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776966f6-959d-49e7-a1b6-55ccdd5dc6e7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:45.644468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776966f6-959d-49e7-a1b6-55ccdd5dc6e7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:45.698211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:45.717068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb9db2-520f-4dbd-8902-877a8cb6374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:45.717753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb9db2-520f-4dbd-8902-877a8cb6374b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:45.718106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb9db2-520f-4dbd-8902-877a8cb6374b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:45.718449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb9db2-520f-4dbd-8902-877a8cb6374b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:45.719111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb9db2-520f-4dbd-8902-877a8cb6374b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:45.721008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb9db2-520f-4dbd-8902-877a8cb6374b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:45.744773 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4015/8044] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:45 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:45.748874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cab79-a018-4e57-818e-f24b7ce7e688 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:45.761679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cab79-a018-4e57-818e-f24b7ce7e688 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:45.766790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab2394-84cd-4f32-b34f-85a25f834c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:45.767452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab2394-84cd-4f32-b34f-85a25f834c51 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:45.768184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab2394-84cd-4f32-b34f-85a25f834c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:45.768659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab2394-84cd-4f32-b34f-85a25f834c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:45.769476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab2394-84cd-4f32-b34f-85a25f834c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:45.771336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab2394-84cd-4f32-b34f-85a25f834c51 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:45.785304 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4030/8045] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:25:45.787318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb9db2-520f-4dbd-8902-877a8cb6374b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:45.798657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb9db2-520f-4dbd-8902-877a8cb6374b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:45.803503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076b506-14bd-40c6-ab40-d3d13687456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:45.804177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076b506-14bd-40c6-ab40-d3d13687456b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:45.804471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076b506-14bd-40c6-ab40-d3d13687456b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:45.804741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076b506-14bd-40c6-ab40-d3d13687456b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:45.805438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076b506-14bd-40c6-ab40-d3d13687456b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:45.807023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076b506-14bd-40c6-ab40-d3d13687456b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:45.817945 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4016/8046] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:45.822771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab2394-84cd-4f32-b34f-85a25f834c51 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:45.833080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab2394-84cd-4f32-b34f-85a25f834c51 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:45.838361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1c0eb-ecef-465e-81cd-0663867e3160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:45.839026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1c0eb-ecef-465e-81cd-0663867e3160 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:45.839421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1c0eb-ecef-465e-81cd-0663867e3160 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:45.839700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1c0eb-ecef-465e-81cd-0663867e3160 admin admin] PATH_INFO: `/v3/projects/3fce20dc8a40418f9382257fc61fb960/users/391253c4ae3c414188f39294e9d1b24c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:45.855029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1c0eb-ecef-465e-81cd-0663867e3160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fce20dc8a40418f9382257fc61fb960, user_id=391253c4ae3c414188f39294e9d1b24c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:45.857954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1c0eb-ecef-465e-81cd-0663867e3160 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:45.871996 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4031/8047] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:45 2022] PUT /identity/v3/projects/3fce20dc8a40418f9382257fc61fb960/users/391253c4ae3c414188f39294e9d1b24c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:45.882738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5e65e-1c65-4ff3-aea5-295e9d9443ca None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:45.883020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5e65e-1c65-4ff3-aea5-295e9d9443ca None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:45.883290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5e65e-1c65-4ff3-aea5-295e9d9443ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:45.911873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7db5e65e-1c65-4ff3-aea5-295e9d9443ca None None] MFA Rules not processed for user `391253c4ae3c414188f39294e9d1b24c`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:45.913110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7db5e65e-1c65-4ff3-aea5-295e9d9443ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:45.988456 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4017/8048] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:45.993558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1c0eb-ecef-465e-81cd-0663867e3160 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:46.056380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1c0eb-ecef-465e-81cd-0663867e3160 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:46.061088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946da378-6fa1-4068-899e-df606ba1057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:46.061722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946da378-6fa1-4068-899e-df606ba1057e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.062000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946da378-6fa1-4068-899e-df606ba1057e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.062274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946da378-6fa1-4068-899e-df606ba1057e admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.062894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946da378-6fa1-4068-899e-df606ba1057e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:46.064793 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946da378-6fa1-4068-899e-df606ba1057e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:46.094491 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4032/8049] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:45 2022] POST /identity/v3/projects => generated 395 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:46.095631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5e65e-1c65-4ff3-aea5-295e9d9443ca None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:46.107123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5e65e-1c65-4ff3-aea5-295e9d9443ca None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:46.165784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33ca7a-586b-43be-a58e-75e2296a0c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:46.166539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ca7a-586b-43be-a58e-75e2296a0c70 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.166815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ca7a-586b-43be-a58e-75e2296a0c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.167196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ca7a-586b-43be-a58e-75e2296a0c70 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.167830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33ca7a-586b-43be-a58e-75e2296a0c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:46.169855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33ca7a-586b-43be-a58e-75e2296a0c70 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:46.193259 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4018/8050] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:46 2022] POST /identity/v3/users => generated 304 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:46.196425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946da378-6fa1-4068-899e-df606ba1057e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:46.207036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946da378-6fa1-4068-899e-df606ba1057e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:46.211914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0a539-b359-4e89-9d07-45029d947162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:46.212516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0a539-b359-4e89-9d07-45029d947162 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.213306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0a539-b359-4e89-9d07-45029d947162 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.213306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0a539-b359-4e89-9d07-45029d947162 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.213860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0a539-b359-4e89-9d07-45029d947162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:46.215464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0a539-b359-4e89-9d07-45029d947162 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:46.226558 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4033/8051] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:46.230865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33ca7a-586b-43be-a58e-75e2296a0c70 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:46.241461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33ca7a-586b-43be-a58e-75e2296a0c70 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:46.246807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be13b63-aa08-42ea-8fdc-68db16dc2ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:46.247471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be13b63-aa08-42ea-8fdc-68db16dc2ade admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.247752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be13b63-aa08-42ea-8fdc-68db16dc2ade admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.248030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be13b63-aa08-42ea-8fdc-68db16dc2ade admin admin] PATH_INFO: `/v3/projects/6f2fea251669405ba3263f309ffc979f/users/7684e3aa1a964d85bb4e9a41e766342c/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.263907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be13b63-aa08-42ea-8fdc-68db16dc2ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2fea251669405ba3263f309ffc979f, user_id=7684e3aa1a964d85bb4e9a41e766342c, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:46.266687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be13b63-aa08-42ea-8fdc-68db16dc2ade admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:46.279898 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4019/8052] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:46 2022] PUT /identity/v3/projects/6f2fea251669405ba3263f309ffc979f/users/7684e3aa1a964d85bb4e9a41e766342c/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:25:46.284006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0a539-b359-4e89-9d07-45029d947162 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:46.295529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0a539-b359-4e89-9d07-45029d947162 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:46.354449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91765cf6-3723-46f4-9ca2-b458a967fbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:46.355324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91765cf6-3723-46f4-9ca2-b458a967fbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.355883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91765cf6-3723-46f4-9ca2-b458a967fbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.356686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91765cf6-3723-46f4-9ca2-b458a967fbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.357380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91765cf6-3723-46f4-9ca2-b458a967fbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:46.359053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91765cf6-3723-46f4-9ca2-b458a967fbb8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:46.371881 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4034/8053] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:46.376005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be13b63-aa08-42ea-8fdc-68db16dc2ade admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:46.388472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be13b63-aa08-42ea-8fdc-68db16dc2ade admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:46.393176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb25aa-0248-41cd-bfa3-fc944d4fe4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:46.393985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb25aa-0248-41cd-bfa3-fc944d4fe4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.394325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb25aa-0248-41cd-bfa3-fc944d4fe4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.394605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb25aa-0248-41cd-bfa3-fc944d4fe4ab admin admin] PATH_INFO: `/v3/projects/6f2fea251669405ba3263f309ffc979f/users/7684e3aa1a964d85bb4e9a41e766342c/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.396555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb25aa-0248-41cd-bfa3-fc944d4fe4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2fea251669405ba3263f309ffc979f, user_id=7684e3aa1a964d85bb4e9a41e766342c, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:46.399279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb25aa-0248-41cd-bfa3-fc944d4fe4ab admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:46.401550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:46.411304 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4020/8054] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:46 2022] PUT /identity/v3/projects/6f2fea251669405ba3263f309ffc979f/users/7684e3aa1a964d85bb4e9a41e766342c/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:46.422975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c671fca-3a81-46c2-b01d-1de61a62622b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.423270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c671fca-3a81-46c2-b01d-1de61a62622b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.423573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c671fca-3a81-46c2-b01d-1de61a62622b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.449402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:46.452639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6c671fca-3a81-46c2-b01d-1de61a62622b None None] MFA Rules not processed for user `7684e3aa1a964d85bb4e9a41e766342c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:46.454699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6c671fca-3a81-46c2-b01d-1de61a62622b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:46.526055 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4035/8055] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:46.530900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb25aa-0248-41cd-bfa3-fc944d4fe4ab admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:46.591372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb25aa-0248-41cd-bfa3-fc944d4fe4ab admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:46.595712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b20d7a-1392-416e-a35b-4ee79e8edc97 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '391253c4ae3c414188f39294e9d1b24c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fce20dc8a40418f9382257fc61fb960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:46.596319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b20d7a-1392-416e-a35b-4ee79e8edc97 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.596595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b20d7a-1392-416e-a35b-4ee79e8edc97 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.596864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b20d7a-1392-416e-a35b-4ee79e8edc97 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.597521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b20d7a-1392-416e-a35b-4ee79e8edc97 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-d5b20d7a-1392-416e-a35b-4ee79e8edc97 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 08 21:25:46.603580 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 08 21:25:46.604492 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 08 21:25:46.604492 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 08 21:25:46.604492 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 08 21:25:46.604492 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 08 21:25:46.604492 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 21:25:46.604492 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 08 21:25:46.604492 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 08 21:25:46.604492 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.604957 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4021/8056] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:25:46 2022] POST /identity/v3/projects => generated 136 bytes in 74 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:25:46.610049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c671fca-3a81-46c2-b01d-1de61a62622b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:46.620148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c671fca-3a81-46c2-b01d-1de61a62622b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:46.624963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87917d84-6c1f-469c-848d-025d34dab168 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7684e3aa1a964d85bb4e9a41e766342c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2fea251669405ba3263f309ffc979f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:46.625606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87917d84-6c1f-469c-848d-025d34dab168 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.625890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87917d84-6c1f-469c-848d-025d34dab168 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.626167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87917d84-6c1f-469c-848d-025d34dab168 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.626782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87917d84-6c1f-469c-848d-025d34dab168 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:46.628646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87917d84-6c1f-469c-848d-025d34dab168 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-87917d84-6c1f-469c-848d-025d34dab168 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Invalid input for field 'name': '' is too short Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: Failed validating 'minLength' in schema['properties']['name']: Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: On instance['name']: Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: Failed validating 'minLength' in schema['properties']['name']: Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: On instance['name']: Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: '' Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise error Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application On instance['name']: Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application '' Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:46.635485 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 08 21:25:46.636818 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 08 21:25:46.637689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 08 21:25:46.637689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 08 21:25:46.637689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:46.637689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 08 21:25:46.637689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:25:46.637689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:46.637689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application On instance['name']: Oct 08 21:25:46.637689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application '' Oct 08 21:25:46.637689 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:46.637689 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4036/8057] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:25:46 2022] POST /identity/v3/projects => generated 283 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 08 21:25:46.641927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b20d7a-1392-416e-a35b-4ee79e8edc97 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:46.656240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b20d7a-1392-416e-a35b-4ee79e8edc97 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:46.660816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc1c6c-7b70-4662-9e72-99431cc733f8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7684e3aa1a964d85bb4e9a41e766342c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2fea251669405ba3263f309ffc979f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:46.661452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc1c6c-7b70-4662-9e72-99431cc733f8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.661738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc1c6c-7b70-4662-9e72-99431cc733f8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.662016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc1c6c-7b70-4662-9e72-99431cc733f8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.662679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc1c6c-7b70-4662-9e72-99431cc733f8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:46.665168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc1c6c-7b70-4662-9e72-99431cc733f8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-53dc1c6c-7b70-4662-9e72-99431cc733f8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: Failed validating 'maxLength' in schema['properties']['name']: Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: On instance['name']: Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: Failed validating 'maxLength' in schema['properties']['name']: Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: On instance['name']: Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise error Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 08 21:25:46.672344 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application On instance['name']: Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:25:46.673516 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application On instance['name']: Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.674787 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4022/8058] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:25:46 2022] POST /identity/v3/projects => generated 412 bytes in 32 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 08 21:25:46.678529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87917d84-6c1f-469c-848d-025d34dab168 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:46.690568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87917d84-6c1f-469c-848d-025d34dab168 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:46.695122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de474d-be2d-4174-adba-12e9cd3e11ee tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7684e3aa1a964d85bb4e9a41e766342c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2fea251669405ba3263f309ffc979f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:46.695723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de474d-be2d-4174-adba-12e9cd3e11ee tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.696001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de474d-be2d-4174-adba-12e9cd3e11ee tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.696275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de474d-be2d-4174-adba-12e9cd3e11ee tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] PATH_INFO: `/v3/projects/946b6cb1650345ceb8fae14f37c9942a` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.703068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de474d-be2d-4174-adba-12e9cd3e11ee tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=946b6cb1650345ceb8fae14f37c9942a)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:46.704936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de474d-be2d-4174-adba-12e9cd3e11ee tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-f7de474d-be2d-4174-adba-12e9cd3e11ee tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Could not find project: 946b6cb1650345ceb8fae14f37c9942a.: keystone.exception.ProjectNotFound: Could not find project: 946b6cb1650345ceb8fae14f37c9942a. Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 08 21:25:46.715822 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 08 21:25:46.716588 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:25:46.716588 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:25:46.716588 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 08 21:25:46.716588 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 08 21:25:46.716588 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:25:46.716588 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:25:46.716588 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:25:46.716588 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:25:46.716588 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 946b6cb1650345ceb8fae14f37c9942a. Oct 08 21:25:46.716588 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:46.717286 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4037/8059] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:46 2022] DELETE /identity/v3/projects/946b6cb1650345ceb8fae14f37c9942a => generated 113 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:25:46.721947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc1c6c-7b70-4662-9e72-99431cc733f8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:46.733696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc1c6c-7b70-4662-9e72-99431cc733f8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:46.737925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632d061-11ae-4a35-ba82-ad20693df534 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '391253c4ae3c414188f39294e9d1b24c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fce20dc8a40418f9382257fc61fb960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:46.738531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632d061-11ae-4a35-ba82-ad20693df534 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.738810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632d061-11ae-4a35-ba82-ad20693df534 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.739085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632d061-11ae-4a35-ba82-ad20693df534 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.739722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632d061-11ae-4a35-ba82-ad20693df534 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] RBAC: Authorizing `identity:list_projects()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-8632d061-11ae-4a35-ba82-ad20693df534 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 08 21:25:46.746227 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._list_projects() Oct 08 21:25:46.747157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 08 21:25:46.747157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 08 21:25:46.747157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 08 21:25:46.747157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 08 21:25:46.747157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 08 21:25:46.747157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 08 21:25:46.747157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 21:25:46.747157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 08 21:25:46.747157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 08 21:25:46.747157 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.747658 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4023/8060] 10.222.0.26 () {58 vars in 1131 bytes} [Sat Oct 8 21:25:46 2022] GET /identity/v3/projects => generated 135 bytes in 26 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:25:46.754323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de474d-be2d-4174-adba-12e9cd3e11ee tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:46.765385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de474d-be2d-4174-adba-12e9cd3e11ee tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:46.770108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b0fe4-791e-4f64-a4de-5df49012b7a8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7684e3aa1a964d85bb4e9a41e766342c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2fea251669405ba3263f309ffc979f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:46.770708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b0fe4-791e-4f64-a4de-5df49012b7a8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.770985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b0fe4-791e-4f64-a4de-5df49012b7a8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.771255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b0fe4-791e-4f64-a4de-5df49012b7a8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.771922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b0fe4-791e-4f64-a4de-5df49012b7a8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:46.773935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b0fe4-791e-4f64-a4de-5df49012b7a8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:46.821410 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4038/8061] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:46 2022] POST /identity/v3/projects => generated 357 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:46.822636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632d061-11ae-4a35-ba82-ad20693df534 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:46.836093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632d061-11ae-4a35-ba82-ad20693df534 tempest-ProjectsNegativeStaticTestJSON-1644377838 tempest-ProjectsNegativeStaticTestJSON-1644377838-project] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:46.906485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129a27f-5636-4509-b4c0-d3914185e79d tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7684e3aa1a964d85bb4e9a41e766342c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2fea251669405ba3263f309ffc979f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:46.907101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129a27f-5636-4509-b4c0-d3914185e79d tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:46.907406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129a27f-5636-4509-b4c0-d3914185e79d tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:46.907673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129a27f-5636-4509-b4c0-d3914185e79d tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:46.908285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129a27f-5636-4509-b4c0-d3914185e79d tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:46.910161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129a27f-5636-4509-b4c0-d3914185e79d tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:46.929967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.sql.core [None req-9129a27f-5636-4509-b4c0-d3914185e79d tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-489740334' for key 'project.ixu_project_name_domain_id'") Oct 08 21:25:46.929967 ncdv-master-1 devstack@keystone.service[99085]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 08 21:25:46.929967 ncdv-master-1 devstack@keystone.service[99085]: [parameters: {'id': 'b9392985f9e049a2aab7f59c9e2d5e61', 'name': 'tempest-project-dup-489740334', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 08 21:25:46.929967 ncdv-master-1 devstack@keystone.service[99085]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=99085) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 08 21:25:46.988983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-9129a27f-5636-4509-b4c0-d3914185e79d tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-489740334, project id b9392985f9e049a2aab7f59c9e2d5e61.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-489740334, project id b9392985f9e049a2aab7f59c9e2d5e61. Oct 08 21:25:46.988983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:46.988983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 21:25:46.988983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 21:25:46.988983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 21:25:46.988983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 21:25:46.988983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 21:25:46.988983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 21:25:46.988983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 21:25:46.988983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application conn.query(q) Oct 08 21:25:46.988983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 21:25:46.988983 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application result.read() Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-489740334' for key 'project.ixu_project_name_domain_id'") Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 08 21:25:46.990884 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application next(self.gen) Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application yield resource Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application next(self.gen) Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.session.rollback() Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.force_reraise() Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise self.value Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 08 21:25:46.992512 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application session.commit() Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._prepare_impl() Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.session.flush() Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._flush(objects) Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application compat.raise_( Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application flush_context.execute() Oct 08 21:25:46.994151 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rec.execute(self) Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 08 21:25:46.995883 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application conn.query(q) Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application result.read() Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 21:25:46.997367 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-489740334' for key 'project.ixu_project_name_domain_id'") Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [parameters: {'id': 'b9392985f9e049a2aab7f59c9e2d5e61', 'name': 'tempest-project-dup-489740334', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:46.998410 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-489740334 at domain ID default. Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:25:46.999638 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:25:47.001214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:25:47.001214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 08 21:25:47.001214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 08 21:25:47.001214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:25:47.001214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:25:47.001214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 08 21:25:47.001214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 08 21:25:47.001214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-489740334, project id b9392985f9e049a2aab7f59c9e2d5e61. Oct 08 21:25:47.001214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:47.001214 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4024/8062] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:25:46 2022] POST /identity/v3/projects => generated 284 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 08 21:25:47.001978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b0fe4-791e-4f64-a4de-5df49012b7a8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:47.009775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b0fe4-791e-4f64-a4de-5df49012b7a8 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:47.014457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab28d3-8c7d-470f-8284-c10e94ed1351 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7684e3aa1a964d85bb4e9a41e766342c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2fea251669405ba3263f309ffc979f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:47.015087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab28d3-8c7d-470f-8284-c10e94ed1351 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:47.015676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab28d3-8c7d-470f-8284-c10e94ed1351 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:47.015676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab28d3-8c7d-470f-8284-c10e94ed1351 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] PATH_INFO: `/v3/projects/b4173f437ac74b05bab0aef8b0dbde2b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:47.017106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab28d3-8c7d-470f-8284-c10e94ed1351 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b4173f437ac74b05bab0aef8b0dbde2b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:47.020436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab28d3-8c7d-470f-8284-c10e94ed1351 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:47.073766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4eab28d3-8c7d-470f-8284-c10e94ed1351 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4173f437ac74b05bab0aef8b0dbde2b', 'request_id': 'req-4eab28d3-8c7d-470f-8284-c10e94ed1351'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.081834 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4eab28d3-8c7d-470f-8284-c10e94ed1351 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4173f437ac74b05bab0aef8b0dbde2b', 'request_id': 'req-4eab28d3-8c7d-470f-8284-c10e94ed1351'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.087577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4eab28d3-8c7d-470f-8284-c10e94ed1351 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4173f437ac74b05bab0aef8b0dbde2b', 'request_id': 'req-4eab28d3-8c7d-470f-8284-c10e94ed1351'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.099526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4eab28d3-8c7d-470f-8284-c10e94ed1351 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] The token cache is being invalidate because project b4173f437ac74b05bab0aef8b0dbde2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:47.099816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4eab28d3-8c7d-470f-8284-c10e94ed1351 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.100620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4eab28d3-8c7d-470f-8284-c10e94ed1351 tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.102987 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4039/8063] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:46 2022] DELETE /identity/v3/projects/b4173f437ac74b05bab0aef8b0dbde2b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:47.108241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129a27f-5636-4509-b4c0-d3914185e79d tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:47.110387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9129a27f-5636-4509-b4c0-d3914185e79d tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:47.180165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129a27f-5636-4509-b4c0-d3914185e79d tempest-ProjectsNegativeStaticTestJSON-315483483 tempest-ProjectsNegativeStaticTestJSON-315483483-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:47.208721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:47.247382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:47.247909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:47.248164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:47.248458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] PATH_INFO: `/v3/users/391253c4ae3c414188f39294e9d1b24c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:47.249778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=391253c4ae3c414188f39294e9d1b24c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:47.252274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:47.305547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391253c4ae3c414188f39294e9d1b24c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.312330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391253c4ae3c414188f39294e9d1b24c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.313107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391253c4ae3c414188f39294e9d1b24c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.313827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391253c4ae3c414188f39294e9d1b24c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.326025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391253c4ae3c414188f39294e9d1b24c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.339530 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4025/8064] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:47 2022] DELETE /identity/v3/users/391253c4ae3c414188f39294e9d1b24c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:25:47.344250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7f26e-341a-46fd-94f9-bdd37e487b2b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:47.344765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7f26e-341a-46fd-94f9-bdd37e487b2b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:47.344857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7f26e-341a-46fd-94f9-bdd37e487b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:47.364155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-84d7f26e-341a-46fd-94f9-bdd37e487b2b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:47.365642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-84d7f26e-341a-46fd-94f9-bdd37e487b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:47.403917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:47.427741 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4040/8065] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:47.438019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:47.439415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:47.500553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fddb6-4f55-409d-b4be-996b9969b93e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:47.504152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c49e7-e606-4319-8942-7b5b25abb1ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:47.504764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c49e7-e606-4319-8942-7b5b25abb1ea service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:47.505039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c49e7-e606-4319-8942-7b5b25abb1ea service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:47.505342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c49e7-e606-4319-8942-7b5b25abb1ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:47.515074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c49e7-e606-4319-8942-7b5b25abb1ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:47.516506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c49e7-e606-4319-8942-7b5b25abb1ea service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:47.526252 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4026/8066] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:25:47.801117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7f26e-341a-46fd-94f9-bdd37e487b2b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:47.802697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-84d7f26e-341a-46fd-94f9-bdd37e487b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:47.816406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7f26e-341a-46fd-94f9-bdd37e487b2b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:47.822220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:47.822860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:47.823425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:47.824634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] PATH_INFO: `/v3/projects/3fce20dc8a40418f9382257fc61fb960` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:47.826239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fce20dc8a40418f9382257fc61fb960)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:47.828432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:47.883292 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fce20dc8a40418f9382257fc61fb960', 'request_id': 'req-9cd1203d-65c7-4a24-a40f-3a72d6772751'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.891821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fce20dc8a40418f9382257fc61fb960', 'request_id': 'req-9cd1203d-65c7-4a24-a40f-3a72d6772751'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.899184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fce20dc8a40418f9382257fc61fb960', 'request_id': 'req-9cd1203d-65c7-4a24-a40f-3a72d6772751'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.911082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] The token cache is being invalidate because project 3fce20dc8a40418f9382257fc61fb960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:47.911377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.912152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:47.914045 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4041/8067] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:47 2022] DELETE /identity/v3/projects/3fce20dc8a40418f9382257fc61fb960 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:47.917971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c49e7-e606-4319-8942-7b5b25abb1ea service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:47.928229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c49e7-e606-4319-8942-7b5b25abb1ea service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:47.986613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:48.001941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd7c17-f204-4ad4-b015-1386998593e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:48.002754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd7c17-f204-4ad4-b015-1386998593e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:48.003098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd7c17-f204-4ad4-b015-1386998593e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:48.003464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd7c17-f204-4ad4-b015-1386998593e6 admin admin] PATH_INFO: `/v3/users/7684e3aa1a964d85bb4e9a41e766342c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:48.004679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd7c17-f204-4ad4-b015-1386998593e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7684e3aa1a964d85bb4e9a41e766342c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:48.006634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd7c17-f204-4ad4-b015-1386998593e6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:48.060624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5edd7c17-f204-4ad4-b015-1386998593e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7684e3aa1a964d85bb4e9a41e766342c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:48.070267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5edd7c17-f204-4ad4-b015-1386998593e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7684e3aa1a964d85bb4e9a41e766342c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:48.070979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5edd7c17-f204-4ad4-b015-1386998593e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7684e3aa1a964d85bb4e9a41e766342c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:48.071606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5edd7c17-f204-4ad4-b015-1386998593e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7684e3aa1a964d85bb4e9a41e766342c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:48.086979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5edd7c17-f204-4ad4-b015-1386998593e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7684e3aa1a964d85bb4e9a41e766342c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:48.122698 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4027/8068] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:47 2022] DELETE /identity/v3/users/7684e3aa1a964d85bb4e9a41e766342c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:25:48.398697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:48.400186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:48.413586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1203d-65c7-4a24-a40f-3a72d6772751 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:48.471108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053ebc5-5aca-4b1b-a65f-05c8ae521200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:48.471731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053ebc5-5aca-4b1b-a65f-05c8ae521200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:48.472012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053ebc5-5aca-4b1b-a65f-05c8ae521200 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:48.472283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053ebc5-5aca-4b1b-a65f-05c8ae521200 admin admin] PATH_INFO: `/v3/projects/6f2fea251669405ba3263f309ffc979f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:48.473413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053ebc5-5aca-4b1b-a65f-05c8ae521200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f2fea251669405ba3263f309ffc979f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:48.475299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053ebc5-5aca-4b1b-a65f-05c8ae521200 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:48.522077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b053ebc5-5aca-4b1b-a65f-05c8ae521200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2fea251669405ba3263f309ffc979f', 'request_id': 'req-b053ebc5-5aca-4b1b-a65f-05c8ae521200'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:48.529180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b053ebc5-5aca-4b1b-a65f-05c8ae521200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2fea251669405ba3263f309ffc979f', 'request_id': 'req-b053ebc5-5aca-4b1b-a65f-05c8ae521200'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:48.534622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b053ebc5-5aca-4b1b-a65f-05c8ae521200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2fea251669405ba3263f309ffc979f', 'request_id': 'req-b053ebc5-5aca-4b1b-a65f-05c8ae521200'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:48.536437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:48.547640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b053ebc5-5aca-4b1b-a65f-05c8ae521200 admin admin] The token cache is being invalidate because project 6f2fea251669405ba3263f309ffc979f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:48.548006 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b053ebc5-5aca-4b1b-a65f-05c8ae521200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:48.548762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b053ebc5-5aca-4b1b-a65f-05c8ae521200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:48.550277 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4042/8069] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:48 2022] DELETE /identity/v3/projects/6f2fea251669405ba3263f309ffc979f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:48.555991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4100b2e-e490-4722-bf5c-0285fb451905 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:48.556468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4100b2e-e490-4722-bf5c-0285fb451905 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:48.556566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4100b2e-e490-4722-bf5c-0285fb451905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:48.576488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d4100b2e-e490-4722-bf5c-0285fb451905 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:48.577743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d4100b2e-e490-4722-bf5c-0285fb451905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:48.636271 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4028/8070] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:48.644215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405898e-3b44-45c9-bb2c-a369b9362a8f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:48.644513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405898e-3b44-45c9-bb2c-a369b9362a8f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:48.644841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405898e-3b44-45c9-bb2c-a369b9362a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:48.666076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f405898e-3b44-45c9-bb2c-a369b9362a8f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:48.667281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f405898e-3b44-45c9-bb2c-a369b9362a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:48.675293 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4043/8071] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:48.680330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4100b2e-e490-4722-bf5c-0285fb451905 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:48.690127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4100b2e-e490-4722-bf5c-0285fb451905 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:48.694658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a962d6b-144f-4ff2-a85a-7d86eaf53a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:48.695249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a962d6b-144f-4ff2-a85a-7d86eaf53a56 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:48.695523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a962d6b-144f-4ff2-a85a-7d86eaf53a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:48.695791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a962d6b-144f-4ff2-a85a-7d86eaf53a56 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:48.696427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a962d6b-144f-4ff2-a85a-7d86eaf53a56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:25:48.696727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a962d6b-144f-4ff2-a85a-7d86eaf53a56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:48.698343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a962d6b-144f-4ff2-a85a-7d86eaf53a56 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:48.712285 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4029/8072] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:48.716442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405898e-3b44-45c9-bb2c-a369b9362a8f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:48.726337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405898e-3b44-45c9-bb2c-a369b9362a8f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:48.731346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5446c0-7ab6-4c76-afff-ed28185d1630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:48.731934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5446c0-7ab6-4c76-afff-ed28185d1630 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:48.732219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5446c0-7ab6-4c76-afff-ed28185d1630 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:48.732497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5446c0-7ab6-4c76-afff-ed28185d1630 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:48.733123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5446c0-7ab6-4c76-afff-ed28185d1630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:48.735052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5446c0-7ab6-4c76-afff-ed28185d1630 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:48.761921 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4044/8073] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:48 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:48.766017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a962d6b-144f-4ff2-a85a-7d86eaf53a56 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:48.775898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a962d6b-144f-4ff2-a85a-7d86eaf53a56 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:48.826514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:48.833424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73db69-391c-439a-988c-8645fada4308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:48.834104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73db69-391c-439a-988c-8645fada4308 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:48.834572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73db69-391c-439a-988c-8645fada4308 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:48.835077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73db69-391c-439a-988c-8645fada4308 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:48.835797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73db69-391c-439a-988c-8645fada4308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:48.837947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73db69-391c-439a-988c-8645fada4308 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:48.860033 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4030/8074] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:48 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:48.864135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5446c0-7ab6-4c76-afff-ed28185d1630 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:48.875362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5446c0-7ab6-4c76-afff-ed28185d1630 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:48.880021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96524e1c-fbe3-4c11-b887-fd32e59e2536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:48.880615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96524e1c-fbe3-4c11-b887-fd32e59e2536 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:48.880899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96524e1c-fbe3-4c11-b887-fd32e59e2536 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:48.881174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96524e1c-fbe3-4c11-b887-fd32e59e2536 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:48.881873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96524e1c-fbe3-4c11-b887-fd32e59e2536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:48.883710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96524e1c-fbe3-4c11-b887-fd32e59e2536 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:48.893924 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4045/8075] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:48.898287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73db69-391c-439a-988c-8645fada4308 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:48.908811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73db69-391c-439a-988c-8645fada4308 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:48.914121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdb7f2-c6bc-403e-9322-7a5b79170e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:48.914712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdb7f2-c6bc-403e-9322-7a5b79170e0b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:48.914989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdb7f2-c6bc-403e-9322-7a5b79170e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:48.915261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdb7f2-c6bc-403e-9322-7a5b79170e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:48.915891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdb7f2-c6bc-403e-9322-7a5b79170e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:48.917489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdb7f2-c6bc-403e-9322-7a5b79170e0b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:48.928066 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4031/8076] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:48.932389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96524e1c-fbe3-4c11-b887-fd32e59e2536 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:48.942260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96524e1c-fbe3-4c11-b887-fd32e59e2536 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:48.946853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a9ed9-13d2-46dc-929c-86787d7d8cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:48.947490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a9ed9-13d2-46dc-929c-86787d7d8cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:48.947769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a9ed9-13d2-46dc-929c-86787d7d8cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:48.948042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a9ed9-13d2-46dc-929c-86787d7d8cfa admin admin] PATH_INFO: `/v3/projects/0effeb42c10d4fb29cf57e70948cf7ab/users/626c4c89efc64df8956f152c1f42103c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:48.962967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a9ed9-13d2-46dc-929c-86787d7d8cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0effeb42c10d4fb29cf57e70948cf7ab, user_id=626c4c89efc64df8956f152c1f42103c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:48.965627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a9ed9-13d2-46dc-929c-86787d7d8cfa admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:48.978780 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4046/8077] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:48 2022] PUT /identity/v3/projects/0effeb42c10d4fb29cf57e70948cf7ab/users/626c4c89efc64df8956f152c1f42103c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:48.989669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9733594-197f-4d11-b191-67e8c854cdd7 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:48.989980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9733594-197f-4d11-b191-67e8c854cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:48.990266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9733594-197f-4d11-b191-67e8c854cdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:49.017966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a9733594-197f-4d11-b191-67e8c854cdd7 None None] MFA Rules not processed for user `626c4c89efc64df8956f152c1f42103c`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:49.019182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a9733594-197f-4d11-b191-67e8c854cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:49.086673 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4032/8078] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:25:49.091244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a9ed9-13d2-46dc-929c-86787d7d8cfa admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:49.153666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a9ed9-13d2-46dc-929c-86787d7d8cfa admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:49.158287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeba935-73d7-4062-b390-2ba5557e6998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:49.158880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeba935-73d7-4062-b390-2ba5557e6998 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:49.159159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeba935-73d7-4062-b390-2ba5557e6998 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:49.159435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeba935-73d7-4062-b390-2ba5557e6998 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:49.160058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeba935-73d7-4062-b390-2ba5557e6998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:49.162000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeba935-73d7-4062-b390-2ba5557e6998 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:49.210100 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4047/8079] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:49 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:49.214402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9733594-197f-4d11-b191-67e8c854cdd7 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:49.225543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9733594-197f-4d11-b191-67e8c854cdd7 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:49.318605 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf2ac5-e562-4cf5-a429-2d1a3dc32f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:49.319236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf2ac5-e562-4cf5-a429-2d1a3dc32f5a admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:49.319518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf2ac5-e562-4cf5-a429-2d1a3dc32f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:49.320316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf2ac5-e562-4cf5-a429-2d1a3dc32f5a admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:49.320957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf2ac5-e562-4cf5-a429-2d1a3dc32f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:49.322914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf2ac5-e562-4cf5-a429-2d1a3dc32f5a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:49.344282 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4033/8080] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:49 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:49.348530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeba935-73d7-4062-b390-2ba5557e6998 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:49.381778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeba935-73d7-4062-b390-2ba5557e6998 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:49.387022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40814f7-3541-4f29-b59e-8cd4ddc74c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:49.387615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40814f7-3541-4f29-b59e-8cd4ddc74c9f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:49.387899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40814f7-3541-4f29-b59e-8cd4ddc74c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:49.388176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40814f7-3541-4f29-b59e-8cd4ddc74c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:49.388813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40814f7-3541-4f29-b59e-8cd4ddc74c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:49.390422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40814f7-3541-4f29-b59e-8cd4ddc74c9f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:49.401554 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4048/8081] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:49.405789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf2ac5-e562-4cf5-a429-2d1a3dc32f5a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:49.415792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf2ac5-e562-4cf5-a429-2d1a3dc32f5a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:49.420401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894acd7-91e3-4e1a-ace1-de23c2b7ed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:49.421075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894acd7-91e3-4e1a-ace1-de23c2b7ed61 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:49.421489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894acd7-91e3-4e1a-ace1-de23c2b7ed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:49.421687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894acd7-91e3-4e1a-ace1-de23c2b7ed61 admin admin] PATH_INFO: `/v3/projects/01a0087549b946ba8ee92e326cdc3087/users/0ade69c03dd44497be20a6c960fcb9e0/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:49.437060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894acd7-91e3-4e1a-ace1-de23c2b7ed61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a0087549b946ba8ee92e326cdc3087, user_id=0ade69c03dd44497be20a6c960fcb9e0, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:49.439725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894acd7-91e3-4e1a-ace1-de23c2b7ed61 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:49.448424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:49.454997 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4034/8082] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:49 2022] PUT /identity/v3/projects/01a0087549b946ba8ee92e326cdc3087/users/0ade69c03dd44497be20a6c960fcb9e0/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:49.458934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40814f7-3541-4f29-b59e-8cd4ddc74c9f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:49.469749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40814f7-3541-4f29-b59e-8cd4ddc74c9f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:49.489986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:49.530343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617b002-cd23-47b0-ad7e-ab128bfc1df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:49.530954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617b002-cd23-47b0-ad7e-ab128bfc1df2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:49.531232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617b002-cd23-47b0-ad7e-ab128bfc1df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:49.531504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617b002-cd23-47b0-ad7e-ab128bfc1df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:49.532141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617b002-cd23-47b0-ad7e-ab128bfc1df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:49.533758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617b002-cd23-47b0-ad7e-ab128bfc1df2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:49.543964 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4049/8083] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:49.548258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894acd7-91e3-4e1a-ace1-de23c2b7ed61 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:49.558570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894acd7-91e3-4e1a-ace1-de23c2b7ed61 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:49.563286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938e431-0d09-43f5-9aa1-9d464283d7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:49.563932 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938e431-0d09-43f5-9aa1-9d464283d7c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:49.564211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938e431-0d09-43f5-9aa1-9d464283d7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:49.564483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938e431-0d09-43f5-9aa1-9d464283d7c2 admin admin] PATH_INFO: `/v3/projects/01a0087549b946ba8ee92e326cdc3087/users/0ade69c03dd44497be20a6c960fcb9e0/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:49.566395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938e431-0d09-43f5-9aa1-9d464283d7c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a0087549b946ba8ee92e326cdc3087, user_id=0ade69c03dd44497be20a6c960fcb9e0, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:49.568989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938e431-0d09-43f5-9aa1-9d464283d7c2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:49.579496 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4035/8084] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:49 2022] PUT /identity/v3/projects/01a0087549b946ba8ee92e326cdc3087/users/0ade69c03dd44497be20a6c960fcb9e0/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:49.591056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1bc9-24ab-4d9e-8b12-3c0a1ab0ed14 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:49.591341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1bc9-24ab-4d9e-8b12-3c0a1ab0ed14 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:49.591621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1bc9-24ab-4d9e-8b12-3c0a1ab0ed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:49.619110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dfbd1bc9-24ab-4d9e-8b12-3c0a1ab0ed14 None None] MFA Rules not processed for user `0ade69c03dd44497be20a6c960fcb9e0`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:49.620326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dfbd1bc9-24ab-4d9e-8b12-3c0a1ab0ed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:49.690536 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4050/8085] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:49.695429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938e431-0d09-43f5-9aa1-9d464283d7c2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:49.706314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938e431-0d09-43f5-9aa1-9d464283d7c2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:49.710971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46e808-e3a3-4f44-9adb-09fd594a10a4 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:49.711559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46e808-e3a3-4f44-9adb-09fd594a10a4 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:49.711834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46e808-e3a3-4f44-9adb-09fd594a10a4 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:49.712105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46e808-e3a3-4f44-9adb-09fd594a10a4 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:49.712758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46e808-e3a3-4f44-9adb-09fd594a10a4 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:49.714341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46e808-e3a3-4f44-9adb-09fd594a10a4 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:49.729101 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4036/8086] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:25:49 2022] POST /identity/v3/roles => generated 234 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:49.733180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd1bc9-24ab-4d9e-8b12-3c0a1ab0ed14 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:49.742835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd1bc9-24ab-4d9e-8b12-3c0a1ab0ed14 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:49.747523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad4bbc-2b71-4aed-a999-4065fd618331 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:49.748109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad4bbc-2b71-4aed-a999-4065fd618331 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:49.748390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad4bbc-2b71-4aed-a999-4065fd618331 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:49.748662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad4bbc-2b71-4aed-a999-4065fd618331 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:49.749354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad4bbc-2b71-4aed-a999-4065fd618331 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:49.750920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad4bbc-2b71-4aed-a999-4065fd618331 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:49.765841 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4051/8087] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:25:49 2022] POST /identity/v3/roles => generated 234 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:49.769957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46e808-e3a3-4f44-9adb-09fd594a10a4 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:49.779772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46e808-e3a3-4f44-9adb-09fd594a10a4 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:49.784410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeb556-9f4f-4539-b113-156cd518f210 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:49.785002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeb556-9f4f-4539-b113-156cd518f210 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:49.785312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeb556-9f4f-4539-b113-156cd518f210 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:49.785587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeb556-9f4f-4539-b113-156cd518f210 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:49.786243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeb556-9f4f-4539-b113-156cd518f210 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:49.787821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeb556-9f4f-4539-b113-156cd518f210 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:49.801665 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4037/8088] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:25:49 2022] POST /identity/v3/roles => generated 234 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:49.806180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad4bbc-2b71-4aed-a999-4065fd618331 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:49.816206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad4bbc-2b71-4aed-a999-4065fd618331 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:49.821517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65cc18-2b7b-4210-84e9-c44681cb99d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:49.822109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65cc18-2b7b-4210-84e9-c44681cb99d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:49.822394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65cc18-2b7b-4210-84e9-c44681cb99d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:49.822670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65cc18-2b7b-4210-84e9-c44681cb99d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:49.823320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65cc18-2b7b-4210-84e9-c44681cb99d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:49.824896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65cc18-2b7b-4210-84e9-c44681cb99d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:49.840662 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4052/8089] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:25:49 2022] POST /identity/v3/domains => generated 275 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:49.844656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeb556-9f4f-4539-b113-156cd518f210 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:49.854615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeb556-9f4f-4539-b113-156cd518f210 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:49.910680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d22adb-99b2-4b42-9bd2-3db5cf8fb6be tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:49.911276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d22adb-99b2-4b42-9bd2-3db5cf8fb6be tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:49.911557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d22adb-99b2-4b42-9bd2-3db5cf8fb6be tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:49.911827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d22adb-99b2-4b42-9bd2-3db5cf8fb6be tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:49.912449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d22adb-99b2-4b42-9bd2-3db5cf8fb6be tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:49.914622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d22adb-99b2-4b42-9bd2-3db5cf8fb6be tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:49.950354 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4038/8090] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:49 2022] POST /identity/v3/projects => generated 399 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:49.954215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65cc18-2b7b-4210-84e9-c44681cb99d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:49.964491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65cc18-2b7b-4210-84e9-c44681cb99d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:50.021762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdac8f6-87e1-431d-9824-5333a520fbaa tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:50.022400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdac8f6-87e1-431d-9824-5333a520fbaa tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:50.022680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdac8f6-87e1-431d-9824-5333a520fbaa tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:50.022950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdac8f6-87e1-431d-9824-5333a520fbaa tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/groups` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:50.023675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdac8f6-87e1-431d-9824-5333a520fbaa tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:50.025605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdac8f6-87e1-431d-9824-5333a520fbaa tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:50.041513 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4053/8091] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:25:49 2022] POST /identity/v3/groups => generated 301 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:50.044761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d22adb-99b2-4b42-9bd2-3db5cf8fb6be tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:50.055617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d22adb-99b2-4b42-9bd2-3db5cf8fb6be tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:50.060179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a232bd-7338-4d21-bd99-0a6b33536578 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:50.060800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a232bd-7338-4d21-bd99-0a6b33536578 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:50.061144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a232bd-7338-4d21-bd99-0a6b33536578 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:50.061456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a232bd-7338-4d21-bd99-0a6b33536578 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:50.062111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a232bd-7338-4d21-bd99-0a6b33536578 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:50.063681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a232bd-7338-4d21-bd99-0a6b33536578 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:50.078222 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4039/8092] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:25:50 2022] POST /identity/v3/roles => generated 235 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:50.082319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdac8f6-87e1-431d-9824-5333a520fbaa tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:50.092282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdac8f6-87e1-431d-9824-5333a520fbaa tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:50.096880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831af18b-6890-47dc-a0b6-ae53e6a1323a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:50.097499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831af18b-6890-47dc-a0b6-ae53e6a1323a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:50.097812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831af18b-6890-47dc-a0b6-ae53e6a1323a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:50.098090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831af18b-6890-47dc-a0b6-ae53e6a1323a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:50.098723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831af18b-6890-47dc-a0b6-ae53e6a1323a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:50.100650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831af18b-6890-47dc-a0b6-ae53e6a1323a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:50.111552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:50.125078 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4054/8093] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:50 2022] POST /identity/v3/users => generated 439 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:50.129279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a232bd-7338-4d21-bd99-0a6b33536578 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:50.139501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a232bd-7338-4d21-bd99-0a6b33536578 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:50.144109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea16af6-fae4-4042-968e-7ed7d30c892f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:50.144728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea16af6-fae4-4042-968e-7ed7d30c892f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:50.145040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea16af6-fae4-4042-968e-7ed7d30c892f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:50.145357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea16af6-fae4-4042-968e-7ed7d30c892f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:50.146024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea16af6-fae4-4042-968e-7ed7d30c892f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:50.147026 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-cea16af6-fae4-4042-968e-7ed7d30c892f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:50.147026 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:25:50.147026 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:25:50.147934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea16af6-fae4-4042-968e-7ed7d30c892f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:50.162633 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4040/8094] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:25:50 2022] POST /identity/v3/roles => generated 269 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:50.167165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831af18b-6890-47dc-a0b6-ae53e6a1323a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:50.177233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831af18b-6890-47dc-a0b6-ae53e6a1323a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:50.183074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399b35-ce3c-400b-bf18-4f74041ab0bc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:50.183719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399b35-ce3c-400b-bf18-4f74041ab0bc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:50.184001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399b35-ce3c-400b-bf18-4f74041ab0bc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:50.184273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399b35-ce3c-400b-bf18-4f74041ab0bc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/cd3623968a604657b2731aad7d6fc4e2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:50.199843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399b35-ce3c-400b-bf18-4f74041ab0bc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_grant(project_id=893fe6519ae541ac92084e628c40954f, user_id=b9f4aed4295c40a0ad5ec02809303b62, role_id=cd3623968a604657b2731aad7d6fc4e2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:50.202556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399b35-ce3c-400b-bf18-4f74041ab0bc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:50.215421 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4055/8095] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:50 2022] PUT /identity/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/cd3623968a604657b2731aad7d6fc4e2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:50.219780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea16af6-fae4-4042-968e-7ed7d30c892f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:50.230389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea16af6-fae4-4042-968e-7ed7d30c892f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:50.286586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d0a4b-9702-4b5f-9787-4b7d906c7507 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:50.287278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d0a4b-9702-4b5f-9787-4b7d906c7507 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:50.287564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d0a4b-9702-4b5f-9787-4b7d906c7507 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:50.287841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d0a4b-9702-4b5f-9787-4b7d906c7507 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:50.289057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d0a4b-9702-4b5f-9787-4b7d906c7507 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Adding query filter params (scope.project.id=893fe6519ae541ac92084e628c40954f, user.id=b9f4aed4295c40a0ad5ec02809303b62) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:25:50.289400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d0a4b-9702-4b5f-9787-4b7d906c7507 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:50.291243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d0a4b-9702-4b5f-9787-4b7d906c7507 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:50.301255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:50.339169 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4041/8096] 10.222.0.26 () {58 vars in 1356 bytes} [Sat Oct 8 21:25:50 2022] GET /identity/v3/role_assignments?scope.project.id=893fe6519ae541ac92084e628c40954f&user.id=b9f4aed4295c40a0ad5ec02809303b62&effective => generated 228 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:50.343129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399b35-ce3c-400b-bf18-4f74041ab0bc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:50.354034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399b35-ce3c-400b-bf18-4f74041ab0bc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:50.359093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516eb11-f28c-46f8-a105-1b7c57a742c3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:50.359740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516eb11-f28c-46f8-a105-1b7c57a742c3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:50.360022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516eb11-f28c-46f8-a105-1b7c57a742c3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:50.360298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516eb11-f28c-46f8-a105-1b7c57a742c3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/cd3623968a604657b2731aad7d6fc4e2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:50.362690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516eb11-f28c-46f8-a105-1b7c57a742c3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=893fe6519ae541ac92084e628c40954f, user_id=b9f4aed4295c40a0ad5ec02809303b62, role_id=cd3623968a604657b2731aad7d6fc4e2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:50.365439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516eb11-f28c-46f8-a105-1b7c57a742c3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:50.371237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c516eb11-f28c-46f8-a105-1b7c57a742c3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role cd3623968a604657b2731aad7d6fc4e2 was removed from user b9f4aed4295c40a0ad5ec02809303b62 on project 893fe6519ae541ac92084e628c40954f. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:50.371522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c516eb11-f28c-46f8-a105-1b7c57a742c3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:50.372179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c516eb11-f28c-46f8-a105-1b7c57a742c3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:50.385439 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4056/8097] 10.222.0.26 () {58 vars in 1467 bytes} [Sat Oct 8 21:25:50 2022] DELETE /identity/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/cd3623968a604657b2731aad7d6fc4e2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:50.389587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d0a4b-9702-4b5f-9787-4b7d906c7507 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:50.391301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-572d0a4b-9702-4b5f-9787-4b7d906c7507 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:50.404283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d0a4b-9702-4b5f-9787-4b7d906c7507 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:50.460147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d489a4-748e-49a9-99a9-f825b47c5243 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:50.461206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d489a4-748e-49a9-99a9-f825b47c5243 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:50.461514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d489a4-748e-49a9-99a9-f825b47c5243 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:50.461816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d489a4-748e-49a9-99a9-f825b47c5243 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/cd3623968a604657b2731aad7d6fc4e2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:50.462958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d489a4-748e-49a9-99a9-f825b47c5243 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=cd3623968a604657b2731aad7d6fc4e2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:50.463969 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-69d489a4-748e-49a9-99a9-f825b47c5243 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:50.463969 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:25:50.463969 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:25:50.464853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d489a4-748e-49a9-99a9-f825b47c5243 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:50.500410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69d489a4-748e-49a9-99a9-f825b47c5243 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role cd3623968a604657b2731aad7d6fc4e2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:50.500698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69d489a4-748e-49a9-99a9-f825b47c5243 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:50.501424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69d489a4-748e-49a9-99a9-f825b47c5243 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:50.503305 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4042/8098] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:50 2022] DELETE /identity/v3/roles/cd3623968a604657b2731aad7d6fc4e2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:50.508465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516eb11-f28c-46f8-a105-1b7c57a742c3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:50.518703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516eb11-f28c-46f8-a105-1b7c57a742c3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:50.574756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24573c3-4d97-4138-9245-1487fc2a46fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:50.575417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24573c3-4d97-4138-9245-1487fc2a46fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:50.575706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24573c3-4d97-4138-9245-1487fc2a46fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:50.575987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24573c3-4d97-4138-9245-1487fc2a46fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/b78f3fb4994b4701a5e5a7758e3e6d28` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:50.578230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24573c3-4d97-4138-9245-1487fc2a46fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_grant(project_id=893fe6519ae541ac92084e628c40954f, user_id=b9f4aed4295c40a0ad5ec02809303b62, role_id=b78f3fb4994b4701a5e5a7758e3e6d28)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:50.580883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24573c3-4d97-4138-9245-1487fc2a46fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:50.594035 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4057/8099] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:50 2022] PUT /identity/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/b78f3fb4994b4701a5e5a7758e3e6d28 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:50.598242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d489a4-748e-49a9-99a9-f825b47c5243 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:50.599706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-69d489a4-748e-49a9-99a9-f825b47c5243 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:50.612964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d489a4-748e-49a9-99a9-f825b47c5243 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:50.670009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dace6a9-feb6-447a-bbe5-44ae2ab707d3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:50.670699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dace6a9-feb6-447a-bbe5-44ae2ab707d3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:50.670986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dace6a9-feb6-447a-bbe5-44ae2ab707d3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:50.671261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dace6a9-feb6-447a-bbe5-44ae2ab707d3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:50.672916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dace6a9-feb6-447a-bbe5-44ae2ab707d3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:50.674023 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-8dace6a9-feb6-447a-bbe5-44ae2ab707d3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:50.674023 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:25:50.674023 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:25:50.674904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dace6a9-feb6-447a-bbe5-44ae2ab707d3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:50.703799 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4043/8100] 10.222.0.26 () {60 vars in 1363 bytes} [Sat Oct 8 21:25:50 2022] PUT /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401 => generated 519 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:50.704986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24573c3-4d97-4138-9245-1487fc2a46fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:50.715895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24573c3-4d97-4138-9245-1487fc2a46fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:50.771086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747a469-7ffb-49e9-9332-585798354b22 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:50.771686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747a469-7ffb-49e9-9332-585798354b22 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:50.771971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747a469-7ffb-49e9-9332-585798354b22 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:50.772289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747a469-7ffb-49e9-9332-585798354b22 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:50.773541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747a469-7ffb-49e9-9332-585798354b22 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Adding query filter params (scope.project.id=893fe6519ae541ac92084e628c40954f, user.id=b9f4aed4295c40a0ad5ec02809303b62) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:25:50.773857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747a469-7ffb-49e9-9332-585798354b22 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:50.775698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747a469-7ffb-49e9-9332-585798354b22 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:50.822343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:50.827420 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4058/8101] 10.222.0.26 () {58 vars in 1356 bytes} [Sat Oct 8 21:25:50 2022] GET /identity/v3/role_assignments?scope.project.id=893fe6519ae541ac92084e628c40954f&user.id=b9f4aed4295c40a0ad5ec02809303b62&effective => generated 1061 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:50.831703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dace6a9-feb6-447a-bbe5-44ae2ab707d3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:50.843537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dace6a9-feb6-447a-bbe5-44ae2ab707d3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:50.848296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8454a-92bf-448b-b714-13dfcb7bae87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:50.848966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8454a-92bf-448b-b714-13dfcb7bae87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:50.849307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8454a-92bf-448b-b714-13dfcb7bae87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:50.849563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8454a-92bf-448b-b714-13dfcb7bae87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:50.851200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8454a-92bf-448b-b714-13dfcb7bae87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:50.852345 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-fac8454a-92bf-448b-b714-13dfcb7bae87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:50.852345 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:25:50.852345 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:25:50.853284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8454a-92bf-448b-b714-13dfcb7bae87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:50.862322 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4044/8102] 10.222.0.26 () {58 vars in 1347 bytes} [Sat Oct 8 21:25:50 2022] DELETE /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:50.866256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747a469-7ffb-49e9-9332-585798354b22 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:50.876454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747a469-7ffb-49e9-9332-585798354b22 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:50.933178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdb68a-32e6-498d-bf1c-265df181a33b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:50.933817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdb68a-32e6-498d-bf1c-265df181a33b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:50.934108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdb68a-32e6-498d-bf1c-265df181a33b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:50.934390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdb68a-32e6-498d-bf1c-265df181a33b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:50.935105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdb68a-32e6-498d-bf1c-265df181a33b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Adding query filter params (scope.project.id=893fe6519ae541ac92084e628c40954f, user.id=b9f4aed4295c40a0ad5ec02809303b62) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:25:50.935418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdb68a-32e6-498d-bf1c-265df181a33b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:50.937294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdb68a-32e6-498d-bf1c-265df181a33b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:50.983741 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4059/8103] 10.222.0.26 () {58 vars in 1356 bytes} [Sat Oct 8 21:25:50 2022] GET /identity/v3/role_assignments?scope.project.id=893fe6519ae541ac92084e628c40954f&user.id=b9f4aed4295c40a0ad5ec02809303b62&effective => generated 577 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:50.987871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8454a-92bf-448b-b714-13dfcb7bae87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:50.993598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:50.999851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8454a-92bf-448b-b714-13dfcb7bae87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.005648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fae7f-c294-46c5-96a9-46b49d797acd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.006323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fae7f-c294-46c5-96a9-46b49d797acd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.006607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fae7f-c294-46c5-96a9-46b49d797acd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.006883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fae7f-c294-46c5-96a9-46b49d797acd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.009899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fae7f-c294-46c5-96a9-46b49d797acd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:51.011613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fae7f-c294-46c5-96a9-46b49d797acd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-298fae7f-c294-46c5-96a9-46b49d797acd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] b78f3fb4994b4701a5e5a7758e3e6d28 does not imply 4ad11af1fafe4aceb9f53d0240690401.: keystone.exception.ImpliedRoleNotFound: b78f3fb4994b4701a5e5a7758e3e6d28 does not imply 4ad11af1fafe4aceb9f53d0240690401. Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = query.one() Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._iter().one() Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._only_one_row( Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:51.032686 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 08 21:25:51.033987 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 08 21:25:51.035149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 08 21:25:51.035149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 08 21:25:51.035149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 08 21:25:51.035149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: b78f3fb4994b4701a5e5a7758e3e6d28 does not imply 4ad11af1fafe4aceb9f53d0240690401. Oct 08 21:25:51.035149 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:51.035149 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4045/8104] 10.222.0.26 () {58 vars in 1347 bytes} [Sat Oct 8 21:25:50 2022] DELETE /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401 => generated 137 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:25:51.038229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdb68a-32e6-498d-bf1c-265df181a33b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:51.048446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdb68a-32e6-498d-bf1c-265df181a33b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.052982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30bfdc-73aa-4ed3-aecf-0d4247395a59 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.053657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30bfdc-73aa-4ed3-aecf-0d4247395a59 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.053964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30bfdc-73aa-4ed3-aecf-0d4247395a59 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.054238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30bfdc-73aa-4ed3-aecf-0d4247395a59 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/b78f3fb4994b4701a5e5a7758e3e6d28` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.056388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30bfdc-73aa-4ed3-aecf-0d4247395a59 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=893fe6519ae541ac92084e628c40954f, user_id=b9f4aed4295c40a0ad5ec02809303b62, role_id=b78f3fb4994b4701a5e5a7758e3e6d28)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:51.059024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30bfdc-73aa-4ed3-aecf-0d4247395a59 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:51.064145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b30bfdc-73aa-4ed3-aecf-0d4247395a59 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role b78f3fb4994b4701a5e5a7758e3e6d28 was removed from user b9f4aed4295c40a0ad5ec02809303b62 on project 893fe6519ae541ac92084e628c40954f. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:51.064432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b30bfdc-73aa-4ed3-aecf-0d4247395a59 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:51.065092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b30bfdc-73aa-4ed3-aecf-0d4247395a59 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:51.079219 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4060/8105] 10.222.0.26 () {58 vars in 1467 bytes} [Sat Oct 8 21:25:51 2022] DELETE /identity/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/b78f3fb4994b4701a5e5a7758e3e6d28 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:51.084567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fae7f-c294-46c5-96a9-46b49d797acd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:51.086808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-298fae7f-c294-46c5-96a9-46b49d797acd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:51.101150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fae7f-c294-46c5-96a9-46b49d797acd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.157903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1e0db-377c-472d-ae51-13a4b1e88bda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.158509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1e0db-377c-472d-ae51-13a4b1e88bda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.158791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1e0db-377c-472d-ae51-13a4b1e88bda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.159065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1e0db-377c-472d-ae51-13a4b1e88bda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.159732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1e0db-377c-472d-ae51-13a4b1e88bda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:51.161431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1e0db-377c-472d-ae51-13a4b1e88bda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:51.176121 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4046/8106] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:51 2022] POST /identity/v3/roles => generated 272 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:51.180677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30bfdc-73aa-4ed3-aecf-0d4247395a59 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:51.190697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30bfdc-73aa-4ed3-aecf-0d4247395a59 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.196320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43919ef-26e6-42af-8fc7-f8b3ee15b7dd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.196915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43919ef-26e6-42af-8fc7-f8b3ee15b7dd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.197208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43919ef-26e6-42af-8fc7-f8b3ee15b7dd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.197506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43919ef-26e6-42af-8fc7-f8b3ee15b7dd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.198153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43919ef-26e6-42af-8fc7-f8b3ee15b7dd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Adding query filter params (domain_id=abe491a7c1e14354a2b33f397aea88bf) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:25:51.198458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43919ef-26e6-42af-8fc7-f8b3ee15b7dd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:51.199464 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-e43919ef-26e6-42af-8fc7-f8b3ee15b7dd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:51.199464 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:51.199464 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:51.200343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43919ef-26e6-42af-8fc7-f8b3ee15b7dd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:51.208524 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4061/8107] 10.222.0.26 () {58 vars in 1207 bytes} [Sat Oct 8 21:25:51 2022] GET /identity/v3/roles?domain_id=abe491a7c1e14354a2b33f397aea88bf => generated 409 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:51.212417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1e0db-377c-472d-ae51-13a4b1e88bda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:51.222510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1e0db-377c-472d-ae51-13a4b1e88bda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.227230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf15f-32fb-4150-b5cc-9ce51803895a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.227848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf15f-32fb-4150-b5cc-9ce51803895a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.228128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf15f-32fb-4150-b5cc-9ce51803895a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.228402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf15f-32fb-4150-b5cc-9ce51803895a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/2692dfdfbd6e4929be09971c75f89df3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.229567 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccf15f-32fb-4150-b5cc-9ce51803895a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=2692dfdfbd6e4929be09971c75f89df3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:51.231391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccf15f-32fb-4150-b5cc-9ce51803895a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:51.265968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-efccf15f-32fb-4150-b5cc-9ce51803895a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role 2692dfdfbd6e4929be09971c75f89df3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:51.266192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-efccf15f-32fb-4150-b5cc-9ce51803895a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:51.266848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-efccf15f-32fb-4150-b5cc-9ce51803895a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:51.268552 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4047/8108] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:51 2022] DELETE /identity/v3/roles/2692dfdfbd6e4929be09971c75f89df3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:51.272482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43919ef-26e6-42af-8fc7-f8b3ee15b7dd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:51.274273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e43919ef-26e6-42af-8fc7-f8b3ee15b7dd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:51.286917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43919ef-26e6-42af-8fc7-f8b3ee15b7dd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.343532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3713f38-c906-4e4b-89bd-467f23ebee83 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.344137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3713f38-c906-4e4b-89bd-467f23ebee83 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.344416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3713f38-c906-4e4b-89bd-467f23ebee83 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.344691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3713f38-c906-4e4b-89bd-467f23ebee83 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.345359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3713f38-c906-4e4b-89bd-467f23ebee83 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Adding query filter params (domain_id=abe491a7c1e14354a2b33f397aea88bf) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:25:51.345662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3713f38-c906-4e4b-89bd-467f23ebee83 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:51.347231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3713f38-c906-4e4b-89bd-467f23ebee83 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:51.352692 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4062/8109] 10.222.0.26 () {58 vars in 1207 bytes} [Sat Oct 8 21:25:51 2022] GET /identity/v3/roles?domain_id=abe491a7c1e14354a2b33f397aea88bf => generated 148 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:51.356950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf15f-32fb-4150-b5cc-9ce51803895a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:51.367651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf15f-32fb-4150-b5cc-9ce51803895a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.372199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c7240-f2fc-40a9-ab1c-e02f04b2c7e6 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.372812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c7240-f2fc-40a9-ab1c-e02f04b2c7e6 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.373087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c7240-f2fc-40a9-ab1c-e02f04b2c7e6 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.373391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c7240-f2fc-40a9-ab1c-e02f04b2c7e6 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/2692dfdfbd6e4929be09971c75f89df3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.385383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c7240-f2fc-40a9-ab1c-e02f04b2c7e6 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-f57c7240-f2fc-40a9-ab1c-e02f04b2c7e6 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Could not find role: 2692dfdfbd6e4929be09971c75f89df3.: keystone.exception.RoleNotFound: Could not find role: 2692dfdfbd6e4929be09971c75f89df3. Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 08 21:25:51.390251 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application with Lock( Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:25:51.391214 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:25:51.392419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:25:51.392419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:25:51.392419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:25:51.392419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:25:51.392419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 21:25:51.392419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 21:25:51.392419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 21:25:51.392419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 21:25:51.392419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 21:25:51.392419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 21:25:51.392419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 2692dfdfbd6e4929be09971c75f89df3. Oct 08 21:25:51.392419 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:51.392419 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4048/8110] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:51 2022] DELETE /identity/v3/roles/2692dfdfbd6e4929be09971c75f89df3 => generated 110 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:25:51.396464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3713f38-c906-4e4b-89bd-467f23ebee83 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:51.406327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3713f38-c906-4e4b-89bd-467f23ebee83 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.410899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341438da-f314-4d6c-ab62-ddf23809d305 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.411534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341438da-f314-4d6c-ab62-ddf23809d305 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.411816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341438da-f314-4d6c-ab62-ddf23809d305 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.412092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341438da-f314-4d6c-ab62-ddf23809d305 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains/abe491a7c1e14354a2b33f397aea88bf/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.418036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341438da-f314-4d6c-ab62-ddf23809d305 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=abe491a7c1e14354a2b33f397aea88bf, group_id=fd1f5b410b4243cba354e114e26e0627, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:51.420643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341438da-f314-4d6c-ab62-ddf23809d305 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:51.434249 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4063/8111] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:51 2022] PUT /identity/v3/domains/abe491a7c1e14354a2b33f397aea88bf/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:25:51.438258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c7240-f2fc-40a9-ab1c-e02f04b2c7e6 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:51.448858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c7240-f2fc-40a9-ab1c-e02f04b2c7e6 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.509620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483f2d8-7e42-42ef-9527-507e5e251bcd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.510301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483f2d8-7e42-42ef-9527-507e5e251bcd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.510586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483f2d8-7e42-42ef-9527-507e5e251bcd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.510861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483f2d8-7e42-42ef-9527-507e5e251bcd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains/abe491a7c1e14354a2b33f397aea88bf/groups/fd1f5b410b4243cba354e114e26e0627/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.512561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483f2d8-7e42-42ef-9527-507e5e251bcd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=abe491a7c1e14354a2b33f397aea88bf, group_id=fd1f5b410b4243cba354e114e26e0627)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:51.513614 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-c483f2d8-7e42-42ef-9527-507e5e251bcd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:51.513614 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:25:51.513614 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:25:51.515409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483f2d8-7e42-42ef-9527-507e5e251bcd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:51.527563 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4049/8112] 10.222.0.26 () {58 vars in 1365 bytes} [Sat Oct 8 21:25:51 2022] GET /identity/v3/domains/abe491a7c1e14354a2b33f397aea88bf/groups/fd1f5b410b4243cba354e114e26e0627/roles => generated 410 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:25:51.531643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341438da-f314-4d6c-ab62-ddf23809d305 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:51.542561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341438da-f314-4d6c-ab62-ddf23809d305 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.547239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6ceb6-7cd6-4a65-b7f4-056df7fcec3f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.547912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6ceb6-7cd6-4a65-b7f4-056df7fcec3f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.548211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6ceb6-7cd6-4a65-b7f4-056df7fcec3f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.548481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6ceb6-7cd6-4a65-b7f4-056df7fcec3f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains/abe491a7c1e14354a2b33f397aea88bf/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.550674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6ceb6-7cd6-4a65-b7f4-056df7fcec3f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=abe491a7c1e14354a2b33f397aea88bf, group_id=fd1f5b410b4243cba354e114e26e0627, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:51.553385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6ceb6-7cd6-4a65-b7f4-056df7fcec3f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:51.559652 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4064/8113] 10.222.0.26 () {58 vars in 1465 bytes} [Sat Oct 8 21:25:51 2022] HEAD /identity/v3/domains/abe491a7c1e14354a2b33f397aea88bf/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:51.563497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483f2d8-7e42-42ef-9527-507e5e251bcd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:51.573498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483f2d8-7e42-42ef-9527-507e5e251bcd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.578197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b665561-bf1d-4be3-a758-354fab3d2bf9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.578837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b665561-bf1d-4be3-a758-354fab3d2bf9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.579119 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b665561-bf1d-4be3-a758-354fab3d2bf9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.579396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b665561-bf1d-4be3-a758-354fab3d2bf9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains/abe491a7c1e14354a2b33f397aea88bf/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.581601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b665561-bf1d-4be3-a758-354fab3d2bf9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=abe491a7c1e14354a2b33f397aea88bf, group_id=fd1f5b410b4243cba354e114e26e0627, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:51.584202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b665561-bf1d-4be3-a758-354fab3d2bf9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:51.589467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8b665561-bf1d-4be3-a758-354fab3d2bf9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role 7877a36cb2814b73b4aeadc4327e69f4 was removed from group fd1f5b410b4243cba354e114e26e0627 on domain abe491a7c1e14354a2b33f397aea88bf. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:51.589761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8b665561-bf1d-4be3-a758-354fab3d2bf9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:51.590420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8b665561-bf1d-4be3-a758-354fab3d2bf9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:51.607631 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4050/8114] 10.222.0.26 () {58 vars in 1467 bytes} [Sat Oct 8 21:25:51 2022] DELETE /identity/v3/domains/abe491a7c1e14354a2b33f397aea88bf/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:51.612687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6ceb6-7cd6-4a65-b7f4-056df7fcec3f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:51.614412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f6a6ceb6-7cd6-4a65-b7f4-056df7fcec3f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:51.623046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:51.629458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6ceb6-7cd6-4a65-b7f4-056df7fcec3f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.688477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cff1a-bf06-476a-8527-455b1926441d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.689136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cff1a-bf06-476a-8527-455b1926441d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.689454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cff1a-bf06-476a-8527-455b1926441d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.689735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cff1a-bf06-476a-8527-455b1926441d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects/893fe6519ae541ac92084e628c40954f/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.691918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cff1a-bf06-476a-8527-455b1926441d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_grant(project_id=893fe6519ae541ac92084e628c40954f, group_id=fd1f5b410b4243cba354e114e26e0627, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:51.694692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cff1a-bf06-476a-8527-455b1926441d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:51.707047 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4065/8115] 10.222.0.26 () {60 vars in 1486 bytes} [Sat Oct 8 21:25:51 2022] PUT /identity/v3/projects/893fe6519ae541ac92084e628c40954f/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:25:51.711233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b665561-bf1d-4be3-a758-354fab3d2bf9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:51.721284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b665561-bf1d-4be3-a758-354fab3d2bf9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.724843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:51.780200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032074b-7685-407b-8555-fe47505313da tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.780784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032074b-7685-407b-8555-fe47505313da tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.781062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032074b-7685-407b-8555-fe47505313da tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.781371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032074b-7685-407b-8555-fe47505313da tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects/893fe6519ae541ac92084e628c40954f/groups/fd1f5b410b4243cba354e114e26e0627/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.783008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032074b-7685-407b-8555-fe47505313da tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_grants(project_id=893fe6519ae541ac92084e628c40954f, group_id=fd1f5b410b4243cba354e114e26e0627)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:51.785838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032074b-7685-407b-8555-fe47505313da tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:51.797769 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4051/8116] 10.222.0.26 () {58 vars in 1368 bytes} [Sat Oct 8 21:25:51 2022] GET /identity/v3/projects/893fe6519ae541ac92084e628c40954f/groups/fd1f5b410b4243cba354e114e26e0627/roles => generated 411 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:51.802075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cff1a-bf06-476a-8527-455b1926441d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:51.813119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cff1a-bf06-476a-8527-455b1926441d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:51.817729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf53007-4aeb-4807-9037-844c860d5569 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:51.818372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf53007-4aeb-4807-9037-844c860d5569 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.818651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf53007-4aeb-4807-9037-844c860d5569 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.818923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf53007-4aeb-4807-9037-844c860d5569 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/groups/fd1f5b410b4243cba354e114e26e0627/users/b9f4aed4295c40a0ad5ec02809303b62` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.820998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf53007-4aeb-4807-9037-844c860d5569 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fd1f5b410b4243cba354e114e26e0627, user_id=b9f4aed4295c40a0ad5ec02809303b62)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:51.822904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf53007-4aeb-4807-9037-844c860d5569 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:51.845578 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4066/8117] 10.222.0.26 () {60 vars in 1360 bytes} [Sat Oct 8 21:25:51 2022] PUT /identity/v3/groups/fd1f5b410b4243cba354e114e26e0627/users/b9f4aed4295c40a0ad5ec02809303b62 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:51.849866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfa719-cc10-43c6-a538-493c43cf0feb None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:51.850151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfa719-cc10-43c6-a538-493c43cf0feb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:51.850427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfa719-cc10-43c6-a538-493c43cf0feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:51.888799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-66cfa719-cc10-43c6-a538-493c43cf0feb None None] MFA Rules not processed for user `b9f4aed4295c40a0ad5ec02809303b62`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:51.890042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-66cfa719-cc10-43c6-a538-493c43cf0feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:51.979356 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4052/8118] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:51.984125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf53007-4aeb-4807-9037-844c860d5569 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.047067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf53007-4aeb-4807-9037-844c860d5569 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.051679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d4d9a-bb9c-4072-b98a-396f9522c15f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.052333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4d9a-bb9c-4072-b98a-396f9522c15f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.052623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4d9a-bb9c-4072-b98a-396f9522c15f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.052904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4d9a-bb9c-4072-b98a-396f9522c15f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects/893fe6519ae541ac92084e628c40954f/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.055088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d4d9a-bb9c-4072-b98a-396f9522c15f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:check_grant(project_id=893fe6519ae541ac92084e628c40954f, group_id=fd1f5b410b4243cba354e114e26e0627, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.057750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d4d9a-bb9c-4072-b98a-396f9522c15f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.063472 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4067/8119] 10.222.0.26 () {58 vars in 1468 bytes} [Sat Oct 8 21:25:51 2022] HEAD /identity/v3/projects/893fe6519ae541ac92084e628c40954f/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:52.067834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfa719-cc10-43c6-a538-493c43cf0feb None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.079483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfa719-cc10-43c6-a538-493c43cf0feb None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.084313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f14ad-2862-44a8-9a71-8783679b15cd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.084970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f14ad-2862-44a8-9a71-8783679b15cd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.085774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f14ad-2862-44a8-9a71-8783679b15cd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.086053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f14ad-2862-44a8-9a71-8783679b15cd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects/893fe6519ae541ac92084e628c40954f/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.088194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f14ad-2862-44a8-9a71-8783679b15cd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=893fe6519ae541ac92084e628c40954f, group_id=fd1f5b410b4243cba354e114e26e0627, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.090883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f14ad-2862-44a8-9a71-8783679b15cd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.096120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f47f14ad-2862-44a8-9a71-8783679b15cd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role 7877a36cb2814b73b4aeadc4327e69f4 was removed from group fd1f5b410b4243cba354e114e26e0627 on project 893fe6519ae541ac92084e628c40954f. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:52.096413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f47f14ad-2862-44a8-9a71-8783679b15cd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:52.097074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f47f14ad-2862-44a8-9a71-8783679b15cd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:52.110738 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4053/8120] 10.222.0.26 () {58 vars in 1470 bytes} [Sat Oct 8 21:25:52 2022] DELETE /identity/v3/projects/893fe6519ae541ac92084e628c40954f/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:52.115002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d4d9a-bb9c-4072-b98a-396f9522c15f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.116791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-714d4d9a-bb9c-4072-b98a-396f9522c15f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:52.129823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d4d9a-bb9c-4072-b98a-396f9522c15f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.203398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ce14e-1bed-499a-b839-dad188ad6502 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.204058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce14e-1bed-499a-b839-dad188ad6502 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.204342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce14e-1bed-499a-b839-dad188ad6502 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.204621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce14e-1bed-499a-b839-dad188ad6502 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/groups/fd1f5b410b4243cba354e114e26e0627/users/b9f4aed4295c40a0ad5ec02809303b62` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.206350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ce14e-1bed-499a-b839-dad188ad6502 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=fd1f5b410b4243cba354e114e26e0627, user_id=b9f4aed4295c40a0ad5ec02809303b62)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.208282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ce14e-1bed-499a-b839-dad188ad6502 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.217141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f10ce14e-1bed-499a-b839-dad188ad6502 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b9f4aed4295c40a0ad5ec02809303b62'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:52.227252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:52.233712 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4068/8121] 10.222.0.26 () {58 vars in 1344 bytes} [Sat Oct 8 21:25:52 2022] DELETE /identity/v3/groups/fd1f5b410b4243cba354e114e26e0627/users/b9f4aed4295c40a0ad5ec02809303b62 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:52.239341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f14ad-2862-44a8-9a71-8783679b15cd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.249618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f14ad-2862-44a8-9a71-8783679b15cd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.282513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:52.307459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26836c-f2d7-40d5-8bf8-62e119e8e47a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.308015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26836c-f2d7-40d5-8bf8-62e119e8e47a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.308299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26836c-f2d7-40d5-8bf8-62e119e8e47a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.308578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26836c-f2d7-40d5-8bf8-62e119e8e47a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/system/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.310286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26836c-f2d7-40d5-8bf8-62e119e8e47a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=fd1f5b410b4243cba354e114e26e0627, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.311295 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-ea26836c-f2d7-40d5-8bf8-62e119e8e47a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:52.311295 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:25:52.311295 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:25:52.312185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26836c-f2d7-40d5-8bf8-62e119e8e47a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.319401 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4054/8122] 10.222.0.26 () {60 vars in 1381 bytes} [Sat Oct 8 21:25:52 2022] PUT /identity/v3/system/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:52.324180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ce14e-1bed-499a-b839-dad188ad6502 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.334799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ce14e-1bed-499a-b839-dad188ad6502 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.340315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7d84-97b9-4157-8f40-2c846e17392c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.340955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7d84-97b9-4157-8f40-2c846e17392c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.341274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7d84-97b9-4157-8f40-2c846e17392c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.341579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7d84-97b9-4157-8f40-2c846e17392c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/system/groups/fd1f5b410b4243cba354e114e26e0627/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.342762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c7d84-97b9-4157-8f40-2c846e17392c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=fd1f5b410b4243cba354e114e26e0627)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.343802 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-422c7d84-97b9-4157-8f40-2c846e17392c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:52.343802 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:52.343802 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:52.344680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c7d84-97b9-4157-8f40-2c846e17392c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.356557 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4069/8123] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:25:52 2022] GET /identity/v3/system/groups/fd1f5b410b4243cba354e114e26e0627/roles => generated 376 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:52.360664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26836c-f2d7-40d5-8bf8-62e119e8e47a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.370797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26836c-f2d7-40d5-8bf8-62e119e8e47a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.375463 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9ef64-910f-435b-91d3-1d34399680d7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.376092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9ef64-910f-435b-91d3-1d34399680d7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.376371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9ef64-910f-435b-91d3-1d34399680d7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.376643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9ef64-910f-435b-91d3-1d34399680d7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/system/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.378392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9ef64-910f-435b-91d3-1d34399680d7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=fd1f5b410b4243cba354e114e26e0627, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.379386 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-70c9ef64-910f-435b-91d3-1d34399680d7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:52.379386 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:25:52.379386 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:25:52.380253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9ef64-910f-435b-91d3-1d34399680d7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.386718 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4055/8124] 10.222.0.26 () {58 vars in 1363 bytes} [Sat Oct 8 21:25:52 2022] HEAD /identity/v3/system/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:52.390631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7d84-97b9-4157-8f40-2c846e17392c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.401865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7d84-97b9-4157-8f40-2c846e17392c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.406369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ec33e-1a71-48c6-a234-4ce8f878bd7f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.407318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ec33e-1a71-48c6-a234-4ce8f878bd7f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.407740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ec33e-1a71-48c6-a234-4ce8f878bd7f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.408021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ec33e-1a71-48c6-a234-4ce8f878bd7f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/system/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.409674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ec33e-1a71-48c6-a234-4ce8f878bd7f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=fd1f5b410b4243cba354e114e26e0627, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.410678 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-9b8ec33e-1a71-48c6-a234-4ce8f878bd7f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:52.410678 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:52.410678 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:52.411547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ec33e-1a71-48c6-a234-4ce8f878bd7f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.419400 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4070/8125] 10.222.0.26 () {58 vars in 1365 bytes} [Sat Oct 8 21:25:52 2022] DELETE /identity/v3/system/groups/fd1f5b410b4243cba354e114e26e0627/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:52.424231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9ef64-910f-435b-91d3-1d34399680d7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.434329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9ef64-910f-435b-91d3-1d34399680d7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.438837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e673803-64b8-4150-a4d9-95b9c6c8a8ac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.439513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e673803-64b8-4150-a4d9-95b9c6c8a8ac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.439795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e673803-64b8-4150-a4d9-95b9c6c8a8ac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.440070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e673803-64b8-4150-a4d9-95b9c6c8a8ac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains/abe491a7c1e14354a2b33f397aea88bf/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.442350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e673803-64b8-4150-a4d9-95b9c6c8a8ac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=abe491a7c1e14354a2b33f397aea88bf, user_id=b9f4aed4295c40a0ad5ec02809303b62, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.445475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e673803-64b8-4150-a4d9-95b9c6c8a8ac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.458015 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4056/8126] 10.222.0.26 () {60 vars in 1480 bytes} [Sat Oct 8 21:25:52 2022] PUT /identity/v3/domains/abe491a7c1e14354a2b33f397aea88bf/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:52.466210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ec33e-1a71-48c6-a234-4ce8f878bd7f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.473361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ec33e-1a71-48c6-a234-4ce8f878bd7f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.533362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b391f5-cf44-4c40-9663-6b42efc1d995 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.534392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b391f5-cf44-4c40-9663-6b42efc1d995 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.534905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b391f5-cf44-4c40-9663-6b42efc1d995 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.535337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b391f5-cf44-4c40-9663-6b42efc1d995 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains/abe491a7c1e14354a2b33f397aea88bf/users/b9f4aed4295c40a0ad5ec02809303b62/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.537049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b391f5-cf44-4c40-9663-6b42efc1d995 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=abe491a7c1e14354a2b33f397aea88bf, user_id=b9f4aed4295c40a0ad5ec02809303b62)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.539706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b391f5-cf44-4c40-9663-6b42efc1d995 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.552577 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4071/8127] 10.222.0.26 () {58 vars in 1362 bytes} [Sat Oct 8 21:25:52 2022] GET /identity/v3/domains/abe491a7c1e14354a2b33f397aea88bf/users/b9f4aed4295c40a0ad5ec02809303b62/roles => generated 409 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:52.557039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e673803-64b8-4150-a4d9-95b9c6c8a8ac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.567372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e673803-64b8-4150-a4d9-95b9c6c8a8ac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.572535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e66039-8418-473a-b3a0-e025863c5958 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.573163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e66039-8418-473a-b3a0-e025863c5958 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.573500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e66039-8418-473a-b3a0-e025863c5958 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.573774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e66039-8418-473a-b3a0-e025863c5958 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains/abe491a7c1e14354a2b33f397aea88bf/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.575943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e66039-8418-473a-b3a0-e025863c5958 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=abe491a7c1e14354a2b33f397aea88bf, user_id=b9f4aed4295c40a0ad5ec02809303b62, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.578607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e66039-8418-473a-b3a0-e025863c5958 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.584640 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4057/8128] 10.222.0.26 () {58 vars in 1462 bytes} [Sat Oct 8 21:25:52 2022] HEAD /identity/v3/domains/abe491a7c1e14354a2b33f397aea88bf/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:52.589316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b391f5-cf44-4c40-9663-6b42efc1d995 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.599337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b391f5-cf44-4c40-9663-6b42efc1d995 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.604696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6710e-3f32-4e86-8260-94871efd7730 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.605382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6710e-3f32-4e86-8260-94871efd7730 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.605668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6710e-3f32-4e86-8260-94871efd7730 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.605948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6710e-3f32-4e86-8260-94871efd7730 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains/abe491a7c1e14354a2b33f397aea88bf/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.608412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6710e-3f32-4e86-8260-94871efd7730 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=abe491a7c1e14354a2b33f397aea88bf, user_id=b9f4aed4295c40a0ad5ec02809303b62, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.611086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6710e-3f32-4e86-8260-94871efd7730 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.616314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f8b6710e-3f32-4e86-8260-94871efd7730 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role 7877a36cb2814b73b4aeadc4327e69f4 was removed from user b9f4aed4295c40a0ad5ec02809303b62 on domain abe491a7c1e14354a2b33f397aea88bf. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:52.616630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f8b6710e-3f32-4e86-8260-94871efd7730 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:52.617324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f8b6710e-3f32-4e86-8260-94871efd7730 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:52.631519 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4072/8129] 10.222.0.26 () {58 vars in 1464 bytes} [Sat Oct 8 21:25:52 2022] DELETE /identity/v3/domains/abe491a7c1e14354a2b33f397aea88bf/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:52.637028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e66039-8418-473a-b3a0-e025863c5958 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.638790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d6e66039-8418-473a-b3a0-e025863c5958 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:52.653083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e66039-8418-473a-b3a0-e025863c5958 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.709237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feabf4f-136a-4035-8e6a-002f0a91c9b7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.709898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feabf4f-136a-4035-8e6a-002f0a91c9b7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.710175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feabf4f-136a-4035-8e6a-002f0a91c9b7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.710451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feabf4f-136a-4035-8e6a-002f0a91c9b7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.712681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feabf4f-136a-4035-8e6a-002f0a91c9b7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_grant(project_id=893fe6519ae541ac92084e628c40954f, user_id=b9f4aed4295c40a0ad5ec02809303b62, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.715336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feabf4f-136a-4035-8e6a-002f0a91c9b7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.728950 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4058/8130] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:52 2022] PUT /identity/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:52.733343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6710e-3f32-4e86-8260-94871efd7730 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.743994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6710e-3f32-4e86-8260-94871efd7730 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.799092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25cdf8-4884-4818-9d6a-0dcc6964a310 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.799735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25cdf8-4884-4818-9d6a-0dcc6964a310 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.800013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25cdf8-4884-4818-9d6a-0dcc6964a310 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.800286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25cdf8-4884-4818-9d6a-0dcc6964a310 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.801971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25cdf8-4884-4818-9d6a-0dcc6964a310 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_grants(project_id=893fe6519ae541ac92084e628c40954f, user_id=b9f4aed4295c40a0ad5ec02809303b62)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.805106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25cdf8-4884-4818-9d6a-0dcc6964a310 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.816054 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4073/8131] 10.222.0.26 () {58 vars in 1365 bytes} [Sat Oct 8 21:25:52 2022] GET /identity/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles => generated 410 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:52.820454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feabf4f-136a-4035-8e6a-002f0a91c9b7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.830673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feabf4f-136a-4035-8e6a-002f0a91c9b7 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.835797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3a07d-8762-44ff-8d0c-ab97d5a33d91 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.836439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a07d-8762-44ff-8d0c-ab97d5a33d91 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.836723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a07d-8762-44ff-8d0c-ab97d5a33d91 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.837002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a07d-8762-44ff-8d0c-ab97d5a33d91 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.839200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3a07d-8762-44ff-8d0c-ab97d5a33d91 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:check_grant(project_id=893fe6519ae541ac92084e628c40954f, user_id=b9f4aed4295c40a0ad5ec02809303b62, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.841833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3a07d-8762-44ff-8d0c-ab97d5a33d91 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.847465 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4059/8132] 10.222.0.26 () {58 vars in 1465 bytes} [Sat Oct 8 21:25:52 2022] HEAD /identity/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:52.851867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25cdf8-4884-4818-9d6a-0dcc6964a310 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.861954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25cdf8-4884-4818-9d6a-0dcc6964a310 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.866583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300ed9a-62dc-4a95-9916-f59e153f2312 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.867205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300ed9a-62dc-4a95-9916-f59e153f2312 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.867477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300ed9a-62dc-4a95-9916-f59e153f2312 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.867749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300ed9a-62dc-4a95-9916-f59e153f2312 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.869928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300ed9a-62dc-4a95-9916-f59e153f2312 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=893fe6519ae541ac92084e628c40954f, user_id=b9f4aed4295c40a0ad5ec02809303b62, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.872519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300ed9a-62dc-4a95-9916-f59e153f2312 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.877634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0300ed9a-62dc-4a95-9916-f59e153f2312 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role 7877a36cb2814b73b4aeadc4327e69f4 was removed from user b9f4aed4295c40a0ad5ec02809303b62 on project 893fe6519ae541ac92084e628c40954f. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:52.877922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0300ed9a-62dc-4a95-9916-f59e153f2312 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:52.878573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0300ed9a-62dc-4a95-9916-f59e153f2312 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:52.891606 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4074/8133] 10.222.0.26 () {58 vars in 1467 bytes} [Sat Oct 8 21:25:52 2022] DELETE /identity/v3/projects/893fe6519ae541ac92084e628c40954f/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:52.896518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3a07d-8762-44ff-8d0c-ab97d5a33d91 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.898872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4cb3a07d-8762-44ff-8d0c-ab97d5a33d91 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:52.911428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3a07d-8762-44ff-8d0c-ab97d5a33d91 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:52.968611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee3c04-7e8f-4b27-b030-075319f2a715 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:52.969273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3c04-7e8f-4b27-b030-075319f2a715 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:52.969552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3c04-7e8f-4b27-b030-075319f2a715 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:52.969823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3c04-7e8f-4b27-b030-075319f2a715 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/system/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:52.971474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee3c04-7e8f-4b27-b030-075319f2a715 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b9f4aed4295c40a0ad5ec02809303b62, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:52.972465 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-d1ee3c04-7e8f-4b27-b030-075319f2a715 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:52.972465 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:25:52.972465 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:25:52.973372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee3c04-7e8f-4b27-b030-075319f2a715 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:52.980732 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4060/8134] 10.222.0.26 () {60 vars in 1378 bytes} [Sat Oct 8 21:25:52 2022] PUT /identity/v3/system/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:52.985418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300ed9a-62dc-4a95-9916-f59e153f2312 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:52.995424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300ed9a-62dc-4a95-9916-f59e153f2312 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.000052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c122d7-d897-46b8-a9d5-53006e859a46 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.000688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c122d7-d897-46b8-a9d5-53006e859a46 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.000966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c122d7-d897-46b8-a9d5-53006e859a46 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.001263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c122d7-d897-46b8-a9d5-53006e859a46 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/system/users/b9f4aed4295c40a0ad5ec02809303b62/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.002441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c122d7-d897-46b8-a9d5-53006e859a46 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=b9f4aed4295c40a0ad5ec02809303b62)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.003475 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-03c122d7-d897-46b8-a9d5-53006e859a46 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:53.003475 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:53.003475 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:53.004414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c122d7-d897-46b8-a9d5-53006e859a46 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.016425 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4075/8135] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:25:52 2022] GET /identity/v3/system/users/b9f4aed4295c40a0ad5ec02809303b62/roles => generated 375 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:25:53.020485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee3c04-7e8f-4b27-b030-075319f2a715 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.030958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee3c04-7e8f-4b27-b030-075319f2a715 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.035615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9756e85-af2a-4e2c-be96-651cf88c4404 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.036243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9756e85-af2a-4e2c-be96-651cf88c4404 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.036521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9756e85-af2a-4e2c-be96-651cf88c4404 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.036790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9756e85-af2a-4e2c-be96-651cf88c4404 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/system/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.039618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9756e85-af2a-4e2c-be96-651cf88c4404 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=b9f4aed4295c40a0ad5ec02809303b62, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.040643 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-a9756e85-af2a-4e2c-be96-651cf88c4404 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:53.040643 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:25:53.040643 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:25:53.041546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9756e85-af2a-4e2c-be96-651cf88c4404 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.046586 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4061/8136] 10.222.0.26 () {58 vars in 1360 bytes} [Sat Oct 8 21:25:53 2022] HEAD /identity/v3/system/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:25:53.050581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c122d7-d897-46b8-a9d5-53006e859a46 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.060442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c122d7-d897-46b8-a9d5-53006e859a46 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.065087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440942-e37e-4117-a6a3-9b2bc9b18a94 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.065777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440942-e37e-4117-a6a3-9b2bc9b18a94 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.066056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440942-e37e-4117-a6a3-9b2bc9b18a94 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.066325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440942-e37e-4117-a6a3-9b2bc9b18a94 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/system/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.068003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74440942-e37e-4117-a6a3-9b2bc9b18a94 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=b9f4aed4295c40a0ad5ec02809303b62, role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.069001 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-74440942-e37e-4117-a6a3-9b2bc9b18a94 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:53.069001 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:53.069001 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:53.070521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74440942-e37e-4117-a6a3-9b2bc9b18a94 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.072111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:53.078389 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4076/8137] 10.222.0.26 () {58 vars in 1362 bytes} [Sat Oct 8 21:25:53 2022] DELETE /identity/v3/system/users/b9f4aed4295c40a0ad5ec02809303b62/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:53.083264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9756e85-af2a-4e2c-be96-651cf88c4404 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.093974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9756e85-af2a-4e2c-be96-651cf88c4404 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.098554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a322f17-994a-4279-b1e3-ac4f00f6c4fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.099140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a322f17-994a-4279-b1e3-ac4f00f6c4fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.099415 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a322f17-994a-4279-b1e3-ac4f00f6c4fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.099682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a322f17-994a-4279-b1e3-ac4f00f6c4fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.100334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a322f17-994a-4279-b1e3-ac4f00f6c4fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.101965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a322f17-994a-4279-b1e3-ac4f00f6c4fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.116574 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4062/8138] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:25:53 2022] POST /identity/v3/roles => generated 270 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:53.120500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440942-e37e-4117-a6a3-9b2bc9b18a94 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.130265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440942-e37e-4117-a6a3-9b2bc9b18a94 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.135432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65931d43-b4b0-447b-859e-aa9be667a568 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.136014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931d43-b4b0-447b-859e-aa9be667a568 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.136294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931d43-b4b0-447b-859e-aa9be667a568 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.136570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931d43-b4b0-447b-859e-aa9be667a568 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.137260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65931d43-b4b0-447b-859e-aa9be667a568 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.138257 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-65931d43-b4b0-447b-859e-aa9be667a568 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:53.138257 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:53.138257 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:53.139131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65931d43-b4b0-447b-859e-aa9be667a568 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.157078 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4077/8139] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:25:53 2022] POST /identity/v3/roles => generated 268 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:53.158270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a322f17-994a-4279-b1e3-ac4f00f6c4fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.168296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a322f17-994a-4279-b1e3-ac4f00f6c4fb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.172989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc5394-3f9e-485b-8700-ca76375876e0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.173679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc5394-3f9e-485b-8700-ca76375876e0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.173964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc5394-3f9e-485b-8700-ca76375876e0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.174235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc5394-3f9e-485b-8700-ca76375876e0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/a21a96ee7e73465f8f1fcb625dc49101/implies/8ec05863596744f78c73b185bacca6bf` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.175867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc5394-3f9e-485b-8700-ca76375876e0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=a21a96ee7e73465f8f1fcb625dc49101, implied_role_id=8ec05863596744f78c73b185bacca6bf)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.177472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc5394-3f9e-485b-8700-ca76375876e0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.178678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:53.204219 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4063/8140] 10.222.0.26 () {60 vars in 1363 bytes} [Sat Oct 8 21:25:53 2022] PUT /identity/v3/roles/a21a96ee7e73465f8f1fcb625dc49101/implies/8ec05863596744f78c73b185bacca6bf => generated 529 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:53.208519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65931d43-b4b0-447b-859e-aa9be667a568 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.219342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65931d43-b4b0-447b-859e-aa9be667a568 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.278149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fb515-10aa-48cd-8da0-57dd0bb30399 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.278859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fb515-10aa-48cd-8da0-57dd0bb30399 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.279140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fb515-10aa-48cd-8da0-57dd0bb30399 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.279414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fb515-10aa-48cd-8da0-57dd0bb30399 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.280105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fb515-10aa-48cd-8da0-57dd0bb30399 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.281760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fb515-10aa-48cd-8da0-57dd0bb30399 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.297289 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4078/8141] 10.222.0.26 () {60 vars in 1149 bytes} [Sat Oct 8 21:25:53 2022] POST /identity/v3/domains => generated 277 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:53.301505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc5394-3f9e-485b-8700-ca76375876e0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.312014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc5394-3f9e-485b-8700-ca76375876e0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.371001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb908d-96b2-4a34-aae6-dc0744bcdde3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.371621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb908d-96b2-4a34-aae6-dc0744bcdde3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.371900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb908d-96b2-4a34-aae6-dc0744bcdde3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.372174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb908d-96b2-4a34-aae6-dc0744bcdde3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.372850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb908d-96b2-4a34-aae6-dc0744bcdde3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.374544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb908d-96b2-4a34-aae6-dc0744bcdde3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.389994 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4064/8142] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:25:53 2022] POST /identity/v3/roles => generated 269 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:53.394102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fb515-10aa-48cd-8da0-57dd0bb30399 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.405419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fb515-10aa-48cd-8da0-57dd0bb30399 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.410642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80727f28-7a4c-48bc-9c68-fda7844f3c3d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.411302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80727f28-7a4c-48bc-9c68-fda7844f3c3d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.411604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80727f28-7a4c-48bc-9c68-fda7844f3c3d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.411887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80727f28-7a4c-48bc-9c68-fda7844f3c3d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/a21a96ee7e73465f8f1fcb625dc49101/implies/570e19152d4e42599666a10c1c50c059` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.413890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80727f28-7a4c-48bc-9c68-fda7844f3c3d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=a21a96ee7e73465f8f1fcb625dc49101, implied_role_id=570e19152d4e42599666a10c1c50c059)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.414936 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-80727f28-7a4c-48bc-9c68-fda7844f3c3d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:53.414936 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:53.414936 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:53.415820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80727f28-7a4c-48bc-9c68-fda7844f3c3d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.448069 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4079/8143] 10.222.0.26 () {60 vars in 1363 bytes} [Sat Oct 8 21:25:53 2022] PUT /identity/v3/roles/a21a96ee7e73465f8f1fcb625dc49101/implies/570e19152d4e42599666a10c1c50c059 => generated 530 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:53.449251 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb908d-96b2-4a34-aae6-dc0744bcdde3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.459991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb908d-96b2-4a34-aae6-dc0744bcdde3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.531486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c75f5-4e23-44ee-9d45-7afb643a2f06 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.532139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c75f5-4e23-44ee-9d45-7afb643a2f06 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.532503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c75f5-4e23-44ee-9d45-7afb643a2f06 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.532781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c75f5-4e23-44ee-9d45-7afb643a2f06 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/a21a96ee7e73465f8f1fcb625dc49101/implies/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.534542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c75f5-4e23-44ee-9d45-7afb643a2f06 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=a21a96ee7e73465f8f1fcb625dc49101, implied_role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.536108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c75f5-4e23-44ee-9d45-7afb643a2f06 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.561671 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4065/8144] 10.222.0.26 () {60 vars in 1363 bytes} [Sat Oct 8 21:25:53 2022] PUT /identity/v3/roles/a21a96ee7e73465f8f1fcb625dc49101/implies/7877a36cb2814b73b4aeadc4327e69f4 => generated 526 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:53.566011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80727f28-7a4c-48bc-9c68-fda7844f3c3d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.578046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80727f28-7a4c-48bc-9c68-fda7844f3c3d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.636142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94051f6-679c-4069-9133-754f2a0cd95e tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.636791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94051f6-679c-4069-9133-754f2a0cd95e tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.637071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94051f6-679c-4069-9133-754f2a0cd95e tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.637376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94051f6-679c-4069-9133-754f2a0cd95e tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/7877a36cb2814b73b4aeadc4327e69f4/implies/a21a96ee7e73465f8f1fcb625dc49101` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.639005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94051f6-679c-4069-9133-754f2a0cd95e tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7877a36cb2814b73b4aeadc4327e69f4, implied_role_id=a21a96ee7e73465f8f1fcb625dc49101)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.640591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94051f6-679c-4069-9133-754f2a0cd95e tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-a94051f6-679c-4069-9133-754f2a0cd95e tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] a21a96ee7e73465f8f1fcb625dc49101 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: a21a96ee7e73465f8f1fcb625dc49101 cannot be an implied roles. Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 08 21:25:53.659298 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 08 21:25:53.660262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:25:53.660262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:25:53.660262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 08 21:25:53.660262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 08 21:25:53.660262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: a21a96ee7e73465f8f1fcb625dc49101 cannot be an implied roles. Oct 08 21:25:53.660262 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:53.660675 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4080/8145] 10.222.0.26 () {60 vars in 1363 bytes} [Sat Oct 8 21:25:53 2022] PUT /identity/v3/roles/7877a36cb2814b73b4aeadc4327e69f4/implies/a21a96ee7e73465f8f1fcb625dc49101 => generated 116 bytes in 95 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 08 21:25:53.665314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c75f5-4e23-44ee-9d45-7afb643a2f06 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.675774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c75f5-4e23-44ee-9d45-7afb643a2f06 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.681002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61d33c-e92d-4166-abfd-b0d24ad09050 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.681673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61d33c-e92d-4166-abfd-b0d24ad09050 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.681960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61d33c-e92d-4166-abfd-b0d24ad09050 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.682236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61d33c-e92d-4166-abfd-b0d24ad09050 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/a21a96ee7e73465f8f1fcb625dc49101/implies/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.683872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61d33c-e92d-4166-abfd-b0d24ad09050 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=a21a96ee7e73465f8f1fcb625dc49101, implied_role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.686166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61d33c-e92d-4166-abfd-b0d24ad09050 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.696482 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4066/8146] 10.222.0.26 () {58 vars in 1347 bytes} [Sat Oct 8 21:25:53 2022] DELETE /identity/v3/roles/a21a96ee7e73465f8f1fcb625dc49101/implies/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:53.700660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94051f6-679c-4069-9133-754f2a0cd95e tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.711910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94051f6-679c-4069-9133-754f2a0cd95e tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.753109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:53.774311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b3770-2cc7-4bc8-ad41-379574f4131b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.775661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b3770-2cc7-4bc8-ad41-379574f4131b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.775661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b3770-2cc7-4bc8-ad41-379574f4131b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.775661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b3770-2cc7-4bc8-ad41-379574f4131b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/a21a96ee7e73465f8f1fcb625dc49101/implies/570e19152d4e42599666a10c1c50c059` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.777640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b3770-2cc7-4bc8-ad41-379574f4131b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=a21a96ee7e73465f8f1fcb625dc49101, implied_role_id=570e19152d4e42599666a10c1c50c059)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.778794 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-c81b3770-2cc7-4bc8-ad41-379574f4131b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:53.778794 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:53.778794 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:53.779933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b3770-2cc7-4bc8-ad41-379574f4131b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.793918 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4081/8147] 10.222.0.26 () {58 vars in 1347 bytes} [Sat Oct 8 21:25:53 2022] DELETE /identity/v3/roles/a21a96ee7e73465f8f1fcb625dc49101/implies/570e19152d4e42599666a10c1c50c059 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:53.795162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61d33c-e92d-4166-abfd-b0d24ad09050 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.806560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61d33c-e92d-4166-abfd-b0d24ad09050 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.850533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:53.870491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc02fc-6109-4173-8f6c-ab0c6affe4ed tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.871056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc02fc-6109-4173-8f6c-ab0c6affe4ed tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.871337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc02fc-6109-4173-8f6c-ab0c6affe4ed tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.871611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc02fc-6109-4173-8f6c-ab0c6affe4ed tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/570e19152d4e42599666a10c1c50c059` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:53.872820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc02fc-6109-4173-8f6c-ab0c6affe4ed tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=570e19152d4e42599666a10c1c50c059)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:53.874514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc02fc-6109-4173-8f6c-ab0c6affe4ed tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:53.910752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fabc02fc-6109-4173-8f6c-ab0c6affe4ed tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role 570e19152d4e42599666a10c1c50c059 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:53.911044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fabc02fc-6109-4173-8f6c-ab0c6affe4ed tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:53.911720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fabc02fc-6109-4173-8f6c-ab0c6affe4ed tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:53.914112 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4067/8148] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:53 2022] DELETE /identity/v3/roles/570e19152d4e42599666a10c1c50c059 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:53.918467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b3770-2cc7-4bc8-ad41-379574f4131b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:53.920199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c81b3770-2cc7-4bc8-ad41-379574f4131b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:53.934564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b3770-2cc7-4bc8-ad41-379574f4131b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:53.993435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71defb-ecd4-4e8b-9b50-d45eb1d4a84b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:53.994293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71defb-ecd4-4e8b-9b50-d45eb1d4a84b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:53.994644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71defb-ecd4-4e8b-9b50-d45eb1d4a84b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:53.994921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71defb-ecd4-4e8b-9b50-d45eb1d4a84b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains/011b2246dbcc4629829a3a65d5212d11` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:54.006870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71defb-ecd4-4e8b-9b50-d45eb1d4a84b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=011b2246dbcc4629829a3a65d5212d11)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:54.008525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71defb-ecd4-4e8b-9b50-d45eb1d4a84b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:54.028815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a71defb-ecd4-4e8b-9b50-d45eb1d4a84b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '011b2246dbcc4629829a3a65d5212d11'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.029529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a71defb-ecd4-4e8b-9b50-d45eb1d4a84b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '011b2246dbcc4629829a3a65d5212d11'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.054576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a71defb-ecd4-4e8b-9b50-d45eb1d4a84b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '011b2246dbcc4629829a3a65d5212d11'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.055216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a71defb-ecd4-4e8b-9b50-d45eb1d4a84b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '011b2246dbcc4629829a3a65d5212d11'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.057712 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4082/8149] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:25:53 2022] PATCH /identity/v3/domains/011b2246dbcc4629829a3a65d5212d11 => generated 278 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:25:54.061860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc02fc-6109-4173-8f6c-ab0c6affe4ed tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:54.071926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc02fc-6109-4173-8f6c-ab0c6affe4ed tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:54.133499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:54.134050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:54.134330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:54.134606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains/011b2246dbcc4629829a3a65d5212d11` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:54.144951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=011b2246dbcc4629829a3a65d5212d11)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:54.146585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:54.169254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '011b2246dbcc4629829a3a65d5212d11'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.178890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '011b2246dbcc4629829a3a65d5212d11'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.218538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011b2246dbcc4629829a3a65d5212d11', 'request_id': 'req-d761671f-2dc7-4063-aff2-431a28b0fb21'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.226490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011b2246dbcc4629829a3a65d5212d11', 'request_id': 'req-d761671f-2dc7-4063-aff2-431a28b0fb21'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.232254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011b2246dbcc4629829a3a65d5212d11', 'request_id': 'req-d761671f-2dc7-4063-aff2-431a28b0fb21'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.243613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] The token cache is being invalidate because project 011b2246dbcc4629829a3a65d5212d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:54.243897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.244542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.248559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:54.252658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '011b2246dbcc4629829a3a65d5212d11', 'request_id': 'req-d761671f-2dc7-4063-aff2-431a28b0fb21'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.256761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '011b2246dbcc4629829a3a65d5212d11', 'request_id': 'req-d761671f-2dc7-4063-aff2-431a28b0fb21'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.257765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '011b2246dbcc4629829a3a65d5212d11', 'request_id': 'req-d761671f-2dc7-4063-aff2-431a28b0fb21'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.263882 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4068/8150] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:25:54 2022] DELETE /identity/v3/domains/011b2246dbcc4629829a3a65d5212d11 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:54.268050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71defb-ecd4-4e8b-9b50-d45eb1d4a84b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:54.269534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0a71defb-ecd4-4e8b-9b50-d45eb1d4a84b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:54.282435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71defb-ecd4-4e8b-9b50-d45eb1d4a84b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:54.337923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea711d49-8037-4b7c-90b5-f9111a658e45 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:54.338582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea711d49-8037-4b7c-90b5-f9111a658e45 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:54.338869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea711d49-8037-4b7c-90b5-f9111a658e45 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:54.339148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea711d49-8037-4b7c-90b5-f9111a658e45 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/a21a96ee7e73465f8f1fcb625dc49101/implies/8ec05863596744f78c73b185bacca6bf` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:54.340844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea711d49-8037-4b7c-90b5-f9111a658e45 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=a21a96ee7e73465f8f1fcb625dc49101, implied_role_id=8ec05863596744f78c73b185bacca6bf)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:54.342458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea711d49-8037-4b7c-90b5-f9111a658e45 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:54.351478 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4083/8151] 10.222.0.26 () {58 vars in 1347 bytes} [Sat Oct 8 21:25:54 2022] DELETE /identity/v3/roles/a21a96ee7e73465f8f1fcb625dc49101/implies/8ec05863596744f78c73b185bacca6bf => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:54.355557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:54.357241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:54.369830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761671f-2dc7-4063-aff2-431a28b0fb21 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:54.425831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017363b-d0e0-4fa6-9c77-8f89a891fd07 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:54.426385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017363b-d0e0-4fa6-9c77-8f89a891fd07 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:54.426663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017363b-d0e0-4fa6-9c77-8f89a891fd07 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:54.426934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017363b-d0e0-4fa6-9c77-8f89a891fd07 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/8ec05863596744f78c73b185bacca6bf` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:54.428050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017363b-d0e0-4fa6-9c77-8f89a891fd07 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=8ec05863596744f78c73b185bacca6bf)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:54.429790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017363b-d0e0-4fa6-9c77-8f89a891fd07 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:54.462710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b017363b-d0e0-4fa6-9c77-8f89a891fd07 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role 8ec05863596744f78c73b185bacca6bf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:54.462994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b017363b-d0e0-4fa6-9c77-8f89a891fd07 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.463637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b017363b-d0e0-4fa6-9c77-8f89a891fd07 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.465481 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4069/8152] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:54 2022] DELETE /identity/v3/roles/8ec05863596744f78c73b185bacca6bf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:54.469517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea711d49-8037-4b7c-90b5-f9111a658e45 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:54.471169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ea711d49-8037-4b7c-90b5-f9111a658e45 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:54.489634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea711d49-8037-4b7c-90b5-f9111a658e45 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:54.518177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:54.547849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cdc70-d291-49d8-a2b8-360292589393 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:54.548480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cdc70-d291-49d8-a2b8-360292589393 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:54.548764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cdc70-d291-49d8-a2b8-360292589393 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:54.549039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cdc70-d291-49d8-a2b8-360292589393 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/a21a96ee7e73465f8f1fcb625dc49101` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:54.550194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cdc70-d291-49d8-a2b8-360292589393 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=a21a96ee7e73465f8f1fcb625dc49101)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:54.551209 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-b81cdc70-d291-49d8-a2b8-360292589393 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:54.551209 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:54.551209 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:54.552105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cdc70-d291-49d8-a2b8-360292589393 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:54.589424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b81cdc70-d291-49d8-a2b8-360292589393 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role a21a96ee7e73465f8f1fcb625dc49101 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:54.590072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b81cdc70-d291-49d8-a2b8-360292589393 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.590365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-b81cdc70-d291-49d8-a2b8-360292589393 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:54.592160 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4084/8153] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:54 2022] DELETE /identity/v3/roles/a21a96ee7e73465f8f1fcb625dc49101 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:54.597706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017363b-d0e0-4fa6-9c77-8f89a891fd07 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:54.607984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017363b-d0e0-4fa6-9c77-8f89a891fd07 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:54.664349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c9545-0ff2-4164-b412-fe6519e68908 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:54.664995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c9545-0ff2-4164-b412-fe6519e68908 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:54.665324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c9545-0ff2-4164-b412-fe6519e68908 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:54.665873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c9545-0ff2-4164-b412-fe6519e68908 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:54.667269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c9545-0ff2-4164-b412-fe6519e68908 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:54.668867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c9545-0ff2-4164-b412-fe6519e68908 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:54.695538 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4070/8154] 10.222.0.26 () {60 vars in 1363 bytes} [Sat Oct 8 21:25:54 2022] PUT /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401 => generated 519 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:54.696632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cdc70-d291-49d8-a2b8-360292589393 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:54.698079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b81cdc70-d291-49d8-a2b8-360292589393 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:54.710972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cdc70-d291-49d8-a2b8-360292589393 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:54.765925 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ebb0c-1927-4dd8-b3bc-ab0ea9115031 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:54.766564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ebb0c-1927-4dd8-b3bc-ab0ea9115031 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `HEAD` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:54.766843 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ebb0c-1927-4dd8-b3bc-ab0ea9115031 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:54.767115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ebb0c-1927-4dd8-b3bc-ab0ea9115031 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:54.768720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ebb0c-1927-4dd8-b3bc-ab0ea9115031 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:54.769754 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-e27ebb0c-1927-4dd8-b3bc-ab0ea9115031 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:54.769754 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:54.769754 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:54.770631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ebb0c-1927-4dd8-b3bc-ab0ea9115031 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:54.771512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ebb0c-1927-4dd8-b3bc-ab0ea9115031 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:54.772370 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-e27ebb0c-1927-4dd8-b3bc-ab0ea9115031 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:54.772370 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:54.772370 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:54.773825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ebb0c-1927-4dd8-b3bc-ab0ea9115031 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:54.779261 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4085/8155] 10.222.0.26 () {58 vars in 1345 bytes} [Sat Oct 8 21:25:54 2022] HEAD /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:54.783416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c9545-0ff2-4164-b412-fe6519e68908 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:54.793660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c9545-0ff2-4164-b412-fe6519e68908 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:54.798535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48aabf-e2cf-49fa-a040-11800b938341 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:54.799165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48aabf-e2cf-49fa-a040-11800b938341 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:54.799448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48aabf-e2cf-49fa-a040-11800b938341 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:54.799724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48aabf-e2cf-49fa-a040-11800b938341 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:54.801412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48aabf-e2cf-49fa-a040-11800b938341 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:54.802417 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-ce48aabf-e2cf-49fa-a040-11800b938341 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:54.802417 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:25:54.802417 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:25:54.803298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48aabf-e2cf-49fa-a040-11800b938341 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:54.808730 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4071/8156] 10.222.0.26 () {58 vars in 1344 bytes} [Sat Oct 8 21:25:54 2022] GET /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401 => generated 519 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:54.812688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ebb0c-1927-4dd8-b3bc-ab0ea9115031 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:54.823022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ebb0c-1927-4dd8-b3bc-ab0ea9115031 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:54.827636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45351a-87c2-4161-9ff0-47fb16a25d4d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:54.828247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45351a-87c2-4161-9ff0-47fb16a25d4d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:54.828526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45351a-87c2-4161-9ff0-47fb16a25d4d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:54.828797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45351a-87c2-4161-9ff0-47fb16a25d4d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:54.830416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45351a-87c2-4161-9ff0-47fb16a25d4d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:54.831976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45351a-87c2-4161-9ff0-47fb16a25d4d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:54.840571 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4086/8157] 10.222.0.26 () {58 vars in 1347 bytes} [Sat Oct 8 21:25:54 2022] DELETE /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:54.844612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48aabf-e2cf-49fa-a040-11800b938341 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:54.854591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48aabf-e2cf-49fa-a040-11800b938341 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:54.876530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:54.913093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063f730-1cff-466b-b9e1-337894dd2ad3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:54.913780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063f730-1cff-466b-b9e1-337894dd2ad3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:54.914061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063f730-1cff-466b-b9e1-337894dd2ad3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:54.914335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063f730-1cff-466b-b9e1-337894dd2ad3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:54.915938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063f730-1cff-466b-b9e1-337894dd2ad3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:54.917547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063f730-1cff-466b-b9e1-337894dd2ad3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-b063f730-1cff-466b-b9e1-337894dd2ad3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] b78f3fb4994b4701a5e5a7758e3e6d28 does not imply 4ad11af1fafe4aceb9f53d0240690401.: keystone.exception.ImpliedRoleNotFound: b78f3fb4994b4701a5e5a7758e3e6d28 does not imply 4ad11af1fafe4aceb9f53d0240690401. Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = query.one() Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._iter().one() Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._only_one_row( Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:54.925644 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 08 21:25:54.926857 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 08 21:25:54.927905 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 08 21:25:54.927905 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: b78f3fb4994b4701a5e5a7758e3e6d28 does not imply 4ad11af1fafe4aceb9f53d0240690401. Oct 08 21:25:54.927905 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:25:54.927905 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4072/8158] 10.222.0.26 () {58 vars in 1344 bytes} [Sat Oct 8 21:25:54 2022] GET /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401 => generated 137 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 08 21:25:54.931621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45351a-87c2-4161-9ff0-47fb16a25d4d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:54.942027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45351a-87c2-4161-9ff0-47fb16a25d4d tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:54.947307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ccc30-d9ce-4d33-99a9-507e6d2cf0d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:54.947877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ccc30-d9ce-4d33-99a9-507e6d2cf0d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:54.948156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ccc30-d9ce-4d33-99a9-507e6d2cf0d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:54.948429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ccc30-d9ce-4d33-99a9-507e6d2cf0d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:54.950090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ccc30-d9ce-4d33-99a9-507e6d2cf0d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:54.951660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ccc30-d9ce-4d33-99a9-507e6d2cf0d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-647ccc30-d9ce-4d33-99a9-507e6d2cf0d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] b78f3fb4994b4701a5e5a7758e3e6d28 does not imply 4ad11af1fafe4aceb9f53d0240690401.: keystone.exception.ImpliedRoleNotFound: b78f3fb4994b4701a5e5a7758e3e6d28 does not imply 4ad11af1fafe4aceb9f53d0240690401. Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = query.one() Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._iter().one() Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._only_one_row( Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:54.975671 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 08 21:25:54.976786 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 08 21:25:54.977824 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 08 21:25:54.977824 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 08 21:25:54.977824 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 08 21:25:54.977824 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: b78f3fb4994b4701a5e5a7758e3e6d28 does not imply 4ad11af1fafe4aceb9f53d0240690401. Oct 08 21:25:54.977824 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:54.977824 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4087/8159] 10.222.0.26 () {58 vars in 1347 bytes} [Sat Oct 8 21:25:54 2022] DELETE /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401 => generated 137 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:25:54.982029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063f730-1cff-466b-b9e1-337894dd2ad3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:54.993412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063f730-1cff-466b-b9e1-337894dd2ad3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:54.998191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a3ce7-0c72-48e0-9991-b71170126041 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:54.998841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a3ce7-0c72-48e0-9991-b71170126041 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:54.999120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a3ce7-0c72-48e0-9991-b71170126041 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:54.999390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a3ce7-0c72-48e0-9991-b71170126041 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.001043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a3ce7-0c72-48e0-9991-b71170126041 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.002688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a3ce7-0c72-48e0-9991-b71170126041 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.027790 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4073/8160] 10.222.0.26 () {60 vars in 1363 bytes} [Sat Oct 8 21:25:54 2022] PUT /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401 => generated 519 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:55.031227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ccc30-d9ce-4d33-99a9-507e6d2cf0d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.041853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ccc30-d9ce-4d33-99a9-507e6d2cf0d9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:55.099570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eba086-f734-47d3-aee8-58166a861dfd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:55.100219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba086-f734-47d3-aee8-58166a861dfd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:55.100501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba086-f734-47d3-aee8-58166a861dfd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:55.100799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba086-f734-47d3-aee8-58166a861dfd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/2f03100fe8cf47e3898a23dad1c04af9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.102481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eba086-f734-47d3-aee8-58166a861dfd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=2f03100fe8cf47e3898a23dad1c04af9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.104085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eba086-f734-47d3-aee8-58166a861dfd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.118631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:55.132733 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4088/8161] 10.222.0.26 () {60 vars in 1363 bytes} [Sat Oct 8 21:25:55 2022] PUT /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/2f03100fe8cf47e3898a23dad1c04af9 => generated 519 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:55.134043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a3ce7-0c72-48e0-9991-b71170126041 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.144169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a3ce7-0c72-48e0-9991-b71170126041 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:55.200148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7e97f-d80e-4deb-a5d4-bccb72187aac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:55.200731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7e97f-d80e-4deb-a5d4-bccb72187aac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:55.201011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7e97f-d80e-4deb-a5d4-bccb72187aac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:55.201318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7e97f-d80e-4deb-a5d4-bccb72187aac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/2f03100fe8cf47e3898a23dad1c04af9/implies/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.202972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7e97f-d80e-4deb-a5d4-bccb72187aac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=2f03100fe8cf47e3898a23dad1c04af9, implied_role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.204548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7e97f-d80e-4deb-a5d4-bccb72187aac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.228081 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4074/8162] 10.222.0.26 () {60 vars in 1363 bytes} [Sat Oct 8 21:25:55 2022] PUT /identity/v3/roles/2f03100fe8cf47e3898a23dad1c04af9/implies/7877a36cb2814b73b4aeadc4327e69f4 => generated 520 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:55.232373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eba086-f734-47d3-aee8-58166a861dfd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.243222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eba086-f734-47d3-aee8-58166a861dfd tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:55.298936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f908e0-8cb3-41de-b783-30dc590846cb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:55.299533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f908e0-8cb3-41de-b783-30dc590846cb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:55.299817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f908e0-8cb3-41de-b783-30dc590846cb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:55.300122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f908e0-8cb3-41de-b783-30dc590846cb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.301003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f908e0-8cb3-41de-b783-30dc590846cb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.302087 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-d5f908e0-8cb3-41de-b783-30dc590846cb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:55.302087 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:55.302087 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:55.303134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f908e0-8cb3-41de-b783-30dc590846cb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.319941 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4089/8163] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 21:25:55 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:25:55.324176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7e97f-d80e-4deb-a5d4-bccb72187aac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.334519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7e97f-d80e-4deb-a5d4-bccb72187aac tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:55.339189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ecbd0-03c1-4b88-87ce-004f58ef38b3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:55.339831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ecbd0-03c1-4b88-87ce-004f58ef38b3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:55.340116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ecbd0-03c1-4b88-87ce-004f58ef38b3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:55.340395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ecbd0-03c1-4b88-87ce-004f58ef38b3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/2f03100fe8cf47e3898a23dad1c04af9/implies/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.342091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ecbd0-03c1-4b88-87ce-004f58ef38b3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=2f03100fe8cf47e3898a23dad1c04af9, implied_role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.343667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ecbd0-03c1-4b88-87ce-004f58ef38b3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.352682 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4075/8164] 10.222.0.26 () {58 vars in 1347 bytes} [Sat Oct 8 21:25:55 2022] DELETE /identity/v3/roles/2f03100fe8cf47e3898a23dad1c04af9/implies/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:55.357072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f908e0-8cb3-41de-b783-30dc590846cb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.367701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f908e0-8cb3-41de-b783-30dc590846cb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:55.422544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ca4ed-03cf-4c00-a027-240bf9a66a76 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:55.423182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ca4ed-03cf-4c00-a027-240bf9a66a76 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:55.423472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ca4ed-03cf-4c00-a027-240bf9a66a76 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:55.423750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ca4ed-03cf-4c00-a027-240bf9a66a76 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/2f03100fe8cf47e3898a23dad1c04af9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.425407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ca4ed-03cf-4c00-a027-240bf9a66a76 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=2f03100fe8cf47e3898a23dad1c04af9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.426999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ca4ed-03cf-4c00-a027-240bf9a66a76 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.436050 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4090/8165] 10.222.0.26 () {58 vars in 1347 bytes} [Sat Oct 8 21:25:55 2022] DELETE /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/2f03100fe8cf47e3898a23dad1c04af9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:55.440171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ecbd0-03c1-4b88-87ce-004f58ef38b3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.450686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ecbd0-03c1-4b88-87ce-004f58ef38b3 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:55.513412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba0b68-ff83-412d-9c81-b1bebdf2f55a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:55.514061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0b68-ff83-412d-9c81-b1bebdf2f55a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:55.514347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0b68-ff83-412d-9c81-b1bebdf2f55a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:55.514619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0b68-ff83-412d-9c81-b1bebdf2f55a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.516262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba0b68-ff83-412d-9c81-b1bebdf2f55a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.517894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba0b68-ff83-412d-9c81-b1bebdf2f55a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.526067 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4076/8166] 10.222.0.26 () {58 vars in 1347 bytes} [Sat Oct 8 21:25:55 2022] DELETE /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:55.531005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ca4ed-03cf-4c00-a027-240bf9a66a76 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.542101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ca4ed-03cf-4c00-a027-240bf9a66a76 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:55.597048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd923f-e33b-4495-a06b-7b9e4060da87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:55.597700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd923f-e33b-4495-a06b-7b9e4060da87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:55.597952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd923f-e33b-4495-a06b-7b9e4060da87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:55.598226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd923f-e33b-4495-a06b-7b9e4060da87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.598855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd923f-e33b-4495-a06b-7b9e4060da87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.600548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd923f-e33b-4495-a06b-7b9e4060da87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.612123 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4091/8167] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:55 2022] GET /identity/v3/roles => generated 2321 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:55.617927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba0b68-ff83-412d-9c81-b1bebdf2f55a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.623371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:55.629748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba0b68-ff83-412d-9c81-b1bebdf2f55a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:55.635280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab111c5-5b9f-4cff-917d-8364196a4449 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:55.635873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab111c5-5b9f-4cff-917d-8364196a4449 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:55.636152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab111c5-5b9f-4cff-917d-8364196a4449 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:55.636426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab111c5-5b9f-4cff-917d-8364196a4449 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.637082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab111c5-5b9f-4cff-917d-8364196a4449 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.638721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab111c5-5b9f-4cff-917d-8364196a4449 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.655226 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4077/8168] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:25:55 2022] POST /identity/v3/roles => generated 235 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:55.659276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd923f-e33b-4495-a06b-7b9e4060da87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.670063 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd923f-e33b-4495-a06b-7b9e4060da87 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:55.674715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0bd1e-90a7-4fb4-92eb-acbdbfcd5ad0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:55.675331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0bd1e-90a7-4fb4-92eb-acbdbfcd5ad0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:55.675612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0bd1e-90a7-4fb4-92eb-acbdbfcd5ad0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:55.675889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0bd1e-90a7-4fb4-92eb-acbdbfcd5ad0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/4c3834a0b13b40688454d0c21ca31e1d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.677361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0bd1e-90a7-4fb4-92eb-acbdbfcd5ad0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:update_role(role_id=4c3834a0b13b40688454d0c21ca31e1d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.678360 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-01e0bd1e-90a7-4fb4-92eb-acbdbfcd5ad0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:55.678360 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:55.678360 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:55.679281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0bd1e-90a7-4fb4-92eb-acbdbfcd5ad0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.695183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:55.707727 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4092/8169] 10.222.0.26 () {60 vars in 1243 bytes} [Sat Oct 8 21:25:55 2022] PATCH /identity/v3/roles/4c3834a0b13b40688454d0c21ca31e1d => generated 237 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:55.712210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab111c5-5b9f-4cff-917d-8364196a4449 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.722380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab111c5-5b9f-4cff-917d-8364196a4449 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:55.727723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa12e76-e1da-44e3-89d9-3483d5a6631c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:55.728347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa12e76-e1da-44e3-89d9-3483d5a6631c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:55.728633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa12e76-e1da-44e3-89d9-3483d5a6631c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:55.728909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa12e76-e1da-44e3-89d9-3483d5a6631c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/4c3834a0b13b40688454d0c21ca31e1d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.737358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa12e76-e1da-44e3-89d9-3483d5a6631c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:get_role(role_id=4c3834a0b13b40688454d0c21ca31e1d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.738363 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-9fa12e76-e1da-44e3-89d9-3483d5a6631c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:55.738363 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:25:55.738363 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:25:55.739248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa12e76-e1da-44e3-89d9-3483d5a6631c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.740524 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4078/8170] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:25:55 2022] GET /identity/v3/roles/4c3834a0b13b40688454d0c21ca31e1d => generated 237 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:55.744228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0bd1e-90a7-4fb4-92eb-acbdbfcd5ad0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.754202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0bd1e-90a7-4fb4-92eb-acbdbfcd5ad0 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:55.758821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e5c50-60b6-498e-8c57-ebf1e46e09ab tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:55.759412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e5c50-60b6-498e-8c57-ebf1e46e09ab tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:55.759700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e5c50-60b6-498e-8c57-ebf1e46e09ab tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:55.759977 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e5c50-60b6-498e-8c57-ebf1e46e09ab tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.760610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e5c50-60b6-498e-8c57-ebf1e46e09ab tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.762213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e5c50-60b6-498e-8c57-ebf1e46e09ab tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.774366 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4093/8171] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:55 2022] GET /identity/v3/roles => generated 2549 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:55.778380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa12e76-e1da-44e3-89d9-3483d5a6631c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.789060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa12e76-e1da-44e3-89d9-3483d5a6631c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:55.793775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018edb7d-5c56-4ef6-a389-beead3608eb9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:55.794403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018edb7d-5c56-4ef6-a389-beead3608eb9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:55.794685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018edb7d-5c56-4ef6-a389-beead3608eb9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:55.794963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018edb7d-5c56-4ef6-a389-beead3608eb9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/4c3834a0b13b40688454d0c21ca31e1d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.796350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018edb7d-5c56-4ef6-a389-beead3608eb9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4c3834a0b13b40688454d0c21ca31e1d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.797961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018edb7d-5c56-4ef6-a389-beead3608eb9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.832750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-018edb7d-5c56-4ef6-a389-beead3608eb9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role 4c3834a0b13b40688454d0c21ca31e1d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:55.833047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-018edb7d-5c56-4ef6-a389-beead3608eb9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:55.833741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-018edb7d-5c56-4ef6-a389-beead3608eb9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:55.835532 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4079/8172] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:55 2022] DELETE /identity/v3/roles/4c3834a0b13b40688454d0c21ca31e1d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:55.840691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e5c50-60b6-498e-8c57-ebf1e46e09ab tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.842482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-923e5c50-60b6-498e-8c57-ebf1e46e09ab tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:55.855013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e5c50-60b6-498e-8c57-ebf1e46e09ab tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:55.910105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486d868-1e45-4900-801d-d20b868a61c5 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:55.910821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486d868-1e45-4900-801d-d20b868a61c5 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:55.911129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486d868-1e45-4900-801d-d20b868a61c5 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:55.911405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486d868-1e45-4900-801d-d20b868a61c5 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:55.913107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486d868-1e45-4900-801d-d20b868a61c5 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:55.914770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486d868-1e45-4900-801d-d20b868a61c5 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:55.937626 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4094/8173] 10.222.0.26 () {60 vars in 1363 bytes} [Sat Oct 8 21:25:55 2022] PUT /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401 => generated 519 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:55.941657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018edb7d-5c56-4ef6-a389-beead3608eb9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:55.952142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018edb7d-5c56-4ef6-a389-beead3608eb9 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:56.008277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1354b-3a8b-45bb-bf8b-0362dff97d60 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:56.008847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1354b-3a8b-45bb-bf8b-0362dff97d60 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:56.009124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1354b-3a8b-45bb-bf8b-0362dff97d60 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:56.009434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1354b-3a8b-45bb-bf8b-0362dff97d60 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/2f03100fe8cf47e3898a23dad1c04af9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:56.011066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1354b-3a8b-45bb-bf8b-0362dff97d60 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=2f03100fe8cf47e3898a23dad1c04af9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:56.012674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1354b-3a8b-45bb-bf8b-0362dff97d60 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:56.035928 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4080/8174] 10.222.0.26 () {60 vars in 1363 bytes} [Sat Oct 8 21:25:55 2022] PUT /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/2f03100fe8cf47e3898a23dad1c04af9 => generated 519 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:56.040555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486d868-1e45-4900-801d-d20b868a61c5 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:56.050948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486d868-1e45-4900-801d-d20b868a61c5 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:56.106519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50a1e0-bc13-4433-b8f1-68dc7b1a8dfc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:56.107146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50a1e0-bc13-4433-b8f1-68dc7b1a8dfc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:56.107427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50a1e0-bc13-4433-b8f1-68dc7b1a8dfc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:56.107700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50a1e0-bc13-4433-b8f1-68dc7b1a8dfc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/2f03100fe8cf47e3898a23dad1c04af9/implies/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:56.109386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50a1e0-bc13-4433-b8f1-68dc7b1a8dfc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=2f03100fe8cf47e3898a23dad1c04af9, implied_role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:56.110983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50a1e0-bc13-4433-b8f1-68dc7b1a8dfc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:56.134350 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4095/8175] 10.222.0.26 () {60 vars in 1363 bytes} [Sat Oct 8 21:25:56 2022] PUT /identity/v3/roles/2f03100fe8cf47e3898a23dad1c04af9/implies/7877a36cb2814b73b4aeadc4327e69f4 => generated 520 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:56.138335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1354b-3a8b-45bb-bf8b-0362dff97d60 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:56.148488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1354b-3a8b-45bb-bf8b-0362dff97d60 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:56.203198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e96ba-7ae9-40f0-8d32-d4e5889b461c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:56.203824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e96ba-7ae9-40f0-8d32-d4e5889b461c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:56.204120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e96ba-7ae9-40f0-8d32-d4e5889b461c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:56.204388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e96ba-7ae9-40f0-8d32-d4e5889b461c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/2f03100fe8cf47e3898a23dad1c04af9/implies` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:56.205520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e96ba-7ae9-40f0-8d32-d4e5889b461c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=2f03100fe8cf47e3898a23dad1c04af9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:56.206512 ncdv-master-1 devstack@keystone.service[99085]: WARNING py.warnings [None req-a74e96ba-7ae9-40f0-8d32-d4e5889b461c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:56.206512 ncdv-master-1 devstack@keystone.service[99085]: warnings.warn(msg) Oct 08 21:25:56.206512 ncdv-master-1 devstack@keystone.service[99085]: Oct 08 21:25:56.207379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e96ba-7ae9-40f0-8d32-d4e5889b461c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:56.213170 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4081/8176] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:25:56 2022] GET /identity/v3/roles/2f03100fe8cf47e3898a23dad1c04af9/implies => generated 489 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:56.217207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50a1e0-bc13-4433-b8f1-68dc7b1a8dfc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:56.228269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50a1e0-bc13-4433-b8f1-68dc7b1a8dfc tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:56.233208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8eca1-a4c9-4eee-a989-68492537f282 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:56.233826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8eca1-a4c9-4eee-a989-68492537f282 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:56.234106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8eca1-a4c9-4eee-a989-68492537f282 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:56.234377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8eca1-a4c9-4eee-a989-68492537f282 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:56.235471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8eca1-a4c9-4eee-a989-68492537f282 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:56.236479 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-66c8eca1-a4c9-4eee-a989-68492537f282 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:25:56.236479 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:25:56.236479 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:25:56.237383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8eca1-a4c9-4eee-a989-68492537f282 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:56.244340 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4096/8177] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:25:56 2022] GET /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies => generated 658 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:25:56.248336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e96ba-7ae9-40f0-8d32-d4e5889b461c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:56.258425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e96ba-7ae9-40f0-8d32-d4e5889b461c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:56.262929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39341aae-33de-4294-89f6-abedc93cc403 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:56.263583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39341aae-33de-4294-89f6-abedc93cc403 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:56.263866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39341aae-33de-4294-89f6-abedc93cc403 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:56.264143 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39341aae-33de-4294-89f6-abedc93cc403 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/2f03100fe8cf47e3898a23dad1c04af9/implies/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:56.265841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39341aae-33de-4294-89f6-abedc93cc403 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=2f03100fe8cf47e3898a23dad1c04af9, implied_role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:56.267405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39341aae-33de-4294-89f6-abedc93cc403 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:56.275849 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4082/8178] 10.222.0.26 () {58 vars in 1347 bytes} [Sat Oct 8 21:25:56 2022] DELETE /identity/v3/roles/2f03100fe8cf47e3898a23dad1c04af9/implies/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:56.279694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8eca1-a4c9-4eee-a989-68492537f282 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:56.290080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8eca1-a4c9-4eee-a989-68492537f282 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:56.323592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:56.347407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc1f63-4798-4b3e-9e90-8756412cdb63 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:56.348046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc1f63-4798-4b3e-9e90-8756412cdb63 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:56.348326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc1f63-4798-4b3e-9e90-8756412cdb63 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:56.348601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc1f63-4798-4b3e-9e90-8756412cdb63 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/2f03100fe8cf47e3898a23dad1c04af9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:56.350269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc1f63-4798-4b3e-9e90-8756412cdb63 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=2f03100fe8cf47e3898a23dad1c04af9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:56.352393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc1f63-4798-4b3e-9e90-8756412cdb63 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:56.361139 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4097/8179] 10.222.0.26 () {58 vars in 1347 bytes} [Sat Oct 8 21:25:56 2022] DELETE /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/2f03100fe8cf47e3898a23dad1c04af9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:56.365373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39341aae-33de-4294-89f6-abedc93cc403 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:56.373234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:56.377485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39341aae-33de-4294-89f6-abedc93cc403 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:56.434215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75630645-0e9f-4c08-9d39-efaf90e1cf66 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:56.434849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75630645-0e9f-4c08-9d39-efaf90e1cf66 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:56.435126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75630645-0e9f-4c08-9d39-efaf90e1cf66 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:56.435396 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75630645-0e9f-4c08-9d39-efaf90e1cf66 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:56.436996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75630645-0e9f-4c08-9d39-efaf90e1cf66 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b78f3fb4994b4701a5e5a7758e3e6d28, implied_role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:56.438593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75630645-0e9f-4c08-9d39-efaf90e1cf66 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:56.446911 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4083/8180] 10.222.0.26 () {58 vars in 1347 bytes} [Sat Oct 8 21:25:56 2022] DELETE /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28/implies/4ad11af1fafe4aceb9f53d0240690401 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:56.451909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc1f63-4798-4b3e-9e90-8756412cdb63 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:56.462884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc1f63-4798-4b3e-9e90-8756412cdb63 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:56.520641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a2460-84d7-4816-bb7f-42df63e30b5a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:56.521227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a2460-84d7-4816-bb7f-42df63e30b5a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:56.521516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a2460-84d7-4816-bb7f-42df63e30b5a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:56.521791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a2460-84d7-4816-bb7f-42df63e30b5a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains/011b2246dbcc4629829a3a65d5212d11` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:56.528830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a2460-84d7-4816-bb7f-42df63e30b5a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-091a2460-84d7-4816-bb7f-42df63e30b5a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Could not find domain: 011b2246dbcc4629829a3a65d5212d11.: keystone.exception.DomainNotFound: Could not find domain: 011b2246dbcc4629829a3a65d5212d11. Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 011b2246dbcc4629829a3a65d5212d11. Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:25:56.533829 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:25:56.534927 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application with Lock( Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._enter() Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.creator() Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application created_value = creator( Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 011b2246dbcc4629829a3a65d5212d11. Oct 08 21:25:56.536074 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:25:56.537067 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4098/8181] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:25:56 2022] PATCH /identity/v3/domains/011b2246dbcc4629829a3a65d5212d11 => generated 112 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 08 21:25:56.539573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75630645-0e9f-4c08-9d39-efaf90e1cf66 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:56.550810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75630645-0e9f-4c08-9d39-efaf90e1cf66 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:56.555504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7a87f-d735-447b-a002-8c0f4368bb7c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:56.556162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7a87f-d735-447b-a002-8c0f4368bb7c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:56.556431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7a87f-d735-447b-a002-8c0f4368bb7c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:56.556702 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7a87f-d735-447b-a002-8c0f4368bb7c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/users/b9f4aed4295c40a0ad5ec02809303b62` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:56.557857 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7a87f-d735-447b-a002-8c0f4368bb7c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b9f4aed4295c40a0ad5ec02809303b62)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:56.559836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7a87f-d735-447b-a002-8c0f4368bb7c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:56.603904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05d7a87f-d735-447b-a002-8c0f4368bb7c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f4aed4295c40a0ad5ec02809303b62'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:56.611032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05d7a87f-d735-447b-a002-8c0f4368bb7c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f4aed4295c40a0ad5ec02809303b62'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:56.611696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05d7a87f-d735-447b-a002-8c0f4368bb7c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f4aed4295c40a0ad5ec02809303b62'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:56.612311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05d7a87f-d735-447b-a002-8c0f4368bb7c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f4aed4295c40a0ad5ec02809303b62'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:56.624228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-05d7a87f-d735-447b-a002-8c0f4368bb7c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f4aed4295c40a0ad5ec02809303b62'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:56.641552 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4084/8182] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:56 2022] DELETE /identity/v3/users/b9f4aed4295c40a0ad5ec02809303b62 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:56.645964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a2460-84d7-4816-bb7f-42df63e30b5a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:56.648584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-091a2460-84d7-4816-bb7f-42df63e30b5a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:56.662339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a2460-84d7-4816-bb7f-42df63e30b5a tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:56.719589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eeffb-a868-4372-a83a-e4a9d1e3af6b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:56.720210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eeffb-a868-4372-a83a-e4a9d1e3af6b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:56.720497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eeffb-a868-4372-a83a-e4a9d1e3af6b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:56.720773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eeffb-a868-4372-a83a-e4a9d1e3af6b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/7877a36cb2814b73b4aeadc4327e69f4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:56.722177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6eeffb-a868-4372-a83a-e4a9d1e3af6b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7877a36cb2814b73b4aeadc4327e69f4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:56.723770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6eeffb-a868-4372-a83a-e4a9d1e3af6b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:56.757558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ab6eeffb-a868-4372-a83a-e4a9d1e3af6b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role 7877a36cb2814b73b4aeadc4327e69f4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:56.757789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ab6eeffb-a868-4372-a83a-e4a9d1e3af6b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:56.758431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ab6eeffb-a868-4372-a83a-e4a9d1e3af6b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:56.760189 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4099/8183] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:56 2022] DELETE /identity/v3/roles/7877a36cb2814b73b4aeadc4327e69f4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:56.764225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7a87f-d735-447b-a002-8c0f4368bb7c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:56.774992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7a87f-d735-447b-a002-8c0f4368bb7c tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:56.832607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616231-2ae8-4aa1-88ba-4965091a7cda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:56.833268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616231-2ae8-4aa1-88ba-4965091a7cda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:56.833550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616231-2ae8-4aa1-88ba-4965091a7cda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:56.833827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616231-2ae8-4aa1-88ba-4965091a7cda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/groups/fd1f5b410b4243cba354e114e26e0627` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:56.834997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96616231-2ae8-4aa1-88ba-4965091a7cda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fd1f5b410b4243cba354e114e26e0627)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:56.837475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96616231-2ae8-4aa1-88ba-4965091a7cda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:56.848367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:56.879014 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4085/8184] 10.222.0.26 () {58 vars in 1227 bytes} [Sat Oct 8 21:25:56 2022] DELETE /identity/v3/groups/fd1f5b410b4243cba354e114e26e0627 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:56.883476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eeffb-a868-4372-a83a-e4a9d1e3af6b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:56.884879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ab6eeffb-a868-4372-a83a-e4a9d1e3af6b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:56.897263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eeffb-a868-4372-a83a-e4a9d1e3af6b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:56.929736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:56.953750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:56.954374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:56.954656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:56.955140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/projects/893fe6519ae541ac92084e628c40954f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:56.956303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_project(project_id=893fe6519ae541ac92084e628c40954f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:56.958221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:57.003151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893fe6519ae541ac92084e628c40954f', 'request_id': 'req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.010853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893fe6519ae541ac92084e628c40954f', 'request_id': 'req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.016482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893fe6519ae541ac92084e628c40954f', 'request_id': 'req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.027920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] The token cache is being invalidate because project 893fe6519ae541ac92084e628c40954f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:57.028141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.028796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.030305 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4100/8185] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:56 2022] DELETE /identity/v3/projects/893fe6519ae541ac92084e628c40954f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:57.034214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616231-2ae8-4aa1-88ba-4965091a7cda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:57.035872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-96616231-2ae8-4aa1-88ba-4965091a7cda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:57.048714 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616231-2ae8-4aa1-88ba-4965091a7cda tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:57.104789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab82a5-1e64-42eb-8622-c739e4719efb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:57.105458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab82a5-1e64-42eb-8622-c739e4719efb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `PATCH` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:57.105735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab82a5-1e64-42eb-8622-c739e4719efb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:57.106271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab82a5-1e64-42eb-8622-c739e4719efb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains/abe491a7c1e14354a2b33f397aea88bf` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:57.107516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab82a5-1e64-42eb-8622-c739e4719efb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=abe491a7c1e14354a2b33f397aea88bf)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:57.109114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab82a5-1e64-42eb-8622-c739e4719efb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:57.129300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-97ab82a5-1e64-42eb-8622-c739e4719efb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'abe491a7c1e14354a2b33f397aea88bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.129993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-97ab82a5-1e64-42eb-8622-c739e4719efb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'abe491a7c1e14354a2b33f397aea88bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.154317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-97ab82a5-1e64-42eb-8622-c739e4719efb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'abe491a7c1e14354a2b33f397aea88bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.154929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-97ab82a5-1e64-42eb-8622-c739e4719efb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'abe491a7c1e14354a2b33f397aea88bf'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.157241 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4086/8186] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 21:25:57 2022] PATCH /identity/v3/domains/abe491a7c1e14354a2b33f397aea88bf => generated 276 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:57.161089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:57.171018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe1a8d-3dfc-41b6-97b8-26811724d3e2 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:57.226475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:57.227109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:57.227395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:57.227671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/domains/abe491a7c1e14354a2b33f397aea88bf` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:57.238226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=abe491a7c1e14354a2b33f397aea88bf)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:57.239845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:57.262161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'abe491a7c1e14354a2b33f397aea88bf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.271868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'abe491a7c1e14354a2b33f397aea88bf'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.301968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:57.312487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe491a7c1e14354a2b33f397aea88bf', 'request_id': 'req-8d701b95-3451-42ad-810f-d40976c0753b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.320297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe491a7c1e14354a2b33f397aea88bf', 'request_id': 'req-8d701b95-3451-42ad-810f-d40976c0753b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.325820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe491a7c1e14354a2b33f397aea88bf', 'request_id': 'req-8d701b95-3451-42ad-810f-d40976c0753b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.336933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] The token cache is being invalidate because project abe491a7c1e14354a2b33f397aea88bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:57.337317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.337959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.345126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'abe491a7c1e14354a2b33f397aea88bf', 'request_id': 'req-8d701b95-3451-42ad-810f-d40976c0753b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.345789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'abe491a7c1e14354a2b33f397aea88bf', 'request_id': 'req-8d701b95-3451-42ad-810f-d40976c0753b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.348954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'abe491a7c1e14354a2b33f397aea88bf', 'request_id': 'req-8d701b95-3451-42ad-810f-d40976c0753b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.354517 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4101/8187] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:25:57 2022] DELETE /identity/v3/domains/abe491a7c1e14354a2b33f397aea88bf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:57.358757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab82a5-1e64-42eb-8622-c739e4719efb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:57.360168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-97ab82a5-1e64-42eb-8622-c739e4719efb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:57.373106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab82a5-1e64-42eb-8622-c739e4719efb tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:57.430177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414becc5-a13e-4044-9690-6e145246874f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:57.430799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414becc5-a13e-4044-9690-6e145246874f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:57.431077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414becc5-a13e-4044-9690-6e145246874f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:57.431370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414becc5-a13e-4044-9690-6e145246874f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/2f03100fe8cf47e3898a23dad1c04af9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:57.432738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414becc5-a13e-4044-9690-6e145246874f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2f03100fe8cf47e3898a23dad1c04af9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:57.434378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414becc5-a13e-4044-9690-6e145246874f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:57.468057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-414becc5-a13e-4044-9690-6e145246874f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role 2f03100fe8cf47e3898a23dad1c04af9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:57.468367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-414becc5-a13e-4044-9690-6e145246874f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.469029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-414becc5-a13e-4044-9690-6e145246874f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.470848 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4087/8188] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:57 2022] DELETE /identity/v3/roles/2f03100fe8cf47e3898a23dad1c04af9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:57.474788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:57.476190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:57.489706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d701b95-3451-42ad-810f-d40976c0753b tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:57.552805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e51765-0605-45b5-8ea5-649cbd4a46de tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:57.553407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e51765-0605-45b5-8ea5-649cbd4a46de tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:57.553687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e51765-0605-45b5-8ea5-649cbd4a46de tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:57.554600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e51765-0605-45b5-8ea5-649cbd4a46de tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/4ad11af1fafe4aceb9f53d0240690401` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:57.556010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e51765-0605-45b5-8ea5-649cbd4a46de tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4ad11af1fafe4aceb9f53d0240690401)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:57.557632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e51765-0605-45b5-8ea5-649cbd4a46de tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:57.593863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5e51765-0605-45b5-8ea5-649cbd4a46de tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role 4ad11af1fafe4aceb9f53d0240690401 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:57.594195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5e51765-0605-45b5-8ea5-649cbd4a46de tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.594969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f5e51765-0605-45b5-8ea5-649cbd4a46de tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.596986 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4102/8189] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:57 2022] DELETE /identity/v3/roles/4ad11af1fafe4aceb9f53d0240690401 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:57.601986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414becc5-a13e-4044-9690-6e145246874f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:57.603457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-414becc5-a13e-4044-9690-6e145246874f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:57.611516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:UPDATE=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:57.619013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414becc5-a13e-4044-9690-6e145246874f tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:57.686697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe129eb5-ff1f-450e-9951-ad27af456f39 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ade69c03dd44497be20a6c960fcb9e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01a0087549b946ba8ee92e326cdc3087', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:57.687749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe129eb5-ff1f-450e-9951-ad27af456f39 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:57.688216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe129eb5-ff1f-450e-9951-ad27af456f39 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:57.688700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe129eb5-ff1f-450e-9951-ad27af456f39 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] PATH_INFO: `/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:57.691003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe129eb5-ff1f-450e-9951-ad27af456f39 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b78f3fb4994b4701a5e5a7758e3e6d28)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:57.693082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe129eb5-ff1f-450e-9951-ad27af456f39 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:57.730502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fe129eb5-ff1f-450e-9951-ad27af456f39 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invalidating the token cache because role b78f3fb4994b4701a5e5a7758e3e6d28 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:57.730840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fe129eb5-ff1f-450e-9951-ad27af456f39 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.731716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fe129eb5-ff1f-450e-9951-ad27af456f39 tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.733684 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4088/8190] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:57 2022] DELETE /identity/v3/roles/b78f3fb4994b4701a5e5a7758e3e6d28 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:57.737860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e51765-0605-45b5-8ea5-649cbd4a46de tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:57.739272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f5e51765-0605-45b5-8ea5-649cbd4a46de tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:57.807121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e51765-0605-45b5-8ea5-649cbd4a46de tempest-RolesV3TestJSON-2021836336 tempest-RolesV3TestJSON-2021836336-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:57.819427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:57.864635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:57.865284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:57.865563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:57.865837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] PATH_INFO: `/v3/users/626c4c89efc64df8956f152c1f42103c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:57.867574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=626c4c89efc64df8956f152c1f42103c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:57.869515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:57.914218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626c4c89efc64df8956f152c1f42103c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.921090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626c4c89efc64df8956f152c1f42103c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.922025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626c4c89efc64df8956f152c1f42103c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.922634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626c4c89efc64df8956f152c1f42103c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.934540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626c4c89efc64df8956f152c1f42103c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:57.947152 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4103/8191] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:57 2022] DELETE /identity/v3/users/626c4c89efc64df8956f152c1f42103c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:57.951837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292297b-8346-4019-a533-b2aa09a777e2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:57.952318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292297b-8346-4019-a533-b2aa09a777e2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:57.952436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292297b-8346-4019-a533-b2aa09a777e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:57.971192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c292297b-8346-4019-a533-b2aa09a777e2 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:57.972377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c292297b-8346-4019-a533-b2aa09a777e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:58.031478 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4089/8192] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:58.041879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:58.043263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:58.102418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaa820-3f87-40f4-9313-ef138db3fd8e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:58.105936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84db1d-1eb6-43ea-81d8-cbd760cc03da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:58.106782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84db1d-1eb6-43ea-81d8-cbd760cc03da service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:58.107057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84db1d-1eb6-43ea-81d8-cbd760cc03da service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:58.107326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84db1d-1eb6-43ea-81d8-cbd760cc03da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:58.116135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84db1d-1eb6-43ea-81d8-cbd760cc03da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:58.117728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84db1d-1eb6-43ea-81d8-cbd760cc03da service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:58.126887 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4104/8193] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:25:58.396446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292297b-8346-4019-a533-b2aa09a777e2 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:58.398546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c292297b-8346-4019-a533-b2aa09a777e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:58.411826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292297b-8346-4019-a533-b2aa09a777e2 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:58.416590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:58.417255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:58.417536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:58.417810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] PATH_INFO: `/v3/projects/0effeb42c10d4fb29cf57e70948cf7ab` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:58.418935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0effeb42c10d4fb29cf57e70948cf7ab)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:58.420831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:58.467816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0effeb42c10d4fb29cf57e70948cf7ab', 'request_id': 'req-8941b266-2b6a-46e2-97cb-46e21539381a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:58.475217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0effeb42c10d4fb29cf57e70948cf7ab', 'request_id': 'req-8941b266-2b6a-46e2-97cb-46e21539381a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:58.480091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:58.482294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0effeb42c10d4fb29cf57e70948cf7ab', 'request_id': 'req-8941b266-2b6a-46e2-97cb-46e21539381a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:58.502305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] The token cache is being invalidate because project 0effeb42c10d4fb29cf57e70948cf7ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:58.502593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:58.503246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:58.504714 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4090/8194] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:58 2022] DELETE /identity/v3/projects/0effeb42c10d4fb29cf57e70948cf7ab => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:58.509441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84db1d-1eb6-43ea-81d8-cbd760cc03da service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:58.519166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84db1d-1eb6-43ea-81d8-cbd760cc03da service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:58.557050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:58.577783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5f2df-488e-4614-b111-e94248dea3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:58.578410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5f2df-488e-4614-b111-e94248dea3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:58.578687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5f2df-488e-4614-b111-e94248dea3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:58.578958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5f2df-488e-4614-b111-e94248dea3d2 admin admin] PATH_INFO: `/v3/users/0ade69c03dd44497be20a6c960fcb9e0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:58.580103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5f2df-488e-4614-b111-e94248dea3d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ade69c03dd44497be20a6c960fcb9e0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:58.582059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5f2df-488e-4614-b111-e94248dea3d2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:58.626596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0ae5f2df-488e-4614-b111-e94248dea3d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ade69c03dd44497be20a6c960fcb9e0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:58.633779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0ae5f2df-488e-4614-b111-e94248dea3d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ade69c03dd44497be20a6c960fcb9e0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:58.634421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0ae5f2df-488e-4614-b111-e94248dea3d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ade69c03dd44497be20a6c960fcb9e0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:58.635015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0ae5f2df-488e-4614-b111-e94248dea3d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ade69c03dd44497be20a6c960fcb9e0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:58.649009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0ae5f2df-488e-4614-b111-e94248dea3d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ade69c03dd44497be20a6c960fcb9e0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:58.661564 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4105/8195] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:25:58 2022] DELETE /identity/v3/users/0ade69c03dd44497be20a6c960fcb9e0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:58.939237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:58.940675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:58.957353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941b266-2b6a-46e2-97cb-46e21539381a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:59.017766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627a8a4-047a-4824-b913-ee09b8d30bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:59.018405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627a8a4-047a-4824-b913-ee09b8d30bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.018689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627a8a4-047a-4824-b913-ee09b8d30bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.018966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627a8a4-047a-4824-b913-ee09b8d30bf3 admin admin] PATH_INFO: `/v3/projects/01a0087549b946ba8ee92e326cdc3087` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.020159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627a8a4-047a-4824-b913-ee09b8d30bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a0087549b946ba8ee92e326cdc3087)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:59.022082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627a8a4-047a-4824-b913-ee09b8d30bf3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:59.068796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9627a8a4-047a-4824-b913-ee09b8d30bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a0087549b946ba8ee92e326cdc3087', 'request_id': 'req-9627a8a4-047a-4824-b913-ee09b8d30bf3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:59.077804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9627a8a4-047a-4824-b913-ee09b8d30bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a0087549b946ba8ee92e326cdc3087', 'request_id': 'req-9627a8a4-047a-4824-b913-ee09b8d30bf3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:59.083927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9627a8a4-047a-4824-b913-ee09b8d30bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a0087549b946ba8ee92e326cdc3087', 'request_id': 'req-9627a8a4-047a-4824-b913-ee09b8d30bf3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:59.095018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9627a8a4-047a-4824-b913-ee09b8d30bf3 admin admin] The token cache is being invalidate because project 01a0087549b946ba8ee92e326cdc3087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:25:59.095304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9627a8a4-047a-4824-b913-ee09b8d30bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:59.095930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9627a8a4-047a-4824-b913-ee09b8d30bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:25:59.097489 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4091/8196] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:25:58 2022] DELETE /identity/v3/projects/01a0087549b946ba8ee92e326cdc3087 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:25:59.103029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2082d2-d656-424f-891a-707414624b3e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.103486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2082d2-d656-424f-891a-707414624b3e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.103573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2082d2-d656-424f-891a-707414624b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.123469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8f2082d2-d656-424f-891a-707414624b3e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:59.124655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8f2082d2-d656-424f-891a-707414624b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:59.182452 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4106/8197] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:59.190474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601502c-3d21-4cd6-86f4-d6607221db83 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.190760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601502c-3d21-4cd6-86f4-d6607221db83 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.191036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601502c-3d21-4cd6-86f4-d6607221db83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.211151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2601502c-3d21-4cd6-86f4-d6607221db83 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:59.212394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2601502c-3d21-4cd6-86f4-d6607221db83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:59.221507 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4092/8198] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:59.226622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2082d2-d656-424f-891a-707414624b3e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:59.236861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2082d2-d656-424f-891a-707414624b3e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:59.242182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c19b5f-90d7-4f78-a69c-ba6baf9b6657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:59.242787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c19b5f-90d7-4f78-a69c-ba6baf9b6657 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.243067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c19b5f-90d7-4f78-a69c-ba6baf9b6657 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.243342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c19b5f-90d7-4f78-a69c-ba6baf9b6657 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.244023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c19b5f-90d7-4f78-a69c-ba6baf9b6657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:25:59.244325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c19b5f-90d7-4f78-a69c-ba6baf9b6657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:59.245995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c19b5f-90d7-4f78-a69c-ba6baf9b6657 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:59.257648 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4107/8199] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:25:59.261963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601502c-3d21-4cd6-86f4-d6607221db83 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:59.271156 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601502c-3d21-4cd6-86f4-d6607221db83 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:59.276053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4e5f5-ea4e-467b-99f7-de75c08dee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:59.276644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e5f5-ea4e-467b-99f7-de75c08dee11 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.276921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e5f5-ea4e-467b-99f7-de75c08dee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.277253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e5f5-ea4e-467b-99f7-de75c08dee11 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.277881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4e5f5-ea4e-467b-99f7-de75c08dee11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:59.279763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4e5f5-ea4e-467b-99f7-de75c08dee11 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:59.307685 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4093/8200] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:59 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:59.312092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c19b5f-90d7-4f78-a69c-ba6baf9b6657 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:59.322388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c19b5f-90d7-4f78-a69c-ba6baf9b6657 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:59.365237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:59.379813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c2a9a-c84b-40be-9f35-f9e3fafeb2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:59.380422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c2a9a-c84b-40be-9f35-f9e3fafeb2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.380701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c2a9a-c84b-40be-9f35-f9e3fafeb2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.380972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c2a9a-c84b-40be-9f35-f9e3fafeb2e1 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.381627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c2a9a-c84b-40be-9f35-f9e3fafeb2e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:59.383576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c2a9a-c84b-40be-9f35-f9e3fafeb2e1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:59.405294 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4108/8201] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:59 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:25:59.409353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4e5f5-ea4e-467b-99f7-de75c08dee11 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:59.420108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4e5f5-ea4e-467b-99f7-de75c08dee11 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:59.424852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ea019-70cb-48a8-9d61-d92bda90f41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:59.425490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ea019-70cb-48a8-9d61-d92bda90f41f admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.425767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ea019-70cb-48a8-9d61-d92bda90f41f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.426085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ea019-70cb-48a8-9d61-d92bda90f41f admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.426721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ea019-70cb-48a8-9d61-d92bda90f41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:59.428322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ea019-70cb-48a8-9d61-d92bda90f41f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:59.438408 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4094/8202] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:59.442256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c2a9a-c84b-40be-9f35-f9e3fafeb2e1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:59.452068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c2a9a-c84b-40be-9f35-f9e3fafeb2e1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:59.456608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461c877-f578-46ba-9932-3cbd07137194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:59.457212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461c877-f578-46ba-9932-3cbd07137194 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.457501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461c877-f578-46ba-9932-3cbd07137194 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.457767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461c877-f578-46ba-9932-3cbd07137194 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.458393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461c877-f578-46ba-9932-3cbd07137194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:59.459956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461c877-f578-46ba-9932-3cbd07137194 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:59.470787 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4109/8203] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:59.474718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ea019-70cb-48a8-9d61-d92bda90f41f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:59.485676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ea019-70cb-48a8-9d61-d92bda90f41f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:59.490503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f41ec-1753-44eb-a7e8-10e9c342112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:59.491252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f41ec-1753-44eb-a7e8-10e9c342112a admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.491550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f41ec-1753-44eb-a7e8-10e9c342112a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.491801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f41ec-1753-44eb-a7e8-10e9c342112a admin admin] PATH_INFO: `/v3/projects/de79a108cf0b4ff5b2d13ffa7564c256/users/453d203bc1474bd8a01bb7afa727d5a9/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.507083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f41ec-1753-44eb-a7e8-10e9c342112a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de79a108cf0b4ff5b2d13ffa7564c256, user_id=453d203bc1474bd8a01bb7afa727d5a9, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:59.509778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f41ec-1753-44eb-a7e8-10e9c342112a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:59.523874 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4095/8204] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:59 2022] PUT /identity/v3/projects/de79a108cf0b4ff5b2d13ffa7564c256/users/453d203bc1474bd8a01bb7afa727d5a9/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:59.534811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e478b72-c883-4399-b6f7-e354c9c2ef03 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.535099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e478b72-c883-4399-b6f7-e354c9c2ef03 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.535399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e478b72-c883-4399-b6f7-e354c9c2ef03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.562904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7e478b72-c883-4399-b6f7-e354c9c2ef03 None None] MFA Rules not processed for user `453d203bc1474bd8a01bb7afa727d5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:25:59.564102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7e478b72-c883-4399-b6f7-e354c9c2ef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:25:59.626032 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4110/8205] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:25:59.630621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f41ec-1753-44eb-a7e8-10e9c342112a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:59.652200 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:59.697615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f41ec-1753-44eb-a7e8-10e9c342112a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:59.702240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e6e41-5bb8-4822-872f-ee9b09502477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:59.702835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e6e41-5bb8-4822-872f-ee9b09502477 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.703111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e6e41-5bb8-4822-872f-ee9b09502477 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.703381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e6e41-5bb8-4822-872f-ee9b09502477 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.704038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e6e41-5bb8-4822-872f-ee9b09502477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:59.705961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e6e41-5bb8-4822-872f-ee9b09502477 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:59.732631 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4096/8206] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:25:59 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:59.736722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e478b72-c883-4399-b6f7-e354c9c2ef03 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:59.747458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e478b72-c883-4399-b6f7-e354c9c2ef03 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:59.802390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadf518-3308-49a3-adb4-d40555bba9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:59.803010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadf518-3308-49a3-adb4-d40555bba9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.803289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadf518-3308-49a3-adb4-d40555bba9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.803557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadf518-3308-49a3-adb4-d40555bba9a8 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.804255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadf518-3308-49a3-adb4-d40555bba9a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:59.806166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadf518-3308-49a3-adb4-d40555bba9a8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:59.827354 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4111/8207] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:25:59 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:25:59.831128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e6e41-5bb8-4822-872f-ee9b09502477 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:59.842321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e6e41-5bb8-4822-872f-ee9b09502477 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:59.847042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699565a-a1f3-4baf-a95e-2304609a246a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:59.847643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699565a-a1f3-4baf-a95e-2304609a246a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.847921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699565a-a1f3-4baf-a95e-2304609a246a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.848194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699565a-a1f3-4baf-a95e-2304609a246a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.848858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699565a-a1f3-4baf-a95e-2304609a246a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:59.850530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699565a-a1f3-4baf-a95e-2304609a246a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:59.862716 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4097/8208] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:25:59.866798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadf518-3308-49a3-adb4-d40555bba9a8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:59.876569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadf518-3308-49a3-adb4-d40555bba9a8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:59.881089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a3b91-c845-47b9-bb6e-ef710ec10b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:59.881751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a3b91-c845-47b9-bb6e-ef710ec10b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.882528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a3b91-c845-47b9-bb6e-ef710ec10b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.882837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a3b91-c845-47b9-bb6e-ef710ec10b7d admin admin] PATH_INFO: `/v3/projects/297ef7f346b046c1a709ff567d1c4019/users/95ddf04196c04e909ee56ce63fc60392/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.897132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a3b91-c845-47b9-bb6e-ef710ec10b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=297ef7f346b046c1a709ff567d1c4019, user_id=95ddf04196c04e909ee56ce63fc60392, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:59.900485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a3b91-c845-47b9-bb6e-ef710ec10b7d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:59.912319 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4112/8209] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:59 2022] PUT /identity/v3/projects/297ef7f346b046c1a709ff567d1c4019/users/95ddf04196c04e909ee56ce63fc60392/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:25:59.916205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699565a-a1f3-4baf-a95e-2304609a246a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:25:59.926215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699565a-a1f3-4baf-a95e-2304609a246a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:25:59.981545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1c6a1-ebdb-4b6b-a25d-772e4c600211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:25:59.982148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1c6a1-ebdb-4b6b-a25d-772e4c600211 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:25:59.982405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1c6a1-ebdb-4b6b-a25d-772e4c600211 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:25:59.982678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1c6a1-ebdb-4b6b-a25d-772e4c600211 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:25:59.983307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1c6a1-ebdb-4b6b-a25d-772e4c600211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:25:59.984873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1c6a1-ebdb-4b6b-a25d-772e4c600211 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:25:59.994680 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4098/8210] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:25:59.998739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a3b91-c845-47b9-bb6e-ef710ec10b7d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:00.009936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a3b91-c845-47b9-bb6e-ef710ec10b7d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:00.014630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910405ef-a455-4c62-a914-f445accbc4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:00.015274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910405ef-a455-4c62-a914-f445accbc4a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.015859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910405ef-a455-4c62-a914-f445accbc4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.016171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910405ef-a455-4c62-a914-f445accbc4a6 admin admin] PATH_INFO: `/v3/projects/297ef7f346b046c1a709ff567d1c4019/users/95ddf04196c04e909ee56ce63fc60392/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.018200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910405ef-a455-4c62-a914-f445accbc4a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297ef7f346b046c1a709ff567d1c4019, user_id=95ddf04196c04e909ee56ce63fc60392, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:00.020830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910405ef-a455-4c62-a914-f445accbc4a6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:00.031525 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4113/8211] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:25:59 2022] PUT /identity/v3/projects/297ef7f346b046c1a709ff567d1c4019/users/95ddf04196c04e909ee56ce63fc60392/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:00.041685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a665-a485-488d-b02b-55ee7fd758f0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.041973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a665-a485-488d-b02b-55ee7fd758f0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.042250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a665-a485-488d-b02b-55ee7fd758f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.069354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-de50a665-a485-488d-b02b-55ee7fd758f0 None None] MFA Rules not processed for user `95ddf04196c04e909ee56ce63fc60392`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:00.071083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-de50a665-a485-488d-b02b-55ee7fd758f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:00.137919 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4099/8212] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:00.142972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910405ef-a455-4c62-a914-f445accbc4a6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:00.154508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910405ef-a455-4c62-a914-f445accbc4a6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:00.159411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d95b1-45aa-4221-abc5-ae8d5703c24d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:00.159994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d95b1-45aa-4221-abc5-ae8d5703c24d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.160275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d95b1-45aa-4221-abc5-ae8d5703c24d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.160547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d95b1-45aa-4221-abc5-ae8d5703c24d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.161167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d95b1-45aa-4221-abc5-ae8d5703c24d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:00.163074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d95b1-45aa-4221-abc5-ae8d5703c24d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:00.167461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:00.191734 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4114/8213] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:26:00 2022] POST /identity/v3/projects => generated 329 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:00.196404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a665-a485-488d-b02b-55ee7fd758f0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:00.205872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a665-a485-488d-b02b-55ee7fd758f0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:00.215153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:00.264803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc370f0-587f-4a28-8913-3922e34fcdfe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:00.265378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc370f0-587f-4a28-8913-3922e34fcdfe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.265664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc370f0-587f-4a28-8913-3922e34fcdfe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.265942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc370f0-587f-4a28-8913-3922e34fcdfe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.266590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc370f0-587f-4a28-8913-3922e34fcdfe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:00.268479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc370f0-587f-4a28-8913-3922e34fcdfe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:00.292513 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4100/8214] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:00 2022] POST /identity/v3/users => generated 416 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:00.293872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d95b1-45aa-4221-abc5-ae8d5703c24d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:00.304741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d95b1-45aa-4221-abc5-ae8d5703c24d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:00.309347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868a440-d630-4bcf-ad1c-24a3e3fbce33 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:00.309966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a440-d630-4bcf-ad1c-24a3e3fbce33 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.310245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a440-d630-4bcf-ad1c-24a3e3fbce33 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.310518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a440-d630-4bcf-ad1c-24a3e3fbce33 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.311169 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868a440-d630-4bcf-ad1c-24a3e3fbce33 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:00.312754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868a440-d630-4bcf-ad1c-24a3e3fbce33 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:00.327186 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4115/8215] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:26:00 2022] POST /identity/v3/roles => generated 244 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:00.331104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc370f0-587f-4a28-8913-3922e34fcdfe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:00.341059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc370f0-587f-4a28-8913-3922e34fcdfe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:00.351617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ea3a7-d7e7-4763-ab99-5e199bb0b79f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:00.352231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ea3a7-d7e7-4763-ab99-5e199bb0b79f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.352515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ea3a7-d7e7-4763-ab99-5e199bb0b79f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.352788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ea3a7-d7e7-4763-ab99-5e199bb0b79f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.353501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ea3a7-d7e7-4763-ab99-5e199bb0b79f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:00.355088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ea3a7-d7e7-4763-ab99-5e199bb0b79f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:00.370365 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4101/8216] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:26:00 2022] POST /identity/v3/roles => generated 246 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:00.374463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868a440-d630-4bcf-ad1c-24a3e3fbce33 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:00.384986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868a440-d630-4bcf-ad1c-24a3e3fbce33 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:00.389619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2ac46-5114-4d1c-a98b-98614d2dd207 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:00.390259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2ac46-5114-4d1c-a98b-98614d2dd207 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.390543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2ac46-5114-4d1c-a98b-98614d2dd207 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.390822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2ac46-5114-4d1c-a98b-98614d2dd207 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/fc233078b7f9435ea12675f2858767af/users/f271700c394e42129a80133a1ff61198/roles/cd6674fae4d64ffcbc69986c0d3bdfb7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.406703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2ac46-5114-4d1c-a98b-98614d2dd207 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fc233078b7f9435ea12675f2858767af, user_id=f271700c394e42129a80133a1ff61198, role_id=cd6674fae4d64ffcbc69986c0d3bdfb7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:00.409419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2ac46-5114-4d1c-a98b-98614d2dd207 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:00.422021 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4116/8217] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:00 2022] PUT /identity/v3/projects/fc233078b7f9435ea12675f2858767af/users/f271700c394e42129a80133a1ff61198/roles/cd6674fae4d64ffcbc69986c0d3bdfb7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:00.426142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ea3a7-d7e7-4763-ab99-5e199bb0b79f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:00.436819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ea3a7-d7e7-4763-ab99-5e199bb0b79f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:00.493038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6745b8-1f29-4975-a8f2-8965c07c7f0a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:00.493764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6745b8-1f29-4975-a8f2-8965c07c7f0a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.494150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6745b8-1f29-4975-a8f2-8965c07c7f0a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.494435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6745b8-1f29-4975-a8f2-8965c07c7f0a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/fc233078b7f9435ea12675f2858767af/users/f271700c394e42129a80133a1ff61198/roles/a6e61f36d95d484c8f2f7a410ecb78c5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.496673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6745b8-1f29-4975-a8f2-8965c07c7f0a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fc233078b7f9435ea12675f2858767af, user_id=f271700c394e42129a80133a1ff61198, role_id=a6e61f36d95d484c8f2f7a410ecb78c5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:00.499361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6745b8-1f29-4975-a8f2-8965c07c7f0a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:00.512262 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4102/8218] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:00 2022] PUT /identity/v3/projects/fc233078b7f9435ea12675f2858767af/users/f271700c394e42129a80133a1ff61198/roles/a6e61f36d95d484c8f2f7a410ecb78c5 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:00.516328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2ac46-5114-4d1c-a98b-98614d2dd207 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:00.526463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2ac46-5114-4d1c-a98b-98614d2dd207 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:00.581512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96064a7e-5e86-410b-8556-87840bdde328 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:00.582112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96064a7e-5e86-410b-8556-87840bdde328 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.582394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96064a7e-5e86-410b-8556-87840bdde328 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.582670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96064a7e-5e86-410b-8556-87840bdde328 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.583346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96064a7e-5e86-410b-8556-87840bdde328 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:00.585241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96064a7e-5e86-410b-8556-87840bdde328 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:00.620446 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4117/8219] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:00 2022] GET /identity/v3/users => generated 6662 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:00.625422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a571b-e02a-42bb-9f6c-16fdb1751abc None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.625710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a571b-e02a-42bb-9f6c-16fdb1751abc None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.625986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a571b-e02a-42bb-9f6c-16fdb1751abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.664577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a07a571b-e02a-42bb-9f6c-16fdb1751abc None None] MFA Rules not processed for user `f271700c394e42129a80133a1ff61198`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:00.665840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a07a571b-e02a-42bb-9f6c-16fdb1751abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:00.728558 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4103/8220] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:00 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:00.738795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78d2b2-558b-4ca2-b78c-61fa0227ba8f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.739105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78d2b2-558b-4ca2-b78c-61fa0227ba8f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.739378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78d2b2-558b-4ca2-b78c-61fa0227ba8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.758767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7c78d2b2-558b-4ca2-b78c-61fa0227ba8f None None] MFA Rules not processed for user `f271700c394e42129a80133a1ff61198`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:00.759952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7c78d2b2-558b-4ca2-b78c-61fa0227ba8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:00.767061 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4118/8221] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:00 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:00.771015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a571b-e02a-42bb-9f6c-16fdb1751abc None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:00.779838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a571b-e02a-42bb-9f6c-16fdb1751abc None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:00.783871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15148e07-8af4-4af3-8ef5-fb90c90b7fac tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f271700c394e42129a80133a1ff61198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc233078b7f9435ea12675f2858767af', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-366153724', 'tempest-DelegatedRole-1166394109'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:00.784465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15148e07-8af4-4af3-8ef5-fb90c90b7fac tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.784741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15148e07-8af4-4af3-8ef5-fb90c90b7fac tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.785008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15148e07-8af4-4af3-8ef5-fb90c90b7fac tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.785690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15148e07-8af4-4af3-8ef5-fb90c90b7fac tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] RBAC: Authorizing `identity:create_trust()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:00.786813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15148e07-8af4-4af3-8ef5-fb90c90b7fac tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:00.790916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:00.866245 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4104/8222] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Oct 8 21:26:00 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:00.870728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78d2b2-558b-4ca2-b78c-61fa0227ba8f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:00.882038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78d2b2-558b-4ca2-b78c-61fa0227ba8f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:00.886685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a823f-241c-44d7-ba13-a65c81827e5d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:00.887364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a823f-241c-44d7-ba13-a65c81827e5d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.887669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a823f-241c-44d7-ba13-a65c81827e5d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.887922 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a823f-241c-44d7-ba13-a65c81827e5d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.888556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a823f-241c-44d7-ba13-a65c81827e5d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:00.889603 ncdv-master-1 devstack@keystone.service[99084]: WARNING py.warnings [None req-513a823f-241c-44d7-ba13-a65c81827e5d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 21:26:00.889603 ncdv-master-1 devstack@keystone.service[99084]: warnings.warn(msg) Oct 08 21:26:00.889603 ncdv-master-1 devstack@keystone.service[99084]: Oct 08 21:26:00.890492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a823f-241c-44d7-ba13-a65c81827e5d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:00.896965 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4119/8223] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 21:26:00 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:00.901397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15148e07-8af4-4af3-8ef5-fb90c90b7fac tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:00.910833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15148e07-8af4-4af3-8ef5-fb90c90b7fac tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:00.915633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce64343-9584-4af9-8543-d6dc552e0e49 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f271700c394e42129a80133a1ff61198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc233078b7f9435ea12675f2858767af', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-366153724', 'tempest-DelegatedRole-1166394109'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:00.916261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce64343-9584-4af9-8543-d6dc552e0e49 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.916541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce64343-9584-4af9-8543-d6dc552e0e49 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.916818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce64343-9584-4af9-8543-d6dc552e0e49 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] PATH_INFO: `/v3/OS-TRUST/trusts/6cedc61fe4f243ab9a70cce2aeaf4092` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:00.925768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce64343-9584-4af9-8543-d6dc552e0e49 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] RBAC: Authorizing `identity:delete_trust(trust_id=6cedc61fe4f243ab9a70cce2aeaf4092)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:00.927208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce64343-9584-4af9-8543-d6dc552e0e49 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:00.947308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ce64343-9584-4af9-8543-d6dc552e0e49 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6cedc61fe4f243ab9a70cce2aeaf4092', 'request_id': 'req-9ce64343-9584-4af9-8543-d6dc552e0e49'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:00.954272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ce64343-9584-4af9-8543-d6dc552e0e49 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6cedc61fe4f243ab9a70cce2aeaf4092', 'request_id': 'req-9ce64343-9584-4af9-8543-d6dc552e0e49'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:00.954919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9ce64343-9584-4af9-8543-d6dc552e0e49 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6cedc61fe4f243ab9a70cce2aeaf4092', 'request_id': 'req-9ce64343-9584-4af9-8543-d6dc552e0e49'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:00.961658 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4105/8224] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 8 21:26:00 2022] DELETE /identity/v3/OS-TRUST/trusts/6cedc61fe4f243ab9a70cce2aeaf4092 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:00.965760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a823f-241c-44d7-ba13-a65c81827e5d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:00.968249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-513a823f-241c-44d7-ba13-a65c81827e5d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:00.984110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a823f-241c-44d7-ba13-a65c81827e5d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:00.988235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5c178-12bd-4d86-9862-dc59ce461e21 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f271700c394e42129a80133a1ff61198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc233078b7f9435ea12675f2858767af', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-366153724', 'tempest-DelegatedRole-1166394109'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:00.988855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5c178-12bd-4d86-9862-dc59ce461e21 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:00.989133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5c178-12bd-4d86-9862-dc59ce461e21 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:00.989442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5c178-12bd-4d86-9862-dc59ce461e21 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] PATH_INFO: `/v3/OS-TRUST/trusts/6cedc61fe4f243ab9a70cce2aeaf4092` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-bca5c178-12bd-4d86-9862-dc59ce461e21 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] Could not find trust: 6cedc61fe4f243ab9a70cce2aeaf4092.: keystone.exception.TrustNotFound: Could not find trust: 6cedc61fe4f243ab9a70cce2aeaf4092. Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 08 21:26:01.018975 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 08 21:26:01.020083 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 08 21:26:01.020083 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 08 21:26:01.020083 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 08 21:26:01.020083 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 08 21:26:01.020083 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 08 21:26:01.020083 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:26:01.020083 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:26:01.020083 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 08 21:26:01.020083 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 08 21:26:01.020083 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 08 21:26:01.020083 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 08 21:26:01.020083 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6cedc61fe4f243ab9a70cce2aeaf4092. Oct 08 21:26:01.020083 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:26:01.021128 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4120/8225] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:26:00 2022] GET /identity/v3/OS-TRUST/trusts/6cedc61fe4f243ab9a70cce2aeaf4092 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:26:01.024688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce64343-9584-4af9-8543-d6dc552e0e49 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:01.026167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9ce64343-9584-4af9-8543-d6dc552e0e49 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:01.041436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce64343-9584-4af9-8543-d6dc552e0e49 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:01.046065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513898f-28d8-42ff-bad7-b290b2811fb4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:01.046689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513898f-28d8-42ff-bad7-b290b2811fb4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:01.046975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513898f-28d8-42ff-bad7-b290b2811fb4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:01.047250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513898f-28d8-42ff-bad7-b290b2811fb4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles/a6e61f36d95d484c8f2f7a410ecb78c5` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:01.048663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513898f-28d8-42ff-bad7-b290b2811fb4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a6e61f36d95d484c8f2f7a410ecb78c5)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:01.050290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513898f-28d8-42ff-bad7-b290b2811fb4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:01.088788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a513898f-28d8-42ff-bad7-b290b2811fb4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invalidating the token cache because role a6e61f36d95d484c8f2f7a410ecb78c5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:01.089087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a513898f-28d8-42ff-bad7-b290b2811fb4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.089784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a513898f-28d8-42ff-bad7-b290b2811fb4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.091563 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4106/8226] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:01 2022] DELETE /identity/v3/roles/a6e61f36d95d484c8f2f7a410ecb78c5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:01.095913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5c178-12bd-4d86-9862-dc59ce461e21 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:01.097661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bca5c178-12bd-4d86-9862-dc59ce461e21 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:01.112678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5c178-12bd-4d86-9862-dc59ce461e21 tempest-TrustsV3TestJSON-1045177204 tempest-user-1327010186] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:01.167367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00943a-0f82-46c3-98ec-dcb6e996daf3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:01.167985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00943a-0f82-46c3-98ec-dcb6e996daf3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:01.168253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00943a-0f82-46c3-98ec-dcb6e996daf3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:01.168525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00943a-0f82-46c3-98ec-dcb6e996daf3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles/cd6674fae4d64ffcbc69986c0d3bdfb7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:01.169913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00943a-0f82-46c3-98ec-dcb6e996daf3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cd6674fae4d64ffcbc69986c0d3bdfb7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:01.171486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00943a-0f82-46c3-98ec-dcb6e996daf3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:01.189844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:01.209330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c00943a-0f82-46c3-98ec-dcb6e996daf3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invalidating the token cache because role cd6674fae4d64ffcbc69986c0d3bdfb7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:01.209616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c00943a-0f82-46c3-98ec-dcb6e996daf3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.210769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-1c00943a-0f82-46c3-98ec-dcb6e996daf3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.212511 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4121/8227] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:01 2022] DELETE /identity/v3/roles/cd6674fae4d64ffcbc69986c0d3bdfb7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:01.216622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513898f-28d8-42ff-bad7-b290b2811fb4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:01.227742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513898f-28d8-42ff-bad7-b290b2811fb4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:01.285937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:01.286491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:01.286770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:01.287042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users/f271700c394e42129a80133a1ff61198` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:01.288158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f271700c394e42129a80133a1ff61198)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:01.290773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:01.305979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:01.335712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f271700c394e42129a80133a1ff61198'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.342929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f271700c394e42129a80133a1ff61198'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.343608 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f271700c394e42129a80133a1ff61198'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.344221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f271700c394e42129a80133a1ff61198'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.355925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f271700c394e42129a80133a1ff61198'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.368801 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4107/8228] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:01 2022] DELETE /identity/v3/users/f271700c394e42129a80133a1ff61198 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:01.372960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00943a-0f82-46c3-98ec-dcb6e996daf3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:01.374492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1c00943a-0f82-46c3-98ec-dcb6e996daf3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:01.387457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00943a-0f82-46c3-98ec-dcb6e996daf3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:01.442693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:01.443314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:01.443591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:01.443862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/fc233078b7f9435ea12675f2858767af` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:01.445600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fc233078b7f9435ea12675f2858767af)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:01.447487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:01.496992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc233078b7f9435ea12675f2858767af', 'request_id': 'req-c38932b4-0e88-4740-9b82-a651a07e35fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.504083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc233078b7f9435ea12675f2858767af', 'request_id': 'req-c38932b4-0e88-4740-9b82-a651a07e35fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.510306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc233078b7f9435ea12675f2858767af', 'request_id': 'req-c38932b4-0e88-4740-9b82-a651a07e35fe'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.521102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] The token cache is being invalidate because project fc233078b7f9435ea12675f2858767af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:01.521419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.522051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:01.524142 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4122/8229] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:01 2022] DELETE /identity/v3/projects/fc233078b7f9435ea12675f2858767af => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:01.529448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:01.531194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:01.544422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f37508-6f94-4721-98b5-b5317e293ee6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:01.601334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ef447-f1e1-47ce-81d3-dba0f58205cc tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:01.602089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ef447-f1e1-47ce-81d3-dba0f58205cc tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:01.602461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ef447-f1e1-47ce-81d3-dba0f58205cc tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:01.602773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ef447-f1e1-47ce-81d3-dba0f58205cc tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:01.603562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ef447-f1e1-47ce-81d3-dba0f58205cc tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:01.605520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ef447-f1e1-47ce-81d3-dba0f58205cc tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:01.632942 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4108/8230] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:26:01 2022] POST /identity/v3/projects => generated 329 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:26:01.636651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:01.638122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:01.652111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38932b4-0e88-4740-9b82-a651a07e35fe tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:01.709055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43066d6-b077-44b6-a2fb-5e9d38639708 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:01.709692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43066d6-b077-44b6-a2fb-5e9d38639708 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:01.709978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43066d6-b077-44b6-a2fb-5e9d38639708 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:01.710271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43066d6-b077-44b6-a2fb-5e9d38639708 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:01.710924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43066d6-b077-44b6-a2fb-5e9d38639708 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:01.712860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43066d6-b077-44b6-a2fb-5e9d38639708 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:01.733614 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4123/8231] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:01 2022] POST /identity/v3/users => generated 416 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:01.737711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ef447-f1e1-47ce-81d3-dba0f58205cc tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:01.748647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ef447-f1e1-47ce-81d3-dba0f58205cc tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:01.753546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1878355-23ee-4c18-8a03-ed1163e20dd9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:01.754281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1878355-23ee-4c18-8a03-ed1163e20dd9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:01.754617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1878355-23ee-4c18-8a03-ed1163e20dd9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:01.754897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1878355-23ee-4c18-8a03-ed1163e20dd9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:01.755564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1878355-23ee-4c18-8a03-ed1163e20dd9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:01.757804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1878355-23ee-4c18-8a03-ed1163e20dd9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:01.773041 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4109/8232] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:26:01 2022] POST /identity/v3/roles => generated 244 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:01.776969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43066d6-b077-44b6-a2fb-5e9d38639708 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:01.782096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:DELETE=8,keystone:UPDATE=1,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:01.789124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43066d6-b077-44b6-a2fb-5e9d38639708 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:01.795183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd59f09-96a2-4230-9833-347919e16e09 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:01.795948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd59f09-96a2-4230-9833-347919e16e09 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:01.796260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd59f09-96a2-4230-9833-347919e16e09 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:01.796545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd59f09-96a2-4230-9833-347919e16e09 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:01.797473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd59f09-96a2-4230-9833-347919e16e09 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:01.799229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd59f09-96a2-4230-9833-347919e16e09 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:01.814072 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4124/8233] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:26:01 2022] POST /identity/v3/roles => generated 247 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:01.818063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1878355-23ee-4c18-8a03-ed1163e20dd9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:01.829046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1878355-23ee-4c18-8a03-ed1163e20dd9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:01.833690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9143c-97f1-4f47-9529-0fa614c6f26b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:01.834341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9143c-97f1-4f47-9529-0fa614c6f26b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:01.834624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9143c-97f1-4f47-9529-0fa614c6f26b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:01.834899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9143c-97f1-4f47-9529-0fa614c6f26b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/a0d3e3682e2042f4bc1c2b1b44907bcf/users/7da0093f69be4941bd6431529fc46bc3/roles/b64f2178db9f409b8597267bae6f46f7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:01.849414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9143c-97f1-4f47-9529-0fa614c6f26b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a0d3e3682e2042f4bc1c2b1b44907bcf, user_id=7da0093f69be4941bd6431529fc46bc3, role_id=b64f2178db9f409b8597267bae6f46f7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:01.852053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9143c-97f1-4f47-9529-0fa614c6f26b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:01.864926 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4110/8234] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:01 2022] PUT /identity/v3/projects/a0d3e3682e2042f4bc1c2b1b44907bcf/users/7da0093f69be4941bd6431529fc46bc3/roles/b64f2178db9f409b8597267bae6f46f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:01.869624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd59f09-96a2-4230-9833-347919e16e09 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:01.879836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd59f09-96a2-4230-9833-347919e16e09 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:01.937094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9854a29-dd98-4241-a175-0238ba5f49a3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:01.937762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9854a29-dd98-4241-a175-0238ba5f49a3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:01.938044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9854a29-dd98-4241-a175-0238ba5f49a3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:01.938320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9854a29-dd98-4241-a175-0238ba5f49a3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/a0d3e3682e2042f4bc1c2b1b44907bcf/users/7da0093f69be4941bd6431529fc46bc3/roles/f79d98dec2df4d38af4f069be7cf66b7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:01.940477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9854a29-dd98-4241-a175-0238ba5f49a3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a0d3e3682e2042f4bc1c2b1b44907bcf, user_id=7da0093f69be4941bd6431529fc46bc3, role_id=f79d98dec2df4d38af4f069be7cf66b7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:01.943159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9854a29-dd98-4241-a175-0238ba5f49a3 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:01.956495 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4125/8235] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:01 2022] PUT /identity/v3/projects/a0d3e3682e2042f4bc1c2b1b44907bcf/users/7da0093f69be4941bd6431529fc46bc3/roles/f79d98dec2df4d38af4f069be7cf66b7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:26:01.960533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9143c-97f1-4f47-9529-0fa614c6f26b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:01.971271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9143c-97f1-4f47-9529-0fa614c6f26b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:02.012952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:02.031443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caa4b0-c8e2-46f2-92f6-135103b5c53f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:02.032073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caa4b0-c8e2-46f2-92f6-135103b5c53f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:02.032319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caa4b0-c8e2-46f2-92f6-135103b5c53f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:02.032593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caa4b0-c8e2-46f2-92f6-135103b5c53f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:02.033277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caa4b0-c8e2-46f2-92f6-135103b5c53f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:02.035101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caa4b0-c8e2-46f2-92f6-135103b5c53f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:02.060961 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4111/8236] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:01 2022] GET /identity/v3/users => generated 6662 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:02.065915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46c05a-3d8f-4e7d-a7f3-3f87fdc508aa None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:02.066205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46c05a-3d8f-4e7d-a7f3-3f87fdc508aa None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:02.066485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46c05a-3d8f-4e7d-a7f3-3f87fdc508aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:02.250907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8d46c05a-3d8f-4e7d-a7f3-3f87fdc508aa None None] MFA Rules not processed for user `7da0093f69be4941bd6431529fc46bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:02.252127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8d46c05a-3d8f-4e7d-a7f3-3f87fdc508aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:02.315991 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4126/8237] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:02 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:02.327142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177e245-6871-4e8b-9da1-144ca52c0c7c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:02.327432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177e245-6871-4e8b-9da1-144ca52c0c7c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:02.327711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177e245-6871-4e8b-9da1-144ca52c0c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:02.347211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d177e245-6871-4e8b-9da1-144ca52c0c7c None None] MFA Rules not processed for user `7da0093f69be4941bd6431529fc46bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:02.348411 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d177e245-6871-4e8b-9da1-144ca52c0c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:02.355524 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4112/8238] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:02 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:02.359852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46c05a-3d8f-4e7d-a7f3-3f87fdc508aa None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:02.368926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46c05a-3d8f-4e7d-a7f3-3f87fdc508aa None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:02.372965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5634c-3dc8-4788-a9c1-ebad840db274 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7da0093f69be4941bd6431529fc46bc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d3e3682e2042f4bc1c2b1b44907bcf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1423687373', 'tempest-DelegatedRole-1027809172'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:02.373931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5634c-3dc8-4788-a9c1-ebad840db274 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:02.374215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5634c-3dc8-4788-a9c1-ebad840db274 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:02.374478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5634c-3dc8-4788-a9c1-ebad840db274 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:02.375131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5634c-3dc8-4788-a9c1-ebad840db274 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] RBAC: Authorizing `identity:create_trust()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:02.376255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5634c-3dc8-4788-a9c1-ebad840db274 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:02.440989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:02.453667 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4127/8239] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Oct 8 21:26:02 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:26:02.457908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177e245-6871-4e8b-9da1-144ca52c0c7c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:02.467174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177e245-6871-4e8b-9da1-144ca52c0c7c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:02.471848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db45a61-122a-4eea-a48b-54070474d23d tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7da0093f69be4941bd6431529fc46bc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d3e3682e2042f4bc1c2b1b44907bcf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1423687373', 'tempest-DelegatedRole-1027809172'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:02.472465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db45a61-122a-4eea-a48b-54070474d23d tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:02.472913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db45a61-122a-4eea-a48b-54070474d23d tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:02.473225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db45a61-122a-4eea-a48b-54070474d23d tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:02.473916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db45a61-122a-4eea-a48b-54070474d23d tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:02.475296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db45a61-122a-4eea-a48b-54070474d23d tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:02.481550 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4113/8240] 10.222.0.26 () {58 vars in 1252 bytes} [Sat Oct 8 21:26:02 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=7da0093f69be4941bd6431529fc46bc3 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:02.485585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5634c-3dc8-4788-a9c1-ebad840db274 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:02.495467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5634c-3dc8-4788-a9c1-ebad840db274 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:02.499864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f7510-9999-43ee-98d1-ca799af157c6 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7da0093f69be4941bd6431529fc46bc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d3e3682e2042f4bc1c2b1b44907bcf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1423687373', 'tempest-DelegatedRole-1027809172'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:02.500489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f7510-9999-43ee-98d1-ca799af157c6 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:02.500768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f7510-9999-43ee-98d1-ca799af157c6 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:02.501044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f7510-9999-43ee-98d1-ca799af157c6 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] PATH_INFO: `/v3/OS-TRUST/trusts/bbf6238a2e5049f9b8b738e4d8f12339` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:02.508999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f7510-9999-43ee-98d1-ca799af157c6 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] RBAC: Authorizing `identity:delete_trust(trust_id=bbf6238a2e5049f9b8b738e4d8f12339)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:02.510483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f7510-9999-43ee-98d1-ca799af157c6 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:02.533245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e55f7510-9999-43ee-98d1-ca799af157c6 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'bbf6238a2e5049f9b8b738e4d8f12339', 'request_id': 'req-e55f7510-9999-43ee-98d1-ca799af157c6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:02.540603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e55f7510-9999-43ee-98d1-ca799af157c6 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bbf6238a2e5049f9b8b738e4d8f12339', 'request_id': 'req-e55f7510-9999-43ee-98d1-ca799af157c6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:02.541278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e55f7510-9999-43ee-98d1-ca799af157c6 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bbf6238a2e5049f9b8b738e4d8f12339', 'request_id': 'req-e55f7510-9999-43ee-98d1-ca799af157c6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:02.547431 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4128/8241] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 8 21:26:02 2022] DELETE /identity/v3/OS-TRUST/trusts/bbf6238a2e5049f9b8b738e4d8f12339 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:02.551530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db45a61-122a-4eea-a48b-54070474d23d tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:02.553250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0db45a61-122a-4eea-a48b-54070474d23d tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:02.565862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db45a61-122a-4eea-a48b-54070474d23d tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:02.570059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12cb3b-72f7-4929-9efc-6eee2c010f32 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7da0093f69be4941bd6431529fc46bc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d3e3682e2042f4bc1c2b1b44907bcf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1423687373', 'tempest-DelegatedRole-1027809172'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:02.571331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12cb3b-72f7-4929-9efc-6eee2c010f32 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:02.571613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12cb3b-72f7-4929-9efc-6eee2c010f32 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:02.571948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12cb3b-72f7-4929-9efc-6eee2c010f32 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] PATH_INFO: `/v3/OS-TRUST/trusts/bbf6238a2e5049f9b8b738e4d8f12339` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-de12cb3b-72f7-4929-9efc-6eee2c010f32 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Could not find trust: bbf6238a2e5049f9b8b738e4d8f12339.: keystone.exception.TrustNotFound: Could not find trust: bbf6238a2e5049f9b8b738e4d8f12339. Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 08 21:26:02.580979 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 08 21:26:02.582010 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 08 21:26:02.582010 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 08 21:26:02.582010 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 08 21:26:02.582010 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 08 21:26:02.582010 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 08 21:26:02.582010 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:26:02.582010 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:26:02.582010 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 08 21:26:02.582010 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 08 21:26:02.582010 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 08 21:26:02.582010 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 08 21:26:02.582010 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: bbf6238a2e5049f9b8b738e4d8f12339. Oct 08 21:26:02.582010 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:26:02.583059 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4114/8242] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:26:02 2022] GET /identity/v3/OS-TRUST/trusts/bbf6238a2e5049f9b8b738e4d8f12339 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:26:02.586015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f7510-9999-43ee-98d1-ca799af157c6 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:02.587388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e55f7510-9999-43ee-98d1-ca799af157c6 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:02.602432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f7510-9999-43ee-98d1-ca799af157c6 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:02.607286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1991f0-25a3-43a4-8fe7-fa6c2bf5352c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:02.607903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1991f0-25a3-43a4-8fe7-fa6c2bf5352c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:02.608192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1991f0-25a3-43a4-8fe7-fa6c2bf5352c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:02.608471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1991f0-25a3-43a4-8fe7-fa6c2bf5352c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles/f79d98dec2df4d38af4f069be7cf66b7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:02.609894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1991f0-25a3-43a4-8fe7-fa6c2bf5352c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f79d98dec2df4d38af4f069be7cf66b7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:02.611510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1991f0-25a3-43a4-8fe7-fa6c2bf5352c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:02.649939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d1991f0-25a3-43a4-8fe7-fa6c2bf5352c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invalidating the token cache because role f79d98dec2df4d38af4f069be7cf66b7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:02.650231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d1991f0-25a3-43a4-8fe7-fa6c2bf5352c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:02.650944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-4d1991f0-25a3-43a4-8fe7-fa6c2bf5352c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:02.652811 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4129/8243] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:02 2022] DELETE /identity/v3/roles/f79d98dec2df4d38af4f069be7cf66b7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:02.656955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12cb3b-72f7-4929-9efc-6eee2c010f32 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:02.658678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-de12cb3b-72f7-4929-9efc-6eee2c010f32 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:02.673960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12cb3b-72f7-4929-9efc-6eee2c010f32 tempest-TrustsV3TestJSON-1521028111 tempest-user-1655189778] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:02.730489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a27fd2-09c0-46ae-b271-74e6ac65912b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:02.731375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a27fd2-09c0-46ae-b271-74e6ac65912b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:02.731660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a27fd2-09c0-46ae-b271-74e6ac65912b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:02.731939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a27fd2-09c0-46ae-b271-74e6ac65912b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles/b64f2178db9f409b8597267bae6f46f7` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:02.733381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a27fd2-09c0-46ae-b271-74e6ac65912b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b64f2178db9f409b8597267bae6f46f7)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:02.734978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a27fd2-09c0-46ae-b271-74e6ac65912b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:02.771275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c1a27fd2-09c0-46ae-b271-74e6ac65912b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invalidating the token cache because role b64f2178db9f409b8597267bae6f46f7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:02.771569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c1a27fd2-09c0-46ae-b271-74e6ac65912b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:02.772234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c1a27fd2-09c0-46ae-b271-74e6ac65912b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:02.774067 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4115/8244] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:02 2022] DELETE /identity/v3/roles/b64f2178db9f409b8597267bae6f46f7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:02.778179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1991f0-25a3-43a4-8fe7-fa6c2bf5352c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:02.788826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1991f0-25a3-43a4-8fe7-fa6c2bf5352c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:02.845369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:02.845928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:02.846212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:02.846487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users/7da0093f69be4941bd6431529fc46bc3` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:02.847637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7da0093f69be4941bd6431529fc46bc3)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:02.849572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:02.892884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da0093f69be4941bd6431529fc46bc3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:02.900142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da0093f69be4941bd6431529fc46bc3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:02.900846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da0093f69be4941bd6431529fc46bc3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:02.901525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da0093f69be4941bd6431529fc46bc3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:02.913076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da0093f69be4941bd6431529fc46bc3'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:02.916043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=13 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:02.930479 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4130/8245] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:02 2022] DELETE /identity/v3/users/7da0093f69be4941bd6431529fc46bc3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:02.934622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a27fd2-09c0-46ae-b271-74e6ac65912b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:02.936069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c1a27fd2-09c0-46ae-b271-74e6ac65912b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:02.949375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a27fd2-09c0-46ae-b271-74e6ac65912b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:03.010828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:03.011460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.011747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.012023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/a0d3e3682e2042f4bc1c2b1b44907bcf` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.013154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a0d3e3682e2042f4bc1c2b1b44907bcf)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:03.015104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:03.038493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:03.066313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d3e3682e2042f4bc1c2b1b44907bcf', 'request_id': 'req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:03.073432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d3e3682e2042f4bc1c2b1b44907bcf', 'request_id': 'req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:03.079597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d3e3682e2042f4bc1c2b1b44907bcf', 'request_id': 'req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:03.091142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] The token cache is being invalidate because project a0d3e3682e2042f4bc1c2b1b44907bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:03.091416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:03.092075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:03.093599 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4116/8246] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:02 2022] DELETE /identity/v3/projects/a0d3e3682e2042f4bc1c2b1b44907bcf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:03.099099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:03.100458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:03.114338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7916d65-528d-4761-b002-fb724101d934 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:03.170709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94977-d638-4c14-82e0-16e71de58c59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:03.171314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94977-d638-4c14-82e0-16e71de58c59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.171597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94977-d638-4c14-82e0-16e71de58c59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.171872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94977-d638-4c14-82e0-16e71de58c59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.172497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c94977-d638-4c14-82e0-16e71de58c59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:03.174457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c94977-d638-4c14-82e0-16e71de58c59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:03.200424 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4131/8247] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:26:03 2022] POST /identity/v3/projects => generated 329 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:26:03.204542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:03.206024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:03.219578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cffa0c-ef23-484e-8dd6-d7cf357c0c4c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:03.280321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af992ac-ff5b-4470-ad47-f273053914db tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:03.280963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af992ac-ff5b-4470-ad47-f273053914db tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.281269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af992ac-ff5b-4470-ad47-f273053914db tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.281544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af992ac-ff5b-4470-ad47-f273053914db tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.282184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af992ac-ff5b-4470-ad47-f273053914db tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:03.284076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af992ac-ff5b-4470-ad47-f273053914db tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:03.305170 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4117/8248] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:03 2022] POST /identity/v3/users => generated 416 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:26:03.309218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94977-d638-4c14-82e0-16e71de58c59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:03.320244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94977-d638-4c14-82e0-16e71de58c59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:03.324794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ed157-edfa-4979-a32e-9037e83db501 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:03.325408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ed157-edfa-4979-a32e-9037e83db501 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.325689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ed157-edfa-4979-a32e-9037e83db501 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.325963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ed157-edfa-4979-a32e-9037e83db501 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.326615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ed157-edfa-4979-a32e-9037e83db501 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:03.328184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ed157-edfa-4979-a32e-9037e83db501 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:03.342636 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4132/8249] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:26:03 2022] POST /identity/v3/roles => generated 243 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:26:03.346471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af992ac-ff5b-4470-ad47-f273053914db tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:03.357813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af992ac-ff5b-4470-ad47-f273053914db tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:03.362454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef7557-390f-4773-8cea-c08fc2d33d47 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:03.363472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef7557-390f-4773-8cea-c08fc2d33d47 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.363472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef7557-390f-4773-8cea-c08fc2d33d47 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.363642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef7557-390f-4773-8cea-c08fc2d33d47 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.364403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef7557-390f-4773-8cea-c08fc2d33d47 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:03.366097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef7557-390f-4773-8cea-c08fc2d33d47 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:03.381685 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4118/8250] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:26:03 2022] POST /identity/v3/roles => generated 247 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:03.385791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ed157-edfa-4979-a32e-9037e83db501 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:03.396132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ed157-edfa-4979-a32e-9037e83db501 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:03.401512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d03fb1-044c-4e29-bb96-bdc897b4e87f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:03.402160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d03fb1-044c-4e29-bb96-bdc897b4e87f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.402468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d03fb1-044c-4e29-bb96-bdc897b4e87f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.402743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d03fb1-044c-4e29-bb96-bdc897b4e87f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/4d4171a7a5d043dcb452be871426ad78/users/89cb87590cd24ed899a79bd44bc0eb04/roles/b8c4c218b1b64f0c9842a7bcf539ad49` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.418212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d03fb1-044c-4e29-bb96-bdc897b4e87f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4d4171a7a5d043dcb452be871426ad78, user_id=89cb87590cd24ed899a79bd44bc0eb04, role_id=b8c4c218b1b64f0c9842a7bcf539ad49)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:03.420847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d03fb1-044c-4e29-bb96-bdc897b4e87f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:03.433549 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4133/8251] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:03 2022] PUT /identity/v3/projects/4d4171a7a5d043dcb452be871426ad78/users/89cb87590cd24ed899a79bd44bc0eb04/roles/b8c4c218b1b64f0c9842a7bcf539ad49 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:03.437627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef7557-390f-4773-8cea-c08fc2d33d47 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:03.447961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef7557-390f-4773-8cea-c08fc2d33d47 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:03.508831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008ef72-7e08-4b53-bcce-50215c43b680 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:03.509538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008ef72-7e08-4b53-bcce-50215c43b680 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.509818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008ef72-7e08-4b53-bcce-50215c43b680 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.510087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008ef72-7e08-4b53-bcce-50215c43b680 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/4d4171a7a5d043dcb452be871426ad78/users/89cb87590cd24ed899a79bd44bc0eb04/roles/61e6df4f2f0240bab75467f34a793162` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.512307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008ef72-7e08-4b53-bcce-50215c43b680 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4d4171a7a5d043dcb452be871426ad78, user_id=89cb87590cd24ed899a79bd44bc0eb04, role_id=61e6df4f2f0240bab75467f34a793162)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:03.514999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008ef72-7e08-4b53-bcce-50215c43b680 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:03.528419 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4119/8252] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:03 2022] PUT /identity/v3/projects/4d4171a7a5d043dcb452be871426ad78/users/89cb87590cd24ed899a79bd44bc0eb04/roles/61e6df4f2f0240bab75467f34a793162 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:03.532722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d03fb1-044c-4e29-bb96-bdc897b4e87f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:03.543230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d03fb1-044c-4e29-bb96-bdc897b4e87f tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:03.600211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec64c4-a7bd-4dc6-a60a-e21ccbad3914 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:03.600813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec64c4-a7bd-4dc6-a60a-e21ccbad3914 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.601092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec64c4-a7bd-4dc6-a60a-e21ccbad3914 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.601451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec64c4-a7bd-4dc6-a60a-e21ccbad3914 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.602109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec64c4-a7bd-4dc6-a60a-e21ccbad3914 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:03.603924 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec64c4-a7bd-4dc6-a60a-e21ccbad3914 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:03.628321 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4134/8253] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:03 2022] GET /identity/v3/users => generated 6662 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:03.633677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8354b-33c9-4510-99c3-c810b710b93d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.633966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8354b-33c9-4510-99c3-c810b710b93d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.634241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8354b-33c9-4510-99c3-c810b710b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.664790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=7,keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:03.674260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c0c8354b-33c9-4510-99c3-c810b710b93d None None] MFA Rules not processed for user `89cb87590cd24ed899a79bd44bc0eb04`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:03.676282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c0c8354b-33c9-4510-99c3-c810b710b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:03.740302 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4120/8254] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:03.750030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f9f6-310f-451e-928d-f98ebfb730a6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.750317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f9f6-310f-451e-928d-f98ebfb730a6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.750594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f9f6-310f-451e-928d-f98ebfb730a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.769749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-94c9f9f6-310f-451e-928d-f98ebfb730a6 None None] MFA Rules not processed for user `89cb87590cd24ed899a79bd44bc0eb04`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:03.770955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-94c9f9f6-310f-451e-928d-f98ebfb730a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:03.778728 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4135/8255] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:03.782736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8354b-33c9-4510-99c3-c810b710b93d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:03.792011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8354b-33c9-4510-99c3-c810b710b93d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:03.796155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884caf4-da00-482e-8e92-3207728228c7 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cb87590cd24ed899a79bd44bc0eb04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4171a7a5d043dcb452be871426ad78', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1037872541', 'tempest-DelegatedRole-676799464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:03.796755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884caf4-da00-482e-8e92-3207728228c7 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.797037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884caf4-da00-482e-8e92-3207728228c7 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.797344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884caf4-da00-482e-8e92-3207728228c7 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.798007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884caf4-da00-482e-8e92-3207728228c7 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorizing `identity:create_trust()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:03.799140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884caf4-da00-482e-8e92-3207728228c7 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:03.869158 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4121/8256] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Oct 8 21:26:03 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:26:03.873805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9f9f6-310f-451e-928d-f98ebfb730a6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:03.882472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9f9f6-310f-451e-928d-f98ebfb730a6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:03.887140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc7bfa-6a17-4beb-be45-8731bda34c9a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cb87590cd24ed899a79bd44bc0eb04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4171a7a5d043dcb452be871426ad78', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1037872541', 'tempest-DelegatedRole-676799464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:03.887742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc7bfa-6a17-4beb-be45-8731bda34c9a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.888023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc7bfa-6a17-4beb-be45-8731bda34c9a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.888297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc7bfa-6a17-4beb-be45-8731bda34c9a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] PATH_INFO: `/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.894298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc7bfa-6a17-4beb-be45-8731bda34c9a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorizing `identity:get_trust(trust_id=a328a13271614a948d43c7ffc5ed9d4d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:03.895728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc7bfa-6a17-4beb-be45-8731bda34c9a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:03.904103 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4136/8257] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:26:03 2022] GET /identity/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d => generated 858 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:03.908184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884caf4-da00-482e-8e92-3207728228c7 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:03.917431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884caf4-da00-482e-8e92-3207728228c7 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:03.921543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237b49b-4b5d-416e-ab82-12032f91c020 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cb87590cd24ed899a79bd44bc0eb04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4171a7a5d043dcb452be871426ad78', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1037872541', 'tempest-DelegatedRole-676799464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:03.922167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237b49b-4b5d-416e-ab82-12032f91c020 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.922454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237b49b-4b5d-416e-ab82-12032f91c020 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.922720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237b49b-4b5d-416e-ab82-12032f91c020 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] PATH_INFO: `/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.928732 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237b49b-4b5d-416e-ab82-12032f91c020 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=a328a13271614a948d43c7ffc5ed9d4d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:03.930725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237b49b-4b5d-416e-ab82-12032f91c020 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:03.937576 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4122/8258] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 21:26:03 2022] GET /identity/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d/roles => generated 370 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:03.941429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc7bfa-6a17-4beb-be45-8731bda34c9a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:03.951201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc7bfa-6a17-4beb-be45-8731bda34c9a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:03.955351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd46ad-da97-44fd-87b1-775830ef355d tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cb87590cd24ed899a79bd44bc0eb04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4171a7a5d043dcb452be871426ad78', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1037872541', 'tempest-DelegatedRole-676799464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:03.955976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd46ad-da97-44fd-87b1-775830ef355d tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.956254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd46ad-da97-44fd-87b1-775830ef355d tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.956581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd46ad-da97-44fd-87b1-775830ef355d tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] PATH_INFO: `/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d/roles/b8c4c218b1b64f0c9842a7bcf539ad49` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.962304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd46ad-da97-44fd-87b1-775830ef355d tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a328a13271614a948d43c7ffc5ed9d4d, role_id=b8c4c218b1b64f0c9842a7bcf539ad49)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:03.963715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd46ad-da97-44fd-87b1-775830ef355d tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:03.964965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:03.972819 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4137/8259] 10.222.0.26 () {58 vars in 1368 bytes} [Sat Oct 8 21:26:03 2022] GET /identity/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d/roles/b8c4c218b1b64f0c9842a7bcf539ad49 => generated 243 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:03.976619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237b49b-4b5d-416e-ab82-12032f91c020 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:03.986174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237b49b-4b5d-416e-ab82-12032f91c020 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:03.990326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db8cef-debd-42df-ab52-fa6135b41958 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cb87590cd24ed899a79bd44bc0eb04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4171a7a5d043dcb452be871426ad78', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1037872541', 'tempest-DelegatedRole-676799464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:03.990958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db8cef-debd-42df-ab52-fa6135b41958 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:03.991235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db8cef-debd-42df-ab52-fa6135b41958 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:03.991517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db8cef-debd-42df-ab52-fa6135b41958 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] PATH_INFO: `/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d/roles/b8c4c218b1b64f0c9842a7bcf539ad49` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:03.997807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db8cef-debd-42df-ab52-fa6135b41958 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a328a13271614a948d43c7ffc5ed9d4d, role_id=b8c4c218b1b64f0c9842a7bcf539ad49)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:03.999217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db8cef-debd-42df-ab52-fa6135b41958 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:04.005800 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4123/8260] 10.222.0.26 () {58 vars in 1369 bytes} [Sat Oct 8 21:26:03 2022] HEAD /identity/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d/roles/b8c4c218b1b64f0c9842a7bcf539ad49 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 08 21:26:04.010315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd46ad-da97-44fd-87b1-775830ef355d tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:04.019625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd46ad-da97-44fd-87b1-775830ef355d tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:04.023733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74722b-d7d0-4fb5-8ed3-ab4021e807ad tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cb87590cd24ed899a79bd44bc0eb04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4171a7a5d043dcb452be871426ad78', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1037872541', 'tempest-DelegatedRole-676799464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:04.024354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74722b-d7d0-4fb5-8ed3-ab4021e807ad tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:04.024634 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74722b-d7d0-4fb5-8ed3-ab4021e807ad tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:04.024906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74722b-d7d0-4fb5-8ed3-ab4021e807ad tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] PATH_INFO: `/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d/roles/61e6df4f2f0240bab75467f34a793162` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:04.030635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74722b-d7d0-4fb5-8ed3-ab4021e807ad tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a328a13271614a948d43c7ffc5ed9d4d, role_id=61e6df4f2f0240bab75467f34a793162)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:04.032040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74722b-d7d0-4fb5-8ed3-ab4021e807ad tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-6d74722b-d7d0-4fb5-8ed3-ab4021e807ad tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Could not find role: 61e6df4f2f0240bab75467f34a793162.: keystone.exception.RoleNotFound: Could not find role: 61e6df4f2f0240bab75467f34a793162. Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 21:26:04.041832 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 61e6df4f2f0240bab75467f34a793162. Oct 08 21:26:04.042733 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:26:04.042953 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4138/8261] 10.222.0.26 () {58 vars in 1368 bytes} [Sat Oct 8 21:26:04 2022] GET /identity/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d/roles/61e6df4f2f0240bab75467f34a793162 => generated 110 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 08 21:26:04.046753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db8cef-debd-42df-ab52-fa6135b41958 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:04.056666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db8cef-debd-42df-ab52-fa6135b41958 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:04.061105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5cca1-5652-499a-8b67-585d062cb3f8 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cb87590cd24ed899a79bd44bc0eb04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4171a7a5d043dcb452be871426ad78', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1037872541', 'tempest-DelegatedRole-676799464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:04.061771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5cca1-5652-499a-8b67-585d062cb3f8 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:04.062050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5cca1-5652-499a-8b67-585d062cb3f8 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:04.062319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5cca1-5652-499a-8b67-585d062cb3f8 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] PATH_INFO: `/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d/roles/61e6df4f2f0240bab75467f34a793162` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:04.068027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5cca1-5652-499a-8b67-585d062cb3f8 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a328a13271614a948d43c7ffc5ed9d4d, role_id=61e6df4f2f0240bab75467f34a793162)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:04.069462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5cca1-5652-499a-8b67-585d062cb3f8 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-c6f5cca1-5652-499a-8b67-585d062cb3f8 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Could not find role: 61e6df4f2f0240bab75467f34a793162.: keystone.exception.RoleNotFound: Could not find role: 61e6df4f2f0240bab75467f34a793162. Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 21:26:04.079875 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 61e6df4f2f0240bab75467f34a793162. Oct 08 21:26:04.080895 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:26:04.080895 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4124/8262] 10.222.0.26 () {58 vars in 1369 bytes} [Sat Oct 8 21:26:04 2022] HEAD /identity/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d/roles/61e6df4f2f0240bab75467f34a793162 => generated 0 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 08 21:26:04.084872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74722b-d7d0-4fb5-8ed3-ab4021e807ad tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:04.094466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74722b-d7d0-4fb5-8ed3-ab4021e807ad tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:04.098522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba391e3-2c34-441c-994a-7ee2275ffd1a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cb87590cd24ed899a79bd44bc0eb04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4171a7a5d043dcb452be871426ad78', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1037872541', 'tempest-DelegatedRole-676799464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:04.099119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba391e3-2c34-441c-994a-7ee2275ffd1a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:04.099417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba391e3-2c34-441c-994a-7ee2275ffd1a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:04.099686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba391e3-2c34-441c-994a-7ee2275ffd1a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] PATH_INFO: `/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:04.105405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba391e3-2c34-441c-994a-7ee2275ffd1a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorizing `identity:delete_trust(trust_id=a328a13271614a948d43c7ffc5ed9d4d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:04.107064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba391e3-2c34-441c-994a-7ee2275ffd1a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:04.123938 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ba391e3-2c34-441c-994a-7ee2275ffd1a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'a328a13271614a948d43c7ffc5ed9d4d', 'request_id': 'req-5ba391e3-2c34-441c-994a-7ee2275ffd1a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.130769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ba391e3-2c34-441c-994a-7ee2275ffd1a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a328a13271614a948d43c7ffc5ed9d4d', 'request_id': 'req-5ba391e3-2c34-441c-994a-7ee2275ffd1a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.131560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5ba391e3-2c34-441c-994a-7ee2275ffd1a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a328a13271614a948d43c7ffc5ed9d4d', 'request_id': 'req-5ba391e3-2c34-441c-994a-7ee2275ffd1a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.138256 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4139/8263] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 8 21:26:04 2022] DELETE /identity/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:04.142174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5cca1-5652-499a-8b67-585d062cb3f8 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:04.143860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c6f5cca1-5652-499a-8b67-585d062cb3f8 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:04.156628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5cca1-5652-499a-8b67-585d062cb3f8 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:04.160981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2a179-fb4f-4c1c-a365-9d6ad95a9972 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cb87590cd24ed899a79bd44bc0eb04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4171a7a5d043dcb452be871426ad78', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1037872541', 'tempest-DelegatedRole-676799464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:04.161647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2a179-fb4f-4c1c-a365-9d6ad95a9972 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:04.161924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2a179-fb4f-4c1c-a365-9d6ad95a9972 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:04.162194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2a179-fb4f-4c1c-a365-9d6ad95a9972 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] PATH_INFO: `/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-9db2a179-fb4f-4c1c-a365-9d6ad95a9972 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Could not find trust: a328a13271614a948d43c7ffc5ed9d4d.: keystone.exception.TrustNotFound: Could not find trust: a328a13271614a948d43c7ffc5ed9d4d. Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 08 21:26:04.170843 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 08 21:26:04.171867 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 08 21:26:04.171867 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 08 21:26:04.171867 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 08 21:26:04.171867 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 08 21:26:04.171867 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 08 21:26:04.171867 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:26:04.171867 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:26:04.171867 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 08 21:26:04.171867 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 08 21:26:04.171867 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 08 21:26:04.171867 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 08 21:26:04.171867 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: a328a13271614a948d43c7ffc5ed9d4d. Oct 08 21:26:04.171867 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:26:04.172809 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4125/8264] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:26:04 2022] GET /identity/v3/OS-TRUST/trusts/a328a13271614a948d43c7ffc5ed9d4d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:26:04.175691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba391e3-2c34-441c-994a-7ee2275ffd1a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:04.177014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5ba391e3-2c34-441c-994a-7ee2275ffd1a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:04.191919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba391e3-2c34-441c-994a-7ee2275ffd1a tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:04.197044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075eccd-0e88-4a7c-8585-c3009546f00d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:04.197679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075eccd-0e88-4a7c-8585-c3009546f00d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:04.197956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075eccd-0e88-4a7c-8585-c3009546f00d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:04.198224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075eccd-0e88-4a7c-8585-c3009546f00d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles/61e6df4f2f0240bab75467f34a793162` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:04.199589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075eccd-0e88-4a7c-8585-c3009546f00d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_role(role_id=61e6df4f2f0240bab75467f34a793162)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:04.201138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075eccd-0e88-4a7c-8585-c3009546f00d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:04.236472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7075eccd-0e88-4a7c-8585-c3009546f00d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invalidating the token cache because role 61e6df4f2f0240bab75467f34a793162 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:04.236761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7075eccd-0e88-4a7c-8585-c3009546f00d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.237477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-7075eccd-0e88-4a7c-8585-c3009546f00d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.239234 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4140/8265] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:04 2022] DELETE /identity/v3/roles/61e6df4f2f0240bab75467f34a793162 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:04.246283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2a179-fb4f-4c1c-a365-9d6ad95a9972 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:04.248036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9db2a179-fb4f-4c1c-a365-9d6ad95a9972 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:04.264173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2a179-fb4f-4c1c-a365-9d6ad95a9972 tempest-TrustsV3TestJSON-1598513150 tempest-user-1467054686] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:04.290260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:04.323087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40f21a-ab63-41b2-8b10-cab96e8ee742 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:04.323712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40f21a-ab63-41b2-8b10-cab96e8ee742 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:04.323998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40f21a-ab63-41b2-8b10-cab96e8ee742 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:04.324278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40f21a-ab63-41b2-8b10-cab96e8ee742 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles/b8c4c218b1b64f0c9842a7bcf539ad49` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:04.325720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40f21a-ab63-41b2-8b10-cab96e8ee742 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b8c4c218b1b64f0c9842a7bcf539ad49)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:04.327329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40f21a-ab63-41b2-8b10-cab96e8ee742 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:04.364607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a40f21a-ab63-41b2-8b10-cab96e8ee742 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invalidating the token cache because role b8c4c218b1b64f0c9842a7bcf539ad49 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:04.364899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a40f21a-ab63-41b2-8b10-cab96e8ee742 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.365575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7a40f21a-ab63-41b2-8b10-cab96e8ee742 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.367961 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4126/8266] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:04 2022] DELETE /identity/v3/roles/b8c4c218b1b64f0c9842a7bcf539ad49 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:04.372059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075eccd-0e88-4a7c-8585-c3009546f00d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:04.382672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075eccd-0e88-4a7c-8585-c3009546f00d tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:04.438244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:04.438801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:04.439083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:04.439359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users/89cb87590cd24ed899a79bd44bc0eb04` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:04.440484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_user(user_id=89cb87590cd24ed899a79bd44bc0eb04)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:04.442417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:04.485439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89cb87590cd24ed899a79bd44bc0eb04'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.493212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89cb87590cd24ed899a79bd44bc0eb04'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.493918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89cb87590cd24ed899a79bd44bc0eb04'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.494549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89cb87590cd24ed899a79bd44bc0eb04'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.496395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=11 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:04.509378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89cb87590cd24ed899a79bd44bc0eb04'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.522486 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4141/8267] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:04 2022] DELETE /identity/v3/users/89cb87590cd24ed899a79bd44bc0eb04 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:04.526599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40f21a-ab63-41b2-8b10-cab96e8ee742 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:04.528050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7a40f21a-ab63-41b2-8b10-cab96e8ee742 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:04.542034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40f21a-ab63-41b2-8b10-cab96e8ee742 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:04.598313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:04.598948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:04.599279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:04.599551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/4d4171a7a5d043dcb452be871426ad78` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:04.600695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4d4171a7a5d043dcb452be871426ad78)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:04.603167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:04.655474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d4171a7a5d043dcb452be871426ad78', 'request_id': 'req-6f89e573-6f2f-46a1-a421-62c5b00d097e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.662218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d4171a7a5d043dcb452be871426ad78', 'request_id': 'req-6f89e573-6f2f-46a1-a421-62c5b00d097e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.668472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d4171a7a5d043dcb452be871426ad78', 'request_id': 'req-6f89e573-6f2f-46a1-a421-62c5b00d097e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.679571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] The token cache is being invalidate because project 4d4171a7a5d043dcb452be871426ad78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:04.679860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.680508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:04.682041 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4127/8268] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:04 2022] DELETE /identity/v3/projects/4d4171a7a5d043dcb452be871426ad78 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:04.687551 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:04.688995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:04.702346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bd7fc-9cd4-41fe-b0be-70ddcc3723f7 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:04.757738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc96ca-a1ca-48f5-8b7d-2e928e41412c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:04.758362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc96ca-a1ca-48f5-8b7d-2e928e41412c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:04.758669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc96ca-a1ca-48f5-8b7d-2e928e41412c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:04.758950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc96ca-a1ca-48f5-8b7d-2e928e41412c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:04.759571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc96ca-a1ca-48f5-8b7d-2e928e41412c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:04.761537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc96ca-a1ca-48f5-8b7d-2e928e41412c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:04.788105 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4142/8269] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:26:04 2022] POST /identity/v3/projects => generated 329 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:04.792783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:04.794199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:04.807466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89e573-6f2f-46a1-a421-62c5b00d097e tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:04.825765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:04.867383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491f98b-04a9-4eed-8fba-184404cd1dee tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:04.868030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491f98b-04a9-4eed-8fba-184404cd1dee tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:04.868309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491f98b-04a9-4eed-8fba-184404cd1dee tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:04.868583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491f98b-04a9-4eed-8fba-184404cd1dee tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:04.869253 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491f98b-04a9-4eed-8fba-184404cd1dee tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:04.871168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491f98b-04a9-4eed-8fba-184404cd1dee tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:04.891952 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4128/8270] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:04 2022] POST /identity/v3/users => generated 416 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:04.896020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc96ca-a1ca-48f5-8b7d-2e928e41412c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:04.907485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc96ca-a1ca-48f5-8b7d-2e928e41412c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:04.912076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74384e3-f70e-4d25-be2e-d6da09d7f524 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:04.912688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74384e3-f70e-4d25-be2e-d6da09d7f524 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:04.912967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74384e3-f70e-4d25-be2e-d6da09d7f524 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:04.913267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74384e3-f70e-4d25-be2e-d6da09d7f524 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:04.914564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74384e3-f70e-4d25-be2e-d6da09d7f524 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:04.916201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74384e3-f70e-4d25-be2e-d6da09d7f524 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:04.931262 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4143/8271] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:26:04 2022] POST /identity/v3/roles => generated 244 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:04.935215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491f98b-04a9-4eed-8fba-184404cd1dee tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:04.945897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491f98b-04a9-4eed-8fba-184404cd1dee tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:04.950504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0be471-db0d-4169-914c-7a1f5905bbaf tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:04.951098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0be471-db0d-4169-914c-7a1f5905bbaf tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:04.951382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0be471-db0d-4169-914c-7a1f5905bbaf tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:04.951657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0be471-db0d-4169-914c-7a1f5905bbaf tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:04.952344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0be471-db0d-4169-914c-7a1f5905bbaf tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:04.954054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0be471-db0d-4169-914c-7a1f5905bbaf tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:04.969695 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4129/8272] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:26:04 2022] POST /identity/v3/roles => generated 246 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:04.973090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74384e3-f70e-4d25-be2e-d6da09d7f524 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:04.984433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74384e3-f70e-4d25-be2e-d6da09d7f524 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:04.989501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0d125-ee43-4a90-8ab6-b6ddd1173668 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:04.990148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0d125-ee43-4a90-8ab6-b6ddd1173668 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:04.990429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0d125-ee43-4a90-8ab6-b6ddd1173668 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:04.990705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0d125-ee43-4a90-8ab6-b6ddd1173668 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/9f8e467d3e9847eb9f4d2afd9311c8d1/users/a61c791f09de4132b1c368764f3b3664/roles/b8491808c3374c72a6e30267946ae94f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:05.006087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0d125-ee43-4a90-8ab6-b6ddd1173668 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9f8e467d3e9847eb9f4d2afd9311c8d1, user_id=a61c791f09de4132b1c368764f3b3664, role_id=b8491808c3374c72a6e30267946ae94f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:05.009337 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0d125-ee43-4a90-8ab6-b6ddd1173668 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:05.025732 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4144/8273] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:04 2022] PUT /identity/v3/projects/9f8e467d3e9847eb9f4d2afd9311c8d1/users/a61c791f09de4132b1c368764f3b3664/roles/b8491808c3374c72a6e30267946ae94f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:05.029887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0be471-db0d-4169-914c-7a1f5905bbaf tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:05.040813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0be471-db0d-4169-914c-7a1f5905bbaf tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:05.097201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8d391-444a-4d62-8e8c-3b29ab1951e8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:05.097877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8d391-444a-4d62-8e8c-3b29ab1951e8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:05.098164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8d391-444a-4d62-8e8c-3b29ab1951e8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:05.098441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8d391-444a-4d62-8e8c-3b29ab1951e8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/9f8e467d3e9847eb9f4d2afd9311c8d1/users/a61c791f09de4132b1c368764f3b3664/roles/d9a33706ed1840c7a906c60fb41cc947` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:05.100676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8d391-444a-4d62-8e8c-3b29ab1951e8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9f8e467d3e9847eb9f4d2afd9311c8d1, user_id=a61c791f09de4132b1c368764f3b3664, role_id=d9a33706ed1840c7a906c60fb41cc947)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:05.103540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8d391-444a-4d62-8e8c-3b29ab1951e8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:05.116762 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4130/8274] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:05 2022] PUT /identity/v3/projects/9f8e467d3e9847eb9f4d2afd9311c8d1/users/a61c791f09de4132b1c368764f3b3664/roles/d9a33706ed1840c7a906c60fb41cc947 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:05.120783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0d125-ee43-4a90-8ab6-b6ddd1173668 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:05.131504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0d125-ee43-4a90-8ab6-b6ddd1173668 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:05.186105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefac2ff-318b-481e-80fa-8715e833b1c0 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:05.186709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefac2ff-318b-481e-80fa-8715e833b1c0 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:05.187041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefac2ff-318b-481e-80fa-8715e833b1c0 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:05.187323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefac2ff-318b-481e-80fa-8715e833b1c0 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:05.188005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefac2ff-318b-481e-80fa-8715e833b1c0 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:05.189866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefac2ff-318b-481e-80fa-8715e833b1c0 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:05.216366 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4145/8275] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:05 2022] GET /identity/v3/users => generated 6662 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:05.221579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d039de-d082-4db9-8b30-a5ec56ba2e72 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:05.221860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d039de-d082-4db9-8b30-a5ec56ba2e72 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:05.222153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d039de-d082-4db9-8b30-a5ec56ba2e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:05.260245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c7d039de-d082-4db9-8b30-a5ec56ba2e72 None None] MFA Rules not processed for user `a61c791f09de4132b1c368764f3b3664`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:05.261493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c7d039de-d082-4db9-8b30-a5ec56ba2e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:05.324859 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4131/8276] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:05.335533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a929e-a5e6-46df-bdf1-2da88deab9f3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:05.335855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a929e-a5e6-46df-bdf1-2da88deab9f3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:05.336135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a929e-a5e6-46df-bdf1-2da88deab9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:05.355765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1d2a929e-a5e6-46df-bdf1-2da88deab9f3 None None] MFA Rules not processed for user `a61c791f09de4132b1c368764f3b3664`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:05.357233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1d2a929e-a5e6-46df-bdf1-2da88deab9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:05.364313 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4146/8277] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:05.368661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d039de-d082-4db9-8b30-a5ec56ba2e72 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:05.377760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d039de-d082-4db9-8b30-a5ec56ba2e72 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:05.381873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ba79d-68cf-4343-aba1-3308b4105f6e tempest-TrustsV3TestJSON-1108709682 tempest-user-1898542372] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61c791f09de4132b1c368764f3b3664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f8e467d3e9847eb9f4d2afd9311c8d1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-427394710', 'tempest-DelegatedRole-1191725953'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:05.382464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ba79d-68cf-4343-aba1-3308b4105f6e tempest-TrustsV3TestJSON-1108709682 tempest-user-1898542372] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:05.383280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ba79d-68cf-4343-aba1-3308b4105f6e tempest-TrustsV3TestJSON-1108709682 tempest-user-1898542372] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:05.383553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ba79d-68cf-4343-aba1-3308b4105f6e tempest-TrustsV3TestJSON-1108709682 tempest-user-1898542372] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:05.384211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ba79d-68cf-4343-aba1-3308b4105f6e tempest-TrustsV3TestJSON-1108709682 tempest-user-1898542372] RBAC: Authorizing `identity:create_trust()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:05.385367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ba79d-68cf-4343-aba1-3308b4105f6e tempest-TrustsV3TestJSON-1108709682 tempest-user-1898542372] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:05.397482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-313ba79d-68cf-4343-aba1-3308b4105f6e tempest-TrustsV3TestJSON-1108709682 tempest-user-1898542372] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 08 21:26:05.477389 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 08 21:26:05.478454 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 08 21:26:05.479475 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 08 21:26:05.479475 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 08 21:26:05.479475 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 08 21:26:05.479475 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 08 21:26:05.479475 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 08 21:26:05.479475 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:26:05.479475 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4132/8278] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Oct 8 21:26:05 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 111 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 08 21:26:05.483060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a929e-a5e6-46df-bdf1-2da88deab9f3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:05.495821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a929e-a5e6-46df-bdf1-2da88deab9f3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:05.500650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72587c0b-5c7a-432f-b2bc-65bb76a6a53a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:05.501309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72587c0b-5c7a-432f-b2bc-65bb76a6a53a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:05.501594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72587c0b-5c7a-432f-b2bc-65bb76a6a53a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:05.501869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72587c0b-5c7a-432f-b2bc-65bb76a6a53a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles/d9a33706ed1840c7a906c60fb41cc947` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:05.503262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72587c0b-5c7a-432f-b2bc-65bb76a6a53a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d9a33706ed1840c7a906c60fb41cc947)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:05.504854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72587c0b-5c7a-432f-b2bc-65bb76a6a53a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:05.513329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:05.542651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-72587c0b-5c7a-432f-b2bc-65bb76a6a53a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invalidating the token cache because role d9a33706ed1840c7a906c60fb41cc947 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:05.542937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-72587c0b-5c7a-432f-b2bc-65bb76a6a53a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.543594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-72587c0b-5c7a-432f-b2bc-65bb76a6a53a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.545337 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4147/8279] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:05 2022] DELETE /identity/v3/roles/d9a33706ed1840c7a906c60fb41cc947 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:05.549472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ba79d-68cf-4343-aba1-3308b4105f6e tempest-TrustsV3TestJSON-1108709682 tempest-user-1898542372] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:05.551205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-313ba79d-68cf-4343-aba1-3308b4105f6e tempest-TrustsV3TestJSON-1108709682 tempest-user-1898542372] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:05.567356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ba79d-68cf-4343-aba1-3308b4105f6e tempest-TrustsV3TestJSON-1108709682 tempest-user-1898542372] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:05.623501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337533d-d0ba-4060-ba37-e870b157f623 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:05.624126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337533d-d0ba-4060-ba37-e870b157f623 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:05.624409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337533d-d0ba-4060-ba37-e870b157f623 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:05.624688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337533d-d0ba-4060-ba37-e870b157f623 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles/b8491808c3374c72a6e30267946ae94f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:05.626163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337533d-d0ba-4060-ba37-e870b157f623 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b8491808c3374c72a6e30267946ae94f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:05.627738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337533d-d0ba-4060-ba37-e870b157f623 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:05.666650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8337533d-d0ba-4060-ba37-e870b157f623 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invalidating the token cache because role b8491808c3374c72a6e30267946ae94f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:05.666935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8337533d-d0ba-4060-ba37-e870b157f623 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.667600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8337533d-d0ba-4060-ba37-e870b157f623 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.669411 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4133/8280] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:05 2022] DELETE /identity/v3/roles/b8491808c3374c72a6e30267946ae94f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:05.673457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72587c0b-5c7a-432f-b2bc-65bb76a6a53a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:05.684567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72587c0b-5c7a-432f-b2bc-65bb76a6a53a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:05.738910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:05.739460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:05.739755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:05.740011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users/a61c791f09de4132b1c368764f3b3664` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:05.741116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a61c791f09de4132b1c368764f3b3664)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:05.743601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:05.785175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a61c791f09de4132b1c368764f3b3664'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.792436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a61c791f09de4132b1c368764f3b3664'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.793095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a61c791f09de4132b1c368764f3b3664'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.793753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a61c791f09de4132b1c368764f3b3664'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.805982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a61c791f09de4132b1c368764f3b3664'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.818128 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4148/8281] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:05 2022] DELETE /identity/v3/users/a61c791f09de4132b1c368764f3b3664 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:05.822282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337533d-d0ba-4060-ba37-e870b157f623 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:05.823666 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8337533d-d0ba-4060-ba37-e870b157f623 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:05.836683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337533d-d0ba-4060-ba37-e870b157f623 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:05.893336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:05.893963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:05.894243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:05.894515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/9f8e467d3e9847eb9f4d2afd9311c8d1` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:05.895632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9f8e467d3e9847eb9f4d2afd9311c8d1)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:05.897553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:05.922351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:05.945227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f8e467d3e9847eb9f4d2afd9311c8d1', 'request_id': 'req-bfe272eb-cf17-41d4-a55a-2d219d269dae'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.952401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f8e467d3e9847eb9f4d2afd9311c8d1', 'request_id': 'req-bfe272eb-cf17-41d4-a55a-2d219d269dae'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.957978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f8e467d3e9847eb9f4d2afd9311c8d1', 'request_id': 'req-bfe272eb-cf17-41d4-a55a-2d219d269dae'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.969408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] The token cache is being invalidate because project 9f8e467d3e9847eb9f4d2afd9311c8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:05.969696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.970337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:05.971819 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4134/8282] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:05 2022] DELETE /identity/v3/projects/9f8e467d3e9847eb9f4d2afd9311c8d1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:05.977686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:05.979105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:05.993239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0eb38-44e9-4e77-98ee-95774a199d05 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.039800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:06.051842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81f71a-0602-47c5-8a0c-6c8317a43b55 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.052449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81f71a-0602-47c5-8a0c-6c8317a43b55 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.052732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81f71a-0602-47c5-8a0c-6c8317a43b55 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.053004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81f71a-0602-47c5-8a0c-6c8317a43b55 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.053663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81f71a-0602-47c5-8a0c-6c8317a43b55 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.056157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81f71a-0602-47c5-8a0c-6c8317a43b55 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.084140 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4149/8283] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:26:05 2022] POST /identity/v3/projects => generated 328 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:26:06.088318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.089814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:06.104337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe272eb-cf17-41d4-a55a-2d219d269dae tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.160968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17dc56-61bd-4c64-87a3-e6a307ce765a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.161604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17dc56-61bd-4c64-87a3-e6a307ce765a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.161890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17dc56-61bd-4c64-87a3-e6a307ce765a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.162167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17dc56-61bd-4c64-87a3-e6a307ce765a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.162793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17dc56-61bd-4c64-87a3-e6a307ce765a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.165370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17dc56-61bd-4c64-87a3-e6a307ce765a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.185952 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4135/8284] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:06 2022] POST /identity/v3/users => generated 413 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:06.190080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81f71a-0602-47c5-8a0c-6c8317a43b55 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.201344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81f71a-0602-47c5-8a0c-6c8317a43b55 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.205932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e02e62-919a-49f6-80c6-500d655bf248 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.206525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e02e62-919a-49f6-80c6-500d655bf248 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.206807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e02e62-919a-49f6-80c6-500d655bf248 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.207080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e02e62-919a-49f6-80c6-500d655bf248 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.207740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e02e62-919a-49f6-80c6-500d655bf248 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.209353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e02e62-919a-49f6-80c6-500d655bf248 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.225034 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4150/8285] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:26:06 2022] POST /identity/v3/roles => generated 244 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:26:06.229462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17dc56-61bd-4c64-87a3-e6a307ce765a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.240084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17dc56-61bd-4c64-87a3-e6a307ce765a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.245047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eddc11-717e-4fbd-84a0-830df7ffb9d9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.245658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eddc11-717e-4fbd-84a0-830df7ffb9d9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.245940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eddc11-717e-4fbd-84a0-830df7ffb9d9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.246218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eddc11-717e-4fbd-84a0-830df7ffb9d9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.246885 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eddc11-717e-4fbd-84a0-830df7ffb9d9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.248474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eddc11-717e-4fbd-84a0-830df7ffb9d9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.265001 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4136/8286] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:26:06 2022] POST /identity/v3/roles => generated 246 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:06.269209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e02e62-919a-49f6-80c6-500d655bf248 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.280398 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e02e62-919a-49f6-80c6-500d655bf248 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.285020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea28b5-c807-4780-b1d6-7b07a2d4e987 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.285707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea28b5-c807-4780-b1d6-7b07a2d4e987 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.285990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea28b5-c807-4780-b1d6-7b07a2d4e987 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.286268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea28b5-c807-4780-b1d6-7b07a2d4e987 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/950dcc2e599f4dd68a57ab9885162f63/users/efefe815b2b445b9b8fe5088c00d4110/roles/37cf3053463041d3836888dded9392a8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.301332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea28b5-c807-4780-b1d6-7b07a2d4e987 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_grant(project_id=950dcc2e599f4dd68a57ab9885162f63, user_id=efefe815b2b445b9b8fe5088c00d4110, role_id=37cf3053463041d3836888dded9392a8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.304371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea28b5-c807-4780-b1d6-7b07a2d4e987 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.316758 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4151/8287] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:06 2022] PUT /identity/v3/projects/950dcc2e599f4dd68a57ab9885162f63/users/efefe815b2b445b9b8fe5088c00d4110/roles/37cf3053463041d3836888dded9392a8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:06.321011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eddc11-717e-4fbd-84a0-830df7ffb9d9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.331404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eddc11-717e-4fbd-84a0-830df7ffb9d9 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.391623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c5bfe-3f19-4050-bb46-d16478d4ea2c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.392290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c5bfe-3f19-4050-bb46-d16478d4ea2c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.392579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c5bfe-3f19-4050-bb46-d16478d4ea2c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.392853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c5bfe-3f19-4050-bb46-d16478d4ea2c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/950dcc2e599f4dd68a57ab9885162f63/users/efefe815b2b445b9b8fe5088c00d4110/roles/78264cf290c049469bb8896f2ebb9b1e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.395273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c5bfe-3f19-4050-bb46-d16478d4ea2c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_grant(project_id=950dcc2e599f4dd68a57ab9885162f63, user_id=efefe815b2b445b9b8fe5088c00d4110, role_id=78264cf290c049469bb8896f2ebb9b1e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.397949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c5bfe-3f19-4050-bb46-d16478d4ea2c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.411713 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4137/8288] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:06 2022] PUT /identity/v3/projects/950dcc2e599f4dd68a57ab9885162f63/users/efefe815b2b445b9b8fe5088c00d4110/roles/78264cf290c049469bb8896f2ebb9b1e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:06.416329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea28b5-c807-4780-b1d6-7b07a2d4e987 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.427143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea28b5-c807-4780-b1d6-7b07a2d4e987 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.483719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966ed53-d616-4696-b9a4-c674d8b4b6c0 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.484336 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966ed53-d616-4696-b9a4-c674d8b4b6c0 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.484620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966ed53-d616-4696-b9a4-c674d8b4b6c0 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.484897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966ed53-d616-4696-b9a4-c674d8b4b6c0 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.485653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966ed53-d616-4696-b9a4-c674d8b4b6c0 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.487490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966ed53-d616-4696-b9a4-c674d8b4b6c0 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.513026 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4152/8289] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:06 2022] GET /identity/v3/users => generated 6659 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:06.518147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bd97-f0fe-4601-bc06-19870dd024a0 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.518459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bd97-f0fe-4601-bc06-19870dd024a0 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.518733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bd97-f0fe-4601-bc06-19870dd024a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.555582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6842bd97-f0fe-4601-bc06-19870dd024a0 None None] MFA Rules not processed for user `efefe815b2b445b9b8fe5088c00d4110`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:06.556779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6842bd97-f0fe-4601-bc06-19870dd024a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:06.560928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:06.623107 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4138/8290] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:06 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:06.633560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627df56-ca78-47e9-b104-a8f45e3fa047 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.633850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627df56-ca78-47e9-b104-a8f45e3fa047 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.634131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627df56-ca78-47e9-b104-a8f45e3fa047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.655676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5627df56-ca78-47e9-b104-a8f45e3fa047 None None] MFA Rules not processed for user `efefe815b2b445b9b8fe5088c00d4110`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:06.656895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5627df56-ca78-47e9-b104-a8f45e3fa047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:06.664236 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4153/8291] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:06 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:06.668528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842bd97-f0fe-4601-bc06-19870dd024a0 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.677593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842bd97-f0fe-4601-bc06-19870dd024a0 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.681741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e84d7-dd51-421b-988e-00d23a88b63e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efefe815b2b445b9b8fe5088c00d4110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950dcc2e599f4dd68a57ab9885162f63', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-114711573', 'tempest-DelegatedRole-1519098344'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.682341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e84d7-dd51-421b-988e-00d23a88b63e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.682620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e84d7-dd51-421b-988e-00d23a88b63e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.682892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e84d7-dd51-421b-988e-00d23a88b63e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.683541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e84d7-dd51-421b-988e-00d23a88b63e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorizing `identity:create_trust()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.684706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e84d7-dd51-421b-988e-00d23a88b63e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.759582 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4139/8292] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Oct 8 21:26:06 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:06.761370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627df56-ca78-47e9-b104-a8f45e3fa047 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.769942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627df56-ca78-47e9-b104-a8f45e3fa047 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.774032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366cbf3-dea6-4b88-93c1-75f9e97aa8ca tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efefe815b2b445b9b8fe5088c00d4110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950dcc2e599f4dd68a57ab9885162f63', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-114711573', 'tempest-DelegatedRole-1519098344'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.774642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366cbf3-dea6-4b88-93c1-75f9e97aa8ca tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.775494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366cbf3-dea6-4b88-93c1-75f9e97aa8ca tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.775768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366cbf3-dea6-4b88-93c1-75f9e97aa8ca tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] PATH_INFO: `/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.781717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366cbf3-dea6-4b88-93c1-75f9e97aa8ca tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorizing `identity:get_trust(trust_id=2e22ea82e034465d943766aba26c0f47)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.783246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366cbf3-dea6-4b88-93c1-75f9e97aa8ca tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.790417 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4154/8293] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:26:06 2022] GET /identity/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47 => generated 834 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:06.794101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e84d7-dd51-421b-988e-00d23a88b63e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.803795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e84d7-dd51-421b-988e-00d23a88b63e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.808090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9c9b8-2173-4846-bdbb-b41e5e08da8e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efefe815b2b445b9b8fe5088c00d4110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950dcc2e599f4dd68a57ab9885162f63', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-114711573', 'tempest-DelegatedRole-1519098344'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.808715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9c9b8-2173-4846-bdbb-b41e5e08da8e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.808993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9c9b8-2173-4846-bdbb-b41e5e08da8e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.809308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9c9b8-2173-4846-bdbb-b41e5e08da8e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] PATH_INFO: `/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.815047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9c9b8-2173-4846-bdbb-b41e5e08da8e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=2e22ea82e034465d943766aba26c0f47)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.816460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9c9b8-2173-4846-bdbb-b41e5e08da8e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.823818 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4140/8294] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 21:26:06 2022] GET /identity/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47/roles => generated 371 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:06.827665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366cbf3-dea6-4b88-93c1-75f9e97aa8ca tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.836856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366cbf3-dea6-4b88-93c1-75f9e97aa8ca tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.841602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bec925-beec-4e58-ba5d-11f355b63bdc tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efefe815b2b445b9b8fe5088c00d4110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950dcc2e599f4dd68a57ab9885162f63', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-114711573', 'tempest-DelegatedRole-1519098344'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.842217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bec925-beec-4e58-ba5d-11f355b63bdc tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.842494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bec925-beec-4e58-ba5d-11f355b63bdc tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.842766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bec925-beec-4e58-ba5d-11f355b63bdc tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] PATH_INFO: `/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47/roles/37cf3053463041d3836888dded9392a8` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.848347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bec925-beec-4e58-ba5d-11f355b63bdc tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorizing `identity:get_role_for_trust(trust_id=2e22ea82e034465d943766aba26c0f47, role_id=37cf3053463041d3836888dded9392a8)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.849783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bec925-beec-4e58-ba5d-11f355b63bdc tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.857354 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4155/8295] 10.222.0.26 () {58 vars in 1368 bytes} [Sat Oct 8 21:26:06 2022] GET /identity/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47/roles/37cf3053463041d3836888dded9392a8 => generated 244 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:06.861219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9c9b8-2173-4846-bdbb-b41e5e08da8e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.870953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9c9b8-2173-4846-bdbb-b41e5e08da8e tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.875090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d54fd-37f5-4f59-b5ea-e06864db9d31 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efefe815b2b445b9b8fe5088c00d4110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950dcc2e599f4dd68a57ab9885162f63', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-114711573', 'tempest-DelegatedRole-1519098344'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.875710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d54fd-37f5-4f59-b5ea-e06864db9d31 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.875991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d54fd-37f5-4f59-b5ea-e06864db9d31 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.876267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d54fd-37f5-4f59-b5ea-e06864db9d31 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] PATH_INFO: `/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47/roles/37cf3053463041d3836888dded9392a8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.882050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d54fd-37f5-4f59-b5ea-e06864db9d31 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorizing `identity:get_role_for_trust(trust_id=2e22ea82e034465d943766aba26c0f47, role_id=37cf3053463041d3836888dded9392a8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.883438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d54fd-37f5-4f59-b5ea-e06864db9d31 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.890240 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4141/8296] 10.222.0.26 () {58 vars in 1369 bytes} [Sat Oct 8 21:26:06 2022] HEAD /identity/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47/roles/37cf3053463041d3836888dded9392a8 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 08 21:26:06.893949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bec925-beec-4e58-ba5d-11f355b63bdc tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.903602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bec925-beec-4e58-ba5d-11f355b63bdc tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.907823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d7328-3ec4-44d6-9249-b1bbaa345e12 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efefe815b2b445b9b8fe5088c00d4110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950dcc2e599f4dd68a57ab9885162f63', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-114711573', 'tempest-DelegatedRole-1519098344'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.908446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d7328-3ec4-44d6-9249-b1bbaa345e12 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.908730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d7328-3ec4-44d6-9249-b1bbaa345e12 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.909008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d7328-3ec4-44d6-9249-b1bbaa345e12 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] PATH_INFO: `/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47/roles/78264cf290c049469bb8896f2ebb9b1e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.914681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d7328-3ec4-44d6-9249-b1bbaa345e12 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorizing `identity:get_role_for_trust(trust_id=2e22ea82e034465d943766aba26c0f47, role_id=78264cf290c049469bb8896f2ebb9b1e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.916626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d7328-3ec4-44d6-9249-b1bbaa345e12 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-4b5d7328-3ec4-44d6-9249-b1bbaa345e12 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Could not find role: 78264cf290c049469bb8896f2ebb9b1e.: keystone.exception.RoleNotFound: Could not find role: 78264cf290c049469bb8896f2ebb9b1e. Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 21:26:06.926415 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 78264cf290c049469bb8896f2ebb9b1e. Oct 08 21:26:06.927461 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:26:06.927461 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4156/8297] 10.222.0.26 () {58 vars in 1368 bytes} [Sat Oct 8 21:26:06 2022] GET /identity/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47/roles/78264cf290c049469bb8896f2ebb9b1e => generated 110 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:26:06.931677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d54fd-37f5-4f59-b5ea-e06864db9d31 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.940783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d54fd-37f5-4f59-b5ea-e06864db9d31 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.944875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c9264-dcc4-482e-bf4c-0bbb9621f740 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efefe815b2b445b9b8fe5088c00d4110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950dcc2e599f4dd68a57ab9885162f63', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-114711573', 'tempest-DelegatedRole-1519098344'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.945528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c9264-dcc4-482e-bf4c-0bbb9621f740 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.945809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c9264-dcc4-482e-bf4c-0bbb9621f740 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.946082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c9264-dcc4-482e-bf4c-0bbb9621f740 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] PATH_INFO: `/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47/roles/78264cf290c049469bb8896f2ebb9b1e` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.952145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c9264-dcc4-482e-bf4c-0bbb9621f740 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorizing `identity:get_role_for_trust(trust_id=2e22ea82e034465d943766aba26c0f47, role_id=78264cf290c049469bb8896f2ebb9b1e)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.953614 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c9264-dcc4-482e-bf4c-0bbb9621f740 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-361c9264-dcc4-482e-bf4c-0bbb9621f740 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Could not find role: 78264cf290c049469bb8896f2ebb9b1e.: keystone.exception.RoleNotFound: Could not find role: 78264cf290c049469bb8896f2ebb9b1e. Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 21:26:06.964106 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 78264cf290c049469bb8896f2ebb9b1e. Oct 08 21:26:06.965115 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:26:06.965221 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4142/8298] 10.222.0.26 () {58 vars in 1369 bytes} [Sat Oct 8 21:26:06 2022] HEAD /identity/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47/roles/78264cf290c049469bb8896f2ebb9b1e => generated 0 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 08 21:26:06.969327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d7328-3ec4-44d6-9249-b1bbaa345e12 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:06.979555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d7328-3ec4-44d6-9249-b1bbaa345e12 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:06.983949 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b9f38-214d-4c31-b0ff-4ae3e3d29972 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efefe815b2b445b9b8fe5088c00d4110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950dcc2e599f4dd68a57ab9885162f63', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-114711573', 'tempest-DelegatedRole-1519098344'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:06.984559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9f38-214d-4c31-b0ff-4ae3e3d29972 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:06.984841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9f38-214d-4c31-b0ff-4ae3e3d29972 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:06.985118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9f38-214d-4c31-b0ff-4ae3e3d29972 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] PATH_INFO: `/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:06.991176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b9f38-214d-4c31-b0ff-4ae3e3d29972 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorizing `identity:delete_trust(trust_id=2e22ea82e034465d943766aba26c0f47)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:06.992624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b9f38-214d-4c31-b0ff-4ae3e3d29972 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:07.008827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-220b9f38-214d-4c31-b0ff-4ae3e3d29972 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '2e22ea82e034465d943766aba26c0f47', 'request_id': 'req-220b9f38-214d-4c31-b0ff-4ae3e3d29972'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.012603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:07.016763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-220b9f38-214d-4c31-b0ff-4ae3e3d29972 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '2e22ea82e034465d943766aba26c0f47', 'request_id': 'req-220b9f38-214d-4c31-b0ff-4ae3e3d29972'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.017732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-220b9f38-214d-4c31-b0ff-4ae3e3d29972 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '2e22ea82e034465d943766aba26c0f47', 'request_id': 'req-220b9f38-214d-4c31-b0ff-4ae3e3d29972'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.026699 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4157/8299] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 8 21:26:06 2022] DELETE /identity/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:26:07.030852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c9264-dcc4-482e-bf4c-0bbb9621f740 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:07.032504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-361c9264-dcc4-482e-bf4c-0bbb9621f740 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:07.046153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c9264-dcc4-482e-bf4c-0bbb9621f740 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:07.050456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeea0de-c912-48f4-a8d2-5f52772a0880 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efefe815b2b445b9b8fe5088c00d4110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950dcc2e599f4dd68a57ab9885162f63', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-114711573', 'tempest-DelegatedRole-1519098344'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:07.051068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeea0de-c912-48f4-a8d2-5f52772a0880 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:07.051345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeea0de-c912-48f4-a8d2-5f52772a0880 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:07.051617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeea0de-c912-48f4-a8d2-5f52772a0880 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] PATH_INFO: `/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-8eeea0de-c912-48f4-a8d2-5f52772a0880 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Could not find trust: 2e22ea82e034465d943766aba26c0f47.: keystone.exception.TrustNotFound: Could not find trust: 2e22ea82e034465d943766aba26c0f47. Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 08 21:26:07.060844 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 08 21:26:07.061896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 08 21:26:07.061896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 08 21:26:07.061896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 08 21:26:07.061896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 08 21:26:07.061896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 08 21:26:07.061896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:26:07.061896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:26:07.061896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 08 21:26:07.061896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 08 21:26:07.061896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 08 21:26:07.061896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 08 21:26:07.061896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 2e22ea82e034465d943766aba26c0f47. Oct 08 21:26:07.061896 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:26:07.062873 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4143/8300] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:26:07 2022] GET /identity/v3/OS-TRUST/trusts/2e22ea82e034465d943766aba26c0f47 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:26:07.066081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b9f38-214d-4c31-b0ff-4ae3e3d29972 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:07.067440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-220b9f38-214d-4c31-b0ff-4ae3e3d29972 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:07.082116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b9f38-214d-4c31-b0ff-4ae3e3d29972 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:07.086745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb96d92-287b-4c6a-96ec-e7f937167cef tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:07.087933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb96d92-287b-4c6a-96ec-e7f937167cef tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:07.088258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb96d92-287b-4c6a-96ec-e7f937167cef tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:07.088532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb96d92-287b-4c6a-96ec-e7f937167cef tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles/78264cf290c049469bb8896f2ebb9b1e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:07.089951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb96d92-287b-4c6a-96ec-e7f937167cef tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_role(role_id=78264cf290c049469bb8896f2ebb9b1e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:07.091620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb96d92-287b-4c6a-96ec-e7f937167cef tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:07.128147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bcb96d92-287b-4c6a-96ec-e7f937167cef tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invalidating the token cache because role 78264cf290c049469bb8896f2ebb9b1e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:07.128440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bcb96d92-287b-4c6a-96ec-e7f937167cef tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.129116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bcb96d92-287b-4c6a-96ec-e7f937167cef tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.130892 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4158/8301] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:07 2022] DELETE /identity/v3/roles/78264cf290c049469bb8896f2ebb9b1e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:07.135045 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeea0de-c912-48f4-a8d2-5f52772a0880 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:07.136864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8eeea0de-c912-48f4-a8d2-5f52772a0880 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:07.152160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeea0de-c912-48f4-a8d2-5f52772a0880 tempest-TrustsV3TestJSON-136094125 tempest-user-197207825] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:07.181381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:07.207745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09962cae-32b8-4d21-8cb4-222a0f1f33ea tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:07.208370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09962cae-32b8-4d21-8cb4-222a0f1f33ea tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:07.208649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09962cae-32b8-4d21-8cb4-222a0f1f33ea tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:07.208924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09962cae-32b8-4d21-8cb4-222a0f1f33ea tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles/37cf3053463041d3836888dded9392a8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:07.210349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09962cae-32b8-4d21-8cb4-222a0f1f33ea tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_role(role_id=37cf3053463041d3836888dded9392a8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:07.211918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09962cae-32b8-4d21-8cb4-222a0f1f33ea tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:07.249351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-09962cae-32b8-4d21-8cb4-222a0f1f33ea tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invalidating the token cache because role 37cf3053463041d3836888dded9392a8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:07.249644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-09962cae-32b8-4d21-8cb4-222a0f1f33ea tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.250306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-09962cae-32b8-4d21-8cb4-222a0f1f33ea tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.252097 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4144/8302] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:07 2022] DELETE /identity/v3/roles/37cf3053463041d3836888dded9392a8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:26:07.256355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb96d92-287b-4c6a-96ec-e7f937167cef tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:07.268034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb96d92-287b-4c6a-96ec-e7f937167cef tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:07.325221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:07.325778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:07.326081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:07.326355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users/efefe815b2b445b9b8fe5088c00d4110` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:07.327602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_user(user_id=efefe815b2b445b9b8fe5088c00d4110)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:07.329603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:07.372968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efefe815b2b445b9b8fe5088c00d4110'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.379801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efefe815b2b445b9b8fe5088c00d4110'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.380471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efefe815b2b445b9b8fe5088c00d4110'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.381096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efefe815b2b445b9b8fe5088c00d4110'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.392836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efefe815b2b445b9b8fe5088c00d4110'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.405442 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4159/8303] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:07 2022] DELETE /identity/v3/users/efefe815b2b445b9b8fe5088c00d4110 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:07.409560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09962cae-32b8-4d21-8cb4-222a0f1f33ea tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:07.410943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-09962cae-32b8-4d21-8cb4-222a0f1f33ea tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:07.424548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09962cae-32b8-4d21-8cb4-222a0f1f33ea tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:07.482526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:07.483173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:07.483458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:07.483736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/950dcc2e599f4dd68a57ab9885162f63` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:07.484898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_project(project_id=950dcc2e599f4dd68a57ab9885162f63)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:07.486843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:07.537122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950dcc2e599f4dd68a57ab9885162f63', 'request_id': 'req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.544851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950dcc2e599f4dd68a57ab9885162f63', 'request_id': 'req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.550644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950dcc2e599f4dd68a57ab9885162f63', 'request_id': 'req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.562148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] The token cache is being invalidate because project 950dcc2e599f4dd68a57ab9885162f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:07.562439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.563081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:07.564561 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4145/8304] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:07 2022] DELETE /identity/v3/projects/950dcc2e599f4dd68a57ab9885162f63 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:07.570184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:07.571702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:07.586839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11da50f-b801-452d-bae5-3cbd05cdde1b tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:07.617012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:07.646129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d06239-cf74-402f-b728-58c0429e5974 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:07.646929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d06239-cf74-402f-b728-58c0429e5974 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:07.647319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d06239-cf74-402f-b728-58c0429e5974 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:07.647691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d06239-cf74-402f-b728-58c0429e5974 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:07.648553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d06239-cf74-402f-b728-58c0429e5974 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:07.651134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d06239-cf74-402f-b728-58c0429e5974 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:07.678174 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4160/8305] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Oct 8 21:26:07 2022] POST /identity/v3/projects => generated 329 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:07.682298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:07.683831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:07.697327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c804b0-43fe-4b7e-802c-c6a6c426dcb6 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:07.722395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:07.756687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c6ac4-b589-417f-8ef9-363bf71f7c71 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:07.757322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c6ac4-b589-417f-8ef9-363bf71f7c71 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:07.757609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c6ac4-b589-417f-8ef9-363bf71f7c71 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:07.757889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c6ac4-b589-417f-8ef9-363bf71f7c71 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:07.758538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c6ac4-b589-417f-8ef9-363bf71f7c71 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:07.760467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c6ac4-b589-417f-8ef9-363bf71f7c71 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:07.782242 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4146/8306] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:07 2022] POST /identity/v3/users => generated 416 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:07.787212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d06239-cf74-402f-b728-58c0429e5974 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:07.798912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d06239-cf74-402f-b728-58c0429e5974 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:07.804046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bafc6-20c3-489c-9733-12cee50e9433 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:07.804641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bafc6-20c3-489c-9733-12cee50e9433 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:07.804926 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bafc6-20c3-489c-9733-12cee50e9433 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:07.805221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bafc6-20c3-489c-9733-12cee50e9433 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:07.806020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bafc6-20c3-489c-9733-12cee50e9433 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:07.807675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bafc6-20c3-489c-9733-12cee50e9433 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:07.822162 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4161/8307] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:26:07 2022] POST /identity/v3/roles => generated 243 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:07.826040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c6ac4-b589-417f-8ef9-363bf71f7c71 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:07.836633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c6ac4-b589-417f-8ef9-363bf71f7c71 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:07.841755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90f3f7-723e-45cc-9196-dc714db7efd4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:07.842287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90f3f7-723e-45cc-9196-dc714db7efd4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:07.842585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90f3f7-723e-45cc-9196-dc714db7efd4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:07.842840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90f3f7-723e-45cc-9196-dc714db7efd4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:07.843494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90f3f7-723e-45cc-9196-dc714db7efd4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:07.845054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90f3f7-723e-45cc-9196-dc714db7efd4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:07.860766 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4147/8308] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Oct 8 21:26:07 2022] POST /identity/v3/roles => generated 246 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:26:07.864550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bafc6-20c3-489c-9733-12cee50e9433 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:07.875019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bafc6-20c3-489c-9733-12cee50e9433 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:07.879594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59984524-c518-44aa-a771-ed8dcd8de8f8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:07.880224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59984524-c518-44aa-a771-ed8dcd8de8f8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:07.880503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59984524-c518-44aa-a771-ed8dcd8de8f8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:07.880776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59984524-c518-44aa-a771-ed8dcd8de8f8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/7f5f1aacb5dc4b3d93b6a2aebd09f213/users/32389083783c4b8ca2b6149ab3bb6187/roles/977a6342255f409f94f56ffe6869d7fc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:07.895383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59984524-c518-44aa-a771-ed8dcd8de8f8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7f5f1aacb5dc4b3d93b6a2aebd09f213, user_id=32389083783c4b8ca2b6149ab3bb6187, role_id=977a6342255f409f94f56ffe6869d7fc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:07.898312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59984524-c518-44aa-a771-ed8dcd8de8f8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:07.910931 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4162/8309] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:07 2022] PUT /identity/v3/projects/7f5f1aacb5dc4b3d93b6a2aebd09f213/users/32389083783c4b8ca2b6149ab3bb6187/roles/977a6342255f409f94f56ffe6869d7fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:07.915115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90f3f7-723e-45cc-9196-dc714db7efd4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:07.926301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90f3f7-723e-45cc-9196-dc714db7efd4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:07.982723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6359322-d8ff-45d8-9761-91f140c24e63 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:07.983381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6359322-d8ff-45d8-9761-91f140c24e63 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:07.983661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6359322-d8ff-45d8-9761-91f140c24e63 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:07.983935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6359322-d8ff-45d8-9761-91f140c24e63 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/7f5f1aacb5dc4b3d93b6a2aebd09f213/users/32389083783c4b8ca2b6149ab3bb6187/roles/f760f77f441d49e2b7a4eda0ee96a5fd` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:07.986126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6359322-d8ff-45d8-9761-91f140c24e63 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7f5f1aacb5dc4b3d93b6a2aebd09f213, user_id=32389083783c4b8ca2b6149ab3bb6187, role_id=f760f77f441d49e2b7a4eda0ee96a5fd)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:07.988820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6359322-d8ff-45d8-9761-91f140c24e63 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:08.001824 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4148/8310] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:07 2022] PUT /identity/v3/projects/7f5f1aacb5dc4b3d93b6a2aebd09f213/users/32389083783c4b8ca2b6149ab3bb6187/roles/f760f77f441d49e2b7a4eda0ee96a5fd => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:08.005998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59984524-c518-44aa-a771-ed8dcd8de8f8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:08.017324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59984524-c518-44aa-a771-ed8dcd8de8f8 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:08.073120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce49472-b82d-4e40-a944-bc03bd1e6d12 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:08.073757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49472-b82d-4e40-a944-bc03bd1e6d12 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.074044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49472-b82d-4e40-a944-bc03bd1e6d12 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.074325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49472-b82d-4e40-a944-bc03bd1e6d12 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.074980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce49472-b82d-4e40-a944-bc03bd1e6d12 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:08.076837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce49472-b82d-4e40-a944-bc03bd1e6d12 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:08.101798 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4163/8311] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:08 2022] GET /identity/v3/users => generated 6662 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:08.106864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad41af9-76b7-4c6f-863c-12d57bf07a80 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.107154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad41af9-76b7-4c6f-863c-12d57bf07a80 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.107435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad41af9-76b7-4c6f-863c-12d57bf07a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.144581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cad41af9-76b7-4c6f-863c-12d57bf07a80 None None] MFA Rules not processed for user `32389083783c4b8ca2b6149ab3bb6187`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:08.145819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cad41af9-76b7-4c6f-863c-12d57bf07a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:08.214166 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4149/8312] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:08.224197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ed46-02ae-40c7-8800-e0a41642e6f4 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.224480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ed46-02ae-40c7-8800-e0a41642e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.224747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ed46-02ae-40c7-8800-e0a41642e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.243851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0244ed46-02ae-40c7-8800-e0a41642e6f4 None None] MFA Rules not processed for user `32389083783c4b8ca2b6149ab3bb6187`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:08.244993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0244ed46-02ae-40c7-8800-e0a41642e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:08.252186 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4164/8313] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:08.256495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad41af9-76b7-4c6f-863c-12d57bf07a80 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:08.266973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad41af9-76b7-4c6f-863c-12d57bf07a80 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:08.271285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c5644-8460-4879-90f3-e7875d5fffd4 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32389083783c4b8ca2b6149ab3bb6187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5f1aacb5dc4b3d93b6a2aebd09f213', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-281400493', 'tempest-NotDelegatedRole-203554953'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:08.271974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c5644-8460-4879-90f3-e7875d5fffd4 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.272258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c5644-8460-4879-90f3-e7875d5fffd4 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.272540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c5644-8460-4879-90f3-e7875d5fffd4 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.273244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c5644-8460-4879-90f3-e7875d5fffd4 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorizing `identity:create_trust()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:08.274464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c5644-8460-4879-90f3-e7875d5fffd4 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:08.292489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:08.348574 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4150/8314] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Oct 8 21:26:08 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:26:08.352807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ed46-02ae-40c7-8800-e0a41642e6f4 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:08.361512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ed46-02ae-40c7-8800-e0a41642e6f4 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:08.365760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dae53-a967-48db-be47-654edc7388fa tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32389083783c4b8ca2b6149ab3bb6187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5f1aacb5dc4b3d93b6a2aebd09f213', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-281400493', 'tempest-NotDelegatedRole-203554953'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:08.366386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dae53-a967-48db-be47-654edc7388fa tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.366662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dae53-a967-48db-be47-654edc7388fa tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.366933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dae53-a967-48db-be47-654edc7388fa tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] PATH_INFO: `/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.373062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dae53-a967-48db-be47-654edc7388fa tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorizing `identity:get_trust(trust_id=8ed1dc27e7cc4ae8b007caf9572a20f2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:08.374510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dae53-a967-48db-be47-654edc7388fa tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:08.381475 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4165/8315] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:26:08 2022] GET /identity/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2 => generated 834 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:08.385937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c5644-8460-4879-90f3-e7875d5fffd4 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:08.395041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c5644-8460-4879-90f3-e7875d5fffd4 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:08.399342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ad572-2c25-4373-adbe-f7fbb5b186c6 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32389083783c4b8ca2b6149ab3bb6187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5f1aacb5dc4b3d93b6a2aebd09f213', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-281400493', 'tempest-NotDelegatedRole-203554953'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:08.400180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ad572-2c25-4373-adbe-f7fbb5b186c6 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.400461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ad572-2c25-4373-adbe-f7fbb5b186c6 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.400735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ad572-2c25-4373-adbe-f7fbb5b186c6 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] PATH_INFO: `/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.406706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ad572-2c25-4373-adbe-f7fbb5b186c6 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=8ed1dc27e7cc4ae8b007caf9572a20f2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:08.408126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ad572-2c25-4373-adbe-f7fbb5b186c6 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:08.415015 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4151/8316] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 21:26:08 2022] GET /identity/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2/roles => generated 370 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:08.419385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dae53-a967-48db-be47-654edc7388fa tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:08.429326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dae53-a967-48db-be47-654edc7388fa tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:08.434034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58dde4-9bd1-43fd-a31a-00b692c6ab20 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32389083783c4b8ca2b6149ab3bb6187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5f1aacb5dc4b3d93b6a2aebd09f213', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-281400493', 'tempest-NotDelegatedRole-203554953'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:08.434668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58dde4-9bd1-43fd-a31a-00b692c6ab20 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.434955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58dde4-9bd1-43fd-a31a-00b692c6ab20 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.435234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58dde4-9bd1-43fd-a31a-00b692c6ab20 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] PATH_INFO: `/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2/roles/977a6342255f409f94f56ffe6869d7fc` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.441008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58dde4-9bd1-43fd-a31a-00b692c6ab20 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8ed1dc27e7cc4ae8b007caf9572a20f2, role_id=977a6342255f409f94f56ffe6869d7fc)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:08.442469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58dde4-9bd1-43fd-a31a-00b692c6ab20 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:08.449609 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4166/8317] 10.222.0.26 () {58 vars in 1368 bytes} [Sat Oct 8 21:26:08 2022] GET /identity/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2/roles/977a6342255f409f94f56ffe6869d7fc => generated 243 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:08.453755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ad572-2c25-4373-adbe-f7fbb5b186c6 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:08.463758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ad572-2c25-4373-adbe-f7fbb5b186c6 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:08.467887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b107a-afc6-475e-b23f-19da2756dd47 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32389083783c4b8ca2b6149ab3bb6187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5f1aacb5dc4b3d93b6a2aebd09f213', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-281400493', 'tempest-NotDelegatedRole-203554953'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:08.468522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b107a-afc6-475e-b23f-19da2756dd47 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.468803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b107a-afc6-475e-b23f-19da2756dd47 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.469080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b107a-afc6-475e-b23f-19da2756dd47 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] PATH_INFO: `/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2/roles/977a6342255f409f94f56ffe6869d7fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.474943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b107a-afc6-475e-b23f-19da2756dd47 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8ed1dc27e7cc4ae8b007caf9572a20f2, role_id=977a6342255f409f94f56ffe6869d7fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:08.476372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b107a-afc6-475e-b23f-19da2756dd47 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:08.484045 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4152/8318] 10.222.0.26 () {58 vars in 1369 bytes} [Sat Oct 8 21:26:08 2022] HEAD /identity/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2/roles/977a6342255f409f94f56ffe6869d7fc => generated 0 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 08 21:26:08.488529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58dde4-9bd1-43fd-a31a-00b692c6ab20 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:08.497956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58dde4-9bd1-43fd-a31a-00b692c6ab20 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:08.502141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942b7cb-a2e7-4106-83d3-751d5b921f7c tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32389083783c4b8ca2b6149ab3bb6187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5f1aacb5dc4b3d93b6a2aebd09f213', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-281400493', 'tempest-NotDelegatedRole-203554953'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:08.502776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942b7cb-a2e7-4106-83d3-751d5b921f7c tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.503055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942b7cb-a2e7-4106-83d3-751d5b921f7c tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.503331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942b7cb-a2e7-4106-83d3-751d5b921f7c tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] PATH_INFO: `/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2/roles/f760f77f441d49e2b7a4eda0ee96a5fd` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.509390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942b7cb-a2e7-4106-83d3-751d5b921f7c tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8ed1dc27e7cc4ae8b007caf9572a20f2, role_id=f760f77f441d49e2b7a4eda0ee96a5fd)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:08.510839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942b7cb-a2e7-4106-83d3-751d5b921f7c tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application [None req-6942b7cb-a2e7-4106-83d3-751d5b921f7c tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Could not find role: f760f77f441d49e2b7a4eda0ee96a5fd.: keystone.exception.RoleNotFound: Could not find role: f760f77f441d49e2b7a4eda0ee96a5fd. Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 21:26:08.520585 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: f760f77f441d49e2b7a4eda0ee96a5fd. Oct 08 21:26:08.521667 ncdv-master-1 devstack@keystone.service[99084]: ERROR keystone.server.flask.application Oct 08 21:26:08.521667 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4167/8319] 10.222.0.26 () {58 vars in 1368 bytes} [Sat Oct 8 21:26:08 2022] GET /identity/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2/roles/f760f77f441d49e2b7a4eda0ee96a5fd => generated 110 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 08 21:26:08.526304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b107a-afc6-475e-b23f-19da2756dd47 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:08.535380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b107a-afc6-475e-b23f-19da2756dd47 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:08.539817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb75bb-7552-4272-a0c3-a545a38be2be tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32389083783c4b8ca2b6149ab3bb6187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5f1aacb5dc4b3d93b6a2aebd09f213', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-281400493', 'tempest-NotDelegatedRole-203554953'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:08.541038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb75bb-7552-4272-a0c3-a545a38be2be tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] REQUEST_METHOD: `HEAD` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.541350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb75bb-7552-4272-a0c3-a545a38be2be tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.541624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb75bb-7552-4272-a0c3-a545a38be2be tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] PATH_INFO: `/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2/roles/f760f77f441d49e2b7a4eda0ee96a5fd` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.547240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb75bb-7552-4272-a0c3-a545a38be2be tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8ed1dc27e7cc4ae8b007caf9572a20f2, role_id=f760f77f441d49e2b7a4eda0ee96a5fd)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:08.548641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb75bb-7552-4272-a0c3-a545a38be2be tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-b7eb75bb-7552-4272-a0c3-a545a38be2be tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Could not find role: f760f77f441d49e2b7a4eda0ee96a5fd.: keystone.exception.RoleNotFound: Could not find role: f760f77f441d49e2b7a4eda0ee96a5fd. Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 21:26:08.558351 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: f760f77f441d49e2b7a4eda0ee96a5fd. Oct 08 21:26:08.559409 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:26:08.559409 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4153/8320] 10.222.0.26 () {58 vars in 1369 bytes} [Sat Oct 8 21:26:08 2022] HEAD /identity/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2/roles/f760f77f441d49e2b7a4eda0ee96a5fd => generated 0 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 08 21:26:08.563347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942b7cb-a2e7-4106-83d3-751d5b921f7c tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:08.573592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942b7cb-a2e7-4106-83d3-751d5b921f7c tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:08.577756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32389083783c4b8ca2b6149ab3bb6187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5f1aacb5dc4b3d93b6a2aebd09f213', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-281400493', 'tempest-NotDelegatedRole-203554953'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:08.578361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.578642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.578918 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] PATH_INFO: `/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.584852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorizing `identity:delete_trust(trust_id=8ed1dc27e7cc4ae8b007caf9572a20f2)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:08.586375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:08.591173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:08.604963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8ed1dc27e7cc4ae8b007caf9572a20f2', 'request_id': 'req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:08.611716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8ed1dc27e7cc4ae8b007caf9572a20f2', 'request_id': 'req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:08.612329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8ed1dc27e7cc4ae8b007caf9572a20f2', 'request_id': 'req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:08.618452 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4168/8321] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 8 21:26:08 2022] DELETE /identity/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:08.622683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb75bb-7552-4272-a0c3-a545a38be2be tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:08.624344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b7eb75bb-7552-4272-a0c3-a545a38be2be tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:08.637344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb75bb-7552-4272-a0c3-a545a38be2be tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:08.641432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531024eb-eedd-4c85-afda-ed788e54ed00 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32389083783c4b8ca2b6149ab3bb6187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5f1aacb5dc4b3d93b6a2aebd09f213', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-281400493', 'tempest-NotDelegatedRole-203554953'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:08.642037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531024eb-eedd-4c85-afda-ed788e54ed00 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.642311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531024eb-eedd-4c85-afda-ed788e54ed00 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.642578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531024eb-eedd-4c85-afda-ed788e54ed00 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] PATH_INFO: `/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application [None req-531024eb-eedd-4c85-afda-ed788e54ed00 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Could not find trust: 8ed1dc27e7cc4ae8b007caf9572a20f2.: keystone.exception.TrustNotFound: Could not find trust: 8ed1dc27e7cc4ae8b007caf9572a20f2. Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 08 21:26:08.652908 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 08 21:26:08.653959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 08 21:26:08.653959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 08 21:26:08.653959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 08 21:26:08.653959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 08 21:26:08.653959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 08 21:26:08.653959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 21:26:08.653959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 21:26:08.653959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 08 21:26:08.653959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 08 21:26:08.653959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 08 21:26:08.653959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 08 21:26:08.653959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8ed1dc27e7cc4ae8b007caf9572a20f2. Oct 08 21:26:08.653959 ncdv-master-1 devstack@keystone.service[99085]: ERROR keystone.server.flask.application Oct 08 21:26:08.657901 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4154/8322] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:26:08 2022] GET /identity/v3/OS-TRUST/trusts/8ed1dc27e7cc4ae8b007caf9572a20f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 08 21:26:08.658102 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:08.659623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:08.675493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd4afe-9867-4bef-9291-9ad3c43e5e6f tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:08.679979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e4217-37eb-4a5d-bf07-7b0e6e348fc4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:08.680591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e4217-37eb-4a5d-bf07-7b0e6e348fc4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.680897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e4217-37eb-4a5d-bf07-7b0e6e348fc4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.681216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e4217-37eb-4a5d-bf07-7b0e6e348fc4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles/f760f77f441d49e2b7a4eda0ee96a5fd` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.682585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e4217-37eb-4a5d-bf07-7b0e6e348fc4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f760f77f441d49e2b7a4eda0ee96a5fd)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:08.684155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e4217-37eb-4a5d-bf07-7b0e6e348fc4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:08.720875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f87e4217-37eb-4a5d-bf07-7b0e6e348fc4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invalidating the token cache because role f760f77f441d49e2b7a4eda0ee96a5fd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:08.721162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f87e4217-37eb-4a5d-bf07-7b0e6e348fc4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:08.721963 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f87e4217-37eb-4a5d-bf07-7b0e6e348fc4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:08.723694 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4169/8323] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:08 2022] DELETE /identity/v3/roles/f760f77f441d49e2b7a4eda0ee96a5fd => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:08.728455 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531024eb-eedd-4c85-afda-ed788e54ed00 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:08.730188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-531024eb-eedd-4c85-afda-ed788e54ed00 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:08.745274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531024eb-eedd-4c85-afda-ed788e54ed00 tempest-TrustsV3TestJSON-1676903723 tempest-user-1180555351] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:08.802462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7592abc-0096-4af5-ac98-2513db0b8f59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:08.803199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7592abc-0096-4af5-ac98-2513db0b8f59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.803546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7592abc-0096-4af5-ac98-2513db0b8f59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.803911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7592abc-0096-4af5-ac98-2513db0b8f59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/roles/977a6342255f409f94f56ffe6869d7fc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.805561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7592abc-0096-4af5-ac98-2513db0b8f59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_role(role_id=977a6342255f409f94f56ffe6869d7fc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:08.807158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7592abc-0096-4af5-ac98-2513db0b8f59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:08.845982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b7592abc-0096-4af5-ac98-2513db0b8f59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invalidating the token cache because role 977a6342255f409f94f56ffe6869d7fc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:08.846269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b7592abc-0096-4af5-ac98-2513db0b8f59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:08.846986 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b7592abc-0096-4af5-ac98-2513db0b8f59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:08.848841 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4155/8324] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:08 2022] DELETE /identity/v3/roles/977a6342255f409f94f56ffe6869d7fc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:26:08.853259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e4217-37eb-4a5d-bf07-7b0e6e348fc4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:08.864245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e4217-37eb-4a5d-bf07-7b0e6e348fc4 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:08.920114 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:08.920741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:08.921053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:08.921355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/users/32389083783c4b8ca2b6149ab3bb6187` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:08.922491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_user(user_id=32389083783c4b8ca2b6149ab3bb6187)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:08.924393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:08.970683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32389083783c4b8ca2b6149ab3bb6187'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:08.977869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32389083783c4b8ca2b6149ab3bb6187'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:08.978626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32389083783c4b8ca2b6149ab3bb6187'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:08.979257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32389083783c4b8ca2b6149ab3bb6187'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:08.991891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32389083783c4b8ca2b6149ab3bb6187'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.004792 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4170/8325] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:08 2022] DELETE /identity/v3/users/32389083783c4b8ca2b6149ab3bb6187 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:09.009503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7592abc-0096-4af5-ac98-2513db0b8f59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:09.010908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b7592abc-0096-4af5-ac98-2513db0b8f59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:09.024103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7592abc-0096-4af5-ac98-2513db0b8f59 tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:09.033322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:09.082131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657561da-c7af-4fd4-9d6c-2a265919ee9c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ddf04196c04e909ee56ce63fc60392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297ef7f346b046c1a709ff567d1c4019', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:09.082802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657561da-c7af-4fd4-9d6c-2a265919ee9c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:09.083138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657561da-c7af-4fd4-9d6c-2a265919ee9c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:09.083423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657561da-c7af-4fd4-9d6c-2a265919ee9c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] PATH_INFO: `/v3/projects/7f5f1aacb5dc4b3d93b6a2aebd09f213` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:09.084751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657561da-c7af-4fd4-9d6c-2a265919ee9c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7f5f1aacb5dc4b3d93b6a2aebd09f213)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:09.086874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657561da-c7af-4fd4-9d6c-2a265919ee9c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:09.134971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-657561da-c7af-4fd4-9d6c-2a265919ee9c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f5f1aacb5dc4b3d93b6a2aebd09f213', 'request_id': 'req-657561da-c7af-4fd4-9d6c-2a265919ee9c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.142028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-657561da-c7af-4fd4-9d6c-2a265919ee9c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f5f1aacb5dc4b3d93b6a2aebd09f213', 'request_id': 'req-657561da-c7af-4fd4-9d6c-2a265919ee9c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.147553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-657561da-c7af-4fd4-9d6c-2a265919ee9c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f5f1aacb5dc4b3d93b6a2aebd09f213', 'request_id': 'req-657561da-c7af-4fd4-9d6c-2a265919ee9c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.158105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-657561da-c7af-4fd4-9d6c-2a265919ee9c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] The token cache is being invalidate because project 7f5f1aacb5dc4b3d93b6a2aebd09f213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:09.158392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-657561da-c7af-4fd4-9d6c-2a265919ee9c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.159023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-657561da-c7af-4fd4-9d6c-2a265919ee9c tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.160489 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4156/8326] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:09 2022] DELETE /identity/v3/projects/7f5f1aacb5dc4b3d93b6a2aebd09f213 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:26:09.166370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:09.167753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:09.186612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:09.236370 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bcbe8-3df7-4a6c-a67a-5e3feb44871a tempest-TrustsV3TestJSON-445831562 tempest-TrustsV3TestJSON-445831562-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:09.294106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:09.294732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:09.295011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:09.295284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] PATH_INFO: `/v3/users/453d203bc1474bd8a01bb7afa727d5a9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:09.296402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453d203bc1474bd8a01bb7afa727d5a9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:09.298329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:09.343059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453d203bc1474bd8a01bb7afa727d5a9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.349941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453d203bc1474bd8a01bb7afa727d5a9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.350600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453d203bc1474bd8a01bb7afa727d5a9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.351210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453d203bc1474bd8a01bb7afa727d5a9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.363568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453d203bc1474bd8a01bb7afa727d5a9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.376518 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4171/8327] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:09 2022] DELETE /identity/v3/users/453d203bc1474bd8a01bb7afa727d5a9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:09.381066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffa4d9-aafa-4b9f-85b7-d372ffdd6859 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:09.381377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffa4d9-aafa-4b9f-85b7-d372ffdd6859 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:09.381650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffa4d9-aafa-4b9f-85b7-d372ffdd6859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:09.410093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-00ffa4d9-aafa-4b9f-85b7-d372ffdd6859 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:09.411236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-00ffa4d9-aafa-4b9f-85b7-d372ffdd6859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:09.469362 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4157/8328] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:09.479756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:09.481429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:09.529045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:09.570639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a1711-e306-4c18-bce5-2b74ae117da6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:09.574419 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339648f4-91a0-4301-8235-5a17feb02e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:09.575019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339648f4-91a0-4301-8235-5a17feb02e47 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:09.575301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339648f4-91a0-4301-8235-5a17feb02e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:09.575598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339648f4-91a0-4301-8235-5a17feb02e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:09.584628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339648f4-91a0-4301-8235-5a17feb02e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:09.586130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339648f4-91a0-4301-8235-5a17feb02e47 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:09.596341 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4172/8329] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:09.863883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffa4d9-aafa-4b9f-85b7-d372ffdd6859 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:09.865427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-00ffa4d9-aafa-4b9f-85b7-d372ffdd6859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:09.879627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffa4d9-aafa-4b9f-85b7-d372ffdd6859 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:09.884713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:09.885422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:09.885738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:09.886009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] PATH_INFO: `/v3/projects/de79a108cf0b4ff5b2d13ffa7564c256` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:09.887179 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de79a108cf0b4ff5b2d13ffa7564c256)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:09.889167 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:09.924381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:09.939373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de79a108cf0b4ff5b2d13ffa7564c256', 'request_id': 'req-84cc957c-d2aa-4b88-b828-8cb530be410a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.945833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de79a108cf0b4ff5b2d13ffa7564c256', 'request_id': 'req-84cc957c-d2aa-4b88-b828-8cb530be410a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.951625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de79a108cf0b4ff5b2d13ffa7564c256', 'request_id': 'req-84cc957c-d2aa-4b88-b828-8cb530be410a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.962963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] The token cache is being invalidate because project de79a108cf0b4ff5b2d13ffa7564c256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:09.963252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.963907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:09.965413 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4158/8330] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:09 2022] DELETE /identity/v3/projects/de79a108cf0b4ff5b2d13ffa7564c256 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:09.969427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339648f4-91a0-4301-8235-5a17feb02e47 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:09.980501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339648f4-91a0-4301-8235-5a17feb02e47 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:10.038213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfa65d-4cb3-4b9b-b605-4a9ba5394a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:10.038830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfa65d-4cb3-4b9b-b605-4a9ba5394a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:10.039107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfa65d-4cb3-4b9b-b605-4a9ba5394a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:10.039377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfa65d-4cb3-4b9b-b605-4a9ba5394a45 admin admin] PATH_INFO: `/v3/users/95ddf04196c04e909ee56ce63fc60392` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:10.041057 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfa65d-4cb3-4b9b-b605-4a9ba5394a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ddf04196c04e909ee56ce63fc60392)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:10.043010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfa65d-4cb3-4b9b-b605-4a9ba5394a45 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:10.086357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ddcfa65d-4cb3-4b9b-b605-4a9ba5394a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ddf04196c04e909ee56ce63fc60392'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:10.093850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ddcfa65d-4cb3-4b9b-b605-4a9ba5394a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ddf04196c04e909ee56ce63fc60392'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:10.094529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ddcfa65d-4cb3-4b9b-b605-4a9ba5394a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ddf04196c04e909ee56ce63fc60392'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:10.095148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ddcfa65d-4cb3-4b9b-b605-4a9ba5394a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ddf04196c04e909ee56ce63fc60392'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:10.107826 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ddcfa65d-4cb3-4b9b-b605-4a9ba5394a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ddf04196c04e909ee56ce63fc60392'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:10.120041 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4173/8331] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:09 2022] DELETE /identity/v3/users/95ddf04196c04e909ee56ce63fc60392 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:10.397615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:10.399180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:10.415642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc957c-d2aa-4b88-b828-8cb530be410a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:10.474017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:10.474632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:10.474917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:10.475191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4 admin admin] PATH_INFO: `/v3/projects/297ef7f346b046c1a709ff567d1c4019` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:10.476338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=297ef7f346b046c1a709ff567d1c4019)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:10.478330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:10.525949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297ef7f346b046c1a709ff567d1c4019', 'request_id': 'req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:10.533720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297ef7f346b046c1a709ff567d1c4019', 'request_id': 'req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:10.539333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297ef7f346b046c1a709ff567d1c4019', 'request_id': 'req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:10.550150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4 admin admin] The token cache is being invalidate because project 297ef7f346b046c1a709ff567d1c4019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:10.550437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:10.551063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ddd2be40-c23c-492f-bbf5-30a2c50bcff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:10.552519 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4159/8332] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:10 2022] DELETE /identity/v3/projects/297ef7f346b046c1a709ff567d1c4019 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:10.558449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95763-7c3d-47f3-9b79-88bbc61ba451 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:10.558737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95763-7c3d-47f3-9b79-88bbc61ba451 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:10.559041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95763-7c3d-47f3-9b79-88bbc61ba451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:10.606960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e9b95763-7c3d-47f3-9b79-88bbc61ba451 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:10.608142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e9b95763-7c3d-47f3-9b79-88bbc61ba451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:10.616424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:10.668544 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4174/8333] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:10.676467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307d91-21c9-4e46-9262-75dd8833ee95 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:10.676751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307d91-21c9-4e46-9262-75dd8833ee95 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:10.677027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307d91-21c9-4e46-9262-75dd8833ee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:10.698381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b6307d91-21c9-4e46-9262-75dd8833ee95 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:10.699573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b6307d91-21c9-4e46-9262-75dd8833ee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:10.707348 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4160/8334] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:10.711462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b95763-7c3d-47f3-9b79-88bbc61ba451 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:10.721310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b95763-7c3d-47f3-9b79-88bbc61ba451 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:10.726016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8482400-1377-4ee4-8e66-881e52cb167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:10.726574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8482400-1377-4ee4-8e66-881e52cb167a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:10.726856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8482400-1377-4ee4-8e66-881e52cb167a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:10.727131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8482400-1377-4ee4-8e66-881e52cb167a admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:10.727827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8482400-1377-4ee4-8e66-881e52cb167a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:26:10.728134 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8482400-1377-4ee4-8e66-881e52cb167a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:10.729760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8482400-1377-4ee4-8e66-881e52cb167a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:10.741467 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4175/8335] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:10.746049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6307d91-21c9-4e46-9262-75dd8833ee95 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:10.755213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6307d91-21c9-4e46-9262-75dd8833ee95 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:10.760530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597251c-d08b-4208-9528-3b9a650f8dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:10.761118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597251c-d08b-4208-9528-3b9a650f8dfc admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:10.761432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597251c-d08b-4208-9528-3b9a650f8dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:10.761701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597251c-d08b-4208-9528-3b9a650f8dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:10.762318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597251c-d08b-4208-9528-3b9a650f8dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:10.764198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597251c-d08b-4208-9528-3b9a650f8dfc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:10.798662 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4161/8336] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:10 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:10.802772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8482400-1377-4ee4-8e66-881e52cb167a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:10.813881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8482400-1377-4ee4-8e66-881e52cb167a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:10.870908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505269bd-8874-4350-8dc4-7d84adbb2257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:10.871492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505269bd-8874-4350-8dc4-7d84adbb2257 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:10.871766 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505269bd-8874-4350-8dc4-7d84adbb2257 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:10.872060 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505269bd-8874-4350-8dc4-7d84adbb2257 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:10.872661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505269bd-8874-4350-8dc4-7d84adbb2257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:10.874618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505269bd-8874-4350-8dc4-7d84adbb2257 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:10.895751 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4176/8337] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:10 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:10.899850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597251c-d08b-4208-9528-3b9a650f8dfc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:10.910351 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597251c-d08b-4208-9528-3b9a650f8dfc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:10.915274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e52df-4b7d-4117-86c6-7c533cfc63ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:10.915877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e52df-4b7d-4117-86c6-7c533cfc63ca admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:10.916185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e52df-4b7d-4117-86c6-7c533cfc63ca admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:10.916578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e52df-4b7d-4117-86c6-7c533cfc63ca admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:10.917250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e52df-4b7d-4117-86c6-7c533cfc63ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:10.918886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e52df-4b7d-4117-86c6-7c533cfc63ca admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:10.924141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:10.932852 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4162/8338] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:10.934384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505269bd-8874-4350-8dc4-7d84adbb2257 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:10.944350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505269bd-8874-4350-8dc4-7d84adbb2257 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:10.949646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec8e44-b487-433b-b697-175babce3ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:10.950285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec8e44-b487-433b-b697-175babce3ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:10.950565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec8e44-b487-433b-b697-175babce3ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:10.950841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec8e44-b487-433b-b697-175babce3ef5 admin admin] PATH_INFO: `/v3/projects/52b6486096a64725b57c8438b021a832/users/8673becd9b1944b29a5bf840bdb23325/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:10.965418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec8e44-b487-433b-b697-175babce3ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b6486096a64725b57c8438b021a832, user_id=8673becd9b1944b29a5bf840bdb23325, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:10.968149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec8e44-b487-433b-b697-175babce3ef5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:10.981076 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4177/8339] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:10 2022] PUT /identity/v3/projects/52b6486096a64725b57c8438b021a832/users/8673becd9b1944b29a5bf840bdb23325/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:26:10.985224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e52df-4b7d-4117-86c6-7c533cfc63ca admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:10.995566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e52df-4b7d-4117-86c6-7c533cfc63ca admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:11.054739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16564f-57a9-43f1-b8fe-c0b1f9c217f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:11.055352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16564f-57a9-43f1-b8fe-c0b1f9c217f1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:11.055643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16564f-57a9-43f1-b8fe-c0b1f9c217f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:11.055921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16564f-57a9-43f1-b8fe-c0b1f9c217f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:11.056566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16564f-57a9-43f1-b8fe-c0b1f9c217f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:11.058185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16564f-57a9-43f1-b8fe-c0b1f9c217f1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:11.068005 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4163/8340] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:11.072687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec8e44-b487-433b-b697-175babce3ef5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:11.082893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec8e44-b487-433b-b697-175babce3ef5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:11.088197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607d48-cb19-473d-94f9-2adece244c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:11.088835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607d48-cb19-473d-94f9-2adece244c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:11.089136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607d48-cb19-473d-94f9-2adece244c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:11.089450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607d48-cb19-473d-94f9-2adece244c2a admin admin] PATH_INFO: `/v3/projects/52b6486096a64725b57c8438b021a832/users/8673becd9b1944b29a5bf840bdb23325/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:11.091468 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5607d48-cb19-473d-94f9-2adece244c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b6486096a64725b57c8438b021a832, user_id=8673becd9b1944b29a5bf840bdb23325, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:11.094106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5607d48-cb19-473d-94f9-2adece244c2a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:11.104546 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4178/8341] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:11 2022] PUT /identity/v3/projects/52b6486096a64725b57c8438b021a832/users/8673becd9b1944b29a5bf840bdb23325/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:11.199268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb8b68-f2a2-494a-a101-c63021d154fe None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:11.199544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb8b68-f2a2-494a-a101-c63021d154fe None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:11.199820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb8b68-f2a2-494a-a101-c63021d154fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:11.228766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e0fb8b68-f2a2-494a-a101-c63021d154fe None None] MFA Rules not processed for user `8673becd9b1944b29a5bf840bdb23325`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:11.230030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e0fb8b68-f2a2-494a-a101-c63021d154fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:11.297871 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4164/8342] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:11.302241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607d48-cb19-473d-94f9-2adece244c2a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:11.353493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:11.365096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607d48-cb19-473d-94f9-2adece244c2a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:11.370326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796a333-df56-4fba-b145-58e20774caf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:11.370921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a333-df56-4fba-b145-58e20774caf6 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:11.371203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a333-df56-4fba-b145-58e20774caf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:11.371477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a333-df56-4fba-b145-58e20774caf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:11.372112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796a333-df56-4fba-b145-58e20774caf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:11.374041 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796a333-df56-4fba-b145-58e20774caf6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:11.401733 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4179/8343] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:11 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:11.405800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb8b68-f2a2-494a-a101-c63021d154fe None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:11.416432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb8b68-f2a2-494a-a101-c63021d154fe None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:11.472717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61d3ce-b6ce-4de5-beac-c371b655df6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:11.473370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61d3ce-b6ce-4de5-beac-c371b655df6a admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:11.473653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61d3ce-b6ce-4de5-beac-c371b655df6a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:11.473933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61d3ce-b6ce-4de5-beac-c371b655df6a admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:11.474575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61d3ce-b6ce-4de5-beac-c371b655df6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:11.476487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61d3ce-b6ce-4de5-beac-c371b655df6a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:11.499405 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4165/8344] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:11 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:11.503380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796a333-df56-4fba-b145-58e20774caf6 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:11.514780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796a333-df56-4fba-b145-58e20774caf6 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:11.519413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5164b4-a990-462d-aa05-5a0acc11c3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:11.520003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5164b4-a990-462d-aa05-5a0acc11c3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:11.520283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5164b4-a990-462d-aa05-5a0acc11c3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:11.520554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5164b4-a990-462d-aa05-5a0acc11c3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:11.521211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5164b4-a990-462d-aa05-5a0acc11c3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:11.522788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5164b4-a990-462d-aa05-5a0acc11c3c2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:11.533477 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4180/8345] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:11.537345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61d3ce-b6ce-4de5-beac-c371b655df6a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:11.547453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61d3ce-b6ce-4de5-beac-c371b655df6a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:11.552392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e08d76-fd54-4213-9d49-6ed4e4136d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:11.552954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e08d76-fd54-4213-9d49-6ed4e4136d54 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:11.553268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e08d76-fd54-4213-9d49-6ed4e4136d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:11.553550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e08d76-fd54-4213-9d49-6ed4e4136d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:11.554195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e08d76-fd54-4213-9d49-6ed4e4136d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:11.556348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e08d76-fd54-4213-9d49-6ed4e4136d54 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:11.561767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:11.570456 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4166/8346] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:26:11.572113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5164b4-a990-462d-aa05-5a0acc11c3c2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:11.582219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5164b4-a990-462d-aa05-5a0acc11c3c2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:11.586973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198be501-2d32-4fc9-b213-f4bf3dff3819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:11.587610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be501-2d32-4fc9-b213-f4bf3dff3819 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:11.587885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be501-2d32-4fc9-b213-f4bf3dff3819 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:11.588152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be501-2d32-4fc9-b213-f4bf3dff3819 admin admin] PATH_INFO: `/v3/projects/324e3eb934db4dccb4445ee523b3ce01/users/deb7f83d588f49f9a79457c48f440a2b/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:11.603256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198be501-2d32-4fc9-b213-f4bf3dff3819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=324e3eb934db4dccb4445ee523b3ce01, user_id=deb7f83d588f49f9a79457c48f440a2b, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:11.607059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198be501-2d32-4fc9-b213-f4bf3dff3819 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:11.621060 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4181/8347] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:11 2022] PUT /identity/v3/projects/324e3eb934db4dccb4445ee523b3ce01/users/deb7f83d588f49f9a79457c48f440a2b/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:11.631089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a003f-8595-449e-8f5c-212f17a57f45 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:11.631378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a003f-8595-449e-8f5c-212f17a57f45 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:11.631655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a003f-8595-449e-8f5c-212f17a57f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:11.661199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7e0a003f-8595-449e-8f5c-212f17a57f45 None None] MFA Rules not processed for user `deb7f83d588f49f9a79457c48f440a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:11.662434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7e0a003f-8595-449e-8f5c-212f17a57f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:11.726573 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4167/8348] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:11.739186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198be501-2d32-4fc9-b213-f4bf3dff3819 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:11.740846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-198be501-2d32-4fc9-b213-f4bf3dff3819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:11.811715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198be501-2d32-4fc9-b213-f4bf3dff3819 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:11.815351 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89dba8-2919-4f4c-ad87-79204e81b133 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:11.815947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89dba8-2919-4f4c-ad87-79204e81b133 service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:11.816230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89dba8-2919-4f4c-ad87-79204e81b133 service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:11.816504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89dba8-2919-4f4c-ad87-79204e81b133 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:11.875910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89dba8-2919-4f4c-ad87-79204e81b133 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:11.877366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89dba8-2919-4f4c-ad87-79204e81b133 service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:11.886852 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4182/8349] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:12.129391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a003f-8595-449e-8f5c-212f17a57f45 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:12.191597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a003f-8595-449e-8f5c-212f17a57f45 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:12.196123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:12.196776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:12.197058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:12.197364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] PATH_INFO: `/v3/users/8673becd9b1944b29a5bf840bdb23325` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:12.198487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8673becd9b1944b29a5bf840bdb23325)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:12.200383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:12.247068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8673becd9b1944b29a5bf840bdb23325'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.254090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8673becd9b1944b29a5bf840bdb23325'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.254767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8673becd9b1944b29a5bf840bdb23325'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.255381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8673becd9b1944b29a5bf840bdb23325'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.267535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8673becd9b1944b29a5bf840bdb23325'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.280404 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4168/8350] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:12 2022] DELETE /identity/v3/users/8673becd9b1944b29a5bf840bdb23325 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:12.284911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b078ae-b94e-4a8b-8da6-4d12cac98030 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:12.285316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b078ae-b94e-4a8b-8da6-4d12cac98030 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:12.285662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b078ae-b94e-4a8b-8da6-4d12cac98030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:12.304861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a1b078ae-b94e-4a8b-8da6-4d12cac98030 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:12.306649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a1b078ae-b94e-4a8b-8da6-4d12cac98030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:12.344229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:12.365521 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4183/8351] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:26:12.375982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:12.377390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:12.388926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:12.438422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb0a6f-37a1-46a6-94a2-286fa21a750d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:12.442075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bcbc5-ab0a-4260-92a8-9a67a0a65bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:12.442673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bcbc5-ab0a-4260-92a8-9a67a0a65bbb service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:12.442950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bcbc5-ab0a-4260-92a8-9a67a0a65bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:12.443242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bcbc5-ab0a-4260-92a8-9a67a0a65bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:12.452751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bcbc5-ab0a-4260-92a8-9a67a0a65bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:12.454178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bcbc5-ab0a-4260-92a8-9a67a0a65bbb service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:12.463599 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4169/8352] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:12.738049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b078ae-b94e-4a8b-8da6-4d12cac98030 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:12.739595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a1b078ae-b94e-4a8b-8da6-4d12cac98030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:12.752614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b078ae-b94e-4a8b-8da6-4d12cac98030 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:12.757489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:12.758120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:12.758397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:12.758666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] PATH_INFO: `/v3/projects/52b6486096a64725b57c8438b021a832` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:12.760507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b6486096a64725b57c8438b021a832)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:12.762642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:12.809545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b6486096a64725b57c8438b021a832', 'request_id': 'req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.816783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b6486096a64725b57c8438b021a832', 'request_id': 'req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.822672 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b6486096a64725b57c8438b021a832', 'request_id': 'req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.833707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] The token cache is being invalidate because project 52b6486096a64725b57c8438b021a832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:12.833995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.834644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.836120 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4184/8353] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:12 2022] DELETE /identity/v3/projects/52b6486096a64725b57c8438b021a832 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:12.840158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bcbc5-ab0a-4260-92a8-9a67a0a65bbb service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:12.849875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bcbc5-ab0a-4260-92a8-9a67a0a65bbb service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:12.907205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9cbbf-f63a-4cf9-862a-80fe1d5ce589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:12.907757 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9cbbf-f63a-4cf9-862a-80fe1d5ce589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:12.908087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9cbbf-f63a-4cf9-862a-80fe1d5ce589 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:12.908307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9cbbf-f63a-4cf9-862a-80fe1d5ce589 admin admin] PATH_INFO: `/v3/users/deb7f83d588f49f9a79457c48f440a2b` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:12.909937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9cbbf-f63a-4cf9-862a-80fe1d5ce589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deb7f83d588f49f9a79457c48f440a2b)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:12.911833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9cbbf-f63a-4cf9-862a-80fe1d5ce589 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:12.958178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69a9cbbf-f63a-4cf9-862a-80fe1d5ce589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deb7f83d588f49f9a79457c48f440a2b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.965589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69a9cbbf-f63a-4cf9-862a-80fe1d5ce589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deb7f83d588f49f9a79457c48f440a2b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.966244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69a9cbbf-f63a-4cf9-862a-80fe1d5ce589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deb7f83d588f49f9a79457c48f440a2b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.966851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69a9cbbf-f63a-4cf9-862a-80fe1d5ce589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deb7f83d588f49f9a79457c48f440a2b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.979314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-69a9cbbf-f63a-4cf9-862a-80fe1d5ce589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deb7f83d588f49f9a79457c48f440a2b'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:12.992315 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4170/8354] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:12 2022] DELETE /identity/v3/users/deb7f83d588f49f9a79457c48f440a2b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:13.270677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:13.272111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:13.289049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a3b1c-0aa8-41c9-8ded-eeef23d6efec admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:13.347502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c99a48-2a29-4b63-856f-09431d8c21a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:13.348137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c99a48-2a29-4b63-856f-09431d8c21a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:13.348421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c99a48-2a29-4b63-856f-09431d8c21a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:13.348697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c99a48-2a29-4b63-856f-09431d8c21a5 admin admin] PATH_INFO: `/v3/projects/324e3eb934db4dccb4445ee523b3ce01` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:13.349825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c99a48-2a29-4b63-856f-09431d8c21a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=324e3eb934db4dccb4445ee523b3ce01)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:13.351752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c99a48-2a29-4b63-856f-09431d8c21a5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:13.397071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e8c99a48-2a29-4b63-856f-09431d8c21a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324e3eb934db4dccb4445ee523b3ce01', 'request_id': 'req-e8c99a48-2a29-4b63-856f-09431d8c21a5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:13.404532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e8c99a48-2a29-4b63-856f-09431d8c21a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324e3eb934db4dccb4445ee523b3ce01', 'request_id': 'req-e8c99a48-2a29-4b63-856f-09431d8c21a5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:13.410631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e8c99a48-2a29-4b63-856f-09431d8c21a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324e3eb934db4dccb4445ee523b3ce01', 'request_id': 'req-e8c99a48-2a29-4b63-856f-09431d8c21a5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:13.412491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:13.424883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e8c99a48-2a29-4b63-856f-09431d8c21a5 admin admin] The token cache is being invalidate because project 324e3eb934db4dccb4445ee523b3ce01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:13.425105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e8c99a48-2a29-4b63-856f-09431d8c21a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:13.425805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e8c99a48-2a29-4b63-856f-09431d8c21a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:13.427366 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4185/8355] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:13 2022] DELETE /identity/v3/projects/324e3eb934db4dccb4445ee523b3ce01 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:13.432432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de90c8-def1-4249-983f-6f3f5ab59c27 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:13.432718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de90c8-def1-4249-983f-6f3f5ab59c27 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:13.432990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de90c8-def1-4249-983f-6f3f5ab59c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:13.452618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b0de90c8-def1-4249-983f-6f3f5ab59c27 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:13.453841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b0de90c8-def1-4249-983f-6f3f5ab59c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:13.480185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:13.524208 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4171/8356] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:26:13.534107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc260a-af57-4c9b-9784-b04e5852a0cb None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:13.534393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc260a-af57-4c9b-9784-b04e5852a0cb None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:13.534689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc260a-af57-4c9b-9784-b04e5852a0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:13.554450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b1cc260a-af57-4c9b-9784-b04e5852a0cb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:13.555703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b1cc260a-af57-4c9b-9784-b04e5852a0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:13.563528 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4186/8357] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:13.567669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de90c8-def1-4249-983f-6f3f5ab59c27 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:13.578101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de90c8-def1-4249-983f-6f3f5ab59c27 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:13.582679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a666757-3c1f-43fd-99f6-7001be3d8edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:13.583279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a666757-3c1f-43fd-99f6-7001be3d8edb admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:13.583559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a666757-3c1f-43fd-99f6-7001be3d8edb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:13.583853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a666757-3c1f-43fd-99f6-7001be3d8edb admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:13.584479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a666757-3c1f-43fd-99f6-7001be3d8edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:26:13.584799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a666757-3c1f-43fd-99f6-7001be3d8edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:13.586392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a666757-3c1f-43fd-99f6-7001be3d8edb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:13.598524 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4172/8358] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:13.602691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc260a-af57-4c9b-9784-b04e5852a0cb None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:13.612164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc260a-af57-4c9b-9784-b04e5852a0cb None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:13.616807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8f689-4537-4b7c-9adb-d9b13f479c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:13.617424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8f689-4537-4b7c-9adb-d9b13f479c04 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:13.617707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8f689-4537-4b7c-9adb-d9b13f479c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:13.617982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8f689-4537-4b7c-9adb-d9b13f479c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:13.619120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8f689-4537-4b7c-9adb-d9b13f479c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:13.621015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8f689-4537-4b7c-9adb-d9b13f479c04 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:13.650167 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4187/8359] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:13 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:13.654258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a666757-3c1f-43fd-99f6-7001be3d8edb admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:13.664408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a666757-3c1f-43fd-99f6-7001be3d8edb admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:13.721004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9ca41-3b65-4439-8ff3-4a708027ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:13.721639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9ca41-3b65-4439-8ff3-4a708027ebdf admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:13.721917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9ca41-3b65-4439-8ff3-4a708027ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:13.722189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9ca41-3b65-4439-8ff3-4a708027ebdf admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:13.722812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9ca41-3b65-4439-8ff3-4a708027ebdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:13.724692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9ca41-3b65-4439-8ff3-4a708027ebdf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:13.746480 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4173/8360] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:13 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:13.750661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8f689-4537-4b7c-9adb-d9b13f479c04 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:13.761787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8f689-4537-4b7c-9adb-d9b13f479c04 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:13.766377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10df580-fdc7-4c51-9007-e56a96591ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:13.766960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10df580-fdc7-4c51-9007-e56a96591ddd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:13.767264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10df580-fdc7-4c51-9007-e56a96591ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:13.767642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10df580-fdc7-4c51-9007-e56a96591ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:13.768301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10df580-fdc7-4c51-9007-e56a96591ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:13.769914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10df580-fdc7-4c51-9007-e56a96591ddd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:13.780048 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4188/8361] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:13.783730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9ca41-3b65-4439-8ff3-4a708027ebdf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:13.793721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9ca41-3b65-4439-8ff3-4a708027ebdf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:13.798289 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c0f39-4699-4a52-82c4-13e9a2e19e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:13.798880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c0f39-4699-4a52-82c4-13e9a2e19e5d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:13.799150 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c0f39-4699-4a52-82c4-13e9a2e19e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:13.799420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c0f39-4699-4a52-82c4-13e9a2e19e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:13.800078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c0f39-4699-4a52-82c4-13e9a2e19e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:13.801682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c0f39-4699-4a52-82c4-13e9a2e19e5d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:13.812491 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4174/8362] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:26:13.816446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10df580-fdc7-4c51-9007-e56a96591ddd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:13.827281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10df580-fdc7-4c51-9007-e56a96591ddd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:13.831914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b84422-89ba-49c9-9274-19aa27759672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:13.832550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b84422-89ba-49c9-9274-19aa27759672 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:13.832827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b84422-89ba-49c9-9274-19aa27759672 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:13.833097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b84422-89ba-49c9-9274-19aa27759672 admin admin] PATH_INFO: `/v3/projects/84e460f31fb74281ab4c77febc2874f2/users/a1af5c4851b244829b6cd4397ac24bb5/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:13.847119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b84422-89ba-49c9-9274-19aa27759672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e460f31fb74281ab4c77febc2874f2, user_id=a1af5c4851b244829b6cd4397ac24bb5, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:13.849764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b84422-89ba-49c9-9274-19aa27759672 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:13.862460 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4189/8363] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:13 2022] PUT /identity/v3/projects/84e460f31fb74281ab4c77febc2874f2/users/a1af5c4851b244829b6cd4397ac24bb5/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:13.873072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f3b4e-c5fa-4445-a6d8-bdf91d8574fe None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:13.873380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f3b4e-c5fa-4445-a6d8-bdf91d8574fe None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:13.873653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f3b4e-c5fa-4445-a6d8-bdf91d8574fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:13.901173 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a16f3b4e-c5fa-4445-a6d8-bdf91d8574fe None None] MFA Rules not processed for user `a1af5c4851b244829b6cd4397ac24bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:13.902389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a16f3b4e-c5fa-4445-a6d8-bdf91d8574fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:13.965744 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4175/8364] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:13.970229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b84422-89ba-49c9-9274-19aa27759672 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:14.031288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b84422-89ba-49c9-9274-19aa27759672 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:14.035972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dc433-b4f0-458b-8162-0648da430c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:14.036600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dc433-b4f0-458b-8162-0648da430c47 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:14.036881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dc433-b4f0-458b-8162-0648da430c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:14.037157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dc433-b4f0-458b-8162-0648da430c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:14.037821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dc433-b4f0-458b-8162-0648da430c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:14.039713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dc433-b4f0-458b-8162-0648da430c47 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:14.067947 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4190/8365] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:13 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:14.072039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f3b4e-c5fa-4445-a6d8-bdf91d8574fe None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:14.082644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f3b4e-c5fa-4445-a6d8-bdf91d8574fe None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:14.107301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:14.140587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6713ab9-8b87-4cc7-8037-97f898a804dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:14.141211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6713ab9-8b87-4cc7-8037-97f898a804dc admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:14.141493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6713ab9-8b87-4cc7-8037-97f898a804dc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:14.141768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6713ab9-8b87-4cc7-8037-97f898a804dc admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:14.142392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6713ab9-8b87-4cc7-8037-97f898a804dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:14.144275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6713ab9-8b87-4cc7-8037-97f898a804dc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:14.165037 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4176/8366] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:14 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:14.169718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dc433-b4f0-458b-8162-0648da430c47 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:14.180091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dc433-b4f0-458b-8162-0648da430c47 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:14.185354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d31134-82c3-4259-8a8d-bebae5f2e533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:14.185946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31134-82c3-4259-8a8d-bebae5f2e533 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:14.186229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31134-82c3-4259-8a8d-bebae5f2e533 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:14.186506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31134-82c3-4259-8a8d-bebae5f2e533 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:14.187146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d31134-82c3-4259-8a8d-bebae5f2e533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:14.188734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d31134-82c3-4259-8a8d-bebae5f2e533 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:14.199176 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4191/8367] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:14.202988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6713ab9-8b87-4cc7-8037-97f898a804dc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:14.213019 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6713ab9-8b87-4cc7-8037-97f898a804dc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:14.217712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e3a6d-637e-43ee-9986-fd7f70754bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:14.218303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e3a6d-637e-43ee-9986-fd7f70754bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:14.218583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e3a6d-637e-43ee-9986-fd7f70754bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:14.218854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e3a6d-637e-43ee-9986-fd7f70754bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:14.219487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e3a6d-637e-43ee-9986-fd7f70754bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:14.221047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e3a6d-637e-43ee-9986-fd7f70754bf4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:14.231941 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4177/8368] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:14.235921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d31134-82c3-4259-8a8d-bebae5f2e533 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:14.246478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d31134-82c3-4259-8a8d-bebae5f2e533 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:14.251100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5458b-a285-425e-9e3e-42d445fa441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:14.251740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5458b-a285-425e-9e3e-42d445fa441f admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:14.252025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5458b-a285-425e-9e3e-42d445fa441f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:14.252305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5458b-a285-425e-9e3e-42d445fa441f admin admin] PATH_INFO: `/v3/projects/5a984065cf0143e181682503696e511d/users/2dd2162528bb48a4b884d3422d555542/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:14.267365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5458b-a285-425e-9e3e-42d445fa441f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a984065cf0143e181682503696e511d, user_id=2dd2162528bb48a4b884d3422d555542, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:14.270056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5458b-a285-425e-9e3e-42d445fa441f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:14.282669 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4192/8369] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:14 2022] PUT /identity/v3/projects/5a984065cf0143e181682503696e511d/users/2dd2162528bb48a4b884d3422d555542/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:14.293294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b63f34-058f-493b-afd4-e8ba5c19f3d4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:14.293572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b63f34-058f-493b-afd4-e8ba5c19f3d4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:14.293866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b63f34-058f-493b-afd4-e8ba5c19f3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:14.322633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-74b63f34-058f-493b-afd4-e8ba5c19f3d4 None None] MFA Rules not processed for user `2dd2162528bb48a4b884d3422d555542`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:14.323842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-74b63f34-058f-493b-afd4-e8ba5c19f3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:14.388981 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4178/8370] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:14.401352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5458b-a285-425e-9e3e-42d445fa441f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:14.403067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d8d5458b-a285-425e-9e3e-42d445fa441f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:14.448455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:14.463585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5458b-a285-425e-9e3e-42d445fa441f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:14.467147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b397f-2799-4744-8486-570da11041b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:14.467739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b397f-2799-4744-8486-570da11041b9 service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:14.468017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b397f-2799-4744-8486-570da11041b9 service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:14.468287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b397f-2799-4744-8486-570da11041b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:14.527974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b397f-2799-4744-8486-570da11041b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:14.529464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b397f-2799-4744-8486-570da11041b9 service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:14.538299 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4193/8371] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:14.663093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b63f34-058f-493b-afd4-e8ba5c19f3d4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:14.676056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b63f34-058f-493b-afd4-e8ba5c19f3d4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:14.679683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c16826-2283-469b-bce8-fd7d42cd026f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:14.680278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c16826-2283-469b-bce8-fd7d42cd026f service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:14.680555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c16826-2283-469b-bce8-fd7d42cd026f service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:14.680830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c16826-2283-469b-bce8-fd7d42cd026f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:14.688981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c16826-2283-469b-bce8-fd7d42cd026f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:14.690434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c16826-2283-469b-bce8-fd7d42cd026f service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:14.699269 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4179/8372] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:15.036219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b397f-2799-4744-8486-570da11041b9 service glance] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:15.098735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b397f-2799-4744-8486-570da11041b9 service glance] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:15.103291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:15.103911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:15.104222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:15.104497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] PATH_INFO: `/v3/users/a1af5c4851b244829b6cd4397ac24bb5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:15.105639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1af5c4851b244829b6cd4397ac24bb5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:15.107817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:15.153219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1af5c4851b244829b6cd4397ac24bb5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.159971 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1af5c4851b244829b6cd4397ac24bb5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.160615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1af5c4851b244829b6cd4397ac24bb5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.161306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1af5c4851b244829b6cd4397ac24bb5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.173256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1af5c4851b244829b6cd4397ac24bb5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.186476 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4194/8373] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:15 2022] DELETE /identity/v3/users/a1af5c4851b244829b6cd4397ac24bb5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:15.190940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a216-2309-4bda-8026-0c954883643b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:15.191255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a216-2309-4bda-8026-0c954883643b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:15.191538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a216-2309-4bda-8026-0c954883643b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:15.211166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-55f9a216-2309-4bda-8026-0c954883643b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:15.212424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-55f9a216-2309-4bda-8026-0c954883643b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:15.270647 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4180/8374] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:15.280578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:15.282018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:15.300493 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:15.345723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48041a1a-0dc4-47fb-bb58-22ece6761333 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:15.349352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14a7e7-bb1e-4592-ab02-b86adeefe51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:15.349962 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14a7e7-bb1e-4592-ab02-b86adeefe51c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:15.350276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14a7e7-bb1e-4592-ab02-b86adeefe51c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:15.350564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14a7e7-bb1e-4592-ab02-b86adeefe51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:15.360400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14a7e7-bb1e-4592-ab02-b86adeefe51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:15.361861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14a7e7-bb1e-4592-ab02-b86adeefe51c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:15.371816 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4195/8375] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:15.643726 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9a216-2309-4bda-8026-0c954883643b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:15.645771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-55f9a216-2309-4bda-8026-0c954883643b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:15.667108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9a216-2309-4bda-8026-0c954883643b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:15.678522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:15.679201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:15.679481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:15.679753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] PATH_INFO: `/v3/projects/84e460f31fb74281ab4c77febc2874f2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:15.681529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e460f31fb74281ab4c77febc2874f2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:15.683430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:15.700244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:15.731000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e460f31fb74281ab4c77febc2874f2', 'request_id': 'req-af5016ec-a468-4de7-92e6-ed780cd476b3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.738451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e460f31fb74281ab4c77febc2874f2', 'request_id': 'req-af5016ec-a468-4de7-92e6-ed780cd476b3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.744826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e460f31fb74281ab4c77febc2874f2', 'request_id': 'req-af5016ec-a468-4de7-92e6-ed780cd476b3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.755690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] The token cache is being invalidate because project 84e460f31fb74281ab4c77febc2874f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:15.755976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.756602 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.758093 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4181/8376] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:15 2022] DELETE /identity/v3/projects/84e460f31fb74281ab4c77febc2874f2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:15.762067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14a7e7-bb1e-4592-ab02-b86adeefe51c service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:15.771712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14a7e7-bb1e-4592-ab02-b86adeefe51c service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:15.826567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb929d-e1bd-470a-923d-0e950ec07e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:15.827186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb929d-e1bd-470a-923d-0e950ec07e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:15.827466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb929d-e1bd-470a-923d-0e950ec07e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:15.827742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb929d-e1bd-470a-923d-0e950ec07e93 admin admin] PATH_INFO: `/v3/users/2dd2162528bb48a4b884d3422d555542` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:15.828850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb929d-e1bd-470a-923d-0e950ec07e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd2162528bb48a4b884d3422d555542)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:15.830817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb929d-e1bd-470a-923d-0e950ec07e93 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:15.876047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-29bb929d-e1bd-470a-923d-0e950ec07e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd2162528bb48a4b884d3422d555542'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.882941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-29bb929d-e1bd-470a-923d-0e950ec07e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd2162528bb48a4b884d3422d555542'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.883590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-29bb929d-e1bd-470a-923d-0e950ec07e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd2162528bb48a4b884d3422d555542'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.884265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-29bb929d-e1bd-470a-923d-0e950ec07e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd2162528bb48a4b884d3422d555542'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.895978 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-29bb929d-e1bd-470a-923d-0e950ec07e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd2162528bb48a4b884d3422d555542'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:15.909242 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4196/8377] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:15 2022] DELETE /identity/v3/users/2dd2162528bb48a4b884d3422d555542 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:16.173416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:16.175048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:16.188390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5016ec-a468-4de7-92e6-ed780cd476b3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:16.246249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:16.246884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:16.247159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:16.247428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89 admin admin] PATH_INFO: `/v3/projects/5a984065cf0143e181682503696e511d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:16.248534 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a984065cf0143e181682503696e511d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:16.250434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:16.295869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a984065cf0143e181682503696e511d', 'request_id': 'req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:16.302616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a984065cf0143e181682503696e511d', 'request_id': 'req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:16.308390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a984065cf0143e181682503696e511d', 'request_id': 'req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:16.319317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89 admin admin] The token cache is being invalidate because project 5a984065cf0143e181682503696e511d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:16.319580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:16.320217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-aa5c1c08-933c-48b6-a6b7-89801b5b3e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:16.322336 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4182/8378] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:16 2022] DELETE /identity/v3/projects/5a984065cf0143e181682503696e511d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:16.329148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377b094-458b-4476-bbd6-ad249fda2c2f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:16.329650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377b094-458b-4476-bbd6-ad249fda2c2f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:16.329778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377b094-458b-4476-bbd6-ad249fda2c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:16.349667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f377b094-458b-4476-bbd6-ad249fda2c2f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:16.350858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f377b094-458b-4476-bbd6-ad249fda2c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:16.386330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:16.415916 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4197/8379] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:16.425263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae4356-1eaf-4128-b2f1-ab3c9be60160 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:16.425497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae4356-1eaf-4128-b2f1-ab3c9be60160 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:16.425774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae4356-1eaf-4128-b2f1-ab3c9be60160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:16.446291 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b4ae4356-1eaf-4128-b2f1-ab3c9be60160 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:16.447546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b4ae4356-1eaf-4128-b2f1-ab3c9be60160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:16.455449 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4183/8380] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:16.459600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377b094-458b-4476-bbd6-ad249fda2c2f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:16.469502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377b094-458b-4476-bbd6-ad249fda2c2f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:16.478787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63b877-2bf0-49e9-80a6-fa50f2a3f5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:16.478787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63b877-2bf0-49e9-80a6-fa50f2a3f5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:16.478787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63b877-2bf0-49e9-80a6-fa50f2a3f5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:16.478787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63b877-2bf0-49e9-80a6-fa50f2a3f5c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:16.479197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63b877-2bf0-49e9-80a6-fa50f2a3f5c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:26:16.479197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63b877-2bf0-49e9-80a6-fa50f2a3f5c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:16.479197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63b877-2bf0-49e9-80a6-fa50f2a3f5c2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:16.491181 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4198/8381] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:16.495923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae4356-1eaf-4128-b2f1-ab3c9be60160 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:16.505166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae4356-1eaf-4128-b2f1-ab3c9be60160 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:16.509945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7436468-b383-4e7d-a827-bd6e35777896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:16.510536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7436468-b383-4e7d-a827-bd6e35777896 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:16.510812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7436468-b383-4e7d-a827-bd6e35777896 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:16.511076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7436468-b383-4e7d-a827-bd6e35777896 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:16.511704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7436468-b383-4e7d-a827-bd6e35777896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:16.513621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7436468-b383-4e7d-a827-bd6e35777896 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:16.539713 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4184/8382] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:16 2022] POST /identity/v3/projects => generated 411 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:16.544350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63b877-2bf0-49e9-80a6-fa50f2a3f5c2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:16.554632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63b877-2bf0-49e9-80a6-fa50f2a3f5c2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:16.614539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaa7f6-5a57-4735-807c-71bebc9bfaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:16.615154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaa7f6-5a57-4735-807c-71bebc9bfaad admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:16.615436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaa7f6-5a57-4735-807c-71bebc9bfaad admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:16.615717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaa7f6-5a57-4735-807c-71bebc9bfaad admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:16.616348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aaa7f6-5a57-4735-807c-71bebc9bfaad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:16.618389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aaa7f6-5a57-4735-807c-71bebc9bfaad admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:16.644760 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4199/8383] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:16 2022] POST /identity/v3/users => generated 306 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:16.646363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7436468-b383-4e7d-a827-bd6e35777896 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:16.663791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7436468-b383-4e7d-a827-bd6e35777896 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:16.669098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc7481-adb5-42d5-a86d-dafdbde8473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:16.669751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc7481-adb5-42d5-a86d-dafdbde8473a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:16.670012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc7481-adb5-42d5-a86d-dafdbde8473a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:16.670283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc7481-adb5-42d5-a86d-dafdbde8473a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:16.670919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc7481-adb5-42d5-a86d-dafdbde8473a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:16.672505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc7481-adb5-42d5-a86d-dafdbde8473a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:16.673928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:16.688053 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4185/8384] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:16.689362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaa7f6-5a57-4735-807c-71bebc9bfaad admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:16.699767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaa7f6-5a57-4735-807c-71bebc9bfaad admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:16.704597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70259325-95c5-4b8b-8a97-840268f61781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:16.705255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70259325-95c5-4b8b-8a97-840268f61781 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:16.705539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70259325-95c5-4b8b-8a97-840268f61781 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:16.705813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70259325-95c5-4b8b-8a97-840268f61781 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:16.706455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70259325-95c5-4b8b-8a97-840268f61781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:16.708036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70259325-95c5-4b8b-8a97-840268f61781 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:16.722854 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4200/8385] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:16.724258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc7481-adb5-42d5-a86d-dafdbde8473a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:16.735833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc7481-adb5-42d5-a86d-dafdbde8473a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:16.740544 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afd75d-dac9-4e29-8c5a-ea078a0c7fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:16.741250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afd75d-dac9-4e29-8c5a-ea078a0c7fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:16.741519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afd75d-dac9-4e29-8c5a-ea078a0c7fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:16.741800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afd75d-dac9-4e29-8c5a-ea078a0c7fc6 admin admin] PATH_INFO: `/v3/projects/56292c3fe22b49d08352a5c3cc587591/users/1f754a6541ac4bfd8cf434de9418822f/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:16.757498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afd75d-dac9-4e29-8c5a-ea078a0c7fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56292c3fe22b49d08352a5c3cc587591, user_id=1f754a6541ac4bfd8cf434de9418822f, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:16.760888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afd75d-dac9-4e29-8c5a-ea078a0c7fc6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:16.778995 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4186/8386] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:16 2022] PUT /identity/v3/projects/56292c3fe22b49d08352a5c3cc587591/users/1f754a6541ac4bfd8cf434de9418822f/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:16.789904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb81c18-d634-4978-beca-bd076ff57e37 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:16.790228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb81c18-d634-4978-beca-bd076ff57e37 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:16.790505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb81c18-d634-4978-beca-bd076ff57e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:16.819093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1fb81c18-d634-4978-beca-bd076ff57e37 None None] MFA Rules not processed for user `1f754a6541ac4bfd8cf434de9418822f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:16.820348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1fb81c18-d634-4978-beca-bd076ff57e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:16.891426 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4201/8387] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:26:16.896049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afd75d-dac9-4e29-8c5a-ea078a0c7fc6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:16.959938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afd75d-dac9-4e29-8c5a-ea078a0c7fc6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:16.965262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85b6df-ce3e-4159-b385-4c3f5cefe3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:16.965872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85b6df-ce3e-4159-b385-4c3f5cefe3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:16.966151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85b6df-ce3e-4159-b385-4c3f5cefe3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:16.966427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85b6df-ce3e-4159-b385-4c3f5cefe3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:16.967068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85b6df-ce3e-4159-b385-4c3f5cefe3f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:16.968995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85b6df-ce3e-4159-b385-4c3f5cefe3f0 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:17.001038 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4187/8388] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:16 2022] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:17.002521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb81c18-d634-4978-beca-bd076ff57e37 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:17.014616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb81c18-d634-4978-beca-bd076ff57e37 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:17.048340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:17.076697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f1d62-7568-49e8-a2e4-4848ded2ab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:17.077338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1d62-7568-49e8-a2e4-4848ded2ab64 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:17.077616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1d62-7568-49e8-a2e4-4848ded2ab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:17.077887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1d62-7568-49e8-a2e4-4848ded2ab64 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:17.078505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f1d62-7568-49e8-a2e4-4848ded2ab64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:17.080407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f1d62-7568-49e8-a2e4-4848ded2ab64 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:17.105262 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4202/8389] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:17 2022] POST /identity/v3/users => generated 310 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:17.107027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85b6df-ce3e-4159-b385-4c3f5cefe3f0 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:17.118066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85b6df-ce3e-4159-b385-4c3f5cefe3f0 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:17.123242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d0639-cbd7-4633-a4f1-91b18eedf95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:17.123925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d0639-cbd7-4633-a4f1-91b18eedf95c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:17.124261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d0639-cbd7-4633-a4f1-91b18eedf95c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:17.124566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d0639-cbd7-4633-a4f1-91b18eedf95c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:17.125228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d0639-cbd7-4633-a4f1-91b18eedf95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:17.126808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d0639-cbd7-4633-a4f1-91b18eedf95c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:17.141938 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4188/8390] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:17.143174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f1d62-7568-49e8-a2e4-4848ded2ab64 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:17.155190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f1d62-7568-49e8-a2e4-4848ded2ab64 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:17.160666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97590d-b30b-4d0a-bdc1-eb84fc4b521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:17.161429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97590d-b30b-4d0a-bdc1-eb84fc4b521c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:17.161782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97590d-b30b-4d0a-bdc1-eb84fc4b521c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:17.162135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97590d-b30b-4d0a-bdc1-eb84fc4b521c admin admin] PATH_INFO: `/v3/projects/93d056fe14b8439f8bb33cc75e1070ce/users/2061653fcd1540beb2dfdbbc48d2fd94/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:17.177406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97590d-b30b-4d0a-bdc1-eb84fc4b521c admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d056fe14b8439f8bb33cc75e1070ce, user_id=2061653fcd1540beb2dfdbbc48d2fd94, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:17.180079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97590d-b30b-4d0a-bdc1-eb84fc4b521c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:17.193848 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4203/8391] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:17 2022] PUT /identity/v3/projects/93d056fe14b8439f8bb33cc75e1070ce/users/2061653fcd1540beb2dfdbbc48d2fd94/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:17.198371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d0639-cbd7-4633-a4f1-91b18eedf95c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:17.209678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d0639-cbd7-4633-a4f1-91b18eedf95c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:17.271221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe3ec0-6e81-4b6c-b4b2-594560070bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:17.271828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe3ec0-6e81-4b6c-b4b2-594560070bdd admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:17.272106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe3ec0-6e81-4b6c-b4b2-594560070bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:17.272404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe3ec0-6e81-4b6c-b4b2-594560070bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:17.273036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe3ec0-6e81-4b6c-b4b2-594560070bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:17.275249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe3ec0-6e81-4b6c-b4b2-594560070bdd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:17.288375 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4189/8392] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:17.289512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97590d-b30b-4d0a-bdc1-eb84fc4b521c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:17.299933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97590d-b30b-4d0a-bdc1-eb84fc4b521c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:17.304633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c611c-c9d4-4ff5-ba82-b5e7946e83b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:17.305317 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c611c-c9d4-4ff5-ba82-b5e7946e83b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:17.305597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c611c-c9d4-4ff5-ba82-b5e7946e83b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:17.305897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c611c-c9d4-4ff5-ba82-b5e7946e83b7 admin admin] PATH_INFO: `/v3/projects/93d056fe14b8439f8bb33cc75e1070ce/users/2061653fcd1540beb2dfdbbc48d2fd94/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:17.308202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c611c-c9d4-4ff5-ba82-b5e7946e83b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d056fe14b8439f8bb33cc75e1070ce, user_id=2061653fcd1540beb2dfdbbc48d2fd94, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:17.310892 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c611c-c9d4-4ff5-ba82-b5e7946e83b7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:17.322069 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4204/8393] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:17 2022] PUT /identity/v3/projects/93d056fe14b8439f8bb33cc75e1070ce/users/2061653fcd1540beb2dfdbbc48d2fd94/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:26:17.332327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d59e-2aaf-4c69-bea6-dfd164ae02d4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:17.332618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d59e-2aaf-4c69-bea6-dfd164ae02d4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:17.332899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d59e-2aaf-4c69-bea6-dfd164ae02d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:17.362706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5f96d59e-2aaf-4c69-bea6-dfd164ae02d4 None None] MFA Rules not processed for user `2061653fcd1540beb2dfdbbc48d2fd94`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:17.363928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5f96d59e-2aaf-4c69-bea6-dfd164ae02d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:17.395518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:17.436271 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4190/8394] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:17 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:17.449716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c611c-c9d4-4ff5-ba82-b5e7946e83b7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:17.452015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9f0c611c-c9d4-4ff5-ba82-b5e7946e83b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:17.522459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c611c-c9d4-4ff5-ba82-b5e7946e83b7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:17.526801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36b981-58c3-4300-a38e-25892010d59d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:17.527417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b981-58c3-4300-a38e-25892010d59d service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:17.527696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b981-58c3-4300-a38e-25892010d59d service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:17.527966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b981-58c3-4300-a38e-25892010d59d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:17.538113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36b981-58c3-4300-a38e-25892010d59d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:17.539587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36b981-58c3-4300-a38e-25892010d59d service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:17.551620 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4205/8395] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:17 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:19.986913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d59e-2aaf-4c69-bea6-dfd164ae02d4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:20.055835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d59e-2aaf-4c69-bea6-dfd164ae02d4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:20.060563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:20.061216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:20.061512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:20.061807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] PATH_INFO: `/v3/users/1f754a6541ac4bfd8cf434de9418822f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:20.062948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f754a6541ac4bfd8cf434de9418822f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:20.064861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:20.118466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f754a6541ac4bfd8cf434de9418822f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.128091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f754a6541ac4bfd8cf434de9418822f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.128813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f754a6541ac4bfd8cf434de9418822f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.129472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f754a6541ac4bfd8cf434de9418822f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.143060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f754a6541ac4bfd8cf434de9418822f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.158305 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4191/8396] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:19 2022] DELETE /identity/v3/users/1f754a6541ac4bfd8cf434de9418822f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:20.164240 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31e0a3-3b23-4b29-b6a8-dec4c9800638 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:20.164776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31e0a3-3b23-4b29-b6a8-dec4c9800638 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:20.164776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31e0a3-3b23-4b29-b6a8-dec4c9800638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:20.186018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0d31e0a3-3b23-4b29-b6a8-dec4c9800638 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:20.187313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0d31e0a3-3b23-4b29-b6a8-dec4c9800638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:20.257599 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4206/8397] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:20.268987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:20.270552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:20.328145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:20.339578 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43487d39-1819-4b6d-a871-956e4ecf4256 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:20.343401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746afa6-18c6-4225-a32b-fb08310e5b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:20.344126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746afa6-18c6-4225-a32b-fb08310e5b7d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:20.344283 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746afa6-18c6-4225-a32b-fb08310e5b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:20.344657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746afa6-18c6-4225-a32b-fb08310e5b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:20.360118 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746afa6-18c6-4225-a32b-fb08310e5b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:20.361575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746afa6-18c6-4225-a32b-fb08310e5b7d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:20.371624 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4192/8398] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:20.666401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31e0a3-3b23-4b29-b6a8-dec4c9800638 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:20.668297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0d31e0a3-3b23-4b29-b6a8-dec4c9800638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:20.695902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31e0a3-3b23-4b29-b6a8-dec4c9800638 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:20.701804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:20.702442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:20.702725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:20.703001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] PATH_INFO: `/v3/projects/56292c3fe22b49d08352a5c3cc587591` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:20.704250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56292c3fe22b49d08352a5c3cc587591)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:20.706645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:20.733253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:20.756931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56292c3fe22b49d08352a5c3cc587591', 'request_id': 'req-5b3ea519-7e12-42b9-b4e7-53852f017d82'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.764218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56292c3fe22b49d08352a5c3cc587591', 'request_id': 'req-5b3ea519-7e12-42b9-b4e7-53852f017d82'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.770585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56292c3fe22b49d08352a5c3cc587591', 'request_id': 'req-5b3ea519-7e12-42b9-b4e7-53852f017d82'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.781559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] The token cache is being invalidate because project 56292c3fe22b49d08352a5c3cc587591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:20.781846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.782471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.784039 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4207/8399] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:20 2022] DELETE /identity/v3/projects/56292c3fe22b49d08352a5c3cc587591 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:20.788023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746afa6-18c6-4225-a32b-fb08310e5b7d service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:20.798107 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746afa6-18c6-4225-a32b-fb08310e5b7d service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:20.857847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11f40f-4f98-489f-b627-2604f26b72d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:20.858496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11f40f-4f98-489f-b627-2604f26b72d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:20.858774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11f40f-4f98-489f-b627-2604f26b72d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:20.859046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11f40f-4f98-489f-b627-2604f26b72d8 admin admin] PATH_INFO: `/v3/users/2061653fcd1540beb2dfdbbc48d2fd94` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:20.860204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11f40f-4f98-489f-b627-2604f26b72d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2061653fcd1540beb2dfdbbc48d2fd94)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:20.862292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11f40f-4f98-489f-b627-2604f26b72d8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:20.910921 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc11f40f-4f98-489f-b627-2604f26b72d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2061653fcd1540beb2dfdbbc48d2fd94'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.918558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc11f40f-4f98-489f-b627-2604f26b72d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2061653fcd1540beb2dfdbbc48d2fd94'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.919248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc11f40f-4f98-489f-b627-2604f26b72d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2061653fcd1540beb2dfdbbc48d2fd94'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.919872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc11f40f-4f98-489f-b627-2604f26b72d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2061653fcd1540beb2dfdbbc48d2fd94'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.933003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-bc11f40f-4f98-489f-b627-2604f26b72d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2061653fcd1540beb2dfdbbc48d2fd94'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:20.946649 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4193/8400] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:20 2022] DELETE /identity/v3/users/2061653fcd1540beb2dfdbbc48d2fd94 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:26:21.134767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:21.136354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:21.153065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ea519-7e12-42b9-b4e7-53852f017d82 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:21.214691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a303345-30d8-4771-b872-355aae874d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:21.215310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a303345-30d8-4771-b872-355aae874d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:21.215593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a303345-30d8-4771-b872-355aae874d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:21.215864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a303345-30d8-4771-b872-355aae874d6a admin admin] PATH_INFO: `/v3/projects/93d056fe14b8439f8bb33cc75e1070ce` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:21.216974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a303345-30d8-4771-b872-355aae874d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d056fe14b8439f8bb33cc75e1070ce)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:21.219558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a303345-30d8-4771-b872-355aae874d6a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:21.268752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9a303345-30d8-4771-b872-355aae874d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d056fe14b8439f8bb33cc75e1070ce', 'request_id': 'req-9a303345-30d8-4771-b872-355aae874d6a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:21.276514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9a303345-30d8-4771-b872-355aae874d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d056fe14b8439f8bb33cc75e1070ce', 'request_id': 'req-9a303345-30d8-4771-b872-355aae874d6a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:21.282554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9a303345-30d8-4771-b872-355aae874d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d056fe14b8439f8bb33cc75e1070ce', 'request_id': 'req-9a303345-30d8-4771-b872-355aae874d6a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:21.294139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9a303345-30d8-4771-b872-355aae874d6a admin admin] The token cache is being invalidate because project 93d056fe14b8439f8bb33cc75e1070ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:21.294429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9a303345-30d8-4771-b872-355aae874d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:21.295071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-9a303345-30d8-4771-b872-355aae874d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:21.296549 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4208/8401] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:21 2022] DELETE /identity/v3/projects/93d056fe14b8439f8bb33cc75e1070ce => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:21.302271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee8904-1832-4396-9731-e8b63e15953e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:21.302756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee8904-1832-4396-9731-e8b63e15953e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:21.302855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee8904-1832-4396-9731-e8b63e15953e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:21.323830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3dee8904-1832-4396-9731-e8b63e15953e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:21.325241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3dee8904-1832-4396-9731-e8b63e15953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:21.388299 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4194/8402] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:21.397262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e844c47-114e-453a-9c63-9e60e5940b74 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:21.397626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e844c47-114e-453a-9c63-9e60e5940b74 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:21.397966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e844c47-114e-453a-9c63-9e60e5940b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:21.418074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6e844c47-114e-453a-9c63-9e60e5940b74 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:21.419289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6e844c47-114e-453a-9c63-9e60e5940b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:21.427538 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4209/8403] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:21.432134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee8904-1832-4396-9731-e8b63e15953e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:21.442032 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee8904-1832-4396-9731-e8b63e15953e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:21.447148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64b917-0e38-48d4-87a6-f37ab849fd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:21.447752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64b917-0e38-48d4-87a6-f37ab849fd87 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:21.448082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64b917-0e38-48d4-87a6-f37ab849fd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:21.448298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64b917-0e38-48d4-87a6-f37ab849fd87 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:21.448943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64b917-0e38-48d4-87a6-f37ab849fd87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:26:21.449831 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64b917-0e38-48d4-87a6-f37ab849fd87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:21.450834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64b917-0e38-48d4-87a6-f37ab849fd87 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:21.453621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:21.469610 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4195/8404] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:21.470529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e844c47-114e-453a-9c63-9e60e5940b74 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:21.481030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e844c47-114e-453a-9c63-9e60e5940b74 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:21.487290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f5043-0e15-4435-a242-a7ec1e4165a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:21.487974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5043-0e15-4435-a242-a7ec1e4165a0 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:21.488324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5043-0e15-4435-a242-a7ec1e4165a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:21.488771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5043-0e15-4435-a242-a7ec1e4165a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:21.489505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f5043-0e15-4435-a242-a7ec1e4165a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:21.491485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f5043-0e15-4435-a242-a7ec1e4165a0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:21.520265 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4210/8405] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:21 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:26:21.524510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64b917-0e38-48d4-87a6-f37ab849fd87 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:21.534473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64b917-0e38-48d4-87a6-f37ab849fd87 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:21.590708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb2427-5e8c-4f04-90ec-6e9787d06360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:21.591317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2427-5e8c-4f04-90ec-6e9787d06360 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:21.591593 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2427-5e8c-4f04-90ec-6e9787d06360 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:21.591863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2427-5e8c-4f04-90ec-6e9787d06360 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:21.592483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb2427-5e8c-4f04-90ec-6e9787d06360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:21.594478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb2427-5e8c-4f04-90ec-6e9787d06360 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:21.622232 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4196/8406] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:21 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:21.626484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f5043-0e15-4435-a242-a7ec1e4165a0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:21.637260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f5043-0e15-4435-a242-a7ec1e4165a0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:21.642158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ac688-c3c2-4d82-8aea-ce55b73b7fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:21.642757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ac688-c3c2-4d82-8aea-ce55b73b7fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:21.643038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ac688-c3c2-4d82-8aea-ce55b73b7fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:21.643315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ac688-c3c2-4d82-8aea-ce55b73b7fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:21.643955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ac688-c3c2-4d82-8aea-ce55b73b7fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:21.645584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ac688-c3c2-4d82-8aea-ce55b73b7fc4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:21.656460 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4211/8407] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:21.660535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb2427-5e8c-4f04-90ec-6e9787d06360 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:21.671414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb2427-5e8c-4f04-90ec-6e9787d06360 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:21.676012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0d4d8-6262-470a-9f92-ba2750b2981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:21.676615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0d4d8-6262-470a-9f92-ba2750b2981e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:21.676898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0d4d8-6262-470a-9f92-ba2750b2981e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:21.677180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0d4d8-6262-470a-9f92-ba2750b2981e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:21.677960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0d4d8-6262-470a-9f92-ba2750b2981e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:21.679446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0d4d8-6262-470a-9f92-ba2750b2981e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:21.693120 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4197/8408] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:21.697751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ac688-c3c2-4d82-8aea-ce55b73b7fc4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:21.702915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:21.709298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ac688-c3c2-4d82-8aea-ce55b73b7fc4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:21.717155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245ff64-bd14-4683-8b89-552f6f662864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:21.718052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245ff64-bd14-4683-8b89-552f6f662864 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:21.718436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245ff64-bd14-4683-8b89-552f6f662864 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:21.718824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245ff64-bd14-4683-8b89-552f6f662864 admin admin] PATH_INFO: `/v3/projects/f4452bc4190c49ff97f7aa62579180c1/users/75f727f49e11434182fdd4fa66637aac/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:21.734818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245ff64-bd14-4683-8b89-552f6f662864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4452bc4190c49ff97f7aa62579180c1, user_id=75f727f49e11434182fdd4fa66637aac, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:21.737534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245ff64-bd14-4683-8b89-552f6f662864 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:21.751982 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4212/8409] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:21 2022] PUT /identity/v3/projects/f4452bc4190c49ff97f7aa62579180c1/users/75f727f49e11434182fdd4fa66637aac/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:21.762850 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74aa71-dd18-4d2d-985c-4373859436ac None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:21.763135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74aa71-dd18-4d2d-985c-4373859436ac None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:21.763413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74aa71-dd18-4d2d-985c-4373859436ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:21.792627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7b74aa71-dd18-4d2d-985c-4373859436ac None None] MFA Rules not processed for user `75f727f49e11434182fdd4fa66637aac`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:21.793965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7b74aa71-dd18-4d2d-985c-4373859436ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:21.866873 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4198/8410] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:26:21.871678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245ff64-bd14-4683-8b89-552f6f662864 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:21.949133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245ff64-bd14-4683-8b89-552f6f662864 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:21.955125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e21a-8a69-4104-8658-0e1909941215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:21.955880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e21a-8a69-4104-8658-0e1909941215 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:21.956262 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e21a-8a69-4104-8658-0e1909941215 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:21.956635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e21a-8a69-4104-8658-0e1909941215 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:21.957529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885e21a-8a69-4104-8658-0e1909941215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:21.959608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885e21a-8a69-4104-8658-0e1909941215 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:21.996271 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4213/8411] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:21 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:22.000260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74aa71-dd18-4d2d-985c-4373859436ac None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:22.014391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74aa71-dd18-4d2d-985c-4373859436ac None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:22.072902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825d04c-2fe4-4dc0-83aa-3b6f783dc906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:22.073759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825d04c-2fe4-4dc0-83aa-3b6f783dc906 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:22.074037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825d04c-2fe4-4dc0-83aa-3b6f783dc906 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:22.074306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825d04c-2fe4-4dc0-83aa-3b6f783dc906 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:22.074946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825d04c-2fe4-4dc0-83aa-3b6f783dc906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:22.076872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825d04c-2fe4-4dc0-83aa-3b6f783dc906 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:22.087979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:22.101107 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4199/8412] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:21 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:22.104973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e21a-8a69-4104-8658-0e1909941215 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:22.115906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e21a-8a69-4104-8658-0e1909941215 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:22.121455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a5ae2-96ab-4236-b759-b0f3560b466b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:22.122062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a5ae2-96ab-4236-b759-b0f3560b466b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:22.122349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a5ae2-96ab-4236-b759-b0f3560b466b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:22.122644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a5ae2-96ab-4236-b759-b0f3560b466b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:22.123289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a5ae2-96ab-4236-b759-b0f3560b466b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:22.124879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a5ae2-96ab-4236-b759-b0f3560b466b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:22.136375 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4214/8413] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:26:22.140430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825d04c-2fe4-4dc0-83aa-3b6f783dc906 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:22.150634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825d04c-2fe4-4dc0-83aa-3b6f783dc906 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:22.155570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023512-68a5-480a-af3b-b307e7bd4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:22.156250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023512-68a5-480a-af3b-b307e7bd4dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:22.156527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023512-68a5-480a-af3b-b307e7bd4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:22.156798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023512-68a5-480a-af3b-b307e7bd4dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:22.157472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023512-68a5-480a-af3b-b307e7bd4dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:22.159083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023512-68a5-480a-af3b-b307e7bd4dc9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:22.172418 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4200/8414] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:22.173625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a5ae2-96ab-4236-b759-b0f3560b466b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:22.184731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a5ae2-96ab-4236-b759-b0f3560b466b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:22.189461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5427591-aaeb-4366-8bbe-8c74f5ba7aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:22.190122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5427591-aaeb-4366-8bbe-8c74f5ba7aae admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:22.190405 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5427591-aaeb-4366-8bbe-8c74f5ba7aae admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:22.190676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5427591-aaeb-4366-8bbe-8c74f5ba7aae admin admin] PATH_INFO: `/v3/projects/8c03d40b693849deb3ff30f39d60b587/users/00eb15f8af454e3cac546120712dcc43/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:22.207091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5427591-aaeb-4366-8bbe-8c74f5ba7aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c03d40b693849deb3ff30f39d60b587, user_id=00eb15f8af454e3cac546120712dcc43, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:22.209880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5427591-aaeb-4366-8bbe-8c74f5ba7aae admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:22.223385 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4215/8415] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:22 2022] PUT /identity/v3/projects/8c03d40b693849deb3ff30f39d60b587/users/00eb15f8af454e3cac546120712dcc43/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:26:22.235631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde091-dc2b-409d-b6ed-bedbd4a898d2 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:22.236010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde091-dc2b-409d-b6ed-bedbd4a898d2 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:22.236349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde091-dc2b-409d-b6ed-bedbd4a898d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:22.265274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-52cde091-dc2b-409d-b6ed-bedbd4a898d2 None None] MFA Rules not processed for user `00eb15f8af454e3cac546120712dcc43`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:22.266510 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-52cde091-dc2b-409d-b6ed-bedbd4a898d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:22.333715 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4201/8416] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:22.338171 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5427591-aaeb-4366-8bbe-8c74f5ba7aae admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:22.422934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5427591-aaeb-4366-8bbe-8c74f5ba7aae admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:22.427724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08dbb0-b93c-4e14-847c-2ed760341db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:22.428324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08dbb0-b93c-4e14-847c-2ed760341db0 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:22.428602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08dbb0-b93c-4e14-847c-2ed760341db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:22.428869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08dbb0-b93c-4e14-847c-2ed760341db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:22.429525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08dbb0-b93c-4e14-847c-2ed760341db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:22.431996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08dbb0-b93c-4e14-847c-2ed760341db0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:22.469606 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4216/8417] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:22 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:22.470750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cde091-dc2b-409d-b6ed-bedbd4a898d2 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:22.496906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cde091-dc2b-409d-b6ed-bedbd4a898d2 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:22.564837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad1682-b809-44b4-ba27-ee1a6785341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:22.565549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad1682-b809-44b4-ba27-ee1a6785341f admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:22.565856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad1682-b809-44b4-ba27-ee1a6785341f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:22.566130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad1682-b809-44b4-ba27-ee1a6785341f admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:22.566884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad1682-b809-44b4-ba27-ee1a6785341f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:22.568858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad1682-b809-44b4-ba27-ee1a6785341f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:22.591731 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4202/8418] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:22 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:22.595955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08dbb0-b93c-4e14-847c-2ed760341db0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:22.608614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08dbb0-b93c-4e14-847c-2ed760341db0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:22.615241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a489a48-0942-4510-a58e-143001927819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:22.615874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a489a48-0942-4510-a58e-143001927819 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:22.616163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a489a48-0942-4510-a58e-143001927819 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:22.616568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a489a48-0942-4510-a58e-143001927819 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:22.617249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a489a48-0942-4510-a58e-143001927819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:22.619494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a489a48-0942-4510-a58e-143001927819 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:22.631060 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4217/8419] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:22.636023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad1682-b809-44b4-ba27-ee1a6785341f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:22.648751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad1682-b809-44b4-ba27-ee1a6785341f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:22.657557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fe9db-3a91-4fb5-bdc9-02c93651fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:22.658379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fe9db-3a91-4fb5-bdc9-02c93651fae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:22.658753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fe9db-3a91-4fb5-bdc9-02c93651fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:22.659127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fe9db-3a91-4fb5-bdc9-02c93651fae6 admin admin] PATH_INFO: `/v3/projects/51af5ee873e647d7a63beeceff83984b/users/8ed2eeb86bd24ef99cf5839426d4c4d4/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:22.675934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fe9db-3a91-4fb5-bdc9-02c93651fae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51af5ee873e647d7a63beeceff83984b, user_id=8ed2eeb86bd24ef99cf5839426d4c4d4, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:22.688505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fe9db-3a91-4fb5-bdc9-02c93651fae6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:22.707040 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4203/8420] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:22 2022] PUT /identity/v3/projects/51af5ee873e647d7a63beeceff83984b/users/8ed2eeb86bd24ef99cf5839426d4c4d4/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:22.712429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a489a48-0942-4510-a58e-143001927819 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:22.719987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:22.727636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a489a48-0942-4510-a58e-143001927819 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:22.815376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8dc64-ab44-4bfb-bdc8-3b3056e41db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:22.816002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8dc64-ab44-4bfb-bdc8-3b3056e41db7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:22.816282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8dc64-ab44-4bfb-bdc8-3b3056e41db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:22.817002 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8dc64-ab44-4bfb-bdc8-3b3056e41db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:22.817850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8dc64-ab44-4bfb-bdc8-3b3056e41db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:22.819603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8dc64-ab44-4bfb-bdc8-3b3056e41db7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:22.835283 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4218/8421] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:22.836500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fe9db-3a91-4fb5-bdc9-02c93651fae6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:22.848881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fe9db-3a91-4fb5-bdc9-02c93651fae6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:22.854709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8fd86-874f-424f-944b-5c6b6fcd4899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:22.855906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8fd86-874f-424f-944b-5c6b6fcd4899 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:22.856095 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8fd86-874f-424f-944b-5c6b6fcd4899 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:22.856722 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8fd86-874f-424f-944b-5c6b6fcd4899 admin admin] PATH_INFO: `/v3/projects/51af5ee873e647d7a63beeceff83984b/users/8ed2eeb86bd24ef99cf5839426d4c4d4/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:22.859134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8fd86-874f-424f-944b-5c6b6fcd4899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51af5ee873e647d7a63beeceff83984b, user_id=8ed2eeb86bd24ef99cf5839426d4c4d4, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:22.862304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8fd86-874f-424f-944b-5c6b6fcd4899 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:22.874824 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4204/8422] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:22 2022] PUT /identity/v3/projects/51af5ee873e647d7a63beeceff83984b/users/8ed2eeb86bd24ef99cf5839426d4c4d4/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:22.885987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a0d0d-9587-4887-97f4-dd0c143f4fa3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:22.886339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a0d0d-9587-4887-97f4-dd0c143f4fa3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:22.886546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a0d0d-9587-4887-97f4-dd0c143f4fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:22.924807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-338a0d0d-9587-4887-97f4-dd0c143f4fa3 None None] MFA Rules not processed for user `8ed2eeb86bd24ef99cf5839426d4c4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:22.926641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-338a0d0d-9587-4887-97f4-dd0c143f4fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:23.017844 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4219/8423] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:23.030116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8fd86-874f-424f-944b-5c6b6fcd4899 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:23.035016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-13d8fd86-874f-424f-944b-5c6b6fcd4899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:23.067169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:23.106621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8fd86-874f-424f-944b-5c6b6fcd4899 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:23.111695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5658808-45de-4572-becb-448927bf96e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:23.113087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5658808-45de-4572-becb-448927bf96e2 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:23.113554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5658808-45de-4572-becb-448927bf96e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:23.113842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5658808-45de-4572-becb-448927bf96e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:23.228745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5658808-45de-4572-becb-448927bf96e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:23.230273 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5658808-45de-4572-becb-448927bf96e2 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:23.242516 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4205/8424] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:31.248796 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a0d0d-9587-4887-97f4-dd0c143f4fa3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:31.250487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-338a0d0d-9587-4887-97f4-dd0c143f4fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:31.274578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a0d0d-9587-4887-97f4-dd0c143f4fa3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:31.279563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf87b5f-35c7-44b3-8045-18d5eef7d060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:31.280278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf87b5f-35c7-44b3-8045-18d5eef7d060 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:31.280855 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf87b5f-35c7-44b3-8045-18d5eef7d060 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:31.281338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf87b5f-35c7-44b3-8045-18d5eef7d060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:31.308841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf87b5f-35c7-44b3-8045-18d5eef7d060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:31.324376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf87b5f-35c7-44b3-8045-18d5eef7d060 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:31.348142 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4220/8425] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:32.778982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2ba3c-2db4-43dd-b48e-596532497301 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:32.779461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2ba3c-2db4-43dd-b48e-596532497301 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:32.779683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2ba3c-2db4-43dd-b48e-596532497301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:32.801853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-acc2ba3c-2db4-43dd-b48e-596532497301 None None] MFA Rules not processed for user `8219a93945a147c4a57bb6452212fe7c`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:32.802767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-acc2ba3c-2db4-43dd-b48e-596532497301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:32.887682 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4206/8426] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:36.154084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf87b5f-35c7-44b3-8045-18d5eef7d060 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:36.166744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf87b5f-35c7-44b3-8045-18d5eef7d060 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:36.170725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e8673-c203-4155-b51f-52d13c739b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:36.171521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e8673-c203-4155-b51f-52d13c739b85 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:36.171803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e8673-c203-4155-b51f-52d13c739b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:36.172077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e8673-c203-4155-b51f-52d13c739b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:36.242647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e8673-c203-4155-b51f-52d13c739b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:36.245461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e8673-c203-4155-b51f-52d13c739b85 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:36.267289 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4221/8427] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:42.874785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=62 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:43.470024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2ba3c-2db4-43dd-b48e-596532497301 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:43.536731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2ba3c-2db4-43dd-b48e-596532497301 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:43.541835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:43.542464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:43.542741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:43.543037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] PATH_INFO: `/v3/users/75f727f49e11434182fdd4fa66637aac` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:43.544144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f727f49e11434182fdd4fa66637aac)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:43.546083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:43.591250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f727f49e11434182fdd4fa66637aac'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:43.598052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f727f49e11434182fdd4fa66637aac'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:43.598706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f727f49e11434182fdd4fa66637aac'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:43.599306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f727f49e11434182fdd4fa66637aac'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:43.611755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f727f49e11434182fdd4fa66637aac'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:43.624715 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4207/8428] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:43 2022] DELETE /identity/v3/users/75f727f49e11434182fdd4fa66637aac => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:43.629175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e80a3-5d81-41c8-8b42-d6bdd4d83175 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:43.629701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e80a3-5d81-41c8-8b42-d6bdd4d83175 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:43.629792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e80a3-5d81-41c8-8b42-d6bdd4d83175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:43.649919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d82e80a3-5d81-41c8-8b42-d6bdd4d83175 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:43.651557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d82e80a3-5d81-41c8-8b42-d6bdd4d83175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:43.656560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:43.712402 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4222/8429] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:43.722165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:43.723687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:43.783070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c056f-383a-46ed-8122-1ed2c9cd3ece admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:43.786825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e08700-2084-49f6-a10f-60ef5364c83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:43.787428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08700-2084-49f6-a10f-60ef5364c83d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:43.787711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08700-2084-49f6-a10f-60ef5364c83d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:43.788004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08700-2084-49f6-a10f-60ef5364c83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:43.797639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e08700-2084-49f6-a10f-60ef5364c83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:43.799054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e08700-2084-49f6-a10f-60ef5364c83d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:43.808483 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4208/8430] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:26:43.992165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e80a3-5d81-41c8-8b42-d6bdd4d83175 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:43.994882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d82e80a3-5d81-41c8-8b42-d6bdd4d83175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:44.008036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e80a3-5d81-41c8-8b42-d6bdd4d83175 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:44.013439 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:44.014071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:44.014811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:44.014811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] PATH_INFO: `/v3/projects/f4452bc4190c49ff97f7aa62579180c1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:44.015792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4452bc4190c49ff97f7aa62579180c1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:44.018249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:44.074554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4452bc4190c49ff97f7aa62579180c1', 'request_id': 'req-6cbac107-8ff3-4f46-be38-92b8061f33e7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.083212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4452bc4190c49ff97f7aa62579180c1', 'request_id': 'req-6cbac107-8ff3-4f46-be38-92b8061f33e7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.090260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4452bc4190c49ff97f7aa62579180c1', 'request_id': 'req-6cbac107-8ff3-4f46-be38-92b8061f33e7'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.104675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] The token cache is being invalidate because project f4452bc4190c49ff97f7aa62579180c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:44.105115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.105840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.108022 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4223/8431] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:43 2022] DELETE /identity/v3/projects/f4452bc4190c49ff97f7aa62579180c1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:44.112071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e08700-2084-49f6-a10f-60ef5364c83d service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:44.123258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e08700-2084-49f6-a10f-60ef5364c83d service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:44.146238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:44.186876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:44.187433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:44.187716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:44.188020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] PATH_INFO: `/v3/users/00eb15f8af454e3cac546120712dcc43` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:44.189174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=00eb15f8af454e3cac546120712dcc43)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:44.191164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:44.240504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00eb15f8af454e3cac546120712dcc43'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.247667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00eb15f8af454e3cac546120712dcc43'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.248402 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00eb15f8af454e3cac546120712dcc43'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.249065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00eb15f8af454e3cac546120712dcc43'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.261904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00eb15f8af454e3cac546120712dcc43'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.275296 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4209/8432] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:44 2022] DELETE /identity/v3/users/00eb15f8af454e3cac546120712dcc43 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:26:44.550225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:44.551655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:44.567190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbac107-8ff3-4f46-be38-92b8061f33e7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:44.624574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:44.625215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:44.625502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:44.625774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] PATH_INFO: `/v3/projects/8c03d40b693849deb3ff30f39d60b587` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:44.626871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c03d40b693849deb3ff30f39d60b587)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:44.628748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:44.665986 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:44.676688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c03d40b693849deb3ff30f39d60b587', 'request_id': 'req-d61f6f51-67a6-4922-a8de-00ddb71cd708'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.683688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c03d40b693849deb3ff30f39d60b587', 'request_id': 'req-d61f6f51-67a6-4922-a8de-00ddb71cd708'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.689278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c03d40b693849deb3ff30f39d60b587', 'request_id': 'req-d61f6f51-67a6-4922-a8de-00ddb71cd708'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.700252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] The token cache is being invalidate because project 8c03d40b693849deb3ff30f39d60b587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:44.700539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.701164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.702681 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4224/8433] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:44 2022] DELETE /identity/v3/projects/8c03d40b693849deb3ff30f39d60b587 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:44.706747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:44.708172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:44.721700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5011e-5c9a-434b-a52e-4471cf0e2ade admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:44.777656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf9ca9-d35b-483e-b9ca-319dd520f2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:44.778209 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf9ca9-d35b-483e-b9ca-319dd520f2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:44.778483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf9ca9-d35b-483e-b9ca-319dd520f2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:44.778761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf9ca9-d35b-483e-b9ca-319dd520f2dc admin admin] PATH_INFO: `/v3/users/8ed2eeb86bd24ef99cf5839426d4c4d4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:44.779868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf9ca9-d35b-483e-b9ca-319dd520f2dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed2eeb86bd24ef99cf5839426d4c4d4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:44.781801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf9ca9-d35b-483e-b9ca-319dd520f2dc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:44.823572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:44.826527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ddcf9ca9-d35b-483e-b9ca-319dd520f2dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed2eeb86bd24ef99cf5839426d4c4d4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.835513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ddcf9ca9-d35b-483e-b9ca-319dd520f2dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed2eeb86bd24ef99cf5839426d4c4d4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.836166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ddcf9ca9-d35b-483e-b9ca-319dd520f2dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed2eeb86bd24ef99cf5839426d4c4d4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.837441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ddcf9ca9-d35b-483e-b9ca-319dd520f2dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed2eeb86bd24ef99cf5839426d4c4d4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.849663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ddcf9ca9-d35b-483e-b9ca-319dd520f2dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed2eeb86bd24ef99cf5839426d4c4d4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:44.862333 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4210/8434] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:44 2022] DELETE /identity/v3/users/8ed2eeb86bd24ef99cf5839426d4c4d4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:45.145821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:45.147239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:45.173128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f6f51-67a6-4922-a8de-00ddb71cd708 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:45.235186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:45.235413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:45.235523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:45.235775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e admin admin] PATH_INFO: `/v3/projects/51af5ee873e647d7a63beeceff83984b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:45.236901 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e admin admin] RBAC: Authorizing `identity:delete_project(project_id=51af5ee873e647d7a63beeceff83984b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:45.238831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:45.287663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51af5ee873e647d7a63beeceff83984b', 'request_id': 'req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:45.295265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51af5ee873e647d7a63beeceff83984b', 'request_id': 'req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:45.301639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51af5ee873e647d7a63beeceff83984b', 'request_id': 'req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:45.313818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e admin admin] The token cache is being invalidate because project 51af5ee873e647d7a63beeceff83984b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:45.314109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:45.314848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8a8a51b2-d0eb-4760-ad97-0d4f7674c71e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:45.316853 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4225/8435] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:45 2022] DELETE /identity/v3/projects/51af5ee873e647d7a63beeceff83984b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:45.322337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db2c3d-2de2-4857-994a-369cb4894eb4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:45.322782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db2c3d-2de2-4857-994a-369cb4894eb4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:45.322984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db2c3d-2de2-4857-994a-369cb4894eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:45.342886 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-27db2c3d-2de2-4857-994a-369cb4894eb4 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:45.344096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-27db2c3d-2de2-4857-994a-369cb4894eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:45.414389 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4211/8436] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:26:45.422144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512192-2c94-44a3-9da0-926120020d93 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:45.422423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512192-2c94-44a3-9da0-926120020d93 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:45.422695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512192-2c94-44a3-9da0-926120020d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:45.442842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0e512192-2c94-44a3-9da0-926120020d93 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:45.444050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0e512192-2c94-44a3-9da0-926120020d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:45.453242 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4226/8437] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:45.457881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db2c3d-2de2-4857-994a-369cb4894eb4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:45.467937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db2c3d-2de2-4857-994a-369cb4894eb4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:45.472505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99af3b9-fac5-45bb-9fbe-42d9c0d1411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:45.473111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99af3b9-fac5-45bb-9fbe-42d9c0d1411e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:45.473848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99af3b9-fac5-45bb-9fbe-42d9c0d1411e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:45.474125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99af3b9-fac5-45bb-9fbe-42d9c0d1411e admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:45.474766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99af3b9-fac5-45bb-9fbe-42d9c0d1411e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:26:45.475064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99af3b9-fac5-45bb-9fbe-42d9c0d1411e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:45.476652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99af3b9-fac5-45bb-9fbe-42d9c0d1411e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:45.490294 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4212/8438] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:45.495356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512192-2c94-44a3-9da0-926120020d93 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:45.505549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512192-2c94-44a3-9da0-926120020d93 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:45.510780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb012-7f85-48eb-b7ac-686c792dbe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:45.511384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb012-7f85-48eb-b7ac-686c792dbe38 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:45.511661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb012-7f85-48eb-b7ac-686c792dbe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:45.511929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb012-7f85-48eb-b7ac-686c792dbe38 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:45.512590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebb012-7f85-48eb-b7ac-686c792dbe38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:45.514693 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebb012-7f85-48eb-b7ac-686c792dbe38 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:45.543335 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4227/8439] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:45 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:45.547771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99af3b9-fac5-45bb-9fbe-42d9c0d1411e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:45.559240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99af3b9-fac5-45bb-9fbe-42d9c0d1411e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:45.618417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0898ac-8e5d-451e-a8b1-499f8a8fdb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:45.619048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0898ac-8e5d-451e-a8b1-499f8a8fdb47 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:45.619326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0898ac-8e5d-451e-a8b1-499f8a8fdb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:45.619603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0898ac-8e5d-451e-a8b1-499f8a8fdb47 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:45.620241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0898ac-8e5d-451e-a8b1-499f8a8fdb47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:45.622184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0898ac-8e5d-451e-a8b1-499f8a8fdb47 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:45.646145 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4213/8440] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:45 2022] POST /identity/v3/users => generated 278 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:45.650516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb012-7f85-48eb-b7ac-686c792dbe38 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:45.664056 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb012-7f85-48eb-b7ac-686c792dbe38 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:45.669694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d283e70-db32-4428-a7f3-a1ffd7726905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:45.670319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d283e70-db32-4428-a7f3-a1ffd7726905 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:45.670595 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d283e70-db32-4428-a7f3-a1ffd7726905 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:45.670862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d283e70-db32-4428-a7f3-a1ffd7726905 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:45.671499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d283e70-db32-4428-a7f3-a1ffd7726905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:45.673144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d283e70-db32-4428-a7f3-a1ffd7726905 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:45.684106 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4228/8441] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:26:45.688197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0898ac-8e5d-451e-a8b1-499f8a8fdb47 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:45.698417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0898ac-8e5d-451e-a8b1-499f8a8fdb47 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:45.703587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bd9d4-0a84-45dc-936b-bc6e83aa7ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:45.704211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bd9d4-0a84-45dc-936b-bc6e83aa7ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:45.704497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bd9d4-0a84-45dc-936b-bc6e83aa7ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:45.704775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bd9d4-0a84-45dc-936b-bc6e83aa7ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:45.705451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bd9d4-0a84-45dc-936b-bc6e83aa7ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:45.707097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bd9d4-0a84-45dc-936b-bc6e83aa7ee6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:45.718415 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4214/8442] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:26:45.722868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d283e70-db32-4428-a7f3-a1ffd7726905 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:45.733860 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d283e70-db32-4428-a7f3-a1ffd7726905 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:45.738649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c71af1-fbc6-48ff-b8d6-2196dc3e907c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:45.739300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71af1-fbc6-48ff-b8d6-2196dc3e907c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:45.739579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71af1-fbc6-48ff-b8d6-2196dc3e907c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:45.739866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71af1-fbc6-48ff-b8d6-2196dc3e907c admin admin] PATH_INFO: `/v3/projects/d7057197c9d9466490984c60fc613708/users/cdeb2e71bab34ae08243d455b3345e3d/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:45.751642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:45.756458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c71af1-fbc6-48ff-b8d6-2196dc3e907c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7057197c9d9466490984c60fc613708, user_id=cdeb2e71bab34ae08243d455b3345e3d, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:45.759731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c71af1-fbc6-48ff-b8d6-2196dc3e907c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:45.774126 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4229/8443] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:45 2022] PUT /identity/v3/projects/d7057197c9d9466490984c60fc613708/users/cdeb2e71bab34ae08243d455b3345e3d/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:26:45.785148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be321-5898-4277-ae41-2866ce469e95 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:45.785471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be321-5898-4277-ae41-2866ce469e95 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:45.785754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be321-5898-4277-ae41-2866ce469e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:45.816952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cd8be321-5898-4277-ae41-2866ce469e95 None None] MFA Rules not processed for user `cdeb2e71bab34ae08243d455b3345e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:45.818229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cd8be321-5898-4277-ae41-2866ce469e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:45.831785 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:45.888075 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4215/8444] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:45.892945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c71af1-fbc6-48ff-b8d6-2196dc3e907c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:45.965392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c71af1-fbc6-48ff-b8d6-2196dc3e907c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:45.970152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89d9c2-4af9-459b-babb-500753dec057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:45.970757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89d9c2-4af9-459b-babb-500753dec057 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:45.971038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89d9c2-4af9-459b-babb-500753dec057 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:45.971310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89d9c2-4af9-459b-babb-500753dec057 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:45.971946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89d9c2-4af9-459b-babb-500753dec057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:45.973895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89d9c2-4af9-459b-babb-500753dec057 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:46.003266 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4230/8445] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:45 2022] POST /identity/v3/projects => generated 355 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:46.007379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8be321-5898-4277-ae41-2866ce469e95 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:46.018382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8be321-5898-4277-ae41-2866ce469e95 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:46.078769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dab1da-652d-4a71-9f96-5103c901cd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:46.079391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dab1da-652d-4a71-9f96-5103c901cd71 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:46.079688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dab1da-652d-4a71-9f96-5103c901cd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:46.079940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dab1da-652d-4a71-9f96-5103c901cd71 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:46.080803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dab1da-652d-4a71-9f96-5103c901cd71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:46.082820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dab1da-652d-4a71-9f96-5103c901cd71 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:46.105102 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4216/8446] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:46 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:46.109290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89d9c2-4af9-459b-babb-500753dec057 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:46.119560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89d9c2-4af9-459b-babb-500753dec057 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:46.124130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb0e10-8670-4273-a5ca-c9497980247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:46.124717 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb0e10-8670-4273-a5ca-c9497980247c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:46.124994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb0e10-8670-4273-a5ca-c9497980247c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:46.125299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb0e10-8670-4273-a5ca-c9497980247c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:46.125934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb0e10-8670-4273-a5ca-c9497980247c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:46.127509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb0e10-8670-4273-a5ca-c9497980247c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:46.138294 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4231/8447] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:46.142457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dab1da-652d-4a71-9f96-5103c901cd71 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:46.153162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dab1da-652d-4a71-9f96-5103c901cd71 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:46.157832 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68b79a-a7ec-46a7-a311-ae44bbed52dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:46.158486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68b79a-a7ec-46a7-a311-ae44bbed52dc admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:46.158771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68b79a-a7ec-46a7-a311-ae44bbed52dc admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:46.159047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68b79a-a7ec-46a7-a311-ae44bbed52dc admin admin] PATH_INFO: `/v3/projects/77d27b0c108e4353b3e7e1f6970a4eea/users/098b44381811436e850144b3504f27a9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:46.174919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68b79a-a7ec-46a7-a311-ae44bbed52dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d27b0c108e4353b3e7e1f6970a4eea, user_id=098b44381811436e850144b3504f27a9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:46.177599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68b79a-a7ec-46a7-a311-ae44bbed52dc admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:46.191975 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4217/8448] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:46 2022] PUT /identity/v3/projects/77d27b0c108e4353b3e7e1f6970a4eea/users/098b44381811436e850144b3504f27a9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:46.196005 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb0e10-8670-4273-a5ca-c9497980247c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:46.206105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb0e10-8670-4273-a5ca-c9497980247c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:46.264185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d813cb-dc69-4693-bb5e-ab17f0dab5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:46.264805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d813cb-dc69-4693-bb5e-ab17f0dab5bd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:46.265087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d813cb-dc69-4693-bb5e-ab17f0dab5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:46.265416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d813cb-dc69-4693-bb5e-ab17f0dab5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:46.266081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d813cb-dc69-4693-bb5e-ab17f0dab5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:46.267700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d813cb-dc69-4693-bb5e-ab17f0dab5bd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:46.281736 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4232/8449] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:46.283105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68b79a-a7ec-46a7-a311-ae44bbed52dc admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:46.293657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68b79a-a7ec-46a7-a311-ae44bbed52dc admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:46.299257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00778692-ebd9-4925-983b-25911b12dd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:46.299942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00778692-ebd9-4925-983b-25911b12dd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:46.300220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00778692-ebd9-4925-983b-25911b12dd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:46.300494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00778692-ebd9-4925-983b-25911b12dd14 admin admin] PATH_INFO: `/v3/projects/77d27b0c108e4353b3e7e1f6970a4eea/users/098b44381811436e850144b3504f27a9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:46.302789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00778692-ebd9-4925-983b-25911b12dd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d27b0c108e4353b3e7e1f6970a4eea, user_id=098b44381811436e850144b3504f27a9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:46.305498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00778692-ebd9-4925-983b-25911b12dd14 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:46.321503 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4218/8450] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:46 2022] PUT /identity/v3/projects/77d27b0c108e4353b3e7e1f6970a4eea/users/098b44381811436e850144b3504f27a9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:46.327587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bcb74-7849-4a23-bfa7-3b26ae1cdfb7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:46.327877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bcb74-7849-4a23-bfa7-3b26ae1cdfb7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:46.328157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bcb74-7849-4a23-bfa7-3b26ae1cdfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:46.357381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fa8bcb74-7849-4a23-bfa7-3b26ae1cdfb7 None None] MFA Rules not processed for user `098b44381811436e850144b3504f27a9`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:46.358514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fa8bcb74-7849-4a23-bfa7-3b26ae1cdfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:46.409076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:46.433574 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4233/8451] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:46.438855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00778692-ebd9-4925-983b-25911b12dd14 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:46.450133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00778692-ebd9-4925-983b-25911b12dd14 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:46.454875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33acf13-8c4a-4c0b-a6c7-1e401e0154ab tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '098b44381811436e850144b3504f27a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77d27b0c108e4353b3e7e1f6970a4eea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:46.455555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33acf13-8c4a-4c0b-a6c7-1e401e0154ab tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:46.455907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33acf13-8c4a-4c0b-a6c7-1e401e0154ab tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:46.456261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33acf13-8c4a-4c0b-a6c7-1e401e0154ab tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:46.457016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33acf13-8c4a-4c0b-a6c7-1e401e0154ab tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:26:46.457494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33acf13-8c4a-4c0b-a6c7-1e401e0154ab tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:46.459153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33acf13-8c4a-4c0b-a6c7-1e401e0154ab tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:46.477659 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4219/8452] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:26:46.478861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bcb74-7849-4a23-bfa7-3b26ae1cdfb7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:46.488521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bcb74-7849-4a23-bfa7-3b26ae1cdfb7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:46.495142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91e048-14be-45a5-aeb5-615d1862bac9 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '098b44381811436e850144b3504f27a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77d27b0c108e4353b3e7e1f6970a4eea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:46.495762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91e048-14be-45a5-aeb5-615d1862bac9 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:46.496040 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91e048-14be-45a5-aeb5-615d1862bac9 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:46.496314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91e048-14be-45a5-aeb5-615d1862bac9 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:46.496956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91e048-14be-45a5-aeb5-615d1862bac9 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:46.498894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91e048-14be-45a5-aeb5-615d1862bac9 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:46.527227 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4234/8453] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:46 2022] POST /identity/v3/projects => generated 350 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:26:46.531215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33acf13-8c4a-4c0b-a6c7-1e401e0154ab tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:46.541823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33acf13-8c4a-4c0b-a6c7-1e401e0154ab tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:46.597491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:46.606378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eda26-9fa8-4b2c-9485-d528b485ccb2 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '098b44381811436e850144b3504f27a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77d27b0c108e4353b3e7e1f6970a4eea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:46.607244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eda26-9fa8-4b2c-9485-d528b485ccb2 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:46.607576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eda26-9fa8-4b2c-9485-d528b485ccb2 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:46.607806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eda26-9fa8-4b2c-9485-d528b485ccb2 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:46.608441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7eda26-9fa8-4b2c-9485-d528b485ccb2 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:26:46.608738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7eda26-9fa8-4b2c-9485-d528b485ccb2 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:46.610615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7eda26-9fa8-4b2c-9485-d528b485ccb2 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:46.623393 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4220/8454] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:26:46.633079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91e048-14be-45a5-aeb5-615d1862bac9 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:46.634944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2d91e048-14be-45a5-aeb5-615d1862bac9 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:46.700764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91e048-14be-45a5-aeb5-615d1862bac9 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:46.704389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb2f9f-dd3f-485a-9511-6df124fc7827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:46.704995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb2f9f-dd3f-485a-9511-6df124fc7827 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:46.705318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb2f9f-dd3f-485a-9511-6df124fc7827 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:46.705578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb2f9f-dd3f-485a-9511-6df124fc7827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:46.715368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb2f9f-dd3f-485a-9511-6df124fc7827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:46.716823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb2f9f-dd3f-485a-9511-6df124fc7827 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:46.726580 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4235/8455] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:46.855990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eda26-9fa8-4b2c-9485-d528b485ccb2 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:46.868987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eda26-9fa8-4b2c-9485-d528b485ccb2 tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:46.873994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '098b44381811436e850144b3504f27a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77d27b0c108e4353b3e7e1f6970a4eea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:46.874642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:46.874919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:46.875194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] PATH_INFO: `/v3/projects/8ee44224afe540c98ff4f6a76cf3ff99` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:46.876336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8ee44224afe540c98ff4f6a76cf3ff99)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:46.878296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:46.930166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee44224afe540c98ff4f6a76cf3ff99', 'request_id': 'req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:46.938571 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee44224afe540c98ff4f6a76cf3ff99', 'request_id': 'req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:46.945062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee44224afe540c98ff4f6a76cf3ff99', 'request_id': 'req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:46.957531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] The token cache is being invalidate because project 8ee44224afe540c98ff4f6a76cf3ff99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:46.957926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:46.958562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ef9f3220-9dd9-48a1-a0e9-66874ddf609d tempest-QuotasTest-371849991 tempest-QuotasTest-371849991-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:46.960305 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4221/8456] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:46 2022] DELETE /identity/v3/projects/8ee44224afe540c98ff4f6a76cf3ff99 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:47.054754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb2f9f-dd3f-485a-9511-6df124fc7827 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:47.124498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb2f9f-dd3f-485a-9511-6df124fc7827 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:47.184677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854d102-0907-4043-b968-a09857140912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:47.185343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854d102-0907-4043-b968-a09857140912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:47.185626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854d102-0907-4043-b968-a09857140912 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:47.185900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854d102-0907-4043-b968-a09857140912 admin admin] PATH_INFO: `/v3/users/cdeb2e71bab34ae08243d455b3345e3d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:47.187023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854d102-0907-4043-b968-a09857140912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdeb2e71bab34ae08243d455b3345e3d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:47.188967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854d102-0907-4043-b968-a09857140912 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:47.203783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:47.241654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d854d102-0907-4043-b968-a09857140912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdeb2e71bab34ae08243d455b3345e3d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:47.248739 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d854d102-0907-4043-b968-a09857140912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdeb2e71bab34ae08243d455b3345e3d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:47.249465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d854d102-0907-4043-b968-a09857140912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdeb2e71bab34ae08243d455b3345e3d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:47.250097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d854d102-0907-4043-b968-a09857140912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdeb2e71bab34ae08243d455b3345e3d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:47.264174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d854d102-0907-4043-b968-a09857140912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdeb2e71bab34ae08243d455b3345e3d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:47.280264 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4236/8457] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:47 2022] DELETE /identity/v3/users/cdeb2e71bab34ae08243d455b3345e3d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:47.285315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8bda8-85e8-4759-9dab-f302c9246807 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:47.285603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8bda8-85e8-4759-9dab-f302c9246807 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:47.285925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8bda8-85e8-4759-9dab-f302c9246807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:47.305241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-afd8bda8-85e8-4759-9dab-f302c9246807 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:47.306776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-afd8bda8-85e8-4759-9dab-f302c9246807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:47.370679 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4222/8458] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:47.380636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854d102-0907-4043-b968-a09857140912 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:47.382261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d854d102-0907-4043-b968-a09857140912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:47.442691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854d102-0907-4043-b968-a09857140912 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:47.447044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b31fa7-b740-46ac-ab61-07e257ecaa12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:47.447721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b31fa7-b740-46ac-ab61-07e257ecaa12 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:47.448001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b31fa7-b740-46ac-ab61-07e257ecaa12 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:47.448270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b31fa7-b740-46ac-ab61-07e257ecaa12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:47.458232 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b31fa7-b740-46ac-ab61-07e257ecaa12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:47.459696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b31fa7-b740-46ac-ab61-07e257ecaa12 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:47.471832 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4237/8459] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:47.929408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8bda8-85e8-4759-9dab-f302c9246807 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:47.933484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-afd8bda8-85e8-4759-9dab-f302c9246807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:47.970155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8bda8-85e8-4759-9dab-f302c9246807 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:47.977625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:47.978616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:47.979177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:47.979600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] PATH_INFO: `/v3/projects/d7057197c9d9466490984c60fc613708` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:47.981161 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7057197c9d9466490984c60fc613708)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:47.985130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:48.041491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7057197c9d9466490984c60fc613708', 'request_id': 'req-63ddca0c-278f-4386-a273-abc36eb0e043'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.051342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7057197c9d9466490984c60fc613708', 'request_id': 'req-63ddca0c-278f-4386-a273-abc36eb0e043'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.059406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7057197c9d9466490984c60fc613708', 'request_id': 'req-63ddca0c-278f-4386-a273-abc36eb0e043'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.061464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:48.076165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] The token cache is being invalidate because project d7057197c9d9466490984c60fc613708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:48.076549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.077969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.079790 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4223/8460] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:47 2022] DELETE /identity/v3/projects/d7057197c9d9466490984c60fc613708 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:48.083789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b31fa7-b740-46ac-ab61-07e257ecaa12 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:48.094646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b31fa7-b740-46ac-ab61-07e257ecaa12 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:48.159124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8166e2-1b04-48fd-8f17-113ae3a0da9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:48.160001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8166e2-1b04-48fd-8f17-113ae3a0da9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:48.160356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8166e2-1b04-48fd-8f17-113ae3a0da9f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:48.160702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8166e2-1b04-48fd-8f17-113ae3a0da9f admin admin] PATH_INFO: `/v3/users/098b44381811436e850144b3504f27a9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:48.161945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8166e2-1b04-48fd-8f17-113ae3a0da9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=098b44381811436e850144b3504f27a9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:48.164011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8166e2-1b04-48fd-8f17-113ae3a0da9f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:48.224785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:48.236703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0b8166e2-1b04-48fd-8f17-113ae3a0da9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098b44381811436e850144b3504f27a9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.249300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0b8166e2-1b04-48fd-8f17-113ae3a0da9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098b44381811436e850144b3504f27a9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.262798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0b8166e2-1b04-48fd-8f17-113ae3a0da9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098b44381811436e850144b3504f27a9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.264933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0b8166e2-1b04-48fd-8f17-113ae3a0da9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098b44381811436e850144b3504f27a9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.300050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0b8166e2-1b04-48fd-8f17-113ae3a0da9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098b44381811436e850144b3504f27a9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.322690 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4238/8461] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:48 2022] DELETE /identity/v3/users/098b44381811436e850144b3504f27a9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:48.640612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:48.642883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:48.659432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddca0c-278f-4386-a273-abc36eb0e043 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:48.723296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cea7b-17a3-4753-aa36-8ce5235696f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:48.723945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cea7b-17a3-4753-aa36-8ce5235696f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:48.724229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cea7b-17a3-4753-aa36-8ce5235696f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:48.724503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cea7b-17a3-4753-aa36-8ce5235696f6 admin admin] PATH_INFO: `/v3/projects/77d27b0c108e4353b3e7e1f6970a4eea` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:48.725705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cea7b-17a3-4753-aa36-8ce5235696f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d27b0c108e4353b3e7e1f6970a4eea)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:48.727642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cea7b-17a3-4753-aa36-8ce5235696f6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:48.778012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d87cea7b-17a3-4753-aa36-8ce5235696f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d27b0c108e4353b3e7e1f6970a4eea', 'request_id': 'req-d87cea7b-17a3-4753-aa36-8ce5235696f6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.785849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d87cea7b-17a3-4753-aa36-8ce5235696f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d27b0c108e4353b3e7e1f6970a4eea', 'request_id': 'req-d87cea7b-17a3-4753-aa36-8ce5235696f6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.792163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d87cea7b-17a3-4753-aa36-8ce5235696f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d27b0c108e4353b3e7e1f6970a4eea', 'request_id': 'req-d87cea7b-17a3-4753-aa36-8ce5235696f6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.804317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d87cea7b-17a3-4753-aa36-8ce5235696f6 admin admin] The token cache is being invalidate because project 77d27b0c108e4353b3e7e1f6970a4eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:48.804611 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d87cea7b-17a3-4753-aa36-8ce5235696f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.805462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d87cea7b-17a3-4753-aa36-8ce5235696f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:48.806961 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4224/8462] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:48 2022] DELETE /identity/v3/projects/77d27b0c108e4353b3e7e1f6970a4eea => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:48.812988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75345454-f359-442a-b409-3a0fafce3c22 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:48.813377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75345454-f359-442a-b409-3a0fafce3c22 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:48.813727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75345454-f359-442a-b409-3a0fafce3c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:48.833850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-75345454-f359-442a-b409-3a0fafce3c22 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:48.835045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-75345454-f359-442a-b409-3a0fafce3c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:48.894441 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4239/8463] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:48.902521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1921c1-479c-4df8-bd44-666ee2ab4aac None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:48.902801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1921c1-479c-4df8-bd44-666ee2ab4aac None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:48.903074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1921c1-479c-4df8-bd44-666ee2ab4aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:48.922823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2f1921c1-479c-4df8-bd44-666ee2ab4aac None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:48.924022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2f1921c1-479c-4df8-bd44-666ee2ab4aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:48.932442 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4225/8464] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:48.936644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75345454-f359-442a-b409-3a0fafce3c22 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:48.946879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75345454-f359-442a-b409-3a0fafce3c22 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:48.951473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f474af-ddeb-4cec-814c-fceb077d7236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:48.952068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f474af-ddeb-4cec-814c-fceb077d7236 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:48.952345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f474af-ddeb-4cec-814c-fceb077d7236 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:48.952617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f474af-ddeb-4cec-814c-fceb077d7236 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:48.953297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f474af-ddeb-4cec-814c-fceb077d7236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:26:48.953599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f474af-ddeb-4cec-814c-fceb077d7236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:48.955186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f474af-ddeb-4cec-814c-fceb077d7236 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:48.966958 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4240/8465] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:48.977751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1921c1-479c-4df8-bd44-666ee2ab4aac None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:48.981895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1921c1-479c-4df8-bd44-666ee2ab4aac None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:48.986577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f16aa-e3f6-4057-a6ba-6c03a0672e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:48.987181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f16aa-e3f6-4057-a6ba-6c03a0672e0a admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:48.987488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f16aa-e3f6-4057-a6ba-6c03a0672e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:48.987760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f16aa-e3f6-4057-a6ba-6c03a0672e0a admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:48.988384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f16aa-e3f6-4057-a6ba-6c03a0672e0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:48.990359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f16aa-e3f6-4057-a6ba-6c03a0672e0a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:49.017875 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4226/8466] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:48 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:49.022058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f474af-ddeb-4cec-814c-fceb077d7236 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:49.032103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f474af-ddeb-4cec-814c-fceb077d7236 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:49.087753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322dfd1-c87a-4edc-8cbc-c07d7acd301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:49.088417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322dfd1-c87a-4edc-8cbc-c07d7acd301e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:49.088638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322dfd1-c87a-4edc-8cbc-c07d7acd301e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:49.088934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322dfd1-c87a-4edc-8cbc-c07d7acd301e admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:49.089653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322dfd1-c87a-4edc-8cbc-c07d7acd301e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:49.091533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322dfd1-c87a-4edc-8cbc-c07d7acd301e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:49.113836 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4241/8467] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:49 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:49.118299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f16aa-e3f6-4057-a6ba-6c03a0672e0a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:49.128596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f16aa-e3f6-4057-a6ba-6c03a0672e0a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:49.133263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1751bf-caef-48b9-b9dd-530353555bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:49.134511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1751bf-caef-48b9-b9dd-530353555bda admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:49.134796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1751bf-caef-48b9-b9dd-530353555bda admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:49.135065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1751bf-caef-48b9-b9dd-530353555bda admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:49.135706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1751bf-caef-48b9-b9dd-530353555bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:49.137318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1751bf-caef-48b9-b9dd-530353555bda admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:49.147779 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4227/8468] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:49.152064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322dfd1-c87a-4edc-8cbc-c07d7acd301e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:49.162479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322dfd1-c87a-4edc-8cbc-c07d7acd301e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:49.167227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34a810-24d2-4a61-8c96-efd8859b8b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:49.167818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34a810-24d2-4a61-8c96-efd8859b8b4f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:49.168094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34a810-24d2-4a61-8c96-efd8859b8b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:49.168362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34a810-24d2-4a61-8c96-efd8859b8b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:49.168993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34a810-24d2-4a61-8c96-efd8859b8b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:49.170599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34a810-24d2-4a61-8c96-efd8859b8b4f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:49.181683 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4242/8469] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:49.185813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1751bf-caef-48b9-b9dd-530353555bda admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:49.195854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1751bf-caef-48b9-b9dd-530353555bda admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:49.201227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a28a7-d9ca-4768-884c-6e5a49c01820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:49.201863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a28a7-d9ca-4768-884c-6e5a49c01820 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:49.202165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a28a7-d9ca-4768-884c-6e5a49c01820 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:49.202445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a28a7-d9ca-4768-884c-6e5a49c01820 admin admin] PATH_INFO: `/v3/projects/2aefd22b6a114298ae6275ef26c449f4/users/3fc7d7a035c241efb8e07289ba45839b/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:49.216931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a28a7-d9ca-4768-884c-6e5a49c01820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aefd22b6a114298ae6275ef26c449f4, user_id=3fc7d7a035c241efb8e07289ba45839b, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:49.219596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a28a7-d9ca-4768-884c-6e5a49c01820 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:49.233011 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4228/8470] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:49 2022] PUT /identity/v3/projects/2aefd22b6a114298ae6275ef26c449f4/users/3fc7d7a035c241efb8e07289ba45839b/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:26:49.246147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102764e-e810-4d50-b89b-03f09f7e1bf3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:49.246431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102764e-e810-4d50-b89b-03f09f7e1bf3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:49.246712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102764e-e810-4d50-b89b-03f09f7e1bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:49.273906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4102764e-e810-4d50-b89b-03f09f7e1bf3 None None] MFA Rules not processed for user `3fc7d7a035c241efb8e07289ba45839b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:49.275026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4102764e-e810-4d50-b89b-03f09f7e1bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:49.283177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:49.343232 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4243/8471] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:49.354473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a28a7-d9ca-4768-884c-6e5a49c01820 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:49.357279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f59a28a7-d9ca-4768-884c-6e5a49c01820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:49.387876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:49.423002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a28a7-d9ca-4768-884c-6e5a49c01820 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:49.426701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767fa50-7acc-4062-b923-89a3a8c545ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:49.427303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767fa50-7acc-4062-b923-89a3a8c545ea service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:49.427586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767fa50-7acc-4062-b923-89a3a8c545ea service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:49.427859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767fa50-7acc-4062-b923-89a3a8c545ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:49.436922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767fa50-7acc-4062-b923-89a3a8c545ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:49.438381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767fa50-7acc-4062-b923-89a3a8c545ea service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:49.447180 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4229/8472] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:26:58.821755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102764e-e810-4d50-b89b-03f09f7e1bf3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:58.886608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102764e-e810-4d50-b89b-03f09f7e1bf3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:58.891193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:58.891832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:58.892208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:58.892374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] PATH_INFO: `/v3/users/3fc7d7a035c241efb8e07289ba45839b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:58.893544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc7d7a035c241efb8e07289ba45839b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:58.895456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:58.945433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc7d7a035c241efb8e07289ba45839b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:58.953529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc7d7a035c241efb8e07289ba45839b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:58.954311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc7d7a035c241efb8e07289ba45839b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:58.954919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc7d7a035c241efb8e07289ba45839b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:58.966812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc7d7a035c241efb8e07289ba45839b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:58.980695 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4244/8473] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:26:58 2022] DELETE /identity/v3/users/3fc7d7a035c241efb8e07289ba45839b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:58.985504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b67ecd-317d-4a06-8eee-4ffadec299f9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:58.985988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b67ecd-317d-4a06-8eee-4ffadec299f9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:58.986183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b67ecd-317d-4a06-8eee-4ffadec299f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:59.007276 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a8b67ecd-317d-4a06-8eee-4ffadec299f9 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:59.008624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a8b67ecd-317d-4a06-8eee-4ffadec299f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:59.077281 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4230/8474] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:26:59.087091 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:59.088583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:59.124473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:59.159061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26316e-da26-4b01-8cc1-fb2f2c4333f3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:59.162750 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7175d95-3e48-40cf-8109-670ae055e367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:59.163366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7175d95-3e48-40cf-8109-670ae055e367 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:59.163647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7175d95-3e48-40cf-8109-670ae055e367 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:59.163916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7175d95-3e48-40cf-8109-670ae055e367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:59.176277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7175d95-3e48-40cf-8109-670ae055e367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:59.177850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7175d95-3e48-40cf-8109-670ae055e367 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:59.189363 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4245/8475] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:26:59.363581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b67ecd-317d-4a06-8eee-4ffadec299f9 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:59.365011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a8b67ecd-317d-4a06-8eee-4ffadec299f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:59.378247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b67ecd-317d-4a06-8eee-4ffadec299f9 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:59.382993 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98d292-a1a7-421c-9781-653742d02e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:59.384381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98d292-a1a7-421c-9781-653742d02e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:59.384724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98d292-a1a7-421c-9781-653742d02e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:59.385005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98d292-a1a7-421c-9781-653742d02e52 admin admin] PATH_INFO: `/v3/projects/2aefd22b6a114298ae6275ef26c449f4` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:59.386256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98d292-a1a7-421c-9781-653742d02e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aefd22b6a114298ae6275ef26c449f4)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:59.388135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98d292-a1a7-421c-9781-653742d02e52 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:59.434271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d98d292-a1a7-421c-9781-653742d02e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aefd22b6a114298ae6275ef26c449f4', 'request_id': 'req-9d98d292-a1a7-421c-9781-653742d02e52'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:59.441297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d98d292-a1a7-421c-9781-653742d02e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aefd22b6a114298ae6275ef26c449f4', 'request_id': 'req-9d98d292-a1a7-421c-9781-653742d02e52'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:59.447383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d98d292-a1a7-421c-9781-653742d02e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aefd22b6a114298ae6275ef26c449f4', 'request_id': 'req-9d98d292-a1a7-421c-9781-653742d02e52'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:59.458130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d98d292-a1a7-421c-9781-653742d02e52 admin admin] The token cache is being invalidate because project 2aefd22b6a114298ae6275ef26c449f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:26:59.458424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d98d292-a1a7-421c-9781-653742d02e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:59.459056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9d98d292-a1a7-421c-9781-653742d02e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:26:59.460559 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4231/8476] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:26:59 2022] DELETE /identity/v3/projects/2aefd22b6a114298ae6275ef26c449f4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:59.465387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557440df-06ea-4135-9bca-2b44d5d5d06f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:59.465675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557440df-06ea-4135-9bca-2b44d5d5d06f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:59.465953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557440df-06ea-4135-9bca-2b44d5d5d06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:59.486444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-557440df-06ea-4135-9bca-2b44d5d5d06f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:59.487675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-557440df-06ea-4135-9bca-2b44d5d5d06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:59.546288 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4246/8477] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:26:59.554008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c254a-6219-4731-b8b9-5e0dbb2a65ce None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:59.554297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c254a-6219-4731-b8b9-5e0dbb2a65ce None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:59.554572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c254a-6219-4731-b8b9-5e0dbb2a65ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:59.574959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-340c254a-6219-4731-b8b9-5e0dbb2a65ce None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:59.576157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-340c254a-6219-4731-b8b9-5e0dbb2a65ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:59.583995 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4232/8478] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:26:59.588028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557440df-06ea-4135-9bca-2b44d5d5d06f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:59.597712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557440df-06ea-4135-9bca-2b44d5d5d06f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:59.602178 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91b9bb-7bef-4c6a-b446-f464e28a3e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:59.602768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91b9bb-7bef-4c6a-b446-f464e28a3e1c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:59.603071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91b9bb-7bef-4c6a-b446-f464e28a3e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:59.603342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91b9bb-7bef-4c6a-b446-f464e28a3e1c admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:59.603976 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91b9bb-7bef-4c6a-b446-f464e28a3e1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:26:59.604274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91b9bb-7bef-4c6a-b446-f464e28a3e1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:59.605885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91b9bb-7bef-4c6a-b446-f464e28a3e1c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:59.618132 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4247/8479] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:26:59.622337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c254a-6219-4731-b8b9-5e0dbb2a65ce None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:59.631462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c254a-6219-4731-b8b9-5e0dbb2a65ce None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:59.637073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16563a86-9ba4-4e46-96f0-09f945c3b52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:59.637691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16563a86-9ba4-4e46-96f0-09f945c3b52e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:59.637966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16563a86-9ba4-4e46-96f0-09f945c3b52e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:59.638232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16563a86-9ba4-4e46-96f0-09f945c3b52e admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:59.638891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16563a86-9ba4-4e46-96f0-09f945c3b52e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:59.640750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16563a86-9ba4-4e46-96f0-09f945c3b52e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:59.670515 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4233/8480] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:26:59 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:26:59.673586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91b9bb-7bef-4c6a-b446-f464e28a3e1c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:59.684391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91b9bb-7bef-4c6a-b446-f464e28a3e1c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:59.739472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0b70c-21b7-459e-ad39-7711e40c563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:59.740064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0b70c-21b7-459e-ad39-7711e40c563f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:59.740341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0b70c-21b7-459e-ad39-7711e40c563f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:59.740611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0b70c-21b7-459e-ad39-7711e40c563f admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:59.741263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0b70c-21b7-459e-ad39-7711e40c563f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:59.743716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0b70c-21b7-459e-ad39-7711e40c563f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:59.765764 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4248/8481] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:26:59 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:26:59.769934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16563a86-9ba4-4e46-96f0-09f945c3b52e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:59.780809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16563a86-9ba4-4e46-96f0-09f945c3b52e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:59.785395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3152e-fb02-4b4a-b2ad-d454c98fae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:59.785990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3152e-fb02-4b4a-b2ad-d454c98fae3e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:59.786271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3152e-fb02-4b4a-b2ad-d454c98fae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:59.786547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3152e-fb02-4b4a-b2ad-d454c98fae3e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:59.787181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3152e-fb02-4b4a-b2ad-d454c98fae3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:59.788765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3152e-fb02-4b4a-b2ad-d454c98fae3e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:59.799247 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4234/8482] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:59.803166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0b70c-21b7-459e-ad39-7711e40c563f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:59.813552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0b70c-21b7-459e-ad39-7711e40c563f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:59.818042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd24114-1ea7-448d-8e5c-68f2f165a3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:59.818619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd24114-1ea7-448d-8e5c-68f2f165a3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:59.818898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd24114-1ea7-448d-8e5c-68f2f165a3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:59.819172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd24114-1ea7-448d-8e5c-68f2f165a3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:59.819801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd24114-1ea7-448d-8e5c-68f2f165a3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:59.821421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd24114-1ea7-448d-8e5c-68f2f165a3e6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:59.832084 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4249/8483] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:26:59.836206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3152e-fb02-4b4a-b2ad-d454c98fae3e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:26:59.846049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3152e-fb02-4b4a-b2ad-d454c98fae3e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:26:59.850622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041e0f2-f966-423d-b796-1212ac505fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:26:59.851261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041e0f2-f966-423d-b796-1212ac505fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:59.851538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041e0f2-f966-423d-b796-1212ac505fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:59.851813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041e0f2-f966-423d-b796-1212ac505fbe admin admin] PATH_INFO: `/v3/projects/69d193f5693048f0b7c6ba48f9202c91/users/411f4d035b3548a38b6eeedfe98595a1/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:59.855329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:59.869362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041e0f2-f966-423d-b796-1212ac505fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d193f5693048f0b7c6ba48f9202c91, user_id=411f4d035b3548a38b6eeedfe98595a1, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:26:59.872089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041e0f2-f966-423d-b796-1212ac505fbe admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:26:59.884465 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4235/8484] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:26:59 2022] PUT /identity/v3/projects/69d193f5693048f0b7c6ba48f9202c91/users/411f4d035b3548a38b6eeedfe98595a1/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:26:59.894782 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c826d-4b47-4671-aba7-19b956f69ff8 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:26:59.895064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c826d-4b47-4671-aba7-19b956f69ff8 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:26:59.895328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c826d-4b47-4671-aba7-19b956f69ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:26:59.922809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-569c826d-4b47-4671-aba7-19b956f69ff8 None None] MFA Rules not processed for user `411f4d035b3548a38b6eeedfe98595a1`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:26:59.924272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-569c826d-4b47-4671-aba7-19b956f69ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:26:59.950233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:59.990654 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4250/8485] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:00.002690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041e0f2-f966-423d-b796-1212ac505fbe admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:00.004410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9041e0f2-f966-423d-b796-1212ac505fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:00.063195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041e0f2-f966-423d-b796-1212ac505fbe admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:00.066915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9f68e-1bd2-4e40-bacb-fa5512e7054b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:00.067514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9f68e-1bd2-4e40-bacb-fa5512e7054b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:00.067798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9f68e-1bd2-4e40-bacb-fa5512e7054b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:00.068075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9f68e-1bd2-4e40-bacb-fa5512e7054b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:00.076397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9f68e-1bd2-4e40-bacb-fa5512e7054b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:00.077858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9f68e-1bd2-4e40-bacb-fa5512e7054b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:00.086635 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4236/8486] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:00.102532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c826d-4b47-4671-aba7-19b956f69ff8 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:00.164506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c826d-4b47-4671-aba7-19b956f69ff8 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:00.169536 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:00.170154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:00.170458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:00.170751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] PATH_INFO: `/v3/users/411f4d035b3548a38b6eeedfe98595a1` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:00.171872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=411f4d035b3548a38b6eeedfe98595a1)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:00.173825 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:00.218313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411f4d035b3548a38b6eeedfe98595a1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:00.225067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411f4d035b3548a38b6eeedfe98595a1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:00.225759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411f4d035b3548a38b6eeedfe98595a1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:00.226416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411f4d035b3548a38b6eeedfe98595a1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:00.239108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411f4d035b3548a38b6eeedfe98595a1'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:00.252043 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4251/8487] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:27:00 2022] DELETE /identity/v3/users/411f4d035b3548a38b6eeedfe98595a1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:00.256530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b660c8f-0cd5-47a0-a8d2-2b5b4ca7f21f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:00.256817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b660c8f-0cd5-47a0-a8d2-2b5b4ca7f21f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:00.257116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b660c8f-0cd5-47a0-a8d2-2b5b4ca7f21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:00.276641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8b660c8f-0cd5-47a0-a8d2-2b5b4ca7f21f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:00.277870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8b660c8f-0cd5-47a0-a8d2-2b5b4ca7f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:00.335631 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4237/8488] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:00.350234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:00.351648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:00.404250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:00.413474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29e77e-d8d2-4821-9e74-329882e22180 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:00.417944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f468e0-ab91-434b-b800-dea020fc2df0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:00.418522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f468e0-ab91-434b-b800-dea020fc2df0 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:00.418802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f468e0-ab91-434b-b800-dea020fc2df0 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:00.419077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f468e0-ab91-434b-b800-dea020fc2df0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:00.428242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f468e0-ab91-434b-b800-dea020fc2df0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:00.429776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f468e0-ab91-434b-b800-dea020fc2df0 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:00.439198 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4252/8489] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:27:00.707168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b660c8f-0cd5-47a0-a8d2-2b5b4ca7f21f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:00.708625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8b660c8f-0cd5-47a0-a8d2-2b5b4ca7f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:00.723215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b660c8f-0cd5-47a0-a8d2-2b5b4ca7f21f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:00.727802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc75ac-1ec9-4141-b822-e209a6929fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:00.728438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc75ac-1ec9-4141-b822-e209a6929fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:00.728720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc75ac-1ec9-4141-b822-e209a6929fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:00.728997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc75ac-1ec9-4141-b822-e209a6929fb5 admin admin] PATH_INFO: `/v3/projects/69d193f5693048f0b7c6ba48f9202c91` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:00.730228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc75ac-1ec9-4141-b822-e209a6929fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d193f5693048f0b7c6ba48f9202c91)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:00.732367 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc75ac-1ec9-4141-b822-e209a6929fb5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:00.779623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19bc75ac-1ec9-4141-b822-e209a6929fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d193f5693048f0b7c6ba48f9202c91', 'request_id': 'req-19bc75ac-1ec9-4141-b822-e209a6929fb5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:00.786900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19bc75ac-1ec9-4141-b822-e209a6929fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d193f5693048f0b7c6ba48f9202c91', 'request_id': 'req-19bc75ac-1ec9-4141-b822-e209a6929fb5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:00.792851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19bc75ac-1ec9-4141-b822-e209a6929fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d193f5693048f0b7c6ba48f9202c91', 'request_id': 'req-19bc75ac-1ec9-4141-b822-e209a6929fb5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:00.803962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19bc75ac-1ec9-4141-b822-e209a6929fb5 admin admin] The token cache is being invalidate because project 69d193f5693048f0b7c6ba48f9202c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:27:00.804249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19bc75ac-1ec9-4141-b822-e209a6929fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:00.804887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19bc75ac-1ec9-4141-b822-e209a6929fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:00.806414 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4238/8490] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:27:00 2022] DELETE /identity/v3/projects/69d193f5693048f0b7c6ba48f9202c91 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:00.811581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ab40-1e0b-4fdc-a5f1-3b55047123b1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:00.811868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ab40-1e0b-4fdc-a5f1-3b55047123b1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:00.812140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ab40-1e0b-4fdc-a5f1-3b55047123b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:00.831984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2265ab40-1e0b-4fdc-a5f1-3b55047123b1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:00.833481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2265ab40-1e0b-4fdc-a5f1-3b55047123b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:00.894053 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4253/8491] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:00.902846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd078e2-e079-4dde-8630-32fc846769c3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:00.903134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd078e2-e079-4dde-8630-32fc846769c3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:00.903412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd078e2-e079-4dde-8630-32fc846769c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:00.922778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-fdd078e2-e079-4dde-8630-32fc846769c3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:00.924001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fdd078e2-e079-4dde-8630-32fc846769c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:00.932481 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4239/8492] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:00.936528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265ab40-1e0b-4fdc-a5f1-3b55047123b1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:00.947395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265ab40-1e0b-4fdc-a5f1-3b55047123b1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:00.951954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7963743-eb84-48fa-bb33-c2ba1183f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:00.952540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963743-eb84-48fa-bb33-c2ba1183f9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:00.952818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963743-eb84-48fa-bb33-c2ba1183f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:00.953085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963743-eb84-48fa-bb33-c2ba1183f9e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:00.953754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7963743-eb84-48fa-bb33-c2ba1183f9e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:27:00.954053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7963743-eb84-48fa-bb33-c2ba1183f9e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:00.955609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7963743-eb84-48fa-bb33-c2ba1183f9e3 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:00.967090 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4254/8493] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:27:00.971171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd078e2-e079-4dde-8630-32fc846769c3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:00.976755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:00.980637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd078e2-e079-4dde-8630-32fc846769c3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:00.987009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c06f-907d-432c-ab36-e1cac94af876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:00.987800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c06f-907d-432c-ab36-e1cac94af876 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:00.988250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c06f-907d-432c-ab36-e1cac94af876 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:00.988620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c06f-907d-432c-ab36-e1cac94af876 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:00.989466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719c06f-907d-432c-ab36-e1cac94af876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:00.991425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719c06f-907d-432c-ab36-e1cac94af876 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:01.021520 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4240/8494] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:27:00 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:27:01.023339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7963743-eb84-48fa-bb33-c2ba1183f9e3 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:01.033679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7963743-eb84-48fa-bb33-c2ba1183f9e3 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:01.089539 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0eb41-3fd5-496e-891c-58d044824901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:01.090135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0eb41-3fd5-496e-891c-58d044824901 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:01.090412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0eb41-3fd5-496e-891c-58d044824901 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:01.090683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0eb41-3fd5-496e-891c-58d044824901 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:01.091306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0eb41-3fd5-496e-891c-58d044824901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:01.093273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0eb41-3fd5-496e-891c-58d044824901 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:01.114676 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4255/8495] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:27:01 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:27:01.119617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c06f-907d-432c-ab36-e1cac94af876 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:01.130069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c06f-907d-432c-ab36-e1cac94af876 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:01.135228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537b066-18dc-4979-8d90-e5170b221409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:01.135817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537b066-18dc-4979-8d90-e5170b221409 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:01.136093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537b066-18dc-4979-8d90-e5170b221409 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:01.136364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537b066-18dc-4979-8d90-e5170b221409 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:01.137035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537b066-18dc-4979-8d90-e5170b221409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:01.138644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537b066-18dc-4979-8d90-e5170b221409 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:01.148291 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4241/8496] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:27:01.152146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0eb41-3fd5-496e-891c-58d044824901 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:01.162160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0eb41-3fd5-496e-891c-58d044824901 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:01.166747 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c1f86-bd0b-4ae5-8600-6a120ae3ba50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:01.167363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c1f86-bd0b-4ae5-8600-6a120ae3ba50 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:01.167641 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c1f86-bd0b-4ae5-8600-6a120ae3ba50 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:01.167915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c1f86-bd0b-4ae5-8600-6a120ae3ba50 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:01.168556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c1f86-bd0b-4ae5-8600-6a120ae3ba50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:01.170162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c1f86-bd0b-4ae5-8600-6a120ae3ba50 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:01.183842 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4256/8497] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:27:01.187916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537b066-18dc-4979-8d90-e5170b221409 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:01.198802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537b066-18dc-4979-8d90-e5170b221409 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:01.203420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea9e7a-4c84-4370-a5f7-7b15ef7bf539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:01.204010 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea9e7a-4c84-4370-a5f7-7b15ef7bf539 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:01.204287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea9e7a-4c84-4370-a5f7-7b15ef7bf539 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:01.204723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea9e7a-4c84-4370-a5f7-7b15ef7bf539 admin admin] PATH_INFO: `/v3/projects/8ce6a03becf64369b720e9632090585b/users/3aed311205e54109b833b41808bd747f/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:01.220159 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea9e7a-4c84-4370-a5f7-7b15ef7bf539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce6a03becf64369b720e9632090585b, user_id=3aed311205e54109b833b41808bd747f, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:01.222815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea9e7a-4c84-4370-a5f7-7b15ef7bf539 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:01.236543 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4242/8498] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:27:01 2022] PUT /identity/v3/projects/8ce6a03becf64369b720e9632090585b/users/3aed311205e54109b833b41808bd747f/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:01.247311 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a46007-3ea8-4216-818f-c46f3fed8e54 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:01.247589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a46007-3ea8-4216-818f-c46f3fed8e54 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:01.247885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a46007-3ea8-4216-818f-c46f3fed8e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:01.275947 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a0a46007-3ea8-4216-818f-c46f3fed8e54 None None] MFA Rules not processed for user `3aed311205e54109b833b41808bd747f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:01.277160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a0a46007-3ea8-4216-818f-c46f3fed8e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:01.320818 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:01.342212 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4257/8499] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:01.346693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea9e7a-4c84-4370-a5f7-7b15ef7bf539 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:01.408005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea9e7a-4c84-4370-a5f7-7b15ef7bf539 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:01.412651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4badb-b59c-48e8-a756-895b92983661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:01.413314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4badb-b59c-48e8-a756-895b92983661 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:01.413597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4badb-b59c-48e8-a756-895b92983661 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:01.413870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4badb-b59c-48e8-a756-895b92983661 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:01.414488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4badb-b59c-48e8-a756-895b92983661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:01.416849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4badb-b59c-48e8-a756-895b92983661 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:01.442896 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4243/8500] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:27:01 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:27:01.447053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a46007-3ea8-4216-818f-c46f3fed8e54 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:01.457969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a46007-3ea8-4216-818f-c46f3fed8e54 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:01.515421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a07ed-bb74-4293-bb84-8f44b38b9b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:01.516026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a07ed-bb74-4293-bb84-8f44b38b9b64 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:01.516306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a07ed-bb74-4293-bb84-8f44b38b9b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:01.516577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a07ed-bb74-4293-bb84-8f44b38b9b64 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:01.517261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a07ed-bb74-4293-bb84-8f44b38b9b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:01.519174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a07ed-bb74-4293-bb84-8f44b38b9b64 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:01.540711 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4258/8501] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:27:01 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:27:01.544631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4badb-b59c-48e8-a756-895b92983661 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:01.554826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4badb-b59c-48e8-a756-895b92983661 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:01.559845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cf9a4-341a-49cb-81d6-53d4793ee05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:01.560437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cf9a4-341a-49cb-81d6-53d4793ee05e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:01.560712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cf9a4-341a-49cb-81d6-53d4793ee05e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:01.560981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cf9a4-341a-49cb-81d6-53d4793ee05e admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:01.561687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cf9a4-341a-49cb-81d6-53d4793ee05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:01.563252 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cf9a4-341a-49cb-81d6-53d4793ee05e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:01.573852 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4244/8502] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:27:01.577700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a07ed-bb74-4293-bb84-8f44b38b9b64 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:01.588452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a07ed-bb74-4293-bb84-8f44b38b9b64 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:01.593084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf25f2-d814-477b-be88-e8d2903bff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:01.593746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf25f2-d814-477b-be88-e8d2903bff47 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:01.594026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf25f2-d814-477b-be88-e8d2903bff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:01.594300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf25f2-d814-477b-be88-e8d2903bff47 admin admin] PATH_INFO: `/v3/projects/248e694d8f394da58dfcd008a49db35e/users/4b62fb07869545e5b378a7d61edf0263/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:01.609903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf25f2-d814-477b-be88-e8d2903bff47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248e694d8f394da58dfcd008a49db35e, user_id=4b62fb07869545e5b378a7d61edf0263, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:01.613269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf25f2-d814-477b-be88-e8d2903bff47 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:01.626646 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4259/8503] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:27:01 2022] PUT /identity/v3/projects/248e694d8f394da58dfcd008a49db35e/users/4b62fb07869545e5b378a7d61edf0263/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:01.630811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cf9a4-341a-49cb-81d6-53d4793ee05e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:01.641265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cf9a4-341a-49cb-81d6-53d4793ee05e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:01.699630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22b33c-8e7c-470a-af96-fed3f9e203a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:01.700242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22b33c-8e7c-470a-af96-fed3f9e203a7 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:01.700525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22b33c-8e7c-470a-af96-fed3f9e203a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:01.700800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22b33c-8e7c-470a-af96-fed3f9e203a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:01.701474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22b33c-8e7c-470a-af96-fed3f9e203a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:01.703057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22b33c-8e7c-470a-af96-fed3f9e203a7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:01.713364 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4245/8504] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:27:01.717538 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf25f2-d814-477b-be88-e8d2903bff47 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:01.728404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf25f2-d814-477b-be88-e8d2903bff47 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:01.733327 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0d01a-9a19-43c2-872f-137c3ba77bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:01.733972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0d01a-9a19-43c2-872f-137c3ba77bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:01.734254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0d01a-9a19-43c2-872f-137c3ba77bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:01.734529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0d01a-9a19-43c2-872f-137c3ba77bcb admin admin] PATH_INFO: `/v3/projects/248e694d8f394da58dfcd008a49db35e/users/4b62fb07869545e5b378a7d61edf0263/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:01.736445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0d01a-9a19-43c2-872f-137c3ba77bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=248e694d8f394da58dfcd008a49db35e, user_id=4b62fb07869545e5b378a7d61edf0263, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:01.739137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0d01a-9a19-43c2-872f-137c3ba77bcb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:01.749310 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4260/8505] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:27:01 2022] PUT /identity/v3/projects/248e694d8f394da58dfcd008a49db35e/users/4b62fb07869545e5b378a7d61edf0263/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:01.759230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e110e-7ae4-4627-90ae-301c2cd38288 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:01.759610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e110e-7ae4-4627-90ae-301c2cd38288 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:01.759893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e110e-7ae4-4627-90ae-301c2cd38288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:01.788184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8f9e110e-7ae4-4627-90ae-301c2cd38288 None None] MFA Rules not processed for user `4b62fb07869545e5b378a7d61edf0263`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:01.789452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8f9e110e-7ae4-4627-90ae-301c2cd38288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:01.795486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:01.858895 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4246/8506] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:01.872223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0d01a-9a19-43c2-872f-137c3ba77bcb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:01.873954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-71d0d01a-9a19-43c2-872f-137c3ba77bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:01.933571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0d01a-9a19-43c2-872f-137c3ba77bcb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:01.937350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0120052-757e-4e9c-9d80-437c4531c184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:01.937951 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0120052-757e-4e9c-9d80-437c4531c184 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:01.938238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0120052-757e-4e9c-9d80-437c4531c184 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:01.938513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0120052-757e-4e9c-9d80-437c4531c184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:01.947491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0120052-757e-4e9c-9d80-437c4531c184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:01.948907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0120052-757e-4e9c-9d80-437c4531c184 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:01.958117 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4261/8507] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:02.338335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e110e-7ae4-4627-90ae-301c2cd38288 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:02.399271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e110e-7ae4-4627-90ae-301c2cd38288 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:02.404353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:02.404978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:02.405295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:02.405569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] PATH_INFO: `/v3/users/3aed311205e54109b833b41808bd747f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:02.406678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aed311205e54109b833b41808bd747f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:02.408653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:02.454615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aed311205e54109b833b41808bd747f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:02.461513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aed311205e54109b833b41808bd747f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:02.462720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aed311205e54109b833b41808bd747f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:02.463345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aed311205e54109b833b41808bd747f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:02.475267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aed311205e54109b833b41808bd747f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:02.489128 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4247/8508] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:27:02 2022] DELETE /identity/v3/users/3aed311205e54109b833b41808bd747f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:27:02.493996 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82619d1d-90b8-47af-88de-1fe7163550e3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:02.494284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82619d1d-90b8-47af-88de-1fe7163550e3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:02.494565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82619d1d-90b8-47af-88de-1fe7163550e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:02.513412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-82619d1d-90b8-47af-88de-1fe7163550e3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:02.514621 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-82619d1d-90b8-47af-88de-1fe7163550e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:02.556113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:02.583112 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4262/8509] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:02.593439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:02.594826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:02.621814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:02.656844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19623c6c-d68b-488f-b48d-baee1b12184a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:02.660673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67442e-2ea7-4d3c-8d19-f50ae62702d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:02.661320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67442e-2ea7-4d3c-8d19-f50ae62702d6 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:02.661601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67442e-2ea7-4d3c-8d19-f50ae62702d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:02.661867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67442e-2ea7-4d3c-8d19-f50ae62702d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:02.671647 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67442e-2ea7-4d3c-8d19-f50ae62702d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:02.673058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67442e-2ea7-4d3c-8d19-f50ae62702d6 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:02.682594 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4248/8510] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:02.951492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82619d1d-90b8-47af-88de-1fe7163550e3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:02.952994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-82619d1d-90b8-47af-88de-1fe7163550e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:02.965820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82619d1d-90b8-47af-88de-1fe7163550e3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:02.971897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:02.972544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:02.972806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:02.973116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] PATH_INFO: `/v3/projects/8ce6a03becf64369b720e9632090585b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:02.974494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce6a03becf64369b720e9632090585b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:02.976519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:03.023127 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce6a03becf64369b720e9632090585b', 'request_id': 'req-a988c2bb-f312-4ec7-bcb2-13d345d17d40'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.031460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce6a03becf64369b720e9632090585b', 'request_id': 'req-a988c2bb-f312-4ec7-bcb2-13d345d17d40'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.041491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce6a03becf64369b720e9632090585b', 'request_id': 'req-a988c2bb-f312-4ec7-bcb2-13d345d17d40'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.052492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] The token cache is being invalidate because project 8ce6a03becf64369b720e9632090585b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:27:03.052783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.053452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.054987 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4263/8511] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:27:02 2022] DELETE /identity/v3/projects/8ce6a03becf64369b720e9632090585b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:03.058999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67442e-2ea7-4d3c-8d19-f50ae62702d6 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:03.068842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67442e-2ea7-4d3c-8d19-f50ae62702d6 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:03.126171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfa83e-17b9-42a6-a063-70856394cf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:03.126799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfa83e-17b9-42a6-a063-70856394cf61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:03.127075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfa83e-17b9-42a6-a063-70856394cf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:03.127350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfa83e-17b9-42a6-a063-70856394cf61 admin admin] PATH_INFO: `/v3/users/4b62fb07869545e5b378a7d61edf0263` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:03.128445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfa83e-17b9-42a6-a063-70856394cf61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b62fb07869545e5b378a7d61edf0263)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:03.130428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfa83e-17b9-42a6-a063-70856394cf61 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:03.176073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e6cfa83e-17b9-42a6-a063-70856394cf61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b62fb07869545e5b378a7d61edf0263'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.183765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e6cfa83e-17b9-42a6-a063-70856394cf61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b62fb07869545e5b378a7d61edf0263'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.184429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e6cfa83e-17b9-42a6-a063-70856394cf61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b62fb07869545e5b378a7d61edf0263'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.185043 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e6cfa83e-17b9-42a6-a063-70856394cf61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b62fb07869545e5b378a7d61edf0263'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.197639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e6cfa83e-17b9-42a6-a063-70856394cf61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b62fb07869545e5b378a7d61edf0263'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.211514 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4249/8512] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:27:03 2022] DELETE /identity/v3/users/4b62fb07869545e5b378a7d61edf0263 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:03.487652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:03.489177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:03.505200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988c2bb-f312-4ec7-bcb2-13d345d17d40 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:03.566008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f663ea-56d5-411e-822a-57011caba16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:03.566567 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f663ea-56d5-411e-822a-57011caba16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:03.566852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f663ea-56d5-411e-822a-57011caba16b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:03.567131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f663ea-56d5-411e-822a-57011caba16b admin admin] PATH_INFO: `/v3/projects/248e694d8f394da58dfcd008a49db35e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:03.568246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f663ea-56d5-411e-822a-57011caba16b admin admin] RBAC: Authorizing `identity:delete_project(project_id=248e694d8f394da58dfcd008a49db35e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:03.570200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f663ea-56d5-411e-822a-57011caba16b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:03.616188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-33f663ea-56d5-411e-822a-57011caba16b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248e694d8f394da58dfcd008a49db35e', 'request_id': 'req-33f663ea-56d5-411e-822a-57011caba16b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.623020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-33f663ea-56d5-411e-822a-57011caba16b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248e694d8f394da58dfcd008a49db35e', 'request_id': 'req-33f663ea-56d5-411e-822a-57011caba16b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.628461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-33f663ea-56d5-411e-822a-57011caba16b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248e694d8f394da58dfcd008a49db35e', 'request_id': 'req-33f663ea-56d5-411e-822a-57011caba16b'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.629571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:03.642882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-33f663ea-56d5-411e-822a-57011caba16b admin admin] The token cache is being invalidate because project 248e694d8f394da58dfcd008a49db35e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:27:03.643168 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-33f663ea-56d5-411e-822a-57011caba16b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.643831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-33f663ea-56d5-411e-822a-57011caba16b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:03.645359 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4264/8513] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:27:03 2022] DELETE /identity/v3/projects/248e694d8f394da58dfcd008a49db35e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:03.651903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b209023-8112-4574-8e85-886ca7f64076 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:03.652543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b209023-8112-4574-8e85-886ca7f64076 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:03.652543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b209023-8112-4574-8e85-886ca7f64076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:03.672151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7b209023-8112-4574-8e85-886ca7f64076 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:03.673406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7b209023-8112-4574-8e85-886ca7f64076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:03.715358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:03.737484 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4250/8514] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:03.745353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea26eb-dd0f-485d-9bb5-57eae1a29bcd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:03.745638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea26eb-dd0f-485d-9bb5-57eae1a29bcd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:03.745910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea26eb-dd0f-485d-9bb5-57eae1a29bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:03.765844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d0ea26eb-dd0f-485d-9bb5-57eae1a29bcd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:03.767034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d0ea26eb-dd0f-485d-9bb5-57eae1a29bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:03.775464 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4265/8515] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:03.779694 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b209023-8112-4574-8e85-886ca7f64076 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:03.789389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b209023-8112-4574-8e85-886ca7f64076 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:03.794039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f77d85-7e67-4d52-a7cb-418df78d9b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:03.794636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f77d85-7e67-4d52-a7cb-418df78d9b41 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:03.794915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f77d85-7e67-4d52-a7cb-418df78d9b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:03.795186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f77d85-7e67-4d52-a7cb-418df78d9b41 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:03.795834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f77d85-7e67-4d52-a7cb-418df78d9b41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:27:03.796136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f77d85-7e67-4d52-a7cb-418df78d9b41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:03.797765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f77d85-7e67-4d52-a7cb-418df78d9b41 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:03.809123 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4251/8516] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:27:03.813461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea26eb-dd0f-485d-9bb5-57eae1a29bcd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:03.823296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea26eb-dd0f-485d-9bb5-57eae1a29bcd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:03.827987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976940cf-3311-4dd8-9f3e-d12d0db8d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:03.828586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976940cf-3311-4dd8-9f3e-d12d0db8d703 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:03.828865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976940cf-3311-4dd8-9f3e-d12d0db8d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:03.829137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976940cf-3311-4dd8-9f3e-d12d0db8d703 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:03.829792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976940cf-3311-4dd8-9f3e-d12d0db8d703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:03.831716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976940cf-3311-4dd8-9f3e-d12d0db8d703 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:03.859354 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4266/8517] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:27:03 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:27:03.863609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f77d85-7e67-4d52-a7cb-418df78d9b41 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:03.874270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f77d85-7e67-4d52-a7cb-418df78d9b41 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:03.930425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b76613-85c5-4837-9a49-903861b84294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:03.931021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b76613-85c5-4837-9a49-903861b84294 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:03.931301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b76613-85c5-4837-9a49-903861b84294 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:03.931572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b76613-85c5-4837-9a49-903861b84294 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:03.932188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b76613-85c5-4837-9a49-903861b84294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:03.934116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b76613-85c5-4837-9a49-903861b84294 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:03.954479 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4252/8518] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:27:03 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:27:03.958652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976940cf-3311-4dd8-9f3e-d12d0db8d703 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:03.969355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976940cf-3311-4dd8-9f3e-d12d0db8d703 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:03.973895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7c8b0-f894-45ed-9c51-babb1ea19dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:03.974476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7c8b0-f894-45ed-9c51-babb1ea19dec admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:03.974753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7c8b0-f894-45ed-9c51-babb1ea19dec admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:03.975024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7c8b0-f894-45ed-9c51-babb1ea19dec admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:03.975653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7c8b0-f894-45ed-9c51-babb1ea19dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:03.977569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7c8b0-f894-45ed-9c51-babb1ea19dec admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:03.988050 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4267/8519] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:27:03.991933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b76613-85c5-4837-9a49-903861b84294 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:04.001923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b76613-85c5-4837-9a49-903861b84294 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:04.006529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fe74c-53d8-4735-b452-fcdb4ac034a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:04.007152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe74c-53d8-4735-b452-fcdb4ac034a6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:04.007433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe74c-53d8-4735-b452-fcdb4ac034a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:04.007706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe74c-53d8-4735-b452-fcdb4ac034a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:04.008345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fe74c-53d8-4735-b452-fcdb4ac034a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:04.009948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fe74c-53d8-4735-b452-fcdb4ac034a6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:04.020399 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4253/8520] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:27:04.024282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7c8b0-f894-45ed-9c51-babb1ea19dec admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:04.036019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7c8b0-f894-45ed-9c51-babb1ea19dec admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:04.041299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb26d2-f047-46e2-964d-a04fd954a464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:04.041920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb26d2-f047-46e2-964d-a04fd954a464 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:04.042193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb26d2-f047-46e2-964d-a04fd954a464 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:04.042465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb26d2-f047-46e2-964d-a04fd954a464 admin admin] PATH_INFO: `/v3/projects/4075244a8af34cbc9c1c0ae398c7e639/users/839dedede3d643e4bb41ade33d54e7f2/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:04.056648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb26d2-f047-46e2-964d-a04fd954a464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4075244a8af34cbc9c1c0ae398c7e639, user_id=839dedede3d643e4bb41ade33d54e7f2, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:04.059305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb26d2-f047-46e2-964d-a04fd954a464 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:04.071860 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4268/8521] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:27:04 2022] PUT /identity/v3/projects/4075244a8af34cbc9c1c0ae398c7e639/users/839dedede3d643e4bb41ade33d54e7f2/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:04.082343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702d92b-5baf-4941-8d7b-fbdaf469d982 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:04.082566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702d92b-5baf-4941-8d7b-fbdaf469d982 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:04.082843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702d92b-5baf-4941-8d7b-fbdaf469d982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:04.111711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f702d92b-5baf-4941-8d7b-fbdaf469d982 None None] MFA Rules not processed for user `839dedede3d643e4bb41ade33d54e7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:04.112966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f702d92b-5baf-4941-8d7b-fbdaf469d982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:04.175888 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4254/8522] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:27:04.180314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb26d2-f047-46e2-964d-a04fd954a464 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:04.241435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb26d2-f047-46e2-964d-a04fd954a464 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:04.246629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895557fa-2bd4-44bb-8f8f-1af4ce681f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:04.247221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895557fa-2bd4-44bb-8f8f-1af4ce681f57 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:04.247498 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895557fa-2bd4-44bb-8f8f-1af4ce681f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:04.247769 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895557fa-2bd4-44bb-8f8f-1af4ce681f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:04.248396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895557fa-2bd4-44bb-8f8f-1af4ce681f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:04.250306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895557fa-2bd4-44bb-8f8f-1af4ce681f57 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:04.276968 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4269/8523] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:27:04 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:27:04.281166 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702d92b-5baf-4941-8d7b-fbdaf469d982 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:04.292028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702d92b-5baf-4941-8d7b-fbdaf469d982 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:04.329464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:04.350172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a19ca5-ead4-4465-9b57-06965af63c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:04.350717 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a19ca5-ead4-4465-9b57-06965af63c6e admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:04.351002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a19ca5-ead4-4465-9b57-06965af63c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:04.351286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a19ca5-ead4-4465-9b57-06965af63c6e admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:04.351922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a19ca5-ead4-4465-9b57-06965af63c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:04.353896 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a19ca5-ead4-4465-9b57-06965af63c6e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:04.374603 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4255/8524] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:27:04 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:27:04.379061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895557fa-2bd4-44bb-8f8f-1af4ce681f57 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:04.390115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895557fa-2bd4-44bb-8f8f-1af4ce681f57 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:04.394682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbab04-8861-4999-add4-97e1be37968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:04.395271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbab04-8861-4999-add4-97e1be37968e admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:04.395545 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbab04-8861-4999-add4-97e1be37968e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:04.395815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbab04-8861-4999-add4-97e1be37968e admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:04.396447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbab04-8861-4999-add4-97e1be37968e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:04.398059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbab04-8861-4999-add4-97e1be37968e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:04.409000 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4270/8525] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:27:04.413030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a19ca5-ead4-4465-9b57-06965af63c6e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:04.423049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a19ca5-ead4-4465-9b57-06965af63c6e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:04.427619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b6308-8c49-47f0-8a52-6b46047d40e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:04.428261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b6308-8c49-47f0-8a52-6b46047d40e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:04.428539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b6308-8c49-47f0-8a52-6b46047d40e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:04.428812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b6308-8c49-47f0-8a52-6b46047d40e5 admin admin] PATH_INFO: `/v3/projects/04b30f2eacfc43b5bcba0db8dfe02a40/users/d4676dac0c134b81b5c001f64590af02/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:04.443987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b6308-8c49-47f0-8a52-6b46047d40e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b30f2eacfc43b5bcba0db8dfe02a40, user_id=d4676dac0c134b81b5c001f64590af02, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:04.447191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b6308-8c49-47f0-8a52-6b46047d40e5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:04.460366 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4256/8526] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:27:04 2022] PUT /identity/v3/projects/04b30f2eacfc43b5bcba0db8dfe02a40/users/d4676dac0c134b81b5c001f64590af02/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:04.464908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbab04-8861-4999-add4-97e1be37968e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:04.474873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbab04-8861-4999-add4-97e1be37968e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:04.531193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2aa08-b6ec-4c4a-91cb-f271d8a5440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:04.531794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2aa08-b6ec-4c4a-91cb-f271d8a5440b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:04.532078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2aa08-b6ec-4c4a-91cb-f271d8a5440b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:04.532352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2aa08-b6ec-4c4a-91cb-f271d8a5440b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:04.532984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2aa08-b6ec-4c4a-91cb-f271d8a5440b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:04.534607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2aa08-b6ec-4c4a-91cb-f271d8a5440b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:04.540043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:04.545789 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4271/8527] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:27:04.549394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b6308-8c49-47f0-8a52-6b46047d40e5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:04.560097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b6308-8c49-47f0-8a52-6b46047d40e5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:04.564761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22208a-88d8-40b6-bd92-ec2582edf261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:04.565446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22208a-88d8-40b6-bd92-ec2582edf261 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:04.565727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22208a-88d8-40b6-bd92-ec2582edf261 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:04.566003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22208a-88d8-40b6-bd92-ec2582edf261 admin admin] PATH_INFO: `/v3/projects/04b30f2eacfc43b5bcba0db8dfe02a40/users/d4676dac0c134b81b5c001f64590af02/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:04.567943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22208a-88d8-40b6-bd92-ec2582edf261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b30f2eacfc43b5bcba0db8dfe02a40, user_id=d4676dac0c134b81b5c001f64590af02, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:04.570973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22208a-88d8-40b6-bd92-ec2582edf261 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:04.581857 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4257/8528] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:27:04 2022] PUT /identity/v3/projects/04b30f2eacfc43b5bcba0db8dfe02a40/users/d4676dac0c134b81b5c001f64590af02/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:04.594154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c85e5-25f8-43c4-87d3-2b4c8e93187b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:04.594441 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c85e5-25f8-43c4-87d3-2b4c8e93187b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:04.594720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c85e5-25f8-43c4-87d3-2b4c8e93187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:04.622988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7e8c85e5-25f8-43c4-87d3-2b4c8e93187b None None] MFA Rules not processed for user `d4676dac0c134b81b5c001f64590af02`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:04.624158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7e8c85e5-25f8-43c4-87d3-2b4c8e93187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:04.692469 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4272/8529] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:27:04.703888 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22208a-88d8-40b6-bd92-ec2582edf261 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:04.705697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8d22208a-88d8-40b6-bd92-ec2582edf261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:04.765774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22208a-88d8-40b6-bd92-ec2582edf261 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:04.769715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421dd07-d07d-45ce-93ef-45db66c65d11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:04.770362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421dd07-d07d-45ce-93ef-45db66c65d11 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:04.770638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421dd07-d07d-45ce-93ef-45db66c65d11 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:04.770908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421dd07-d07d-45ce-93ef-45db66c65d11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:04.825134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421dd07-d07d-45ce-93ef-45db66c65d11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:04.826569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421dd07-d07d-45ce-93ef-45db66c65d11 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:04.835306 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4258/8530] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:07.396659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c85e5-25f8-43c4-87d3-2b4c8e93187b None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:07.409614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c85e5-25f8-43c4-87d3-2b4c8e93187b None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:07.413128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5b261-67ba-458b-a56c-776d873e7c0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:07.413743 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5b261-67ba-458b-a56c-776d873e7c0d service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:07.414022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5b261-67ba-458b-a56c-776d873e7c0d service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:07.414295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5b261-67ba-458b-a56c-776d873e7c0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:07.423146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5b261-67ba-458b-a56c-776d873e7c0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:07.424556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5b261-67ba-458b-a56c-776d873e7c0d service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:07.433812 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4273/8531] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:14.831264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:17.429795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=40 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:22.007393 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421dd07-d07d-45ce-93ef-45db66c65d11 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:22.070134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421dd07-d07d-45ce-93ef-45db66c65d11 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:22.074621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:22.075247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:22.075527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:22.075800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] PATH_INFO: `/v3/users/839dedede3d643e4bb41ade33d54e7f2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:22.076904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=839dedede3d643e4bb41ade33d54e7f2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:22.078848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:22.124723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839dedede3d643e4bb41ade33d54e7f2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.131677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839dedede3d643e4bb41ade33d54e7f2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.132337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839dedede3d643e4bb41ade33d54e7f2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.132944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839dedede3d643e4bb41ade33d54e7f2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.145465 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839dedede3d643e4bb41ade33d54e7f2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.160154 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4259/8532] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:27:22 2022] DELETE /identity/v3/users/839dedede3d643e4bb41ade33d54e7f2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:22.164602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae33004-c24e-4f6a-bc74-dc8e254992fc None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:22.165073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae33004-c24e-4f6a-bc74-dc8e254992fc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:22.165364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae33004-c24e-4f6a-bc74-dc8e254992fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:22.184486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1ae33004-c24e-4f6a-bc74-dc8e254992fc None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:22.185715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1ae33004-c24e-4f6a-bc74-dc8e254992fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:22.201451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:22.202847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:22.247303 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4274/8533] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:22.257288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae33004-c24e-4f6a-bc74-dc8e254992fc None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:22.258635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1ae33004-c24e-4f6a-bc74-dc8e254992fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:22.265021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feaf67-3cc0-4653-b1c0-e16188bc1dca admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:22.268766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861055d-9628-458f-8b47-7da69b4a8357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:22.269428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861055d-9628-458f-8b47-7da69b4a8357 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:22.269713 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861055d-9628-458f-8b47-7da69b4a8357 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:22.270185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861055d-9628-458f-8b47-7da69b4a8357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:22.271855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7861055d-9628-458f-8b47-7da69b4a8357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:22.274565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae33004-c24e-4f6a-bc74-dc8e254992fc None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:22.278207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59e6c-3e3a-4dbc-bb15-f8ec47497142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:22.279407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59e6c-3e3a-4dbc-bb15-f8ec47497142 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:22.279685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59e6c-3e3a-4dbc-bb15-f8ec47497142 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:22.279953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59e6c-3e3a-4dbc-bb15-f8ec47497142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:22.289372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d59e6c-3e3a-4dbc-bb15-f8ec47497142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:22.290794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d59e6c-3e3a-4dbc-bb15-f8ec47497142 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:22.300316 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4275/8534] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:27:22.306196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:22.351462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861055d-9628-458f-8b47-7da69b4a8357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:22.352969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861055d-9628-458f-8b47-7da69b4a8357 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:22.368070 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4260/8535] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:27:22.569844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59e6c-3e3a-4dbc-bb15-f8ec47497142 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:22.583748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59e6c-3e3a-4dbc-bb15-f8ec47497142 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:22.587623 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a0b6c-43a7-41ed-a123-95aab2d49ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:22.588223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a0b6c-43a7-41ed-a123-95aab2d49ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:22.588503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a0b6c-43a7-41ed-a123-95aab2d49ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:22.588775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a0b6c-43a7-41ed-a123-95aab2d49ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:22.590606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-961a0b6c-43a7-41ed-a123-95aab2d49ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:22.593269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861055d-9628-458f-8b47-7da69b4a8357 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:22.594701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7861055d-9628-458f-8b47-7da69b4a8357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:22.609767 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a0b6c-43a7-41ed-a123-95aab2d49ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:22.611319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a0b6c-43a7-41ed-a123-95aab2d49ae8 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:22.617033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861055d-9628-458f-8b47-7da69b4a8357 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:22.622634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:22.623452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:22.623735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:22.624004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] PATH_INFO: `/v3/projects/4075244a8af34cbc9c1c0ae398c7e639` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:22.625146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4075244a8af34cbc9c1c0ae398c7e639)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:22.627066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:22.627637 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4276/8536] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:22.677580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4075244a8af34cbc9c1c0ae398c7e639', 'request_id': 'req-d505a12b-c60e-463b-a168-0d0a4fdb291f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.685559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4075244a8af34cbc9c1c0ae398c7e639', 'request_id': 'req-d505a12b-c60e-463b-a168-0d0a4fdb291f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.692239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4075244a8af34cbc9c1c0ae398c7e639', 'request_id': 'req-d505a12b-c60e-463b-a168-0d0a4fdb291f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.708494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] The token cache is being invalidate because project 4075244a8af34cbc9c1c0ae398c7e639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:27:22.708795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.709456 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.710912 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4261/8537] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:27:22 2022] DELETE /identity/v3/projects/4075244a8af34cbc9c1c0ae398c7e639 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:22.715066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a0b6c-43a7-41ed-a123-95aab2d49ae8 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:22.726055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a0b6c-43a7-41ed-a123-95aab2d49ae8 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:22.786537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:22.787210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:22.787488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:22.787758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] PATH_INFO: `/v3/users/d4676dac0c134b81b5c001f64590af02` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:22.788943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4676dac0c134b81b5c001f64590af02)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:22.790868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:22.837193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4676dac0c134b81b5c001f64590af02'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.844636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4676dac0c134b81b5c001f64590af02'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.845420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4676dac0c134b81b5c001f64590af02'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.846088 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4676dac0c134b81b5c001f64590af02'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.859377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4676dac0c134b81b5c001f64590af02'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:22.862053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:22.875788 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4277/8538] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:27:22 2022] DELETE /identity/v3/users/d4676dac0c134b81b5c001f64590af02 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:27:23.127401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:23.128902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:23.159619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:23.161148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:23.213175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505a12b-c60e-463b-a168-0d0a4fdb291f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:23.233928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549b9fb-ea49-4936-879c-07ab9292e8d0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:23.238803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b5986-6448-4236-acae-686413a96aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:23.239499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5986-6448-4236-acae-686413a96aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:23.239846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5986-6448-4236-acae-686413a96aab admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:23.240209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5986-6448-4236-acae-686413a96aab admin admin] PATH_INFO: `/v3/projects/04b30f2eacfc43b5bcba0db8dfe02a40` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:23.242713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b5986-6448-4236-acae-686413a96aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b30f2eacfc43b5bcba0db8dfe02a40)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:23.244716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b5986-6448-4236-acae-686413a96aab admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:23.263562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:23.285136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04933083-b962-46f8-8279-b18882af32a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:23.285813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04933083-b962-46f8-8279-b18882af32a7 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:23.286098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04933083-b962-46f8-8279-b18882af32a7 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:23.286370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04933083-b962-46f8-8279-b18882af32a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:23.288071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-04933083-b962-46f8-8279-b18882af32a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:23.301850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c40b5986-6448-4236-acae-686413a96aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b30f2eacfc43b5bcba0db8dfe02a40', 'request_id': 'req-c40b5986-6448-4236-acae-686413a96aab'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:23.303366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04933083-b962-46f8-8279-b18882af32a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:23.304942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04933083-b962-46f8-8279-b18882af32a7 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:23.310167 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c40b5986-6448-4236-acae-686413a96aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b30f2eacfc43b5bcba0db8dfe02a40', 'request_id': 'req-c40b5986-6448-4236-acae-686413a96aab'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:23.316133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c40b5986-6448-4236-acae-686413a96aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b30f2eacfc43b5bcba0db8dfe02a40', 'request_id': 'req-c40b5986-6448-4236-acae-686413a96aab'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:23.318151 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4262/8539] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:23.327895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c40b5986-6448-4236-acae-686413a96aab admin admin] The token cache is being invalidate because project 04b30f2eacfc43b5bcba0db8dfe02a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:27:23.328185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c40b5986-6448-4236-acae-686413a96aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:23.328827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-c40b5986-6448-4236-acae-686413a96aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:23.330338 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4278/8540] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:27:23 2022] DELETE /identity/v3/projects/04b30f2eacfc43b5bcba0db8dfe02a40 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:27:23.335198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9863264-d397-418a-8928-d0201051b1e5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:23.335478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9863264-d397-418a-8928-d0201051b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:23.335753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9863264-d397-418a-8928-d0201051b1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:23.355723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c9863264-d397-418a-8928-d0201051b1e5 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:23.357883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c9863264-d397-418a-8928-d0201051b1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:23.427290 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4263/8541] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:23.435331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b8156-f9e6-4817-99b2-65ee218b9ead None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:23.435616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b8156-f9e6-4817-99b2-65ee218b9ead None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:23.435893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b8156-f9e6-4817-99b2-65ee218b9ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:23.457166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b29b8156-f9e6-4817-99b2-65ee218b9ead None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:23.458421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b29b8156-f9e6-4817-99b2-65ee218b9ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:23.471303 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4279/8542] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:23.472988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9863264-d397-418a-8928-d0201051b1e5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:23.494884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9863264-d397-418a-8928-d0201051b1e5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:23.501052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78abf3-cdea-4add-8394-709a6ad477f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:23.501777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78abf3-cdea-4add-8394-709a6ad477f1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:23.502124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78abf3-cdea-4add-8394-709a6ad477f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:23.502467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78abf3-cdea-4add-8394-709a6ad477f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:23.503190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78abf3-cdea-4add-8394-709a6ad477f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:27:23.503559 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78abf3-cdea-4add-8394-709a6ad477f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:23.505395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78abf3-cdea-4add-8394-709a6ad477f1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:23.523122 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4264/8543] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:27:23.530890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b8156-f9e6-4817-99b2-65ee218b9ead None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:23.541338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b8156-f9e6-4817-99b2-65ee218b9ead None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:23.547987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb1ff4-a9eb-4842-88c6-0fefa358ce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:23.548821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb1ff4-a9eb-4842-88c6-0fefa358ce7e admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:23.549278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb1ff4-a9eb-4842-88c6-0fefa358ce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:23.549861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb1ff4-a9eb-4842-88c6-0fefa358ce7e admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:23.550638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb1ff4-a9eb-4842-88c6-0fefa358ce7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:23.553130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb1ff4-a9eb-4842-88c6-0fefa358ce7e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:23.590566 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4280/8544] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:27:23 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:27:23.595809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78abf3-cdea-4add-8394-709a6ad477f1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:23.617329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78abf3-cdea-4add-8394-709a6ad477f1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:23.685844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f93d4-5aae-47ef-96db-ff409c2c47b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:23.686453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f93d4-5aae-47ef-96db-ff409c2c47b3 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:23.686734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f93d4-5aae-47ef-96db-ff409c2c47b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:23.687025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f93d4-5aae-47ef-96db-ff409c2c47b3 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:23.687679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f93d4-5aae-47ef-96db-ff409c2c47b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:23.689782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f93d4-5aae-47ef-96db-ff409c2c47b3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:23.712383 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4265/8545] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:27:23 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:27:23.717427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb1ff4-a9eb-4842-88c6-0fefa358ce7e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:23.728682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb1ff4-a9eb-4842-88c6-0fefa358ce7e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:23.734706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b28419-d15f-4edb-b2cf-e18337f3f941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:23.735323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b28419-d15f-4edb-b2cf-e18337f3f941 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:23.735635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b28419-d15f-4edb-b2cf-e18337f3f941 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:23.735905 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b28419-d15f-4edb-b2cf-e18337f3f941 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:23.736582 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b28419-d15f-4edb-b2cf-e18337f3f941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:23.738219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b28419-d15f-4edb-b2cf-e18337f3f941 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:23.752690 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4281/8546] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:27:23.753927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f93d4-5aae-47ef-96db-ff409c2c47b3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:23.764644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f93d4-5aae-47ef-96db-ff409c2c47b3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:23.769330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ee033-8752-4ed9-8c96-0c6082977e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:23.769938 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ee033-8752-4ed9-8c96-0c6082977e18 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:23.770216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ee033-8752-4ed9-8c96-0c6082977e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:23.770489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ee033-8752-4ed9-8c96-0c6082977e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:23.771125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ee033-8752-4ed9-8c96-0c6082977e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:23.772749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ee033-8752-4ed9-8c96-0c6082977e18 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:23.784300 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4266/8547] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:27:23.788579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b28419-d15f-4edb-b2cf-e18337f3f941 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:23.804326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b28419-d15f-4edb-b2cf-e18337f3f941 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:23.809221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4aaa82-bff2-4af2-99dd-b94618ad605c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:23.809916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aaa82-bff2-4af2-99dd-b94618ad605c admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:23.810312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aaa82-bff2-4af2-99dd-b94618ad605c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:23.810712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aaa82-bff2-4af2-99dd-b94618ad605c admin admin] PATH_INFO: `/v3/projects/44a90a283e60413e87f0461e75d562f3/users/adf00aad959c4b06879d77954f1dbbd4/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:23.827205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4aaa82-bff2-4af2-99dd-b94618ad605c admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a90a283e60413e87f0461e75d562f3, user_id=adf00aad959c4b06879d77954f1dbbd4, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:23.829887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4aaa82-bff2-4af2-99dd-b94618ad605c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:23.843690 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4282/8548] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:27:23 2022] PUT /identity/v3/projects/44a90a283e60413e87f0461e75d562f3/users/adf00aad959c4b06879d77954f1dbbd4/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:23.855345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231ce33-d5e2-46d6-b9ff-7567dc69cbbf None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:23.855628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231ce33-d5e2-46d6-b9ff-7567dc69cbbf None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:23.855902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231ce33-d5e2-46d6-b9ff-7567dc69cbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:23.884354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4231ce33-d5e2-46d6-b9ff-7567dc69cbbf None None] MFA Rules not processed for user `adf00aad959c4b06879d77954f1dbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:23.885624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4231ce33-d5e2-46d6-b9ff-7567dc69cbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:23.918392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:23.955911 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4267/8549] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:23.960561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4aaa82-bff2-4af2-99dd-b94618ad605c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:23.982862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:24.033333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4aaa82-bff2-4af2-99dd-b94618ad605c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:24.039404 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c898fe-11d6-4bc4-bf7b-76a01c69d3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:24.040021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c898fe-11d6-4bc4-bf7b-76a01c69d3bb admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:24.040308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c898fe-11d6-4bc4-bf7b-76a01c69d3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:24.040650 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c898fe-11d6-4bc4-bf7b-76a01c69d3bb admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:24.041316 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c898fe-11d6-4bc4-bf7b-76a01c69d3bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:24.043271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c898fe-11d6-4bc4-bf7b-76a01c69d3bb admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:24.077906 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4283/8550] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:27:23 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:27:24.079205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231ce33-d5e2-46d6-b9ff-7567dc69cbbf None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:24.091488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231ce33-d5e2-46d6-b9ff-7567dc69cbbf None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:24.152817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485a697-6cc7-465f-bf48-3e8afd32bed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:24.153591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485a697-6cc7-465f-bf48-3e8afd32bed8 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:24.153878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485a697-6cc7-465f-bf48-3e8afd32bed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:24.154157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485a697-6cc7-465f-bf48-3e8afd32bed8 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:24.154859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485a697-6cc7-465f-bf48-3e8afd32bed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:24.156973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485a697-6cc7-465f-bf48-3e8afd32bed8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:24.180327 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4268/8551] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:27:24 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:27:24.185305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c898fe-11d6-4bc4-bf7b-76a01c69d3bb admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:24.196217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c898fe-11d6-4bc4-bf7b-76a01c69d3bb admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:24.202035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e9ada-2a44-44a3-8552-1c97f1c5693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:24.202649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e9ada-2a44-44a3-8552-1c97f1c5693b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:24.202954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e9ada-2a44-44a3-8552-1c97f1c5693b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:24.203230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e9ada-2a44-44a3-8552-1c97f1c5693b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:24.203873 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e9ada-2a44-44a3-8552-1c97f1c5693b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:24.206234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e9ada-2a44-44a3-8552-1c97f1c5693b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:24.220743 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4284/8552] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:27:24.222016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485a697-6cc7-465f-bf48-3e8afd32bed8 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:24.232586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485a697-6cc7-465f-bf48-3e8afd32bed8 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:24.237287 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da789693-e466-4e88-9dbd-c1f46a534869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:24.237940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da789693-e466-4e88-9dbd-c1f46a534869 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:24.238242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da789693-e466-4e88-9dbd-c1f46a534869 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:24.238489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da789693-e466-4e88-9dbd-c1f46a534869 admin admin] PATH_INFO: `/v3/projects/e8ee91dee788487dae565ea49dd95a96/users/6a49ab1066514ab58fc172b53b5ae696/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:24.255485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da789693-e466-4e88-9dbd-c1f46a534869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ee91dee788487dae565ea49dd95a96, user_id=6a49ab1066514ab58fc172b53b5ae696, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:24.258216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da789693-e466-4e88-9dbd-c1f46a534869 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:24.273366 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4269/8553] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:27:24 2022] PUT /identity/v3/projects/e8ee91dee788487dae565ea49dd95a96/users/6a49ab1066514ab58fc172b53b5ae696/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:24.277349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e9ada-2a44-44a3-8552-1c97f1c5693b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:24.288531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e9ada-2a44-44a3-8552-1c97f1c5693b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:24.348387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfbfe8-0717-4a49-bba6-33784761e005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:24.349107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfbfe8-0717-4a49-bba6-33784761e005 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:24.349431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfbfe8-0717-4a49-bba6-33784761e005 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:24.349715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfbfe8-0717-4a49-bba6-33784761e005 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:24.350366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfbfe8-0717-4a49-bba6-33784761e005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:24.351952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfbfe8-0717-4a49-bba6-33784761e005 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:24.365946 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4285/8554] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:27:24.367080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da789693-e466-4e88-9dbd-c1f46a534869 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:24.378272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da789693-e466-4e88-9dbd-c1f46a534869 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:24.382902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a60b-0693-4be6-81e5-8481bd5b11ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:24.383553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a60b-0693-4be6-81e5-8481bd5b11ca admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:24.383836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a60b-0693-4be6-81e5-8481bd5b11ca admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:24.384112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a60b-0693-4be6-81e5-8481bd5b11ca admin admin] PATH_INFO: `/v3/projects/e8ee91dee788487dae565ea49dd95a96/users/6a49ab1066514ab58fc172b53b5ae696/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:24.386078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2a60b-0693-4be6-81e5-8481bd5b11ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ee91dee788487dae565ea49dd95a96, user_id=6a49ab1066514ab58fc172b53b5ae696, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:24.388734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2a60b-0693-4be6-81e5-8481bd5b11ca admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:24.398788 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4270/8555] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:27:24 2022] PUT /identity/v3/projects/e8ee91dee788487dae565ea49dd95a96/users/6a49ab1066514ab58fc172b53b5ae696/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:24.409224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f08ca1-603e-4d6e-a22b-1eaf8cab4cbc None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:24.409525 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f08ca1-603e-4d6e-a22b-1eaf8cab4cbc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:24.409805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f08ca1-603e-4d6e-a22b-1eaf8cab4cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:24.438219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e4f08ca1-603e-4d6e-a22b-1eaf8cab4cbc None None] MFA Rules not processed for user `6a49ab1066514ab58fc172b53b5ae696`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:24.439434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e4f08ca1-603e-4d6e-a22b-1eaf8cab4cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:24.507279 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4286/8556] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:24.518535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a60b-0693-4be6-81e5-8481bd5b11ca admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:24.520370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2fb2a60b-0693-4be6-81e5-8481bd5b11ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:24.581943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a60b-0693-4be6-81e5-8481bd5b11ca admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:24.585641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a454f5c-0141-464e-ba7b-f26ae532fb55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:24.586249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a454f5c-0141-464e-ba7b-f26ae532fb55 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:24.586525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a454f5c-0141-464e-ba7b-f26ae532fb55 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:24.586794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a454f5c-0141-464e-ba7b-f26ae532fb55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:24.596224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a454f5c-0141-464e-ba7b-f26ae532fb55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:24.597616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a454f5c-0141-464e-ba7b-f26ae532fb55 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:24.608650 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4271/8557] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:25.197483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f08ca1-603e-4d6e-a22b-1eaf8cab4cbc None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:25.217111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:25.267617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f08ca1-603e-4d6e-a22b-1eaf8cab4cbc None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:25.272533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:25.273166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:25.273481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:25.273772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] PATH_INFO: `/v3/users/adf00aad959c4b06879d77954f1dbbd4` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:25.274909 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf00aad959c4b06879d77954f1dbbd4)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:25.276831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:25.324274 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf00aad959c4b06879d77954f1dbbd4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:25.332935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf00aad959c4b06879d77954f1dbbd4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:25.333753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf00aad959c4b06879d77954f1dbbd4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:25.334434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf00aad959c4b06879d77954f1dbbd4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:25.347348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf00aad959c4b06879d77954f1dbbd4'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:25.361357 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4287/8558] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:27:25 2022] DELETE /identity/v3/users/adf00aad959c4b06879d77954f1dbbd4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:25.365737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8869b31-e058-447b-9d31-c83c89b2e11e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:25.366206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8869b31-e058-447b-9d31-c83c89b2e11e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:25.366366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8869b31-e058-447b-9d31-c83c89b2e11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:25.387188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e8869b31-e058-447b-9d31-c83c89b2e11e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:25.388925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e8869b31-e058-447b-9d31-c83c89b2e11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:25.410234 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:25.449640 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4272/8559] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:25.459942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:25.461376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:25.522711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40017ab4-de20-43b1-a184-2e59d9bbd290 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:25.526367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efee85-bfdd-4a4e-a1fb-d108783c0dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:25.526966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efee85-bfdd-4a4e-a1fb-d108783c0dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:25.527248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efee85-bfdd-4a4e-a1fb-d108783c0dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:25.527524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efee85-bfdd-4a4e-a1fb-d108783c0dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:25.536836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efee85-bfdd-4a4e-a1fb-d108783c0dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:25.538301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efee85-bfdd-4a4e-a1fb-d108783c0dc8 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:25.547833 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4288/8560] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:25.817604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8869b31-e058-447b-9d31-c83c89b2e11e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:25.819053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e8869b31-e058-447b-9d31-c83c89b2e11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:25.832240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8869b31-e058-447b-9d31-c83c89b2e11e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:25.837741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:25.838383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:25.838665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:25.839007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] PATH_INFO: `/v3/projects/44a90a283e60413e87f0461e75d562f3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:25.840223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a90a283e60413e87f0461e75d562f3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:25.842435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:25.889065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a90a283e60413e87f0461e75d562f3', 'request_id': 'req-2b502b56-6d18-4cb7-b949-591613f6ce9e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:25.896364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a90a283e60413e87f0461e75d562f3', 'request_id': 'req-2b502b56-6d18-4cb7-b949-591613f6ce9e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:25.902016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a90a283e60413e87f0461e75d562f3', 'request_id': 'req-2b502b56-6d18-4cb7-b949-591613f6ce9e'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:25.913140 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] The token cache is being invalidate because project 44a90a283e60413e87f0461e75d562f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:27:25.913464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:25.914114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:25.915610 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4273/8561] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:27:25 2022] DELETE /identity/v3/projects/44a90a283e60413e87f0461e75d562f3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:27:25.920092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efee85-bfdd-4a4e-a1fb-d108783c0dc8 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:25.929894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efee85-bfdd-4a4e-a1fb-d108783c0dc8 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:25.964462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:25.991974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0886b6-8304-4a6a-a15e-fc827daa6ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:25.992606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0886b6-8304-4a6a-a15e-fc827daa6ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:25.992933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0886b6-8304-4a6a-a15e-fc827daa6ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:25.993239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0886b6-8304-4a6a-a15e-fc827daa6ebe admin admin] PATH_INFO: `/v3/users/6a49ab1066514ab58fc172b53b5ae696` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:25.994377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0886b6-8304-4a6a-a15e-fc827daa6ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a49ab1066514ab58fc172b53b5ae696)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:25.996260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0886b6-8304-4a6a-a15e-fc827daa6ebe admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:26.043509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ff0886b6-8304-4a6a-a15e-fc827daa6ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a49ab1066514ab58fc172b53b5ae696'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:26.051792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ff0886b6-8304-4a6a-a15e-fc827daa6ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a49ab1066514ab58fc172b53b5ae696'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:26.052486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ff0886b6-8304-4a6a-a15e-fc827daa6ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a49ab1066514ab58fc172b53b5ae696'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:26.053098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ff0886b6-8304-4a6a-a15e-fc827daa6ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a49ab1066514ab58fc172b53b5ae696'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:26.065663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ff0886b6-8304-4a6a-a15e-fc827daa6ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a49ab1066514ab58fc172b53b5ae696'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:26.079115 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4289/8562] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:27:25 2022] DELETE /identity/v3/users/6a49ab1066514ab58fc172b53b5ae696 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:26.358667 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:26.360126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:26.373121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b502b56-6d18-4cb7-b949-591613f6ce9e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:26.433875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faff0fd-8323-4f1a-b396-b010c2c963e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:26.434442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faff0fd-8323-4f1a-b396-b010c2c963e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:26.434747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faff0fd-8323-4f1a-b396-b010c2c963e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:26.435021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faff0fd-8323-4f1a-b396-b010c2c963e4 admin admin] PATH_INFO: `/v3/projects/e8ee91dee788487dae565ea49dd95a96` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:26.436132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faff0fd-8323-4f1a-b396-b010c2c963e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ee91dee788487dae565ea49dd95a96)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:26.438055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faff0fd-8323-4f1a-b396-b010c2c963e4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:26.484237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9faff0fd-8323-4f1a-b396-b010c2c963e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ee91dee788487dae565ea49dd95a96', 'request_id': 'req-9faff0fd-8323-4f1a-b396-b010c2c963e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:26.487293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:26.494266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9faff0fd-8323-4f1a-b396-b010c2c963e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ee91dee788487dae565ea49dd95a96', 'request_id': 'req-9faff0fd-8323-4f1a-b396-b010c2c963e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:26.500788 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9faff0fd-8323-4f1a-b396-b010c2c963e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ee91dee788487dae565ea49dd95a96', 'request_id': 'req-9faff0fd-8323-4f1a-b396-b010c2c963e4'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:26.512250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9faff0fd-8323-4f1a-b396-b010c2c963e4 admin admin] The token cache is being invalidate because project e8ee91dee788487dae565ea49dd95a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:27:26.512539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9faff0fd-8323-4f1a-b396-b010c2c963e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:26.513330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-9faff0fd-8323-4f1a-b396-b010c2c963e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:27:26.514825 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4274/8563] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:27:26 2022] DELETE /identity/v3/projects/e8ee91dee788487dae565ea49dd95a96 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:26.519907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683dcf1-3503-4c4c-85c8-20304d6c4d15 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:26.520362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683dcf1-3503-4c4c-85c8-20304d6c4d15 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:26.520466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683dcf1-3503-4c4c-85c8-20304d6c4d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:26.540475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d683dcf1-3503-4c4c-85c8-20304d6c4d15 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:26.541712 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d683dcf1-3503-4c4c-85c8-20304d6c4d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:26.599925 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4290/8564] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:26.608905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001b3e7-1ccc-49c6-b412-0c110f877b2e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:26.609212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001b3e7-1ccc-49c6-b412-0c110f877b2e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:26.609512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001b3e7-1ccc-49c6-b412-0c110f877b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:26.628931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a001b3e7-1ccc-49c6-b412-0c110f877b2e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:26.630181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a001b3e7-1ccc-49c6-b412-0c110f877b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:26.638555 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4275/8565] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:26.642691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683dcf1-3503-4c4c-85c8-20304d6c4d15 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:26.653011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683dcf1-3503-4c4c-85c8-20304d6c4d15 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:26.660714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f822-df51-4969-9402-d361fddfc3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:26.661588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f822-df51-4969-9402-d361fddfc3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:26.662132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f822-df51-4969-9402-d361fddfc3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:26.662461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f822-df51-4969-9402-d361fddfc3c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:26.663339 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028f822-df51-4969-9402-d361fddfc3c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:27:26.663652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028f822-df51-4969-9402-d361fddfc3c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:26.665697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028f822-df51-4969-9402-d361fddfc3c2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:26.677700 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4291/8566] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:27:26.682053 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001b3e7-1ccc-49c6-b412-0c110f877b2e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:26.691404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001b3e7-1ccc-49c6-b412-0c110f877b2e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:26.696055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41663c05-4b6b-4b62-b35c-27c51abf03ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:26.696648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41663c05-4b6b-4b62-b35c-27c51abf03ef admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:26.696928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41663c05-4b6b-4b62-b35c-27c51abf03ef admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:26.697223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41663c05-4b6b-4b62-b35c-27c51abf03ef admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:26.697853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41663c05-4b6b-4b62-b35c-27c51abf03ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:26.699738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41663c05-4b6b-4b62-b35c-27c51abf03ef admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:26.727298 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4276/8567] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:27:26 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:27:26.731372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f822-df51-4969-9402-d361fddfc3c2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:26.741735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f822-df51-4969-9402-d361fddfc3c2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:26.783141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:26.799555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2921f-190d-4a03-92ea-7233db3a997c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:26.800161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2921f-190d-4a03-92ea-7233db3a997c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:26.800442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2921f-190d-4a03-92ea-7233db3a997c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:26.800742 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2921f-190d-4a03-92ea-7233db3a997c admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:26.801391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2921f-190d-4a03-92ea-7233db3a997c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:26.803303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2921f-190d-4a03-92ea-7233db3a997c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:26.823053 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4292/8568] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:27:26 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:27:26.827784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41663c05-4b6b-4b62-b35c-27c51abf03ef admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:26.837950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41663c05-4b6b-4b62-b35c-27c51abf03ef admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:26.843170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621a65c-8b71-448d-a066-86b3c0dff454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:26.843755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621a65c-8b71-448d-a066-86b3c0dff454 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:26.844033 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621a65c-8b71-448d-a066-86b3c0dff454 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:26.844305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621a65c-8b71-448d-a066-86b3c0dff454 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:26.844944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621a65c-8b71-448d-a066-86b3c0dff454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:26.846547 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621a65c-8b71-448d-a066-86b3c0dff454 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:26.856183 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4277/8569] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:27:26.860250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2921f-190d-4a03-92ea-7233db3a997c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:26.870342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2921f-190d-4a03-92ea-7233db3a997c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:26.875215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da713e-c5e6-400f-baa6-a855d601edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:26.875800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da713e-c5e6-400f-baa6-a855d601edf1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:26.876077 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da713e-c5e6-400f-baa6-a855d601edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:26.876349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da713e-c5e6-400f-baa6-a855d601edf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:26.877012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da713e-c5e6-400f-baa6-a855d601edf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:26.878699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da713e-c5e6-400f-baa6-a855d601edf1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:26.889789 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4293/8570] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:27:26.893867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621a65c-8b71-448d-a066-86b3c0dff454 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:26.904423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621a65c-8b71-448d-a066-86b3c0dff454 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:26.909039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad5cea-4c8a-44c6-bc97-29fc107a80b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:26.909724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5cea-4c8a-44c6-bc97-29fc107a80b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:26.910007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5cea-4c8a-44c6-bc97-29fc107a80b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:26.910280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5cea-4c8a-44c6-bc97-29fc107a80b1 admin admin] PATH_INFO: `/v3/projects/79a6a8bf389b4191816195072295a080/users/6100a1568dd042e58ce63e4b30a87429/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:26.924553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad5cea-4c8a-44c6-bc97-29fc107a80b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a6a8bf389b4191816195072295a080, user_id=6100a1568dd042e58ce63e4b30a87429, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:26.927205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad5cea-4c8a-44c6-bc97-29fc107a80b1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:26.939385 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4278/8571] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:27:26 2022] PUT /identity/v3/projects/79a6a8bf389b4191816195072295a080/users/6100a1568dd042e58ce63e4b30a87429/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:26.944379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f9abe-5ef5-45cf-b21b-a9297008278b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:26.944655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f9abe-5ef5-45cf-b21b-a9297008278b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:26.944929 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f9abe-5ef5-45cf-b21b-a9297008278b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:26.964476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1b0f9abe-5ef5-45cf-b21b-a9297008278b None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:26.965689 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1b0f9abe-5ef5-45cf-b21b-a9297008278b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:27.025523 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4294/8572] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:27.035211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad5cea-4c8a-44c6-bc97-29fc107a80b1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:27.036920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b1ad5cea-4c8a-44c6-bc97-29fc107a80b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:27.096561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad5cea-4c8a-44c6-bc97-29fc107a80b1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:27.100157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821730dd-760f-42a5-9871-e72442fa81c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:27.100783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821730dd-760f-42a5-9871-e72442fa81c7 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:27.101060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821730dd-760f-42a5-9871-e72442fa81c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:27.101392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821730dd-760f-42a5-9871-e72442fa81c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:27.110901 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821730dd-760f-42a5-9871-e72442fa81c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:27.112320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821730dd-760f-42a5-9871-e72442fa81c7 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:27.121764 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4279/8573] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:31.808280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe86be8-21c0-478e-9991-0c1ceae98921 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:31.808893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe86be8-21c0-478e-9991-0c1ceae98921 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:31.808893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe86be8-21c0-478e-9991-0c1ceae98921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:31.841533 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dbe86be8-21c0-478e-9991-0c1ceae98921 None None] MFA Rules not processed for user `6100a1568dd042e58ce63e4b30a87429`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:31.842911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dbe86be8-21c0-478e-9991-0c1ceae98921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:31.909450 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4295/8574] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:31.913964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821730dd-760f-42a5-9871-e72442fa81c7 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:31.924615 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821730dd-760f-42a5-9871-e72442fa81c7 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:31.929526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6cdff-0a78-4dd5-947e-250b3e2b1484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:31.930149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6cdff-0a78-4dd5-947e-250b3e2b1484 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:31.930484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6cdff-0a78-4dd5-947e-250b3e2b1484 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:31.930766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6cdff-0a78-4dd5-947e-250b3e2b1484 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:31.931428 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6cdff-0a78-4dd5-947e-250b3e2b1484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:31.933391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6cdff-0a78-4dd5-947e-250b3e2b1484 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:31.960787 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4280/8575] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:27:31 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:27:31.964946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe86be8-21c0-478e-9991-0c1ceae98921 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:31.975942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe86be8-21c0-478e-9991-0c1ceae98921 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:32.024424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:32.034367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124c881-0b54-43bd-b943-f970513994d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:32.035016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124c881-0b54-43bd-b943-f970513994d0 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:32.035299 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124c881-0b54-43bd-b943-f970513994d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:32.035584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124c881-0b54-43bd-b943-f970513994d0 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:32.036218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124c881-0b54-43bd-b943-f970513994d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:32.038250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124c881-0b54-43bd-b943-f970513994d0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:32.059092 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4296/8576] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:27:31 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:27:32.063761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6cdff-0a78-4dd5-947e-250b3e2b1484 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:32.074180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6cdff-0a78-4dd5-947e-250b3e2b1484 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:32.078737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df51c49-e596-4523-8663-ce011a61e0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:32.079341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df51c49-e596-4523-8663-ce011a61e0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:32.079622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df51c49-e596-4523-8663-ce011a61e0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:32.079895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df51c49-e596-4523-8663-ce011a61e0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:32.080535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df51c49-e596-4523-8663-ce011a61e0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:32.082151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df51c49-e596-4523-8663-ce011a61e0d4 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:32.093585 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4281/8577] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:27:32.097787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124c881-0b54-43bd-b943-f970513994d0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:32.108290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124c881-0b54-43bd-b943-f970513994d0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:32.113308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf21d8-8dbd-4dfc-86ef-14bbe4ff6837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:32.114043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf21d8-8dbd-4dfc-86ef-14bbe4ff6837 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:32.114378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf21d8-8dbd-4dfc-86ef-14bbe4ff6837 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:32.114664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf21d8-8dbd-4dfc-86ef-14bbe4ff6837 admin admin] PATH_INFO: `/v3/projects/bfd3d258fa484de9810ee01435471b70/users/4a0fce05417b4cc691cc4879e616cde9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:32.130338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf21d8-8dbd-4dfc-86ef-14bbe4ff6837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd3d258fa484de9810ee01435471b70, user_id=4a0fce05417b4cc691cc4879e616cde9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:32.133027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf21d8-8dbd-4dfc-86ef-14bbe4ff6837 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:32.146453 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4297/8578] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:27:32 2022] PUT /identity/v3/projects/bfd3d258fa484de9810ee01435471b70/users/4a0fce05417b4cc691cc4879e616cde9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:32.150574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df51c49-e596-4523-8663-ce011a61e0d4 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:32.161804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df51c49-e596-4523-8663-ce011a61e0d4 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:32.210227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:32.226576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca2c37-1aeb-4f26-a5b6-c8fff8dc456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:32.227301 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca2c37-1aeb-4f26-a5b6-c8fff8dc456c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:32.227580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca2c37-1aeb-4f26-a5b6-c8fff8dc456c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:32.227852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca2c37-1aeb-4f26-a5b6-c8fff8dc456c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:32.228516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca2c37-1aeb-4f26-a5b6-c8fff8dc456c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:32.230462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca2c37-1aeb-4f26-a5b6-c8fff8dc456c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:32.241416 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4282/8579] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:27:32.245674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf21d8-8dbd-4dfc-86ef-14bbe4ff6837 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:32.258776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf21d8-8dbd-4dfc-86ef-14bbe4ff6837 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:32.264993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cd746-ceab-4fe8-81de-09a62185c17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:32.266306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cd746-ceab-4fe8-81de-09a62185c17f admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:32.266659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cd746-ceab-4fe8-81de-09a62185c17f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:32.267019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cd746-ceab-4fe8-81de-09a62185c17f admin admin] PATH_INFO: `/v3/projects/bfd3d258fa484de9810ee01435471b70/users/4a0fce05417b4cc691cc4879e616cde9/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:32.269094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cd746-ceab-4fe8-81de-09a62185c17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd3d258fa484de9810ee01435471b70, user_id=4a0fce05417b4cc691cc4879e616cde9, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:32.279162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cd746-ceab-4fe8-81de-09a62185c17f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:32.290962 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4298/8580] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:27:32 2022] PUT /identity/v3/projects/bfd3d258fa484de9810ee01435471b70/users/4a0fce05417b4cc691cc4879e616cde9/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:27:36.800336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd10f-db9f-4bb9-b84f-1ee2d83bfa4d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:36.800804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd10f-db9f-4bb9-b84f-1ee2d83bfa4d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:36.801155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd10f-db9f-4bb9-b84f-1ee2d83bfa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:36.833498 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-196cd10f-db9f-4bb9-b84f-1ee2d83bfa4d None None] MFA Rules not processed for user `4a0fce05417b4cc691cc4879e616cde9`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:36.834978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-196cd10f-db9f-4bb9-b84f-1ee2d83bfa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:36.925673 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4283/8581] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:36.940035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cd746-ceab-4fe8-81de-09a62185c17f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:36.942138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e96cd746-ceab-4fe8-81de-09a62185c17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:37.032692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cd746-ceab-4fe8-81de-09a62185c17f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:37.038379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bb5ca-e230-4347-8f47-7ffc74a79602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:37.039052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bb5ca-e230-4347-8f47-7ffc74a79602 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:37.039331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bb5ca-e230-4347-8f47-7ffc74a79602 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:37.039601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bb5ca-e230-4347-8f47-7ffc74a79602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:37.099720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bb5ca-e230-4347-8f47-7ffc74a79602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:37.101369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bb5ca-e230-4347-8f47-7ffc74a79602 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:37.112149 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4299/8582] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:38.259331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db0f6d-c487-47ac-9aee-417effc9763f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:38.259776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db0f6d-c487-47ac-9aee-417effc9763f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:38.259903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db0f6d-c487-47ac-9aee-417effc9763f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:38.279948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d2db0f6d-c487-47ac-9aee-417effc9763f None None] MFA Rules not processed for user `6100a1568dd042e58ce63e4b30a87429`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:27:38.281157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d2db0f6d-c487-47ac-9aee-417effc9763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:38.288152 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4284/8583] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:27:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:27:38.925492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bb5ca-e230-4347-8f47-7ffc74a79602 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:38.926953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7c4bb5ca-e230-4347-8f47-7ffc74a79602 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:38.975028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:38.990994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bb5ca-e230-4347-8f47-7ffc74a79602 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:38.994981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520a678-34ca-4fab-8110-f7b0fcb61bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:38.995580 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a678-34ca-4fab-8110-f7b0fcb61bfe service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:38.995864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a678-34ca-4fab-8110-f7b0fcb61bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:38.996140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520a678-34ca-4fab-8110-f7b0fcb61bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:38.997900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d520a678-34ca-4fab-8110-f7b0fcb61bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:39.010707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520a678-34ca-4fab-8110-f7b0fcb61bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:39.012154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520a678-34ca-4fab-8110-f7b0fcb61bfe service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:39.023822 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4300/8584] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:41.321795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db0f6d-c487-47ac-9aee-417effc9763f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:41.340248 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db0f6d-c487-47ac-9aee-417effc9763f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:41.344825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cd337-e104-4358-85c9-7f84c43aa2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:41.345701 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cd337-e104-4358-85c9-7f84c43aa2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:41.345984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cd337-e104-4358-85c9-7f84c43aa2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:41.346257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cd337-e104-4358-85c9-7f84c43aa2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:41.348249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-622cd337-e104-4358-85c9-7f84c43aa2b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:41.362467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cd337-e104-4358-85c9-7f84c43aa2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:41.364431 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cd337-e104-4358-85c9-7f84c43aa2b2 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:41.378664 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4285/8585] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:46.263637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520a678-34ca-4fab-8110-f7b0fcb61bfe service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:46.278957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520a678-34ca-4fab-8110-f7b0fcb61bfe service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:46.284428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd9c4b-b995-4c61-b940-04a635d52326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:46.285014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd9c4b-b995-4c61-b940-04a635d52326 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:46.285326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd9c4b-b995-4c61-b940-04a635d52326 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:46.285598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd9c4b-b995-4c61-b940-04a635d52326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:46.287312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f1dd9c4b-b995-4c61-b940-04a635d52326 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:46.302393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd9c4b-b995-4c61-b940-04a635d52326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:46.304200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd9c4b-b995-4c61-b940-04a635d52326 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:46.317604 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4301/8586] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:46.421492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cd337-e104-4358-85c9-7f84c43aa2b2 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:46.433782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cd337-e104-4358-85c9-7f84c43aa2b2 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:46.438319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae78b17-0b1a-4345-a649-898f33dc01c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:46.438955 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae78b17-0b1a-4345-a649-898f33dc01c9 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:46.439237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae78b17-0b1a-4345-a649-898f33dc01c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:46.439514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae78b17-0b1a-4345-a649-898f33dc01c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:46.441311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fae78b17-0b1a-4345-a649-898f33dc01c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:27:46.455202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae78b17-0b1a-4345-a649-898f33dc01c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:46.456869 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae78b17-0b1a-4345-a649-898f33dc01c9 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:46.468831 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4286/8587] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:50.855502 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd9c4b-b995-4c61-b940-04a635d52326 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:27:50.868144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd9c4b-b995-4c61-b940-04a635d52326 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:27:50.871735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccf7f8-3314-4838-a96b-80d00aabbe72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:27:50.873001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccf7f8-3314-4838-a96b-80d00aabbe72 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:27:50.873315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccf7f8-3314-4838-a96b-80d00aabbe72 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:27:50.873591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccf7f8-3314-4838-a96b-80d00aabbe72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:27:50.882508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccf7f8-3314-4838-a96b-80d00aabbe72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:27:50.883933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccf7f8-3314-4838-a96b-80d00aabbe72 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:27:50.893411 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4302/8588] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:27:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:27:56.462027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=57 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:00.889270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=19 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:27.811909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae78b17-0b1a-4345-a649-898f33dc01c9 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:28:27.823386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae78b17-0b1a-4345-a649-898f33dc01c9 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:28:27.826956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f2bba-650c-46c5-bdfa-91bbfb7ed06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:28:27.827618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f2bba-650c-46c5-bdfa-91bbfb7ed06b service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:28:27.827897 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f2bba-650c-46c5-bdfa-91bbfb7ed06b service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:28:27.828169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f2bba-650c-46c5-bdfa-91bbfb7ed06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:28:27.829877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-214f2bba-650c-46c5-bdfa-91bbfb7ed06b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:28:27.842102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f2bba-650c-46c5-bdfa-91bbfb7ed06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:28:27.843508 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f2bba-650c-46c5-bdfa-91bbfb7ed06b service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:28:27.853713 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4287/8589] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:28:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:28:32.355970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccf7f8-3314-4838-a96b-80d00aabbe72 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:28:32.358477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d4ccf7f8-3314-4838-a96b-80d00aabbe72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:28:32.379842 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccf7f8-3314-4838-a96b-80d00aabbe72 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:28:32.386159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b80fe4-1d2d-4f05-a0de-3ebe342f31d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:28:32.386833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b80fe4-1d2d-4f05-a0de-3ebe342f31d8 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:28:32.387117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b80fe4-1d2d-4f05-a0de-3ebe342f31d8 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:28:32.387391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b80fe4-1d2d-4f05-a0de-3ebe342f31d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:28:32.389170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c8b80fe4-1d2d-4f05-a0de-3ebe342f31d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:28:32.404714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b80fe4-1d2d-4f05-a0de-3ebe342f31d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:28:32.406444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b80fe4-1d2d-4f05-a0de-3ebe342f31d8 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:28:32.420447 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4303/8590] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:28:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:28:37.018426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f2bba-650c-46c5-bdfa-91bbfb7ed06b service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:28:37.020514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-214f2bba-650c-46c5-bdfa-91bbfb7ed06b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:28:37.099913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f2bba-650c-46c5-bdfa-91bbfb7ed06b service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:28:37.105133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f32ce-626d-4330-b1ad-bf950a67ac77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:28:37.105777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f32ce-626d-4330-b1ad-bf950a67ac77 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:28:37.106055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f32ce-626d-4330-b1ad-bf950a67ac77 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:28:37.106325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f32ce-626d-4330-b1ad-bf950a67ac77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:28:37.108306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-003f32ce-626d-4330-b1ad-bf950a67ac77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:28:37.122685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f32ce-626d-4330-b1ad-bf950a67ac77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:28:37.124267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f32ce-626d-4330-b1ad-bf950a67ac77 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:28:37.137878 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4288/8591] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:28:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:28:42.412857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:42.783969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f37047-3cea-455f-a2b0-7b19836ad35e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:28:42.784305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f37047-3cea-455f-a2b0-7b19836ad35e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:28:42.784592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f37047-3cea-455f-a2b0-7b19836ad35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:28:42.804893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-04f37047-3cea-455f-a2b0-7b19836ad35e None None] MFA Rules not processed for user `8219a93945a147c4a57bb6452212fe7c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:28:42.806279 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-04f37047-3cea-455f-a2b0-7b19836ad35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:28:42.869074 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4304/8592] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:28:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:28:43.682400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f32ce-626d-4330-b1ad-bf950a67ac77 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:28:43.707786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f32ce-626d-4330-b1ad-bf950a67ac77 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:28:43.729066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69bf0a-1076-43d7-822d-44395bec402b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:28:43.729770 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69bf0a-1076-43d7-822d-44395bec402b service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:28:43.730056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69bf0a-1076-43d7-822d-44395bec402b service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:28:43.731433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69bf0a-1076-43d7-822d-44395bec402b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:28:43.736338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6e69bf0a-1076-43d7-822d-44395bec402b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:28:43.765042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69bf0a-1076-43d7-822d-44395bec402b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:28:43.767172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69bf0a-1076-43d7-822d-44395bec402b service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:28:43.786653 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4289/8593] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:28:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:28:52.861071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=25 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:53.013231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f37047-3cea-455f-a2b0-7b19836ad35e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:28:53.030720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f37047-3cea-455f-a2b0-7b19836ad35e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:28:53.036177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1b4c5-881a-4a83-b2fb-d909b5cd383c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:28:53.036781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1b4c5-881a-4a83-b2fb-d909b5cd383c service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:28:53.037058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1b4c5-881a-4a83-b2fb-d909b5cd383c service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:28:53.037366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1b4c5-881a-4a83-b2fb-d909b5cd383c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:28:53.039106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0fa1b4c5-881a-4a83-b2fb-d909b5cd383c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:28:53.055029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1b4c5-881a-4a83-b2fb-d909b5cd383c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:28:53.056615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1b4c5-881a-4a83-b2fb-d909b5cd383c service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:28:53.070687 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4305/8594] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:28:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:28:53.776536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=44 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:29:03.063430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:29:21.272775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69bf0a-1076-43d7-822d-44395bec402b service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:29:21.290413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69bf0a-1076-43d7-822d-44395bec402b service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:29:21.296079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c987d-e117-4e91-af75-5fc5277dc8e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:29:21.296704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c987d-e117-4e91-af75-5fc5277dc8e3 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:29:21.296981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c987d-e117-4e91-af75-5fc5277dc8e3 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:29:21.297809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c987d-e117-4e91-af75-5fc5277dc8e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:29:21.299550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-034c987d-e117-4e91-af75-5fc5277dc8e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:29:21.310924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c987d-e117-4e91-af75-5fc5277dc8e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:29:21.312476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c987d-e117-4e91-af75-5fc5277dc8e3 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:29:21.323114 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4290/8595] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:29:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:29:31.318109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:29:32.979340 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1b4c5-881a-4a83-b2fb-d909b5cd383c service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:29:32.993417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1b4c5-881a-4a83-b2fb-d909b5cd383c service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:29:32.998832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fed1bf-89b5-4288-a13f-b643d65e7546 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:29:32.999428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fed1bf-89b5-4288-a13f-b643d65e7546 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:29:32.999707 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fed1bf-89b5-4288-a13f-b643d65e7546 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:29:33.000478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fed1bf-89b5-4288-a13f-b643d65e7546 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:29:33.002376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-13fed1bf-89b5-4288-a13f-b643d65e7546 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:29:33.064982 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fed1bf-89b5-4288-a13f-b643d65e7546 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:29:33.066604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fed1bf-89b5-4288-a13f-b643d65e7546 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:29:33.077270 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4306/8596] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:29:32 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:29:33.584386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c987d-e117-4e91-af75-5fc5277dc8e3 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:29:33.596450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c987d-e117-4e91-af75-5fc5277dc8e3 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:29:33.600018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc754f54-cc4b-47c4-9433-56543a1abc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:29:33.600595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc754f54-cc4b-47c4-9433-56543a1abc51 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:29:33.600899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc754f54-cc4b-47c4-9433-56543a1abc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:29:33.601164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc754f54-cc4b-47c4-9433-56543a1abc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:29:33.602884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fc754f54-cc4b-47c4-9433-56543a1abc51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:29:33.615296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc754f54-cc4b-47c4-9433-56543a1abc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:29:33.616688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc754f54-cc4b-47c4-9433-56543a1abc51 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:29:33.627579 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4291/8597] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:29:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:29:33.715375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fed1bf-89b5-4288-a13f-b643d65e7546 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:29:33.727814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fed1bf-89b5-4288-a13f-b643d65e7546 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:29:33.731449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b82b13-f9be-41f5-ad31-38788cebc912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:29:33.732046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b82b13-f9be-41f5-ad31-38788cebc912 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:29:33.732329 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b82b13-f9be-41f5-ad31-38788cebc912 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:29:33.732604 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b82b13-f9be-41f5-ad31-38788cebc912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:29:33.735174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-89b82b13-f9be-41f5-ad31-38788cebc912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:29:33.751257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b82b13-f9be-41f5-ad31-38788cebc912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:29:33.752724 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b82b13-f9be-41f5-ad31-38788cebc912 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:29:33.766586 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4307/8598] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:29:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:29:43.620985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:29:43.759019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=36 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:29:49.277067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc754f54-cc4b-47c4-9433-56543a1abc51 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:29:49.296538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc754f54-cc4b-47c4-9433-56543a1abc51 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:29:49.318037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31675b90-2e5e-4815-a615-a10092f5702f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:29:49.318687 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31675b90-2e5e-4815-a615-a10092f5702f service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:29:49.318971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31675b90-2e5e-4815-a615-a10092f5702f service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:29:49.319404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31675b90-2e5e-4815-a615-a10092f5702f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:29:49.321446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-31675b90-2e5e-4815-a615-a10092f5702f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:29:49.375628 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31675b90-2e5e-4815-a615-a10092f5702f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:29:49.378001 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31675b90-2e5e-4815-a615-a10092f5702f service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:29:49.399484 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4292/8599] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:29:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:29:55.098927 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98c8d-6e54-4c25-9e9d-a36799febac5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:29:55.099836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98c8d-6e54-4c25-9e9d-a36799febac5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:29:55.100314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98c8d-6e54-4c25-9e9d-a36799febac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:29:55.120838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b4f98c8d-6e54-4c25-9e9d-a36799febac5 None None] MFA Rules not processed for user `8219a93945a147c4a57bb6452212fe7c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:29:55.122388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b4f98c8d-6e54-4c25-9e9d-a36799febac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:29:55.133982 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4308/8600] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:29:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:29:56.485261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31675b90-2e5e-4815-a615-a10092f5702f service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:29:56.486690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-31675b90-2e5e-4815-a615-a10092f5702f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:29:56.505240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31675b90-2e5e-4815-a615-a10092f5702f service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:29:56.510725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43e2c5-37e3-48e6-b605-2fd02073fd86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:29:56.511584 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43e2c5-37e3-48e6-b605-2fd02073fd86 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:29:56.511872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43e2c5-37e3-48e6-b605-2fd02073fd86 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:29:56.512147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43e2c5-37e3-48e6-b605-2fd02073fd86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:29:56.514440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4d43e2c5-37e3-48e6-b605-2fd02073fd86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:29:56.529269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43e2c5-37e3-48e6-b605-2fd02073fd86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:29:56.530867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43e2c5-37e3-48e6-b605-2fd02073fd86 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:29:56.543957 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4293/8601] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:29:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:30:01.521591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98c8d-6e54-4c25-9e9d-a36799febac5 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:30:01.536225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98c8d-6e54-4c25-9e9d-a36799febac5 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:30:01.541053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6db17c-3342-45cc-9cf6-29d64e76211c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:30:01.541681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db17c-3342-45cc-9cf6-29d64e76211c service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:30:01.541956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db17c-3342-45cc-9cf6-29d64e76211c service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:30:01.542225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db17c-3342-45cc-9cf6-29d64e76211c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:30:01.544004 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-df6db17c-3342-45cc-9cf6-29d64e76211c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:30:01.558911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6db17c-3342-45cc-9cf6-29d64e76211c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:30:01.560497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6db17c-3342-45cc-9cf6-29d64e76211c service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:30:01.573240 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4309/8602] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:30:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:30:06.537074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=17 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:30:11.566420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=9 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:50.348155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43e2c5-37e3-48e6-b605-2fd02073fd86 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:50.349895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4d43e2c5-37e3-48e6-b605-2fd02073fd86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:31:50.423394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43e2c5-37e3-48e6-b605-2fd02073fd86 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:50.427837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:50.428457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:50.428734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:50.429004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] PATH_INFO: `/v3/users/8219a93945a147c4a57bb6452212fe7c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:50.430160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8219a93945a147c4a57bb6452212fe7c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:50.432037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:50.488183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8219a93945a147c4a57bb6452212fe7c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:50.495646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8219a93945a147c4a57bb6452212fe7c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:50.496884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8219a93945a147c4a57bb6452212fe7c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:50.497552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8219a93945a147c4a57bb6452212fe7c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:50.512826 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8219a93945a147c4a57bb6452212fe7c'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:50.529884 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4294/8603] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:31:50 2022] DELETE /identity/v3/users/8219a93945a147c4a57bb6452212fe7c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:31:50.534496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da09e7-39e6-460a-bcb9-fe9a01e19e0a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:50.534969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da09e7-39e6-460a-bcb9-fe9a01e19e0a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:50.535064 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da09e7-39e6-460a-bcb9-fe9a01e19e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:50.558452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e9da09e7-39e6-460a-bcb9-fe9a01e19e0a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:31:50.560184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e9da09e7-39e6-460a-bcb9-fe9a01e19e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:31:50.619867 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4310/8604] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:31:50.630195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:50.631577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:31:50.703028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb4af3-e27a-43d5-b1d1-6dcfaaed651a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:50.706618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ac920-c2f8-42d1-8a54-766e23f5dc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:50.707220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ac920-c2f8-42d1-8a54-766e23f5dc10 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:50.707496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ac920-c2f8-42d1-8a54-766e23f5dc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:50.707766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ac920-c2f8-42d1-8a54-766e23f5dc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:50.716634 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ac920-c2f8-42d1-8a54-766e23f5dc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:50.718083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ac920-c2f8-42d1-8a54-766e23f5dc10 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:50.727579 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4295/8605] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:31:50.893135 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da09e7-39e6-460a-bcb9-fe9a01e19e0a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:50.894561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e9da09e7-39e6-460a-bcb9-fe9a01e19e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:31:50.907313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da09e7-39e6-460a-bcb9-fe9a01e19e0a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:50.911933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:50.912630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:50.912913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:50.913209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] PATH_INFO: `/v3/projects/3eeb6be960cc408296ecce6353b72f6d` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:50.914438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eeb6be960cc408296ecce6353b72f6d)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:50.916612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:50.963388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eeb6be960cc408296ecce6353b72f6d', 'request_id': 'req-15c7c159-4344-44ca-bb05-7f73f9decb8f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:50.969815 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eeb6be960cc408296ecce6353b72f6d', 'request_id': 'req-15c7c159-4344-44ca-bb05-7f73f9decb8f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:50.976067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eeb6be960cc408296ecce6353b72f6d', 'request_id': 'req-15c7c159-4344-44ca-bb05-7f73f9decb8f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:50.987914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] The token cache is being invalidate because project 3eeb6be960cc408296ecce6353b72f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:31:50.988199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:50.988832 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:50.990342 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4311/8606] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:31:50 2022] DELETE /identity/v3/projects/3eeb6be960cc408296ecce6353b72f6d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:31:50.994343 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ac920-c2f8-42d1-8a54-766e23f5dc10 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:51.001013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:51.006092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ac920-c2f8-42d1-8a54-766e23f5dc10 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:51.064202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833b688-cceb-4739-9a6c-a0240ecda4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:51.064824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833b688-cceb-4739-9a6c-a0240ecda4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:51.065101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833b688-cceb-4739-9a6c-a0240ecda4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:51.065483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833b688-cceb-4739-9a6c-a0240ecda4ae admin admin] PATH_INFO: `/v3/users/a691762d84b24f50926fa20dfc4d4ad9` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:51.066591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833b688-cceb-4739-9a6c-a0240ecda4ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a691762d84b24f50926fa20dfc4d4ad9)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:51.068468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833b688-cceb-4739-9a6c-a0240ecda4ae admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:51.112966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5833b688-cceb-4739-9a6c-a0240ecda4ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a691762d84b24f50926fa20dfc4d4ad9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:51.119754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5833b688-cceb-4739-9a6c-a0240ecda4ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a691762d84b24f50926fa20dfc4d4ad9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:51.120379 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5833b688-cceb-4739-9a6c-a0240ecda4ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a691762d84b24f50926fa20dfc4d4ad9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:51.120977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5833b688-cceb-4739-9a6c-a0240ecda4ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a691762d84b24f50926fa20dfc4d4ad9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:51.133005 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-5833b688-cceb-4739-9a6c-a0240ecda4ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a691762d84b24f50926fa20dfc4d4ad9'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:51.145947 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4296/8607] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:31:50 2022] DELETE /identity/v3/users/a691762d84b24f50926fa20dfc4d4ad9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:31:51.323304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:51.325482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:31:51.342173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c159-4344-44ca-bb05-7f73f9decb8f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:51.403391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:51.404027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:51.404307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:51.404583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227 admin admin] PATH_INFO: `/v3/projects/3661b4b41b604beea175732bb476f4a7` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:51.405755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3661b4b41b604beea175732bb476f4a7)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:51.407665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:51.438550 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:51.456848 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3661b4b41b604beea175732bb476f4a7', 'request_id': 'req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:51.463603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3661b4b41b604beea175732bb476f4a7', 'request_id': 'req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:51.469491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3661b4b41b604beea175732bb476f4a7', 'request_id': 'req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:51.481997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227 admin admin] The token cache is being invalidate because project 3661b4b41b604beea175732bb476f4a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:31:51.482289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:51.482944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6e9aad59-d7ee-4376-bf2c-2b61c4e9d227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:31:51.484439 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4312/8608] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:31:51 2022] DELETE /identity/v3/projects/3661b4b41b604beea175732bb476f4a7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:31:51.490013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f410e-9d11-47a5-8034-b9940429b834 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:51.490483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f410e-9d11-47a5-8034-b9940429b834 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:51.490595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f410e-9d11-47a5-8034-b9940429b834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:51.512272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e45f410e-9d11-47a5-8034-b9940429b834 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:31:51.513512 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e45f410e-9d11-47a5-8034-b9940429b834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:31:51.571609 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4297/8609] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:31:51.580774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a37ef7-34cd-457c-ba00-052a3129be6a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:51.581304 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a37ef7-34cd-457c-ba00-052a3129be6a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:51.581436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a37ef7-34cd-457c-ba00-052a3129be6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:51.601491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-31a37ef7-34cd-457c-ba00-052a3129be6a None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:31:51.602690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-31a37ef7-34cd-457c-ba00-052a3129be6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:31:51.611072 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4313/8610] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:31:51.615286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f410e-9d11-47a5-8034-b9940429b834 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:51.625565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f410e-9d11-47a5-8034-b9940429b834 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:51.630083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19452df5-d1a2-490a-a2f2-7033cfea4135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:51.630676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19452df5-d1a2-490a-a2f2-7033cfea4135 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:51.630952 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19452df5-d1a2-490a-a2f2-7033cfea4135 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:51.631221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19452df5-d1a2-490a-a2f2-7033cfea4135 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:51.631859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19452df5-d1a2-490a-a2f2-7033cfea4135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:31:51.632160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19452df5-d1a2-490a-a2f2-7033cfea4135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:51.633760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19452df5-d1a2-490a-a2f2-7033cfea4135 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:51.646646 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4298/8611] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:31:51.651075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a37ef7-34cd-457c-ba00-052a3129be6a None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:51.660455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a37ef7-34cd-457c-ba00-052a3129be6a None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:51.665230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36a69d-dc2f-47cb-b3e0-fd0e8782a6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:51.665827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36a69d-dc2f-47cb-b3e0-fd0e8782a6da admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:51.666107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36a69d-dc2f-47cb-b3e0-fd0e8782a6da admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:51.666380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36a69d-dc2f-47cb-b3e0-fd0e8782a6da admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:51.666999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36a69d-dc2f-47cb-b3e0-fd0e8782a6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:51.669461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36a69d-dc2f-47cb-b3e0-fd0e8782a6da admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:51.697574 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4314/8612] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:31:51 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:31:51.701659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19452df5-d1a2-490a-a2f2-7033cfea4135 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:51.711873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19452df5-d1a2-490a-a2f2-7033cfea4135 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:51.719626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:51.770353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3691c75-7823-4d4b-915d-f79e4402dae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:51.771056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3691c75-7823-4d4b-915d-f79e4402dae7 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:51.771358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3691c75-7823-4d4b-915d-f79e4402dae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:51.771670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3691c75-7823-4d4b-915d-f79e4402dae7 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:51.772303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3691c75-7823-4d4b-915d-f79e4402dae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:51.774229 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3691c75-7823-4d4b-915d-f79e4402dae7 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:51.795675 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4299/8613] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:31:51 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:31:51.799752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36a69d-dc2f-47cb-b3e0-fd0e8782a6da admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:51.810126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36a69d-dc2f-47cb-b3e0-fd0e8782a6da admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:51.814669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e720ae-9f0e-45cd-a082-a2b63028e6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:51.815269 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e720ae-9f0e-45cd-a082-a2b63028e6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:51.815543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e720ae-9f0e-45cd-a082-a2b63028e6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:51.815812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e720ae-9f0e-45cd-a082-a2b63028e6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:51.816437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e720ae-9f0e-45cd-a082-a2b63028e6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:51.818048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e720ae-9f0e-45cd-a082-a2b63028e6e7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:51.827889 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4315/8614] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:31:51.831790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3691c75-7823-4d4b-915d-f79e4402dae7 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:51.842683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3691c75-7823-4d4b-915d-f79e4402dae7 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:51.847257 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c5f52-071a-4815-b287-117e3133c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:51.847852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c5f52-071a-4815-b287-117e3133c56d admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:51.848131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c5f52-071a-4815-b287-117e3133c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:51.848405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c5f52-071a-4815-b287-117e3133c56d admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:51.849040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c5f52-071a-4815-b287-117e3133c56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:51.850911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c5f52-071a-4815-b287-117e3133c56d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:51.862159 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4300/8615] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:31:51.866226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e720ae-9f0e-45cd-a082-a2b63028e6e7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:51.876210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e720ae-9f0e-45cd-a082-a2b63028e6e7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:51.880821 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299796bd-aed2-4b73-8d30-10956af7b755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:51.881543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299796bd-aed2-4b73-8d30-10956af7b755 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:51.882150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299796bd-aed2-4b73-8d30-10956af7b755 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:51.882664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299796bd-aed2-4b73-8d30-10956af7b755 admin admin] PATH_INFO: `/v3/projects/83ec57e206564c6ea7676aa86bd6e369/users/4c2c620715814d3ea000ae6c0dd21f0a/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:51.897702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299796bd-aed2-4b73-8d30-10956af7b755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ec57e206564c6ea7676aa86bd6e369, user_id=4c2c620715814d3ea000ae6c0dd21f0a, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:51.900306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299796bd-aed2-4b73-8d30-10956af7b755 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:51.913777 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4316/8616] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:31:51 2022] PUT /identity/v3/projects/83ec57e206564c6ea7676aa86bd6e369/users/4c2c620715814d3ea000ae6c0dd21f0a/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:31:51.919528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e36fa7-8e3d-4624-ac23-aa0e23a7577f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:51.919816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e36fa7-8e3d-4624-ac23-aa0e23a7577f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:51.920089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e36fa7-8e3d-4624-ac23-aa0e23a7577f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:51.938965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-28e36fa7-8e3d-4624-ac23-aa0e23a7577f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:31:51.940175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-28e36fa7-8e3d-4624-ac23-aa0e23a7577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:31:51.998316 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4301/8617] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:31:52.008012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299796bd-aed2-4b73-8d30-10956af7b755 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:52.009734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-299796bd-aed2-4b73-8d30-10956af7b755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:31:52.070779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299796bd-aed2-4b73-8d30-10956af7b755 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:52.074521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb4c83-d11b-449a-9e60-fa1b6e291220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:52.075146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb4c83-d11b-449a-9e60-fa1b6e291220 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:52.075428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb4c83-d11b-449a-9e60-fa1b6e291220 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:52.075706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb4c83-d11b-449a-9e60-fa1b6e291220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:52.084625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb4c83-d11b-449a-9e60-fa1b6e291220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:52.086093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb4c83-d11b-449a-9e60-fa1b6e291220 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:52.096070 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4317/8618] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:31:52.723794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d2f63-3b7f-4ce1-9c65-27ab6c702af6 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:52.724554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d2f63-3b7f-4ce1-9c65-27ab6c702af6 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:52.724656 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d2f63-3b7f-4ce1-9c65-27ab6c702af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:52.754247 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8c6d2f63-3b7f-4ce1-9c65-27ab6c702af6 None None] MFA Rules not processed for user `4c2c620715814d3ea000ae6c0dd21f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:31:52.755496 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8c6d2f63-3b7f-4ce1-9c65-27ab6c702af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:31:52.822346 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4302/8619] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:31:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:31:52.827511 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb4c83-d11b-449a-9e60-fa1b6e291220 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:52.839078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb4c83-d11b-449a-9e60-fa1b6e291220 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:52.846698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c87b8-0cac-4d35-be7d-a4ec8742c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:52.847512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c87b8-0cac-4d35-be7d-a4ec8742c938 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:52.847789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c87b8-0cac-4d35-be7d-a4ec8742c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:52.848110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c87b8-0cac-4d35-be7d-a4ec8742c938 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:52.848890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c87b8-0cac-4d35-be7d-a4ec8742c938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:52.851488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c87b8-0cac-4d35-be7d-a4ec8742c938 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:52.881224 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4318/8620] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:31:52 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:31:52.885336 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d2f63-3b7f-4ce1-9c65-27ab6c702af6 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:52.897035 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d2f63-3b7f-4ce1-9c65-27ab6c702af6 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:52.913739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:52.955106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11053fe0-387a-4b2e-925f-84a1317c9a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:52.955720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11053fe0-387a-4b2e-925f-84a1317c9a74 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:52.956002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11053fe0-387a-4b2e-925f-84a1317c9a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:52.956277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11053fe0-387a-4b2e-925f-84a1317c9a74 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:52.956911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11053fe0-387a-4b2e-925f-84a1317c9a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:52.958855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11053fe0-387a-4b2e-925f-84a1317c9a74 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:52.980097 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4303/8621] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:31:52 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:31:52.984540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c87b8-0cac-4d35-be7d-a4ec8742c938 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:52.994952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c87b8-0cac-4d35-be7d-a4ec8742c938 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:53.000188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d30f0d-271b-4146-80be-6681ddc6f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:53.000776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d30f0d-271b-4146-80be-6681ddc6f9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:53.001052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d30f0d-271b-4146-80be-6681ddc6f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:53.001361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d30f0d-271b-4146-80be-6681ddc6f9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:53.001988 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d30f0d-271b-4146-80be-6681ddc6f9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:53.003559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d30f0d-271b-4146-80be-6681ddc6f9b2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:53.014174 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4319/8622] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:31:53.018064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11053fe0-387a-4b2e-925f-84a1317c9a74 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:53.028418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11053fe0-387a-4b2e-925f-84a1317c9a74 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:53.033047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f75b24-9886-4f3b-9ecc-bd025f025840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:53.033738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f75b24-9886-4f3b-9ecc-bd025f025840 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:53.034020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f75b24-9886-4f3b-9ecc-bd025f025840 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:53.034298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f75b24-9886-4f3b-9ecc-bd025f025840 admin admin] PATH_INFO: `/v3/projects/cd3fd850d2024a8683c5625b41703f9b/users/bb4f0c52a9f04c1ab41d9a75c98cfaa8/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:53.049861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f75b24-9886-4f3b-9ecc-bd025f025840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3fd850d2024a8683c5625b41703f9b, user_id=bb4f0c52a9f04c1ab41d9a75c98cfaa8, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:53.052545 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f75b24-9886-4f3b-9ecc-bd025f025840 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:53.065737 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4304/8623] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:31:53 2022] PUT /identity/v3/projects/cd3fd850d2024a8683c5625b41703f9b/users/bb4f0c52a9f04c1ab41d9a75c98cfaa8/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:31:53.069681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d30f0d-271b-4146-80be-6681ddc6f9b2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:53.079649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d30f0d-271b-4146-80be-6681ddc6f9b2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:53.095646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:53.136973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836f38c-5f4d-4bd6-9047-71024d334739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:53.137612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836f38c-5f4d-4bd6-9047-71024d334739 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:53.137887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836f38c-5f4d-4bd6-9047-71024d334739 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:53.138163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836f38c-5f4d-4bd6-9047-71024d334739 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:53.138788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836f38c-5f4d-4bd6-9047-71024d334739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:53.140380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836f38c-5f4d-4bd6-9047-71024d334739 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:53.149796 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4320/8624] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:31:53.153992 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f75b24-9886-4f3b-9ecc-bd025f025840 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:53.164328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f75b24-9886-4f3b-9ecc-bd025f025840 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:53.169504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedddcc2-502b-4a09-bdfd-d3dd85650fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:53.170151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedddcc2-502b-4a09-bdfd-d3dd85650fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:53.170433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedddcc2-502b-4a09-bdfd-d3dd85650fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:53.170705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedddcc2-502b-4a09-bdfd-d3dd85650fc9 admin admin] PATH_INFO: `/v3/projects/cd3fd850d2024a8683c5625b41703f9b/users/bb4f0c52a9f04c1ab41d9a75c98cfaa8/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:53.172645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedddcc2-502b-4a09-bdfd-d3dd85650fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3fd850d2024a8683c5625b41703f9b, user_id=bb4f0c52a9f04c1ab41d9a75c98cfaa8, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:53.175294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedddcc2-502b-4a09-bdfd-d3dd85650fc9 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:53.185814 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4305/8625] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:31:53 2022] PUT /identity/v3/projects/cd3fd850d2024a8683c5625b41703f9b/users/bb4f0c52a9f04c1ab41d9a75c98cfaa8/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:31:53.822798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188287-6406-4ffe-823c-39239089574c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:53.822798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188287-6406-4ffe-823c-39239089574c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:53.823038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188287-6406-4ffe-823c-39239089574c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:53.852430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1b188287-6406-4ffe-823c-39239089574c None None] MFA Rules not processed for user `bb4f0c52a9f04c1ab41d9a75c98cfaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:31:53.853603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1b188287-6406-4ffe-823c-39239089574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:31:53.927174 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4321/8626] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:31:53.937820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb291394-48e0-4b4d-928b-7e9831a5c7ed None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:53.938386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb291394-48e0-4b4d-928b-7e9831a5c7ed None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:53.938386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb291394-48e0-4b4d-928b-7e9831a5c7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:53.957811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-cb291394-48e0-4b4d-928b-7e9831a5c7ed None None] MFA Rules not processed for user `4c2c620715814d3ea000ae6c0dd21f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:31:53.959074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cb291394-48e0-4b4d-928b-7e9831a5c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:31:54.018828 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4306/8627] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:31:54.031576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188287-6406-4ffe-823c-39239089574c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:31:54.033177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1b188287-6406-4ffe-823c-39239089574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:31:54.137597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188287-6406-4ffe-823c-39239089574c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:31:54.143051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc9ea3-c945-41e9-acd7-54b58992b80f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:31:54.143657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc9ea3-c945-41e9-acd7-54b58992b80f service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:31:54.143957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc9ea3-c945-41e9-acd7-54b58992b80f service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:31:54.144213 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc9ea3-c945-41e9-acd7-54b58992b80f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:31:54.151880 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc9ea3-c945-41e9-acd7-54b58992b80f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:31:54.153587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc9ea3-c945-41e9-acd7-54b58992b80f service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:31:54.158099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:54.163003 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4322/8628] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:31:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:32:04.011520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=60,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:17.314607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb291394-48e0-4b4d-928b-7e9831a5c7ed None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:17.377781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb291394-48e0-4b4d-928b-7e9831a5c7ed None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:17.382227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:17.382846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:17.383120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:17.383390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] PATH_INFO: `/v3/users/4c2c620715814d3ea000ae6c0dd21f0a` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:17.384491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2c620715814d3ea000ae6c0dd21f0a)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:17.386413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:17.431307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2c620715814d3ea000ae6c0dd21f0a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.438177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2c620715814d3ea000ae6c0dd21f0a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.438838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2c620715814d3ea000ae6c0dd21f0a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.439453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2c620715814d3ea000ae6c0dd21f0a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.451604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2c620715814d3ea000ae6c0dd21f0a'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.463888 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4307/8629] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:32:17 2022] DELETE /identity/v3/users/4c2c620715814d3ea000ae6c0dd21f0a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:32:17.634648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc9ea3-c945-41e9-acd7-54b58992b80f service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:17.649149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc9ea3-c945-41e9-acd7-54b58992b80f service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:17.709611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:17.710236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:17.710516 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:17.710788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] PATH_INFO: `/v3/projects/83ec57e206564c6ea7676aa86bd6e369` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:17.711883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ec57e206564c6ea7676aa86bd6e369)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:17.714434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:17.759442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ec57e206564c6ea7676aa86bd6e369', 'request_id': 'req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.770687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ec57e206564c6ea7676aa86bd6e369', 'request_id': 'req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.778157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ec57e206564c6ea7676aa86bd6e369', 'request_id': 'req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.789448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] The token cache is being invalidate because project 83ec57e206564c6ea7676aa86bd6e369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:32:17.789735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.790380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.792197 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4323/8630] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:32:17 2022] DELETE /identity/v3/projects/83ec57e206564c6ea7676aa86bd6e369 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:32:17.796153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:17.798105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:17.811727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e5a01-828d-4cec-b102-2e49501fb647 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:17.867974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c215f8-c3a1-41f8-acd4-8a620fa543d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:17.868603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c215f8-c3a1-41f8-acd4-8a620fa543d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:17.868883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c215f8-c3a1-41f8-acd4-8a620fa543d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:17.869180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c215f8-c3a1-41f8-acd4-8a620fa543d1 admin admin] PATH_INFO: `/v3/users/bb4f0c52a9f04c1ab41d9a75c98cfaa8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:17.870329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c215f8-c3a1-41f8-acd4-8a620fa543d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4f0c52a9f04c1ab41d9a75c98cfaa8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:17.872285 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c215f8-c3a1-41f8-acd4-8a620fa543d1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:17.893488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:17.919368 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-79c215f8-c3a1-41f8-acd4-8a620fa543d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4f0c52a9f04c1ab41d9a75c98cfaa8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.926481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-79c215f8-c3a1-41f8-acd4-8a620fa543d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4f0c52a9f04c1ab41d9a75c98cfaa8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.927149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-79c215f8-c3a1-41f8-acd4-8a620fa543d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4f0c52a9f04c1ab41d9a75c98cfaa8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.927775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-79c215f8-c3a1-41f8-acd4-8a620fa543d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4f0c52a9f04c1ab41d9a75c98cfaa8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.939596 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-79c215f8-c3a1-41f8-acd4-8a620fa543d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4f0c52a9f04c1ab41d9a75c98cfaa8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:17.952329 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4308/8631] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:32:17 2022] DELETE /identity/v3/users/bb4f0c52a9f04c1ab41d9a75c98cfaa8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:32:18.125142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:18.126705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:18.141406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0bbbd-dfd8-4ee6-b86a-dad1021c657e admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:18.198648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2eecd-5022-4977-88d3-ab68735c8e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:18.199277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2eecd-5022-4977-88d3-ab68735c8e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:18.199558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2eecd-5022-4977-88d3-ab68735c8e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:18.199885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2eecd-5022-4977-88d3-ab68735c8e68 admin admin] PATH_INFO: `/v3/projects/cd3fd850d2024a8683c5625b41703f9b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:18.201047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2eecd-5022-4977-88d3-ab68735c8e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3fd850d2024a8683c5625b41703f9b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:18.203008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2eecd-5022-4977-88d3-ab68735c8e68 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:18.235932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:18.249298 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2f2eecd-5022-4977-88d3-ab68735c8e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3fd850d2024a8683c5625b41703f9b', 'request_id': 'req-f2f2eecd-5022-4977-88d3-ab68735c8e68'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:18.256482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2f2eecd-5022-4977-88d3-ab68735c8e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3fd850d2024a8683c5625b41703f9b', 'request_id': 'req-f2f2eecd-5022-4977-88d3-ab68735c8e68'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:18.262771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2f2eecd-5022-4977-88d3-ab68735c8e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3fd850d2024a8683c5625b41703f9b', 'request_id': 'req-f2f2eecd-5022-4977-88d3-ab68735c8e68'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:18.273543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2f2eecd-5022-4977-88d3-ab68735c8e68 admin admin] The token cache is being invalidate because project cd3fd850d2024a8683c5625b41703f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:32:18.273831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2f2eecd-5022-4977-88d3-ab68735c8e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:18.274453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-f2f2eecd-5022-4977-88d3-ab68735c8e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:18.275935 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4324/8632] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:32:18 2022] DELETE /identity/v3/projects/cd3fd850d2024a8683c5625b41703f9b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:32:18.281068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601bb0-4984-477c-b9a0-4a394060b938 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:18.281387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601bb0-4984-477c-b9a0-4a394060b938 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:18.281669 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601bb0-4984-477c-b9a0-4a394060b938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:18.304219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-85601bb0-4984-477c-b9a0-4a394060b938 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:32:18.305506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-85601bb0-4984-477c-b9a0-4a394060b938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:18.365335 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4309/8633] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:32:18.373108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cf805-910a-4ae4-b112-2661acd16318 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:18.373486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cf805-910a-4ae4-b112-2661acd16318 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:18.373773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cf805-910a-4ae4-b112-2661acd16318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:18.393820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-554cf805-910a-4ae4-b112-2661acd16318 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:32:18.395038 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-554cf805-910a-4ae4-b112-2661acd16318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:18.403520 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4325/8634] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:32:18.407654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85601bb0-4984-477c-b9a0-4a394060b938 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:18.417391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85601bb0-4984-477c-b9a0-4a394060b938 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:18.421971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29698ea1-c7b0-4529-92dd-1740c8bfed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:18.422565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29698ea1-c7b0-4529-92dd-1740c8bfed6e admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:18.422844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29698ea1-c7b0-4529-92dd-1740c8bfed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:18.423115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29698ea1-c7b0-4529-92dd-1740c8bfed6e admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:18.423765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29698ea1-c7b0-4529-92dd-1740c8bfed6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:32:18.424097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29698ea1-c7b0-4529-92dd-1740c8bfed6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:18.425710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29698ea1-c7b0-4529-92dd-1740c8bfed6e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:18.437343 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4310/8635] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:32:18.441161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cf805-910a-4ae4-b112-2661acd16318 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:18.450913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cf805-910a-4ae4-b112-2661acd16318 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:18.455458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5bfcb-a86a-4a8c-83b8-8363e0d45fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:18.456044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5bfcb-a86a-4a8c-83b8-8363e0d45fba admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:18.456343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5bfcb-a86a-4a8c-83b8-8363e0d45fba admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:18.456716 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5bfcb-a86a-4a8c-83b8-8363e0d45fba admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:18.457452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5bfcb-a86a-4a8c-83b8-8363e0d45fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:18.459334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5bfcb-a86a-4a8c-83b8-8363e0d45fba admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:18.490031 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4326/8636] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:32:18 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:32:18.491073 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29698ea1-c7b0-4529-92dd-1740c8bfed6e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:18.501261 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29698ea1-c7b0-4529-92dd-1740c8bfed6e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:18.558449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7dd016-5dd8-45d8-be49-3a83f4c6fc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:18.559047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dd016-5dd8-45d8-be49-3a83f4c6fc03 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:18.559321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dd016-5dd8-45d8-be49-3a83f4c6fc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:18.559591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dd016-5dd8-45d8-be49-3a83f4c6fc03 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:18.560196 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7dd016-5dd8-45d8-be49-3a83f4c6fc03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:18.562153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7dd016-5dd8-45d8-be49-3a83f4c6fc03 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:18.583151 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4311/8637] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:32:18 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:32:18.587277 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5bfcb-a86a-4a8c-83b8-8363e0d45fba admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:18.598478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5bfcb-a86a-4a8c-83b8-8363e0d45fba admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:18.603349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765109ef-c5f1-49c3-9996-cafdc9e0f304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:18.603939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765109ef-c5f1-49c3-9996-cafdc9e0f304 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:18.604218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765109ef-c5f1-49c3-9996-cafdc9e0f304 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:18.604489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765109ef-c5f1-49c3-9996-cafdc9e0f304 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:18.605121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765109ef-c5f1-49c3-9996-cafdc9e0f304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:18.606960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765109ef-c5f1-49c3-9996-cafdc9e0f304 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:18.616812 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4327/8638] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:32:18.620558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7dd016-5dd8-45d8-be49-3a83f4c6fc03 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:18.630334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7dd016-5dd8-45d8-be49-3a83f4c6fc03 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:18.635460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182c6b8-f374-4012-952b-26e0e51dcd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:18.636040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182c6b8-f374-4012-952b-26e0e51dcd5b admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:18.636315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182c6b8-f374-4012-952b-26e0e51dcd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:18.636586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182c6b8-f374-4012-952b-26e0e51dcd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:18.637237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182c6b8-f374-4012-952b-26e0e51dcd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:18.638791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182c6b8-f374-4012-952b-26e0e51dcd5b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:18.649357 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4312/8639] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:32:18.654031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765109ef-c5f1-49c3-9996-cafdc9e0f304 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:18.664058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765109ef-c5f1-49c3-9996-cafdc9e0f304 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:18.668710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c53a56-b5fe-4e87-bee1-c7aac6899c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:18.669387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c53a56-b5fe-4e87-bee1-c7aac6899c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:18.669670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c53a56-b5fe-4e87-bee1-c7aac6899c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:18.669945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c53a56-b5fe-4e87-bee1-c7aac6899c2f admin admin] PATH_INFO: `/v3/projects/5c13f3a9d12c4710882a17d9d06b3473/users/0f0e898ea13845068ead117311106b0c/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:18.686080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c53a56-b5fe-4e87-bee1-c7aac6899c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c13f3a9d12c4710882a17d9d06b3473, user_id=0f0e898ea13845068ead117311106b0c, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:18.688751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c53a56-b5fe-4e87-bee1-c7aac6899c2f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:18.701753 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4328/8640] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:32:18 2022] PUT /identity/v3/projects/5c13f3a9d12c4710882a17d9d06b3473/users/0f0e898ea13845068ead117311106b0c/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:32:18.706856 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7f04f-a3c2-4b26-ba51-ab422f8eccc8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:18.707141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7f04f-a3c2-4b26-ba51-ab422f8eccc8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:18.707412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7f04f-a3c2-4b26-ba51-ab422f8eccc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:18.715903 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:18.727662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-23e7f04f-a3c2-4b26-ba51-ab422f8eccc8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:32:18.729847 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-23e7f04f-a3c2-4b26-ba51-ab422f8eccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:18.788301 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4313/8641] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:32:18.798578 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c53a56-b5fe-4e87-bee1-c7aac6899c2f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:18.800249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-76c53a56-b5fe-4e87-bee1-c7aac6899c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:18.859528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c53a56-b5fe-4e87-bee1-c7aac6899c2f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:18.863346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9fa3f-7f4f-4c24-9028-7bb7063e401f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:18.863937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9fa3f-7f4f-4c24-9028-7bb7063e401f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:18.864212 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9fa3f-7f4f-4c24-9028-7bb7063e401f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:18.864481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9fa3f-7f4f-4c24-9028-7bb7063e401f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:18.874096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9fa3f-7f4f-4c24-9028-7bb7063e401f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:18.875458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9fa3f-7f4f-4c24-9028-7bb7063e401f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:18.885653 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4329/8642] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:32:22.845987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67f22b-8633-4f2d-acb8-23f15e83526a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:22.846458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67f22b-8633-4f2d-acb8-23f15e83526a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:22.846540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67f22b-8633-4f2d-acb8-23f15e83526a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:22.875966 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ff67f22b-8633-4f2d-acb8-23f15e83526a None None] MFA Rules not processed for user `0f0e898ea13845068ead117311106b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:32:22.877202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ff67f22b-8633-4f2d-acb8-23f15e83526a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:22.955380 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4314/8643] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:32:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:32:22.964913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9fa3f-7f4f-4c24-9028-7bb7063e401f service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:22.979829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9fa3f-7f4f-4c24-9028-7bb7063e401f service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:22.984499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cf89f-98e8-4708-a04a-19c75d46508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:22.985034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cf89f-98e8-4708-a04a-19c75d46508a admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:22.985412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cf89f-98e8-4708-a04a-19c75d46508a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:22.985686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cf89f-98e8-4708-a04a-19c75d46508a admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:22.986321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cf89f-98e8-4708-a04a-19c75d46508a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:22.988207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cf89f-98e8-4708-a04a-19c75d46508a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:23.019964 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4330/8644] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:32:22 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:32:23.024056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67f22b-8633-4f2d-acb8-23f15e83526a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:23.036097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67f22b-8633-4f2d-acb8-23f15e83526a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:23.096460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024aee6-1ad2-4ae9-9455-1b0a9ab72771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:23.097518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024aee6-1ad2-4ae9-9455-1b0a9ab72771 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:23.097800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024aee6-1ad2-4ae9-9455-1b0a9ab72771 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:23.098075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024aee6-1ad2-4ae9-9455-1b0a9ab72771 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:23.098733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024aee6-1ad2-4ae9-9455-1b0a9ab72771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:23.100711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024aee6-1ad2-4ae9-9455-1b0a9ab72771 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:23.124852 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4315/8645] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:32:23 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:32:23.128913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cf89f-98e8-4708-a04a-19c75d46508a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:23.140237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cf89f-98e8-4708-a04a-19c75d46508a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:23.144939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a312a-ab45-494a-9e07-c48a9e11474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:23.145583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a312a-ab45-494a-9e07-c48a9e11474b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:23.145864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a312a-ab45-494a-9e07-c48a9e11474b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:23.146143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a312a-ab45-494a-9e07-c48a9e11474b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:23.146791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a312a-ab45-494a-9e07-c48a9e11474b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:23.148401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a312a-ab45-494a-9e07-c48a9e11474b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:23.160593 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4331/8646] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:32:23.165419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024aee6-1ad2-4ae9-9455-1b0a9ab72771 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:23.177538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024aee6-1ad2-4ae9-9455-1b0a9ab72771 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:23.182802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc91a2-68e1-4701-9f2f-1380cb6ce851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:23.183477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc91a2-68e1-4701-9f2f-1380cb6ce851 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:23.183759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc91a2-68e1-4701-9f2f-1380cb6ce851 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:23.184036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc91a2-68e1-4701-9f2f-1380cb6ce851 admin admin] PATH_INFO: `/v3/projects/5a8f2217084c4687b5407fbea4b3d39f/users/51623e38eefd43d5900a5e1ffbbfbf2f/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:23.200395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc91a2-68e1-4701-9f2f-1380cb6ce851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8f2217084c4687b5407fbea4b3d39f, user_id=51623e38eefd43d5900a5e1ffbbfbf2f, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:23.203104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc91a2-68e1-4701-9f2f-1380cb6ce851 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:23.213828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:23.219363 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4316/8647] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:32:23 2022] PUT /identity/v3/projects/5a8f2217084c4687b5407fbea4b3d39f/users/51623e38eefd43d5900a5e1ffbbfbf2f/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:32:23.223702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a312a-ab45-494a-9e07-c48a9e11474b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:23.234321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a312a-ab45-494a-9e07-c48a9e11474b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:23.259719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:23.304967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678b356-5df7-4428-8186-f7c5a3c154e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:23.305727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678b356-5df7-4428-8186-f7c5a3c154e2 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:23.306638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678b356-5df7-4428-8186-f7c5a3c154e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:23.307255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678b356-5df7-4428-8186-f7c5a3c154e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:23.308113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678b356-5df7-4428-8186-f7c5a3c154e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:23.309997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678b356-5df7-4428-8186-f7c5a3c154e2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:23.324834 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4332/8648] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:32:23.325594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc91a2-68e1-4701-9f2f-1380cb6ce851 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:23.337134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc91a2-68e1-4701-9f2f-1380cb6ce851 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:23.345423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9349-e6c4-40fd-a64f-ea68c738cac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:23.345423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9349-e6c4-40fd-a64f-ea68c738cac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:23.345423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9349-e6c4-40fd-a64f-ea68c738cac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:23.345423 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9349-e6c4-40fd-a64f-ea68c738cac3 admin admin] PATH_INFO: `/v3/projects/5a8f2217084c4687b5407fbea4b3d39f/users/51623e38eefd43d5900a5e1ffbbfbf2f/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:23.345855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf9349-e6c4-40fd-a64f-ea68c738cac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8f2217084c4687b5407fbea4b3d39f, user_id=51623e38eefd43d5900a5e1ffbbfbf2f, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:23.348481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf9349-e6c4-40fd-a64f-ea68c738cac3 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:23.361742 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4317/8649] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:32:23 2022] PUT /identity/v3/projects/5a8f2217084c4687b5407fbea4b3d39f/users/51623e38eefd43d5900a5e1ffbbfbf2f/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:32:27.777594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8b7a-bf6f-4270-a1d4-54d069f3b25e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:27.778191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8b7a-bf6f-4270-a1d4-54d069f3b25e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:27.778332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8b7a-bf6f-4270-a1d4-54d069f3b25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:27.808980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7a0c8b7a-bf6f-4270-a1d4-54d069f3b25e None None] MFA Rules not processed for user `51623e38eefd43d5900a5e1ffbbfbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:32:27.810285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7a0c8b7a-bf6f-4270-a1d4-54d069f3b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:27.895806 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4333/8650] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:32:27.909328 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9349-e6c4-40fd-a64f-ea68c738cac3 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:27.911090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dddf9349-e6c4-40fd-a64f-ea68c738cac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:27.985378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9349-e6c4-40fd-a64f-ea68c738cac3 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:27.989432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6ecfa-9618-4326-84c0-8efb4ac6e8c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:27.990058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6ecfa-9618-4326-84c0-8efb4ac6e8c8 service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:27.990339 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6ecfa-9618-4326-84c0-8efb4ac6e8c8 service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:27.990610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6ecfa-9618-4326-84c0-8efb4ac6e8c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:28.074375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6ecfa-9618-4326-84c0-8efb4ac6e8c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:28.075816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6ecfa-9618-4326-84c0-8efb4ac6e8c8 service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:28.085081 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4318/8651] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:32:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:32:32.557132 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c8b7a-bf6f-4270-a1d4-54d069f3b25e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:32.672891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c8b7a-bf6f-4270-a1d4-54d069f3b25e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:32.679399 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c37935-a9f8-48de-8f28-044c81e9879a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:32.680172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37935-a9f8-48de-8f28-044c81e9879a service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:32.680601 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37935-a9f8-48de-8f28-044c81e9879a service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:32.680985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37935-a9f8-48de-8f28-044c81e9879a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:32.686224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c3c37935-a9f8-48de-8f28-044c81e9879a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:32.768089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:32.790400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c37935-a9f8-48de-8f28-044c81e9879a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:32.792555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c37935-a9f8-48de-8f28-044c81e9879a service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:32.829557 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4334/8652] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:32:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:32:34.077360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6ecfa-9618-4326-84c0-8efb4ac6e8c8 service glance] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:34.079686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-14c6ecfa-9618-4326-84c0-8efb4ac6e8c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:34.119541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6ecfa-9618-4326-84c0-8efb4ac6e8c8 service glance] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:34.127239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa4188-24ee-42fd-b401-0e3ac34b9bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:34.127931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa4188-24ee-42fd-b401-0e3ac34b9bfc service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:34.128228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa4188-24ee-42fd-b401-0e3ac34b9bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:34.128503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa4188-24ee-42fd-b401-0e3ac34b9bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:34.130594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f2aa4188-24ee-42fd-b401-0e3ac34b9bfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:34.152473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa4188-24ee-42fd-b401-0e3ac34b9bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:34.154790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa4188-24ee-42fd-b401-0e3ac34b9bfc service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:34.179002 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4319/8653] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:32:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:32:36.529692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c37935-a9f8-48de-8f28-044c81e9879a service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:36.531154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c3c37935-a9f8-48de-8f28-044c81e9879a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:36.547916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c37935-a9f8-48de-8f28-044c81e9879a service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:36.553631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db7c48-67b8-49f8-b2dc-0d5b06f188e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:36.554252 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db7c48-67b8-49f8-b2dc-0d5b06f188e2 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:36.554510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db7c48-67b8-49f8-b2dc-0d5b06f188e2 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:36.554779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db7c48-67b8-49f8-b2dc-0d5b06f188e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:36.556472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b1db7c48-67b8-49f8-b2dc-0d5b06f188e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:36.615453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db7c48-67b8-49f8-b2dc-0d5b06f188e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:36.617308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db7c48-67b8-49f8-b2dc-0d5b06f188e2 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:36.627056 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4335/8654] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:32:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:32:37.369746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa4188-24ee-42fd-b401-0e3ac34b9bfc service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:37.381645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa4188-24ee-42fd-b401-0e3ac34b9bfc service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:37.385313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f89aa2-3767-4315-aafe-e15ec0cdfcfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:37.385913 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f89aa2-3767-4315-aafe-e15ec0cdfcfa service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:37.386193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f89aa2-3767-4315-aafe-e15ec0cdfcfa service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:37.386464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f89aa2-3767-4315-aafe-e15ec0cdfcfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:37.388178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a4f89aa2-3767-4315-aafe-e15ec0cdfcfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:37.454214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f89aa2-3767-4315-aafe-e15ec0cdfcfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:37.455698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f89aa2-3767-4315-aafe-e15ec0cdfcfa service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:37.468146 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4320/8655] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:32:45.125775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf7821-f438-4866-ab9b-0294f64cfc26 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:45.126519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf7821-f438-4866-ab9b-0294f64cfc26 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:45.126519 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf7821-f438-4866-ab9b-0294f64cfc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:45.149829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c0bf7821-f438-4866-ab9b-0294f64cfc26 None None] MFA Rules not processed for user `0f0e898ea13845068ead117311106b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:32:45.151381 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c0bf7821-f438-4866-ab9b-0294f64cfc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:45.159008 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4336/8656] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:32:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:32:45.391945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f89aa2-3767-4315-aafe-e15ec0cdfcfa service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:45.394489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a4f89aa2-3767-4315-aafe-e15ec0cdfcfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:45.410954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f89aa2-3767-4315-aafe-e15ec0cdfcfa service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:45.416956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:45.417813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:45.418314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:45.418601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] PATH_INFO: `/v3/users/6100a1568dd042e58ce63e4b30a87429` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:45.419834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6100a1568dd042e58ce63e4b30a87429)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:45.422002 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:45.428194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:45.489680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6100a1568dd042e58ce63e4b30a87429'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:45.498700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6100a1568dd042e58ce63e4b30a87429'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:45.499532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6100a1568dd042e58ce63e4b30a87429'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:45.500282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6100a1568dd042e58ce63e4b30a87429'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:45.514507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6100a1568dd042e58ce63e4b30a87429'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:45.530116 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4321/8657] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:32:45 2022] DELETE /identity/v3/users/6100a1568dd042e58ce63e4b30a87429 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:32:45.626039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf7821-f438-4866-ab9b-0294f64cfc26 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:45.642515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf7821-f438-4866-ab9b-0294f64cfc26 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:45.693755 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0d5af-b5c1-49cf-bce9-36df29e32aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:45.694372 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0d5af-b5c1-49cf-bce9-36df29e32aba service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:45.694718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0d5af-b5c1-49cf-bce9-36df29e32aba service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:45.695043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0d5af-b5c1-49cf-bce9-36df29e32aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:45.697633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-48c0d5af-b5c1-49cf-bce9-36df29e32aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:45.706795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:45.707587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:45.717402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0d5af-b5c1-49cf-bce9-36df29e32aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:45.719338 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0d5af-b5c1-49cf-bce9-36df29e32aba service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:45.733007 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4337/8658] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:32:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:32:45.782865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a655ec6-c458-4090-8a6d-71067a02ef01 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:45.787564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:45.788192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:45.788468 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:45.788740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] PATH_INFO: `/v3/projects/79a6a8bf389b4191816195072295a080` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:45.790404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a6a8bf389b4191816195072295a080)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:45.792280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:45.840526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a6a8bf389b4191816195072295a080', 'request_id': 'req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:45.847590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a6a8bf389b4191816195072295a080', 'request_id': 'req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:45.854383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a6a8bf389b4191816195072295a080', 'request_id': 'req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:45.865439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] The token cache is being invalidate because project 79a6a8bf389b4191816195072295a080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:32:45.865751 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:45.866430 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:45.867962 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4322/8659] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:32:45 2022] DELETE /identity/v3/projects/79a6a8bf389b4191816195072295a080 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:32:45.872159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0d5af-b5c1-49cf-bce9-36df29e32aba service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:45.883830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0d5af-b5c1-49cf-bce9-36df29e32aba service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:45.941837 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711c485-59ca-4c11-920d-0681b7f89211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:45.942479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c485-59ca-4c11-920d-0681b7f89211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:45.942761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c485-59ca-4c11-920d-0681b7f89211 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:45.943030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c485-59ca-4c11-920d-0681b7f89211 admin admin] PATH_INFO: `/v3/users/4a0fce05417b4cc691cc4879e616cde9` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:45.944164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711c485-59ca-4c11-920d-0681b7f89211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a0fce05417b4cc691cc4879e616cde9)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:45.946223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711c485-59ca-4c11-920d-0681b7f89211 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:45.982759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:46.002356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e711c485-59ca-4c11-920d-0681b7f89211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a0fce05417b4cc691cc4879e616cde9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:46.009458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e711c485-59ca-4c11-920d-0681b7f89211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a0fce05417b4cc691cc4879e616cde9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:46.010143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e711c485-59ca-4c11-920d-0681b7f89211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a0fce05417b4cc691cc4879e616cde9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:46.010768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e711c485-59ca-4c11-920d-0681b7f89211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a0fce05417b4cc691cc4879e616cde9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:46.023353 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e711c485-59ca-4c11-920d-0681b7f89211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a0fce05417b4cc691cc4879e616cde9'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:46.037687 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4338/8660] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:32:45 2022] DELETE /identity/v3/users/4a0fce05417b4cc691cc4879e616cde9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:32:46.234752 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:46.236108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:46.249782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb67eb-15d4-49e1-b84f-c23951b3c7be admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:46.264472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:46.321627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e0495-825f-42f1-b28a-6a186258c2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:46.322574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e0495-825f-42f1-b28a-6a186258c2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:46.322905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e0495-825f-42f1-b28a-6a186258c2db admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:46.323185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e0495-825f-42f1-b28a-6a186258c2db admin admin] PATH_INFO: `/v3/projects/bfd3d258fa484de9810ee01435471b70` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:46.324450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e0495-825f-42f1-b28a-6a186258c2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd3d258fa484de9810ee01435471b70)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:46.326438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e0495-825f-42f1-b28a-6a186258c2db admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:46.376756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dc9e0495-825f-42f1-b28a-6a186258c2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd3d258fa484de9810ee01435471b70', 'request_id': 'req-dc9e0495-825f-42f1-b28a-6a186258c2db'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:46.385791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dc9e0495-825f-42f1-b28a-6a186258c2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd3d258fa484de9810ee01435471b70', 'request_id': 'req-dc9e0495-825f-42f1-b28a-6a186258c2db'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:46.391478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dc9e0495-825f-42f1-b28a-6a186258c2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd3d258fa484de9810ee01435471b70', 'request_id': 'req-dc9e0495-825f-42f1-b28a-6a186258c2db'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:46.408641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dc9e0495-825f-42f1-b28a-6a186258c2db admin admin] The token cache is being invalidate because project bfd3d258fa484de9810ee01435471b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:32:46.409381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dc9e0495-825f-42f1-b28a-6a186258c2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:46.409630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-dc9e0495-825f-42f1-b28a-6a186258c2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:32:46.411160 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4323/8661] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:32:46 2022] DELETE /identity/v3/projects/bfd3d258fa484de9810ee01435471b70 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:32:46.416238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e24ea-8ec1-455e-bfd7-8dfd914390c1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:46.416694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e24ea-8ec1-455e-bfd7-8dfd914390c1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:46.416784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e24ea-8ec1-455e-bfd7-8dfd914390c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:46.438422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fb6e24ea-8ec1-455e-bfd7-8dfd914390c1 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:32:46.440061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fb6e24ea-8ec1-455e-bfd7-8dfd914390c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:46.509892 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4339/8662] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:32:46.517736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1359324-2b2a-441b-8956-927f1a9a1e0e None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:46.518023 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1359324-2b2a-441b-8956-927f1a9a1e0e None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:46.518298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1359324-2b2a-441b-8956-927f1a9a1e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:46.539794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f1359324-2b2a-441b-8956-927f1a9a1e0e None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:32:46.541136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f1359324-2b2a-441b-8956-927f1a9a1e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:46.550733 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4324/8663] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:32:46.554350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e24ea-8ec1-455e-bfd7-8dfd914390c1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:46.564596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e24ea-8ec1-455e-bfd7-8dfd914390c1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:46.569214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e1120-cb2f-4abb-82d5-a5bdc6dc9f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:46.569814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1120-cb2f-4abb-82d5-a5bdc6dc9f16 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:46.570118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1120-cb2f-4abb-82d5-a5bdc6dc9f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:46.570365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1120-cb2f-4abb-82d5-a5bdc6dc9f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:46.571722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e1120-cb2f-4abb-82d5-a5bdc6dc9f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:32:46.572027 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e1120-cb2f-4abb-82d5-a5bdc6dc9f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:46.573658 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e1120-cb2f-4abb-82d5-a5bdc6dc9f16 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:46.586455 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4340/8664] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:32:46.590907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1359324-2b2a-441b-8956-927f1a9a1e0e None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:46.600652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1359324-2b2a-441b-8956-927f1a9a1e0e None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:46.605789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e83ad-0af8-4c4a-8505-2b5203d81c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:46.606392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e83ad-0af8-4c4a-8505-2b5203d81c33 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:46.606749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e83ad-0af8-4c4a-8505-2b5203d81c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:46.607203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e83ad-0af8-4c4a-8505-2b5203d81c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:46.607930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e83ad-0af8-4c4a-8505-2b5203d81c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:46.609819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e83ad-0af8-4c4a-8505-2b5203d81c33 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:46.646125 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4325/8665] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:32:46 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:32:46.647131 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e1120-cb2f-4abb-82d5-a5bdc6dc9f16 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:46.657333 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e1120-cb2f-4abb-82d5-a5bdc6dc9f16 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:46.714107 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cda997-695e-4d6a-a7a0-491f0ea9782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:46.714718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cda997-695e-4d6a-a7a0-491f0ea9782c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:46.715010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cda997-695e-4d6a-a7a0-491f0ea9782c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:46.715281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cda997-695e-4d6a-a7a0-491f0ea9782c admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:46.715894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cda997-695e-4d6a-a7a0-491f0ea9782c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:46.717830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cda997-695e-4d6a-a7a0-491f0ea9782c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:46.739746 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4341/8666] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:32:46 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:32:46.744347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e83ad-0af8-4c4a-8505-2b5203d81c33 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:46.755692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e83ad-0af8-4c4a-8505-2b5203d81c33 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:46.761056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969368a-c106-4443-84cb-a6119019fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:46.761625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969368a-c106-4443-84cb-a6119019fb57 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:46.761905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969368a-c106-4443-84cb-a6119019fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:46.762177 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969368a-c106-4443-84cb-a6119019fb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:46.762812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969368a-c106-4443-84cb-a6119019fb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:46.764416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969368a-c106-4443-84cb-a6119019fb57 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:46.774483 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4326/8667] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:32:46.778342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cda997-695e-4d6a-a7a0-491f0ea9782c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:46.788163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cda997-695e-4d6a-a7a0-491f0ea9782c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:46.792748 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92912651-4b59-4fd3-9419-26d0411b3dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:46.793369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92912651-4b59-4fd3-9419-26d0411b3dec admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:46.793652 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92912651-4b59-4fd3-9419-26d0411b3dec admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:46.793923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92912651-4b59-4fd3-9419-26d0411b3dec admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:46.794561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92912651-4b59-4fd3-9419-26d0411b3dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:46.796119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92912651-4b59-4fd3-9419-26d0411b3dec admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:46.807063 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4342/8668] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:32:46.810994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969368a-c106-4443-84cb-a6119019fb57 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:46.821677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969368a-c106-4443-84cb-a6119019fb57 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:46.826225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d681ad-ff38-40dc-a53d-e41dc90b2718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:46.826865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d681ad-ff38-40dc-a53d-e41dc90b2718 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:46.827138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d681ad-ff38-40dc-a53d-e41dc90b2718 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:46.827413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d681ad-ff38-40dc-a53d-e41dc90b2718 admin admin] PATH_INFO: `/v3/projects/8d9857e88402494e964f2099de5bb60c/users/7ac4eff18a664804af16cf21321f9290/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:46.841553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d681ad-ff38-40dc-a53d-e41dc90b2718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9857e88402494e964f2099de5bb60c, user_id=7ac4eff18a664804af16cf21321f9290, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:46.844436 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d681ad-ff38-40dc-a53d-e41dc90b2718 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:46.857622 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4327/8669] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:32:46 2022] PUT /identity/v3/projects/8d9857e88402494e964f2099de5bb60c/users/7ac4eff18a664804af16cf21321f9290/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:32:46.862518 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8a287-475f-499a-b8ac-e1fcd3ce690c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:46.862871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8a287-475f-499a-b8ac-e1fcd3ce690c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:46.863199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8a287-475f-499a-b8ac-e1fcd3ce690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:46.882359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0cf8a287-475f-499a-b8ac-e1fcd3ce690c None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:32:46.884175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0cf8a287-475f-499a-b8ac-e1fcd3ce690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:46.888110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:46.944379 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4343/8670] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:32:46.954063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d681ad-ff38-40dc-a53d-e41dc90b2718 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:46.955761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d0d681ad-ff38-40dc-a53d-e41dc90b2718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:47.004861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:47.020506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d681ad-ff38-40dc-a53d-e41dc90b2718 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:47.024142 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff161519-c7c3-4690-8d92-69ecfc1da364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:47.024746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff161519-c7c3-4690-8d92-69ecfc1da364 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:47.025055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff161519-c7c3-4690-8d92-69ecfc1da364 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:47.025403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff161519-c7c3-4690-8d92-69ecfc1da364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:47.034467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff161519-c7c3-4690-8d92-69ecfc1da364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:47.035895 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff161519-c7c3-4690-8d92-69ecfc1da364 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:47.046445 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4328/8671] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:32:50.311675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8a287-475f-499a-b8ac-e1fcd3ce690c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:50.314737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0cf8a287-475f-499a-b8ac-e1fcd3ce690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:50.347465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8a287-475f-499a-b8ac-e1fcd3ce690c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:50.352294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64161528-07cb-4cf5-9794-4a3fc8bb9f9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:50.355070 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64161528-07cb-4cf5-9794-4a3fc8bb9f9c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:50.355611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64161528-07cb-4cf5-9794-4a3fc8bb9f9c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:50.356130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64161528-07cb-4cf5-9794-4a3fc8bb9f9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:50.363219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-64161528-07cb-4cf5-9794-4a3fc8bb9f9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:50.390632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64161528-07cb-4cf5-9794-4a3fc8bb9f9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:50.393059 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64161528-07cb-4cf5-9794-4a3fc8bb9f9c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:50.416169 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4344/8672] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:32:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:32:52.237743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f2b0d-bc42-408d-9038-9cd4d14a4561 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:52.238203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f2b0d-bc42-408d-9038-9cd4d14a4561 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:52.238296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f2b0d-bc42-408d-9038-9cd4d14a4561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:52.276639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e67f2b0d-bc42-408d-9038-9cd4d14a4561 None None] MFA Rules not processed for user `7ac4eff18a664804af16cf21321f9290`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:32:52.277963 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e67f2b0d-bc42-408d-9038-9cd4d14a4561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:52.391582 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4329/8673] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:32:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:32:52.395882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64161528-07cb-4cf5-9794-4a3fc8bb9f9c service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:52.408792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64161528-07cb-4cf5-9794-4a3fc8bb9f9c service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:52.413664 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88160c7-a0ef-49fe-9ecf-9f95752b3243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:52.414803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88160c7-a0ef-49fe-9ecf-9f95752b3243 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:52.415090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88160c7-a0ef-49fe-9ecf-9f95752b3243 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:52.415366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88160c7-a0ef-49fe-9ecf-9f95752b3243 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:52.415999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88160c7-a0ef-49fe-9ecf-9f95752b3243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:52.417965 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88160c7-a0ef-49fe-9ecf-9f95752b3243 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:52.452906 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4345/8674] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:32:52 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:32:52.457127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f2b0d-bc42-408d-9038-9cd4d14a4561 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:52.481405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f2b0d-bc42-408d-9038-9cd4d14a4561 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:52.551639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082323b-7471-47a4-afbf-982816211bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:52.552270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082323b-7471-47a4-afbf-982816211bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:52.552550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082323b-7471-47a4-afbf-982816211bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:52.552827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082323b-7471-47a4-afbf-982816211bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:52.553828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082323b-7471-47a4-afbf-982816211bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:52.556395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082323b-7471-47a4-afbf-982816211bd1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:52.581000 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4330/8675] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:32:52 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:32:52.584995 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88160c7-a0ef-49fe-9ecf-9f95752b3243 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:52.596095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88160c7-a0ef-49fe-9ecf-9f95752b3243 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:52.601200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc980fd5-d9e9-46de-8cc0-e253582ccfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:52.602024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc980fd5-d9e9-46de-8cc0-e253582ccfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:52.602313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc980fd5-d9e9-46de-8cc0-e253582ccfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:52.602579 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc980fd5-d9e9-46de-8cc0-e253582ccfc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:52.603257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc980fd5-d9e9-46de-8cc0-e253582ccfc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:52.604849 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc980fd5-d9e9-46de-8cc0-e253582ccfc1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:52.617686 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4346/8676] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:32:52.621991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082323b-7471-47a4-afbf-982816211bd1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:52.633538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082323b-7471-47a4-afbf-982816211bd1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:52.639114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4741b68-45a3-4928-9152-97e7e9705b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:52.639874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4741b68-45a3-4928-9152-97e7e9705b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:52.640227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4741b68-45a3-4928-9152-97e7e9705b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:52.640928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4741b68-45a3-4928-9152-97e7e9705b28 admin admin] PATH_INFO: `/v3/projects/caa5c43be90e4e8c806def0912311f29/users/7b1e7427302e4c7091796d6610b5d577/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:52.660138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4741b68-45a3-4928-9152-97e7e9705b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa5c43be90e4e8c806def0912311f29, user_id=7b1e7427302e4c7091796d6610b5d577, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:52.662907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4741b68-45a3-4928-9152-97e7e9705b28 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:52.677950 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4331/8677] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:32:52 2022] PUT /identity/v3/projects/caa5c43be90e4e8c806def0912311f29/users/7b1e7427302e4c7091796d6610b5d577/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:32:52.682679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc980fd5-d9e9-46de-8cc0-e253582ccfc1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:52.700014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc980fd5-d9e9-46de-8cc0-e253582ccfc1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:52.765696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bced3-1436-45d2-b918-193111379fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:52.766445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bced3-1436-45d2-b918-193111379fad admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:52.766803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bced3-1436-45d2-b918-193111379fad admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:52.767161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bced3-1436-45d2-b918-193111379fad admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:52.767957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9bced3-1436-45d2-b918-193111379fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:52.769683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9bced3-1436-45d2-b918-193111379fad admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:52.781250 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4347/8678] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:32:52.785616 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4741b68-45a3-4928-9152-97e7e9705b28 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:52.798860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4741b68-45a3-4928-9152-97e7e9705b28 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:52.814693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6799bb-8abd-44a0-8d26-bff2a9a215e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:52.815384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6799bb-8abd-44a0-8d26-bff2a9a215e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:52.815664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6799bb-8abd-44a0-8d26-bff2a9a215e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:52.815943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6799bb-8abd-44a0-8d26-bff2a9a215e1 admin admin] PATH_INFO: `/v3/projects/caa5c43be90e4e8c806def0912311f29/users/7b1e7427302e4c7091796d6610b5d577/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:52.818181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6799bb-8abd-44a0-8d26-bff2a9a215e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa5c43be90e4e8c806def0912311f29, user_id=7b1e7427302e4c7091796d6610b5d577, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:52.821905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6799bb-8abd-44a0-8d26-bff2a9a215e1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:52.835780 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4332/8679] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:32:52 2022] PUT /identity/v3/projects/caa5c43be90e4e8c806def0912311f29/users/7b1e7427302e4c7091796d6610b5d577/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:32:57.173656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a66fb7-25c8-456c-a955-9d241cc14455 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:57.174098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a66fb7-25c8-456c-a955-9d241cc14455 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:57.174245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a66fb7-25c8-456c-a955-9d241cc14455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:57.204823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b6a66fb7-25c8-456c-a955-9d241cc14455 None None] MFA Rules not processed for user `7b1e7427302e4c7091796d6610b5d577`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:32:57.206096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b6a66fb7-25c8-456c-a955-9d241cc14455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:57.256238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:57.281281 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4348/8680] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:32:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:32:57.294164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6799bb-8abd-44a0-8d26-bff2a9a215e1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:32:57.295989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ff6799bb-8abd-44a0-8d26-bff2a9a215e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:32:57.332013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:57.376741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6799bb-8abd-44a0-8d26-bff2a9a215e1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:32:57.380591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4d649-53ea-4bea-a076-5af4fb1112c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:32:57.381332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d649-53ea-4bea-a076-5af4fb1112c0 service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:32:57.381683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d649-53ea-4bea-a076-5af4fb1112c0 service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:32:57.382712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d649-53ea-4bea-a076-5af4fb1112c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:32:57.450482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4d649-53ea-4bea-a076-5af4fb1112c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:32:57.451937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4d649-53ea-4bea-a076-5af4fb1112c0 service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:32:57.463049 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4333/8681] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:32:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:33:01.487093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56094f-d5e8-4a03-91f7-34cac1a2321c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:33:01.487649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56094f-d5e8-4a03-91f7-34cac1a2321c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:33:01.487649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56094f-d5e8-4a03-91f7-34cac1a2321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:33:01.508891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fa56094f-d5e8-4a03-91f7-34cac1a2321c None None] MFA Rules not processed for user `7ac4eff18a664804af16cf21321f9290`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:33:01.510335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fa56094f-d5e8-4a03-91f7-34cac1a2321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:33:01.517370 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4349/8682] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:33:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:33:01.827920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4d649-53ea-4bea-a076-5af4fb1112c0 service glance] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:33:01.891540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4d649-53ea-4bea-a076-5af4fb1112c0 service glance] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:33:01.895175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ab1f9-ed25-466e-9d6b-a0f9c0adf993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:33:01.895780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ab1f9-ed25-466e-9d6b-a0f9c0adf993 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:33:01.896056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ab1f9-ed25-466e-9d6b-a0f9c0adf993 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:33:01.896327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ab1f9-ed25-466e-9d6b-a0f9c0adf993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:33:01.898706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2f4ab1f9-ed25-466e-9d6b-a0f9c0adf993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:33:01.911583 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ab1f9-ed25-466e-9d6b-a0f9c0adf993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:33:01.913083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ab1f9-ed25-466e-9d6b-a0f9c0adf993 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:33:01.924686 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4334/8683] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:33:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:33:02.561328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56094f-d5e8-4a03-91f7-34cac1a2321c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:33:02.573740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56094f-d5e8-4a03-91f7-34cac1a2321c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:33:02.577363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986619ff-d089-4203-9b00-a1e5e019254f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:33:02.577969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986619ff-d089-4203-9b00-a1e5e019254f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:33:02.578268 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986619ff-d089-4203-9b00-a1e5e019254f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:33:02.578505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986619ff-d089-4203-9b00-a1e5e019254f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:33:02.580200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-986619ff-d089-4203-9b00-a1e5e019254f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:33:02.648423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986619ff-d089-4203-9b00-a1e5e019254f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:33:02.650083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986619ff-d089-4203-9b00-a1e5e019254f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:33:02.661177 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4350/8684] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:33:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:33:05.219632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ab1f9-ed25-466e-9d6b-a0f9c0adf993 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:33:05.222750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2f4ab1f9-ed25-466e-9d6b-a0f9c0adf993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:33:05.384102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ab1f9-ed25-466e-9d6b-a0f9c0adf993 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:33:05.395766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ca343-f804-4b25-831f-5e5bf6b82aa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:33:05.397824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ca343-f804-4b25-831f-5e5bf6b82aa0 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:33:05.398491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ca343-f804-4b25-831f-5e5bf6b82aa0 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:33:05.399128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ca343-f804-4b25-831f-5e5bf6b82aa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:33:05.401446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9b2ca343-f804-4b25-831f-5e5bf6b82aa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:33:05.426309 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ca343-f804-4b25-831f-5e5bf6b82aa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:33:05.428227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ca343-f804-4b25-831f-5e5bf6b82aa0 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:33:05.441173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986619ff-d089-4203-9b00-a1e5e019254f service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:33:05.445595 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4335/8685] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:33:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:33:05.478395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986619ff-d089-4203-9b00-a1e5e019254f service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:33:05.496191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44e030-f151-4712-a6c7-29aa5a0c0622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:33:05.497052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e030-f151-4712-a6c7-29aa5a0c0622 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:33:05.497367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e030-f151-4712-a6c7-29aa5a0c0622 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:33:05.497649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e030-f151-4712-a6c7-29aa5a0c0622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:33:05.503861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ea44e030-f151-4712-a6c7-29aa5a0c0622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:33:05.529683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44e030-f151-4712-a6c7-29aa5a0c0622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:33:05.531140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44e030-f151-4712-a6c7-29aa5a0c0622 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:33:05.553723 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4351/8686] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:33:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:33:15.435879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:15.543609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=46 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:24.853029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c507-de54-46cd-a4dd-7f73f601acf1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:33:24.853565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c507-de54-46cd-a4dd-7f73f601acf1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:33:24.853668 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c507-de54-46cd-a4dd-7f73f601acf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:33:24.873851 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ba34c507-de54-46cd-a4dd-7f73f601acf1 None None] MFA Rules not processed for user `7ac4eff18a664804af16cf21321f9290`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:33:24.875037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ba34c507-de54-46cd-a4dd-7f73f601acf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:33:24.882137 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4336/8687] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:33:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:33:34.866928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:38.331749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff8b6b-eb7d-4950-aec1-32e8b6c7e7f1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:33:38.332687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff8b6b-eb7d-4950-aec1-32e8b6c7e7f1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:33:38.333032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff8b6b-eb7d-4950-aec1-32e8b6c7e7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:33:38.399226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2cff8b6b-eb7d-4950-aec1-32e8b6c7e7f1 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:33:38.400391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2cff8b6b-eb7d-4950-aec1-32e8b6c7e7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:33:38.476022 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4352/8688] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:33:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:33:38.532727 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34c507-de54-46cd-a4dd-7f73f601acf1 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:33:38.534432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ba34c507-de54-46cd-a4dd-7f73f601acf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:33:38.640914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34c507-de54-46cd-a4dd-7f73f601acf1 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:33:38.646935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643a1af-5e99-4a17-adf0-70be9dcec3db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:33:38.647574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643a1af-5e99-4a17-adf0-70be9dcec3db service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:33:38.647881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643a1af-5e99-4a17-adf0-70be9dcec3db service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:33:38.648158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643a1af-5e99-4a17-adf0-70be9dcec3db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:33:38.656836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643a1af-5e99-4a17-adf0-70be9dcec3db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:33:38.658464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643a1af-5e99-4a17-adf0-70be9dcec3db service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:33:38.666868 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4337/8689] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:33:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:33:39.940891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515a121-f059-42b6-91e3-63c5c128ab21 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:33:39.941460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515a121-f059-42b6-91e3-63c5c128ab21 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:33:39.941460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515a121-f059-42b6-91e3-63c5c128ab21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:33:39.960432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2515a121-f059-42b6-91e3-63c5c128ab21 None None] MFA Rules not processed for user `7ac4eff18a664804af16cf21321f9290`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:33:39.961684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2515a121-f059-42b6-91e3-63c5c128ab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:33:39.969762 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4353/8690] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:33:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:33:43.350945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643a1af-5e99-4a17-adf0-70be9dcec3db service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:33:43.352618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0643a1af-5e99-4a17-adf0-70be9dcec3db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:33:43.373303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643a1af-5e99-4a17-adf0-70be9dcec3db service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:33:43.379457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b84a8e-2cd4-4fbb-a068-3042d24aa3cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:33:43.380259 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84a8e-2cd4-4fbb-a068-3042d24aa3cd service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:33:43.380733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84a8e-2cd4-4fbb-a068-3042d24aa3cd service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:33:43.381008 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84a8e-2cd4-4fbb-a068-3042d24aa3cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:33:43.382997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-96b84a8e-2cd4-4fbb-a068-3042d24aa3cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:33:43.398930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b84a8e-2cd4-4fbb-a068-3042d24aa3cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:33:43.400507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b84a8e-2cd4-4fbb-a068-3042d24aa3cd service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:33:43.414646 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4338/8691] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:33:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:33:49.955602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=47 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:53.407458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=47 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:34:05.510019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515a121-f059-42b6-91e3-63c5c128ab21 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:34:05.511598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2515a121-f059-42b6-91e3-63c5c128ab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:34:05.587287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515a121-f059-42b6-91e3-63c5c128ab21 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:34:05.592126 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:34:05.592757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:34:05.593036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:34:05.593352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] PATH_INFO: `/v3/users/0f0e898ea13845068ead117311106b0c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:34:05.594473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f0e898ea13845068ead117311106b0c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:34:05.596377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:34:05.641952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f0e898ea13845068ead117311106b0c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:05.649044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f0e898ea13845068ead117311106b0c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:05.649756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f0e898ea13845068ead117311106b0c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:05.650367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f0e898ea13845068ead117311106b0c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:05.662847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f0e898ea13845068ead117311106b0c'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:05.675565 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4354/8692] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:34:05 2022] DELETE /identity/v3/users/0f0e898ea13845068ead117311106b0c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:34:05.849113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b84a8e-2cd4-4fbb-a068-3042d24aa3cd service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:34:05.860342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b84a8e-2cd4-4fbb-a068-3042d24aa3cd service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:34:05.918437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:34:05.919066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:34:05.919345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:34:05.919613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] PATH_INFO: `/v3/projects/5c13f3a9d12c4710882a17d9d06b3473` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:34:05.921265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c13f3a9d12c4710882a17d9d06b3473)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:34:05.923138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:34:05.968181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c13f3a9d12c4710882a17d9d06b3473', 'request_id': 'req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:05.974557 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c13f3a9d12c4710882a17d9d06b3473', 'request_id': 'req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:05.980360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c13f3a9d12c4710882a17d9d06b3473', 'request_id': 'req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:05.992205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] The token cache is being invalidate because project 5c13f3a9d12c4710882a17d9d06b3473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:34:05.992400 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:05.993040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:05.994646 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4339/8693] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:34:05 2022] DELETE /identity/v3/projects/5c13f3a9d12c4710882a17d9d06b3473 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:34:05.999527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:34:06.000958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:34:06.014564 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fbea2-d812-4167-b5d9-43de61248ae8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:34:06.078245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23be3b-8cf0-4d03-a6bb-6a41a959a843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:34:06.078888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23be3b-8cf0-4d03-a6bb-6a41a959a843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:34:06.079885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23be3b-8cf0-4d03-a6bb-6a41a959a843 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:34:06.080170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23be3b-8cf0-4d03-a6bb-6a41a959a843 admin admin] PATH_INFO: `/v3/users/51623e38eefd43d5900a5e1ffbbfbf2f` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:34:06.081620 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23be3b-8cf0-4d03-a6bb-6a41a959a843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51623e38eefd43d5900a5e1ffbbfbf2f)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:34:06.083465 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23be3b-8cf0-4d03-a6bb-6a41a959a843 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:34:06.110074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:34:06.138286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cd23be3b-8cf0-4d03-a6bb-6a41a959a843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51623e38eefd43d5900a5e1ffbbfbf2f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:06.145156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cd23be3b-8cf0-4d03-a6bb-6a41a959a843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51623e38eefd43d5900a5e1ffbbfbf2f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:06.145847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cd23be3b-8cf0-4d03-a6bb-6a41a959a843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51623e38eefd43d5900a5e1ffbbfbf2f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:06.146450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cd23be3b-8cf0-4d03-a6bb-6a41a959a843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51623e38eefd43d5900a5e1ffbbfbf2f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:06.158898 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cd23be3b-8cf0-4d03-a6bb-6a41a959a843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51623e38eefd43d5900a5e1ffbbfbf2f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:06.171473 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4355/8694] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:34:05 2022] DELETE /identity/v3/users/51623e38eefd43d5900a5e1ffbbfbf2f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:34:06.348192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:34:06.349973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:34:06.371036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c5f3d-a56e-43b2-8eb3-e539fcc1f3e5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:34:06.436803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:34:06.437483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:34:06.437766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:34:06.438049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] PATH_INFO: `/v3/projects/5a8f2217084c4687b5407fbea4b3d39f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:34:06.439871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a8f2217084c4687b5407fbea4b3d39f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:34:06.442212 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:34:06.480540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:34:06.496329 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a8f2217084c4687b5407fbea4b3d39f', 'request_id': 'req-e30adf25-371e-48cc-8064-6574ad2bb90f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:06.508635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a8f2217084c4687b5407fbea4b3d39f', 'request_id': 'req-e30adf25-371e-48cc-8064-6574ad2bb90f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:06.516096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a8f2217084c4687b5407fbea4b3d39f', 'request_id': 'req-e30adf25-371e-48cc-8064-6574ad2bb90f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:06.528759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] The token cache is being invalidate because project 5a8f2217084c4687b5407fbea4b3d39f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:34:06.529018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:06.530275 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:34:06.531844 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4340/8695] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:34:06 2022] DELETE /identity/v3/projects/5a8f2217084c4687b5407fbea4b3d39f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:34:16.167482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:34:16.525125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:34:35.160666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f2c6-a790-4fe4-870c-6c7cf860daef None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:34:35.161120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f2c6-a790-4fe4-870c-6c7cf860daef None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:34:35.161309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f2c6-a790-4fe4-870c-6c7cf860daef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:34:35.180776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dc75f2c6-a790-4fe4-870c-6c7cf860daef None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:34:35.182007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dc75f2c6-a790-4fe4-870c-6c7cf860daef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:34:35.236645 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4356/8696] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:34:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:34:35.248844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:34:35.250418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:34:35.323416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30adf25-371e-48cc-8064-6574ad2bb90f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:34:35.328478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506674be-43ac-4f47-8d37-bcdb7238ad22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:34:35.329092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506674be-43ac-4f47-8d37-bcdb7238ad22 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:34:35.329408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506674be-43ac-4f47-8d37-bcdb7238ad22 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:34:35.329690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506674be-43ac-4f47-8d37-bcdb7238ad22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:34:35.337719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506674be-43ac-4f47-8d37-bcdb7238ad22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:34:35.339543 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506674be-43ac-4f47-8d37-bcdb7238ad22 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:34:35.348060 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4341/8697] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:34:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:34:38.141777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d1ea-376b-43ac-8293-18acd59c7bcf None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:34:38.142270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d1ea-376b-43ac-8293-18acd59c7bcf None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:34:38.142376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d1ea-376b-43ac-8293-18acd59c7bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:34:38.161526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2047d1ea-376b-43ac-8293-18acd59c7bcf None None] MFA Rules not processed for user `7ac4eff18a664804af16cf21321f9290`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:34:38.162709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2047d1ea-376b-43ac-8293-18acd59c7bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:34:38.215902 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4357/8698] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:34:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:34:38.993133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506674be-43ac-4f47-8d37-bcdb7238ad22 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:34:38.994805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-506674be-43ac-4f47-8d37-bcdb7238ad22 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:34:39.080990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506674be-43ac-4f47-8d37-bcdb7238ad22 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:34:39.086192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7285406-d269-47d8-8748-542d3cec85ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:34:39.086803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285406-d269-47d8-8748-542d3cec85ec service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:34:39.087085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285406-d269-47d8-8748-542d3cec85ec service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:34:39.087360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285406-d269-47d8-8748-542d3cec85ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:34:39.089358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c7285406-d269-47d8-8748-542d3cec85ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:34:39.103264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7285406-d269-47d8-8748-542d3cec85ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:34:39.104829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7285406-d269-47d8-8748-542d3cec85ec service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:34:39.117305 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4342/8699] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:34:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:34:46.580655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047d1ea-376b-43ac-8293-18acd59c7bcf None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:34:46.582350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2047d1ea-376b-43ac-8293-18acd59c7bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:34:46.664771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047d1ea-376b-43ac-8293-18acd59c7bcf None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:34:46.670194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82697823-7227-4820-a8d0-5512cb8c42fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:34:46.670799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82697823-7227-4820-a8d0-5512cb8c42fe service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:34:46.671083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82697823-7227-4820-a8d0-5512cb8c42fe service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:34:46.671361 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82697823-7227-4820-a8d0-5512cb8c42fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:34:46.673125 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-82697823-7227-4820-a8d0-5512cb8c42fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:34:46.687721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82697823-7227-4820-a8d0-5512cb8c42fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:34:46.689858 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82697823-7227-4820-a8d0-5512cb8c42fe service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:34:46.702947 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4358/8700] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:34:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:34:48.650450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7285406-d269-47d8-8748-542d3cec85ec service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:34:48.651840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c7285406-d269-47d8-8748-542d3cec85ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:34:48.710469 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7285406-d269-47d8-8748-542d3cec85ec service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:34:48.714281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc5d3b-ad0f-4108-aa0d-dcfdbd7e4cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:34:48.714872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc5d3b-ad0f-4108-aa0d-dcfdbd7e4cca service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:34:48.715147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc5d3b-ad0f-4108-aa0d-dcfdbd7e4cca service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:34:48.715414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc5d3b-ad0f-4108-aa0d-dcfdbd7e4cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:34:48.717146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4fdc5d3b-ad0f-4108-aa0d-dcfdbd7e4cca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:34:48.742807 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:34:48.779308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc5d3b-ad0f-4108-aa0d-dcfdbd7e4cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:34:48.780719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc5d3b-ad0f-4108-aa0d-dcfdbd7e4cca service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:34:48.790660 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4343/8701] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:34:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:34:56.696001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:34:58.786461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=18 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:35:01.736119 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82697823-7227-4820-a8d0-5512cb8c42fe service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:35:01.750035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82697823-7227-4820-a8d0-5512cb8c42fe service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:35:01.755156 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7142df-409e-4a91-adc0-88527ed0ff43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:35:01.755758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7142df-409e-4a91-adc0-88527ed0ff43 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:35:01.756039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7142df-409e-4a91-adc0-88527ed0ff43 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:35:01.756312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7142df-409e-4a91-adc0-88527ed0ff43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:35:01.758090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cd7142df-409e-4a91-adc0-88527ed0ff43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:35:01.772173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7142df-409e-4a91-adc0-88527ed0ff43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:35:01.773786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7142df-409e-4a91-adc0-88527ed0ff43 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:35:01.786823 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4359/8702] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:35:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:35:04.450117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc5d3b-ad0f-4108-aa0d-dcfdbd7e4cca service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:35:04.451517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4fdc5d3b-ad0f-4108-aa0d-dcfdbd7e4cca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:35:04.468706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc5d3b-ad0f-4108-aa0d-dcfdbd7e4cca service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:35:04.474310 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39456d-1338-4f4d-87cb-419e61cb20f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:35:04.474917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39456d-1338-4f4d-87cb-419e61cb20f7 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:35:04.475198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39456d-1338-4f4d-87cb-419e61cb20f7 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:35:04.475475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39456d-1338-4f4d-87cb-419e61cb20f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:35:04.477172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d39456d-1338-4f4d-87cb-419e61cb20f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:35:04.492163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39456d-1338-4f4d-87cb-419e61cb20f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:35:04.493783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39456d-1338-4f4d-87cb-419e61cb20f7 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:35:04.506669 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4344/8703] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:35:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:35:11.779509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:35:14.499742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:36:59.078208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81139a4-f090-43c0-9101-f5c4283e859d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:36:59.079239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81139a4-f090-43c0-9101-f5c4283e859d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:36:59.079349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81139a4-f090-43c0-9101-f5c4283e859d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:36:59.111448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e81139a4-f090-43c0-9101-f5c4283e859d None None] MFA Rules not processed for user `7ac4eff18a664804af16cf21321f9290`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:36:59.112696 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e81139a4-f090-43c0-9101-f5c4283e859d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:36:59.139205 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4360/8704] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:36:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:37:09.137122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=15 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:38:07.827439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39456d-1338-4f4d-87cb-419e61cb20f7 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:38:07.829243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3d39456d-1338-4f4d-87cb-419e61cb20f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:38:07.890968 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39456d-1338-4f4d-87cb-419e61cb20f7 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:38:07.895633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dba45e-7aed-4c51-b4dd-eea53471229c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:38:07.896307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dba45e-7aed-4c51-b4dd-eea53471229c service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:38:07.896618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dba45e-7aed-4c51-b4dd-eea53471229c service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:38:07.896907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dba45e-7aed-4c51-b4dd-eea53471229c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:38:07.898956 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-57dba45e-7aed-4c51-b4dd-eea53471229c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:38:07.912076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dba45e-7aed-4c51-b4dd-eea53471229c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:38:07.913644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dba45e-7aed-4c51-b4dd-eea53471229c service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:38:07.926345 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4345/8705] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:38:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:38:17.918443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=24 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:38:51.296524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81139a4-f090-43c0-9101-f5c4283e859d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:38:51.298667 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e81139a4-f090-43c0-9101-f5c4283e859d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:38:51.378745 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81139a4-f090-43c0-9101-f5c4283e859d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:38:51.382307 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e3e3-514c-4e36-bd9d-48dc53336ce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:38:51.382906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e3e3-514c-4e36-bd9d-48dc53336ce0 service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:38:51.383179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e3e3-514c-4e36-bd9d-48dc53336ce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:38:51.383451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e3e3-514c-4e36-bd9d-48dc53336ce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:38:51.385148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b358e3e3-514c-4e36-bd9d-48dc53336ce0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:38:51.395944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358e3e3-514c-4e36-bd9d-48dc53336ce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:38:51.397402 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358e3e3-514c-4e36-bd9d-48dc53336ce0 service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:38:51.406414 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4361/8706] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:38:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:38:54.085169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7ecf-0e2c-4639-ad7e-a514d14619e4 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:38:54.085728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7ecf-0e2c-4639-ad7e-a514d14619e4 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:38:54.085830 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7ecf-0e2c-4639-ad7e-a514d14619e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:38:54.106957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-769e7ecf-0e2c-4639-ad7e-a514d14619e4 None None] MFA Rules not processed for user `7ac4eff18a664804af16cf21321f9290`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:38:54.108160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-769e7ecf-0e2c-4639-ad7e-a514d14619e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:38:54.115653 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4346/8707] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:38:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:38:54.161378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e3e3-514c-4e36-bd9d-48dc53336ce0 service cinder] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:38:54.172383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e3e3-514c-4e36-bd9d-48dc53336ce0 service cinder] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:38:54.176627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f2481-eea6-4401-b6db-f8af7f98dbdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:38:54.177241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f2481-eea6-4401-b6db-f8af7f98dbdf service cinder] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:38:54.177522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f2481-eea6-4401-b6db-f8af7f98dbdf service cinder] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:38:54.177820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f2481-eea6-4401-b6db-f8af7f98dbdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:38:54.179537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1d5f2481-eea6-4401-b6db-f8af7f98dbdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:38:54.201558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f2481-eea6-4401-b6db-f8af7f98dbdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:38:54.203209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f2481-eea6-4401-b6db-f8af7f98dbdf service cinder] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:38:54.216881 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4362/8708] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:38:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:38:54.502644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e7ecf-0e2c-4639-ad7e-a514d14619e4 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:38:54.514854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e7ecf-0e2c-4639-ad7e-a514d14619e4 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:38:54.518899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55d12d-8a6c-46e4-8cda-14c5b875ed8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:38:54.519494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55d12d-8a6c-46e4-8cda-14c5b875ed8c service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:38:54.519771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55d12d-8a6c-46e4-8cda-14c5b875ed8c service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:38:54.520042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55d12d-8a6c-46e4-8cda-14c5b875ed8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:38:54.521844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-fa55d12d-8a6c-46e4-8cda-14c5b875ed8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:38:54.534514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55d12d-8a6c-46e4-8cda-14c5b875ed8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:38:54.535961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55d12d-8a6c-46e4-8cda-14c5b875ed8c service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:38:54.546593 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4347/8709] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:38:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:38:55.018941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90bd28-1478-4fbb-baf1-801833542e40 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:38:55.019313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90bd28-1478-4fbb-baf1-801833542e40 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:38:55.019665 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90bd28-1478-4fbb-baf1-801833542e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:38:55.076642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6e90bd28-1478-4fbb-baf1-801833542e40 None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:38:55.078162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6e90bd28-1478-4fbb-baf1-801833542e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:38:55.085242 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4363/8710] 10.222.0.26 () {58 vars in 1061 bytes} [Sat Oct 8 21:38:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:38:55.091939 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55d12d-8a6c-46e4-8cda-14c5b875ed8c service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:38:55.101420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55d12d-8a6c-46e4-8cda-14c5b875ed8c service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:38:55.105462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493783e6-1ae8-471f-8358-bbeda9472aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:38:55.106067 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493783e6-1ae8-471f-8358-bbeda9472aea service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:38:55.106347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493783e6-1ae8-471f-8358-bbeda9472aea service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:38:55.106620 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493783e6-1ae8-471f-8358-bbeda9472aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:38:55.108323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-493783e6-1ae8-471f-8358-bbeda9472aea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:38:55.125504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493783e6-1ae8-471f-8358-bbeda9472aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:38:55.126912 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493783e6-1ae8-471f-8358-bbeda9472aea service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:38:55.141320 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4348/8711] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:38:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:38:57.791047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90bd28-1478-4fbb-baf1-801833542e40 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:38:57.799434 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90bd28-1478-4fbb-baf1-801833542e40 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:38:57.803185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9701e94-2515-49ec-a552-c6db94e03bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:38:57.803800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9701e94-2515-49ec-a552-c6db94e03bdd service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:38:57.804080 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9701e94-2515-49ec-a552-c6db94e03bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:38:57.804528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9701e94-2515-49ec-a552-c6db94e03bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:38:57.806343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e9701e94-2515-49ec-a552-c6db94e03bdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:38:57.820460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9701e94-2515-49ec-a552-c6db94e03bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:38:57.822376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9701e94-2515-49ec-a552-c6db94e03bdd service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:38:57.836052 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4364/8712] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:38:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:38:58.493233 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493783e6-1ae8-471f-8358-bbeda9472aea service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:38:58.494657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-493783e6-1ae8-471f-8358-bbeda9472aea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:38:58.521358 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493783e6-1ae8-471f-8358-bbeda9472aea service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:38:58.528997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90276fa9-6134-4853-a9ca-3910ba4972dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:38:58.530974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276fa9-6134-4853-a9ca-3910ba4972dc service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:38:58.530974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276fa9-6134-4853-a9ca-3910ba4972dc service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:38:58.531335 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276fa9-6134-4853-a9ca-3910ba4972dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:38:58.538404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-90276fa9-6134-4853-a9ca-3910ba4972dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:38:58.557085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90276fa9-6134-4853-a9ca-3910ba4972dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:38:58.559014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90276fa9-6134-4853-a9ca-3910ba4972dc service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:38:58.573626 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4349/8713] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:38:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:39:07.828440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=63 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:39:08.565638 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=21 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:40:05.768736 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9701e94-2515-49ec-a552-c6db94e03bdd service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:40:05.784423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9701e94-2515-49ec-a552-c6db94e03bdd service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:40:05.789895 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2245d-16f3-47c9-89eb-8d188055be7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:40:05.790496 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2245d-16f3-47c9-89eb-8d188055be7c service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:40:05.790779 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2245d-16f3-47c9-89eb-8d188055be7c service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:40:05.791052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2245d-16f3-47c9-89eb-8d188055be7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:40:05.802759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2245d-16f3-47c9-89eb-8d188055be7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:40:05.804442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2245d-16f3-47c9-89eb-8d188055be7c service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:40:05.817514 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4365/8714] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:40:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:40:06.477052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90276fa9-6134-4853-a9ca-3910ba4972dc service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:40:06.492978 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90276fa9-6134-4853-a9ca-3910ba4972dc service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:40:06.498941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88884e2-b003-44b6-9fb8-e8bc9d103f62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:40:06.499591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88884e2-b003-44b6-9fb8-e8bc9d103f62 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:40:06.499870 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88884e2-b003-44b6-9fb8-e8bc9d103f62 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:40:06.500141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88884e2-b003-44b6-9fb8-e8bc9d103f62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:40:06.511364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88884e2-b003-44b6-9fb8-e8bc9d103f62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:40:06.512987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88884e2-b003-44b6-9fb8-e8bc9d103f62 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:40:06.525504 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4350/8715] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:40:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:40:15.810911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:40:16.518520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:26.416934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2245d-16f3-47c9-89eb-8d188055be7c service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:26.434659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2245d-16f3-47c9-89eb-8d188055be7c service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:26.449875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cfadf-cbf8-421c-8694-c11192cc799e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:26.451408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cfadf-cbf8-421c-8694-c11192cc799e service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:26.451979 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cfadf-cbf8-421c-8694-c11192cc799e service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:26.453237 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cfadf-cbf8-421c-8694-c11192cc799e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:26.456467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f78cfadf-cbf8-421c-8694-c11192cc799e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:26.475586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cfadf-cbf8-421c-8694-c11192cc799e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:26.477409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cfadf-cbf8-421c-8694-c11192cc799e service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:26.495645 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4366/8716] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:41:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:41:31.940038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693422ba-2ad4-4790-a541-757291e11b6c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:31.940587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693422ba-2ad4-4790-a541-757291e11b6c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:31.940690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693422ba-2ad4-4790-a541-757291e11b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:31.960610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-693422ba-2ad4-4790-a541-757291e11b6c None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:41:31.961789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-693422ba-2ad4-4790-a541-757291e11b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:31.970496 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4351/8717] 10.222.0.26 () {58 vars in 1061 bytes} [Sat Oct 8 21:41:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:41:31.976513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cfadf-cbf8-421c-8694-c11192cc799e service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:31.985695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cfadf-cbf8-421c-8694-c11192cc799e service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:31.989244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b8f03-650a-4edf-b182-84474b9816ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:31.989829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b8f03-650a-4edf-b182-84474b9816ef service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:31.990104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b8f03-650a-4edf-b182-84474b9816ef service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:31.990373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b8f03-650a-4edf-b182-84474b9816ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:31.992058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-678b8f03-650a-4edf-b182-84474b9816ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:32.074919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b8f03-650a-4edf-b182-84474b9816ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:32.076342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b8f03-650a-4edf-b182-84474b9816ef service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:32.085746 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4367/8718] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:41:35.209441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693422ba-2ad4-4790-a541-757291e11b6c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:35.227844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693422ba-2ad4-4790-a541-757291e11b6c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:35.233395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083cf9d-1fc4-4f63-9728-6e5711743716 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:35.234223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083cf9d-1fc4-4f63-9728-6e5711743716 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:35.234629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083cf9d-1fc4-4f63-9728-6e5711743716 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:35.234929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083cf9d-1fc4-4f63-9728-6e5711743716 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:35.236735 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5083cf9d-1fc4-4f63-9728-6e5711743716 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:35.270920 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083cf9d-1fc4-4f63-9728-6e5711743716 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:35.273371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083cf9d-1fc4-4f63-9728-6e5711743716 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:35.291602 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4352/8719] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:41:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:41:38.311153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b8f03-650a-4edf-b182-84474b9816ef service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:38.337141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b8f03-650a-4edf-b182-84474b9816ef service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:38.343719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5d92b-684f-4546-baa6-7c2a89b46bb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:38.344654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5d92b-684f-4546-baa6-7c2a89b46bb5 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:38.345087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5d92b-684f-4546-baa6-7c2a89b46bb5 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:38.345691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5d92b-684f-4546-baa6-7c2a89b46bb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:38.347638 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cfc5d92b-684f-4546-baa6-7c2a89b46bb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:38.363776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5d92b-684f-4546-baa6-7c2a89b46bb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:38.365208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5d92b-684f-4546-baa6-7c2a89b46bb5 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:38.381050 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4368/8720] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:41:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:41:38.399354 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083cf9d-1fc4-4f63-9728-6e5711743716 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:38.400911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5083cf9d-1fc4-4f63-9728-6e5711743716 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:38.422806 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083cf9d-1fc4-4f63-9728-6e5711743716 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:38.427504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:38.428134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:38.428413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:38.428716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] PATH_INFO: `/v3/users/7ac4eff18a664804af16cf21321f9290` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:38.429861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac4eff18a664804af16cf21321f9290)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:38.431763 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:38.483414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac4eff18a664804af16cf21321f9290'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.490652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac4eff18a664804af16cf21321f9290'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.491346 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac4eff18a664804af16cf21321f9290'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.491953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac4eff18a664804af16cf21321f9290'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.504244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac4eff18a664804af16cf21321f9290'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.517407 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4353/8721] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:41:38 2022] DELETE /identity/v3/users/7ac4eff18a664804af16cf21321f9290 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:41:38.690451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5d92b-684f-4546-baa6-7c2a89b46bb5 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:38.701700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5d92b-684f-4546-baa6-7c2a89b46bb5 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:38.759765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:38.760395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:38.760677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:38.760953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] PATH_INFO: `/v3/projects/8d9857e88402494e964f2099de5bb60c` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:38.762093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9857e88402494e964f2099de5bb60c)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:38.763990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:38.809568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9857e88402494e964f2099de5bb60c', 'request_id': 'req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.811149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:38.816831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9857e88402494e964f2099de5bb60c', 'request_id': 'req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.823073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9857e88402494e964f2099de5bb60c', 'request_id': 'req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.833836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] The token cache is being invalidate because project 8d9857e88402494e964f2099de5bb60c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:41:38.834120 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.834732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.836194 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4369/8722] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:41:38 2022] DELETE /identity/v3/projects/8d9857e88402494e964f2099de5bb60c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:41:38.840409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:38.841945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:38.855401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873b422-8a5e-40d5-b553-fc4b373697ce admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:38.910640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e62a7b-1b7d-4c15-bc60-923a04f0c90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:38.911193 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62a7b-1b7d-4c15-bc60-923a04f0c90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:38.911470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62a7b-1b7d-4c15-bc60-923a04f0c90d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:38.911742 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62a7b-1b7d-4c15-bc60-923a04f0c90d admin admin] PATH_INFO: `/v3/users/7b1e7427302e4c7091796d6610b5d577` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:38.912861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e62a7b-1b7d-4c15-bc60-923a04f0c90d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1e7427302e4c7091796d6610b5d577)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:38.914787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e62a7b-1b7d-4c15-bc60-923a04f0c90d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:38.962075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:38.965361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23e62a7b-1b7d-4c15-bc60-923a04f0c90d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1e7427302e4c7091796d6610b5d577'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.974221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23e62a7b-1b7d-4c15-bc60-923a04f0c90d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1e7427302e4c7091796d6610b5d577'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.974926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23e62a7b-1b7d-4c15-bc60-923a04f0c90d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1e7427302e4c7091796d6610b5d577'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.975595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23e62a7b-1b7d-4c15-bc60-923a04f0c90d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1e7427302e4c7091796d6610b5d577'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:38.987889 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-23e62a7b-1b7d-4c15-bc60-923a04f0c90d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1e7427302e4c7091796d6610b5d577'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:39.000036 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4354/8723] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:41:38 2022] DELETE /identity/v3/users/7b1e7427302e4c7091796d6610b5d577 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:41:39.170089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:39.171534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:39.189830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84225ebb-5c1d-4b23-8fc8-3a25fbe926ec admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:39.246116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:39.246822 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:39.247100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:39.247371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30 admin admin] PATH_INFO: `/v3/projects/caa5c43be90e4e8c806def0912311f29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:39.248651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa5c43be90e4e8c806def0912311f29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:39.250575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:39.296552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa5c43be90e4e8c806def0912311f29', 'request_id': 'req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:39.304839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa5c43be90e4e8c806def0912311f29', 'request_id': 'req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:39.311201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa5c43be90e4e8c806def0912311f29', 'request_id': 'req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:39.322347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30 admin admin] The token cache is being invalidate because project caa5c43be90e4e8c806def0912311f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:41:39.322890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:39.323562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-970e2aad-b968-4ff3-b9e9-acb74b4dfa30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:41:39.325116 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4370/8724] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:41:39 2022] DELETE /identity/v3/projects/caa5c43be90e4e8c806def0912311f29 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:41:48.996526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:DELETE=4,keystone:SELECT=13,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:49.141636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e030a-34b4-4622-9cf0-38cddd186ce3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:49.141918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e030a-34b4-4622-9cf0-38cddd186ce3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:49.142192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e030a-34b4-4622-9cf0-38cddd186ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:49.189802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2c9e030a-34b4-4622-9cf0-38cddd186ce3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:41:49.191017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2c9e030a-34b4-4622-9cf0-38cddd186ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:49.249218 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4355/8725] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:41:49.258146 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5ef3-feec-4840-b9a2-7a5e02f60cbd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:49.258625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5ef3-feec-4840-b9a2-7a5e02f60cbd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:49.258722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5ef3-feec-4840-b9a2-7a5e02f60cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:49.278617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-92db5ef3-feec-4840-b9a2-7a5e02f60cbd None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:41:49.279803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-92db5ef3-feec-4840-b9a2-7a5e02f60cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:49.287462 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4371/8726] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:41:49.292003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e030a-34b4-4622-9cf0-38cddd186ce3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:49.301758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e030a-34b4-4622-9cf0-38cddd186ce3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:49.306316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e111eca-861c-4f19-a8f8-e47dbb5db61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:49.306907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e111eca-861c-4f19-a8f8-e47dbb5db61c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:49.307189 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e111eca-861c-4f19-a8f8-e47dbb5db61c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:49.307461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e111eca-861c-4f19-a8f8-e47dbb5db61c admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:49.308101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e111eca-861c-4f19-a8f8-e47dbb5db61c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:41:49.308401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e111eca-861c-4f19-a8f8-e47dbb5db61c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:49.310507 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e111eca-861c-4f19-a8f8-e47dbb5db61c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:49.321828 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4356/8727] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:41:49.331176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db5ef3-feec-4840-b9a2-7a5e02f60cbd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:49.341387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db5ef3-feec-4840-b9a2-7a5e02f60cbd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:49.346173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e45be5-e393-4b8f-aaf2-38fd17bf5578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:49.346781 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e45be5-e393-4b8f-aaf2-38fd17bf5578 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:49.347085 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e45be5-e393-4b8f-aaf2-38fd17bf5578 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:49.347387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e45be5-e393-4b8f-aaf2-38fd17bf5578 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:49.348028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e45be5-e393-4b8f-aaf2-38fd17bf5578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:49.349997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e45be5-e393-4b8f-aaf2-38fd17bf5578 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:49.391267 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4372/8728] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:41:49 2022] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:41:49.392662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e111eca-861c-4f19-a8f8-e47dbb5db61c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:49.403185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e111eca-861c-4f19-a8f8-e47dbb5db61c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:49.459522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20685e80-0809-440d-a5cd-84fe248660d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:49.460125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20685e80-0809-440d-a5cd-84fe248660d1 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:49.460406 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20685e80-0809-440d-a5cd-84fe248660d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:49.460680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20685e80-0809-440d-a5cd-84fe248660d1 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:49.461330 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20685e80-0809-440d-a5cd-84fe248660d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:49.463221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20685e80-0809-440d-a5cd-84fe248660d1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:49.484308 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4357/8729] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:41:49 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:41:49.488590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e45be5-e393-4b8f-aaf2-38fd17bf5578 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:49.500464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e45be5-e393-4b8f-aaf2-38fd17bf5578 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:49.504952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef471548-f827-4887-ad5d-40883a715a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:49.505613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef471548-f827-4887-ad5d-40883a715a29 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:49.505891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef471548-f827-4887-ad5d-40883a715a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:49.506164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef471548-f827-4887-ad5d-40883a715a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:49.506799 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef471548-f827-4887-ad5d-40883a715a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:49.508375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef471548-f827-4887-ad5d-40883a715a29 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:49.518219 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4373/8730] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:41:49.522267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20685e80-0809-440d-a5cd-84fe248660d1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:49.532258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20685e80-0809-440d-a5cd-84fe248660d1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:49.536804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362e871-c388-416f-80be-6d2cd243e294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:49.537425 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362e871-c388-416f-80be-6d2cd243e294 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:49.537711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362e871-c388-416f-80be-6d2cd243e294 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:49.537988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362e871-c388-416f-80be-6d2cd243e294 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:49.538627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362e871-c388-416f-80be-6d2cd243e294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:49.540215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362e871-c388-416f-80be-6d2cd243e294 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:49.551103 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4358/8731] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:41:49.555034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef471548-f827-4887-ad5d-40883a715a29 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:49.565560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef471548-f827-4887-ad5d-40883a715a29 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:49.570228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67150de0-6373-4d06-b6e9-b7fc911c2d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:49.570866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67150de0-6373-4d06-b6e9-b7fc911c2d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:49.571148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67150de0-6373-4d06-b6e9-b7fc911c2d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:49.571424 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67150de0-6373-4d06-b6e9-b7fc911c2d82 admin admin] PATH_INFO: `/v3/projects/5a63a83e582d420994af2f99ff94a18d/users/6cffbc45fdf3426684cf1478cac3f6b5/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:49.586229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67150de0-6373-4d06-b6e9-b7fc911c2d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a63a83e582d420994af2f99ff94a18d, user_id=6cffbc45fdf3426684cf1478cac3f6b5, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:49.588857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67150de0-6373-4d06-b6e9-b7fc911c2d82 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:49.593315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:49.604857 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4374/8732] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:41:49 2022] PUT /identity/v3/projects/5a63a83e582d420994af2f99ff94a18d/users/6cffbc45fdf3426684cf1478cac3f6b5/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:41:49.618417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3ef07-df58-4658-b319-568521ae2444 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:49.618728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3ef07-df58-4658-b319-568521ae2444 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:49.619006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3ef07-df58-4658-b319-568521ae2444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:49.646716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-00c3ef07-df58-4658-b319-568521ae2444 None None] MFA Rules not processed for user `6cffbc45fdf3426684cf1478cac3f6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:41:49.647918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-00c3ef07-df58-4658-b319-568521ae2444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:49.679640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:49.713076 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4359/8733] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:41:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:41:49.717656 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67150de0-6373-4d06-b6e9-b7fc911c2d82 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:49.787260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67150de0-6373-4d06-b6e9-b7fc911c2d82 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:49.792852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a33a5-0a82-44d8-91b6-7b943428872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:49.793520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a33a5-0a82-44d8-91b6-7b943428872c admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:49.793813 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a33a5-0a82-44d8-91b6-7b943428872c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:49.794084 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a33a5-0a82-44d8-91b6-7b943428872c admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:49.794749 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a33a5-0a82-44d8-91b6-7b943428872c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:49.797306 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a33a5-0a82-44d8-91b6-7b943428872c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:49.832743 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4375/8734] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:41:49 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:41:49.834158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3ef07-df58-4658-b319-568521ae2444 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:49.845902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3ef07-df58-4658-b319-568521ae2444 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:49.902009 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ebb60-f068-469a-ae02-6c4b14e850d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:49.902619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ebb60-f068-469a-ae02-6c4b14e850d5 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:49.903424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ebb60-f068-469a-ae02-6c4b14e850d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:49.903723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ebb60-f068-469a-ae02-6c4b14e850d5 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:49.904348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ebb60-f068-469a-ae02-6c4b14e850d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:49.906314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ebb60-f068-469a-ae02-6c4b14e850d5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:49.926982 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4360/8735] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:41:49 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:41:49.933143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a33a5-0a82-44d8-91b6-7b943428872c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:49.945806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a33a5-0a82-44d8-91b6-7b943428872c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:49.950820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2e81a-4e84-4458-bdf9-b1a3d79fb196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:49.951406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2e81a-4e84-4458-bdf9-b1a3d79fb196 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:49.951682 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2e81a-4e84-4458-bdf9-b1a3d79fb196 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:49.951953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2e81a-4e84-4458-bdf9-b1a3d79fb196 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:49.952615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2e81a-4e84-4458-bdf9-b1a3d79fb196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:49.954266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2e81a-4e84-4458-bdf9-b1a3d79fb196 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:49.964708 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4376/8736] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:41:49.969454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ebb60-f068-469a-ae02-6c4b14e850d5 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:49.979504 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ebb60-f068-469a-ae02-6c4b14e850d5 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:49.984852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ba7bb-719f-48c5-bf39-620014f0f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:49.985536 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ba7bb-719f-48c5-bf39-620014f0f28c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:49.985812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ba7bb-719f-48c5-bf39-620014f0f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:49.986083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ba7bb-719f-48c5-bf39-620014f0f28c admin admin] PATH_INFO: `/v3/projects/e0db56a031a4484489dac0b36fe1e336/users/033f6de070454d3d86de05d560a8fe93/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:50.147505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ba7bb-719f-48c5-bf39-620014f0f28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0db56a031a4484489dac0b36fe1e336, user_id=033f6de070454d3d86de05d560a8fe93, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:50.150085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ba7bb-719f-48c5-bf39-620014f0f28c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:50.163703 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4361/8737] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:41:49 2022] PUT /identity/v3/projects/e0db56a031a4484489dac0b36fe1e336/users/033f6de070454d3d86de05d560a8fe93/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:41:50.167684 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2e81a-4e84-4458-bdf9-b1a3d79fb196 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:50.177785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2e81a-4e84-4458-bdf9-b1a3d79fb196 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:50.234530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a529fb7-38b5-4639-861a-7c0a2dce176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:50.235142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a529fb7-38b5-4639-861a-7c0a2dce176b admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:50.235426 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a529fb7-38b5-4639-861a-7c0a2dce176b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:50.235703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a529fb7-38b5-4639-861a-7c0a2dce176b admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:50.236344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a529fb7-38b5-4639-861a-7c0a2dce176b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:50.237985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a529fb7-38b5-4639-861a-7c0a2dce176b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:50.247852 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4377/8738] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:41:50.252093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ba7bb-719f-48c5-bf39-620014f0f28c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:50.263341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ba7bb-719f-48c5-bf39-620014f0f28c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:50.267825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e26831-853c-4e27-99b1-79facb150c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:50.268475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e26831-853c-4e27-99b1-79facb150c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:50.268738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e26831-853c-4e27-99b1-79facb150c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:50.269006 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e26831-853c-4e27-99b1-79facb150c8c admin admin] PATH_INFO: `/v3/projects/e0db56a031a4484489dac0b36fe1e336/users/033f6de070454d3d86de05d560a8fe93/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:50.270996 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e26831-853c-4e27-99b1-79facb150c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0db56a031a4484489dac0b36fe1e336, user_id=033f6de070454d3d86de05d560a8fe93, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:50.273612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e26831-853c-4e27-99b1-79facb150c8c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:50.284318 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4362/8739] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:41:50 2022] PUT /identity/v3/projects/e0db56a031a4484489dac0b36fe1e336/users/033f6de070454d3d86de05d560a8fe93/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:41:50.294349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbde27-f097-470c-aacb-9e4ea0e2ae06 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:50.294808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbde27-f097-470c-aacb-9e4ea0e2ae06 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:50.294950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbde27-f097-470c-aacb-9e4ea0e2ae06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:50.322975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-50fbde27-f097-470c-aacb-9e4ea0e2ae06 None None] MFA Rules not processed for user `033f6de070454d3d86de05d560a8fe93`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:41:50.324210 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-50fbde27-f097-470c-aacb-9e4ea0e2ae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:50.373543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:50.393557 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4378/8740] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:41:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:41:50.407246 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d16a4c-8892-4b30-b6d5-84208d4be1b1 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:50.407464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d16a4c-8892-4b30-b6d5-84208d4be1b1 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:50.407740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d16a4c-8892-4b30-b6d5-84208d4be1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:50.427223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-79d16a4c-8892-4b30-b6d5-84208d4be1b1 None None] MFA Rules not processed for user `6cffbc45fdf3426684cf1478cac3f6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:41:50.428449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-79d16a4c-8892-4b30-b6d5-84208d4be1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:50.482788 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4363/8741] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:41:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:41:50.497432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbde27-f097-470c-aacb-9e4ea0e2ae06 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:50.498844 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-50fbde27-f097-470c-aacb-9e4ea0e2ae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:50.574382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbde27-f097-470c-aacb-9e4ea0e2ae06 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:50.580510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36957-a022-4d5c-92f1-d183705b1606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:50.581105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36957-a022-4d5c-92f1-d183705b1606 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:50.581417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36957-a022-4d5c-92f1-d183705b1606 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:50.581706 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36957-a022-4d5c-92f1-d183705b1606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:50.589321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a36957-a022-4d5c-92f1-d183705b1606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:50.590997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a36957-a022-4d5c-92f1-d183705b1606 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:50.599728 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4379/8742] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:41:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:41:52.072773 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd754dc3-6500-4fbb-848f-f779aef0ef93 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:52.073353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd754dc3-6500-4fbb-848f-f779aef0ef93 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:52.073353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd754dc3-6500-4fbb-848f-f779aef0ef93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:52.112286 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bd754dc3-6500-4fbb-848f-f779aef0ef93 None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:41:52.113527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bd754dc3-6500-4fbb-848f-f779aef0ef93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:52.126269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:52.181563 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4364/8743] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 21:41:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:41:52.193558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36957-a022-4d5c-92f1-d183705b1606 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:41:52.194950 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-28a36957-a022-4d5c-92f1-d183705b1606 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:41:52.212049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36957-a022-4d5c-92f1-d183705b1606 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:41:52.217577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612440a-3bc4-4489-a4e8-a6e2abbba305 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:41:52.218160 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612440a-3bc4-4489-a4e8-a6e2abbba305 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:41:52.218522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612440a-3bc4-4489-a4e8-a6e2abbba305 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:41:52.218792 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612440a-3bc4-4489-a4e8-a6e2abbba305 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:41:52.227061 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612440a-3bc4-4489-a4e8-a6e2abbba305 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:41:52.228666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612440a-3bc4-4489-a4e8-a6e2abbba305 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:41:52.239288 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4380/8744] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:41:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:42:00.672160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd754dc3-6500-4fbb-848f-f779aef0ef93 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:00.705096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd754dc3-6500-4fbb-848f-f779aef0ef93 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:00.711135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeded17e-66ef-461c-a4da-8194ddcdf30c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:00.711356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeded17e-66ef-461c-a4da-8194ddcdf30c service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:00.711635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeded17e-66ef-461c-a4da-8194ddcdf30c service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:00.711910 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeded17e-66ef-461c-a4da-8194ddcdf30c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:00.713649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-eeded17e-66ef-461c-a4da-8194ddcdf30c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:00.742902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeded17e-66ef-461c-a4da-8194ddcdf30c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:00.744473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeded17e-66ef-461c-a4da-8194ddcdf30c service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:00.758243 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4365/8745] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:42:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:42:02.235105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=44 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:02.993897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612440a-3bc4-4489-a4e8-a6e2abbba305 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:02.995283 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1612440a-3bc4-4489-a4e8-a6e2abbba305 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:03.014052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612440a-3bc4-4489-a4e8-a6e2abbba305 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:03.019476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601dea7-0955-4293-bf2e-415b2289cb2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:03.020062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601dea7-0955-4293-bf2e-415b2289cb2b service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:03.020342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601dea7-0955-4293-bf2e-415b2289cb2b service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:03.020614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601dea7-0955-4293-bf2e-415b2289cb2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:03.029145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601dea7-0955-4293-bf2e-415b2289cb2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:03.030725 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601dea7-0955-4293-bf2e-415b2289cb2b service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:03.040022 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4381/8746] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:42:02 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:42:03.055098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1591232-dd6f-4f7d-ad3b-05ea12f212aa None None] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:03.055580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1591232-dd6f-4f7d-ad3b-05ea12f212aa None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:03.055686 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1591232-dd6f-4f7d-ad3b-05ea12f212aa None None] PATH_INFO: `/` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:03.056970 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4366/8747] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 21:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 21:42:03.061661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601dea7-0955-4293-bf2e-415b2289cb2b service nova] Authenticating service token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 21:42:03.075944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601dea7-0955-4293-bf2e-415b2289cb2b service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:03.084147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601dea7-0955-4293-bf2e-415b2289cb2b service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:03.088702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38b094-953b-4084-a526-7e985414d85b tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '033f6de070454d3d86de05d560a8fe93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0db56a031a4484489dac0b36fe1e336', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:03.089357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38b094-953b-4084-a526-7e985414d85b tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:03.090217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38b094-953b-4084-a526-7e985414d85b tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:03.090512 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38b094-953b-4084-a526-7e985414d85b tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] PATH_INFO: `/v3/projects/e0db56a031a4484489dac0b36fe1e336` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:03.091628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38b094-953b-4084-a526-7e985414d85b tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] RBAC: Authorizing `identity:get_project(project_id=e0db56a031a4484489dac0b36fe1e336)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:03.093449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38b094-953b-4084-a526-7e985414d85b tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:03.095194 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4382/8748] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 21:42:03 2022] GET /identity/v3/projects/e0db56a031a4484489dac0b36fe1e336 => generated 393 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:42:03.254127 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1591232-dd6f-4f7d-ad3b-05ea12f212aa None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:03.255837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f1591232-dd6f-4f7d-ad3b-05ea12f212aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:03.322525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1591232-dd6f-4f7d-ad3b-05ea12f212aa None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:03.326636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852ba1a-29fd-4dd1-9a2c-75277fd726f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:03.327235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852ba1a-29fd-4dd1-9a2c-75277fd726f2 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:03.327530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852ba1a-29fd-4dd1-9a2c-75277fd726f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:03.327782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852ba1a-29fd-4dd1-9a2c-75277fd726f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:03.329484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a852ba1a-29fd-4dd1-9a2c-75277fd726f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:03.341222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852ba1a-29fd-4dd1-9a2c-75277fd726f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:03.342610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852ba1a-29fd-4dd1-9a2c-75277fd726f2 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:03.352916 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4367/8749] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:42:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:42:03.509624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c59ebd-dff9-41d6-872d-03b45f217c93 None None] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:03.510097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c59ebd-dff9-41d6-872d-03b45f217c93 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:03.510202 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c59ebd-dff9-41d6-872d-03b45f217c93 None None] PATH_INFO: `/` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:03.512153 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4383/8750] 10.222.0.26 () {54 vars in 912 bytes} [Sat Oct 8 21:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 21:42:03.516899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852ba1a-29fd-4dd1-9a2c-75277fd726f2 service neutron] Authenticating service token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 08 21:42:03.532590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852ba1a-29fd-4dd1-9a2c-75277fd726f2 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:03.541944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852ba1a-29fd-4dd1-9a2c-75277fd726f2 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:03.546503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6a2ff-f118-4e74-92a8-2e592bb53c82 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '033f6de070454d3d86de05d560a8fe93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0db56a031a4484489dac0b36fe1e336', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:03.547153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6a2ff-f118-4e74-92a8-2e592bb53c82 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:03.547435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6a2ff-f118-4e74-92a8-2e592bb53c82 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:03.547712 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6a2ff-f118-4e74-92a8-2e592bb53c82 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] PATH_INFO: `/v3/projects/e0db56a031a4484489dac0b36fe1e336` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:03.548844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6a2ff-f118-4e74-92a8-2e592bb53c82 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] RBAC: Authorizing `identity:get_project(project_id=e0db56a031a4484489dac0b36fe1e336)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:03.550635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6a2ff-f118-4e74-92a8-2e592bb53c82 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:03.552238 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4368/8751] 10.222.0.26 () {58 vars in 1443 bytes} [Sat Oct 8 21:42:03 2022] GET /identity/v3/projects/e0db56a031a4484489dac0b36fe1e336 => generated 393 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:42:07.475175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c59ebd-dff9-41d6-872d-03b45f217c93 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:07.548823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c59ebd-dff9-41d6-872d-03b45f217c93 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:07.553301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:07.553919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:07.554196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:07.554473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] PATH_INFO: `/v3/users/6cffbc45fdf3426684cf1478cac3f6b5` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:07.555590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cffbc45fdf3426684cf1478cac3f6b5)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:07.557537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:07.604295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cffbc45fdf3426684cf1478cac3f6b5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:07.611505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cffbc45fdf3426684cf1478cac3f6b5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:07.612182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cffbc45fdf3426684cf1478cac3f6b5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:07.612797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cffbc45fdf3426684cf1478cac3f6b5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:07.624703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cffbc45fdf3426684cf1478cac3f6b5'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:07.637410 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4384/8752] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:42:07 2022] DELETE /identity/v3/users/6cffbc45fdf3426684cf1478cac3f6b5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:42:07.642538 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f2f53-8901-48ea-88ff-5a7aa9d19d89 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:07.643016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f2f53-8901-48ea-88ff-5a7aa9d19d89 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:07.643131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f2f53-8901-48ea-88ff-5a7aa9d19d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:07.661858 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-e18f2f53-8901-48ea-88ff-5a7aa9d19d89 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:42:07.663046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e18f2f53-8901-48ea-88ff-5a7aa9d19d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:07.711481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=100 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:07.721017 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4369/8753] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:42:07.730916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:07.732380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:07.786820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:07.790521 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42928634-cc9a-47cb-a47f-18982e7d9f58 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:07.795148 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee727e7-2ee4-4ad2-81d2-48d06c580581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:07.795783 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee727e7-2ee4-4ad2-81d2-48d06c580581 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:07.796484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee727e7-2ee4-4ad2-81d2-48d06c580581 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:07.796661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee727e7-2ee4-4ad2-81d2-48d06c580581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:07.806729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee727e7-2ee4-4ad2-81d2-48d06c580581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:07.808151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee727e7-2ee4-4ad2-81d2-48d06c580581 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:07.818242 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4385/8754] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:42:07.991801 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f2f53-8901-48ea-88ff-5a7aa9d19d89 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:07.993271 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e18f2f53-8901-48ea-88ff-5a7aa9d19d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:08.005700 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f2f53-8901-48ea-88ff-5a7aa9d19d89 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:08.010327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:08.010950 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:08.011223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:08.011491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] PATH_INFO: `/v3/projects/5a63a83e582d420994af2f99ff94a18d` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:08.012604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a63a83e582d420994af2f99ff94a18d)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:08.015121 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:08.061866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a63a83e582d420994af2f99ff94a18d', 'request_id': 'req-254d171d-98af-44d4-85a7-a1437a702006'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.069102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a63a83e582d420994af2f99ff94a18d', 'request_id': 'req-254d171d-98af-44d4-85a7-a1437a702006'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.074882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a63a83e582d420994af2f99ff94a18d', 'request_id': 'req-254d171d-98af-44d4-85a7-a1437a702006'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.086643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] The token cache is being invalidate because project 5a63a83e582d420994af2f99ff94a18d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:42:08.086931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.087568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.089019 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4370/8755] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:42:07 2022] DELETE /identity/v3/projects/5a63a83e582d420994af2f99ff94a18d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:42:08.092998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee727e7-2ee4-4ad2-81d2-48d06c580581 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:08.102728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee727e7-2ee4-4ad2-81d2-48d06c580581 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:08.158115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb0857-646f-4ec7-bfcb-d31822c66624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:08.158865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb0857-646f-4ec7-bfcb-d31822c66624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:08.159145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb0857-646f-4ec7-bfcb-d31822c66624 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:08.159415 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb0857-646f-4ec7-bfcb-d31822c66624 admin admin] PATH_INFO: `/v3/users/033f6de070454d3d86de05d560a8fe93` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:08.160557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb0857-646f-4ec7-bfcb-d31822c66624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=033f6de070454d3d86de05d560a8fe93)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:08.162508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb0857-646f-4ec7-bfcb-d31822c66624 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:08.208527 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-13eb0857-646f-4ec7-bfcb-d31822c66624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '033f6de070454d3d86de05d560a8fe93'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.215425 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-13eb0857-646f-4ec7-bfcb-d31822c66624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '033f6de070454d3d86de05d560a8fe93'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.216029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-13eb0857-646f-4ec7-bfcb-d31822c66624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '033f6de070454d3d86de05d560a8fe93'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.216637 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-13eb0857-646f-4ec7-bfcb-d31822c66624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '033f6de070454d3d86de05d560a8fe93'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.232817 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-13eb0857-646f-4ec7-bfcb-d31822c66624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '033f6de070454d3d86de05d560a8fe93'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.251179 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4386/8756] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:42:08 2022] DELETE /identity/v3/users/033f6de070454d3d86de05d560a8fe93 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:42:08.526790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:08.528527 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:08.543199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d171d-98af-44d4-85a7-a1437a702006 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:08.605814 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99467169-64ba-4f50-a8a1-486ef2eed0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:08.606474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467169-64ba-4f50-a8a1-486ef2eed0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:08.606756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467169-64ba-4f50-a8a1-486ef2eed0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:08.607029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467169-64ba-4f50-a8a1-486ef2eed0e6 admin admin] PATH_INFO: `/v3/projects/e0db56a031a4484489dac0b36fe1e336` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:08.608144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99467169-64ba-4f50-a8a1-486ef2eed0e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0db56a031a4484489dac0b36fe1e336)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:08.610065 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99467169-64ba-4f50-a8a1-486ef2eed0e6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:08.656104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-99467169-64ba-4f50-a8a1-486ef2eed0e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0db56a031a4484489dac0b36fe1e336', 'request_id': 'req-99467169-64ba-4f50-a8a1-486ef2eed0e6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.663215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-99467169-64ba-4f50-a8a1-486ef2eed0e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0db56a031a4484489dac0b36fe1e336', 'request_id': 'req-99467169-64ba-4f50-a8a1-486ef2eed0e6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.668790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-99467169-64ba-4f50-a8a1-486ef2eed0e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0db56a031a4484489dac0b36fe1e336', 'request_id': 'req-99467169-64ba-4f50-a8a1-486ef2eed0e6'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.679689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-99467169-64ba-4f50-a8a1-486ef2eed0e6 admin admin] The token cache is being invalidate because project e0db56a031a4484489dac0b36fe1e336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:42:08.679974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-99467169-64ba-4f50-a8a1-486ef2eed0e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.680601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-99467169-64ba-4f50-a8a1-486ef2eed0e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:42:08.682129 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4371/8757] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:42:08 2022] DELETE /identity/v3/projects/e0db56a031a4484489dac0b36fe1e336 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:42:08.688613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54ed5c-880c-4f08-b261-1b1f5be02435 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:08.689079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54ed5c-880c-4f08-b261-1b1f5be02435 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:08.689216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54ed5c-880c-4f08-b261-1b1f5be02435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:08.710051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ac54ed5c-880c-4f08-b261-1b1f5be02435 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:42:08.711275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ac54ed5c-880c-4f08-b261-1b1f5be02435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:08.775312 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4387/8758] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:42:08.784639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c54ea-406d-4b48-9ebd-d98d4ee9a324 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:08.784927 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c54ea-406d-4b48-9ebd-d98d4ee9a324 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:08.785296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c54ea-406d-4b48-9ebd-d98d4ee9a324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:08.805014 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2a6c54ea-406d-4b48-9ebd-d98d4ee9a324 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:42:08.806262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2a6c54ea-406d-4b48-9ebd-d98d4ee9a324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:08.815587 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4372/8759] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:42:08.819913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54ed5c-880c-4f08-b261-1b1f5be02435 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:08.830630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54ed5c-880c-4f08-b261-1b1f5be02435 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:08.835242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d44ba7-36fd-4da0-9a25-e6d2552ac6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:08.835836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d44ba7-36fd-4da0-9a25-e6d2552ac6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:08.836118 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d44ba7-36fd-4da0-9a25-e6d2552ac6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:08.836394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d44ba7-36fd-4da0-9a25-e6d2552ac6d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:08.837042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d44ba7-36fd-4da0-9a25-e6d2552ac6d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:42:08.837382 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d44ba7-36fd-4da0-9a25-e6d2552ac6d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:08.838984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d44ba7-36fd-4da0-9a25-e6d2552ac6d1 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:08.845662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:08.855287 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4388/8760] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:42:08.856867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c54ea-406d-4b48-9ebd-d98d4ee9a324 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:08.866361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c54ea-406d-4b48-9ebd-d98d4ee9a324 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:08.871059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7cfb2-dfb9-4712-a157-8877a93e9cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:08.871641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7cfb2-dfb9-4712-a157-8877a93e9cab admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:08.871917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7cfb2-dfb9-4712-a157-8877a93e9cab admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:08.872759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7cfb2-dfb9-4712-a157-8877a93e9cab admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:08.873432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7cfb2-dfb9-4712-a157-8877a93e9cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:08.875305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7cfb2-dfb9-4712-a157-8877a93e9cab admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:08.879704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:08.903506 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4373/8761] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:42:08 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:42:08.907806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d44ba7-36fd-4da0-9a25-e6d2552ac6d1 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:08.917768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d44ba7-36fd-4da0-9a25-e6d2552ac6d1 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:08.973231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb05346-8f0b-4412-8972-ceda256f645f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:08.973830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb05346-8f0b-4412-8972-ceda256f645f admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:08.974117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb05346-8f0b-4412-8972-ceda256f645f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:08.974392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb05346-8f0b-4412-8972-ceda256f645f admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:08.975020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb05346-8f0b-4412-8972-ceda256f645f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:08.976934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb05346-8f0b-4412-8972-ceda256f645f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:08.998653 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4389/8762] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:42:08 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:42:09.002929 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7cfb2-dfb9-4712-a157-8877a93e9cab admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:09.014410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7cfb2-dfb9-4712-a157-8877a93e9cab admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:09.019128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34470-b023-465a-ba83-a3e9fabc4348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:09.019837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34470-b023-465a-ba83-a3e9fabc4348 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:09.020146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34470-b023-465a-ba83-a3e9fabc4348 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:09.020420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34470-b023-465a-ba83-a3e9fabc4348 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:09.021086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34470-b023-465a-ba83-a3e9fabc4348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:09.022706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34470-b023-465a-ba83-a3e9fabc4348 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:09.034574 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4374/8763] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:42:09.038768 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb05346-8f0b-4412-8972-ceda256f645f admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:09.049517 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb05346-8f0b-4412-8972-ceda256f645f admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:09.054350 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba0f5e-5e10-4ed0-b877-8b1ccb35b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:09.054942 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba0f5e-5e10-4ed0-b877-8b1ccb35b6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:09.055226 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba0f5e-5e10-4ed0-b877-8b1ccb35b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:09.055499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba0f5e-5e10-4ed0-b877-8b1ccb35b6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:09.056139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba0f5e-5e10-4ed0-b877-8b1ccb35b6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:09.057991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba0f5e-5e10-4ed0-b877-8b1ccb35b6d5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:09.069456 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4390/8764] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:42:09.073843 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34470-b023-465a-ba83-a3e9fabc4348 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:09.083841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34470-b023-465a-ba83-a3e9fabc4348 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:09.088440 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fa933-770a-4491-8837-50c250121caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:09.089072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fa933-770a-4491-8837-50c250121caf admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:09.089381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fa933-770a-4491-8837-50c250121caf admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:09.089651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fa933-770a-4491-8837-50c250121caf admin admin] PATH_INFO: `/v3/projects/1b9165c14330434ba951ad616b3f76ce/users/8a8cc619b5f742a3a2849d2d424082cb/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:09.103739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fa933-770a-4491-8837-50c250121caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9165c14330434ba951ad616b3f76ce, user_id=8a8cc619b5f742a3a2849d2d424082cb, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:09.106877 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fa933-770a-4491-8837-50c250121caf admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:09.119033 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4375/8765] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:42:09 2022] PUT /identity/v3/projects/1b9165c14330434ba951ad616b3f76ce/users/8a8cc619b5f742a3a2849d2d424082cb/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:42:09.124718 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cae449-5770-43e1-ba99-3653ddb41f5f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:09.125058 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cae449-5770-43e1-ba99-3653ddb41f5f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:09.125368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cae449-5770-43e1-ba99-3653ddb41f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:09.144013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-12cae449-5770-43e1-ba99-3653ddb41f5f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:42:09.145247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-12cae449-5770-43e1-ba99-3653ddb41f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:09.203017 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4391/8766] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:42:09.212935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fa933-770a-4491-8837-50c250121caf admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:09.214621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3e2fa933-770a-4491-8837-50c250121caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:09.270227 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fa933-770a-4491-8837-50c250121caf admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:09.273824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad003a9-7aac-4912-a0d7-8049fd6c7afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:09.274448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad003a9-7aac-4912-a0d7-8049fd6c7afb service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:09.274731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad003a9-7aac-4912-a0d7-8049fd6c7afb service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:09.275004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad003a9-7aac-4912-a0d7-8049fd6c7afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:09.284375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad003a9-7aac-4912-a0d7-8049fd6c7afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:09.285846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad003a9-7aac-4912-a0d7-8049fd6c7afb service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:09.295758 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4376/8767] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:42:13.257073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a462-72f9-4e18-b7f9-a8472ad5a9e1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:13.257635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a462-72f9-4e18-b7f9-a8472ad5a9e1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:13.257635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a462-72f9-4e18-b7f9-a8472ad5a9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:13.287513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b9f6a462-72f9-4e18-b7f9-a8472ad5a9e1 None None] MFA Rules not processed for user `8a8cc619b5f742a3a2849d2d424082cb`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:42:13.289723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b9f6a462-72f9-4e18-b7f9-a8472ad5a9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:13.367372 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4392/8768] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:42:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:42:13.379091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b7313-e8e2-44d7-a7a8-9a9068497493 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:13.379540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b7313-e8e2-44d7-a7a8-9a9068497493 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:13.379639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b7313-e8e2-44d7-a7a8-9a9068497493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:13.399478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c57b7313-e8e2-44d7-a7a8-9a9068497493 None None] MFA Rules not processed for user `8a8cc619b5f742a3a2849d2d424082cb`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:42:13.400695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c57b7313-e8e2-44d7-a7a8-9a9068497493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:13.408673 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4377/8769] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:42:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:42:13.422752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6a462-72f9-4e18-b7f9-a8472ad5a9e1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:13.424481 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b9f6a462-72f9-4e18-b7f9-a8472ad5a9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:13.435099 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:13.513708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6a462-72f9-4e18-b7f9-a8472ad5a9e1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:13.519449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dd696-dd1e-4155-a1fa-aeccc63710be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:13.520065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dd696-dd1e-4155-a1fa-aeccc63710be service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:13.520341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dd696-dd1e-4155-a1fa-aeccc63710be service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:13.520612 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dd696-dd1e-4155-a1fa-aeccc63710be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:13.529233 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dd696-dd1e-4155-a1fa-aeccc63710be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:13.530823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dd696-dd1e-4155-a1fa-aeccc63710be service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:13.540567 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4393/8770] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:42:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:42:14.115305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca9f1f-2823-4075-bb77-f12c9adf9fc8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:14.115586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca9f1f-2823-4075-bb77-f12c9adf9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:14.115859 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca9f1f-2823-4075-bb77-f12c9adf9fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:14.143157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-18ca9f1f-2823-4075-bb77-f12c9adf9fc8 None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:42:14.144566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-18ca9f1f-2823-4075-bb77-f12c9adf9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:14.215542 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4378/8771] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 21:42:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:42:14.227184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dd696-dd1e-4155-a1fa-aeccc63710be service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:14.228565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f93dd696-dd1e-4155-a1fa-aeccc63710be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:14.246476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dd696-dd1e-4155-a1fa-aeccc63710be service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:14.252310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dbe24-6a30-4591-b5cd-72a857d69e6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:14.252917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dbe24-6a30-4591-b5cd-72a857d69e6c service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:14.253217 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dbe24-6a30-4591-b5cd-72a857d69e6c service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:14.253500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dbe24-6a30-4591-b5cd-72a857d69e6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:14.262597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dbe24-6a30-4591-b5cd-72a857d69e6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:14.264188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dbe24-6a30-4591-b5cd-72a857d69e6c service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:14.274190 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4394/8772] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:42:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:42:24.206609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=79,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:24.269945 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=37 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:24.999636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca9f1f-2823-4075-bb77-f12c9adf9fc8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:25.008662 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca9f1f-2823-4075-bb77-f12c9adf9fc8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:25.012748 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df1ec7-7383-4ba0-b6c5-82c7eb75c8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:25.013503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df1ec7-7383-4ba0-b6c5-82c7eb75c8ae service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:25.013789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df1ec7-7383-4ba0-b6c5-82c7eb75c8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:25.014075 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df1ec7-7383-4ba0-b6c5-82c7eb75c8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:25.015898 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a5df1ec7-7383-4ba0-b6c5-82c7eb75c8ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:25.029277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df1ec7-7383-4ba0-b6c5-82c7eb75c8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:25.030691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df1ec7-7383-4ba0-b6c5-82c7eb75c8ae service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:25.041877 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4379/8773] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:42:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:42:25.121921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426fce4-f9ef-42a7-a513-dadfe582c1a9 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:25.122309 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426fce4-f9ef-42a7-a513-dadfe582c1a9 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:25.122703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426fce4-f9ef-42a7-a513-dadfe582c1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:25.142310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e426fce4-f9ef-42a7-a513-dadfe582c1a9 None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:42:25.143500 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e426fce4-f9ef-42a7-a513-dadfe582c1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:25.152063 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4395/8774] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 21:42:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:42:25.163762 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df1ec7-7383-4ba0-b6c5-82c7eb75c8ae service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:25.178772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df1ec7-7383-4ba0-b6c5-82c7eb75c8ae service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:25.183692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc067e-84e6-4c91-803f-e316b8b74452 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:25.184282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc067e-84e6-4c91-803f-e316b8b74452 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:25.184601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc067e-84e6-4c91-803f-e316b8b74452 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:25.184872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc067e-84e6-4c91-803f-e316b8b74452 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:25.192949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc067e-84e6-4c91-803f-e316b8b74452 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:25.194533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc067e-84e6-4c91-803f-e316b8b74452 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:25.204156 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4380/8775] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:42:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:42:25.379391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426fce4-f9ef-42a7-a513-dadfe582c1a9 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:42:25.380807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e426fce4-f9ef-42a7-a513-dadfe582c1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:25.392209 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426fce4-f9ef-42a7-a513-dadfe582c1a9 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:42:25.395732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ceae8-ec24-4ab3-ae4b-cfb1ca1d04f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:42:25.396320 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ceae8-ec24-4ab3-ae4b-cfb1ca1d04f5 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:42:25.396600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ceae8-ec24-4ab3-ae4b-cfb1ca1d04f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:42:25.396875 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ceae8-ec24-4ab3-ae4b-cfb1ca1d04f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:42:25.398573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ea3ceae8-ec24-4ab3-ae4b-cfb1ca1d04f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:42:25.414117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ceae8-ec24-4ab3-ae4b-cfb1ca1d04f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:42:25.415530 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ceae8-ec24-4ab3-ae4b-cfb1ca1d04f5 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:42:25.429698 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4396/8776] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:42:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:42:35.200262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=12 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:35.422055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=9 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:05.299304 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc067e-84e6-4c91-803f-e316b8b74452 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:43:05.315297 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc067e-84e6-4c91-803f-e316b8b74452 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:43:05.320441 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a2240-def5-443d-9f64-9e77202f7f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:43:05.321550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a2240-def5-443d-9f64-9e77202f7f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:05.321899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a2240-def5-443d-9f64-9e77202f7f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:05.322278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a2240-def5-443d-9f64-9e77202f7f9f admin admin] PATH_INFO: `/v3/users/8a8cc619b5f742a3a2849d2d424082cb` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:05.323646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a2240-def5-443d-9f64-9e77202f7f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8cc619b5f742a3a2849d2d424082cb)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:43:05.326250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a2240-def5-443d-9f64-9e77202f7f9f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:43:05.379940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8d2a2240-def5-443d-9f64-9e77202f7f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8cc619b5f742a3a2849d2d424082cb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:43:05.388382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8d2a2240-def5-443d-9f64-9e77202f7f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8cc619b5f742a3a2849d2d424082cb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:43:05.389211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8d2a2240-def5-443d-9f64-9e77202f7f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8cc619b5f742a3a2849d2d424082cb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:43:05.390031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8d2a2240-def5-443d-9f64-9e77202f7f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8cc619b5f742a3a2849d2d424082cb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:43:05.402588 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8d2a2240-def5-443d-9f64-9e77202f7f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8cc619b5f742a3a2849d2d424082cb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:43:05.416025 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4381/8777] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:43:05 2022] DELETE /identity/v3/users/8a8cc619b5f742a3a2849d2d424082cb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:43:05.592935 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ceae8-ec24-4ab3-ae4b-cfb1ca1d04f5 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:43:05.603887 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ceae8-ec24-4ab3-ae4b-cfb1ca1d04f5 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:43:05.662890 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32094d30-0aaa-46cb-94dc-248756a91620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:43:05.663458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32094d30-0aaa-46cb-94dc-248756a91620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:05.663741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32094d30-0aaa-46cb-94dc-248756a91620 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:05.664017 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32094d30-0aaa-46cb-94dc-248756a91620 admin admin] PATH_INFO: `/v3/projects/1b9165c14330434ba951ad616b3f76ce` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:05.665138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32094d30-0aaa-46cb-94dc-248756a91620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9165c14330434ba951ad616b3f76ce)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:43:05.667174 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32094d30-0aaa-46cb-94dc-248756a91620 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:43:05.715121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-32094d30-0aaa-46cb-94dc-248756a91620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9165c14330434ba951ad616b3f76ce', 'request_id': 'req-32094d30-0aaa-46cb-94dc-248756a91620'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:43:05.722966 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-32094d30-0aaa-46cb-94dc-248756a91620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9165c14330434ba951ad616b3f76ce', 'request_id': 'req-32094d30-0aaa-46cb-94dc-248756a91620'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:43:05.728613 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-32094d30-0aaa-46cb-94dc-248756a91620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9165c14330434ba951ad616b3f76ce', 'request_id': 'req-32094d30-0aaa-46cb-94dc-248756a91620'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:43:05.740287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-32094d30-0aaa-46cb-94dc-248756a91620 admin admin] The token cache is being invalidate because project 1b9165c14330434ba951ad616b3f76ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:43:05.740605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-32094d30-0aaa-46cb-94dc-248756a91620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:43:05.741513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-32094d30-0aaa-46cb-94dc-248756a91620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:43:05.743266 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4397/8778] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:43:05 2022] DELETE /identity/v3/projects/1b9165c14330434ba951ad616b3f76ce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:43:05.748324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f059966-04c0-45e9-bb42-06b1a5eb9761 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:05.748606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f059966-04c0-45e9-bb42-06b1a5eb9761 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:05.748880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f059966-04c0-45e9-bb42-06b1a5eb9761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:05.769352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-3f059966-04c0-45e9-bb42-06b1a5eb9761 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:43:05.770485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3f059966-04c0-45e9-bb42-06b1a5eb9761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:43:05.830459 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4382/8779] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:43:05.838208 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad677a-8ab3-4721-95ab-6081e6781d91 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:05.838494 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad677a-8ab3-4721-95ab-6081e6781d91 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:05.838772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad677a-8ab3-4721-95ab-6081e6781d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:05.860048 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-59ad677a-8ab3-4721-95ab-6081e6781d91 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:43:05.861302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-59ad677a-8ab3-4721-95ab-6081e6781d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:43:05.869253 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4398/8780] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:43:05.873690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f059966-04c0-45e9-bb42-06b1a5eb9761 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:43:05.883364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f059966-04c0-45e9-bb42-06b1a5eb9761 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:43:05.887905 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a346e-463b-4300-921d-b3428de6945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:43:05.888494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a346e-463b-4300-921d-b3428de6945c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:05.888767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a346e-463b-4300-921d-b3428de6945c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:05.889031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a346e-463b-4300-921d-b3428de6945c admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:05.889706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a346e-463b-4300-921d-b3428de6945c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:43:05.890007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a346e-463b-4300-921d-b3428de6945c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:43:05.891599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a346e-463b-4300-921d-b3428de6945c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:43:05.902819 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4383/8781] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:43:05.907847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad677a-8ab3-4721-95ab-6081e6781d91 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:43:05.917142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad677a-8ab3-4721-95ab-6081e6781d91 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:43:05.922593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35898aa-4f5e-4e25-a531-236b433463ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:43:05.923183 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35898aa-4f5e-4e25-a531-236b433463ac admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:05.923460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35898aa-4f5e-4e25-a531-236b433463ac admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:05.923734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35898aa-4f5e-4e25-a531-236b433463ac admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:05.924384 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35898aa-4f5e-4e25-a531-236b433463ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:43:05.926330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35898aa-4f5e-4e25-a531-236b433463ac admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:43:05.953046 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4399/8782] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:43:05 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:43:05.957342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a346e-463b-4300-921d-b3428de6945c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:43:05.967696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a346e-463b-4300-921d-b3428de6945c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:43:06.022414 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da52c1c-4839-440e-9c88-6bafcb109401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:43:06.022945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da52c1c-4839-440e-9c88-6bafcb109401 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:06.023221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da52c1c-4839-440e-9c88-6bafcb109401 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:06.023491 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da52c1c-4839-440e-9c88-6bafcb109401 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:06.024103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da52c1c-4839-440e-9c88-6bafcb109401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:43:06.026038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da52c1c-4839-440e-9c88-6bafcb109401 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:43:06.034470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:06.050420 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4384/8783] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:43:05 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:43:06.054617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35898aa-4f5e-4e25-a531-236b433463ac admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:43:06.068383 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35898aa-4f5e-4e25-a531-236b433463ac admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:43:06.073096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a37df2-0d45-4867-a820-19308e5bb31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:43:06.073814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a37df2-0d45-4867-a820-19308e5bb31a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:06.074098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a37df2-0d45-4867-a820-19308e5bb31a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:06.074375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a37df2-0d45-4867-a820-19308e5bb31a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:06.075151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a37df2-0d45-4867-a820-19308e5bb31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:43:06.076765 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a37df2-0d45-4867-a820-19308e5bb31a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:43:06.089440 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4400/8784] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:43:06.093683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da52c1c-4839-440e-9c88-6bafcb109401 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:43:06.104281 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da52c1c-4839-440e-9c88-6bafcb109401 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:43:06.109974 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4906bd5-64dc-46e1-a5ce-0417a8b7e63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:43:06.110823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4906bd5-64dc-46e1-a5ce-0417a8b7e63a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:06.111198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4906bd5-64dc-46e1-a5ce-0417a8b7e63a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:06.111531 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4906bd5-64dc-46e1-a5ce-0417a8b7e63a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:06.112318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4906bd5-64dc-46e1-a5ce-0417a8b7e63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:43:06.113944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4906bd5-64dc-46e1-a5ce-0417a8b7e63a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:43:06.125150 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4385/8785] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:43:06.129341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a37df2-0d45-4867-a820-19308e5bb31a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:43:06.139466 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a37df2-0d45-4867-a820-19308e5bb31a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:43:06.144087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236f203-cc99-4ab2-8989-a38ce0eea3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:43:06.144735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236f203-cc99-4ab2-8989-a38ce0eea3d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:06.145015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236f203-cc99-4ab2-8989-a38ce0eea3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:06.145330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236f203-cc99-4ab2-8989-a38ce0eea3d5 admin admin] PATH_INFO: `/v3/projects/1be36356ccbf4266819b18ca6cee6d97/users/b2beee1a677a47b48dd244a12de6dac0/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:06.160449 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236f203-cc99-4ab2-8989-a38ce0eea3d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be36356ccbf4266819b18ca6cee6d97, user_id=b2beee1a677a47b48dd244a12de6dac0, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:43:06.163185 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236f203-cc99-4ab2-8989-a38ce0eea3d5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:43:06.176604 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4401/8786] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:43:06 2022] PUT /identity/v3/projects/1be36356ccbf4266819b18ca6cee6d97/users/b2beee1a677a47b48dd244a12de6dac0/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:43:06.181795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e24bf-b72f-4af6-ac40-3369ecd554ba None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:06.182083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e24bf-b72f-4af6-ac40-3369ecd554ba None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:06.182357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e24bf-b72f-4af6-ac40-3369ecd554ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:06.202292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c20e24bf-b72f-4af6-ac40-3369ecd554ba None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:43:06.203489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c20e24bf-b72f-4af6-ac40-3369ecd554ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:43:06.261457 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4386/8787] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:43:06.271940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236f203-cc99-4ab2-8989-a38ce0eea3d5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:43:06.273701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4236f203-cc99-4ab2-8989-a38ce0eea3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:43:06.304499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:06.332757 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236f203-cc99-4ab2-8989-a38ce0eea3d5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:43:06.336752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7793684-f369-4a99-ae76-afe0c147360d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:43:06.337389 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7793684-f369-4a99-ae76-afe0c147360d service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:06.337673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7793684-f369-4a99-ae76-afe0c147360d service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:06.337994 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7793684-f369-4a99-ae76-afe0c147360d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:06.351597 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7793684-f369-4a99-ae76-afe0c147360d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:43:06.353047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7793684-f369-4a99-ae76-afe0c147360d service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:43:06.363575 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4402/8788] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:43:10.708206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b03c2c-f782-41e4-b0eb-511c6fda4c31 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:10.708755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b03c2c-f782-41e4-b0eb-511c6fda4c31 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:10.708755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b03c2c-f782-41e4-b0eb-511c6fda4c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:10.740649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-69b03c2c-f782-41e4-b0eb-511c6fda4c31 None None] MFA Rules not processed for user `b2beee1a677a47b48dd244a12de6dac0`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:43:10.741864 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-69b03c2c-f782-41e4-b0eb-511c6fda4c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:43:10.814483 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4387/8789] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:43:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:43:10.825397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ed129-69fe-49ac-9fd0-9dd20d5faa16 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:10.825954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ed129-69fe-49ac-9fd0-9dd20d5faa16 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:10.825954 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ed129-69fe-49ac-9fd0-9dd20d5faa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:10.845806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-785ed129-69fe-49ac-9fd0-9dd20d5faa16 None None] MFA Rules not processed for user `b2beee1a677a47b48dd244a12de6dac0`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:43:10.847042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-785ed129-69fe-49ac-9fd0-9dd20d5faa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:43:10.854169 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4403/8790] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:43:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:43:10.866659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b03c2c-f782-41e4-b0eb-511c6fda4c31 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:43:10.868139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-69b03c2c-f782-41e4-b0eb-511c6fda4c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:43:10.949833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b03c2c-f782-41e4-b0eb-511c6fda4c31 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:43:10.955457 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b4c19-f14b-4cb8-808e-e9dce8590544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:43:10.956083 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b4c19-f14b-4cb8-808e-e9dce8590544 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:10.956362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b4c19-f14b-4cb8-808e-e9dce8590544 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:10.956631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b4c19-f14b-4cb8-808e-e9dce8590544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:10.961871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:10.967930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b4c19-f14b-4cb8-808e-e9dce8590544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:43:10.970476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b4c19-f14b-4cb8-808e-e9dce8590544 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:43:10.980459 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4388/8791] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:43:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:43:20.839889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=17 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:20.975970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:50.577823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ed129-69fe-49ac-9fd0-9dd20d5faa16 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:43:50.587570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ed129-69fe-49ac-9fd0-9dd20d5faa16 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:43:50.591101 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354d372-40e7-4137-b765-bab47c890cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:43:50.591791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354d372-40e7-4137-b765-bab47c890cda service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:50.592092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354d372-40e7-4137-b765-bab47c890cda service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:50.592366 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354d372-40e7-4137-b765-bab47c890cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:50.594092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5354d372-40e7-4137-b765-bab47c890cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:43:50.606271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354d372-40e7-4137-b765-bab47c890cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:43:50.608222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354d372-40e7-4137-b765-bab47c890cda service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:43:50.618734 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4404/8792] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:43:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:43:55.460218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b4c19-f14b-4cb8-808e-e9dce8590544 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:43:55.470185 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b4c19-f14b-4cb8-808e-e9dce8590544 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:43:55.474158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713edf5-2502-4810-b93a-50a5e236f8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:43:55.474749 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713edf5-2502-4810-b93a-50a5e236f8bb service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:55.475054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713edf5-2502-4810-b93a-50a5e236f8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:55.475319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713edf5-2502-4810-b93a-50a5e236f8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:55.477050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e713edf5-2502-4810-b93a-50a5e236f8bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:43:55.493867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713edf5-2502-4810-b93a-50a5e236f8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:43:55.495279 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713edf5-2502-4810-b93a-50a5e236f8bb service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:43:55.509707 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4389/8793] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:43:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:43:56.875879 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354d372-40e7-4137-b765-bab47c890cda service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:43:56.877364 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5354d372-40e7-4137-b765-bab47c890cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:43:56.887344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354d372-40e7-4137-b765-bab47c890cda service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:43:56.891019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec4dd7-39a1-4cee-8a21-bc31d4f9dceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:43:56.891603 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec4dd7-39a1-4cee-8a21-bc31d4f9dceb service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:56.891877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec4dd7-39a1-4cee-8a21-bc31d4f9dceb service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:56.892150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec4dd7-39a1-4cee-8a21-bc31d4f9dceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:56.893801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-96ec4dd7-39a1-4cee-8a21-bc31d4f9dceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:43:56.910112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec4dd7-39a1-4cee-8a21-bc31d4f9dceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:43:56.911440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec4dd7-39a1-4cee-8a21-bc31d4f9dceb service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:43:56.925546 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4405/8794] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:43:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:43:58.580216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171d3ca-3a75-4dd2-8fa8-765b3abc494f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:43:58.580731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171d3ca-3a75-4dd2-8fa8-765b3abc494f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:43:58.580848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171d3ca-3a75-4dd2-8fa8-765b3abc494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:43:58.599892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-6171d3ca-3a75-4dd2-8fa8-765b3abc494f None None] MFA Rules not processed for user `b2beee1a677a47b48dd244a12de6dac0`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:43:58.601084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6171d3ca-3a75-4dd2-8fa8-765b3abc494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:43:58.607894 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4390/8795] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:43:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:44:06.917607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=12 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:08.595050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=9 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:38.020289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec4dd7-39a1-4cee-8a21-bc31d4f9dceb service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:44:38.029110 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec4dd7-39a1-4cee-8a21-bc31d4f9dceb service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:44:38.032744 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de4ae-e9d4-4e9c-bbad-f8285808f05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:44:38.033367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de4ae-e9d4-4e9c-bbad-f8285808f05e service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:38.033647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de4ae-e9d4-4e9c-bbad-f8285808f05e service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:38.033921 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de4ae-e9d4-4e9c-bbad-f8285808f05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:38.035611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-361de4ae-e9d4-4e9c-bbad-f8285808f05e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:44:38.047588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361de4ae-e9d4-4e9c-bbad-f8285808f05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:44:38.049197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361de4ae-e9d4-4e9c-bbad-f8285808f05e service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:44:38.059742 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4406/8796] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:44:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:44:38.815878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171d3ca-3a75-4dd2-8fa8-765b3abc494f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:44:38.817388 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6171d3ca-3a75-4dd2-8fa8-765b3abc494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:44:38.837499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171d3ca-3a75-4dd2-8fa8-765b3abc494f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:44:38.843084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36194ce4-f275-4607-ae17-998734a31f76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:44:38.843697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36194ce4-f275-4607-ae17-998734a31f76 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:38.843998 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36194ce4-f275-4607-ae17-998734a31f76 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:38.844774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36194ce4-f275-4607-ae17-998734a31f76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:38.846631 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-36194ce4-f275-4607-ae17-998734a31f76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:44:38.862471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36194ce4-f275-4607-ae17-998734a31f76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:44:38.864056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36194ce4-f275-4607-ae17-998734a31f76 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:44:38.877689 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4391/8797] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:44:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:44:48.053738 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:48.870589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:50.683239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de4ae-e9d4-4e9c-bbad-f8285808f05e service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:44:50.698948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de4ae-e9d4-4e9c-bbad-f8285808f05e service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:44:50.703475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c1824-1976-4270-b76d-076b46049d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:44:50.704128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c1824-1976-4270-b76d-076b46049d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:50.704409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c1824-1976-4270-b76d-076b46049d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:50.704683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c1824-1976-4270-b76d-076b46049d40 admin admin] PATH_INFO: `/v3/users/b2beee1a677a47b48dd244a12de6dac0` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:50.705934 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c1824-1976-4270-b76d-076b46049d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2beee1a677a47b48dd244a12de6dac0)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:44:50.707867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c1824-1976-4270-b76d-076b46049d40 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:44:50.754864 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d53c1824-1976-4270-b76d-076b46049d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2beee1a677a47b48dd244a12de6dac0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:44:50.762189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d53c1824-1976-4270-b76d-076b46049d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2beee1a677a47b48dd244a12de6dac0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:44:50.762867 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d53c1824-1976-4270-b76d-076b46049d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2beee1a677a47b48dd244a12de6dac0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:44:50.763482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d53c1824-1976-4270-b76d-076b46049d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2beee1a677a47b48dd244a12de6dac0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:44:50.775444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d53c1824-1976-4270-b76d-076b46049d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2beee1a677a47b48dd244a12de6dac0'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:44:50.788408 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4407/8798] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:44:50 2022] DELETE /identity/v3/users/b2beee1a677a47b48dd244a12de6dac0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:44:51.259245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36194ce4-f275-4607-ae17-998734a31f76 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:44:51.270500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36194ce4-f275-4607-ae17-998734a31f76 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:44:51.326962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d0f64-4305-4450-882e-b2af38ed29e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:44:51.327595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d0f64-4305-4450-882e-b2af38ed29e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:51.327875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d0f64-4305-4450-882e-b2af38ed29e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:51.328146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d0f64-4305-4450-882e-b2af38ed29e5 admin admin] PATH_INFO: `/v3/projects/1be36356ccbf4266819b18ca6cee6d97` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:51.329813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d0f64-4305-4450-882e-b2af38ed29e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be36356ccbf4266819b18ca6cee6d97)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:44:51.331677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d0f64-4305-4450-882e-b2af38ed29e5 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:44:51.377452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ca2d0f64-4305-4450-882e-b2af38ed29e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be36356ccbf4266819b18ca6cee6d97', 'request_id': 'req-ca2d0f64-4305-4450-882e-b2af38ed29e5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:44:51.384506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ca2d0f64-4305-4450-882e-b2af38ed29e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be36356ccbf4266819b18ca6cee6d97', 'request_id': 'req-ca2d0f64-4305-4450-882e-b2af38ed29e5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:44:51.390235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ca2d0f64-4305-4450-882e-b2af38ed29e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be36356ccbf4266819b18ca6cee6d97', 'request_id': 'req-ca2d0f64-4305-4450-882e-b2af38ed29e5'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:44:51.401778 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ca2d0f64-4305-4450-882e-b2af38ed29e5 admin admin] The token cache is being invalidate because project 1be36356ccbf4266819b18ca6cee6d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:44:51.402069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ca2d0f64-4305-4450-882e-b2af38ed29e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:44:51.402710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-ca2d0f64-4305-4450-882e-b2af38ed29e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:44:51.404216 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4392/8799] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:44:51 2022] DELETE /identity/v3/projects/1be36356ccbf4266819b18ca6cee6d97 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:44:51.409344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c5c9b-b80c-4e46-ae53-ed9683fad66d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:51.409632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c5c9b-b80c-4e46-ae53-ed9683fad66d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:51.409906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c5c9b-b80c-4e46-ae53-ed9683fad66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:51.429798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-084c5c9b-b80c-4e46-ae53-ed9683fad66d None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:44:51.431034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-084c5c9b-b80c-4e46-ae53-ed9683fad66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:44:51.490495 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4408/8800] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:44:51.499003 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679b626-01b5-4114-a7fb-d074d987c1b8 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:51.499295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679b626-01b5-4114-a7fb-d074d987c1b8 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:51.499579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679b626-01b5-4114-a7fb-d074d987c1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:51.520151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8679b626-01b5-4114-a7fb-d074d987c1b8 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:44:51.521394 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8679b626-01b5-4114-a7fb-d074d987c1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:44:51.529244 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4393/8801] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:44:51.533346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c5c9b-b80c-4e46-ae53-ed9683fad66d None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:44:51.542989 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c5c9b-b80c-4e46-ae53-ed9683fad66d None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:44:51.547489 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c9985-d2a8-4ada-89be-a2bc557ab8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:44:51.548073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c9985-d2a8-4ada-89be-a2bc557ab8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:51.548359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c9985-d2a8-4ada-89be-a2bc557ab8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:51.548626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c9985-d2a8-4ada-89be-a2bc557ab8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:51.549295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c9985-d2a8-4ada-89be-a2bc557ab8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:44:51.549598 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c9985-d2a8-4ada-89be-a2bc557ab8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:44:51.551163 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c9985-d2a8-4ada-89be-a2bc557ab8c8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:44:51.562895 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4409/8802] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:44:51.567803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679b626-01b5-4114-a7fb-d074d987c1b8 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:44:51.577408 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679b626-01b5-4114-a7fb-d074d987c1b8 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:44:51.583268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cb7dd-1f4c-4518-9871-adda9f58a9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:44:51.584026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cb7dd-1f4c-4518-9871-adda9f58a9db admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:51.584222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cb7dd-1f4c-4518-9871-adda9f58a9db admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:51.584533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cb7dd-1f4c-4518-9871-adda9f58a9db admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:51.585277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cb7dd-1f4c-4518-9871-adda9f58a9db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:44:51.587178 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cb7dd-1f4c-4518-9871-adda9f58a9db admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:44:51.613995 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4394/8803] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:44:51 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:44:51.618447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c9985-d2a8-4ada-89be-a2bc557ab8c8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:44:51.629078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c9985-d2a8-4ada-89be-a2bc557ab8c8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:44:51.685702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb94f68-6778-4155-b75c-eb66edf17790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:44:51.686331 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb94f68-6778-4155-b75c-eb66edf17790 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:51.686499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb94f68-6778-4155-b75c-eb66edf17790 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:51.686776 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb94f68-6778-4155-b75c-eb66edf17790 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:51.687427 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb94f68-6778-4155-b75c-eb66edf17790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:44:51.689899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb94f68-6778-4155-b75c-eb66edf17790 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:44:51.698055 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:51.713078 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4410/8804] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:44:51 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:44:51.717317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cb7dd-1f4c-4518-9871-adda9f58a9db admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:44:51.730215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cb7dd-1f4c-4518-9871-adda9f58a9db admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:44:51.735087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30872045-ed29-4115-a05d-952386ad4da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:44:51.736207 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30872045-ed29-4115-a05d-952386ad4da1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:51.736502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30872045-ed29-4115-a05d-952386ad4da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:51.736776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30872045-ed29-4115-a05d-952386ad4da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:51.737433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30872045-ed29-4115-a05d-952386ad4da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:44:51.739012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30872045-ed29-4115-a05d-952386ad4da1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:44:51.749599 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4395/8805] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:44:51.754410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb94f68-6778-4155-b75c-eb66edf17790 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:44:51.764642 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb94f68-6778-4155-b75c-eb66edf17790 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:44:51.769400 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfadbd2-1e5f-4d52-a920-92d3e79e9a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:44:51.769992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfadbd2-1e5f-4d52-a920-92d3e79e9a50 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:51.770273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfadbd2-1e5f-4d52-a920-92d3e79e9a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:51.770547 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfadbd2-1e5f-4d52-a920-92d3e79e9a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:51.771188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfadbd2-1e5f-4d52-a920-92d3e79e9a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:44:51.772762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfadbd2-1e5f-4d52-a920-92d3e79e9a50 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:44:51.783607 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4411/8806] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:44:51.787697 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30872045-ed29-4115-a05d-952386ad4da1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:44:51.797494 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30872045-ed29-4115-a05d-952386ad4da1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:44:51.802804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fdc43-f20d-4e7b-ba9f-5e044ea69844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:44:51.803464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fdc43-f20d-4e7b-ba9f-5e044ea69844 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:51.803768 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fdc43-f20d-4e7b-ba9f-5e044ea69844 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:51.804048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fdc43-f20d-4e7b-ba9f-5e044ea69844 admin admin] PATH_INFO: `/v3/projects/3718dd3e536649b5bf1970ff06ddea69/users/5e838176b44c4f23b470cfc152f79990/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:51.820387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fdc43-f20d-4e7b-ba9f-5e044ea69844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3718dd3e536649b5bf1970ff06ddea69, user_id=5e838176b44c4f23b470cfc152f79990, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:44:51.823059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fdc43-f20d-4e7b-ba9f-5e044ea69844 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:44:51.835804 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4396/8807] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:44:51 2022] PUT /identity/v3/projects/3718dd3e536649b5bf1970ff06ddea69/users/5e838176b44c4f23b470cfc152f79990/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:44:51.840897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9115c0b-ed44-4076-94c0-889e7fb0ff41 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:51.841206 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9115c0b-ed44-4076-94c0-889e7fb0ff41 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:51.841504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9115c0b-ed44-4076-94c0-889e7fb0ff41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:51.860020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d9115c0b-ed44-4076-94c0-889e7fb0ff41 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:44:51.861836 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d9115c0b-ed44-4076-94c0-889e7fb0ff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:44:51.921262 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4412/8808] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:44:51.931485 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fdc43-f20d-4e7b-ba9f-5e044ea69844 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:44:51.933210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-242fdc43-f20d-4e7b-ba9f-5e044ea69844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:44:51.964055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:51.991639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fdc43-f20d-4e7b-ba9f-5e044ea69844 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:44:51.995331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb19c5f-6a2f-4290-a0b1-c46628ea1aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:44:51.995933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb19c5f-6a2f-4290-a0b1-c46628ea1aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:51.996215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb19c5f-6a2f-4290-a0b1-c46628ea1aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:51.996490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb19c5f-6a2f-4290-a0b1-c46628ea1aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:52.006026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb19c5f-6a2f-4290-a0b1-c46628ea1aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:44:52.007439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb19c5f-6a2f-4290-a0b1-c46628ea1aa6 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:44:52.017012 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4397/8809] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 21:44:55.837685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef577e2-b744-4d71-a3e1-cdeeda10e098 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:55.838222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef577e2-b744-4d71-a3e1-cdeeda10e098 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:55.838222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef577e2-b744-4d71-a3e1-cdeeda10e098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:55.867777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1ef577e2-b744-4d71-a3e1-cdeeda10e098 None None] MFA Rules not processed for user `5e838176b44c4f23b470cfc152f79990`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:44:55.869003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1ef577e2-b744-4d71-a3e1-cdeeda10e098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:44:55.943953 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4413/8810] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:44:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:44:55.958802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb19c5f-6a2f-4290-a0b1-c46628ea1aa6 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:44:55.960344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-acb19c5f-6a2f-4290-a0b1-c46628ea1aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:44:56.038375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb19c5f-6a2f-4290-a0b1-c46628ea1aa6 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:44:56.044126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceda82-1b94-47d6-b072-077404493b16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:44:56.044737 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceda82-1b94-47d6-b072-077404493b16 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:56.045016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceda82-1b94-47d6-b072-077404493b16 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:56.045318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceda82-1b94-47d6-b072-077404493b16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:56.054887 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceda82-1b94-47d6-b072-077404493b16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:44:56.056467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceda82-1b94-47d6-b072-077404493b16 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:44:56.066628 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4398/8811] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:44:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:44:57.352753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5627a55-13b1-46ba-850c-31ca59ac85b1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:44:57.353281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5627a55-13b1-46ba-850c-31ca59ac85b1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:44:57.353394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5627a55-13b1-46ba-850c-31ca59ac85b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:44:57.372820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b5627a55-13b1-46ba-850c-31ca59ac85b1 None None] MFA Rules not processed for user `5e838176b44c4f23b470cfc152f79990`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:44:57.374182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b5627a55-13b1-46ba-850c-31ca59ac85b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:44:57.381915 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4414/8812] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:44:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:45:06.061673 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=48 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:45:07.367784 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:45:12.457591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceda82-1b94-47d6-b072-077404493b16 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:45:12.458999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-07ceda82-1b94-47d6-b072-077404493b16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:45:12.539371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceda82-1b94-47d6-b072-077404493b16 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:45:12.544477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128bec56-1215-412e-85a2-4f81a8cfd1bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:45:12.545087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bec56-1215-412e-85a2-4f81a8cfd1bc service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:45:12.545397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bec56-1215-412e-85a2-4f81a8cfd1bc service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:45:12.545671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bec56-1215-412e-85a2-4f81a8cfd1bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:45:12.547392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-128bec56-1215-412e-85a2-4f81a8cfd1bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:45:12.561154 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128bec56-1215-412e-85a2-4f81a8cfd1bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:45:12.562739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128bec56-1215-412e-85a2-4f81a8cfd1bc service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:45:12.575795 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4399/8813] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:45:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:45:12.738117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5627a55-13b1-46ba-850c-31ca59ac85b1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:45:12.753576 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5627a55-13b1-46ba-850c-31ca59ac85b1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:45:12.758523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237181a-55ea-46dc-b12f-fb0117ffea5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:45:12.759116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237181a-55ea-46dc-b12f-fb0117ffea5a service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:45:12.759396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237181a-55ea-46dc-b12f-fb0117ffea5a service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:45:12.759668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237181a-55ea-46dc-b12f-fb0117ffea5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:45:12.761435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d237181a-55ea-46dc-b12f-fb0117ffea5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:45:12.775436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237181a-55ea-46dc-b12f-fb0117ffea5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:45:12.776987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237181a-55ea-46dc-b12f-fb0117ffea5a service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:45:12.789338 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4415/8814] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:45:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:45:22.569139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=36 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:45:22.782611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:46:14.758794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71968e52-d6fd-4541-ad07-a7b100a8d939 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:46:14.759385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71968e52-d6fd-4541-ad07-a7b100a8d939 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:46:14.759475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71968e52-d6fd-4541-ad07-a7b100a8d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:46:14.779819 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-71968e52-d6fd-4541-ad07-a7b100a8d939 None None] MFA Rules not processed for user `5e838176b44c4f23b470cfc152f79990`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:46:14.781060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-71968e52-d6fd-4541-ad07-a7b100a8d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:46:14.788327 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4400/8815] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:46:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:46:15.097709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237181a-55ea-46dc-b12f-fb0117ffea5a service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:46:15.106907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237181a-55ea-46dc-b12f-fb0117ffea5a service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:46:15.110459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d1ce5-1e5c-49f7-8939-d565ff82fcdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:46:15.111053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d1ce5-1e5c-49f7-8939-d565ff82fcdb service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:46:15.111335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d1ce5-1e5c-49f7-8939-d565ff82fcdb service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:46:15.111609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d1ce5-1e5c-49f7-8939-d565ff82fcdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:46:15.113846 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-273d1ce5-1e5c-49f7-8939-d565ff82fcdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:46:15.125553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d1ce5-1e5c-49f7-8939-d565ff82fcdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:46:15.126981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d1ce5-1e5c-49f7-8939-d565ff82fcdb service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:46:15.137889 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4416/8816] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:46:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:46:24.774195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:46:25.132709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:47:09.482868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71968e52-d6fd-4541-ad07-a7b100a8d939 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:47:09.512260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71968e52-d6fd-4541-ad07-a7b100a8d939 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:47:09.517260 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdc643-15ab-472b-9e69-390c5aa98a84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:47:09.517863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdc643-15ab-472b-9e69-390c5aa98a84 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:47:09.518141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdc643-15ab-472b-9e69-390c5aa98a84 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:47:09.518410 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdc643-15ab-472b-9e69-390c5aa98a84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:47:09.520091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7afdc643-15ab-472b-9e69-390c5aa98a84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:47:09.531125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdc643-15ab-472b-9e69-390c5aa98a84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:47:09.532661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdc643-15ab-472b-9e69-390c5aa98a84 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:47:09.543646 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4401/8817] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:47:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:47:13.723571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d1ce5-1e5c-49f7-8939-d565ff82fcdb service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:47:13.725020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-273d1ce5-1e5c-49f7-8939-d565ff82fcdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:47:13.744952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d1ce5-1e5c-49f7-8939-d565ff82fcdb service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:47:13.750600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64036349-8807-440b-bff2-efc80e1dc5ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:47:13.751215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64036349-8807-440b-bff2-efc80e1dc5ef service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:47:13.751484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64036349-8807-440b-bff2-efc80e1dc5ef service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:47:13.751754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64036349-8807-440b-bff2-efc80e1dc5ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:47:13.753482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-64036349-8807-440b-bff2-efc80e1dc5ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:47:13.768719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64036349-8807-440b-bff2-efc80e1dc5ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:47:13.770326 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64036349-8807-440b-bff2-efc80e1dc5ef service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:47:13.784979 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4417/8818] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:47:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:47:19.279223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdc643-15ab-472b-9e69-390c5aa98a84 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:47:19.296303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdc643-15ab-472b-9e69-390c5aa98a84 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:47:19.302878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac5f0f-9edb-4e0e-909e-7db1914aafcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:47:19.303487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5f0f-9edb-4e0e-909e-7db1914aafcc service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:47:19.303766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5f0f-9edb-4e0e-909e-7db1914aafcc service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:47:19.304098 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5f0f-9edb-4e0e-909e-7db1914aafcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:47:19.305853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a6ac5f0f-9edb-4e0e-909e-7db1914aafcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:47:19.323000 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac5f0f-9edb-4e0e-909e-7db1914aafcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:47:19.324655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac5f0f-9edb-4e0e-909e-7db1914aafcc service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:47:19.338907 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4402/8819] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:47:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:47:23.671919 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c180a96-ca3f-4395-9404-7c8083fa8fb2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:47:23.672528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c180a96-ca3f-4395-9404-7c8083fa8fb2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:47:23.672640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c180a96-ca3f-4395-9404-7c8083fa8fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:47:23.703278 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5c180a96-ca3f-4395-9404-7c8083fa8fb2 None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:47:23.704546 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5c180a96-ca3f-4395-9404-7c8083fa8fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:47:23.715668 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4418/8820] 10.222.0.50 () {58 vars in 1015 bytes} [Sat Oct 8 21:47:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:47:23.728153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac5f0f-9edb-4e0e-909e-7db1914aafcc service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:47:23.729624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a6ac5f0f-9edb-4e0e-909e-7db1914aafcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:47:23.746472 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac5f0f-9edb-4e0e-909e-7db1914aafcc service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:47:23.751461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6197aa7-1358-47ed-93ff-bfa094c6ea9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:47:23.752063 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6197aa7-1358-47ed-93ff-bfa094c6ea9e service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:47:23.752344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6197aa7-1358-47ed-93ff-bfa094c6ea9e service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:47:23.752617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6197aa7-1358-47ed-93ff-bfa094c6ea9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:47:23.761747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6197aa7-1358-47ed-93ff-bfa094c6ea9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:47:23.763331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6197aa7-1358-47ed-93ff-bfa094c6ea9e service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:47:23.773747 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4403/8821] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:47:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:47:24.718352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27600b-c01c-4ccf-bea4-6fc9bef0730a None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:47:24.718811 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27600b-c01c-4ccf-bea4-6fc9bef0730a None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:47:24.718917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27600b-c01c-4ccf-bea4-6fc9bef0730a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:47:24.738215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bf27600b-c01c-4ccf-bea4-6fc9bef0730a None None] MFA Rules not processed for user `5e838176b44c4f23b470cfc152f79990`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:47:24.739411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bf27600b-c01c-4ccf-bea4-6fc9bef0730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:47:24.746158 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4419/8822] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:47:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:47:25.051165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6197aa7-1358-47ed-93ff-bfa094c6ea9e service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:47:25.052551 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f6197aa7-1358-47ed-93ff-bfa094c6ea9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:47:25.064334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6197aa7-1358-47ed-93ff-bfa094c6ea9e service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:47:25.068680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53383fd-08c8-49c5-8a39-82d675f7c713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:47:25.069314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53383fd-08c8-49c5-8a39-82d675f7c713 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:47:25.069597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53383fd-08c8-49c5-8a39-82d675f7c713 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:47:25.069876 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53383fd-08c8-49c5-8a39-82d675f7c713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:47:25.071618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c53383fd-08c8-49c5-8a39-82d675f7c713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:47:25.083979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53383fd-08c8-49c5-8a39-82d675f7c713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:47:25.085419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53383fd-08c8-49c5-8a39-82d675f7c713 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:47:25.095774 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4404/8823] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:47:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:47:25.654284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67314e06-7bfa-41b8-9583-f3b2f88bbfe6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:47:25.654648 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67314e06-7bfa-41b8-9583-f3b2f88bbfe6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:47:25.654998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67314e06-7bfa-41b8-9583-f3b2f88bbfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:47:25.675953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-67314e06-7bfa-41b8-9583-f3b2f88bbfe6 None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:47:25.677416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-67314e06-7bfa-41b8-9583-f3b2f88bbfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:47:25.686474 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4420/8824] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Oct 8 21:47:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:47:25.693532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53383fd-08c8-49c5-8a39-82d675f7c713 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:47:25.706900 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53383fd-08c8-49c5-8a39-82d675f7c713 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:47:25.711916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3d92b-a884-42c3-a116-e9b4a2164701 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:47:25.712521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3d92b-a884-42c3-a116-e9b4a2164701 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:47:25.712803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3d92b-a884-42c3-a116-e9b4a2164701 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:47:25.713079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3d92b-a884-42c3-a116-e9b4a2164701 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:47:25.715399 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-3ab3d92b-a884-42c3-a116-e9b4a2164701 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:47:25.728782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3d92b-a884-42c3-a116-e9b4a2164701 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:47:25.730467 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3d92b-a884-42c3-a116-e9b4a2164701 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:47:25.741506 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4405/8825] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:47:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:47:26.259608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b046fe8-b0ba-44e1-880a-760ef04d5988 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:47:26.260162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b046fe8-b0ba-44e1-880a-760ef04d5988 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:47:26.260162 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b046fe8-b0ba-44e1-880a-760ef04d5988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:47:26.279828 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0b046fe8-b0ba-44e1-880a-760ef04d5988 None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:47:26.281029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0b046fe8-b0ba-44e1-880a-760ef04d5988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:47:26.290471 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4421/8826] 10.222.0.45 () {58 vars in 1015 bytes} [Sat Oct 8 21:47:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:47:26.325848 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3d92b-a884-42c3-a116-e9b4a2164701 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:47:26.339357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3d92b-a884-42c3-a116-e9b4a2164701 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:47:26.344561 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208579cf-257b-40b6-b9dc-eb5d36a57b02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:47:26.345268 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208579cf-257b-40b6-b9dc-eb5d36a57b02 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:47:26.345565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208579cf-257b-40b6-b9dc-eb5d36a57b02 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:47:26.345837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208579cf-257b-40b6-b9dc-eb5d36a57b02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:47:26.354878 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208579cf-257b-40b6-b9dc-eb5d36a57b02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:47:26.356424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208579cf-257b-40b6-b9dc-eb5d36a57b02 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:47:26.365952 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4406/8827] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:47:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:47:36.275090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=22 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:47:36.362293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=42 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:09.407847 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b046fe8-b0ba-44e1-880a-760ef04d5988 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:48:09.427047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b046fe8-b0ba-44e1-880a-760ef04d5988 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:48:09.433251 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35d3dd-655e-416b-94a6-d7763f43588f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:48:09.433863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35d3dd-655e-416b-94a6-d7763f43588f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:48:09.434144 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35d3dd-655e-416b-94a6-d7763f43588f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:48:09.434416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35d3dd-655e-416b-94a6-d7763f43588f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:48:09.436289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bf35d3dd-655e-416b-94a6-d7763f43588f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:48:09.490773 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35d3dd-655e-416b-94a6-d7763f43588f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:48:09.492257 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35d3dd-655e-416b-94a6-d7763f43588f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:48:09.504561 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4422/8828] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:48:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:48:09.592359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208579cf-257b-40b6-b9dc-eb5d36a57b02 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:48:09.612206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208579cf-257b-40b6-b9dc-eb5d36a57b02 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:48:09.617703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f3a62-28d3-40b0-867a-3adb9649e0b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:48:09.618288 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f3a62-28d3-40b0-867a-3adb9649e0b4 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:48:09.618563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f3a62-28d3-40b0-867a-3adb9649e0b4 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:48:09.618828 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f3a62-28d3-40b0-867a-3adb9649e0b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:48:09.620478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a75f3a62-28d3-40b0-867a-3adb9649e0b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:48:09.632320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f3a62-28d3-40b0-867a-3adb9649e0b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:48:09.633954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f3a62-28d3-40b0-867a-3adb9649e0b4 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:48:09.644348 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4407/8829] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:48:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:48:09.819462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35d3dd-655e-416b-94a6-d7763f43588f service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:48:09.828044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35d3dd-655e-416b-94a6-d7763f43588f service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:48:09.831622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b711b8-a28f-4082-baa9-c3dd68110a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:48:09.832215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b711b8-a28f-4082-baa9-c3dd68110a7d service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:48:09.832490 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b711b8-a28f-4082-baa9-c3dd68110a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:48:09.832759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b711b8-a28f-4082-baa9-c3dd68110a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:48:09.834458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-68b711b8-a28f-4082-baa9-c3dd68110a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:48:09.850614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b711b8-a28f-4082-baa9-c3dd68110a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:48:09.852025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b711b8-a28f-4082-baa9-c3dd68110a7d service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:48:09.865923 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4423/8830] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:48:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:48:19.639846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=11 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:19.858054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=30 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:37.919480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67e42-d792-49b8-9d6d-33cf28f1d000 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:48:37.919995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67e42-d792-49b8-9d6d-33cf28f1d000 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:48:37.920105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67e42-d792-49b8-9d6d-33cf28f1d000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:48:37.939112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-05f67e42-d792-49b8-9d6d-33cf28f1d000 None None] MFA Rules not processed for user `5e838176b44c4f23b470cfc152f79990`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:48:37.941068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-05f67e42-d792-49b8-9d6d-33cf28f1d000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:48:37.947869 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4408/8831] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:48:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:48:47.934220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:49.225031 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b711b8-a28f-4082-baa9-c3dd68110a7d service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:48:49.234969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b711b8-a28f-4082-baa9-c3dd68110a7d service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:48:49.238657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ae28f-0aab-42cd-94f1-b0b60403bc2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:48:49.239246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ae28f-0aab-42cd-94f1-b0b60403bc2b service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:48:49.239520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ae28f-0aab-42cd-94f1-b0b60403bc2b service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:48:49.239790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ae28f-0aab-42cd-94f1-b0b60403bc2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:48:49.242242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-762ae28f-0aab-42cd-94f1-b0b60403bc2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:48:49.254778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ae28f-0aab-42cd-94f1-b0b60403bc2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:48:49.256194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ae28f-0aab-42cd-94f1-b0b60403bc2b service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:48:49.267143 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4424/8832] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:48:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:48:59.260993 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:23.329492 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f67e42-d792-49b8-9d6d-33cf28f1d000 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:49:23.339501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f67e42-d792-49b8-9d6d-33cf28f1d000 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:49:23.343041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7692-c492-49ab-8a20-e3dddbfff50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:49:23.343637 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7692-c492-49ab-8a20-e3dddbfff50d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:23.343914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7692-c492-49ab-8a20-e3dddbfff50d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:23.344184 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7692-c492-49ab-8a20-e3dddbfff50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:23.345902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-277b7692-c492-49ab-8a20-e3dddbfff50d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:49:23.369323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b7692-c492-49ab-8a20-e3dddbfff50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:49:23.370890 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b7692-c492-49ab-8a20-e3dddbfff50d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:49:23.385365 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4409/8833] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:49:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:49:23.571456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179f7ef-bc7e-4e42-a6bd-3db8007a340b None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:23.571894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179f7ef-bc7e-4e42-a6bd-3db8007a340b None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:23.572010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179f7ef-bc7e-4e42-a6bd-3db8007a340b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:23.638440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0179f7ef-bc7e-4e42-a6bd-3db8007a340b None None] MFA Rules not processed for user `7885df3b2ae34969852f76fbc94a7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:49:23.639651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0179f7ef-bc7e-4e42-a6bd-3db8007a340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:49:23.701572 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4425/8834] 10.222.0.26 () {58 vars in 1060 bytes} [Sat Oct 8 21:49:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:49:23.707879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7692-c492-49ab-8a20-e3dddbfff50d service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:49:23.716794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7692-c492-49ab-8a20-e3dddbfff50d service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:49:23.720385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f96e4e-fe6e-4969-b019-38aa5efe6916 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:49:23.720982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f96e4e-fe6e-4969-b019-38aa5efe6916 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:23.721300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f96e4e-fe6e-4969-b019-38aa5efe6916 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:23.721575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f96e4e-fe6e-4969-b019-38aa5efe6916 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:23.723282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b3f96e4e-fe6e-4969-b019-38aa5efe6916 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:49:23.739386 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f96e4e-fe6e-4969-b019-38aa5efe6916 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:49:23.740729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f96e4e-fe6e-4969-b019-38aa5efe6916 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:49:23.754717 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4410/8835] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:49:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:49:33.698753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=42 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:33.747350 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=15 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:34.579296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d8233-5470-441e-9033-8f45a1aeef7e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:34.579600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d8233-5470-441e-9033-8f45a1aeef7e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:34.579874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d8233-5470-441e-9033-8f45a1aeef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:34.616808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-476d8233-5470-441e-9033-8f45a1aeef7e None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:49:34.618089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-476d8233-5470-441e-9033-8f45a1aeef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:49:34.627466 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4426/8836] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Oct 8 21:49:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:49:35.812445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766ebf5-4da1-45f1-bda0-de0eac24707a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:35.813017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766ebf5-4da1-45f1-bda0-de0eac24707a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:35.813017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766ebf5-4da1-45f1-bda0-de0eac24707a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:35.833081 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7766ebf5-4da1-45f1-bda0-de0eac24707a None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:49:35.834323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7766ebf5-4da1-45f1-bda0-de0eac24707a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:49:35.844103 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4411/8837] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Oct 8 21:49:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:49:41.720577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe4f5e-6805-41b4-97e0-6c8206ac4257 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:41.721451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe4f5e-6805-41b4-97e0-6c8206ac4257 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:41.721451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe4f5e-6805-41b4-97e0-6c8206ac4257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:41.749999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f2fe4f5e-6805-41b4-97e0-6c8206ac4257 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:49:41.751117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f2fe4f5e-6805-41b4-97e0-6c8206ac4257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:49:41.760890 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4427/8838] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:49:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:49:41.772447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766ebf5-4da1-45f1-bda0-de0eac24707a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:49:41.784087 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766ebf5-4da1-45f1-bda0-de0eac24707a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:49:41.787947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247329e-48da-4f45-98ce-deaecc8d5e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:49:41.788403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247329e-48da-4f45-98ce-deaecc8d5e39 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:41.788682 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247329e-48da-4f45-98ce-deaecc8d5e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:41.788949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247329e-48da-4f45-98ce-deaecc8d5e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:41.799188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247329e-48da-4f45-98ce-deaecc8d5e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:49:41.800595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247329e-48da-4f45-98ce-deaecc8d5e39 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:49:41.811673 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4412/8839] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:49:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:49:41.935431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe4f5e-6805-41b4-97e0-6c8206ac4257 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:49:41.945984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe4f5e-6805-41b4-97e0-6c8206ac4257 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:49:41.949599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbd7b6-9bd9-4868-9407-782610d2c1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:49:41.950194 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbd7b6-9bd9-4868-9407-782610d2c1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:41.950476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbd7b6-9bd9-4868-9407-782610d2c1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:41.950751 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbd7b6-9bd9-4868-9407-782610d2c1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:41.952447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-81fbd7b6-9bd9-4868-9407-782610d2c1e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:49:41.965034 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbd7b6-9bd9-4868-9407-782610d2c1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:49:41.966474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbd7b6-9bd9-4868-9407-782610d2c1e1 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:49:41.976999 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4428/8840] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:49:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:49:42.377130 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247329e-48da-4f45-98ce-deaecc8d5e39 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:49:42.389318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247329e-48da-4f45-98ce-deaecc8d5e39 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:49:42.396610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905ce9d-0341-4315-a77d-9eca9adb0ed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:49:42.397918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905ce9d-0341-4315-a77d-9eca9adb0ed4 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:42.398198 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905ce9d-0341-4315-a77d-9eca9adb0ed4 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:42.398471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905ce9d-0341-4315-a77d-9eca9adb0ed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:42.400216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b905ce9d-0341-4315-a77d-9eca9adb0ed4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:49:42.415342 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905ce9d-0341-4315-a77d-9eca9adb0ed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:49:42.416917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905ce9d-0341-4315-a77d-9eca9adb0ed4 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:49:42.430698 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4413/8841] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:49:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:49:44.261673 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d595557-9d62-4e37-8dbd-a2fa243df5ba None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:44.262261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d595557-9d62-4e37-8dbd-a2fa243df5ba None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:44.262373 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d595557-9d62-4e37-8dbd-a2fa243df5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:44.281704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-9d595557-9d62-4e37-8dbd-a2fa243df5ba None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:49:44.282889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-9d595557-9d62-4e37-8dbd-a2fa243df5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:49:44.292058 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4429/8842] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:49:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:49:44.303625 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905ce9d-0341-4315-a77d-9eca9adb0ed4 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:49:44.312866 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905ce9d-0341-4315-a77d-9eca9adb0ed4 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:49:44.316679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42c34b-554a-43b0-8d1c-4c5f640bd1ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:49:44.317308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42c34b-554a-43b0-8d1c-4c5f640bd1ec service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:44.317590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42c34b-554a-43b0-8d1c-4c5f640bd1ec service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:44.317860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42c34b-554a-43b0-8d1c-4c5f640bd1ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:44.328924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42c34b-554a-43b0-8d1c-4c5f640bd1ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:49:44.330690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42c34b-554a-43b0-8d1c-4c5f640bd1ec service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:49:44.342630 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4414/8843] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:49:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:49:51.900660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89916a-61eb-458a-9116-b4d9e45b0848 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:51.901136 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89916a-61eb-458a-9116-b4d9e45b0848 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:51.901272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89916a-61eb-458a-9116-b4d9e45b0848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:51.939325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2b89916a-61eb-458a-9116-b4d9e45b0848 None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:49:51.940791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2b89916a-61eb-458a-9116-b4d9e45b0848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:49:51.948279 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4430/8844] 10.222.0.50 () {58 vars in 1015 bytes} [Sat Oct 8 21:49:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:49:51.960374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42c34b-554a-43b0-8d1c-4c5f640bd1ec service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:49:51.968769 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42c34b-554a-43b0-8d1c-4c5f640bd1ec service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:49:51.972348 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c263cbc-00de-43b3-ba80-eb19341a332e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:49:51.972971 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c263cbc-00de-43b3-ba80-eb19341a332e service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:51.973249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c263cbc-00de-43b3-ba80-eb19341a332e service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:51.973518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c263cbc-00de-43b3-ba80-eb19341a332e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:51.980501 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c263cbc-00de-43b3-ba80-eb19341a332e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:49:51.981863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c263cbc-00de-43b3-ba80-eb19341a332e service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:49:51.989875 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4415/8845] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:49:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:49:52.372380 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fba5a-3705-47a5-95db-2c022cd97346 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:52.372548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fba5a-3705-47a5-95db-2c022cd97346 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:52.372854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fba5a-3705-47a5-95db-2c022cd97346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:52.393375 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-295fba5a-3705-47a5-95db-2c022cd97346 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:49:52.394635 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-295fba5a-3705-47a5-95db-2c022cd97346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:49:52.404306 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4431/8846] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 21:49:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:49:52.760412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c263cbc-00de-43b3-ba80-eb19341a332e service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:49:52.774445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c263cbc-00de-43b3-ba80-eb19341a332e service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:49:52.780029 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b8576-871a-483f-8a19-273fe50a17df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:49:52.780692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b8576-871a-483f-8a19-273fe50a17df service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:52.780915 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b8576-871a-483f-8a19-273fe50a17df service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:52.781208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b8576-871a-483f-8a19-273fe50a17df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:52.790979 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b8576-871a-483f-8a19-273fe50a17df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:49:52.792553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b8576-871a-483f-8a19-273fe50a17df service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:49:52.803570 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4416/8847] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:49:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:49:54.953239 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297eac0-1acf-4a3b-94f5-986c122c61e3 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:54.953804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297eac0-1acf-4a3b-94f5-986c122c61e3 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:54.953804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297eac0-1acf-4a3b-94f5-986c122c61e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:54.973074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3297eac0-1acf-4a3b-94f5-986c122c61e3 None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:49:54.974310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3297eac0-1acf-4a3b-94f5-986c122c61e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:49:54.981109 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4432/8848] 10.222.0.45 () {58 vars in 1015 bytes} [Sat Oct 8 21:49:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:49:54.994442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b8576-871a-483f-8a19-273fe50a17df service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:49:55.003803 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b8576-871a-483f-8a19-273fe50a17df service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:49:55.008105 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c7569-4afa-4fd8-b054-62ee6fe3a73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:49:55.008710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c7569-4afa-4fd8-b054-62ee6fe3a73f service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:55.009046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c7569-4afa-4fd8-b054-62ee6fe3a73f service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:55.009305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c7569-4afa-4fd8-b054-62ee6fe3a73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:55.016613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c7569-4afa-4fd8-b054-62ee6fe3a73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:49:55.018077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c7569-4afa-4fd8-b054-62ee6fe3a73f service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:49:55.026248 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4417/8849] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:49:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:49:55.483456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297eac0-1acf-4a3b-94f5-986c122c61e3 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:49:55.493409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297eac0-1acf-4a3b-94f5-986c122c61e3 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:49:55.497461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f56b5-23e3-4224-8b97-ecd6067cb6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:49:55.498651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f56b5-23e3-4224-8b97-ecd6067cb6bf service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:49:55.498651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f56b5-23e3-4224-8b97-ecd6067cb6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:49:55.498851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f56b5-23e3-4224-8b97-ecd6067cb6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:49:55.509318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f56b5-23e3-4224-8b97-ecd6067cb6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:49:55.510770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f56b5-23e3-4224-8b97-ecd6067cb6bf service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:49:55.520695 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4433/8850] 10.222.0.26 () {60 vars in 1396 bytes} [Sat Oct 8 21:49:55 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:50:04.224705 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c7569-4afa-4fd8-b054-62ee6fe3a73f service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:04.228760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=40 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:04.234576 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c7569-4afa-4fd8-b054-62ee6fe3a73f service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:04.238183 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f7c1c-8cc6-4e21-8c35-d18aee364787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:04.238813 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f7c1c-8cc6-4e21-8c35-d18aee364787 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:04.239089 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f7c1c-8cc6-4e21-8c35-d18aee364787 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:04.239360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f7c1c-8cc6-4e21-8c35-d18aee364787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:04.248157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f7c1c-8cc6-4e21-8c35-d18aee364787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:04.249685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f7c1c-8cc6-4e21-8c35-d18aee364787 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:04.259669 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4418/8851] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:50:05.516019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=42 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:07.360087 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d161fab-710b-4da0-9a2e-0e0de8f2bcdd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:07.360710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d161fab-710b-4da0-9a2e-0e0de8f2bcdd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:07.360710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d161fab-710b-4da0-9a2e-0e0de8f2bcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:07.382561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8d161fab-710b-4da0-9a2e-0e0de8f2bcdd None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:07.383820 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8d161fab-710b-4da0-9a2e-0e0de8f2bcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:07.399180 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4434/8852] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Oct 8 21:50:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 21:50:07.400055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f7c1c-8cc6-4e21-8c35-d18aee364787 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:07.413471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f7c1c-8cc6-4e21-8c35-d18aee364787 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:07.418981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d161fab-710b-4da0-9a2e-0e0de8f2bcdd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:07.420090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce456dc-9161-4abf-a988-2b982a29e575 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:07.420821 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce456dc-9161-4abf-a988-2b982a29e575 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:07.421308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce456dc-9161-4abf-a988-2b982a29e575 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:07.421740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce456dc-9161-4abf-a988-2b982a29e575 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:07.430054 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dce456dc-9161-4abf-a988-2b982a29e575 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:07.434335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d161fab-710b-4da0-9a2e-0e0de8f2bcdd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:07.438983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ccacd-cc6f-4e6b-8420-5a74036cd245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:07.439610 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ccacd-cc6f-4e6b-8420-5a74036cd245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:07.440140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ccacd-cc6f-4e6b-8420-5a74036cd245 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:07.440410 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ccacd-cc6f-4e6b-8420-5a74036cd245 admin admin] PATH_INFO: `/v3/users/5e838176b44c4f23b470cfc152f79990` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:07.441584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ccacd-cc6f-4e6b-8420-5a74036cd245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e838176b44c4f23b470cfc152f79990)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:07.446095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ccacd-cc6f-4e6b-8420-5a74036cd245 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:07.448641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce456dc-9161-4abf-a988-2b982a29e575 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:07.450266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce456dc-9161-4abf-a988-2b982a29e575 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:07.465834 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4419/8853] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:50:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:50:07.504630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e29ccacd-cc6f-4e6b-8420-5a74036cd245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e838176b44c4f23b470cfc152f79990'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:07.511823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e29ccacd-cc6f-4e6b-8420-5a74036cd245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e838176b44c4f23b470cfc152f79990'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:07.512486 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e29ccacd-cc6f-4e6b-8420-5a74036cd245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e838176b44c4f23b470cfc152f79990'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:07.513093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e29ccacd-cc6f-4e6b-8420-5a74036cd245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e838176b44c4f23b470cfc152f79990'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:07.525414 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-e29ccacd-cc6f-4e6b-8420-5a74036cd245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e838176b44c4f23b470cfc152f79990'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:07.538208 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4435/8854] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:50:07 2022] DELETE /identity/v3/users/5e838176b44c4f23b470cfc152f79990 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:50:07.711449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce456dc-9161-4abf-a988-2b982a29e575 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:07.722852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce456dc-9161-4abf-a988-2b982a29e575 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:07.782225 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a2142-21b1-42b9-9f49-aacf694acbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:07.782874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a2142-21b1-42b9-9f49-aacf694acbfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:07.783141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a2142-21b1-42b9-9f49-aacf694acbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:07.783419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a2142-21b1-42b9-9f49-aacf694acbfb admin admin] PATH_INFO: `/v3/projects/3718dd3e536649b5bf1970ff06ddea69` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:07.784529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a2142-21b1-42b9-9f49-aacf694acbfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3718dd3e536649b5bf1970ff06ddea69)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:07.787314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a2142-21b1-42b9-9f49-aacf694acbfb admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:07.832678 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a77a2142-21b1-42b9-9f49-aacf694acbfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3718dd3e536649b5bf1970ff06ddea69', 'request_id': 'req-a77a2142-21b1-42b9-9f49-aacf694acbfb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:07.844420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a77a2142-21b1-42b9-9f49-aacf694acbfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3718dd3e536649b5bf1970ff06ddea69', 'request_id': 'req-a77a2142-21b1-42b9-9f49-aacf694acbfb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:07.850311 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a77a2142-21b1-42b9-9f49-aacf694acbfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3718dd3e536649b5bf1970ff06ddea69', 'request_id': 'req-a77a2142-21b1-42b9-9f49-aacf694acbfb'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:07.861794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a77a2142-21b1-42b9-9f49-aacf694acbfb admin admin] The token cache is being invalidate because project 3718dd3e536649b5bf1970ff06ddea69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:50:07.862082 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a77a2142-21b1-42b9-9f49-aacf694acbfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:07.862719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-a77a2142-21b1-42b9-9f49-aacf694acbfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:07.864187 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4420/8855] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:50:07 2022] DELETE /identity/v3/projects/3718dd3e536649b5bf1970ff06ddea69 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:50:07.869270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15b00-06bb-4601-8711-a7367a7cc842 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:07.869558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15b00-06bb-4601-8711-a7367a7cc842 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:07.869833 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15b00-06bb-4601-8711-a7367a7cc842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:07.889695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d8d15b00-06bb-4601-8711-a7367a7cc842 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:07.890886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d8d15b00-06bb-4601-8711-a7367a7cc842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:07.949427 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4436/8856] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:07.957800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce20355-6ba8-4b06-b922-72826e407202 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:07.958080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce20355-6ba8-4b06-b922-72826e407202 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:07.959022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce20355-6ba8-4b06-b922-72826e407202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:07.978422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-2ce20355-6ba8-4b06-b922-72826e407202 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:07.979603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-2ce20355-6ba8-4b06-b922-72826e407202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:07.987365 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4421/8857] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:07.991499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d15b00-06bb-4601-8711-a7367a7cc842 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:08.000991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d15b00-06bb-4601-8711-a7367a7cc842 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:08.006321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e8b87-4e15-4fd8-97cc-f343370e6af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:08.006915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e8b87-4e15-4fd8-97cc-f343370e6af8 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:08.007190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e8b87-4e15-4fd8-97cc-f343370e6af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:08.007463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e8b87-4e15-4fd8-97cc-f343370e6af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:08.008138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e8b87-4e15-4fd8-97cc-f343370e6af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:50:08.008432 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e8b87-4e15-4fd8-97cc-f343370e6af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:08.011726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e8b87-4e15-4fd8-97cc-f343370e6af8 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:08.024345 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4437/8858] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:50:08.029092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce20355-6ba8-4b06-b922-72826e407202 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:08.038796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce20355-6ba8-4b06-b922-72826e407202 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:08.043603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dec25-f737-47d3-8dec-c7939990800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:08.044205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dec25-f737-47d3-8dec-c7939990800d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:08.044483 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dec25-f737-47d3-8dec-c7939990800d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:08.044755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dec25-f737-47d3-8dec-c7939990800d admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:08.045427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dec25-f737-47d3-8dec-c7939990800d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:08.047319 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dec25-f737-47d3-8dec-c7939990800d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:08.075430 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4422/8859] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:50:08 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:50:08.079649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e8b87-4e15-4fd8-97cc-f343370e6af8 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:08.090575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e8b87-4e15-4fd8-97cc-f343370e6af8 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:08.137235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:08.147602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5cb42-bb73-45a0-8df8-72c52742c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:08.148200 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5cb42-bb73-45a0-8df8-72c52742c017 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:08.148479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5cb42-bb73-45a0-8df8-72c52742c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:08.148753 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5cb42-bb73-45a0-8df8-72c52742c017 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:08.149408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5cb42-bb73-45a0-8df8-72c52742c017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:08.151324 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5cb42-bb73-45a0-8df8-72c52742c017 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:08.172031 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4438/8860] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:50:08 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:50:08.176231 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dec25-f737-47d3-8dec-c7939990800d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:08.186823 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dec25-f737-47d3-8dec-c7939990800d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:08.191767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6f8a8-a01a-4d0a-b7fa-1a697814f3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:08.192362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6f8a8-a01a-4d0a-b7fa-1a697814f3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:08.193174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6f8a8-a01a-4d0a-b7fa-1a697814f3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:08.193477 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6f8a8-a01a-4d0a-b7fa-1a697814f3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:08.194112 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6f8a8-a01a-4d0a-b7fa-1a697814f3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:08.195681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6f8a8-a01a-4d0a-b7fa-1a697814f3c2 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:08.205497 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4423/8861] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:50:08.209840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5cb42-bb73-45a0-8df8-72c52742c017 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:08.219702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5cb42-bb73-45a0-8df8-72c52742c017 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:08.224313 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630de56b-652d-4ba6-bf27-78434dd8da2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:08.224889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630de56b-652d-4ba6-bf27-78434dd8da2f admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:08.225166 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630de56b-652d-4ba6-bf27-78434dd8da2f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:08.225469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630de56b-652d-4ba6-bf27-78434dd8da2f admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:08.226097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630de56b-652d-4ba6-bf27-78434dd8da2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:08.227649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630de56b-652d-4ba6-bf27-78434dd8da2f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:08.238369 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4439/8862] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:50:08.242816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6f8a8-a01a-4d0a-b7fa-1a697814f3c2 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:08.252792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6f8a8-a01a-4d0a-b7fa-1a697814f3c2 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:08.258088 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953acad-3bf5-4040-8fc4-e86fd592a2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:08.258789 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953acad-3bf5-4040-8fc4-e86fd592a2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:08.259040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953acad-3bf5-4040-8fc4-e86fd592a2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:08.259298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953acad-3bf5-4040-8fc4-e86fd592a2ea admin admin] PATH_INFO: `/v3/projects/a7e9d160d2fc4f5fb7ccb312246c977e/users/94a4c8a5bd25448a8479a4316479ba18/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:08.274706 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953acad-3bf5-4040-8fc4-e86fd592a2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e9d160d2fc4f5fb7ccb312246c977e, user_id=94a4c8a5bd25448a8479a4316479ba18, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:08.277369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953acad-3bf5-4040-8fc4-e86fd592a2ea admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:08.290954 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4424/8863] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:50:08 2022] PUT /identity/v3/projects/a7e9d160d2fc4f5fb7ccb312246c977e/users/94a4c8a5bd25448a8479a4316479ba18/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:50:08.296583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eed6e2-5eae-4b34-9012-c2c25f983b40 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:08.296868 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eed6e2-5eae-4b34-9012-c2c25f983b40 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:08.297149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eed6e2-5eae-4b34-9012-c2c25f983b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:08.316955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-31eed6e2-5eae-4b34-9012-c2c25f983b40 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:08.318199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-31eed6e2-5eae-4b34-9012-c2c25f983b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:08.379634 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4440/8864] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:08.389324 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953acad-3bf5-4040-8fc4-e86fd592a2ea admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:08.391007 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6953acad-3bf5-4040-8fc4-e86fd592a2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:08.396991 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:08.449834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953acad-3bf5-4040-8fc4-e86fd592a2ea admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:08.453672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec988440-851d-41e5-8597-4d5b068fb0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:08.454284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec988440-851d-41e5-8597-4d5b068fb0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:08.454572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec988440-851d-41e5-8597-4d5b068fb0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:08.454845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec988440-851d-41e5-8597-4d5b068fb0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:08.464489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec988440-851d-41e5-8597-4d5b068fb0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:08.465934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec988440-851d-41e5-8597-4d5b068fb0b1 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:08.476112 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4425/8865] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:50:12.274679 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b65112-c052-4f1e-8a4f-f08c4ccc484e None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:12.275248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b65112-c052-4f1e-8a4f-f08c4ccc484e None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:12.275509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b65112-c052-4f1e-8a4f-f08c4ccc484e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:12.304544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-99b65112-c052-4f1e-8a4f-f08c4ccc484e None None] MFA Rules not processed for user `94a4c8a5bd25448a8479a4316479ba18`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:12.305803 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-99b65112-c052-4f1e-8a4f-f08c4ccc484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:12.372648 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4441/8866] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:50:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:12.382904 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592f204-21b3-4247-a6c9-9e5c2752be34 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:12.383429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592f204-21b3-4247-a6c9-9e5c2752be34 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:12.383429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592f204-21b3-4247-a6c9-9e5c2752be34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:12.403205 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-7592f204-21b3-4247-a6c9-9e5c2752be34 None None] MFA Rules not processed for user `94a4c8a5bd25448a8479a4316479ba18`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:12.404420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7592f204-21b3-4247-a6c9-9e5c2752be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:12.411421 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4426/8867] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:50:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:12.423273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b65112-c052-4f1e-8a4f-f08c4ccc484e None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:12.424722 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-99b65112-c052-4f1e-8a4f-f08c4ccc484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:12.498554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:12.516223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b65112-c052-4f1e-8a4f-f08c4ccc484e None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:12.522596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585cc84-a312-4d00-8183-1d0f1ef7b4ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:12.523211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585cc84-a312-4d00-8183-1d0f1ef7b4ab service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:12.523499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585cc84-a312-4d00-8183-1d0f1ef7b4ab service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:12.523775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585cc84-a312-4d00-8183-1d0f1ef7b4ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:12.531785 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585cc84-a312-4d00-8183-1d0f1ef7b4ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:12.533396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585cc84-a312-4d00-8183-1d0f1ef7b4ab service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:12.549391 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4442/8868] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:50:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:50:16.169322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fad80-64eb-4c06-9bba-8e82880f5cc9 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:16.170180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fad80-64eb-4c06-9bba-8e82880f5cc9 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:16.170736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fad80-64eb-4c06-9bba-8e82880f5cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:16.214570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-ca7fad80-64eb-4c06-9bba-8e82880f5cc9 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:16.216078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ca7fad80-64eb-4c06-9bba-8e82880f5cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:16.229171 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4427/8869] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 21:50:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:16.253587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585cc84-a312-4d00-8183-1d0f1ef7b4ab service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:16.266482 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585cc84-a312-4d00-8183-1d0f1ef7b4ab service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:16.279957 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561193e8-1733-49a7-8d6c-c914ffcc4c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:16.280668 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561193e8-1733-49a7-8d6c-c914ffcc4c05 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:16.281142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561193e8-1733-49a7-8d6c-c914ffcc4c05 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:16.281616 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561193e8-1733-49a7-8d6c-c914ffcc4c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:16.291296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561193e8-1733-49a7-8d6c-c914ffcc4c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:16.292894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561193e8-1733-49a7-8d6c-c914ffcc4c05 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:16.305392 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4443/8870] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:50:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:50:23.275473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f14f19-cfd5-4445-b1f5-7fa68f527652 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:23.275995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f14f19-cfd5-4445-b1f5-7fa68f527652 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:23.275995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f14f19-cfd5-4445-b1f5-7fa68f527652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:23.297892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-a9f14f19-cfd5-4445-b1f5-7fa68f527652 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:23.299114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a9f14f19-cfd5-4445-b1f5-7fa68f527652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:23.308807 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4428/8871] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 21:50:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:23.324780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561193e8-1733-49a7-8d6c-c914ffcc4c05 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:23.326259 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-561193e8-1733-49a7-8d6c-c914ffcc4c05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:23.341677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561193e8-1733-49a7-8d6c-c914ffcc4c05 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:23.347416 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e8d9d-9d82-4cec-8bb0-4ad6c94cc64d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:23.348047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e8d9d-9d82-4cec-8bb0-4ad6c94cc64d service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:23.348371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e8d9d-9d82-4cec-8bb0-4ad6c94cc64d service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:23.349255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e8d9d-9d82-4cec-8bb0-4ad6c94cc64d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:23.358360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e8d9d-9d82-4cec-8bb0-4ad6c94cc64d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:23.359932 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e8d9d-9d82-4cec-8bb0-4ad6c94cc64d service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:23.370392 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4444/8872] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:50:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:50:25.173908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462927b8-b3d3-4dc2-b119-51fc1f32408a None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:25.174448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462927b8-b3d3-4dc2-b119-51fc1f32408a None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:25.174448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462927b8-b3d3-4dc2-b119-51fc1f32408a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:25.192946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-462927b8-b3d3-4dc2-b119-51fc1f32408a None None] MFA Rules not processed for user `94a4c8a5bd25448a8479a4316479ba18`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:25.194659 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-462927b8-b3d3-4dc2-b119-51fc1f32408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:25.201422 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4429/8873] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:50:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:33.365944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=18 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:35.187902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=37 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:44.667520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e8d9d-9d82-4cec-8bb0-4ad6c94cc64d service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:44.669026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-399e8d9d-9d82-4cec-8bb0-4ad6c94cc64d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:44.719321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462927b8-b3d3-4dc2-b119-51fc1f32408a None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:44.735600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462927b8-b3d3-4dc2-b119-51fc1f32408a None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:44.740989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febf226-b1cf-4cd0-a83c-2394529c6e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:44.741648 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf226-b1cf-4cd0-a83c-2394529c6e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:44.741926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf226-b1cf-4cd0-a83c-2394529c6e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:44.742206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf226-b1cf-4cd0-a83c-2394529c6e23 admin admin] PATH_INFO: `/v3/users/94a4c8a5bd25448a8479a4316479ba18` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:44.743369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febf226-b1cf-4cd0-a83c-2394529c6e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94a4c8a5bd25448a8479a4316479ba18)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:44.745306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febf226-b1cf-4cd0-a83c-2394529c6e23 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:44.758714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e8d9d-9d82-4cec-8bb0-4ad6c94cc64d service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:44.764686 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a9e89-5a28-4fb7-9bd9-f5831d6ca9c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:44.765325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a9e89-5a28-4fb7-9bd9-f5831d6ca9c8 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:44.765611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a9e89-5a28-4fb7-9bd9-f5831d6ca9c8 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:44.765888 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a9e89-5a28-4fb7-9bd9-f5831d6ca9c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:44.767713 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-885a9e89-5a28-4fb7-9bd9-f5831d6ca9c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:44.784728 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a9e89-5a28-4fb7-9bd9-f5831d6ca9c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:44.787049 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a9e89-5a28-4fb7-9bd9-f5831d6ca9c8 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:44.797964 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2febf226-b1cf-4cd0-a83c-2394529c6e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94a4c8a5bd25448a8479a4316479ba18'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:44.800774 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4445/8874] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:50:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:50:44.805743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2febf226-b1cf-4cd0-a83c-2394529c6e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94a4c8a5bd25448a8479a4316479ba18'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:44.806435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2febf226-b1cf-4cd0-a83c-2394529c6e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94a4c8a5bd25448a8479a4316479ba18'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:44.807046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2febf226-b1cf-4cd0-a83c-2394529c6e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94a4c8a5bd25448a8479a4316479ba18'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:44.824255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-2febf226-b1cf-4cd0-a83c-2394529c6e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94a4c8a5bd25448a8479a4316479ba18'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:44.839356 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4430/8875] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:50:44 2022] DELETE /identity/v3/users/94a4c8a5bd25448a8479a4316479ba18 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:50:45.007328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a9e89-5a28-4fb7-9bd9-f5831d6ca9c8 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:45.018016 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a9e89-5a28-4fb7-9bd9-f5831d6ca9c8 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:45.074955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d81d6-74f9-4b25-a127-b41fbe27b7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:45.075615 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d81d6-74f9-4b25-a127-b41fbe27b7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:45.075900 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d81d6-74f9-4b25-a127-b41fbe27b7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:45.076177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d81d6-74f9-4b25-a127-b41fbe27b7ff admin admin] PATH_INFO: `/v3/projects/a7e9d160d2fc4f5fb7ccb312246c977e` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:45.077322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d81d6-74f9-4b25-a127-b41fbe27b7ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e9d160d2fc4f5fb7ccb312246c977e)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:45.079236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d81d6-74f9-4b25-a127-b41fbe27b7ff admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:45.124710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-167d81d6-74f9-4b25-a127-b41fbe27b7ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'request_id': 'req-167d81d6-74f9-4b25-a127-b41fbe27b7ff'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:45.132770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-167d81d6-74f9-4b25-a127-b41fbe27b7ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'request_id': 'req-167d81d6-74f9-4b25-a127-b41fbe27b7ff'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:45.139149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-167d81d6-74f9-4b25-a127-b41fbe27b7ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'request_id': 'req-167d81d6-74f9-4b25-a127-b41fbe27b7ff'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:45.150236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-167d81d6-74f9-4b25-a127-b41fbe27b7ff admin admin] The token cache is being invalidate because project a7e9d160d2fc4f5fb7ccb312246c977e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:50:45.150514 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-167d81d6-74f9-4b25-a127-b41fbe27b7ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:45.151479 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-167d81d6-74f9-4b25-a127-b41fbe27b7ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:45.152951 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4446/8876] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:50:45 2022] DELETE /identity/v3/projects/a7e9d160d2fc4f5fb7ccb312246c977e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:50:45.157931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96887038-3e09-4f6a-94ad-4c448845bfe3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:45.158218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96887038-3e09-4f6a-94ad-4c448845bfe3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:45.158493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96887038-3e09-4f6a-94ad-4c448845bfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:45.179293 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-96887038-3e09-4f6a-94ad-4c448845bfe3 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:45.180511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-96887038-3e09-4f6a-94ad-4c448845bfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:45.243935 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4431/8877] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:45.251882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654477d7-9437-4a16-a091-b0d3edc3b4e7 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:45.252104 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654477d7-9437-4a16-a091-b0d3edc3b4e7 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:45.252394 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654477d7-9437-4a16-a091-b0d3edc3b4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:45.274175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-654477d7-9437-4a16-a091-b0d3edc3b4e7 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:45.275385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-654477d7-9437-4a16-a091-b0d3edc3b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:45.283551 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4447/8878] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:45.287873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96887038-3e09-4f6a-94ad-4c448845bfe3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:45.297918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96887038-3e09-4f6a-94ad-4c448845bfe3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:45.304027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa767a2d-d0c0-4401-bdbf-ccf57fff34e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:45.304633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa767a2d-d0c0-4401-bdbf-ccf57fff34e6 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:45.304914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa767a2d-d0c0-4401-bdbf-ccf57fff34e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:45.305210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa767a2d-d0c0-4401-bdbf-ccf57fff34e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:45.305906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa767a2d-d0c0-4401-bdbf-ccf57fff34e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:50:45.306215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa767a2d-d0c0-4401-bdbf-ccf57fff34e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:45.307865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa767a2d-d0c0-4401-bdbf-ccf57fff34e6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:45.320185 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4432/8879] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:50:45.324390 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654477d7-9437-4a16-a091-b0d3edc3b4e7 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:45.333883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654477d7-9437-4a16-a091-b0d3edc3b4e7 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:45.338669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db5d41-8455-481e-8385-b00e1fa5c94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:45.339260 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db5d41-8455-481e-8385-b00e1fa5c94b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:45.339543 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db5d41-8455-481e-8385-b00e1fa5c94b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:45.339819 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db5d41-8455-481e-8385-b00e1fa5c94b admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:45.340452 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db5d41-8455-481e-8385-b00e1fa5c94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:45.342467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db5d41-8455-481e-8385-b00e1fa5c94b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:45.354140 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:45.371458 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4448/8880] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:50:45 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:50:45.375572 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa767a2d-d0c0-4401-bdbf-ccf57fff34e6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:45.385626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa767a2d-d0c0-4401-bdbf-ccf57fff34e6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:45.441489 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347651e-89b5-4b6a-ae8d-3bf18d590d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:45.442103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347651e-89b5-4b6a-ae8d-3bf18d590d25 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:45.442385 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347651e-89b5-4b6a-ae8d-3bf18d590d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:45.442660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347651e-89b5-4b6a-ae8d-3bf18d590d25 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:45.443326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347651e-89b5-4b6a-ae8d-3bf18d590d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:45.445256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347651e-89b5-4b6a-ae8d-3bf18d590d25 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:45.453218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:45.468024 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4433/8881] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:50:45 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:50:45.472153 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db5d41-8455-481e-8385-b00e1fa5c94b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:45.483124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db5d41-8455-481e-8385-b00e1fa5c94b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:45.487789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f5e52-7fcd-4960-aa93-b99e34500d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:45.488413 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f5e52-7fcd-4960-aa93-b99e34500d90 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:45.488710 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f5e52-7fcd-4960-aa93-b99e34500d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:45.488970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f5e52-7fcd-4960-aa93-b99e34500d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:45.490238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f5e52-7fcd-4960-aa93-b99e34500d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:45.491831 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f5e52-7fcd-4960-aa93-b99e34500d90 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:45.502080 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4449/8882] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:50:45.506378 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347651e-89b5-4b6a-ae8d-3bf18d590d25 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:45.517825 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347651e-89b5-4b6a-ae8d-3bf18d590d25 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:45.522874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24db0c-3c8d-4793-8ace-0026d34cfd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:45.523482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24db0c-3c8d-4793-8ace-0026d34cfd7a admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:45.523764 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24db0c-3c8d-4793-8ace-0026d34cfd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:45.524168 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24db0c-3c8d-4793-8ace-0026d34cfd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:45.524818 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24db0c-3c8d-4793-8ace-0026d34cfd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:45.526442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24db0c-3c8d-4793-8ace-0026d34cfd7a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:45.539957 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4434/8883] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:50:45.544354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f5e52-7fcd-4960-aa93-b99e34500d90 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:45.555348 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f5e52-7fcd-4960-aa93-b99e34500d90 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:45.559987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a02408-5755-479c-b03e-342d17e6782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:45.560655 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a02408-5755-479c-b03e-342d17e6782d admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:45.560936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a02408-5755-479c-b03e-342d17e6782d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:45.561243 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a02408-5755-479c-b03e-342d17e6782d admin admin] PATH_INFO: `/v3/projects/f7b08a39a9bf4b628fc3469a6bda9e27/users/470fb6696dc645b19d802a8aa987f3f8/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:45.575953 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a02408-5755-479c-b03e-342d17e6782d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b08a39a9bf4b628fc3469a6bda9e27, user_id=470fb6696dc645b19d802a8aa987f3f8, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:45.578624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a02408-5755-479c-b03e-342d17e6782d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:45.590842 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4450/8884] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:50:45 2022] PUT /identity/v3/projects/f7b08a39a9bf4b628fc3469a6bda9e27/users/470fb6696dc645b19d802a8aa987f3f8/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:50:45.602607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddec3dd-2e5e-4a97-b8c9-9f8f2f842127 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:45.602894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddec3dd-2e5e-4a97-b8c9-9f8f2f842127 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:45.603194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddec3dd-2e5e-4a97-b8c9-9f8f2f842127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:45.632439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-9ddec3dd-2e5e-4a97-b8c9-9f8f2f842127 None None] MFA Rules not processed for user `470fb6696dc645b19d802a8aa987f3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:45.633688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-9ddec3dd-2e5e-4a97-b8c9-9f8f2f842127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:45.698034 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4435/8885] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:50:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:45.709201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a02408-5755-479c-b03e-342d17e6782d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:45.710899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-50a02408-5755-479c-b03e-342d17e6782d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:45.766698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a02408-5755-479c-b03e-342d17e6782d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:45.770334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc04f7-ebf7-4061-8016-257c81b836a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:45.771457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc04f7-ebf7-4061-8016-257c81b836a1 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:45.771731 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc04f7-ebf7-4061-8016-257c81b836a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:45.771999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc04f7-ebf7-4061-8016-257c81b836a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:45.781581 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc04f7-ebf7-4061-8016-257c81b836a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:45.783007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc04f7-ebf7-4061-8016-257c81b836a1 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:45.792520 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4451/8886] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:50:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:50:55.694973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:55.788506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:55.892879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddec3dd-2e5e-4a97-b8c9-9f8f2f842127 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:55.959976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddec3dd-2e5e-4a97-b8c9-9f8f2f842127 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:55.964464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:55.965096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:55.965405 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:55.965679 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] PATH_INFO: `/v3/users/470fb6696dc645b19d802a8aa987f3f8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:55.966794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=470fb6696dc645b19d802a8aa987f3f8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:55.968692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:56.014064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470fb6696dc645b19d802a8aa987f3f8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:56.021581 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470fb6696dc645b19d802a8aa987f3f8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:56.022220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470fb6696dc645b19d802a8aa987f3f8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:56.022817 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470fb6696dc645b19d802a8aa987f3f8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:56.034641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470fb6696dc645b19d802a8aa987f3f8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:56.047016 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4436/8887] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:50:55 2022] DELETE /identity/v3/users/470fb6696dc645b19d802a8aa987f3f8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:50:56.051549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5284e-07e9-44af-9d5d-a84bccb6736f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:56.051917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5284e-07e9-44af-9d5d-a84bccb6736f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:56.052195 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5284e-07e9-44af-9d5d-a84bccb6736f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:56.071624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-1ad5284e-07e9-44af-9d5d-a84bccb6736f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:56.072808 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1ad5284e-07e9-44af-9d5d-a84bccb6736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:56.130252 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4452/8888] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:56.140037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:56.141462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:56.197874 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd43777-efc1-4b94-b168-a670182b4f9c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:56.201523 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abd093-9af4-4cd3-a9fd-db09675d9e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:56.202123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abd093-9af4-4cd3-a9fd-db09675d9e7c service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:56.202404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abd093-9af4-4cd3-a9fd-db09675d9e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:56.202676 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abd093-9af4-4cd3-a9fd-db09675d9e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:56.212203 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abd093-9af4-4cd3-a9fd-db09675d9e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:56.213589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abd093-9af4-4cd3-a9fd-db09675d9e7c service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:56.223478 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4437/8889] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:50:56.390023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5284e-07e9-44af-9d5d-a84bccb6736f None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:56.391462 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-1ad5284e-07e9-44af-9d5d-a84bccb6736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:56.403760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5284e-07e9-44af-9d5d-a84bccb6736f None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:56.408859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:56.409606 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:56.409893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:56.410172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028 admin admin] PATH_INFO: `/v3/projects/f7b08a39a9bf4b628fc3469a6bda9e27` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:56.411314 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b08a39a9bf4b628fc3469a6bda9e27)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:56.413249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:56.460967 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b08a39a9bf4b628fc3469a6bda9e27', 'request_id': 'req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:56.468275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b08a39a9bf4b628fc3469a6bda9e27', 'request_id': 'req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:56.473735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b08a39a9bf4b628fc3469a6bda9e27', 'request_id': 'req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:56.484992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028 admin admin] The token cache is being invalidate because project f7b08a39a9bf4b628fc3469a6bda9e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:50:56.485341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:56.486003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d2d7ca5a-4695-4c0c-8a7a-5ef9a3701028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:50:56.487517 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4453/8890] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:50:56 2022] DELETE /identity/v3/projects/f7b08a39a9bf4b628fc3469a6bda9e27 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:50:56.493243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22768bfa-e029-40ec-bbe4-5070fdd5b32f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:56.493529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22768bfa-e029-40ec-bbe4-5070fdd5b32f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:56.493805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22768bfa-e029-40ec-bbe4-5070fdd5b32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:56.514295 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-22768bfa-e029-40ec-bbe4-5070fdd5b32f None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:56.515961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-22768bfa-e029-40ec-bbe4-5070fdd5b32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:56.534243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:56.579381 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4438/8891] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:56.587386 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9da9c6-8585-45e2-99fd-16b82264c944 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:56.587669 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9da9c6-8585-45e2-99fd-16b82264c944 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:56.587952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9da9c6-8585-45e2-99fd-16b82264c944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:56.608291 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-bc9da9c6-8585-45e2-99fd-16b82264c944 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:56.609540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bc9da9c6-8585-45e2-99fd-16b82264c944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:56.620274 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4454/8892] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:56.624123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22768bfa-e029-40ec-bbe4-5070fdd5b32f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:56.633954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22768bfa-e029-40ec-bbe4-5070fdd5b32f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:56.638627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689fe71-ea7e-4816-8543-e8b0603e0494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:56.639238 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689fe71-ea7e-4816-8543-e8b0603e0494 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:56.639519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689fe71-ea7e-4816-8543-e8b0603e0494 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:56.639783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689fe71-ea7e-4816-8543-e8b0603e0494 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:56.640435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689fe71-ea7e-4816-8543-e8b0603e0494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:50:56.640736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689fe71-ea7e-4816-8543-e8b0603e0494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:56.642364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689fe71-ea7e-4816-8543-e8b0603e0494 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:56.654193 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4439/8893] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 21:50:56.658559 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9da9c6-8585-45e2-99fd-16b82264c944 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:56.668791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9da9c6-8585-45e2-99fd-16b82264c944 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:56.678790 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22bba3-324d-4a9b-b229-95c0ba855b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:56.679406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22bba3-324d-4a9b-b229-95c0ba855b16 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:56.679683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22bba3-324d-4a9b-b229-95c0ba855b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:56.680046 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22bba3-324d-4a9b-b229-95c0ba855b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:56.680752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22bba3-324d-4a9b-b229-95c0ba855b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:56.682676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22bba3-324d-4a9b-b229-95c0ba855b16 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:56.710402 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4455/8894] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:50:56 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:50:56.714953 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689fe71-ea7e-4816-8543-e8b0603e0494 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:56.725635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689fe71-ea7e-4816-8543-e8b0603e0494 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:56.782834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bb6c0-ea40-470f-a997-f373a66ca1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:56.783443 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bb6c0-ea40-470f-a997-f373a66ca1cd admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:56.783720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bb6c0-ea40-470f-a997-f373a66ca1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:56.783989 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bb6c0-ea40-470f-a997-f373a66ca1cd admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:56.784613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bb6c0-ea40-470f-a997-f373a66ca1cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:56.787152 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bb6c0-ea40-470f-a997-f373a66ca1cd admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:56.808416 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4440/8895] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:50:56 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:50:56.812740 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22bba3-324d-4a9b-b229-95c0ba855b16 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:56.823456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22bba3-324d-4a9b-b229-95c0ba855b16 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:56.828115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e99ee3-7f7f-4d2d-95f4-63ca6ad16ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:56.828700 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e99ee3-7f7f-4d2d-95f4-63ca6ad16ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:56.828980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e99ee3-7f7f-4d2d-95f4-63ca6ad16ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:56.829280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e99ee3-7f7f-4d2d-95f4-63ca6ad16ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:56.829916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e99ee3-7f7f-4d2d-95f4-63ca6ad16ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:56.831505 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e99ee3-7f7f-4d2d-95f4-63ca6ad16ba7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:56.841369 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4456/8896] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:50:56.845300 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bb6c0-ea40-470f-a997-f373a66ca1cd admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:56.855937 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bb6c0-ea40-470f-a997-f373a66ca1cd admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:56.860555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949a46d-b727-4ac9-b508-d4d794ab6f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:56.861155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949a46d-b727-4ac9-b508-d4d794ab6f05 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:56.861464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949a46d-b727-4ac9-b508-d4d794ab6f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:56.861738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949a46d-b727-4ac9-b508-d4d794ab6f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:56.862372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949a46d-b727-4ac9-b508-d4d794ab6f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:56.863942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949a46d-b727-4ac9-b508-d4d794ab6f05 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:56.875144 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4441/8897] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:50:56.879263 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e99ee3-7f7f-4d2d-95f4-63ca6ad16ba7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:56.889445 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e99ee3-7f7f-4d2d-95f4-63ca6ad16ba7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:56.894053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acda99-ac3d-4cfe-9215-e86915db8c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:56.894694 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acda99-ac3d-4cfe-9215-e86915db8c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:56.894969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acda99-ac3d-4cfe-9215-e86915db8c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:56.895241 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acda99-ac3d-4cfe-9215-e86915db8c29 admin admin] PATH_INFO: `/v3/projects/731227f4b0da43ffaf5f9b790e14a422/users/a69b8e6efff045568b99d39d7fbc1aad/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:56.911756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acda99-ac3d-4cfe-9215-e86915db8c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=731227f4b0da43ffaf5f9b790e14a422, user_id=a69b8e6efff045568b99d39d7fbc1aad, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:56.914534 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acda99-ac3d-4cfe-9215-e86915db8c29 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:56.928356 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4457/8898] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:50:56 2022] PUT /identity/v3/projects/731227f4b0da43ffaf5f9b790e14a422/users/a69b8e6efff045568b99d39d7fbc1aad/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:50:56.938284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38351b6b-d169-4844-b939-4c858b5c6cfd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:56.938591 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38351b6b-d169-4844-b939-4c858b5c6cfd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:56.938868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38351b6b-d169-4844-b939-4c858b5c6cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:56.966954 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-38351b6b-d169-4844-b939-4c858b5c6cfd None None] MFA Rules not processed for user `a69b8e6efff045568b99d39d7fbc1aad`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:50:56.968163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-38351b6b-d169-4844-b939-4c858b5c6cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:57.030915 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4442/8899] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:50:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:50:57.041720 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acda99-ac3d-4cfe-9215-e86915db8c29 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:50:57.043412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-63acda99-ac3d-4cfe-9215-e86915db8c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:50:57.065014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:57.103010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acda99-ac3d-4cfe-9215-e86915db8c29 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:50:57.106704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5719314-004c-4e25-b83e-8f7733b5ed68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:50:57.107286 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5719314-004c-4e25-b83e-8f7733b5ed68 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:50:57.107588 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5719314-004c-4e25-b83e-8f7733b5ed68 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:50:57.107859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5719314-004c-4e25-b83e-8f7733b5ed68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:50:57.115991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5719314-004c-4e25-b83e-8f7733b5ed68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:50:57.117437 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5719314-004c-4e25-b83e-8f7733b5ed68 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:50:57.126018 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4458/8900] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:50:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:51:01.601693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38351b6b-d169-4844-b939-4c858b5c6cfd None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:01.620842 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:01.665256 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38351b6b-d169-4844-b939-4c858b5c6cfd None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:01.669723 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:01.670352 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:01.670635 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:01.670909 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] PATH_INFO: `/v3/users/a69b8e6efff045568b99d39d7fbc1aad` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:01.672042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a69b8e6efff045568b99d39d7fbc1aad)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:01.673981 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:01.721672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a69b8e6efff045568b99d39d7fbc1aad'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:51:01.729223 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a69b8e6efff045568b99d39d7fbc1aad'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:51:01.729907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a69b8e6efff045568b99d39d7fbc1aad'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:51:01.730515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a69b8e6efff045568b99d39d7fbc1aad'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:51:01.742182 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a69b8e6efff045568b99d39d7fbc1aad'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:51:01.756474 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4443/8901] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:51:01 2022] DELETE /identity/v3/users/a69b8e6efff045568b99d39d7fbc1aad => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:51:01.760959 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e043850-2dd1-4db8-b6d8-e642707482dc None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:01.761460 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e043850-2dd1-4db8-b6d8-e642707482dc None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:01.761558 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e043850-2dd1-4db8-b6d8-e642707482dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:01.782289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3e043850-2dd1-4db8-b6d8-e642707482dc None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:51:01.783754 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3e043850-2dd1-4db8-b6d8-e642707482dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:01.844803 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4459/8902] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:51:01.854691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:01.856084 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:01.912539 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5848028-9b5f-4991-9b38-995e5cdf9012 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:01.916395 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e0cc4-ea20-40c2-8dec-cab8cc78830c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:01.916985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e0cc4-ea20-40c2-8dec-cab8cc78830c service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:01.917294 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e0cc4-ea20-40c2-8dec-cab8cc78830c service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:01.917568 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e0cc4-ea20-40c2-8dec-cab8cc78830c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:01.927057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e0cc4-ea20-40c2-8dec-cab8cc78830c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:01.928462 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e0cc4-ea20-40c2-8dec-cab8cc78830c service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:01.937952 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4444/8903] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:51:02.107797 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e043850-2dd1-4db8-b6d8-e642707482dc None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:02.109235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3e043850-2dd1-4db8-b6d8-e642707482dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:02.124456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e043850-2dd1-4db8-b6d8-e642707482dc None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:02.130705 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf355f58-61e0-42a3-ae66-84179b67d519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:02.131371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf355f58-61e0-42a3-ae66-84179b67d519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:02.131685 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf355f58-61e0-42a3-ae66-84179b67d519 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:02.131980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf355f58-61e0-42a3-ae66-84179b67d519 admin admin] PATH_INFO: `/v3/projects/731227f4b0da43ffaf5f9b790e14a422` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:02.133042 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf355f58-61e0-42a3-ae66-84179b67d519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=731227f4b0da43ffaf5f9b790e14a422)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:02.134981 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf355f58-61e0-42a3-ae66-84179b67d519 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:02.181609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cf355f58-61e0-42a3-ae66-84179b67d519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731227f4b0da43ffaf5f9b790e14a422', 'request_id': 'req-cf355f58-61e0-42a3-ae66-84179b67d519'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:51:02.188605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cf355f58-61e0-42a3-ae66-84179b67d519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731227f4b0da43ffaf5f9b790e14a422', 'request_id': 'req-cf355f58-61e0-42a3-ae66-84179b67d519'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:51:02.194928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cf355f58-61e0-42a3-ae66-84179b67d519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731227f4b0da43ffaf5f9b790e14a422', 'request_id': 'req-cf355f58-61e0-42a3-ae66-84179b67d519'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:51:02.205709 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cf355f58-61e0-42a3-ae66-84179b67d519 admin admin] The token cache is being invalidate because project 731227f4b0da43ffaf5f9b790e14a422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:51:02.205997 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cf355f58-61e0-42a3-ae66-84179b67d519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:51:02.206617 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cf355f58-61e0-42a3-ae66-84179b67d519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:51:02.208703 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4460/8904] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:51:02 2022] DELETE /identity/v3/projects/731227f4b0da43ffaf5f9b790e14a422 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:51:02.214528 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4ac63-94d4-4391-a411-107f278f7eeb None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:02.214812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4ac63-94d4-4391-a411-107f278f7eeb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:02.215090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4ac63-94d4-4391-a411-107f278f7eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:02.235078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-5ef4ac63-94d4-4391-a411-107f278f7eeb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:51:02.236265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-5ef4ac63-94d4-4391-a411-107f278f7eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:02.269522 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:02.295890 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4445/8905] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:51:02.304108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903f74d-4622-40af-a158-8d20cfb4c4a0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:02.304388 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903f74d-4622-40af-a158-8d20cfb4c4a0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:02.304659 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903f74d-4622-40af-a158-8d20cfb4c4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:02.325523 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5903f74d-4622-40af-a158-8d20cfb4c4a0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:51:02.326701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5903f74d-4622-40af-a158-8d20cfb4c4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:02.334807 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4461/8906] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:51:02.338917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4ac63-94d4-4391-a411-107f278f7eeb None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:02.348580 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4ac63-94d4-4391-a411-107f278f7eeb None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:02.353124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b66ddc-5a93-4f4a-a20d-2221b482ca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:02.353756 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b66ddc-5a93-4f4a-a20d-2221b482ca99 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:02.354645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b66ddc-5a93-4f4a-a20d-2221b482ca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:02.354928 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b66ddc-5a93-4f4a-a20d-2221b482ca99 admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:02.355575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b66ddc-5a93-4f4a-a20d-2221b482ca99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:51:02.355880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b66ddc-5a93-4f4a-a20d-2221b482ca99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:02.357474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b66ddc-5a93-4f4a-a20d-2221b482ca99 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:02.369245 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4446/8907] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:51:02.373354 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903f74d-4622-40af-a158-8d20cfb4c4a0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:02.383123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903f74d-4622-40af-a158-8d20cfb4c4a0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:02.387704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcfe8c-e96a-46b7-b00c-00bc29f12362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:02.388288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcfe8c-e96a-46b7-b00c-00bc29f12362 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:02.388566 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcfe8c-e96a-46b7-b00c-00bc29f12362 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:02.388839 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcfe8c-e96a-46b7-b00c-00bc29f12362 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:02.389522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcfe8c-e96a-46b7-b00c-00bc29f12362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:02.391393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcfe8c-e96a-46b7-b00c-00bc29f12362 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:02.418182 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4462/8908] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:51:02 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:51:02.422601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b66ddc-5a93-4f4a-a20d-2221b482ca99 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:02.433147 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b66ddc-5a93-4f4a-a20d-2221b482ca99 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:02.499149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2876aa-887a-4576-9ad2-7609d30f924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:02.499766 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2876aa-887a-4576-9ad2-7609d30f924d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:02.500048 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2876aa-887a-4576-9ad2-7609d30f924d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:02.500322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2876aa-887a-4576-9ad2-7609d30f924d admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:02.500957 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2876aa-887a-4576-9ad2-7609d30f924d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:02.502899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2876aa-887a-4576-9ad2-7609d30f924d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:02.524406 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4447/8909] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:51:02 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:51:02.528800 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcfe8c-e96a-46b7-b00c-00bc29f12362 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:02.539071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcfe8c-e96a-46b7-b00c-00bc29f12362 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:02.543570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce361a13-4994-47a3-b608-0cb5f25bd06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:02.544154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce361a13-4994-47a3-b608-0cb5f25bd06c admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:02.544430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce361a13-4994-47a3-b608-0cb5f25bd06c admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:02.544701 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce361a13-4994-47a3-b608-0cb5f25bd06c admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:02.545362 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce361a13-4994-47a3-b608-0cb5f25bd06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:02.546973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce361a13-4994-47a3-b608-0cb5f25bd06c admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:02.557228 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4463/8910] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 21:51:02.560944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2876aa-887a-4576-9ad2-7609d30f924d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:02.571924 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2876aa-887a-4576-9ad2-7609d30f924d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:02.576881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f5a0b-788a-4d31-b6a1-4c6861ca6eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:02.577517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f5a0b-788a-4d31-b6a1-4c6861ca6eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:02.577796 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f5a0b-788a-4d31-b6a1-4c6861ca6eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:02.578206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f5a0b-788a-4d31-b6a1-4c6861ca6eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:02.578837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f5a0b-788a-4d31-b6a1-4c6861ca6eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:02.580299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f5a0b-788a-4d31-b6a1-4c6861ca6eb1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:02.591346 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4448/8911] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:51:02.595649 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce361a13-4994-47a3-b608-0cb5f25bd06c admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:02.606188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce361a13-4994-47a3-b608-0cb5f25bd06c admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:02.610816 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bcbab-d2e0-478a-8f9e-6c96eb62273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:02.611457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bcbab-d2e0-478a-8f9e-6c96eb62273a admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:02.611735 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bcbab-d2e0-478a-8f9e-6c96eb62273a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:02.612007 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bcbab-d2e0-478a-8f9e-6c96eb62273a admin admin] PATH_INFO: `/v3/projects/c3c1dbcc78cc4349b68eb40eb879be88/users/80a96d23b9a84b03a0549f1d57be4779/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:02.614882 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:02.631349 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bcbab-d2e0-478a-8f9e-6c96eb62273a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c1dbcc78cc4349b68eb40eb879be88, user_id=80a96d23b9a84b03a0549f1d57be4779, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:02.634112 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bcbab-d2e0-478a-8f9e-6c96eb62273a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:02.647146 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4464/8912] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:51:02 2022] PUT /identity/v3/projects/c3c1dbcc78cc4349b68eb40eb879be88/users/80a96d23b9a84b03a0549f1d57be4779/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:51:02.652435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e123e-e712-4466-a291-6bc8061fc567 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:02.652951 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e123e-e712-4466-a291-6bc8061fc567 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:02.653042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e123e-e712-4466-a291-6bc8061fc567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:02.672461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4f1e123e-e712-4466-a291-6bc8061fc567 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:51:02.673695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4f1e123e-e712-4466-a291-6bc8061fc567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:02.734300 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4449/8913] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:51:02.744697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bcbab-d2e0-478a-8f9e-6c96eb62273a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:02.746447 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-988bcbab-d2e0-478a-8f9e-6c96eb62273a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:02.804190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bcbab-d2e0-478a-8f9e-6c96eb62273a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:02.807806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaec31-ae05-4130-a6e6-7dd4ff771edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:02.808407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaec31-ae05-4130-a6e6-7dd4ff771edb service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:02.808687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaec31-ae05-4130-a6e6-7dd4ff771edb service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:02.808960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaec31-ae05-4130-a6e6-7dd4ff771edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:02.818179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaec31-ae05-4130-a6e6-7dd4ff771edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:02.819639 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaec31-ae05-4130-a6e6-7dd4ff771edb service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:02.829047 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4465/8914] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:51:06.895822 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b87d1e-8b9f-40e5-a438-c457e6337c56 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:06.896331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b87d1e-8b9f-40e5-a438-c457e6337c56 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:06.896579 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b87d1e-8b9f-40e5-a438-c457e6337c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:06.930875 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-c3b87d1e-8b9f-40e5-a438-c457e6337c56 None None] MFA Rules not processed for user `80a96d23b9a84b03a0549f1d57be4779`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:51:06.932135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c3b87d1e-8b9f-40e5-a438-c457e6337c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:06.974791 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:07.012805 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4450/8915] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:51:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:51:07.017342 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaec31-ae05-4130-a6e6-7dd4ff771edb service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:07.032662 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaec31-ae05-4130-a6e6-7dd4ff771edb service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:07.042264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedee508-ecf8-4e5a-aff9-c60e303b77e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:07.042972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedee508-ecf8-4e5a-aff9-c60e303b77e5 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:07.043540 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedee508-ecf8-4e5a-aff9-c60e303b77e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:07.043881 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedee508-ecf8-4e5a-aff9-c60e303b77e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:07.044584 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedee508-ecf8-4e5a-aff9-c60e303b77e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:07.047698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedee508-ecf8-4e5a-aff9-c60e303b77e5 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:07.081817 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4466/8916] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:51:07 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:51:07.085683 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b87d1e-8b9f-40e5-a438-c457e6337c56 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:07.097481 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b87d1e-8b9f-40e5-a438-c457e6337c56 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:07.163211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7a4aa-fd83-45ca-afbd-74f53cb2869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:07.163853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7a4aa-fd83-45ca-afbd-74f53cb2869b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:07.164134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7a4aa-fd83-45ca-afbd-74f53cb2869b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:07.164409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7a4aa-fd83-45ca-afbd-74f53cb2869b admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:07.165036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7a4aa-fd83-45ca-afbd-74f53cb2869b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:07.167278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7a4aa-fd83-45ca-afbd-74f53cb2869b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:07.188963 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4451/8917] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:51:07 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:51:07.193504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedee508-ecf8-4e5a-aff9-c60e303b77e5 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:07.203786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedee508-ecf8-4e5a-aff9-c60e303b77e5 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:07.208406 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4da66-6ee5-491a-9e9d-27c8c6367fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:07.209001 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4da66-6ee5-491a-9e9d-27c8c6367fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:07.209323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4da66-6ee5-491a-9e9d-27c8c6367fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:07.209592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4da66-6ee5-491a-9e9d-27c8c6367fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:07.210223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4da66-6ee5-491a-9e9d-27c8c6367fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:07.211948 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4da66-6ee5-491a-9e9d-27c8c6367fc0 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:07.222919 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4467/8918] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:51:07.227626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7a4aa-fd83-45ca-afbd-74f53cb2869b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:07.237930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7a4aa-fd83-45ca-afbd-74f53cb2869b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:07.243282 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c26543-9b37-4e7d-a225-38b1cc5f5c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:07.243961 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c26543-9b37-4e7d-a225-38b1cc5f5c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:07.244243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c26543-9b37-4e7d-a225-38b1cc5f5c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:07.244520 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c26543-9b37-4e7d-a225-38b1cc5f5c3e admin admin] PATH_INFO: `/v3/projects/a21cfdd3254d4d1c83805b6ec588f22c/users/564dfd71a65349039e7439aab345aa58/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:07.259186 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c26543-9b37-4e7d-a225-38b1cc5f5c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21cfdd3254d4d1c83805b6ec588f22c, user_id=564dfd71a65349039e7439aab345aa58, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:07.261930 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c26543-9b37-4e7d-a225-38b1cc5f5c3e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:07.274515 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4452/8919] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:51:07 2022] PUT /identity/v3/projects/a21cfdd3254d4d1c83805b6ec588f22c/users/564dfd71a65349039e7439aab345aa58/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:51:07.278631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4da66-6ee5-491a-9e9d-27c8c6367fc0 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:07.289379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4da66-6ee5-491a-9e9d-27c8c6367fc0 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:07.348053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6349d-5912-4d78-9de8-729093bd7a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:07.349214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6349d-5912-4d78-9de8-729093bd7a98 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:07.349491 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6349d-5912-4d78-9de8-729093bd7a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:07.349752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6349d-5912-4d78-9de8-729093bd7a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:07.350407 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6349d-5912-4d78-9de8-729093bd7a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:07.351987 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6349d-5912-4d78-9de8-729093bd7a98 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:07.361784 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4468/8920] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:51:07.366623 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c26543-9b37-4e7d-a225-38b1cc5f5c3e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:07.377245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c26543-9b37-4e7d-a225-38b1cc5f5c3e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:07.381987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da35bb-c505-40cf-8743-91661322f777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:07.382672 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da35bb-c505-40cf-8743-91661322f777 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:07.383080 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da35bb-c505-40cf-8743-91661322f777 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:07.383359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da35bb-c505-40cf-8743-91661322f777 admin admin] PATH_INFO: `/v3/projects/a21cfdd3254d4d1c83805b6ec588f22c/users/564dfd71a65349039e7439aab345aa58/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:07.385450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da35bb-c505-40cf-8743-91661322f777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21cfdd3254d4d1c83805b6ec588f22c, user_id=564dfd71a65349039e7439aab345aa58, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:07.388050 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da35bb-c505-40cf-8743-91661322f777 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:07.398203 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4453/8921] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:51:07 2022] PUT /identity/v3/projects/a21cfdd3254d4d1c83805b6ec588f22c/users/564dfd71a65349039e7439aab345aa58/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:51:11.878222 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329aeac-c180-4fb5-beab-5fecd2031b07 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:11.879455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329aeac-c180-4fb5-beab-5fecd2031b07 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:11.879974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329aeac-c180-4fb5-beab-5fecd2031b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:11.924219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-6329aeac-c180-4fb5-beab-5fecd2031b07 None None] MFA Rules not processed for user `564dfd71a65349039e7439aab345aa58`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:51:11.925507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6329aeac-c180-4fb5-beab-5fecd2031b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:11.986352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:12.041382 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4469/8922] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:51:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:51:12.078893 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa518cb-cb8d-4ae5-ab40-6548cef8e805 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:12.079435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa518cb-cb8d-4ae5-ab40-6548cef8e805 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:12.079548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa518cb-cb8d-4ae5-ab40-6548cef8e805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:12.145479 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0aa518cb-cb8d-4ae5-ab40-6548cef8e805 None None] MFA Rules not processed for user `6d82a39388514ff79b2235ff2ede6ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:51:12.146786 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0aa518cb-cb8d-4ae5-ab40-6548cef8e805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:12.227053 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4454/8923] 10.222.0.26 () {58 vars in 1059 bytes} [Sat Oct 8 21:51:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:51:12.233464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329aeac-c180-4fb5-beab-5fecd2031b07 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:12.245983 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329aeac-c180-4fb5-beab-5fecd2031b07 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:12.251861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab2c7d-79a8-49e7-9971-8525ba887e00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:12.252492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2c7d-79a8-49e7-9971-8525ba887e00 service glance] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:12.252760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2c7d-79a8-49e7-9971-8525ba887e00 service glance] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:12.253033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2c7d-79a8-49e7-9971-8525ba887e00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:12.324443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab2c7d-79a8-49e7-9971-8525ba887e00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:12.325939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab2c7d-79a8-49e7-9971-8525ba887e00 service glance] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:12.336277 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4470/8924] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:51:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:51:12.485370 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e396e9-46bf-464c-93df-3256a23f7b75 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:12.485741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e396e9-46bf-464c-93df-3256a23f7b75 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:12.486062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e396e9-46bf-464c-93df-3256a23f7b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:12.494439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:12.537941 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-29e396e9-46bf-464c-93df-3256a23f7b75 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:51:12.539158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-29e396e9-46bf-464c-93df-3256a23f7b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:12.607726 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4455/8925] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:51:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:51:12.655341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580aec-a2d5-4114-8dea-93e92e6399f5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:12.655627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580aec-a2d5-4114-8dea-93e92e6399f5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:12.655903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580aec-a2d5-4114-8dea-93e92e6399f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:12.710122 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-2d580aec-a2d5-4114-8dea-93e92e6399f5 None None] MFA Rules not processed for user `5bd5adc10b4344e1847c23c2c0599e59`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:51:12.711376 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2d580aec-a2d5-4114-8dea-93e92e6399f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:12.789333 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4471/8926] 10.222.0.26 () {58 vars in 1040 bytes} [Sat Oct 8 21:51:12 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:51:12.795926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e396e9-46bf-464c-93df-3256a23f7b75 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:12.809213 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e396e9-46bf-464c-93df-3256a23f7b75 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:12.814677 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1282cc8-6819-4dcc-8375-16b0d76222a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:12.815290 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1282cc8-6819-4dcc-8375-16b0d76222a9 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:12.815600 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1282cc8-6819-4dcc-8375-16b0d76222a9 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:12.815931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1282cc8-6819-4dcc-8375-16b0d76222a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:12.824871 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1282cc8-6819-4dcc-8375-16b0d76222a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:12.826733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1282cc8-6819-4dcc-8375-16b0d76222a9 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:12.835529 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4456/8927] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:51:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:51:21.645958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa8b86-5bfe-446c-8562-2fa7a4b903cd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:21.646552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa8b86-5bfe-446c-8562-2fa7a4b903cd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:21.646660 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa8b86-5bfe-446c-8562-2fa7a4b903cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:21.667124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-83aa8b86-5bfe-446c-8562-2fa7a4b903cd None None] MFA Rules not processed for user `80a96d23b9a84b03a0549f1d57be4779`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:51:21.672529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-83aa8b86-5bfe-446c-8562-2fa7a4b903cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:21.680136 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4472/8928] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:51:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:51:21.960891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a9c3-f7a1-4faa-bbd5-fdbdbddeb25d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:21.961487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a9c3-f7a1-4faa-bbd5-fdbdbddeb25d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:21.961487 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a9c3-f7a1-4faa-bbd5-fdbdbddeb25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:21.981810 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-98c1a9c3-f7a1-4faa-bbd5-fdbdbddeb25d None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:51:21.983028 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-98c1a9c3-f7a1-4faa-bbd5-fdbdbddeb25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:22.036392 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4457/8929] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:51:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:51:22.048910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa8b86-5bfe-446c-8562-2fa7a4b903cd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:22.050430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-83aa8b86-5bfe-446c-8562-2fa7a4b903cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:22.062201 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa8b86-5bfe-446c-8562-2fa7a4b903cd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:22.066074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38ed02-4521-4ef5-90c0-b8ad4cbfaac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:22.067196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38ed02-4521-4ef5-90c0-b8ad4cbfaac6 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:22.067470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38ed02-4521-4ef5-90c0-b8ad4cbfaac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:22.067802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38ed02-4521-4ef5-90c0-b8ad4cbfaac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:22.074893 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38ed02-4521-4ef5-90c0-b8ad4cbfaac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:22.076420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38ed02-4521-4ef5-90c0-b8ad4cbfaac6 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:22.084853 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4473/8930] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:51:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:51:23.678967 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1fd25-b0a7-4655-bce4-6efa10ca4d2d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:23.679711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1fd25-b0a7-4655-bce4-6efa10ca4d2d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:23.679711 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1fd25-b0a7-4655-bce4-6efa10ca4d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:23.701944 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-45a1fd25-b0a7-4655-bce4-6efa10ca4d2d None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:51:23.703433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-45a1fd25-b0a7-4655-bce4-6efa10ca4d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:51:23.711573 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4458/8931] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:51:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:51:23.725421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38ed02-4521-4ef5-90c0-b8ad4cbfaac6 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:23.739600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38ed02-4521-4ef5-90c0-b8ad4cbfaac6 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:23.746670 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8428ae-286b-47b0-8101-767f8f2cc27a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:23.747985 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8428ae-286b-47b0-8101-767f8f2cc27a service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:23.748271 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8428ae-286b-47b0-8101-767f8f2cc27a service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:23.748609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8428ae-286b-47b0-8101-767f8f2cc27a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:23.761587 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8428ae-286b-47b0-8101-767f8f2cc27a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:23.764052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8428ae-286b-47b0-8101-767f8f2cc27a service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:23.781076 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4474/8932] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:51:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 21:51:33.695518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=70 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:33.774889 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=99 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:48.507988 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1fd25-b0a7-4655-bce4-6efa10ca4d2d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:51:48.517303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1fd25-b0a7-4655-bce4-6efa10ca4d2d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:51:48.521533 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40084364-6138-4086-a6d8-218009d58e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:51:48.522131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40084364-6138-4086-a6d8-218009d58e6a service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:51:48.522404 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40084364-6138-4086-a6d8-218009d58e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:51:48.522670 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40084364-6138-4086-a6d8-218009d58e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:51:48.531334 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40084364-6138-4086-a6d8-218009d58e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:51:48.532745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40084364-6138-4086-a6d8-218009d58e6a service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:51:48.542013 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4459/8933] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:51:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:51:58.537949 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:53:22.418254 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8428ae-286b-47b0-8101-767f8f2cc27a service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:53:22.419697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3c8428ae-286b-47b0-8101-767f8f2cc27a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:53:22.564675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8428ae-286b-47b0-8101-767f8f2cc27a service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:53:22.570207 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9ed0d-8b36-4cf9-9578-dea4ee0a5b58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:53:22.570812 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9ed0d-8b36-4cf9-9578-dea4ee0a5b58 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:53:22.571093 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9ed0d-8b36-4cf9-9578-dea4ee0a5b58 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:53:22.571367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9ed0d-8b36-4cf9-9578-dea4ee0a5b58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:53:22.573096 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-33e9ed0d-8b36-4cf9-9578-dea4ee0a5b58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:53:22.584746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9ed0d-8b36-4cf9-9578-dea4ee0a5b58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:53:22.586365 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9ed0d-8b36-4cf9-9578-dea4ee0a5b58 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:53:22.596801 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4475/8934] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:53:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:53:23.761284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40084364-6138-4086-a6d8-218009d58e6a service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:53:23.773313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40084364-6138-4086-a6d8-218009d58e6a service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:53:23.778215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b75852-6ec1-47d9-a34d-454ec211328e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:53:23.778811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b75852-6ec1-47d9-a34d-454ec211328e service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:53:23.779090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b75852-6ec1-47d9-a34d-454ec211328e service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:53:23.779361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b75852-6ec1-47d9-a34d-454ec211328e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:53:23.781074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-61b75852-6ec1-47d9-a34d-454ec211328e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:53:23.793215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b75852-6ec1-47d9-a34d-454ec211328e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:53:23.794815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b75852-6ec1-47d9-a34d-454ec211328e service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:53:23.805287 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4460/8935] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:53:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:53:32.592698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=37 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:53:33.800546 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:55:19.461172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9ed0d-8b36-4cf9-9578-dea4ee0a5b58 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:55:19.479980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9ed0d-8b36-4cf9-9578-dea4ee0a5b58 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:55:19.483607 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a7de2-aca0-48ce-897d-2bde8a0ebb77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:55:19.484245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a7de2-aca0-48ce-897d-2bde8a0ebb77 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:19.484549 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a7de2-aca0-48ce-897d-2bde8a0ebb77 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:19.484823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a7de2-aca0-48ce-897d-2bde8a0ebb77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:19.486557 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-254a7de2-aca0-48ce-897d-2bde8a0ebb77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:19.496537 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a7de2-aca0-48ce-897d-2bde8a0ebb77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:55:19.497984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a7de2-aca0-48ce-897d-2bde8a0ebb77 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:55:19.505906 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4476/8936] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:55:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:55:27.094146 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b75852-6ec1-47d9-a34d-454ec211328e service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:55:27.104188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b75852-6ec1-47d9-a34d-454ec211328e service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:55:27.108486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41720b-dc55-4469-bd1e-6507438cd60e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:55:27.109344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41720b-dc55-4469-bd1e-6507438cd60e service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:27.109651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41720b-dc55-4469-bd1e-6507438cd60e service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:27.109926 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41720b-dc55-4469-bd1e-6507438cd60e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:27.111734 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cc41720b-dc55-4469-bd1e-6507438cd60e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:27.199715 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41720b-dc55-4469-bd1e-6507438cd60e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:55:27.201126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41720b-dc55-4469-bd1e-6507438cd60e service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:55:27.221477 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4461/8937] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:55:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:55:27.643585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a7de2-aca0-48ce-897d-2bde8a0ebb77 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:55:27.645301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-254a7de2-aca0-48ce-897d-2bde8a0ebb77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:27.675699 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a7de2-aca0-48ce-897d-2bde8a0ebb77 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:55:27.685074 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c18fda-efcf-4156-8884-de915c0bb863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:55:27.685865 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18fda-efcf-4156-8884-de915c0bb863 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:27.686276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18fda-efcf-4156-8884-de915c0bb863 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:27.686647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18fda-efcf-4156-8884-de915c0bb863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:27.689295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-86c18fda-efcf-4156-8884-de915c0bb863 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:27.705456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c18fda-efcf-4156-8884-de915c0bb863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:55:27.707272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c18fda-efcf-4156-8884-de915c0bb863 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:55:27.722964 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4477/8938] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:55:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:55:28.712307 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41720b-dc55-4469-bd1e-6507438cd60e service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:55:28.713868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cc41720b-dc55-4469-bd1e-6507438cd60e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:28.730306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41720b-dc55-4469-bd1e-6507438cd60e service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:55:28.736220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1cf76-6593-4256-8cc9-fd781d564e1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:55:28.736776 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1cf76-6593-4256-8cc9-fd781d564e1b service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:28.737057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1cf76-6593-4256-8cc9-fd781d564e1b service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:28.737366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1cf76-6593-4256-8cc9-fd781d564e1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:28.739274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e3b1cf76-6593-4256-8cc9-fd781d564e1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:28.752397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1cf76-6593-4256-8cc9-fd781d564e1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:55:28.754038 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1cf76-6593-4256-8cc9-fd781d564e1b service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:55:28.764855 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4462/8939] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:55:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:55:28.805911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482291a-8acf-4bbb-947f-f6b57ace1391 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:28.807378 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482291a-8acf-4bbb-947f-f6b57ace1391 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:28.807661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482291a-8acf-4bbb-947f-f6b57ace1391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:28.832786 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-8482291a-8acf-4bbb-947f-f6b57ace1391 None None] MFA Rules not processed for user `7885df3b2ae34969852f76fbc94a7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:55:28.834045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-8482291a-8acf-4bbb-947f-f6b57ace1391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:28.886424 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4478/8940] 10.222.0.26 () {58 vars in 1060 bytes} [Sat Oct 8 21:55:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:55:28.892899 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1cf76-6593-4256-8cc9-fd781d564e1b service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:55:28.903108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1cf76-6593-4256-8cc9-fd781d564e1b service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:55:28.906959 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789b62-8e28-438e-9778-46c04991b761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7885df3b2ae34969852f76fbc94a7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:55:28.907816 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789b62-8e28-438e-9778-46c04991b761 service cinder] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:28.908109 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789b62-8e28-438e-9778-46c04991b761 service cinder] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:28.908387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789b62-8e28-438e-9778-46c04991b761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:28.910554 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-db789b62-8e28-438e-9778-46c04991b761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:28.924699 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789b62-8e28-438e-9778-46c04991b761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:55:28.926187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789b62-8e28-438e-9778-46c04991b761 service cinder] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:55:28.938367 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4463/8941] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:55:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:55:35.136305 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b7920-4c29-4a1e-aa3b-aeaeb64fd62d None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:35.136824 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b7920-4c29-4a1e-aa3b-aeaeb64fd62d None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:35.136937 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b7920-4c29-4a1e-aa3b-aeaeb64fd62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:35.155896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c12b7920-4c29-4a1e-aa3b-aeaeb64fd62d None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:55:35.157079 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c12b7920-4c29-4a1e-aa3b-aeaeb64fd62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:35.164150 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4479/8942] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:55:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:55:35.204969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789b62-8e28-438e-9778-46c04991b761 service cinder] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:55:35.216372 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789b62-8e28-438e-9778-46c04991b761 service cinder] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:55:35.221575 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e6f11-9a86-4d36-87a4-0c21df59c71d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:55:35.222188 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e6f11-9a86-4d36-87a4-0c21df59c71d service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:35.222475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e6f11-9a86-4d36-87a4-0c21df59c71d service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:35.222750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e6f11-9a86-4d36-87a4-0c21df59c71d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:35.231560 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e6f11-9a86-4d36-87a4-0c21df59c71d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:55:35.233125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e6f11-9a86-4d36-87a4-0c21df59c71d service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:55:35.241203 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4464/8943] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:55:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:55:35.726910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693591c-bbde-4e6c-89f7-80eafca3836f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:35.727197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693591c-bbde-4e6c-89f7-80eafca3836f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:35.727472 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693591c-bbde-4e6c-89f7-80eafca3836f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:35.747155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-5693591c-bbde-4e6c-89f7-80eafca3836f None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:55:35.748347 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-5693591c-bbde-4e6c-89f7-80eafca3836f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:35.755391 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4480/8944] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:55:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:55:35.767604 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e6f11-9a86-4d36-87a4-0c21df59c71d service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:55:35.778691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e6f11-9a86-4d36-87a4-0c21df59c71d service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:55:35.783861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a27ae-18ca-43c6-829a-cec30c69279e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:55:35.784461 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a27ae-18ca-43c6-829a-cec30c69279e service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:35.784745 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a27ae-18ca-43c6-829a-cec30c69279e service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:35.785021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a27ae-18ca-43c6-829a-cec30c69279e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:35.793812 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a27ae-18ca-43c6-829a-cec30c69279e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:55:35.795371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a27ae-18ca-43c6-829a-cec30c69279e service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:55:35.804749 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4465/8945] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:55:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:55:45.371506 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68d6c9-1b45-47c9-8b4b-f7ce6f4d061c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:45.372105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68d6c9-1b45-47c9-8b4b-f7ce6f4d061c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:45.372105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68d6c9-1b45-47c9-8b4b-f7ce6f4d061c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:45.379230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=46 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:55:45.394228 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ea68d6c9-1b45-47c9-8b4b-f7ce6f4d061c None None] MFA Rules not processed for user `80a96d23b9a84b03a0549f1d57be4779`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:55:45.395436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ea68d6c9-1b45-47c9-8b4b-f7ce6f4d061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:45.402450 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4481/8946] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:55:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:55:45.666750 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041fa67-55ab-4aeb-8f48-648a9d0cdbe3 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:45.667269 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041fa67-55ab-4aeb-8f48-648a9d0cdbe3 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:45.667914 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041fa67-55ab-4aeb-8f48-648a9d0cdbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:45.687495 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f041fa67-55ab-4aeb-8f48-648a9d0cdbe3 None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:55:45.688947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f041fa67-55ab-4aeb-8f48-648a9d0cdbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:45.695275 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4466/8947] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:55:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:55:45.706692 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68d6c9-1b45-47c9-8b4b-f7ce6f4d061c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:55:45.716303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68d6c9-1b45-47c9-8b4b-f7ce6f4d061c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:55:45.720053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eece4d1-a496-4e76-8b06-adcc3ef47e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:55:45.720675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eece4d1-a496-4e76-8b06-adcc3ef47e99 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:45.720958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eece4d1-a496-4e76-8b06-adcc3ef47e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:45.721266 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eece4d1-a496-4e76-8b06-adcc3ef47e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:45.728139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eece4d1-a496-4e76-8b06-adcc3ef47e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:55:45.729624 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eece4d1-a496-4e76-8b06-adcc3ef47e99 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:55:45.737879 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4482/8948] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:55:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:55:46.076272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041fa67-55ab-4aeb-8f48-648a9d0cdbe3 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:55:46.098176 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041fa67-55ab-4aeb-8f48-648a9d0cdbe3 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:55:46.103093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4b658-895a-41a6-8467-30d1f2a061e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:55:46.104202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4b658-895a-41a6-8467-30d1f2a061e6 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:46.104202 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4b658-895a-41a6-8467-30d1f2a061e6 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:46.104422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4b658-895a-41a6-8467-30d1f2a061e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:46.106835 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-32e4b658-895a-41a6-8467-30d1f2a061e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:46.119066 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4b658-895a-41a6-8467-30d1f2a061e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:55:46.121355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4b658-895a-41a6-8467-30d1f2a061e6 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:55:46.131790 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4467/8949] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:55:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:55:47.306391 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0286a6-a448-44f9-9ce1-4d3e12ea4486 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:47.306876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0286a6-a448-44f9-9ce1-4d3e12ea4486 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:47.306984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0286a6-a448-44f9-9ce1-4d3e12ea4486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:47.327224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ff0286a6-a448-44f9-9ce1-4d3e12ea4486 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:55:47.328440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ff0286a6-a448-44f9-9ce1-4d3e12ea4486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:47.337348 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4483/8950] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 21:55:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:55:47.352855 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4b658-895a-41a6-8467-30d1f2a061e6 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:55:47.365660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4b658-895a-41a6-8467-30d1f2a061e6 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:55:47.370646 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7e700-e19e-404c-b343-41012f3c0cf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:55:47.371240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7e700-e19e-404c-b343-41012f3c0cf5 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:47.371517 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7e700-e19e-404c-b343-41012f3c0cf5 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:47.371787 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7e700-e19e-404c-b343-41012f3c0cf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:47.380552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7e700-e19e-404c-b343-41012f3c0cf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:55:47.382149 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7e700-e19e-404c-b343-41012f3c0cf5 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:55:47.391107 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4468/8951] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:55:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:55:55.487392 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0286a6-a448-44f9-9ce1-4d3e12ea4486 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:55:55.497225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0286a6-a448-44f9-9ce1-4d3e12ea4486 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:55:55.500830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357c0d6-2542-43e2-a932-cd2f7f395200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:55:55.501476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357c0d6-2542-43e2-a932-cd2f7f395200 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:55:55.501761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357c0d6-2542-43e2-a932-cd2f7f395200 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:55:55.502157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357c0d6-2542-43e2-a932-cd2f7f395200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:55:55.503897 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7357c0d6-2542-43e2-a932-cd2f7f395200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:55:55.513644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357c0d6-2542-43e2-a932-cd2f7f395200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:55:55.515098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357c0d6-2542-43e2-a932-cd2f7f395200 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:55:55.523374 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4484/8952] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:55:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:55:57.387564 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:56:01.639820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7e700-e19e-404c-b343-41012f3c0cf5 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:56:01.653867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7e700-e19e-404c-b343-41012f3c0cf5 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:56:01.659529 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da66386-d35e-4ce1-9762-7ef386b23bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:56:01.660135 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da66386-d35e-4ce1-9762-7ef386b23bf7 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:56:01.660419 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da66386-d35e-4ce1-9762-7ef386b23bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:56:01.660695 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da66386-d35e-4ce1-9762-7ef386b23bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:56:01.662458 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4da66386-d35e-4ce1-9762-7ef386b23bf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:56:01.675359 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da66386-d35e-4ce1-9762-7ef386b23bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:56:01.676984 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da66386-d35e-4ce1-9762-7ef386b23bf7 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:56:01.687928 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4469/8953] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:56:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:56:05.519629 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=17 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:56:11.683236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:56:12.004106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357c0d6-2542-43e2-a932-cd2f7f395200 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:56:12.013763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357c0d6-2542-43e2-a932-cd2f7f395200 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:56:12.017528 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192eda5-3eb0-45a3-9346-18e2af1cbd77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:56:12.018139 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192eda5-3eb0-45a3-9346-18e2af1cbd77 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:56:12.018423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192eda5-3eb0-45a3-9346-18e2af1cbd77 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:56:12.018703 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192eda5-3eb0-45a3-9346-18e2af1cbd77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:56:12.028467 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192eda5-3eb0-45a3-9346-18e2af1cbd77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:56:12.029943 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192eda5-3eb0-45a3-9346-18e2af1cbd77 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:56:12.039998 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4485/8954] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:56:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:56:22.035229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:27.892382 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f599b8-ed72-4212-8125-db56b0dfa7a5 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:27.892922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f599b8-ed72-4212-8125-db56b0dfa7a5 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:27.892922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f599b8-ed72-4212-8125-db56b0dfa7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:27.922693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-85f599b8-ed72-4212-8125-db56b0dfa7a5 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:57:27.924548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-85f599b8-ed72-4212-8125-db56b0dfa7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:27.931723 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4470/8955] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 21:57:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:57:27.971788 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192eda5-3eb0-45a3-9346-18e2af1cbd77 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:27.997073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192eda5-3eb0-45a3-9346-18e2af1cbd77 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:28.002111 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f6e47-76f7-4235-ac93-3cf301a2fd12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:28.002704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f6e47-76f7-4235-ac93-3cf301a2fd12 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:28.002984 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f6e47-76f7-4235-ac93-3cf301a2fd12 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:28.003258 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f6e47-76f7-4235-ac93-3cf301a2fd12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:28.011282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f6e47-76f7-4235-ac93-3cf301a2fd12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:28.012801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f6e47-76f7-4235-ac93-3cf301a2fd12 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:28.020718 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4486/8956] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 21:57:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 21:57:28.369555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f599b8-ed72-4212-8125-db56b0dfa7a5 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:28.379099 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f599b8-ed72-4212-8125-db56b0dfa7a5 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:28.382753 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66d2a4-c0e1-460d-bb92-d43f534cba2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:28.383409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66d2a4-c0e1-460d-bb92-d43f534cba2d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:28.383710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66d2a4-c0e1-460d-bb92-d43f534cba2d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:28.383977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66d2a4-c0e1-460d-bb92-d43f534cba2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:28.453280 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66d2a4-c0e1-460d-bb92-d43f534cba2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:28.454709 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66d2a4-c0e1-460d-bb92-d43f534cba2d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:28.474367 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4471/8957] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:57:31.314293 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a585b4-928a-4702-8cdd-bc74a2ca9038 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:31.316106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a585b4-928a-4702-8cdd-bc74a2ca9038 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:31.316619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a585b4-928a-4702-8cdd-bc74a2ca9038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:31.367470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-76a585b4-928a-4702-8cdd-bc74a2ca9038 None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:57:31.369157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-76a585b4-928a-4702-8cdd-bc74a2ca9038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:31.380966 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4487/8958] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 21:57:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:57:31.393990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66d2a4-c0e1-460d-bb92-d43f534cba2d service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:31.395805 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6e66d2a4-c0e1-460d-bb92-d43f534cba2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:31.445698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66d2a4-c0e1-460d-bb92-d43f534cba2d service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:31.451169 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87006a2e-cafd-463c-b250-084472dd6077 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:31.452337 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87006a2e-cafd-463c-b250-084472dd6077 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:31.453077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87006a2e-cafd-463c-b250-084472dd6077 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:31.453387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87006a2e-cafd-463c-b250-084472dd6077 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:31.463245 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87006a2e-cafd-463c-b250-084472dd6077 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:31.464834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87006a2e-cafd-463c-b250-084472dd6077 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:31.476802 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4472/8959] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:57:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:57:34.917501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a585b4-928a-4702-8cdd-bc74a2ca9038 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:34.929149 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a585b4-928a-4702-8cdd-bc74a2ca9038 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:34.934242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:34.934886 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:34.935155 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:34.935433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] PATH_INFO: `/v3/users/80a96d23b9a84b03a0549f1d57be4779` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:34.936562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a96d23b9a84b03a0549f1d57be4779)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:34.938775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:34.985164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a96d23b9a84b03a0549f1d57be4779'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:34.991974 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a96d23b9a84b03a0549f1d57be4779'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:34.992632 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a96d23b9a84b03a0549f1d57be4779'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:34.993261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a96d23b9a84b03a0549f1d57be4779'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.005455 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a96d23b9a84b03a0549f1d57be4779'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.018409 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4488/8960] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:57:34 2022] DELETE /identity/v3/users/80a96d23b9a84b03a0549f1d57be4779 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:57:35.192442 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87006a2e-cafd-463c-b250-084472dd6077 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:35.204106 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87006a2e-cafd-463c-b250-084472dd6077 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:35.262020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:35.262650 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:35.262931 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:35.263204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] PATH_INFO: `/v3/projects/c3c1dbcc78cc4349b68eb40eb879be88` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:35.264313 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c1dbcc78cc4349b68eb40eb879be88)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:35.266244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:35.311306 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c1dbcc78cc4349b68eb40eb879be88', 'request_id': 'req-1ad70770-dd7b-4418-ac32-267f319b6040'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.313327 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:35.320719 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c1dbcc78cc4349b68eb40eb879be88', 'request_id': 'req-1ad70770-dd7b-4418-ac32-267f319b6040'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.326535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c1dbcc78cc4349b68eb40eb879be88', 'request_id': 'req-1ad70770-dd7b-4418-ac32-267f319b6040'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.349059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] The token cache is being invalidate because project c3c1dbcc78cc4349b68eb40eb879be88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:57:35.349374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.349995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.351474 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4473/8961] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:57:35 2022] DELETE /identity/v3/projects/c3c1dbcc78cc4349b68eb40eb879be88 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:57:35.355444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:35.356911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:35.370332 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2472a-e103-4649-92df-7b29d6dba7c4 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:35.426052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33f54b-8bfd-4c74-a987-8dc00a698984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:35.426678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33f54b-8bfd-4c74-a987-8dc00a698984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:35.426958 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33f54b-8bfd-4c74-a987-8dc00a698984 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:35.427234 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33f54b-8bfd-4c74-a987-8dc00a698984 admin admin] PATH_INFO: `/v3/users/564dfd71a65349039e7439aab345aa58` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:35.428497 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33f54b-8bfd-4c74-a987-8dc00a698984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=564dfd71a65349039e7439aab345aa58)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:35.431151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33f54b-8bfd-4c74-a987-8dc00a698984 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:35.459553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:35.478008 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac33f54b-8bfd-4c74-a987-8dc00a698984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564dfd71a65349039e7439aab345aa58'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.484960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac33f54b-8bfd-4c74-a987-8dc00a698984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564dfd71a65349039e7439aab345aa58'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.485674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac33f54b-8bfd-4c74-a987-8dc00a698984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564dfd71a65349039e7439aab345aa58'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.486285 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac33f54b-8bfd-4c74-a987-8dc00a698984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564dfd71a65349039e7439aab345aa58'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.499018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-ac33f54b-8bfd-4c74-a987-8dc00a698984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564dfd71a65349039e7439aab345aa58'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.512534 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4489/8962] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 21:57:35 2022] DELETE /identity/v3/users/564dfd71a65349039e7439aab345aa58 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:57:35.687774 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:35.689250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:35.704505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad70770-dd7b-4418-ac32-267f319b6040 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:35.763840 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb2212-888d-480a-acd0-97267fe52a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:35.764471 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb2212-888d-480a-acd0-97267fe52a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:35.764747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb2212-888d-480a-acd0-97267fe52a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:35.765012 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb2212-888d-480a-acd0-97267fe52a90 admin admin] PATH_INFO: `/v3/projects/a21cfdd3254d4d1c83805b6ec588f22c` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:35.766162 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb2212-888d-480a-acd0-97267fe52a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21cfdd3254d4d1c83805b6ec588f22c)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:35.768663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb2212-888d-480a-acd0-97267fe52a90 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:35.813811 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3eb2212-888d-480a-acd0-97267fe52a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21cfdd3254d4d1c83805b6ec588f22c', 'request_id': 'req-b3eb2212-888d-480a-acd0-97267fe52a90'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.822125 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3eb2212-888d-480a-acd0-97267fe52a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21cfdd3254d4d1c83805b6ec588f22c', 'request_id': 'req-b3eb2212-888d-480a-acd0-97267fe52a90'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.827653 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3eb2212-888d-480a-acd0-97267fe52a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21cfdd3254d4d1c83805b6ec588f22c', 'request_id': 'req-b3eb2212-888d-480a-acd0-97267fe52a90'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.838624 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3eb2212-888d-480a-acd0-97267fe52a90 admin admin] The token cache is being invalidate because project a21cfdd3254d4d1c83805b6ec588f22c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 21:57:35.838908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3eb2212-888d-480a-acd0-97267fe52a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.839532 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-b3eb2212-888d-480a-acd0-97267fe52a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 21:57:35.841101 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4474/8963] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:57:35 2022] DELETE /identity/v3/projects/a21cfdd3254d4d1c83805b6ec588f22c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:57:35.846359 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87828ca9-1976-40d2-b691-cf7aad328156 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:35.846647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87828ca9-1976-40d2-b691-cf7aad328156 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:35.846923 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87828ca9-1976-40d2-b691-cf7aad328156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:35.894913 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-87828ca9-1976-40d2-b691-cf7aad328156 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:57:35.896047 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-87828ca9-1976-40d2-b691-cf7aad328156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:35.953836 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4490/8964] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:57:35.961655 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd6fe-7b2d-4301-9664-e0fba8d3e107 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:35.961943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd6fe-7b2d-4301-9664-e0fba8d3e107 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:35.962222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd6fe-7b2d-4301-9664-e0fba8d3e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:35.981675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-f30cd6fe-7b2d-4301-9664-e0fba8d3e107 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:57:35.982884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f30cd6fe-7b2d-4301-9664-e0fba8d3e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:35.991238 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4475/8965] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:57:35.995363 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87828ca9-1976-40d2-b691-cf7aad328156 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:36.005697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87828ca9-1976-40d2-b691-cf7aad328156 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:36.010323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631c2e3-52da-48f1-a2a6-f3531596d86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:36.010911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631c2e3-52da-48f1-a2a6-f3531596d86a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.011190 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631c2e3-52da-48f1-a2a6-f3531596d86a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.011463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631c2e3-52da-48f1-a2a6-f3531596d86a admin admin] PATH_INFO: `/v3/domains` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.012108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631c2e3-52da-48f1-a2a6-f3531596d86a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 21:57:36.012412 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631c2e3-52da-48f1-a2a6-f3531596d86a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:36.014024 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631c2e3-52da-48f1-a2a6-f3531596d86a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:36.025318 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4491/8966] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 21:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 21:57:36.029369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cd6fe-7b2d-4301-9664-e0fba8d3e107 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:36.038689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cd6fe-7b2d-4301-9664-e0fba8d3e107 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:36.043380 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48f605-ef60-4f71-a104-5ac870b51de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:36.043972 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f605-ef60-4f71-a104-5ac870b51de6 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.044254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f605-ef60-4f71-a104-5ac870b51de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.044525 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f605-ef60-4f71-a104-5ac870b51de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.045145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48f605-ef60-4f71-a104-5ac870b51de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:36.047042 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48f605-ef60-4f71-a104-5ac870b51de6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:36.083736 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4476/8967] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:57:36 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:57:36.087801 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631c2e3-52da-48f1-a2a6-f3531596d86a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:36.097763 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631c2e3-52da-48f1-a2a6-f3531596d86a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:36.153939 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee6aa-aea7-4713-bb1a-9cac536f8f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:36.154464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee6aa-aea7-4713-bb1a-9cac536f8f87 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.154759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee6aa-aea7-4713-bb1a-9cac536f8f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.155012 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee6aa-aea7-4713-bb1a-9cac536f8f87 admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.155644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee6aa-aea7-4713-bb1a-9cac536f8f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:36.157569 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee6aa-aea7-4713-bb1a-9cac536f8f87 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:36.175141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:36.180803 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4492/8968] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:57:36 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 21:57:36.184743 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48f605-ef60-4f71-a104-5ac870b51de6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:36.195241 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48f605-ef60-4f71-a104-5ac870b51de6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:36.199809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b47165-e4a7-4156-930f-6d72defe04f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:36.200448 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b47165-e4a7-4156-930f-6d72defe04f1 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.200729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b47165-e4a7-4156-930f-6d72defe04f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.200999 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b47165-e4a7-4156-930f-6d72defe04f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.201674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b47165-e4a7-4156-930f-6d72defe04f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:36.203242 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b47165-e4a7-4156-930f-6d72defe04f1 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:36.213081 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4477/8969] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:57:36.217065 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee6aa-aea7-4713-bb1a-9cac536f8f87 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:36.227903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee6aa-aea7-4713-bb1a-9cac536f8f87 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:36.232509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d14f0-087e-43d8-9246-fa505be163fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:36.233100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d14f0-087e-43d8-9246-fa505be163fd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.233430 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d14f0-087e-43d8-9246-fa505be163fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.233708 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d14f0-087e-43d8-9246-fa505be163fd admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.234345 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d14f0-087e-43d8-9246-fa505be163fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:36.235908 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d14f0-087e-43d8-9246-fa505be163fd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:36.247080 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4493/8970] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:57:36.251274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b47165-e4a7-4156-930f-6d72defe04f1 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:36.261240 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b47165-e4a7-4156-930f-6d72defe04f1 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:36.265730 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf81380-90a4-4c9a-95dc-d8e577d2fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:36.266365 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf81380-90a4-4c9a-95dc-d8e577d2fc37 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.266644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf81380-90a4-4c9a-95dc-d8e577d2fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.266916 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf81380-90a4-4c9a-95dc-d8e577d2fc37 admin admin] PATH_INFO: `/v3/projects/b4acd2b59f7943cbb555876b9df70bee/users/771e9bc89e9d459e9e1714de7c514f4f/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.269919 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:36.283976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf81380-90a4-4c9a-95dc-d8e577d2fc37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4acd2b59f7943cbb555876b9df70bee, user_id=771e9bc89e9d459e9e1714de7c514f4f, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:36.286627 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf81380-90a4-4c9a-95dc-d8e577d2fc37 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:36.299579 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4478/8971] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:57:36 2022] PUT /identity/v3/projects/b4acd2b59f7943cbb555876b9df70bee/users/771e9bc89e9d459e9e1714de7c514f4f/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 21:57:36.310572 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f208e-ffaf-431f-bace-abe843ec21f2 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.310862 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f208e-ffaf-431f-bace-abe843ec21f2 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.311142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f208e-ffaf-431f-bace-abe843ec21f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.339003 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4c3f208e-ffaf-431f-bace-abe843ec21f2 None None] MFA Rules not processed for user `771e9bc89e9d459e9e1714de7c514f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:57:36.340218 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4c3f208e-ffaf-431f-bace-abe843ec21f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:36.402723 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4494/8972] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:57:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:57:36.407265 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf81380-90a4-4c9a-95dc-d8e577d2fc37 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:36.469204 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf81380-90a4-4c9a-95dc-d8e577d2fc37 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:36.474451 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b4ef3-78b8-4bfd-8589-c3379dffad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:36.475060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4ef3-78b8-4bfd-8589-c3379dffad1b admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.475344 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4ef3-78b8-4bfd-8589-c3379dffad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.475621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4ef3-78b8-4bfd-8589-c3379dffad1b admin admin] PATH_INFO: `/v3/projects` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.476258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b4ef3-78b8-4bfd-8589-c3379dffad1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:36.478191 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b4ef3-78b8-4bfd-8589-c3379dffad1b admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:36.505555 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4479/8973] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 21:57:36 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:57:36.509591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f208e-ffaf-431f-bace-abe843ec21f2 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:36.520878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f208e-ffaf-431f-bace-abe843ec21f2 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:36.579073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440ebd4-4651-46e7-9335-58ed3a5d7e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:36.579675 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440ebd4-4651-46e7-9335-58ed3a5d7e3d admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.579955 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440ebd4-4651-46e7-9335-58ed3a5d7e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.580775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440ebd4-4651-46e7-9335-58ed3a5d7e3d admin admin] PATH_INFO: `/v3/users` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.581422 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440ebd4-4651-46e7-9335-58ed3a5d7e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:36.583367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440ebd4-4651-46e7-9335-58ed3a5d7e3d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:36.604579 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4495/8974] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 21:57:36 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 21:57:36.608429 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b4ef3-78b8-4bfd-8589-c3379dffad1b admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:36.619236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b4ef3-78b8-4bfd-8589-c3379dffad1b admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:36.624263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74780a-2dba-477f-8dcd-549795874751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:36.624872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74780a-2dba-477f-8dcd-549795874751 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.625153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74780a-2dba-477f-8dcd-549795874751 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.625473 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74780a-2dba-477f-8dcd-549795874751 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.626120 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74780a-2dba-477f-8dcd-549795874751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:36.628315 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74780a-2dba-477f-8dcd-549795874751 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:36.638993 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4480/8975] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:57:36.643115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440ebd4-4651-46e7-9335-58ed3a5d7e3d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:36.653247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440ebd4-4651-46e7-9335-58ed3a5d7e3d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:36.657885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a2c12-d0a2-4cdb-be1b-ccd476b18072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:36.658473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a2c12-d0a2-4cdb-be1b-ccd476b18072 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.658780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a2c12-d0a2-4cdb-be1b-ccd476b18072 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.659033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a2c12-d0a2-4cdb-be1b-ccd476b18072 admin admin] PATH_INFO: `/v3/projects/581ffd2c5bb34f3e875e6857a948585b/users/089b19977d644c64905c61d39254a0a3/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.675334 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a2c12-d0a2-4cdb-be1b-ccd476b18072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581ffd2c5bb34f3e875e6857a948585b, user_id=089b19977d644c64905c61d39254a0a3, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:36.678022 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a2c12-d0a2-4cdb-be1b-ccd476b18072 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:36.691513 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4496/8976] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:57:36 2022] PUT /identity/v3/projects/581ffd2c5bb34f3e875e6857a948585b/users/089b19977d644c64905c61d39254a0a3/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:57:36.695594 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74780a-2dba-477f-8dcd-549795874751 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:36.706362 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74780a-2dba-477f-8dcd-549795874751 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:36.763633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8a26e-362e-4a75-8d0d-754f12f13f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:36.764236 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8a26e-362e-4a75-8d0d-754f12f13f45 admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.764513 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8a26e-362e-4a75-8d0d-754f12f13f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.764820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8a26e-362e-4a75-8d0d-754f12f13f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.765521 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8a26e-362e-4a75-8d0d-754f12f13f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:36.766985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8a26e-362e-4a75-8d0d-754f12f13f45 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:36.777147 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4481/8977] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 21:57:36.781420 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a2c12-d0a2-4cdb-be1b-ccd476b18072 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:36.792068 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a2c12-d0a2-4cdb-be1b-ccd476b18072 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:36.796636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35375b-c3fb-43b8-a220-780e66a5ab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:36.797308 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35375b-c3fb-43b8-a220-780e66a5ab07 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.797586 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35375b-c3fb-43b8-a220-780e66a5ab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.797856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35375b-c3fb-43b8-a220-780e66a5ab07 admin admin] PATH_INFO: `/v3/projects/581ffd2c5bb34f3e875e6857a948585b/users/089b19977d644c64905c61d39254a0a3/roles/a409f81bd5744563a303a825783bed61` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.799823 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35375b-c3fb-43b8-a220-780e66a5ab07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581ffd2c5bb34f3e875e6857a948585b, user_id=089b19977d644c64905c61d39254a0a3, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:36.802469 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35375b-c3fb-43b8-a220-780e66a5ab07 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:36.812957 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4497/8978] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 21:57:36 2022] PUT /identity/v3/projects/581ffd2c5bb34f3e875e6857a948585b/users/089b19977d644c64905c61d39254a0a3/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 21:57:36.822775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfb48d-80ae-4d92-ae9b-13717cf4467b None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:36.823139 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfb48d-80ae-4d92-ae9b-13717cf4467b None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:36.823505 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfb48d-80ae-4d92-ae9b-13717cf4467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:36.852345 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-16dfb48d-80ae-4d92-ae9b-13717cf4467b None None] MFA Rules not processed for user `089b19977d644c64905c61d39254a0a3`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:57:36.853595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-16dfb48d-80ae-4d92-ae9b-13717cf4467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:36.896219 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:36.921783 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4482/8979] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:57:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:57:36.944729 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35375b-c3fb-43b8-a220-780e66a5ab07 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:36.946480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0c35375b-c3fb-43b8-a220-780e66a5ab07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:36.981130 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:37.021585 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35375b-c3fb-43b8-a220-780e66a5ab07 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:37.027478 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260ac23-11e4-4111-a6f4-ed3ee21c19ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:37.028082 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260ac23-11e4-4111-a6f4-ed3ee21c19ef service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:37.028367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260ac23-11e4-4111-a6f4-ed3ee21c19ef service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:37.028645 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260ac23-11e4-4111-a6f4-ed3ee21c19ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:37.083733 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260ac23-11e4-4111-a6f4-ed3ee21c19ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:37.085369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260ac23-11e4-4111-a6f4-ed3ee21c19ef service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:37.094205 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4498/8980] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:57:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:57:39.765973 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfb48d-80ae-4d92-ae9b-13717cf4467b None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:39.768093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-16dfb48d-80ae-4d92-ae9b-13717cf4467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:39.827133 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfb48d-80ae-4d92-ae9b-13717cf4467b None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:39.831488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7165c-4c55-44f0-a181-4e0659ef9b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:39.832090 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7165c-4c55-44f0-a181-4e0659ef9b06 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:39.832364 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7165c-4c55-44f0-a181-4e0659ef9b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:39.832633 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7165c-4c55-44f0-a181-4e0659ef9b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:39.842249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7165c-4c55-44f0-a181-4e0659ef9b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:39.843718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7165c-4c55-44f0-a181-4e0659ef9b06 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:39.854022 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4483/8981] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:57:39 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:57:42.744683 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c1019-1442-4a74-98ef-a6397118b834 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:42.745916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c1019-1442-4a74-98ef-a6397118b834 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:42.746473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c1019-1442-4a74-98ef-a6397118b834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:42.788704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-d63c1019-1442-4a74-98ef-a6397118b834 None None] MFA Rules not processed for user `771e9bc89e9d459e9e1714de7c514f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:57:42.793429 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d63c1019-1442-4a74-98ef-a6397118b834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:42.810620 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4499/8982] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:57:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:57:43.518933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7165c-4c55-44f0-a181-4e0659ef9b06 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:57:43.520526 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-12b7165c-4c55-44f0-a181-4e0659ef9b06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:43.603987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7165c-4c55-44f0-a181-4e0659ef9b06 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:57:43.608657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95111142-dff2-4763-af93-5e3e7afd87fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:57:43.609432 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95111142-dff2-4763-af93-5e3e7afd87fd service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:57:43.609718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95111142-dff2-4763-af93-5e3e7afd87fd service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:57:43.609994 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95111142-dff2-4763-af93-5e3e7afd87fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:57:43.612412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-95111142-dff2-4763-af93-5e3e7afd87fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:57:43.624607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95111142-dff2-4763-af93-5e3e7afd87fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:57:43.626232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95111142-dff2-4763-af93-5e3e7afd87fd service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:57:43.637527 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4484/8983] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:57:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:57:52.763053 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=45 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:53.633041 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=67 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:58:26.422100 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c1019-1442-4a74-98ef-a6397118b834 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:58:26.444473 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c1019-1442-4a74-98ef-a6397118b834 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:58:26.449531 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e9b4f-0cbd-4e2c-8895-113267cd337f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:58:26.450137 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e9b4f-0cbd-4e2c-8895-113267cd337f service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:58:26.450421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e9b4f-0cbd-4e2c-8895-113267cd337f service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:58:26.450702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e9b4f-0cbd-4e2c-8895-113267cd337f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:58:26.452510 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-357e9b4f-0cbd-4e2c-8895-113267cd337f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:58:26.484161 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e9b4f-0cbd-4e2c-8895-113267cd337f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:58:26.485805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e9b4f-0cbd-4e2c-8895-113267cd337f service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:58:26.495944 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4500/8984] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:58:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:58:28.746047 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95111142-dff2-4763-af93-5e3e7afd87fd service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:58:28.766132 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95111142-dff2-4763-af93-5e3e7afd87fd service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:58:28.771160 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986e502-27bc-4adf-8126-793a33bd5cbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:58:28.771758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986e502-27bc-4adf-8126-793a33bd5cbb service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:58:28.772037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986e502-27bc-4adf-8126-793a33bd5cbb service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:58:28.772314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986e502-27bc-4adf-8126-793a33bd5cbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:58:28.774059 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1986e502-27bc-4adf-8126-793a33bd5cbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:58:28.785262 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986e502-27bc-4adf-8126-793a33bd5cbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:58:28.786815 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986e502-27bc-4adf-8126-793a33bd5cbb service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:58:28.797207 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4485/8985] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:58:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:58:36.491611 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=19 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:58:38.793562 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=11 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:58:49.983010 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545b1fd-d256-4eff-a0dd-ad7f2816b01f None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:58:49.983596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545b1fd-d256-4eff-a0dd-ad7f2816b01f None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:58:49.983596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545b1fd-d256-4eff-a0dd-ad7f2816b01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:58:50.020562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-c545b1fd-d256-4eff-a0dd-ad7f2816b01f None None] MFA Rules not processed for user `771e9bc89e9d459e9e1714de7c514f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 21:58:50.022078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c545b1fd-d256-4eff-a0dd-ad7f2816b01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:58:50.030898 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4501/8986] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 21:58:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 21:58:50.388642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986e502-27bc-4adf-8126-793a33bd5cbb service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 21:58:50.390148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1986e502-27bc-4adf-8126-793a33bd5cbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:58:50.423660 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986e502-27bc-4adf-8126-793a33bd5cbb service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 21:58:50.427353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb73897-f3bf-432d-85fd-8b2e91a89dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 21:58:50.428011 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb73897-f3bf-432d-85fd-8b2e91a89dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 21:58:50.428363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb73897-f3bf-432d-85fd-8b2e91a89dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 21:58:50.428641 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb73897-f3bf-432d-85fd-8b2e91a89dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 21:58:50.430582 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ceb73897-f3bf-432d-85fd-8b2e91a89dd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 21:58:50.441303 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb73897-f3bf-432d-85fd-8b2e91a89dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 21:58:50.442946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb73897-f3bf-432d-85fd-8b2e91a89dd2 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 21:58:50.452524 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4486/8987] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 21:58:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 21:59:00.006219 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:59:00.448587 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=11 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:00:27.952325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c95d1-3b53-41b9-a1bc-76b5409ad225 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:00:27.952876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c95d1-3b53-41b9-a1bc-76b5409ad225 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:00:27.952876 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c95d1-3b53-41b9-a1bc-76b5409ad225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:00:27.972590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-e55c95d1-3b53-41b9-a1bc-76b5409ad225 None None] MFA Rules not processed for user `771e9bc89e9d459e9e1714de7c514f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:00:27.973841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e55c95d1-3b53-41b9-a1bc-76b5409ad225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:00:27.984075 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4502/8988] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:00:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:00:28.020661 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb73897-f3bf-432d-85fd-8b2e91a89dd2 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:00:28.022651 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-ceb73897-f3bf-432d-85fd-8b2e91a89dd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:00:28.088192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb73897-f3bf-432d-85fd-8b2e91a89dd2 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:00:28.092037 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36b39-5361-47c6-92c9-f10ee11f4c20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:00:28.092597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36b39-5361-47c6-92c9-f10ee11f4c20 service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:00:28.092902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36b39-5361-47c6-92c9-f10ee11f4c20 service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:00:28.093381 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36b39-5361-47c6-92c9-f10ee11f4c20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:00:28.095175 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-32c36b39-5361-47c6-92c9-f10ee11f4c20 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:00:28.120550 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c36b39-5361-47c6-92c9-f10ee11f4c20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:00:28.121995 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c36b39-5361-47c6-92c9-f10ee11f4c20 service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:00:28.134419 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4487/8989] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:00:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:00:31.067964 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c95d1-3b53-41b9-a1bc-76b5409ad225 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:00:31.083435 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c95d1-3b53-41b9-a1bc-76b5409ad225 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:00:31.092238 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244712f8-6ec2-488c-bc1e-0e57cd61983c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:00:31.093108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244712f8-6ec2-488c-bc1e-0e57cd61983c service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:00:31.093863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244712f8-6ec2-488c-bc1e-0e57cd61983c service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:00:31.094318 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244712f8-6ec2-488c-bc1e-0e57cd61983c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:00:31.096431 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-244712f8-6ec2-488c-bc1e-0e57cd61983c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:00:31.116916 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244712f8-6ec2-488c-bc1e-0e57cd61983c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:00:31.118418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244712f8-6ec2-488c-bc1e-0e57cd61983c service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:00:31.135137 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4503/8990] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:00:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:00:31.391361 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36b39-5361-47c6-92c9-f10ee11f4c20 service glance] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:00:31.405490 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36b39-5361-47c6-92c9-f10ee11f4c20 service glance] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:00:31.409609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe44a-6431-433e-a75b-fb9e1442a231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:00:31.411514 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe44a-6431-433e-a75b-fb9e1442a231 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:00:31.412004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe44a-6431-433e-a75b-fb9e1442a231 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:00:31.414100 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe44a-6431-433e-a75b-fb9e1442a231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:00:31.417134 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-a7fbe44a-6431-433e-a75b-fb9e1442a231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:00:31.448674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbe44a-6431-433e-a75b-fb9e1442a231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:00:31.450243 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbe44a-6431-433e-a75b-fb9e1442a231 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:00:31.467137 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4488/8991] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:00:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 22:00:32.143872 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244712f8-6ec2-488c-bc1e-0e57cd61983c service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:00:32.155691 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244712f8-6ec2-488c-bc1e-0e57cd61983c service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:00:32.163123 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec9fbd-4f8d-45c1-b750-bd4ad5b39d27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:00:32.163764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec9fbd-4f8d-45c1-b750-bd4ad5b39d27 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:00:32.164066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec9fbd-4f8d-45c1-b750-bd4ad5b39d27 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:00:32.164352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec9fbd-4f8d-45c1-b750-bd4ad5b39d27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:00:32.166181 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bfec9fbd-4f8d-45c1-b750-bd4ad5b39d27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:00:32.179591 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec9fbd-4f8d-45c1-b750-bd4ad5b39d27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:00:32.181211 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec9fbd-4f8d-45c1-b750-bd4ad5b39d27 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:00:32.193080 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4504/8992] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:00:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:00:41.455689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=35 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:00:42.188328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=15 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:01:17.564124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe44a-6431-433e-a75b-fb9e1442a231 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:01:17.574077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe44a-6431-433e-a75b-fb9e1442a231 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:01:17.578217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015410b5-5696-4bcb-8d3c-31b80f28a1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:01:17.578820 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015410b5-5696-4bcb-8d3c-31b80f28a1ac service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:01:17.579101 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015410b5-5696-4bcb-8d3c-31b80f28a1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:01:17.579375 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015410b5-5696-4bcb-8d3c-31b80f28a1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:01:17.581113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-015410b5-5696-4bcb-8d3c-31b80f28a1ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:01:17.591085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015410b5-5696-4bcb-8d3c-31b80f28a1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:01:17.592484 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015410b5-5696-4bcb-8d3c-31b80f28a1ac service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:01:17.600489 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4489/8993] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:01:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:01:17.735215 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baf067-b841-44c1-9658-24af58e40bc0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:01:17.735830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baf067-b841-44c1-9658-24af58e40bc0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:01:17.735830 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baf067-b841-44c1-9658-24af58e40bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:01:17.790284 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-69baf067-b841-44c1-9658-24af58e40bc0 None None] MFA Rules not processed for user `32932449fed540ac9073f056065899bd`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:01:17.792147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-69baf067-b841-44c1-9658-24af58e40bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:01:17.799241 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4505/8994] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 22:01:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 22:01:17.810565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015410b5-5696-4bcb-8d3c-31b80f28a1ac service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:01:17.820040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015410b5-5696-4bcb-8d3c-31b80f28a1ac service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:01:17.823975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337493d-701b-45f5-b905-8c77b162d5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:01:17.824681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337493d-701b-45f5-b905-8c77b162d5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:01:17.825027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337493d-701b-45f5-b905-8c77b162d5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:01:17.825413 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337493d-701b-45f5-b905-8c77b162d5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:01:17.834274 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337493d-701b-45f5-b905-8c77b162d5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:01:17.836076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337493d-701b-45f5-b905-8c77b162d5e4 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:01:17.846186 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4490/8995] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:01:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:01:17.937396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baf067-b841-44c1-9658-24af58e40bc0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:01:17.938805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-69baf067-b841-44c1-9658-24af58e40bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:01:17.954671 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baf067-b841-44c1-9658-24af58e40bc0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:01:17.959573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c2676-548a-49e7-9180-4507908c3fef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:01:17.960180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c2676-548a-49e7-9180-4507908c3fef service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:01:17.960475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c2676-548a-49e7-9180-4507908c3fef service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:01:17.960752 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c2676-548a-49e7-9180-4507908c3fef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:01:17.963172 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fa0c2676-548a-49e7-9180-4507908c3fef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:01:17.975341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c2676-548a-49e7-9180-4507908c3fef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:01:17.976931 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c2676-548a-49e7-9180-4507908c3fef service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:01:17.987953 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4506/8996] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:01:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:01:18.186305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcbd54-f47b-44a1-85a1-114a40b055bc None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:01:18.186824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcbd54-f47b-44a1-85a1-114a40b055bc None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:01:18.187117 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcbd54-f47b-44a1-85a1-114a40b055bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:01:18.230180 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-4abcbd54-f47b-44a1-85a1-114a40b055bc None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:01:18.231426 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-4abcbd54-f47b-44a1-85a1-114a40b055bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:01:18.241427 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4491/8997] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 22:01:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:01:18.252397 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c2676-548a-49e7-9180-4507908c3fef service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:01:18.264602 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c2676-548a-49e7-9180-4507908c3fef service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:01:18.268461 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4672f-4099-43b9-82ac-5b42836817e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:01:18.269128 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4672f-4099-43b9-82ac-5b42836817e4 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:01:18.269454 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4672f-4099-43b9-82ac-5b42836817e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:01:18.269727 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4672f-4099-43b9-82ac-5b42836817e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:01:18.280124 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4672f-4099-43b9-82ac-5b42836817e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:01:18.281592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4672f-4099-43b9-82ac-5b42836817e4 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:01:18.292314 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4507/8998] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:01:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:01:18.352192 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcbd54-f47b-44a1-85a1-114a40b055bc None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:01:18.363433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcbd54-f47b-44a1-85a1-114a40b055bc None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:01:18.368447 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5c8c8-09f6-4262-b518-18407733ee1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:01:18.369736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5c8c8-09f6-4262-b518-18407733ee1b service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:01:18.370026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5c8c8-09f6-4262-b518-18407733ee1b service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:01:18.370299 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5c8c8-09f6-4262-b518-18407733ee1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:01:18.372017 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cbd5c8c8-09f6-4262-b518-18407733ee1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:01:18.383357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5c8c8-09f6-4262-b518-18407733ee1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:01:18.385540 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5c8c8-09f6-4262-b518-18407733ee1b service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:01:18.395216 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4492/8999] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:01:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:01:28.287626 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=25 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:01:28.391145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=27 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:01:37.001991 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4672f-4099-43b9-82ac-5b42836817e4 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:01:37.010501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4672f-4099-43b9-82ac-5b42836817e4 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:01:37.014704 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c403d6d-9e37-46e5-8648-542184be303f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:01:37.015297 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c403d6d-9e37-46e5-8648-542184be303f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:01:37.015577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c403d6d-9e37-46e5-8648-542184be303f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:01:37.015851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c403d6d-9e37-46e5-8648-542184be303f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:01:37.017609 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2c403d6d-9e37-46e5-8648-542184be303f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:01:37.027393 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c403d6d-9e37-46e5-8648-542184be303f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:01:37.028859 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c403d6d-9e37-46e5-8648-542184be303f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:01:37.036600 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4508/9000] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:01:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:01:43.275195 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5c8c8-09f6-4262-b518-18407733ee1b service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:01:43.287765 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5c8c8-09f6-4262-b518-18407733ee1b service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:01:43.293216 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224f3ee-e473-4106-ba6b-ff2eeb033d22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:01:43.294332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f3ee-e473-4106-ba6b-ff2eeb033d22 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:01:43.294610 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f3ee-e473-4106-ba6b-ff2eeb033d22 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:01:43.294906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f3ee-e473-4106-ba6b-ff2eeb033d22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:01:43.296609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1224f3ee-e473-4106-ba6b-ff2eeb033d22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:01:43.308691 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224f3ee-e473-4106-ba6b-ff2eeb033d22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:01:43.310845 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224f3ee-e473-4106-ba6b-ff2eeb033d22 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:01:43.323890 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4493/9001] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:01:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:01:47.033346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:01:53.317837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:17.591592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeee815-622f-499d-92a9-224c6d615aee None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:02:17.592173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeee815-622f-499d-92a9-224c6d615aee None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:02:17.592173 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeee815-622f-499d-92a9-224c6d615aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:02:17.612513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-0aeee815-622f-499d-92a9-224c6d615aee None None] MFA Rules not processed for user `2dc47f2448a042fca1a986695a350c94`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:02:17.613829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-0aeee815-622f-499d-92a9-224c6d615aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:02:17.622454 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4509/9002] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 22:02:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:02:17.648541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224f3ee-e473-4106-ba6b-ff2eeb033d22 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:02:17.664074 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224f3ee-e473-4106-ba6b-ff2eeb033d22 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:02:17.669228 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056f245-472c-490a-a122-a55635dd0ef5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:02:17.673317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056f245-472c-490a-a122-a55635dd0ef5 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:02:17.673861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056f245-472c-490a-a122-a55635dd0ef5 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:02:17.674211 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056f245-472c-490a-a122-a55635dd0ef5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:02:17.684030 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056f245-472c-490a-a122-a55635dd0ef5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:02:17.685894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056f245-472c-490a-a122-a55635dd0ef5 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:02:17.698039 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4494/9003] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:02:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:02:23.566220 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9538c6-7f0c-4718-b17d-56007ad37087 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:02:23.566795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9538c6-7f0c-4718-b17d-56007ad37087 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:02:23.566795 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9538c6-7f0c-4718-b17d-56007ad37087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:02:23.588261 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-3c9538c6-7f0c-4718-b17d-56007ad37087 None None] MFA Rules not processed for user `771e9bc89e9d459e9e1714de7c514f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:02:23.589560 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3c9538c6-7f0c-4718-b17d-56007ad37087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:02:23.597078 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4510/9004] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:02:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:02:27.698190 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:33.583051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:37.153573 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056f245-472c-490a-a122-a55635dd0ef5 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:02:37.155221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7056f245-472c-490a-a122-a55635dd0ef5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:02:37.160295 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9538c6-7f0c-4718-b17d-56007ad37087 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:02:37.174242 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9538c6-7f0c-4718-b17d-56007ad37087 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:02:37.176622 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056f245-472c-490a-a122-a55635dd0ef5 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:02:37.180423 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769de45-b817-4299-8de7-6bbc9696ea18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:02:37.181029 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769de45-b817-4299-8de7-6bbc9696ea18 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:02:37.181346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769de45-b817-4299-8de7-6bbc9696ea18 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:02:37.181622 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769de45-b817-4299-8de7-6bbc9696ea18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:02:37.183020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bca58-bb47-4697-b2e6-ab6160e0f8d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:02:37.183343 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7769de45-b817-4299-8de7-6bbc9696ea18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:02:37.183626 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bca58-bb47-4697-b2e6-ab6160e0f8d9 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:02:37.183906 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bca58-bb47-4697-b2e6-ab6160e0f8d9 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:02:37.184318 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bca58-bb47-4697-b2e6-ab6160e0f8d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:02:37.193780 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bca58-bb47-4697-b2e6-ab6160e0f8d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:02:37.196141 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bca58-bb47-4697-b2e6-ab6160e0f8d9 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:02:37.196456 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769de45-b817-4299-8de7-6bbc9696ea18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:02:37.198071 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769de45-b817-4299-8de7-6bbc9696ea18 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:02:37.206540 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4495/9005] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:02:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:02:37.220556 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4511/9006] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:02:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:02:47.201321 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:47.205690 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:03:30.428070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bca58-bb47-4697-b2e6-ab6160e0f8d9 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:03:30.439341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bca58-bb47-4697-b2e6-ab6160e0f8d9 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:03:30.444891 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9d51-a4d7-4113-9ebb-e41627b116ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:03:30.445515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9d51-a4d7-4113-9ebb-e41627b116ac service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:03:30.445793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9d51-a4d7-4113-9ebb-e41627b116ac service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:03:30.446061 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9d51-a4d7-4113-9ebb-e41627b116ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:03:30.454194 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb9d51-a4d7-4113-9ebb-e41627b116ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:03:30.455759 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb9d51-a4d7-4113-9ebb-e41627b116ac service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:03:30.465350 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4496/9007] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:03:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:03:32.758457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769de45-b817-4299-8de7-6bbc9696ea18 service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:03:32.770374 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769de45-b817-4299-8de7-6bbc9696ea18 service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:03:32.775321 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e59dc-4bef-4814-b059-0cd3f618faa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:03:32.775915 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e59dc-4bef-4814-b059-0cd3f618faa6 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:03:32.776196 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e59dc-4bef-4814-b059-0cd3f618faa6 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:03:32.776508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e59dc-4bef-4814-b059-0cd3f618faa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:03:32.785476 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e59dc-4bef-4814-b059-0cd3f618faa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:03:32.787044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e59dc-4bef-4814-b059-0cd3f618faa6 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:03:32.796743 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4512/9008] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:03:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:03:40.461322 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:03:42.792762 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:04:09.151016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9d51-a4d7-4113-9ebb-e41627b116ac service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:04:09.160674 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9d51-a4d7-4113-9ebb-e41627b116ac service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:04:09.165052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe467dc-6451-4a6b-bbe6-9e46a91d1384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:04:09.165740 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe467dc-6451-4a6b-bbe6-9e46a91d1384 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:04:09.166022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe467dc-6451-4a6b-bbe6-9e46a91d1384 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:04:09.166298 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe467dc-6451-4a6b-bbe6-9e46a91d1384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:04:09.175403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe467dc-6451-4a6b-bbe6-9e46a91d1384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:04:09.177482 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe467dc-6451-4a6b-bbe6-9e46a91d1384 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:04:09.187620 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4497/9009] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:04:09 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:04:12.234477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7025-d854-4581-b030-6ffd7f48ec93 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:04:12.235044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7025-d854-4581-b030-6ffd7f48ec93 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:04:12.235154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7025-d854-4581-b030-6ffd7f48ec93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:04:12.259009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-dd7a7025-d854-4581-b030-6ffd7f48ec93 None None] MFA Rules not processed for user `771e9bc89e9d459e9e1714de7c514f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:04:12.260438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dd7a7025-d854-4581-b030-6ffd7f48ec93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:04:12.267767 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4513/9010] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:04:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:04:19.182802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:04:22.252688 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:13.378016 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe467dc-6451-4a6b-bbe6-9e46a91d1384 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:13.444671 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe467dc-6451-4a6b-bbe6-9e46a91d1384 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:13.449503 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:13.450170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:13.450453 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:13.450729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] PATH_INFO: `/v3/users/771e9bc89e9d459e9e1714de7c514f4f` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:13.451884 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] RBAC: Authorizing `identity:delete_user(user_id=771e9bc89e9d459e9e1714de7c514f4f)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:13.454123 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:13.510862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771e9bc89e9d459e9e1714de7c514f4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:13.517809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771e9bc89e9d459e9e1714de7c514f4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:13.518478 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771e9bc89e9d459e9e1714de7c514f4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:13.519092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771e9bc89e9d459e9e1714de7c514f4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:13.530846 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771e9bc89e9d459e9e1714de7c514f4f'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:13.544023 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4498/9011] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 22:05:13 2022] DELETE /identity/v3/users/771e9bc89e9d459e9e1714de7c514f4f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:05:13.549674 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492094b-b508-4049-973a-afef72a948d0 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:13.550204 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492094b-b508-4049-973a-afef72a948d0 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:13.550322 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492094b-b508-4049-973a-afef72a948d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:13.569563 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-f492094b-b508-4049-973a-afef72a948d0 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:05:13.570695 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f492094b-b508-4049-973a-afef72a948d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:13.627976 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4514/9012] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 22:05:13.637685 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:13.639057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:13.697206 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ed311-7225-4c57-9869-f9cc3115910e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:13.700784 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e1db3-0d40-409a-9046-9654d86ce3a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:13.701416 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e1db3-0d40-409a-9046-9654d86ce3a1 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:13.701698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e1db3-0d40-409a-9046-9654d86ce3a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:13.701969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e1db3-0d40-409a-9046-9654d86ce3a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:13.711357 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e1db3-0d40-409a-9046-9654d86ce3a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:13.712767 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e1db3-0d40-409a-9046-9654d86ce3a1 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:13.722795 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4499/9013] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:05:13.894245 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492094b-b508-4049-973a-afef72a948d0 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:13.896073 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f492094b-b508-4049-973a-afef72a948d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:13.913741 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492094b-b508-4049-973a-afef72a948d0 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:13.919281 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:13.919917 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:13.920221 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:13.920492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] PATH_INFO: `/v3/projects/b4acd2b59f7943cbb555876b9df70bee` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:13.921814 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4acd2b59f7943cbb555876b9df70bee)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:13.923794 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:13.971044 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4acd2b59f7943cbb555876b9df70bee', 'request_id': 'req-bbf58765-8fab-45f2-a91c-730a21a76546'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:13.978663 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4acd2b59f7943cbb555876b9df70bee', 'request_id': 'req-bbf58765-8fab-45f2-a91c-730a21a76546'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:13.984244 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4acd2b59f7943cbb555876b9df70bee', 'request_id': 'req-bbf58765-8fab-45f2-a91c-730a21a76546'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:13.995224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] The token cache is being invalidate because project b4acd2b59f7943cbb555876b9df70bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 22:05:13.995509 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:13.996129 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:13.997635 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4515/9014] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 22:05:13 2022] DELETE /identity/v3/projects/b4acd2b59f7943cbb555876b9df70bee => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:05:14.001917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e1db3-0d40-409a-9046-9654d86ce3a1 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:14.011474 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e1db3-0d40-409a-9046-9654d86ce3a1 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:14.029663 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:14.070589 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675f105-7ed5-40ec-9e94-c20e1cc161f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:14.071312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675f105-7ed5-40ec-9e94-c20e1cc161f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:14.071703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675f105-7ed5-40ec-9e94-c20e1cc161f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:14.071982 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675f105-7ed5-40ec-9e94-c20e1cc161f8 admin admin] PATH_INFO: `/v3/users/089b19977d644c64905c61d39254a0a3` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:14.073124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675f105-7ed5-40ec-9e94-c20e1cc161f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=089b19977d644c64905c61d39254a0a3)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:14.075172 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675f105-7ed5-40ec-9e94-c20e1cc161f8 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:14.122270 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c675f105-7ed5-40ec-9e94-c20e1cc161f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089b19977d644c64905c61d39254a0a3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:14.130214 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c675f105-7ed5-40ec-9e94-c20e1cc161f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089b19977d644c64905c61d39254a0a3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:14.131036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c675f105-7ed5-40ec-9e94-c20e1cc161f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089b19977d644c64905c61d39254a0a3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:14.131738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c675f105-7ed5-40ec-9e94-c20e1cc161f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089b19977d644c64905c61d39254a0a3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:14.145606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-c675f105-7ed5-40ec-9e94-c20e1cc161f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089b19977d644c64905c61d39254a0a3'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:14.157818 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4500/9015] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 22:05:14 2022] DELETE /identity/v3/users/089b19977d644c64905c61d39254a0a3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:05:14.425154 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:14.426746 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:14.441009 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf58765-8fab-45f2-a91c-730a21a76546 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:14.505878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:14.506513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:14.506789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:14.507062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6 admin admin] PATH_INFO: `/v3/projects/581ffd2c5bb34f3e875e6857a948585b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:14.508170 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581ffd2c5bb34f3e875e6857a948585b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:14.510098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:14.540052 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:14.561492 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581ffd2c5bb34f3e875e6857a948585b', 'request_id': 'req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:14.569369 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581ffd2c5bb34f3e875e6857a948585b', 'request_id': 'req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:14.575072 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581ffd2c5bb34f3e875e6857a948585b', 'request_id': 'req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:14.586192 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6 admin admin] The token cache is being invalidate because project 581ffd2c5bb34f3e875e6857a948585b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 22:05:14.586474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:14.587103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-87c4d597-e33e-4bf8-9e9e-4d83112aa5f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:05:14.588566 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4516/9016] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 22:05:14 2022] DELETE /identity/v3/projects/581ffd2c5bb34f3e875e6857a948585b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:05:14.593934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9fa58-2665-43a6-86bc-f055186ad384 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:14.594422 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9fa58-2665-43a6-86bc-f055186ad384 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:14.594537 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9fa58-2665-43a6-86bc-f055186ad384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:14.614071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-47c9fa58-2665-43a6-86bc-f055186ad384 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:05:14.615258 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-47c9fa58-2665-43a6-86bc-f055186ad384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:14.672415 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4501/9017] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:05:14.680164 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5305af-18c1-4c37-a0ae-0307fd2c69b6 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:14.680451 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5305af-18c1-4c37-a0ae-0307fd2c69b6 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:14.680756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5305af-18c1-4c37-a0ae-0307fd2c69b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:14.701235 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ea5305af-18c1-4c37-a0ae-0307fd2c69b6 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:05:14.702428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ea5305af-18c1-4c37-a0ae-0307fd2c69b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:14.710220 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4517/9018] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:05:14.714320 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9fa58-2665-43a6-86bc-f055186ad384 None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:14.724338 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9fa58-2665-43a6-86bc-f055186ad384 None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:14.728917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e15d7-e127-4e50-8f16-c7e0c75095ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:14.729553 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e15d7-e127-4e50-8f16-c7e0c75095ee admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:14.729829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e15d7-e127-4e50-8f16-c7e0c75095ee admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:14.730097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e15d7-e127-4e50-8f16-c7e0c75095ee admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:14.730733 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e15d7-e127-4e50-8f16-c7e0c75095ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 22:05:14.731031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e15d7-e127-4e50-8f16-c7e0c75095ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:14.732606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e15d7-e127-4e50-8f16-c7e0c75095ee admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:14.744633 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4502/9019] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 22:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 22:05:14.748850 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5305af-18c1-4c37-a0ae-0307fd2c69b6 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:14.758851 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5305af-18c1-4c37-a0ae-0307fd2c69b6 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:14.763463 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec27f7a-2bb0-4d60-b2e8-99cd122fd632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:14.764050 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec27f7a-2bb0-4d60-b2e8-99cd122fd632 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:14.764357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec27f7a-2bb0-4d60-b2e8-99cd122fd632 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:14.764627 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec27f7a-2bb0-4d60-b2e8-99cd122fd632 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:14.765282 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec27f7a-2bb0-4d60-b2e8-99cd122fd632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:14.767231 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec27f7a-2bb0-4d60-b2e8-99cd122fd632 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:14.793967 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4518/9020] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 22:05:14 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 22:05:14.798739 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e15d7-e127-4e50-8f16-c7e0c75095ee admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:14.809509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e15d7-e127-4e50-8f16-c7e0c75095ee admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:14.835308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:14.869836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a946279-3305-4761-9075-44e07f71d28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:14.870446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a946279-3305-4761-9075-44e07f71d28d admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:14.870725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a946279-3305-4761-9075-44e07f71d28d admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:14.871018 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a946279-3305-4761-9075-44e07f71d28d admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:14.871652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a946279-3305-4761-9075-44e07f71d28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:14.873632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a946279-3305-4761-9075-44e07f71d28d admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:14.894352 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4503/9021] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 22:05:14 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 22:05:14.898719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec27f7a-2bb0-4d60-b2e8-99cd122fd632 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:14.909470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec27f7a-2bb0-4d60-b2e8-99cd122fd632 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:14.914039 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553a70a-3c90-4a15-9736-35a1b3709f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:14.914628 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553a70a-3c90-4a15-9736-35a1b3709f35 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:14.914910 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553a70a-3c90-4a15-9736-35a1b3709f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:14.915177 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553a70a-3c90-4a15-9736-35a1b3709f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:14.915806 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553a70a-3c90-4a15-9736-35a1b3709f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:14.917418 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553a70a-3c90-4a15-9736-35a1b3709f35 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:14.927907 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4519/9022] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 22:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 22:05:14.931741 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a946279-3305-4761-9075-44e07f71d28d admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:14.942022 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a946279-3305-4761-9075-44e07f71d28d admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:14.946629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9d7be-175c-48a2-9a68-0bb564d8de5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:14.947218 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d7be-175c-48a2-9a68-0bb564d8de5c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:14.947493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d7be-175c-48a2-9a68-0bb564d8de5c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:14.947760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d7be-175c-48a2-9a68-0bb564d8de5c admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:14.948383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9d7be-175c-48a2-9a68-0bb564d8de5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:14.950013 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9d7be-175c-48a2-9a68-0bb564d8de5c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:14.960664 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4504/9023] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 22:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 22:05:14.964687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553a70a-3c90-4a15-9736-35a1b3709f35 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:14.975548 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553a70a-3c90-4a15-9736-35a1b3709f35 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:14.980186 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ef69-93fe-415f-91f1-733484497ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:14.980869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ef69-93fe-415f-91f1-733484497ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:14.981145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ef69-93fe-415f-91f1-733484497ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:14.981450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ef69-93fe-415f-91f1-733484497ea2 admin admin] PATH_INFO: `/v3/projects/b9c33d4041764691b1ad69f9f1abe60b/users/199e2426220e4cc4b1d37d4075e67cbc/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:14.996303 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ef69-93fe-415f-91f1-733484497ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c33d4041764691b1ad69f9f1abe60b, user_id=199e2426220e4cc4b1d37d4075e67cbc, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:14.998970 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ef69-93fe-415f-91f1-733484497ea2 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:15.011625 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4520/9024] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 22:05:14 2022] PUT /identity/v3/projects/b9c33d4041764691b1ad69f9f1abe60b/users/199e2426220e4cc4b1d37d4075e67cbc/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:05:15.016868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2d0be-ec6a-4187-909e-767a83462806 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:15.017155 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2d0be-ec6a-4187-909e-767a83462806 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:15.017452 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2d0be-ec6a-4187-909e-767a83462806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:15.036377 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-d6f2d0be-ec6a-4187-909e-767a83462806 None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:05:15.037599 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d6f2d0be-ec6a-4187-909e-767a83462806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:15.095031 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4505/9025] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:05:15.104787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ef69-93fe-415f-91f1-733484497ea2 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:15.106470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-e0a7ef69-93fe-415f-91f1-733484497ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:15.163264 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ef69-93fe-415f-91f1-733484497ea2 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:15.167032 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b3c7e-d73e-4228-a100-14f9d60aa1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:15.167636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b3c7e-d73e-4228-a100-14f9d60aa1da service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:15.167920 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b3c7e-d73e-4228-a100-14f9d60aa1da service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:15.168198 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b3c7e-d73e-4228-a100-14f9d60aa1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:15.178020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b3c7e-d73e-4228-a100-14f9d60aa1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:15.179385 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b3c7e-d73e-4228-a100-14f9d60aa1da service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:15.189073 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4521/9026] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:05:19.221827 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94cb05-5880-44e6-811f-f525f6b3f39d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:19.222374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94cb05-5880-44e6-811f-f525f6b3f39d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:19.222374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94cb05-5880-44e6-811f-f525f6b3f39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:19.258577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-1d94cb05-5880-44e6-811f-f525f6b3f39d None None] MFA Rules not processed for user `199e2426220e4cc4b1d37d4075e67cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:05:19.259946 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1d94cb05-5880-44e6-811f-f525f6b3f39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:19.357409 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4506/9027] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:05:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:05:19.361457 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b3c7e-d73e-4228-a100-14f9d60aa1da service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:19.371319 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b3c7e-d73e-4228-a100-14f9d60aa1da service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:19.375936 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9222e-8d77-40f5-83c5-f46386d7168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:19.376526 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9222e-8d77-40f5-83c5-f46386d7168b admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:19.376805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9222e-8d77-40f5-83c5-f46386d7168b admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:19.377076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9222e-8d77-40f5-83c5-f46386d7168b admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:19.377726 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9222e-8d77-40f5-83c5-f46386d7168b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:19.379618 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9222e-8d77-40f5-83c5-f46386d7168b admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:19.409905 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4522/9028] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 22:05:19 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 22:05:19.414071 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94cb05-5880-44e6-811f-f525f6b3f39d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:19.426558 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94cb05-5880-44e6-811f-f525f6b3f39d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:19.461563 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:19.494731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658026b-f349-4a85-bef6-bbc8d18e3435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:19.495360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658026b-f349-4a85-bef6-bbc8d18e3435 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:19.495649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658026b-f349-4a85-bef6-bbc8d18e3435 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:19.495925 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658026b-f349-4a85-bef6-bbc8d18e3435 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:19.496577 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658026b-f349-4a85-bef6-bbc8d18e3435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:19.498597 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658026b-f349-4a85-bef6-bbc8d18e3435 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:19.521928 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4507/9029] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 22:05:19 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 22:05:19.525973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9222e-8d77-40f5-83c5-f46386d7168b admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:19.537113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9222e-8d77-40f5-83c5-f46386d7168b admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:19.541941 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68bb87-c261-4cb5-9693-b33bc91874be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:19.542568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68bb87-c261-4cb5-9693-b33bc91874be admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:19.542838 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68bb87-c261-4cb5-9693-b33bc91874be admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:19.543115 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68bb87-c261-4cb5-9693-b33bc91874be admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:19.543760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68bb87-c261-4cb5-9693-b33bc91874be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:19.545474 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68bb87-c261-4cb5-9693-b33bc91874be admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:19.557718 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4523/9030] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 22:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 22:05:19.562684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658026b-f349-4a85-bef6-bbc8d18e3435 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:19.573965 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658026b-f349-4a85-bef6-bbc8d18e3435 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:19.579383 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234f94c-a226-40d1-916f-8642c99b590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:19.580056 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234f94c-a226-40d1-916f-8642c99b590f admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:19.580340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234f94c-a226-40d1-916f-8642c99b590f admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:19.580619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234f94c-a226-40d1-916f-8642c99b590f admin admin] PATH_INFO: `/v3/projects/20bf9fee84f84780a5f661a36c6323a6/users/4da7c595cf3643b2965e2a35d54f49c8/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:19.597021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234f94c-a226-40d1-916f-8642c99b590f admin admin] RBAC: Authorizing `identity:create_grant(project_id=20bf9fee84f84780a5f661a36c6323a6, user_id=4da7c595cf3643b2965e2a35d54f49c8, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:19.599721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234f94c-a226-40d1-916f-8642c99b590f admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:19.614657 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4508/9031] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 22:05:19 2022] PUT /identity/v3/projects/20bf9fee84f84780a5f661a36c6323a6/users/4da7c595cf3643b2965e2a35d54f49c8/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:05:19.618640 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68bb87-c261-4cb5-9693-b33bc91874be admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:19.629443 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68bb87-c261-4cb5-9693-b33bc91874be admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:19.647067 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:19.691907 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26e352-3770-45d2-b6e1-5f12b2787882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:19.692541 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26e352-3770-45d2-b6e1-5f12b2787882 admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:19.692829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26e352-3770-45d2-b6e1-5f12b2787882 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:19.693103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26e352-3770-45d2-b6e1-5f12b2787882 admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:19.693770 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26e352-3770-45d2-b6e1-5f12b2787882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:19.695377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26e352-3770-45d2-b6e1-5f12b2787882 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:19.709905 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4524/9032] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 22:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 22:05:19.711515 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234f94c-a226-40d1-916f-8642c99b590f admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:19.722744 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234f94c-a226-40d1-916f-8642c99b590f admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:19.728639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447a8f1-6b84-4e2d-acf0-6a62420e5065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:19.729250 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a8f1-6b84-4e2d-acf0-6a62420e5065 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:19.729535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a8f1-6b84-4e2d-acf0-6a62420e5065 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:19.729808 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a8f1-6b84-4e2d-acf0-6a62420e5065 admin admin] PATH_INFO: `/v3/projects/20bf9fee84f84780a5f661a36c6323a6/users/4da7c595cf3643b2965e2a35d54f49c8/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:19.731797 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447a8f1-6b84-4e2d-acf0-6a62420e5065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20bf9fee84f84780a5f661a36c6323a6, user_id=4da7c595cf3643b2965e2a35d54f49c8, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:19.735326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447a8f1-6b84-4e2d-acf0-6a62420e5065 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:19.746905 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4509/9033] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 22:05:19 2022] PUT /identity/v3/projects/20bf9fee84f84780a5f661a36c6323a6/users/4da7c595cf3643b2965e2a35d54f49c8/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:05:24.505856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66a40-ca2f-40ae-818d-9789fb1d8b11 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:24.506440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66a40-ca2f-40ae-818d-9789fb1d8b11 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:24.506440 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66a40-ca2f-40ae-818d-9789fb1d8b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:24.538267 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-ddf66a40-ca2f-40ae-818d-9789fb1d8b11 None None] MFA Rules not processed for user `4da7c595cf3643b2965e2a35d54f49c8`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:05:24.539487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ddf66a40-ca2f-40ae-818d-9789fb1d8b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:24.615013 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4525/9034] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:05:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:05:24.633115 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447a8f1-6b84-4e2d-acf0-6a62420e5065 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:24.635096 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c447a8f1-6b84-4e2d-acf0-6a62420e5065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:24.715681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447a8f1-6b84-4e2d-acf0-6a62420e5065 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:24.721552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdc490-fb31-4fa2-8a95-18509209a272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:24.723758 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdc490-fb31-4fa2-8a95-18509209a272 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:24.724077 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdc490-fb31-4fa2-8a95-18509209a272 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:24.724267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdc490-fb31-4fa2-8a95-18509209a272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:24.783076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdc490-fb31-4fa2-8a95-18509209a272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:24.784574 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdc490-fb31-4fa2-8a95-18509209a272 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:24.793700 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4510/9035] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:05:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:05:25.900756 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b8ceb-1490-4ec9-a079-9601229394fd None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:25.901330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b8ceb-1490-4ec9-a079-9601229394fd None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:25.901485 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b8ceb-1490-4ec9-a079-9601229394fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:25.922089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-b15b8ceb-1490-4ec9-a079-9601229394fd None None] MFA Rules not processed for user `199e2426220e4cc4b1d37d4075e67cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:05:25.923577 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b15b8ceb-1490-4ec9-a079-9601229394fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:25.930702 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4526/9036] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:05:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:05:26.586201 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdc490-fb31-4fa2-8a95-18509209a272 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:26.587639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6fbdc490-fb31-4fa2-8a95-18509209a272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:26.634145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:26.687153 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdc490-fb31-4fa2-8a95-18509209a272 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:26.692427 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea7693-8508-48fc-9aad-6f0ec88da3d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:26.693046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea7693-8508-48fc-9aad-6f0ec88da3d4 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:26.693363 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea7693-8508-48fc-9aad-6f0ec88da3d4 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:26.693632 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea7693-8508-48fc-9aad-6f0ec88da3d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:26.695355 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-35ea7693-8508-48fc-9aad-6f0ec88da3d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:26.708044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea7693-8508-48fc-9aad-6f0ec88da3d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:26.709652 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea7693-8508-48fc-9aad-6f0ec88da3d4 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:26.720933 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4511/9037] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:05:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:05:28.850157 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b8ceb-1490-4ec9-a079-9601229394fd None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:28.852775 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-b15b8ceb-1490-4ec9-a079-9601229394fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:28.934515 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b8ceb-1490-4ec9-a079-9601229394fd None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:28.938488 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8d56e-4fca-4e67-b963-ee906d41d6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:28.939103 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8d56e-4fca-4e67-b963-ee906d41d6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:28.939387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8d56e-4fca-4e67-b963-ee906d41d6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:28.939666 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8d56e-4fca-4e67-b963-ee906d41d6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:28.941487 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-ffe8d56e-4fca-4e67-b963-ee906d41d6f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:28.982045 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8d56e-4fca-4e67-b963-ee906d41d6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:28.985885 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8d56e-4fca-4e67-b963-ee906d41d6f3 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:29.012484 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4527/9038] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:05:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:05:31.387606 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea7693-8508-48fc-9aad-6f0ec88da3d4 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:31.397217 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea7693-8508-48fc-9aad-6f0ec88da3d4 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:31.400800 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a32d6-d90e-4c8f-86ba-e9ea15e255fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:31.401435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a32d6-d90e-4c8f-86ba-e9ea15e255fa service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:31.401716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a32d6-d90e-4c8f-86ba-e9ea15e255fa service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:31.401990 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a32d6-d90e-4c8f-86ba-e9ea15e255fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:31.403703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-c65a32d6-d90e-4c8f-86ba-e9ea15e255fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:05:31.417795 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a32d6-d90e-4c8f-86ba-e9ea15e255fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:31.419210 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a32d6-d90e-4c8f-86ba-e9ea15e255fa service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:31.430627 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4512/9039] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:05:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:05:36.775158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8d56e-4fca-4e67-b963-ee906d41d6f3 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:05:36.779223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:36.785625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8d56e-4fca-4e67-b963-ee906d41d6f3 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:05:36.789289 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766af79e-20ee-45b0-bb6f-34b048adbeaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:05:36.789884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766af79e-20ee-45b0-bb6f-34b048adbeaa service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:05:36.790191 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766af79e-20ee-45b0-bb6f-34b048adbeaa service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:05:36.790464 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766af79e-20ee-45b0-bb6f-34b048adbeaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:05:36.800654 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766af79e-20ee-45b0-bb6f-34b048adbeaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:05:36.802106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766af79e-20ee-45b0-bb6f-34b048adbeaa service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:05:36.812037 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4528/9040] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:05:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:05:41.425862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=31 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:46.807565 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=5 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:06:40.171064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a32d6-d90e-4c8f-86ba-e9ea15e255fa service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:06:40.180488 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a32d6-d90e-4c8f-86ba-e9ea15e255fa service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:06:40.184163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221c1e9-3193-4ded-8f3e-ca82e3f8c958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:06:40.184755 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221c1e9-3193-4ded-8f3e-ca82e3f8c958 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:06:40.185034 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221c1e9-3193-4ded-8f3e-ca82e3f8c958 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:06:40.185347 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221c1e9-3193-4ded-8f3e-ca82e3f8c958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:06:40.187036 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e221c1e9-3193-4ded-8f3e-ca82e3f8c958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:06:40.196403 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221c1e9-3193-4ded-8f3e-ca82e3f8c958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:06:40.197837 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221c1e9-3193-4ded-8f3e-ca82e3f8c958 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:06:40.206135 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4513/9041] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:06:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:06:50.202199 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:07:46.323535 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbc744-4522-4dfa-bcd7-50f086061455 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:07:46.324083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbc744-4522-4dfa-bcd7-50f086061455 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:07:46.324083 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbc744-4522-4dfa-bcd7-50f086061455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:07:46.383165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-03cbc744-4522-4dfa-bcd7-50f086061455 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:07:46.384360 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-03cbc744-4522-4dfa-bcd7-50f086061455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:07:46.448944 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4529/9042] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 22:07:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:07:46.495873 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221c1e9-3193-4ded-8f3e-ca82e3f8c958 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:07:46.497316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-e221c1e9-3193-4ded-8f3e-ca82e3f8c958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:07:46.601255 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221c1e9-3193-4ded-8f3e-ca82e3f8c958 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:07:46.606244 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f3f1d-da67-4179-9441-8cf2f6a5b04e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:07:46.606844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f3f1d-da67-4179-9441-8cf2f6a5b04e service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:07:46.607124 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f3f1d-da67-4179-9441-8cf2f6a5b04e service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:07:46.607398 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f3f1d-da67-4179-9441-8cf2f6a5b04e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:07:46.617862 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f3f1d-da67-4179-9441-8cf2f6a5b04e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:07:46.619849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f3f1d-da67-4179-9441-8cf2f6a5b04e service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:07:46.628570 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4514/9043] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 22:07:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 22:07:49.118647 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbc744-4522-4dfa-bcd7-50f086061455 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:07:49.142272 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbc744-4522-4dfa-bcd7-50f086061455 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:07:49.152778 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b41d62-00ea-419d-b427-adb3e8a2eaaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:07:49.154193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b41d62-00ea-419d-b427-adb3e8a2eaaa service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:07:49.154715 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b41d62-00ea-419d-b427-adb3e8a2eaaa service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:07:49.155147 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b41d62-00ea-419d-b427-adb3e8a2eaaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:07:49.157903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-98b41d62-00ea-419d-b427-adb3e8a2eaaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:07:49.183015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b41d62-00ea-419d-b427-adb3e8a2eaaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:07:49.215562 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b41d62-00ea-419d-b427-adb3e8a2eaaa service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:07:49.228468 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4530/9044] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:07:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:07:56.625230 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=47 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:07:58.934917 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f3f1d-da67-4179-9441-8cf2f6a5b04e service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:07:58.944675 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f3f1d-da67-4179-9441-8cf2f6a5b04e service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:07:58.948266 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989fdcf-a04e-47db-8a2d-529be8f51804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:07:58.948854 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989fdcf-a04e-47db-8a2d-529be8f51804 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:07:58.949128 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989fdcf-a04e-47db-8a2d-529be8f51804 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:07:58.949433 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989fdcf-a04e-47db-8a2d-529be8f51804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:07:58.951110 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7989fdcf-a04e-47db-8a2d-529be8f51804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:07:58.960221 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989fdcf-a04e-47db-8a2d-529be8f51804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:07:58.961654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989fdcf-a04e-47db-8a2d-529be8f51804 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:07:58.969361 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4515/9045] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:07:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:07:59.082117 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966206b-5f4c-4f81-ad2c-d3056f53d973 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:07:59.082676 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966206b-5f4c-4f81-ad2c-d3056f53d973 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:07:59.082777 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966206b-5f4c-4f81-ad2c-d3056f53d973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:07:59.104081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-4966206b-5f4c-4f81-ad2c-d3056f53d973 None None] MFA Rules not processed for user `187d6f51b1604327a4879e9e19b47963`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:07:59.105421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4966206b-5f4c-4f81-ad2c-d3056f53d973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:07:59.116056 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4531/9046] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Oct 8 22:07:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:07:59.134165 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989fdcf-a04e-47db-8a2d-529be8f51804 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:07:59.135640 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7989fdcf-a04e-47db-8a2d-529be8f51804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:07:59.242151 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989fdcf-a04e-47db-8a2d-529be8f51804 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:07:59.245829 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b544f8-1fdd-4660-b172-4af03f0192be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:07:59.246434 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b544f8-1fdd-4660-b172-4af03f0192be service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:07:59.246707 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b544f8-1fdd-4660-b172-4af03f0192be service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:07:59.246976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b544f8-1fdd-4660-b172-4af03f0192be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:07:59.257923 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b544f8-1fdd-4660-b172-4af03f0192be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:07:59.259374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b544f8-1fdd-4660-b172-4af03f0192be service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:07:59.270150 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4516/9047] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:07:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:07:59.338928 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966206b-5f4c-4f81-ad2c-d3056f53d973 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:07:59.348255 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966206b-5f4c-4f81-ad2c-d3056f53d973 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:07:59.352368 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d7cd-ca04-4a5b-aa65-0f72d2372a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:07:59.352960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d7cd-ca04-4a5b-aa65-0f72d2372a01 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:07:59.353280 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d7cd-ca04-4a5b-aa65-0f72d2372a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:07:59.353556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d7cd-ca04-4a5b-aa65-0f72d2372a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:07:59.355265 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6337d7cd-ca04-4a5b-aa65-0f72d2372a01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:07:59.364408 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337d7cd-ca04-4a5b-aa65-0f72d2372a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:07:59.366448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337d7cd-ca04-4a5b-aa65-0f72d2372a01 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:07:59.374214 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4532/9048] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:07:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:07:59.447570 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b544f8-1fdd-4660-b172-4af03f0192be service glance] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:07:59.456809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b544f8-1fdd-4660-b172-4af03f0192be service glance] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:07:59.460892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0a28-4d25-427c-8af0-76ad42acba0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:07:59.461518 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0a28-4d25-427c-8af0-76ad42acba0e service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:07:59.461794 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0a28-4d25-427c-8af0-76ad42acba0e service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:07:59.462064 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0a28-4d25-427c-8af0-76ad42acba0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:07:59.463779 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-537a0a28-4d25-427c-8af0-76ad42acba0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:07:59.477639 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a0a28-4d25-427c-8af0-76ad42acba0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:07:59.479051 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a0a28-4d25-427c-8af0-76ad42acba0e service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:07:59.490414 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4517/9049] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:07:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:07:59.554396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d7cd-ca04-4a5b-aa65-0f72d2372a01 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:07:59.555787 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-6337d7cd-ca04-4a5b-aa65-0f72d2372a01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:07:59.580165 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d7cd-ca04-4a5b-aa65-0f72d2372a01 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:07:59.587105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e40218-7467-48cc-ba7b-f44362b0a9e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:07:59.587702 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e40218-7467-48cc-ba7b-f44362b0a9e6 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:07:59.588036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e40218-7467-48cc-ba7b-f44362b0a9e6 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:07:59.588312 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e40218-7467-48cc-ba7b-f44362b0a9e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:07:59.590095 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f4e40218-7467-48cc-ba7b-f44362b0a9e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:07:59.602719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e40218-7467-48cc-ba7b-f44362b0a9e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:07:59.604325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e40218-7467-48cc-ba7b-f44362b0a9e6 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:07:59.615040 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4533/9050] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:07:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:08:00.462449 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0a28-4d25-427c-8af0-76ad42acba0e service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:08:00.470977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0a28-4d25-427c-8af0-76ad42acba0e service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:08:00.475305 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55793c2-5c9e-4f93-a0f3-a2a0c87c6920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:08:00.475907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55793c2-5c9e-4f93-a0f3-a2a0c87c6920 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:08:00.476390 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55793c2-5c9e-4f93-a0f3-a2a0c87c6920 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:08:00.476834 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55793c2-5c9e-4f93-a0f3-a2a0c87c6920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:08:00.478902 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f55793c2-5c9e-4f93-a0f3-a2a0c87c6920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:08:00.489131 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55793c2-5c9e-4f93-a0f3-a2a0c87c6920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:08:00.490612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55793c2-5c9e-4f93-a0f3-a2a0c87c6920 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:08:00.498663 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4518/9051] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:08:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:08:01.350734 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e40218-7467-48cc-ba7b-f44362b0a9e6 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:08:01.352290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f4e40218-7467-48cc-ba7b-f44362b0a9e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:08:01.367930 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e40218-7467-48cc-ba7b-f44362b0a9e6 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:08:01.373556 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11510e13-d5f4-4bb9-84b3-701cd659266b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:08:01.374159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11510e13-d5f4-4bb9-84b3-701cd659266b service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:08:01.374444 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11510e13-d5f4-4bb9-84b3-701cd659266b service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:08:01.374721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11510e13-d5f4-4bb9-84b3-701cd659266b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:08:01.376448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-11510e13-d5f4-4bb9-84b3-701cd659266b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:08:01.388698 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11510e13-d5f4-4bb9-84b3-701cd659266b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:08:01.390315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11510e13-d5f4-4bb9-84b3-701cd659266b service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:08:01.401311 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4534/9052] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:08:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:08:02.080237 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a8626-b40b-4f72-8a3b-0c02ef6f7a56 None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:08:02.080760 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a8626-b40b-4f72-8a3b-0c02ef6f7a56 None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:08:02.080922 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a8626-b40b-4f72-8a3b-0c02ef6f7a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:08:02.100948 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-b22a8626-b40b-4f72-8a3b-0c02ef6f7a56 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:08:02.102222 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b22a8626-b40b-4f72-8a3b-0c02ef6f7a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:08:02.109662 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4519/9053] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 22:08:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:08:02.122504 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11510e13-d5f4-4bb9-84b3-701cd659266b service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:08:02.133636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11510e13-d5f4-4bb9-84b3-701cd659266b service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:08:02.138653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a40e2-b015-4989-8c32-25688b3c3583 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:08:02.139249 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a40e2-b015-4989-8c32-25688b3c3583 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:08:02.139529 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a40e2-b015-4989-8c32-25688b3c3583 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:08:02.139804 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a40e2-b015-4989-8c32-25688b3c3583 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:08:02.149035 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a40e2-b015-4989-8c32-25688b3c3583 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:08:02.150677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a40e2-b015-4989-8c32-25688b3c3583 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:08:02.159807 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4535/9054] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 22:08:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 22:08:12.094720 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=56 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:08:12.162903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=81 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:08:19.909511 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37891e-23d1-4c4c-a479-a8d419050e4d None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:08:19.910060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37891e-23d1-4c4c-a479-a8d419050e4d None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:08:19.910060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37891e-23d1-4c4c-a479-a8d419050e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:08:19.929506 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bb37891e-23d1-4c4c-a479-a8d419050e4d None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:08:19.930689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bb37891e-23d1-4c4c-a479-a8d419050e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:08:19.937686 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4520/9055] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 22:08:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:08:19.950633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a40e2-b015-4989-8c32-25688b3c3583 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:08:19.961387 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a40e2-b015-4989-8c32-25688b3c3583 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:08:19.966411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14952048-0b4c-4365-a78c-4e48ca449dfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:08:19.967019 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14952048-0b4c-4365-a78c-4e48ca449dfc service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:08:19.967302 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14952048-0b4c-4365-a78c-4e48ca449dfc service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:08:19.967571 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14952048-0b4c-4365-a78c-4e48ca449dfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:08:19.975520 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14952048-0b4c-4365-a78c-4e48ca449dfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:08:19.977089 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14952048-0b4c-4365-a78c-4e48ca449dfc service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:08:19.984959 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4536/9056] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 22:08:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 22:08:29.923617 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:08:29.981774 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:08:33.373102 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37891e-23d1-4c4c-a479-a8d419050e4d None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:08:33.395097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37891e-23d1-4c4c-a479-a8d419050e4d None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:08:33.400138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212ce82-ccae-4b6a-8ac8-b8e7113e4c7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:08:33.400736 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212ce82-ccae-4b6a-8ac8-b8e7113e4c7c service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:08:33.401015 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212ce82-ccae-4b6a-8ac8-b8e7113e4c7c service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:08:33.401323 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212ce82-ccae-4b6a-8ac8-b8e7113e4c7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:08:33.403031 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-f212ce82-ccae-4b6a-8ac8-b8e7113e4c7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:08:33.434138 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212ce82-ccae-4b6a-8ac8-b8e7113e4c7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:08:33.435665 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212ce82-ccae-4b6a-8ac8-b8e7113e4c7c service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:08:33.446037 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4521/9057] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:08:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:08:39.695275 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14952048-0b4c-4365-a78c-4e48ca449dfc service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:08:39.715975 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14952048-0b4c-4365-a78c-4e48ca449dfc service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:08:39.720998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176075-d956-4e46-84bf-924475afb5bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:08:39.721630 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176075-d956-4e46-84bf-924475afb5bc service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:08:39.721914 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176075-d956-4e46-84bf-924475afb5bc service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:08:39.722189 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176075-d956-4e46-84bf-924475afb5bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:08:39.723904 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3a176075-d956-4e46-84bf-924475afb5bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:08:39.735600 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a176075-d956-4e46-84bf-924475afb5bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:08:39.737116 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a176075-d956-4e46-84bf-924475afb5bc service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:08:39.747469 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4537/9058] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:08:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:08:43.441401 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=19 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:08:49.743450 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=11 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:09:39.082657 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212ce82-ccae-4b6a-8ac8-b8e7113e4c7c service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:09:39.095424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212ce82-ccae-4b6a-8ac8-b8e7113e4c7c service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:09:39.102114 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8883dba-ad41-4ab8-96d2-094faae9f30b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:09:39.102879 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8883dba-ad41-4ab8-96d2-094faae9f30b service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:09:39.103171 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8883dba-ad41-4ab8-96d2-094faae9f30b service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:09:39.103542 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8883dba-ad41-4ab8-96d2-094faae9f30b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:09:39.105664 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b8883dba-ad41-4ab8-96d2-094faae9f30b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:09:39.118466 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8883dba-ad41-4ab8-96d2-094faae9f30b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:09:39.120055 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8883dba-ad41-4ab8-96d2-094faae9f30b service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:09:39.131263 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4522/9059] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:09:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:09:41.870020 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631b83c-e733-423d-9d81-68463c4f7eef None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:09:41.870555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631b83c-e733-423d-9d81-68463c4f7eef None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:09:41.870555 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631b83c-e733-423d-9d81-68463c4f7eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:09:41.889697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-7631b83c-e733-423d-9d81-68463c4f7eef None None] MFA Rules not processed for user `199e2426220e4cc4b1d37d4075e67cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:09:41.890911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-7631b83c-e733-423d-9d81-68463c4f7eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:09:41.898321 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4538/9060] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:09:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 22:09:49.126326 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:09:51.884719 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:12:04.106555 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8883dba-ad41-4ab8-96d2-094faae9f30b service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:12:04.125718 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8883dba-ad41-4ab8-96d2-094faae9f30b service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:12:04.131239 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41afb0-425d-4d6d-8ae2-ee93622a231e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:12:04.131833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41afb0-425d-4d6d-8ae2-ee93622a231e service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:12:04.132113 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41afb0-425d-4d6d-8ae2-ee93622a231e service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:12:04.132389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41afb0-425d-4d6d-8ae2-ee93622a231e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:12:04.140093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41afb0-425d-4d6d-8ae2-ee93622a231e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:12:04.141688 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41afb0-425d-4d6d-8ae2-ee93622a231e service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:12:04.150456 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4523/9061] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:12:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:12:04.335355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631b83c-e733-423d-9d81-68463c4f7eef None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:12:04.345636 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631b83c-e733-423d-9d81-68463c4f7eef None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:12:04.349371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0408db-b5a3-4d3b-b072-c3d0f91034dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:12:04.349903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0408db-b5a3-4d3b-b072-c3d0f91034dd service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:12:04.350182 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0408db-b5a3-4d3b-b072-c3d0f91034dd service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:12:04.350484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0408db-b5a3-4d3b-b072-c3d0f91034dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:12:04.361998 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0408db-b5a3-4d3b-b072-c3d0f91034dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:12:04.363438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0408db-b5a3-4d3b-b072-c3d0f91034dd service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:12:04.374269 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4539/9062] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:12:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:12:05.565754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41afb0-425d-4d6d-8ae2-ee93622a231e service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:12:05.575079 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41afb0-425d-4d6d-8ae2-ee93622a231e service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:12:05.578708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd6052-26d1-4dc8-9985-97ab267f626d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:12:05.579302 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd6052-26d1-4dc8-9985-97ab267f626d service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:12:05.579586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd6052-26d1-4dc8-9985-97ab267f626d service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:12:05.579860 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd6052-26d1-4dc8-9985-97ab267f626d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:12:05.589911 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd6052-26d1-4dc8-9985-97ab267f626d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:12:05.591353 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd6052-26d1-4dc8-9985-97ab267f626d service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:12:05.602081 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4524/9063] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:12:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:12:14.369570 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:12:15.597438 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=15 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:12:19.902453 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0408db-b5a3-4d3b-b072-c3d0f91034dd service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:12:19.911687 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0408db-b5a3-4d3b-b072-c3d0f91034dd service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:12:19.916014 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc1bed-71af-43fa-8fbb-b0c4f48e6584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:12:19.916678 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc1bed-71af-43fa-8fbb-b0c4f48e6584 service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:12:19.916968 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc1bed-71af-43fa-8fbb-b0c4f48e6584 service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:12:19.917288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc1bed-71af-43fa-8fbb-b0c4f48e6584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:12:19.926108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc1bed-71af-43fa-8fbb-b0c4f48e6584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:12:19.927608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc1bed-71af-43fa-8fbb-b0c4f48e6584 service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:12:19.938876 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4540/9064] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:12:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:12:29.933054 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:13:39.392824 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd6052-26d1-4dc8-9985-97ab267f626d service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:13:39.403987 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd6052-26d1-4dc8-9985-97ab267f626d service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:13:39.408907 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdac451-3e98-44a1-bd98-35a3133e4824 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:13:39.409535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdac451-3e98-44a1-bd98-35a3133e4824 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:13:39.410062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdac451-3e98-44a1-bd98-35a3133e4824 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:13:39.410332 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdac451-3e98-44a1-bd98-35a3133e4824 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:13:39.419424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdac451-3e98-44a1-bd98-35a3133e4824 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:13:39.421046 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdac451-3e98-44a1-bd98-35a3133e4824 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:13:39.431423 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4525/9065] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:13:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:13:46.733028 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc1bed-71af-43fa-8fbb-b0c4f48e6584 service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:13:46.745344 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc1bed-71af-43fa-8fbb-b0c4f48e6584 service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:13:46.750723 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4815afa-ca05-4b7c-87a7-70c050080e9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:13:46.751315 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4815afa-ca05-4b7c-87a7-70c050080e9b service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:13:46.751589 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4815afa-ca05-4b7c-87a7-70c050080e9b service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:13:46.751854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4815afa-ca05-4b7c-87a7-70c050080e9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:13:46.760870 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4815afa-ca05-4b7c-87a7-70c050080e9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:13:46.762471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4815afa-ca05-4b7c-87a7-70c050080e9b service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:13:46.772017 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4541/9066] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:13:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:13:49.426853 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=6 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:13:56.485649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdac451-3e98-44a1-bd98-35a3133e4824 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:13:56.496039 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdac451-3e98-44a1-bd98-35a3133e4824 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:13:56.499708 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54faf3-c0cb-44c5-80ba-6430dc0d8944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:13:56.500308 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54faf3-c0cb-44c5-80ba-6430dc0d8944 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:13:56.500592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54faf3-c0cb-44c5-80ba-6430dc0d8944 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:13:56.500868 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54faf3-c0cb-44c5-80ba-6430dc0d8944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:13:56.571942 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54faf3-c0cb-44c5-80ba-6430dc0d8944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:13:56.573412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54faf3-c0cb-44c5-80ba-6430dc0d8944 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:13:56.592911 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4526/9067] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 22:13:56.767990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:13:59.711287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4815afa-ca05-4b7c-87a7-70c050080e9b service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:13:59.722246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4815afa-ca05-4b7c-87a7-70c050080e9b service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:13:59.730105 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63121e8-dd41-4b32-8ee6-20a783c1b8d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:13:59.730863 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63121e8-dd41-4b32-8ee6-20a783c1b8d5 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:13:59.731300 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63121e8-dd41-4b32-8ee6-20a783c1b8d5 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:13:59.731681 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63121e8-dd41-4b32-8ee6-20a783c1b8d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:13:59.734021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f63121e8-dd41-4b32-8ee6-20a783c1b8d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:13:59.763952 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63121e8-dd41-4b32-8ee6-20a783c1b8d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:13:59.766357 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63121e8-dd41-4b32-8ee6-20a783c1b8d5 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:13:59.782657 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4542/9068] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:13:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:14:03.039704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54faf3-c0cb-44c5-80ba-6430dc0d8944 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:03.052464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54faf3-c0cb-44c5-80ba-6430dc0d8944 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:03.059331 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:03.059985 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:03.060267 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:03.060541 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] PATH_INFO: `/v3/users/199e2426220e4cc4b1d37d4075e67cbc` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:03.061747 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=199e2426220e4cc4b1d37d4075e67cbc)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:03.063690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:03.121232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199e2426220e4cc4b1d37d4075e67cbc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.128224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199e2426220e4cc4b1d37d4075e67cbc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.128947 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199e2426220e4cc4b1d37d4075e67cbc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.129603 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199e2426220e4cc4b1d37d4075e67cbc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.141569 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199e2426220e4cc4b1d37d4075e67cbc'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.155565 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4527/9069] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 22:14:03 2022] DELETE /identity/v3/users/199e2426220e4cc4b1d37d4075e67cbc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:14:03.333852 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63121e8-dd41-4b32-8ee6-20a783c1b8d5 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:03.347294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63121e8-dd41-4b32-8ee6-20a783c1b8d5 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:03.411078 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:03.411714 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:03.411992 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:03.412290 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] PATH_INFO: `/v3/projects/b9c33d4041764691b1ad69f9f1abe60b` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:03.413442 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c33d4041764691b1ad69f9f1abe60b)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:03.415894 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:03.464216 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c33d4041764691b1ad69f9f1abe60b', 'request_id': 'req-3832e292-8de6-4421-9aa6-85a9f653058a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.475250 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c33d4041764691b1ad69f9f1abe60b', 'request_id': 'req-3832e292-8de6-4421-9aa6-85a9f653058a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.483940 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c33d4041764691b1ad69f9f1abe60b', 'request_id': 'req-3832e292-8de6-4421-9aa6-85a9f653058a'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.510175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] The token cache is being invalidate because project b9c33d4041764691b1ad69f9f1abe60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 22:14:03.510483 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.511121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.512605 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4543/9070] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 22:14:03 2022] DELETE /identity/v3/projects/b9c33d4041764691b1ad69f9f1abe60b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:14:03.516621 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:03.518078 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:03.531716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dda8c-2f1c-4407-aa77-cb0ab3102e6e admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:03.576340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:03.589704 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7e8f9-cf36-4694-8d41-9b72fa5dbf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:03.590340 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e8f9-cf36-4694-8d41-9b72fa5dbf1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:03.590619 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e8f9-cf36-4694-8d41-9b72fa5dbf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:03.590892 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e8f9-cf36-4694-8d41-9b72fa5dbf1e admin admin] PATH_INFO: `/v3/users/4da7c595cf3643b2965e2a35d54f49c8` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:03.592025 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7e8f9-cf36-4694-8d41-9b72fa5dbf1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da7c595cf3643b2965e2a35d54f49c8)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:03.593969 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7e8f9-cf36-4694-8d41-9b72fa5dbf1e admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:03.640407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4cd7e8f9-cf36-4694-8d41-9b72fa5dbf1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da7c595cf3643b2965e2a35d54f49c8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.647278 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4cd7e8f9-cf36-4694-8d41-9b72fa5dbf1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da7c595cf3643b2965e2a35d54f49c8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.647970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4cd7e8f9-cf36-4694-8d41-9b72fa5dbf1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da7c595cf3643b2965e2a35d54f49c8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.648590 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4cd7e8f9-cf36-4694-8d41-9b72fa5dbf1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da7c595cf3643b2965e2a35d54f49c8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.661086 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-4cd7e8f9-cf36-4694-8d41-9b72fa5dbf1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da7c595cf3643b2965e2a35d54f49c8'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.674058 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4528/9071] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 22:14:03 2022] DELETE /identity/v3/users/4da7c595cf3643b2965e2a35d54f49c8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:14:03.848874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:03.850356 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:03.864108 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832e292-8de6-4421-9aa6-85a9f653058a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:03.920575 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68164b-aa2a-467c-8204-740a9ae9bb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:03.921227 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68164b-aa2a-467c-8204-740a9ae9bb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:03.921507 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68164b-aa2a-467c-8204-740a9ae9bb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:03.921780 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68164b-aa2a-467c-8204-740a9ae9bb2f admin admin] PATH_INFO: `/v3/projects/20bf9fee84f84780a5f661a36c6323a6` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:03.922877 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68164b-aa2a-467c-8204-740a9ae9bb2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=20bf9fee84f84780a5f661a36c6323a6)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:03.924761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68164b-aa2a-467c-8204-740a9ae9bb2f admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:03.933030 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:03.972436 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aa68164b-aa2a-467c-8204-740a9ae9bb2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20bf9fee84f84780a5f661a36c6323a6', 'request_id': 'req-aa68164b-aa2a-467c-8204-740a9ae9bb2f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.979446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aa68164b-aa2a-467c-8204-740a9ae9bb2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20bf9fee84f84780a5f661a36c6323a6', 'request_id': 'req-aa68164b-aa2a-467c-8204-740a9ae9bb2f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.985081 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aa68164b-aa2a-467c-8204-740a9ae9bb2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20bf9fee84f84780a5f661a36c6323a6', 'request_id': 'req-aa68164b-aa2a-467c-8204-740a9ae9bb2f'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.996276 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aa68164b-aa2a-467c-8204-740a9ae9bb2f admin admin] The token cache is being invalidate because project 20bf9fee84f84780a5f661a36c6323a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 22:14:03.996561 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aa68164b-aa2a-467c-8204-740a9ae9bb2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.997214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-aa68164b-aa2a-467c-8204-740a9ae9bb2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:14:03.998862 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4544/9072] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 22:14:03 2022] DELETE /identity/v3/projects/20bf9fee84f84780a5f661a36c6323a6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:14:04.003861 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87a7e2-8165-4b2a-9ef3-b05e821abfce None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:04.004148 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87a7e2-8165-4b2a-9ef3-b05e821abfce None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:04.004418 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87a7e2-8165-4b2a-9ef3-b05e821abfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:04.060977 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8c87a7e2-8165-4b2a-9ef3-b05e821abfce None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:14:04.062208 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8c87a7e2-8165-4b2a-9ef3-b05e821abfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:04.119261 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4529/9073] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:14:04.128301 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fae87-7830-453a-a796-10e1a515cbba None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:04.128590 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fae87-7830-453a-a796-10e1a515cbba None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:04.128869 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fae87-7830-453a-a796-10e1a515cbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:04.149086 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-371fae87-7830-453a-a796-10e1a515cbba None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:14:04.150330 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-371fae87-7830-453a-a796-10e1a515cbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:04.158163 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4545/9074] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:14:04.162333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87a7e2-8165-4b2a-9ef3-b05e821abfce None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:04.172181 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87a7e2-8165-4b2a-9ef3-b05e821abfce None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:04.176710 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38061-a0e9-42d5-9fa0-b731b7ceed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:04.177333 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38061-a0e9-42d5-9fa0-b731b7ceed4c admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:04.177612 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38061-a0e9-42d5-9fa0-b731b7ceed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:04.177881 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38061-a0e9-42d5-9fa0-b731b7ceed4c admin admin] PATH_INFO: `/v3/domains` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:04.178516 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f38061-a0e9-42d5-9fa0-b731b7ceed4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 22:14:04.178844 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f38061-a0e9-42d5-9fa0-b731b7ceed4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:04.180945 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f38061-a0e9-42d5-9fa0-b731b7ceed4c admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:04.192284 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4530/9075] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Oct 8 22:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 22:14:04.196807 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fae87-7830-453a-a796-10e1a515cbba None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:04.206011 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fae87-7830-453a-a796-10e1a515cbba None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:04.210657 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbab200-66f6-4bbc-822a-8050182cd0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:04.211247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbab200-66f6-4bbc-822a-8050182cd0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:04.211544 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbab200-66f6-4bbc-822a-8050182cd0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:04.211845 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbab200-66f6-4bbc-822a-8050182cd0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:04.212501 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbab200-66f6-4bbc-822a-8050182cd0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:04.214459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbab200-66f6-4bbc-822a-8050182cd0c7 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:04.250720 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4546/9076] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 22:14:04 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 22:14:04.254392 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38061-a0e9-42d5-9fa0-b731b7ceed4c admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:04.265232 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38061-a0e9-42d5-9fa0-b731b7ceed4c admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:04.285792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:04.324703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b6490-ecbc-4fe8-ba4d-21751ef48809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:04.325356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b6490-ecbc-4fe8-ba4d-21751ef48809 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:04.325636 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b6490-ecbc-4fe8-ba4d-21751ef48809 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:04.325908 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b6490-ecbc-4fe8-ba4d-21751ef48809 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:04.326535 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b6490-ecbc-4fe8-ba4d-21751ef48809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:04.328424 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b6490-ecbc-4fe8-ba4d-21751ef48809 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:04.349159 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4531/9077] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 22:14:04 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 22:14:04.353760 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbab200-66f6-4bbc-822a-8050182cd0c7 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:04.364090 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbab200-66f6-4bbc-822a-8050182cd0c7 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:04.369247 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891be6ec-3f8c-4ae5-b823-06af0a045d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:04.369841 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891be6ec-3f8c-4ae5-b823-06af0a045d9a admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:04.370113 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891be6ec-3f8c-4ae5-b823-06af0a045d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:04.370379 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891be6ec-3f8c-4ae5-b823-06af0a045d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:04.371013 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891be6ec-3f8c-4ae5-b823-06af0a045d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:04.372583 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891be6ec-3f8c-4ae5-b823-06af0a045d9a admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:04.382439 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4547/9078] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 22:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 22:14:04.386435 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b6490-ecbc-4fe8-ba4d-21751ef48809 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:04.396263 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b6490-ecbc-4fe8-ba4d-21751ef48809 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:04.400793 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fab74d-f91a-4257-93f9-1c3d227c07ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:04.401409 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fab74d-f91a-4257-93f9-1c3d227c07ed admin admin] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:04.401689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fab74d-f91a-4257-93f9-1c3d227c07ed admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:04.401960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fab74d-f91a-4257-93f9-1c3d227c07ed admin admin] PATH_INFO: `/v3/roles` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:04.402595 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fab74d-f91a-4257-93f9-1c3d227c07ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:04.404145 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fab74d-f91a-4257-93f9-1c3d227c07ed admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:04.414520 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4532/9079] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 22:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 22:14:04.419176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891be6ec-3f8c-4ae5-b823-06af0a045d9a admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:04.428969 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891be6ec-3f8c-4ae5-b823-06af0a045d9a admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:04.434121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451dbe2-06b6-4c0a-8caf-0b6e610a16ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:04.434758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451dbe2-06b6-4c0a-8caf-0b6e610a16ab admin admin] REQUEST_METHOD: `PUT` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:04.435037 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451dbe2-06b6-4c0a-8caf-0b6e610a16ab admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:04.435341 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451dbe2-06b6-4c0a-8caf-0b6e610a16ab admin admin] PATH_INFO: `/v3/projects/00e9fa73af9541119afd5edb5d180e58/users/a42e32e56dd84caab93645385e5a1493/roles/27431c49ccd74f7a898d1a39e251ce29` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:04.449737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451dbe2-06b6-4c0a-8caf-0b6e610a16ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e9fa73af9541119afd5edb5d180e58, user_id=a42e32e56dd84caab93645385e5a1493, role_id=27431c49ccd74f7a898d1a39e251ce29)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:04.452409 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451dbe2-06b6-4c0a-8caf-0b6e610a16ab admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:04.466321 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4548/9080] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 22:14:04 2022] PUT /identity/v3/projects/00e9fa73af9541119afd5edb5d180e58/users/a42e32e56dd84caab93645385e5a1493/roles/27431c49ccd74f7a898d1a39e251ce29 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:14:04.471296 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2af1c4-27ab-4df9-9ee1-e227d09198cb None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:04.471585 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2af1c4-27ab-4df9-9ee1-e227d09198cb None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:04.471882 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2af1c4-27ab-4df9-9ee1-e227d09198cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:04.492729 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-bf2af1c4-27ab-4df9-9ee1-e227d09198cb None None] MFA Rules not processed for user `1a6e50d0928e4f92987cd089e6138f36`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:14:04.494565 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-bf2af1c4-27ab-4df9-9ee1-e227d09198cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:04.552530 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4533/9081] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:14:04.562758 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451dbe2-06b6-4c0a-8caf-0b6e610a16ab admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:04.564503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-f451dbe2-06b6-4c0a-8caf-0b6e610a16ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:04.633323 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451dbe2-06b6-4c0a-8caf-0b6e610a16ab admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:04.637246 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b5bff-d014-472f-94da-1cb099ab8a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:04.637857 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b5bff-d014-472f-94da-1cb099ab8a6f service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:04.638142 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b5bff-d014-472f-94da-1cb099ab8a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:04.638421 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b5bff-d014-472f-94da-1cb099ab8a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:04.647524 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b5bff-d014-472f-94da-1cb099ab8a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:04.649508 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b5bff-d014-472f-94da-1cb099ab8a6f service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:04.659084 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4549/9082] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:14:08.647126 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963f06-91f2-4c9e-b11a-e1e08cb5af5f None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:08.647690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963f06-91f2-4c9e-b11a-e1e08cb5af5f None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:08.647690 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963f06-91f2-4c9e-b11a-e1e08cb5af5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:08.677841 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-0d963f06-91f2-4c9e-b11a-e1e08cb5af5f None None] MFA Rules not processed for user `a42e32e56dd84caab93645385e5a1493`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:14:08.678997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-0d963f06-91f2-4c9e-b11a-e1e08cb5af5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:08.747868 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4534/9083] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:14:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:14:08.752480 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b5bff-d014-472f-94da-1cb099ab8a6f service neutron] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:08.763270 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b5bff-d014-472f-94da-1cb099ab8a6f service neutron] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:08.768062 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653cad8-fcbb-40bb-9d0d-9f5ed21e1850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:08.768605 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cad8-fcbb-40bb-9d0d-9f5ed21e1850 admin admin] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:08.768883 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cad8-fcbb-40bb-9d0d-9f5ed21e1850 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:08.769158 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cad8-fcbb-40bb-9d0d-9f5ed21e1850 admin admin] PATH_INFO: `/v3/projects` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:08.769827 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653cad8-fcbb-40bb-9d0d-9f5ed21e1850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:08.771732 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653cad8-fcbb-40bb-9d0d-9f5ed21e1850 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:08.788643 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:08.807496 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4550/9084] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Oct 8 22:14:08 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 22:14:08.811360 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963f06-91f2-4c9e-b11a-e1e08cb5af5f None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:08.823220 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963f06-91f2-4c9e-b11a-e1e08cb5af5f None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:08.858004 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:08.893387 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fadb-86b2-4ba5-98cb-bc1cb393b961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:08.894108 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fadb-86b2-4ba5-98cb-bc1cb393b961 admin admin] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:08.894464 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fadb-86b2-4ba5-98cb-bc1cb393b961 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:08.894833 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fadb-86b2-4ba5-98cb-bc1cb393b961 admin admin] PATH_INFO: `/v3/users` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:08.895497 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6fadb-86b2-4ba5-98cb-bc1cb393b961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:08.897470 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6fadb-86b2-4ba5-98cb-bc1cb393b961 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:08.924224 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4535/9085] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Oct 8 22:14:08 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 22:14:08.925532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653cad8-fcbb-40bb-9d0d-9f5ed21e1850 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:08.936903 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653cad8-fcbb-40bb-9d0d-9f5ed21e1850 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:08.941973 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922553d-9c5c-4a54-8392-bd7e130068fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:08.942592 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922553d-9c5c-4a54-8392-bd7e130068fd admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:08.942874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922553d-9c5c-4a54-8392-bd7e130068fd admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:08.943150 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922553d-9c5c-4a54-8392-bd7e130068fd admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:08.943798 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922553d-9c5c-4a54-8392-bd7e130068fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:08.945433 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922553d-9c5c-4a54-8392-bd7e130068fd admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:08.956877 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4551/9086] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 22:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 22:14:08.961097 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fadb-86b2-4ba5-98cb-bc1cb393b961 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:08.971698 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fadb-86b2-4ba5-98cb-bc1cb393b961 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:08.976480 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879c117-e2d8-4e3d-a517-80536cdd75d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:08.977692 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879c117-e2d8-4e3d-a517-80536cdd75d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:08.977976 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879c117-e2d8-4e3d-a517-80536cdd75d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:08.978254 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879c117-e2d8-4e3d-a517-80536cdd75d6 admin admin] PATH_INFO: `/v3/projects/f735e0c6a71b4354b4eb945075d13798/users/f53ce416c1b2455f9cfb1fcb6cc12fb2/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:08.994693 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879c117-e2d8-4e3d-a517-80536cdd75d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f735e0c6a71b4354b4eb945075d13798, user_id=f53ce416c1b2455f9cfb1fcb6cc12fb2, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:08.997417 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879c117-e2d8-4e3d-a517-80536cdd75d6 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:09.011360 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4536/9087] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 22:14:08 2022] PUT /identity/v3/projects/f735e0c6a71b4354b4eb945075d13798/users/f53ce416c1b2455f9cfb1fcb6cc12fb2/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:14:09.015513 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922553d-9c5c-4a54-8392-bd7e130068fd admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:09.044145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922553d-9c5c-4a54-8392-bd7e130068fd admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:09.112021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c425cb7-5cef-45aa-92c0-269017d8309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:09.112661 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c425cb7-5cef-45aa-92c0-269017d8309d admin admin] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:09.112946 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c425cb7-5cef-45aa-92c0-269017d8309d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:09.113248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c425cb7-5cef-45aa-92c0-269017d8309d admin admin] PATH_INFO: `/v3/roles` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:09.113899 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c425cb7-5cef-45aa-92c0-269017d8309d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:09.115522 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c425cb7-5cef-45aa-92c0-269017d8309d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:09.126862 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4552/9088] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 22:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 22:14:09.131060 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879c117-e2d8-4e3d-a517-80536cdd75d6 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:09.142091 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879c117-e2d8-4e3d-a517-80536cdd75d6 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:09.147093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffe7d5-6b8d-4f69-98bf-14a848b30b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:09.147798 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffe7d5-6b8d-4f69-98bf-14a848b30b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:09.148076 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffe7d5-6b8d-4f69-98bf-14a848b30b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:09.148374 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffe7d5-6b8d-4f69-98bf-14a848b30b03 admin admin] PATH_INFO: `/v3/projects/f735e0c6a71b4354b4eb945075d13798/users/f53ce416c1b2455f9cfb1fcb6cc12fb2/roles/a409f81bd5744563a303a825783bed61` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:09.151104 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffe7d5-6b8d-4f69-98bf-14a848b30b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f735e0c6a71b4354b4eb945075d13798, user_id=f53ce416c1b2455f9cfb1fcb6cc12fb2, role_id=a409f81bd5744563a303a825783bed61)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:09.153792 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffe7d5-6b8d-4f69-98bf-14a848b30b03 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:09.168690 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4537/9089] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Oct 8 22:14:09 2022] PUT /identity/v3/projects/f735e0c6a71b4354b4eb945075d13798/users/f53ce416c1b2455f9cfb1fcb6cc12fb2/roles/a409f81bd5744563a303a825783bed61 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:14:13.620138 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de576abb-1320-4aa9-a728-0e467a9904d5 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:13.620651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de576abb-1320-4aa9-a728-0e467a9904d5 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:13.620737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de576abb-1320-4aa9-a728-0e467a9904d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:13.649730 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-de576abb-1320-4aa9-a728-0e467a9904d5 None None] MFA Rules not processed for user `f53ce416c1b2455f9cfb1fcb6cc12fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:14:13.651018 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-de576abb-1320-4aa9-a728-0e467a9904d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:13.730870 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4553/9090] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:14:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:14:13.748738 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffe7d5-6b8d-4f69-98bf-14a848b30b03 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:13.751872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-d1ffe7d5-6b8d-4f69-98bf-14a848b30b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:13.840865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffe7d5-6b8d-4f69-98bf-14a848b30b03 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:13.846450 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bb7c8-ff0f-49d9-a103-c9d1915b004c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:13.847069 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bb7c8-ff0f-49d9-a103-c9d1915b004c service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:13.847371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bb7c8-ff0f-49d9-a103-c9d1915b004c service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:13.847642 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bb7c8-ff0f-49d9-a103-c9d1915b004c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:13.948445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bb7c8-ff0f-49d9-a103-c9d1915b004c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:13.950215 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bb7c8-ff0f-49d9-a103-c9d1915b004c service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:13.959778 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4538/9091] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:14:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:14:15.056990 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1ca70-3c83-4a45-8f52-5769ab74676c None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:15.057484 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1ca70-3c83-4a45-8f52-5769ab74676c None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:15.057599 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1ca70-3c83-4a45-8f52-5769ab74676c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:15.078152 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-efb1ca70-3c83-4a45-8f52-5769ab74676c None None] MFA Rules not processed for user `a42e32e56dd84caab93645385e5a1493`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:14:15.079805 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-efb1ca70-3c83-4a45-8f52-5769ab74676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:15.093153 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4554/9092] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:14:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:14:15.426292 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bb7c8-ff0f-49d9-a103-c9d1915b004c service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:15.452645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:15.488224 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bb7c8-ff0f-49d9-a103-c9d1915b004c service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:15.493476 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae43ad-d0f6-4ad3-bc5c-8a0e46aedca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:15.494093 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae43ad-d0f6-4ad3-bc5c-8a0e46aedca7 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:15.494373 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae43ad-d0f6-4ad3-bc5c-8a0e46aedca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:15.494644 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae43ad-d0f6-4ad3-bc5c-8a0e46aedca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:15.496366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8dae43ad-d0f6-4ad3-bc5c-8a0e46aedca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:15.506654 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae43ad-d0f6-4ad3-bc5c-8a0e46aedca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:15.508618 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae43ad-d0f6-4ad3-bc5c-8a0e46aedca7 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:15.516702 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4539/9093] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:14:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:14:15.874644 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1ca70-3c83-4a45-8f52-5769ab74676c None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:15.876143 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-efb1ca70-3c83-4a45-8f52-5769ab74676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:15.938159 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:15.954193 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1ca70-3c83-4a45-8f52-5769ab74676c None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:15.959355 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce92b66-c12b-4c55-bdc2-79a210bdfa2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:15.959972 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce92b66-c12b-4c55-bdc2-79a210bdfa2d service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:15.960256 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce92b66-c12b-4c55-bdc2-79a210bdfa2d service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:15.960532 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce92b66-c12b-4c55-bdc2-79a210bdfa2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:15.962861 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2ce92b66-c12b-4c55-bdc2-79a210bdfa2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:15.975043 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce92b66-c12b-4c55-bdc2-79a210bdfa2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:15.976721 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce92b66-c12b-4c55-bdc2-79a210bdfa2d service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:15.988607 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4555/9094] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:14:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:14:18.294630 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae43ad-d0f6-4ad3-bc5c-8a0e46aedca7 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:18.298548 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8dae43ad-d0f6-4ad3-bc5c-8a0e46aedca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:18.310460 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae43ad-d0f6-4ad3-bc5c-8a0e46aedca7 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:18.314197 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602d93c-f5ad-4372-b267-b58f8da5c116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:18.314809 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602d93c-f5ad-4372-b267-b58f8da5c116 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:18.315085 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602d93c-f5ad-4372-b267-b58f8da5c116 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:18.315356 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602d93c-f5ad-4372-b267-b58f8da5c116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:18.317103 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-1602d93c-f5ad-4372-b267-b58f8da5c116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:18.327761 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602d93c-f5ad-4372-b267-b58f8da5c116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:18.329158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602d93c-f5ad-4372-b267-b58f8da5c116 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:18.337058 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4540/9095] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:14:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:14:24.452477 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce92b66-c12b-4c55-bdc2-79a210bdfa2d service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:24.453896 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-2ce92b66-c12b-4c55-bdc2-79a210bdfa2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:24.469631 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce92b66-c12b-4c55-bdc2-79a210bdfa2d service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:24.480092 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd83e1f-d8c3-49b6-bf4e-ad17a071bf68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:24.480737 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd83e1f-d8c3-49b6-bf4e-ad17a071bf68 service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:24.481026 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd83e1f-d8c3-49b6-bf4e-ad17a071bf68 service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:24.481367 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd83e1f-d8c3-49b6-bf4e-ad17a071bf68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:24.483230 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-dfd83e1f-d8c3-49b6-bf4e-ad17a071bf68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:14:24.501106 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd83e1f-d8c3-49b6-bf4e-ad17a071bf68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:24.502772 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd83e1f-d8c3-49b6-bf4e-ad17a071bf68 service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:24.514493 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4556/9096] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:14:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:14:26.796609 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602d93c-f5ad-4372-b267-b58f8da5c116 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:14:26.805158 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602d93c-f5ad-4372-b267-b58f8da5c116 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:14:26.808804 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f0845-2683-4586-b6c2-ba9d05d34732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:14:26.809500 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f0845-2683-4586-b6c2-ba9d05d34732 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:14:26.809781 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f0845-2683-4586-b6c2-ba9d05d34732 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:14:26.810052 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f0845-2683-4586-b6c2-ba9d05d34732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:14:26.818880 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f0845-2683-4586-b6c2-ba9d05d34732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:14:26.820783 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f0845-2683-4586-b6c2-ba9d05d34732 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:14:26.830187 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4541/9097] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:14:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:14:34.509625 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=12 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:36.826136 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=28 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:16:30.544761 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76e8b-7f59-4973-9b07-f4168ffda287 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:16:30.545288 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76e8b-7f59-4973-9b07-f4168ffda287 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:16:30.545395 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76e8b-7f59-4973-9b07-f4168ffda287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:16:30.565036 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a4c76e8b-7f59-4973-9b07-f4168ffda287 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:16:30.566273 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a4c76e8b-7f59-4973-9b07-f4168ffda287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:16:30.627024 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4557/9098] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 22:16:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:16:30.672502 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f0845-2683-4586-b6c2-ba9d05d34732 service neutron] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:16:30.673970 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-cd0f0845-2683-4586-b6c2-ba9d05d34732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:16:30.741681 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f0845-2683-4586-b6c2-ba9d05d34732 service neutron] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:16:30.747264 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29cff7-fdac-4ae3-8913-16fa6daed47d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:16:30.747865 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29cff7-fdac-4ae3-8913-16fa6daed47d service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:16:30.748144 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29cff7-fdac-4ae3-8913-16fa6daed47d service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:16:30.748420 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29cff7-fdac-4ae3-8913-16fa6daed47d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:16:30.756475 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29cff7-fdac-4ae3-8913-16fa6daed47d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:16:30.758068 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29cff7-fdac-4ae3-8913-16fa6daed47d service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:16:30.766086 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4542/9099] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 22:16:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 22:16:39.823871 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c53a00-ce87-44b2-b783-182ad33c27f1 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:16:39.824335 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c53a00-ce87-44b2-b783-182ad33c27f1 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:16:39.824438 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c53a00-ce87-44b2-b783-182ad33c27f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:16:39.843205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-02c53a00-ce87-44b2-b783-182ad33c27f1 None None] MFA Rules not processed for user `a42e32e56dd84caab93645385e5a1493`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:16:39.844396 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-02c53a00-ce87-44b2-b783-182ad33c27f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:16:39.851269 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4558/9100] 10.222.0.26 () {58 vars in 958 bytes} [Sat Oct 8 22:16:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:16:40.170613 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29cff7-fdac-4ae3-8913-16fa6daed47d service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:16:40.189369 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29cff7-fdac-4ae3-8913-16fa6daed47d service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:16:40.193040 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cccbae-5fa1-4ea2-ba3a-d55a4f0bd6c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:16:40.193680 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cccbae-5fa1-4ea2-ba3a-d55a4f0bd6c3 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:16:40.193960 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cccbae-5fa1-4ea2-ba3a-d55a4f0bd6c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:16:40.194235 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cccbae-5fa1-4ea2-ba3a-d55a4f0bd6c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:16:40.195943 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b8cccbae-5fa1-4ea2-ba3a-d55a4f0bd6c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:16:40.205493 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cccbae-5fa1-4ea2-ba3a-d55a4f0bd6c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:16:40.206894 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cccbae-5fa1-4ea2-ba3a-d55a4f0bd6c3 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:16:40.215220 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4543/9101] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:16:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:16:40.547471 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c53a00-ce87-44b2-b783-182ad33c27f1 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:16:40.559066 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c53a00-ce87-44b2-b783-182ad33c27f1 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:16:40.564023 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59694d2-28d3-4698-b2df-e20592d9aff6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:16:40.564553 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59694d2-28d3-4698-b2df-e20592d9aff6 service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:16:40.564829 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59694d2-28d3-4698-b2df-e20592d9aff6 service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:16:40.565098 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59694d2-28d3-4698-b2df-e20592d9aff6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:16:40.567000 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-c59694d2-28d3-4698-b2df-e20592d9aff6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:16:40.593180 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59694d2-28d3-4698-b2df-e20592d9aff6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:16:40.594791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59694d2-28d3-4698-b2df-e20592d9aff6 service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:16:40.605086 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4559/9102] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:16:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:16:41.910092 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b502731-6481-4aee-88df-aec6275bf76c None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:16:41.910629 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b502731-6481-4aee-88df-aec6275bf76c None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:16:41.910836 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b502731-6481-4aee-88df-aec6275bf76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:16:41.931509 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-8b502731-6481-4aee-88df-aec6275bf76c None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:16:41.932754 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-8b502731-6481-4aee-88df-aec6275bf76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:16:41.940016 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4544/9103] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 22:16:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:16:41.951956 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59694d2-28d3-4698-b2df-e20592d9aff6 service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:16:41.964902 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59694d2-28d3-4698-b2df-e20592d9aff6 service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:16:41.969980 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b9f87-2823-4715-9bf5-d7fe5b6fa41f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:16:41.970573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b9f87-2823-4715-9bf5-d7fe5b6fa41f service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:16:41.971015 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b9f87-2823-4715-9bf5-d7fe5b6fa41f service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:16:41.971287 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b9f87-2823-4715-9bf5-d7fe5b6fa41f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:16:41.980448 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b9f87-2823-4715-9bf5-d7fe5b6fa41f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:16:41.982076 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b9f87-2823-4715-9bf5-d7fe5b6fa41f service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:16:41.996696 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4560/9104] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 22:16:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 22:16:51.925721 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=45 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:16:51.990999 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=48 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:16:53.259027 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b502731-6481-4aee-88df-aec6275bf76c None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:16:53.288799 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b502731-6481-4aee-88df-aec6275bf76c None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:16:53.296459 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babda55-2cae-4c00-897a-02c483dc15f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:16:53.297174 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babda55-2cae-4c00-897a-02c483dc15f7 service nova] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:16:53.297586 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babda55-2cae-4c00-897a-02c483dc15f7 service nova] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:16:53.297934 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babda55-2cae-4c00-897a-02c483dc15f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:16:53.303044 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7babda55-2cae-4c00-897a-02c483dc15f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:16:53.330552 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babda55-2cae-4c00-897a-02c483dc15f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:16:53.332314 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babda55-2cae-4c00-897a-02c483dc15f7 service nova] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:16:53.343931 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4545/9105] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:16:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:17:03.338958 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=15 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:17:51.154853 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b9f87-2823-4715-9bf5-d7fe5b6fa41f service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:17:51.164459 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b9f87-2823-4715-9bf5-d7fe5b6fa41f service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:17:51.168223 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a48944-0b9c-45a8-8a11-e2ef2d0df9ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:17:51.168840 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48944-0b9c-45a8-8a11-e2ef2d0df9ea service neutron] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:17:51.169133 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48944-0b9c-45a8-8a11-e2ef2d0df9ea service neutron] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:17:51.169411 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48944-0b9c-45a8-8a11-e2ef2d0df9ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:17:51.171651 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-57a48944-0b9c-45a8-8a11-e2ef2d0df9ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:17:51.180789 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a48944-0b9c-45a8-8a11-e2ef2d0df9ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:17:51.182229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a48944-0b9c-45a8-8a11-e2ef2d0df9ea service neutron] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:17:51.192054 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4561/9106] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:17:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:18:01.188568 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=6 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:18:30.335643 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babda55-2cae-4c00-897a-02c483dc15f7 service nova] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:18:30.337024 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-7babda55-2cae-4c00-897a-02c483dc15f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:18:30.412021 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babda55-2cae-4c00-897a-02c483dc15f7 service nova] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:18:30.415852 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1fb0a-dde2-4979-9939-3056fa86a6a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d82a39388514ff79b2235ff2ede6ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:18:30.416454 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1fb0a-dde2-4979-9939-3056fa86a6a0 service glance] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:30.416731 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1fb0a-dde2-4979-9939-3056fa86a6a0 service glance] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:30.417020 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1fb0a-dde2-4979-9939-3056fa86a6a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:30.418724 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-dda1fb0a-dde2-4979-9939-3056fa86a6a0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:18:30.445782 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1fb0a-dde2-4979-9939-3056fa86a6a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:18:30.447187 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1fb0a-dde2-4979-9939-3056fa86a6a0 service glance] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:18:30.458903 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4546/9107] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:18:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:18:33.583021 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964268a-f57e-41e1-ab49-bb6611160a99 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:33.583573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964268a-f57e-41e1-ab49-bb6611160a99 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:33.583573 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964268a-f57e-41e1-ab49-bb6611160a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:33.651401 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-a964268a-f57e-41e1-ab49-bb6611160a99 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:18:33.652633 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-a964268a-f57e-41e1-ab49-bb6611160a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:18:33.679584 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4562/9108] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Oct 8 22:18:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:18:33.721062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1fb0a-dde2-4979-9939-3056fa86a6a0 service glance] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:18:33.749684 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1fb0a-dde2-4979-9939-3056fa86a6a0 service glance] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:18:33.754716 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db234a9-9c43-4062-bff2-cdcb08182028 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:18:33.755316 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db234a9-9c43-4062-bff2-cdcb08182028 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:33.755598 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db234a9-9c43-4062-bff2-cdcb08182028 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:33.755872 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db234a9-9c43-4062-bff2-cdcb08182028 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:33.763863 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db234a9-9c43-4062-bff2-cdcb08182028 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:18:33.766062 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db234a9-9c43-4062-bff2-cdcb08182028 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:18:33.774144 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4547/9109] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 22:18:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 22:18:43.032025 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa982c43-77e7-47ec-972b-757ed4cd6c82 None None] REQUEST_METHOD: `POST` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:43.032554 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa982c43-77e7-47ec-972b-757ed4cd6c82 None None] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:43.032646 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa982c43-77e7-47ec-972b-757ed4cd6c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:43.052810 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.auth.core [None req-fa982c43-77e7-47ec-972b-757ed4cd6c82 None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:18:43.061884 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-fa982c43-77e7-47ec-972b-757ed4cd6c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:18:43.081767 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4563/9110] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 22:18:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:18:43.095407 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db234a9-9c43-4062-bff2-cdcb08182028 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:18:43.117111 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db234a9-9c43-4062-bff2-cdcb08182028 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:18:43.122277 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0137e6-d0d5-45d8-b78e-302ddf7e1fe2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:18:43.122883 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0137e6-d0d5-45d8-b78e-302ddf7e1fe2 service swift] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:43.123164 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0137e6-d0d5-45d8-b78e-302ddf7e1fe2 service swift] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:43.123437 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0137e6-d0d5-45d8-b78e-302ddf7e1fe2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:43.131696 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0137e6-d0d5-45d8-b78e-302ddf7e1fe2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:18:43.133325 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0137e6-d0d5-45d8-b78e-302ddf7e1fe2 service swift] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:18:43.141616 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4548/9111] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 22:18:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 22:18:44.260809 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa982c43-77e7-47ec-972b-757ed4cd6c82 None None] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:18:44.273944 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa982c43-77e7-47ec-972b-757ed4cd6c82 None None] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:18:44.282680 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb66f28-ec6d-4c45-bc40-cdc938553d6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187d6f51b1604327a4879e9e19b47963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:18:44.283352 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb66f28-ec6d-4c45-bc40-cdc938553d6f service nova] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:44.283912 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb66f28-ec6d-4c45-bc40-cdc938553d6f service nova] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:44.284199 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb66f28-ec6d-4c45-bc40-cdc938553d6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:44.288075 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-bbb66f28-ec6d-4c45-bc40-cdc938553d6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:18:44.302176 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb66f28-ec6d-4c45-bc40-cdc938553d6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:18:44.303911 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb66f28-ec6d-4c45-bc40-cdc938553d6f service nova] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:18:44.316113 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4564/9112] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:18:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 22:18:44.457849 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0137e6-d0d5-45d8-b78e-302ddf7e1fe2 service swift] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:18:44.467975 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0137e6-d0d5-45d8-b78e-302ddf7e1fe2 service swift] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:18:44.471601 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43347c4a-80b7-4799-8eb8-2d6947fe37b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32932449fed540ac9073f056065899bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:18:44.472249 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43347c4a-80b7-4799-8eb8-2d6947fe37b3 service neutron] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:44.472530 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43347c4a-80b7-4799-8eb8-2d6947fe37b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:44.472802 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43347c4a-80b7-4799-8eb8-2d6947fe37b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:44.474658 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-43347c4a-80b7-4799-8eb8-2d6947fe37b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:18:44.490725 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43347c4a-80b7-4799-8eb8-2d6947fe37b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:18:44.492170 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43347c4a-80b7-4799-8eb8-2d6947fe37b3 service neutron] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:18:44.504107 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4549/9113] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:18:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:18:46.571614 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb66f28-ec6d-4c45-bc40-cdc938553d6f service nova] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:18:46.595866 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb66f28-ec6d-4c45-bc40-cdc938553d6f service nova] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:18:46.601224 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cbe96-87d8-4ec1-8a57-90052a91253b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:18:46.601835 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cbe96-87d8-4ec1-8a57-90052a91253b service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:46.602145 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cbe96-87d8-4ec1-8a57-90052a91253b service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:46.602458 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cbe96-87d8-4ec1-8a57-90052a91253b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:46.604229 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-4f8cbe96-87d8-4ec1-8a57-90052a91253b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:18:46.616574 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cbe96-87d8-4ec1-8a57-90052a91253b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:18:46.618197 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cbe96-87d8-4ec1-8a57-90052a91253b service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:18:46.629291 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4565/9114] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:18:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:18:48.016607 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d8782-e9e1-4c6e-9d11-d82187f993cd None None] REQUEST_METHOD: `POST` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:48.017049 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d8782-e9e1-4c6e-9d11-d82187f993cd None None] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:48.017391 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d8782-e9e1-4c6e-9d11-d82187f993cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:48.038790 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.auth.core [None req-127d8782-e9e1-4c6e-9d11-d82187f993cd None None] MFA Rules not processed for user `5a6d89a355d4415a95913449481b3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=99085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 22:18:48.039997 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-127d8782-e9e1-4c6e-9d11-d82187f993cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:18:48.047283 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4550/9115] 10.222.0.26 () {58 vars in 967 bytes} [Sat Oct 8 22:18:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 22:18:48.059175 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cbe96-87d8-4ec1-8a57-90052a91253b service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:18:48.071961 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cbe96-87d8-4ec1-8a57-90052a91253b service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:18:48.077503 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea0a4c-bd79-4622-97bb-aa6097ca4729 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd5adc10b4344e1847c23c2c0599e59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:18:48.078097 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea0a4c-bd79-4622-97bb-aa6097ca4729 service swift] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:48.078377 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea0a4c-bd79-4622-97bb-aa6097ca4729 service swift] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:48.078653 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea0a4c-bd79-4622-97bb-aa6097ca4729 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:48.086594 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea0a4c-bd79-4622-97bb-aa6097ca4729 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:18:48.088151 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea0a4c-bd79-4622-97bb-aa6097ca4729 service swift] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:18:48.096664 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4566/9116] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Oct 8 22:18:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 22:18:51.801867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d8782-e9e1-4c6e-9d11-d82187f993cd None None] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:18:51.814775 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d8782-e9e1-4c6e-9d11-d82187f993cd None None] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:18:51.819772 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed62776-7c30-4b1a-af6c-d9d061c82c69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:18:51.820371 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed62776-7c30-4b1a-af6c-d9d061c82c69 service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:51.820645 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed62776-7c30-4b1a-af6c-d9d061c82c69 service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:51.820918 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed62776-7c30-4b1a-af6c-d9d061c82c69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:51.822649 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-6ed62776-7c30-4b1a-af6c-d9d061c82c69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:18:51.834349 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed62776-7c30-4b1a-af6c-d9d061c82c69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:18:51.835935 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed62776-7c30-4b1a-af6c-d9d061c82c69 service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:18:51.845902 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4551/9117] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:18:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:18:56.323188 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea0a4c-bd79-4622-97bb-aa6097ca4729 service swift] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:18:56.324764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-03ea0a4c-bd79-4622-97bb-aa6097ca4729 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:18:56.351141 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea0a4c-bd79-4622-97bb-aa6097ca4729 service swift] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:18:56.356791 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdca10-f689-48b3-805b-a564d7f73eae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:18:56.357933 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdca10-f689-48b3-805b-a564d7f73eae service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:56.358225 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdca10-f689-48b3-805b-a564d7f73eae service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:56.358499 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdca10-f689-48b3-805b-a564d7f73eae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:56.360236 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-65fdca10-f689-48b3-805b-a564d7f73eae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:18:56.377121 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdca10-f689-48b3-805b-a564d7f73eae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:18:56.378874 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdca10-f689-48b3-805b-a564d7f73eae service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:18:56.390122 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4567/9118] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:18:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:18:59.303499 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed62776-7c30-4b1a-af6c-d9d061c82c69 service placement] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:18:59.308962 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=81 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:18:59.375389 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed62776-7c30-4b1a-af6c-d9d061c82c69 service placement] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:18:59.380057 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:18:59.380703 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:59.380980 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:59.381284 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] PATH_INFO: `/v3/users/a42e32e56dd84caab93645385e5a1493` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:59.382566 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42e32e56dd84caab93645385e5a1493)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:18:59.384689 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:18:59.434384 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42e32e56dd84caab93645385e5a1493'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.441777 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42e32e56dd84caab93645385e5a1493'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.442439 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42e32e56dd84caab93645385e5a1493'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.443072 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42e32e56dd84caab93645385e5a1493'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.455838 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42e32e56dd84caab93645385e5a1493'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.468232 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4552/9119] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 22:18:59 2022] DELETE /identity/v3/users/a42e32e56dd84caab93645385e5a1493 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:18:59.646856 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdca10-f689-48b3-805b-a564d7f73eae service placement] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:18:59.659203 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdca10-f689-48b3-805b-a564d7f73eae service placement] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:18:59.718214 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:18:59.718771 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:59.719051 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:59.719325 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] PATH_INFO: `/v3/projects/00e9fa73af9541119afd5edb5d180e58` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:59.720428 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e9fa73af9541119afd5edb5d180e58)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:18:59.722346 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:18:59.739094 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=100 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:18:59.769033 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e9fa73af9541119afd5edb5d180e58', 'request_id': 'req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.776248 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e9fa73af9541119afd5edb5d180e58', 'request_id': 'req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.782475 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e9fa73af9541119afd5edb5d180e58', 'request_id': 'req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.793470 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] The token cache is being invalidate because project 00e9fa73af9541119afd5edb5d180e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 22:18:59.793764 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.794417 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.795896 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4568/9120] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 22:18:59 2022] DELETE /identity/v3/projects/00e9fa73af9541119afd5edb5d180e58 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:18:59.799933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:18:59.801366 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:18:59.814412 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9310-0626-412e-9af0-9421fe51d190 admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:18:59.871519 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:18:59.872312 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:18:59.872592 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:18:59.872867 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] PATH_INFO: `/v3/users/f53ce416c1b2455f9cfb1fcb6cc12fb2` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:18:59.874058 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f53ce416c1b2455f9cfb1fcb6cc12fb2)` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:18:59.876026 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:18:59.898933 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:18:59.926341 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f53ce416c1b2455f9cfb1fcb6cc12fb2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.933486 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f53ce416c1b2455f9cfb1fcb6cc12fb2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.934157 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f53ce416c1b2455f9cfb1fcb6cc12fb2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.934771 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f53ce416c1b2455f9cfb1fcb6cc12fb2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.947070 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.notifications [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f53ce416c1b2455f9cfb1fcb6cc12fb2'} {{(pid=99085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:18:59.959802 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4553/9121] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 22:18:59 2022] DELETE /identity/v3/users/f53ce416c1b2455f9cfb1fcb6cc12fb2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:19:00.130677 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:19:00.132184 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:19:00.145802 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f4c6d-733e-4974-91f2-6f15c96a7b9d admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:19:00.206697 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e50d0928e4f92987cd089e6138f36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbdca763b15498ebcee722600237097', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:19:00.207328 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:19:00.207608 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:19:00.207878 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] PATH_INFO: `/v3/projects/f735e0c6a71b4354b4eb945075d13798` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:19:00.209296 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f735e0c6a71b4354b4eb945075d13798)` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:19:00.211205 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:19:00.257253 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f735e0c6a71b4354b4eb945075d13798', 'request_id': 'req-cbee2cfa-cccd-4ce8-895f-8ef04c750437'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:19:00.264960 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f735e0c6a71b4354b4eb945075d13798', 'request_id': 'req-cbee2cfa-cccd-4ce8-895f-8ef04c750437'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:19:00.270619 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f735e0c6a71b4354b4eb945075d13798', 'request_id': 'req-cbee2cfa-cccd-4ce8-895f-8ef04c750437'} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:19:00.281596 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] The token cache is being invalidate because project f735e0c6a71b4354b4eb945075d13798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 22:19:00.281891 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:19:00.282552 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.notifications [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 22:19:00.284032 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4569/9122] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 22:19:00 2022] DELETE /identity/v3/projects/f735e0c6a71b4354b4eb945075d13798 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 22:19:09.956317 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=20,keystone:DELETE=6,keystone:INSERT=1 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:19:10.278593 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:23:51.355940 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] Authenticating user token {{(pid=99085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:23:51.357397 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:23:51.434116 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ab58d-812e-42f8-a6d3-3caab7449e6a admin admin] Validating token access rules against request {{(pid=99085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:23:51.493549 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372b3e9-ca51-4bc7-a77f-c52f05d162de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:23:51.494163 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372b3e9-ca51-4bc7-a77f-c52f05d162de service placement] REQUEST_METHOD: `GET` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:23:51.494446 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372b3e9-ca51-4bc7-a77f-c52f05d162de service placement] SCRIPT_NAME: `/identity` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:23:51.494728 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372b3e9-ca51-4bc7-a77f-c52f05d162de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:23:51.497272 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.fernet_utils [None req-b372b3e9-ca51-4bc7-a77f-c52f05d162de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:23:51.509122 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372b3e9-ca51-4bc7-a77f-c52f05d162de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:23:51.510746 ncdv-master-1 devstack@keystone.service[99085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372b3e9-ca51-4bc7-a77f-c52f05d162de service placement] RBAC: Authorization granted {{(pid=99085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:23:51.520550 ncdv-master-1 devstack@keystone.service[99085]: [pid: 99085|app: 0|req: 4554/9123] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:23:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:23:54.673371 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] Authenticating user token {{(pid=99084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 22:23:54.674759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:23:54.695854 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee2cfa-cccd-4ce8-895f-8ef04c750437 admin admin] Validating token access rules against request {{(pid=99084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 22:23:54.701310 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4801c4-0344-42be-ae5a-c8a7d4b1baad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc47f2448a042fca1a986695a350c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 22:23:54.701906 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4801c4-0344-42be-ae5a-c8a7d4b1baad service placement] REQUEST_METHOD: `GET` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 22:23:54.702179 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4801c4-0344-42be-ae5a-c8a7d4b1baad service placement] SCRIPT_NAME: `/identity` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 22:23:54.702446 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4801c4-0344-42be-ae5a-c8a7d4b1baad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 22:23:54.704109 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.fernet_utils [None req-db4801c4-0344-42be-ae5a-c8a7d4b1baad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 22:23:54.715711 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4801c4-0344-42be-ae5a-c8a7d4b1baad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 22:23:54.717294 ncdv-master-1 devstack@keystone.service[99084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4801c4-0344-42be-ae5a-c8a7d4b1baad service placement] RBAC: Authorization granted {{(pid=99084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 22:23:54.726836 ncdv-master-1 devstack@keystone.service[99084]: [pid: 99084|app: 0|req: 4570/9124] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Oct 8 22:23:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 22:24:01.516445 ncdv-master-1 devstack@keystone.service[99085]: DEBUG dbcounter [-] [99085] Writing DB stats keystone:SELECT=61 {{(pid=99085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:24:04.722759 ncdv-master-1 devstack@keystone.service[99084]: DEBUG dbcounter [-] [99084] Writing DB stats keystone:SELECT=9 {{(pid=99084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}